ppef 1.1.0 → 1.2.1

package/README.md

@@ -2,16 +2,18 @@
 
 A claim-driven, deterministic evaluation framework for experiments. PPEF provides a structured approach to testing and validating software components through reusable test cases, statistical aggregation, and claim-based evaluation.
 
+Published npm package with dual ESM/CJS output. Single runtime dependency: `commander`.
+
 ## Features
 
-- **Core**: Type-safe foundation with zero external dependencies
-- **Store**: Centralized registry for Systems Under Test (SUTs)
-- **Case**: Reusable test case infrastructure with setup/teardown
-- **Execute**: Deterministic test execution with snapshot capture
-- **Aggregate**: Statistical aggregation across test runs (mean, median, mode, min, max, stdDev)
-- **Evaluate**: Claim-driven validation with custom predicates
-- **Render**: Report generation in multiple formats (console, Markdown, JSON)
-- **Monitor**: Built-in memory and CPU monitoring for resource tracking
+- **Type-safe**: Strict TypeScript with generic SUT, Case, and Evaluator abstractions
+- **Registry**: Centralized registries for Systems Under Test (SUTs) and evaluation cases with role/tag filtering
+- **Execution**: Deterministic execution with worker threads, checkpointing, memory monitoring, and binary SUT support
+- **Statistical**: Mann-Whitney U test, Cohen's d, confidence intervals
+- **Aggregation**: Summary stats, pairwise comparisons, and rankings across runs
+- **Evaluation**: Four built-in evaluators — claims, robustness, metrics, and exploratory
+- **Rendering**: LaTeX table generation for thesis integration
+- **CLI**: Five commands for running, validating, planning, aggregating, and evaluating experiments
 
 ## Installation
 
@@ -20,153 +22,102 @@ A claim-driven, deterministic evaluation framework for experiments. PPEF provide
 pnpm add ppef
 
 # Or use locally for development
-git clone <repository-url>
+git clone https://github.com/Mearman/ppef.git
 cd ppef
 pnpm install
 pnpm build
 ```
 
-## Quick Start
+## Development
 
-```typescript
-import { Store, Case, Execute, Aggregate, Evaluate, Render } from 'ppef';
-
-// 1. Register your System Under Test (SUT)
-Store.register('sort-algo', {
-  name: 'QuickSort',
-  execute: (input: number[]) => input.sort((a, b) => a - b)
-});
-
-// 2. Define test cases
-const ascendingCase = new Case({
-  name: 'ascending-order',
-  setup: () => [1, 2, 3, 4, 5],
-  teardown: (result) => console.log('Result:', result)
-});
-
-const descendingCase = new Case({
-  name: 'descending-order',
-  setup: () => [5, 4, 3, 2, 1],
-  teardown: (result) => console.log('Result:', result)
-});
-
-// 3. Execute tests
-const results = Execute.run('sort-algo', [ascendingCase, descendingCase]);
-
-// 4. Aggregate metrics across multiple runs
-const aggregated = Aggregate.mean(results);
-
-// 5. Evaluate claims
-const claims = Evaluate.claims(aggregated, {
-  'always-sorted': (result) => {
-    const arr = result.output;
-    for (let i = 0; i < arr.length - 1; i++) {
-      if (arr[i] > arr[i + 1]) return false;
-    }
-    return true;
-  }
-});
-
-// 6. Render reports
-Render.console(claims);
-Render.markdown(claims, './results.md');
-Render.json(claims, './results.json');
+```bash
+pnpm install              # Install dependencies
+pnpm build                # TypeScript compile + CJS wrapper generation
+pnpm typecheck            # Type-check only (tsc --noEmit)
+pnpm lint                 # ESLint + Prettier with auto-fix
+pnpm test                 # Run all tests with coverage (c8 + tsx + Node native test runner)
 ```
 
-## Modules
+Run a single test file:
+```bash
+npx tsx --test src/path/to/file.test.ts
+```
 
-### Core
-Type-safe foundation providing primitive types and interfaces. Zero external dependencies - pure TypeScript utilities for the entire framework.
+CLI (after build):
+```bash
+ppef run          # Execute experiments
+ppef validate     # Validate configuration
+ppef plan         # Dry-run execution plan
+ppef aggregate    # Post-process results
+ppef evaluate     # Run evaluators on results
+```
 
-### Store
-Centralized registry for managing Systems Under Test (SUTs). Register implementations with unique identifiers and retrieve them for execution.
+## Architecture
 
-```typescript
-Store.register('my-sut', {
-  name: 'My Implementation',
-  version: '1.0.0',
-  execute: (input) => { /* implementation */ }
-});
+### Data Flow Pipeline
 
-const sut = Store.get('my-sut');
 ```
-
-### Case
-Reusable test case infrastructure with lifecycle management. Each case includes setup, execution, and teardown phases with automatic resource cleanup.
-
-```typescript
-const testCase = new Case({
-  name: 'test-case-1',
-  setup: () => ({ data: [1, 2, 3] }),
-  teardown: (result) => console.log('Cleanup:', result)
-});
+SUTs + Cases (Registries)
+    → Executor (runs SUTs against cases, deterministic runIds)
+    → EvaluationResult (canonical schema)
+    → ResultCollector (validates + filters)
+    → Aggregation Pipeline (summary stats, comparisons, rankings)
+    → Evaluators (claims, robustness, metrics, exploratory)
+    → Renderers (LaTeX tables for thesis)
 ```
 
-### Execute
-Deterministic test execution engine. Runs SUTs against test cases and captures snapshots of inputs, outputs, and execution metadata.
+### Module Map (`src/`)
 
-```typescript
-const results = Execute.run('my-sut', [testCase]);
-const snapshot = Execute.capture('my-sut', testCase);
-```
+| Module | Purpose |
+|--------|---------|
+| `types/` | All canonical type definitions (result, sut, case, claims, evaluator, aggregate, perturbation) |
+| `registry/` | `SUTRegistry` and `CaseRegistry` — generic registries with role/tag filtering |
+| `executor/` | Orchestrator with worker threads, checkpointing, memory monitoring, binary SUT support |
+| `collector/` | Result aggregation and JSON schema validation |
+| `statistical/` | Mann-Whitney U test, Cohen's d, confidence intervals |
+| `aggregation/` | `computeSummaryStats()`, `computeComparison()`, `computeRankings()`, pipeline |
+| `evaluators/` | Four built-in evaluators + extensible registry (see below) |
+| `claims/` | Claim type definitions |
+| `robustness/` | Perturbation configs and robustness metric types |
+| `renderers/` | LaTeX table renderer |
+| `cli/` | Five commands with config loading, module loading, output writing |
 
-### Aggregate
-Statistical aggregation utilities for analyzing test results across multiple runs. Compute mean, median, mode, min, max, and standard deviation.
+### Key Abstractions
 
-```typescript
-const stats = Aggregate.mean(results);
-const median = Aggregate.median(results);
-const deviation = Aggregate.stdDev(results);
-```
+**SUT** (`SUT<TInputs, TResult>`): Generic System Under Test. Has `id`, `config`, and `run(inputs)`. Roles: `primary`, `baseline`, `oracle`.
 
-### Evaluate
-Claim-driven validation framework. Define custom predicates to validate test results against expected properties and behaviors.
+**CaseDefinition** (`CaseDefinition<TInput, TInputs>`): Two-phase resource factory — `getInput()` loads a resource once, `getInputs()` returns algorithm-specific inputs.
 
-```typescript
-const claims = Evaluate.claims(results, {
-  'performance': (r) => r.duration < 100,
-  'correctness': (r) => r.output === expected,
-  'memory-safe': (r) => r.memoryUsage < 1024 * 1024
-});
-```
+**Evaluator** (`Evaluator<TConfig, TInput, TOutput>`): Extensible evaluation with `validateConfig()`, `evaluate()`, `summarize()`. Four built-in types:
+- **ClaimsEvaluator** — tests explicit hypotheses with statistical significance
+- **RobustnessEvaluator** — sensitivity analysis under perturbations
+- **MetricsEvaluator** — multi-criterion threshold/baseline/target-range evaluation
+- **ExploratoryEvaluator** — hypothesis-free analysis (rankings, pairwise comparisons, correlations, case-class effects)
 
-### Render
-Multi-format report generation. Output results to console, Markdown files, or JSON for documentation and CI/CD integration.
+**EvaluationResult**: Canonical output schema capturing run identity (deterministic SHA-256 `runId`), correctness, metrics, output artefacts, and provenance.
 
-```typescript
-Render.console(results);
-Render.markdown(results, './report.md');
-Render.json(results, './report.json');
-```
+### Subpath Exports
 
-### Monitor
-Built-in resource tracking for performance profiling. Monitor memory usage and CPU consumption during test execution.
+Each module is independently importable:
 
 ```typescript
-const monitor = new Monitor();
-monitor.start();
-// ... run tests ...
-const metrics = monitor.stop();
-console.log('Memory used:', metrics.memoryUsage);
+import { SUTRegistry } from 'ppef/registry';
+import { EvaluationResult } from 'ppef/types';
+import { computeSummaryStats } from 'ppef/aggregation';
 ```
 
-## API Reference
+Available subpaths: `ppef/types`, `ppef/registry`, `ppef/executor`, `ppef/collector`, `ppef/statistical`, `ppef/aggregation`, `ppef/evaluators`, `ppef/claims`, `ppef/robustness`, `ppef/renderers`.
 
-Detailed type definitions and API documentation are available in the source files:
+## Conventions
 
-- `src/core/` - Core types and interfaces
-- `src/store.ts` - SUT registry API
-- `src/case.ts` - Test case API
-- `src/execute.ts` - Execution engine API
-- `src/aggregate.ts` - Statistical functions
-- `src/evaluate.ts` - Claim evaluation API
-- `src/render.ts` - Report generation API
-- `src/monitor.ts` - Resource monitoring API
+- TypeScript strict mode, ES2023 target, ES modules
+- Node.js native test runner (`node:test` + `node:assert`) — not Vitest/Jest
+- Coverage via c8 (text + html + json-summary in `./coverage/`)
+- Conventional commits enforced via commitlint + husky
+- Semantic release from all branches
+- No `any` types — use `unknown` with type guards
+- Executor produces deterministic `runId` via SHA-256 hash of inputs
 
 ## License
 
 MIT
-
----
-
-**PPEF** - Making experiments reproducible, evaluable, and documentable.

package/dist/__tests__/cli/evaluate-command.integration.test.d.ts

@@ -0,0 +1,8 @@
+/**
+ * Integration tests for Evaluate Command
+ *
+ * Tests the CLI evaluate command using dependency injection
+ * for file system and process exit mocking.
+ */
+export {};
+//# sourceMappingURL=evaluate-command.integration.test.d.ts.map

package/dist/__tests__/cli/evaluate-command.integration.test.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"evaluate-command.integration.test.d.ts","sourceRoot":"","sources":["../../../src/__tests__/cli/evaluate-command.integration.test.ts"],"names":[],"mappings":"AAAA;;;;;GAKG"}

package/dist/__tests__/cli/evaluate-command.integration.test.js

@@ -0,0 +1,308 @@
+/**
+ * Integration tests for Evaluate Command
+ *
+ * Tests the CLI evaluate command using dependency injection
+ * for file system and process exit mocking.
+ */
+import { describe, it } from "node:test";
+import { strict as assert } from "node:assert";
+import { executeEvaluate } from "../../cli/commands/evaluate.js";
+import { createMockAggregate, createMockSummaryStats } from "../test-helpers.js";
+/**
+ * Test helpers
+ */
+function createMockAggregatesFile() {
+    const aggregates = [
+        createMockAggregate("primary-sut", "primary", undefined, {
+            accuracy: createMockSummaryStats([0.85, 0.87, 0.86]),
+        }),
+        createMockAggregate("baseline-sut", "baseline", undefined, {
+            accuracy: createMockSummaryStats([0.75, 0.77, 0.76]),
+        }),
+    ];
+    return JSON.stringify({ aggregates }, null, 2);
+}
+function createMockClaimsConfig() {
+    return JSON.stringify({
+        claims: [
+            {
+                claimId: "C001",
+                description: "Test claim",
+                sut: "primary-sut",
+                baseline: "baseline-sut",
+                metric: "accuracy",
+                direction: "greater",
+                scope: "global",
+            },
+        ],
+    }, null, 2);
+}
+function createMockMetricsConfig() {
+    return JSON.stringify({
+        criteria: [
+            {
+                criterionId: "C001",
+                description: "Test criterion",
+                type: "threshold",
+                metric: "accuracy",
+                sut: "primary-sut",
+                threshold: { operator: "gte", value: 0.8 },
+            },
+        ],
+    }, null, 2);
+}
+function createMockRobustnessConfig() {
+    return JSON.stringify({
+        metrics: ["accuracy"],
+        perturbations: ["noise"],
+    }, null, 2);
+}
+/**
+ * Spy logger that captures all calls
+ */
+class SpyLogger {
+    calls = [];
+    header(message) {
+        this.calls.push(`header:${message}`);
+    }
+    subheader(message) {
+        this.calls.push(`subheader:${message}`);
+    }
+    info(message) {
+        this.calls.push(`info:${message}`);
+    }
+    debug(message) {
+        this.calls.push(`debug:${message}`);
+    }
+    error(message) {
+        this.calls.push(`error:${message}`);
+    }
+    warn(message) {
+        this.calls.push(`warn:${message}`);
+    }
+    setProgress(_enabled) {
+        // Ignore
+    }
+    hasInfo(message) {
+        return this.calls.includes(`info:${message}`);
+    }
+    hasError(message) {
+        return this.calls.some((call) => call.startsWith(`error:`) && call.includes(message));
+    }
+}
+/**
+ * Mock file system
+ */
+class MockFS {
+    files = new Map();
+    constructor(files) {
+        Object.entries(files).forEach(([path, content]) => {
+            this.files.set(path, content);
+        });
+    }
+    async readFile(path, _encoding) {
+        const content = this.files.get(path);
+        if (content === undefined) {
+            throw new Error(`File not found: ${path}`);
+        }
+        return content;
+    }
+    async writeFile(path, data, _encoding) {
+        this.files.set(path, data);
+    }
+}
+describe("evaluate command - integration tests", () => {
+    describe("claims evaluation", () => {
+        it("should evaluate claims successfully", async () => {
+            const aggregatesFile = "/mock/aggregates.json";
+            const configFile = "/mock/config.json";
+            const mockFS = new MockFS({
+                [aggregatesFile]: createMockAggregatesFile(),
+                [configFile]: createMockClaimsConfig(),
+            });
+            const mockLogger = new SpyLogger();
+            let exitCode;
+            const mockExit = (code) => {
+                exitCode = code;
+                throw new Error(`Exit ${code}`);
+            };
+            // executeEvaluate doesn't call processExit on success
+            try {
+                await executeEvaluate(aggregatesFile, { type: "claims", config: configFile, verbose: true }, { logger: mockLogger, fileSystem: mockFS, processExit: mockExit });
+            }
+            catch (e) {
+                // If processExit was called, we should see the exit code and logged errors
+                if (exitCode !== undefined) {
+                    const errorLogs = mockLogger.calls.filter((call) => call.startsWith("error:"));
+                    assert.fail(`processExit was called with code ${exitCode}. Logged errors:\n${errorLogs.join("\n")}`);
+                }
+                throw e;
+            }
+            assert.strictEqual(exitCode, undefined, "processExit should not be called on success");
+            // Check for "Evaluation complete: claims" message
+            assert.ok(mockLogger.calls.some((call) => call.startsWith("info:Evaluation complete:")));
+        });
+        it("should use provided config file", async () => {
+            const aggregatesFile = "/mock/aggregates.json";
+            const configFile = "/mock/config.json";
+            const mockFS = new MockFS({
+                [aggregatesFile]: createMockAggregatesFile(),
+                [configFile]: createMockClaimsConfig(),
+            });
+            const mockLogger = new SpyLogger();
+            let exitCode;
+            const mockExit = (code) => {
+                exitCode = code;
+                throw new Error(`Exit ${code}`);
+            };
+            try {
+                await executeEvaluate(aggregatesFile, { type: "claims", config: configFile }, { logger: mockLogger, fileSystem: mockFS, processExit: mockExit });
+            }
+            catch (e) {
+                if (exitCode !== undefined) {
+                    const errorLogs = mockLogger.calls.filter((call) => call.startsWith("error:"));
+                    assert.fail(`processExit was called with code ${exitCode}. Logged errors:\n${errorLogs.join("\n")}`);
+                }
+                throw e;
+            }
+            assert.strictEqual(exitCode, undefined, "processExit should not be called on success");
+        });
+        it("should handle invalid config gracefully", async () => {
+            const aggregatesFile = "/mock/aggregates.json";
+            const configFile = "/mock/config.json";
+            const mockFS = new MockFS({
+                [aggregatesFile]: createMockAggregatesFile(),
+                [configFile]: JSON.stringify({ invalid: "config" }),
+            });
+            const mockLogger = new SpyLogger();
+            let exitCode = 0;
+            const mockExit = (code) => {
+                exitCode = code;
+                throw new Error(`Exit ${code}`);
+            };
+            await executeEvaluate(aggregatesFile, { type: "claims", config: configFile }, { logger: mockLogger, fileSystem: mockFS, processExit: mockExit }).catch(() => {
+                // Expected
+            });
+            assert.strictEqual(exitCode, 1);
+            assert.ok(mockLogger.hasError("validation failed"));
+        });
+    });
+    describe("metrics evaluation", () => {
+        it("should evaluate metrics successfully", async () => {
+            const aggregatesFile = "/mock/aggregates.json";
+            const configFile = "/mock/config.json";
+            const mockFS = new MockFS({
+                [aggregatesFile]: createMockAggregatesFile(),
+                [configFile]: createMockMetricsConfig(),
+            });
+            const mockLogger = new SpyLogger();
+            let exitCode;
+            const mockExit = (code) => {
+                exitCode = code;
+                throw new Error(`Exit ${code}`);
+            };
+            try {
+                await executeEvaluate(aggregatesFile, {
+                    type: "metrics",
+                    config: configFile,
+                    verbose: true,
+                }, { logger: mockLogger, fileSystem: mockFS, processExit: mockExit });
+            }
+            catch (e) {
+                if (exitCode !== undefined) {
+                    const errorLogs = mockLogger.calls.filter((call) => call.startsWith("error:"));
+                    assert.fail(`processExit was called with code ${exitCode}. Logged errors:\n${errorLogs.join("\n")}`);
+                }
+                throw e;
+            }
+            assert.strictEqual(exitCode, undefined, "processExit should not be called on success");
+            assert.ok(mockLogger.calls.some((call) => call.startsWith("info:Evaluation complete:")));
+        });
+    });
+    describe("error handling", () => {
+        it("should exit with error when file not found", async () => {
+            const mockFS = new MockFS({});
+            const mockLogger = new SpyLogger();
+            let exitCode = 0;
+            const mockExit = (code) => {
+                exitCode = code;
+                throw new Error(`Exit ${code}`);
+            };
+            await executeEvaluate("/mock/missing.json", { type: "claims" }, { logger: mockLogger, fileSystem: mockFS, processExit: mockExit }).catch(() => {
+                // Expected
+            });
+            assert.strictEqual(exitCode, 1);
+            assert.ok(mockLogger.calls.some((call) => call.startsWith("error:")));
+        });
+        it("should handle invalid JSON gracefully", async () => {
+            const aggregatesFile = "/mock/aggregates.json";
+            const mockFS = new MockFS({
+                [aggregatesFile]: "invalid json{",
+            });
+            const mockLogger = new SpyLogger();
+            let exitCode = 0;
+            const mockExit = (code) => {
+                exitCode = code;
+                throw new Error(`Exit ${code}`);
+            };
+            await executeEvaluate(aggregatesFile, { type: "claims" }, { logger: mockLogger, fileSystem: mockFS, processExit: mockExit }).catch(() => {
+                // Expected
+            });
+            assert.strictEqual(exitCode, 1);
+        });
+        it("should handle missing aggregates in file", async () => {
+            const aggregatesFile = "/mock/aggregates.json";
+            const mockFS = new MockFS({
+                [aggregatesFile]: JSON.stringify({ results: [] }),
+            });
+            const mockLogger = new SpyLogger();
+            let exitCode = 0;
+            const mockExit = (code) => {
+                exitCode = code;
+                throw new Error(`Exit ${code}`);
+            };
+            await executeEvaluate(aggregatesFile, { type: "claims" }, { logger: mockLogger, fileSystem: mockFS, processExit: mockExit }).catch(() => {
+                // Expected
+            });
+            assert.strictEqual(exitCode, 1);
+            assert.ok(mockLogger.calls.some((call) => call.startsWith("error:") && call.includes("aggregate")));
+        });
+    });
+    describe("robustness evaluation", () => {
+        it("should require raw results for robustness", async () => {
+            const aggregatesFile = "/mock/aggregates.json";
+            const configFile = "/mock/config.json";
+            const mockFS = new MockFS({
+                [aggregatesFile]: JSON.stringify({
+                    aggregates: [
+                        createMockAggregate("sut-1", "primary", undefined, {
+                            accuracy: createMockSummaryStats([0.85]),
+                        }),
+                    ],
+                }),
+                [configFile]: createMockRobustnessConfig(),
+            });
+            const mockLogger = new SpyLogger();
+            let exitCode = 0;
+            const mockExit = (code) => {
+                exitCode = code;
+                throw new Error(`Exit ${code}`);
+            };
+            await executeEvaluate(aggregatesFile, { type: "robustness", config: configFile }, { logger: mockLogger, fileSystem: mockFS, processExit: mockExit }).catch(() => {
+                // Expected to throw due to mockExit
+            });
+            // Check exitCode first
+            if (exitCode !== 1) {
+                assert.fail(`Expected exitCode to be 1, but got ${exitCode}. All calls:\n${mockLogger.calls.join("\n")}`);
+            }
+            // Check for error message
+            const hasRawResultsError = mockLogger.calls.some((call) => call.startsWith("error:") && call.includes("raw results"));
+            if (!hasRawResultsError) {
+                assert.fail(`Expected error message containing 'raw results', but got:\n${mockLogger.calls
+                    .filter((c) => c.startsWith("error:"))
+                    .join("\n")}`);
+            }
+        });
+    });
+});
+//# sourceMappingURL=evaluate-command.integration.test.js.map

package/dist/__tests__/cli/evaluate-command.integration.test.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"evaluate-command.integration.test.js","sourceRoot":"","sources":["../../../src/__tests__/cli/evaluate-command.integration.test.ts"],"names":[],"mappings":"AAAA;;;;;GAKG;AAEH,OAAO,EAAE,QAAQ,EAAE,EAAE,EAAE,MAAM,WAAW,CAAC;AACzC,OAAO,EAAE,MAAM,IAAI,MAAM,EAAE,MAAM,aAAa,CAAC;AAG/C,OAAO,EAAE,eAAe,EAAE,MAAM,gCAAgC,CAAC;AAEjE,OAAO,EAAE,mBAAmB,EAAE,sBAAsB,EAAE,MAAM,oBAAoB,CAAC;AAEjF;;GAEG;AAEH,SAAS,wBAAwB;IAChC,MAAM,UAAU,GAAuB;QACtC,mBAAmB,CAAC,aAAa,EAAE,SAAS,EAAE,SAAS,EAAE;YACxD,QAAQ,EAAE,sBAAsB,CAAC,CAAC,IAAI,EAAE,IAAI,EAAE,IAAI,CAAC,CAAC;SACpD,CAAC;QACF,mBAAmB,CAAC,cAAc,EAAE,UAAU,EAAE,SAAS,EAAE;YAC1D,QAAQ,EAAE,sBAAsB,CAAC,CAAC,IAAI,EAAE,IAAI,EAAE,IAAI,CAAC,CAAC;SACpD,CAAC;KACF,CAAC;IAEF,OAAO,IAAI,CAAC,SAAS,CAAC,EAAE,UAAU,EAAE,EAAE,IAAI,EAAE,CAAC,CAAC,CAAC;AAChD,CAAC;AAED,SAAS,sBAAsB;IAC9B,OAAO,IAAI,CAAC,SAAS,CACpB;QACC,MAAM,EAAE;YACP;gBACC,OAAO,EAAE,MAAM;gBACf,WAAW,EAAE,YAAY;gBACzB,GAAG,EAAE,aAAa;gBAClB,QAAQ,EAAE,cAAc;gBACxB,MAAM,EAAE,UAAU;gBAClB,SAAS,EAAE,SAAS;gBACpB,KAAK,EAAE,QAAQ;aACf;SACD;KACD,EACD,IAAI,EACJ,CAAC,CACD,CAAC;AACH,CAAC;AAED,SAAS,uBAAuB;IAC/B,OAAO,IAAI,CAAC,SAAS,CACpB;QACC,QAAQ,EAAE;YACT;gBACC,WAAW,EAAE,MAAM;gBACnB,WAAW,EAAE,gBAAgB;gBAC7B,IAAI,EAAE,WAAW;gBACjB,MAAM,EAAE,UAAU;gBAClB,GAAG,EAAE,aAAa;gBAClB,SAAS,EAAE,EAAE,QAAQ,EAAE,KAAK,EAAE,KAAK,EAAE,GAAG,EAAE;aAC1C;SACD;KACD,EACD,IAAI,EACJ,CAAC,CACD,CAAC;AACH,CAAC;AAED,SAAS,0BAA0B;IAClC,OAAO,IAAI,CAAC,SAAS,CACpB;QACC,OAAO,EAAE,CAAC,UAAU,CAAC;QACrB,aAAa,EAAE,CAAC,OAAO,CAAC;KACxB,EACD,IAAI,EACJ,CAAC,CACD,CAAC;AACH,CAAC;AAED;;GAEG;AACH,MAAM,SAAS;IACd,KAAK,GAAa,EAAE,CAAC;IAErB,MAAM,CAAC,OAAe;QACrB,IAAI,CAAC,KAAK,CAAC,IAAI,CAAC,UAAU,OAAO,EAAE,CAAC,CAAC;IACtC,CAAC;IAED,SAAS,CAAC,OAAe;QACxB,IAAI,CAAC,KAAK,CAAC,IAAI,CAAC,aAAa,OAAO,EAAE,CAAC,CAAC;IACzC,CAAC;IAED,IAAI,CAAC,OAAe;QACnB,IAAI,CAAC,KAAK,CAAC,IAAI,CAAC,QAAQ,OAAO,EAAE,CAAC,CAAC;IACpC,CAAC;IAED,KAAK,CAAC,OAAe;QACpB,IAAI,CAAC,KAAK,CAAC,IAAI,CAAC,SAAS,OAAO,EAAE,CAAC,CAAC;IACrC,CAAC;IAED,KAAK,CAAC,OAAe;QACpB,IAAI,CAAC,KAAK,CAAC,IAAI,CAAC,SAAS,OAAO,EAAE,CAAC,CAAC;IACrC,CAAC;IAED,IAAI,CAAC,OAAe;QACnB,IAAI,CAAC,KAAK,CAAC,IAAI,CAAC,QAAQ,OAAO,EAAE,CAAC,CAAC;IACpC,CAAC;IAED,WAAW,CAAC,QAAiB;QAC5B,SAAS;IACV,CAAC;IAED,OAAO,CAAC,OAAe;QACtB,OAAO,IAAI,CAAC,KAAK,CAAC,QAAQ,CAAC,QAAQ,OAAO,EAAE,CAAC,CAAC;IAC/C,CAAC;IAED,QAAQ,CAAC,OAAe;QACvB,OAAO,IAAI,CAAC,KAAK,CAAC,IAAI,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,IAAI,CAAC,UAAU,CAAC,QAAQ,CAAC,IAAI,IAAI,CAAC,QAAQ,CAAC,OAAO,CAAC,CAAC,CAAC;IACvF,CAAC;CACD;AAED;;GAEG;AACH,MAAM,MAAM;IACH,KAAK,GAAG,IAAI,GAAG,EAAkB,CAAC;IAE1C,YAAY,KAA6B;QACxC,MAAM,CAAC,OAAO,CAAC,KAAK,CAAC,CAAC,OAAO,CAAC,CAAC,CAAC,IAAI,EAAE,OAAO,CAAC,EAAE,EAAE;YACjD,IAAI,CAAC,KAAK,CAAC,GAAG,CAAC,IAAI,EAAE,OAAO,CAAC,CAAC;QAC/B,CAAC,CAAC,CAAC;IACJ,CAAC;IAED,KAAK,CAAC,QAAQ,CAAC,IAAY,EAAE,SAAiB;QAC7C,MAAM,OAAO,GAAG,IAAI,CAAC,KAAK,CAAC,GAAG,CAAC,IAAI,CAAC,CAAC;QACrC,IAAI,OAAO,KAAK,SAAS,EAAE,CAAC;YAC3B,MAAM,IAAI,KAAK,CAAC,mBAAmB,IAAI,EAAE,CAAC,CAAC;QAC5C,CAAC;QACD,OAAO,OAAO,CAAC;IAChB,CAAC;IAED,KAAK,CAAC,SAAS,CAAC,IAAY,EAAE,IAAY,EAAE,SAAiB;QAC5D,IAAI,CAAC,KAAK,CAAC,GAAG,CAAC,IAAI,EAAE,IAAI,CAAC,CAAC;IAC5B,CAAC;CACD;AAED,QAAQ,CAAC,sCAAsC,EAAE,GAAG,EAAE;IACrD,QAAQ,CAAC,mBAAmB,EAAE,GAAG,EAAE;QAClC,EAAE,CAAC,qCAAqC,EAAE,KAAK,IAAI,EAAE;YACpD,MAAM,cAAc,GAAG,uBAAuB,CAAC;YAC/C,MAAM,UAAU,GAAG,mBAAmB,CAAC;YACvC,MAAM,MAAM,GAAG,IAAI,MAAM,CAAC;gBACzB,CAAC,cAAc,CAAC,EAAE,wBAAwB,EAAE;gBAC5C,CAAC,UAAU,CAAC,EAAE,sBAAsB,EAAE;aACtC,CAAC,CAAC;YACH,MAAM,UAAU,GAAG,IAAI,SAAS,EAAE,CAAC;YACnC,IAAI,QAA4B,CAAC;YACjC,MAAM,QAAQ,GAAG,CAAC,IAAY,EAAE,EAAE;gBACjC,QAAQ,GAAG,IAAI,CAAC;gBAChB,MAAM,IAAI,KAAK,CAAC,QAAQ,IAAI,EAAE,CAAC,CAAC;YACjC,CAAC,CAAC;YAEF,sDAAsD;YACtD,IAAI,CAAC;gBACJ,MAAM,eAAe,CACpB,cAAc,EACd,EAAE,IAAI,EAAE,QAAiB,EAAE,MAAM,EAAE,UAAU,EAAE,OAAO,EAAE,IAAI,EAAE,EAC9D,EAAE,MAAM,EAAE,UAAU,EAAE,UAAU,EAAE,MAAM,EAAE,WAAW,EAAE,QAAQ,EAAE,CACjE,CAAC;YACH,CAAC;YAAC,OAAO,CAAC,EAAE,CAAC;gBACZ,2EAA2E;gBAC3E,IAAI,QAAQ,KAAK,SAAS,EAAE,CAAC;oBAC5B,MAAM,SAAS,GAAG,UAAU,CAAC,KAAK,CAAC,MAAM,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,IAAI,CAAC,UAAU,CAAC,QAAQ,CAAC,CAAC,CAAC;oBAC/E,MAAM,CAAC,IAAI,CACV,oCAAoC,QAAQ,qBAAqB,SAAS,CAAC,IAAI,CAAC,IAAI,CAAC,EAAE,CACvF,CAAC;gBACH,CAAC;gBACD,MAAM,CAAC,CAAC;YACT,CAAC;YAED,MAAM,CAAC,WAAW,CAAC,QAAQ,EAAE,SAAS,EAAE,6CAA6C,CAAC,CAAC;YACvF,kDAAkD;YAClD,MAAM,CAAC,EAAE,CAAC,UAAU,CAAC,KAAK,CAAC,IAAI,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,IAAI,CAAC,UAAU,CAAC,2BAA2B,CAAC,CAAC,CAAC,CAAC;QAC1F,CAAC,CAAC,CAAC;QAEH,EAAE,CAAC,iCAAiC,EAAE,KAAK,IAAI,EAAE;YAChD,MAAM,cAAc,GAAG,uBAAuB,CAAC;YAC/C,MAAM,UAAU,GAAG,mBAAmB,CAAC;YACvC,MAAM,MAAM,GAAG,IAAI,MAAM,CAAC;gBACzB,CAAC,cAAc,CAAC,EAAE,wBAAwB,EAAE;gBAC5C,CAAC,UAAU,CAAC,EAAE,sBAAsB,EAAE;aACtC,CAAC,CAAC;YACH,MAAM,UAAU,GAAG,IAAI,SAAS,EAAE,CAAC;YACnC,IAAI,QAA4B,CAAC;YACjC,MAAM,QAAQ,GAAG,CAAC,IAAY,EAAE,EAAE;gBACjC,QAAQ,GAAG,IAAI,CAAC;gBAChB,MAAM,IAAI,KAAK,CAAC,QAAQ,IAAI,EAAE,CAAC,CAAC;YACjC,CAAC,CAAC;YAEF,IAAI,CAAC;gBACJ,MAAM,eAAe,CACpB,cAAc,EACd,EAAE,IAAI,EAAE,QAAiB,EAAE,MAAM,EAAE,UAAU,EAAE,EAC/C,EAAE,MAAM,EAAE,UAAU,EAAE,UAAU,EAAE,MAAM,EAAE,WAAW,EAAE,QAAQ,EAAE,CACjE,CAAC;YACH,CAAC;YAAC,OAAO,CAAC,EAAE,CAAC;gBACZ,IAAI,QAAQ,KAAK,SAAS,EAAE,CAAC;oBAC5B,MAAM,SAAS,GAAG,UAAU,CAAC,KAAK,CAAC,MAAM,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,IAAI,CAAC,UAAU,CAAC,QAAQ,CAAC,CAAC,CAAC;oBAC/E,MAAM,CAAC,IAAI,CACV,oCAAoC,QAAQ,qBAAqB,SAAS,CAAC,IAAI,CAAC,IAAI,CAAC,EAAE,CACvF,CAAC;gBACH,CAAC;gBACD,MAAM,CAAC,CAAC;YACT,CAAC;YAED,MAAM,CAAC,WAAW,CAAC,QAAQ,EAAE,SAAS,EAAE,6CAA6C,CAAC,CAAC;QACxF,CAAC,CAAC,CAAC;QAEH,EAAE,CAAC,yCAAyC,EAAE,KAAK,IAAI,EAAE;YACxD,MAAM,cAAc,GAAG,uBAAuB,CAAC;YAC/C,MAAM,UAAU,GAAG,mBAAmB,CAAC;YACvC,MAAM,MAAM,GAAG,IAAI,MAAM,CAAC;gBACzB,CAAC,cAAc,CAAC,EAAE,wBAAwB,EAAE;gBAC5C,CAAC,UAAU,CAAC,EAAE,IAAI,CAAC,SAAS,CAAC,EAAE,OAAO,EAAE,QAAQ,EAAE,CAAC;aACnD,CAAC,CAAC;YACH,MAAM,UAAU,GAAG,IAAI,SAAS,EAAE,CAAC;YACnC,IAAI,QAAQ,GAAG,CAAC,CAAC;YACjB,MAAM,QAAQ,GAAG,CAAC,IAAY,EAAE,EAAE;gBACjC,QAAQ,GAAG,IAAI,CAAC;gBAChB,MAAM,IAAI,KAAK,CAAC,QAAQ,IAAI,EAAE,CAAC,CAAC;YACjC,CAAC,CAAC;YAEF,MAAM,eAAe,CACpB,cAAc,EACd,EAAE,IAAI,EAAE,QAAiB,EAAE,MAAM,EAAE,UAAU,EAAE,EAC/C,EAAE,MAAM,EAAE,UAAU,EAAE,UAAU,EAAE,MAAM,EAAE,WAAW,EAAE,QAAQ,EAAE,CACjE,CAAC,KAAK,CAAC,GAAG,EAAE;gBACZ,WAAW;YACZ,CAAC,CAAC,CAAC;YAEH,MAAM,CAAC,WAAW,CAAC,QAAQ,EAAE,CAAC,CAAC,CAAC;YAChC,MAAM,CAAC,EAAE,CAAC,UAAU,CAAC,QAAQ,CAAC,mBAAmB,CAAC,CAAC,CAAC;QACrD,CAAC,CAAC,CAAC;IACJ,CAAC,CAAC,CAAC;IAEH,QAAQ,CAAC,oBAAoB,EAAE,GAAG,EAAE;QACnC,EAAE,CAAC,sCAAsC,EAAE,KAAK,IAAI,EAAE;YACrD,MAAM,cAAc,GAAG,uBAAuB,CAAC;YAC/C,MAAM,UAAU,GAAG,mBAAmB,CAAC;YACvC,MAAM,MAAM,GAAG,IAAI,MAAM,CAAC;gBACzB,CAAC,cAAc,CAAC,EAAE,wBAAwB,EAAE;gBAC5C,CAAC,UAAU,CAAC,EAAE,uBAAuB,EAAE;aACvC,CAAC,CAAC;YACH,MAAM,UAAU,GAAG,IAAI,SAAS,EAAE,CAAC;YACnC,IAAI,QAA4B,CAAC;YACjC,MAAM,QAAQ,GAAG,CAAC,IAAY,EAAE,EAAE;gBACjC,QAAQ,GAAG,IAAI,CAAC;gBAChB,MAAM,IAAI,KAAK,CAAC,QAAQ,IAAI,EAAE,CAAC,CAAC;YACjC,CAAC,CAAC;YAEF,IAAI,CAAC;gBACJ,MAAM,eAAe,CACpB,cAAc,EACd;oBACC,IAAI,EAAE,SAAkB;oBACxB,MAAM,EAAE,UAAU;oBAClB,OAAO,EAAE,IAAI;iBACb,EACD,EAAE,MAAM,EAAE,UAAU,EAAE,UAAU,EAAE,MAAM,EAAE,WAAW,EAAE,QAAQ,EAAE,CACjE,CAAC;YACH,CAAC;YAAC,OAAO,CAAC,EAAE,CAAC;gBACZ,IAAI,QAAQ,KAAK,SAAS,EAAE,CAAC;oBAC5B,MAAM,SAAS,GAAG,UAAU,CAAC,KAAK,CAAC,MAAM,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,IAAI,CAAC,UAAU,CAAC,QAAQ,CAAC,CAAC,CAAC;oBAC/E,MAAM,CAAC,IAAI,CACV,oCAAoC,QAAQ,qBAAqB,SAAS,CAAC,IAAI,CAAC,IAAI,CAAC,EAAE,CACvF,CAAC;gBACH,CAAC;gBACD,MAAM,CAAC,CAAC;YACT,CAAC;YAED,MAAM,CAAC,WAAW,CAAC,QAAQ,EAAE,SAAS,EAAE,6CAA6C,CAAC,CAAC;YACvF,MAAM,CAAC,EAAE,CAAC,UAAU,CAAC,KAAK,CAAC,IAAI,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,IAAI,CAAC,UAAU,CAAC,2BAA2B,CAAC,CAAC,CAAC,CAAC;QAC1F,CAAC,CAAC,CAAC;IACJ,CAAC,CAAC,CAAC;IAEH,QAAQ,CAAC,gBAAgB,EAAE,GAAG,EAAE;QAC/B,EAAE,CAAC,4CAA4C,EAAE,KAAK,IAAI,EAAE;YAC3D,MAAM,MAAM,GAAG,IAAI,MAAM,CAAC,EAAE,CAAC,CAAC;YAC9B,MAAM,UAAU,GAAG,IAAI,SAAS,EAAE,CAAC;YACnC,IAAI,QAAQ,GAAG,CAAC,CAAC;YACjB,MAAM,QAAQ,GAAG,CAAC,IAAY,EAAE,EAAE;gBACjC,QAAQ,GAAG,IAAI,CAAC;gBAChB,MAAM,IAAI,KAAK,CAAC,QAAQ,IAAI,EAAE,CAAC,CAAC;YACjC,CAAC,CAAC;YAEF,MAAM,eAAe,CACpB,oBAAoB,EACpB,EAAE,IAAI,EAAE,QAAiB,EAAE,EAC3B,EAAE,MAAM,EAAE,UAAU,EAAE,UAAU,EAAE,MAAM,EAAE,WAAW,EAAE,QAAQ,EAAE,CACjE,CAAC,KAAK,CAAC,GAAG,EAAE;gBACZ,WAAW;YACZ,CAAC,CAAC,CAAC;YAEH,MAAM,CAAC,WAAW,CAAC,QAAQ,EAAE,CAAC,CAAC,CAAC;YAChC,MAAM,CAAC,EAAE,CAAC,UAAU,CAAC,KAAK,CAAC,IAAI,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,IAAI,CAAC,UAAU,CAAC,QAAQ,CAAC,CAAC,CAAC,CAAC;QACvE,CAAC,CAAC,CAAC;QAEH,EAAE,CAAC,uCAAuC,EAAE,KAAK,IAAI,EAAE;YACtD,MAAM,cAAc,GAAG,uBAAuB,CAAC;YAC/C,MAAM,MAAM,GAAG,IAAI,MAAM,CAAC;gBACzB,CAAC,cAAc,CAAC,EAAE,eAAe;aACjC,CAAC,CAAC;YACH,MAAM,UAAU,GAAG,IAAI,SAAS,EAAE,CAAC;YACnC,IAAI,QAAQ,GAAG,CAAC,CAAC;YACjB,MAAM,QAAQ,GAAG,CAAC,IAAY,EAAE,EAAE;gBACjC,QAAQ,GAAG,IAAI,CAAC;gBAChB,MAAM,IAAI,KAAK,CAAC,QAAQ,IAAI,EAAE,CAAC,CAAC;YACjC,CAAC,CAAC;YAEF,MAAM,eAAe,CACpB,cAAc,EACd,EAAE,IAAI,EAAE,QAAiB,EAAE,EAC3B,EAAE,MAAM,EAAE,UAAU,EAAE,UAAU,EAAE,MAAM,EAAE,WAAW,EAAE,QAAQ,EAAE,CACjE,CAAC,KAAK,CAAC,GAAG,EAAE;gBACZ,WAAW;YACZ,CAAC,CAAC,CAAC;YAEH,MAAM,CAAC,WAAW,CAAC,QAAQ,EAAE,CAAC,CAAC,CAAC;QACjC,CAAC,CAAC,CAAC;QAEH,EAAE,CAAC,0CAA0C,EAAE,KAAK,IAAI,EAAE;YACzD,MAAM,cAAc,GAAG,uBAAuB,CAAC;YAC/C,MAAM,MAAM,GAAG,IAAI,MAAM,CAAC;gBACzB,CAAC,cAAc,CAAC,EAAE,IAAI,CAAC,SAAS,CAAC,EAAE,OAAO,EAAE,EAAE,EAAE,CAAC;aACjD,CAAC,CAAC;YACH,MAAM,UAAU,GAAG,IAAI,SAAS,EAAE,CAAC;YACnC,IAAI,QAAQ,GAAG,CAAC,CAAC;YACjB,MAAM,QAAQ,GAAG,CAAC,IAAY,EAAE,EAAE;gBACjC,QAAQ,GAAG,IAAI,CAAC;gBAChB,MAAM,IAAI,KAAK,CAAC,QAAQ,IAAI,EAAE,CAAC,CAAC;YACjC,CAAC,CAAC;YAEF,MAAM,eAAe,CACpB,cAAc,EACd,EAAE,IAAI,EAAE,QAAiB,EAAE,EAC3B,EAAE,MAAM,EAAE,UAAU,EAAE,UAAU,EAAE,MAAM,EAAE,WAAW,EAAE,QAAQ,EAAE,CACjE,CAAC,KAAK,CAAC,GAAG,EAAE;gBACZ,WAAW;YACZ,CAAC,CAAC,CAAC;YAEH,MAAM,CAAC,WAAW,CAAC,QAAQ,EAAE,CAAC,CAAC,CAAC;YAChC,MAAM,CAAC,EAAE,CACR,UAAU,CAAC,KAAK,CAAC,IAAI,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,IAAI,CAAC,UAAU,CAAC,QAAQ,CAAC,IAAI,IAAI,CAAC,QAAQ,CAAC,WAAW,CAAC,CAAC,CACxF,CAAC;QACH,CAAC,CAAC,CAAC;IACJ,CAAC,CAAC,CAAC;IAEH,QAAQ,CAAC,uBAAuB,EAAE,GAAG,EAAE;QACtC,EAAE,CAAC,2CAA2C,EAAE,KAAK,IAAI,EAAE;YAC1D,MAAM,cAAc,GAAG,uBAAuB,CAAC;YAC/C,MAAM,UAAU,GAAG,mBAAmB,CAAC;YACvC,MAAM,MAAM,GAAG,IAAI,MAAM,CAAC;gBACzB,CAAC,cAAc,CAAC,EAAE,IAAI,CAAC,SAAS,CAAC;oBAChC,UAAU,EAAE;wBACX,mBAAmB,CAAC,OAAO,EAAE,SAAS,EAAE,SAAS,EAAE;4BAClD,QAAQ,EAAE,sBAAsB,CAAC,CAAC,IAAI,CAAC,CAAC;yBACxC,CAAC;qBACF;iBACD,CAAC;gBACF,CAAC,UAAU,CAAC,EAAE,0BAA0B,EAAE;aAC1C,CAAC,CAAC;YACH,MAAM,UAAU,GAAG,IAAI,SAAS,EAAE,CAAC;YACnC,IAAI,QAAQ,GAAG,CAAC,CAAC;YACjB,MAAM,QAAQ,GAAG,CAAC,IAAY,EAAE,EAAE;gBACjC,QAAQ,GAAG,IAAI,CAAC;gBAChB,MAAM,IAAI,KAAK,CAAC,QAAQ,IAAI,EAAE,CAAC,CAAC;YACjC,CAAC,CAAC;YAEF,MAAM,eAAe,CACpB,cAAc,EACd,EAAE,IAAI,EAAE,YAAqB,EAAE,MAAM,EAAE,UAAU,EAAE,EACnD,EAAE,MAAM,EAAE,UAAU,EAAE,UAAU,EAAE,MAAM,EAAE,WAAW,EAAE,QAAQ,EAAE,CACjE,CAAC,KAAK,CAAC,GAAG,EAAE;gBACZ,oCAAoC;YACrC,CAAC,CAAC,CAAC;YAEH,uBAAuB;YACvB,IAAI,QAAQ,KAAK,CAAC,EAAE,CAAC;gBACpB,MAAM,CAAC,IAAI,CACV,sCAAsC,QAAQ,iBAAiB,UAAU,CAAC,KAAK,CAAC,IAAI,CAAC,IAAI,CAAC,EAAE,CAC5F,CAAC;YACH,CAAC;YAED,0BAA0B;YAC1B,MAAM,kBAAkB,GAAG,UAAU,CAAC,KAAK,CAAC,IAAI,CAC/C,CAAC,IAAI,EAAE,EAAE,CAAC,IAAI,CAAC,UAAU,CAAC,QAAQ,CAAC,IAAI,IAAI,CAAC,QAAQ,CAAC,aAAa,CAAC,CACnE,CAAC;YACF,IAAI,CAAC,kBAAkB,EAAE,CAAC;gBACzB,MAAM,CAAC,IAAI,CACV,8DAA8D,UAAU,CAAC,KAAK;qBAC5E,MAAM,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,UAAU,CAAC,QAAQ,CAAC,CAAC;qBACrC,IAAI,CAAC,IAAI,CAAC,EAAE,CACd,CAAC;YACH,CAAC;QACF,CAAC,CAAC,CAAC;IACJ,CAAC,CAAC,CAAC;AACJ,CAAC,CAAC,CAAC"}

package/dist/__tests__/evaluators/claims-evaluator.unit.test.d.ts

@@ -0,0 +1,8 @@
+/**
+ * Unit tests for Claims Evaluator
+ *
+ * Tests the claims evaluator functionality including edge cases
+ * for different directions, thresholds, and the summarize method.
+ */
+export {};
+//# sourceMappingURL=claims-evaluator.unit.test.d.ts.map

package/dist/__tests__/evaluators/claims-evaluator.unit.test.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"claims-evaluator.unit.test.d.ts","sourceRoot":"","sources":["../../../src/__tests__/evaluators/claims-evaluator.unit.test.ts"],"names":[],"mappings":"AAAA;;;;;GAKG"}