automatey 0.1.10 → 0.1.16

package/README.md

@@ -45,7 +45,7 @@
 - **Sessions**: Save/load conversation sessions in `~/.automatey/sessions/`
 - **Checkpoints**: `/checkpoint` — full conversation snapshots with BM25 keyword search
 - **Auto-compact**: LLM summarises older context when usage ≥ 90%
-- **Skills**: Progressive SKILL.md loading from `.agents/skills/`
+- **Skills**: Progressive SKILL.md loading from the canonical universal path `.agents/skills/`, plus extra directories via `AUTOMATEY_SKILLS_DIRS`
 - **Eval system**: `/eval <file.jsonl>` runs MCQ, keyword, and regex benchmarks with per-category accuracy reports
 - **Planner MCP**: Bundled `mcp/planner` — todos + plans, prompts for task breakdown
 - **Coder MCP**: Bundled `mcp/coder` — read/write/edit files, run commands, glob files, prompts for analysis
@@ -196,10 +196,6 @@ ay "summarise this repo"          # one-shot against the current directory
 | `~/.automatey/planner/` | Planner MCP server data |
 | `~/.automatey/logs/` | Agent log files |
 
-> JSON / JSONC in `mcp.json`: Standard JSON does not allow `//` comments.
-> The agent uses a JSONC parser — `//` line comments and `/* */` block comments
-> are fully supported in all `mcp.json` files.
-
 ## MCP Config — `mcp.json`
 
 The agent looks for MCP config in this order:
@@ -215,26 +211,27 @@ cp mcp.example.json mcp.json          # project-local
 cp mcp.example.json ~/.automatey/mcp.json  # global
 ```
 
+Prefer strict JSON with no comments. Field descriptions and examples live in [docs/MCP-CONFIG.md](c:\build\automatey-org\automatey\docs\MCP-CONFIG.md).
+
 Example `mcp.json`:
 
-```jsonc
+```json
 {
-  // JSONC is supported — '//' and '/* */' comments are stripped before parsing
   "mcpServers": {
     "planner": {
-      "type": "stdio",
+      "transport": "stdio",
       "command": "node",
       "args": ["./mcp/planner/dist/server.js"]
     },
     "brave-search": {
-      "type": "stdio",
+      "transport": "stdio",
       "command": "npx",
       "args": ["-y", "@brave/brave-search-mcp-server", "--transport", "stdio"],
       "env": { "BRAVE_API_KEY": "${env:BRAVE_API_KEY}" },
       "requiresEnv": "BRAVE_API_KEY"
     },
     "memento": {
-      "type": "http",
+      "transport": "http",
       "url": "http://localhost:3500/mcp",
       "portCheck": true
     }
@@ -242,10 +239,6 @@ Example `mcp.json`:
 }
 ```
 
-Conditional loading:
-- `requiresEnv` — skip server if env var is missing (no key = no server, no error)
-- `portCheck: true` — skip HTTP/SSE server if the URL is unreachable at startup (1 s probe)
-
 ## Config
 
 Config lives in `~/.automatey/config.json` (auto-created on first run):
@@ -318,6 +311,120 @@ Checkpoints are full conversation snapshots saved to `~/.automatey/checkpoints/`
 
 The BM25 search indexes the full message history of every checkpoint and ranks them by keyword relevance.
 
+## Sub-Agents
+
+Sub-agents let the main agent delegate focused tasks to a nested ReAct loop — with its own tools, model, and system prompt. The parent spawns the sub-agent, waits for its result, and continues.
+
+### How it works
+
+The LLM calls the built-in `run_subagent` tool:
+
+```
+run_subagent(
+  description: "Write and test a Node.js hello-world script",
+  prompt: "Create hello.js that prints Hello World, run it with node, and confirm the output.",
+  agentName: "nemotron-coder"   // optional — uses a named .agent.md definition
+)
+```
+
+The sub-agent runs its own ReAct loop (up to `maxToolRounds`) and returns a plain-text result to the main agent.
+
+### Named agents — `.agent.md` files
+
+Define reusable agents as `.agent.md` files in `.agents/agents/` (project-local) or `~/.agents/agents/` (global). Format is YAML frontmatter + system prompt body:
+
+```markdown
+---
+name: nemotron-coder
+description: >
+  Code generation sub-agent on the local Nemotron vLLM instance.
+  Use for writing, editing, and running code — offloads code tasks
+  to a local model without burning cloud API quota.
+model: auto
+provider: nemotron
+baseUrl: http://192.168.0.58:8002/v1
+tools:
+  - read_file
+  - write_file
+  - execute_command
+  - glob_files
+  - list_dir
+  - search_text
+  - edit_file
+maxToolRounds: 12
+---
+
+You are a code-generation agent running on a local Nemotron model.
+Write complete, working code and save it to disk.
+Use execute_command to run and verify output. Never truncate code.
+```
+
+Place in:
+- **`.agents/agents/nemotron-coder.agent.md`** — project-local (resolved from `cwd` at runtime)
+- **`~/.agents/agents/nemotron-coder.agent.md`** — global (available in every directory)
+
+Extra directories: set `AUTOMATEY_AGENTS_DIRS` (path-separator-delimited) to add more search paths.
+
+### Frontmatter fields
+
+| Field | Description |
+|---|---|
+| `name` | Agent identifier (falls back to filename stem) |
+| `description` | When to use this agent — shown to the LLM in the system prompt |
+| `model` | Model ID, `auto`, or wildcard mask (e.g. `*Super*`, `nvidia/*`) |
+| `provider` | `nemotron` \| `openai` \| `anthropic` \| `perplexity` |
+| `baseUrl` | Base URL for OpenAI-compatible endpoints |
+| `apiKey` | API key — supports `${ENV_VAR}` interpolation |
+| `tools` | Allowlist of tool names (absent = inherit all parent tools) |
+| `mcpServers` | Allowlist of MCP server names (absent = inherit all) |
+| `maxToolRounds` | Max ReAct rounds (absent = parent's setting) |
+
+### Model resolution
+
+For `nemotron` agents, `model` supports the same resolution as the main config:
+
+```yaml
+model: auto              # picks the first model from /v1/models
+model: "*Super*"         # glob-matches the first model containing "Super"
+model: nvidia/*          # any nvidia/ model
+model: nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4  # exact ID
+```
+
+automatey probes the `baseUrl`'s `/v1/models` endpoint at sub-agent spawn time to resolve wildcards.
+
+### Listing agents
+
+```
+/agents list            # show all discovered agents + scope (project / global)
+/agents info <name>     # show frontmatter + system prompt for an agent
+/agents help            # usage and file format reference
+```
+
+### Example prompts
+
+```
+Write a CLI tool in Go that downloads a URL to a file — use nemotron-coder
+```
+
+```
+Run nemotron-coder to generate a Python FastAPI stub for a todo list API, then run it and show me the /docs URL
+```
+
+```
+Delegate to nemotron-coder: read package.json, bump the patch version, and commit it
+```
+
+### Generic sub-agents (no `.agent.md`)
+
+Omit `agentName` and the parent's own LLM client and full tool set are used:
+
+```
+Split this task into three parallel sub-agents: one for backend tests,
+one for frontend tests, one for linting. Run each and summarise.
+```
+
+> Sub-agents are stateless — they do not share session, context, or compaction with the parent. Each sub-agent starts fresh with an empty context containing only its system prompt and the prompt passed by the parent.
+
 ## Built-in MCP Servers
 
 ### 🗂 Coder (`mcp/coder`)

package/dist/adapters/index.d.ts

@@ -2,4 +2,5 @@ export { LLMClient } from './llm-client.ts';
 export type { LLMClientConfig } from './llm-client.ts';
 export { judgeResult, judgeQuality, judgeConfigFromEnv, JudgeVerdictSchema, QualityVerdictSchema, } from './judge-client.ts';
 export type { JudgeConfig, JudgeMode, JudgeVerdict, QualityVerdict, } from './judge-client.ts';
+export { JsonMemoryClient } from './json-memory-client.ts';
 //# sourceMappingURL=index.d.ts.map

package/dist/adapters/index.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../../src/adapters/index.ts"],"names":[],"mappings":"AACA,OAAO,EAAE,SAAS,EAAE,MAAM,iBAAiB,CAAC;AAC5C,YAAY,EAAE,eAAe,EAAE,MAAM,iBAAiB,CAAC;AACvD,OAAO,EACL,WAAW,EACX,YAAY,EACZ,kBAAkB,EAClB,kBAAkB,EAClB,oBAAoB,GACrB,MAAM,mBAAmB,CAAC;AAC3B,YAAY,EACV,WAAW,EACX,SAAS,EACT,YAAY,EACZ,cAAc,GACf,MAAM,mBAAmB,CAAC"}
+{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../../src/adapters/index.ts"],"names":[],"mappings":"AACA,OAAO,EAAE,SAAS,EAAE,MAAM,iBAAiB,CAAC;AAC5C,YAAY,EAAE,eAAe,EAAE,MAAM,iBAAiB,CAAC;AACvD,OAAO,EACL,WAAW,EACX,YAAY,EACZ,kBAAkB,EAClB,kBAAkB,EAClB,oBAAoB,GACrB,MAAM,mBAAmB,CAAC;AAC3B,YAAY,EACV,WAAW,EACX,SAAS,EACT,YAAY,EACZ,cAAc,GACf,MAAM,mBAAmB,CAAC;AAC3B,OAAO,EAAE,gBAAgB,EAAE,MAAM,yBAAyB,CAAC"}

package/dist/adapters/index.js

@@ -1,4 +1,5 @@
 // Adapters barrel
 export { LLMClient } from "./llm-client.js";
 export { judgeResult, judgeQuality, judgeConfigFromEnv, JudgeVerdictSchema, QualityVerdictSchema, } from "./judge-client.js";
+export { JsonMemoryClient } from "./json-memory-client.js";
 //# sourceMappingURL=index.js.map

package/dist/adapters/index.js.map

@@ -1 +1 @@
-{"version":3,"file":"index.js","sourceRoot":"","sources":["../../src/adapters/index.ts"],"names":[],"mappings":"AAAA,kBAAkB;AAClB,OAAO,EAAE,SAAS,EAAE,MAAM,iBAAiB,CAAC;AAE5C,OAAO,EACL,WAAW,EACX,YAAY,EACZ,kBAAkB,EAClB,kBAAkB,EAClB,oBAAoB,GACrB,MAAM,mBAAmB,CAAC"}
+{"version":3,"file":"index.js","sourceRoot":"","sources":["../../src/adapters/index.ts"],"names":[],"mappings":"AAAA,kBAAkB;AAClB,OAAO,EAAE,SAAS,EAAE,MAAM,iBAAiB,CAAC;AAE5C,OAAO,EACL,WAAW,EACX,YAAY,EACZ,kBAAkB,EAClB,kBAAkB,EAClB,oBAAoB,GACrB,MAAM,mBAAmB,CAAC;AAO3B,OAAO,EAAE,gBAAgB,EAAE,MAAM,yBAAyB,CAAC"}

package/dist/adapters/json-memory-client.d.ts

@@ -0,0 +1,40 @@
+/**
+ * JsonMemoryClient — A zero-dependency file-backed memory implementation.
+ *
+ * Stores memories as a JSON array in `~/.automatey/memory.json`.
+ * Full-text search is BM25-inspired: tf-idf over words, substring matching for
+ * short queries.
+ *
+ * Trade-offs vs Memento / SQLite:
+ *   + Zero dependencies — no native addons, no network
+ *   + JSON is human-readable and grep-able
+ *   − No vector embeddings → purely lexical recall
+ *   − Full scan on search (fast up to ~50K entries)
+ *   − No URL hydration or LLM cleanup in enhanceMemory (throws)
+ *
+ * Switch to MementoMemoryClient or SqliteMemoryClient for semantic search.
+ */
+import type { IMemoryClient, Memory, MemoryEnhanceOptions, MemoryEnhanceResult, MemoryResult, MemorySearchOptions, MemoryStoreOptions } from '#core/interfaces';
+export declare class JsonMemoryClient implements IMemoryClient {
+    private storePath;
+    private memories;
+    private connected;
+    constructor(storePath?: string);
+    connect(): Promise<void>;
+    disconnect(): Promise<void>;
+    isConnected(): boolean;
+    searchMemory(query: string, options?: MemorySearchOptions): Promise<MemoryResult[]>;
+    storeMemory(text: string, options?: MemoryStoreOptions): Promise<string>;
+    getMemory(id: string): Promise<Memory | null>;
+    updateMemory(id: string, updates: {
+        text?: string;
+        tags?: string[];
+        metadata?: Record<string, unknown>;
+    }): Promise<void>;
+    enhanceMemory(_id: string, _options?: MemoryEnhanceOptions): Promise<MemoryEnhanceResult>;
+    private assertConnected;
+    private persist;
+    private toMemory;
+    private tryParseJson;
+}
+//# sourceMappingURL=json-memory-client.d.ts.map

package/dist/adapters/json-memory-client.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"json-memory-client.d.ts","sourceRoot":"","sources":["../../src/adapters/json-memory-client.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;;GAeG;AAOH,OAAO,KAAK,EACV,aAAa,EACb,MAAM,EACN,oBAAoB,EACpB,mBAAmB,EACnB,YAAY,EACZ,mBAAmB,EACnB,kBAAkB,EACnB,MAAM,kBAAkB,CAAC;AA6C1B,qBAAa,gBAAiB,YAAW,aAAa;IACpD,OAAO,CAAC,SAAS,CAAS;IAC1B,OAAO,CAAC,QAAQ,CAAsB;IACtC,OAAO,CAAC,SAAS,CAAS;gBAEd,SAAS,CAAC,EAAE,MAAM;IAIxB,OAAO,IAAI,OAAO,CAAC,IAAI,CAAC;IAaxB,UAAU,IAAI,OAAO,CAAC,IAAI,CAAC;IAIjC,WAAW,IAAI,OAAO;IAIhB,YAAY,CAAC,KAAK,EAAE,MAAM,EAAE,OAAO,CAAC,EAAE,mBAAmB,GAAG,OAAO,CAAC,YAAY,EAAE,CAAC;IA2CnF,WAAW,CAAC,IAAI,EAAE,MAAM,EAAE,OAAO,CAAC,EAAE,kBAAkB,GAAG,OAAO,CAAC,MAAM,CAAC;IAkBxE,SAAS,CAAC,EAAE,EAAE,MAAM,GAAG,OAAO,CAAC,MAAM,GAAG,IAAI,CAAC;IAO7C,YAAY,CAChB,EAAE,EAAE,MAAM,EACV,OAAO,EAAE;QAAE,IAAI,CAAC,EAAE,MAAM,CAAC;QAAC,IAAI,CAAC,EAAE,MAAM,EAAE,CAAC;QAAC,QAAQ,CAAC,EAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,CAAA;KAAE,GAC9E,OAAO,CAAC,IAAI,CAAC;IAYV,aAAa,CAAC,GAAG,EAAE,MAAM,EAAE,QAAQ,CAAC,EAAE,oBAAoB,GAAG,OAAO,CAAC,mBAAmB,CAAC;IAS/F,OAAO,CAAC,eAAe;YAIT,OAAO;IAIrB,OAAO,CAAC,QAAQ;IAYhB,OAAO,CAAC,YAAY;CAGrB"}

package/dist/adapters/json-memory-client.js

@@ -0,0 +1,187 @@
+/**
+ * JsonMemoryClient — A zero-dependency file-backed memory implementation.
+ *
+ * Stores memories as a JSON array in `~/.automatey/memory.json`.
+ * Full-text search is BM25-inspired: tf-idf over words, substring matching for
+ * short queries.
+ *
+ * Trade-offs vs Memento / SQLite:
+ *   + Zero dependencies — no native addons, no network
+ *   + JSON is human-readable and grep-able
+ *   − No vector embeddings → purely lexical recall
+ *   − Full scan on search (fast up to ~50K entries)
+ *   − No URL hydration or LLM cleanup in enhanceMemory (throws)
+ *
+ * Switch to MementoMemoryClient or SqliteMemoryClient for semantic search.
+ */
+import { createHash } from 'node:crypto';
+import { existsSync } from 'node:fs';
+import { readFile, writeFile, mkdir } from 'node:fs/promises';
+import { homedir } from 'node:os';
+import { join } from 'node:path';
+// ── Token / TF-IDF helpers ────────────────────────────────────────────────
+function tokenize(text) {
+    return text
+        .toLowerCase()
+        .replace(/[^a-z0-9\s]/g, ' ')
+        .split(/\s+/)
+        .filter(t => t.length > 1);
+}
+/** Compute a simple BM25-inspired score (k1=1.5, b=0.75). */
+function bm25Score(queryTokens, docTokens, avgDocLen) {
+    const k1 = 1.5;
+    const b = 0.75;
+    const docLen = docTokens.length;
+    const freqMap = new Map();
+    for (const t of docTokens)
+        freqMap.set(t, (freqMap.get(t) ?? 0) + 1);
+    let score = 0;
+    for (const qt of queryTokens) {
+        const tf = freqMap.get(qt) ?? 0;
+        if (tf === 0)
+            continue;
+        const idf = 1; // no corpus IDF without global stats — treat as 1
+        const tfNorm = (tf * (k1 + 1)) / (tf + k1 * (1 - b + b * (docLen / avgDocLen)));
+        score += idf * tfNorm;
+    }
+    return score;
+}
+// ── JsonMemoryClient ──────────────────────────────────────────────────────
+export class JsonMemoryClient {
+    storePath;
+    memories = [];
+    connected = false;
+    constructor(storePath) {
+        this.storePath = storePath ?? join(homedir(), '.automatey', 'memory.json');
+    }
+    async connect() {
+        await mkdir(join(homedir(), '.automatey'), { recursive: true });
+        if (existsSync(this.storePath)) {
+            try {
+                const raw = await readFile(this.storePath, 'utf-8');
+                this.memories = JSON.parse(raw);
+            }
+            catch {
+                this.memories = [];
+            }
+        }
+        this.connected = true;
+    }
+    async disconnect() {
+        this.connected = false;
+    }
+    isConnected() {
+        return this.connected;
+    }
+    async searchMemory(query, options) {
+        this.assertConnected();
+        const k = options?.k ?? 8;
+        const namespaces = options?.namespace
+            ? Array.isArray(options.namespace) ? options.namespace : [options.namespace]
+            : null;
+        const tagFilter = options?.tagFilter?.split(',').map(t => t.trim().toLowerCase()) ?? null;
+        const queryTokens = tokenize(query);
+        const lowerQuery = query.toLowerCase();
+        // Filter to matching namespaces + tags
+        let pool = this.memories.filter(m => {
+            if (namespaces && !namespaces.includes(m.namespace))
+                return false;
+            if (tagFilter && !tagFilter.every(t => m.tags.some(mt => mt.toLowerCase().includes(t))))
+                return false;
+            return true;
+        });
+        if (pool.length === 0)
+            return [];
+        const avgDocLen = pool.reduce((s, m) => s + tokenize(m.text).length, 0) / pool.length;
+        const scored = pool.map(mem => {
+            const docTokens = tokenize(mem.text);
+            let score = bm25Score(queryTokens, docTokens, avgDocLen);
+            // Boost exact substring matches
+            if (mem.text.toLowerCase().includes(lowerQuery))
+                score += 2;
+            return { mem, score };
+        });
+        return scored
+            .filter(x => x.score > 0)
+            .sort((a, b) => b.score - a.score)
+            .slice(0, k)
+            .map(x => ({
+            id: x.mem.id,
+            text: x.mem.text,
+            score: Math.min(x.score / 10, 1), // normalise to [0,1] approximately
+            namespace: x.mem.namespace,
+            tags: x.mem.tags,
+        }));
+    }
+    async storeMemory(text, options) {
+        this.assertConnected();
+        const id = createHash('sha256').update(text + Date.now()).digest('hex').slice(0, 16);
+        const now = new Date().toISOString();
+        const record = {
+            id,
+            text,
+            namespace: options?.namespace ?? 'default',
+            tags: options?.tags?.split(',').map(t => t.trim()).filter(Boolean) ?? [],
+            metadata: options?.metadata ? this.tryParseJson(options.metadata) : {},
+            createdAt: now,
+            updatedAt: now,
+        };
+        this.memories.push(record);
+        await this.persist();
+        return id;
+    }
+    async getMemory(id) {
+        this.assertConnected();
+        const m = this.memories.find(x => x.id === id);
+        if (!m)
+            return null;
+        return this.toMemory(m);
+    }
+    async updateMemory(id, updates) {
+        this.assertConnected();
+        const idx = this.memories.findIndex(x => x.id === id);
+        if (idx < 0)
+            throw new Error(`Memory not found: ${id}`);
+        const m = this.memories[idx];
+        if (updates.text !== undefined)
+            m.text = updates.text;
+        if (updates.tags !== undefined)
+            m.tags = updates.tags;
+        if (updates.metadata !== undefined)
+            m.metadata = updates.metadata;
+        m.updatedAt = new Date().toISOString();
+        await this.persist();
+    }
+    async enhanceMemory(_id, _options) {
+        throw new Error('JsonMemoryClient does not support enhanceMemory. ' +
+            'Use MementoMemoryClient for URL hydration and LLM cleanup.');
+    }
+    // ── Private helpers ──────────────────────────────────────────────────────
+    assertConnected() {
+        if (!this.connected)
+            throw new Error('JsonMemoryClient not connected. Call connect() first.');
+    }
+    async persist() {
+        await writeFile(this.storePath, JSON.stringify(this.memories, null, 2), 'utf-8');
+    }
+    toMemory(m) {
+        return {
+            id: m.id,
+            text: m.text,
+            namespace: m.namespace,
+            tags: m.tags,
+            metadata: m.metadata,
+            createdAt: new Date(m.createdAt),
+            updatedAt: new Date(m.updatedAt),
+        };
+    }
+    tryParseJson(s) {
+        try {
+            return JSON.parse(s);
+        }
+        catch {
+            return {};
+        }
+    }
+}
+//# sourceMappingURL=json-memory-client.js.map

package/dist/adapters/json-memory-client.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"json-memory-client.js","sourceRoot":"","sources":["../../src/adapters/json-memory-client.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;;GAeG;AAEH,OAAO,EAAE,UAAU,EAAc,MAAM,aAAa,CAAC;AACrD,OAAO,EAAE,UAAU,EAAE,MAAM,SAAS,CAAC;AACrC,OAAO,EAAE,QAAQ,EAAE,SAAS,EAAE,KAAK,EAAE,MAAM,kBAAkB,CAAC;AAC9D,OAAO,EAAE,OAAO,EAAE,MAAM,SAAS,CAAC;AAClC,OAAO,EAAE,IAAI,EAAE,MAAM,WAAW,CAAC;AAuBjC,6EAA6E;AAE7E,SAAS,QAAQ,CAAC,IAAY;IAC5B,OAAO,IAAI;SACR,WAAW,EAAE;SACb,OAAO,CAAC,cAAc,EAAE,GAAG,CAAC;SAC5B,KAAK,CAAC,KAAK,CAAC;SACZ,MAAM,CAAC,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC,MAAM,GAAG,CAAC,CAAC,CAAC;AAC/B,CAAC;AAED,6DAA6D;AAC7D,SAAS,SAAS,CAAC,WAAqB,EAAE,SAAmB,EAAE,SAAiB;IAC9E,MAAM,EAAE,GAAG,GAAG,CAAC;IACf,MAAM,CAAC,GAAG,IAAI,CAAC;IACf,MAAM,MAAM,GAAG,SAAS,CAAC,MAAM,CAAC;IAChC,MAAM,OAAO,GAAG,IAAI,GAAG,EAAkB,CAAC;IAC1C,KAAK,MAAM,CAAC,IAAI,SAAS;QAAE,OAAO,CAAC,GAAG,CAAC,CAAC,EAAE,CAAC,OAAO,CAAC,GAAG,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC;IAErE,IAAI,KAAK,GAAG,CAAC,CAAC;IACd,KAAK,MAAM,EAAE,IAAI,WAAW,EAAE,CAAC;QAC7B,MAAM,EAAE,GAAG,OAAO,CAAC,GAAG,CAAC,EAAE,CAAC,IAAI,CAAC,CAAC;QAChC,IAAI,EAAE,KAAK,CAAC;YAAE,SAAS;QACvB,MAAM,GAAG,GAAG,CAAC,CAAC,CAAC,kDAAkD;QACjE,MAAM,MAAM,GAAG,CAAC,EAAE,GAAG,CAAC,EAAE,GAAG,CAAC,CAAC,CAAC,GAAG,CAAC,EAAE,GAAG,EAAE,GAAG,CAAC,CAAC,GAAG,CAAC,GAAG,CAAC,GAAG,CAAC,MAAM,GAAG,SAAS,CAAC,CAAC,CAAC,CAAC;QAChF,KAAK,IAAI,GAAG,GAAG,MAAM,CAAC;IACxB,CAAC;IACD,OAAO,KAAK,CAAC;AACf,CAAC;AAED,6EAA6E;AAE7E,MAAM,OAAO,gBAAgB;IACnB,SAAS,CAAS;IAClB,QAAQ,GAAmB,EAAE,CAAC;IAC9B,SAAS,GAAG,KAAK,CAAC;IAE1B,YAAY,SAAkB;QAC5B,IAAI,CAAC,SAAS,GAAG,SAAS,IAAI,IAAI,CAAC,OAAO,EAAE,EAAE,YAAY,EAAE,aAAa,CAAC,CAAC;IAC7E,CAAC;IAED,KAAK,CAAC,OAAO;QACX,MAAM,KAAK,CAAC,IAAI,CAAC,OAAO,EAAE,EAAE,YAAY,CAAC,EAAE,EAAE,SAAS,EAAE,IAAI,EAAE,CAAC,CAAC;QAChE,IAAI,UAAU,CAAC,IAAI,CAAC,SAAS,CAAC,EAAE,CAAC;YAC/B,IAAI,CAAC;gBACH,MAAM,GAAG,GAAG,MAAM,QAAQ,CAAC,IAAI,CAAC,SAAS,EAAE,OAAO,CAAC,CAAC;gBACpD,IAAI,CAAC,QAAQ,GAAG,IAAI,CAAC,KAAK,CAAC,GAAG,CAAmB,CAAC;YACpD,CAAC;YAAC,MAAM,CAAC;gBACP,IAAI,CAAC,QAAQ,GAAG,EAAE,CAAC;YACrB,CAAC;QACH,CAAC;QACD,IAAI,CAAC,SAAS,GAAG,IAAI,CAAC;IACxB,CAAC;IAED,KAAK,CAAC,UAAU;QACd,IAAI,CAAC,SAAS,GAAG,KAAK,CAAC;IACzB,CAAC;IAED,WAAW;QACT,OAAO,IAAI,CAAC,SAAS,CAAC;IACxB,CAAC;IAED,KAAK,CAAC,YAAY,CAAC,KAAa,EAAE,OAA6B;QAC7D,IAAI,CAAC,eAAe,EAAE,CAAC;QACvB,MAAM,CAAC,GAAG,OAAO,EAAE,CAAC,IAAI,CAAC,CAAC;QAC1B,MAAM,UAAU,GAAG,OAAO,EAAE,SAAS;YACnC,CAAC,CAAC,KAAK,CAAC,OAAO,CAAC,OAAO,CAAC,SAAS,CAAC,CAAC,CAAC,CAAC,OAAO,CAAC,SAAS,CAAC,CAAC,CAAC,CAAC,OAAO,CAAC,SAAS,CAAC;YAC5E,CAAC,CAAC,IAAI,CAAC;QACT,MAAM,SAAS,GAAG,OAAO,EAAE,SAAS,EAAE,KAAK,CAAC,GAAG,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC,IAAI,EAAE,CAAC,WAAW,EAAE,CAAC,IAAI,IAAI,CAAC;QAE1F,MAAM,WAAW,GAAG,QAAQ,CAAC,KAAK,CAAC,CAAC;QACpC,MAAM,UAAU,GAAG,KAAK,CAAC,WAAW,EAAE,CAAC;QAEvC,uCAAuC;QACvC,IAAI,IAAI,GAAG,IAAI,CAAC,QAAQ,CAAC,MAAM,CAAC,CAAC,CAAC,EAAE;YAClC,IAAI,UAAU,IAAI,CAAC,UAAU,CAAC,QAAQ,CAAC,CAAC,CAAC,SAAS,CAAC;gBAAE,OAAO,KAAK,CAAC;YAClE,IAAI,SAAS,IAAI,CAAC,SAAS,CAAC,KAAK,CAAC,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC,IAAI,CAAC,IAAI,CAAC,EAAE,CAAC,EAAE,CAAC,EAAE,CAAC,WAAW,EAAE,CAAC,QAAQ,CAAC,CAAC,CAAC,CAAC,CAAC;gBAAE,OAAO,KAAK,CAAC;YACtG,OAAO,IAAI,CAAC;QACd,CAAC,CAAC,CAAC;QAEH,IAAI,IAAI,CAAC,MAAM,KAAK,CAAC;YAAE,OAAO,EAAE,CAAC;QAEjC,MAAM,SAAS,GAAG,IAAI,CAAC,MAAM,CAAC,CAAC,CAAC,EAAE,CAAC,EAAE,EAAE,CAAC,CAAC,GAAG,QAAQ,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC,MAAM,EAAE,CAAC,CAAC,GAAG,IAAI,CAAC,MAAM,CAAC;QAEtF,MAAM,MAAM,GAAG,IAAI,CAAC,GAAG,CAAC,GAAG,CAAC,EAAE;YAC5B,MAAM,SAAS,GAAG,QAAQ,CAAC,GAAG,CAAC,IAAI,CAAC,CAAC;YACrC,IAAI,KAAK,GAAG,SAAS,CAAC,WAAW,EAAE,SAAS,EAAE,SAAS,CAAC,CAAC;YACzD,gCAAgC;YAChC,IAAI,GAAG,CAAC,IAAI,CAAC,WAAW,EAAE,CAAC,QAAQ,CAAC,UAAU,CAAC;gBAAE,KAAK,IAAI,CAAC,CAAC;YAC5D,OAAO,EAAE,GAAG,EAAE,KAAK,EAAE,CAAC;QACxB,CAAC,CAAC,CAAC;QAEH,OAAO,MAAM;aACV,MAAM,CAAC,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC,KAAK,GAAG,CAAC,CAAC;aACxB,IAAI,CAAC,CAAC,CAAC,EAAE,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,KAAK,GAAG,CAAC,CAAC,KAAK,CAAC;aACjC,KAAK,CAAC,CAAC,EAAE,CAAC,CAAC;aACX,GAAG,CAAC,CAAC,CAAC,EAAE,CAAC,CAAC;YACT,EAAE,EAAE,CAAC,CAAC,GAAG,CAAC,EAAE;YACZ,IAAI,EAAE,CAAC,CAAC,GAAG,CAAC,IAAI;YAChB,KAAK,EAAE,IAAI,CAAC,GAAG,CAAC,CAAC,CAAC,KAAK,GAAG,EAAE,EAAE,CAAC,CAAC,EAAE,mCAAmC;YACrE,SAAS,EAAE,CAAC,CAAC,GAAG,CAAC,SAAS;YAC1B,IAAI,EAAE,CAAC,CAAC,GAAG,CAAC,IAAI;SACjB,CAAC,CAAC,CAAC;IACR,CAAC;IAED,KAAK,CAAC,WAAW,CAAC,IAAY,EAAE,OAA4B;QAC1D,IAAI,CAAC,eAAe,EAAE,CAAC;QACvB,MAAM,EAAE,GAAG,UAAU,CAAC,QAAQ,CAAC,CAAC,MAAM,CAAC,IAAI,GAAG,IAAI,CAAC,GAAG,EAAE,CAAC,CAAC,MAAM,CAAC,KAAK,CAAC,CAAC,KAAK,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC;QACrF,MAAM,GAAG,GAAG,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,CAAC;QACrC,MAAM,MAAM,GAAiB;YAC3B,EAAE;YACF,IAAI;YACJ,SAAS,EAAE,OAAO,EAAE,SAAS,IAAI,SAAS;YAC1C,IAAI,EAAE,OAAO,EAAE,IAAI,EAAE,KAAK,CAAC,GAAG,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC,IAAI,EAAE,CAAC,CAAC,MAAM,CAAC,OAAO,CAAC,IAAI,EAAE;YACxE,QAAQ,EAAE,OAAO,EAAE,QAAQ,CAAC,CAAC,CAAC,IAAI,CAAC,YAAY,CAAC,OAAO,CAAC,QAAQ,CAAC,CAAC,CAAC,CAAC,EAAE;YACtE,SAAS,EAAE,GAAG;YACd,SAAS,EAAE,GAAG;SACf,CAAC;QACF,IAAI,CAAC,QAAQ,CAAC,IAAI,CAAC,MAAM,CAAC,CAAC;QAC3B,MAAM,IAAI,CAAC,OAAO,EAAE,CAAC;QACrB,OAAO,EAAE,CAAC;IACZ,CAAC;IAED,KAAK,CAAC,SAAS,CAAC,EAAU;QACxB,IAAI,CAAC,eAAe,EAAE,CAAC;QACvB,MAAM,CAAC,GAAG,IAAI,CAAC,QAAQ,CAAC,IAAI,CAAC,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC,EAAE,KAAK,EAAE,CAAC,CAAC;QAC/C,IAAI,CAAC,CAAC;YAAE,OAAO,IAAI,CAAC;QACpB,OAAO,IAAI,CAAC,QAAQ,CAAC,CAAC,CAAC,CAAC;IAC1B,CAAC;IAED,KAAK,CAAC,YAAY,CAChB,EAAU,EACV,OAA+E;QAE/E,IAAI,CAAC,eAAe,EAAE,CAAC;QACvB,MAAM,GAAG,GAAG,IAAI,CAAC,QAAQ,CAAC,SAAS,CAAC,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC,EAAE,KAAK,EAAE,CAAC,CAAC;QACtD,IAAI,GAAG,GAAG,CAAC;YAAE,MAAM,IAAI,KAAK,CAAC,qBAAqB,EAAE,EAAE,CAAC,CAAC;QACxD,MAAM,CAAC,GAAG,IAAI,CAAC,QAAQ,CAAC,GAAG,CAAC,CAAC;QAC7B,IAAI,OAAO,CAAC,IAAI,KAAK,SAAS;YAAE,CAAC,CAAC,IAAI,GAAG,OAAO,CAAC,IAAI,CAAC;QACtD,IAAI,OAAO,CAAC,IAAI,KAAK,SAAS;YAAE,CAAC,CAAC,IAAI,GAAG,OAAO,CAAC,IAAI,CAAC;QACtD,IAAI,OAAO,CAAC,QAAQ,KAAK,SAAS;YAAE,CAAC,CAAC,QAAQ,GAAG,OAAO,CAAC,QAAQ,CAAC;QAClE,CAAC,CAAC,SAAS,GAAG,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,CAAC;QACvC,MAAM,IAAI,CAAC,OAAO,EAAE,CAAC;IACvB,CAAC;IAED,KAAK,CAAC,aAAa,CAAC,GAAW,EAAE,QAA+B;QAC9D,MAAM,IAAI,KAAK,CACb,mDAAmD;YACnD,4DAA4D,CAC7D,CAAC;IACJ,CAAC;IAED,4EAA4E;IAEpE,eAAe;QACrB,IAAI,CAAC,IAAI,CAAC,SAAS;YAAE,MAAM,IAAI,KAAK,CAAC,uDAAuD,CAAC,CAAC;IAChG,CAAC;IAEO,KAAK,CAAC,OAAO;QACnB,MAAM,SAAS,CAAC,IAAI,CAAC,SAAS,EAAE,IAAI,CAAC,SAAS,CAAC,IAAI,CAAC,QAAQ,EAAE,IAAI,EAAE,CAAC,CAAC,EAAE,OAAO,CAAC,CAAC;IACnF,CAAC;IAEO,QAAQ,CAAC,CAAe;QAC9B,OAAO;YACL,EAAE,EAAE,CAAC,CAAC,EAAE;YACR,IAAI,EAAE,CAAC,CAAC,IAAI;YACZ,SAAS,EAAE,CAAC,CAAC,SAAS;YACtB,IAAI,EAAE,CAAC,CAAC,IAAI;YACZ,QAAQ,EAAE,CAAC,CAAC,QAAQ;YACpB,SAAS,EAAE,IAAI,IAAI,CAAC,CAAC,CAAC,SAAS,CAAC;YAChC,SAAS,EAAE,IAAI,IAAI,CAAC,CAAC,CAAC,SAAS,CAAC;SACjC,CAAC;IACJ,CAAC;IAEO,YAAY,CAAC,CAAS;QAC5B,IAAI,CAAC;YAAC,OAAO,IAAI,CAAC,KAAK,CAAC,CAAC,CAA4B,CAAC;QAAC,CAAC;QAAC,MAAM,CAAC;YAAC,OAAO,EAAE,CAAC;QAAC,CAAC;IAC/E,CAAC;CACF"}

package/dist/adapters/judge-client.d.ts

@@ -16,18 +16,14 @@
 import { z } from 'zod';
 import type { LLMProvider } from '#core/interfaces';
 export declare const JudgeVerdictSchema: z.ZodObject<{
-    verdict: z.ZodEnum<["correct", "incorrect", "uncertain"]>;
+    verdict: z.ZodEnum<{
+        correct: "correct";
+        incorrect: "incorrect";
+        uncertain: "uncertain";
+    }>;
     reasoning: z.ZodString;
     confidence: z.ZodNumber;
-}, "strip", z.ZodTypeAny, {
-    reasoning: string;
-    verdict: "correct" | "incorrect" | "uncertain";
-    confidence: number;
-}, {
-    reasoning: string;
-    verdict: "correct" | "incorrect" | "uncertain";
-    confidence: number;
-}>;
+}, z.core.$strip>;
 export type JudgeVerdict = z.infer<typeof JudgeVerdictSchema> & {
     /** Cited URLs from Perplexity responses (when EVAL_JUDGE_PROVIDER=perplexity). */
     sources?: string[];
@@ -63,22 +59,10 @@ export declare function judgeResult(config: JudgeConfig, question: string, expec
 export declare const QualityVerdictSchema: z.ZodObject<{
     score: z.ZodNumber;
     reasoning: z.ZodString;
-    strengths: z.ZodArray<z.ZodString, "many">;
-    weaknesses: z.ZodArray<z.ZodString, "many">;
-    suggestions: z.ZodArray<z.ZodString, "many">;
-}, "strip", z.ZodTypeAny, {
-    reasoning: string;
-    score: number;
-    strengths: string[];
-    weaknesses: string[];
-    suggestions: string[];
-}, {
-    reasoning: string;
-    score: number;
-    strengths: string[];
-    weaknesses: string[];
-    suggestions: string[];
-}>;
+    strengths: z.ZodArray<z.ZodString>;
+    weaknesses: z.ZodArray<z.ZodString>;
+    suggestions: z.ZodArray<z.ZodString>;
+}, z.core.$strip>;
 export type QualityVerdict = z.infer<typeof QualityVerdictSchema>;
 /**
  * Judge agent output quality with a structured 0-10 score and feedback.

package/dist/adapters/judge-client.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"judge-client.d.ts","sourceRoot":"","sources":["../../src/adapters/judge-client.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;GAcG;AAGH,OAAO,EAAE,CAAC,EAAE,MAAM,KAAK,CAAC;AACxB,OAAO,KAAK,EAAE,WAAW,EAAE,MAAM,kBAAkB,CAAC;AAKpD,eAAO,MAAM,kBAAkB;;;;;;;;;;;;EAI7B,CAAC;AAEH,MAAM,MAAM,YAAY,GAAG,CAAC,CAAC,KAAK,CAAC,OAAO,kBAAkB,CAAC,GAAG;IAC9D,kFAAkF;IAClF,OAAO,CAAC,EAAE,MAAM,EAAE,CAAC;CACpB,CAAC;AAEF,MAAM,MAAM,SAAS,GAAG,OAAO,GAAG,YAAY,GAAG,QAAQ,CAAC;AAE1D,MAAM,WAAW,WAAW;IAC1B,QAAQ,EAAE,WAAW,CAAC;IACtB,KAAK,EAAE,MAAM,CAAC;IACd,IAAI,EAAE,SAAS,CAAC;IAChB,wDAAwD;IACxD,OAAO,CAAC,EAAE,MAAM,CAAC;IACjB,6DAA6D;IAC7D,MAAM,CAAC,EAAE,MAAM,CAAC;CACjB;AAaD;;;GAGG;AACH,wBAAgB,kBAAkB,CAAC,eAAe,CAAC,EAAE,MAAM,GAAG,WAAW,GAAG,IAAI,CA0B/E;AAqBD;;;;;;;GAOG;AACH,wBAAsB,WAAW,CAC/B,MAAM,EAAE,WAAW,EACnB,QAAQ,EAAE,MAAM,EAChB,cAAc,EAAE,MAAM,EACtB,YAAY,EAAE,MAAM,GACnB,OAAO,CAAC,YAAY,CAAC,CA4BvB;AAID;;;GAGG;AACH,eAAO,MAAM,oBAAoB;;;;;;;;;;;;;;;;;;EAM/B,CAAC;AAEH,MAAM,MAAM,cAAc,GAAG,CAAC,CAAC,KAAK,CAAC,OAAO,oBAAoB,CAAC,CAAC;AAelE;;;;;;;;;GASG;AACH,wBAAsB,YAAY,CAChC,MAAM,EAAE,WAAW,EACnB,IAAI,EAAE,MAAM,EACZ,QAAQ,EAAE,MAAM,EAChB,YAAY,EAAE,MAAM,EACpB,MAAM,EAAE,MAAM,GACb,OAAO,CAAC,cAAc,CAAC,CA0BzB"}
+{"version":3,"file":"judge-client.d.ts","sourceRoot":"","sources":["../../src/adapters/judge-client.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;GAcG;AAGH,OAAO,EAAE,CAAC,EAAE,MAAM,KAAK,CAAC;AACxB,OAAO,KAAK,EAAE,WAAW,EAAE,MAAM,kBAAkB,CAAC;AAKpD,eAAO,MAAM,kBAAkB;;;;;;;;iBAI7B,CAAC;AAEH,MAAM,MAAM,YAAY,GAAG,CAAC,CAAC,KAAK,CAAC,OAAO,kBAAkB,CAAC,GAAG;IAC9D,kFAAkF;IAClF,OAAO,CAAC,EAAE,MAAM,EAAE,CAAC;CACpB,CAAC;AAEF,MAAM,MAAM,SAAS,GAAG,OAAO,GAAG,YAAY,GAAG,QAAQ,CAAC;AAE1D,MAAM,WAAW,WAAW;IAC1B,QAAQ,EAAE,WAAW,CAAC;IACtB,KAAK,EAAE,MAAM,CAAC;IACd,IAAI,EAAE,SAAS,CAAC;IAChB,wDAAwD;IACxD,OAAO,CAAC,EAAE,MAAM,CAAC;IACjB,6DAA6D;IAC7D,MAAM,CAAC,EAAE,MAAM,CAAC;CACjB;AAiBD;;;GAGG;AACH,wBAAgB,kBAAkB,CAAC,eAAe,CAAC,EAAE,MAAM,GAAG,WAAW,GAAG,IAAI,CA0B/E;AAqBD;;;;;;;GAOG;AACH,wBAAsB,WAAW,CAC/B,MAAM,EAAE,WAAW,EACnB,QAAQ,EAAE,MAAM,EAChB,cAAc,EAAE,MAAM,EACtB,YAAY,EAAE,MAAM,GACnB,OAAO,CAAC,YAAY,CAAC,CA4BvB;AAID;;;GAGG;AACH,eAAO,MAAM,oBAAoB;;;;;;iBAM/B,CAAC;AAEH,MAAM,MAAM,cAAc,GAAG,CAAC,CAAC,KAAK,CAAC,OAAO,oBAAoB,CAAC,CAAC;AAelE;;;;;;;;;GASG;AACH,wBAAsB,YAAY,CAChC,MAAM,EAAE,WAAW,EACnB,IAAI,EAAE,MAAM,EACZ,QAAQ,EAAE,MAAM,EAChB,YAAY,EAAE,MAAM,EACpB,MAAM,EAAE,MAAM,GACb,OAAO,CAAC,cAAc,CAAC,CA0BzB"}

package/dist/adapters/judge-client.js

@@ -28,6 +28,10 @@ const DEFAULT_MODELS = {
     openai: 'gpt-4o-mini',
     anthropic: 'claude-haiku-4-5',
     nemotron: 'nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16',
+    google: 'gemini-2.0-flash',
+    groq: 'llama-3.3-70b-versatile',
+    mistral: 'mistral-small-latest',
+    xai: 'grok-3-mini',
 };
 // ── Config factory ────────────────────────────────────────────────────────────
 /**
@@ -38,7 +42,7 @@ export function judgeConfigFromEnv(overrideBaseUrl) {
     const provider = process.env.EVAL_JUDGE_PROVIDER;
     if (!provider)
         return null;
-    const validProviders = ['perplexity', 'openai', 'anthropic', 'nemotron'];
+    const validProviders = ['perplexity', 'openai', 'anthropic', 'nemotron', 'google', 'groq', 'mistral', 'xai'];
     if (!validProviders.includes(provider)) {
         throw new Error(`EVAL_JUDGE_PROVIDER="${provider}" is not valid. Choose from: ${validProviders.join(', ')}`);
     }

package/dist/adapters/judge-client.js.map

@@ -1 +1 @@
-{"version":3,"file":"judge-client.js","sourceRoot":"","sources":["../../src/adapters/judge-client.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;GAcG;AAEH,OAAO,EAAE,cAAc,EAAE,MAAM,IAAI,CAAC;AACpC,OAAO,EAAE,CAAC,EAAE,MAAM,KAAK,CAAC;AAExB,OAAO,EAAE,UAAU,EAAE,MAAM,qBAAqB,CAAC;AAEjD,iFAAiF;AAEjF,MAAM,CAAC,MAAM,kBAAkB,GAAG,CAAC,CAAC,MAAM,CAAC;IACzC,OAAO,EAAE,CAAC,CAAC,IAAI,CAAC,CAAC,SAAS,EAAE,WAAW,EAAE,WAAW,CAAC,CAAC;IACtD,SAAS,EAAE,CAAC,CAAC,MAAM,EAAE;IACrB,UAAU,EAAE,CAAC,CAAC,MAAM,EAAE,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC;CACrC,CAAC,CAAC;AAmBH,iFAAiF;AAEjF,MAAM,cAAc,GAAgC;IAClD,UAAU,EAAE,WAAW;IACvB,MAAM,EAAE,aAAa;IACrB,SAAS,EAAE,kBAAkB;IAC7B,QAAQ,EAAE,4CAA4C;CACvD,CAAC;AAEF,iFAAiF;AAEjF;;;GAGG;AACH,MAAM,UAAU,kBAAkB,CAAC,eAAwB;IACzD,MAAM,QAAQ,GAAG,OAAO,CAAC,GAAG,CAAC,mBAA8C,CAAC;IAC5E,IAAI,CAAC,QAAQ;QAAE,OAAO,IAAI,CAAC;IAE3B,MAAM,cAAc,GAAkB,CAAC,YAAY,EAAE,QAAQ,EAAE,WAAW,EAAE,UAAU,CAAC,CAAC;IACxF,IAAI,CAAC,cAAc,CAAC,QAAQ,CAAC,QAAQ,CAAC,EAAE,CAAC;QACvC,MAAM,IAAI,KAAK,CACb,wBAAwB,QAAQ,gCAAgC,cAAc,CAAC,IAAI,CAAC,IAAI,CAAC,EAAE,CAC5F,CAAC;IACJ,CAAC;IAED,MAAM,KAAK,GAAG,OAAO,CAAC,GAAG,CAAC,gBAAgB,IAAI,cAAc,CAAC,QAAQ,CAAC,CAAC;IACvE,MAAM,OAAO,GAAG,OAAO,CAAC,GAAG,CAAC,eAAe,IAAI,YAAY,CAAC;IAC5D,MAAM,UAAU,GAAgB,CAAC,OAAO,EAAE,YAAY,EAAE,QAAQ,CAAC,CAAC;IAClE,IAAI,CAAC,UAAU,CAAC,QAAQ,CAAC,OAAoB,CAAC,EAAE,CAAC;QAC/C,MAAM,IAAI,KAAK,CACb,oBAAoB,OAAO,gCAAgC,UAAU,CAAC,IAAI,CAAC,IAAI,CAAC,EAAE,CACnF,CAAC;IACJ,CAAC;IAED,OAAO;QACL,QAAQ;QACR,KAAK;QACL,IAAI,EAAE,OAAoB;QAC1B,OAAO,EAAE,OAAO,CAAC,GAAG,CAAC,YAAY,IAAI,eAAe;KACrD,CAAC;AACJ,CAAC;AAED,gFAAgF;AAEhF,SAAS,eAAe,CAAC,MAAmB;IAC1C,OAAO,UAAU,CAAC;QAChB,QAAQ,EAAE,MAAM,CAAC,QAAQ;QACzB,KAAK,EAAE,MAAM,CAAC,KAAK;QACnB,MAAM,EAAE,MAAM,CAAC,MAAM;QACrB,OAAO,EAAE,MAAM,CAAC,OAAO;KACxB,CAAC,CAAC;AACL,CAAC;AAED,iFAAiF;AAEjF,MAAM,mBAAmB,GACvB,gGAAgG;IAChG,uDAAuD;IACvD,8EAA8E;IAC9E,mEAAmE,CAAC;AAEtE;;;;;;;GAOG;AACH,MAAM,CAAC,KAAK,UAAU,WAAW,CAC/B,MAAmB,EACnB,QAAgB,EAChB,cAAsB,EACtB,YAAoB;IAEpB,MAAM,KAAK,GAAG,eAAe,CAAC,MAAM,CAAC,CAAC;IAEtC,MAAM,MAAM,GACV,aAAa,QAAQ,MAAM;QAC3B,oBAAoB,cAAc,MAAM;QACxC,oBAAoB,YAAY,EAAE,CAAC;IAErC,MAAM,MAAM,GAAG,MAAM,cAAc,CAAC;QAClC,KAAK;QACL,MAAM,EAAE,kBAAkB;QAC1B,MAAM,EAAE,mBAAmB;QAC3B,MAAM;QACN,UAAU,EAAE,CAAC;KACd,CAAC,CAAC;IAEH,MAAM,OAAO,GAAiB,EAAE,GAAG,MAAM,CAAC,MAAM,EAAE,CAAC;IAEnD,mEAAmE;IACnE,MAAM,IAAI,GAAI,MAAgH,CAAC,6BAA6B,CAAC;IAC7J,MAAM,OAAO,GAAG,IAAI,EAAE,UAAU,EAAE,OAAO;QACvC,EAAE,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,EAAE,GAAG,CAAC;SACnB,MAAM,CAAC,CAAC,CAAC,EAAe,EAAE,CAAC,OAAO,CAAC,KAAK,QAAQ,CAAC,CAAC;IACrD,IAAI,OAAO,IAAI,OAAO,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;QAClC,OAAO,CAAC,OAAO,GAAG,OAAO,CAAC;IAC5B,CAAC;IAED,OAAO,OAAO,CAAC;AACjB,CAAC;AAED,iFAAiF;AAEjF;;;GAGG;AACH,MAAM,CAAC,MAAM,oBAAoB,GAAG,CAAC,CAAC,MAAM,CAAC;IAC3C,KAAK,EAAE,CAAC,CAAC,MAAM,EAAE,CAAC,QAAQ,CAAC,iDAAiD,CAAC;IAC7E,SAAS,EAAE,CAAC,CAAC,MAAM,EAAE,CAAC,QAAQ,CAAC,gCAAgC,CAAC;IAChE,SAAS,EAAE,CAAC,CAAC,KAAK,CAAC,CAAC,CAAC,MAAM,EAAE,CAAC,CAAC,QAAQ,CAAC,yBAAyB,CAAC;IAClE,UAAU,EAAE,CAAC,CAAC,KAAK,CAAC,CAAC,CAAC,MAAM,EAAE,CAAC,CAAC,QAAQ,CAAC,qCAAqC,CAAC;IAC/E,WAAW,EAAE,CAAC,CAAC,KAAK,CAAC,CAAC,CAAC,MAAM,EAAE,CAAC,CAAC,QAAQ,CAAC,6DAA6D,CAAC;CACzG,CAAC,CAAC;AAIH,MAAM,oBAAoB,GACxB,kEAAkE;IAClE,sBAAsB;IACtB,8CAA8C;IAC9C,sDAAsD;IACtD,2CAA2C;IAC3C,mCAAmC;IACnC,uEAAuE;IACvE,2EAA2E;IAC3E,uDAAuD;IACvD,mFAAmF;IACnF,oFAAoF,CAAC;AAEvF;;;;;;;;;GASG;AACH,MAAM,CAAC,KAAK,UAAU,YAAY,CAChC,MAAmB,EACnB,IAAY,EACZ,QAAgB,EAChB,YAAoB,EACpB,MAAc;IAEd,MAAM,KAAK,GAAG,eAAe,CAAC,MAAM,CAAC,CAAC;IAEtC,MAAM,MAAM,GAAG;QACb,SAAS;QACT,IAAI;QACJ,EAAE;QACF,wBAAwB;QACxB,QAAQ;QACR,EAAE;QACF,gCAAgC;QAChC,YAAY;QACZ,EAAE;QACF,iBAAiB;QACjB,MAAM,CAAC,KAAK,CAAC,CAAC,EAAE,MAAM,CAAC;KACxB,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC;IAEb,MAAM,MAAM,GAAG,MAAM,cAAc,CAAC;QAClC,KAAK;QACL,MAAM,EAAE,oBAAoB;QAC5B,MAAM,EAAE,oBAAoB;QAC5B,MAAM;QACN,UAAU,EAAE,CAAC;KACd,CAAC,CAAC;IAEH,OAAO,MAAM,CAAC,MAAM,CAAC;AACvB,CAAC"}
+{"version":3,"file":"judge-client.js","sourceRoot":"","sources":["../../src/adapters/judge-client.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;GAcG;AAEH,OAAO,EAAE,cAAc,EAAE,MAAM,IAAI,CAAC;AACpC,OAAO,EAAE,CAAC,EAAE,MAAM,KAAK,CAAC;AAExB,OAAO,EAAE,UAAU,EAAE,MAAM,qBAAqB,CAAC;AAEjD,iFAAiF;AAEjF,MAAM,CAAC,MAAM,kBAAkB,GAAG,CAAC,CAAC,MAAM,CAAC;IACzC,OAAO,EAAE,CAAC,CAAC,IAAI,CAAC,CAAC,SAAS,EAAE,WAAW,EAAE,WAAW,CAAC,CAAC;IACtD,SAAS,EAAE,CAAC,CAAC,MAAM,EAAE;IACrB,UAAU,EAAE,CAAC,CAAC,MAAM,EAAE,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC;CACrC,CAAC,CAAC;AAmBH,iFAAiF;AAEjF,MAAM,cAAc,GAAgC;IAClD,UAAU,EAAE,WAAW;IACvB,MAAM,EAAE,aAAa;IACrB,SAAS,EAAE,kBAAkB;IAC7B,QAAQ,EAAE,4CAA4C;IACtD,MAAM,EAAE,kBAAkB;IAC1B,IAAI,EAAE,yBAAyB;IAC/B,OAAO,EAAE,sBAAsB;IAC/B,GAAG,EAAE,aAAa;CACnB,CAAC;AAEF,iFAAiF;AAEjF;;;GAGG;AACH,MAAM,UAAU,kBAAkB,CAAC,eAAwB;IACzD,MAAM,QAAQ,GAAG,OAAO,CAAC,GAAG,CAAC,mBAA8C,CAAC;IAC5E,IAAI,CAAC,QAAQ;QAAE,OAAO,IAAI,CAAC;IAE3B,MAAM,cAAc,GAAkB,CAAC,YAAY,EAAE,QAAQ,EAAE,WAAW,EAAE,UAAU,EAAE,QAAQ,EAAE,MAAM,EAAE,SAAS,EAAE,KAAK,CAAC,CAAC;IAC5H,IAAI,CAAC,cAAc,CAAC,QAAQ,CAAC,QAAQ,CAAC,EAAE,CAAC;QACvC,MAAM,IAAI,KAAK,CACb,wBAAwB,QAAQ,gCAAgC,cAAc,CAAC,IAAI,CAAC,IAAI,CAAC,EAAE,CAC5F,CAAC;IACJ,CAAC;IAED,MAAM,KAAK,GAAG,OAAO,CAAC,GAAG,CAAC,gBAAgB,IAAI,cAAc,CAAC,QAAQ,CAAC,CAAC;IACvE,MAAM,OAAO,GAAG,OAAO,CAAC,GAAG,CAAC,eAAe,IAAI,YAAY,CAAC;IAC5D,MAAM,UAAU,GAAgB,CAAC,OAAO,EAAE,YAAY,EAAE,QAAQ,CAAC,CAAC;IAClE,IAAI,CAAC,UAAU,CAAC,QAAQ,CAAC,OAAoB,CAAC,EAAE,CAAC;QAC/C,MAAM,IAAI,KAAK,CACb,oBAAoB,OAAO,gCAAgC,UAAU,CAAC,IAAI,CAAC,IAAI,CAAC,EAAE,CACnF,CAAC;IACJ,CAAC;IAED,OAAO;QACL,QAAQ;QACR,KAAK;QACL,IAAI,EAAE,OAAoB;QAC1B,OAAO,EAAE,OAAO,CAAC,GAAG,CAAC,YAAY,IAAI,eAAe;KACrD,CAAC;AACJ,CAAC;AAED,gFAAgF;AAEhF,SAAS,eAAe,CAAC,MAAmB;IAC1C,OAAO,UAAU,CAAC;QAChB,QAAQ,EAAE,MAAM,CAAC,QAAQ;QACzB,KAAK,EAAE,MAAM,CAAC,KAAK;QACnB,MAAM,EAAE,MAAM,CAAC,MAAM;QACrB,OAAO,EAAE,MAAM,CAAC,OAAO;KACxB,CAAC,CAAC;AACL,CAAC;AAED,iFAAiF;AAEjF,MAAM,mBAAmB,GACvB,gGAAgG;IAChG,uDAAuD;IACvD,8EAA8E;IAC9E,mEAAmE,CAAC;AAEtE;;;;;;;GAOG;AACH,MAAM,CAAC,KAAK,UAAU,WAAW,CAC/B,MAAmB,EACnB,QAAgB,EAChB,cAAsB,EACtB,YAAoB;IAEpB,MAAM,KAAK,GAAG,eAAe,CAAC,MAAM,CAAC,CAAC;IAEtC,MAAM,MAAM,GACV,aAAa,QAAQ,MAAM;QAC3B,oBAAoB,cAAc,MAAM;QACxC,oBAAoB,YAAY,EAAE,CAAC;IAErC,MAAM,MAAM,GAAG,MAAM,cAAc,CAAC;QAClC,KAAK;QACL,MAAM,EAAE,kBAAkB;QAC1B,MAAM,EAAE,mBAAmB;QAC3B,MAAM;QACN,UAAU,EAAE,CAAC;KACd,CAAC,CAAC;IAEH,MAAM,OAAO,GAAiB,EAAE,GAAG,MAAM,CAAC,MAAM,EAAE,CAAC;IAEnD,mEAAmE;IACnE,MAAM,IAAI,GAAI,MAAgH,CAAC,6BAA6B,CAAC;IAC7J,MAAM,OAAO,GAAG,IAAI,EAAE,UAAU,EAAE,OAAO;QACvC,EAAE,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,EAAE,GAAG,CAAC;SACnB,MAAM,CAAC,CAAC,CAAC,EAAe,EAAE,CAAC,OAAO,CAAC,KAAK,QAAQ,CAAC,CAAC;IACrD,IAAI,OAAO,IAAI,OAAO,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;QAClC,OAAO,CAAC,OAAO,GAAG,OAAO,CAAC;IAC5B,CAAC;IAED,OAAO,OAAO,CAAC;AACjB,CAAC;AAED,iFAAiF;AAEjF;;;GAGG;AACH,MAAM,CAAC,MAAM,oBAAoB,GAAG,CAAC,CAAC,MAAM,CAAC;IAC3C,KAAK,EAAE,CAAC,CAAC,MAAM,EAAE,CAAC,QAAQ,CAAC,iDAAiD,CAAC;IAC7E,SAAS,EAAE,CAAC,CAAC,MAAM,EAAE,CAAC,QAAQ,CAAC,gCAAgC,CAAC;IAChE,SAAS,EAAE,CAAC,CAAC,KAAK,CAAC,CAAC,CAAC,MAAM,EAAE,CAAC,CAAC,QAAQ,CAAC,yBAAyB,CAAC;IAClE,UAAU,EAAE,CAAC,CAAC,KAAK,CAAC,CAAC,CAAC,MAAM,EAAE,CAAC,CAAC,QAAQ,CAAC,qCAAqC,CAAC;IAC/E,WAAW,EAAE,CAAC,CAAC,KAAK,CAAC,CAAC,CAAC,MAAM,EAAE,CAAC,CAAC,QAAQ,CAAC,6DAA6D,CAAC;CACzG,CAAC,CAAC;AAIH,MAAM,oBAAoB,GACxB,kEAAkE;IAClE,sBAAsB;IACtB,8CAA8C;IAC9C,sDAAsD;IACtD,2CAA2C;IAC3C,mCAAmC;IACnC,uEAAuE;IACvE,2EAA2E;IAC3E,uDAAuD;IACvD,mFAAmF;IACnF,oFAAoF,CAAC;AAEvF;;;;;;;;;GASG;AACH,MAAM,CAAC,KAAK,UAAU,YAAY,CAChC,MAAmB,EACnB,IAAY,EACZ,QAAgB,EAChB,YAAoB,EACpB,MAAc;IAEd,MAAM,KAAK,GAAG,eAAe,CAAC,MAAM,CAAC,CAAC;IAEtC,MAAM,MAAM,GAAG;QACb,SAAS;QACT,IAAI;QACJ,EAAE;QACF,wBAAwB;QACxB,QAAQ;QACR,EAAE;QACF,gCAAgC;QAChC,YAAY;QACZ,EAAE;QACF,iBAAiB;QACjB,MAAM,CAAC,KAAK,CAAC,CAAC,EAAE,MAAM,CAAC;KACxB,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC;IAEb,MAAM,MAAM,GAAG,MAAM,cAAc,CAAC;QAClC,KAAK;QACL,MAAM,EAAE,oBAAoB;QAC5B,MAAM,EAAE,oBAAoB;QAC5B,MAAM;QACN,UAAU,EAAE,CAAC;KACd,CAAC,CAAC;IAEH,OAAO,MAAM,CAAC,MAAM,CAAC;AACvB,CAAC"}

package/dist/adapters/llm-client.d.ts

@@ -49,7 +49,14 @@ export declare class LLMClient implements ILLMClient {
      */
     private _buildProviderOptions;
     private _toAIMessages;
+    /**
+     * Flatten oneOf/anyOf in property schemas to the first concrete type.
+     * vLLM's Jinja2 chat template cannot handle oneOf/anyOf in tool parameter schemas.
+     */
+    private _flattenSchema;
     private _toAITools;
     private _mapFinish;
+    private _recoverFromReasoning;
+    private _stripThinkingArtifacts;
 }
 //# sourceMappingURL=llm-client.d.ts.map

package/dist/adapters/llm-client.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"llm-client.d.ts","sourceRoot":"","sources":["../../src/adapters/llm-client.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;GAaG;AAcH,OAAO,KAAK,EACV,WAAW,EACX,YAAY,EACZ,UAAU,EACV,WAAW,EACX,OAAO,EAGR,MAAM,kBAAkB,CAAC;AAG1B,MAAM,WAAW,eAAe;IAC9B,QAAQ,EAAE,WAAW,CAAC;IACtB,KAAK,EAAE,MAAM,CAAC;IACd,eAAe,CAAC,EAAE,MAAM,EAAE,CAAC;IAC3B,uDAAuD;IACvD,OAAO,CAAC,EAAE,MAAM,CAAC;IACjB,sCAAsC;IACtC,MAAM,CAAC,EAAE,MAAM,CAAC;CACjB;AAED,qBAAa,SAAU,YAAW,UAAU;IAC1C,OAAO,CAAC,QAAQ,CAAc;IAC9B,OAAO,CAAC,YAAY,CAAS;IAC7B,OAAO,CAAC,eAAe,CAAW;IAClC,OAAO,CAAC,OAAO,CAAS;IACxB,OAAO,CAAC,gBAAgB,CAAU;IAClC,OAAO,CAAC,MAAM,CAAqB;gBAEvB,MAAM,EAAE,eAAe;IASnC,kBAAkB,IAAI,MAAM,EAAE;IAC9B,eAAe,IAAI,MAAM;IACzB,QAAQ,CAAC,KAAK,EAAE,MAAM,GAAG,IAAI;IASvB,IAAI,CAAC,QAAQ,EAAE,OAAO,EAAE,EAAE,OAAO,CAAC,EAAE,WAAW,GAAG,OAAO,CAAC,YAAY,CAAC;YAgB/D,OAAO;YA8FP,SAAS;IA8CvB,OAAO,CAAC,WAAW;IAwDnB,yFAAyF;IACzF,OAAO,CAAC,uBAAuB;IAI/B,0EAA0E;IAC1E,OAAO,CAAC,mBAAmB;IAQ3B;;;;;OAKG;IACH,OAAO,CAAC,qBAAqB;IAiC7B,OAAO,CAAC,aAAa;IAyCrB,OAAO,CAAC,UAAU;IAYlB,OAAO,CAAC,UAAU;CAKnB"}
+{"version":3,"file":"llm-client.d.ts","sourceRoot":"","sources":["../../src/adapters/llm-client.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;GAaG;AAkBH,OAAO,KAAK,EACV,WAAW,EACX,YAAY,EACZ,UAAU,EACV,WAAW,EACX,OAAO,EAGR,MAAM,kBAAkB,CAAC;AAG1B,MAAM,WAAW,eAAe;IAC9B,QAAQ,EAAE,WAAW,CAAC;IACtB,KAAK,EAAE,MAAM,CAAC;IACd,eAAe,CAAC,EAAE,MAAM,EAAE,CAAC;IAC3B,uDAAuD;IACvD,OAAO,CAAC,EAAE,MAAM,CAAC;IACjB,sCAAsC;IACtC,MAAM,CAAC,EAAE,MAAM,CAAC;CACjB;AAED,qBAAa,SAAU,YAAW,UAAU;IAC1C,OAAO,CAAC,QAAQ,CAAc;IAC9B,OAAO,CAAC,YAAY,CAAS;IAC7B,OAAO,CAAC,eAAe,CAAW;IAClC,OAAO,CAAC,OAAO,CAAS;IACxB,OAAO,CAAC,gBAAgB,CAAU;IAClC,OAAO,CAAC,MAAM,CAAqB;gBAEvB,MAAM,EAAE,eAAe;IASnC,kBAAkB,IAAI,MAAM,EAAE;IAC9B,eAAe,IAAI,MAAM;IACzB,QAAQ,CAAC,KAAK,EAAE,MAAM,GAAG,IAAI;IASvB,IAAI,CAAC,QAAQ,EAAE,OAAO,EAAE,EAAE,OAAO,CAAC,EAAE,WAAW,GAAG,OAAO,CAAC,YAAY,CAAC;YAkB/D,OAAO;YA8GP,SAAS;IAgEvB,OAAO,CAAC,WAAW;IA4EnB,yFAAyF;IACzF,OAAO,CAAC,uBAAuB;IAK/B,0EAA0E;IAC1E,OAAO,CAAC,mBAAmB;IAQ3B;;;;;OAKG;IACH,OAAO,CAAC,qBAAqB;IAiC7B,OAAO,CAAC,aAAa;IAyCrB;;;OAGG;IACH,OAAO,CAAC,cAAc;IA0BtB,OAAO,CAAC,UAAU;IAalB,OAAO,CAAC,UAAU;IAMlB,OAAO,CAAC,qBAAqB;IA4C7B,OAAO,CAAC,uBAAuB;CAMhC"}