@nestbox-ai/cli 1.0.64 → 1.0.67

package/README.md

@@ -52,7 +52,7 @@ Options:
 - [`document`](#document) - Manage Nestbox documents and collections
 - [`image`](#image) - Manage Nestbox images
 - [`doc-proc`](#doc-proc) - Document processing pipeline management
-- [`generate`](#generate) - AI-assisted configuration and project generation
+- [`generate`](#generate) - AI-assisted configuration generation (Anthropic or OpenAI)
 
 ---
 
@@ -916,7 +916,7 @@ nestbox doc-proc health [options]
 
 ### `generate`
 
-AI-assisted generation of configuration files and project scaffolds. Uses Claude to generate validated YAML configurations from plain-English instruction files.
+AI-assisted generation of configuration files and project scaffolds. Uses an AI agent (Anthropic Claude or OpenAI GPT, your choice) to produce validated YAML configurations from plain-English instruction files. The agent writes, validates against the schema, and iterates automatically until the output is valid.
 
 ---
 
@@ -950,36 +950,47 @@ nestbox generate project my-chatbot --lang js --template chatbot
 
 ### `generate doc-proc`
 
-Generate a document processing pipeline configuration (`config.yaml` and `eval.yaml`) from a plain-English instructions file using Claude AI.
+Generate a document processing pipeline configuration (`config.yaml` and `eval.yaml`) from a plain-English instructions file using AI.
 
-The agent reads your instructions, writes both files, validates each against their schemas, and iterates automatically until both pass validation.
+The agent reads your instructions, writes both files, validates each against their schemas, and iterates automatically until both pass validation. Supports **Anthropic Claude** and **OpenAI GPT** — provide one API key to select the provider.
 
 ```bash
-nestbox generate doc-proc --file <path> --output <dir> --anthropicApiKey <key> [options]
+nestbox generate doc-proc --file <path> --output <dir> [--anthropicApiKey <key> | --openAiApiKey <key>] [options]
 ```
 
 **Required options:**
 - `-f, --file <path>` - Path to a Markdown file describing what the pipeline should do
 - `-o, --output <dir>` - Output directory where `config.yaml` and `eval.yaml` will be written
-- `--anthropicApiKey <key>` - Anthropic API key (or set `ANTHROPIC_API_KEY` env var)
+
+**API key (one required):**
+- `--anthropicApiKey <key>` - Use Claude (Anthropic). Also reads `ANTHROPIC_API_KEY` env var
+- `--openAiApiKey <key>` - Use GPT (OpenAI). Also reads `OPENAI_API_KEY` env var
+
+When both are provided, Anthropic takes precedence.
 
 **Optional options:**
-- `--model <model>` - Claude model ID (default: `claude-sonnet-4-6`)
+- `--model <model>` - Model ID. Defaults to `claude-sonnet-4-6` (Anthropic) or `gpt-4o` (OpenAI)
 - `--maxIterations <n>` - Maximum agent iterations before giving up (default: `8`)
 
 **Output files:**
 - `config.yaml` — document processing pipeline configuration
 - `eval.yaml` — evaluation test cases for the pipeline
 
-**Example:**
+**Examples:**
 ```bash
-# Using a flag for the API key
+# Anthropic Claude
 nestbox generate doc-proc \
   --file ./instructions.md \
   --output ./pipeline \
   --anthropicApiKey sk-ant-...
 
-# Using the environment variable
+# OpenAI GPT
+nestbox generate doc-proc \
+  --file ./instructions.md \
+  --output ./pipeline \
+  --openAiApiKey sk-...
+
+# Via environment variables
 export ANTHROPIC_API_KEY=sk-ant-...
 nestbox generate doc-proc --file ./instructions.md --output ./pipeline
 ```
@@ -1001,32 +1012,48 @@ Eval test cases:
 
 ### `generate report-composer`
 
-Generate a GraphRAG report composer configuration (`report.yaml`) from a plain-English instructions file using Claude AI.
+Generate a GraphRAG report composer configuration (`report.yaml`) from a plain-English instructions file using AI.
 
-The agent reads your instructions, writes the report configuration, validates it against the schema (v2.2), and iterates automatically until it passes — it will not finish until the file is valid.
+The agent reads your instructions, writes the report configuration, validates it against the schema (v2.2), and iterates automatically until it passes — it will not finish until the file is valid. Supports **Anthropic Claude** and **OpenAI GPT** — provide one API key to select the provider.
 
 ```bash
-nestbox generate report-composer --file <path> --output <dir> --anthropicApiKey <key> [options]
+nestbox generate report-composer --file <path> --output <dir> [--anthropicApiKey <key> | --openAiApiKey <key>] [options]
 ```
 
 **Required options:**
 - `-f, --file <path>` - Path to a Markdown file describing the report to generate
 - `-o, --output <dir>` - Output directory where `report.yaml` will be written
-- `--anthropicApiKey <key>` - Anthropic API key (or set `ANTHROPIC_API_KEY` env var)
+
+**API key (one required):**
+- `--anthropicApiKey <key>` - Use Claude (Anthropic). Also reads `ANTHROPIC_API_KEY` env var
+- `--openAiApiKey <key>` - Use GPT (OpenAI). Also reads `OPENAI_API_KEY` env var
+
+When both are provided, Anthropic takes precedence.
 
 **Optional options:**
-- `--model <model>` - Claude model ID (default: `claude-sonnet-4-6`)
+- `--model <model>` - Model ID. Defaults to `claude-sonnet-4-6` (Anthropic) or `gpt-4o` (OpenAI)
 - `--maxIterations <n>` - Maximum agent iterations before giving up (default: `5`)
 
 **Output files:**
 - `report.yaml` — report composer configuration (schema version 2.2)
 
-**Example:**
+**Examples:**
 ```bash
+# Anthropic Claude
 nestbox generate report-composer \
   --file ./report-instructions.md \
   --output ~/Downloads/my-report \
   --anthropicApiKey sk-ant-...
+
+# OpenAI GPT
+nestbox generate report-composer \
+  --file ./report-instructions.md \
+  --output ~/Downloads/my-report \
+  --openAiApiKey sk-...
+
+# Via environment variable
+export OPENAI_API_KEY=sk-...
+nestbox generate report-composer --file ./report-instructions.md --output ~/Downloads/my-report
 ```
 
 **Example instructions file (`report-instructions.md`):**

package/dist/agents/docProc/anthropic.d.ts

@@ -0,0 +1,21 @@
+export interface DocProcAgentOptions {
+    /** Full instruction text (from the instructions file) */
+    instructions: string;
+    /** Anthropic API key */
+    anthropicApiKey: string;
+    /** Claude model ID, e.g. "claude-sonnet-4-6" */
+    model?: string;
+    /** Maximum agentic iterations before giving up */
+    maxIterations?: number;
+    /** Called on each status update (for spinner / logging) */
+    onProgress?: (message: string) => void;
+}
+export interface DocProcAgentResult {
+    configYaml: string;
+    evalYaml: string;
+    iterations: number;
+    configValid: boolean;
+    evalValid: boolean;
+}
+export declare const DEFAULT_MODEL = "claude-sonnet-4-6";
+export declare function runDocProcAgent(options: DocProcAgentOptions): Promise<DocProcAgentResult>;

package/dist/agents/docProc/anthropic.js

@@ -0,0 +1,225 @@
+"use strict";
+var __awaiter = (this && this.__awaiter) || function (thisArg, _arguments, P, generator) {
+    function adopt(value) { return value instanceof P ? value : new P(function (resolve) { resolve(value); }); }
+    return new (P || (P = Promise))(function (resolve, reject) {
+        function fulfilled(value) { try { step(generator.next(value)); } catch (e) { reject(e); } }
+        function rejected(value) { try { step(generator["throw"](value)); } catch (e) { reject(e); } }
+        function step(result) { result.done ? resolve(result.value) : adopt(result.value).then(fulfilled, rejected); }
+        step((generator = generator.apply(thisArg, _arguments || [])).next());
+    });
+};
+var __importDefault = (this && this.__importDefault) || function (mod) {
+    return (mod && mod.__esModule) ? mod : { "default": mod };
+};
+Object.defineProperty(exports, "__esModule", { value: true });
+exports.DEFAULT_MODEL = void 0;
+exports.runDocProcAgent = runDocProcAgent;
+const sdk_1 = __importDefault(require("@anthropic-ai/sdk"));
+const fs_1 = __importDefault(require("fs"));
+const path_1 = __importDefault(require("path"));
+const js_yaml_1 = __importDefault(require("js-yaml"));
+const ajv_1 = __importDefault(require("ajv"));
+// ─── Constants ────────────────────────────────────────────────────────────────
+const AGENTS_DIR = __dirname;
+exports.DEFAULT_MODEL = 'claude-sonnet-4-6';
+const DEFAULT_MAX_ITERATIONS = 8;
+// ─── Helpers ─────────────────────────────────────────────────────────────────
+function readLocalFile(filename) {
+    return fs_1.default.readFileSync(path_1.default.join(AGENTS_DIR, filename), 'utf8');
+}
+function validateYaml(content, schemaContent) {
+    var _a;
+    // Replace ${ENV_VAR} references with a plain string so YAML parses cleanly
+    // and AJV treats them as valid string values.
+    const preprocessed = content.replace(/\$\{[^}]+\}/g, 'env-var-placeholder');
+    let data;
+    try {
+        data = js_yaml_1.default.load(preprocessed);
+    }
+    catch (e) {
+        return { valid: false, errors: [`YAML parse error: ${e.message}`] };
+    }
+    let schema;
+    try {
+        schema = js_yaml_1.default.load(schemaContent);
+    }
+    catch (e) {
+        return { valid: false, errors: [`Schema parse error: ${e.message}`] };
+    }
+    const ajv = new ajv_1.default({ strict: false, allErrors: true });
+    // Suppress "unknown format 'uri' ignored" console warnings from AJV
+    ajv.addFormat('uri', () => true);
+    const validate = ajv.compile(schema);
+    const ok = validate(data);
+    if (ok)
+        return { valid: true, errors: [] };
+    const errors = ((_a = validate.errors) !== null && _a !== void 0 ? _a : []).map((err) => {
+        const loc = err.instancePath || '(root)';
+        return `[${loc}] ${err.message}`;
+    });
+    return { valid: false, errors };
+}
+// ─── System Prompt ────────────────────────────────────────────────────────────
+function buildSystemPrompt() {
+    const systemPrompt = readLocalFile('SYSTEM_PROMPT.md');
+    const configGuide = readLocalFile('CONFIG_GUIDE.md');
+    const evalGuide = readLocalFile('EVAL_GUIDE.md');
+    return `${systemPrompt}\n\n---\n\n${configGuide}\n\n---\n\n${evalGuide}`;
+}
+// ─── Tool Definitions ─────────────────────────────────────────────────────────
+const TOOLS = [
+    {
+        name: 'write_and_validate_config',
+        description: 'Write the config.yaml content and validate it against the schema. Returns "VALID" on success or a list of validation errors to fix.',
+        input_schema: {
+            type: 'object',
+            properties: {
+                yaml_content: {
+                    type: 'string',
+                    description: 'The complete YAML content for config.yaml',
+                },
+            },
+            required: ['yaml_content'],
+        },
+    },
+    {
+        name: 'write_and_validate_eval',
+        description: 'Write the eval.yaml content and validate it against the schema. Returns "VALID" on success or a list of validation errors to fix.',
+        input_schema: {
+            type: 'object',
+            properties: {
+                yaml_content: {
+                    type: 'string',
+                    description: 'The complete YAML content for eval.yaml',
+                },
+            },
+            required: ['yaml_content'],
+        },
+    },
+    {
+        name: 'finish',
+        description: 'Signal that both files are complete and valid. Call this only after both write_and_validate_config and write_and_validate_eval have returned "VALID".',
+        input_schema: {
+            type: 'object',
+            properties: {
+                summary: {
+                    type: 'string',
+                    description: 'Brief summary of what was generated and why key choices were made',
+                },
+            },
+            required: ['summary'],
+        },
+    },
+];
+// ─── Agent ────────────────────────────────────────────────────────────────────
+function runDocProcAgent(options) {
+    return __awaiter(this, void 0, void 0, function* () {
+        const { instructions, anthropicApiKey, model = exports.DEFAULT_MODEL, maxIterations = DEFAULT_MAX_ITERATIONS, onProgress = () => { }, } = options;
+        const configSchema = readLocalFile('config.schema.yaml');
+        const evalSchema = readLocalFile('eval-test-cases.schema.yaml');
+        const client = new sdk_1.default({ apiKey: anthropicApiKey });
+        let latestConfig = '';
+        let latestEval = '';
+        let configValid = false;
+        let evalValid = false;
+        let finished = false;
+        let iteration = 0;
+        function executeTool(name, input) {
+            var _a, _b;
+            if (name === 'write_and_validate_config') {
+                const content = (_a = input.yaml_content) !== null && _a !== void 0 ? _a : '';
+                latestConfig = content;
+                const result = validateYaml(content, configSchema);
+                configValid = result.valid;
+                if (result.valid)
+                    return 'VALID';
+                return `VALIDATION ERRORS — fix all of these before calling again:\n${result.errors.map((e) => `  • ${e}`).join('\n')}`;
+            }
+            if (name === 'write_and_validate_eval') {
+                const content = (_b = input.yaml_content) !== null && _b !== void 0 ? _b : '';
+                latestEval = content;
+                const result = validateYaml(content, evalSchema);
+                evalValid = result.valid;
+                if (result.valid)
+                    return 'VALID';
+                return `VALIDATION ERRORS — fix all of these before calling again:\n${result.errors.map((e) => `  • ${e}`).join('\n')}`;
+            }
+            if (name === 'finish') {
+                finished = true;
+                return 'Done.';
+            }
+            return `Unknown tool: ${name}`;
+        }
+        // Build the system prompt once and mark it for caching.
+        // On iteration 1 the prompt is written to the cache (normal price).
+        // On iterations 2+ the large system prompt is read from cache at
+        // 10% of the normal input token price.
+        const systemPromptText = buildSystemPrompt();
+        const systemPrompt = [
+            {
+                type: 'text',
+                text: systemPromptText,
+                cache_control: { type: 'ephemeral' },
+            },
+        ];
+        const messages = [
+            {
+                role: 'user',
+                content: `Here are the instructions for the pipeline you need to configure:\n\n${instructions}\n\nGenerate the config.yaml and eval.yaml files now. Use the tools to write and validate them.`,
+            },
+        ];
+        onProgress('Starting agent...');
+        while (iteration < maxIterations && !finished) {
+            iteration++;
+            onProgress(`Iteration ${iteration}/${maxIterations} — calling Claude...`);
+            const response = yield client.messages.create({
+                model,
+                max_tokens: 8096,
+                system: systemPrompt,
+                tools: TOOLS,
+                // Force Claude to call a tool every turn — prevents it from
+                // replying with plain text and exiting the loop prematurely.
+                tool_choice: { type: 'any' },
+                messages,
+            });
+            // Append assistant turn
+            messages.push({ role: 'assistant', content: response.content });
+            if (response.stop_reason !== 'tool_use') {
+                onProgress(`Agent stopped unexpectedly: ${response.stop_reason}`);
+                break;
+            }
+            // Process all tool calls and collect results
+            const toolResults = [];
+            for (const block of response.content) {
+                if (block.type !== 'tool_use')
+                    continue;
+                onProgress(`  → tool: ${block.name}`);
+                const result = executeTool(block.name, block.input);
+                onProgress(`    ${result.startsWith('VALID') ? '✓ valid' : result.split('\n')[0]}`);
+                toolResults.push({
+                    type: 'tool_result',
+                    tool_use_id: block.id,
+                    content: result,
+                });
+                if (finished)
+                    break;
+            }
+            if (toolResults.length > 0) {
+                messages.push({ role: 'user', content: toolResults });
+            }
+            if (finished)
+                break;
+        }
+        if (iteration >= maxIterations && !finished) {
+            onProgress(`Warning: reached max iterations (${maxIterations}) without finishing.`);
+        }
+        return {
+            configYaml: latestConfig,
+            evalYaml: latestEval,
+            iterations: iteration,
+            configValid,
+            evalValid,
+        };
+    });
+}
+//# sourceMappingURL=anthropic.js.map

package/dist/agents/docProc/anthropic.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"anthropic.js","sourceRoot":"","sources":["../../../src/agents/docProc/anthropic.ts"],"names":[],"mappings":";;;;;;;;;;;;;;;AA8IA,0CAkIC;AAhRD,4DAA0C;AAC1C,4CAAoB;AACpB,gDAAwB;AACxB,sDAA2B;AAC3B,8CAAsB;AA8BtB,iFAAiF;AAEjF,MAAM,UAAU,GAAG,SAAS,CAAC;AAChB,QAAA,aAAa,GAAG,mBAAmB,CAAC;AACjD,MAAM,sBAAsB,GAAG,CAAC,CAAC;AAEjC,gFAAgF;AAEhF,SAAS,aAAa,CAAC,QAAgB;IACrC,OAAO,YAAE,CAAC,YAAY,CAAC,cAAI,CAAC,IAAI,CAAC,UAAU,EAAE,QAAQ,CAAC,EAAE,MAAM,CAAC,CAAC;AAClE,CAAC;AAED,SAAS,YAAY,CAAC,OAAe,EAAE,aAAqB;;IAC1D,2EAA2E;IAC3E,8CAA8C;IAC9C,MAAM,YAAY,GAAG,OAAO,CAAC,OAAO,CAAC,cAAc,EAAE,qBAAqB,CAAC,CAAC;IAE5E,IAAI,IAAa,CAAC;IAClB,IAAI,CAAC;QACH,IAAI,GAAG,iBAAI,CAAC,IAAI,CAAC,YAAY,CAAC,CAAC;IACjC,CAAC;IAAC,OAAO,CAAM,EAAE,CAAC;QAChB,OAAO,EAAE,KAAK,EAAE,KAAK,EAAE,MAAM,EAAE,CAAC,qBAAqB,CAAC,CAAC,OAAO,EAAE,CAAC,EAAE,CAAC;IACtE,CAAC;IAED,IAAI,MAAc,CAAC;IACnB,IAAI,CAAC;QACH,MAAM,GAAG,iBAAI,CAAC,IAAI,CAAC,aAAa,CAAW,CAAC;IAC9C,CAAC;IAAC,OAAO,CAAM,EAAE,CAAC;QAChB,OAAO,EAAE,KAAK,EAAE,KAAK,EAAE,MAAM,EAAE,CAAC,uBAAuB,CAAC,CAAC,OAAO,EAAE,CAAC,EAAE,CAAC;IACxE,CAAC;IAED,MAAM,GAAG,GAAG,IAAI,aAAG,CAAC,EAAE,MAAM,EAAE,KAAK,EAAE,SAAS,EAAE,IAAI,EAAE,CAAC,CAAC;IACxD,oEAAoE;IACpE,GAAG,CAAC,SAAS,CAAC,KAAK,EAAE,GAAG,EAAE,CAAC,IAAI,CAAC,CAAC;IACjC,MAAM,QAAQ,GAAG,GAAG,CAAC,OAAO,CAAC,MAAM,CAAC,CAAC;IACrC,MAAM,EAAE,GAAG,QAAQ,CAAC,IAAI,CAAC,CAAC;IAE1B,IAAI,EAAE;QAAE,OAAO,EAAE,KAAK,EAAE,IAAI,EAAE,MAAM,EAAE,EAAE,EAAE,CAAC;IAE3C,MAAM,MAAM,GAAG,CAAC,MAAA,QAAQ,CAAC,MAAM,mCAAI,EAAE,CAAC,CAAC,GAAG,CAAC,CAAC,GAAG,EAAE,EAAE;QACjD,MAAM,GAAG,GAAG,GAAG,CAAC,YAAY,IAAI,QAAQ,CAAC;QACzC,OAAO,IAAI,GAAG,KAAK,GAAG,CAAC,OAAO,EAAE,CAAC;IACnC,CAAC,CAAC,CAAC;IACH,OAAO,EAAE,KAAK,EAAE,KAAK,EAAE,MAAM,EAAE,CAAC;AAClC,CAAC;AAED,iFAAiF;AAEjF,SAAS,iBAAiB;IACxB,MAAM,YAAY,GAAG,aAAa,CAAC,kBAAkB,CAAC,CAAC;IACvD,MAAM,WAAW,GAAI,aAAa,CAAC,iBAAiB,CAAC,CAAC;IACtD,MAAM,SAAS,GAAM,aAAa,CAAC,eAAe,CAAC,CAAC;IAEpD,OAAO,GAAG,YAAY,cAAc,WAAW,cAAc,SAAS,EAAE,CAAC;AAC3E,CAAC;AAED,iFAAiF;AAEjF,MAAM,KAAK,GAAqB;IAC9B;QACE,IAAI,EAAE,2BAA2B;QACjC,WAAW,EACT,qIAAqI;QACvI,YAAY,EAAE;YACZ,IAAI,EAAE,QAAiB;YACvB,UAAU,EAAE;gBACV,YAAY,EAAE;oBACZ,IAAI,EAAE,QAAQ;oBACd,WAAW,EAAE,2CAA2C;iBACzD;aACF;YACD,QAAQ,EAAE,CAAC,cAAc,CAAC;SAC3B;KACF;IACD;QACE,IAAI,EAAE,yBAAyB;QAC/B,WAAW,EACT,mIAAmI;QACrI,YAAY,EAAE;YACZ,IAAI,EAAE,QAAiB;YACvB,UAAU,EAAE;gBACV,YAAY,EAAE;oBACZ,IAAI,EAAE,QAAQ;oBACd,WAAW,EAAE,yCAAyC;iBACvD;aACF;YACD,QAAQ,EAAE,CAAC,cAAc,CAAC;SAC3B;KACF;IACD;QACE,IAAI,EAAE,QAAQ;QACd,WAAW,EACT,uJAAuJ;QACzJ,YAAY,EAAE;YACZ,IAAI,EAAE,QAAiB;YACvB,UAAU,EAAE;gBACV,OAAO,EAAE;oBACP,IAAI,EAAE,QAAQ;oBACd,WAAW,EAAE,mEAAmE;iBACjF;aACF;YACD,QAAQ,EAAE,CAAC,SAAS,CAAC;SACtB;KACF;CACF,CAAC;AAEF,iFAAiF;AAEjF,SAAsB,eAAe,CAAC,OAA4B;;QAChE,MAAM,EACJ,YAAY,EACZ,eAAe,EACf,KAAK,GAAG,qBAAa,EACrB,aAAa,GAAG,sBAAsB,EACtC,UAAU,GAAG,GAAG,EAAE,GAAE,CAAC,GACtB,GAAG,OAAO,CAAC;QAEZ,MAAM,YAAY,GAAG,aAAa,CAAC,oBAAoB,CAAC,CAAC;QACzD,MAAM,UAAU,GAAG,aAAa,CAAC,6BAA6B,CAAC,CAAC;QAEhE,MAAM,MAAM,GAAG,IAAI,aAAS,CAAC,EAAE,MAAM,EAAE,eAAe,EAAE,CAAC,CAAC;QAE1D,IAAI,YAAY,GAAG,EAAE,CAAC;QACtB,IAAI,UAAU,GAAG,EAAE,CAAC;QACpB,IAAI,WAAW,GAAG,KAAK,CAAC;QACxB,IAAI,SAAS,GAAG,KAAK,CAAC;QACtB,IAAI,QAAQ,GAAG,KAAK,CAAC;QACrB,IAAI,SAAS,GAAG,CAAC,CAAC;QAElB,SAAS,WAAW,CAAC,IAAY,EAAE,KAA6B;;YAC9D,IAAI,IAAI,KAAK,2BAA2B,EAAE,CAAC;gBACzC,MAAM,OAAO,GAAG,MAAA,KAAK,CAAC,YAAY,mCAAI,EAAE,CAAC;gBACzC,YAAY,GAAG,OAAO,CAAC;gBACvB,MAAM,MAAM,GAAG,YAAY,CAAC,OAAO,EAAE,YAAY,CAAC,CAAC;gBACnD,WAAW,GAAG,MAAM,CAAC,KAAK,CAAC;gBAC3B,IAAI,MAAM,CAAC,KAAK;oBAAE,OAAO,OAAO,CAAC;gBACjC,OAAO,+DAA+D,MAAM,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,OAAO,CAAC,EAAE,CAAC,CAAC,IAAI,CAAC,IAAI,CAAC,EAAE,CAAC;YAC1H,CAAC;YAED,IAAI,IAAI,KAAK,yBAAyB,EAAE,CAAC;gBACvC,MAAM,OAAO,GAAG,MAAA,KAAK,CAAC,YAAY,mCAAI,EAAE,CAAC;gBACzC,UAAU,GAAG,OAAO,CAAC;gBACrB,MAAM,MAAM,GAAG,YAAY,CAAC,OAAO,EAAE,UAAU,CAAC,CAAC;gBACjD,SAAS,GAAG,MAAM,CAAC,KAAK,CAAC;gBACzB,IAAI,MAAM,CAAC,KAAK;oBAAE,OAAO,OAAO,CAAC;gBACjC,OAAO,+DAA+D,MAAM,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,OAAO,CAAC,EAAE,CAAC,CAAC,IAAI,CAAC,IAAI,CAAC,EAAE,CAAC;YAC1H,CAAC;YAED,IAAI,IAAI,KAAK,QAAQ,EAAE,CAAC;gBACtB,QAAQ,GAAG,IAAI,CAAC;gBAChB,OAAO,OAAO,CAAC;YACjB,CAAC;YAED,OAAO,iBAAiB,IAAI,EAAE,CAAC;QACjC,CAAC;QAED,wDAAwD;QACxD,oEAAoE;QACpE,iEAAiE;QACjE,uCAAuC;QACvC,MAAM,gBAAgB,GAAG,iBAAiB,EAAE,CAAC;QAC7C,MAAM,YAAY,GAA+B;YAC/C;gBACE,IAAI,EAAE,MAAM;gBACZ,IAAI,EAAE,gBAAgB;gBACtB,aAAa,EAAE,EAAE,IAAI,EAAE,WAAW,EAAE;aACrC;SACF,CAAC;QAEF,MAAM,QAAQ,GAA6B;YACzC;gBACE,IAAI,EAAE,MAAM;gBACZ,OAAO,EAAE,wEAAwE,YAAY,iGAAiG;aAC/L;SACF,CAAC;QAEF,UAAU,CAAC,mBAAmB,CAAC,CAAC;QAEhC,OAAO,SAAS,GAAG,aAAa,IAAI,CAAC,QAAQ,EAAE,CAAC;YAC9C,SAAS,EAAE,CAAC;YACZ,UAAU,CAAC,aAAa,SAAS,IAAI,aAAa,sBAAsB,CAAC,CAAC;YAE1E,MAAM,QAAQ,GAAG,MAAM,MAAM,CAAC,QAAQ,CAAC,MAAM,CAAC;gBAC5C,KAAK;gBACL,UAAU,EAAE,IAAI;gBAChB,MAAM,EAAE,YAAY;gBACpB,KAAK,EAAE,KAAK;gBACZ,4DAA4D;gBAC5D,6DAA6D;gBAC7D,WAAW,EAAE,EAAE,IAAI,EAAE,KAAK,EAAE;gBAC5B,QAAQ;aACT,CAAC,CAAC;YAEH,wBAAwB;YACxB,QAAQ,CAAC,IAAI,CAAC,EAAE,IAAI,EAAE,WAAW,EAAE,OAAO,EAAE,QAAQ,CAAC,OAAO,EAAE,CAAC,CAAC;YAEhE,IAAI,QAAQ,CAAC,WAAW,KAAK,UAAU,EAAE,CAAC;gBACxC,UAAU,CAAC,+BAA+B,QAAQ,CAAC,WAAW,EAAE,CAAC,CAAC;gBAClE,MAAM;YACR,CAAC;YAED,6CAA6C;YAC7C,MAAM,WAAW,GAAqC,EAAE,CAAC;YAEzD,KAAK,MAAM,KAAK,IAAI,QAAQ,CAAC,OAAO,EAAE,CAAC;gBACrC,IAAI,KAAK,CAAC,IAAI,KAAK,UAAU;oBAAE,SAAS;gBAExC,UAAU,CAAC,aAAa,KAAK,CAAC,IAAI,EAAE,CAAC,CAAC;gBACtC,MAAM,MAAM,GAAG,WAAW,CAAC,KAAK,CAAC,IAAI,EAAE,KAAK,CAAC,KAA+B,CAAC,CAAC;gBAC9E,UAAU,CAAC,OAAO,MAAM,CAAC,UAAU,CAAC,OAAO,CAAC,CAAC,CAAC,CAAC,SAAS,CAAC,CAAC,CAAC,MAAM,CAAC,KAAK,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC,EAAE,CAAC,CAAC;gBAEpF,WAAW,CAAC,IAAI,CAAC;oBACf,IAAI,EAAE,aAAa;oBACnB,WAAW,EAAE,KAAK,CAAC,EAAE;oBACrB,OAAO,EAAE,MAAM;iBAChB,CAAC,CAAC;gBAEH,IAAI,QAAQ;oBAAE,MAAM;YACtB,CAAC;YAED,IAAI,WAAW,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;gBAC3B,QAAQ,CAAC,IAAI,CAAC,EAAE,IAAI,EAAE,MAAM,EAAE,OAAO,EAAE,WAAW,EAAE,CAAC,CAAC;YACxD,CAAC;YAED,IAAI,QAAQ;gBAAE,MAAM;QACtB,CAAC;QAED,IAAI,SAAS,IAAI,aAAa,IAAI,CAAC,QAAQ,EAAE,CAAC;YAC5C,UAAU,CAAC,oCAAoC,aAAa,sBAAsB,CAAC,CAAC;QACtF,CAAC;QAED,OAAO;YACL,UAAU,EAAE,YAAY;YACxB,QAAQ,EAAE,UAAU;YACpB,UAAU,EAAE,SAAS;YACrB,WAAW;YACX,SAAS;SACV,CAAC;IACJ,CAAC;CAAA"}

package/dist/agents/docProc/index.d.ts

@@ -1,20 +1,2 @@
-export interface DocProcAgentOptions {
-    /** Full instruction text (from the instructions file) */
-    instructions: string;
-    /** Anthropic API key */
-    anthropicApiKey: string;
-    /** Claude model ID, e.g. "claude-opus-4-6" */
-    model?: string;
-    /** Maximum agentic iterations before giving up */
-    maxIterations?: number;
-    /** Called on each status update (for spinner / logging) */
-    onProgress?: (message: string) => void;
-}
-export interface DocProcAgentResult {
-    configYaml: string;
-    evalYaml: string;
-    iterations: number;
-    configValid: boolean;
-    evalValid: boolean;
-}
-export declare function runDocProcAgent(options: DocProcAgentOptions): Promise<DocProcAgentResult>;
+export { runDocProcAgent, DocProcAgentOptions, DocProcAgentResult, DEFAULT_MODEL as ANTHROPIC_DEFAULT_MODEL } from './anthropic';
+export { runDocProcAgentWithOpenAI, DocProcOpenAIAgentOptions, DEFAULT_MODEL as OPENAI_DEFAULT_MODEL } from './openai';

package/dist/agents/docProc/index.js

@@ -1,226 +1,10 @@
 "use strict";
-var __awaiter = (this && this.__awaiter) || function (thisArg, _arguments, P, generator) {
-    function adopt(value) { return value instanceof P ? value : new P(function (resolve) { resolve(value); }); }
-    return new (P || (P = Promise))(function (resolve, reject) {
-        function fulfilled(value) { try { step(generator.next(value)); } catch (e) { reject(e); } }
-        function rejected(value) { try { step(generator["throw"](value)); } catch (e) { reject(e); } }
-        function step(result) { result.done ? resolve(result.value) : adopt(result.value).then(fulfilled, rejected); }
-        step((generator = generator.apply(thisArg, _arguments || [])).next());
-    });
-};
-var __importDefault = (this && this.__importDefault) || function (mod) {
-    return (mod && mod.__esModule) ? mod : { "default": mod };
-};
 Object.defineProperty(exports, "__esModule", { value: true });
-exports.runDocProcAgent = runDocProcAgent;
-const sdk_1 = __importDefault(require("@anthropic-ai/sdk"));
-const fs_1 = __importDefault(require("fs"));
-const path_1 = __importDefault(require("path"));
-const js_yaml_1 = __importDefault(require("js-yaml"));
-const ajv_1 = __importDefault(require("ajv"));
-// ─── Constants ────────────────────────────────────────────────────────────────
-const AGENTS_DIR = __dirname;
-const DEFAULT_MODEL = 'claude-sonnet-4-6';
-const DEFAULT_MAX_ITERATIONS = 8;
-// ─── Helpers ─────────────────────────────────────────────────────────────────
-function readLocalFile(filename) {
-    return fs_1.default.readFileSync(path_1.default.join(AGENTS_DIR, filename), 'utf8');
-}
-function validateYaml(content, schemaContent) {
-    var _a;
-    // Replace ${ENV_VAR} references with a plain string so YAML parses cleanly
-    // and AJV treats them as valid string values.
-    const preprocessed = content.replace(/\$\{[^}]+\}/g, 'env-var-placeholder');
-    let data;
-    try {
-        data = js_yaml_1.default.load(preprocessed);
-    }
-    catch (e) {
-        return { valid: false, errors: [`YAML parse error: ${e.message}`] };
-    }
-    let schema;
-    try {
-        schema = js_yaml_1.default.load(schemaContent);
-    }
-    catch (e) {
-        return { valid: false, errors: [`Schema parse error: ${e.message}`] };
-    }
-    const ajv = new ajv_1.default({ strict: false, allErrors: true });
-    // Suppress "unknown format 'uri' ignored" console warnings from AJV
-    ajv.addFormat('uri', () => true);
-    const validate = ajv.compile(schema);
-    const ok = validate(data);
-    if (ok)
-        return { valid: true, errors: [] };
-    const errors = ((_a = validate.errors) !== null && _a !== void 0 ? _a : []).map((err) => {
-        const loc = err.instancePath || '(root)';
-        return `[${loc}] ${err.message}`;
-    });
-    return { valid: false, errors };
-}
-// ─── System Prompt ────────────────────────────────────────────────────────────
-function buildSystemPrompt() {
-    const systemPrompt = readLocalFile('SYSTEM_PROMPT.md');
-    const configGuide = readLocalFile('CONFIG_GUIDE.md');
-    const evalGuide = readLocalFile('EVAL_GUIDE.md');
-    return `${systemPrompt}\n\n---\n\n${configGuide}\n\n---\n\n${evalGuide}`;
-}
-// ─── Tool Definitions ─────────────────────────────────────────────────────────
-const TOOLS = [
-    {
-        name: 'write_and_validate_config',
-        description: 'Write the config.yaml content and validate it against the schema. Returns "VALID" on success or a list of validation errors to fix.',
-        input_schema: {
-            type: 'object',
-            properties: {
-                yaml_content: {
-                    type: 'string',
-                    description: 'The complete YAML content for config.yaml',
-                },
-            },
-            required: ['yaml_content'],
-        },
-    },
-    {
-        name: 'write_and_validate_eval',
-        description: 'Write the eval.yaml content and validate it against the schema. Returns "VALID" on success or a list of validation errors to fix.',
-        input_schema: {
-            type: 'object',
-            properties: {
-                yaml_content: {
-                    type: 'string',
-                    description: 'The complete YAML content for eval.yaml',
-                },
-            },
-            required: ['yaml_content'],
-        },
-    },
-    {
-        name: 'finish',
-        description: 'Signal that both files are complete and valid. Call this only after both write_and_validate_config and write_and_validate_eval have returned "VALID".',
-        input_schema: {
-            type: 'object',
-            properties: {
-                summary: {
-                    type: 'string',
-                    description: 'Brief summary of what was generated and why key choices were made',
-                },
-            },
-            required: ['summary'],
-        },
-    },
-];
-// ─── Agent ────────────────────────────────────────────────────────────────────
-function runDocProcAgent(options) {
-    return __awaiter(this, void 0, void 0, function* () {
-        const { instructions, anthropicApiKey, model = DEFAULT_MODEL, maxIterations = DEFAULT_MAX_ITERATIONS, onProgress = () => { }, } = options;
-        const configSchema = readLocalFile('config.schema.yaml');
-        const evalSchema = readLocalFile('eval-test-cases.schema.yaml');
-        const client = new sdk_1.default({ apiKey: anthropicApiKey });
-        // Mutable state updated by tool calls
-        let latestConfig = '';
-        let latestEval = '';
-        let configValid = false;
-        let evalValid = false;
-        let finished = false;
-        let iteration = 0;
-        // Execute a tool call and return the result string
-        function executeTool(name, input) {
-            var _a, _b;
-            if (name === 'write_and_validate_config') {
-                const content = (_a = input.yaml_content) !== null && _a !== void 0 ? _a : '';
-                latestConfig = content;
-                const result = validateYaml(content, configSchema);
-                configValid = result.valid;
-                if (result.valid)
-                    return 'VALID';
-                return `VALIDATION ERRORS — fix all of these before calling again:\n${result.errors.map((e) => `  • ${e}`).join('\n')}`;
-            }
-            if (name === 'write_and_validate_eval') {
-                const content = (_b = input.yaml_content) !== null && _b !== void 0 ? _b : '';
-                latestEval = content;
-                const result = validateYaml(content, evalSchema);
-                evalValid = result.valid;
-                if (result.valid)
-                    return 'VALID';
-                return `VALIDATION ERRORS — fix all of these before calling again:\n${result.errors.map((e) => `  • ${e}`).join('\n')}`;
-            }
-            if (name === 'finish') {
-                finished = true;
-                return 'Done.';
-            }
-            return `Unknown tool: ${name}`;
-        }
-        // Build the system prompt once and mark it for caching.
-        // On iteration 1 the prompt is written to the cache (normal price).
-        // On iterations 2+ the 20k-token system prompt is read from cache at
-        // 10% of the normal input token price — the biggest cost lever here.
-        const systemPromptText = buildSystemPrompt();
-        const systemPrompt = [
-            {
-                type: 'text',
-                text: systemPromptText,
-                cache_control: { type: 'ephemeral' },
-            },
-        ];
-        const messages = [
-            {
-                role: 'user',
-                content: `Here are the instructions for the pipeline you need to configure:\n\n${instructions}\n\nGenerate the config.yaml and eval.yaml files now. Use the tools to write and validate them.`,
-            },
-        ];
-        onProgress('Starting agent...');
-        while (iteration < maxIterations && !finished) {
-            iteration++;
-            onProgress(`Iteration ${iteration}/${maxIterations} — calling Claude...`);
-            const response = yield client.messages.create({
-                model,
-                max_tokens: 8096,
-                system: systemPrompt,
-                tools: TOOLS,
-                // Force Claude to call a tool every turn — prevents it from
-                // replying with plain text and exiting the loop prematurely.
-                tool_choice: { type: 'any' },
-                messages,
-            });
-            // Append assistant turn
-            messages.push({ role: 'assistant', content: response.content });
-            if (response.stop_reason !== 'tool_use') {
-                onProgress(`Agent stopped unexpectedly: ${response.stop_reason}`);
-                break;
-            }
-            // Process all tool calls and collect results
-            const toolResults = [];
-            for (const block of response.content) {
-                if (block.type !== 'tool_use')
-                    continue;
-                onProgress(`  → tool: ${block.name}`);
-                const result = executeTool(block.name, block.input);
-                onProgress(`    ${result.startsWith('VALID') ? '✓ valid' : result.split('\n')[0]}`);
-                toolResults.push({
-                    type: 'tool_result',
-                    tool_use_id: block.id,
-                    content: result,
-                });
-                if (finished)
-                    break;
-            }
-            if (toolResults.length > 0) {
-                messages.push({ role: 'user', content: toolResults });
-            }
-            if (finished)
-                break;
-        }
-        if (iteration >= maxIterations && !finished) {
-            onProgress(`Warning: reached max iterations (${maxIterations}) without finishing.`);
-        }
-        return {
-            configYaml: latestConfig,
-            evalYaml: latestEval,
-            iterations: iteration,
-            configValid,
-            evalValid,
-        };
-    });
-}
+exports.OPENAI_DEFAULT_MODEL = exports.runDocProcAgentWithOpenAI = exports.ANTHROPIC_DEFAULT_MODEL = exports.runDocProcAgent = void 0;
+var anthropic_1 = require("./anthropic");
+Object.defineProperty(exports, "runDocProcAgent", { enumerable: true, get: function () { return anthropic_1.runDocProcAgent; } });
+Object.defineProperty(exports, "ANTHROPIC_DEFAULT_MODEL", { enumerable: true, get: function () { return anthropic_1.DEFAULT_MODEL; } });
+var openai_1 = require("./openai");
+Object.defineProperty(exports, "runDocProcAgentWithOpenAI", { enumerable: true, get: function () { return openai_1.runDocProcAgentWithOpenAI; } });
+Object.defineProperty(exports, "OPENAI_DEFAULT_MODEL", { enumerable: true, get: function () { return openai_1.DEFAULT_MODEL; } });
 //# sourceMappingURL=index.js.map