@amodalai/runtime 0.1.26 → 0.2.1

package/dist/src/__fixtures__/README.md

@@ -0,0 +1,88 @@
+# Smoke Tests
+
+End-to-end integration tests that start a real `amodal dev` server with mock REST and MCP backends, then run assertions against the chat API using a live LLM.
+
+## Setup
+
+Create `.env.test` at the **repo root** with your API key:
+
+```
+ANTHROPIC_API_KEY=sk-ant-...
+```
+
+This file is gitignored. Tests skip automatically if the key isn't set.
+
+## Running
+
+```bash
+# All smoke tests (~90s, ~23 LLM calls)
+pnpm --filter @amodalai/runtime run test:smoke
+
+# Single test by name (~5s, 1 LLM call)
+pnpm --filter @amodalai/runtime run test:smoke -t "dispatch_task tool is available"
+
+# Multiple tests by pattern
+pnpm --filter @amodalai/runtime run test:smoke -t "dispatch_task|persists data"
+
+# Regex patterns work too
+pnpm --filter @amodalai/runtime run test:smoke -t "store.*persist"
+```
+
+> **No `--` before `-t`.** pnpm passes trailing args directly to vitest. Adding `--` breaks the flag parsing.
+
+The `-t` flag filters which `it()` blocks execute. The server still starts once (shared `beforeAll`), but only matched tests make LLM calls — so filtering saves both time and money.
+
+## What's tested
+
+| #   | Test               | What it verifies                                       |
+| --- | ------------------ | ------------------------------------------------------ |
+| 1   | health endpoint    | Server starts and responds                             |
+| 2   | config endpoint    | Agent config loads from repo                           |
+| 3   | system prompt (G9) | Prompt includes connections, skills, knowledge, stores |
+| 4   | chat streaming     | Init, text_delta, done events with usage               |
+| 5   | session resume     | Multi-turn context preserved across messages           |
+| 6   | store tool call    | Model calls query_store                                |
+| 7   | connection request | Request tool hits mock-api                             |
+| 8   | tool error status  | Failed tool calls report status: error                 |
+| 9   | eval run           | Eval suite executes and scores                         |
+| 10  | admin chat         | Admin agent reads repo files                           |
+| 11  | write intent (G8)  | POST with intent "read" rejected                       |
+| 12  | store persistence  | Write + query in separate sessions                     |
+| 13  | session isolation  | Concurrent sessions don't share context                |
+| 14  | automation API     | Automation endpoint responds                           |
+| 15  | multi-turn tools   | Tool call → reasoning about result                     |
+| 16  | evals list         | Eval suites listed from repo                           |
+| 17  | inspect endpoint   | Connection status visible                              |
+| 18  | MCP tool call      | MCP tool executes via stdio transport                  |
+| 19  | custom tool        | echo_tool with ctx.request + ctx.store                 |
+| 20  | stop_execution     | Tool is available to model                             |
+| 21  | done usage (G2)    | Done event always has token counts                     |
+| 22  | dispatch_task      | Child agent runs with tool subset                      |
+| 23  | dispatch available | dispatch_task tool in model's tool list                |
+
+## Architecture
+
+```
+smoke.test.ts          — test suite (vitest)
+smoke-agent/           — self-contained agent repo (.amodal/ config)
+  amodal.json          — agent config (name, model)
+  connections/         — mock-api (REST) + mock-mcp (MCP stdio)
+  stores/              — test-items store schema
+  skills/              — test-skill
+  knowledge/           — reference doc with tool list
+  tools/               — echo-tool custom handler
+  evals/               — basic-eval suite
+  automations/         — test-auto definition
+smoke-rest-server.mjs  — Express mock returning test data on :9901
+smoke-mcp-server.mjs   — MCP stdio server with search/lookup/count tools
+```
+
+The test `beforeAll` starts the mock REST server and `createLocalServer()` programmatically on port 9900. Tests call `POST /chat` and parse SSE events from the response.
+
+## Web tools (`web_search`, `fetch_url`)
+
+When `GOOGLE_API_KEY` is set in `.env.test`, `beforeAll` adds a `webTools` block to `amodal.json` so the agent registers the web tools alongside the existing ones. One additional test fires a real `web_search` call through whichever main provider `SMOKE_TARGET` selects — this exercises the cross-provider case (e.g. Anthropic main + Google-backed search). The web-tool test skips automatically when `GOOGLE_API_KEY` is absent.
+
+## LLM non-determinism
+
+Some tests depend on the model calling specific tools. When the model chooses not to (despite explicit instruction), the test skips gracefully with a console warning rather than failing. This prevents flaky CI from LLM variability while still catching real code bugs.

package/dist/src/__fixtures__/e2e.test.js

@@ -0,0 +1,211 @@
+/**
+ * @license
+ * Copyright 2026 Amodal Labs, Inc.
+ * SPDX-License-Identifier: MIT
+ */
+/**
+ * End-to-end tests for the agent loop against real LLM providers.
+ * Exercises:
+ *
+ *   - Token budget enforcement — the loop terminates with
+ *     DoneReason='budget_exceeded' when cumulative tokens hit maxSessionTokens.
+ *   - Summarizer hook — context eviction invokes summarizeToolResult
+ *     and the generated summary flows into subsequent prompts.
+ *
+ * Parameterized over multiple providers. Select which to run via the
+ * E2E_TARGETS env var (comma-separated); defaults to `google`
+ * (gemini-2.5-flash) as the cheapest base model. Targets missing an
+ * API key auto-skip.
+ *
+ *   E2E_TARGETS=google                   # base (default)
+ *   E2E_TARGETS=anthropic                # single provider
+ *   E2E_TARGETS=google,anthropic,openai,groq   # all
+ */
+import { describe, it, expect, beforeAll, afterAll } from 'vitest';
+import { z } from 'zod';
+import { StandaloneSessionManager } from '../session/manager.js';
+import { createPGLiteSessionStore } from '../session/pglite-session-store.js';
+import { createProvider } from '../providers/create-provider.js';
+import { createToolRegistry } from '../tools/registry.js';
+import { createLogger } from '../logger.js';
+import { SSEEventType } from '../types.js';
+import { loadTestEnv, defaultTargetName } from './test-env.js';
+// Pull API keys out of <repo-root>/.env.test (gitignored) so targets
+// whose keys are set can run; others auto-skip.
+loadTestEnv();
+const logger = createLogger({ component: 'test:e2e' });
+const TARGETS = {
+    google: { provider: 'google', model: 'gemini-2.5-flash', apiKeyEnv: 'GOOGLE_API_KEY' },
+    anthropic: { provider: 'anthropic', model: 'claude-haiku-4-5-20251001', apiKeyEnv: 'ANTHROPIC_API_KEY' },
+    openai: { provider: 'openai', model: 'gpt-4o-mini', apiKeyEnv: 'OPENAI_API_KEY' },
+    groq: { provider: 'groq', model: 'llama-3.3-70b-versatile', apiKeyEnv: 'GROQ_API_KEY' },
+};
+// If E2E_TARGETS is unset, fall through the shared preference chain
+// (google → anthropic → openai → groq) and pick the first target whose
+// API key is configured.
+const selected = (process.env['E2E_TARGETS'] ?? defaultTargetName(TARGETS))
+    .split(',')
+    .map((s) => s.trim())
+    .filter((s) => s.length > 0);
+const activeTargets = selected
+    .map((name) => [name, TARGETS[name]])
+    .filter((entry) => {
+    const [name, cfg] = entry;
+    if (!cfg) {
+        // eslint-disable-next-line no-console
+        console.warn(`[e2e] unknown target "${name}" — skipped. Known: ${Object.keys(TARGETS).join(', ')}`);
+        return false;
+    }
+    if (!process.env[cfg.apiKeyEnv]) {
+        // eslint-disable-next-line no-console
+        console.warn(`[e2e] ${name}: ${cfg.apiKeyEnv} not set — skipped`);
+        return false;
+    }
+    return true;
+});
+const allowAll = {
+    check: () => ({ allowed: true }),
+};
+/** Echo tool — returns a plain string so the model sees a clear result. */
+function makeEchoTool() {
+    return {
+        description: 'Echoes back the input value. Use this whenever the user asks you to echo something.',
+        parameters: z.object({ value: z.string() }),
+        execute: (params) => Promise.resolve(`echoed: ${params.value}`),
+        readOnly: true,
+        metadata: { category: 'custom' },
+    };
+}
+function buildRegistry() {
+    const registry = createToolRegistry();
+    registry.register('echo_tool', makeEchoTool());
+    return registry;
+}
+describe.skipIf(activeTargets.length === 0)('e2e', () => {
+    let store;
+    let mgr;
+    beforeAll(async () => {
+        store = await createPGLiteSessionStore({ logger });
+        mgr = new StandaloneSessionManager({ logger, store });
+        mgr.start();
+    });
+    afterAll(async () => {
+        await mgr.shutdown();
+        await store.close();
+    });
+    describe.each(activeTargets)('[%s]', (_name, target) => {
+        it('terminates with budget_exceeded when maxSessionTokens cap is hit', async () => {
+            const provider = createProvider({
+                provider: target.provider,
+                model: target.model,
+                apiKey: process.env[target.apiKeyEnv],
+            });
+            // Tiny budget — any first-turn input+output will blow past this,
+            // causing budget_exceeded to fire on the next outer-loop check.
+            // Small enough that every provider trips regardless of how terse
+            // the model chooses to be.
+            const MAX_TOKENS = 200;
+            const session = mgr.create({
+                provider,
+                toolRegistry: buildRegistry(),
+                permissionChecker: allowAll,
+                systemPrompt: 'You are a terse assistant. Use the echo_tool when asked.',
+                maxTurns: 10,
+                maxSessionTokens: MAX_TOKENS,
+            });
+            const events = [];
+            for await (const event of mgr.runMessage(session.id, 'Echo these strings one at a time: alpha, bravo, charlie, delta, echo, foxtrot. Use echo_tool for each.', { signal: AbortSignal.timeout(60_000) })) {
+                events.push(event);
+            }
+            const done = events.find((e) => e.type === SSEEventType.Done);
+            expect(done).toBeDefined();
+            if (done && done.type === SSEEventType.Done) {
+                expect(done.reason).toBe('budget_exceeded');
+                expect(done.usage?.total_tokens ?? 0).toBeGreaterThanOrEqual(MAX_TOKENS);
+            }
+        }, 90_000);
+        it('invokes summarizeToolResult hook when context is evicted', async () => {
+            const provider = createProvider({
+                provider: target.provider,
+                model: target.model,
+                apiKey: process.env[target.apiKeyEnv],
+            });
+            // Seed 20 tool-result messages so the default clearThreshold=15 fires
+            // on the very first turn. Messages are in pairs: an assistant tool-call
+            // followed by the tool result, matching the real shape. An initial
+            // user message is required to satisfy Anthropic's message-sequence
+            // validation (conversations must begin with user).
+            const seeded = [
+                { role: 'user', content: 'Please echo some seed values for me.' },
+            ];
+            for (let i = 0; i < 20; i++) {
+                seeded.push({
+                    role: 'assistant',
+                    content: [{
+                            type: 'tool-call',
+                            toolCallId: `c${i}`,
+                            toolName: 'echo_tool',
+                            input: { value: `seed-${i}` },
+                        }],
+                });
+                seeded.push({
+                    role: 'tool',
+                    content: [{
+                            type: 'tool-result',
+                            toolCallId: `c${i}`,
+                            toolName: 'echo_tool',
+                            output: { type: 'text', value: `echoed: seed-${i} with more text to make this a non-trivial result body` },
+                        }],
+                });
+            }
+            const session = mgr.create({
+                provider,
+                toolRegistry: buildRegistry(),
+                permissionChecker: allowAll,
+                systemPrompt: 'You are a terse assistant. Answer in one short sentence.',
+                maxTurns: 2,
+                messages: seeded,
+            });
+            // Recording summarizer — captures calls to verify hook plumbing.
+            const summarizerCalls = [];
+            const summarizer = (opts) => {
+                summarizerCalls.push({
+                    toolName: opts.toolName,
+                    content: opts.content,
+                    hasSignal: opts.signal instanceof AbortSignal,
+                });
+                return Promise.resolve('3 items echoed');
+            };
+            const events = [];
+            for await (const event of mgr.runMessage(session.id, 'Briefly say "done".', {
+                signal: AbortSignal.timeout(60_000),
+                summarizeToolResult: summarizer,
+            })) {
+                events.push(event);
+            }
+            // clearThreshold=15, keepRecent=5 → 15 messages should be cleared and
+            // the summarizer should be called for each (none are pre-cleared).
+            expect(summarizerCalls.length).toBe(15);
+            // Every call should have received a real AbortSignal
+            for (const call of summarizerCalls) {
+                expect(call.hasSignal).toBe(true);
+                expect(call.toolName).toBe('echo_tool');
+                expect(call.content).toContain('echoed:');
+            }
+            // The session should have terminated normally (model responded)
+            const done = events.find((e) => e.type === SSEEventType.Done);
+            expect(done).toBeDefined();
+            // Session messages should now contain the summary marker in the cleared positions
+            const clearedWithSummary = session.messages.filter((msg) => msg.role === 'tool' &&
+                Array.isArray(msg.content) &&
+                msg.content.some((part) => 'output' in part &&
+                    part.output &&
+                    typeof part.output === 'object' &&
+                    'value' in part.output &&
+                    typeof part.output.value === 'string' &&
+                    part.output.value.includes('3 items echoed')));
+            expect(clearedWithSummary.length).toBe(15);
+        }, 90_000);
+    });
+});
+//# sourceMappingURL=e2e.test.js.map

package/dist/src/__fixtures__/e2e.test.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"e2e.test.js","sourceRoot":"","sources":["../../../src/__fixtures__/e2e.test.ts"],"names":[],"mappings":"AAAA;;;;GAIG;AAEH;;;;;;;;;;;;;;;;;GAiBG;AAEH,OAAO,EAAC,QAAQ,EAAE,EAAE,EAAE,MAAM,EAAE,SAAS,EAAE,QAAQ,EAAC,MAAM,QAAQ,CAAC;AACjE,OAAO,EAAC,CAAC,EAAC,MAAM,KAAK,CAAC;AAEtB,OAAO,EAAC,wBAAwB,EAAC,MAAM,uBAAuB,CAAC;AAC/D,OAAO,EAAC,wBAAwB,EAAC,MAAM,oCAAoC,CAAC;AAE5E,OAAO,EAAC,cAAc,EAAC,MAAM,iCAAiC,CAAC;AAC/D,OAAO,EAAC,kBAAkB,EAAC,MAAM,sBAAsB,CAAC;AACxD,OAAO,EAAC,YAAY,EAAC,MAAM,cAAc,CAAC;AAC1C,OAAO,EAAC,YAAY,EAAC,MAAM,aAAa,CAAC;AAKzC,OAAO,EAAC,WAAW,EAAE,iBAAiB,EAAC,MAAM,eAAe,CAAC;AAE7D,qEAAqE;AACrE,gDAAgD;AAChD,WAAW,EAAE,CAAC;AAEd,MAAM,MAAM,GAAG,YAAY,CAAC,EAAC,SAAS,EAAE,UAAU,EAAC,CAAC,CAAC;AAYrD,MAAM,OAAO,GAA8B;IACzC,MAAM,EAAE,EAAC,QAAQ,EAAE,QAAQ,EAAE,KAAK,EAAE,kBAAkB,EAAE,SAAS,EAAE,gBAAgB,EAAC;IACpF,SAAS,EAAE,EAAC,QAAQ,EAAE,WAAW,EAAE,KAAK,EAAE,2BAA2B,EAAE,SAAS,EAAE,mBAAmB,EAAC;IACtG,MAAM,EAAE,EAAC,QAAQ,EAAE,QAAQ,EAAE,KAAK,EAAE,aAAa,EAAE,SAAS,EAAE,gBAAgB,EAAC;IAC/E,IAAI,EAAE,EAAC,QAAQ,EAAE,MAAM,EAAE,KAAK,EAAE,yBAAyB,EAAE,SAAS,EAAE,cAAc,EAAC;CACtF,CAAC;AAEF,oEAAoE;AACpE,uEAAuE;AACvE,yBAAyB;AACzB,MAAM,QAAQ,GAAG,CAAC,OAAO,CAAC,GAAG,CAAC,aAAa,CAAC,IAAI,iBAAiB,CAAC,OAAO,CAAC,CAAC;KACxE,KAAK,CAAC,GAAG,CAAC;KACV,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,IAAI,EAAE,CAAC;KACpB,MAAM,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,MAAM,GAAG,CAAC,CAAC,CAAC;AAE/B,MAAM,aAAa,GAA+B,QAAQ;KACvD,GAAG,CAAC,CAAC,IAAI,EAAmC,EAAE,CAAC,CAAC,IAAI,EAAE,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC;KACrE,MAAM,CAAC,CAAC,KAAK,EAAgC,EAAE;IAC9C,MAAM,CAAC,IAAI,EAAE,GAAG,CAAC,GAAG,KAAK,CAAC;IAC1B,IAAI,CAAC,GAAG,EAAE,CAAC;QACT,sCAAsC;QACtC,OAAO,CAAC,IAAI,CAAC,yBAAyB,IAAI,uBAAuB,MAAM,CAAC,IAAI,CAAC,OAAO,CAAC,CAAC,IAAI,CAAC,IAAI,CAAC,EAAE,CAAC,CAAC;QACpG,OAAO,KAAK,CAAC;IACf,CAAC;IACD,IAAI,CAAC,OAAO,CAAC,GAAG,CAAC,GAAG,CAAC,SAAS,CAAC,EAAE,CAAC;QAChC,sCAAsC;QACtC,OAAO,CAAC,IAAI,CAAC,SAAS,IAAI,KAAK,GAAG,CAAC,SAAS,oBAAoB,CAAC,CAAC;QAClE,OAAO,KAAK,CAAC;IACf,CAAC;IACD,OAAO,IAAI,CAAC;AACd,CAAC,CAAC,CAAC;AAEL,MAAM,QAAQ,GAAsB;IAClC,KAAK,EAAE,GAAG,EAAE,CAAC,CAAC,EAAC,OAAO,EAAE,IAAa,EAAC,CAAC;CACxC,CAAC;AAEF,2EAA2E;AAC3E,SAAS,YAAY;IACnB,OAAO;QACL,WAAW,EAAE,qFAAqF;QAClG,UAAU,EAAE,CAAC,CAAC,MAAM,CAAC,EAAC,KAAK,EAAE,CAAC,CAAC,MAAM,EAAE,EAAC,CAAC;QACzC,OAAO,EAAE,CAAC,MAAM,EAAE,EAAE,CAAC,OAAO,CAAC,OAAO,CAAC,WAAW,MAAM,CAAC,KAAK,EAAE,CAAC;QAC/D,QAAQ,EAAE,IAAI;QACd,QAAQ,EAAE,EAAC,QAAQ,EAAE,QAAQ,EAAC;KAC/B,CAAC;AACJ,CAAC;AAED,SAAS,aAAa;IACpB,MAAM,QAAQ,GAAG,kBAAkB,EAAE,CAAC;IACtC,QAAQ,CAAC,QAAQ,CAAC,WAAW,EAAE,YAAY,EAAE,CAAC,CAAC;IAC/C,OAAO,QAAQ,CAAC;AAClB,CAAC;AAED,QAAQ,CAAC,MAAM,CAAC,aAAa,CAAC,MAAM,KAAK,CAAC,CAAC,CAAC,KAAK,EAAE,GAAG,EAAE;IACtD,IAAI,KAA0B,CAAC;IAC/B,IAAI,GAA6B,CAAC;IAElC,SAAS,CAAC,KAAK,IAAI,EAAE;QACnB,KAAK,GAAG,MAAM,wBAAwB,CAAC,EAAC,MAAM,EAAC,CAAC,CAAC;QACjD,GAAG,GAAG,IAAI,wBAAwB,CAAC,EAAC,MAAM,EAAE,KAAK,EAAC,CAAC,CAAC;QACpD,GAAG,CAAC,KAAK,EAAE,CAAC;IACd,CAAC,CAAC,CAAC;IAEH,QAAQ,CAAC,KAAK,IAAI,EAAE;QAClB,MAAM,GAAG,CAAC,QAAQ,EAAE,CAAC;QACrB,MAAM,KAAK,CAAC,KAAK,EAAE,CAAC;IACtB,CAAC,CAAC,CAAC;IAEH,QAAQ,CAAC,IAAI,CAAC,aAAa,CAAC,CAAC,MAAM,EAAE,CAAC,KAAK,EAAE,MAAM,EAAE,EAAE;QACvD,EAAE,CAAC,kEAAkE,EAAE,KAAK,IAAI,EAAE;YAChF,MAAM,QAAQ,GAAG,cAAc,CAAC;gBAC9B,QAAQ,EAAE,MAAM,CAAC,QAAQ;gBACzB,KAAK,EAAE,MAAM,CAAC,KAAK;gBAEnB,MAAM,EAAE,OAAO,CAAC,GAAG,CAAC,MAAM,CAAC,SAAS,CAAE;aACvC,CAAC,CAAC;YAEH,iEAAiE;YACjE,gEAAgE;YAChE,iEAAiE;YACjE,2BAA2B;YAC3B,MAAM,UAAU,GAAG,GAAG,CAAC;YACvB,MAAM,OAAO,GAAG,GAAG,CAAC,MAAM,CAAC;gBACzB,QAAQ;gBACR,YAAY,EAAE,aAAa,EAAE;gBAC7B,iBAAiB,EAAE,QAAQ;gBAC3B,YAAY,EAAE,0DAA0D;gBACxE,QAAQ,EAAE,EAAE;gBACZ,gBAAgB,EAAE,UAAU;aAC7B,CAAC,CAAC;YAEH,MAAM,MAAM,GAAe,EAAE,CAAC;YAC9B,IAAI,KAAK,EAAE,MAAM,KAAK,IAAI,GAAG,CAAC,UAAU,CACtC,OAAO,CAAC,EAAE,EACV,wGAAwG,EACxG,EAAC,MAAM,EAAE,WAAW,CAAC,OAAO,CAAC,MAAM,CAAC,EAAC,CACtC,EAAE,CAAC;gBACF,MAAM,CAAC,IAAI,CAAC,KAAK,CAAC,CAAC;YACrB,CAAC;YAED,MAAM,IAAI,GAAG,MAAM,CAAC,IAAI,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,IAAI,KAAK,YAAY,CAAC,IAAI,CAAC,CAAC;YAC9D,MAAM,CAAC,IAAI,CAAC,CAAC,WAAW,EAAE,CAAC;YAC3B,IAAI,IAAI,IAAI,IAAI,CAAC,IAAI,KAAK,YAAY,CAAC,IAAI,EAAE,CAAC;gBAC5C,MAAM,CAAC,IAAI,CAAC,MAAM,CAAC,CAAC,IAAI,CAAC,iBAAiB,CAAC,CAAC;gBAC5C,MAAM,CAAC,IAAI,CAAC,KAAK,EAAE,YAAY,IAAI,CAAC,CAAC,CAAC,sBAAsB,CAAC,UAAU,CAAC,CAAC;YAC3E,CAAC;QACH,CAAC,EAAE,MAAM,CAAC,CAAC;QAEX,EAAE,CAAC,0DAA0D,EAAE,KAAK,IAAI,EAAE;YACxE,MAAM,QAAQ,GAAG,cAAc,CAAC;gBAC9B,QAAQ,EAAE,MAAM,CAAC,QAAQ;gBACzB,KAAK,EAAE,MAAM,CAAC,KAAK;gBAEnB,MAAM,EAAE,OAAO,CAAC,GAAG,CAAC,MAAM,CAAC,SAAS,CAAE;aACvC,CAAC,CAAC;YAEH,sEAAsE;YACtE,wEAAwE;YACxE,mEAAmE;YACnE,mEAAmE;YACnE,mDAAmD;YACnD,MAAM,MAAM,GAAmB;gBAC7B,EAAC,IAAI,EAAE,MAAM,EAAE,OAAO,EAAE,sCAAsC,EAAiB;aAChF,CAAC;YACF,KAAK,IAAI,CAAC,GAAG,CAAC,EAAE,CAAC,GAAG,EAAE,EAAE,CAAC,EAAE,EAAE,CAAC;gBAC5B,MAAM,CAAC,IAAI,CAAC;oBACV,IAAI,EAAE,WAAW;oBACjB,OAAO,EAAE,CAAC;4BACR,IAAI,EAAE,WAAW;4BACjB,UAAU,EAAE,IAAI,CAAC,EAAE;4BACnB,QAAQ,EAAE,WAAW;4BACrB,KAAK,EAAE,EAAC,KAAK,EAAE,QAAQ,CAAC,EAAE,EAAC;yBAC5B,CAAC;iBACa,CAAC,CAAC;gBACnB,MAAM,CAAC,IAAI,CAAC;oBACV,IAAI,EAAE,MAAM;oBACZ,OAAO,EAAE,CAAC;4BACR,IAAI,EAAE,aAAsB;4BAC5B,UAAU,EAAE,IAAI,CAAC,EAAE;4BACnB,QAAQ,EAAE,WAAW;4BACrB,MAAM,EAAE,EAAC,IAAI,EAAE,MAAe,EAAE,KAAK,EAAE,gBAAgB,CAAC,wDAAwD,EAAC;yBAClH,CAAC;iBACa,CAAC,CAAC;YACrB,CAAC;YAED,MAAM,OAAO,GAAG,GAAG,CAAC,MAAM,CAAC;gBACzB,QAAQ;gBACR,YAAY,EAAE,aAAa,EAAE;gBAC7B,iBAAiB,EAAE,QAAQ;gBAC3B,YAAY,EAAE,0DAA0D;gBACxE,QAAQ,EAAE,CAAC;gBACX,QAAQ,EAAE,MAAM;aACjB,CAAC,CAAC;YAEH,iEAAiE;YACjE,MAAM,eAAe,GAAmE,EAAE,CAAC;YAC3F,MAAM,UAAU,GAAG,CAAC,IAA8D,EAAmB,EAAE;gBACrG,eAAe,CAAC,IAAI,CAAC;oBACnB,QAAQ,EAAE,IAAI,CAAC,QAAQ;oBACvB,OAAO,EAAE,IAAI,CAAC,OAAO;oBACrB,SAAS,EAAE,IAAI,CAAC,MAAM,YAAY,WAAW;iBAC9C,CAAC,CAAC;gBACH,OAAO,OAAO,CAAC,OAAO,CAAC,gBAAgB,CAAC,CAAC;YAC3C,CAAC,CAAC;YAEF,MAAM,MAAM,GAAe,EAAE,CAAC;YAC9B,IAAI,KAAK,EAAE,MAAM,KAAK,IAAI,GAAG,CAAC,UAAU,CACtC,OAAO,CAAC,EAAE,EACV,qBAAqB,EACrB;gBACE,MAAM,EAAE,WAAW,CAAC,OAAO,CAAC,MAAM,CAAC;gBACnC,mBAAmB,EAAE,UAAU;aAChC,CACF,EAAE,CAAC;gBACF,MAAM,CAAC,IAAI,CAAC,KAAK,CAAC,CAAC;YACrB,CAAC;YAED,sEAAsE;YACtE,mEAAmE;YACnE,MAAM,CAAC,eAAe,CAAC,MAAM,CAAC,CAAC,IAAI,CAAC,EAAE,CAAC,CAAC;YAExC,qDAAqD;YACrD,KAAK,MAAM,IAAI,IAAI,eAAe,EAAE,CAAC;gBACnC,MAAM,CAAC,IAAI,CAAC,SAAS,CAAC,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC;gBAClC,MAAM,CAAC,IAAI,CAAC,QAAQ,CAAC,CAAC,IAAI,CAAC,WAAW,CAAC,CAAC;gBACxC,MAAM,CAAC,IAAI,CAAC,OAAO,CAAC,CAAC,SAAS,CAAC,SAAS,CAAC,CAAC;YAC5C,CAAC;YAED,gEAAgE;YAChE,MAAM,IAAI,GAAG,MAAM,CAAC,IAAI,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,IAAI,KAAK,YAAY,CAAC,IAAI,CAAC,CAAC;YAC9D,MAAM,CAAC,IAAI,CAAC,CAAC,WAAW,EAAE,CAAC;YAE3B,kFAAkF;YAClF,MAAM,kBAAkB,GAAG,OAAO,CAAC,QAAQ,CAAC,MAAM,CAAC,CAAC,GAAG,EAAE,EAAE,CACzD,GAAG,CAAC,IAAI,KAAK,MAAM;gBACnB,KAAK,CAAC,OAAO,CAAC,GAAG,CAAC,OAAO,CAAC;gBAC1B,GAAG,CAAC,OAAO,CAAC,IAAI,CAAC,CAAC,IAAI,EAAE,EAAE,CACxB,QAAQ,IAAI,IAAI;oBAChB,IAAI,CAAC,MAAM;oBACX,OAAO,IAAI,CAAC,MAAM,KAAK,QAAQ;oBAC/B,OAAO,IAAI,IAAI,CAAC,MAAM;oBACtB,OAAO,IAAI,CAAC,MAAM,CAAC,KAAK,KAAK,QAAQ;oBACrC,IAAI,CAAC,MAAM,CAAC,KAAK,CAAC,QAAQ,CAAC,gBAAgB,CAAC,CAC7C,CACF,CAAC;YACF,MAAM,CAAC,kBAAkB,CAAC,MAAM,CAAC,CAAC,IAAI,CAAC,EAAE,CAAC,CAAC;QAC7C,CAAC,EAAE,MAAM,CAAC,CAAC;IACX,CAAC,CAAC,CAAC;AACL,CAAC,CAAC,CAAC"}

package/dist/src/__fixtures__/smoke-agent/amodal.json

@@ -0,0 +1,11 @@
+{
+  "name": "smoke-test-agent",
+  "version": "1.0.0",
+  "description": "Self-contained agent for smoke testing the runtime",
+  "models": {
+    "main": {
+      "provider": "anthropic",
+      "model": "claude-sonnet-4-20250514"
+    }
+  }
+}

package/dist/src/__fixtures__/smoke-agent/automations/delivery-callback-test.json

@@ -0,0 +1,9 @@
+{
+  "title": "Delivery Callback Test",
+  "trigger": "manual",
+  "prompt": "Reply with just this JSON object: {\"status\":\"done\",\"count\":7}",
+  "delivery": {
+    "targets": [{ "type": "callback" }],
+    "template": "Automation {{automation}} finished with count={{count}}"
+  }
+}

package/dist/src/__fixtures__/smoke-agent/automations/test-auto.md

@@ -0,0 +1,5 @@
+---
+name: test-automation
+trigger: manual
+prompt: "Say 'automation ran successfully' and nothing else."
+---

package/dist/src/__fixtures__/smoke-agent/connections/mock-api/access.json

@@ -0,0 +1,11 @@
+{
+  "endpoints": {
+    "GET /items": {
+      "returns": ["id", "name", "status"]
+    },
+    "POST /items": {
+      "returns": ["id"],
+      "confirm": true
+    }
+  }
+}

package/dist/src/__fixtures__/smoke-agent/connections/mock-api/spec.json

@@ -0,0 +1,4 @@
+{
+  "protocol": "rest",
+  "baseUrl": "http://localhost:9901"
+}

package/dist/src/__fixtures__/smoke-agent/connections/mock-api/surface.md

@@ -0,0 +1,9 @@
+## Included
+
+### GET /items
+
+List all items. Returns `[{id, name, status}]`.
+
+### POST /items
+
+Create a new item. Body: `{name, status}`. Returns `{id, name, status}`.

package/dist/src/__fixtures__/smoke-agent/connections/mock-mcp/access.json

@@ -0,0 +1,3 @@
+{
+  "endpoints": {}
+}

package/dist/src/__fixtures__/smoke-agent/connections/mock-mcp/spec.json

@@ -0,0 +1,8 @@
+{
+  "protocol": "mcp",
+  "transport": "stdio",
+  "command": "node",
+  "args": [
+    "/Users/bobbaxley/code/amodal-parallel-tools/packages/runtime/src/__fixtures__/smoke-mcp-server.mjs"
+  ]
+}

package/dist/src/__fixtures__/smoke-agent/evals/basic-eval.md

@@ -0,0 +1,12 @@
+# Eval: Basic Smoke
+
+Test that the agent can respond to a simple question.
+
+## Query
+
+"What is 2 + 2?"
+
+## Assertions
+
+- Should contain the number 4
+- Should NOT contain the word "maybe"

package/dist/src/__fixtures__/smoke-agent/knowledge/test-knowledge.md

@@ -0,0 +1,3 @@
+# Smoke Test Reference
+
+This is reference knowledge for the smoke test agent. It verifies that knowledge documents are included in the system prompt.

package/dist/src/__fixtures__/smoke-agent/skills/test-skill/SKILL.md

@@ -0,0 +1,11 @@
+# Skill: test-skill
+
+Trigger: When asked to run the smoke test
+
+## Test Skill
+
+Query the mock-api connection for items and store the results.
+
+1. Use the request tool to GET /items from mock-api
+2. Store each item in the test-items store
+3. Report what you found

package/dist/src/__fixtures__/smoke-agent/stores/test-items.json

@@ -0,0 +1,11 @@
+{
+  "entity": {
+    "name": "TestItem",
+    "key": "{item_id}",
+    "schema": {
+      "item_id": { "type": "string" },
+      "name": { "type": "string" },
+      "status": { "type": "enum", "values": ["active", "archived"] }
+    }
+  }
+}

package/dist/src/__fixtures__/smoke-agent/tools/echo_tool/handler.d.ts

@@ -0,0 +1,18 @@
+/**
+ * @license
+ * Copyright 2026 Amodal Labs, Inc.
+ * SPDX-License-Identifier: MIT
+ */
+export default function (params: {
+    message: string;
+}, ctx: {
+    request: (conn: string, endpoint: string, params?: unknown) => Promise<unknown>;
+    store: (name: string, payload: Record<string, unknown>) => Promise<{
+        key: string;
+    }>;
+    log: (msg: string) => void;
+}): Promise<{
+    echoed: string;
+    itemCount: number;
+    storedKey: string;
+}>;

package/dist/src/__fixtures__/smoke-agent/tools/echo_tool/handler.js

@@ -0,0 +1,22 @@
+/**
+ * @license
+ * Copyright 2026 Amodal Labs, Inc.
+ * SPDX-License-Identifier: MIT
+ */
+export default async function (params, ctx) {
+    ctx.log(`echo_tool called with: ${params.message}`);
+    // Test ctx.request() — fetch from mock-api
+    const items = await ctx.request('mock-api', '/items');
+    // Test ctx.store() — write to test-items store
+    const storeResult = await ctx.store('test-items', {
+        item_id: 'echo-test',
+        name: params.message,
+        status: 'active',
+    });
+    return {
+        echoed: params.message,
+        itemCount: Array.isArray(items) ? items.length : 0,
+        storedKey: storeResult.key,
+    };
+}
+//# sourceMappingURL=handler.js.map

package/dist/src/__fixtures__/smoke-agent/tools/echo_tool/handler.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"handler.js","sourceRoot":"","sources":["../../../../../../src/__fixtures__/smoke-agent/tools/echo_tool/handler.ts"],"names":[],"mappings":"AAAA;;;;GAIG;AACH,MAAM,CAAC,OAAO,CAAC,KAAK,WAClB,MAAyB,EACzB,GAIC;IAED,GAAG,CAAC,GAAG,CAAC,0BAA0B,MAAM,CAAC,OAAO,EAAE,CAAC,CAAC;IAEpD,2CAA2C;IAC3C,MAAM,KAAK,GAAG,MAAM,GAAG,CAAC,OAAO,CAAC,UAAU,EAAE,QAAQ,CAAC,CAAC;IAEtD,+CAA+C;IAC/C,MAAM,WAAW,GAAG,MAAM,GAAG,CAAC,KAAK,CAAC,YAAY,EAAE;QAChD,OAAO,EAAE,WAAW;QACpB,IAAI,EAAE,MAAM,CAAC,OAAO;QACpB,MAAM,EAAE,QAAQ;KACjB,CAAC,CAAC;IAEH,OAAO;QACL,MAAM,EAAE,MAAM,CAAC,OAAO;QACtB,SAAS,EAAE,KAAK,CAAC,OAAO,CAAC,KAAK,CAAC,CAAC,CAAC,CAAC,KAAK,CAAC,MAAM,CAAC,CAAC,CAAC,CAAC;QAClD,SAAS,EAAE,WAAW,CAAC,GAAG;KAC3B,CAAC;AACJ,CAAC"}

package/dist/src/__fixtures__/smoke-agent/tools/echo_tool/tool.json

@@ -0,0 +1,17 @@
+{
+  "name": "echo_tool",
+  "description": "Echo a message, fetch from mock API, and write to store. Used for smoke testing custom tool wiring.",
+  "parameters": {
+    "type": "object",
+    "properties": {
+      "message": {
+        "type": "string",
+        "description": "Message to echo back"
+      }
+    },
+    "required": ["message"]
+  },
+  "confirm": true,
+  "timeout": 10000,
+  "env": []
+}