@agentuity/runtime 0.0.100 → 0.0.102

package/AGENTS.md

@@ -2,99 +2,30 @@
 
 ## Package Overview
 
-Server runtime for building Agentuity applications. Built on Hono framework and optimized for Bun runtime with OpenTelemetry observability.
+Hono-based server runtime for Agentuity applications, optimized for Bun with OpenTelemetry observability.
 
 ## Commands
 
-- **Build**: `bun run build` (compiles for Bun target)
-- **Typecheck**: `bun run typecheck` (runs TypeScript type checking)
-- **Clean**: `bun run clean` (removes dist/)
+- **Build**: `bun run build`
+- **Typecheck**: `bun run typecheck`
+- **Test**: `bun test`
+- **Clean**: `bun run clean`
 
 ## Architecture
 
-- **Runtime**: Bun server runtime (required for native WebSocket support)
-- **Framework**: Hono (lightweight web framework)
-- **Build target**: Bun runtime
+- **Runtime**: Bun (required for native WebSocket)
+- **Framework**: Hono
 - **Dependencies**: `@agentuity/core`, Hono, OpenTelemetry
-- **Observability**: Built-in OpenTelemetry for logs, traces, and metrics
-- **WebSocket**: Native Bun WebSocket via `hono/bun` (production and development)
-- **Dev Mode**: Integrates with Vite asset server for HMR (proxied through Bun server)
+- **Features**: WebSocket, SSE, streaming, storage abstractions (kv, vector, stream)
 
-## Structure
+## Code Conventions
 
-```
-src/
-├── index.ts        # Main exports
-├── app.ts          # createApp() function
-├── agent.ts        # Agent types and createAgent()
-├── router.ts       # createRouter() with extended methods
-├── logger.ts       # Logging utilities
-├── _server.ts      # Internal server creation
-├── _context.ts     # Internal context management
-└── _util.ts        # Internal utilities
-```
-
-## Code Style
-
-- **Hono patterns** - Follow Hono's context-based API design
-- **Type safety** - Extensive use of TypeScript generics
-- **Middleware pattern** - Support Hono middleware
-- **Async handlers** - All handlers can be async
-- **OpenTelemetry** - Use tracer/logger from context
-
-## Important Conventions
-
-- **Agent context** - Every agent handler receives `AgentContext` as first parameter
-- **Schema validation** - Support StandardSchemaV1 (works with Zod, Valibot, etc.)
-- **Route validation** - Use `agent.validator()` for automatic input validation with full type safety
-- **Streaming support** - Agents can return ReadableStream for streaming responses
-- **WebSocket support** - Use `router.websocket()` for WebSocket routes
-- **SSE support** - Use `router.sse()` for Server-Sent Events
-- **Session tracking** - Each request gets unique sessionId
-- **Storage abstractions** - Provide kv, stream, vector interfaces
-
-## Route Validation
+- **Agent context**: Every handler receives `AgentContext` with logger, tracer, storage
+- **Schema validation**: Use `agent.validator()` for automatic input validation
+- **Observability**: Use `ctx.logger` not `console.log`
+- **Type inference**: Let TypeScript infer handler types from schemas
 
-Routes can use `agent.validator()` to automatically validate request input using the agent's schema:
-
-```typescript
-import { createRouter } from '@agentuity/runtime';
-import myAgent from './my-agent';
-
-const router = createRouter();
-
-// Automatic validation using agent's input schema
-router.post('/', myAgent.validator(), async (c) => {
-	const data = c.req.valid('json'); // Fully typed from agent schema!
-	const output = await myAgent.run(data);
-	return c.json(output);
-});
-
-// Override with custom schema
-router.post(
-	'/custom',
-	agent.validator({
-		input: z.object({ custom: z.string() }),
-	}),
-	async (c) => {
-		const data = c.req.valid('json'); // Typed as { custom: string }
-		return c.json(data);
-	}
-);
-
-// GET routes don't need validation
-router.get('/', async (c) => {
-	return c.json({ hello: 'world' });
-});
-```
-
-The validator supports three overload signatures:
-
-- `agent.validator()` - Uses agent's input/output schemas
-- `agent.validator({ output: schema })` - Output-only validation (GET-compatible)
-- `agent.validator({ input: schema, output?: schema })` - Custom input/output schemas
-
-## Agent Definition Pattern
+## Agent Pattern
 
 ```typescript
 import { createAgent } from '@agentuity/runtime';
@@ -103,150 +34,41 @@ import { s } from '@agentuity/schema';
 export default createAgent('my-agent', {
 	description: 'What this agent does',
 	schema: {
-		input: s.object({
-			/* ... */
-		}),
-		output: s.object({
-			/* ... */
-		}),
+		input: s.object({ name: s.string() }),
+		output: s.object({ id: s.string() }),
 	},
 	handler: async (ctx, input) => {
-		// ctx.logger, ctx.tracer, ctx.kv, ctx.app, etc.
-		return output;
+		// ctx.logger, ctx.kv, ctx.tracer available
+		return { id: `user-${input.name}` };
 	},
 });
 ```
 
-**Note:** Internal metadata (id, agentId, filename, version) is automatically injected by the build system.
-
-## Router Extensions
-
-The `createRouter()` function returns an extended Hono instance with:
-
-- **Standard HTTP methods**: `get`, `post`, `put`, `delete`, `patch`
-- **Streaming**: `stream(path, handler)` - Returns ReadableStream
-- **WebSocket**: `websocket(path, handler)` - WebSocket connections
-- **SSE**: `sse(path, handler)` - Server-Sent Events
-
-## AgentContext API
-
-Every agent handler receives:
+## Route Validation
 
 ```typescript
-interface AgentContext {
-	logger: Logger; // Structured logger
-	tracer: Tracer; // OpenTelemetry tracer
-	sessionId: string; // Unique session ID
-	kv: KeyValueStorage; // Key-value storage
-	stream: StreamStorage; // Stream storage
-	vector: VectorStorage; // Vector storage
-	state: Map<string, unknown>; // Request-scoped state
-	thread: Thread; // Thread information
-	session: Session; // Session information
-	config: TConfig; // Agent-specific config from setup
-	app: TAppState; // Application state from createApp
-	waitUntil: (promise) => void; // Background tasks
-}
-```
-
-## Observability
-
-- **Logging**: Use `ctx.logger.info/warn/error()` not console.log
-- **Tracing**: Create spans with `ctx.tracer.startSpan()`
-- **Metrics**: Access via `c.var.meter` in Hono context
-- **Environment**: Metrics/traces sent to OTLP endpoints
-
-## Type Safety
-
-**End-to-end type safety is a core feature of the runtime.** When you use `createAgent()` with schemas and `agent.validator()` in routes, TypeScript automatically infers correct types throughout your application.
-
-### What IS Type-Safe ✅
-
-1. **Route handler input types** - `c.req.valid('json')` is automatically typed from agent schema
-2. **Agent handler types** - Both `ctx` and `input` parameters are fully typed
-3. **Runtime validation** - Input/output validation happens automatically
-4. **Schema overrides** - Custom schemas in `agent.validator({ input, output })` maintain type safety
-5. **Multiple agents** - Each route maintains independent type safety
-
-### Type Inference Best Practices
-
-**CRITICAL:** Do NOT add type annotations to agent handler parameters - let TypeScript infer them:
+const router = createRouter();
 
-```typescript
-// ✅ CORRECT: Let TypeScript infer types from schema
-const agent = createAgent('user', {
-  schema: {
-    input: z.object({ name: z.string(), age: z.number() }),
-    output: z.object({ id: z.string() }),
-  },
-  handler: async (ctx, input) => {
-    // ctx is typed as AgentContext
-    // input is typed as { name: string, age: number }
-    return { id: `user-${input.name}` };
-  },
+// Automatic validation from agent schema
+router.post('/', myAgent.validator(), async (c) => {
+	const data = c.req.valid('json'); // Fully typed!
+	return c.json(await myAgent.run(data));
 });
-
-// ❌ WRONG: Explicit types defeat inference
-handler: async (ctx: AgentContext, input: any) => { ... }
 ```
 
-### Hono Method Chaining
-
-For best type inference with Hono, use method chaining:
-
-```typescript
-// ✅ RECOMMENDED: Method chaining preserves types
-const app = new Hono()
-	.post('/users', userAgent.validator(), handler)
-	.get('/users/:id', userAgent.validator({ output: UserSchema }), handler);
-```
-
-### Testing Type Safety
-
-**IMPORTANT:** Due to Hono's `testClient()` type inference limitations with method-chained apps, use `app.request()` for testing:
+## Type Safety
 
-```typescript
-// ✅ CORRECT: Use app.request() for testing
-test('creates user', async () => {
-	const app = new Hono().post('/users', agent.validator(), async (c) => {
-		const data = c.req.valid('json'); // Fully typed!
-		return c.json({ id: `user-${data.name}` });
-	});
-
-	const res = await app.request('/users', {
-		method: 'POST',
-		headers: { 'Content-Type': 'application/json' },
-		body: JSON.stringify({ name: 'Alice', age: 30 }),
-	});
-
-	expect(res.status).toBe(200);
-	const result = await res.json();
-	expect(result.id).toBe('user-Alice');
-});
+**CRITICAL:** Do NOT add type annotations to handler parameters - let TypeScript infer them.
 
-// ❌ AVOID: testClient has type inference issues
-import { testClient } from 'hono/testing';
-const client = testClient(app); // Returns unknown type
-```
+See [TYPE_SAFETY.md](TYPE_SAFETY.md) for detailed documentation.
 
-See `test/agent-type-safety.test.ts` for comprehensive type-safe testing examples.
+## Testing
 
-For detailed type safety documentation, see `TYPE_SAFETY.md`.
+- Use `app.request()` for route testing (NOT `testClient()`)
+- Mock contexts from `test/helpers/test-context.ts`
+- Import from `../src/` in tests
 
-## Testing
+## Publishing
 
-- **Test runner**: Use Bun's test runner: `bun test`
-- **Test structure**: All tests in `test/` folder parallel to `src/`
-- **Test imports**: Import from `../src/` not `../`
-- **Mock contexts**: Use `TestAgentContext` from `test/helpers/test-context.ts`
-- **Mock services**: Use mock storage interfaces (kv, stream, vector, etc.)
-- **Route testing**: Use `app.request()` for testing routes (NOT `testClient()`)
-- **Type verification**: Let TypeScript infer agent handler types - do NOT add type annotations
-
-## Publishing Checklist
-
-1. Run `bun run build` to compile for Bun runtime
-2. Verify OpenTelemetry dependencies are correct versions
-3. Test with real Hono server
-4. Must publish **after** @agentuity/core
-5. Ensure React is only in devDependencies (for type checking web components)
+1. Run build, typecheck, test
+2. Publish **after** `@agentuity/core`

package/dist/_metadata.d.ts

@@ -0,0 +1,107 @@
+/**
+ * Build metadata utilities
+ * Provides cached access to agentuity.metadata.json
+ */
+export interface BuildMetadataAgent {
+    filename: string;
+    id: string;
+    agentId: string;
+    version: string;
+    name: string;
+    description?: string;
+    projectId?: string;
+    schema?: {
+        input?: string;
+        output?: string;
+    };
+    evals?: Array<{
+        filename: string;
+        id: string;
+        evalId: string;
+        name: string;
+        version: string;
+        description?: string;
+        agentIdentifier?: string;
+        projectId?: string;
+    }>;
+}
+export interface BuildMetadataRoute {
+    id: string;
+    filename: string;
+    path: string;
+    method: 'get' | 'post' | 'put' | 'delete' | 'patch';
+    version: string;
+    type?: string;
+    agentIds?: string[];
+    config?: Record<string, unknown>;
+    schema?: {
+        input?: string;
+        output?: string;
+    };
+}
+export interface BuildMetadata {
+    routes: BuildMetadataRoute[];
+    agents: BuildMetadataAgent[];
+    assets?: string[];
+    project: {
+        id: string;
+        name: string;
+        version?: string;
+        description?: string;
+        keywords?: string[];
+        orgId?: string;
+    };
+    deployment: {
+        id: string;
+        date: string;
+        build: {
+            bun: string;
+            agentuity: string;
+            arch: string;
+            platform: string;
+        };
+        git?: {
+            branch?: string;
+            repo?: string;
+            provider?: string;
+            tags?: string[];
+            commit?: string;
+            message?: string;
+        };
+    };
+}
+/**
+ * Get the path to agentuity.metadata.json
+ */
+export declare function getMetadataPath(): string;
+/**
+ * Load and cache the build metadata from agentuity.metadata.json
+ * Returns undefined if the file doesn't exist or can't be parsed
+ */
+export declare function loadBuildMetadata(): BuildMetadata | undefined;
+export type BuildMetadataEval = NonNullable<BuildMetadataAgent['evals']>[number];
+/**
+ * Look up agent metadata by name
+ */
+export declare function getAgentMetadataByName(agentName: string): BuildMetadataAgent | undefined;
+/**
+ * Look up agent metadata by agentId
+ */
+export declare function getAgentMetadataByAgentId(agentId: string): BuildMetadataAgent | undefined;
+/**
+ * Look up eval metadata by agent name and eval name
+ */
+export declare function getEvalMetadata(agentName: string, evalName: string): BuildMetadataEval | undefined;
+/**
+ * Look up eval metadata by agentId and eval name
+ */
+export declare function getEvalMetadataByAgentId(agentId: string, evalName: string): BuildMetadataEval | undefined;
+/**
+ * Check if metadata file exists (uses cache)
+ */
+export declare function hasMetadata(): boolean;
+/**
+ * Clear the metadata cache (useful for testing or hot reload)
+ */
+export declare function clearMetadataCache(): void;
+//# sourceMappingURL=_metadata.d.ts.map

package/dist/_metadata.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"_metadata.d.ts","sourceRoot":"","sources":["../src/_metadata.ts"],"names":[],"mappings":"AAAA;;;GAGG;AAMH,MAAM,WAAW,kBAAkB;IAClC,QAAQ,EAAE,MAAM,CAAC;IACjB,EAAE,EAAE,MAAM,CAAC;IACX,OAAO,EAAE,MAAM,CAAC;IAChB,OAAO,EAAE,MAAM,CAAC;IAChB,IAAI,EAAE,MAAM,CAAC;IACb,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB,MAAM,CAAC,EAAE;QACR,KAAK,CAAC,EAAE,MAAM,CAAC;QACf,MAAM,CAAC,EAAE,MAAM,CAAC;KAChB,CAAC;IACF,KAAK,CAAC,EAAE,KAAK,CAAC;QACb,QAAQ,EAAE,MAAM,CAAC;QACjB,EAAE,EAAE,MAAM,CAAC;QACX,MAAM,EAAE,MAAM,CAAC;QACf,IAAI,EAAE,MAAM,CAAC;QACb,OAAO,EAAE,MAAM,CAAC;QAChB,WAAW,CAAC,EAAE,MAAM,CAAC;QACrB,eAAe,CAAC,EAAE,MAAM,CAAC;QACzB,SAAS,CAAC,EAAE,MAAM,CAAC;KACnB,CAAC,CAAC;CACH;AAED,MAAM,WAAW,kBAAkB;IAClC,EAAE,EAAE,MAAM,CAAC;IACX,QAAQ,EAAE,MAAM,CAAC;IACjB,IAAI,EAAE,MAAM,CAAC;IACb,MAAM,EAAE,KAAK,GAAG,MAAM,GAAG,KAAK,GAAG,QAAQ,GAAG,OAAO,CAAC;IACpD,OAAO,EAAE,MAAM,CAAC;IAChB,IAAI,CAAC,EAAE,MAAM,CAAC;IACd,QAAQ,CAAC,EAAE,MAAM,EAAE,CAAC;IACpB,MAAM,CAAC,EAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,CAAC;IACjC,MAAM,CAAC,EAAE;QACR,KAAK,CAAC,EAAE,MAAM,CAAC;QACf,MAAM,CAAC,EAAE,MAAM,CAAC;KAChB,CAAC;CACF;AAED,MAAM,WAAW,aAAa;IAC7B,MAAM,EAAE,kBAAkB,EAAE,CAAC;IAC7B,MAAM,EAAE,kBAAkB,EAAE,CAAC;IAC7B,MAAM,CAAC,EAAE,MAAM,EAAE,CAAC;IAClB,OAAO,EAAE;QACR,EAAE,EAAE,MAAM,CAAC;QACX,IAAI,EAAE,MAAM,CAAC;QACb,OAAO,CAAC,EAAE,MAAM,CAAC;QACjB,WAAW,CAAC,EAAE,MAAM,CAAC;QACrB,QAAQ,CAAC,EAAE,MAAM,EAAE,CAAC;QACpB,KAAK,CAAC,EAAE,MAAM,CAAC;KACf,CAAC;IACF,UAAU,EAAE;QACX,EAAE,EAAE,MAAM,CAAC;QACX,IAAI,EAAE,MAAM,CAAC;QACb,KAAK,EAAE;YACN,GAAG,EAAE,MAAM,CAAC;YACZ,SAAS,EAAE,MAAM,CAAC;YAClB,IAAI,EAAE,MAAM,CAAC;YACb,QAAQ,EAAE,MAAM,CAAC;SACjB,CAAC;QACF,GAAG,CAAC,EAAE;YACL,MAAM,CAAC,EAAE,MAAM,CAAC;YAChB,IAAI,CAAC,EAAE,MAAM,CAAC;YACd,QAAQ,CAAC,EAAE,MAAM,CAAC;YAClB,IAAI,CAAC,EAAE,MAAM,EAAE,CAAC;YAChB,MAAM,CAAC,EAAE,MAAM,CAAC;YAChB,OAAO,CAAC,EAAE,MAAM,CAAC;SACjB,CAAC;KACF,CAAC;CACF;AAKD;;GAEG;AACH,wBAAgB,eAAe,IAAI,MAAM,CAExC;AAED;;;GAGG;AACH,wBAAgB,iBAAiB,IAAI,aAAa,GAAG,SAAS,CAkD7D;AAGD,MAAM,MAAM,iBAAiB,GAAG,WAAW,CAAC,kBAAkB,CAAC,OAAO,CAAC,CAAC,CAAC,MAAM,CAAC,CAAC;AAqEjF;;GAEG;AACH,wBAAgB,sBAAsB,CAAC,SAAS,EAAE,MAAM,GAAG,kBAAkB,GAAG,SAAS,CAGxF;AAED;;GAEG;AACH,wBAAgB,yBAAyB,CAAC,OAAO,EAAE,MAAM,GAAG,kBAAkB,GAAG,SAAS,CAGzF;AAED;;GAEG;AACH,wBAAgB,eAAe,CAC9B,SAAS,EAAE,MAAM,EACjB,QAAQ,EAAE,MAAM,GACd,iBAAiB,GAAG,SAAS,CAoC/B;AAED;;GAEG;AACH,wBAAgB,wBAAwB,CACvC,OAAO,EAAE,MAAM,EACf,QAAQ,EAAE,MAAM,GACd,iBAAiB,GAAG,SAAS,CAG/B;AAED;;GAEG;AACH,wBAAgB,WAAW,IAAI,OAAO,CAErC;AAED;;GAEG;AACH,wBAAgB,kBAAkB,IAAI,IAAI,CASzC"}

package/dist/_metadata.js

@@ -0,0 +1,179 @@
+/**
+ * Build metadata utilities
+ * Provides cached access to agentuity.metadata.json
+ */
+import { join } from 'node:path';
+import { existsSync, readFileSync } from 'node:fs';
+import { internal } from './logger/internal';
+// Cached metadata - null means not yet loaded, undefined means file not found
+let _metadataCache = null;
+/**
+ * Get the path to agentuity.metadata.json
+ */
+export function getMetadataPath() {
+    return join(process.cwd(), '.agentuity', 'agentuity.metadata.json');
+}
+/**
+ * Load and cache the build metadata from agentuity.metadata.json
+ * Returns undefined if the file doesn't exist or can't be parsed
+ */
+export function loadBuildMetadata() {
+    // Return cached value if already loaded
+    if (_metadataCache !== null) {
+        internal.info('[metadata] loadBuildMetadata: returning cached value (exists: %s)', _metadataCache !== undefined);
+        return _metadataCache;
+    }
+    const metadataPath = getMetadataPath();
+    internal.info('[metadata] loadBuildMetadata: checking path %s', metadataPath);
+    internal.info('[metadata] loadBuildMetadata: cwd=%s', process.cwd());
+    if (!existsSync(metadataPath)) {
+        internal.info('[metadata] agentuity.metadata.json not found at %s', metadataPath);
+        _metadataCache = undefined;
+        return undefined;
+    }
+    try {
+        internal.info('[metadata] loadBuildMetadata: file exists, reading...');
+        const content = readFileSync(metadataPath, 'utf-8');
+        const metadata = JSON.parse(content);
+        _metadataCache = metadata;
+        // Log agent and eval counts
+        let totalEvals = 0;
+        for (const agent of metadata.agents ?? []) {
+            totalEvals += agent.evals?.length ?? 0;
+        }
+        internal.info('[metadata] loaded agentuity.metadata.json: %d agents, %d routes, %d total evals', metadata.agents?.length ?? 0, metadata.routes?.length ?? 0, totalEvals);
+        // Log agent names and their eval counts
+        for (const agent of metadata.agents ?? []) {
+            internal.info('[metadata]   agent: %s (evals: %d)', agent.name, agent.evals?.length ?? 0);
+        }
+        return metadata;
+    }
+    catch (err) {
+        internal.info('[metadata] failed to load agentuity.metadata.json: %s', err);
+        _metadataCache = undefined;
+        return undefined;
+    }
+}
+// Agent lookup cache - built lazily from metadata
+let _agentsByName = null;
+let _agentsByAgentId = null;
+// Eval lookup cache - nested map: agentName -> evalName -> evalMetadata
+let _evalsByAgentName = null;
+let _evalsByAgentId = null;
+// Track if we've already attempted a reload for empty eval map
+let _evalReloadAttempted = false;
+/**
+ * Build agent lookup maps from metadata
+ */
+function ensureAgentMaps() {
+    if (_agentsByName !== null) {
+        internal.info(`[metadata] ensureAgentMaps: already initialized, skipping`);
+        return;
+    }
+    internal.info(`[metadata] ensureAgentMaps: initializing agent and eval maps`);
+    _agentsByName = new Map();
+    _agentsByAgentId = new Map();
+    _evalsByAgentName = new Map();
+    _evalsByAgentId = new Map();
+    const metadata = loadBuildMetadata();
+    if (!metadata?.agents) {
+        internal.info(`[metadata] ensureAgentMaps: no metadata or no agents found`);
+        return;
+    }
+    internal.info(`[metadata] ensureAgentMaps: processing ${metadata.agents.length} agents`);
+    for (const agent of metadata.agents) {
+        if (agent.name) {
+            _agentsByName.set(agent.name, agent);
+        }
+        if (agent.agentId) {
+            _agentsByAgentId.set(agent.agentId, agent);
+        }
+        // Build eval lookup maps
+        if (agent.evals && agent.evals.length > 0) {
+            const evalsByName = new Map();
+            for (const evalMeta of agent.evals) {
+                if (evalMeta.name) {
+                    evalsByName.set(evalMeta.name, evalMeta);
+                    internal.info(`[metadata] Indexed eval: agent='${agent.name}' eval='${evalMeta.name}' evalId='${evalMeta.evalId}'`);
+                }
+            }
+            if (agent.name) {
+                _evalsByAgentName.set(agent.name, evalsByName);
+            }
+            if (agent.agentId) {
+                _evalsByAgentId.set(agent.agentId, evalsByName);
+            }
+        }
+        else {
+            internal.info(`[metadata] Agent '${agent.name}' has no evals`);
+        }
+    }
+    internal.info(`[metadata] Eval maps built: ${_evalsByAgentName?.size ?? 0} agents with evals`);
+}
+/**
+ * Look up agent metadata by name
+ */
+export function getAgentMetadataByName(agentName) {
+    ensureAgentMaps();
+    return _agentsByName?.get(agentName);
+}
+/**
+ * Look up agent metadata by agentId
+ */
+export function getAgentMetadataByAgentId(agentId) {
+    ensureAgentMaps();
+    return _agentsByAgentId?.get(agentId);
+}
+/**
+ * Look up eval metadata by agent name and eval name
+ */
+export function getEvalMetadata(agentName, evalName) {
+    ensureAgentMaps();
+    // If eval map is empty, the cache may have been built before metadata was ready
+    // Try clearing and reloading once (only attempt once to avoid repeated reloads)
+    if (_evalsByAgentName?.size === 0 && !_evalReloadAttempted) {
+        _evalReloadAttempted = true;
+        internal.info(`[metadata] getEvalMetadata: eval map is empty, attempting cache clear and reload`);
+        clearMetadataCache();
+        ensureAgentMaps();
+        internal.info(`[metadata] getEvalMetadata: after reload, eval map size: ${_evalsByAgentName?.size ?? 0}`);
+    }
+    const agentEvals = _evalsByAgentName?.get(agentName);
+    internal.info(`[metadata] getEvalMetadata('${agentName}', '${evalName}'): agentEvals=${agentEvals ? `Map(${agentEvals.size})` : 'undefined'}`);
+    if (agentEvals) {
+        internal.info(`[metadata] Available evals for agent '${agentName}': [${[...agentEvals.keys()].join(', ')}]`);
+    }
+    if (!agentEvals) {
+        internal.info(`[metadata] Available agents in eval map: [${[...(_evalsByAgentName?.keys() ?? [])].join(', ')}]`);
+    }
+    const result = agentEvals?.get(evalName);
+    internal.info(`[metadata] getEvalMetadata result: ${result ? `found evalId=${result.evalId}` : 'not found'}`);
+    return result;
+}
+/**
+ * Look up eval metadata by agentId and eval name
+ */
+export function getEvalMetadataByAgentId(agentId, evalName) {
+    ensureAgentMaps();
+    return _evalsByAgentId?.get(agentId)?.get(evalName);
+}
+/**
+ * Check if metadata file exists (uses cache)
+ */
+export function hasMetadata() {
+    return loadBuildMetadata() !== undefined;
+}
+/**
+ * Clear the metadata cache (useful for testing or hot reload)
+ */
+export function clearMetadataCache() {
+    internal.info('[metadata] clearMetadataCache: clearing all caches');
+    _metadataCache = null;
+    _agentsByName = null;
+    _agentsByAgentId = null;
+    _evalsByAgentName = null;
+    _evalsByAgentId = null;
+    // Note: _evalReloadAttempted is intentionally NOT reset here
+    // to prevent infinite reload loops in getEvalMetadata
+}
+//# sourceMappingURL=_metadata.js.map

package/dist/_metadata.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"_metadata.js","sourceRoot":"","sources":["../src/_metadata.ts"],"names":[],"mappings":"AAAA;;;GAGG;AAEH,OAAO,EAAE,IAAI,EAAE,MAAM,WAAW,CAAC;AACjC,OAAO,EAAE,UAAU,EAAE,YAAY,EAAE,MAAM,SAAS,CAAC;AACnD,OAAO,EAAE,QAAQ,EAAE,MAAM,mBAAmB,CAAC;AAyE7C,8EAA8E;AAC9E,IAAI,cAAc,GAAqC,IAAI,CAAC;AAE5D;;GAEG;AACH,MAAM,UAAU,eAAe;IAC9B,OAAO,IAAI,CAAC,OAAO,CAAC,GAAG,EAAE,EAAE,YAAY,EAAE,yBAAyB,CAAC,CAAC;AACrE,CAAC;AAED;;;GAGG;AACH,MAAM,UAAU,iBAAiB;IAChC,wCAAwC;IACxC,IAAI,cAAc,KAAK,IAAI,EAAE,CAAC;QAC7B,QAAQ,CAAC,IAAI,CACZ,mEAAmE,EACnE,cAAc,KAAK,SAAS,CAC5B,CAAC;QACF,OAAO,cAAc,CAAC;IACvB,CAAC;IAED,MAAM,YAAY,GAAG,eAAe,EAAE,CAAC;IACvC,QAAQ,CAAC,IAAI,CAAC,gDAAgD,EAAE,YAAY,CAAC,CAAC;IAC9E,QAAQ,CAAC,IAAI,CAAC,sCAAsC,EAAE,OAAO,CAAC,GAAG,EAAE,CAAC,CAAC;IAErE,IAAI,CAAC,UAAU,CAAC,YAAY,CAAC,EAAE,CAAC;QAC/B,QAAQ,CAAC,IAAI,CAAC,oDAAoD,EAAE,YAAY,CAAC,CAAC;QAClF,cAAc,GAAG,SAAS,CAAC;QAC3B,OAAO,SAAS,CAAC;IAClB,CAAC;IAED,IAAI,CAAC;QACJ,QAAQ,CAAC,IAAI,CAAC,uDAAuD,CAAC,CAAC;QACvE,MAAM,OAAO,GAAG,YAAY,CAAC,YAAY,EAAE,OAAO,CAAC,CAAC;QACpD,MAAM,QAAQ,GAAG,IAAI,CAAC,KAAK,CAAC,OAAO,CAAkB,CAAC;QACtD,cAAc,GAAG,QAAQ,CAAC;QAE1B,4BAA4B;QAC5B,IAAI,UAAU,GAAG,CAAC,CAAC;QACnB,KAAK,MAAM,KAAK,IAAI,QAAQ,CAAC,MAAM,IAAI,EAAE,EAAE,CAAC;YAC3C,UAAU,IAAI,KAAK,CAAC,KAAK,EAAE,MAAM,IAAI,CAAC,CAAC;QACxC,CAAC;QAED,QAAQ,CAAC,IAAI,CACZ,iFAAiF,EACjF,QAAQ,CAAC,MAAM,EAAE,MAAM,IAAI,CAAC,EAC5B,QAAQ,CAAC,MAAM,EAAE,MAAM,IAAI,CAAC,EAC5B,UAAU,CACV,CAAC;QAEF,wCAAwC;QACxC,KAAK,MAAM,KAAK,IAAI,QAAQ,CAAC,MAAM,IAAI,EAAE,EAAE,CAAC;YAC3C,QAAQ,CAAC,IAAI,CAAC,oCAAoC,EAAE,KAAK,CAAC,IAAI,EAAE,KAAK,CAAC,KAAK,EAAE,MAAM,IAAI,CAAC,CAAC,CAAC;QAC3F,CAAC;QAED,OAAO,QAAQ,CAAC;IACjB,CAAC;IAAC,OAAO,GAAG,EAAE,CAAC;QACd,QAAQ,CAAC,IAAI,CAAC,uDAAuD,EAAE,GAAG,CAAC,CAAC;QAC5E,cAAc,GAAG,SAAS,CAAC;QAC3B,OAAO,SAAS,CAAC;IAClB,CAAC;AACF,CAAC;AAKD,kDAAkD;AAClD,IAAI,aAAa,GAA2C,IAAI,CAAC;AACjE,IAAI,gBAAgB,GAA2C,IAAI,CAAC;AAEpE,wEAAwE;AACxE,IAAI,iBAAiB,GAAuD,IAAI,CAAC;AACjF,IAAI,eAAe,GAAuD,IAAI,CAAC;AAE/E,+DAA+D;AAC/D,IAAI,oBAAoB,GAAG,KAAK,CAAC;AAEjC;;GAEG;AACH,SAAS,eAAe;IACvB,IAAI,aAAa,KAAK,IAAI,EAAE,CAAC;QAC5B,QAAQ,CAAC,IAAI,CAAC,2DAA2D,CAAC,CAAC;QAC3E,OAAO;IACR,CAAC;IAED,QAAQ,CAAC,IAAI,CAAC,8DAA8D,CAAC,CAAC;IAE9E,aAAa,GAAG,IAAI,GAAG,EAAE,CAAC;IAC1B,gBAAgB,GAAG,IAAI,GAAG,EAAE,CAAC;IAC7B,iBAAiB,GAAG,IAAI,GAAG,EAAE,CAAC;IAC9B,eAAe,GAAG,IAAI,GAAG,EAAE,CAAC;IAE5B,MAAM,QAAQ,GAAG,iBAAiB,EAAE,CAAC;IACrC,IAAI,CAAC,QAAQ,EAAE,MAAM,EAAE,CAAC;QACvB,QAAQ,CAAC,IAAI,CAAC,4DAA4D,CAAC,CAAC;QAC5E,OAAO;IACR,CAAC;IAED,QAAQ,CAAC,IAAI,CAAC,0CAA0C,QAAQ,CAAC,MAAM,CAAC,MAAM,SAAS,CAAC,CAAC;IAEzF,KAAK,MAAM,KAAK,IAAI,QAAQ,CAAC,MAAM,EAAE,CAAC;QACrC,IAAI,KAAK,CAAC,IAAI,EAAE,CAAC;YAChB,aAAa,CAAC,GAAG,CAAC,KAAK,CAAC,IAAI,EAAE,KAAK,CAAC,CAAC;QACtC,CAAC;QACD,IAAI,KAAK,CAAC,OAAO,EAAE,CAAC;YACnB,gBAAgB,CAAC,GAAG,CAAC,KAAK,CAAC,OAAO,EAAE,KAAK,CAAC,CAAC;QAC5C,CAAC;QAED,yBAAyB;QACzB,IAAI,KAAK,CAAC,KAAK,IAAI,KAAK,CAAC,KAAK,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;YAC3C,MAAM,WAAW,GAAG,IAAI,GAAG,EAA6B,CAAC;YACzD,KAAK,MAAM,QAAQ,IAAI,KAAK,CAAC,KAAK,EAAE,CAAC;gBACpC,IAAI,QAAQ,CAAC,IAAI,EAAE,CAAC;oBACnB,WAAW,CAAC,GAAG,CAAC,QAAQ,CAAC,IAAI,EAAE,QAAQ,CAAC,CAAC;oBACzC,QAAQ,CAAC,IAAI,CACZ,mCAAmC,KAAK,CAAC,IAAI,WAAW,QAAQ,CAAC,IAAI,aAAa,QAAQ,CAAC,MAAM,GAAG,CACpG,CAAC;gBACH,CAAC;YACF,CAAC;YACD,IAAI,KAAK,CAAC,IAAI,EAAE,CAAC;gBAChB,iBAAiB,CAAC,GAAG,CAAC,KAAK,CAAC,IAAI,EAAE,WAAW,CAAC,CAAC;YAChD,CAAC;YACD,IAAI,KAAK,CAAC,OAAO,EAAE,CAAC;gBACnB,eAAe,CAAC,GAAG,CAAC,KAAK,CAAC,OAAO,EAAE,WAAW,CAAC,CAAC;YACjD,CAAC;QACF,CAAC;aAAM,CAAC;YACP,QAAQ,CAAC,IAAI,CAAC,qBAAqB,KAAK,CAAC,IAAI,gBAAgB,CAAC,CAAC;QAChE,CAAC;IACF,CAAC;IACD,QAAQ,CAAC,IAAI,CAAC,+BAA+B,iBAAiB,EAAE,IAAI,IAAI,CAAC,oBAAoB,CAAC,CAAC;AAChG,CAAC;AAED;;GAEG;AACH,MAAM,UAAU,sBAAsB,CAAC,SAAiB;IACvD,eAAe,EAAE,CAAC;IAClB,OAAO,aAAa,EAAE,GAAG,CAAC,SAAS,CAAC,CAAC;AACtC,CAAC;AAED;;GAEG;AACH,MAAM,UAAU,yBAAyB,CAAC,OAAe;IACxD,eAAe,EAAE,CAAC;IAClB,OAAO,gBAAgB,EAAE,GAAG,CAAC,OAAO,CAAC,CAAC;AACvC,CAAC;AAED;;GAEG;AACH,MAAM,UAAU,eAAe,CAC9B,SAAiB,EACjB,QAAgB;IAEhB,eAAe,EAAE,CAAC;IAElB,gFAAgF;IAChF,gFAAgF;IAChF,IAAI,iBAAiB,EAAE,IAAI,KAAK,CAAC,IAAI,CAAC,oBAAoB,EAAE,CAAC;QAC5D,oBAAoB,GAAG,IAAI,CAAC;QAC5B,QAAQ,CAAC,IAAI,CACZ,kFAAkF,CAClF,CAAC;QACF,kBAAkB,EAAE,CAAC;QACrB,eAAe,EAAE,CAAC;QAClB,QAAQ,CAAC,IAAI,CACZ,4DAA4D,iBAAiB,EAAE,IAAI,IAAI,CAAC,EAAE,CAC1F,CAAC;IACH,CAAC;IAED,MAAM,UAAU,GAAG,iBAAiB,EAAE,GAAG,CAAC,SAAS,CAAC,CAAC;IACrD,QAAQ,CAAC,IAAI,CACZ,+BAA+B,SAAS,OAAO,QAAQ,kBAAkB,UAAU,CAAC,CAAC,CAAC,OAAO,UAAU,CAAC,IAAI,GAAG,CAAC,CAAC,CAAC,WAAW,EAAE,CAC/H,CAAC;IACF,IAAI,UAAU,EAAE,CAAC;QAChB,QAAQ,CAAC,IAAI,CACZ,yCAAyC,SAAS,OAAO,CAAC,GAAG,UAAU,CAAC,IAAI,EAAE,CAAC,CAAC,IAAI,CAAC,IAAI,CAAC,GAAG,CAC7F,CAAC;IACH,CAAC;IACD,IAAI,CAAC,UAAU,EAAE,CAAC;QACjB,QAAQ,CAAC,IAAI,CACZ,6CAA6C,CAAC,GAAG,CAAC,iBAAiB,EAAE,IAAI,EAAE,IAAI,EAAE,CAAC,CAAC,CAAC,IAAI,CAAC,IAAI,CAAC,GAAG,CACjG,CAAC;IACH,CAAC;IACD,MAAM,MAAM,GAAG,UAAU,EAAE,GAAG,CAAC,QAAQ,CAAC,CAAC;IACzC,QAAQ,CAAC,IAAI,CACZ,sCAAsC,MAAM,CAAC,CAAC,CAAC,gBAAgB,MAAM,CAAC,MAAM,EAAE,CAAC,CAAC,CAAC,WAAW,EAAE,CAC9F,CAAC;IACF,OAAO,MAAM,CAAC;AACf,CAAC;AAED;;GAEG;AACH,MAAM,UAAU,wBAAwB,CACvC,OAAe,EACf,QAAgB;IAEhB,eAAe,EAAE,CAAC;IAClB,OAAO,eAAe,EAAE,GAAG,CAAC,OAAO,CAAC,EAAE,GAAG,CAAC,QAAQ,CAAC,CAAC;AACrD,CAAC;AAED;;GAEG;AACH,MAAM,UAAU,WAAW;IAC1B,OAAO,iBAAiB,EAAE,KAAK,SAAS,CAAC;AAC1C,CAAC;AAED;;GAEG;AACH,MAAM,UAAU,kBAAkB;IACjC,QAAQ,CAAC,IAAI,CAAC,oDAAoD,CAAC,CAAC;IACpE,cAAc,GAAG,IAAI,CAAC;IACtB,aAAa,GAAG,IAAI,CAAC;IACrB,gBAAgB,GAAG,IAAI,CAAC;IACxB,iBAAiB,GAAG,IAAI,CAAC;IACzB,eAAe,GAAG,IAAI,CAAC;IACvB,6DAA6D;IAC7D,sDAAsD;AACvD,CAAC"}

package/dist/_process-protection.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"_process-protection.d.ts","sourceRoot":"","sources":["../src/_process-protection.ts"],"names":[],"mappings":"AAAA;;;;;GAKG;AAiBH;;;GAGG;AACH,wBAAgB,2BAA2B,IAAI,IAAI,CAYlD;AAED;;GAEG;AACH,wBAAgB,4BAA4B,IAAI,IAAI,CAOnD;AAED;;;GAGG;AACH,wBAAgB,YAAY,CAAC,IAAI,CAAC,EAAE,MAAM,GAAG,KAAK,CAEjD;AAED;;GAEG;AACH,wBAAgB,mBAAmB,IAAI,OAAO,CAE7C"}
+{"version":3,"file":"_process-protection.d.ts","sourceRoot":"","sources":["../src/_process-protection.ts"],"names":[],"mappings":"AAAA;;;;;GAKG;AAiBH;;;GAGG;AACH,wBAAgB,2BAA2B,IAAI,IAAI,CAelD;AAED;;GAEG;AACH,wBAAgB,4BAA4B,IAAI,IAAI,CAUnD;AAED;;;GAGG;AACH,wBAAgB,YAAY,CAAC,IAAI,CAAC,EAAE,MAAM,GAAG,KAAK,CAEjD;AAED;;GAEG;AACH,wBAAgB,mBAAmB,IAAI,OAAO,CAE7C"}

package/dist/_process-protection.js

@@ -19,6 +19,8 @@ export function enableProcessExitProtection() {
         return;
     }
     protectionEnabled = true;
+    // eslint-disable-next-line @typescript-eslint/no-explicit-any
+    globalThis.AGENTUITY_PROCESS_EXIT = originalExit;
     // Replace process.exit with a function that throws
     // eslint-disable-next-line @typescript-eslint/no-explicit-any
     process.exit = function (code) {
@@ -32,6 +34,8 @@ export function disableProcessExitProtection() {
     if (!protectionEnabled) {
         return;
     }
+    // eslint-disable-next-line @typescript-eslint/no-explicit-any
+    globalThis.AGENTUITY_PROCESS_EXIT = undefined;
     protectionEnabled = false;
     process.exit = originalExit;
 }

package/dist/_process-protection.js.map

@@ -1 +1 @@
-{"version":3,"file":"_process-protection.js","sourceRoot":"","sources":["../src/_process-protection.ts"],"names":[],"mappings":"AAAA;;;;;GAKG;AAEH,OAAO,EAAE,eAAe,EAAE,MAAM,iBAAiB,CAAC;AAElD,kCAAkC;AAClC,MAAM,YAAY,GAAG,OAAO,CAAC,IAAI,CAAC,IAAI,CAAC,OAAO,CAAC,CAAC;AAEhD,yCAAyC;AACzC,IAAI,iBAAiB,GAAG,KAAK,CAAC;AAE9B,MAAM,uBAAuB,GAAG,eAAe,CAC9C,yBAAyB,EACzB,yGAAyG,CACzG,EAEG,CAAC;AAEL;;;GAGG;AACH,MAAM,UAAU,2BAA2B;IAC1C,IAAI,iBAAiB,EAAE,CAAC;QACvB,OAAO;IACR,CAAC;IAED,iBAAiB,GAAG,IAAI,CAAC;IAEzB,mDAAmD;IACnD,8DAA8D;IAC7D,OAAe,CAAC,IAAI,GAAG,UAAU,IAAyC;QAC1E,MAAM,IAAI,uBAAuB,CAAC,EAAE,IAAI,EAAE,CAAC,CAAC;IAC7C,CAAC,CAAC;AACH,CAAC;AAED;;GAEG;AACH,MAAM,UAAU,4BAA4B;IAC3C,IAAI,CAAC,iBAAiB,EAAE,CAAC;QACxB,OAAO;IACR,CAAC;IAED,iBAAiB,GAAG,KAAK,CAAC;IAC1B,OAAO,CAAC,IAAI,GAAG,YAAY,CAAC;AAC7B,CAAC;AAED;;;GAGG;AACH,MAAM,UAAU,YAAY,CAAC,IAAa;IACzC,OAAO,YAAY,CAAC,IAAI,CAAC,CAAC;AAC3B,CAAC;AAED;;GAEG;AACH,MAAM,UAAU,mBAAmB;IAClC,OAAO,iBAAiB,CAAC;AAC1B,CAAC"}
+{"version":3,"file":"_process-protection.js","sourceRoot":"","sources":["../src/_process-protection.ts"],"names":[],"mappings":"AAAA;;;;;GAKG;AAEH,OAAO,EAAE,eAAe,EAAE,MAAM,iBAAiB,CAAC;AAElD,kCAAkC;AAClC,MAAM,YAAY,GAAG,OAAO,CAAC,IAAI,CAAC,IAAI,CAAC,OAAO,CAAC,CAAC;AAEhD,yCAAyC;AACzC,IAAI,iBAAiB,GAAG,KAAK,CAAC;AAE9B,MAAM,uBAAuB,GAAG,eAAe,CAC9C,yBAAyB,EACzB,yGAAyG,CACzG,EAEG,CAAC;AAEL;;;GAGG;AACH,MAAM,UAAU,2BAA2B;IAC1C,IAAI,iBAAiB,EAAE,CAAC;QACvB,OAAO;IACR,CAAC;IAED,iBAAiB,GAAG,IAAI,CAAC;IAEzB,8DAA8D;IAC7D,UAAkB,CAAC,sBAAsB,GAAG,YAAY,CAAC;IAE1D,mDAAmD;IACnD,8DAA8D;IAC7D,OAAe,CAAC,IAAI,GAAG,UAAU,IAAyC;QAC1E,MAAM,IAAI,uBAAuB,CAAC,EAAE,IAAI,EAAE,CAAC,CAAC;IAC7C,CAAC,CAAC;AACH,CAAC;AAED;;GAEG;AACH,MAAM,UAAU,4BAA4B;IAC3C,IAAI,CAAC,iBAAiB,EAAE,CAAC;QACxB,OAAO;IACR,CAAC;IAED,8DAA8D;IAC7D,UAAkB,CAAC,sBAAsB,GAAG,SAAS,CAAC;IAEvD,iBAAiB,GAAG,KAAK,CAAC;IAC1B,OAAO,CAAC,IAAI,GAAG,YAAY,CAAC;AAC7B,CAAC;AAED;;;GAGG;AACH,MAAM,UAAU,YAAY,CAAC,IAAa;IACzC,OAAO,YAAY,CAAC,IAAI,CAAC,CAAC;AAC3B,CAAC;AAED;;GAEG;AACH,MAAM,UAAU,mBAAmB;IAClC,OAAO,iBAAiB,CAAC;AAC1B,CAAC"}

package/dist/_services.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"_services.d.ts","sourceRoot":"","sources":["../src/_services.ts"],"names":[],"mappings":"AACA,OAAO,EAKN,KAAK,eAAe,EACpB,KAAK,aAAa,EAClB,KAAK,aAAa,EAIlB,KAAK,MAAM,EACX,KAAK,oBAAoB,EACzB,KAAK,oBAAoB,EAEzB,MAAM,iBAAiB,CAAC;AAmBzB,OAAO,KAAK,EAAE,SAAS,EAAE,MAAM,OAAO,CAAC;AACvC,OAAO,EAGN,KAAK,cAAc,EACnB,KAAK,eAAe,EACpB,MAAM,WAAW,CAAC;AA4InB,wBAAgB,cAAc,CAAC,MAAM,EAAE,MAAM,EAAE,MAAM,CAAC,EAAE,SAAS,CAAC,GAAG,CAAC,EAAE,SAAS,CAAC,EAAE,MAAM;;;;EA2EzF;AAED,wBAAgB,iBAAiB,IAAI,cAAc,CAElD;AAED,wBAAgB,kBAAkB,IAAI,eAAe,CAEpD;AAGD,wBAAgB,cAAc,IAAI,GAAG,GAAG,IAAI,CAE3C;AAED,wBAAgB,uBAAuB,yBAEtC;AAED,wBAAgB,uBAAuB,yBAEtC;AAED,wBAAgB,WAAW;;;;EAE1B;AAGD,wBAAgB,gBAAgB,CAAC,CAAC,EAAE,GAAG,EAAE,aAAa,UAAQ,QAkC7D"}
+{"version":3,"file":"_services.d.ts","sourceRoot":"","sources":["../src/_services.ts"],"names":[],"mappings":"AACA,OAAO,EAKN,KAAK,eAAe,EACpB,KAAK,aAAa,EAClB,KAAK,aAAa,EAIlB,KAAK,MAAM,EACX,KAAK,oBAAoB,EACzB,KAAK,oBAAoB,EAEzB,MAAM,iBAAiB,CAAC;AAmBzB,OAAO,KAAK,EAAE,SAAS,EAAE,MAAM,OAAO,CAAC;AACvC,OAAO,EAGN,KAAK,cAAc,EACnB,KAAK,eAAe,EACpB,MAAM,WAAW,CAAC;AA6InB,wBAAgB,cAAc,CAAC,MAAM,EAAE,MAAM,EAAE,MAAM,CAAC,EAAE,SAAS,CAAC,GAAG,CAAC,EAAE,SAAS,CAAC,EAAE,MAAM;;;;EA4EzF;AAED,wBAAgB,iBAAiB,IAAI,cAAc,CAElD;AAED,wBAAgB,kBAAkB,IAAI,eAAe,CAEpD;AAGD,wBAAgB,cAAc,IAAI,GAAG,GAAG,IAAI,CAE3C;AAED,wBAAgB,uBAAuB,yBAEtC;AAED,wBAAgB,uBAAuB,yBAEtC;AAED,wBAAgB,WAAW;;;;EAE1B;AAGD,wBAAgB,gBAAgB,CAAC,CAAC,EAAE,GAAG,EAAE,aAAa,UAAQ,QAkC7D"}