@orq-ai/evaluatorq 1.2.0-rc.4 → 1.2.1

package/README.md

@@ -12,6 +12,19 @@ An evaluation framework library that provides a flexible way to run parallel eva
 - **Pass/Fail Tracking**: Evaluators can return pass/fail status for CI/CD integration
 - **Integrations**: LangChain, LangGraph, and Vercel AI SDK agent integration
 
+## 📖 Table of Contents
+
+- [Installation](#-installation)
+- [Getting Started](#-getting-started)
+- [Quick Start](#-quick-start)
+- [LangChain Integration](#-langchain-integration)
+- [Vercel AI SDK Integration](#-vercel-ai-sdk-integration)
+- [Configuration](#-configuration)
+- [Orq Platform Integration](#-orq-platform-integration)
+- [OpenTelemetry Tracing](#-opentelemetry-tracing)
+- [Pass/Fail Tracking](#-passfail-tracking)
+- [API Reference](#-api-reference)
+
 ## 📥 Installation
 
 ```bash
@@ -45,9 +58,25 @@ npm install langchain @langchain/core @langchain/langgraph
 For Vercel AI SDK integration:
 
 ```bash
-npm install ai 
+npm install ai
 ```
 
+## 🏁 Getting Started
+
+New to evaluatorq? Follow this path to get up and running:
+
+| Step | What you'll learn | Example |
+|------|------------------|---------|
+| 1. **Basic eval** | Run your first evaluation with inline data | [`pass-fail-simple.ts`](../../examples/src/lib/basics/pass-fail-simple.ts) |
+| 2. **Multiple jobs** | Run multiple jobs in parallel on each data point | [`example-runners.ts`](../../examples/src/lib/basics/example-runners.ts) |
+| 3. **Reusable patterns** | Create reusable jobs and evaluators | [`eval-reuse.eval.ts`](../../examples/src/lib/basics/eval-reuse.eval.ts) |
+| 4. **Datasets** | Load data from the Orq platform | [`dataset-example.eval.ts`](../../examples/src/lib/datasets/dataset-example.eval.ts) |
+| 5. **Structured scores** | Return multi-dimensional metrics | [`structured-rubric.eval.ts`](../../examples/src/lib/structured/structured-rubric.eval.ts) |
+| 6. **LangChain agent** | Evaluate a LangChain/LangGraph agent | [`langchain-agent-eval.ts`](../../examples/src/lib/integrations/langchain/langchain-agent-eval.ts) |
+| 7. **Vercel AI SDK** | Evaluate a Vercel AI SDK agent | [`vercel_ai_sdk_integration_example.ts`](../../examples/src/lib/integrations/vercel/vercel_ai_sdk_integration_example.ts) |
+
+> **Tip:** Start with step 1 and work your way up. Each example builds on concepts from the previous one.
+
 ## 🚀 Quick Start
 
 ### Basic Usage
@@ -89,6 +118,8 @@ await evaluatorq("text-analysis", {
 });
 ```
 
+> **Tip:** The `job()` helper preserves the job name in error messages. Always prefer `job("name", fn)` over raw functions for better debugging.
+
 ### Using Orq Platform Datasets
 
 ```typescript
@@ -125,6 +156,8 @@ await evaluatorq("dataset-evaluation", {
 });
 ```
 
+> **Tip:** Use `parallelism` to control how many data points are processed concurrently. Start with a low value (3-5) when calling external APIs to avoid rate limits.
+
 ### Advanced Features
 
 #### Multiple Jobs
@@ -179,17 +212,47 @@ await evaluatorq("async-eval", {
 });
 ```
 
+#### Dashboard Organization with `path`
+
+Use the `path` parameter to organize evaluation results into folders on the Orq dashboard:
+
+```typescript
+await evaluatorq("my-evaluation", {
+  path: "MyProject/Evaluations/Unit Tests",
+  data: [...],
+  jobs: [...],
+  evaluators: [...],
+});
+```
+
+> **Tip:** Use paths like `"Team/Sprint-42/Feature-X"` to keep experiments organized across teams and sprints.
+
+See [`path-organization.eval.ts`](../../examples/src/lib/structured/path-organization.eval.ts) for a complete example.
+
+#### Evaluation Description
+
+Add a description to document the purpose of each evaluation run:
+
+```typescript
+await evaluatorq("model-comparison", {
+  description: "Compare GPT-4o vs Claude on customer support responses",
+  data: [...],
+  jobs: [...],
+  evaluators: [...],
+});
+```
+
 #### Structured Evaluation Results
 
 Evaluators can return structured, multi-dimensional metrics using `EvaluationResultCell`. This is useful for metrics like BERT scores, ROUGE-N scores, or any evaluation that produces multiple sub-scores.
 
 See the runnable examples in the `examples/` directory:
 
-- [`structured-rubric.eval.ts`](../../examples/src/lib/structured-rubric.eval.ts) - Multi-criteria quality rubric (relevance, coherence, fluency)
-- [`structured-sentiment.eval.ts`](../../examples/src/lib/structured-sentiment.eval.ts) - Sentiment distribution breakdown (positive, negative, neutral)
-- [`structured-safety.eval.ts`](../../examples/src/lib/structured-safety.eval.ts) - Toxicity/safety severity scores with pass/fail tracking
+- [`structured-rubric.eval.ts`](../../examples/src/lib/structured/structured-rubric.eval.ts) - Multi-criteria quality rubric (relevance, coherence, fluency)
+- [`structured-sentiment.eval.ts`](../../examples/src/lib/structured/structured-sentiment.eval.ts) - Sentiment distribution breakdown (positive, negative, neutral)
+- [`structured-safety.eval.ts`](../../examples/src/lib/structured/structured-safety.eval.ts) - Toxicity/safety severity scores with pass/fail tracking
 
-For a BERT score example using the Orq platform, see [`llm-eval-with-results.ts`](../../examples/src/lib/llm-eval-with-results.ts).
+For a BERT score example using the Orq platform, see [`llm-eval-with-results.ts`](../../examples/src/lib/basics/llm-eval-with-results.ts).
 
 > **Note:** Structured results display as `[structured]` in the terminal summary table but are preserved in full when sent to the Orq platform and OpenTelemetry spans.
 
@@ -244,12 +307,60 @@ The LangChain integration allows you to:
 - Automatically convert agent outputs to OpenResponses format
 - Evaluate agent behavior using standard evaluatorq evaluators
 
+### System Instructions
+
+Use the `instructions` option to inject a system prompt into the agent. It can be a static string or a function that builds instructions dynamically from the dataset row:
+
+```typescript
+import { wrapLangChainAgent } from "@orq-ai/evaluatorq/langchain";
+
+// Static instructions
+const job = wrapLangChainAgent(agent, {
+  name: "my-agent",
+  instructions: "You are a helpful weather assistant.",
+});
+
+// Dynamic instructions from dataset inputs
+const job = wrapLangChainAgent(agent, {
+  name: "research-agent",
+  instructions: (data) =>
+    `Research the topic: ${data.inputs.topic}. Focus on ${data.inputs.focus}.`,
+});
+```
+
+### Input Modes
+
+The wrapper reads the user input from `data.inputs` in three ways:
+
+- **`prompt`** (default): `data.inputs.prompt` — a single string, sent as one user message.
+- **`messages`**: `data.inputs.messages` — an array of `{ role, content }` objects, sent as-is.
+- **Both**: when both are present, `messages` are sent first, followed by `prompt` as a final user message.
+
+Change the prompt key with the `promptKey` option (e.g., `{ promptKey: "question" }`).
+
+### Extracting Text
+
+Agent wrappers return a full OpenResponses object. Use `extractText()` to pull out the assistant's reply:
+
+```typescript
+import { extractText } from "@orq-ai/evaluatorq/openresponses";
+
+const scorer = async ({ output }) => {
+  const text = extractText(output);
+  return { value: text.length > 0 ? 1 : 0 };
+};
+```
+
 ### Examples
 
 Complete examples are available in the examples folder:
 
-- **LangChain Agent**: [`examples/src/lib/integrations/langchain-agent-eval.ts`](../../examples/src/lib/integrations/langchain-agent-eval.ts)
-- **LangGraph Agent**: [`examples/src/lib/integrations/langgraph-agent-eval.ts`](../../examples/src/lib/integrations/langgraph-agent-eval.ts)
+- **LangChain Agent**: [`examples/src/lib/integrations/langchain/langchain-agent-eval.ts`](../../examples/src/lib/integrations/langchain/langchain-agent-eval.ts)
+- **LangGraph Agent**: [`examples/src/lib/integrations/langchain/langgraph-agent-eval.ts`](../../examples/src/lib/integrations/langchain/langgraph-agent-eval.ts)
+- **LangChain Research Agent (advanced)**: [`examples/src/lib/integrations/langchain/langchain-research-eval.ts`](../../examples/src/lib/integrations/langchain/langchain-research-eval.ts) — Dataset-driven research agent with dynamic `instructions` and multi-criteria evaluators
+- **LangGraph Research Agent (advanced)**: [`examples/src/lib/integrations/langchain/langgraph-research-eval.ts`](../../examples/src/lib/integrations/langchain/langgraph-research-eval.ts) — Multi-tool research agent with correctness, tool chain, quality, completeness, and efficiency evaluators
+
+> **Tip:** Pass the `instructions` option to `wrapLangChainAgent` for dynamic system prompts — no need to write a custom job function.
 
 ## 🤖 Vercel AI SDK Integration
 
@@ -260,11 +371,15 @@ The Vercel AI SDK integration allows you to:
 - Automatically convert agent outputs to OpenResponses format
 - Evaluate agent behavior using standard evaluatorq evaluators
 
+The same `instructions`, `messages` input, and `extractText` support described in the LangChain section also applies to `wrapAISdkAgent`.
+
 ### Examples
 
 Complete examples are available in the examples folder:
 
-- **Vercel AI SDK Agent**: [`examples/src/lib/integrations/vercel_ai_sdk_integration_example.ts`](../../examples/src/lib/integrations/vercel_ai_sdk_integration_example.ts)
+- **Vercel AI SDK Agent**: [`examples/src/lib/integrations/vercel/vercel_ai_sdk_integration_example.ts`](../../examples/src/lib/integrations/vercel/vercel_ai_sdk_integration_example.ts)
+- **Vercel AI SDK Dataset Eval**: [`examples/src/lib/integrations/vercel/vercel_ai_sdk_dataset_example.ts`](../../examples/src/lib/integrations/vercel/vercel_ai_sdk_dataset_example.ts) — Dataset-based weather agent evaluation with expected output comparison
+- **Vercel Multi-Agent Eval (advanced)**: [`examples/src/lib/integrations/vercel/vercel-multi-agent-eval.ts`](../../examples/src/lib/integrations/vercel/vercel-multi-agent-eval.ts) — Research + math agents with `instructions` parameter, scored on correctness, tool usage, quality rubric, and safety
 
 ## 🔧 Configuration
 
@@ -388,6 +503,9 @@ Main function to run evaluations.
   - `data`: Array of data points, async iterable, or Orq dataset config
   - `jobs`: Array of job functions to run on each data point
   - `evaluators`: Array of evaluator configurations
+  - `parallelism`: Number of concurrent jobs (default: 1)
+  - `path`: Optional string for organizing results on the Orq dashboard (e.g., `"Project/Category"`)
+  - `description`: Optional string describing the evaluation run
 
 #### Returns:
 
@@ -461,6 +579,20 @@ type Scorer = (
 import { wrapLangChainAgent, wrapLangGraphAgent } from "@orq-ai/evaluatorq/langchain";
 import { wrapAISdkAgent } from "@orq-ai/evaluatorq/ai-sdk";
 import type { ResponseResource } from "@orq-ai/evaluatorq/openresponses";
+import { extractText } from "@orq-ai/evaluatorq/openresponses";
+
+// Extract the assistant's text reply from an OpenResponses output
+function extractText(output: unknown): string;
+
+// Options accepted by wrapLangChainAgent, wrapLangGraphAgent, and wrapAISdkAgent
+interface AgentJobOptions {
+  /** Job name (defaults to "agent" or agent.id) */
+  name?: string;
+  /** Key in data.inputs to use as the prompt (defaults to "prompt") */
+  promptKey?: string;
+  /** Static string or function returning system instructions */
+  instructions?: string | ((data: DataPoint) => string);
+}
 
 // Deployment helper types
 interface DeploymentOptions {

package/dist/lib/integrations/ai-sdk/convert.d.ts

@@ -13,10 +13,10 @@ export declare function buildInputFromSteps<TOOLS extends ToolSet>(result: Await
 /**
  * Converts Vercel AI SDK agent result to OpenResponses format.
  */
-export declare function convertToOpenResponses<TOOLS extends ToolSet>(result: Awaited<ReturnType<Agent<never, TOOLS, never>["generate"]>>, agent: Agent<never, TOOLS, never>, prompt?: string): ResponseResource;
+export declare function convertToOpenResponses<TOOLS extends ToolSet>(result: Awaited<ReturnType<Agent<never, TOOLS, never>["generate"]>>, agent: Agent<never, TOOLS, never>): ResponseResource;
 /**
- * Fallback function to manually build OpenResponses format from steps.
- * Used when the provider doesn't return native OpenResponses format.
+ * Builds OpenResponses format from AI SDK agent result steps.
+ * Extracts input messages from the request body when available.
  */
 export declare function buildOpenResponsesFromSteps<TOOLS extends ToolSet>(result: Awaited<ReturnType<Agent<never, TOOLS, never>["generate"]>>, agent: Agent<never, TOOLS, never>, _prompt?: string): ResponseResource;
 //# sourceMappingURL=convert.d.ts.map

package/dist/lib/integrations/ai-sdk/convert.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"convert.d.ts","sourceRoot":"","sources":["../../../../src/lib/integrations/ai-sdk/convert.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,EAAE,KAAK,EAAc,OAAO,EAAE,MAAM,IAAI,CAAC;AAOrD,OAAO,KAAK,EAMV,gBAAgB,EAEjB,MAAM,2BAA2B,CAAC;AASnC;;;;;;;;GAQG;AACH,wBAAgB,mBAAmB,CAAC,KAAK,SAAS,OAAO,EACvD,MAAM,EAAE,OAAO,CAAC,UAAU,CAAC,KAAK,CAAC,KAAK,EAAE,KAAK,EAAE,KAAK,CAAC,CAAC,UAAU,CAAC,CAAC,CAAC,EACnE,MAAM,EAAE,MAAM,GAAG,SAAS,GACzB,OAAO,EAAE,CA6EX;AAED;;GAEG;AACH,wBAAgB,sBAAsB,CAAC,KAAK,SAAS,OAAO,EAC1D,MAAM,EAAE,OAAO,CAAC,UAAU,CAAC,KAAK,CAAC,KAAK,EAAE,KAAK,EAAE,KAAK,CAAC,CAAC,UAAU,CAAC,CAAC,CAAC,EACnE,KAAK,EAAE,KAAK,CAAC,KAAK,EAAE,KAAK,EAAE,KAAK,CAAC,EACjC,MAAM,CAAC,EAAE,MAAM,GACd,gBAAgB,CAElB;AAwCD;;;GAGG;AACH,wBAAgB,2BAA2B,CAAC,KAAK,SAAS,OAAO,EAC/D,MAAM,EAAE,OAAO,CAAC,UAAU,CAAC,KAAK,CAAC,KAAK,EAAE,KAAK,EAAE,KAAK,CAAC,CAAC,UAAU,CAAC,CAAC,CAAC,EACnE,KAAK,EAAE,KAAK,CAAC,KAAK,EAAE,KAAK,EAAE,KAAK,CAAC,EACjC,OAAO,CAAC,EAAE,MAAM,GACf,gBAAgB,CA4JlB"}
+{"version":3,"file":"convert.d.ts","sourceRoot":"","sources":["../../../../src/lib/integrations/ai-sdk/convert.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,EAAE,KAAK,EAAc,OAAO,EAAE,MAAM,IAAI,CAAC;AAOrD,OAAO,KAAK,EAMV,gBAAgB,EAEjB,MAAM,2BAA2B,CAAC;AASnC;;;;;;;;GAQG;AACH,wBAAgB,mBAAmB,CAAC,KAAK,SAAS,OAAO,EACvD,MAAM,EAAE,OAAO,CAAC,UAAU,CAAC,KAAK,CAAC,KAAK,EAAE,KAAK,EAAE,KAAK,CAAC,CAAC,UAAU,CAAC,CAAC,CAAC,EACnE,MAAM,EAAE,MAAM,GAAG,SAAS,GACzB,OAAO,EAAE,CA6EX;AAED;;GAEG;AACH,wBAAgB,sBAAsB,CAAC,KAAK,SAAS,OAAO,EAC1D,MAAM,EAAE,OAAO,CAAC,UAAU,CAAC,KAAK,CAAC,KAAK,EAAE,KAAK,EAAE,KAAK,CAAC,CAAC,UAAU,CAAC,CAAC,CAAC,EACnE,KAAK,EAAE,KAAK,CAAC,KAAK,EAAE,KAAK,EAAE,KAAK,CAAC,GAChC,gBAAgB,CAElB;AA8FD;;;GAGG;AACH,wBAAgB,2BAA2B,CAAC,KAAK,SAAS,OAAO,EAC/D,MAAM,EAAE,OAAO,CAAC,UAAU,CAAC,KAAK,CAAC,KAAK,EAAE,KAAK,EAAE,KAAK,CAAC,CAAC,UAAU,CAAC,CAAC,CAAC,EACnE,KAAK,EAAE,KAAK,CAAC,KAAK,EAAE,KAAK,EAAE,KAAK,CAAC,EACjC,OAAO,CAAC,EAAE,MAAM,GACf,gBAAgB,CA6JlB"}

package/dist/lib/integrations/ai-sdk/convert.js

@@ -84,12 +84,51 @@ export function buildInputFromSteps(result, prompt) {
 /**
  * Converts Vercel AI SDK agent result to OpenResponses format.
  */
-export function convertToOpenResponses(result, agent, prompt) {
-    return buildOpenResponsesFromSteps(result, agent, prompt);
+export function convertToOpenResponses(result, agent) {
+    return buildOpenResponsesFromSteps(result, agent);
 }
 /**
- * Fallback function to manually build OpenResponses format from steps.
- * Used when the provider doesn't return native OpenResponses format.
+ * Maps a request body role to an OpenResponses Message role.
+ */
+const ROLE_MAP = {
+    system: "system",
+    user: "user",
+    assistant: "assistant",
+};
+/**
+ * Extracts text from request body message content.
+ * Content can be a plain string or an array of content blocks.
+ */
+function extractContentText(content) {
+    if (typeof content === "string")
+        return content;
+    return content
+        .filter((block) => block.type === "text" || block.type === "input_text")
+        .map((block) => block.text ?? "")
+        .join("");
+}
+/**
+ * Builds input ItemField[] from the request body input messages.
+ * Extracts system + user messages from result.steps[0].request.body.input.
+ */
+function buildInputFromRequestBody(requestInput) {
+    if (!requestInput || requestInput.length === 0)
+        return [];
+    return requestInput.map((msg) => {
+        const role = ROLE_MAP[msg.role] ?? "user";
+        const text = extractContentText(msg.content);
+        return {
+            type: "message",
+            id: generateItemId("msg"),
+            status: "completed",
+            role,
+            content: [{ type: "input_text", text }],
+        };
+    });
+}
+/**
+ * Builds OpenResponses format from AI SDK agent result steps.
+ * Extracts input messages from the request body when available.
  */
 export function buildOpenResponsesFromSteps(result, agent, _prompt) {
     const now = Math.floor(Date.now() / 1000);
@@ -199,6 +238,7 @@ export function buildOpenResponsesFromSteps(result, agent, _prompt) {
         model: result.response.modelId,
         previous_response_id: null,
         instructions: null,
+        input: buildInputFromRequestBody(requestBody?.input),
         output,
         error: status === "failed" ? { message: "Agent execution failed" } : null,
         tools,

package/dist/lib/integrations/ai-sdk/types.d.ts

@@ -1,4 +1,5 @@
 import type { StepResult } from "ai";
+import type { DataPoint } from "../../types.js";
 import type { FunctionTool, ResponseResource } from "../openresponses/index.js";
 export type { StepResult };
 /**
@@ -52,5 +53,10 @@ export interface AgentJobOptions {
     name?: string;
     /** The key in data.inputs to use as the prompt (defaults to "prompt") */
     promptKey?: string;
+    /**
+     * System instructions to prepend to the messages sent to the agent.
+     * Can be a static string or a function that receives the data point and returns the instructions.
+     */
+    instructions?: string | ((data: DataPoint) => string);
 }
 //# sourceMappingURL=types.d.ts.map

package/dist/lib/integrations/ai-sdk/types.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"types.d.ts","sourceRoot":"","sources":["../../../../src/lib/integrations/ai-sdk/types.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,EAAE,UAAU,EAAE,MAAM,IAAI,CAAC;AAErC,OAAO,KAAK,EAAE,YAAY,EAAE,gBAAgB,EAAE,MAAM,2BAA2B,CAAC;AAGhF,YAAY,EAAE,UAAU,EAAE,CAAC;AAE3B;;;;GAIG;AACH,MAAM,WAAW,QAAQ;IAEvB,OAAO,CAAC,EAAE,KAAK,CAAC;QACd,IAAI,EAAE,MAAM,CAAC;QACb,UAAU,CAAC,EAAE,MAAM,CAAC;QACpB,QAAQ,CAAC,EAAE,MAAM,CAAC;QAClB,KAAK,CAAC,EAAE,OAAO,CAAC;QAChB,MAAM,CAAC,EAAE,OAAO,CAAC;KAClB,CAAC,CAAC;IAEH,OAAO,CAAC,EAAE;QACR,IAAI,CAAC,EAAE;YACL,KAAK,CAAC,EAAE,OAAO,EAAE,CAAC;YAClB,KAAK,CAAC,EAAE,YAAY,EAAE,CAAC;SACxB,CAAC;KACH,CAAC;IACF,QAAQ,CAAC,EAAE;QACT,IAAI,CAAC,EAAE,gBAAgB,CAAC;QACxB,QAAQ,CAAC,EAAE,KAAK,CAAC;YACf,IAAI,EAAE,MAAM,CAAC;YACb,OAAO,EAAE,KAAK,CAAC;gBACb,IAAI,EAAE,MAAM,CAAC;gBACb,UAAU,CAAC,EAAE,MAAM,CAAC;gBACpB,QAAQ,CAAC,EAAE,MAAM,CAAC;gBAClB,KAAK,CAAC,EAAE,OAAO,CAAC;gBAChB,IAAI,CAAC,EAAE,MAAM,CAAC;gBACd,eAAe,CAAC,EAAE;oBAChB,MAAM,CAAC,EAAE;wBACP,MAAM,CAAC,EAAE,MAAM,CAAC;qBACjB,CAAC;iBACH,CAAC;aACH,CAAC,CAAC;SACJ,CAAC,CAAC;KACJ,CAAC;IACF,gBAAgB,CAAC,EAAE;QACjB,MAAM,CAAC,EAAE;YACP,MAAM,CAAC,EAAE,MAAM,CAAC;SACjB,CAAC;KACH,CAAC;CACH;AAED;;GAEG;AACH,MAAM,WAAW,eAAe;IAC9B,4DAA4D;IAC5D,IAAI,CAAC,EAAE,MAAM,CAAC;IACd,yEAAyE;IACzE,SAAS,CAAC,EAAE,MAAM,CAAC;CACpB"}
+{"version":3,"file":"types.d.ts","sourceRoot":"","sources":["../../../../src/lib/integrations/ai-sdk/types.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,EAAE,UAAU,EAAE,MAAM,IAAI,CAAC;AAErC,OAAO,KAAK,EAAE,SAAS,EAAE,MAAM,gBAAgB,CAAC;AAChD,OAAO,KAAK,EAAE,YAAY,EAAE,gBAAgB,EAAE,MAAM,2BAA2B,CAAC;AAGhF,YAAY,EAAE,UAAU,EAAE,CAAC;AAE3B;;;;GAIG;AACH,MAAM,WAAW,QAAQ;IAEvB,OAAO,CAAC,EAAE,KAAK,CAAC;QACd,IAAI,EAAE,MAAM,CAAC;QACb,UAAU,CAAC,EAAE,MAAM,CAAC;QACpB,QAAQ,CAAC,EAAE,MAAM,CAAC;QAClB,KAAK,CAAC,EAAE,OAAO,CAAC;QAChB,MAAM,CAAC,EAAE,OAAO,CAAC;KAClB,CAAC,CAAC;IAEH,OAAO,CAAC,EAAE;QACR,IAAI,CAAC,EAAE;YACL,KAAK,CAAC,EAAE,OAAO,EAAE,CAAC;YAClB,KAAK,CAAC,EAAE,YAAY,EAAE,CAAC;SACxB,CAAC;KACH,CAAC;IACF,QAAQ,CAAC,EAAE;QACT,IAAI,CAAC,EAAE,gBAAgB,CAAC;QACxB,QAAQ,CAAC,EAAE,KAAK,CAAC;YACf,IAAI,EAAE,MAAM,CAAC;YACb,OAAO,EAAE,KAAK,CAAC;gBACb,IAAI,EAAE,MAAM,CAAC;gBACb,UAAU,CAAC,EAAE,MAAM,CAAC;gBACpB,QAAQ,CAAC,EAAE,MAAM,CAAC;gBAClB,KAAK,CAAC,EAAE,OAAO,CAAC;gBAChB,IAAI,CAAC,EAAE,MAAM,CAAC;gBACd,eAAe,CAAC,EAAE;oBAChB,MAAM,CAAC,EAAE;wBACP,MAAM,CAAC,EAAE,MAAM,CAAC;qBACjB,CAAC;iBACH,CAAC;aACH,CAAC,CAAC;SACJ,CAAC,CAAC;KACJ,CAAC;IACF,gBAAgB,CAAC,EAAE;QACjB,MAAM,CAAC,EAAE;YACP,MAAM,CAAC,EAAE,MAAM,CAAC;SACjB,CAAC;KACH,CAAC;CACH;AAED;;GAEG;AACH,MAAM,WAAW,eAAe;IAC9B,4DAA4D;IAC5D,IAAI,CAAC,EAAE,MAAM,CAAC;IACd,yEAAyE;IACzE,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB;;;OAGG;IACH,YAAY,CAAC,EAAE,MAAM,GAAG,CAAC,CAAC,IAAI,EAAE,SAAS,KAAK,MAAM,CAAC,CAAC;CACvD"}

package/dist/lib/integrations/ai-sdk/wrap-agent.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"wrap-agent.d.ts","sourceRoot":"","sources":["../../../../src/lib/integrations/ai-sdk/wrap-agent.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,EAAE,KAAK,EAAE,OAAO,EAAE,MAAM,IAAI,CAAC;AAEzC,OAAO,KAAK,EAAa,GAAG,EAAU,MAAM,gBAAgB,CAAC;AAG7D,OAAO,KAAK,EAAE,eAAe,EAAE,MAAM,YAAY,CAAC;AAElD;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;GAoDG;AACH,wBAAgB,cAAc,CAAC,KAAK,SAAS,OAAO,EAClD,KAAK,EAAE,KAAK,CAAC,KAAK,EAAE,KAAK,EAAE,KAAK,CAAC,EACjC,OAAO,GAAE,eAAoB,GAC5B,GAAG,CAeL"}
+{"version":3,"file":"wrap-agent.d.ts","sourceRoot":"","sources":["../../../../src/lib/integrations/ai-sdk/wrap-agent.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,EAAE,KAAK,EAAgB,OAAO,EAAE,MAAM,IAAI,CAAC;AAEvD,OAAO,KAAK,EAAa,GAAG,EAAU,MAAM,gBAAgB,CAAC;AAM7D,OAAO,KAAK,EAAE,eAAe,EAAE,MAAM,YAAY,CAAC;AAElD;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;GAoDG;AACH,wBAAgB,cAAc,CAAC,KAAK,SAAS,OAAO,EAClD,KAAK,EAAE,KAAK,CAAC,KAAK,EAAE,KAAK,EAAE,KAAK,CAAC,EACjC,OAAO,GAAE,eAAoB,GAC5B,GAAG,CAuFL"}

package/dist/lib/integrations/ai-sdk/wrap-agent.js

@@ -1,4 +1,4 @@
-import { extractPromptFromData } from "../common/index.js";
+import { extractMessagesFromData, extractPromptFromData, } from "../common/utils.js";
 import { convertToOpenResponses } from "./convert.js";
 /**
  * Creates an evaluatorq Job from any AI SDK Agent.
@@ -54,12 +54,78 @@ import { convertToOpenResponses } from "./convert.js";
  * ```
  */
 export function wrapAISdkAgent(agent, options = {}) {
-    const { name = agent.id ?? "agent", promptKey = "prompt" } = options;
+    const { name = agent.id ?? "agent", promptKey = "prompt", instructions, } = options;
     return async (data, _row) => {
-        const prompt = extractPromptFromData(data, promptKey);
-        const result = await agent.generate({ prompt });
+        const inputMessages = extractMessagesFromData(data);
+        const hasMessages = inputMessages !== undefined;
+        const hasPrompt = typeof data.inputs[promptKey] === "string" && data.inputs[promptKey];
+        let result;
+        if (instructions) {
+            // Resolve instructions (static string or dynamic function)
+            const resolvedInstructions = typeof instructions === "function" ? instructions(data) : instructions;
+            const systemMessage = {
+                role: "system",
+                content: resolvedInstructions,
+            };
+            if (hasMessages && hasPrompt) {
+                const messages = [
+                    systemMessage,
+                    ...inputMessages,
+                    {
+                        role: "user",
+                        content: data.inputs[promptKey],
+                    },
+                ];
+                result = await agent.generate({ messages });
+            }
+            else if (hasPrompt) {
+                const messages = [
+                    systemMessage,
+                    {
+                        role: "user",
+                        content: data.inputs[promptKey],
+                    },
+                ];
+                result = await agent.generate({ messages });
+            }
+            else if (hasMessages) {
+                const messages = [
+                    systemMessage,
+                    ...inputMessages,
+                ];
+                result = await agent.generate({ messages });
+            }
+            else {
+                throw new Error("Expected data.inputs.messages (array) or data.inputs.prompt (string), but neither was provided");
+            }
+        }
+        else if (hasMessages && hasPrompt) {
+            // Both exist — merge messages + prompt appended as user message
+            const messages = [
+                ...inputMessages,
+                {
+                    role: "user",
+                    content: data.inputs[promptKey],
+                },
+            ];
+            result = await agent.generate({ messages });
+        }
+        else if (hasPrompt) {
+            // Prompt only — use native single-turn API
+            const prompt = extractPromptFromData(data, promptKey);
+            result = await agent.generate({ prompt });
+        }
+        else if (hasMessages) {
+            // Messages only — pass directly
+            result = await agent.generate({
+                messages: inputMessages,
+            });
+        }
+        else {
+            throw new Error("Expected data.inputs.messages (array) or data.inputs.prompt (string), but neither was provided");
+        }
         // Convert to OpenResponses format
-        const openResponsesOutput = convertToOpenResponses(result, agent, prompt);
+        const openResponsesOutput = convertToOpenResponses(result, agent);
         return {
             name,
             output: openResponsesOutput,

package/dist/lib/integrations/common/utils.d.ts

@@ -25,6 +25,15 @@ export declare function serializeArgs(args: unknown): string;
  * @returns The corresponding OpenResponses status
  */
 export declare function getResponseStatus(finishReason: string | undefined): ResponseResource["status"];
+export type InputMessage = {
+    role: string;
+    content: string;
+};
+/**
+ * Safely extracts messages from a DataPoint.
+ * Returns undefined when `data.inputs.messages` is missing, not an array, or empty.
+ */
+export declare function extractMessagesFromData(data: DataPoint): InputMessage[] | undefined;
 /**
  * Extracts and validates a prompt string from a DataPoint.
  *

package/dist/lib/integrations/common/utils.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"utils.d.ts","sourceRoot":"","sources":["../../../../src/lib/integrations/common/utils.ts"],"names":[],"mappings":"AAAA;;GAEG;AAEH,OAAO,KAAK,EAAE,SAAS,EAAE,MAAM,gBAAgB,CAAC;AAChD,OAAO,KAAK,EAAE,gBAAgB,EAAE,MAAM,2BAA2B,CAAC;AAElE;;;;;GAKG;AACH,wBAAgB,cAAc,CAAC,MAAM,EAAE,MAAM,GAAG,MAAM,CAErD;AAED;;;;;GAKG;AACH,wBAAgB,aAAa,CAAC,IAAI,EAAE,OAAO,GAAG,MAAM,CAiBnD;AAED;;;;;;GAMG;AACH,wBAAgB,iBAAiB,CAC/B,YAAY,EAAE,MAAM,GAAG,SAAS,GAC/B,gBAAgB,CAAC,QAAQ,CAAC,CAa5B;AAED;;;;;;;GAOG;AACH,wBAAgB,qBAAqB,CACnC,IAAI,EAAE,SAAS,EACf,SAAS,EAAE,MAAM,GAChB,MAAM,CAQR"}
+{"version":3,"file":"utils.d.ts","sourceRoot":"","sources":["../../../../src/lib/integrations/common/utils.ts"],"names":[],"mappings":"AAAA;;GAEG;AAEH,OAAO,KAAK,EAAE,SAAS,EAAE,MAAM,gBAAgB,CAAC;AAChD,OAAO,KAAK,EAAE,gBAAgB,EAAE,MAAM,2BAA2B,CAAC;AAElE;;;;;GAKG;AACH,wBAAgB,cAAc,CAAC,MAAM,EAAE,MAAM,GAAG,MAAM,CAErD;AAED;;;;;GAKG;AACH,wBAAgB,aAAa,CAAC,IAAI,EAAE,OAAO,GAAG,MAAM,CAiBnD;AAED;;;;;;GAMG;AACH,wBAAgB,iBAAiB,CAC/B,YAAY,EAAE,MAAM,GAAG,SAAS,GAC/B,gBAAgB,CAAC,QAAQ,CAAC,CAa5B;AAED,MAAM,MAAM,YAAY,GAAG;IAAE,IAAI,EAAE,MAAM,CAAC;IAAC,OAAO,EAAE,MAAM,CAAA;CAAE,CAAC;AAE7D;;;GAGG;AACH,wBAAgB,uBAAuB,CACrC,IAAI,EAAE,SAAS,GACd,YAAY,EAAE,GAAG,SAAS,CAI5B;AAED;;;;;;;GAOG;AACH,wBAAgB,qBAAqB,CACnC,IAAI,EAAE,SAAS,EACf,SAAS,EAAE,MAAM,GAChB,MAAM,CAQR"}

package/dist/lib/integrations/common/utils.js

@@ -56,6 +56,16 @@ export function getResponseStatus(finishReason) {
             return "completed";
     }
 }
+/**
+ * Safely extracts messages from a DataPoint.
+ * Returns undefined when `data.inputs.messages` is missing, not an array, or empty.
+ */
+export function extractMessagesFromData(data) {
+    const messages = data.inputs.messages;
+    if (!Array.isArray(messages) || messages.length === 0)
+        return undefined;
+    return messages;
+}
 /**
  * Extracts and validates a prompt string from a DataPoint.
  *

package/dist/lib/integrations/langchain/convert.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"convert.d.ts","sourceRoot":"","sources":["../../../../src/lib/integrations/langchain/convert.ts"],"names":[],"mappings":"AAAA;;GAEG;AAEH,OAAO,KAAK,EAAE,WAAW,EAAE,MAAM,0BAA0B,CAAC;AAO5D,OAAO,KAAK,EAMV,gBAAgB,EAEjB,MAAM,2BAA2B,CAAC;AACnC,OAAO,KAAK,EAEV,gBAAgB,EAGhB,cAAc,EAEf,MAAM,YAAY,CAAC;AAEpB;;;GAGG;AACH,MAAM,MAAM,YAAY,GAAG,WAAW,GAAG,gBAAgB,CAAC;AAwB1D;;;;;;;;GAQG;AACH,wBAAgB,sBAAsB,CACpC,QAAQ,EAAE,YAAY,EAAE,EACxB,KAAK,CAAC,EAAE,cAAc,EAAE,GACvB,gBAAgB,CAuMlB"}
+{"version":3,"file":"convert.d.ts","sourceRoot":"","sources":["../../../../src/lib/integrations/langchain/convert.ts"],"names":[],"mappings":"AAAA;;GAEG;AAEH,OAAO,KAAK,EAAE,WAAW,EAAE,MAAM,0BAA0B,CAAC;AAO5D,OAAO,KAAK,EAMV,gBAAgB,EAEjB,MAAM,2BAA2B,CAAC;AACnC,OAAO,KAAK,EAEV,gBAAgB,EAGhB,cAAc,EAEf,MAAM,YAAY,CAAC;AAEpB;;;GAGG;AACH,MAAM,MAAM,YAAY,GAAG,WAAW,GAAG,gBAAgB,CAAC;AAwB1D;;;;;;;;GAQG;AACH,wBAAgB,sBAAsB,CACpC,QAAQ,EAAE,YAAY,EAAE,EACxB,KAAK,CAAC,EAAE,cAAc,EAAE,GACvB,gBAAgB,CA6MlB"}

package/dist/lib/integrations/langchain/convert.js

@@ -45,12 +45,15 @@ export function convertToOpenResponses(messages, tools) {
         // Handle both message objects and dict format
         const msgType = getMessageType(msg);
         const msgData = getMessageData(msg);
+        // Resolve the message ID: prefer msgData.id (from kwargs.id for constructor format)
+        // over msg.id (which is the LC constructor id array for serialized messages).
+        const messageId = msgData.id ?? (typeof msg.id === "string" ? msg.id : undefined);
         if (msgType === "human") {
             // User message goes into input
             const contentText = getContent(msgData);
             const inputMessage = {
                 type: "message",
-                id: msg.id ?? generateItemId("msg"),
+                id: messageId ?? generateItemId("msg"),
                 role: "user",
                 status: "completed",
                 content: [{ type: "input_text", text: contentText }],
@@ -108,7 +111,7 @@ export function convertToOpenResponses(messages, tools) {
                 if (contentText) {
                     const outputMessage = {
                         type: "message",
-                        id: msg.id ?? generateItemId("msg"),
+                        id: messageId ?? generateItemId("msg"),
                         role: "assistant",
                         status: "completed",
                         content: [
@@ -130,7 +133,7 @@ export function convertToOpenResponses(messages, tools) {
             const outputContent = getContent(msgData);
             const functionCallOutput = {
                 type: "function_call_output",
-                id: msg.id ?? generateItemId("fco"),
+                id: messageId ?? generateItemId("fco"),
                 call_id: toolCallId,
                 output: outputContent,
                 status: "completed",
@@ -140,14 +143,14 @@ export function convertToOpenResponses(messages, tools) {
         else if (msgType === "system") {
             // System message goes into input
             const contentText = getContent(msgData);
-            const systemMessage = {
+            const inputMessage = {
                 type: "message",
-                id: msg.id ?? generateItemId("msg"),
+                id: messageId ?? generateItemId("msg"),
                 role: "system",
                 status: "completed",
                 content: [{ type: "input_text", text: contentText }],
             };
-            inputItems.push(systemMessage);
+            inputItems.push(inputMessage);
         }
     }
     // Build tools array
@@ -184,6 +187,7 @@ export function convertToOpenResponses(messages, tools) {
         model: modelName,
         previous_response_id: null,
         instructions: null,
+        input: inputItems,
         output: outputItems,
         error: status === "failed" ? { message: "Agent execution failed" } : null,
         tools: toolsArray,

package/dist/lib/integrations/langchain/types.d.ts

@@ -3,6 +3,7 @@
  */
 import type { BaseMessage } from "@langchain/core/messages";
 import type { RunnableConfig } from "@langchain/core/runnables";
+import type { DataPoint } from "../../types.js";
 export type { BaseMessage, RunnableConfig };
 /**
  * Protocol for LangChain/LangGraph invocable objects.
@@ -120,6 +121,11 @@ export interface AgentJobOptions {
     name?: string;
     /** The key in data.inputs to use as the prompt (defaults to "prompt") */
     promptKey?: string;
+    /**
+     * System instructions to prepend to the messages sent to the agent.
+     * Can be a static string or a function that receives the data point and returns the instructions.
+     */
+    instructions?: string | ((data: DataPoint) => string);
 }
 /**
  * Tool definition for OpenResponses output.

package/dist/lib/integrations/langchain/types.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"types.d.ts","sourceRoot":"","sources":["../../../../src/lib/integrations/langchain/types.ts"],"names":[],"mappings":"AAAA;;GAEG;AAEH,OAAO,KAAK,EAAE,WAAW,EAAE,MAAM,0BAA0B,CAAC;AAC5D,OAAO,KAAK,EAAE,cAAc,EAAE,MAAM,2BAA2B,CAAC;AAGhE,YAAY,EAAE,WAAW,EAAE,cAAc,EAAE,CAAC;AAE5C;;;;;;;;;GASG;AACH,MAAM,WAAW,kBAAkB;IACjC,MAAM,CACJ,KAAK,EAAE,OAAO,EACd,MAAM,CAAC,EAAE,cAAc,GACtB,OAAO,CAAC;QAAE,QAAQ,EAAE,OAAO,EAAE,CAAA;KAAE,GAAG,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,CAAC,CAAC;IAC9D,sDAAsD;IACtD,KAAK,CAAC,EAAE,SAAS,OAAO,EAAE,CAAC;IAC3B,yDAAyD;IACzD,KAAK,CAAC,EAAE;QAAE,KAAK,CAAC,EAAE,SAAS,OAAO,EAAE,CAAA;KAAE,CAAC;IACvC,uEAAuE;IACvE,OAAO,CAAC,EAAE;QACR,KAAK,CAAC,EAAE,SAAS,OAAO,EAAE,CAAC;QAC3B,UAAU,CAAC,EAAE,aAAa,CAAC;YAAE,KAAK,CAAC,EAAE,SAAS,OAAO,EAAE,CAAA;SAAE,CAAC,CAAC;KAC5D,CAAC;CACH;AAED;;GAEG;AACH,MAAM,WAAW,eAAe;IAC9B,QAAQ,EAAE,gBAAgB,EAAE,CAAC;CAC9B;AAED;;GAEG;AACH,MAAM,WAAW,gBAAgB;IAC/B,oDAAoD;IACpD,IAAI,CAAC,EAAE,MAAM,CAAC;IACd,iEAAiE;IACjE,OAAO,CAAC,EAAE,MAAM,GAAG,YAAY,EAAE,CAAC;IAClC,qCAAqC;IACrC,UAAU,CAAC,EAAE,QAAQ,EAAE,CAAC;IACxB,8CAA8C;IAC9C,YAAY,CAAC,EAAE,MAAM,CAAC;IACtB,uCAAuC;IACvC,iBAAiB,CAAC,EAAE,gBAAgB,CAAC;IACrC,2BAA2B;IAC3B,cAAc,CAAC,EAAE,aAAa,CAAC;IAC/B,kDAAkD;IAClD,EAAE,CAAC,EAAE,MAAM,CAAC;IACZ,mDAAmD;IACnD,EAAE,CAAC,EAAE,MAAM,CAAC;IACZ,6FAA6F;IAE7F,MAAM,CAAC,EAAE,GAAG,CAAC;CACd;AAED;;GAEG;AACH,MAAM,WAAW,YAAY;IAC3B,IAAI,EAAE,MAAM,CAAC;IACb,IAAI,CAAC,EAAE,MAAM,CAAC;CACf;AAED;;;GAGG;AACH,MAAM,WAAW,QAAQ;IACvB,0CAA0C;IAC1C,EAAE,CAAC,EAAE,MAAM,CAAC;IACZ,+BAA+B;IAC/B,IAAI,EAAE,MAAM,CAAC;IACb,oCAAoC;IACpC,IAAI,EAAE,OAAO,CAAC;IACd,kDAAkD;IAClD,IAAI,CAAC,EAAE,WAAW,CAAC;CACpB;AAED;;GAEG;AACH,MAAM,WAAW,gBAAgB;IAC/B,6CAA6C;IAC7C,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,yCAAyC;IACzC,aAAa,CAAC,EAAE,MAAM,CAAC;IACvB,sCAAsC;IACtC,cAAc,CAAC,EAAE,MAAM,CAAC;IACxB,qCAAqC;IACrC,kBAAkB,CAAC,EAAE,MAAM,CAAC;CAC7B;AAED;;;GAGG;AACH,MAAM,WAAW,aAAa;IAC5B,YAAY,CAAC,EAAE,MAAM,CAAC;IACtB,aAAa,CAAC,EAAE,MAAM,CAAC;IACvB,YAAY,CAAC,EAAE,MAAM,CAAC;IACtB,mBAAmB,CAAC,EAAE;QAAE,UAAU,CAAC,EAAE,MAAM,CAAC;QAAC,KAAK,CAAC,EAAE,MAAM,CAAA;KAAE,CAAC;IAC9D,oBAAoB,CAAC,EAAE;QAAE,SAAS,CAAC,EAAE,MAAM,CAAC;QAAC,KAAK,CAAC,EAAE,MAAM,CAAA;KAAE,CAAC;CAC/D;AAED;;GAEG;AACH,MAAM,WAAW,eAAe;IAC9B,gDAAgD;IAChD,IAAI,CAAC,EAAE,MAAM,CAAC;IACd,yEAAyE;IACzE,SAAS,CAAC,EAAE,MAAM,CAAC;CACpB;AAED;;GAEG;AACH,MAAM,WAAW,cAAc;IAC7B,IAAI,EAAE,MAAM,CAAC;IACb,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,UAAU,CAAC,EAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,CAAC;CACtC"}
+{"version":3,"file":"types.d.ts","sourceRoot":"","sources":["../../../../src/lib/integrations/langchain/types.ts"],"names":[],"mappings":"AAAA;;GAEG;AAEH,OAAO,KAAK,EAAE,WAAW,EAAE,MAAM,0BAA0B,CAAC;AAC5D,OAAO,KAAK,EAAE,cAAc,EAAE,MAAM,2BAA2B,CAAC;AAEhE,OAAO,KAAK,EAAE,SAAS,EAAE,MAAM,gBAAgB,CAAC;AAGhD,YAAY,EAAE,WAAW,EAAE,cAAc,EAAE,CAAC;AAE5C;;;;;;;;;GASG;AACH,MAAM,WAAW,kBAAkB;IACjC,MAAM,CACJ,KAAK,EAAE,OAAO,EACd,MAAM,CAAC,EAAE,cAAc,GACtB,OAAO,CAAC;QAAE,QAAQ,EAAE,OAAO,EAAE,CAAA;KAAE,GAAG,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,CAAC,CAAC;IAC9D,sDAAsD;IACtD,KAAK,CAAC,EAAE,SAAS,OAAO,EAAE,CAAC;IAC3B,yDAAyD;IACzD,KAAK,CAAC,EAAE;QAAE,KAAK,CAAC,EAAE,SAAS,OAAO,EAAE,CAAA;KAAE,CAAC;IACvC,uEAAuE;IACvE,OAAO,CAAC,EAAE;QACR,KAAK,CAAC,EAAE,SAAS,OAAO,EAAE,CAAC;QAC3B,UAAU,CAAC,EAAE,aAAa,CAAC;YAAE,KAAK,CAAC,EAAE,SAAS,OAAO,EAAE,CAAA;SAAE,CAAC,CAAC;KAC5D,CAAC;CACH;AAED;;GAEG;AACH,MAAM,WAAW,eAAe;IAC9B,QAAQ,EAAE,gBAAgB,EAAE,CAAC;CAC9B;AAED;;GAEG;AACH,MAAM,WAAW,gBAAgB;IAC/B,oDAAoD;IACpD,IAAI,CAAC,EAAE,MAAM,CAAC;IACd,iEAAiE;IACjE,OAAO,CAAC,EAAE,MAAM,GAAG,YAAY,EAAE,CAAC;IAClC,qCAAqC;IACrC,UAAU,CAAC,EAAE,QAAQ,EAAE,CAAC;IACxB,8CAA8C;IAC9C,YAAY,CAAC,EAAE,MAAM,CAAC;IACtB,uCAAuC;IACvC,iBAAiB,CAAC,EAAE,gBAAgB,CAAC;IACrC,2BAA2B;IAC3B,cAAc,CAAC,EAAE,aAAa,CAAC;IAC/B,kDAAkD;IAClD,EAAE,CAAC,EAAE,MAAM,CAAC;IACZ,mDAAmD;IACnD,EAAE,CAAC,EAAE,MAAM,CAAC;IACZ,6FAA6F;IAE7F,MAAM,CAAC,EAAE,GAAG,CAAC;CACd;AAED;;GAEG;AACH,MAAM,WAAW,YAAY;IAC3B,IAAI,EAAE,MAAM,CAAC;IACb,IAAI,CAAC,EAAE,MAAM,CAAC;CACf;AAED;;;GAGG;AACH,MAAM,WAAW,QAAQ;IACvB,0CAA0C;IAC1C,EAAE,CAAC,EAAE,MAAM,CAAC;IACZ,+BAA+B;IAC/B,IAAI,EAAE,MAAM,CAAC;IACb,oCAAoC;IACpC,IAAI,EAAE,OAAO,CAAC;IACd,kDAAkD;IAClD,IAAI,CAAC,EAAE,WAAW,CAAC;CACpB;AAED;;GAEG;AACH,MAAM,WAAW,gBAAgB;IAC/B,6CAA6C;IAC7C,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,yCAAyC;IACzC,aAAa,CAAC,EAAE,MAAM,CAAC;IACvB,sCAAsC;IACtC,cAAc,CAAC,EAAE,MAAM,CAAC;IACxB,qCAAqC;IACrC,kBAAkB,CAAC,EAAE,MAAM,CAAC;CAC7B;AAED;;;GAGG;AACH,MAAM,WAAW,aAAa;IAC5B,YAAY,CAAC,EAAE,MAAM,CAAC;IACtB,aAAa,CAAC,EAAE,MAAM,CAAC;IACvB,YAAY,CAAC,EAAE,MAAM,CAAC;IACtB,mBAAmB,CAAC,EAAE;QAAE,UAAU,CAAC,EAAE,MAAM,CAAC;QAAC,KAAK,CAAC,EAAE,MAAM,CAAA;KAAE,CAAC;IAC9D,oBAAoB,CAAC,EAAE;QAAE,SAAS,CAAC,EAAE,MAAM,CAAC;QAAC,KAAK,CAAC,EAAE,MAAM,CAAA;KAAE,CAAC;CAC/D;AAED;;GAEG;AACH,MAAM,WAAW,eAAe;IAC9B,gDAAgD;IAChD,IAAI,CAAC,EAAE,MAAM,CAAC;IACd,yEAAyE;IACzE,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB;;;OAGG;IACH,YAAY,CAAC,EAAE,MAAM,GAAG,CAAC,CAAC,IAAI,EAAE,SAAS,KAAK,MAAM,CAAC,CAAC;CACvD;AAED;;GAEG;AACH,MAAM,WAAW,cAAc;IAC7B,IAAI,EAAE,MAAM,CAAC;IACb,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,UAAU,CAAC,EAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,CAAC;CACtC"}

package/dist/lib/integrations/langchain/wrap-agent.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"wrap-agent.d.ts","sourceRoot":"","sources":["../../../../src/lib/integrations/langchain/wrap-agent.ts"],"names":[],"mappings":"AAAA;;GAEG;AAKH,OAAO,KAAK,EAAa,GAAG,EAAU,MAAM,gBAAgB,CAAC;AAG7D,OAAO,KAAK,EACV,eAAe,EACf,kBAAkB,EAClB,cAAc,EACf,MAAM,YAAY,CAAC;AA8CpB;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;GA2CG;AACH,wBAAgB,kBAAkB,CAChC,KAAK,EAAE,kBAAkB,EACzB,OAAO,GAAE,eAAe,GAAG;IAAE,KAAK,CAAC,EAAE,cAAc,EAAE,CAAA;CAAO,GAC3D,GAAG,CA4BL;AAED;;;;;;;;GAQG;AACH,wBAAgB,qBAAqB,CACnC,KAAK,EAAE,kBAAkB,GACxB,cAAc,EAAE,CAgElB;AAED;;;;;GAKG;AACH,eAAO,MAAM,kBAAkB,2BAAqB,CAAC"}
+{"version":3,"file":"wrap-agent.d.ts","sourceRoot":"","sources":["../../../../src/lib/integrations/langchain/wrap-agent.ts"],"names":[],"mappings":"AAAA;;GAEG;AAKH,OAAO,KAAK,EAAa,GAAG,EAAU,MAAM,gBAAgB,CAAC;AAM7D,OAAO,KAAK,EACV,eAAe,EACf,kBAAkB,EAClB,cAAc,EACf,MAAM,YAAY,CAAC;AA8CpB;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;GA2CG;AACH,wBAAgB,kBAAkB,CAChC,KAAK,EAAE,kBAAkB,EACzB,OAAO,GAAE,eAAe,GAAG;IAAE,KAAK,CAAC,EAAE,cAAc,EAAE,CAAA;CAAO,GAC3D,GAAG,CA8EL;AAED;;;;;;;;GAQG;AACH,wBAAgB,qBAAqB,CACnC,KAAK,EAAE,kBAAkB,GACxB,cAAc,EAAE,CAgElB;AAED;;;;;GAKG;AACH,eAAO,MAAM,kBAAkB,2BAAqB,CAAC"}