@runhuman/mcp-server 2.0.4 → 2.0.5

package/.env.example

@@ -1,12 +1,12 @@
-# RunHuman API Configuration
-
-# API Base URL
-# For local development, use http://localhost:3400
-# For production, use your deployed API URL
-RUNHUMAN_API_URL=http://localhost:3400
-
-# API Key
-# Get this from the API dashboard at http://localhost:3400/app.html
-# Or use the default test key below for local development
-# Format: qa_live_xxxxxxxxxxxxxxxxxxxxx
-RUNHUMAN_API_KEY=qa_live_test_key_for_demo_purposes_only_12345
+# Runhuman API Configuration
+
+# API Base URL
+# For local development, use http://localhost:3400
+# For production, use your deployed API URL
+RUNHUMAN_API_URL=http://localhost:3400
+
+# API Key
+# Get this from the API dashboard at http://localhost:3400/app.html
+# Or use the default test key below for local development
+# Format: qa_live_xxxxxxxxxxxxxxxxxxxxx
+RUNHUMAN_API_KEY=qa_live_test_key_for_demo_purposes_only_12345

package/README.md

@@ -1,243 +1,243 @@
-# RunHuman MCP Server
-
-A Model Context Protocol (MCP) server that allows AI agents to interact with the RunHuman QA testing service.
-
-## Overview
-
-This MCP server provides tools for creating and managing human QA jobs through the RunHuman API. AI agents can use this server to:
-
-- Create new QA jobs with custom schemas
-- Check the status of running jobs
-- Retrieve completed job results
-
-## Installation
-
-### For Claude Desktop (Recommended)
-
-1. Get your API key at: https://runhuman.com/dashboard/api-keys
-
-2. Add to your Claude Desktop config (`~/Library/Application Support/Claude/claude_desktop_config.json` on Mac):
-
-```json
-{
-  "mcpServers": {
-    "runhuman": {
-      "command": "npx",
-      "args": ["-y", "@runhuman/mcp-server", "--api-key=qa_live_xxxxxxxxxxxxx"]
-    }
-  }
-}
-```
-
-3. Restart Claude Desktop
-
-That's it! The server will be automatically downloaded and run by Claude.
-
-### For Development
-
-From the monorepo root:
-
-```bash
-npm install
-npm run build --workspace=@runhuman/mcp-server
-
-# Run with API key
-node packages/mcp-server/dist/index.js --api-key=qa_live_xxxxx
-```
-
-### Available Tools
-
-#### `create_job`
-Create a new QA job with human testers.
-
-**Parameters:**
-- `url` (string): The URL to test
-- `description` (string): Instructions for the human tester describing what to test
-- `schema` (object): Expected result schema that the tester response will be extracted into
-- `targetDurationMinutes` (number, optional): Time limit for tester (default: 5, range: 1-60)
-
-#### `wait_for_result`
-Check status, wait, and retrieve results for a QA job in a single convenient call.
-
-**Parameters:**
-- `jobId` (string): The ID of the job to check
-- `waitSeconds` (number, optional): How long to wait before checking again (default: 30, range: 1-300)
-
-**Behavior:**
-- Checks status BEFORE waiting (returns immediately if already complete)
-- Waits for the specified duration
-- Checks status AFTER waiting
-- Returns results if complete, otherwise suggests calling again with longer wait time
-
-**Usage Pattern:**
-```javascript
-// After creating a job, call repeatedly with increasing wait times:
-let result = await wait_for_result(jobId, { waitSeconds: 30 });
-if (result.status !== 'completed') {
-  result = await wait_for_result(jobId, { waitSeconds: 45 });
-}
-if (result.status !== 'completed') {
-  result = await wait_for_result(jobId, { waitSeconds: 60 });
-}
-```
-
-**Returns:**
-- `result`: Structured test results extracted from tester's response
-- `status`: Job status (completed, failed, timeout, pending, claimed, in_progress)
-- `costUsd`: Exact cost in USD with full precision (e.g., 0.396)
-- `testDurationSeconds`: Time spent by tester in seconds (rounded up)
-- `testerResponse`: Raw natural language feedback from the human tester
-- `testerAlias`: Anonymized tester name (e.g., "Tester Alpha")
-- `testerAvatarUrl`: Avatar image URL for UI display
-- `testerColor`: Hex color code for theming (e.g., "#4A90E2")
-- Additional metadata (timestamps, etc.)
-
-**Cost Calculation:**
-- Costs are calculated as: `duration × $0.0018/second` (general-use tier)
-- Duration is always rounded UP using Math.ceil (any partial second counts)
-- Costs are never $0 unless the tester never actually worked on it
-- Full precision maintained (not rounded to cents)
-
-## Configuration
-
-The MCP server needs to be configured with your RunHuman API credentials.
-
-### 1. Get an API Key
-
-**Option A: Via Dashboard**
-1. Start the API server: `npm run dev --workspace=@runhuman/api`
-2. Open http://localhost:3400/api-keys
-3. Click "Create API Key"
-4. Copy the key (starts with `qa_live_`)
-
-**Option B: Use Default Test Key**
-- For local development, you can use: `qa_live_test_key_123`
-- This key exists in `packages/api/data/api-keys.json`
-
-### 2. Configure Environment Variables
-
-Create a `.env` file in the MCP server directory:
-
-```bash
-# For local development
-RUNHUMAN_API_URL=http://localhost:3400
-RUNHUMAN_API_KEY=qa_live_test_key_123
-
-# For production
-RUNHUMAN_API_URL=https://api.runhuman.com
-RUNHUMAN_API_KEY=qa_live_xxxxxxxxxxxxxxxxxxxxx
-```
-
-**Important:** Never commit `.env` files to git! They're already in `.gitignore`.
-
-### 3. Verify Configuration
-
-Test your API key works:
-
-```bash
-curl http://localhost:3400/api/jobs \
-  -H "Authorization: Bearer qa_live_test_key_123" \
-  -H "Content-Type: application/json" \
-  -d '{"url":"https://example.com","description":"test","outputSchema":{}}'
-```
-
-Should return a job ID if authentication works.
-
-For more details, see [docs/API-AUTHENTICATION.md](docs/API-AUTHENTICATION.md)
-
-## Testing
-
-The MCP server includes automated tests to verify it's working correctly:
-
-```bash
-# Build first
-npm run build --workspace=@runhuman/mcp-server
-
-# Run simple automated test
-npm run test --workspace=@runhuman/mcp-server
-
-# Or use the MCP Inspector (interactive testing)
-npm run test:inspector --workspace=@runhuman/mcp-server
-```
-
-The test script will:
-1. ✅ Initialize a connection to the MCP server
-2. ✅ List all available tools (create_job, wait_for_result)
-3. ✅ Test calling the create_job tool
-
-### Expected Test Output
-
-```
-✅ Server initialized successfully
-✅ Tools listed: create_job, wait_for_result
-✅ create_job tool called successfully
-```
-
-## Development
-
-```bash
-# Watch mode (auto-rebuild on changes)
-npm run dev --workspace=@runhuman/mcp-server
-
-# Build
-npm run build --workspace=@runhuman/mcp-server
-
-# Test after building
-npm run test --workspace=@runhuman/mcp-server
-```
-
-## Integration with Claude Desktop
-
-To use this MCP server with Claude Desktop, add it to your configuration:
-
-```json
-{
-  "mcpServers": {
-    "runhuman": {
-      "command": "node",
-      "args": ["/path/to/qa-experiment/packages/mcp-server/dist/index.js"]
-    }
-  }
-}
-```
-
-## Example Usage
-
-Once connected to an AI agent (like Claude), the agent can use these tools naturally:
-
-**User:** "Can someone test my checkout page at https://myapp.com/checkout?"
-
-**Agent uses create_job:**
-```
-✅ Job created successfully!
-Job ID: job_abc123
-Status: pending
-...
-```
-
-**Agent calls wait_for_result repeatedly until complete:**
-```
-⏳ Job Status: in_progress
-Waited 30s, job not complete yet.
-💡 Suggestion: Call wait_for_result again with waitSeconds: 45
-```
-
-**Finally:**
-```
-✅ Test completed!
-Results Summary:
-- Checkout Flow: ✅ Working
-- Payment Processing: ✅ Successful
-...
-```
-
-## Developer Documentation
-
-For developers working on this MCP server:
-- [docs/HOW-AGENTS-USE-MCP.md](docs/HOW-AGENTS-USE-MCP.md) - How AI agents discover and use MCP servers
-- [docs/TOOL-RESPONSE-BEST-PRACTICES.md](docs/TOOL-RESPONSE-BEST-PRACTICES.md) - Best practices for tool responses
-
-## Learn More
-
-- [Model Context Protocol Documentation](https://modelcontextprotocol.io/)
-- [RunHuman API Documentation](../api/README.md)
+# Runhuman MCP Server
+
+A Model Context Protocol (MCP) server that allows AI agents to interact with the Runhuman QA testing service.
+
+## Overview
+
+This MCP server provides tools for creating and managing human QA jobs through the Runhuman API. AI agents can use this server to:
+
+- Create new QA jobs with custom schemas
+- Check the status of running jobs
+- Retrieve completed job results
+
+## Installation
+
+### For Claude Desktop (Recommended)
+
+1. Get your API key at: https://runhuman.com/dashboard/api-keys
+
+2. Add to your Claude Desktop config (`~/Library/Application Support/Claude/claude_desktop_config.json` on Mac):
+
+```json
+{
+  "mcpServers": {
+    "runhuman": {
+      "command": "npx",
+      "args": ["-y", "@runhuman/mcp-server", "--api-key=qa_live_xxxxxxxxxxxxx"]
+    }
+  }
+}
+```
+
+3. Restart Claude Desktop
+
+That's it! The server will be automatically downloaded and run by Claude.
+
+### For Development
+
+From the monorepo root:
+
+```bash
+npm install
+npm run build --workspace=@runhuman/mcp-server
+
+# Run with API key
+node packages/mcp-server/dist/index.js --api-key=qa_live_xxxxx
+```
+
+### Available Tools
+
+#### `create_job`
+Create a new QA job with human testers.
+
+**Parameters:**
+- `url` (string): The URL to test
+- `description` (string): Instructions for the human tester describing what to test
+- `schema` (object): Expected result schema that the tester response will be extracted into
+- `targetDurationMinutes` (number, optional): Time limit for tester (default: 5, range: 1-60)
+
+#### `wait_for_result`
+Check status, wait, and retrieve results for a QA job in a single convenient call.
+
+**Parameters:**
+- `jobId` (string): The ID of the job to check
+- `waitSeconds` (number, optional): How long to wait before checking again (default: 30, range: 1-300)
+
+**Behavior:**
+- Checks status BEFORE waiting (returns immediately if already complete)
+- Waits for the specified duration
+- Checks status AFTER waiting
+- Returns results if complete, otherwise suggests calling again with longer wait time
+
+**Usage Pattern:**
+```javascript
+// After creating a job, call repeatedly with increasing wait times:
+let result = await wait_for_result(jobId, { waitSeconds: 30 });
+if (result.status !== 'completed') {
+  result = await wait_for_result(jobId, { waitSeconds: 45 });
+}
+if (result.status !== 'completed') {
+  result = await wait_for_result(jobId, { waitSeconds: 60 });
+}
+```
+
+**Returns:**
+- `result`: Structured test results extracted from tester's response
+- `status`: Job status (completed, failed, timeout, pending, claimed, in_progress)
+- `costUsd`: Exact cost in USD with full precision (e.g., 0.396)
+- `testDurationSeconds`: Time spent by tester in seconds (rounded up)
+- `testerResponse`: Raw natural language feedback from the human tester
+- `testerAlias`: Anonymized tester name (e.g., "Tester Alpha")
+- `testerAvatarUrl`: Avatar image URL for UI display
+- `testerColor`: Hex color code for theming (e.g., "#4A90E2")
+- Additional metadata (timestamps, etc.)
+
+**Cost Calculation:**
+- Costs are calculated as: `duration × $0.0018/second` (general-use tier)
+- Duration is always rounded UP using Math.ceil (any partial second counts)
+- Costs are never $0 unless the tester never actually worked on it
+- Full precision maintained (not rounded to cents)
+
+## Configuration
+
+The MCP server needs to be configured with your Runhuman API credentials.
+
+### 1. Get an API Key
+
+**Option A: Via Dashboard**
+1. Start the API server: `npm run dev --workspace=@runhuman/api`
+2. Open http://localhost:3400/api-keys
+3. Click "Create API Key"
+4. Copy the key (starts with `qa_live_`)
+
+**Option B: Use Default Test Key**
+- For local development, you can use: `qa_live_test_key_123`
+- This key exists in `packages/api/data/api-keys.json`
+
+### 2. Configure Environment Variables
+
+Create a `.env` file in the MCP server directory:
+
+```bash
+# For local development
+RUNHUMAN_API_URL=http://localhost:3400
+RUNHUMAN_API_KEY=qa_live_test_key_123
+
+# For production
+RUNHUMAN_API_URL=https://api.runhuman.com
+RUNHUMAN_API_KEY=qa_live_xxxxxxxxxxxxxxxxxxxxx
+```
+
+**Important:** Never commit `.env` files to git! They're already in `.gitignore`.
+
+### 3. Verify Configuration
+
+Test your API key works:
+
+```bash
+curl http://localhost:3400/api/jobs \
+  -H "Authorization: Bearer qa_live_test_key_123" \
+  -H "Content-Type: application/json" \
+  -d '{"url":"https://example.com","description":"test","outputSchema":{}}'
+```
+
+Should return a job ID if authentication works.
+
+For more details, see [docs/API-AUTHENTICATION.md](docs/API-AUTHENTICATION.md)
+
+## Testing
+
+The MCP server includes automated tests to verify it's working correctly:
+
+```bash
+# Build first
+npm run build --workspace=@runhuman/mcp-server
+
+# Run simple automated test
+npm run test --workspace=@runhuman/mcp-server
+
+# Or use the MCP Inspector (interactive testing)
+npm run test:inspector --workspace=@runhuman/mcp-server
+```
+
+The test script will:
+1. ✅ Initialize a connection to the MCP server
+2. ✅ List all available tools (create_job, wait_for_result)
+3. ✅ Test calling the create_job tool
+
+### Expected Test Output
+
+```
+✅ Server initialized successfully
+✅ Tools listed: create_job, wait_for_result
+✅ create_job tool called successfully
+```
+
+## Development
+
+```bash
+# Watch mode (auto-rebuild on changes)
+npm run dev --workspace=@runhuman/mcp-server
+
+# Build
+npm run build --workspace=@runhuman/mcp-server
+
+# Test after building
+npm run test --workspace=@runhuman/mcp-server
+```
+
+## Integration with Claude Desktop
+
+To use this MCP server with Claude Desktop, add it to your configuration:
+
+```json
+{
+  "mcpServers": {
+    "runhuman": {
+      "command": "node",
+      "args": ["/path/to/qa-experiment/packages/mcp-server/dist/index.js"]
+    }
+  }
+}
+```
+
+## Example Usage
+
+Once connected to an AI agent (like Claude), the agent can use these tools naturally:
+
+**User:** "Can someone test my checkout page at https://myapp.com/checkout?"
+
+**Agent uses create_job:**
+```
+✅ Job created successfully!
+Job ID: job_abc123
+Status: pending
+...
+```
+
+**Agent calls wait_for_result repeatedly until complete:**
+```
+⏳ Job Status: in_progress
+Waited 30s, job not complete yet.
+💡 Suggestion: Call wait_for_result again with waitSeconds: 45
+```
+
+**Finally:**
+```
+✅ Test completed!
+Results Summary:
+- Checkout Flow: ✅ Working
+- Payment Processing: ✅ Successful
+...
+```
+
+## Developer Documentation
+
+For developers working on this MCP server:
+- [docs/HOW-AGENTS-USE-MCP.md](docs/HOW-AGENTS-USE-MCP.md) - How AI agents discover and use MCP servers
+- [docs/TOOL-RESPONSE-BEST-PRACTICES.md](docs/TOOL-RESPONSE-BEST-PRACTICES.md) - Best practices for tool responses
+
+## Learn More
+
+- [Model Context Protocol Documentation](https://modelcontextprotocol.io/)
+- [Runhuman API Documentation](../api/README.md)

package/dist/index.d.ts

@@ -1,6 +1,6 @@
 #!/usr/bin/env node
 /**
- * RunHuman MCP Server - stdio entry point
+ * Runhuman MCP Server - stdio entry point
  *
  * This is the CLI entry point for npx @runhuman/mcp-server.
  * It uses stdio transport for communication with MCP clients like Claude Desktop.

package/dist/index.js

@@ -1,6 +1,6 @@
 #!/usr/bin/env node
 /**
- * RunHuman MCP Server - stdio entry point
+ * Runhuman MCP Server - stdio entry point
  *
  * This is the CLI entry point for npx @runhuman/mcp-server.
  * It uses stdio transport for communication with MCP clients like Claude Desktop.
@@ -21,7 +21,7 @@ const apiUrlArg = args.find(arg => arg.startsWith('--api-url='))?.split('=')[1];
 const API_URL = apiUrlArg || process.env.RUNHUMAN_API_URL || 'https://qa-experiment.fly.dev';
 const API_KEY = apiKeyArg || process.env.RUNHUMAN_API_KEY;
 if (!API_KEY) {
-    console.error('❌ Error: API key is required');
+    console.error('Error: API key is required');
     console.error('');
     console.error('For Claude Desktop, add to your config:');
     console.error('{');
@@ -36,8 +36,8 @@ if (!API_KEY) {
     console.error('Get your API key at: https://qa-experiment.fly.dev/app.html');
     process.exit(1);
 }
-console.error(`🔗 Connected to RunHuman API at: ${API_URL}`);
-console.error(`🔑 Using API key: ${API_KEY.substring(0, 12)}...`);
+console.error(`Connected to Runhuman API at: ${API_URL}`);
+console.error(`Using API key: ${API_KEY.substring(0, 12)}...`);
 // Create the MCP server with configuration
 const server = createMcpServer({
     apiUrl: API_URL,
@@ -49,7 +49,7 @@ const server = createMcpServer({
 async function main() {
     const transport = new StdioServerTransport();
     await server.connect(transport);
-    console.error('RunHuman MCP server running on stdio');
+    console.error('Runhuman MCP server running on stdio');
 }
 main().catch((error) => {
     console.error('Server error:', error);

package/dist/index.js.map

@@ -1 +1 @@
-{"version":3,"file":"index.js","sourceRoot":"","sources":["../src/index.ts"],"names":[],"mappings":";AAEA;;;;;;;GAOG;AAEH,OAAO,EAAE,oBAAoB,EAAE,MAAM,2CAA2C,CAAC;AACjF,OAAO,KAAK,MAAM,MAAM,QAAQ,CAAC;AACjC,OAAO,EAAE,eAAe,EAAE,MAAM,yBAAyB,CAAC;AAE1D,iEAAiE;AACjE,MAAM,CAAC,MAAM,EAAE,CAAC;AAEhB,gBAAgB;AAChB,2CAA2C;AAC3C,0EAA0E;AAC1E,MAAM,IAAI,GAAG,OAAO,CAAC,IAAI,CAAC,KAAK,CAAC,CAAC,CAAC,CAAC;AACnC,MAAM,SAAS,GAAG,IAAI,CAAC,IAAI,CAAC,GAAG,CAAC,EAAE,CAAC,GAAG,CAAC,UAAU,CAAC,YAAY,CAAC,CAAC,EAAE,KAAK,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,CAAC;AAChF,MAAM,SAAS,GAAG,IAAI,CAAC,IAAI,CAAC,GAAG,CAAC,EAAE,CAAC,GAAG,CAAC,UAAU,CAAC,YAAY,CAAC,CAAC,EAAE,KAAK,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,CAAC;AAEhF,MAAM,OAAO,GAAG,SAAS,IAAI,OAAO,CAAC,GAAG,CAAC,gBAAgB,IAAI,+BAA+B,CAAC;AAC7F,MAAM,OAAO,GAAG,SAAS,IAAI,OAAO,CAAC,GAAG,CAAC,gBAAgB,CAAC;AAE1D,IAAI,CAAC,OAAO,EAAE,CAAC;IACb,OAAO,CAAC,KAAK,CAAC,8BAA8B,CAAC,CAAC;IAC9C,OAAO,CAAC,KAAK,CAAC,EAAE,CAAC,CAAC;IAClB,OAAO,CAAC,KAAK,CAAC,yCAAyC,CAAC,CAAC;IACzD,OAAO,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC;IACnB,OAAO,CAAC,KAAK,CAAC,mBAAmB,CAAC,CAAC;IACnC,OAAO,CAAC,KAAK,CAAC,mBAAmB,CAAC,CAAC;IACnC,OAAO,CAAC,KAAK,CAAC,yBAAyB,CAAC,CAAC;IACzC,OAAO,CAAC,KAAK,CAAC,yEAAyE,CAAC,CAAC;IACzF,OAAO,CAAC,KAAK,CAAC,OAAO,CAAC,CAAC;IACvB,OAAO,CAAC,KAAK,CAAC,KAAK,CAAC,CAAC;IACrB,OAAO,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC;IACnB,OAAO,CAAC,KAAK,CAAC,EAAE,CAAC,CAAC;IAClB,OAAO,CAAC,KAAK,CAAC,6DAA6D,CAAC,CAAC;IAC7E,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;AAClB,CAAC;AAED,OAAO,CAAC,KAAK,CAAC,oCAAoC,OAAO,EAAE,CAAC,CAAC;AAC7D,OAAO,CAAC,KAAK,CAAC,qBAAqB,OAAO,CAAC,SAAS,CAAC,CAAC,EAAE,EAAE,CAAC,KAAK,CAAC,CAAC;AAElE,2CAA2C;AAC3C,MAAM,MAAM,GAAG,eAAe,CAAC;IAC7B,MAAM,EAAE,OAAO;IACf,MAAM,EAAE,OAAO;CAChB,CAAC,CAAC;AAEH;;GAEG;AACH,KAAK,UAAU,IAAI;IACjB,MAAM,SAAS,GAAG,IAAI,oBAAoB,EAAE,CAAC;IAC7C,MAAM,MAAM,CAAC,OAAO,CAAC,SAAS,CAAC,CAAC;IAChC,OAAO,CAAC,KAAK,CAAC,sCAAsC,CAAC,CAAC;AACxD,CAAC;AAED,IAAI,EAAE,CAAC,KAAK,CAAC,CAAC,KAAK,EAAE,EAAE;IACrB,OAAO,CAAC,KAAK,CAAC,eAAe,EAAE,KAAK,CAAC,CAAC;IACtC,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;AAClB,CAAC,CAAC,CAAC"}
+{"version":3,"file":"index.js","sourceRoot":"","sources":["../src/index.ts"],"names":[],"mappings":";AAEA;;;;;;;GAOG;AAEH,OAAO,EAAE,oBAAoB,EAAE,MAAM,2CAA2C,CAAC;AACjF,OAAO,KAAK,MAAM,MAAM,QAAQ,CAAC;AACjC,OAAO,EAAE,eAAe,EAAE,MAAM,yBAAyB,CAAC;AAE1D,iEAAiE;AACjE,MAAM,CAAC,MAAM,EAAE,CAAC;AAEhB,gBAAgB;AAChB,2CAA2C;AAC3C,0EAA0E;AAC1E,MAAM,IAAI,GAAG,OAAO,CAAC,IAAI,CAAC,KAAK,CAAC,CAAC,CAAC,CAAC;AACnC,MAAM,SAAS,GAAG,IAAI,CAAC,IAAI,CAAC,GAAG,CAAC,EAAE,CAAC,GAAG,CAAC,UAAU,CAAC,YAAY,CAAC,CAAC,EAAE,KAAK,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,CAAC;AAChF,MAAM,SAAS,GAAG,IAAI,CAAC,IAAI,CAAC,GAAG,CAAC,EAAE,CAAC,GAAG,CAAC,UAAU,CAAC,YAAY,CAAC,CAAC,EAAE,KAAK,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,CAAC;AAEhF,MAAM,OAAO,GAAG,SAAS,IAAI,OAAO,CAAC,GAAG,CAAC,gBAAgB,IAAI,+BAA+B,CAAC;AAC7F,MAAM,OAAO,GAAG,SAAS,IAAI,OAAO,CAAC,GAAG,CAAC,gBAAgB,CAAC;AAE1D,IAAI,CAAC,OAAO,EAAE,CAAC;IACb,OAAO,CAAC,KAAK,CAAC,4BAA4B,CAAC,CAAC;IAC5C,OAAO,CAAC,KAAK,CAAC,EAAE,CAAC,CAAC;IAClB,OAAO,CAAC,KAAK,CAAC,yCAAyC,CAAC,CAAC;IACzD,OAAO,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC;IACnB,OAAO,CAAC,KAAK,CAAC,mBAAmB,CAAC,CAAC;IACnC,OAAO,CAAC,KAAK,CAAC,mBAAmB,CAAC,CAAC;IACnC,OAAO,CAAC,KAAK,CAAC,yBAAyB,CAAC,CAAC;IACzC,OAAO,CAAC,KAAK,CAAC,yEAAyE,CAAC,CAAC;IACzF,OAAO,CAAC,KAAK,CAAC,OAAO,CAAC,CAAC;IACvB,OAAO,CAAC,KAAK,CAAC,KAAK,CAAC,CAAC;IACrB,OAAO,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC;IACnB,OAAO,CAAC,KAAK,CAAC,EAAE,CAAC,CAAC;IAClB,OAAO,CAAC,KAAK,CAAC,6DAA6D,CAAC,CAAC;IAC7E,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;AAClB,CAAC;AAED,OAAO,CAAC,KAAK,CAAC,iCAAiC,OAAO,EAAE,CAAC,CAAC;AAC1D,OAAO,CAAC,KAAK,CAAC,kBAAkB,OAAO,CAAC,SAAS,CAAC,CAAC,EAAE,EAAE,CAAC,KAAK,CAAC,CAAC;AAE/D,2CAA2C;AAC3C,MAAM,MAAM,GAAG,eAAe,CAAC;IAC7B,MAAM,EAAE,OAAO;IACf,MAAM,EAAE,OAAO;CAChB,CAAC,CAAC;AAEH;;GAEG;AACH,KAAK,UAAU,IAAI;IACjB,MAAM,SAAS,GAAG,IAAI,oBAAoB,EAAE,CAAC;IAC7C,MAAM,MAAM,CAAC,OAAO,CAAC,SAAS,CAAC,CAAC;IAChC,OAAO,CAAC,KAAK,CAAC,sCAAsC,CAAC,CAAC;AACxD,CAAC;AAED,IAAI,EAAE,CAAC,KAAK,CAAC,CAAC,KAAK,EAAE,EAAE;IACrB,OAAO,CAAC,KAAK,CAAC,eAAe,EAAE,KAAK,CAAC,CAAC;IACtC,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;AAClB,CAAC,CAAC,CAAC"}

package/dist/mcp-server-factory.js

@@ -22,7 +22,7 @@ export function createMcpServer(config) {
         prompts: [
             {
                 name: 'explain_runhuman',
-                description: 'Get an explanation of how to use RunHuman for QA testing',
+                description: 'Get an explanation of how to use Runhuman for QA testing',
             },
         ],
     }));

package/dist/tools/create-job.tool.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"create-job.tool.d.ts","sourceRoot":"","sources":["../../src/tools/create-job.tool.ts"],"names":[],"mappings":"AAAA;;GAEG;AAEH,OAAO,KAAK,EAAE,IAAI,EAAE,MAAM,oCAAoC,CAAC;AAC/D,OAAO,KAAK,EAAE,eAAe,EAAE,aAAa,EAAqB,MAAM,aAAa,CAAC;AAErF,eAAO,MAAM,uBAAuB,EAAE,IAiDrC,CAAC;AAEF,wBAAsB,eAAe,CACnC,IAAI,EAAE,aAAa,EACnB,MAAM,EAAE,eAAe,GACtB,OAAO,CAAC;IAAE,OAAO,EAAE,KAAK,CAAC;QAAE,IAAI,EAAE,MAAM,CAAC;QAAC,IAAI,EAAE,MAAM,CAAA;KAAE,CAAC,CAAC;IAAC,OAAO,CAAC,EAAE,OAAO,CAAA;CAAE,CAAC,CAgFhF"}
+{"version":3,"file":"create-job.tool.d.ts","sourceRoot":"","sources":["../../src/tools/create-job.tool.ts"],"names":[],"mappings":"AAAA;;GAEG;AAEH,OAAO,KAAK,EAAE,IAAI,EAAE,MAAM,oCAAoC,CAAC;AAC/D,OAAO,KAAK,EAAE,eAAe,EAAE,aAAa,EAAqB,MAAM,aAAa,CAAC;AAErF,eAAO,MAAM,uBAAuB,EAAE,IAqDrC,CAAC;AAEF,wBAAsB,eAAe,CACnC,IAAI,EAAE,aAAa,EACnB,MAAM,EAAE,eAAe,GACtB,OAAO,CAAC;IAAE,OAAO,EAAE,KAAK,CAAC;QAAE,IAAI,EAAE,MAAM,CAAC;QAAC,IAAI,EAAE,MAAM,CAAA;KAAE,CAAC,CAAC;IAAC,OAAO,CAAC,EAAE,OAAO,CAAA;CAAE,CAAC,CAiFhF"}

package/dist/tools/create-job.tool.js

@@ -3,22 +3,22 @@
  */
 export const createJobToolDefinition = {
     name: 'create_job',
-    description: `⚠️ IMPORTANT: This ONLY creates and queues a job. It does NOT perform the test or return results. You MUST follow up with wait_for_result.
-
-Creates a QA job that will be performed by a REAL HUMAN tester (not AI). The human will manually test your application, describe findings in natural language, and GPT-4o will extract structured data from their response.
-
-Use this when you need human verification of:
-- UI/UX functionality that's hard to automate
-- Visual issues, accessibility problems
-- Complex user flows (login, checkout, forms)
-- Cross-browser compatibility
-- Real user experience feedback
-
-⚠️ REQUIRED WORKFLOW (do NOT skip steps):
-1. create_job → Returns jobId (job is now QUEUED, not complete!)
-2. wait_for_result → Checks status, waits, and retrieves results (takes 2-10 min total)
-3. If not complete, call wait_for_result again with longer wait time
-
+    description: `IMPORTANT: This ONLY creates and queues a job. It does NOT perform the test or return results. You MUST follow up with wait_for_result.
+
+Creates a QA job that will be performed by a REAL HUMAN tester (not AI). The human will manually test your application, describe findings in natural language, and GPT-4o will extract structured data from their response.
+
+Use this when you need human verification of:
+- UI/UX functionality that's hard to automate
+- Visual issues, accessibility problems
+- Complex user flows (login, checkout, forms)
+- Cross-browser compatibility
+- Real user experience feedback
+
+REQUIRED WORKFLOW (do NOT skip steps):
+1. create_job → Returns jobId (job is now QUEUED, not complete!)
+2. wait_for_result → Checks status, waits, and retrieves results (takes 2-10 min total)
+3. If not complete, call wait_for_result again with longer wait time
+
 DO NOT treat job creation as completion. You MUST wait for and retrieve results.`,
     inputSchema: {
         type: 'object',
@@ -47,6 +47,10 @@ DO NOT treat job creation as completion. You MUST wait for and retrieve results.
                 type: ['number', 'boolean'],
                 description: 'Maximum additional minutes allowed for extension. Set to false for unlimited. Default: false (unlimited). Range: 1-60 if number.',
             },
+            additionalValidationInstructions: {
+                type: 'string',
+                description: 'Optional custom instructions for the AI when validating test results. Use this to specify what to focus on, what to ignore, or how to interpret specific scenarios. Example: "Ignore minor UI glitches in the header. Only mark as failed if the core checkout functionality does not work."',
+            },
         },
         required: ['url', 'description', 'schema'],
     },
@@ -67,6 +71,7 @@ export async function handleCreateJob(args, config) {
                 targetDurationMinutes: args.targetDurationMinutes,
                 allowDurationExtension: args.allowDurationExtension,
                 maxExtensionMinutes: args.maxExtensionMinutes,
+                additionalValidationInstructions: args.additionalValidationInstructions,
             }),
         });
         if (!response.ok) {
@@ -74,14 +79,14 @@ export async function handleCreateJob(args, config) {
             return {
                 content: [{
                         type: 'text',
-                        text: `❌ Failed to create job
-
-Error: ${error.error || error.message || response.statusText}
-Status: ${response.status}
-
-Please check:
-- Your RUNHUMAN_API_KEY is valid
-- The API server is running at ${apiUrl}
+                        text: `Failed to create job
+
+Error: ${error.error || error.message || response.statusText}
+Status: ${response.status}
+
+Please check:
+- Your RUNHUMAN_API_KEY is valid
+- The API server is running at ${apiUrl}
 - Your API key has permission to create jobs`,
                     }],
                 isError: true,
@@ -92,22 +97,22 @@ Please check:
         return {
             content: [{
                     type: 'text',
-                    text: `⏳ Job QUEUED (not complete yet!)
-
-Job ID: ${data.jobId}
-Status: ${data.status}
-URL: ${args.url}
-Time limit: ${duration} minutes
-
-The test has been queued for a HUMAN tester. It is NOT complete yet.
-
-⚠️ REQUIRED NEXT STEPS:
-1. Call wait_for_result(jobId: "${data.jobId}", waitSeconds: 30)
-2. If not complete, call wait_for_result again with waitSeconds: 45
-3. Continue with increasing wait times (60, 90, etc.) until complete
-
-Typical completion time: 2-10 minutes total.
-
+                    text: `Job QUEUED (not complete yet!)
+
+Job ID: ${data.jobId}
+Status: ${data.status}
+URL: ${args.url}
+Time limit: ${duration} minutes
+
+The test has been queued for a HUMAN tester. It is NOT complete yet.
+
+REQUIRED NEXT STEPS:
+1. Call wait_for_result(jobId: "${data.jobId}", waitSeconds: 30)
+2. If not complete, call wait_for_result again with waitSeconds: 45
+3. Continue with increasing wait times (60, 90, etc.) until complete
+
+Typical completion time: 2-10 minutes total.
+
 DO NOT consider this task done until you have retrieved the results!`,
                 }],
         };
@@ -116,13 +121,13 @@ DO NOT consider this task done until you have retrieved the results!`,
         return {
             content: [{
                     type: 'text',
-                    text: `❌ Error creating job
-
-${error instanceof Error ? error.message : 'Unknown error'}
-
-Please check:
-- The API server is running at ${apiUrl}
-- Your network connection
+                    text: `Error creating job
+
+${error instanceof Error ? error.message : 'Unknown error'}
+
+Please check:
+- The API server is running at ${apiUrl}
+- Your network connection
 - Your .env file configuration`,
                 }],
             isError: true,

package/dist/tools/create-job.tool.js.map

@@ -1 +1 @@
-{"version":3,"file":"create-job.tool.js","sourceRoot":"","sources":["../../src/tools/create-job.tool.ts"],"names":[],"mappings":"AAAA;;GAEG;AAKH,MAAM,CAAC,MAAM,uBAAuB,GAAS;IAC3C,IAAI,EAAE,YAAY;IAClB,WAAW,EAAE;;;;;;;;;;;;;;;;iFAgBkE;IAC/E,WAAW,EAAE;QACX,IAAI,EAAE,QAAQ;QACd,UAAU,EAAE;YACV,GAAG,EAAE;gBACH,IAAI,EAAE,QAAQ;gBACd,WAAW,EAAE,sFAAsF;aACpG;YACD,WAAW,EAAE;gBACX,IAAI,EAAE,QAAQ;gBACd,WAAW,EAAE,6PAA6P;aAC3Q;YACD,MAAM,EAAE;gBACN,IAAI,EAAE,QAAQ;gBACd,WAAW,EAAE,mRAAmR;aACjS;YACD,qBAAqB,EAAE;gBACrB,IAAI,EAAE,QAAQ;gBACd,WAAW,EAAE,4GAA4G;aAC1H;YACD,sBAAsB,EAAE;gBACtB,IAAI,EAAE,SAAS;gBACf,WAAW,EAAE,mGAAmG;aACjH;YACD,mBAAmB,EAAE;gBACnB,IAAI,EAAE,CAAC,QAAQ,EAAE,SAAS,CAAC;gBAC3B,WAAW,EAAE,kIAAkI;aAChJ;SACF;QACD,QAAQ,EAAE,CAAC,KAAK,EAAE,aAAa,EAAE,QAAQ,CAAC;KAC3C;CACF,CAAC;AAEF,MAAM,CAAC,KAAK,UAAU,eAAe,CACnC,IAAmB,EACnB,MAAuB;IAEvB,MAAM,EAAE,MAAM,EAAE,MAAM,EAAE,GAAG,MAAM,CAAC;IAElC,IAAI,CAAC;QACH,MAAM,QAAQ,GAAG,MAAM,KAAK,CAAC,GAAG,MAAM,WAAW,EAAE;YACjD,MAAM,EAAE,MAAM;YACd,OAAO,EAAE;gBACP,eAAe,EAAE,UAAU,MAAM,EAAE;gBACnC,cAAc,EAAE,kBAAkB;aACnC;YACD,IAAI,EAAE,IAAI,CAAC,SAAS,CAAC;gBACnB,GAAG,EAAE,IAAI,CAAC,GAAG;gBACb,WAAW,EAAE,IAAI,CAAC,WAAW;gBAC7B,YAAY,EAAE,IAAI,CAAC,MAAM;gBACzB,qBAAqB,EAAE,IAAI,CAAC,qBAAqB;gBACjD,sBAAsB,EAAE,IAAI,CAAC,sBAAsB;gBACnD,mBAAmB,EAAE,IAAI,CAAC,mBAAmB;aAC9C,CAAC;SACH,CAAC,CAAC;QAEH,IAAI,CAAC,QAAQ,CAAC,EAAE,EAAE,CAAC;YACjB,MAAM,KAAK,GAAG,MAAM,QAAQ,CAAC,IAAI,EAAE,CAAC,KAAK,CAAC,GAAG,EAAE,CAAC,CAAC,EAAE,KAAK,EAAE,QAAQ,CAAC,UAAU,EAAE,CAAC,CAAyC,CAAC;YAC1H,OAAO;gBACL,OAAO,EAAE,CAAC;wBACR,IAAI,EAAE,MAAM;wBACZ,IAAI,EAAE;;SAEP,KAAK,CAAC,KAAK,IAAI,KAAK,CAAC,OAAO,IAAI,QAAQ,CAAC,UAAU;UAClD,QAAQ,CAAC,MAAM;;;;iCAIQ,MAAM;6CACM;qBACpC,CAAC;gBACF,OAAO,EAAE,IAAI;aACd,CAAC;QACJ,CAAC;QAED,MAAM,IAAI,GAAG,MAAM,QAAQ,CAAC,IAAI,EAAuB,CAAC;QACxD,MAAM,QAAQ,GAAG,IAAI,CAAC,qBAAqB,IAAI,CAAC,CAAC;QAEjD,OAAO;YACL,OAAO,EAAE,CAAC;oBACR,IAAI,EAAE,MAAM;oBACZ,IAAI,EAAE;;UAEJ,IAAI,CAAC,KAAK;UACV,IAAI,CAAC,MAAM;OACd,IAAI,CAAC,GAAG;cACD,QAAQ;;;;;kCAKY,IAAI,CAAC,KAAK;;;;;;qEAMyB;iBAC9D,CAAC;SACH,CAAC;IACJ,CAAC;IAAC,OAAO,KAAK,EAAE,CAAC;QACf,OAAO;YACL,OAAO,EAAE,CAAC;oBACR,IAAI,EAAE,MAAM;oBACZ,IAAI,EAAE;;EAEZ,KAAK,YAAY,KAAK,CAAC,CAAC,CAAC,KAAK,CAAC,OAAO,CAAC,CAAC,CAAC,eAAe;;;iCAGzB,MAAM;;+BAER;iBACxB,CAAC;YACF,OAAO,EAAE,IAAI;SACd,CAAC;IACJ,CAAC;AACH,CAAC"}
+{"version":3,"file":"create-job.tool.js","sourceRoot":"","sources":["../../src/tools/create-job.tool.ts"],"names":[],"mappings":"AAAA;;GAEG;AAKH,MAAM,CAAC,MAAM,uBAAuB,GAAS;IAC3C,IAAI,EAAE,YAAY;IAClB,WAAW,EAAE;;;;;;;;;;;;;;;;iFAgBkE;IAC/E,WAAW,EAAE;QACX,IAAI,EAAE,QAAQ;QACd,UAAU,EAAE;YACV,GAAG,EAAE;gBACH,IAAI,EAAE,QAAQ;gBACd,WAAW,EAAE,sFAAsF;aACpG;YACD,WAAW,EAAE;gBACX,IAAI,EAAE,QAAQ;gBACd,WAAW,EAAE,6PAA6P;aAC3Q;YACD,MAAM,EAAE;gBACN,IAAI,EAAE,QAAQ;gBACd,WAAW,EAAE,mRAAmR;aACjS;YACD,qBAAqB,EAAE;gBACrB,IAAI,EAAE,QAAQ;gBACd,WAAW,EAAE,4GAA4G;aAC1H;YACD,sBAAsB,EAAE;gBACtB,IAAI,EAAE,SAAS;gBACf,WAAW,EAAE,mGAAmG;aACjH;YACD,mBAAmB,EAAE;gBACnB,IAAI,EAAE,CAAC,QAAQ,EAAE,SAAS,CAAC;gBAC3B,WAAW,EAAE,kIAAkI;aAChJ;YACD,gCAAgC,EAAE;gBAChC,IAAI,EAAE,QAAQ;gBACd,WAAW,EAAE,8RAA8R;aAC5S;SACF;QACD,QAAQ,EAAE,CAAC,KAAK,EAAE,aAAa,EAAE,QAAQ,CAAC;KAC3C;CACF,CAAC;AAEF,MAAM,CAAC,KAAK,UAAU,eAAe,CACnC,IAAmB,EACnB,MAAuB;IAEvB,MAAM,EAAE,MAAM,EAAE,MAAM,EAAE,GAAG,MAAM,CAAC;IAElC,IAAI,CAAC;QACH,MAAM,QAAQ,GAAG,MAAM,KAAK,CAAC,GAAG,MAAM,WAAW,EAAE;YACjD,MAAM,EAAE,MAAM;YACd,OAAO,EAAE;gBACP,eAAe,EAAE,UAAU,MAAM,EAAE;gBACnC,cAAc,EAAE,kBAAkB;aACnC;YACD,IAAI,EAAE,IAAI,CAAC,SAAS,CAAC;gBACnB,GAAG,EAAE,IAAI,CAAC,GAAG;gBACb,WAAW,EAAE,IAAI,CAAC,WAAW;gBAC7B,YAAY,EAAE,IAAI,CAAC,MAAM;gBACzB,qBAAqB,EAAE,IAAI,CAAC,qBAAqB;gBACjD,sBAAsB,EAAE,IAAI,CAAC,sBAAsB;gBACnD,mBAAmB,EAAE,IAAI,CAAC,mBAAmB;gBAC7C,gCAAgC,EAAE,IAAI,CAAC,gCAAgC;aACxE,CAAC;SACH,CAAC,CAAC;QAEH,IAAI,CAAC,QAAQ,CAAC,EAAE,EAAE,CAAC;YACjB,MAAM,KAAK,GAAG,MAAM,QAAQ,CAAC,IAAI,EAAE,CAAC,KAAK,CAAC,GAAG,EAAE,CAAC,CAAC,EAAE,KAAK,EAAE,QAAQ,CAAC,UAAU,EAAE,CAAC,CAAyC,CAAC;YAC1H,OAAO;gBACL,OAAO,EAAE,CAAC;wBACR,IAAI,EAAE,MAAM;wBACZ,IAAI,EAAE;;SAEP,KAAK,CAAC,KAAK,IAAI,KAAK,CAAC,OAAO,IAAI,QAAQ,CAAC,UAAU;UAClD,QAAQ,CAAC,MAAM;;;;iCAIQ,MAAM;6CACM;qBACpC,CAAC;gBACF,OAAO,EAAE,IAAI;aACd,CAAC;QACJ,CAAC;QAED,MAAM,IAAI,GAAG,MAAM,QAAQ,CAAC,IAAI,EAAuB,CAAC;QACxD,MAAM,QAAQ,GAAG,IAAI,CAAC,qBAAqB,IAAI,CAAC,CAAC;QAEjD,OAAO;YACL,OAAO,EAAE,CAAC;oBACR,IAAI,EAAE,MAAM;oBACZ,IAAI,EAAE;;UAEJ,IAAI,CAAC,KAAK;UACV,IAAI,CAAC,MAAM;OACd,IAAI,CAAC,GAAG;cACD,QAAQ;;;;;kCAKY,IAAI,CAAC,KAAK;;;;;;qEAMyB;iBAC9D,CAAC;SACH,CAAC;IACJ,CAAC;IAAC,OAAO,KAAK,EAAE,CAAC;QACf,OAAO;YACL,OAAO,EAAE,CAAC;oBACR,IAAI,EAAE,MAAM;oBACZ,IAAI,EAAE;;EAEZ,KAAK,YAAY,KAAK,CAAC,CAAC,CAAC,KAAK,CAAC,OAAO,CAAC,CAAC,CAAC,eAAe;;;iCAGzB,MAAM;;+BAER;iBACxB,CAAC;YACF,OAAO,EAAE,IAAI;SACd,CAAC;IACJ,CAAC;AACH,CAAC"}

package/dist/tools/wait-for-result.tool.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"wait-for-result.tool.d.ts","sourceRoot":"","sources":["../../src/tools/wait-for-result.tool.ts"],"names":[],"mappings":"AAAA;;GAEG;AAEH,OAAO,KAAK,EAAE,IAAI,EAAE,MAAM,oCAAoC,CAAC;AAC/D,OAAO,KAAK,EAAE,eAAe,EAAE,iBAAiB,EAAe,MAAM,aAAa,CAAC;AAEnF,eAAO,MAAM,2BAA2B,EAAE,IAmCzC,CAAC;AAwEF,wBAAsB,mBAAmB,CACvC,IAAI,EAAE,iBAAiB,EACvB,MAAM,EAAE,eAAe,GACtB,OAAO,CAAC;IAAE,OAAO,EAAE,KAAK,CAAC;QAAE,IAAI,EAAE,MAAM,CAAC;QAAC,IAAI,EAAE,MAAM,CAAA;KAAE,CAAC,CAAC;IAAC,OAAO,CAAC,EAAE,OAAO,CAAA;CAAE,CAAC,CAqGhF"}
+{"version":3,"file":"wait-for-result.tool.d.ts","sourceRoot":"","sources":["../../src/tools/wait-for-result.tool.ts"],"names":[],"mappings":"AAAA;;GAEG;AAEH,OAAO,KAAK,EAAE,IAAI,EAAE,MAAM,oCAAoC,CAAC;AAC/D,OAAO,KAAK,EAAE,eAAe,EAAE,iBAAiB,EAAe,MAAM,aAAa,CAAC;AAEnF,eAAO,MAAM,2BAA2B,EAAE,IAwCzC,CAAC;AAyFF,wBAAsB,mBAAmB,CACvC,IAAI,EAAE,iBAAiB,EACvB,MAAM,EAAE,eAAe,GACtB,OAAO,CAAC;IAAE,OAAO,EAAE,KAAK,CAAC;QAAE,IAAI,EAAE,MAAM,CAAC;QAAC,IAAI,EAAE,MAAM,CAAA;KAAE,CAAC,CAAC;IAAC,OAAO,CAAC,EAAE,OAAO,CAAA;CAAE,CAAC,CAiHhF"}

package/dist/tools/wait-for-result.tool.js

@@ -3,22 +3,27 @@
  */
 export const waitForResultToolDefinition = {
     name: 'wait_for_result',
-    description: `Check status, wait, and retrieve results for a QA job in a single call.
-
-This tool combines status checking, waiting, and result retrieval into one convenient function:
-- Checks status BEFORE waiting (returns immediately if already complete)
-- Polls status every 5 seconds during the wait period
-- Returns immediately when job completes (no need to wait full duration)
-- Returns results if complete, otherwise suggests calling again with longer wait
-
-Jobs progress through states: pending → claimed → in_progress → completed (or failed/timeout)
-Typical completion time: 2-10 minutes total
-
-Use this tool repeatedly with increasing wait times until you get results:
-- First call: wait_for_result(jobId, { waitSeconds: 30 })
-- If not complete: wait_for_result(jobId, { waitSeconds: 45 })
-- If still not complete: wait_for_result(jobId, { waitSeconds: 60 })
-
+    description: `Check status, wait, and retrieve results for a QA job in a single call.
+
+This tool combines status checking, waiting, and result retrieval into one convenient function:
+- Checks status BEFORE waiting (returns immediately if already complete)
+- Polls status every 5 seconds during the wait period
+- Returns immediately when job completes (no need to wait full duration)
+- Returns results if complete, otherwise suggests calling again with longer wait
+
+Jobs progress through states: pending → waiting → working → completed (or incomplete/abandoned/error)
+- pending: Job is being prepared
+- waiting: Job posted to Slack, waiting for a tester to claim it
+- working: Tester has claimed the job and is actively testing
+- completed/incomplete/abandoned/error: Terminal states
+
+Typical completion time: 2-10 minutes total
+
+Use this tool repeatedly with increasing wait times until you get results:
+- First call: wait_for_result(jobId, { waitSeconds: 30 })
+- If not complete: wait_for_result(jobId, { waitSeconds: 45 })
+- If still not complete: wait_for_result(jobId, { waitSeconds: 60 })
+
 Returns immediately if job is already complete (no waiting needed).`,
     inputSchema: {
         type: 'object',
@@ -56,10 +61,10 @@ function formatCompletedResult(job) {
         content: [
             {
                 type: 'text',
-                text: `✅ Test completed!
-
-Job ID: ${job.id}
-
+                text: `Test completed!
+
+Job ID: ${job.id}
+
 **Test Results:**`,
             },
             {
@@ -76,27 +81,43 @@ Job ID: ${job.id}
         ],
     };
 }
-function formatFailedResult(job) {
+function formatIncompleteResult(job) {
     return {
         content: [{
                 type: 'text',
-                text: `❌ Job failed
-
-Job ID: ${job.id}
-Error: ${job.error || 'Unknown error'}`,
+                text: `Test completed with incomplete data
+
+Job ID: ${job.id}
+
+The test was completed but some required data was missing or incomplete.
+${job.error ? `\nDetails: ${job.error}` : ''}`,
+            }],
+        isError: true,
+    };
+}
+function formatAbandonedResult(job) {
+    return {
+        content: [{
+                type: 'text',
+                text: `Test abandoned
+
+Job ID: ${job.id}
+
+The tester abandoned this test.
+${job.error ? `\nReason: ${job.error}` : ''}`,
             }],
         isError: true,
     };
 }
-function formatTimeoutResult(job) {
+function formatErrorResult(job) {
     return {
         content: [{
                 type: 'text',
-                text: `⏰ Job timed out
-
-Job ID: ${job.id}
-
-The tester did not complete the test in time.`,
+                text: `Test failed due to system error
+
+Job ID: ${job.id}
+
+Error: ${job.error || 'Unknown error'}`,
             }],
         isError: true,
     };
@@ -113,13 +134,17 @@ export async function handleWaitForResult(args, config) {
             console.error(`[wait_for_result] Job already completed`);
             return formatCompletedResult(job);
         }
-        if (job.status === 'failed') {
-            console.error(`[wait_for_result] Job already failed`);
-            return formatFailedResult(job);
+        if (job.status === 'incomplete') {
+            console.error(`[wait_for_result] Job already completed with incomplete data`);
+            return formatIncompleteResult(job);
+        }
+        if (job.status === 'abandoned') {
+            console.error(`[wait_for_result] Job already abandoned`);
+            return formatAbandonedResult(job);
         }
-        if (job.status === 'timeout') {
-            console.error(`[wait_for_result] Job already timed out`);
-            return formatTimeoutResult(job);
+        if (job.status === 'error') {
+            console.error(`[wait_for_result] Job already failed with error`);
+            return formatErrorResult(job);
         }
         // Job not complete yet, poll periodically during the wait period
         console.error(`[wait_for_result] Job status: ${job.status}. Polling every ${pollIntervalSeconds}s for up to ${waitSeconds}s...`);
@@ -139,44 +164,54 @@ export async function handleWaitForResult(args, config) {
             // Check status
             console.error(`[wait_for_result] Polling status (${elapsedSeconds}s elapsed)...`);
             job = await checkJobStatus(args.jobId, config);
-            // Check if complete now
+            // Check if in terminal state now
             if (job.status === 'completed') {
                 console.error(`[wait_for_result] Job completed after ${elapsedSeconds}s`);
                 return formatCompletedResult(job);
             }
-            if (job.status === 'failed') {
-                console.error(`[wait_for_result] Job failed after ${elapsedSeconds}s`);
-                return formatFailedResult(job);
+            if (job.status === 'incomplete') {
+                console.error(`[wait_for_result] Job completed with incomplete data after ${elapsedSeconds}s`);
+                return formatIncompleteResult(job);
             }
-            if (job.status === 'timeout') {
-                console.error(`[wait_for_result] Job timed out after ${elapsedSeconds}s`);
-                return formatTimeoutResult(job);
+            if (job.status === 'abandoned') {
+                console.error(`[wait_for_result] Job abandoned after ${elapsedSeconds}s`);
+                return formatAbandonedResult(job);
+            }
+            if (job.status === 'error') {
+                console.error(`[wait_for_result] Job failed with error after ${elapsedSeconds}s`);
+                return formatErrorResult(job);
             }
             console.error(`[wait_for_result] Job still ${job.status}, continuing to poll...`);
         }
         // Reached max wait time without completion
-        const statusEmoji = {
-            pending: '⏳',
-            claimed: '👤',
-            in_progress: '🔄',
-        };
-        const emoji = statusEmoji[job.status] || '📊';
         const nextWait = Math.min(waitSeconds + 15, 120);
-        const statusMessage = job.status === 'pending'
-            ? 'Waiting for a tester to claim this job...'
-            : 'The tester is working on your test...';
+        // Determine appropriate status message based on job state
+        let statusMessage;
+        if (job.status === 'pending') {
+            statusMessage = 'Your test is being prepared and will be posted to testers shortly...';
+        }
+        else if (job.status === 'waiting') {
+            statusMessage = 'Waiting for a tester to claim your test...';
+        }
+        else if (job.status === 'working') {
+            statusMessage = 'The tester is working on your test...';
+        }
+        else {
+            // Fallback for any unexpected status
+            statusMessage = `Job is in ${job.status} state...`;
+        }
         return {
             content: [{
                     type: 'text',
-                    text: `${emoji} Job Status: ${job.status}
-
-Job ID: ${job.id}
-
-${statusMessage}
-
-⏰ Waited ${waitSeconds}s (polling every ${pollIntervalSeconds}s), job not complete yet.
-
-💡 Suggestion: Call wait_for_result again with waitSeconds: ${nextWait}
+                    text: `Job Status: ${job.status}
+
+Job ID: ${job.id}
+
+${statusMessage}
+
+Waited ${waitSeconds}s (polling every ${pollIntervalSeconds}s), job not complete yet.
+
+Suggestion: Call wait_for_result again with waitSeconds: ${nextWait}
 Typical completion time: 2-10 minutes total.`,
                 }],
         };
@@ -185,8 +220,8 @@ Typical completion time: 2-10 minutes total.`,
         return {
             content: [{
                     type: 'text',
-                    text: `❌ Error waiting for result
-
+                    text: `Error waiting for result
+
 ${error instanceof Error ? error.message : 'Unknown error'}`,
                 }],
             isError: true,

package/dist/tools/wait-for-result.tool.js.map

@@ -1 +1 @@
-{"version":3,"file":"wait-for-result.tool.js","sourceRoot":"","sources":["../../src/tools/wait-for-result.tool.ts"],"names":[],"mappings":"AAAA;;GAEG;AAKH,MAAM,CAAC,MAAM,2BAA2B,GAAS;IAC/C,IAAI,EAAE,iBAAiB;IACvB,WAAW,EAAE;;;;;;;;;;;;;;;;oEAgBqD;IAClE,WAAW,EAAE;QACX,IAAI,EAAE,QAAQ;QACd,UAAU,EAAE;YACV,KAAK,EAAE;gBACL,IAAI,EAAE,QAAQ;gBACd,WAAW,EAAE,sFAAsF;aACpG;YACD,WAAW,EAAE;gBACX,IAAI,EAAE,QAAQ;gBACd,WAAW,EAAE,gKAAgK;gBAC7K,OAAO,EAAE,CAAC;gBACV,OAAO,EAAE,GAAG;aACb;SACF;QACD,QAAQ,EAAE,CAAC,OAAO,CAAC;KACpB;CACF,CAAC;AAEF,KAAK,UAAU,cAAc,CAAC,KAAa,EAAE,MAAuB;IAClE,MAAM,QAAQ,GAAG,MAAM,KAAK,CAAC,GAAG,MAAM,CAAC,MAAM,YAAY,KAAK,EAAE,EAAE;QAChE,OAAO,EAAE;YACP,eAAe,EAAE,UAAU,MAAM,CAAC,MAAM,EAAE;SAC3C;KACF,CAAC,CAAC;IAEH,IAAI,CAAC,QAAQ,CAAC,EAAE,EAAE,CAAC;QACjB,IAAI,QAAQ,CAAC,MAAM,KAAK,GAAG,EAAE,CAAC;YAC5B,MAAM,IAAI,KAAK,CAAC,kBAAkB,KAAK,EAAE,CAAC,CAAC;QAC7C,CAAC;QACD,MAAM,IAAI,KAAK,CAAC,6BAA6B,QAAQ,CAAC,MAAM,IAAI,QAAQ,CAAC,UAAU,EAAE,CAAC,CAAC;IACzF,CAAC;IAED,OAAO,MAAM,QAAQ,CAAC,IAAI,EAAiB,CAAC;AAC9C,CAAC;AAED,SAAS,qBAAqB,CAAC,GAAgB;IAC7C,OAAO;QACL,OAAO,EAAE;YACP;gBACE,IAAI,EAAE,MAAM;gBACZ,IAAI,EAAE;;UAEJ,GAAG,CAAC,EAAE;;kBAEE;aACX;YACD;gBACE,IAAI,EAAE,MAAM;gBACZ,IAAI,EAAE,IAAI,CAAC,SAAS,CAAC;oBACnB,MAAM,EAAE,GAAG,CAAC,MAAM,IAAI,EAAE;oBACxB,cAAc,EAAE,GAAG,CAAC,cAAc;oBAClC,WAAW,EAAE,GAAG,CAAC,WAAW;oBAC5B,eAAe,EAAE,GAAG,CAAC,eAAe;oBACpC,WAAW,EAAE,GAAG,CAAC,WAAW;oBAC5B,UAAU,EAAE,GAAG,CAAC,UAAU;iBAC3B,EAAE,IAAI,EAAE,CAAC,CAAC;aACZ;SACF;KACF,CAAC;AACJ,CAAC;AAED,SAAS,kBAAkB,CAAC,GAAgB;IAC1C,OAAO;QACL,OAAO,EAAE,CAAC;gBACR,IAAI,EAAE,MAAM;gBACZ,IAAI,EAAE;;UAEF,GAAG,CAAC,EAAE;SACP,GAAG,CAAC,KAAK,IAAI,eAAe,EAAE;aAClC,CAAC;QACF,OAAO,EAAE,IAAI;KACd,CAAC;AACJ,CAAC;AAED,SAAS,mBAAmB,CAAC,GAAgB;IAC3C,OAAO;QACL,OAAO,EAAE,CAAC;gBACR,IAAI,EAAE,MAAM;gBACZ,IAAI,EAAE;;UAEF,GAAG,CAAC,EAAE;;8CAE8B;aACzC,CAAC;QACF,OAAO,EAAE,IAAI;KACd,CAAC;AACJ,CAAC;AAED,MAAM,CAAC,KAAK,UAAU,mBAAmB,CACvC,IAAuB,EACvB,MAAuB;IAEvB,IAAI,CAAC;QACH,MAAM,WAAW,GAAG,IAAI,CAAC,GAAG,CAAC,IAAI,CAAC,GAAG,CAAC,IAAI,CAAC,WAAW,IAAI,EAAE,EAAE,CAAC,CAAC,EAAE,GAAG,CAAC,CAAC;QACvE,MAAM,mBAAmB,GAAG,CAAC,CAAC,CAAC,uBAAuB;QAEtD,8BAA8B;QAC9B,OAAO,CAAC,KAAK,CAAC,qDAAqD,IAAI,CAAC,KAAK,KAAK,CAAC,CAAC;QACpF,IAAI,GAAG,GAAG,MAAM,cAAc,CAAC,IAAI,CAAC,KAAK,EAAE,MAAM,CAAC,CAAC;QAEnD,mDAAmD;QACnD,IAAI,GAAG,CAAC,MAAM,KAAK,WAAW,EAAE,CAAC;YAC/B,OAAO,CAAC,KAAK,CAAC,yCAAyC,CAAC,CAAC;YACzD,OAAO,qBAAqB,CAAC,GAAG,CAAC,CAAC;QACpC,CAAC;QACD,IAAI,GAAG,CAAC,MAAM,KAAK,QAAQ,EAAE,CAAC;YAC5B,OAAO,CAAC,KAAK,CAAC,sCAAsC,CAAC,CAAC;YACtD,OAAO,kBAAkB,CAAC,GAAG,CAAC,CAAC;QACjC,CAAC;QACD,IAAI,GAAG,CAAC,MAAM,KAAK,SAAS,EAAE,CAAC;YAC7B,OAAO,CAAC,KAAK,CAAC,yCAAyC,CAAC,CAAC;YACzD,OAAO,mBAAmB,CAAC,GAAG,CAAC,CAAC;QAClC,CAAC;QAED,iEAAiE;QACjE,OAAO,CAAC,KAAK,CAAC,iCAAiC,GAAG,CAAC,MAAM,mBAAmB,mBAAmB,eAAe,WAAW,MAAM,CAAC,CAAC;QAEjI,MAAM,SAAS,GAAG,IAAI,CAAC,GAAG,EAAE,CAAC;QAC7B,MAAM,SAAS,GAAG,WAAW,GAAG,IAAI,CAAC;QACrC,IAAI,cAAc,GAAG,CAAC,CAAC;QAEvB,OAAO,IAAI,EAAE,CAAC;YACZ,6BAA6B;YAC7B,MAAM,IAAI,OAAO,CAAC,OAAO,CAAC,EAAE,CAAC,UAAU,CAAC,OAAO,EAAE,mBAAmB,GAAG,IAAI,CAAC,CAAC,CAAC;YAC9E,cAAc,IAAI,mBAAmB,CAAC;YAEtC,4CAA4C;YAC5C,MAAM,OAAO,GAAG,IAAI,CAAC,GAAG,EAAE,GAAG,SAAS,CAAC;YACvC,IAAI,OAAO,IAAI,SAAS,EAAE,CAAC;gBACzB,OAAO,CAAC,KAAK,CAAC,8CAA8C,WAAW,GAAG,CAAC,CAAC;gBAC5E,MAAM;YACR,CAAC;YAED,eAAe;YACf,OAAO,CAAC,KAAK,CAAC,qCAAqC,cAAc,eAAe,CAAC,CAAC;YAClF,GAAG,GAAG,MAAM,cAAc,CAAC,IAAI,CAAC,KAAK,EAAE,MAAM,CAAC,CAAC;YAE/C,wBAAwB;YACxB,IAAI,GAAG,CAAC,MAAM,KAAK,WAAW,EAAE,CAAC;gBAC/B,OAAO,CAAC,KAAK,CAAC,yCAAyC,cAAc,GAAG,CAAC,CAAC;gBAC1E,OAAO,qBAAqB,CAAC,GAAG,CAAC,CAAC;YACpC,CAAC;YACD,IAAI,GAAG,CAAC,MAAM,KAAK,QAAQ,EAAE,CAAC;gBAC5B,OAAO,CAAC,KAAK,CAAC,sCAAsC,cAAc,GAAG,CAAC,CAAC;gBACvE,OAAO,kBAAkB,CAAC,GAAG,CAAC,CAAC;YACjC,CAAC;YACD,IAAI,GAAG,CAAC,MAAM,KAAK,SAAS,EAAE,CAAC;gBAC7B,OAAO,CAAC,KAAK,CAAC,yCAAyC,cAAc,GAAG,CAAC,CAAC;gBAC1E,OAAO,mBAAmB,CAAC,GAAG,CAAC,CAAC;YAClC,CAAC;YAED,OAAO,CAAC,KAAK,CAAC,+BAA+B,GAAG,CAAC,MAAM,yBAAyB,CAAC,CAAC;QACpF,CAAC;QAED,2CAA2C;QAC3C,MAAM,WAAW,GAA2B;YAC1C,OAAO,EAAE,GAAG;YACZ,OAAO,EAAE,IAAI;YACb,WAAW,EAAE,IAAI;SAClB,CAAC;QACF,MAAM,KAAK,GAAG,WAAW,CAAC,GAAG,CAAC,MAAM,CAAC,IAAI,IAAI,CAAC;QAC9C,MAAM,QAAQ,GAAG,IAAI,CAAC,GAAG,CAAC,WAAW,GAAG,EAAE,EAAE,GAAG,CAAC,CAAC;QACjD,MAAM,aAAa,GAAG,GAAG,CAAC,MAAM,KAAK,SAAS;YAC5C,CAAC,CAAC,2CAA2C;YAC7C,CAAC,CAAC,uCAAuC,CAAC;QAE5C,OAAO;YACL,OAAO,EAAE,CAAC;oBACR,IAAI,EAAE,MAAM;oBACZ,IAAI,EAAE,GAAG,KAAK,gBAAgB,GAAG,CAAC,MAAM;;UAEtC,GAAG,CAAC,EAAE;;EAEd,aAAa;;WAEJ,WAAW,oBAAoB,mBAAmB;;8DAEC,QAAQ;6CACzB;iBACtC,CAAC;SACH,CAAC;IACJ,CAAC;IAAC,OAAO,KAAK,EAAE,CAAC;QACf,OAAO;YACL,OAAO,EAAE,CAAC;oBACR,IAAI,EAAE,MAAM;oBACZ,IAAI,EAAE;;EAEZ,KAAK,YAAY,KAAK,CAAC,CAAC,CAAC,KAAK,CAAC,OAAO,CAAC,CAAC,CAAC,eAAe,EAAE;iBACrD,CAAC;YACF,OAAO,EAAE,IAAI;SACd,CAAC;IACJ,CAAC;AACH,CAAC"}
+{"version":3,"file":"wait-for-result.tool.js","sourceRoot":"","sources":["../../src/tools/wait-for-result.tool.ts"],"names":[],"mappings":"AAAA;;GAEG;AAKH,MAAM,CAAC,MAAM,2BAA2B,GAAS;IAC/C,IAAI,EAAE,iBAAiB;IACvB,WAAW,EAAE;;;;;;;;;;;;;;;;;;;;;oEAqBqD;IAClE,WAAW,EAAE;QACX,IAAI,EAAE,QAAQ;QACd,UAAU,EAAE;YACV,KAAK,EAAE;gBACL,IAAI,EAAE,QAAQ;gBACd,WAAW,EAAE,sFAAsF;aACpG;YACD,WAAW,EAAE;gBACX,IAAI,EAAE,QAAQ;gBACd,WAAW,EAAE,gKAAgK;gBAC7K,OAAO,EAAE,CAAC;gBACV,OAAO,EAAE,GAAG;aACb;SACF;QACD,QAAQ,EAAE,CAAC,OAAO,CAAC;KACpB;CACF,CAAC;AAEF,KAAK,UAAU,cAAc,CAAC,KAAa,EAAE,MAAuB;IAClE,MAAM,QAAQ,GAAG,MAAM,KAAK,CAAC,GAAG,MAAM,CAAC,MAAM,YAAY,KAAK,EAAE,EAAE;QAChE,OAAO,EAAE;YACP,eAAe,EAAE,UAAU,MAAM,CAAC,MAAM,EAAE;SAC3C;KACF,CAAC,CAAC;IAEH,IAAI,CAAC,QAAQ,CAAC,EAAE,EAAE,CAAC;QACjB,IAAI,QAAQ,CAAC,MAAM,KAAK,GAAG,EAAE,CAAC;YAC5B,MAAM,IAAI,KAAK,CAAC,kBAAkB,KAAK,EAAE,CAAC,CAAC;QAC7C,CAAC;QACD,MAAM,IAAI,KAAK,CAAC,6BAA6B,QAAQ,CAAC,MAAM,IAAI,QAAQ,CAAC,UAAU,EAAE,CAAC,CAAC;IACzF,CAAC;IAED,OAAO,MAAM,QAAQ,CAAC,IAAI,EAAiB,CAAC;AAC9C,CAAC;AAED,SAAS,qBAAqB,CAAC,GAAgB;IAC7C,OAAO;QACL,OAAO,EAAE;YACP;gBACE,IAAI,EAAE,MAAM;gBACZ,IAAI,EAAE;;UAEJ,GAAG,CAAC,EAAE;;kBAEE;aACX;YACD;gBACE,IAAI,EAAE,MAAM;gBACZ,IAAI,EAAE,IAAI,CAAC,SAAS,CAAC;oBACnB,MAAM,EAAE,GAAG,CAAC,MAAM,IAAI,EAAE;oBACxB,cAAc,EAAE,GAAG,CAAC,cAAc;oBAClC,WAAW,EAAE,GAAG,CAAC,WAAW;oBAC5B,eAAe,EAAE,GAAG,CAAC,eAAe;oBACpC,WAAW,EAAE,GAAG,CAAC,WAAW;oBAC5B,UAAU,EAAE,GAAG,CAAC,UAAU;iBAC3B,EAAE,IAAI,EAAE,CAAC,CAAC;aACZ;SACF;KACF,CAAC;AACJ,CAAC;AAED,SAAS,sBAAsB,CAAC,GAAgB;IAC9C,OAAO;QACL,OAAO,EAAE,CAAC;gBACR,IAAI,EAAE,MAAM;gBACZ,IAAI,EAAE;;UAEF,GAAG,CAAC,EAAE;;;EAGd,GAAG,CAAC,KAAK,CAAC,CAAC,CAAC,cAAc,GAAG,CAAC,KAAK,EAAE,CAAC,CAAC,CAAC,EAAE,EAAE;aACzC,CAAC;QACF,OAAO,EAAE,IAAI;KACd,CAAC;AACJ,CAAC;AAED,SAAS,qBAAqB,CAAC,GAAgB;IAC7C,OAAO;QACL,OAAO,EAAE,CAAC;gBACR,IAAI,EAAE,MAAM;gBACZ,IAAI,EAAE;;UAEF,GAAG,CAAC,EAAE;;;EAGd,GAAG,CAAC,KAAK,CAAC,CAAC,CAAC,aAAa,GAAG,CAAC,KAAK,EAAE,CAAC,CAAC,CAAC,EAAE,EAAE;aACxC,CAAC;QACF,OAAO,EAAE,IAAI;KACd,CAAC;AACJ,CAAC;AAED,SAAS,iBAAiB,CAAC,GAAgB;IACzC,OAAO;QACL,OAAO,EAAE,CAAC;gBACR,IAAI,EAAE,MAAM;gBACZ,IAAI,EAAE;;UAEF,GAAG,CAAC,EAAE;;SAEP,GAAG,CAAC,KAAK,IAAI,eAAe,EAAE;aAClC,CAAC;QACF,OAAO,EAAE,IAAI;KACd,CAAC;AACJ,CAAC;AAED,MAAM,CAAC,KAAK,UAAU,mBAAmB,CACvC,IAAuB,EACvB,MAAuB;IAEvB,IAAI,CAAC;QACH,MAAM,WAAW,GAAG,IAAI,CAAC,GAAG,CAAC,IAAI,CAAC,GAAG,CAAC,IAAI,CAAC,WAAW,IAAI,EAAE,EAAE,CAAC,CAAC,EAAE,GAAG,CAAC,CAAC;QACvE,MAAM,mBAAmB,GAAG,CAAC,CAAC,CAAC,uBAAuB;QAEtD,8BAA8B;QAC9B,OAAO,CAAC,KAAK,CAAC,qDAAqD,IAAI,CAAC,KAAK,KAAK,CAAC,CAAC;QACpF,IAAI,GAAG,GAAG,MAAM,cAAc,CAAC,IAAI,CAAC,KAAK,EAAE,MAAM,CAAC,CAAC;QAEnD,mDAAmD;QACnD,IAAI,GAAG,CAAC,MAAM,KAAK,WAAW,EAAE,CAAC;YAC/B,OAAO,CAAC,KAAK,CAAC,yCAAyC,CAAC,CAAC;YACzD,OAAO,qBAAqB,CAAC,GAAG,CAAC,CAAC;QACpC,CAAC;QACD,IAAI,GAAG,CAAC,MAAM,KAAK,YAAY,EAAE,CAAC;YAChC,OAAO,CAAC,KAAK,CAAC,8DAA8D,CAAC,CAAC;YAC9E,OAAO,sBAAsB,CAAC,GAAG,CAAC,CAAC;QACrC,CAAC;QACD,IAAI,GAAG,CAAC,MAAM,KAAK,WAAW,EAAE,CAAC;YAC/B,OAAO,CAAC,KAAK,CAAC,yCAAyC,CAAC,CAAC;YACzD,OAAO,qBAAqB,CAAC,GAAG,CAAC,CAAC;QACpC,CAAC;QACD,IAAI,GAAG,CAAC,MAAM,KAAK,OAAO,EAAE,CAAC;YAC3B,OAAO,CAAC,KAAK,CAAC,iDAAiD,CAAC,CAAC;YACjE,OAAO,iBAAiB,CAAC,GAAG,CAAC,CAAC;QAChC,CAAC;QAED,iEAAiE;QACjE,OAAO,CAAC,KAAK,CAAC,iCAAiC,GAAG,CAAC,MAAM,mBAAmB,mBAAmB,eAAe,WAAW,MAAM,CAAC,CAAC;QAEjI,MAAM,SAAS,GAAG,IAAI,CAAC,GAAG,EAAE,CAAC;QAC7B,MAAM,SAAS,GAAG,WAAW,GAAG,IAAI,CAAC;QACrC,IAAI,cAAc,GAAG,CAAC,CAAC;QAEvB,OAAO,IAAI,EAAE,CAAC;YACZ,6BAA6B;YAC7B,MAAM,IAAI,OAAO,CAAC,OAAO,CAAC,EAAE,CAAC,UAAU,CAAC,OAAO,EAAE,mBAAmB,GAAG,IAAI,CAAC,CAAC,CAAC;YAC9E,cAAc,IAAI,mBAAmB,CAAC;YAEtC,4CAA4C;YAC5C,MAAM,OAAO,GAAG,IAAI,CAAC,GAAG,EAAE,GAAG,SAAS,CAAC;YACvC,IAAI,OAAO,IAAI,SAAS,EAAE,CAAC;gBACzB,OAAO,CAAC,KAAK,CAAC,8CAA8C,WAAW,GAAG,CAAC,CAAC;gBAC5E,MAAM;YACR,CAAC;YAED,eAAe;YACf,OAAO,CAAC,KAAK,CAAC,qCAAqC,cAAc,eAAe,CAAC,CAAC;YAClF,GAAG,GAAG,MAAM,cAAc,CAAC,IAAI,CAAC,KAAK,EAAE,MAAM,CAAC,CAAC;YAE/C,iCAAiC;YACjC,IAAI,GAAG,CAAC,MAAM,KAAK,WAAW,EAAE,CAAC;gBAC/B,OAAO,CAAC,KAAK,CAAC,yCAAyC,cAAc,GAAG,CAAC,CAAC;gBAC1E,OAAO,qBAAqB,CAAC,GAAG,CAAC,CAAC;YACpC,CAAC;YACD,IAAI,GAAG,CAAC,MAAM,KAAK,YAAY,EAAE,CAAC;gBAChC,OAAO,CAAC,KAAK,CAAC,8DAA8D,cAAc,GAAG,CAAC,CAAC;gBAC/F,OAAO,sBAAsB,CAAC,GAAG,CAAC,CAAC;YACrC,CAAC;YACD,IAAI,GAAG,CAAC,MAAM,KAAK,WAAW,EAAE,CAAC;gBAC/B,OAAO,CAAC,KAAK,CAAC,yCAAyC,cAAc,GAAG,CAAC,CAAC;gBAC1E,OAAO,qBAAqB,CAAC,GAAG,CAAC,CAAC;YACpC,CAAC;YACD,IAAI,GAAG,CAAC,MAAM,KAAK,OAAO,EAAE,CAAC;gBAC3B,OAAO,CAAC,KAAK,CAAC,iDAAiD,cAAc,GAAG,CAAC,CAAC;gBAClF,OAAO,iBAAiB,CAAC,GAAG,CAAC,CAAC;YAChC,CAAC;YAED,OAAO,CAAC,KAAK,CAAC,+BAA+B,GAAG,CAAC,MAAM,yBAAyB,CAAC,CAAC;QACpF,CAAC;QAED,2CAA2C;QAC3C,MAAM,QAAQ,GAAG,IAAI,CAAC,GAAG,CAAC,WAAW,GAAG,EAAE,EAAE,GAAG,CAAC,CAAC;QAEjD,0DAA0D;QAC1D,IAAI,aAAqB,CAAC;QAC1B,IAAI,GAAG,CAAC,MAAM,KAAK,SAAS,EAAE,CAAC;YAC7B,aAAa,GAAG,sEAAsE,CAAC;QACzF,CAAC;aAAM,IAAI,GAAG,CAAC,MAAM,KAAK,SAAS,EAAE,CAAC;YACpC,aAAa,GAAG,4CAA4C,CAAC;QAC/D,CAAC;aAAM,IAAI,GAAG,CAAC,MAAM,KAAK,SAAS,EAAE,CAAC;YACpC,aAAa,GAAG,uCAAuC,CAAC;QAC1D,CAAC;aAAM,CAAC;YACN,qCAAqC;YACrC,aAAa,GAAG,aAAa,GAAG,CAAC,MAAM,WAAW,CAAC;QACrD,CAAC;QAED,OAAO;YACL,OAAO,EAAE,CAAC;oBACR,IAAI,EAAE,MAAM;oBACZ,IAAI,EAAE,eAAe,GAAG,CAAC,MAAM;;UAE7B,GAAG,CAAC,EAAE;;EAEd,aAAa;;SAEN,WAAW,oBAAoB,mBAAmB;;2DAEA,QAAQ;6CACtB;iBACtC,CAAC;SACH,CAAC;IACJ,CAAC;IAAC,OAAO,KAAK,EAAE,CAAC;QACf,OAAO;YACL,OAAO,EAAE,CAAC;oBACR,IAAI,EAAE,MAAM;oBACZ,IAAI,EAAE;;EAEZ,KAAK,YAAY,KAAK,CAAC,CAAC,CAAC,KAAK,CAAC,OAAO,CAAC,CAAC,CAAC,eAAe,EAAE;iBACrD,CAAC;YACF,OAAO,EAAE,IAAI;SACd,CAAC;IACJ,CAAC;AACH,CAAC"}

package/dist/types.d.ts

@@ -2,7 +2,7 @@
  * MCP Server Configuration Types
  */
 export interface McpServerConfig {
-    /** Base URL of the RunHuman API */
+    /** Base URL of the Runhuman API */
     apiUrl: string;
     /** API key for authentication */
     apiKey: string;
@@ -14,6 +14,8 @@ export interface CreateJobArgs {
     targetDurationMinutes?: number;
     allowDurationExtension?: boolean;
     maxExtensionMinutes?: number | boolean;
+    /** Custom instructions for the AI when validating test results */
+    additionalValidationInstructions?: string;
 }
 export interface WaitForResultArgs {
     jobId: string;

package/dist/types.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"types.d.ts","sourceRoot":"","sources":["../src/types.ts"],"names":[],"mappings":"AAAA;;GAEG;AAEH,MAAM,WAAW,eAAe;IAC9B,mCAAmC;IACnC,MAAM,EAAE,MAAM,CAAC;IACf,iCAAiC;IACjC,MAAM,EAAE,MAAM,CAAC;CAChB;AAED,MAAM,WAAW,aAAa;IAC5B,GAAG,EAAE,MAAM,CAAC;IACZ,WAAW,EAAE,MAAM,CAAC;IACpB,MAAM,EAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,CAAC;IAChC,qBAAqB,CAAC,EAAE,MAAM,CAAC;IAC/B,sBAAsB,CAAC,EAAE,OAAO,CAAC;IACjC,mBAAmB,CAAC,EAAE,MAAM,GAAG,OAAO,CAAC;CACxC;AAED,MAAM,WAAW,iBAAiB;IAChC,KAAK,EAAE,MAAM,CAAC;IACd,WAAW,CAAC,EAAE,MAAM,CAAC;CACtB;AAED,MAAM,WAAW,WAAW;IAC1B,EAAE,EAAE,MAAM,CAAC;IACX,MAAM,EAAE,MAAM,CAAC;IACf,MAAM,CAAC,EAAE,OAAO,CAAC;IACjB,KAAK,CAAC,EAAE,MAAM,CAAC;IACf,cAAc,CAAC,EAAE,MAAM,CAAC;IACxB,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,eAAe,CAAC,EAAE,MAAM,CAAC;IACzB,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,UAAU,CAAC,EAAE;QACX,mBAAmB,EAAE,MAAM,CAAC;QAC5B,eAAe,EAAE,KAAK,CAAC;YAAE,IAAI,EAAE,MAAM,CAAC;YAAC,OAAO,EAAE,MAAM,CAAC;YAAC,SAAS,EAAE,MAAM,CAAA;SAAE,CAAC,CAAC;QAC7E,eAAe,EAAE,KAAK,CAAC;YAAE,GAAG,EAAE,MAAM,CAAC;YAAC,MAAM,EAAE,MAAM,CAAC;YAAC,MAAM,CAAC,EAAE,MAAM,CAAC;YAAC,SAAS,EAAE,MAAM,CAAA;SAAE,CAAC,CAAC;QAC5F,MAAM,EAAE,KAAK,CAAC;YAAE,CAAC,EAAE,MAAM,CAAC;YAAC,CAAC,EAAE,MAAM,CAAC;YAAC,SAAS,EAAE,MAAM,CAAC;YAAC,OAAO,CAAC,EAAE,MAAM,CAAA;SAAE,CAAC,CAAC;QAC7E,WAAW,EAAE,MAAM,EAAE,CAAC;QACtB,QAAQ,CAAC,EAAE,MAAM,CAAC;KACnB,CAAC;CACH;AAED,MAAM,WAAW,iBAAiB;IAChC,KAAK,EAAE,MAAM,CAAC;IACd,MAAM,EAAE,MAAM,CAAC;CAChB"}
+{"version":3,"file":"types.d.ts","sourceRoot":"","sources":["../src/types.ts"],"names":[],"mappings":"AAAA;;GAEG;AAEH,MAAM,WAAW,eAAe;IAC9B,mCAAmC;IACnC,MAAM,EAAE,MAAM,CAAC;IACf,iCAAiC;IACjC,MAAM,EAAE,MAAM,CAAC;CAChB;AAED,MAAM,WAAW,aAAa;IAC5B,GAAG,EAAE,MAAM,CAAC;IACZ,WAAW,EAAE,MAAM,CAAC;IACpB,MAAM,EAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,CAAC;IAChC,qBAAqB,CAAC,EAAE,MAAM,CAAC;IAC/B,sBAAsB,CAAC,EAAE,OAAO,CAAC;IACjC,mBAAmB,CAAC,EAAE,MAAM,GAAG,OAAO,CAAC;IACvC,kEAAkE;IAClE,gCAAgC,CAAC,EAAE,MAAM,CAAC;CAC3C;AAED,MAAM,WAAW,iBAAiB;IAChC,KAAK,EAAE,MAAM,CAAC;IACd,WAAW,CAAC,EAAE,MAAM,CAAC;CACtB;AAED,MAAM,WAAW,WAAW;IAC1B,EAAE,EAAE,MAAM,CAAC;IACX,MAAM,EAAE,MAAM,CAAC;IACf,MAAM,CAAC,EAAE,OAAO,CAAC;IACjB,KAAK,CAAC,EAAE,MAAM,CAAC;IACf,cAAc,CAAC,EAAE,MAAM,CAAC;IACxB,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,eAAe,CAAC,EAAE,MAAM,CAAC;IACzB,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,UAAU,CAAC,EAAE;QACX,mBAAmB,EAAE,MAAM,CAAC;QAC5B,eAAe,EAAE,KAAK,CAAC;YAAE,IAAI,EAAE,MAAM,CAAC;YAAC,OAAO,EAAE,MAAM,CAAC;YAAC,SAAS,EAAE,MAAM,CAAA;SAAE,CAAC,CAAC;QAC7E,eAAe,EAAE,KAAK,CAAC;YAAE,GAAG,EAAE,MAAM,CAAC;YAAC,MAAM,EAAE,MAAM,CAAC;YAAC,MAAM,CAAC,EAAE,MAAM,CAAC;YAAC,SAAS,EAAE,MAAM,CAAA;SAAE,CAAC,CAAC;QAC5F,MAAM,EAAE,KAAK,CAAC;YAAE,CAAC,EAAE,MAAM,CAAC;YAAC,CAAC,EAAE,MAAM,CAAC;YAAC,SAAS,EAAE,MAAM,CAAC;YAAC,OAAO,CAAC,EAAE,MAAM,CAAA;SAAE,CAAC,CAAC;QAC7E,WAAW,EAAE,MAAM,EAAE,CAAC;QACtB,QAAQ,CAAC,EAAE,MAAM,CAAC;KACnB,CAAC;CACH;AAED,MAAM,WAAW,iBAAiB;IAChC,KAAK,EAAE,MAAM,CAAC;IACd,MAAM,EAAE,MAAM,CAAC;CAChB"}

package/package.json

@@ -1,78 +1,78 @@
-{
-  "name": "@runhuman/mcp-server",
-  "version": "2.0.4",
-  "description": "Model Context Protocol (MCP) server for RunHuman - Human-powered QA testing for AI agents",
-  "main": "dist/lib.js",
-  "type": "module",
-  "exports": {
-    ".": {
-      "import": "./dist/lib.js",
-      "require": "./dist/lib.js",
-      "types": "./dist/lib.d.ts"
-    },
-    "./factory": {
-      "import": "./dist/mcp-server-factory.js",
-      "types": "./dist/mcp-server-factory.d.ts"
-    },
-    "./types": {
-      "import": "./dist/types.js",
-      "types": "./dist/types.d.ts"
-    }
-  },
-  "bin": {
-    "runhuman-mcp": "dist/index.js"
-  },
-  "files": [
-    "dist",
-    "README.md",
-    ".env.example"
-  ],
-  "scripts": {
-    "build": "tsc",
-    "dev": "tsx watch src/index.ts",
-    "start": "node dist/index.js",
-    "prepublishOnly": "npm run build",
-    "type-check": "tsc",
-    "test": "node test-simple.cjs",
-    "test:all": "node test-all-tools.cjs",
-    "test:routes": "node test-route-fix.cjs",
-    "test:endpoints": "node test-api-endpoints.cjs",
-    "test:ci": "npm run test:endpoints && npm run test:routes",
-    "test:inspector": "npx @modelcontextprotocol/inspector node dist/index.js"
-  },
-  "keywords": [
-    "mcp",
-    "model-context-protocol",
-    "qa",
-    "testing",
-    "human-in-the-loop",
-    "ai-agent",
-    "claude",
-    "anthropic",
-    "qa-testing",
-    "manual-testing"
-  ],
-  "author": "RunHuman <hey@runhuman.com>",
-  "repository": {
-    "type": "git",
-    "url": "git+https://github.com/yueranyuan/qa-experiment.git",
-    "directory": "packages/mcp-server"
-  },
-  "homepage": "https://runhuman.com",
-  "bugs": {
-    "url": "https://github.com/yueranyuan/qa-experiment/issues"
-  },
-  "license": "ISC",
-  "engines": {
-    "node": ">=18.0.0"
-  },
-  "dependencies": {
-    "@modelcontextprotocol/sdk": "latest",
-    "dotenv": "^17.2.3"
-  },
-  "devDependencies": {
-    "@types/node": "^20.11.17",
-    "tsx": "^4.7.1",
-    "typescript": "^5.3.3"
-  }
-}
+{
+  "name": "@runhuman/mcp-server",
+  "version": "2.0.5",
+  "description": "Model Context Protocol (MCP) server for Runhuman - Human-powered QA testing for AI agents",
+  "main": "dist/lib.js",
+  "type": "module",
+  "exports": {
+    ".": {
+      "import": "./dist/lib.js",
+      "require": "./dist/lib.js",
+      "types": "./dist/lib.d.ts"
+    },
+    "./factory": {
+      "import": "./dist/mcp-server-factory.js",
+      "types": "./dist/mcp-server-factory.d.ts"
+    },
+    "./types": {
+      "import": "./dist/types.js",
+      "types": "./dist/types.d.ts"
+    }
+  },
+  "bin": {
+    "runhuman-mcp": "dist/index.js"
+  },
+  "files": [
+    "dist",
+    "README.md",
+    ".env.example"
+  ],
+  "scripts": {
+    "build": "tsc",
+    "dev": "tsx watch src/index.ts",
+    "start": "node dist/index.js",
+    "prepublishOnly": "npm run build",
+    "type-check": "tsc",
+    "test": "node test-simple.cjs",
+    "test:all": "node test-all-tools.cjs",
+    "test:routes": "node test-route-fix.cjs",
+    "test:endpoints": "node test-api-endpoints.cjs",
+    "test:ci": "npm run test:endpoints && npm run test:routes",
+    "test:inspector": "npx @modelcontextprotocol/inspector node dist/index.js"
+  },
+  "keywords": [
+    "mcp",
+    "model-context-protocol",
+    "qa",
+    "testing",
+    "human-in-the-loop",
+    "ai-agent",
+    "claude",
+    "anthropic",
+    "qa-testing",
+    "manual-testing"
+  ],
+  "author": "Runhuman <hey@runhuman.com>",
+  "repository": {
+    "type": "git",
+    "url": "git+https://github.com/yueranyuan/qa-experiment.git",
+    "directory": "packages/mcp-server"
+  },
+  "homepage": "https://runhuman.com",
+  "bugs": {
+    "url": "https://github.com/yueranyuan/qa-experiment/issues"
+  },
+  "license": "ISC",
+  "engines": {
+    "node": ">=18.0.0"
+  },
+  "dependencies": {
+    "@modelcontextprotocol/sdk": "latest",
+    "dotenv": "^17.2.3"
+  },
+  "devDependencies": {
+    "@types/node": "^20.11.17",
+    "tsx": "^4.7.1",
+    "typescript": "^5.3.3"
+  }
+}