proctor-mcp-server 0.1.0 → 0.1.2

package/README.md

@@ -36,15 +36,13 @@ This is an MCP ([Model Context Protocol](https://modelcontextprotocol.io/)) Serv
 
 This server is built and tested on macOS with Claude Desktop. It should work with other MCP clients as well.
 
-| Tool Name              | Tool Group | Read/Write | Description                                              |
-| ---------------------- | ---------- | ---------- | -------------------------------------------------------- |
-| `get_proctor_metadata` | exams      | read       | Get available runtimes and exams for Proctor testing.    |
-| `run_exam`             | exams      | write      | Execute a Proctor exam against an MCP server.            |
-| `save_result`          | exams      | write      | Save exam results to the database for future comparison. |
-| `get_prior_result`     | exams      | read       | Retrieve a previous exam result for comparison.          |
-| `get_machines`         | machines   | read       | List active Fly.io machines used for Proctor exams.      |
-| `destroy_machine`      | machines   | write      | Delete a Fly.io machine.                                 |
-| `cancel_exam`          | machines   | write      | Cancel a running Proctor exam.                           |
+| Tool Name              | Tool Group | Read/Write | Description                                           |
+| ---------------------- | ---------- | ---------- | ----------------------------------------------------- |
+| `get_proctor_metadata` | exams      | read       | Get available runtimes and exams for Proctor testing. |
+| `run_exam`             | exams      | write      | Execute a Proctor exam against an MCP server.         |
+| `get_machines`         | machines   | read       | List active Fly.io machines used for Proctor exams.   |
+| `destroy_machine`      | machines   | write      | Delete a Fly.io machine.                              |
+| `cancel_exam`          | machines   | write      | Cancel a running Proctor exam.                        |
 
 # Tool Groups
 
@@ -57,16 +55,16 @@ This server organizes tools into groups that can be selectively enabled or disab
 
 | Group               | Tools | Description                            |
 | ------------------- | ----- | -------------------------------------- |
-| `exams`             | 4     | Full exam execution (read + write)     |
-| `exams_readonly`    | 2     | Exam metadata and results (read only)  |
+| `exams`             | 2     | Full exam execution (read + write)     |
+| `exams_readonly`    | 1     | Exam metadata (read only)              |
 | `machines`          | 3     | Full machine management (read + write) |
 | `machines_readonly` | 1     | Machine listing (read only)            |
 
 ### Tools by Group
 
 - **exams** / **exams_readonly**:
-  - Read-only: `get_proctor_metadata`, `get_prior_result`
-  - Write: `run_exam`, `save_result`
+  - Read-only: `get_proctor_metadata`
+  - Write: `run_exam`
 - **machines** / **machines_readonly**:
   - Read-only: `get_machines`
   - Write: `destroy_machine`, `cancel_exam`
@@ -114,9 +112,8 @@ TOOL_GROUPS=exams,machines_readonly
 
 # Usage Tips
 
-- Use `get_proctor_metadata` first to discover available runtimes and exam types
-- The `mcp_config` parameter for `run_exam` must be a valid JSON string
-- Save results with `save_result` to enable future comparisons with `get_prior_result`
+- Use `get_proctor_metadata` to discover available runtimes and exam types
+- Run exams with `run_exam` to test MCP servers with streaming progress logs
 - Use `get_machines` to monitor active exam infrastructure
 - Clean up machines with `destroy_machine` when no longer needed
 - Use `cancel_exam` to stop a stuck or slow exam before destroying the machine
@@ -141,24 +138,6 @@ Here are the available exams:
 - Init Tools List (id: proctor-mcp-client-init-tools-list) - Tests initialization and tool listing
 ```
 
-## Run an Exam
-
-```
-User: Run the init-tools-list exam against my MCP server at https://example.com/mcp
-Assistant: I'll run the exam against your server.
-
-[Calls run_exam with runtime_id="v0.0.37", exam_id="proctor-mcp-client-init-tools-list", mcp_config=...]
-
-The exam completed successfully. Here are the results:
-
-**Status:** Success
-**Tests Passed:** 5/5
-- Initialization: Passed
-- Tool listing: Passed
-- Tool execution: Passed
-...
-```
-
 ## Monitor Infrastructure
 
 ```
@@ -175,38 +154,28 @@ There are 2 active machines:
 
 # Setup
 
-## Cheatsheet
-
-Quick setup:
-
-```bash
-# Install dependencies
-npm run install-all
+## Claude Desktop
 
-# Build the server
-npm run build
+Make sure you have your Proctor API key ready.
 
-# Set your API key
-export PROCTOR_API_KEY="your-api-key-here"
+Then proceed to the setup instructions below. If this is your first time using MCP Servers, you'll want to make sure you have the [Claude Desktop application](https://claude.ai/download) and follow the [official MCP setup instructions](https://modelcontextprotocol.io/quickstart/user).
 
-# Run the server
-cd local && npm start
-```
+### Manual Setup
 
-## Claude Desktop
+You're going to need Node working on your machine so you can run `npx` commands in your terminal. If you don't have Node, you can install it from [nodejs.org](https://nodejs.org/en/download).
 
-Add to your Claude Desktop configuration:
+macOS: `~/Library/Application Support/Claude/claude_desktop_config.json`
 
-### macOS: `~/Library/Application Support/Claude/claude_desktop_config.json`
+Windows: `%APPDATA%\Claude\claude_desktop_config.json`
 
-### Windows: `%APPDATA%\Claude\claude_desktop_config.json`
+Modify your `claude_desktop_config.json` file to add the following:
 
 ```json
 {
   "mcpServers": {
     "proctor": {
-      "command": "node",
-      "args": ["/path/to/proctor/local/build/index.js"],
+      "command": "npx",
+      "args": ["-y", "proctor-mcp-server"],
       "env": {
         "PROCTOR_API_KEY": "your-api-key-here",
         "TOOL_GROUPS": "exams,machines"
@@ -216,14 +185,16 @@ Add to your Claude Desktop configuration:
 }
 ```
 
+Restart Claude Desktop and you should be ready to go!
+
 For read-only access:
 
 ```json
 {
   "mcpServers": {
     "proctor-readonly": {
-      "command": "node",
-      "args": ["/path/to/proctor/local/build/index.js"],
+      "command": "npx",
+      "args": ["-y", "proctor-mcp-server"],
       "env": {
         "PROCTOR_API_KEY": "your-api-key-here",
         "TOOL_GROUPS": "exams_readonly,machines_readonly"
@@ -233,13 +204,22 @@ For read-only access:
 }
 ```
 
-### Manual Setup
+## Development
 
-If you prefer to run the server manually:
+### Quick Setup
 
 ```bash
-cd /path/to/proctor/local
-PROCTOR_API_KEY="your-api-key-here" node build/index.js
+# Install dependencies
+npm run install-all
+
+# Build the server
+npm run build
+
+# Set your API key
+export PROCTOR_API_KEY="your-api-key-here"
+
+# Run the server
+cd local && npm start
 ```
 
 ## License

package/build/index.integration-with-mock.js

@@ -9,8 +9,6 @@ import { createMCPServer, logServerStart, logError } from '../shared/index.js';
  * Integration mock implementation of IProctorClient
  */
 class IntegrationMockProctorClient {
-    priorResults = new Map();
-    savedResultId = 0;
     async getMetadata() {
         return {
             runtimes: [
@@ -39,61 +37,24 @@ class IntegrationMockProctorClient {
             ],
         };
     }
-    async *runExam(params) {
+    async *runExam(_params) {
+        yield { type: 'log', data: { time: '2024-01-15T10:30:00Z', message: 'Starting exam...' } };
         yield {
             type: 'log',
-            data: { time: new Date().toISOString(), message: 'Starting exam...' },
-        };
-        yield {
-            type: 'log',
-            data: { time: new Date().toISOString(), message: `Using runtime: ${params.runtime_id}` },
-        };
-        yield {
-            type: 'log',
-            data: { time: new Date().toISOString(), message: `Running exam: ${params.exam_id}` },
-        };
-        yield {
-            type: 'log',
-            data: { time: new Date().toISOString(), message: 'Exam completed successfully' },
+            data: { time: '2024-01-15T10:30:01Z', message: 'Initializing MCP client...' },
         };
+        yield { type: 'log', data: { time: '2024-01-15T10:30:02Z', message: 'Running tests...' } };
         yield {
             type: 'result',
             data: {
-                status: 'success',
-                input: {
-                    'mcp.json': JSON.parse(params.mcp_config),
-                },
+                status: 'passed',
                 tests: [
                     { name: 'initialization', passed: true },
-                    { name: 'tool_listing', passed: true },
+                    { name: 'tools_list', passed: true },
                 ],
             },
         };
     }
-    async saveResult(params) {
-        this.savedResultId++;
-        const result = {
-            success: true,
-            id: this.savedResultId,
-        };
-        const key = `${params.mirror_id}-${params.exam_id}`;
-        this.priorResults.set(key, {
-            id: this.savedResultId,
-            datetime_performed: new Date().toISOString(),
-            results: typeof params.results === 'string' ? JSON.parse(params.results) : params.results,
-            runtime_image: params.runtime_id,
-            match_type: 'exact',
-        });
-        return result;
-    }
-    async getPriorResult(params) {
-        const key = `${params.mirror_id}-${params.exam_id}`;
-        const result = this.priorResults.get(key);
-        if (!result) {
-            throw new Error('No prior result found');
-        }
-        return result;
-    }
     async getMachines() {
         return {
             machines: [

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "proctor-mcp-server",
-  "version": "0.1.0",
+  "version": "0.1.2",
   "description": "Local implementation of Proctor MCP server",
   "main": "build/index.js",
   "type": "module",

package/shared/index.d.ts

@@ -3,5 +3,5 @@ export type { IProctorClient, ClientFactory } from './server.js';
 export { createRegisterTools, parseEnabledToolGroups } from './tools.js';
 export type { ToolGroup } from './tools.js';
 export { logServerStart, logError, logWarning, logDebug } from './logging.js';
-export type { ProctorRuntime, ProctorExam, ProctorMetadataResponse, ExamLogEntry, ExamStreamLog, ExamStreamResult, ExamStreamError, ExamStreamEntry, ExamResult, RunExamParams, SaveResultParams, SaveResultResponse, PriorResultParams, PriorResultResponse, FlyMachine, MachinesResponse, CancelExamParams, CancelExamResponse, ApiError, } from './types.js';
+export type { ProctorRuntime, ProctorExam, ProctorMetadataResponse, ExamLogEntry, ExamStreamLog, ExamStreamResult, ExamStreamError, ExamStreamEntry, ExamResult, RunExamParams, FlyMachine, MachinesResponse, CancelExamParams, CancelExamResponse, ApiError, } from './types.js';
 //# sourceMappingURL=index.d.ts.map

package/shared/proctor-client/lib/run-exam.js

@@ -7,7 +7,9 @@ export async function* runExam(apiKey, baseUrl, params) {
     const body = {
         runtime_id: params.runtime_id,
         exam_id: params.exam_id,
-        mcp_config: params.mcp_config,
+        mcp_config: params.mcp_json,
+        // Always disable OAuth credential persistence - the MCP server manages its own credentials
+        no_result_persistence: true,
     };
     if (params.server_json) {
         body.server_json = params.server_json;
@@ -18,12 +20,6 @@ export async function* runExam(apiKey, baseUrl, params) {
     if (params.max_retries !== undefined) {
         body.max_retries = params.max_retries;
     }
-    if (params.mcp_server_slug) {
-        body.mcp_server_slug = params.mcp_server_slug;
-    }
-    if (params.mcp_json_id !== undefined) {
-        body.mcp_json_id = params.mcp_json_id;
-    }
     const response = await fetch(url.toString(), {
         method: 'POST',
         headers: {

package/shared/server.d.ts

@@ -1,10 +1,8 @@
 import { Server } from '@modelcontextprotocol/sdk/server/index.js';
-import type { ProctorMetadataResponse, RunExamParams, ExamStreamEntry, SaveResultParams, SaveResultResponse, PriorResultParams, PriorResultResponse, MachinesResponse, CancelExamParams, CancelExamResponse } from './types.js';
+import type { ProctorMetadataResponse, RunExamParams, ExamStreamEntry, MachinesResponse, CancelExamParams, CancelExamResponse } from './types.js';
 export interface IProctorClient {
     getMetadata(): Promise<ProctorMetadataResponse>;
     runExam(params: RunExamParams): AsyncGenerator<ExamStreamEntry, void, unknown>;
-    saveResult(params: SaveResultParams): Promise<SaveResultResponse>;
-    getPriorResult(params: PriorResultParams): Promise<PriorResultResponse>;
     getMachines(): Promise<MachinesResponse>;
     destroyMachine(machineId: string): Promise<{
         success: boolean;
@@ -17,8 +15,6 @@ export declare class ProctorClient implements IProctorClient {
     constructor(apiKey: string, baseUrl?: string);
     getMetadata(): Promise<ProctorMetadataResponse>;
     runExam(params: RunExamParams): AsyncGenerator<ExamStreamEntry, void, unknown>;
-    saveResult(params: SaveResultParams): Promise<SaveResultResponse>;
-    getPriorResult(params: PriorResultParams): Promise<PriorResultResponse>;
     getMachines(): Promise<MachinesResponse>;
     destroyMachine(machineId: string): Promise<{
         success: boolean;

package/shared/server.js

@@ -16,14 +16,6 @@ export class ProctorClient {
         const { runExam } = await import('./proctor-client/lib/run-exam.js');
         yield* runExam(this.apiKey, this.baseUrl, params);
     }
-    async saveResult(params) {
-        const { saveResult } = await import('./proctor-client/lib/save-result.js');
-        return saveResult(this.apiKey, this.baseUrl, params);
-    }
-    async getPriorResult(params) {
-        const { getPriorResult } = await import('./proctor-client/lib/get-prior-result.js');
-        return getPriorResult(this.apiKey, this.baseUrl, params);
-    }
     async getMachines() {
         const { getMachines } = await import('./proctor-client/lib/get-machines.js');
         return getMachines(this.apiKey, this.baseUrl);
@@ -40,7 +32,7 @@ export class ProctorClient {
 export function createMCPServer() {
     const server = new Server({
         name: 'proctor-mcp-server',
-        version: '0.1.0',
+        version: '0.1.2',
     }, {
         capabilities: {
             tools: {},

package/shared/tools/get-metadata.js

@@ -3,20 +3,16 @@ export function getMetadata(_server, clientFactory) {
         name: 'get_proctor_metadata',
         description: `Get available runtimes and exams for Proctor testing.
 
-Returns the list of available runtime environments (Docker images) and exam types
-that can be used with the run_exam tool.
+Returns the list of available runtime environments (Docker images) and exam types.
 
 **Returns:**
 - runtimes: Array of runtime configurations with id, name, and Docker image
 - exams: Array of exam types with id, name, and description
 
 **Use cases:**
-- Discover available runtime environments before running an exam
+- Discover available runtime environments
 - Find the correct exam ID for a specific test type
-- Check which runtime versions are available
-- Plan which exam to run against an MCP server
-
-**Note:** Use the runtime_id and exam_id values from this response when calling run_exam.`,
+- Check which runtime versions are available`,
         inputSchema: {
             type: 'object',
             properties: {},

package/shared/tools/run-exam.d.ts

@@ -14,7 +14,7 @@ export declare function runExam(_server: Server, clientFactory: ClientFactory):
                 type: string;
                 description: "Exam ID from get_proctor_metadata. Example: \"proctor-mcp-client-init-tools-list\" or \"proctor-mcp-client-auth-check\"";
             };
-            mcp_config: {
+            mcp_json: {
                 type: string;
                 description: "JSON string of the mcp.json configuration for the MCP server. Must be a valid JSON object with server configurations.";
             };
@@ -30,14 +30,6 @@ export declare function runExam(_server: Server, clientFactory: ClientFactory):
                 type: string;
                 description: "Maximum number of retry attempts (0-10). Default is 0.";
             };
-            mcp_server_slug: {
-                type: string;
-                description: "Optional MCP server slug for auto-injection of proctor files and OAuth credentials.";
-            };
-            mcp_json_id: {
-                type: string;
-                description: "Optional McpJson ID for preloaded OAuth credentials.";
-            };
         };
         required: string[];
     };

package/shared/tools/run-exam.js

@@ -3,22 +3,18 @@ import { z } from 'zod';
 const PARAM_DESCRIPTIONS = {
     runtime_id: 'Runtime ID from get_proctor_metadata, or "__custom__" for a custom Docker image. Example: "v0.0.37"',
     exam_id: 'Exam ID from get_proctor_metadata. Example: "proctor-mcp-client-init-tools-list" or "proctor-mcp-client-auth-check"',
-    mcp_config: 'JSON string of the mcp.json configuration for the MCP server. Must be a valid JSON object with server configurations.',
+    mcp_json: 'JSON string of the mcp.json configuration for the MCP server. Must be a valid JSON object with server configurations.',
     server_json: 'Optional JSON string of server.json for result enrichment. Provides additional context about the server being tested.',
     custom_runtime_image: 'Required if runtime_id is "__custom__". Docker image URL in format: registry/image:tag',
     max_retries: 'Maximum number of retry attempts (0-10). Default is 0.',
-    mcp_server_slug: 'Optional MCP server slug for auto-injection of proctor files and OAuth credentials.',
-    mcp_json_id: 'Optional McpJson ID for preloaded OAuth credentials.',
 };
 const RunExamSchema = z.object({
     runtime_id: z.string().min(1).describe(PARAM_DESCRIPTIONS.runtime_id),
     exam_id: z.string().min(1).describe(PARAM_DESCRIPTIONS.exam_id),
-    mcp_config: z.string().min(1).describe(PARAM_DESCRIPTIONS.mcp_config),
+    mcp_json: z.string().min(1).describe(PARAM_DESCRIPTIONS.mcp_json),
     server_json: z.string().optional().describe(PARAM_DESCRIPTIONS.server_json),
     custom_runtime_image: z.string().optional().describe(PARAM_DESCRIPTIONS.custom_runtime_image),
     max_retries: z.number().min(0).max(10).optional().describe(PARAM_DESCRIPTIONS.max_retries),
-    mcp_server_slug: z.string().optional().describe(PARAM_DESCRIPTIONS.mcp_server_slug),
-    mcp_json_id: z.number().optional().describe(PARAM_DESCRIPTIONS.mcp_json_id),
 });
 export function runExam(_server, clientFactory) {
     return {
@@ -41,9 +37,8 @@ tests the MCP server's functionality and returns detailed results.
 
 **Note:**
 - Use get_proctor_metadata first to discover available runtimes and exams
-- The mcp_config must be a valid JSON string representing the mcp.json format
-- Custom runtime images require the "__custom__" runtime_id and custom_runtime_image parameter
-- Results can be saved using save_result for future comparison`,
+- The mcp_json must be a valid JSON string representing the mcp.json format
+- Custom runtime images require the "__custom__" runtime_id and custom_runtime_image parameter`,
         inputSchema: {
             type: 'object',
             properties: {
@@ -55,9 +50,9 @@ tests the MCP server's functionality and returns detailed results.
                     type: 'string',
                     description: PARAM_DESCRIPTIONS.exam_id,
                 },
-                mcp_config: {
+                mcp_json: {
                     type: 'string',
-                    description: PARAM_DESCRIPTIONS.mcp_config,
+                    description: PARAM_DESCRIPTIONS.mcp_json,
                 },
                 server_json: {
                     type: 'string',
@@ -71,29 +66,21 @@ tests the MCP server's functionality and returns detailed results.
                     type: 'number',
                     description: PARAM_DESCRIPTIONS.max_retries,
                 },
-                mcp_server_slug: {
-                    type: 'string',
-                    description: PARAM_DESCRIPTIONS.mcp_server_slug,
-                },
-                mcp_json_id: {
-                    type: 'number',
-                    description: PARAM_DESCRIPTIONS.mcp_json_id,
-                },
             },
-            required: ['runtime_id', 'exam_id', 'mcp_config'],
+            required: ['runtime_id', 'exam_id', 'mcp_json'],
         },
         handler: async (args) => {
             const validatedArgs = RunExamSchema.parse(args);
-            // Validate mcp_config is valid JSON
+            // Validate mcp_json is valid JSON
             try {
-                JSON.parse(validatedArgs.mcp_config);
+                JSON.parse(validatedArgs.mcp_json);
             }
             catch {
                 return {
                     content: [
                         {
                             type: 'text',
-                            text: 'Error: mcp_config must be a valid JSON string',
+                            text: 'Error: mcp_json must be a valid JSON string',
                         },
                     ],
                     isError: true,
@@ -120,12 +107,10 @@ tests the MCP server's functionality and returns detailed results.
                 for await (const entry of client.runExam({
                     runtime_id: validatedArgs.runtime_id,
                     exam_id: validatedArgs.exam_id,
-                    mcp_config: validatedArgs.mcp_config,
+                    mcp_json: validatedArgs.mcp_json,
                     server_json: validatedArgs.server_json,
                     custom_runtime_image: validatedArgs.custom_runtime_image,
                     max_retries: validatedArgs.max_retries,
-                    mcp_server_slug: validatedArgs.mcp_server_slug,
-                    mcp_json_id: validatedArgs.mcp_json_id,
                 })) {
                     if (entry.type === 'log') {
                         const logData = entry.data;

package/shared/tools.d.ts

@@ -31,7 +31,7 @@ export declare function parseEnabledToolGroups(enabledGroupsParam?: string): Too
  *
  * Available tool groups:
  * - exams: All exam-related tools (read + write)
- * - exams_readonly: Exam tools (read only - get_proctor_metadata, get_prior_result)
+ * - exams_readonly: Exam tools (read only - get_proctor_metadata)
  * - machines: All machine management tools (read + write)
  * - machines_readonly: Machine tools (read only - get_machines)
  *

package/shared/tools.js

@@ -1,8 +1,6 @@
 import { ListToolsRequestSchema, CallToolRequestSchema } from '@modelcontextprotocol/sdk/types.js';
 import { getMetadata } from './tools/get-metadata.js';
 import { runExam } from './tools/run-exam.js';
-import { saveResult } from './tools/save-result.js';
-import { getPriorResult } from './tools/get-prior-result.js';
 import { getMachines } from './tools/get-machines.js';
 import { destroyMachine } from './tools/destroy-machine.js';
 import { cancelExam } from './tools/cancel-exam.js';
@@ -10,8 +8,6 @@ const ALL_TOOLS = [
     // Exam tools
     { factory: getMetadata, group: 'exams', isWriteOperation: false },
     { factory: runExam, group: 'exams', isWriteOperation: true },
-    { factory: saveResult, group: 'exams', isWriteOperation: true },
-    { factory: getPriorResult, group: 'exams', isWriteOperation: false },
     // Machine management tools
     { factory: getMachines, group: 'machines', isWriteOperation: false },
     { factory: destroyMachine, group: 'machines', isWriteOperation: true },
@@ -81,7 +77,7 @@ function shouldIncludeTool(toolDef, enabledGroups) {
  *
  * Available tool groups:
  * - exams: All exam-related tools (read + write)
- * - exams_readonly: Exam tools (read only - get_proctor_metadata, get_prior_result)
+ * - exams_readonly: Exam tools (read only - get_proctor_metadata)
  * - machines: All machine management tools (read + write)
  * - machines_readonly: Machine tools (read only - get_machines)
  *

package/shared/types.d.ts

@@ -67,48 +67,17 @@ export interface ExamResult {
 export interface RunExamParams {
     runtime_id: string;
     exam_id: string;
-    mcp_config: string;
+    mcp_json: string;
     server_json?: string;
     custom_runtime_image?: string;
     max_retries?: number;
-    mcp_server_slug?: string;
-    mcp_json_id?: number;
-}
-/**
- * Parameters for saving exam results
- */
-export interface SaveResultParams {
-    runtime_id: string;
-    exam_id: string;
-    mcp_server_slug: string;
-    mirror_id: number;
-    results: string | Record<string, unknown>;
-    custom_runtime_image?: string;
-}
-/**
- * Response from save_result endpoint
- */
-export interface SaveResultResponse {
-    success: boolean;
-    id: number;
-}
-/**
- * Parameters for getting prior results
- */
-export interface PriorResultParams {
-    mirror_id: number;
-    exam_id: string;
-    input_json?: string;
-}
-/**
- * Response from prior_result endpoint
- */
-export interface PriorResultResponse {
-    id: number;
-    datetime_performed: string;
-    results: ExamResult;
-    runtime_image: string;
-    match_type: 'exact' | 'entry_key';
+    /**
+     * When true, OAuth credentials obtained via web bridge are not persisted in the database.
+     * Instead, the user receives a one-time copy-to-clipboard page with their credentials.
+     * This is useful for the MCP server since it manages its own credential storage.
+     * @internal Hardcoded to true in the API client - not exposed as a tool parameter
+     */
+    no_result_persistence?: boolean;
 }
 /**
  * Fly.io machine information

package/shared/proctor-client/lib/get-prior-result.d.ts

@@ -1,6 +0,0 @@
-import type { PriorResultParams, PriorResultResponse } from '../../types.js';
-/**
- * Get a prior exam result for comparison
- */
-export declare function getPriorResult(apiKey: string, baseUrl: string, params: PriorResultParams): Promise<PriorResultResponse>;
-//# sourceMappingURL=get-prior-result.d.ts.map

package/shared/proctor-client/lib/get-prior-result.js

@@ -1,35 +0,0 @@
-/**
- * Get a prior exam result for comparison
- */
-export async function getPriorResult(apiKey, baseUrl, params) {
-    const url = new URL('/api/proctor/prior_result', baseUrl);
-    url.searchParams.append('mirror_id', String(params.mirror_id));
-    url.searchParams.append('exam_id', params.exam_id);
-    if (params.input_json) {
-        url.searchParams.append('input_json', params.input_json);
-    }
-    const response = await fetch(url.toString(), {
-        method: 'GET',
-        headers: {
-            'X-API-Key': apiKey,
-            Accept: 'application/json',
-        },
-    });
-    if (!response.ok) {
-        if (response.status === 401) {
-            throw new Error('Invalid API key');
-        }
-        if (response.status === 403) {
-            throw new Error('User lacks admin privileges or insufficient permissions');
-        }
-        if (response.status === 400) {
-            const errorData = (await response.json());
-            throw new Error(`Bad request: ${errorData.error || 'Missing required parameters'}`);
-        }
-        if (response.status === 404) {
-            throw new Error('No prior result found');
-        }
-        throw new Error(`Failed to get prior result: ${response.status} ${response.statusText}`);
-    }
-    return (await response.json());
-}

package/shared/proctor-client/lib/save-result.d.ts

@@ -1,6 +0,0 @@
-import type { SaveResultParams, SaveResultResponse } from '../../types.js';
-/**
- * Save exam results to the database
- */
-export declare function saveResult(apiKey: string, baseUrl: string, params: SaveResultParams): Promise<SaveResultResponse>;
-//# sourceMappingURL=save-result.d.ts.map

package/shared/proctor-client/lib/save-result.js

@@ -1,42 +0,0 @@
-/**
- * Save exam results to the database
- */
-export async function saveResult(apiKey, baseUrl, params) {
-    const url = new URL('/api/proctor/save_result', baseUrl);
-    const body = {
-        runtime_id: params.runtime_id,
-        exam_id: params.exam_id,
-        mcp_server_slug: params.mcp_server_slug,
-        mirror_id: params.mirror_id,
-        results: typeof params.results === 'string' ? params.results : JSON.stringify(params.results),
-    };
-    if (params.custom_runtime_image) {
-        body.custom_runtime_image = params.custom_runtime_image;
-    }
-    const response = await fetch(url.toString(), {
-        method: 'POST',
-        headers: {
-            'X-API-Key': apiKey,
-            'Content-Type': 'application/json',
-            Accept: 'application/json',
-        },
-        body: JSON.stringify(body),
-    });
-    if (!response.ok) {
-        if (response.status === 401) {
-            throw new Error('Invalid API key');
-        }
-        if (response.status === 403) {
-            throw new Error('User lacks admin privileges or insufficient permissions');
-        }
-        if (response.status === 404) {
-            throw new Error('Mirror not found');
-        }
-        if (response.status === 422) {
-            const errorData = (await response.json());
-            throw new Error(`Validation error: ${errorData.error || 'Unknown validation error'}`);
-        }
-        throw new Error(`Failed to save result: ${response.status} ${response.statusText}`);
-    }
-    return (await response.json());
-}

package/shared/tools/get-prior-result.d.ts

@@ -1,38 +0,0 @@
-import { Server } from '@modelcontextprotocol/sdk/server/index.js';
-import type { ClientFactory } from '../server.js';
-export declare function getPriorResult(_server: Server, clientFactory: ClientFactory): {
-    name: string;
-    description: string;
-    inputSchema: {
-        type: string;
-        properties: {
-            mirror_id: {
-                type: string;
-                description: "ID of the unofficial mirror to get prior results for.";
-            };
-            exam_id: {
-                type: string;
-                description: "Exam ID to filter results by.";
-            };
-            input_json: {
-                type: string;
-                description: "Optional JSON string of the current mcp.json for matching. If provided, returns the most recent result with matching config.";
-            };
-        };
-        required: string[];
-    };
-    handler: (args: unknown) => Promise<{
-        content: {
-            type: string;
-            text: string;
-        }[];
-        isError?: undefined;
-    } | {
-        content: {
-            type: string;
-            text: string;
-        }[];
-        isError: boolean;
-    }>;
-};
-//# sourceMappingURL=get-prior-result.d.ts.map

package/shared/tools/get-prior-result.js

@@ -1,106 +0,0 @@
-import { z } from 'zod';
-// Parameter descriptions - single source of truth
-const PARAM_DESCRIPTIONS = {
-    mirror_id: 'ID of the unofficial mirror to get prior results for.',
-    exam_id: 'Exam ID to filter results by.',
-    input_json: 'Optional JSON string of the current mcp.json for matching. If provided, returns the most recent result with matching config.',
-};
-const GetPriorResultSchema = z.object({
-    mirror_id: z.number().describe(PARAM_DESCRIPTIONS.mirror_id),
-    exam_id: z.string().min(1).describe(PARAM_DESCRIPTIONS.exam_id),
-    input_json: z.string().optional().describe(PARAM_DESCRIPTIONS.input_json),
-});
-export function getPriorResult(_server, clientFactory) {
-    return {
-        name: 'get_prior_result',
-        description: `Retrieve a previous exam result for comparison.
-
-Finds the most recent prior result for the specified mirror and exam, optionally
-matching against the current input configuration.
-
-**Returns:**
-- id: Result record ID
-- datetime_performed: When the exam was run (ISO 8601)
-- results: The full exam results
-- runtime_image: Docker image used for the exam
-- match_type: "exact" if mcp.json matches exactly, "entry_key" if only entry key matches
-
-**Use cases:**
-- Compare current test results with previous runs
-- Detect regressions in MCP server functionality
-- Review historical test outcomes
-- Validate that changes haven't broken existing behavior
-
-**Note:**
-- Returns 404 if no prior result exists
-- The match_type indicates how closely the prior result matches your input_json`,
-        inputSchema: {
-            type: 'object',
-            properties: {
-                mirror_id: {
-                    type: 'number',
-                    description: PARAM_DESCRIPTIONS.mirror_id,
-                },
-                exam_id: {
-                    type: 'string',
-                    description: PARAM_DESCRIPTIONS.exam_id,
-                },
-                input_json: {
-                    type: 'string',
-                    description: PARAM_DESCRIPTIONS.input_json,
-                },
-            },
-            required: ['mirror_id', 'exam_id'],
-        },
-        handler: async (args) => {
-            const validatedArgs = GetPriorResultSchema.parse(args);
-            const client = clientFactory();
-            try {
-                const response = await client.getPriorResult({
-                    mirror_id: validatedArgs.mirror_id,
-                    exam_id: validatedArgs.exam_id,
-                    input_json: validatedArgs.input_json,
-                });
-                let content = '## Prior Result\n\n';
-                content += `**Result ID:** ${response.id}\n`;
-                content += `**Date Performed:** ${response.datetime_performed}\n`;
-                content += `**Runtime Image:** ${response.runtime_image}\n`;
-                content += `**Match Type:** ${response.match_type}\n\n`;
-                content += '### Results\n\n```json\n';
-                content += JSON.stringify(response.results, null, 2);
-                content += '\n```\n';
-                return {
-                    content: [
-                        {
-                            type: 'text',
-                            text: content.trim(),
-                        },
-                    ],
-                };
-            }
-            catch (error) {
-                const message = error instanceof Error ? error.message : String(error);
-                // Handle "no prior result found" as a non-error case
-                if (message.includes('No prior result found')) {
-                    return {
-                        content: [
-                            {
-                                type: 'text',
-                                text: 'No prior result found for this mirror and exam combination.',
-                            },
-                        ],
-                    };
-                }
-                return {
-                    content: [
-                        {
-                            type: 'text',
-                            text: `Error getting prior result: ${message}`,
-                        },
-                    ],
-                    isError: true,
-                };
-            }
-        },
-    };
-}

package/shared/tools/save-result.d.ts

@@ -1,52 +0,0 @@
-import { Server } from '@modelcontextprotocol/sdk/server/index.js';
-import type { ClientFactory } from '../server.js';
-export declare function saveResult(_server: Server, clientFactory: ClientFactory): {
-    name: string;
-    description: string;
-    inputSchema: {
-        type: string;
-        properties: {
-            runtime_id: {
-                type: string;
-                description: "Runtime ID used for the exam, or \"__custom__\" if a custom Docker image was used.";
-            };
-            exam_id: {
-                type: string;
-                description: "Exam ID that was executed.";
-            };
-            mcp_server_slug: {
-                type: string;
-                description: "Slug of the MCP server that was tested.";
-            };
-            mirror_id: {
-                type: string;
-                description: "ID of the unofficial mirror associated with this test.";
-            };
-            results: {
-                oneOf: {
-                    type: string;
-                }[];
-                description: "Exam results as a JSON string or object. This is the full result from run_exam.";
-            };
-            custom_runtime_image: {
-                type: string;
-                description: "Required if runtime_id is \"__custom__\". The Docker image URL that was used.";
-            };
-        };
-        required: string[];
-    };
-    handler: (args: unknown) => Promise<{
-        content: {
-            type: string;
-            text: string;
-        }[];
-        isError: boolean;
-    } | {
-        content: {
-            type: string;
-            text: string;
-        }[];
-        isError?: undefined;
-    }>;
-};
-//# sourceMappingURL=save-result.d.ts.map

package/shared/tools/save-result.js

@@ -1,122 +0,0 @@
-import { z } from 'zod';
-// Parameter descriptions - single source of truth
-const PARAM_DESCRIPTIONS = {
-    runtime_id: 'Runtime ID used for the exam, or "__custom__" if a custom Docker image was used.',
-    exam_id: 'Exam ID that was executed.',
-    mcp_server_slug: 'Slug of the MCP server that was tested.',
-    mirror_id: 'ID of the unofficial mirror associated with this test.',
-    results: 'Exam results as a JSON string or object. This is the full result from run_exam.',
-    custom_runtime_image: 'Required if runtime_id is "__custom__". The Docker image URL that was used.',
-};
-const SaveResultSchema = z.object({
-    runtime_id: z.string().min(1).describe(PARAM_DESCRIPTIONS.runtime_id),
-    exam_id: z.string().min(1).describe(PARAM_DESCRIPTIONS.exam_id),
-    mcp_server_slug: z.string().min(1).describe(PARAM_DESCRIPTIONS.mcp_server_slug),
-    mirror_id: z.number().describe(PARAM_DESCRIPTIONS.mirror_id),
-    results: z.union([z.string(), z.record(z.unknown())]).describe(PARAM_DESCRIPTIONS.results),
-    custom_runtime_image: z.string().optional().describe(PARAM_DESCRIPTIONS.custom_runtime_image),
-});
-export function saveResult(_server, clientFactory) {
-    return {
-        name: 'save_result',
-        description: `Save exam results to the database for future comparison.
-
-Stores the results of a Proctor exam run so they can be retrieved later for
-comparison with new test runs.
-
-**Returns:**
-- success: boolean indicating if the save was successful
-- id: ID of the saved result record
-
-**Use cases:**
-- Persist exam results after running tests
-- Create a baseline for future comparisons
-- Track test history for an MCP server
-- Enable regression testing by comparing against prior results
-
-**Note:**
-- The mirror_id must be a valid unofficial mirror ID
-- Results should be the full output from run_exam
-- Custom runtime images require the custom_runtime_image parameter`,
-        inputSchema: {
-            type: 'object',
-            properties: {
-                runtime_id: {
-                    type: 'string',
-                    description: PARAM_DESCRIPTIONS.runtime_id,
-                },
-                exam_id: {
-                    type: 'string',
-                    description: PARAM_DESCRIPTIONS.exam_id,
-                },
-                mcp_server_slug: {
-                    type: 'string',
-                    description: PARAM_DESCRIPTIONS.mcp_server_slug,
-                },
-                mirror_id: {
-                    type: 'number',
-                    description: PARAM_DESCRIPTIONS.mirror_id,
-                },
-                results: {
-                    oneOf: [{ type: 'string' }, { type: 'object' }],
-                    description: PARAM_DESCRIPTIONS.results,
-                },
-                custom_runtime_image: {
-                    type: 'string',
-                    description: PARAM_DESCRIPTIONS.custom_runtime_image,
-                },
-            },
-            required: ['runtime_id', 'exam_id', 'mcp_server_slug', 'mirror_id', 'results'],
-        },
-        handler: async (args) => {
-            const validatedArgs = SaveResultSchema.parse(args);
-            // Validate custom runtime requirements
-            if (validatedArgs.runtime_id === '__custom__' && !validatedArgs.custom_runtime_image) {
-                return {
-                    content: [
-                        {
-                            type: 'text',
-                            text: 'Error: custom_runtime_image is required when runtime_id is "__custom__"',
-                        },
-                    ],
-                    isError: true,
-                };
-            }
-            const client = clientFactory();
-            try {
-                const response = await client.saveResult({
-                    runtime_id: validatedArgs.runtime_id,
-                    exam_id: validatedArgs.exam_id,
-                    mcp_server_slug: validatedArgs.mcp_server_slug,
-                    mirror_id: validatedArgs.mirror_id,
-                    results: validatedArgs.results,
-                    custom_runtime_image: validatedArgs.custom_runtime_image,
-                });
-                let content = '## Result Saved\n\n';
-                content += `**Success:** ${response.success}\n`;
-                content += `**Result ID:** ${response.id}\n\n`;
-                content +=
-                    'The exam result has been saved and can be retrieved for comparison using get_prior_result.';
-                return {
-                    content: [
-                        {
-                            type: 'text',
-                            text: content.trim(),
-                        },
-                    ],
-                };
-            }
-            catch (error) {
-                return {
-                    content: [
-                        {
-                            type: 'text',
-                            text: `Error saving result: ${error instanceof Error ? error.message : String(error)}`,
-                        },
-                    ],
-                    isError: true,
-                };
-            }
-        },
-    };
-}