@inspectr/mcplab 1.29.0 → 1.30.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (48) hide show
  1. package/README.md +22 -1
  2. package/dist/app/assets/index-8I9ZyPIK.js +243 -0
  3. package/dist/app/assets/index-jX7LoIQP.css +2 -0
  4. package/dist/app/index.html +2 -2
  5. package/dist/app-server/connection-test-routes.d.ts +8 -0
  6. package/dist/app-server/connection-test-routes.d.ts.map +1 -0
  7. package/dist/app-server/connection-test-routes.js +34 -0
  8. package/dist/app-server/connection-test-routes.js.map +1 -0
  9. package/dist/app-server/decision-routes.d.ts +8 -0
  10. package/dist/app-server/decision-routes.d.ts.map +1 -0
  11. package/dist/app-server/decision-routes.js +27 -0
  12. package/dist/app-server/decision-routes.js.map +1 -0
  13. package/dist/app-server/live-tests.d.ts +2 -5
  14. package/dist/app-server/live-tests.d.ts.map +1 -1
  15. package/dist/app-server/live-tests.js +21 -8
  16. package/dist/app-server/live-tests.js.map +1 -1
  17. package/dist/app-server/provider-models.d.ts +1 -6
  18. package/dist/app-server/provider-models.d.ts.map +1 -1
  19. package/dist/app-server/provider-models.js +11 -12
  20. package/dist/app-server/provider-models.js.map +1 -1
  21. package/dist/app-server/request-origin.d.ts +6 -0
  22. package/dist/app-server/request-origin.d.ts.map +1 -0
  23. package/dist/app-server/request-origin.js +61 -0
  24. package/dist/app-server/request-origin.js.map +1 -0
  25. package/dist/app-server/result-assistant-domain.d.ts +1 -1
  26. package/dist/app-server/router.d.ts +0 -2
  27. package/dist/app-server/router.d.ts.map +1 -1
  28. package/dist/app-server/router.js +57 -57
  29. package/dist/app-server/router.js.map +1 -1
  30. package/dist/app-server/run-queue-executor.d.ts +2 -14
  31. package/dist/app-server/run-queue-executor.d.ts.map +1 -1
  32. package/dist/app-server/run-queue-executor.js +7 -16
  33. package/dist/app-server/run-queue-executor.js.map +1 -1
  34. package/dist/app-server/runs-routes.d.ts.map +1 -1
  35. package/dist/app-server/runs-routes.js +15 -14
  36. package/dist/app-server/runs-routes.js.map +1 -1
  37. package/dist/app-server/scenario-assistant-domain.d.ts +1 -1
  38. package/dist/app-server/settings-store.d.ts +3 -7
  39. package/dist/app-server/settings-store.d.ts.map +1 -1
  40. package/dist/app-server/settings-store.js +33 -15
  41. package/dist/app-server/settings-store.js.map +1 -1
  42. package/dist/app-server/types.d.ts +2 -3
  43. package/dist/app-server/types.d.ts.map +1 -1
  44. package/dist/cli.js +4 -5
  45. package/dist/cli.js.map +1 -1
  46. package/package.json +4 -4
  47. package/dist/app/assets/index-256LN2cO.css +0 -2
  48. package/dist/app/assets/index-DVIaEnjQ.js +0 -243
package/README.md CHANGED
@@ -55,7 +55,7 @@ See the [Rover Browser Agents guide](https://mcplab.inspectr.dev/docs/app/rover/
55
55
 
56
56
  ### Core Capabilities
57
57
  - **HTTP SSE Transport** - Test MCP servers over Streamable HTTP
58
- - **Multi-LLM Support** - OpenAI, Anthropic Claude, Azure OpenAI
58
+ - **Multi-LLM Support** - OpenAI, Anthropic Claude, Azure OpenAI, Azure Foundry
59
59
  - **Browser Agents** - Run evaluations in browser chats through the MCPLab Rover extension
60
60
  - **Rich Assertions** - Validate tool usage, sequences, and response content
61
61
  - **Variance Testing** - Run multiple iterations to measure stability
@@ -268,6 +268,26 @@ agents:
268
268
  system: "You are a helpful assistant."
269
269
  ```
270
270
 
271
+ The legacy Azure OpenAI provider uses `AZURE_OPENAI_DEPLOYMENT` at runtime. Existing configurations retain this behavior.
272
+
273
+ **Azure Foundry:**
274
+
275
+ ```yaml
276
+ agents:
277
+ - id: foundry-agent
278
+ provider: azure_foundry
279
+ model: my-chat-deployment
280
+ max_tokens: 2048
281
+ ```
282
+
283
+ Each Foundry agent uses its own `model` value as the deployment name. Configure `AZURE_FOUNDRY_ENDPOINT` with the resource endpoint, such as `https://your-resource.services.ai.azure.com`, and `AZURE_FOUNDRY_API_KEY` on the backend. If the dedicated key is absent, MCPLab uses `AZURE_OPENAI_API_KEY`; that key must belong to the same resource. The endpoint remains explicit. Restart MCPLab after changing environment variables.
284
+
285
+ In **Libraries → Agents**, choose **Azure Foundry**, enter the deployment name, and save. **Test Connection** sends a small inference request using the current provider and deployment, even before saving a new agent. It uses a 30-second timeout and clears or cancels the test when the draft changes. Success confirms basic inference access; it does not establish support for every tool or structured-output capability.
286
+
287
+ Optional `AZURE_FOUNDRY_DEPLOYMENTS` contains comma-separated deployment suggestions. **Load configured deployments** reads this backend environment variable and does not query Azure. Manual entry works without suggestions. Foundry agents can be selected for evaluation runs, assistants, or the Evaluation Judge. Decision Engine deployment and threshold settings remain independent.
288
+
289
+ V1 supports API-key authentication and deployments compatible with Foundry's `/openai/v1/chat/completions` API through the existing OpenAI SDK. Microsoft-Decision-1 uses the separate Decision Engine setting. Entra authentication, Responses API, and native Anthropic endpoints are outside this integration. See [Microsoft's v1 API documentation](https://learn.microsoft.com/en-us/azure/foundry/openai/api-version-lifecycle).
290
+
271
291
  **Browser agents (Rover):**
272
292
 
273
293
  Define a reusable browser agent in `mcplab/agents.yaml`:
@@ -294,6 +314,7 @@ Use `claude` for Claude, `chatgpt-com` for ChatGPT, or the id of a learned provi
294
314
  - Anthropic: `ANTHROPIC_API_KEY`
295
315
  - OpenAI: `OPENAI_API_KEY`
296
316
  - Azure: `AZURE_OPENAI_ENDPOINT`, `AZURE_OPENAI_API_KEY`, `AZURE_OPENAI_DEPLOYMENT`
317
+ - Azure Foundry: `AZURE_FOUNDRY_ENDPOINT`, `AZURE_FOUNDRY_API_KEY` (or `AZURE_OPENAI_API_KEY` for the same resource)
297
318
 
298
319
  ### Scenarios
299
320