@iris-eval/mcp-server 0.5.0 → 0.5.1

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (28) hide show
  1. package/README.md +4 -3
  2. package/dist/dashboard/assets/index-VI_nbMfN.js +10 -0
  3. package/dist/dashboard/index.html +1 -1
  4. package/dist/dashboard/routes/traces.js +9 -0
  5. package/dist/dashboard/seed-demo-data.js +3 -3
  6. package/dist/eval/citation-verify/verifier.d.ts +17 -0
  7. package/dist/eval/citation-verify/verifier.js +68 -15
  8. package/dist/eval/decision-moment.js +17 -9
  9. package/dist/eval/engine.js +32 -0
  10. package/dist/eval/llm-judge/evaluator.js +50 -33
  11. package/dist/eval/llm-judge/templates/index.d.ts +4 -0
  12. package/dist/eval/llm-judge/templates/index.js +10 -4
  13. package/dist/eval/rules/custom.js +59 -6
  14. package/dist/eval/rules/relevance.js +1 -1
  15. package/dist/eval/rules/safety.js +20 -7
  16. package/dist/storage/migrations/006-eval-critical-failures.d.ts +3 -0
  17. package/dist/storage/migrations/006-eval-critical-failures.js +23 -0
  18. package/dist/storage/migrations/index.js +2 -0
  19. package/dist/storage/sqlite-adapter.js +19 -3
  20. package/dist/tools/evaluate-output.js +15 -8
  21. package/dist/tools/evaluate-with-llm-judge.js +1 -1
  22. package/dist/tools/log-trace.js +1 -1
  23. package/dist/tools/verify-citations.js +1 -1
  24. package/dist/types/decision-moment.d.ts +8 -0
  25. package/dist/types/eval.d.ts +15 -0
  26. package/package.json +1 -1
  27. package/server.json +2 -2
  28. package/dist/dashboard/assets/index-BZZt8bVh.js +0 -10
package/README.md CHANGED
@@ -172,8 +172,9 @@ Iris is a standard stdio MCP server — one `npx @iris-eval/mcp-server` command,
172
172
  npm install -g @iris-eval/mcp-server
173
173
  iris-mcp --dashboard
174
174
 
175
- # Docker
176
- docker run -p 3000:3000 -v iris-data:/data ghcr.io/iris-eval/mcp-server
175
+ # Docker — two servers, two ports: 3000 = MCP HTTP transport,
176
+ # 6920 = dashboard (which also serves the POST /api/v1/traces ingest endpoint)
177
+ docker run -p 3000:3000 -p 6920:6920 -v iris-data:/data ghcr.io/iris-eval/mcp-server
177
178
  ```
178
179
 
179
180
  > **Tip:** Global install (`npm install -g`) stores traces persistently at `~/.iris/iris.db`. With `npx`, traces persist in the same location, but startup is slower due to package resolution.
@@ -287,7 +288,7 @@ When using HTTP transport, Iris includes:
287
288
 
288
289
  - API key authentication with timing-safe comparison
289
290
  - CORS restricted to localhost by default
290
- - Rate limiting (100 req/min API, 20 req/min MCP)
291
+ - Rate limiting (600 req/min dashboard API, 20 req/min MCP)
291
292
  - Helmet security headers
292
293
  - Zod input validation on all routes
293
294
  - ReDoS-safe regex for custom eval rules