@kryptosai/mcp-observatory 1.32.0 → 1.32.1

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (117) hide show
  1. package/README.md +4 -10
  2. package/README.zh-CN.md +4 -10
  3. package/dist/src/cli.js +1 -1
  4. package/dist/src/cli.js.map +1 -1
  5. package/dist/src/commands/enforce.d.ts +2 -2
  6. package/dist/src/commands/enforce.js +5 -8
  7. package/dist/src/commands/enforce.js.map +1 -1
  8. package/dist/src/commands/scan.js.map +1 -1
  9. package/dist/src/commands/test.js +2 -2
  10. package/dist/src/commands/test.js.map +1 -1
  11. package/dist/src/telemetry.js +2 -1
  12. package/dist/src/telemetry.js.map +1 -1
  13. package/dist/src/validate.js +5 -6
  14. package/dist/src/validate.js.map +1 -1
  15. package/docs/mcp-server-safety-index.md +68 -8
  16. package/docs/safety-index/artifacts/antv-chart-server.json +1452 -19
  17. package/docs/safety-index/artifacts/antv-chart-server.md +156 -10
  18. package/docs/safety-index/artifacts/brave-search-server.json +341 -0
  19. package/docs/safety-index/artifacts/brave-search-server.md +201 -0
  20. package/docs/safety-index/artifacts/browsermcp-server.json +83 -18
  21. package/docs/safety-index/artifacts/browsermcp-server.md +46 -12
  22. package/docs/safety-index/artifacts/chrome-devtools-mcp-server.json +592 -21
  23. package/docs/safety-index/artifacts/chrome-devtools-mcp-server.md +96 -14
  24. package/docs/safety-index/artifacts/clay-server.json +66 -0
  25. package/docs/safety-index/artifacts/clay-server.md +106 -0
  26. package/docs/safety-index/artifacts/cloudflare-server.json +66 -0
  27. package/docs/safety-index/artifacts/cloudflare-server.md +106 -0
  28. package/docs/safety-index/artifacts/context7-server.json +85 -18
  29. package/docs/safety-index/artifacts/context7-server.md +52 -11
  30. package/docs/safety-index/artifacts/cyanheads-git-mcp-server.json +1565 -34
  31. package/docs/safety-index/artifacts/cyanheads-git-mcp-server.md +178 -17
  32. package/docs/safety-index/artifacts/docker-server.json +395 -0
  33. package/docs/safety-index/artifacts/docker-server.md +204 -0
  34. package/docs/safety-index/artifacts/everything-server.json +145 -18
  35. package/docs/safety-index/artifacts/everything-server.md +56 -11
  36. package/docs/safety-index/artifacts/exa-server.json +400 -0
  37. package/docs/safety-index/artifacts/exa-server.md +207 -0
  38. package/docs/safety-index/artifacts/executeautomation-playwright-server.json +625 -18
  39. package/docs/safety-index/artifacts/executeautomation-playwright-server.md +95 -11
  40. package/docs/safety-index/artifacts/fetch-server.json +66 -0
  41. package/docs/safety-index/artifacts/fetch-server.md +106 -0
  42. package/docs/safety-index/artifacts/figma-server.json +1766 -0
  43. package/docs/safety-index/artifacts/figma-server.md +256 -0
  44. package/docs/safety-index/artifacts/filesystem-mcp-server.json +428 -24
  45. package/docs/safety-index/artifacts/filesystem-mcp-server.md +75 -14
  46. package/docs/safety-index/artifacts/filesystem-server.json +426 -22
  47. package/docs/safety-index/artifacts/filesystem-server.md +73 -12
  48. package/docs/safety-index/artifacts/firecrawl-server.json +4056 -0
  49. package/docs/safety-index/artifacts/firecrawl-server.md +243 -0
  50. package/docs/safety-index/artifacts/github-mcp-server.json +374 -21
  51. package/docs/safety-index/artifacts/github-mcp-server.md +71 -15
  52. package/docs/safety-index/artifacts/gitlab-server.json +229 -0
  53. package/docs/safety-index/artifacts/gitlab-server.md +753 -0
  54. package/docs/safety-index/artifacts/gmail-server.json +66 -0
  55. package/docs/safety-index/artifacts/gmail-server.md +106 -0
  56. package/docs/safety-index/artifacts/google-calendar-server.json +66 -0
  57. package/docs/safety-index/artifacts/google-calendar-server.md +106 -0
  58. package/docs/safety-index/artifacts/google-drive-server.json +66 -0
  59. package/docs/safety-index/artifacts/google-drive-server.md +106 -0
  60. package/docs/safety-index/artifacts/google-sheets-server.json +66 -0
  61. package/docs/safety-index/artifacts/google-sheets-server.md +106 -0
  62. package/docs/safety-index/artifacts/google-tasks-server.json +66 -0
  63. package/docs/safety-index/artifacts/google-tasks-server.md +106 -0
  64. package/docs/safety-index/artifacts/huggingface-server.json +66 -0
  65. package/docs/safety-index/artifacts/huggingface-server.md +106 -0
  66. package/docs/safety-index/artifacts/jina-server.json +66 -0
  67. package/docs/safety-index/artifacts/jina-server.md +106 -0
  68. package/docs/safety-index/artifacts/kubernetes-server.json +1054 -27
  69. package/docs/safety-index/artifacts/kubernetes-server.md +137 -18
  70. package/docs/safety-index/artifacts/linear-server.json +1494 -0
  71. package/docs/safety-index/artifacts/linear-server.md +237 -0
  72. package/docs/safety-index/artifacts/memory-server.json +191 -18
  73. package/docs/safety-index/artifacts/memory-server.md +51 -9
  74. package/docs/safety-index/artifacts/mongodb-server.json +66 -0
  75. package/docs/safety-index/artifacts/mongodb-server.md +106 -0
  76. package/docs/safety-index/artifacts/neon-server.json +66 -0
  77. package/docs/safety-index/artifacts/neon-server.md +103 -0
  78. package/docs/safety-index/artifacts/notion-server.json +7151 -0
  79. package/docs/safety-index/artifacts/notion-server.md +236 -0
  80. package/docs/safety-index/artifacts/onesignal-server.json +66 -0
  81. package/docs/safety-index/artifacts/onesignal-server.md +106 -0
  82. package/docs/safety-index/artifacts/opentofu-server.json +31 -19
  83. package/docs/safety-index/artifacts/opentofu-server.md +28 -10
  84. package/docs/safety-index/artifacts/playwright-mcp-server.json +415 -24
  85. package/docs/safety-index/artifacts/playwright-mcp-server.md +84 -20
  86. package/docs/safety-index/artifacts/postgres-server.json +330 -0
  87. package/docs/safety-index/artifacts/postgres-server.md +208 -0
  88. package/docs/safety-index/artifacts/promptopia-server.json +96 -19
  89. package/docs/safety-index/artifacts/promptopia-server.md +43 -9
  90. package/docs/safety-index/artifacts/puppeteer-server.json +118 -29
  91. package/docs/safety-index/artifacts/puppeteer-server.md +61 -19
  92. package/docs/safety-index/artifacts/qdrant-server.json +66 -0
  93. package/docs/safety-index/artifacts/qdrant-server.md +106 -0
  94. package/docs/safety-index/artifacts/reddit-server.json +66 -0
  95. package/docs/safety-index/artifacts/reddit-server.md +106 -0
  96. package/docs/safety-index/artifacts/ref-tools-server.json +95 -18
  97. package/docs/safety-index/artifacts/ref-tools-server.md +45 -12
  98. package/docs/safety-index/artifacts/sentry-server.json +66 -0
  99. package/docs/safety-index/artifacts/sentry-server.md +106 -0
  100. package/docs/safety-index/artifacts/sequential-thinking-server.json +59 -18
  101. package/docs/safety-index/artifacts/sequential-thinking-server.md +41 -9
  102. package/docs/safety-index/artifacts/slack-server.json +66 -0
  103. package/docs/safety-index/artifacts/slack-server.md +102 -0
  104. package/docs/safety-index/artifacts/sqlite-server.json +67 -0
  105. package/docs/safety-index/artifacts/sqlite-server.md +106 -0
  106. package/docs/safety-index/artifacts/stripe-server.json +66 -0
  107. package/docs/safety-index/artifacts/stripe-server.md +106 -0
  108. package/docs/safety-index/artifacts/supabase-server.json +66 -0
  109. package/docs/safety-index/artifacts/supabase-server.md +102 -0
  110. package/docs/safety-index/artifacts/tavily-search-server.json +66 -0
  111. package/docs/safety-index/artifacts/tavily-search-server.md +106 -0
  112. package/docs/safety-index/artifacts/ui5-mcp-server.json +24 -24
  113. package/docs/safety-index/artifacts/ui5-mcp-server.md +13 -13
  114. package/docs/safety-index/artifacts/vercel-ai-server.json +66 -0
  115. package/docs/safety-index/artifacts/vercel-ai-server.md +106 -0
  116. package/docs/safety-index/targets.json +535 -0
  117. package/package.json +1 -1
@@ -1,6 +1,6 @@
1
1
  # MCP Observatory Run Report
2
2
 
3
- Generated at 2026-07-07T03:17:28.113Z
3
+ Generated at 2026-07-12T23:44:15.494Z
4
4
 
5
5
  ## Target and Environment Metadata
6
6
 
@@ -8,8 +8,8 @@ Generated at 2026-07-07T03:17:28.113Z
8
8
  - Adapter: `local-process`
9
9
  - Command: `npx -y chrome-devtools-mcp`
10
10
  - Server: `chrome_devtools 1.5.0`
11
- - Platform: `darwin 24.0.0`
12
- - Node: `v25.8.1`
11
+ - Platform: `darwin 25.5.0`
12
+ - Node: `v22.22.1`
13
13
 
14
14
  ## Executive Summary
15
15
 
@@ -25,20 +25,89 @@ Generated at 2026-07-07T03:17:28.113Z
25
25
 
26
26
  | Gate | Total | Pass | Fail | Partial | Unsupported | Flaky | Skipped |
27
27
  | --- | --- | --- | --- | --- | --- | --- | --- |
28
- | fail | 8 | 2 | 2 | 2 | 2 | 0 | 0 |
28
+ | fail | 9 | 2 | 2 | 3 | 2 | 0 | 0 |
29
29
 
30
30
  ## At a Glance
31
31
 
32
32
  - Safety verdict: **Blocked** — One or more checks can break agent dependence and should be fixed before production use.
33
- - Top risks: attack-sim: Safe attack simulation found 9 finding(s): 0 high, 9 medium, 0 low.; schema-quality: Found 10 quality finding(s) across 29 item(s): 0 warnings, 10 info.; security: Found 30 security finding(s): 1 high, 7 medium, 22 low.
33
+ - Top risks: attack-sim: Safe attack simulation found 9 finding(s): 0 high, 9 medium, 0 low.; runtime-profile: Detected 9 potential egress target(s) and 36 potential state mutation(s) with high confidence.; schema-quality: Found 10 quality finding(s) across 29 item(s): 0 warnings, 10 info.
34
34
  - Regression/schema drift: Run `mcp-observatory diff <previous-run.json> <current-run.json>` to classify regressions and schema drift.
35
35
  - Failing checks: security-lite, security
36
- - Partial or flaky checks: schema-quality, attack-sim
36
+ - Partial or flaky checks: runtime-profile, schema-quality, attack-sim
37
37
  - Skipped checks: none
38
38
  - Unsupported checks: prompts, resources
39
39
  - Suggested next step: Start with the failing checks: security-lite, security.
40
40
  - CI next step: `Add CI: npx @kryptosai/mcp-observatory setup-ci --all --command "npx -y <server-package>"`
41
41
 
42
+ ## What Was Not Tested
43
+
44
+ - 🔒 filesystem_mutation: Filesystem write operations were not exercised
45
+ - â„šī¸ credential_access: Credential scanning was performed (see security findings)
46
+ - â„šī¸ destructive_payloads: Destructive payloads were not attempted (safe-mode only)
47
+
48
+ ## Runtime Profile
49
+
50
+ ### Egress Manifest
51
+
52
+ The following targets were identified as potentially reachable by this server (confidence: **high**):
53
+
54
+ | Target | Protocol | Source | Confidence |
55
+ | --- | --- | --- | --- |
56
+ | Extra HTTP headers as a JSON string object, e.g. {"X-Custom": "value", "Authorization": "Bearer token"}. Headers are included into every HTTP request originating from the page and persist across navigations until cleared. Pass an empty string to clear all extra headers. | unknown | description_analysis | medium |
57
+ | url | unknown | tool_schema | high |
58
+ | Navigate the page by URL, back or forward in history, or reload. | unknown | description_analysis | medium |
59
+ | Target URL (only type=url) | unknown | description_analysis | medium |
60
+ | navigate_page | unknown | description_analysis | low |
61
+ | url | unknown | tool_schema | high |
62
+ | URL to load in a new page. | unknown | description_analysis | medium |
63
+ | new_page | unknown | description_analysis | low |
64
+ | Determines if, once tracing has started, the current selected page should be automatically reloaded. Navigate the page to the right URL using the navigate_page tool BEFORE starting the trace if reload or autoStop is set to true. | unknown | description_analysis | medium |
65
+
66
+ ### State Mutations
67
+
68
+ The following state-modifying operations were identified from tool schemas:
69
+
70
+ | Resource | Operation | Scope | Source |
71
+ | --- | --- | --- | --- |
72
+ | filesystem | write | working_directory | description_analysis |
73
+ | filesystem | write | working_directory | description_analysis |
74
+ | filesystem | write | working_directory | description_analysis |
75
+ | filesystem | write | working_directory | description_analysis |
76
+ | filesystem | write | working_directory | tool_schema |
77
+ | filesystem | write | working_directory | description_analysis |
78
+ | filesystem | write | working_directory | description_analysis |
79
+ | filesystem | write | working_directory | description_analysis |
80
+ | filesystem | write | working_directory | description_analysis |
81
+ | filesystem | write | working_directory | description_analysis |
82
+ | filesystem | write | working_directory | description_analysis |
83
+ | filesystem | write | working_directory | description_analysis |
84
+ | filesystem | write | working_directory | description_analysis |
85
+ | filesystem | write | working_directory | description_analysis |
86
+ | filesystem | write | working_directory | description_analysis |
87
+ | filesystem | write | working_directory | description_analysis |
88
+ | filesystem | write | working_directory | description_analysis |
89
+ | filesystem | write | working_directory | tool_schema |
90
+ | filesystem | write | working_directory | description_analysis |
91
+ | filesystem | write | working_directory | description_analysis |
92
+ | filesystem | write | working_directory | tool_schema |
93
+ | filesystem | write | working_directory | description_analysis |
94
+ | filesystem | write | working_directory | tool_schema |
95
+ | filesystem | write | working_directory | description_analysis |
96
+ | filesystem | write | working_directory | tool_schema |
97
+ | filesystem | write | working_directory | description_analysis |
98
+ | filesystem | write | working_directory | description_analysis |
99
+ | filesystem | write | working_directory | description_analysis |
100
+ | filesystem | write | working_directory | description_analysis |
101
+ | filesystem | write | working_directory | tool_schema |
102
+ | filesystem | write | working_directory | description_analysis |
103
+ | filesystem | write | working_directory | tool_schema |
104
+ | filesystem | write | working_directory | description_analysis |
105
+ | filesystem | write | working_directory | description_analysis |
106
+ | filesystem | write | working_directory | description_analysis |
107
+ | filesystem | write | working_directory | description_analysis |
108
+
109
+ _Analyzed at 2026-07-12T23:44:16.468Z_
110
+
42
111
  ## Regressions and Recoveries
43
112
 
44
113
  _Use the `diff` command against another run artifact to classify regressions and recoveries over time._
@@ -47,14 +116,15 @@ _Use the `diff` command against another run artifact to classify regressions and
47
116
 
48
117
  | Focus | Check | Status | Duration (ms) | Message |
49
118
  | --- | --- | --- | --- | --- |
50
- | healthy | conformance | pass | 961.11 | All 7 conformance checks passed. |
51
- | healthy | tools | pass | 4.25 | Advertised capability responded with the minimal expected shape (29 items). |
52
- | review | attack-sim | partial | 1.11 | Safe attack simulation found 9 finding(s): 0 high, 9 medium, 0 low. |
53
- | review | schema-quality | partial | 0.91 | Found 10 quality finding(s) across 29 item(s): 0 warnings, 10 info. |
119
+ | healthy | conformance | pass | 585.52 | All 7 conformance checks passed. |
120
+ | healthy | tools | pass | 3.24 | Advertised capability responded with the minimal expected shape (29 items). |
121
+ | review | attack-sim | partial | 0.96 | Safe attack simulation found 9 finding(s): 0 high, 9 medium, 0 low. |
122
+ | review | runtime-profile | partial | 0.30 | Detected 9 potential egress target(s) and 36 potential state mutation(s) with high confidence. |
123
+ | review | schema-quality | partial | 1.03 | Found 10 quality finding(s) across 29 item(s): 0 warnings, 10 info. |
54
124
  | confirm intent | prompts | unsupported | 0.00 | Prompts are not advertised by the target. |
55
- | confirm intent | resources | unsupported | 0.01 | Resources are not advertised by the target. |
56
- | act now | security | fail | 0.75 | Found 30 security finding(s): 1 high, 7 medium, 22 low. |
57
- | act now | security-lite | fail | 0.13 | Found 30 security finding(s): 1 high, 7 medium, 22 low. |
125
+ | confirm intent | resources | unsupported | 0.00 | Resources are not advertised by the target. |
126
+ | act now | security | fail | 0.82 | Found 30 security finding(s): 1 high, 7 medium, 22 low. |
127
+ | act now | security-lite | fail | 0.08 | Found 30 security finding(s): 1 high, 7 medium, 22 low. |
58
128
 
59
129
  ## Evidence Snippets
60
130
 
@@ -94,6 +164,18 @@ Summary: Safe attack simulation found 9 finding(s): 0 high, 9 medium, 0 low.
94
164
  - Identifiers: evaluate_script, navigate_page, new_page, performance_start_trace, performance_stop_trace (+4 more)
95
165
  - Diagnostics: [medium] Tool "evaluate_script" combines broad parameters (filePath) with destructive or non-read-only behavior., [medium] Tool "navigate_page" combines broad parameters (url) with destructive or non-read-only behavior., [medium] Tool "new_page" combines broad parameters (url) with destructive or non-read-only behavior. (+6 more)
96
166
 
167
+ ### runtime-profile — partial
168
+
169
+ Summary: Detected 9 potential egress target(s) and 36 potential state mutation(s) with high confidence.
170
+
171
+ - Endpoint: `runtime-profile/analyze`
172
+ - Advertised: `true`
173
+ - Responded: `true`
174
+ - Minimal shape present: `true`
175
+ - Item count: `45`
176
+ - Identifiers: none
177
+ - Diagnostics: Egress entries: 9, State mutations: 36, Confidence: high
178
+
97
179
  ### schema-quality — partial
98
180
 
99
181
  Summary: Found 10 quality finding(s) across 29 item(s): 0 warnings, 10 info.
@@ -165,5 +247,5 @@ npm run cli -- report --run <path-to-run-artifact.json> --format markdown
165
247
 
166
248
  - Artifact type: `run`
167
249
  - Schema version: `1.0.0`
168
- - Run ID: `run_2026-07-07T031728113Z_b22904e8`
250
+ - Run ID: `run_2026-07-12T234415494Z_abf0d9f2`
169
251
  - Gate: `fail`
@@ -0,0 +1,66 @@
1
+ {
2
+ "artifactType": "run",
3
+ "schemaVersion": "1.0.0",
4
+ "gate": "fail",
5
+ "runId": "run_2026-07-12T234436895Z_9fe95c8f",
6
+ "createdAt": "2026-07-12T23:44:36.895Z",
7
+ "toolVersion": "1.31.0",
8
+ "target": {
9
+ "targetId": "clay-server",
10
+ "adapter": "local-process",
11
+ "command": "npx",
12
+ "args": [
13
+ "-y",
14
+ "@anthropic/mcp-server-clay"
15
+ ],
16
+ "cwd": ".",
17
+ "metadata": {
18
+ "package": "@anthropic/mcp-server-clay",
19
+ "purpose": "mcp-safety-index",
20
+ "riskClass": "CRM data access",
21
+ "failureClass": "Contact/relationship boundary",
22
+ "whyItMatters": "Clay MCP servers can access contact data, enrichment, and relationship intelligence — agents could read or modify CRM records with personal and business contact data."
23
+ }
24
+ },
25
+ "environment": {
26
+ "platform": "darwin 25.5.0",
27
+ "nodeVersion": "v22.22.1"
28
+ },
29
+ "summary": {
30
+ "total": 3,
31
+ "pass": 0,
32
+ "fail": 0,
33
+ "partial": 0,
34
+ "unsupported": 0,
35
+ "flaky": 0,
36
+ "skipped": 3,
37
+ "gate": "fail"
38
+ },
39
+ "checks": [
40
+ {
41
+ "id": "tools",
42
+ "capability": "tools",
43
+ "status": "skipped",
44
+ "durationMs": 0,
45
+ "message": "Skipped because startup failed before the MCP session initialized. See the failure diagnosis.",
46
+ "evidence": []
47
+ },
48
+ {
49
+ "id": "prompts",
50
+ "capability": "prompts",
51
+ "status": "skipped",
52
+ "durationMs": 0,
53
+ "message": "Skipped because startup failed before the MCP session initialized. See the failure diagnosis.",
54
+ "evidence": []
55
+ },
56
+ {
57
+ "id": "resources",
58
+ "capability": "resources",
59
+ "status": "skipped",
60
+ "durationMs": 0,
61
+ "message": "Skipped because startup failed before the MCP session initialized. See the failure diagnosis.",
62
+ "evidence": []
63
+ }
64
+ ],
65
+ "fatalError": "Could not establish a plain stdio MCP session for target `clay-server`.\nCommand: npx -y @anthropic/mcp-server-clay\nDiagnosis: The process exited or detached before MCP initialization completed.\nRaw error: MCP error -32000: Connection closed\nLikely causes:\n- The package may expect extra startup arguments or environment variables.\n- The package may not behave like a plain local-process stdio target under this invocation.\n- The server may be crashing immediately and only leaving clues on stderr.\nNext steps:\n- Run the command manually and look for usage output, auth prompts, or crash text.\n- Check whether the package expects a different transport or an app-oriented startup flow.\n- Use the recent stderr lines below before assuming this is a harness bug.\nRecent stderr:\n- npm error 404 '@anthropic/mcp-server-clay@*' is not in this registry.\n- npm error 404\n- npm error 404 Note that you can also install from a\n- npm error 404 tarball, folder, http url, or git url.\n- npm error A complete log of this run can be found in: /Users/williamweishuhn/.npm/_logs/2026-07-12T23_44_36_970Z-debug-0.log"
66
+ }
@@ -0,0 +1,106 @@
1
+ # MCP Observatory Run Report
2
+
3
+ Generated at 2026-07-12T23:44:36.895Z
4
+
5
+ ## Target and Environment Metadata
6
+
7
+ - Target: `clay-server`
8
+ - Adapter: `local-process`
9
+ - Command: `npx -y @anthropic/mcp-server-clay`
10
+ - Server: `unknown `
11
+ - Platform: `darwin 25.5.0`
12
+ - Node: `v22.22.1`
13
+
14
+ ## Executive Summary
15
+
16
+ | Gate | Total | Pass | Fail | Partial | Unsupported | Flaky | Skipped |
17
+ | --- | --- | --- | --- | --- | --- | --- | --- |
18
+ | fail | 3 | 0 | 0 | 0 | 0 | 0 | 3 |
19
+
20
+ ## At a Glance
21
+
22
+ - Safety verdict: **Blocked** — One or more checks can break agent dependence and should be fixed before production use.
23
+ - Top risks: startup: server failed to start
24
+ - Regression/schema drift: Run `mcp-observatory diff <previous-run.json> <current-run.json>` to classify regressions and schema drift.
25
+ - Failing checks: none
26
+ - Partial or flaky checks: none
27
+ - Skipped checks: tools, prompts, resources
28
+ - Unsupported checks: none
29
+ - Suggested next step: Run the target command manually, compare stderr with the diagnosis below, and only raise timeoutMs if startup is genuinely slow.
30
+ - CI next step: `Add CI: npx @kryptosai/mcp-observatory setup-ci --all --command "npx -y <server-package>"`
31
+
32
+ ## What Was Not Tested
33
+
34
+ - 🔒 network_egress: No outbound network calls were attempted during scan
35
+ - 🔒 filesystem_mutation: Filesystem write operations were not exercised
36
+ - 🔒 credential_access: Credential scanning was not performed
37
+ - â„šī¸ destructive_payloads: Destructive payloads were not attempted (safe-mode only)
38
+
39
+ ## Regressions and Recoveries
40
+
41
+ _Use the `diff` command against another run artifact to classify regressions and recoveries over time._
42
+
43
+ ## Failure Diagnosis
44
+
45
+ ```text
46
+ Could not establish a plain stdio MCP session for target `clay-server`.
47
+ Command: npx -y @anthropic/mcp-server-clay
48
+ Diagnosis: The process exited or detached before MCP initialization completed.
49
+ Raw error: MCP error -32000: Connection closed
50
+ Likely causes:
51
+ - The package may expect extra startup arguments or environment variables.
52
+ - The package may not behave like a plain local-process stdio target under this invocation.
53
+ - The server may be crashing immediately and only leaving clues on stderr.
54
+ Next steps:
55
+ - Run the command manually and look for usage output, auth prompts, or crash text.
56
+ - Check whether the package expects a different transport or an app-oriented startup flow.
57
+ - Use the recent stderr lines below before assuming this is a harness bug.
58
+ Recent stderr:
59
+ - npm error 404 '@anthropic/mcp-server-clay@*' is not in this registry.
60
+ - npm error 404
61
+ - npm error 404 Note that you can also install from a
62
+ - npm error 404 tarball, folder, http url, or git url.
63
+ - npm error A complete log of this run can be found in: /Users/williamweishuhn/.npm/_logs/2026-07-12T23_44_36_970Z-debug-0.log
64
+ ```
65
+
66
+ ## Full Capability Status Table
67
+
68
+ | Focus | Check | Status | Duration (ms) | Message |
69
+ | --- | --- | --- | --- | --- |
70
+ | inspect startup | prompts | skipped | 0.00 | Skipped because startup failed before the MCP session initialized. See the failure diagnosis. |
71
+ | inspect startup | resources | skipped | 0.00 | Skipped because startup failed before the MCP session initialized. See the failure diagnosis. |
72
+ | inspect startup | tools | skipped | 0.00 | Skipped because startup failed before the MCP session initialized. See the failure diagnosis. |
73
+
74
+ ## Evidence Snippets
75
+
76
+ ### prompts — skipped
77
+
78
+ Summary: Skipped because startup failed before the MCP session initialized. See the failure diagnosis.
79
+
80
+ _No evidence was captured._
81
+
82
+ ### resources — skipped
83
+
84
+ Summary: Skipped because startup failed before the MCP session initialized. See the failure diagnosis.
85
+
86
+ _No evidence was captured._
87
+
88
+ ### tools — skipped
89
+
90
+ Summary: Skipped because startup failed before the MCP session initialized. See the failure diagnosis.
91
+
92
+ _No evidence was captured._
93
+
94
+ ## Reproduction Commands
95
+
96
+ ```bash
97
+ npm run cli -- run --target <path-to-target-config.json>
98
+ npm run cli -- report --run <path-to-run-artifact.json> --format markdown
99
+ ```
100
+
101
+ ## Artifact Provenance
102
+
103
+ - Artifact type: `run`
104
+ - Schema version: `1.0.0`
105
+ - Run ID: `run_2026-07-12T234436895Z_9fe95c8f`
106
+ - Gate: `fail`
@@ -0,0 +1,66 @@
1
+ {
2
+ "artifactType": "run",
3
+ "schemaVersion": "1.0.0",
4
+ "gate": "fail",
5
+ "runId": "run_2026-07-12T234418955Z_402aece3",
6
+ "createdAt": "2026-07-12T23:44:18.955Z",
7
+ "toolVersion": "1.31.0",
8
+ "target": {
9
+ "targetId": "cloudflare-server",
10
+ "adapter": "local-process",
11
+ "command": "npx",
12
+ "args": [
13
+ "-y",
14
+ "@anthropic/mcp-server-cloudflare"
15
+ ],
16
+ "cwd": ".",
17
+ "metadata": {
18
+ "package": "@anthropic/mcp-server-cloudflare",
19
+ "purpose": "mcp-safety-index",
20
+ "riskClass": "Infrastructure control",
21
+ "failureClass": "DNS/worker/deployment boundary",
22
+ "whyItMatters": "Cloudflare MCP servers can expose DNS records, Workers, KV stores, and deployment pipelines to agents."
23
+ }
24
+ },
25
+ "environment": {
26
+ "platform": "darwin 25.5.0",
27
+ "nodeVersion": "v22.22.1"
28
+ },
29
+ "summary": {
30
+ "total": 3,
31
+ "pass": 0,
32
+ "fail": 0,
33
+ "partial": 0,
34
+ "unsupported": 0,
35
+ "flaky": 0,
36
+ "skipped": 3,
37
+ "gate": "fail"
38
+ },
39
+ "checks": [
40
+ {
41
+ "id": "tools",
42
+ "capability": "tools",
43
+ "status": "skipped",
44
+ "durationMs": 0,
45
+ "message": "Skipped because startup failed before the MCP session initialized. See the failure diagnosis.",
46
+ "evidence": []
47
+ },
48
+ {
49
+ "id": "prompts",
50
+ "capability": "prompts",
51
+ "status": "skipped",
52
+ "durationMs": 0,
53
+ "message": "Skipped because startup failed before the MCP session initialized. See the failure diagnosis.",
54
+ "evidence": []
55
+ },
56
+ {
57
+ "id": "resources",
58
+ "capability": "resources",
59
+ "status": "skipped",
60
+ "durationMs": 0,
61
+ "message": "Skipped because startup failed before the MCP session initialized. See the failure diagnosis.",
62
+ "evidence": []
63
+ }
64
+ ],
65
+ "fatalError": "Could not establish a plain stdio MCP session for target `cloudflare-server`.\nCommand: npx -y @anthropic/mcp-server-cloudflare\nDiagnosis: The process exited or detached before MCP initialization completed.\nRaw error: MCP error -32000: Connection closed\nLikely causes:\n- The package may expect extra startup arguments or environment variables.\n- The package may not behave like a plain local-process stdio target under this invocation.\n- The server may be crashing immediately and only leaving clues on stderr.\nNext steps:\n- Run the command manually and look for usage output, auth prompts, or crash text.\n- Check whether the package expects a different transport or an app-oriented startup flow.\n- Use the recent stderr lines below before assuming this is a harness bug.\nRecent stderr:\n- npm error 404 '@anthropic/mcp-server-cloudflare@*' is not in this registry.\n- npm error 404\n- npm error 404 Note that you can also install from a\n- npm error 404 tarball, folder, http url, or git url.\n- npm error A complete log of this run can be found in: /Users/williamweishuhn/.npm/_logs/2026-07-12T23_44_19_050Z-debug-0.log"
66
+ }
@@ -0,0 +1,106 @@
1
+ # MCP Observatory Run Report
2
+
3
+ Generated at 2026-07-12T23:44:18.955Z
4
+
5
+ ## Target and Environment Metadata
6
+
7
+ - Target: `cloudflare-server`
8
+ - Adapter: `local-process`
9
+ - Command: `npx -y @anthropic/mcp-server-cloudflare`
10
+ - Server: `unknown `
11
+ - Platform: `darwin 25.5.0`
12
+ - Node: `v22.22.1`
13
+
14
+ ## Executive Summary
15
+
16
+ | Gate | Total | Pass | Fail | Partial | Unsupported | Flaky | Skipped |
17
+ | --- | --- | --- | --- | --- | --- | --- | --- |
18
+ | fail | 3 | 0 | 0 | 0 | 0 | 0 | 3 |
19
+
20
+ ## At a Glance
21
+
22
+ - Safety verdict: **Blocked** — One or more checks can break agent dependence and should be fixed before production use.
23
+ - Top risks: startup: server failed to start
24
+ - Regression/schema drift: Run `mcp-observatory diff <previous-run.json> <current-run.json>` to classify regressions and schema drift.
25
+ - Failing checks: none
26
+ - Partial or flaky checks: none
27
+ - Skipped checks: tools, prompts, resources
28
+ - Unsupported checks: none
29
+ - Suggested next step: Run the target command manually, compare stderr with the diagnosis below, and only raise timeoutMs if startup is genuinely slow.
30
+ - CI next step: `Add CI: npx @kryptosai/mcp-observatory setup-ci --all --command "npx -y <server-package>"`
31
+
32
+ ## What Was Not Tested
33
+
34
+ - 🔒 network_egress: No outbound network calls were attempted during scan
35
+ - 🔒 filesystem_mutation: Filesystem write operations were not exercised
36
+ - 🔒 credential_access: Credential scanning was not performed
37
+ - â„šī¸ destructive_payloads: Destructive payloads were not attempted (safe-mode only)
38
+
39
+ ## Regressions and Recoveries
40
+
41
+ _Use the `diff` command against another run artifact to classify regressions and recoveries over time._
42
+
43
+ ## Failure Diagnosis
44
+
45
+ ```text
46
+ Could not establish a plain stdio MCP session for target `cloudflare-server`.
47
+ Command: npx -y @anthropic/mcp-server-cloudflare
48
+ Diagnosis: The process exited or detached before MCP initialization completed.
49
+ Raw error: MCP error -32000: Connection closed
50
+ Likely causes:
51
+ - The package may expect extra startup arguments or environment variables.
52
+ - The package may not behave like a plain local-process stdio target under this invocation.
53
+ - The server may be crashing immediately and only leaving clues on stderr.
54
+ Next steps:
55
+ - Run the command manually and look for usage output, auth prompts, or crash text.
56
+ - Check whether the package expects a different transport or an app-oriented startup flow.
57
+ - Use the recent stderr lines below before assuming this is a harness bug.
58
+ Recent stderr:
59
+ - npm error 404 '@anthropic/mcp-server-cloudflare@*' is not in this registry.
60
+ - npm error 404
61
+ - npm error 404 Note that you can also install from a
62
+ - npm error 404 tarball, folder, http url, or git url.
63
+ - npm error A complete log of this run can be found in: /Users/williamweishuhn/.npm/_logs/2026-07-12T23_44_19_050Z-debug-0.log
64
+ ```
65
+
66
+ ## Full Capability Status Table
67
+
68
+ | Focus | Check | Status | Duration (ms) | Message |
69
+ | --- | --- | --- | --- | --- |
70
+ | inspect startup | prompts | skipped | 0.00 | Skipped because startup failed before the MCP session initialized. See the failure diagnosis. |
71
+ | inspect startup | resources | skipped | 0.00 | Skipped because startup failed before the MCP session initialized. See the failure diagnosis. |
72
+ | inspect startup | tools | skipped | 0.00 | Skipped because startup failed before the MCP session initialized. See the failure diagnosis. |
73
+
74
+ ## Evidence Snippets
75
+
76
+ ### prompts — skipped
77
+
78
+ Summary: Skipped because startup failed before the MCP session initialized. See the failure diagnosis.
79
+
80
+ _No evidence was captured._
81
+
82
+ ### resources — skipped
83
+
84
+ Summary: Skipped because startup failed before the MCP session initialized. See the failure diagnosis.
85
+
86
+ _No evidence was captured._
87
+
88
+ ### tools — skipped
89
+
90
+ Summary: Skipped because startup failed before the MCP session initialized. See the failure diagnosis.
91
+
92
+ _No evidence was captured._
93
+
94
+ ## Reproduction Commands
95
+
96
+ ```bash
97
+ npm run cli -- run --target <path-to-target-config.json>
98
+ npm run cli -- report --run <path-to-run-artifact.json> --format markdown
99
+ ```
100
+
101
+ ## Artifact Provenance
102
+
103
+ - Artifact type: `run`
104
+ - Schema version: `1.0.0`
105
+ - Run ID: `run_2026-07-12T234418955Z_402aece3`
106
+ - Gate: `fail`