@kryptosai/mcp-observatory 1.28.2 → 1.28.3
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CONTRIBUTORS.md +4 -1
- package/README.md +109 -14
- package/README.zh-CN.md +654 -0
- package/dist/src/adapters/http.js +13 -4
- package/dist/src/adapters/http.js.map +1 -1
- package/dist/src/checks/runtime-profile.d.ts +5 -0
- package/dist/src/checks/runtime-profile.js +214 -0
- package/dist/src/checks/runtime-profile.js.map +1 -0
- package/dist/src/checks/security-rules.js +18 -0
- package/dist/src/checks/security-rules.js.map +1 -1
- package/dist/src/checks/security.js +33 -65
- package/dist/src/checks/security.js.map +1 -1
- package/dist/src/checks/skill-scan.d.ts +46 -0
- package/dist/src/checks/skill-scan.js +665 -0
- package/dist/src/checks/skill-scan.js.map +1 -0
- package/dist/src/cli.js +15 -2
- package/dist/src/cli.js.map +1 -1
- package/dist/src/commands/enforce.d.ts +12 -0
- package/dist/src/commands/enforce.js +187 -0
- package/dist/src/commands/enforce.js.map +1 -0
- package/dist/src/commands/helpers.d.ts +2 -1
- package/dist/src/commands/helpers.js +9 -1
- package/dist/src/commands/helpers.js.map +1 -1
- package/dist/src/commands/legacy.js +3 -0
- package/dist/src/commands/legacy.js.map +1 -1
- package/dist/src/commands/risk-graph.d.ts +2 -0
- package/dist/src/commands/risk-graph.js +64 -0
- package/dist/src/commands/risk-graph.js.map +1 -0
- package/dist/src/commands/scan.js +36 -9
- package/dist/src/commands/scan.js.map +1 -1
- package/dist/src/commands/score.js.map +1 -1
- package/dist/src/commands/skill-scan.d.ts +6 -0
- package/dist/src/commands/skill-scan.js +62 -0
- package/dist/src/commands/skill-scan.js.map +1 -0
- package/dist/src/commands/test.js +13 -0
- package/dist/src/commands/test.js.map +1 -1
- package/dist/src/commands/watch.js +13 -8
- package/dist/src/commands/watch.js.map +1 -1
- package/dist/src/discovery.d.ts +15 -1
- package/dist/src/discovery.js +251 -35
- package/dist/src/discovery.js.map +1 -1
- package/dist/src/index.d.ts +3 -1
- package/dist/src/index.js +3 -1
- package/dist/src/index.js.map +1 -1
- package/dist/src/receipt.d.ts +4 -1
- package/dist/src/receipt.js +85 -0
- package/dist/src/receipt.js.map +1 -1
- package/dist/src/reporters/markdown.js +39 -0
- package/dist/src/reporters/markdown.js.map +1 -1
- package/dist/src/reporters/terminal.d.ts +2 -0
- package/dist/src/reporters/terminal.js +55 -2
- package/dist/src/reporters/terminal.js.map +1 -1
- package/dist/src/risk-graph.d.ts +64 -0
- package/dist/src/risk-graph.js +452 -0
- package/dist/src/risk-graph.js.map +1 -0
- package/dist/src/runner.js +6 -0
- package/dist/src/runner.js.map +1 -1
- package/dist/src/server.d.ts +1 -3
- package/dist/src/server.js +29 -645
- package/dist/src/server.js.map +1 -1
- package/dist/src/storage.js +13 -9
- package/dist/src/storage.js.map +1 -1
- package/dist/src/telemetry.d.ts +7 -0
- package/dist/src/telemetry.js.map +1 -1
- package/dist/src/tools/check-server.d.ts +27 -0
- package/dist/src/tools/check-server.js +46 -0
- package/dist/src/tools/check-server.js.map +1 -0
- package/dist/src/tools/ci-report.d.ts +21 -0
- package/dist/src/tools/ci-report.js +38 -0
- package/dist/src/tools/ci-report.js.map +1 -0
- package/dist/src/tools/diff-runs.d.ts +28 -0
- package/dist/src/tools/diff-runs.js +39 -0
- package/dist/src/tools/diff-runs.js.map +1 -0
- package/dist/src/tools/get-history.d.ts +21 -0
- package/dist/src/tools/get-history.js +37 -0
- package/dist/src/tools/get-history.js.map +1 -0
- package/dist/src/tools/get-last-run.d.ts +21 -0
- package/dist/src/tools/get-last-run.js +47 -0
- package/dist/src/tools/get-last-run.js.map +1 -0
- package/dist/src/tools/helpers.d.ts +8 -0
- package/dist/src/tools/helpers.js +32 -0
- package/dist/src/tools/helpers.js.map +1 -0
- package/dist/src/tools/lock-verify.d.ts +21 -0
- package/dist/src/tools/lock-verify.js +47 -0
- package/dist/src/tools/lock-verify.js.map +1 -0
- package/dist/src/tools/record.d.ts +23 -0
- package/dist/src/tools/record.js +48 -0
- package/dist/src/tools/record.js.map +1 -0
- package/dist/src/tools/replay.d.ts +21 -0
- package/dist/src/tools/replay.js +54 -0
- package/dist/src/tools/replay.js.map +1 -0
- package/dist/src/tools/scan.d.ts +18 -0
- package/dist/src/tools/scan.js +43 -0
- package/dist/src/tools/scan.js.map +1 -0
- package/dist/src/tools/score-server.d.ts +23 -0
- package/dist/src/tools/score-server.js +53 -0
- package/dist/src/tools/score-server.js.map +1 -0
- package/dist/src/tools/suggest-servers.d.ts +21 -0
- package/dist/src/tools/suggest-servers.js +114 -0
- package/dist/src/tools/suggest-servers.js.map +1 -0
- package/dist/src/tools/verify-tool.d.ts +25 -0
- package/dist/src/tools/verify-tool.js +48 -0
- package/dist/src/tools/verify-tool.js.map +1 -0
- package/dist/src/tools/watch.d.ts +23 -0
- package/dist/src/tools/watch.js +67 -0
- package/dist/src/tools/watch.js.map +1 -0
- package/dist/src/types.d.ts +26 -1
- package/dist/src/utils/security.d.ts +3 -0
- package/dist/src/utils/security.js +37 -0
- package/dist/src/utils/security.js.map +1 -0
- package/dist/src/validate.d.ts +1 -0
- package/dist/src/validate.js +119 -35
- package/dist/src/validate.js.map +1 -1
- package/docs/agent-tasks.md +1 -1
- package/docs/commercial-boundary.md +9 -1
- package/docs/contributor-recognition.md +2 -0
- package/docs/demo.svg +1 -59
- package/docs/mcp-receipts.md +9 -0
- package/docs/mcp-server-safety-index.md +21 -16
- package/docs/metrics-dashboard.md +17 -1
- package/docs/private-mcp-fleet-risk-graph.md +69 -0
- package/docs/receipt-graph.md +118 -31
- package/docs/safety-index/artifacts/chrome-devtools-mcp-server.json +1745 -0
- package/docs/safety-index/artifacts/chrome-devtools-mcp-server.md +169 -0
- package/docs/safety-index/artifacts/filesystem-mcp-server.json +786 -0
- package/docs/safety-index/artifacts/filesystem-mcp-server.md +169 -0
- package/docs/safety-index/artifacts/github-mcp-server.json +1707 -0
- package/docs/safety-index/artifacts/github-mcp-server.md +169 -0
- package/docs/safety-index/mcp-risk-graph.html +167 -0
- package/docs/safety-index/mcp-risk-graph.json +669 -0
- package/docs/safety-index/mcp-risk-graph.md +47 -0
- package/docs/safety-index/targets.json +57 -0
- package/docs/sample-private-fleet-risk-graph.md +90 -0
- package/package.json +21 -11
|
@@ -0,0 +1,169 @@
|
|
|
1
|
+
# MCP Observatory Run Report
|
|
2
|
+
|
|
3
|
+
Generated at 2026-07-07T21:16:35.668Z
|
|
4
|
+
|
|
5
|
+
## Target and Environment Metadata
|
|
6
|
+
|
|
7
|
+
- Target: `filesystem-mcp-server`
|
|
8
|
+
- Adapter: `local-process`
|
|
9
|
+
- Command: `npx -y @modelcontextprotocol/server-filesystem <safe-empty-temp-dir>`
|
|
10
|
+
- Server: `secure-filesystem-server 0.2.0`
|
|
11
|
+
- Platform: `darwin 24.0.0`
|
|
12
|
+
- Node: `v25.8.1`
|
|
13
|
+
|
|
14
|
+
## Executive Summary
|
|
15
|
+
|
|
16
|
+
**Health Score: 77/100 (C)**
|
|
17
|
+
|
|
18
|
+
| Dimension | Score | Weight |
|
|
19
|
+
| --- | --- | --- |
|
|
20
|
+
| Protocol Compliance | 100/100 | 30% |
|
|
21
|
+
| Schema Quality | 60/100 | 20% |
|
|
22
|
+
| Security | 60/100 | 20% |
|
|
23
|
+
| Reliability | 67/100 | 20% |
|
|
24
|
+
| Performance | 100/100 | 10% |
|
|
25
|
+
|
|
26
|
+
| Gate | Total | Pass | Fail | Partial | Unsupported | Flaky | Skipped |
|
|
27
|
+
| --- | --- | --- | --- | --- | --- | --- | --- |
|
|
28
|
+
| pass | 8 | 2 | 0 | 4 | 2 | 0 | 0 |
|
|
29
|
+
|
|
30
|
+
## At a Glance
|
|
31
|
+
|
|
32
|
+
- Safety verdict: **Needs review** — The server is usable, but caveated checks should be reviewed before agents depend on it.
|
|
33
|
+
- Top risks: attack-sim: Safe attack simulation found 3 finding(s): 0 high, 3 medium, 0 low.; schema-quality: Found 18 quality finding(s) across 14 item(s): 0 warnings, 18 info.; security: Found 3 security finding(s): 0 high, 3 medium, 0 low.
|
|
34
|
+
- Regression/schema drift: Run `mcp-observatory diff <previous-run.json> <current-run.json>` to classify regressions and schema drift.
|
|
35
|
+
- Failing checks: none
|
|
36
|
+
- Partial or flaky checks: security-lite, schema-quality, security, attack-sim
|
|
37
|
+
- Skipped checks: none
|
|
38
|
+
- Unsupported checks: prompts, resources
|
|
39
|
+
- Suggested next step: Review the caveated checks next: security-lite, schema-quality, security, attack-sim.
|
|
40
|
+
- CI next step: `Add CI: npx @kryptosai/mcp-observatory setup-ci --all --command "npx -y <server-package>"`
|
|
41
|
+
|
|
42
|
+
## Regressions and Recoveries
|
|
43
|
+
|
|
44
|
+
_Use the `diff` command against another run artifact to classify regressions and recoveries over time._
|
|
45
|
+
|
|
46
|
+
## Full Capability Status Table
|
|
47
|
+
|
|
48
|
+
| Focus | Check | Status | Duration (ms) | Message |
|
|
49
|
+
| --- | --- | --- | --- | --- |
|
|
50
|
+
| healthy | conformance | pass | 4.97 | All 7 conformance checks passed. |
|
|
51
|
+
| healthy | tools | pass | 4.94 | Advertised capability responded with the minimal expected shape (14 items). |
|
|
52
|
+
| review | attack-sim | partial | 2.58 | Safe attack simulation found 3 finding(s): 0 high, 3 medium, 0 low. |
|
|
53
|
+
| review | schema-quality | partial | 2.06 | Found 18 quality finding(s) across 14 item(s): 0 warnings, 18 info. |
|
|
54
|
+
| review | security | partial | 2.29 | Found 3 security finding(s): 0 high, 3 medium, 0 low. |
|
|
55
|
+
| review | security-lite | partial | 0.06 | Found 3 security finding(s): 0 high, 3 medium, 0 low. |
|
|
56
|
+
| confirm intent | prompts | unsupported | 0.00 | Prompts are not advertised by the target. |
|
|
57
|
+
| confirm intent | resources | unsupported | 0.00 | Resources are not advertised by the target. |
|
|
58
|
+
|
|
59
|
+
## Evidence Snippets
|
|
60
|
+
|
|
61
|
+
### conformance — pass
|
|
62
|
+
|
|
63
|
+
Summary: All 7 conformance checks passed.
|
|
64
|
+
|
|
65
|
+
- Endpoint: `conformance/check`
|
|
66
|
+
- Advertised: `true`
|
|
67
|
+
- Responded: `true`
|
|
68
|
+
- Minimal shape present: `true`
|
|
69
|
+
- Item count: `7`
|
|
70
|
+
- Identifiers: none
|
|
71
|
+
- Diagnostics: [pass] capabilities-present: Server returned capabilities object., [pass] server-info: Server provided initialization info., [pass] tools-capability-match: tools/list returned 14 tool(s). (+4 more)
|
|
72
|
+
|
|
73
|
+
### tools — pass
|
|
74
|
+
|
|
75
|
+
Summary: Advertised capability responded with the minimal expected shape (14 items).
|
|
76
|
+
|
|
77
|
+
- Endpoint: `tools/list`
|
|
78
|
+
- Advertised: `true`
|
|
79
|
+
- Responded: `true`
|
|
80
|
+
- Minimal shape present: `true`
|
|
81
|
+
- Item count: `14`
|
|
82
|
+
- Identifiers: read_file, read_text_file, read_media_file, read_multiple_files, write_file (+9 more)
|
|
83
|
+
- Diagnostics: Secure MCP Filesystem Server running on stdio, Client does not support MCP Roots, using allowed directories set from server args: [, '<safe-empty-temp-dir>', (+2 more)
|
|
84
|
+
|
|
85
|
+
### attack-sim — partial
|
|
86
|
+
|
|
87
|
+
Summary: Safe attack simulation found 3 finding(s): 0 high, 3 medium, 0 low.
|
|
88
|
+
|
|
89
|
+
- Endpoint: `attack-sim/safe`
|
|
90
|
+
- Advertised: `true`
|
|
91
|
+
- Responded: `true`
|
|
92
|
+
- Minimal shape present: `true`
|
|
93
|
+
- Item count: `3`
|
|
94
|
+
- Identifiers: write_file, edit_file, create_directory
|
|
95
|
+
- Diagnostics: [medium] Tool "write_file" combines broad parameters (path) with destructive or non-read-only behavior., [medium] Tool "edit_file" combines broad parameters (path) with destructive or non-read-only behavior., [medium] Tool "create_directory" combines broad parameters (path) with destructive or non-read-only behavior.
|
|
96
|
+
|
|
97
|
+
### schema-quality — partial
|
|
98
|
+
|
|
99
|
+
Summary: Found 18 quality finding(s) across 14 item(s): 0 warnings, 18 info.
|
|
100
|
+
|
|
101
|
+
- Endpoint: `schema-quality/scan`
|
|
102
|
+
- Advertised: `true`
|
|
103
|
+
- Responded: `true`
|
|
104
|
+
- Minimal shape present: `true`
|
|
105
|
+
- Item count: `18`
|
|
106
|
+
- Identifiers: read_file, read_text_file, read_media_file, write_file, edit_file (+7 more)
|
|
107
|
+
- Diagnostics: [info] tool "read_file": Property 'path' missing description, [info] tool "read_text_file": Property 'path' missing description, [info] tool "read_media_file": Property 'path' missing description (+15 more)
|
|
108
|
+
|
|
109
|
+
### security — partial
|
|
110
|
+
|
|
111
|
+
Summary: Found 3 security finding(s): 0 high, 3 medium, 0 low.
|
|
112
|
+
|
|
113
|
+
- Endpoint: `security/scan`
|
|
114
|
+
- Advertised: `true`
|
|
115
|
+
- Responded: `true`
|
|
116
|
+
- Minimal shape present: `true`
|
|
117
|
+
- Item count: `3`
|
|
118
|
+
- Identifiers: write_file, edit_file, create_directory
|
|
119
|
+
- Diagnostics: [medium] Tool "write_file" accepts filesystem paths and has destructive capabilities., [medium] Tool "edit_file" accepts filesystem paths and has destructive capabilities., [medium] Tool "create_directory" accepts filesystem paths and has destructive capabilities.
|
|
120
|
+
|
|
121
|
+
### security-lite — partial
|
|
122
|
+
|
|
123
|
+
Summary: Found 3 security finding(s): 0 high, 3 medium, 0 low.
|
|
124
|
+
|
|
125
|
+
- Endpoint: `security/scan-lite`
|
|
126
|
+
- Advertised: `true`
|
|
127
|
+
- Responded: `true`
|
|
128
|
+
- Minimal shape present: `true`
|
|
129
|
+
- Item count: `3`
|
|
130
|
+
- Identifiers: write_file, edit_file, create_directory
|
|
131
|
+
- Diagnostics: [medium] Tool "write_file" accepts filesystem paths and has destructive capabilities., [medium] Tool "edit_file" accepts filesystem paths and has destructive capabilities., [medium] Tool "create_directory" accepts filesystem paths and has destructive capabilities.
|
|
132
|
+
|
|
133
|
+
### prompts — unsupported
|
|
134
|
+
|
|
135
|
+
Summary: Prompts are not advertised by the target.
|
|
136
|
+
|
|
137
|
+
- Endpoint: `prompts/list`
|
|
138
|
+
- Advertised: `false`
|
|
139
|
+
- Responded: `false`
|
|
140
|
+
- Minimal shape present: `false`
|
|
141
|
+
- Item count: `0`
|
|
142
|
+
- Identifiers: none
|
|
143
|
+
- Diagnostics: none
|
|
144
|
+
|
|
145
|
+
### resources — unsupported
|
|
146
|
+
|
|
147
|
+
Summary: Resources are not advertised by the target.
|
|
148
|
+
|
|
149
|
+
- Endpoint: `resources/list | resources/templates/list`
|
|
150
|
+
- Advertised: `false`
|
|
151
|
+
- Responded: `false`
|
|
152
|
+
- Minimal shape present: `false`
|
|
153
|
+
- Item count: `0`
|
|
154
|
+
- Identifiers: none
|
|
155
|
+
- Diagnostics: none
|
|
156
|
+
|
|
157
|
+
## Reproduction Commands
|
|
158
|
+
|
|
159
|
+
```bash
|
|
160
|
+
npm run cli -- run --target <path-to-target-config.json>
|
|
161
|
+
npm run cli -- report --run <path-to-run-artifact.json> --format markdown
|
|
162
|
+
```
|
|
163
|
+
|
|
164
|
+
## Artifact Provenance
|
|
165
|
+
|
|
166
|
+
- Artifact type: `run`
|
|
167
|
+
- Schema version: `1.0.0`
|
|
168
|
+
- Run ID: `run_2026-07-07T211635668Z_9369cd63`
|
|
169
|
+
- Gate: `pass`
|