@kryptosai/mcp-observatory 0.26.1 → 0.28.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/COMMERCIAL.md +13 -9
- package/CONTRIBUTORS.md +39 -0
- package/PRIVACY.md +5 -5
- package/README.md +83 -30
- package/TERMS.md +1 -1
- package/dist/src/adapters/http.js +1 -5
- package/dist/src/adapters/http.js.map +1 -1
- package/dist/src/cassette.js +3 -2
- package/dist/src/cassette.js.map +1 -1
- package/dist/src/checks/attack-sim.d.ts +18 -0
- package/dist/src/checks/attack-sim.js +304 -0
- package/dist/src/checks/attack-sim.js.map +1 -0
- package/dist/src/checks/schema-quality.js +1 -0
- package/dist/src/checks/schema-quality.js.map +1 -1
- package/dist/src/ci-issue.js +4 -3
- package/dist/src/ci-issue.js.map +1 -1
- package/dist/src/cli.js +17 -3
- package/dist/src/cli.js.map +1 -1
- package/dist/src/commands/attack-sim.d.ts +2 -0
- package/dist/src/commands/attack-sim.js +168 -0
- package/dist/src/commands/attack-sim.js.map +1 -0
- package/dist/src/commands/helpers.d.ts +3 -1
- package/dist/src/commands/helpers.js +2 -2
- package/dist/src/commands/helpers.js.map +1 -1
- package/dist/src/commands/init-ci.d.ts +3 -0
- package/dist/src/commands/init-ci.js +57 -11
- package/dist/src/commands/init-ci.js.map +1 -1
- package/dist/src/commands/legacy.js +24 -3
- package/dist/src/commands/legacy.js.map +1 -1
- package/dist/src/commands/scan.js +37 -10
- package/dist/src/commands/scan.js.map +1 -1
- package/dist/src/commands/serve.js +9 -1
- package/dist/src/commands/serve.js.map +1 -1
- package/dist/src/commands/setup-ci-conversion.d.ts +26 -0
- package/dist/src/commands/setup-ci-conversion.js +120 -0
- package/dist/src/commands/setup-ci-conversion.js.map +1 -0
- package/dist/src/commands/telemetry.js +20 -14
- package/dist/src/commands/telemetry.js.map +1 -1
- package/dist/src/commands/test.js +63 -4
- package/dist/src/commands/test.js.map +1 -1
- package/dist/src/findings.d.ts +20 -0
- package/dist/src/findings.js +272 -0
- package/dist/src/findings.js.map +1 -0
- package/dist/src/history.js +3 -2
- package/dist/src/history.js.map +1 -1
- package/dist/src/index.d.ts +3 -0
- package/dist/src/index.js +3 -0
- package/dist/src/index.js.map +1 -1
- package/dist/src/integrations/smithery.js +5 -1
- package/dist/src/integrations/smithery.js.map +1 -1
- package/dist/src/reporters/attack-sim.d.ts +2 -0
- package/dist/src/reporters/attack-sim.js +84 -0
- package/dist/src/reporters/attack-sim.js.map +1 -0
- package/dist/src/reporters/pr-comment.js +20 -6
- package/dist/src/reporters/pr-comment.js.map +1 -1
- package/dist/src/reporters/sarif.d.ts +4 -1
- package/dist/src/reporters/sarif.js +58 -37
- package/dist/src/reporters/sarif.js.map +1 -1
- package/dist/src/runner.d.ts +3 -0
- package/dist/src/runner.js +5 -0
- package/dist/src/runner.js.map +1 -1
- package/dist/src/score.js +1 -1
- package/dist/src/score.js.map +1 -1
- package/dist/src/storage.d.ts +1 -0
- package/dist/src/storage.js +28 -2
- package/dist/src/storage.js.map +1 -1
- package/dist/src/telemetry.d.ts +6 -0
- package/dist/src/telemetry.js +17 -1
- package/dist/src/telemetry.js.map +1 -1
- package/dist/src/types.d.ts +1 -1
- package/dist/src/utils/files.d.ts +1 -0
- package/dist/src/utils/files.js +21 -0
- package/dist/src/utils/files.js.map +1 -0
- package/dist/src/utils/ids.js +18 -5
- package/dist/src/utils/ids.js.map +1 -1
- package/dist/src/utils/url.d.ts +2 -0
- package/dist/src/utils/url.js +15 -0
- package/dist/src/utils/url.js.map +1 -0
- package/dist/src/validate.js +1 -1
- package/dist/src/validate.js.map +1 -1
- package/docs/agent-ecosystem-promotion-plan.md +244 -0
- package/docs/agent-runtime-quickstart.md +98 -0
- package/docs/agent-tasks.md +95 -0
- package/docs/automatic-ci-integration.md +33 -0
- package/docs/campaign-attribution.md +58 -0
- package/docs/code-scanning-demo.md +57 -0
- package/docs/code-scanning-launch-outreach.md +55 -0
- package/docs/contributor-proof-cards/README.md +33 -0
- package/docs/contributor-recognition.md +92 -0
- package/docs/feishu-lark-mcp.md +3 -3
- package/docs/github-code-scanning-for-mcp.md +94 -0
- package/docs/launch.md +64 -0
- package/docs/mcp-attack-simulator.md +57 -0
- package/docs/mcp-server-safety-index.md +18 -12
- package/docs/metrics-dashboard.md +2 -2
- package/docs/openclaw-agent-template/SOUL.md +156 -0
- package/docs/proof.md +7 -4
- package/docs/receipt-graph.md +54 -0
- package/docs/safety-index/artifacts/antv-chart-server.json +21 -21
- package/docs/safety-index/artifacts/antv-chart-server.md +10 -10
- package/docs/safety-index/artifacts/browsermcp-server.json +17 -17
- package/docs/safety-index/artifacts/browsermcp-server.md +10 -10
- package/docs/safety-index/artifacts/context7-server.json +17 -17
- package/docs/safety-index/artifacts/context7-server.md +10 -10
- package/docs/safety-index/artifacts/cyanheads-git-mcp-server.json +2014 -0
- package/docs/safety-index/artifacts/cyanheads-git-mcp-server.md +163 -0
- package/docs/safety-index/artifacts/everything-server.json +131 -56
- package/docs/safety-index/artifacts/everything-server.md +24 -24
- package/docs/safety-index/artifacts/executeautomation-playwright-server.json +26 -18
- package/docs/safety-index/artifacts/executeautomation-playwright-server.md +10 -10
- package/docs/safety-index/artifacts/filesystem-server.json +128 -20
- package/docs/safety-index/artifacts/filesystem-server.md +10 -10
- package/docs/safety-index/artifacts/kubernetes-server.attack.json +1559 -0
- package/docs/safety-index/artifacts/kubernetes-server.attack.md +43 -0
- package/docs/safety-index/artifacts/kubernetes-server.attack.sarif +2857 -0
- package/docs/safety-index/artifacts/kubernetes-server.json +1348 -0
- package/docs/safety-index/artifacts/kubernetes-server.md +150 -0
- package/docs/safety-index/artifacts/memory-server.json +75 -32
- package/docs/safety-index/artifacts/memory-server.md +35 -28
- package/docs/safety-index/artifacts/opentofu-server.json +25 -17
- package/docs/safety-index/artifacts/opentofu-server.md +11 -11
- package/docs/safety-index/artifacts/playwright-mcp-server.json +56 -20
- package/docs/safety-index/artifacts/playwright-mcp-server.md +12 -12
- package/docs/safety-index/artifacts/promptopia-server.json +28 -20
- package/docs/safety-index/artifacts/promptopia-server.md +11 -11
- package/docs/safety-index/artifacts/puppeteer-server.json +42 -30
- package/docs/safety-index/artifacts/puppeteer-server.md +28 -28
- package/docs/safety-index/artifacts/ref-tools-server.json +17 -17
- package/docs/safety-index/artifacts/ref-tools-server.md +9 -9
- package/docs/safety-index/artifacts/sequential-thinking-server.json +20 -21
- package/docs/safety-index/artifacts/sequential-thinking-server.md +10 -10
- package/docs/safety-index/targets.json +90 -14
- package/docs/setup-ci-doctor.md +2 -0
- package/docs/target-contribution-guide.md +139 -0
- package/docs/target-gallery.md +49 -0
- package/docs/target-registry.md +120 -0
- package/docs/tool-call-receipts.md +116 -0
- package/package.json +52 -9
- package/schemas/run-artifact.schema.json +1 -0
- package/scripts/postinstall.mjs +123 -0
- package/docs/certification-campaign-template.md +0 -181
- package/docs/certification-distribution.md +0 -145
- package/docs/certification-pr-campaign.md +0 -68
- package/docs/clone-to-ci-campaign.md +0 -62
- package/docs/directory-listing-copy.md +0 -85
- package/docs/distribution-launch.md +0 -76
- package/docs/ecosystem-distribution-kit.md +0 -79
- package/docs/enterprise-outreach-playbook.md +0 -83
- package/docs/paid-pilot-offer.md +0 -74
- package/docs/project-case-study.md +0 -140
- package/docs/public-post-drafts.md +0 -98
- package/docs/publish-readiness.md +0 -79
|
@@ -2,9 +2,9 @@
|
|
|
2
2
|
"artifactType": "run",
|
|
3
3
|
"schemaVersion": "1.0.0",
|
|
4
4
|
"gate": "fail",
|
|
5
|
-
"runId": "run_2026-
|
|
6
|
-
"createdAt": "2026-
|
|
7
|
-
"toolVersion": "0.
|
|
5
|
+
"runId": "run_2026-07-06T014705638Z_2fa3564a",
|
|
6
|
+
"createdAt": "2026-07-06T01:47:05.638Z",
|
|
7
|
+
"toolVersion": "0.26.1",
|
|
8
8
|
"target": {
|
|
9
9
|
"targetId": "executeautomation-playwright-server",
|
|
10
10
|
"adapter": "local-process",
|
|
@@ -25,8 +25,8 @@
|
|
|
25
25
|
"serverVersion": "1.0.11"
|
|
26
26
|
},
|
|
27
27
|
"environment": {
|
|
28
|
-
"platform": "darwin
|
|
29
|
-
"nodeVersion": "
|
|
28
|
+
"platform": "darwin 24.0.0",
|
|
29
|
+
"nodeVersion": "v25.8.1"
|
|
30
30
|
},
|
|
31
31
|
"summary": {
|
|
32
32
|
"total": 7,
|
|
@@ -43,7 +43,7 @@
|
|
|
43
43
|
"id": "tools",
|
|
44
44
|
"capability": "tools",
|
|
45
45
|
"status": "pass",
|
|
46
|
-
"durationMs":
|
|
46
|
+
"durationMs": 1.4651249999988067,
|
|
47
47
|
"message": "Advertised capability responded with the minimal expected shape (33 items).",
|
|
48
48
|
"evidence": [
|
|
49
49
|
{
|
|
@@ -746,7 +746,7 @@
|
|
|
746
746
|
"id": "prompts",
|
|
747
747
|
"capability": "prompts",
|
|
748
748
|
"status": "unsupported",
|
|
749
|
-
"durationMs": 0.
|
|
749
|
+
"durationMs": 0.0007910000003903406,
|
|
750
750
|
"message": "Prompts are not advertised by the target.",
|
|
751
751
|
"evidence": [
|
|
752
752
|
{
|
|
@@ -762,7 +762,7 @@
|
|
|
762
762
|
"id": "resources",
|
|
763
763
|
"capability": "resources",
|
|
764
764
|
"status": "pass",
|
|
765
|
-
"durationMs":
|
|
765
|
+
"durationMs": 0.7251669999986916,
|
|
766
766
|
"message": "Advertised capability responded with the minimal expected shape, but one optional resource endpoint appears unsupported.",
|
|
767
767
|
"evidence": [
|
|
768
768
|
{
|
|
@@ -791,7 +791,7 @@
|
|
|
791
791
|
"id": "security-lite",
|
|
792
792
|
"capability": "security-lite",
|
|
793
793
|
"status": "fail",
|
|
794
|
-
"durationMs": 0.
|
|
794
|
+
"durationMs": 0.06308300000091549,
|
|
795
795
|
"message": "Found 1 security finding(s): 1 high, 0 medium, 0 low.",
|
|
796
796
|
"evidence": [
|
|
797
797
|
{
|
|
@@ -821,7 +821,7 @@
|
|
|
821
821
|
"id": "conformance",
|
|
822
822
|
"capability": "conformance",
|
|
823
823
|
"status": "pass",
|
|
824
|
-
"durationMs":
|
|
824
|
+
"durationMs": 2.7162499999994907,
|
|
825
825
|
"message": "All 7 conformance checks passed.",
|
|
826
826
|
"evidence": [
|
|
827
827
|
{
|
|
@@ -847,7 +847,7 @@
|
|
|
847
847
|
"id": "schema-quality",
|
|
848
848
|
"capability": "schema-quality",
|
|
849
849
|
"status": "partial",
|
|
850
|
-
"durationMs":
|
|
850
|
+
"durationMs": 0.7485839999990276,
|
|
851
851
|
"message": "Found 1 quality finding(s) across 34 item(s): 1 warnings, 0 info.",
|
|
852
852
|
"evidence": [
|
|
853
853
|
{
|
|
@@ -861,6 +861,14 @@
|
|
|
861
861
|
],
|
|
862
862
|
"diagnostics": [
|
|
863
863
|
"[warning] resource \"Browser console logs\": Missing description"
|
|
864
|
+
],
|
|
865
|
+
"findings": [
|
|
866
|
+
{
|
|
867
|
+
"itemType": "resource",
|
|
868
|
+
"itemName": "Browser console logs",
|
|
869
|
+
"issue": "Missing description",
|
|
870
|
+
"severity": "warning"
|
|
871
|
+
}
|
|
864
872
|
]
|
|
865
873
|
}
|
|
866
874
|
]
|
|
@@ -869,7 +877,7 @@
|
|
|
869
877
|
"id": "security",
|
|
870
878
|
"capability": "security",
|
|
871
879
|
"status": "fail",
|
|
872
|
-
"durationMs": 0.
|
|
880
|
+
"durationMs": 0.4188750000012078,
|
|
873
881
|
"message": "Found 1 security finding(s): 1 high, 0 medium, 0 low.",
|
|
874
882
|
"evidence": [
|
|
875
883
|
{
|
|
@@ -940,16 +948,16 @@
|
|
|
940
948
|
"weight": 0.1,
|
|
941
949
|
"score": 100,
|
|
942
950
|
"details": [
|
|
943
|
-
"Connect:
|
|
944
|
-
"p95 latency:
|
|
951
|
+
"Connect: 850ms",
|
|
952
|
+
"p95 latency: 1ms (3 operations)"
|
|
945
953
|
]
|
|
946
954
|
}
|
|
947
955
|
]
|
|
948
956
|
},
|
|
949
957
|
"performanceMetrics": {
|
|
950
|
-
"connectMs":
|
|
951
|
-
"toolsListMs":
|
|
952
|
-
"promptsListMs": 0.
|
|
953
|
-
"resourcesListMs":
|
|
958
|
+
"connectMs": 850.0112910000007,
|
|
959
|
+
"toolsListMs": 1.4651249999988067,
|
|
960
|
+
"promptsListMs": 0.0007910000003903406,
|
|
961
|
+
"resourcesListMs": 0.7251669999986916
|
|
954
962
|
}
|
|
955
963
|
}
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
# MCP Observatory Run Report
|
|
2
2
|
|
|
3
|
-
Generated at 2026-
|
|
3
|
+
Generated at 2026-07-06T01:47:05.638Z
|
|
4
4
|
|
|
5
5
|
## Target and Environment Metadata
|
|
6
6
|
|
|
@@ -8,8 +8,8 @@ Generated at 2026-06-24T02:07:44.894Z
|
|
|
8
8
|
- Adapter: `local-process`
|
|
9
9
|
- Command: `npx -y @executeautomation/playwright-mcp-server`
|
|
10
10
|
- Server: `playwright-mcp 1.0.11`
|
|
11
|
-
- Platform: `darwin
|
|
12
|
-
- Node: `
|
|
11
|
+
- Platform: `darwin 24.0.0`
|
|
12
|
+
- Node: `v25.8.1`
|
|
13
13
|
|
|
14
14
|
## Executive Summary
|
|
15
15
|
|
|
@@ -47,13 +47,13 @@ _Use the `diff` command against another run artifact to classify regressions and
|
|
|
47
47
|
|
|
48
48
|
| Focus | Check | Status | Duration (ms) | Message |
|
|
49
49
|
| --- | --- | --- | --- | --- |
|
|
50
|
-
| healthy | conformance | pass |
|
|
51
|
-
| healthy | resources | pass |
|
|
52
|
-
| healthy | tools | pass |
|
|
53
|
-
| review | schema-quality | partial |
|
|
50
|
+
| healthy | conformance | pass | 2.72 | All 7 conformance checks passed. |
|
|
51
|
+
| healthy | resources | pass | 0.73 | Advertised capability responded with the minimal expected shape, but one optional resource endpoint appears unsupported. |
|
|
52
|
+
| healthy | tools | pass | 1.47 | Advertised capability responded with the minimal expected shape (33 items). |
|
|
53
|
+
| review | schema-quality | partial | 0.75 | Found 1 quality finding(s) across 34 item(s): 1 warnings, 0 info. |
|
|
54
54
|
| confirm intent | prompts | unsupported | 0.00 | Prompts are not advertised by the target. |
|
|
55
|
-
| act now | security | fail | 0.
|
|
56
|
-
| act now | security-lite | fail | 0.
|
|
55
|
+
| act now | security | fail | 0.42 | Found 1 security finding(s): 1 high, 0 medium, 0 low. |
|
|
56
|
+
| act now | security-lite | fail | 0.06 | Found 1 security finding(s): 1 high, 0 medium, 0 low. |
|
|
57
57
|
|
|
58
58
|
## Evidence Snippets
|
|
59
59
|
|
|
@@ -159,5 +159,5 @@ npm run cli -- report --run <path-to-run-artifact.json> --format markdown
|
|
|
159
159
|
|
|
160
160
|
- Artifact type: `run`
|
|
161
161
|
- Schema version: `1.0.0`
|
|
162
|
-
- Run ID: `run_2026-
|
|
162
|
+
- Run ID: `run_2026-07-06T014705638Z_2fa3564a`
|
|
163
163
|
- Gate: `fail`
|
|
@@ -2,9 +2,9 @@
|
|
|
2
2
|
"artifactType": "run",
|
|
3
3
|
"schemaVersion": "1.0.0",
|
|
4
4
|
"gate": "pass",
|
|
5
|
-
"runId": "run_2026-
|
|
6
|
-
"createdAt": "2026-
|
|
7
|
-
"toolVersion": "0.
|
|
5
|
+
"runId": "run_2026-07-06T014653596Z_2f383767",
|
|
6
|
+
"createdAt": "2026-07-06T01:46:53.596Z",
|
|
7
|
+
"toolVersion": "0.26.1",
|
|
8
8
|
"target": {
|
|
9
9
|
"targetId": "filesystem-server",
|
|
10
10
|
"adapter": "local-process",
|
|
@@ -26,8 +26,8 @@
|
|
|
26
26
|
"serverVersion": "0.2.0"
|
|
27
27
|
},
|
|
28
28
|
"environment": {
|
|
29
|
-
"platform": "darwin
|
|
30
|
-
"nodeVersion": "
|
|
29
|
+
"platform": "darwin 24.0.0",
|
|
30
|
+
"nodeVersion": "v25.8.1"
|
|
31
31
|
},
|
|
32
32
|
"summary": {
|
|
33
33
|
"total": 7,
|
|
@@ -44,7 +44,7 @@
|
|
|
44
44
|
"id": "tools",
|
|
45
45
|
"capability": "tools",
|
|
46
46
|
"status": "pass",
|
|
47
|
-
"durationMs":
|
|
47
|
+
"durationMs": 6.062416000000212,
|
|
48
48
|
"message": "Advertised capability responded with the minimal expected shape (14 items).",
|
|
49
49
|
"evidence": [
|
|
50
50
|
{
|
|
@@ -71,9 +71,7 @@
|
|
|
71
71
|
],
|
|
72
72
|
"diagnostics": [
|
|
73
73
|
"Secure MCP Filesystem Server running on stdio",
|
|
74
|
-
"Client does not support MCP Roots, using allowed directories set from server args: ["
|
|
75
|
-
"'/Users/williamweishuhn/Documents/New project/mcp-observatory/examples/filesystem-fixture'",
|
|
76
|
-
"]"
|
|
74
|
+
"Client does not support MCP Roots, using allowed directories set from server args: [ '/Users/sanghoon/mcp-observatory/examples/filesystem-fixture' ]"
|
|
77
75
|
],
|
|
78
76
|
"schemas": {
|
|
79
77
|
"read_file": {
|
|
@@ -327,7 +325,7 @@
|
|
|
327
325
|
"id": "prompts",
|
|
328
326
|
"capability": "prompts",
|
|
329
327
|
"status": "unsupported",
|
|
330
|
-
"durationMs": 0.
|
|
328
|
+
"durationMs": 0.002250000000003638,
|
|
331
329
|
"message": "Prompts are not advertised by the target.",
|
|
332
330
|
"evidence": [
|
|
333
331
|
{
|
|
@@ -343,7 +341,7 @@
|
|
|
343
341
|
"id": "resources",
|
|
344
342
|
"capability": "resources",
|
|
345
343
|
"status": "unsupported",
|
|
346
|
-
"durationMs": 0.
|
|
344
|
+
"durationMs": 0.0014999999998508429,
|
|
347
345
|
"message": "Resources are not advertised by the target.",
|
|
348
346
|
"evidence": [
|
|
349
347
|
{
|
|
@@ -359,7 +357,7 @@
|
|
|
359
357
|
"id": "security-lite",
|
|
360
358
|
"capability": "security-lite",
|
|
361
359
|
"status": "partial",
|
|
362
|
-
"durationMs": 0.
|
|
360
|
+
"durationMs": 0.1989160000002812,
|
|
363
361
|
"message": "Found 3 security finding(s): 0 high, 3 medium, 0 low.",
|
|
364
362
|
"evidence": [
|
|
365
363
|
{
|
|
@@ -405,7 +403,7 @@
|
|
|
405
403
|
"id": "conformance",
|
|
406
404
|
"capability": "conformance",
|
|
407
405
|
"status": "pass",
|
|
408
|
-
"durationMs":
|
|
406
|
+
"durationMs": 6.366665999999896,
|
|
409
407
|
"message": "All 7 conformance checks passed.",
|
|
410
408
|
"evidence": [
|
|
411
409
|
{
|
|
@@ -431,7 +429,7 @@
|
|
|
431
429
|
"id": "schema-quality",
|
|
432
430
|
"capability": "schema-quality",
|
|
433
431
|
"status": "partial",
|
|
434
|
-
"durationMs": 2.
|
|
432
|
+
"durationMs": 2.5983750000000327,
|
|
435
433
|
"message": "Found 18 quality finding(s) across 14 item(s): 0 warnings, 18 info.",
|
|
436
434
|
"evidence": [
|
|
437
435
|
{
|
|
@@ -473,6 +471,116 @@
|
|
|
473
471
|
"[info] tool \"search_files\": Property 'pattern' missing description",
|
|
474
472
|
"[info] tool \"search_files\": Property 'excludePatterns' missing description",
|
|
475
473
|
"[info] tool \"get_file_info\": Property 'path' missing description"
|
|
474
|
+
],
|
|
475
|
+
"findings": [
|
|
476
|
+
{
|
|
477
|
+
"itemType": "tool",
|
|
478
|
+
"itemName": "read_file",
|
|
479
|
+
"issue": "Property 'path' missing description",
|
|
480
|
+
"severity": "info"
|
|
481
|
+
},
|
|
482
|
+
{
|
|
483
|
+
"itemType": "tool",
|
|
484
|
+
"itemName": "read_text_file",
|
|
485
|
+
"issue": "Property 'path' missing description",
|
|
486
|
+
"severity": "info"
|
|
487
|
+
},
|
|
488
|
+
{
|
|
489
|
+
"itemType": "tool",
|
|
490
|
+
"itemName": "read_media_file",
|
|
491
|
+
"issue": "Property 'path' missing description",
|
|
492
|
+
"severity": "info"
|
|
493
|
+
},
|
|
494
|
+
{
|
|
495
|
+
"itemType": "tool",
|
|
496
|
+
"itemName": "write_file",
|
|
497
|
+
"issue": "Property 'path' missing description",
|
|
498
|
+
"severity": "info"
|
|
499
|
+
},
|
|
500
|
+
{
|
|
501
|
+
"itemType": "tool",
|
|
502
|
+
"itemName": "write_file",
|
|
503
|
+
"issue": "Property 'content' missing description",
|
|
504
|
+
"severity": "info"
|
|
505
|
+
},
|
|
506
|
+
{
|
|
507
|
+
"itemType": "tool",
|
|
508
|
+
"itemName": "edit_file",
|
|
509
|
+
"issue": "Property 'path' missing description",
|
|
510
|
+
"severity": "info"
|
|
511
|
+
},
|
|
512
|
+
{
|
|
513
|
+
"itemType": "tool",
|
|
514
|
+
"itemName": "edit_file",
|
|
515
|
+
"issue": "Property 'edits' missing description",
|
|
516
|
+
"severity": "info"
|
|
517
|
+
},
|
|
518
|
+
{
|
|
519
|
+
"itemType": "tool",
|
|
520
|
+
"itemName": "create_directory",
|
|
521
|
+
"issue": "Property 'path' missing description",
|
|
522
|
+
"severity": "info"
|
|
523
|
+
},
|
|
524
|
+
{
|
|
525
|
+
"itemType": "tool",
|
|
526
|
+
"itemName": "list_directory",
|
|
527
|
+
"issue": "Property 'path' missing description",
|
|
528
|
+
"severity": "info"
|
|
529
|
+
},
|
|
530
|
+
{
|
|
531
|
+
"itemType": "tool",
|
|
532
|
+
"itemName": "list_directory_with_sizes",
|
|
533
|
+
"issue": "Property 'path' missing description",
|
|
534
|
+
"severity": "info"
|
|
535
|
+
},
|
|
536
|
+
{
|
|
537
|
+
"itemType": "tool",
|
|
538
|
+
"itemName": "directory_tree",
|
|
539
|
+
"issue": "Property 'path' missing description",
|
|
540
|
+
"severity": "info"
|
|
541
|
+
},
|
|
542
|
+
{
|
|
543
|
+
"itemType": "tool",
|
|
544
|
+
"itemName": "directory_tree",
|
|
545
|
+
"issue": "Property 'excludePatterns' missing description",
|
|
546
|
+
"severity": "info"
|
|
547
|
+
},
|
|
548
|
+
{
|
|
549
|
+
"itemType": "tool",
|
|
550
|
+
"itemName": "move_file",
|
|
551
|
+
"issue": "Property 'source' missing description",
|
|
552
|
+
"severity": "info"
|
|
553
|
+
},
|
|
554
|
+
{
|
|
555
|
+
"itemType": "tool",
|
|
556
|
+
"itemName": "move_file",
|
|
557
|
+
"issue": "Property 'destination' missing description",
|
|
558
|
+
"severity": "info"
|
|
559
|
+
},
|
|
560
|
+
{
|
|
561
|
+
"itemType": "tool",
|
|
562
|
+
"itemName": "search_files",
|
|
563
|
+
"issue": "Property 'path' missing description",
|
|
564
|
+
"severity": "info"
|
|
565
|
+
},
|
|
566
|
+
{
|
|
567
|
+
"itemType": "tool",
|
|
568
|
+
"itemName": "search_files",
|
|
569
|
+
"issue": "Property 'pattern' missing description",
|
|
570
|
+
"severity": "info"
|
|
571
|
+
},
|
|
572
|
+
{
|
|
573
|
+
"itemType": "tool",
|
|
574
|
+
"itemName": "search_files",
|
|
575
|
+
"issue": "Property 'excludePatterns' missing description",
|
|
576
|
+
"severity": "info"
|
|
577
|
+
},
|
|
578
|
+
{
|
|
579
|
+
"itemType": "tool",
|
|
580
|
+
"itemName": "get_file_info",
|
|
581
|
+
"issue": "Property 'path' missing description",
|
|
582
|
+
"severity": "info"
|
|
583
|
+
}
|
|
476
584
|
]
|
|
477
585
|
}
|
|
478
586
|
]
|
|
@@ -481,7 +589,7 @@
|
|
|
481
589
|
"id": "security",
|
|
482
590
|
"capability": "security",
|
|
483
591
|
"status": "partial",
|
|
484
|
-
"durationMs": 2.
|
|
592
|
+
"durationMs": 2.7058750000001055,
|
|
485
593
|
"message": "Found 3 security finding(s): 0 high, 3 medium, 0 low.",
|
|
486
594
|
"evidence": [
|
|
487
595
|
{
|
|
@@ -568,16 +676,16 @@
|
|
|
568
676
|
"weight": 0.1,
|
|
569
677
|
"score": 100,
|
|
570
678
|
"details": [
|
|
571
|
-
"Connect:
|
|
679
|
+
"Connect: 682ms",
|
|
572
680
|
"p95 latency: 6ms (3 operations)"
|
|
573
681
|
]
|
|
574
682
|
}
|
|
575
683
|
]
|
|
576
684
|
},
|
|
577
685
|
"performanceMetrics": {
|
|
578
|
-
"connectMs":
|
|
579
|
-
"toolsListMs":
|
|
580
|
-
"promptsListMs": 0.
|
|
581
|
-
"resourcesListMs": 0.
|
|
686
|
+
"connectMs": 681.851917,
|
|
687
|
+
"toolsListMs": 6.062416000000212,
|
|
688
|
+
"promptsListMs": 0.002250000000003638,
|
|
689
|
+
"resourcesListMs": 0.0014999999998508429
|
|
582
690
|
}
|
|
583
691
|
}
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
# MCP Observatory Run Report
|
|
2
2
|
|
|
3
|
-
Generated at 2026-
|
|
3
|
+
Generated at 2026-07-06T01:46:53.596Z
|
|
4
4
|
|
|
5
5
|
## Target and Environment Metadata
|
|
6
6
|
|
|
@@ -8,8 +8,8 @@ Generated at 2026-06-24T02:07:23.999Z
|
|
|
8
8
|
- Adapter: `local-process`
|
|
9
9
|
- Command: `npx -y @modelcontextprotocol/server-filesystem examples/filesystem-fixture`
|
|
10
10
|
- Server: `secure-filesystem-server 0.2.0`
|
|
11
|
-
- Platform: `darwin
|
|
12
|
-
- Node: `
|
|
11
|
+
- Platform: `darwin 24.0.0`
|
|
12
|
+
- Node: `v25.8.1`
|
|
13
13
|
|
|
14
14
|
## Executive Summary
|
|
15
15
|
|
|
@@ -47,11 +47,11 @@ _Use the `diff` command against another run artifact to classify regressions and
|
|
|
47
47
|
|
|
48
48
|
| Focus | Check | Status | Duration (ms) | Message |
|
|
49
49
|
| --- | --- | --- | --- | --- |
|
|
50
|
-
| healthy | conformance | pass |
|
|
51
|
-
| healthy | tools | pass |
|
|
52
|
-
| review | schema-quality | partial | 2.
|
|
53
|
-
| review | security | partial | 2.
|
|
54
|
-
| review | security-lite | partial | 0.
|
|
50
|
+
| healthy | conformance | pass | 6.37 | All 7 conformance checks passed. |
|
|
51
|
+
| healthy | tools | pass | 6.06 | Advertised capability responded with the minimal expected shape (14 items). |
|
|
52
|
+
| review | schema-quality | partial | 2.60 | Found 18 quality finding(s) across 14 item(s): 0 warnings, 18 info. |
|
|
53
|
+
| review | security | partial | 2.71 | Found 3 security finding(s): 0 high, 3 medium, 0 low. |
|
|
54
|
+
| review | security-lite | partial | 0.20 | Found 3 security finding(s): 0 high, 3 medium, 0 low. |
|
|
55
55
|
| confirm intent | prompts | unsupported | 0.00 | Prompts are not advertised by the target. |
|
|
56
56
|
| confirm intent | resources | unsupported | 0.00 | Resources are not advertised by the target. |
|
|
57
57
|
|
|
@@ -79,7 +79,7 @@ Summary: Advertised capability responded with the minimal expected shape (14 ite
|
|
|
79
79
|
- Minimal shape present: `true`
|
|
80
80
|
- Item count: `14`
|
|
81
81
|
- Identifiers: read_file, read_text_file, read_media_file, read_multiple_files, write_file (+9 more)
|
|
82
|
-
- Diagnostics: Secure MCP Filesystem Server running on stdio, Client does not support MCP Roots, using allowed directories set from server args: [
|
|
82
|
+
- Diagnostics: Secure MCP Filesystem Server running on stdio, Client does not support MCP Roots, using allowed directories set from server args: [ '/Users/sanghoon/mcp-observatory/examples/filesystem-fixture' ]
|
|
83
83
|
|
|
84
84
|
### schema-quality — partial
|
|
85
85
|
|
|
@@ -152,5 +152,5 @@ npm run cli -- report --run <path-to-run-artifact.json> --format markdown
|
|
|
152
152
|
|
|
153
153
|
- Artifact type: `run`
|
|
154
154
|
- Schema version: `1.0.0`
|
|
155
|
-
- Run ID: `run_2026-
|
|
155
|
+
- Run ID: `run_2026-07-06T014653596Z_2f383767`
|
|
156
156
|
- Gate: `pass`
|