@kryptosai/mcp-observatory 0.27.0 → 1.28.1

package/docs/safety-index/artifacts/kubernetes-server.md

@@ -0,0 +1,176 @@
+# MCP Observatory Run Report
+
+Generated at 2026-07-06T19:49:58.878Z
+
+## Target and Environment Metadata
+
+- Target: `kubernetes-server`
+- Adapter: `local-process`
+- Command: `npx -y mcp-server-kubernetes`
+- Server: `kubernetes 3.9.3`
+- Platform: `darwin 25.5.0`
+- Node: `v22.22.1`
+
+## Executive Summary
+
+**Health Score: 72/100 (C)**
+
+| Dimension | Score | Weight |
+| --- | --- | --- |
+| Protocol Compliance | 100/100 | 30% |
+| Schema Quality | 60/100 | 20% |
+| Security | 0/100 | 20% |
+| Reliability | 100/100 | 20% |
+| Performance | 100/100 | 10% |
+
+| Gate | Total | Pass | Fail | Partial | Unsupported | Flaky | Skipped |
+| --- | --- | --- | --- | --- | --- | --- | --- |
+| fail | 8 | 4 | 3 | 1 | 0 | 0 | 0 |
+
+## At a Glance
+
+- Safety verdict: **Blocked** — One or more checks can break agent dependence and should be fixed before production use.
+- Top risks: schema-quality: Found 7 quality finding(s) across 29 item(s): 0 warnings, 7 info.; attack-sim: Safe attack simulation found 5 finding(s): 3 high, 2 medium, 0 low.; security: Found 8 security finding(s): 3 high, 3 medium, 2 low.
+- Regression/schema drift: Run `mcp-observatory diff <previous-run.json> <current-run.json>` to classify regressions and schema drift.
+- Failing checks: security-lite, security, attack-sim
+- Partial or flaky checks: schema-quality
+- Skipped checks: none
+- Unsupported checks: none
+- Suggested next step: Start with the failing checks: security-lite, security, attack-sim.
+- CI next step: `Add CI: npx @kryptosai/mcp-observatory setup-ci --all --command "npx -y <server-package>"`
+
+## Regressions and Recoveries
+
+_Use the `diff` command against another run artifact to classify regressions and recoveries over time._
+
+## Full Capability Status Table
+
+| Focus | Check | Status | Duration (ms) | Message |
+| --- | --- | --- | --- | --- |
+| healthy | conformance | pass | 1.69 | All 7 conformance checks passed. |
+| healthy | prompts | pass | 0.30 | Advertised capability responded with the minimal expected shape (1 item). |
+| healthy | resources | pass | 0.38 | Advertised capability responded with the minimal expected shape, but one optional resource endpoint appears unsupported. |
+| healthy | tools | pass | 1.26 | Advertised capability responded with the minimal expected shape (23 items). |
+| review | schema-quality | partial | 0.49 | Found 7 quality finding(s) across 29 item(s): 0 warnings, 7 info. |
+| act now | attack-sim | fail | 0.75 | Safe attack simulation found 5 finding(s): 3 high, 2 medium, 0 low. |
+| act now | security | fail | 0.28 | Found 8 security finding(s): 3 high, 3 medium, 2 low. |
+| act now | security-lite | fail | 0.06 | Found 8 security finding(s): 3 high, 3 medium, 2 low. |
+
+## Evidence Snippets
+
+### conformance — pass
+
+Summary: All 7 conformance checks passed.
+
+- Endpoint: `conformance/check`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `7`
+  - Identifiers: none
+  - Diagnostics: [pass] capabilities-present: Server returned capabilities object., [pass] server-info: Server provided initialization info., [pass] tools-capability-match: tools/list returned 23 tool(s). (+4 more)
+
+### prompts — pass
+
+Summary: Advertised capability responded with the minimal expected shape (1 item).
+
+- Endpoint: `prompts/list`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `1`
+  - Identifiers: k8s-diagnose
+  - Diagnostics: Starting Kubernetes MCP server v3.9.3, handling commands..., Telemetry: Disabled, (node:13988) [DEP0040] DeprecationWarning: The `punycode` module is deprecated. Please use a userland alternative instead. (+1 more)
+
+### resources — pass
+
+Summary: Advertised capability responded with the minimal expected shape, but one optional resource endpoint appears unsupported.
+
+- Endpoint: `resources/list`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `5`
+  - Identifiers: k8s://default/pods, k8s://default/deployments, k8s://default/services, k8s://namespaces, k8s://nodes
+  - Diagnostics: Starting Kubernetes MCP server v3.9.3, handling commands..., Telemetry: Disabled, (node:13988) [DEP0040] DeprecationWarning: The `punycode` module is deprecated. Please use a userland alternative instead. (+1 more)
+- Endpoint: `resources/templates/list`
+  - Advertised: `true`
+  - Responded: `false`
+  - Minimal shape present: `false`
+  - Item count: `0`
+  - Identifiers: none
+  - Diagnostics: MCP error -32601: Method not found, Starting Kubernetes MCP server v3.9.3, handling commands..., Telemetry: Disabled (+2 more)
+
+### tools — pass
+
+Summary: Advertised capability responded with the minimal expected shape (23 items).
+
+- Endpoint: `tools/list`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `23`
+  - Identifiers: cleanup, kubectl_get, kubectl_describe, kubectl_apply, kubectl_delete (+18 more)
+  - Diagnostics: Starting Kubernetes MCP server v3.9.3, handling commands..., Telemetry: Disabled, (node:13988) [DEP0040] DeprecationWarning: The `punycode` module is deprecated. Please use a userland alternative instead. (+1 more)
+
+### schema-quality — partial
+
+Summary: Found 7 quality finding(s) across 29 item(s): 0 warnings, 7 info.
+
+- Endpoint: `schema-quality/scan`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `7`
+  - Identifiers: port_forward, stop_port_forward, list_api_resources
+  - Diagnostics: [info] tool "port_forward": Property 'resourceType' missing description, [info] tool "port_forward": Property 'resourceName' missing description, [info] tool "port_forward": Property 'localPort' missing description (+4 more)
+
+### attack-sim — fail
+
+Summary: Safe attack simulation found 5 finding(s): 3 high, 2 medium, 0 low.
+
+- Endpoint: `attack-sim/safe`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `5`
+  - Identifiers: kubectl_apply, kubectl_delete, kubectl_create, exec_in_pod, kubectl_generic
+  - Diagnostics: [medium] Tool "kubectl_apply" combines broad parameters (filename) with destructive or non-read-only behavior., [medium] Tool "kubectl_delete" combines broad parameters (filename) with destructive or non-read-only behavior., [high] Tool "kubectl_create" combines broad parameters (filename, command) with destructive or non-read-only behavior. (+2 more)
+
+### security — fail
+
+Summary: Found 8 security finding(s): 3 high, 3 medium, 2 low.
+
+- Endpoint: `security/scan`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `8`
+  - Identifiers: cleanup, kubectl_apply, kubectl_delete, kubectl_create, kubectl_reconnect (+2 more)
+  - Diagnostics: [low] Tool "cleanup" has an empty schema but is marked as destructive., [medium] Tool "kubectl_apply" accepts filesystem paths and has destructive capabilities., [medium] Tool "kubectl_delete" accepts filesystem paths and has destructive capabilities. (+5 more)
+
+### security-lite — fail
+
+Summary: Found 8 security finding(s): 3 high, 3 medium, 2 low.
+
+- Endpoint: `security/scan-lite`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `8`
+  - Identifiers: cleanup, kubectl_apply, kubectl_delete, kubectl_create, kubectl_reconnect (+2 more)
+  - Diagnostics: [low] Tool "cleanup" has an empty schema but is marked as destructive., [medium] Tool "kubectl_apply" accepts filesystem paths and has destructive capabilities., [medium] Tool "kubectl_delete" accepts filesystem paths and has destructive capabilities. (+5 more)
+
+## Reproduction Commands
+
+```bash
+npm run cli -- run --target <path-to-target-config.json>
+npm run cli -- report --run <path-to-run-artifact.json> --format markdown
+```
+
+## Artifact Provenance
+
+- Artifact type: `run`
+- Schema version: `1.0.0`
+- Run ID: `run_2026-07-06T194958878Z_b41bb221`
+- Gate: `fail`

package/docs/safety-index/artifacts/memory-server.json

@@ -2,9 +2,9 @@
   "artifactType": "run",
   "schemaVersion": "1.0.0",
   "gate": "pass",
-  "runId": "run_2026-06-24T020723256Z_467de620",
-  "createdAt": "2026-06-24T02:07:23.256Z",
-  "toolVersion": "0.24.0",
+  "runId": "run_2026-07-06T194946771Z_35b0da26",
+  "createdAt": "2026-07-06T19:49:46.771Z",
+  "toolVersion": "0.28.0",
   "target": {
     "targetId": "memory-server",
     "adapter": "local-process",
@@ -29,11 +29,11 @@
     "nodeVersion": "v22.22.1"
   },
   "summary": {
-    "total": 7,
-    "pass": 4,
+    "total": 8,
+    "pass": 6,
     "fail": 0,
     "partial": 1,
-    "unsupported": 2,
+    "unsupported": 1,
     "flaky": 0,
     "skipped": 0,
     "gate": "pass"
@@ -43,7 +43,7 @@
       "id": "tools",
       "capability": "tools",
       "status": "pass",
-      "durationMs": 7.443624999999884,
+      "durationMs": 7.618457999999919,
       "message": "Advertised capability responded with the minimal expected shape (9 items).",
       "evidence": [
         {
@@ -295,7 +295,7 @@
       "id": "prompts",
       "capability": "prompts",
       "status": "unsupported",
-      "durationMs": 0.0019579999998313724,
+      "durationMs": 0.0020410000001902517,
       "message": "Prompts are not advertised by the target.",
       "evidence": [
         {
@@ -310,16 +310,33 @@
     {
       "id": "resources",
       "capability": "resources",
-      "status": "unsupported",
-      "durationMs": 0.001374999999825377,
-      "message": "Resources are not advertised by the target.",
+      "status": "pass",
+      "durationMs": 1.1717079999998532,
+      "message": "Advertised capability responded with the minimal expected shape (1 items).",
       "evidence": [
         {
-          "endpoint": "resources/list | resources/templates/list",
-          "advertised": false,
-          "responded": false,
-          "minimalShapePresent": false,
-          "diagnostics": []
+          "endpoint": "resources/list",
+          "advertised": true,
+          "responded": true,
+          "minimalShapePresent": true,
+          "itemCount": 1,
+          "identifiers": [
+            "memory://knowledge-graph"
+          ],
+          "diagnostics": [
+            "Knowledge Graph MCP Server running on stdio"
+          ]
+        },
+        {
+          "endpoint": "resources/templates/list",
+          "advertised": true,
+          "responded": true,
+          "minimalShapePresent": true,
+          "itemCount": 0,
+          "identifiers": [],
+          "diagnostics": [
+            "Knowledge Graph MCP Server running on stdio"
+          ]
         }
       ]
     },
@@ -327,7 +344,7 @@
       "id": "security-lite",
       "capability": "security-lite",
       "status": "pass",
-      "durationMs": 0.03662500000018554,
+      "durationMs": 0.04383400000006077,
       "message": "No security issues detected (lightweight scan).",
       "evidence": [
         {
@@ -343,7 +360,7 @@
       "id": "conformance",
       "capability": "conformance",
       "status": "pass",
-      "durationMs": 9.77066700000023,
+      "durationMs": 9.354083000000173,
       "message": "All 7 conformance checks passed.",
       "evidence": [
         {
@@ -358,7 +375,7 @@
             "[pass] server-info: Server provided initialization info.",
             "[pass] tools-capability-match: tools/list returned 9 tool(s).",
             "[pass] prompts-capability-match: Prompts not advertised — endpoint check skipped.",
-            "[pass] resources-capability-match: Resources not advertised — endpoint check skipped.",
+            "[pass] resources-capability-match: resources/list returned 1 resource(s).",
             "[pass] tool-response-content: Tool \"read_graph\" response has valid content array.",
             "[pass] error-handling: Server returned proper error code -32601 for unknown method."
           ]
@@ -369,8 +386,8 @@
       "id": "schema-quality",
       "capability": "schema-quality",
       "status": "partial",
-      "durationMs": 4.149374999999964,
-      "message": "Found 4 quality finding(s) across 9 item(s): 0 warnings, 4 info.",
+      "durationMs": 4.083458000000064,
+      "message": "Found 4 quality finding(s) across 10 item(s): 0 warnings, 4 info.",
       "evidence": [
         {
           "endpoint": "schema-quality/scan",
@@ -389,6 +406,32 @@
             "[info] tool \"create_relations\": Property 'relations' missing description",
             "[info] tool \"add_observations\": Property 'observations' missing description",
             "[info] tool \"delete_observations\": Property 'deletions' missing description"
+          ],
+          "findings": [
+            {
+              "itemType": "tool",
+              "itemName": "create_entities",
+              "issue": "Property 'entities' missing description",
+              "severity": "info"
+            },
+            {
+              "itemType": "tool",
+              "itemName": "create_relations",
+              "issue": "Property 'relations' missing description",
+              "severity": "info"
+            },
+            {
+              "itemType": "tool",
+              "itemName": "add_observations",
+              "issue": "Property 'observations' missing description",
+              "severity": "info"
+            },
+            {
+              "itemType": "tool",
+              "itemName": "delete_observations",
+              "issue": "Property 'deletions' missing description",
+              "severity": "info"
+            }
           ]
         }
       ]
@@ -397,7 +440,7 @@
       "id": "security",
       "capability": "security",
       "status": "pass",
-      "durationMs": 4.098707999999988,
+      "durationMs": 3.6132500000003347,
       "message": "No security issues detected.",
       "evidence": [
         {
@@ -408,10 +451,27 @@
           "itemCount": 0
         }
       ]
+    },
+    {
+      "id": "attack-sim",
+      "capability": "attack-sim",
+      "status": "pass",
+      "durationMs": 3.8723329999997986,
+      "message": "Safe attack simulation found no high-risk MCP attack-readiness findings.",
+      "evidence": [
+        {
+          "endpoint": "attack-sim/safe",
+          "advertised": true,
+          "responded": true,
+          "minimalShapePresent": true,
+          "itemCount": 0,
+          "identifiers": []
+        }
+      ]
     }
   ],
   "healthScore": {
-    "overall": 85,
+    "overall": 89,
     "grade": "B",
     "dimensions": [
       {
@@ -436,17 +496,18 @@
         "score": 100,
         "details": [
           "security-lite: pass (100/100)",
-          "security: pass (100/100)"
+          "security: pass (100/100)",
+          "attack-sim: pass (100/100)"
         ]
       },
       {
         "name": "Reliability",
         "weight": 0.2,
-        "score": 67,
+        "score": 83,
         "details": [
           "tools: pass (100/100)",
           "prompts: unsupported (50/100)",
-          "resources: unsupported (50/100)"
+          "resources: pass (100/100)"
         ]
       },
       {
@@ -454,16 +515,16 @@
         "weight": 0.1,
         "score": 100,
         "details": [
-          "Connect: 703ms",
-          "p95 latency: 7ms (3 operations)"
+          "Connect: 628ms",
+          "p95 latency: 8ms (3 operations)"
         ]
       }
     ]
   },
   "performanceMetrics": {
-    "connectMs": 703.391959,
-    "toolsListMs": 7.443624999999884,
-    "promptsListMs": 0.0019579999998313724,
-    "resourcesListMs": 0.001374999999825377
+    "connectMs": 628.0643749999999,
+    "toolsListMs": 7.618457999999919,
+    "promptsListMs": 0.0020410000001902517,
+    "resourcesListMs": 1.1717079999998532
   }
 }

package/docs/safety-index/artifacts/memory-server.md

@@ -1,6 +1,6 @@
 # MCP Observatory Run Report
 
-Generated at 2026-06-24T02:07:23.256Z
+Generated at 2026-07-06T19:49:46.771Z
 
 ## Target and Environment Metadata
 
@@ -13,29 +13,29 @@ Generated at 2026-06-24T02:07:23.256Z
 
 ## Executive Summary
 
-**Health Score: 85/100 (B)**
+**Health Score: 89/100 (B)**
 
 | Dimension | Score | Weight |
 | --- | --- | --- |
 | Protocol Compliance | 100/100 | 30% |
 | Schema Quality | 60/100 | 20% |
 | Security | 100/100 | 20% |
-| Reliability | 67/100 | 20% |
+| Reliability | 83/100 | 20% |
 | Performance | 100/100 | 10% |
 
 | Gate | Total | Pass | Fail | Partial | Unsupported | Flaky | Skipped |
 | --- | --- | --- | --- | --- | --- | --- | --- |
-| pass | 7 | 4 | 0 | 1 | 2 | 0 | 0 |
+| pass | 8 | 6 | 0 | 1 | 1 | 0 | 0 |
 
 ## At a Glance
 
 - Safety verdict: **Needs review** — The server is usable, but caveated checks should be reviewed before agents depend on it.
-- Top risks: schema-quality: Found 4 quality finding(s) across 9 item(s): 0 warnings, 4 info.
+- Top risks: schema-quality: Found 4 quality finding(s) across 10 item(s): 0 warnings, 4 info.
 - Regression/schema drift: Run `mcp-observatory diff <previous-run.json> <current-run.json>` to classify regressions and schema drift.
 - Failing checks: none
 - Partial or flaky checks: schema-quality
 - Skipped checks: none
-- Unsupported checks: prompts, resources
+- Unsupported checks: prompts
 - Suggested next step: Review the caveated checks next: schema-quality.
 - CI next step: `Add CI: npx @kryptosai/mcp-observatory setup-ci --all --command "npx -y <server-package>"`
 
@@ -47,16 +47,29 @@ _Use the `diff` command against another run artifact to classify regressions and
 
 | Focus | Check | Status | Duration (ms) | Message |
 | --- | --- | --- | --- | --- |
-| healthy | conformance | pass | 9.77 | All 7 conformance checks passed. |
-| healthy | security | pass | 4.10 | No security issues detected. |
+| healthy | attack-sim | pass | 3.87 | Safe attack simulation found no high-risk MCP attack-readiness findings. |
+| healthy | conformance | pass | 9.35 | All 7 conformance checks passed. |
+| healthy | resources | pass | 1.17 | Advertised capability responded with the minimal expected shape (1 items). |
+| healthy | security | pass | 3.61 | No security issues detected. |
 | healthy | security-lite | pass | 0.04 | No security issues detected (lightweight scan). |
-| healthy | tools | pass | 7.44 | Advertised capability responded with the minimal expected shape (9 items). |
-| review | schema-quality | partial | 4.15 | Found 4 quality finding(s) across 9 item(s): 0 warnings, 4 info. |
+| healthy | tools | pass | 7.62 | Advertised capability responded with the minimal expected shape (9 items). |
+| review | schema-quality | partial | 4.08 | Found 4 quality finding(s) across 10 item(s): 0 warnings, 4 info. |
 | confirm intent | prompts | unsupported | 0.00 | Prompts are not advertised by the target. |
-| confirm intent | resources | unsupported | 0.00 | Resources are not advertised by the target. |
 
 ## Evidence Snippets
 
+### attack-sim — pass
+
+Summary: Safe attack simulation found no high-risk MCP attack-readiness findings.
+
+- Endpoint: `attack-sim/safe`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `0`
+  - Identifiers: none
+  - Diagnostics: none
+
 ### conformance — pass
 
 Summary: All 7 conformance checks passed.
@@ -69,6 +82,25 @@ Summary: All 7 conformance checks passed.
   - Identifiers: none
   - Diagnostics: [pass] capabilities-present: Server returned capabilities object., [pass] server-info: Server provided initialization info., [pass] tools-capability-match: tools/list returned 9 tool(s). (+4 more)
 
+### resources — pass
+
+Summary: Advertised capability responded with the minimal expected shape (1 items).
+
+- Endpoint: `resources/list`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `1`
+  - Identifiers: memory://knowledge-graph
+  - Diagnostics: Knowledge Graph MCP Server running on stdio
+- Endpoint: `resources/templates/list`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `0`
+  - Identifiers: none
+  - Diagnostics: Knowledge Graph MCP Server running on stdio
+
 ### security — pass
 
 Summary: No security issues detected.
@@ -107,7 +139,7 @@ Summary: Advertised capability responded with the minimal expected shape (9 item
 
 ### schema-quality — partial
 
-Summary: Found 4 quality finding(s) across 9 item(s): 0 warnings, 4 info.
+Summary: Found 4 quality finding(s) across 10 item(s): 0 warnings, 4 info.
 
 - Endpoint: `schema-quality/scan`
   - Advertised: `true`
@@ -129,18 +161,6 @@ Summary: Prompts are not advertised by the target.
   - Identifiers: none
   - Diagnostics: none
 
-### resources — unsupported
-
-Summary: Resources are not advertised by the target.
-
-- Endpoint: `resources/list | resources/templates/list`
-  - Advertised: `false`
-  - Responded: `false`
-  - Minimal shape present: `false`
-  - Item count: `0`
-  - Identifiers: none
-  - Diagnostics: none
-
 ## Reproduction Commands
 
 ```bash
@@ -152,5 +172,5 @@ npm run cli -- report --run <path-to-run-artifact.json> --format markdown
 
 - Artifact type: `run`
 - Schema version: `1.0.0`
-- Run ID: `run_2026-06-24T020723256Z_467de620`
+- Run ID: `run_2026-07-06T194946771Z_35b0da26`
 - Gate: `pass`