@kryptosai/mcp-observatory 0.23.0 → 0.24.0

package/docs/safety-index/artifacts/memory-server.md

@@ -0,0 +1,156 @@
+# MCP Observatory Run Report
+
+Generated at 2026-06-24T02:07:23.256Z
+
+## Target and Environment Metadata
+
+- Target: `memory-server`
+- Adapter: `local-process`
+- Command: `npx -y @modelcontextprotocol/server-memory`
+- Server: `memory-server 0.6.3`
+- Platform: `darwin 25.5.0`
+- Node: `v22.22.1`
+
+## Executive Summary
+
+**Health Score: 85/100 (B)**
+
+| Dimension | Score | Weight |
+| --- | --- | --- |
+| Protocol Compliance | 100/100 | 30% |
+| Schema Quality | 60/100 | 20% |
+| Security | 100/100 | 20% |
+| Reliability | 67/100 | 20% |
+| Performance | 100/100 | 10% |
+
+| Gate | Total | Pass | Fail | Partial | Unsupported | Flaky | Skipped |
+| --- | --- | --- | --- | --- | --- | --- | --- |
+| pass | 7 | 4 | 0 | 1 | 2 | 0 | 0 |
+
+## At a Glance
+
+- Safety verdict: **Needs review** — The server is usable, but caveated checks should be reviewed before agents depend on it.
+- Top risks: schema-quality: Found 4 quality finding(s) across 9 item(s): 0 warnings, 4 info.
+- Regression/schema drift: Run `mcp-observatory diff <previous-run.json> <current-run.json>` to classify regressions and schema drift.
+- Failing checks: none
+- Partial or flaky checks: schema-quality
+- Skipped checks: none
+- Unsupported checks: prompts, resources
+- Suggested next step: Review the caveated checks next: schema-quality.
+- CI next step: `Add CI: npx @kryptosai/mcp-observatory init-ci --all --command "npx -y <server-package>"`
+
+## Regressions and Recoveries
+
+_Use the `diff` command against another run artifact to classify regressions and recoveries over time._
+
+## Full Capability Status Table
+
+| Focus | Check | Status | Duration (ms) | Message |
+| --- | --- | --- | --- | --- |
+| healthy | conformance | pass | 9.77 | All 7 conformance checks passed. |
+| healthy | security | pass | 4.10 | No security issues detected. |
+| healthy | security-lite | pass | 0.04 | No security issues detected (lightweight scan). |
+| healthy | tools | pass | 7.44 | Advertised capability responded with the minimal expected shape (9 items). |
+| review | schema-quality | partial | 4.15 | Found 4 quality finding(s) across 9 item(s): 0 warnings, 4 info. |
+| confirm intent | prompts | unsupported | 0.00 | Prompts are not advertised by the target. |
+| confirm intent | resources | unsupported | 0.00 | Resources are not advertised by the target. |
+
+## Evidence Snippets
+
+### conformance — pass
+
+Summary: All 7 conformance checks passed.
+
+- Endpoint: `conformance/check`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `7`
+  - Identifiers: none
+  - Diagnostics: [pass] capabilities-present: Server returned capabilities object., [pass] server-info: Server provided initialization info., [pass] tools-capability-match: tools/list returned 9 tool(s). (+4 more)
+
+### security — pass
+
+Summary: No security issues detected.
+
+- Endpoint: `security/scan`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `0`
+  - Identifiers: none
+  - Diagnostics: none
+
+### security-lite — pass
+
+Summary: No security issues detected (lightweight scan).
+
+- Endpoint: `security/scan-lite`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `0`
+  - Identifiers: none
+  - Diagnostics: none
+
+### tools — pass
+
+Summary: Advertised capability responded with the minimal expected shape (9 items).
+
+- Endpoint: `tools/list`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `9`
+  - Identifiers: create_entities, create_relations, add_observations, delete_entities, delete_observations (+4 more)
+  - Diagnostics: Knowledge Graph MCP Server running on stdio
+
+### schema-quality — partial
+
+Summary: Found 4 quality finding(s) across 9 item(s): 0 warnings, 4 info.
+
+- Endpoint: `schema-quality/scan`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `4`
+  - Identifiers: create_entities, create_relations, add_observations, delete_observations
+  - Diagnostics: [info] tool "create_entities": Property 'entities' missing description, [info] tool "create_relations": Property 'relations' missing description, [info] tool "add_observations": Property 'observations' missing description (+1 more)
+
+### prompts — unsupported
+
+Summary: Prompts are not advertised by the target.
+
+- Endpoint: `prompts/list`
+  - Advertised: `false`
+  - Responded: `false`
+  - Minimal shape present: `false`
+  - Item count: `0`
+  - Identifiers: none
+  - Diagnostics: none
+
+### resources — unsupported
+
+Summary: Resources are not advertised by the target.
+
+- Endpoint: `resources/list | resources/templates/list`
+  - Advertised: `false`
+  - Responded: `false`
+  - Minimal shape present: `false`
+  - Item count: `0`
+  - Identifiers: none
+  - Diagnostics: none
+
+## Reproduction Commands
+
+```bash
+npm run cli -- run --target <path-to-target-config.json>
+npm run cli -- report --run <path-to-run-artifact.json> --format markdown
+```
+
+## Artifact Provenance
+
+- Artifact type: `run`
+- Schema version: `1.0.0`
+- Run ID: `run_2026-06-24T020723256Z_467de620`
+- Gate: `pass`

package/docs/safety-index/artifacts/opentofu-server.json

@@ -0,0 +1,387 @@
+{
+  "artifactType": "run",
+  "schemaVersion": "1.0.0",
+  "gate": "pass",
+  "runId": "run_2026-06-24T020729328Z_2a54782d",
+  "createdAt": "2026-06-24T02:07:29.328Z",
+  "toolVersion": "0.24.0",
+  "target": {
+    "targetId": "opentofu-server",
+    "adapter": "local-process",
+    "command": "npx",
+    "args": [
+      "-y",
+      "@opentofu/opentofu-mcp-server"
+    ],
+    "cwd": ".",
+    "metadata": {
+      "package": "@opentofu/opentofu-mcp-server",
+      "purpose": "mcp-safety-index",
+      "riskClass": "Infrastructure-as-code",
+      "failureClass": "Infrastructure tool surface",
+      "whyItMatters": "Infrastructure tools can influence production configuration and should have reviewable MCP surfaces."
+    },
+    "serverName": "opentofu",
+    "serverVersion": "0.1.0"
+  },
+  "environment": {
+    "platform": "darwin 25.5.0",
+    "nodeVersion": "v22.22.1"
+  },
+  "summary": {
+    "total": 7,
+    "pass": 5,
+    "fail": 0,
+    "partial": 1,
+    "unsupported": 1,
+    "flaky": 0,
+    "skipped": 0,
+    "gate": "pass"
+  },
+  "checks": [
+    {
+      "id": "tools",
+      "capability": "tools",
+      "status": "pass",
+      "durationMs": 2.47979099999975,
+      "message": "Advertised capability responded with the minimal expected shape (5 items).",
+      "evidence": [
+        {
+          "endpoint": "tools/list",
+          "advertised": true,
+          "responded": true,
+          "minimalShapePresent": true,
+          "itemCount": 5,
+          "identifiers": [
+            "search-opentofu-registry",
+            "get-provider-details",
+            "get-module-details",
+            "get-resource-docs",
+            "get-datasource-docs"
+          ],
+          "diagnostics": [],
+          "schemas": {
+            "search-opentofu-registry": {
+              "type": "object",
+              "properties": {
+                "query": {
+                  "type": "string",
+                  "minLength": 2,
+                  "description": "Search query for finding OpenTofu components (e.g., 'aws', 'kubernetes', 'database', 's3')"
+                },
+                "type": {
+                  "type": "string",
+                  "enum": [
+                    "provider",
+                    "module",
+                    "resource",
+                    "data-source",
+                    "all"
+                  ],
+                  "default": "all",
+                  "description": "Type of registry items to search for"
+                }
+              },
+              "required": [
+                "query"
+              ],
+              "additionalProperties": false,
+              "$schema": "http://json-schema.org/draft-07/schema#"
+            },
+            "get-provider-details": {
+              "type": "object",
+              "properties": {
+                "namespace": {
+                  "type": "string",
+                  "minLength": 1,
+                  "description": "Provider namespace (e.g., 'hashicorp', 'opentofu')"
+                },
+                "name": {
+                  "type": "string",
+                  "minLength": 1,
+                  "description": "Provider name WITHOUT 'terraform-provider-' prefix (e.g., 'aws', 'kubernetes', 'azurerm')"
+                }
+              },
+              "required": [
+                "namespace",
+                "name"
+              ],
+              "additionalProperties": false,
+              "$schema": "http://json-schema.org/draft-07/schema#"
+            },
+            "get-module-details": {
+              "type": "object",
+              "properties": {
+                "namespace": {
+                  "type": "string",
+                  "minLength": 1,
+                  "description": "Module namespace without prefix (e.g., 'terraform-aws-modules')"
+                },
+                "name": {
+                  "type": "string",
+                  "minLength": 1,
+                  "description": "Simple module name WITHOUT 'terraform-aws-' or similar prefix (e.g., 'vpc', 's3-bucket')"
+                },
+                "target": {
+                  "type": "string",
+                  "minLength": 1,
+                  "description": "Module target platform (e.g., 'aws', 'kubernetes', 'azurerm')"
+                }
+              },
+              "required": [
+                "namespace",
+                "name",
+                "target"
+              ],
+              "additionalProperties": false,
+              "$schema": "http://json-schema.org/draft-07/schema#"
+            },
+            "get-resource-docs": {
+              "type": "object",
+              "properties": {
+                "namespace": {
+                  "type": "string",
+                  "minLength": 1,
+                  "description": "Provider namespace (e.g., 'hashicorp', 'opentofu')"
+                },
+                "name": {
+                  "type": "string",
+                  "minLength": 1,
+                  "description": "Provider name WITHOUT 'terraform-provider-' prefix (e.g., 'aws', 'kubernetes')"
+                },
+                "resource": {
+                  "type": "string",
+                  "minLength": 1,
+                  "description": "Resource name WITHOUT provider prefix (e.g., 's3_bucket', 'instance')"
+                },
+                "version": {
+                  "type": "string",
+                  "description": "Provider version (e.g., 'v4.0.0'). If not specified, latest version will be used"
+                }
+              },
+              "required": [
+                "namespace",
+                "name",
+                "resource"
+              ],
+              "additionalProperties": false,
+              "$schema": "http://json-schema.org/draft-07/schema#"
+            },
+            "get-datasource-docs": {
+              "type": "object",
+              "properties": {
+                "namespace": {
+                  "type": "string",
+                  "minLength": 1,
+                  "description": "Provider namespace (e.g., 'hashicorp', 'opentofu')"
+                },
+                "name": {
+                  "type": "string",
+                  "minLength": 1,
+                  "description": "Provider name WITHOUT 'terraform-provider-' prefix (e.g., 'aws', 'kubernetes')"
+                },
+                "dataSource": {
+                  "type": "string",
+                  "minLength": 1,
+                  "description": "Data source name WITHOUT provider prefix (e.g., 'ami', 'vpc')"
+                },
+                "version": {
+                  "type": "string",
+                  "description": "Provider version (e.g., 'v4.0.0'). If not specified, latest version will be used"
+                }
+              },
+              "required": [
+                "namespace",
+                "name",
+                "dataSource"
+              ],
+              "additionalProperties": false,
+              "$schema": "http://json-schema.org/draft-07/schema#"
+            }
+          }
+        }
+      ]
+    },
+    {
+      "id": "prompts",
+      "capability": "prompts",
+      "status": "unsupported",
+      "durationMs": 0.0038340000010066433,
+      "message": "Prompts are not advertised by the target.",
+      "evidence": [
+        {
+          "endpoint": "prompts/list",
+          "advertised": false,
+          "responded": false,
+          "minimalShapePresent": false,
+          "diagnostics": []
+        }
+      ]
+    },
+    {
+      "id": "resources",
+      "capability": "resources",
+      "status": "pass",
+      "durationMs": 1.4208330000001297,
+      "message": "Advertised capability responded with the minimal expected shape (1 items).",
+      "evidence": [
+        {
+          "endpoint": "resources/list",
+          "advertised": true,
+          "responded": true,
+          "minimalShapePresent": true,
+          "itemCount": 1,
+          "identifiers": [
+            "opentofu:registry-info"
+          ],
+          "diagnostics": []
+        },
+        {
+          "endpoint": "resources/templates/list",
+          "advertised": true,
+          "responded": true,
+          "minimalShapePresent": true,
+          "itemCount": 0,
+          "identifiers": [],
+          "diagnostics": []
+        }
+      ]
+    },
+    {
+      "id": "security-lite",
+      "capability": "security-lite",
+      "status": "pass",
+      "durationMs": 0.03974999999991269,
+      "message": "No security issues detected (lightweight scan).",
+      "evidence": [
+        {
+          "endpoint": "security/scan-lite",
+          "advertised": true,
+          "responded": true,
+          "minimalShapePresent": true,
+          "itemCount": 0
+        }
+      ]
+    },
+    {
+      "id": "conformance",
+      "capability": "conformance",
+      "status": "pass",
+      "durationMs": 2.5802920000005543,
+      "message": "All 7 conformance checks passed.",
+      "evidence": [
+        {
+          "endpoint": "conformance/check",
+          "advertised": true,
+          "responded": true,
+          "minimalShapePresent": true,
+          "itemCount": 7,
+          "identifiers": [],
+          "diagnostics": [
+            "[pass] capabilities-present: Server returned capabilities object.",
+            "[pass] server-info: Server provided initialization info.",
+            "[pass] tools-capability-match: tools/list returned 5 tool(s).",
+            "[pass] prompts-capability-match: Prompts not advertised — endpoint check skipped.",
+            "[pass] resources-capability-match: resources/list returned 1 resource(s).",
+            "[pass] tool-response-content: No safe tool to invoke — content validation skipped.",
+            "[pass] error-handling: Server returned proper error code -32601 for unknown method."
+          ]
+        }
+      ]
+    },
+    {
+      "id": "schema-quality",
+      "capability": "schema-quality",
+      "status": "partial",
+      "durationMs": 0.7996249999996508,
+      "message": "Found 1 quality finding(s) across 6 item(s): 1 warnings, 0 info.",
+      "evidence": [
+        {
+          "endpoint": "schema-quality/scan",
+          "advertised": true,
+          "responded": true,
+          "minimalShapePresent": true,
+          "itemCount": 1,
+          "identifiers": [
+            "opentofu-registry-info"
+          ],
+          "diagnostics": [
+            "[warning] resource \"opentofu-registry-info\": Missing description"
+          ]
+        }
+      ]
+    },
+    {
+      "id": "security",
+      "capability": "security",
+      "status": "pass",
+      "durationMs": 0.36629200000061246,
+      "message": "No security issues detected.",
+      "evidence": [
+        {
+          "endpoint": "security/scan",
+          "advertised": true,
+          "responded": true,
+          "minimalShapePresent": true,
+          "itemCount": 0
+        }
+      ]
+    }
+  ],
+  "healthScore": {
+    "overall": 89,
+    "grade": "B",
+    "dimensions": [
+      {
+        "name": "Protocol Compliance",
+        "weight": 0.3,
+        "score": 100,
+        "details": [
+          "conformance: pass (100/100)"
+        ]
+      },
+      {
+        "name": "Schema Quality",
+        "weight": 0.2,
+        "score": 60,
+        "details": [
+          "schema-quality: partial (60/100)"
+        ]
+      },
+      {
+        "name": "Security",
+        "weight": 0.2,
+        "score": 100,
+        "details": [
+          "security-lite: pass (100/100)",
+          "security: pass (100/100)"
+        ]
+      },
+      {
+        "name": "Reliability",
+        "weight": 0.2,
+        "score": 83,
+        "details": [
+          "tools: pass (100/100)",
+          "prompts: unsupported (50/100)",
+          "resources: pass (100/100)"
+        ]
+      },
+      {
+        "name": "Performance",
+        "weight": 0.1,
+        "score": 100,
+        "details": [
+          "Connect: 940ms",
+          "p95 latency: 2ms (3 operations)"
+        ]
+      }
+    ]
+  },
+  "performanceMetrics": {
+    "connectMs": 940.4044579999991,
+    "toolsListMs": 2.47979099999975,
+    "promptsListMs": 0.0038340000010066433,
+    "resourcesListMs": 1.4208330000001297
+  }
+}

package/docs/safety-index/artifacts/opentofu-server.md

@@ -0,0 +1,163 @@
+# MCP Observatory Run Report
+
+Generated at 2026-06-24T02:07:29.328Z
+
+## Target and Environment Metadata
+
+- Target: `opentofu-server`
+- Adapter: `local-process`
+- Command: `npx -y @opentofu/opentofu-mcp-server`
+- Server: `opentofu 0.1.0`
+- Platform: `darwin 25.5.0`
+- Node: `v22.22.1`
+
+## Executive Summary
+
+**Health Score: 89/100 (B)**
+
+| Dimension | Score | Weight |
+| --- | --- | --- |
+| Protocol Compliance | 100/100 | 30% |
+| Schema Quality | 60/100 | 20% |
+| Security | 100/100 | 20% |
+| Reliability | 83/100 | 20% |
+| Performance | 100/100 | 10% |
+
+| Gate | Total | Pass | Fail | Partial | Unsupported | Flaky | Skipped |
+| --- | --- | --- | --- | --- | --- | --- | --- |
+| pass | 7 | 5 | 0 | 1 | 1 | 0 | 0 |
+
+## At a Glance
+
+- Safety verdict: **Needs review** — The server is usable, but caveated checks should be reviewed before agents depend on it.
+- Top risks: schema-quality: Found 1 quality finding(s) across 6 item(s): 1 warnings, 0 info.
+- Regression/schema drift: Run `mcp-observatory diff <previous-run.json> <current-run.json>` to classify regressions and schema drift.
+- Failing checks: none
+- Partial or flaky checks: schema-quality
+- Skipped checks: none
+- Unsupported checks: prompts
+- Suggested next step: Review the caveated checks next: schema-quality.
+- CI next step: `Add CI: npx @kryptosai/mcp-observatory init-ci --all --command "npx -y <server-package>"`
+
+## Regressions and Recoveries
+
+_Use the `diff` command against another run artifact to classify regressions and recoveries over time._
+
+## Full Capability Status Table
+
+| Focus | Check | Status | Duration (ms) | Message |
+| --- | --- | --- | --- | --- |
+| healthy | conformance | pass | 2.58 | All 7 conformance checks passed. |
+| healthy | resources | pass | 1.42 | Advertised capability responded with the minimal expected shape (1 items). |
+| healthy | security | pass | 0.37 | No security issues detected. |
+| healthy | security-lite | pass | 0.04 | No security issues detected (lightweight scan). |
+| healthy | tools | pass | 2.48 | Advertised capability responded with the minimal expected shape (5 items). |
+| review | schema-quality | partial | 0.80 | Found 1 quality finding(s) across 6 item(s): 1 warnings, 0 info. |
+| confirm intent | prompts | unsupported | 0.00 | Prompts are not advertised by the target. |
+
+## Evidence Snippets
+
+### conformance — pass
+
+Summary: All 7 conformance checks passed.
+
+- Endpoint: `conformance/check`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `7`
+  - Identifiers: none
+  - Diagnostics: [pass] capabilities-present: Server returned capabilities object., [pass] server-info: Server provided initialization info., [pass] tools-capability-match: tools/list returned 5 tool(s). (+4 more)
+
+### resources — pass
+
+Summary: Advertised capability responded with the minimal expected shape (1 items).
+
+- Endpoint: `resources/list`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `1`
+  - Identifiers: opentofu:registry-info
+  - Diagnostics: none
+- Endpoint: `resources/templates/list`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `0`
+  - Identifiers: none
+  - Diagnostics: none
+
+### security — pass
+
+Summary: No security issues detected.
+
+- Endpoint: `security/scan`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `0`
+  - Identifiers: none
+  - Diagnostics: none
+
+### security-lite — pass
+
+Summary: No security issues detected (lightweight scan).
+
+- Endpoint: `security/scan-lite`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `0`
+  - Identifiers: none
+  - Diagnostics: none
+
+### tools — pass
+
+Summary: Advertised capability responded with the minimal expected shape (5 items).
+
+- Endpoint: `tools/list`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `5`
+  - Identifiers: search-opentofu-registry, get-provider-details, get-module-details, get-resource-docs, get-datasource-docs
+  - Diagnostics: none
+
+### schema-quality — partial
+
+Summary: Found 1 quality finding(s) across 6 item(s): 1 warnings, 0 info.
+
+- Endpoint: `schema-quality/scan`
+  - Advertised: `true`
+  - Responded: `true`
+  - Minimal shape present: `true`
+  - Item count: `1`
+  - Identifiers: opentofu-registry-info
+  - Diagnostics: [warning] resource "opentofu-registry-info": Missing description
+
+### prompts — unsupported
+
+Summary: Prompts are not advertised by the target.
+
+- Endpoint: `prompts/list`
+  - Advertised: `false`
+  - Responded: `false`
+  - Minimal shape present: `false`
+  - Item count: `0`
+  - Identifiers: none
+  - Diagnostics: none
+
+## Reproduction Commands
+
+```bash
+npm run cli -- run --target <path-to-target-config.json>
+npm run cli -- report --run <path-to-run-artifact.json> --format markdown
+```
+
+## Artifact Provenance
+
+- Artifact type: `run`
+- Schema version: `1.0.0`
+- Run ID: `run_2026-06-24T020729328Z_2a54782d`
+- Gate: `pass`