harness-everything 0.36.4 → 0.38.0

package/.claude-plugin/marketplace.json

@@ -10,7 +10,7 @@
       "name": "harness-everything",
       "source": "./",
       "description": "Harness OS: an orchestrated agent operating system — tier routing, circuit breaker guardrails, verification gates, WAL session memory, and self-evolving workspace rules.",
-      "version": "0.36.4",
+      "version": "0.38.0",
       "author": {
         "name": "Miya Daniel"
       },

package/.claude-plugin/plugin.json

@@ -1,7 +1,7 @@
 {
   "name": "harness-everything",
   "description": "Harness OS: an orchestrated agent operating system — tier routing, circuit breaker guardrails, verification gates, WAL session memory, and self-evolving workspace rules.",
-  "version": "0.36.4",
+  "version": "0.38.0",
   "author": {
     "name": "Miya Daniel"
   },

package/CHANGELOG.md

@@ -2,6 +2,28 @@
 
 All notable changes to this project are documented in this file.
 
+## [0.38.0](https://github.com/dyphn1/Harness-everything/compare/v0.37.0...v0.38.0) (2026-10-21)
+
+### Features
+
+* **doc-lifecycle:** add default-off s1 document reconciliation gate ([#325](https://github.com/dyphn1/Harness-everything/issues/325)) ([8903435](https://github.com/dyphn1/Harness-everything/commit/8903435efa04e0e142a70d26caa9c0c4b78a7834)), closes [#341](https://github.com/dyphn1/Harness-everything/issues/341)
+
+### Bug Fixes
+
+* **doc-lifecycle:** keep the stop decision when the session store is unwritable ([#325](https://github.com/dyphn1/Harness-everything/issues/325)) ([8c8d6fa](https://github.com/dyphn1/Harness-everything/commit/8c8d6faa7a3fc9b239dbe520981b69f99d0b6c90))
+* **doc-lifecycle:** scope stop persistence recovery to an actual withheld pilot run ([#325](https://github.com/dyphn1/Harness-everything/issues/325)) ([0f766ef](https://github.com/dyphn1/Harness-everything/commit/0f766efe67a76606144ae97ad703e0789ab4bce8))
+* **doc-lifecycle:** withhold on config scope change and failed withholding writes ([#325](https://github.com/dyphn1/Harness-everything/issues/325)) ([dc04db8](https://github.com/dyphn1/Harness-everything/commit/dc04db8d573339604f32a28ec1a8a65fcffe10a1))
+
+## [Unreleased]
+
+- Ship default-OFF Phase 3b S1 scope assessment and no-credit runtime gate (opt in with `HARNESS_DOC_RECONCILIATION_PILOT=1`); S2 pending (S3 shipped in 0.37.0), E1 not started.
+
+## [0.37.0](https://github.com/dyphn1/Harness-everything/compare/v0.36.4...v0.37.0) (2026-10-21)
+
+### Features
+
+* **doc-lifecycle:** add pure advisory doc provider suggestions ([#325](https://github.com/dyphn1/Harness-everything/issues/325)) ([cffe1d2](https://github.com/dyphn1/Harness-everything/commit/cffe1d277375adc318f3d0d52267e94d3f3253f0))
+
 ## [0.36.4](https://github.com/dyphn1/Harness-everything/compare/v0.36.3...v0.36.4) (2026-10-21)
 
 ## [0.36.3](https://github.com/dyphn1/Harness-everything/compare/v0.36.2...v0.36.3) (2026-10-20)
@@ -71,6 +93,8 @@ All notable changes to this project are documented in this file.
 
 ## [Unreleased]
 
+- Ship the S3 pure advisory provider suggestion function (`suggestDocProviders`) with strict validation and active-step filtering; it is not wired into workflow integration yet.
+
 ### Documentation
 
 * **doc-evidence:** define role-scoped read consistency, compatibility traces, and Phase 0 conformance limits

package/ci/fixtures/doc-obligations/providers-s3/cases.json

@@ -0,0 +1,535 @@
+{
+  "schemaVersion": 1,
+  "phase": "325-3b-S3",
+  "description": "S3 advisory provider suggestion cases. Expected outputs are hand-derived from docs/doc-workflow-reconciliation.md (S3 section) and are the RED oracle. The three contract examples live in reconciliation-prep/provider-contract.json and are read directly by the suite. Kinds: valid (exact output with suggestions and unavailable only), malformed (structured invalid-input result). Reason strings: 'active-step capability and host requirements match'; 'host lacks <sorted missing, joined with ', '>'; 'no available provider metadata for the active-step capability'; invalid-input.",
+  "cases": [
+    {
+      "id": "H2-future-step-not-suggested",
+      "kind": "valid",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["outline-confirmation"],
+        "availableProviderMetadata": [
+          { "providerId": "fixture-future-outline", "capabilities": ["outline-confirmation"], "stepTypes": ["doc-change"], "requiresHostCapabilities": [], "locator": { "kind": "binding", "id": "to-spec" } }
+        ],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "suggestions": [],
+        "unavailable": [{ "capability": "outline-confirmation", "reason": "no available provider metadata for the active-step capability" }]
+      }
+    },
+    {
+      "id": "H2-unneeded-capability-not-suggested",
+      "kind": "valid",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [
+          { "providerId": "fixture-multi", "capabilities": ["doc-lint", "quality-review"], "stepTypes": ["verification"], "requiresHostCapabilities": [], "locator": { "kind": "tool", "id": "fixture-multi" } }
+        ],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "suggestions": [
+          { "capability": "doc-lint", "providerId": "fixture-multi", "availability": "available", "reason": "active-step capability and host requirements match" }
+        ],
+        "unavailable": []
+      }
+    },
+    {
+      "id": "multi-capability-record-one-suggestion-per-match",
+      "kind": "valid",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint", "quality-review"],
+        "availableProviderMetadata": [
+          { "providerId": "fixture-multi", "capabilities": ["doc-lint", "quality-review"], "stepTypes": ["verification"], "requiresHostCapabilities": [], "locator": { "kind": "tool", "id": "fixture-multi" } }
+        ],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "suggestions": [
+          { "capability": "doc-lint", "providerId": "fixture-multi", "availability": "available", "reason": "active-step capability and host requirements match" },
+          { "capability": "quality-review", "providerId": "fixture-multi", "availability": "available", "reason": "active-step capability and host requirements match" }
+        ],
+        "unavailable": []
+      }
+    },
+    {
+      "id": "host-unmet-multiple-requirements-sorted-reason",
+      "kind": "valid",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [
+          { "providerId": "fixture-two-host", "capabilities": ["doc-lint"], "stepTypes": ["verification"], "requiresHostCapabilities": ["independent-review-events", "execution-events"], "locator": { "kind": "tool", "id": "fixture-two-host" } }
+        ],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "suggestions": [
+          { "capability": "doc-lint", "providerId": "fixture-two-host", "availability": "unavailable", "reason": "host lacks execution-events, independent-review-events" }
+        ],
+        "unavailable": [
+          { "capability": "doc-lint", "reason": "host lacks execution-events, independent-review-events" }
+        ]
+      }
+    },
+    {
+      "id": "host-all-requirements-present-available",
+      "kind": "valid",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [
+          { "providerId": "fixture-two-host", "capabilities": ["doc-lint"], "stepTypes": ["verification"], "requiresHostCapabilities": ["execution-events", "independent-review-events"], "locator": { "kind": "tool", "id": "fixture-two-host" } }
+        ],
+        "hostCapabilities": ["execution-events", "independent-review-events"]
+      },
+      "expected": {
+        "suggestions": [
+          { "capability": "doc-lint", "providerId": "fixture-two-host", "availability": "available", "reason": "active-step capability and host requirements match" }
+        ],
+        "unavailable": []
+      }
+    },
+    {
+      "id": "two-candidates-one-blocked-one-available",
+      "kind": "valid",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [
+          { "providerId": "fixture-open", "capabilities": ["doc-lint"], "stepTypes": ["verification"], "requiresHostCapabilities": [], "locator": { "kind": "tool", "id": "fixture-open" } },
+          { "providerId": "fixture-blocked", "capabilities": ["doc-lint"], "stepTypes": ["verification"], "requiresHostCapabilities": ["execution-events"], "locator": { "kind": "tool", "id": "fixture-blocked" } }
+        ],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "suggestions": [
+          { "capability": "doc-lint", "providerId": "fixture-blocked", "availability": "unavailable", "reason": "host lacks execution-events" },
+          { "capability": "doc-lint", "providerId": "fixture-open", "availability": "available", "reason": "active-step capability and host requirements match" }
+        ],
+        "unavailable": []
+      }
+    },
+    {
+      "id": "two-blocked-candidates-reasons-joined-distinct-sorted",
+      "kind": "valid",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [
+          { "providerId": "fixture-a", "capabilities": ["doc-lint"], "stepTypes": ["verification"], "requiresHostCapabilities": ["execution-events"], "locator": { "kind": "tool", "id": "fixture-a" } },
+          { "providerId": "fixture-b", "capabilities": ["doc-lint"], "stepTypes": ["verification"], "requiresHostCapabilities": ["independent-review-events"], "locator": { "kind": "tool", "id": "fixture-b" } }
+        ],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "suggestions": [
+          { "capability": "doc-lint", "providerId": "fixture-a", "availability": "unavailable", "reason": "host lacks execution-events" },
+          { "capability": "doc-lint", "providerId": "fixture-b", "availability": "unavailable", "reason": "host lacks independent-review-events" }
+        ],
+        "unavailable": [
+          { "capability": "doc-lint", "reason": "host lacks execution-events; host lacks independent-review-events" }
+        ]
+      }
+    },
+    {
+      "id": "no-metadata-each-needed-capability-sorted",
+      "kind": "valid",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["quality-review", "doc-lint"],
+        "availableProviderMetadata": [],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "suggestions": [],
+        "unavailable": [
+          { "capability": "doc-lint", "reason": "no available provider metadata for the active-step capability" },
+          { "capability": "quality-review", "reason": "no available provider metadata for the active-step capability" }
+        ]
+      }
+    },
+    {
+      "id": "H1-omit-all-providers-keeps-every-needed-capability",
+      "kind": "valid",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint", "quality-review"],
+        "availableProviderMetadata": [],
+        "hostCapabilities": ["execution-events"]
+      },
+      "expected": {
+        "suggestions": [],
+        "unavailable": [
+          { "capability": "doc-lint", "reason": "no available provider metadata for the active-step capability" },
+          { "capability": "quality-review", "reason": "no available provider metadata for the active-step capability" }
+        ]
+      }
+    },
+    {
+      "id": "empty-needed-is-valid-no-output",
+      "kind": "valid",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": [],
+        "availableProviderMetadata": [
+          { "providerId": "fixture-lint-a", "capabilities": ["doc-lint"], "stepTypes": ["verification"], "requiresHostCapabilities": [], "locator": { "kind": "tool", "id": "fixture-lint-a" } }
+        ],
+        "hostCapabilities": []
+      },
+      "expected": { "suggestions": [], "unavailable": [] }
+    },
+    {
+      "id": "all-empty-is-valid-no-output",
+      "kind": "valid",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": [],
+        "availableProviderMetadata": [],
+        "hostCapabilities": []
+      },
+      "expected": { "suggestions": [], "unavailable": [] }
+    },
+    {
+      "id": "capability-match-is-case-sensitive",
+      "kind": "valid",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [
+          { "providerId": "fixture-case", "capabilities": ["Doc-Lint"], "stepTypes": ["verification"], "requiresHostCapabilities": [], "locator": { "kind": "tool", "id": "fixture-case" } }
+        ],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "suggestions": [],
+        "unavailable": [{ "capability": "doc-lint", "reason": "no available provider metadata for the active-step capability" }]
+      }
+    },
+    {
+      "id": "step-type-match-is-case-sensitive",
+      "kind": "valid",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "Verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [
+          { "providerId": "fixture-case", "capabilities": ["doc-lint"], "stepTypes": ["verification"], "requiresHostCapabilities": [], "locator": { "kind": "tool", "id": "fixture-case" } }
+        ],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "suggestions": [],
+        "unavailable": [{ "capability": "doc-lint", "reason": "no available provider metadata for the active-step capability" }]
+      }
+    },
+    {
+      "id": "extra-fields-confer-no-capability-or-authority",
+      "kind": "valid",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["quality-review"],
+        "availableProviderMetadata": [
+          { "providerId": "fixture-extra", "capabilities": ["doc-lint"], "stepTypes": ["verification"], "requiresHostCapabilities": [], "locator": { "kind": "tool", "id": "fixture-extra" }, "extraCapabilities": ["quality-review"], "authority": "granted" }
+        ],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "suggestions": [],
+        "unavailable": [{ "capability": "quality-review", "reason": "no available provider metadata for the active-step capability" }]
+      }
+    },
+    {
+      "id": "malformed-input-null",
+      "kind": "malformed",
+      "input": null,
+      "expected": { "unavailable": [], "diagnosticPathPrefixes": ["input"] }
+    },
+    {
+      "id": "malformed-activeStep-missing-retains-needed",
+      "kind": "malformed",
+      "input": {
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "unavailable": [{ "capability": "doc-lint", "reason": "invalid-input" }],
+        "diagnosticPathPrefixes": ["activeStep"]
+      }
+    },
+    {
+      "id": "malformed-activeStep-id-whitespace",
+      "kind": "malformed",
+      "input": {
+        "activeStep": { "id": "   ", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "unavailable": [{ "capability": "doc-lint", "reason": "invalid-input" }],
+        "diagnosticPathPrefixes": ["activeStep"]
+      }
+    },
+    {
+      "id": "malformed-neededCapabilities-not-array-empties-unavailable",
+      "kind": "malformed",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": "doc-lint",
+        "availableProviderMetadata": [],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "unavailable": [],
+        "diagnosticPathPrefixes": ["neededCapabilities"]
+      }
+    },
+    {
+      "id": "malformed-neededCapabilities-duplicate-empties-unavailable",
+      "kind": "malformed",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint", "doc-lint"],
+        "availableProviderMetadata": [],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "unavailable": [],
+        "diagnosticPathPrefixes": ["neededCapabilities"]
+      }
+    },
+    {
+      "id": "malformed-hostCapabilities-missing-retains-needed",
+      "kind": "malformed",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": []
+      },
+      "expected": {
+        "unavailable": [{ "capability": "doc-lint", "reason": "invalid-input" }],
+        "diagnosticPathPrefixes": ["hostCapabilities"]
+      }
+    },
+    {
+      "id": "malformed-hostCapabilities-null-retains-needed",
+      "kind": "malformed",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [],
+        "hostCapabilities": null
+      },
+      "expected": {
+        "unavailable": [{ "capability": "doc-lint", "reason": "invalid-input" }],
+        "diagnosticPathPrefixes": ["hostCapabilities"]
+      }
+    },
+    {
+      "id": "malformed-hostCapabilities-string-retains-needed",
+      "kind": "malformed",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [],
+        "hostCapabilities": "execution-events"
+      },
+      "expected": {
+        "unavailable": [{ "capability": "doc-lint", "reason": "invalid-input" }],
+        "diagnosticPathPrefixes": ["hostCapabilities"]
+      }
+    },
+    {
+      "id": "malformed-hostCapabilities-duplicate-retains-needed",
+      "kind": "malformed",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [],
+        "hostCapabilities": ["execution-events", "execution-events"]
+      },
+      "expected": {
+        "unavailable": [{ "capability": "doc-lint", "reason": "invalid-input" }],
+        "diagnosticPathPrefixes": ["hostCapabilities"]
+      }
+    },
+    {
+      "id": "malformed-metadata-entry-null",
+      "kind": "malformed",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [null],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "unavailable": [{ "capability": "doc-lint", "reason": "invalid-input" }],
+        "diagnosticPathPrefixes": ["availableProviderMetadata"]
+      }
+    },
+    {
+      "id": "malformed-locator-kind-command",
+      "kind": "malformed",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [
+          { "providerId": "fixture-cmd", "capabilities": ["doc-lint"], "stepTypes": ["verification"], "requiresHostCapabilities": [], "locator": { "kind": "command", "id": "npm run lint" } }
+        ],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "unavailable": [{ "capability": "doc-lint", "reason": "invalid-input" }],
+        "diagnosticPathPrefixes": ["availableProviderMetadata"]
+      }
+    },
+    {
+      "id": "malformed-providerId-number-no-coercion",
+      "kind": "malformed",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [
+          { "providerId": 42, "capabilities": ["doc-lint"], "stepTypes": ["verification"], "requiresHostCapabilities": [], "locator": { "kind": "tool", "id": "fixture-num" } }
+        ],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "unavailable": [{ "capability": "doc-lint", "reason": "invalid-input" }],
+        "diagnosticPathPrefixes": ["availableProviderMetadata"]
+      }
+    },
+    {
+      "id": "malformed-providerId-whitespace",
+      "kind": "malformed",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [
+          { "providerId": "   ", "capabilities": ["doc-lint"], "stepTypes": ["verification"], "requiresHostCapabilities": [], "locator": { "kind": "tool", "id": "fixture-ws" } }
+        ],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "unavailable": [{ "capability": "doc-lint", "reason": "invalid-input" }],
+        "diagnosticPathPrefixes": ["availableProviderMetadata"]
+      }
+    },
+    {
+      "id": "malformed-metadata-capabilities-duplicate",
+      "kind": "malformed",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [
+          { "providerId": "fixture-dup", "capabilities": ["doc-lint", "doc-lint"], "stepTypes": ["verification"], "requiresHostCapabilities": [], "locator": { "kind": "tool", "id": "fixture-dup" } }
+        ],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "unavailable": [{ "capability": "doc-lint", "reason": "invalid-input" }],
+        "diagnosticPathPrefixes": ["availableProviderMetadata"]
+      }
+    },
+    {
+      "id": "malformed-requiresHostCapabilities-null",
+      "kind": "malformed",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [
+          { "providerId": "fixture-null", "capabilities": ["doc-lint"], "stepTypes": ["verification"], "requiresHostCapabilities": null, "locator": { "kind": "tool", "id": "fixture-null" } }
+        ],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "unavailable": [{ "capability": "doc-lint", "reason": "invalid-input" }],
+        "diagnosticPathPrefixes": ["availableProviderMetadata"]
+      }
+    },
+    {
+      "id": "malformed-stepTypes-not-array",
+      "kind": "malformed",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [
+          { "providerId": "fixture-str", "capabilities": ["doc-lint"], "stepTypes": "verification", "requiresHostCapabilities": [], "locator": { "kind": "tool", "id": "fixture-str" } }
+        ],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "unavailable": [{ "capability": "doc-lint", "reason": "invalid-input" }],
+        "diagnosticPathPrefixes": ["availableProviderMetadata"]
+      }
+    },
+    {
+      "id": "malformed-capability-empty-string",
+      "kind": "malformed",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [
+          { "providerId": "fixture-empty", "capabilities": [""], "stepTypes": ["verification"], "requiresHostCapabilities": [], "locator": { "kind": "tool", "id": "fixture-empty" } }
+        ],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "unavailable": [{ "capability": "doc-lint", "reason": "invalid-input" }],
+        "diagnosticPathPrefixes": ["availableProviderMetadata"]
+      }
+    },
+    {
+      "id": "malformed-partly-valid-emits-no-suggestions",
+      "kind": "malformed",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [
+          { "providerId": "fixture-good", "capabilities": ["doc-lint"], "stepTypes": ["verification"], "requiresHostCapabilities": [], "locator": { "kind": "tool", "id": "fixture-good" } },
+          { "providerId": "", "capabilities": ["doc-lint"], "stepTypes": ["verification"], "requiresHostCapabilities": [], "locator": { "kind": "tool", "id": "fixture-bad" } }
+        ],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "unavailable": [{ "capability": "doc-lint", "reason": "invalid-input" }],
+        "diagnosticPathPrefixes": ["availableProviderMetadata"]
+      }
+    },
+    {
+      "id": "malformed-unrelated-values-not-exposed-in-diagnostics",
+      "kind": "malformed",
+      "input": {
+        "activeStep": { "id": "verify-docs", "stepType": "verification" },
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": [
+          { "providerId": "", "capabilities": ["doc-lint"], "stepTypes": ["verification"], "requiresHostCapabilities": [], "locator": { "kind": "tool", "id": "fixture-sentinel" }, "secretNote": "SENTINEL-XYZ-42" }
+        ],
+        "hostCapabilities": []
+      },
+      "expected": {
+        "unavailable": [{ "capability": "doc-lint", "reason": "invalid-input" }],
+        "diagnosticPathPrefixes": ["availableProviderMetadata"],
+        "forbiddenText": ["SENTINEL-XYZ-42"]
+      }
+    },
+    {
+      "id": "malformed-multiple-errors-diagnostics-ordered-by-path",
+      "kind": "malformed",
+      "input": {
+        "neededCapabilities": ["doc-lint"],
+        "availableProviderMetadata": []
+      },
+      "expected": {
+        "unavailable": [{ "capability": "doc-lint", "reason": "invalid-input" }],
+        "diagnosticPathPrefixes": ["activeStep", "hostCapabilities"],
+        "minDiagnostics": 2
+      }
+    }
+  ]
+}