agent-inspect 6.20.0 → 6.21.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +6 -0
- package/README.md +1 -1
- package/docs/TRACE-CONTRACTS.md +39 -0
- package/package.json +1 -1
- package/packages/cli/dist/{chunk-QPRJUVLH.mjs → chunk-CRUHIL5J.mjs} +16 -2
- package/packages/cli/dist/chunk-CRUHIL5J.mjs.map +1 -0
- package/packages/cli/dist/index.cjs +22 -3
- package/packages/cli/dist/index.cjs.map +1 -1
- package/packages/cli/dist/index.mjs +4 -4
- package/packages/cli/dist/index.mjs.map +1 -1
- package/packages/cli/dist/{src-6W5ZR3I7.mjs → src-MNJFYW3W.mjs} +3 -3
- package/packages/cli/dist/{src-6W5ZR3I7.mjs.map → src-MNJFYW3W.mjs.map} +1 -1
- package/packages/core/dist/advanced.cjs +3 -0
- package/packages/core/dist/advanced.cjs.map +1 -1
- package/packages/core/dist/advanced.d.cts +6 -156
- package/packages/core/dist/advanced.d.ts +6 -156
- package/packages/core/dist/advanced.mjs +6 -60
- package/packages/core/dist/advanced.mjs.map +1 -1
- package/packages/core/dist/checks.cjs +558 -25
- package/packages/core/dist/checks.cjs.map +1 -1
- package/packages/core/dist/checks.d.cts +81 -3
- package/packages/core/dist/checks.d.ts +81 -3
- package/packages/core/dist/checks.mjs +2 -2
- package/packages/core/dist/{chunk-G47KQB42.mjs → chunk-43SHIPZM.mjs} +556 -29
- package/packages/core/dist/chunk-43SHIPZM.mjs.map +1 -0
- package/packages/core/dist/{chunk-3XS5O4JI.mjs → chunk-R4SSYU6D.mjs} +3 -3
- package/packages/core/dist/chunk-R4SSYU6D.mjs.map +1 -0
- package/packages/core/dist/{chunk-5YFJJFXU.mjs → chunk-WGDSM37E.mjs} +3 -3
- package/packages/core/dist/{chunk-5YFJJFXU.mjs.map → chunk-WGDSM37E.mjs.map} +1 -1
- package/packages/core/dist/{context-C5ye_xcS.d.cts → context-DOOT9GZ-.d.cts} +1 -1
- package/packages/core/dist/{context-CNsNSgE2.d.ts → context-DOX2-RjH.d.ts} +1 -1
- package/packages/core/dist/diff.d.cts +1 -1
- package/packages/core/dist/diff.d.ts +1 -1
- package/packages/core/dist/exporters.d.cts +1 -1
- package/packages/core/dist/exporters.d.ts +1 -1
- package/packages/core/dist/exporters.mjs +1 -1
- package/packages/core/dist/{index-rVpX5PPh.d.cts → index-BG-ZBESI.d.cts} +153 -1
- package/packages/core/dist/{index-Bg9ZdsdS.d.ts → index-xevIlqdd.d.ts} +153 -1
- package/packages/core/dist/index.d.cts +3 -3
- package/packages/core/dist/index.d.ts +3 -3
- package/packages/core/dist/index.mjs +3 -3
- package/packages/core/dist/persisted.d.cts +1 -1
- package/packages/core/dist/persisted.d.ts +1 -1
- package/packages/core/dist/{types--ainI31J.d.ts → types-Bx3mEZ04.d.ts} +1 -1
- package/packages/core/dist/{types-UnrNaTo2.d.cts → types-VzKihKQo.d.cts} +1 -1
- package/packages/cli/dist/chunk-QPRJUVLH.mjs.map +0 -1
- package/packages/core/dist/chunk-3XS5O4JI.mjs.map +0 -1
- package/packages/core/dist/chunk-G47KQB42.mjs.map +0 -1
package/CHANGELOG.md
CHANGED
|
@@ -1,5 +1,11 @@
|
|
|
1
1
|
# Changelog
|
|
2
2
|
|
|
3
|
+
## 6.21.0
|
|
4
|
+
|
|
5
|
+
### Minor Changes
|
|
6
|
+
|
|
7
|
+
- 9d6a24f: Actor-scoped TraceContracts (`scope` selectors) and structural observation provenance (`observations.requireProvenance`) for multi-agent precision (#320/#321). Includes planner/verifier recipe.
|
|
8
|
+
|
|
3
9
|
## 6.20.0
|
|
4
10
|
|
|
5
11
|
### Minor Changes
|
package/README.md
CHANGED
|
@@ -212,7 +212,7 @@ The root package is enough for custom capture, the CLI, checks, and Evidence wor
|
|
|
212
212
|
|
|
213
213
|
## Status and documentation
|
|
214
214
|
|
|
215
|
-
**Current published baseline:** **6.
|
|
215
|
+
**Current published baseline:** **6.21.0** · persisted schema `1.0` · Node.js `>=20` · MIT.
|
|
216
216
|
|
|
217
217
|
Legacy v0.1 and v0.2 traces remain readable. Check the npm badge and [changelog](CHANGELOG.md) for the current published version.
|
|
218
218
|
|
package/docs/TRACE-CONTRACTS.md
CHANGED
|
@@ -12,6 +12,8 @@ Contracts compile to deterministic check rules for common cases:
|
|
|
12
12
|
- tool required / forbidden / allowed / maxCalls / order (`requiredTools` / `forbiddenTools` aliases)
|
|
13
13
|
- selectable `requiredOrderMode` (`first-occurrence` | `happens-before` | `all-occurrences`)
|
|
14
14
|
- `alternatives.anyOf` for one level of legitimate alternate paths
|
|
15
|
+
- actor `scope` selectors (`runId`, `subAgentId`, `groupId`, `workflowStep`, `rootEventId`)
|
|
16
|
+
- observation `requireProvenance` (structural method / evidence / same-run event references)
|
|
15
17
|
- `lintTraceContract` / `explainTraceContract` for brittle-contract diagnostics
|
|
16
18
|
- LLM maxCalls / maxTotalTokens / allowedModels
|
|
17
19
|
- evidence-bearing findings on failures
|
|
@@ -126,6 +128,43 @@ Constraints:
|
|
|
126
128
|
|
|
127
129
|
Requires externally observed or effect evidence (for example HTTP status, file write, cache key) rather than a specific tool call. Prefer this when the invariant is about **outcome** rather than **which tool ran**.
|
|
128
130
|
|
|
131
|
+
### `scope` (shipped — experimental)
|
|
132
|
+
|
|
133
|
+
Select one actor before evaluation using **explicit** metadata only:
|
|
134
|
+
|
|
135
|
+
```ts
|
|
136
|
+
defineTraceContract({
|
|
137
|
+
scope: { subAgentId: "verifier-agent" },
|
|
138
|
+
tools: { required: ["run_tests"] },
|
|
139
|
+
});
|
|
140
|
+
```
|
|
141
|
+
|
|
142
|
+
Supported selectors: `runId`, `subAgentId`, `groupId`, `workflowStep`, `rootEventId` (subtree projection).
|
|
143
|
+
|
|
144
|
+
- zero matches → error (no whole-session fallback)
|
|
145
|
+
- singular selector matching multiple runs → error
|
|
146
|
+
- no timestamp, prose, or display-name inference
|
|
147
|
+
- successful selection reports the actor and evidence event count
|
|
148
|
+
|
|
149
|
+
### `observations.requireProvenance` (shipped — experimental)
|
|
150
|
+
|
|
151
|
+
Structural provenance for named outcomes. These checks prove method/evidence linkage was recorded; they do **not** prove the claim is semantically true, authorized, complete, or externally trusted.
|
|
152
|
+
|
|
153
|
+
```ts
|
|
154
|
+
defineTraceContract({
|
|
155
|
+
observations: {
|
|
156
|
+
required: ["refund-confirmed"],
|
|
157
|
+
requireProvenance: {
|
|
158
|
+
method: true,
|
|
159
|
+
evidence: true,
|
|
160
|
+
sameRunEventReference: true,
|
|
161
|
+
},
|
|
162
|
+
},
|
|
163
|
+
});
|
|
164
|
+
```
|
|
165
|
+
|
|
166
|
+
Bounded evidence shapes: string event id, `{ eventId }`, or `{ eventIds }` (max 16). Method must be in the `ObservedOutcomeMethod` vocabulary. Omitting `requireProvenance` leaves prior observation behavior unchanged.
|
|
167
|
+
|
|
129
168
|
### Lint and explain (shipped)
|
|
130
169
|
|
|
131
170
|
```ts
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "agent-inspect",
|
|
3
|
-
"version": "6.
|
|
3
|
+
"version": "6.21.0",
|
|
4
4
|
"license": "MIT",
|
|
5
5
|
"type": "module",
|
|
6
6
|
"description": "Local evidence debugger and trajectory-test toolkit for TypeScript AI agents — execution trees, TraceContract checks, Evidence v2, and read-only MCP",
|
|
@@ -2579,6 +2579,17 @@ var OBSERVED_OUTCOME_STATUSES = [
|
|
|
2579
2579
|
"unknown",
|
|
2580
2580
|
"skipped"
|
|
2581
2581
|
];
|
|
2582
|
+
var OBSERVED_OUTCOME_METHODS = [
|
|
2583
|
+
"dom",
|
|
2584
|
+
"accessibility",
|
|
2585
|
+
"snapshot",
|
|
2586
|
+
"network",
|
|
2587
|
+
"storage",
|
|
2588
|
+
"filesystem",
|
|
2589
|
+
"database",
|
|
2590
|
+
"queue",
|
|
2591
|
+
"custom"
|
|
2592
|
+
];
|
|
2582
2593
|
var OUTCOME_ATTRIBUTE_STATUS_KEY = "outcomeStatus";
|
|
2583
2594
|
var OUTCOME_ATTRIBUTE_EXPECTATION_KEY = "expectation";
|
|
2584
2595
|
var OUTCOME_ATTRIBUTE_METHOD_KEY = "method";
|
|
@@ -6681,6 +6692,9 @@ function isCredentialSensitiveKey(key, sensitiveKeys = DEFAULT_CREDENTIAL_SENSIT
|
|
|
6681
6692
|
return false;
|
|
6682
6693
|
}
|
|
6683
6694
|
|
|
6695
|
+
// packages/core/src/checks/contract.ts
|
|
6696
|
+
new Set(OBSERVED_OUTCOME_METHODS);
|
|
6697
|
+
|
|
6684
6698
|
// packages/core/src/checks/index.ts
|
|
6685
6699
|
var SEVERITY_RANK = {
|
|
6686
6700
|
error: 0,
|
|
@@ -11781,5 +11795,5 @@ function renderGateReport(result, options = {}) {
|
|
|
11781
11795
|
}
|
|
11782
11796
|
|
|
11783
11797
|
export { COHORT_METRIC_IDS, DEFAULT_SUITE_ARTIFACTS_DIR, EVIDENCE_FORMAT_VERSION, EVIDENCE_HTML_FILENAME, EVIDENCE_MANIFEST_FILENAME, Redactor, TraceDirectory, TraceReadError, TreeBuilder, aggregateBundleSafeStatus, aggregateSessionCheckResults, analyzeCohort, applyProfileMetadataCaps, assertBundlePathContained, assertEvidenceRelativePath, buildActivitySummary, buildBundleMetadata, buildBundleSummaryMarkdown, buildEvidenceCausalFailureViewHtml, buildEvidenceCiPackage, buildEvidenceCircuitViewHtml, buildEvidenceContractsViewHtml, buildEvidenceDiffViewHtml, buildEvidenceHtmlShell, buildEvidenceManifest, buildEvidenceOutcomesViewHtml, buildEvidenceProvenanceViewHtml, buildEvidenceSafetyViewHtml, buildEvidenceTimelineViewHtml, buildEvidenceToolsLlmViewHtml, buildEvidenceTreeViewHtml, buildLocalExplanation, buildPlaceholderArtifact, buildRunSummary, buildRunTimeline, buildRunWhatSummary, buildSessionIndex, buildTraceStats, buildZipArchive, bundleFailsOnSafety, bundleRunAssetRelativePath, collectTraceSchemaVersions, compactAttributes, createBaselineRegressionRule, createLlmUsageRule, createMaxStepDurationRule, createObservedOutcomeRule, createRequireCompletedRule, createRunDepthRule, createRunDurationRule, createRunStatusRule, createSafetyOversizedAttributeRule, createSafetyRawContentRule, createSafetyRedactionRule, createSafetySecretPatternRule, createStallDetectionRule, createStructureCycleRule, createStructureOrphanRule, createStructureParallelWidthRule, createStructureRelationshipRule, createToolUsageRule, defaultBundleOutputPath, defaultSuiteConfigTemplate, diffRuns, diffTraceEvents, enrichSessionRunRecord, escapeHtml, escapeMarkdown, extractMetadata, extractOutcomesFromTraceEvents, filterMetasBySessionScope, filterTraces, flattenTree, formatDuration2 as formatDuration, formatStepLabel, formatTimestamp, gateHasThresholds, getIndent, getTraceFilePath, inferEvidenceFileRole, isAgentInspectTrace, isPersistedInspectEvent, loadSessionRunRecords, loadSuiteConfig, loadTraceMetadataList, manualTraceEventsToComparableRun, nanoid, normalizeBundleOutputPath, openTrace, parseCohortMetricList, parseDuration, parseDurationFilter, parseGateList, parseTraceJsonl, persistedInspectEventsToTraceEvents, renderActivitySummaryHuman, renderCohortReport, renderErrorLine, renderGateReport, renderObservedOutcomesHtml, renderObservedOutcomesMarkdown, renderRunDiff, renderRunWhat, renderStepLine, renderSuiteReport, renderTimeline, renderTraceStats, resolveBundleRunIds, resolveRedactionProfile, resolveSuiteTemplate, resolveTraceDir, runGate, runSuite, runTraceChecks, safeString, sanitizeBundleRunId, searchTraces, serializeEvidenceManifest, sha256Hex, stableJson, summarizeObservedOutcomes, summarizeSemanticParity, traceEventToPersistedInspectEvent, truncateName, truncateStringForProfile, validateEvent, validateSuiteConfig, verifyEvidenceDirectory, zeroKinds };
|
|
11784
|
-
//# sourceMappingURL=chunk-
|
|
11785
|
-
//# sourceMappingURL=chunk-
|
|
11798
|
+
//# sourceMappingURL=chunk-CRUHIL5J.mjs.map
|
|
11799
|
+
//# sourceMappingURL=chunk-CRUHIL5J.mjs.map
|