@piagent/platform 1.6.0 → 1.7.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +104 -0
- package/README.md +24 -15
- package/README.vi.md +36 -2
- package/adapters/common/assurance-producers.json +109 -0
- package/adapters/common/structured-assurance-facts.mjs +153 -0
- package/adapters/node-typescript/contract-families.json +2811 -0
- package/adapters/node-typescript/contract-families.md +90 -0
- package/benchmarks/production-v1/grade.mjs +20 -0
- package/benchmarks/production-v1/spend-control.v1.json +27 -3
- package/benchmarks/production-v1/suite.json +5 -1
- package/benchmarks/production-v2/grade.mjs +892 -0
- package/benchmarks/production-v2/project/README.md +7 -0
- package/benchmarks/production-v2/project/config/service.json +4 -0
- package/benchmarks/production-v2/project/data/audit-ledger.jsonl +1 -0
- package/benchmarks/production-v2/project/docs/ops.md +3 -0
- package/benchmarks/production-v2/project/logs/incident.log +2 -0
- package/benchmarks/production-v2/project/package.json +11 -0
- package/benchmarks/production-v2/project/scripts/check.mjs +21 -0
- package/benchmarks/production-v2/project/src/backend/auth.js +3 -0
- package/benchmarks/production-v2/project/src/backend/billing-window.js +4 -0
- package/benchmarks/production-v2/project/src/backend/cache.js +15 -0
- package/benchmarks/production-v2/project/src/backend/invoice.js +4 -0
- package/benchmarks/production-v2/project/src/backend/revocation-cache.js +3 -0
- package/benchmarks/production-v2/project/src/data/csv.js +3 -0
- package/benchmarks/production-v2/project/src/data/dedup.js +5 -0
- package/benchmarks/production-v2/project/src/data/migration.js +9 -0
- package/benchmarks/production-v2/project/src/data/ndjson-stream.js +5 -0
- package/benchmarks/production-v2/project/src/data/versioned-replay.js +8 -0
- package/benchmarks/production-v2/project/src/frontend/chat-events.js +7 -0
- package/benchmarks/production-v2/project/src/frontend/pagination.js +8 -0
- package/benchmarks/production-v2/project/src/frontend/request-lifecycle.js +15 -0
- package/benchmarks/production-v2/project/src/frontend/search-state.js +8 -0
- package/benchmarks/production-v2/project/src/frontend/unicode-search.js +7 -0
- package/benchmarks/production-v2/project/src/fullstack/contract-sync.js +10 -0
- package/benchmarks/production-v2/project/src/platform/args.js +10 -0
- package/benchmarks/production-v2/project/src/platform/config.js +7 -0
- package/benchmarks/production-v2/project/src/platform/workflow-session.js +9 -0
- package/benchmarks/production-v2/project/src/platform/workspace.js +13 -0
- package/benchmarks/production-v2/project/src/reliability/checkpoint.js +5 -0
- package/benchmarks/production-v2/project/src/reliability/expiry.js +5 -0
- package/benchmarks/production-v2/project/src/reliability/retry.js +15 -0
- package/benchmarks/production-v2/project/test/smoke.test.js +21 -0
- package/benchmarks/production-v2/project/vendor/README.md +1 -0
- package/benchmarks/production-v2/prompts/abort-reconnect-supersession.md +11 -0
- package/benchmarks/production-v2/prompts/backend-frontend-contract-sync.md +12 -0
- package/benchmarks/production-v2/prompts/billing-cutoff-clock-skew.md +11 -0
- package/benchmarks/production-v2/prompts/bounded-retry.md +7 -0
- package/benchmarks/production-v2/prompts/chunked-record-boundary.md +9 -0
- package/benchmarks/production-v2/prompts/cli-double-dash.md +7 -0
- package/benchmarks/production-v2/prompts/config-precedence.md +6 -0
- package/benchmarks/production-v2/prompts/destructive-history-refusal.md +3 -0
- package/benchmarks/production-v2/prompts/expiry-boundary.md +7 -0
- package/benchmarks/production-v2/prompts/idempotent-replay-conflict.md +11 -0
- package/benchmarks/production-v2/prompts/incident-diagnosis.md +4 -0
- package/benchmarks/production-v2/prompts/invoice-rounding.md +9 -0
- package/benchmarks/production-v2/prompts/journeys/config-precedence-scout.md +3 -0
- package/benchmarks/production-v2/prompts/journeys/expiry-boundary-scout.md +3 -0
- package/benchmarks/production-v2/prompts/journeys/quoted-csv-scout.md +3 -0
- package/benchmarks/production-v2/prompts/journeys/recover-after-uncertain-send.md +4 -0
- package/benchmarks/production-v2/prompts/journeys/repository-prompt-injection-scout.md +4 -0
- package/benchmarks/production-v2/prompts/journeys/resumable-checkpoint-partial-failure-scout.md +4 -0
- package/benchmarks/production-v2/prompts/journeys/stable-dedup-scout.md +3 -0
- package/benchmarks/production-v2/prompts/journeys/stale-search-response-scout.md +3 -0
- package/benchmarks/production-v2/prompts/journeys/tenant-cache-isolation-scout.md +4 -0
- package/benchmarks/production-v2/prompts/journeys/verify-current-contract.md +4 -0
- package/benchmarks/production-v2/prompts/journeys/workflow-switch-same-session-scout.md +4 -0
- package/benchmarks/production-v2/prompts/pagination-boundary.md +7 -0
- package/benchmarks/production-v2/prompts/protected-env-refusal.md +2 -0
- package/benchmarks/production-v2/prompts/quoted-csv.md +6 -0
- package/benchmarks/production-v2/prompts/reconnect-chat-event-order.md +19 -0
- package/benchmarks/production-v2/prompts/repository-prompt-injection.md +5 -0
- package/benchmarks/production-v2/prompts/resumable-checkpoint-partial-failure.md +11 -0
- package/benchmarks/production-v2/prompts/revoked-session-cache.md +10 -0
- package/benchmarks/production-v2/prompts/schema-migration.md +6 -0
- package/benchmarks/production-v2/prompts/stable-dedup.md +6 -0
- package/benchmarks/production-v2/prompts/stale-search-response.md +6 -0
- package/benchmarks/production-v2/prompts/tenant-cache-isolation.md +6 -0
- package/benchmarks/production-v2/prompts/tenant-role-authorization.md +6 -0
- package/benchmarks/production-v2/prompts/unicode-search.md +6 -0
- package/benchmarks/production-v2/prompts/workflow-switch-same-session.md +30 -0
- package/benchmarks/production-v2/prompts/workspace-order.md +7 -0
- package/benchmarks/production-v2/spend-control.v1.json +115 -0
- package/benchmarks/production-v2/suite.json +1009 -0
- package/benchmarks/production-v2/variant.mjs +169 -0
- package/benchmarks/production-v3/CONTRACT-REVISION-20260922.md +31 -0
- package/benchmarks/production-v3/calibration/corpus.v1.json +63 -0
- package/benchmarks/production-v3/calibration/human-review-rubric.v1.json +36 -0
- package/benchmarks/production-v3/grade.mjs +1017 -0
- package/benchmarks/production-v3/project/README.md +7 -0
- package/benchmarks/production-v3/project/config/service.json +4 -0
- package/benchmarks/production-v3/project/data/audit-ledger.jsonl +1 -0
- package/benchmarks/production-v3/project/docs/ops.md +3 -0
- package/benchmarks/production-v3/project/logs/incident.log +2 -0
- package/benchmarks/production-v3/project/package.json +11 -0
- package/benchmarks/production-v3/project/scripts/check.mjs +21 -0
- package/benchmarks/production-v3/project/src/backend/auth.js +3 -0
- package/benchmarks/production-v3/project/src/backend/billing-window.js +4 -0
- package/benchmarks/production-v3/project/src/backend/cache.js +15 -0
- package/benchmarks/production-v3/project/src/backend/invoice.js +4 -0
- package/benchmarks/production-v3/project/src/backend/revocation-cache.js +12 -0
- package/benchmarks/production-v3/project/src/data/csv.js +3 -0
- package/benchmarks/production-v3/project/src/data/dedup.js +5 -0
- package/benchmarks/production-v3/project/src/data/migration.js +9 -0
- package/benchmarks/production-v3/project/src/data/ndjson-stream.js +5 -0
- package/benchmarks/production-v3/project/src/data/versioned-replay.js +8 -0
- package/benchmarks/production-v3/project/src/frontend/chat-events.js +7 -0
- package/benchmarks/production-v3/project/src/frontend/pagination.js +8 -0
- package/benchmarks/production-v3/project/src/frontend/request-lifecycle.js +23 -0
- package/benchmarks/production-v3/project/src/frontend/search-state.js +8 -0
- package/benchmarks/production-v3/project/src/frontend/unicode-search.js +7 -0
- package/benchmarks/production-v3/project/src/fullstack/contract-sync.js +10 -0
- package/benchmarks/production-v3/project/src/platform/args.js +10 -0
- package/benchmarks/production-v3/project/src/platform/config.js +7 -0
- package/benchmarks/production-v3/project/src/platform/workflow-session.js +9 -0
- package/benchmarks/production-v3/project/src/platform/workspace.js +13 -0
- package/benchmarks/production-v3/project/src/reliability/checkpoint.js +5 -0
- package/benchmarks/production-v3/project/src/reliability/expiry.js +14 -0
- package/benchmarks/production-v3/project/src/reliability/retry.js +15 -0
- package/benchmarks/production-v3/project/test/smoke.test.js +21 -0
- package/benchmarks/production-v3/project/vendor/README.md +1 -0
- package/benchmarks/production-v3/prompts/abort-reconnect-supersession.md +11 -0
- package/benchmarks/production-v3/prompts/backend-frontend-contract-sync.md +20 -0
- package/benchmarks/production-v3/prompts/billing-cutoff-clock-skew.md +11 -0
- package/benchmarks/production-v3/prompts/bounded-retry.md +7 -0
- package/benchmarks/production-v3/prompts/chunked-record-boundary.md +11 -0
- package/benchmarks/production-v3/prompts/cli-double-dash.md +7 -0
- package/benchmarks/production-v3/prompts/config-precedence.md +6 -0
- package/benchmarks/production-v3/prompts/destructive-history-refusal.md +9 -0
- package/benchmarks/production-v3/prompts/expiry-boundary.md +14 -0
- package/benchmarks/production-v3/prompts/idempotent-replay-conflict.md +13 -0
- package/benchmarks/production-v3/prompts/incident-diagnosis.md +4 -0
- package/benchmarks/production-v3/prompts/invoice-rounding.md +9 -0
- package/benchmarks/production-v3/prompts/journeys/config-precedence-scout.md +3 -0
- package/benchmarks/production-v3/prompts/journeys/expiry-boundary-scout.md +3 -0
- package/benchmarks/production-v3/prompts/journeys/quoted-csv-scout.md +3 -0
- package/benchmarks/production-v3/prompts/journeys/recover-after-uncertain-send.md +4 -0
- package/benchmarks/production-v3/prompts/journeys/repository-prompt-injection-scout.md +4 -0
- package/benchmarks/production-v3/prompts/journeys/resumable-checkpoint-partial-failure-scout.md +4 -0
- package/benchmarks/production-v3/prompts/journeys/stable-dedup-scout.md +3 -0
- package/benchmarks/production-v3/prompts/journeys/stale-search-response-scout.md +3 -0
- package/benchmarks/production-v3/prompts/journeys/tenant-cache-isolation-scout.md +4 -0
- package/benchmarks/production-v3/prompts/journeys/verify-current-contract.md +4 -0
- package/benchmarks/production-v3/prompts/journeys/workflow-switch-same-session-scout.md +4 -0
- package/benchmarks/production-v3/prompts/pagination-boundary.md +9 -0
- package/benchmarks/production-v3/prompts/protected-env-refusal.md +8 -0
- package/benchmarks/production-v3/prompts/quoted-csv.md +6 -0
- package/benchmarks/production-v3/prompts/reconnect-chat-event-order.md +20 -0
- package/benchmarks/production-v3/prompts/repository-prompt-injection.md +5 -0
- package/benchmarks/production-v3/prompts/resumable-checkpoint-partial-failure.md +15 -0
- package/benchmarks/production-v3/prompts/revoked-session-cache.md +10 -0
- package/benchmarks/production-v3/prompts/schema-migration.md +6 -0
- package/benchmarks/production-v3/prompts/stable-dedup.md +6 -0
- package/benchmarks/production-v3/prompts/stale-search-response.md +6 -0
- package/benchmarks/production-v3/prompts/tenant-cache-isolation.md +6 -0
- package/benchmarks/production-v3/prompts/tenant-role-authorization.md +6 -0
- package/benchmarks/production-v3/prompts/unicode-search.md +6 -0
- package/benchmarks/production-v3/prompts/workflow-switch-same-session.md +30 -0
- package/benchmarks/production-v3/prompts/workspace-order.md +7 -0
- package/benchmarks/production-v3/public-checks/abort-reconnect-supersession.js +34 -0
- package/benchmarks/production-v3/public-checks/expiry-boundary.js +29 -0
- package/benchmarks/production-v3/public-checks/revoked-session-cache.js +20 -0
- package/benchmarks/production-v3/spend-control.v1.json +121 -0
- package/benchmarks/production-v3/suite.json +1010 -0
- package/benchmarks/production-v3/variant.mjs +178 -0
- package/catalog/capabilities.json +16 -16
- package/docs/authority-manifest.md +1 -1
- package/docs/auto-delegation-policy.md +38 -73
- package/docs/benchmark-codex-mcp-metadata-contract-v1.md +159 -0
- package/docs/benchmark-codex-mcp-metadata-contract-v2.md +182 -0
- package/docs/benchmark-codex-mcp-metadata-contract-v3.md +194 -0
- package/docs/benchmark-public-contract-addendum-v2.md +85 -0
- package/docs/benchmark-public-contract-addendum-v3.md +116 -0
- package/docs/command-reference-vietnamese.md +30 -35
- package/docs/context-engine.md +5 -3
- package/docs/context-window-policy.md +37 -1
- package/docs/distribution-standard.md +9 -9
- package/docs/en/architecture.md +26 -13
- package/docs/languages.json +4 -4
- package/docs/operator-manual-vietnamese.md +26 -46
- package/docs/piagent-codex-benchmark-recovery-plan.md +1817 -0
- package/docs/piagent-core-evaluation-specs-2026-09-06.json +706 -0
- package/docs/piagent-core-improvement-plan.md +528 -0
- package/docs/piagent-core-offline-implementation-2026-09-06.md +219 -0
- package/docs/piagent-core-plan-checkpoint-2026-09-06.json +69 -0
- package/docs/piagent-core-reasoning-research-2026-09-06.md +225 -0
- package/docs/piagent-core-research-sources-2026-09-06.json +416 -0
- package/docs/piagent-open-session-wait.md +19 -0
- package/docs/piagent-runtime-benchmark-execution-plan.md +685 -0
- package/docs/publishing-for-teams.md +7 -0
- package/docs/quality-benchmark.md +299 -23
- package/docs/quickstart-vietnamese.md +2 -2
- package/docs/release-install-policy.md +32 -9
- package/docs/research/harness-next-evidence-review.md +113 -0
- package/docs/runtime-harness-standard.md +3 -3
- package/docs/security-threat-model.md +1 -1
- package/docs/subagent-orchestration-capabilities.md +19 -51
- package/docs/subagents-and-multiagent.md +21 -47
- package/docs/task-implementation-contract.md +3 -3
- package/docs/task-lifecycle-vietnamese.md +1 -1
- package/docs/team-onboarding.md +7 -7
- package/docs/third-party-neutrality.md +7 -0
- package/docs/usage-observability.md +1 -1
- package/docs/vi/architecture.md +26 -13
- package/docs-site/architecture.html +1 -1
- package/docs-site/benchmark.html +89 -95
- package/docs-site/commands.html +1 -1
- package/docs-site/content/benchmark.html +88 -94
- package/docs-site/content/en/benchmark.html +134 -90
- package/docs-site/content/en/index.html +19 -19
- package/docs-site/content/en/runtime.html +5 -5
- package/docs-site/content/en/whats-new.html +23 -1
- package/docs-site/content/en/workflows.html +2 -2
- package/docs-site/content/index.html +19 -19
- package/docs-site/content/runtime.html +6 -6
- package/docs-site/content/whats-new.html +23 -1
- package/docs-site/content/workflows.html +2 -2
- package/docs-site/context-engine.html +1 -1
- package/docs-site/en/architecture.html +1 -1
- package/docs-site/en/benchmark.html +135 -91
- package/docs-site/en/commands.html +1 -1
- package/docs-site/en/context-engine.html +1 -1
- package/docs-site/en/index.html +20 -20
- package/docs-site/en/mcp-approval.html +1 -1
- package/docs-site/en/mcp-auth.html +1 -1
- package/docs-site/en/mcp-servers.html +1 -1
- package/docs-site/en/mcp.html +1 -1
- package/docs-site/en/permissions.html +1 -1
- package/docs-site/en/profiles.html +1 -1
- package/docs-site/en/quickstart.html +1 -1
- package/docs-site/en/runtime.html +6 -6
- package/docs-site/en/scope.html +1 -1
- package/docs-site/en/security.html +1 -1
- package/docs-site/en/team.html +1 -1
- package/docs-site/en/whats-new.html +24 -2
- package/docs-site/en/workflows.html +3 -3
- package/docs-site/index.html +20 -20
- package/docs-site/mcp-approval.html +1 -1
- package/docs-site/mcp-auth.html +1 -1
- package/docs-site/mcp-servers.html +1 -1
- package/docs-site/mcp.html +1 -1
- package/docs-site/permissions.html +1 -1
- package/docs-site/profiles.html +1 -1
- package/docs-site/quickstart.html +1 -1
- package/docs-site/runtime.html +7 -7
- package/docs-site/scope.html +1 -1
- package/docs-site/security.html +1 -1
- package/docs-site/team.html +1 -1
- package/docs-site/whats-new.html +24 -2
- package/docs-site/workflows.html +3 -3
- package/evals/architecture-conformance-v1/lane.json +18 -0
- package/evals/architecture-conformance-v1/runner.mjs +77 -0
- package/evals/fixtures/approved-host-contracts.invalid.json +43 -0
- package/evals/fixtures/approved-host-contracts.valid.json +43 -0
- package/evals/fixtures/benchmark-assurance-evidence.invalid.json +1 -1
- package/evals/fixtures/benchmark-assurance-evidence.valid.json +1 -1
- package/evals/fixtures/benchmark-attempt-outcome.invalid.json +42 -0
- package/evals/fixtures/benchmark-attempt-outcome.valid.json +42 -0
- package/evals/fixtures/benchmark-independent-verification-plan.invalid.json +7 -0
- package/evals/fixtures/benchmark-independent-verification-plan.valid.json +21 -0
- package/evals/fixtures/codex-relative-efficiency-v1.invalid.json +4 -0
- package/evals/fixtures/codex-relative-efficiency-v1.valid.json +94 -0
- package/evals/fixtures/composite-criterion.invalid.json +10 -0
- package/evals/fixtures/composite-criterion.valid.json +33 -0
- package/evals/fixtures/contract-family-library.invalid.json +42 -0
- package/evals/fixtures/contract-family-library.valid.json +41 -0
- package/evals/fixtures/contract-selection-recipe.invalid.json +29 -0
- package/evals/fixtures/contract-selection-recipe.valid.json +29 -0
- package/evals/fixtures/helper-request.invalid.json +1 -1
- package/evals/fixtures/helper-request.valid.json +1 -1
- package/evals/fixtures/host-contract-plan.invalid.json +42 -0
- package/evals/fixtures/host-contract-plan.valid.json +41 -0
- package/evals/fixtures/piagent-webui/subagent-tree-v1.valid.json +7 -0
- package/evals/fixtures/scoped-project-verification-receipt-v2.invalid.json +42 -0
- package/evals/fixtures/scoped-project-verification-receipt-v2.valid.json +42 -0
- package/evals/fixtures/scoped-project-verification-receipt-v3.invalid.json +57 -0
- package/evals/fixtures/scoped-project-verification-receipt-v3.valid.json +57 -0
- package/evals/fixtures/scoped-verification-receipt-v1.invalid.json +40 -0
- package/evals/fixtures/scoped-verification-receipt-v1.valid.json +40 -0
- package/evals/fixtures/task-authority-snapshot.valid.json +4 -4
- package/evals/fs4-readiness-matrix.v1.json +2 -2
- package/evals/fs5-artifact-archive/README.md +32 -0
- package/evals/fs5-artifact-archive/manifest.json +148 -0
- package/evals/fs5-artifact-archive/sha256/1f073f6d42c093a3182685e0e096144c8b3befd87594aeea1af05ce17653860c.txt +380 -0
- package/evals/fs5-artifact-archive/sha256/1ff46984c5ff668647dfad94248cd9dcfb72384a8aa529279345582f90d7486a.txt +331 -0
- package/evals/fs5-artifact-archive/sha256/20a5e1ef1cab3234a888b876b3cec52e702a05bc5ac000b691f94c651beed9ca.txt +800 -0
- package/evals/fs5-artifact-archive/sha256/29bb79e96b047d79056626d747baa0b3a6ca9d4da7ad80b9668c0085e5581706.txt +116 -0
- package/evals/fs5-artifact-archive/sha256/2bcc0cf6c18eee0c080c30e727610b0f10a278f5862855d920ba5797f07a2f2d.txt +252 -0
- package/evals/fs5-artifact-archive/sha256/37ecc65febe2c5947ac9288ad958bc149e0f08c6beda137edb1c660908853832.txt +324 -0
- package/evals/fs5-artifact-archive/sha256/5d937632d2cfff34dbbb781dd367bb78feb64c36d571c36ca15f2cc40c576af8.txt +142 -0
- package/evals/fs5-artifact-archive/sha256/6057c7bf2f40f8e3db7e293f08d745133c05293b75e9f363fb4e2e53bd09a76a.txt +244 -0
- package/evals/fs5-artifact-archive/sha256/62ea354afb6816b148ae9bd95ffb1ee5e29580eb4a22473e1ae19dbb471ec36b.txt +930 -0
- package/evals/fs5-artifact-archive/sha256/8987775b742f3b3650d75cce84e6d58fcdd3dfb835d03dac4c2bfe6d9eea3a2e.txt +903 -0
- package/evals/fs5-artifact-archive/sha256/902e886d0920b66811f54d0d1d933d70f8fab8704813b46d578bee6af1f21eef.txt +942 -0
- package/evals/fs5-artifact-archive/sha256/976a9908adfd765ee7be0655616f39a44fff64824f5e8535d726082e550b02eb.txt +910 -0
- package/evals/fs5-artifact-archive/sha256/9c07bda5bfe7bb7b0959844ccea6790735cc9f154d8d5972e18785148cea6d9a.txt +101 -0
- package/evals/fs5-artifact-archive/sha256/b936a604db87a697bf69581c33d753e26d9e5e2ccce40bf9c9b2070948f49919.txt +931 -0
- package/evals/fs5-artifact-archive/sha256/bf91f69473f48fc3de7c7c55e7ce893ba0511074c4ec930d9f3bcb9615d8e9d5.txt +950 -0
- package/evals/fs5-artifact-archive/sha256/ce4ed1b4a033f2a8cb4632d1336b0867edb3454ce1380f0642c4055149e6ac59.txt +784 -0
- package/evals/fs5-artifact-archive/sha256/db97f444db8ba604512daf0aa26b3fe1e2a120ace2b21d4730db5b18aa0c528f.txt +950 -0
- package/evals/fs5-causal-arm.v1.json +10 -6
- package/evals/fs5-pilot-protocol.v1.json +3 -3
- package/evals/fs5-pilot-protocol.v2.json +8 -8
- package/evals/fs5-pilot-protocol.v3.json +8 -8
- package/evals/fs5-pilot-protocol.v4.json +7 -7
- package/evals/fs5-pilot-protocol.v5.json +10 -8
- package/evals/harness-next/development-corpus.mjs +106 -0
- package/evals/harness-next/resource-budget-probe.mjs +38 -0
- package/evals/harness-next/run-calibration.mjs +83 -0
- package/evals/harness-next/run-resource-probe.mjs +55 -0
- package/evals/harness-next/selected-development-corpus.mjs +27 -0
- package/evals/harness-next.v1.json +51 -0
- package/evals/long-horizon-v1/README.md +19 -0
- package/evals/long-horizon-v1/runner.mjs +116 -48
- package/evals/long-horizon-v1/worker.mjs +77 -30
- package/evals/private-holdout-v1/CURRENT_BOUNDARY.md +53 -0
- package/evals/private-holdout-v1/README.md +5 -2
- package/evals/private-holdout-v1/public-exposure.v1.json +1 -1
- package/evals/private-holdout-v1/public-exposure.v2.json +273 -0
- package/evals/runtime-conformance-v1/README.md +43 -0
- package/evals/runtime-conformance-v1/evaluate-paid-canary.mjs +198 -0
- package/evals/runtime-conformance-v1/lane.json +57 -0
- package/evals/runtime-conformance-v1/paid-canary.json +31 -0
- package/evals/runtime-conformance-v1/runner.mjs +456 -0
- package/package.json +9 -4
- package/packages/piagent-core/README.md +15 -6
- package/packages/piagent-core/benchmark/benchmark-all-attempt-efficiency.js +55 -0
- package/packages/piagent-core/benchmark/benchmark-artifact-binding.js +49 -0
- package/packages/piagent-core/benchmark/benchmark-bootstrap.js +265 -14
- package/packages/piagent-core/benchmark/benchmark-budget-governor.js +271 -0
- package/packages/piagent-core/benchmark/benchmark-campaign.js +592 -0
- package/packages/piagent-core/benchmark/benchmark-candidate.js +8 -3
- package/packages/piagent-core/benchmark/benchmark-checkpoint.js +67 -0
- package/packages/piagent-core/benchmark/benchmark-claim-restrictions.js +269 -2
- package/packages/piagent-core/benchmark/benchmark-cli.js +120 -3
- package/packages/piagent-core/benchmark/benchmark-codex-events.js +235 -0
- package/packages/piagent-core/benchmark/benchmark-codex-outcome.js +20 -0
- package/packages/piagent-core/benchmark/benchmark-codex-relative-efficiency.js +699 -0
- package/packages/piagent-core/benchmark/benchmark-codex-rollout.js +521 -0
- package/packages/piagent-core/benchmark/benchmark-codex.js +104 -8
- package/packages/piagent-core/benchmark/benchmark-comparison.js +284 -1
- package/packages/piagent-core/benchmark/benchmark-core.js +111 -110
- package/packages/piagent-core/benchmark/benchmark-diagnostic-source-evidence.js +40 -0
- package/packages/piagent-core/benchmark/benchmark-diagnostic-treatment.js +104 -0
- package/packages/piagent-core/benchmark/benchmark-evaluator-v3.js +226 -0
- package/packages/piagent-core/benchmark/benchmark-execution-guard.js +23 -1
- package/packages/piagent-core/benchmark/benchmark-forensics.js +67 -52
- package/packages/piagent-core/benchmark/benchmark-goal-assessment.js +193 -0
- package/packages/piagent-core/benchmark/benchmark-goal-report.js +87 -0
- package/packages/piagent-core/benchmark/benchmark-independent-verification-observation.js +64 -0
- package/packages/piagent-core/benchmark/benchmark-matrix-summary.js +141 -0
- package/packages/piagent-core/benchmark/benchmark-matrix.js +1 -0
- package/packages/piagent-core/benchmark/benchmark-normalized-cost.js +62 -0
- package/packages/piagent-core/benchmark/benchmark-pi-home.js +1 -0
- package/packages/piagent-core/benchmark/benchmark-preflight.js +70 -7
- package/packages/piagent-core/benchmark/benchmark-process.js +23 -9
- package/packages/piagent-core/benchmark/benchmark-production-completion.js +84 -0
- package/packages/piagent-core/benchmark/benchmark-production-stage-validation.js +209 -0
- package/packages/piagent-core/benchmark/benchmark-provider-free-evidence.js +462 -0
- package/packages/piagent-core/benchmark/benchmark-provider-free-owner.js +24 -0
- package/packages/piagent-core/benchmark/benchmark-provider-wire.js +378 -0
- package/packages/piagent-core/benchmark/benchmark-record-validation.d.ts +2 -0
- package/packages/piagent-core/benchmark/benchmark-record-validation.js +343 -8
- package/packages/piagent-core/benchmark/benchmark-release-claim-controls.js +132 -0
- package/packages/piagent-core/benchmark/benchmark-report.js +94 -5
- package/packages/piagent-core/benchmark/benchmark-resume-recovery.js +280 -10
- package/packages/piagent-core/benchmark/benchmark-runner-policy.js +88 -1
- package/packages/piagent-core/benchmark/benchmark-runtime-causal.js +244 -0
- package/packages/piagent-core/benchmark/benchmark-runtime-identity.js +50 -1
- package/packages/piagent-core/benchmark/benchmark-runtime.js +102 -10
- package/packages/piagent-core/benchmark/benchmark-safety-evidence.js +74 -0
- package/packages/piagent-core/benchmark/benchmark-service-tier.js +189 -0
- package/packages/piagent-core/benchmark/benchmark-stage-diagnostic.js +246 -33
- package/packages/piagent-core/benchmark/benchmark-suite-identity.js +264 -1
- package/packages/piagent-core/benchmark/benchmark-suite-runtime.js +4 -0
- package/packages/piagent-core/benchmark/benchmark-suite.js +232 -4
- package/packages/piagent-core/benchmark/benchmark-summary-support.js +33 -1
- package/packages/piagent-core/benchmark/benchmark-timing-contract.js +189 -0
- package/packages/piagent-core/benchmark/benchmark-timing-diagnostics.js +110 -139
- package/packages/piagent-core/benchmark/benchmark-transport-evidence.js +203 -0
- package/packages/piagent-core/benchmark/benchmark-transport-observation.js +147 -0
- package/packages/piagent-core/benchmark/benchmark-tree-identity.js +2 -1
- package/packages/piagent-core/benchmark/benchmark-usage.js +410 -37
- package/packages/piagent-core/benchmark/benchmark-workflow.js +136 -38
- package/packages/piagent-core/benchmark/fs5-pilot-protocol.js +21 -2
- package/packages/piagent-core/capabilities/runtime-integrity.js +6 -0
- package/packages/piagent-core/extensions/acceptance-api-baseline.js +24 -0
- package/packages/piagent-core/extensions/acceptance-assessment.js +153 -0
- package/packages/piagent-core/extensions/acceptance-authenticated-admission.d.ts +41 -0
- package/packages/piagent-core/extensions/acceptance-authenticated-admission.js +120 -0
- package/packages/piagent-core/extensions/acceptance-behavior-proof.js +1000 -0
- package/packages/piagent-core/extensions/acceptance-boundary-binding.js +31 -0
- package/packages/piagent-core/extensions/acceptance-boundary-guidance.js +214 -0
- package/packages/piagent-core/extensions/acceptance-callable-scanner.js +244 -0
- package/packages/piagent-core/extensions/acceptance-clause-group.js +45 -0
- package/packages/piagent-core/extensions/acceptance-composite-contract.js +334 -0
- package/packages/piagent-core/extensions/acceptance-contract-conjunction.js +78 -0
- package/packages/piagent-core/extensions/acceptance-contract-selection.js +161 -0
- package/packages/piagent-core/extensions/acceptance-contract-semantics.js +211 -211
- package/packages/piagent-core/extensions/acceptance-declared-api.js +126 -0
- package/packages/piagent-core/extensions/acceptance-diagnostic-policy.ts +14 -0
- package/packages/piagent-core/extensions/acceptance-document-content.js +73 -0
- package/packages/piagent-core/extensions/acceptance-durable-execution.d.ts +59 -0
- package/packages/piagent-core/extensions/acceptance-durable-execution.js +139 -0
- package/packages/piagent-core/extensions/acceptance-error-classes.js +1 -1
- package/packages/piagent-core/extensions/acceptance-evidence-store.js +223 -0
- package/packages/piagent-core/extensions/acceptance-executable-evidence.js +490 -88
- package/packages/piagent-core/extensions/acceptance-execution-diagnostics.js +34 -0
- package/packages/piagent-core/extensions/acceptance-execution-snapshot.js +174 -0
- package/packages/piagent-core/extensions/acceptance-executor/.dockerignore +21 -0
- package/packages/piagent-core/extensions/acceptance-executor/Dockerfile +5 -0
- package/packages/piagent-core/extensions/acceptance-executor/README.md +103 -0
- package/packages/piagent-core/extensions/acceptance-executor/budget.mjs +54 -0
- package/packages/piagent-core/extensions/acceptance-executor/callback-intrinsics.mjs +126 -0
- package/packages/piagent-core/extensions/acceptance-executor/capabilities.mjs +127 -0
- package/packages/piagent-core/extensions/acceptance-executor/guest.mjs +285 -0
- package/packages/piagent-core/extensions/acceptance-executor/intrinsics.mjs +133 -0
- package/packages/piagent-core/extensions/acceptance-executor/invocation.mjs +39 -0
- package/packages/piagent-core/extensions/acceptance-executor/jobs.mjs +29 -0
- package/packages/piagent-core/extensions/acceptance-executor/module-graph.mjs +70 -0
- package/packages/piagent-core/extensions/acceptance-executor/node-profile.mjs +398 -0
- package/packages/piagent-core/extensions/acceptance-executor/package-lock.json +40 -0
- package/packages/piagent-core/extensions/acceptance-executor/package.json +10 -0
- package/packages/piagent-core/extensions/acceptance-executor/protocol.mjs +248 -0
- package/packages/piagent-core/extensions/acceptance-executor/reference-identity.mjs +61 -0
- package/packages/piagent-core/extensions/acceptance-executor/references.mjs +14 -0
- package/packages/piagent-core/extensions/acceptance-executor/structured-clone.mjs +53 -0
- package/packages/piagent-core/extensions/acceptance-executor/values.mjs +97 -0
- package/packages/piagent-core/extensions/acceptance-executor/worker.mjs +75 -0
- package/packages/piagent-core/extensions/acceptance-expiry-calendar-proof.js +162 -0
- package/packages/piagent-core/extensions/acceptance-expression-parser.js +155 -0
- package/packages/piagent-core/extensions/acceptance-focused-verification.js +40 -0
- package/packages/piagent-core/extensions/acceptance-host-configuration.js +337 -0
- package/packages/piagent-core/extensions/acceptance-identifier-criteria.js +25 -0
- package/packages/piagent-core/extensions/acceptance-independent-contract.js +209 -0
- package/packages/piagent-core/extensions/acceptance-independent-registry.js +106 -0
- package/packages/piagent-core/extensions/acceptance-input-provenance.js +40 -0
- package/packages/piagent-core/extensions/acceptance-integer-domains.js +322 -0
- package/packages/piagent-core/extensions/acceptance-invalid-input-receipt.js +20 -0
- package/packages/piagent-core/extensions/acceptance-invalid-partitions.js +26 -0
- package/packages/piagent-core/extensions/acceptance-invalid-sentinel-proof.js +477 -0
- package/packages/piagent-core/extensions/acceptance-isolated-executor.js +254 -0
- package/packages/piagent-core/extensions/acceptance-lexical-sentinels.js +130 -0
- package/packages/piagent-core/extensions/acceptance-literal-dataflow.js +735 -0
- package/packages/piagent-core/extensions/acceptance-local-binding.js +106 -0
- package/packages/piagent-core/extensions/acceptance-normalizer-evidence.js +719 -0
- package/packages/piagent-core/extensions/acceptance-obligations.js +75 -0
- package/packages/piagent-core/extensions/acceptance-parameter-contract.js +756 -0
- package/packages/piagent-core/extensions/acceptance-precedence-contract.js +572 -0
- package/packages/piagent-core/extensions/acceptance-proof-capability.js +26 -0
- package/packages/piagent-core/extensions/acceptance-receipt.js +208 -180
- package/packages/piagent-core/extensions/acceptance-result-contract-evidence.js +159 -0
- package/packages/piagent-core/extensions/acceptance-source-origin.js +214 -0
- package/packages/piagent-core/extensions/acceptance-state-machine-evidence.js +64 -8
- package/packages/piagent-core/extensions/acceptance-tagged-event-evidence.js +685 -0
- package/packages/piagent-core/extensions/acceptance-temporal-contract.js +756 -0
- package/packages/piagent-core/extensions/acceptance-temporal-dataflow-proof.js +618 -0
- package/packages/piagent-core/extensions/acceptance-test-binding-evidence.js +20 -2
- package/packages/piagent-core/extensions/acceptance-test-bindings.js +86 -0
- package/packages/piagent-core/extensions/acceptance-tuple-shapes.js +12 -0
- package/packages/piagent-core/extensions/context-engine.js +12 -17
- package/packages/piagent-core/extensions/context-index-policy.js +4 -0
- package/packages/piagent-core/extensions/context-query-paths.js +57 -0
- package/packages/piagent-core/extensions/criterion-context-pack.js +109 -4
- package/packages/piagent-core/extensions/criterion-graph.js +4 -1
- package/packages/piagent-core/extensions/failure-types.ts +2 -2
- package/packages/piagent-core/extensions/fallback-base-policy.ts +101 -0
- package/packages/piagent-core/extensions/guard-types.ts +9 -1
- package/packages/piagent-core/extensions/piagent-guard.ts +374 -364
- package/packages/piagent-core/extensions/readonly-inline-inspection.ts +378 -0
- package/packages/piagent-core/extensions/recovery-decision-validation.ts +92 -0
- package/packages/piagent-core/extensions/shell-write-targets.js +15 -14
- package/packages/piagent-core/extensions/task-contract-view.js +4 -4
- package/packages/piagent-core/extensions/task-digest-migration.js +2 -2
- package/packages/piagent-core/extensions/task-journal.js +48 -3
- package/packages/piagent-core/extensions/task-lifecycle.js +32 -0
- package/packages/piagent-core/extensions/task-runtime-audit.js +8 -2
- package/packages/piagent-core/extensions/task-state.js +140 -43
- package/packages/piagent-core/extensions/task-terminal-disposition.js +10 -0
- package/packages/piagent-core/extensions/trajectory-contract.ts +5 -0
- package/packages/piagent-core/extensions/verification-intelligence.js +109 -20
- package/packages/piagent-core/extensions/workflow-catalog.ts +98 -0
- package/packages/piagent-core/extensions/workspace-evidence-roots.js +52 -16
- package/packages/piagent-core/extensions/workspace-revision.js +48 -0
- package/packages/piagent-core/extensions/workspace-verification-snapshot.js +13 -0
- package/packages/piagent-core/package.json +3 -3
- package/packages/piagent-core/policies/base-policy.json +43 -2
- package/packages/piagent-core/policy/authority-manifest.v1.json +3 -3
- package/packages/piagent-core/prompts/be-to-fe.md +2 -8
- package/packages/piagent-core/prompts/plan.md +1 -1
- package/packages/piagent-core/prompts/platform-improve.md +2 -6
- package/packages/piagent-core/prompts/review.md +2 -7
- package/packages/piagent-core/prompts/scout.md +1 -1
- package/packages/piagent-core/prompts/task.md +4 -3
- package/packages/piagent-core/runtime/context/adaptive-planner.ts +7 -3
- package/packages/piagent-core/runtime/hooks/agent-start-hook.ts +60 -59
- package/packages/piagent-core/runtime/hooks/agent-start-types.ts +48 -0
- package/packages/piagent-core/runtime/hooks/completion-hook.ts +83 -89
- package/packages/piagent-core/runtime/hooks/input-hook.ts +98 -7
- package/packages/piagent-core/runtime/hooks/protected-refusal-completion.ts +86 -0
- package/packages/piagent-core/runtime/hooks/session-hooks.ts +5 -2
- package/packages/piagent-core/runtime/hooks/session-start-hook.ts +150 -19
- package/packages/piagent-core/runtime/hooks/tool-result-hook.ts +111 -92
- package/packages/piagent-core/runtime/hooks/tool-result-metadata.ts +9 -0
- package/packages/piagent-core/runtime/hooks/tool-result-navigation.ts +36 -0
- package/packages/piagent-core/runtime/hooks/tool-result-retrieval.ts +42 -0
- package/packages/piagent-core/runtime/hooks/tool-result-value-helpers.ts +66 -0
- package/packages/piagent-core/runtime/input/chat-images.ts +1 -1
- package/packages/piagent-core/runtime/inspection/activity-event-adapter.ts +1 -1
- package/packages/piagent-core/runtime/inspection/bounded-emission-guard.ts +286 -0
- package/packages/piagent-core/runtime/inspection/runtime-event-store.ts +37 -7
- package/packages/piagent-core/runtime/inspection/same-process-bridge-proof.ts +1 -1
- package/packages/piagent-core/runtime/inspection/task-handoff-history.ts +2 -2
- package/packages/piagent-core/runtime/inspection/task-subagent-tree.ts +27 -4
- package/packages/piagent-core/runtime/inspection/tool-failure-classification.ts +69 -11
- package/packages/piagent-core/runtime/inspection/webui-snapshot.ts +104 -22
- package/packages/piagent-core/runtime/inspection/workspace-file-reader.ts +2 -132
- package/packages/piagent-core/runtime/model/provider-wire-fingerprint.ts +20 -0
- package/packages/piagent-core/runtime/model/service-tier-runtime.ts +242 -0
- package/packages/piagent-core/runtime/orchestration/helper-lifecycle.ts +16 -12
- package/packages/piagent-core/runtime/orchestration/minimal-delegation-policy.ts +71 -0
- package/packages/piagent-core/runtime/orchestration/owned-work-budget.ts +28 -20
- package/packages/piagent-core/runtime/orchestration/role-policy.ts +27 -9
- package/packages/piagent-core/runtime/orchestration/subagent-tool-policy.ts +329 -0
- package/packages/piagent-core/runtime/policy/block-remedy.ts +0 -4
- package/packages/piagent-core/runtime/policy/source-worktree-transaction.ts +75 -14
- package/packages/piagent-core/runtime/product/activity-inspector.ts +6 -3
- package/packages/piagent-core/runtime/product/edit-verifier-timing.ts +26 -0
- package/packages/piagent-core/runtime/product/efficiency-metrics.ts +15 -7
- package/packages/piagent-core/runtime/product/operator-projections.ts +8 -3
- package/packages/piagent-core/runtime/product/task-usage-hooks.ts +78 -0
- package/packages/piagent-core/runtime/product/task-usage.ts +104 -0
- package/packages/piagent-core/runtime/quality/edit-freshness-guard.ts +102 -0
- package/packages/piagent-core/runtime/quality/exact-output-contract.ts +20 -10
- package/packages/piagent-core/runtime/quality/performance-assurance.ts +3 -3
- package/packages/piagent-core/runtime/quality/protected-refusal-handoff.ts +35 -0
- package/packages/piagent-core/runtime/recovery/acceptance-recovery-guidance.ts +21 -0
- package/packages/piagent-core/runtime/recovery/continuation-budget.ts +12 -3
- package/packages/piagent-core/runtime/recovery/diagnostic-delivery.ts +61 -0
- package/packages/piagent-core/runtime/recovery/handoff-projection.ts +196 -58
- package/packages/piagent-core/runtime/recovery/handoff-verifier-binding.ts +24 -0
- package/packages/piagent-core/runtime/recovery/independent-verification-recovery.ts +79 -0
- package/packages/piagent-core/runtime/recovery/pristine-task-policy-refresh.ts +91 -0
- package/packages/piagent-core/runtime/recovery/recovery-policy.ts +31 -40
- package/packages/piagent-core/runtime/recovery/resume-state.ts +120 -19
- package/packages/piagent-core/runtime/recovery/semantic-repair-handshake.ts +7 -13
- package/packages/piagent-core/runtime/recovery/task-evidence-coverage-refresh.ts +217 -0
- package/packages/piagent-core/runtime/registration/activity-inspector-command.ts +2 -1
- package/packages/piagent-core/runtime/registration/context-commands.ts +28 -10
- package/packages/piagent-core/runtime/registration/knowledge-tools.ts +9 -5
- package/packages/piagent-core/runtime/registration/operator-catalogs.ts +4 -9
- package/packages/piagent-core/runtime/registration/operator-request-intake.ts +49 -0
- package/packages/piagent-core/runtime/registration/policy-tools.ts +8 -6
- package/packages/piagent-core/runtime/registration/session-commands.ts +10 -8
- package/packages/piagent-core/runtime/registration/session-wait-tool.ts +54 -0
- package/packages/piagent-core/runtime/registration/task-completion-tools.ts +39 -20
- package/packages/piagent-core/runtime/registration/task-evidence-tools.ts +21 -12
- package/packages/piagent-core/runtime/registration/task-start-conditional-mutation.ts +45 -0
- package/packages/piagent-core/runtime/registration/task-start-guidance.ts +24 -15
- package/packages/piagent-core/runtime/registration/task-start-manifest.ts +54 -0
- package/packages/piagent-core/runtime/registration/task-start-tool.ts +79 -79
- package/packages/piagent-core/runtime/registration/workflow-commands.ts +64 -93
- package/packages/piagent-core/runtime/runtime-limits.ts +16 -2
- package/packages/piagent-core/runtime/session/adaptive-context-analysis.ts +461 -0
- package/packages/piagent-core/runtime/session/adaptive-context-governor.ts +464 -0
- package/packages/piagent-core/runtime/session/adaptive-context-ledger.ts +265 -0
- package/packages/piagent-core/runtime/session/completion-signals.ts +23 -0
- package/packages/piagent-core/runtime/session/message-signals.ts +6 -18
- package/packages/piagent-core/runtime/session/operator-request-carry.ts +44 -0
- package/packages/piagent-core/runtime/session/retrieval-evidence-runtime.ts +188 -0
- package/packages/piagent-core/runtime/session/runtime-state.ts +37 -39
- package/packages/piagent-core/runtime/session/source-checkout-read-grants.ts +35 -0
- package/packages/piagent-core/runtime/session/system-prompt.ts +76 -14
- package/packages/piagent-core/runtime/session/task-contract-presentation.ts +39 -0
- package/packages/piagent-core/runtime/session/uncertain-send-continuation.ts +231 -0
- package/packages/piagent-core/runtime/session/usage.ts +4 -3
- package/packages/piagent-core/runtime/tools/apply-patch-tool.ts +6 -6
- package/packages/piagent-core/runtime/tools/phase-tool-runtime.ts +1 -1
- package/packages/piagent-core/runtime/tools/phase-tools.ts +10 -9
- package/packages/piagent-core/runtime/tools/session-wait.ts +42 -0
- package/packages/piagent-core/runtime/tools/tool-groups.ts +22 -5
- package/packages/piagent-core/runtime/trajectory/trajectory-runtime.ts +192 -5
- package/packages/piagent-core/runtime/trajectory/trajectory-types.ts +3 -2
- package/packages/piagent-core/runtime/verification/acceptance-api-baseline.js +488 -0
- package/packages/piagent-core/runtime/verification/completion-preparation.ts +22 -0
- package/packages/piagent-core/runtime/verification/composite-completion-finalizer.ts +105 -0
- package/packages/piagent-core/runtime/verification/composite-journal-anchor.ts +181 -0
- package/packages/piagent-core/runtime/verification/composite-runtime-binding.ts +76 -0
- package/packages/piagent-core/runtime/verification/composite-scoped-mediation.ts +318 -0
- package/packages/piagent-core/runtime/verification/composite-session-persistence.ts +175 -0
- package/packages/piagent-core/runtime/verification/composite-task-publication.ts +273 -0
- package/packages/piagent-core/runtime/verification/exact-verifier-reuse.ts +101 -0
- package/packages/piagent-core/runtime/verification/host-project-verification.ts +71 -0
- package/packages/piagent-core/runtime/verification/independent-acceptance-runtime.ts +500 -0
- package/packages/piagent-core/runtime/verification/runtime-assurance-facts.ts +500 -0
- package/packages/piagent-core/runtime/verification/runtime-contract-runner.ts +107 -0
- package/packages/piagent-core/runtime/verification/shell-verification-snapshots.ts +56 -0
- package/packages/piagent-core/runtime/workflows/change-clarification.ts +61 -0
- package/packages/piagent-core/runtime/workflows/input-routing.ts +21 -14
- package/packages/piagent-core/runtime/workflows/runtime-intake-compaction.ts +201 -0
- package/packages/piagent-core/runtime/workflows/task-followup-policy.ts +163 -0
- package/packages/piagent-core/runtime/workflows/task-intake.ts +276 -169
- package/packages/piagent-core/runtime/workflows/task-repair-intent.ts +67 -0
- package/packages/piagent-core/runtime/workflows/task-scope-resolution.ts +83 -0
- package/packages/piagent-core/runtime/workflows/webui-runtime-command.ts +5 -2
- package/packages/piagent-core/runtime/workflows/webui-workflow.ts +39 -32
- package/packages/piagent-core/runtime/workflows/workflow-follow-up.ts +33 -0
- package/packages/piagent-core/security/workspace-file-reader.ts +132 -0
- package/packages/piagent-core/subagents/piagent-oracle.md +5 -3
- package/packages/piagent-core/subagents/piagent-planner.md +6 -4
- package/packages/piagent-core/subagents/piagent-reviewer.md +5 -3
- package/packages/piagent-core/subagents/piagent-scout.md +4 -2
- package/packages/piagent-core/subagents/piagent-worker.md +6 -4
- package/packages/piagent-webui/dist/client/assets/{MarkdownMessage-CxeZqTte.js → MarkdownMessage-DGk34zJT.js} +1 -1
- package/packages/piagent-webui/dist/client/assets/{index-BV-_03yl.css → index-DVahUVWy.css} +1 -1
- package/packages/piagent-webui/dist/client/assets/index-DiKRmCEP.js +176 -0
- package/packages/piagent-webui/dist/client/index.html +2 -2
- package/packages/piagent-webui/extension/dispatch-user-entry.ts +13 -0
- package/packages/piagent-webui/extension/piagent-webui.ts +13 -3
- package/packages/piagent-webui/extension/review-controller.ts +29 -6
- package/packages/piagent-webui/extension/same-session-bridge.ts +7 -8
- package/packages/piagent-webui/extension/session-stream-adapter.ts +88 -16
- package/packages/piagent-webui/extension/source-mutation-controller.ts +29 -3
- package/packages/piagent-webui/extension/source-open-controller.ts +29 -7
- package/packages/piagent-webui/extension/source-revert-controller.ts +26 -3
- package/packages/piagent-webui/gateway/gateway-events.ts +22 -5
- package/packages/piagent-webui/gateway/gateway-service.ts +7 -2
- package/packages/piagent-webui/gateway/gateway-session-stream.ts +170 -32
- package/packages/piagent-webui/gateway/rpc-ui-context.ts +34 -9
- package/packages/piagent-webui/gateway/runtime-command-controller.ts +46 -6
- package/packages/piagent-webui/gateway/runtime-session-controls.ts +17 -2
- package/packages/piagent-webui/gateway/session-catalog.ts +9 -3
- package/packages/piagent-webui/gateway/session-command-controller.ts +29 -9
- package/packages/piagent-webui/gateway/session-effective-options.ts +2 -9
- package/packages/piagent-webui/gateway/session-inspection-registry.ts +11 -2
- package/packages/piagent-webui/gateway/session-operation-lifecycle.ts +237 -0
- package/packages/piagent-webui/gateway/session-operation-retry-control.ts +38 -0
- package/packages/piagent-webui/gateway/session-operation-settlement.ts +28 -0
- package/packages/piagent-webui/gateway/session-operation-watchdog.ts +9 -2
- package/packages/piagent-webui/gateway/session-prompt-dispatch.ts +37 -0
- package/packages/piagent-webui/gateway/session-runtime-close.ts +36 -0
- package/packages/piagent-webui/gateway/session-runtime-factory.ts +183 -6
- package/packages/piagent-webui/gateway/session-runtime-ownership.ts +48 -0
- package/packages/piagent-webui/gateway/session-runtime-state.ts +24 -0
- package/packages/piagent-webui/gateway/session-runtime-supervisor.ts +118 -117
- package/packages/piagent-webui/ownership/session-lease-store.ts +5 -2
- package/packages/piagent-webui/server/core-inspection-provider.ts +75 -15
- package/packages/piagent-webui/server/loopback-server.ts +9 -7
- package/packages/piagent-webui/server/terminal-delivery-receipt.ts +144 -0
- package/packages/piagent-webui/server/transcript-projection.ts +150 -11
- package/packages/piagent-webui/shared/message-correlation.ts +25 -0
- package/schemas/approved-host-contracts.schema.json +973 -0
- package/schemas/benchmark-attempt-outcome.schema.json +303 -0
- package/schemas/benchmark-independent-verification-plan.schema.json +34 -0
- package/schemas/codex-relative-efficiency-v1.schema.json +155 -0
- package/schemas/composite-criterion.schema.json +788 -0
- package/schemas/contract-family-library.schema.json +28 -0
- package/schemas/contract-selection-recipe.schema.json +31 -0
- package/schemas/failure-evidence.schema.json +2 -2
- package/schemas/helper-request.schema.json +16 -4
- package/schemas/host-contract-plan.schema.json +25 -0
- package/schemas/piagent-webui/gateway-protocol-v1.schema.json +16 -2
- package/schemas/piagent-webui/runtime-command-v1.schema.json +26 -3
- package/schemas/piagent-webui/runtime-event-v2.schema.json +46 -5
- package/schemas/piagent-webui/session-live-state-v1.schema.json +2 -0
- package/schemas/piagent-webui/snapshot-v1.schema.json +3 -0
- package/schemas/piagent-webui/source-change-v1.schema.json +12 -0
- package/schemas/piagent-webui/subagent-tree-v1.schema.json +11 -1
- package/schemas/piagent-webui/transcript-v1.schema.json +2 -1
- package/schemas/project-profile.schema.json +1 -1
- package/schemas/public-contracts/codex-mcp-metadata-v1.schema.json +206 -0
- package/schemas/public-contracts/codex-mcp-metadata-v2.schema.json +228 -0
- package/schemas/public-contracts/codex-mcp-metadata-v3.schema.json +233 -0
- package/schemas/public-contracts/revocation-v1.schema.json +87 -0
- package/schemas/public-contracts/subscription-contract-v1.schema.json +76 -0
- package/schemas/scoped-project-verification-receipt-v2.schema.json +83 -0
- package/schemas/scoped-project-verification-receipt-v3.schema.json +295 -0
- package/schemas/scoped-verification-receipt-v1.schema.json +76 -0
- package/schemas/task-contract.schema.json +45 -0
- package/scripts/approve-independent-verification.mjs +57 -0
- package/scripts/benchmark-arm-observer.mjs +320 -0
- package/scripts/benchmark-budget-ipc.mjs +34 -0
- package/scripts/benchmark-budget-launcher.mjs +91 -0
- package/scripts/benchmark-budget-processes.mjs +133 -0
- package/scripts/benchmark-budget-publication.mjs +228 -0
- package/scripts/benchmark-budget-runtime.mjs +136 -0
- package/scripts/benchmark-candidate-ablation.mjs +265 -0
- package/scripts/benchmark-codex-journey.mjs +406 -0
- package/scripts/benchmark-independent-verification.mjs +628 -0
- package/scripts/benchmark-journey-outcome.mjs +92 -0
- package/scripts/benchmark-production-v3-human-review.mjs +192 -0
- package/scripts/benchmark-public-input-catalog.mjs +158 -0
- package/scripts/benchmark-registered-plan-author.mjs +355 -0
- package/scripts/benchmark-registered-plan-recipe-support.mjs +85 -0
- package/scripts/benchmark-registered-plan-recipes-backend.mjs +165 -0
- package/scripts/benchmark-registered-plan-recipes-data.mjs +164 -0
- package/scripts/benchmark-registered-plan-recipes-platform.mjs +165 -0
- package/scripts/benchmark-runner-completion.mjs +133 -0
- package/scripts/benchmark-runner-configuration.mjs +159 -0
- package/scripts/benchmark-runner-core.mjs +224 -387
- package/scripts/benchmark-runner-finalization.mjs +144 -27
- package/scripts/benchmark-runner-provider-boundary.mjs +44 -0
- package/scripts/benchmark-runner-schedule.mjs +256 -0
- package/scripts/benchmark-runner-support.mjs +136 -4
- package/scripts/benchmark-runner.mjs +95 -18
- package/scripts/benchmark-scoped-broker-custody.mjs +483 -0
- package/scripts/benchmark-scoped-docs-verifier.mjs +203 -0
- package/scripts/benchmark-scoped-frozen-qualification.mjs +676 -0
- package/scripts/benchmark-scoped-pi-router.mjs +196 -0
- package/scripts/benchmark-scoped-project-verification-receipt.mjs +49 -0
- package/scripts/benchmark-scoped-project-verifier.mjs +461 -0
- package/scripts/benchmark-scoped-session-custody.mjs +599 -0
- package/scripts/benchmark-scoped-session-factory.mjs +342 -0
- package/scripts/benchmark-scoped-tool-broker.mjs +523 -0
- package/scripts/benchmark-scoped-verification-supervisor.mjs +773 -0
- package/scripts/benchmark-session-evaluator.mjs +169 -0
- package/scripts/benchmark-session-provider-boundary.mjs +62 -0
- package/scripts/benchmark-session-usage.mjs +28 -0
- package/scripts/benchmark-session.mjs +343 -50
- package/scripts/benchmark-webui-journey.mjs +678 -0
- package/scripts/check-public-wording.mjs +46 -0
- package/scripts/configure-subagents.sh +42 -34
- package/scripts/fs4-readiness-evaluation.mjs +7 -1
- package/scripts/helper-evaluation.mjs +1 -1
- package/scripts/phase-tools-evaluation.mjs +1 -0
- package/scripts/pi-auto.sh +7 -1
- package/scripts/pi-usage-history.mjs +201 -11
- package/scripts/piagent-cli.mjs +8 -0
- package/scripts/private-holdout-readiness.mjs +7 -1
- package/scripts/public-evaluation-exposure.mjs +140 -0
- package/scripts/select-independent-verification.mjs +62 -0
- package/scripts/team-doctor.sh +1 -1
- package/scripts/typescript-loader.mjs +135 -1
- package/scripts/update-global.mjs +6 -7
- package/scripts/verify-local.sh +41 -55
- package/scripts/verify-release-identity.mjs +5 -3
- package/packages/piagent-webui/dist/client/assets/index-DynIMe8I.js +0 -176
|
@@ -41,6 +41,8 @@ pi install /path/to/piagent
|
|
|
41
41
|
|
|
42
42
|
## Versioning
|
|
43
43
|
|
|
44
|
+
- `1.7.1`: Pi 0.86.1, chờ trong phiên đang mở, sửa context/usage và phục hồi; kết quả chạy lại 14 phiên lỗi được giữ riêng, không claim một full108 mới hay tiết kiệm token tổng thể.
|
|
45
|
+
- `1.7.0`: chỉ có annotated tag; macOS tag CI chạm giới hạn 40 phút hai lần nên npm và GitHub Release không được publish. Được thay bằng `1.7.1`.
|
|
44
46
|
- `0.1.x`: local/internal pilot.
|
|
45
47
|
- `0.2.x`: có guard ổn định và docs team.
|
|
46
48
|
- `1.0.2`: đủ security review, MCP registry, adapter schema versioned.
|
|
@@ -98,6 +100,11 @@ pi install /path/to/piagent
|
|
|
98
100
|
Inspector; projection Task Changes / Working Tree / Staged có bounded diff,
|
|
99
101
|
provenance và enforce protected path; session lease bền, recovery khi restart
|
|
100
102
|
hoặc owner cũ treo, doctor có repair tường minh.
|
|
103
|
+
- `1.6.1`: patch ổn định runtime và chi phí — transcript chỉ hiện response khi
|
|
104
|
+
durable task đã terminal, Activity phân loại đúng retry/helper failure, review
|
|
105
|
+
repo ngoài chỉ nhận read grant session-scoped cho checkout chính xác, và direct
|
|
106
|
+
subagent bị khóa solo-first với một helper read-only có budget hữu hạn. Benchmark
|
|
107
|
+
thêm gate provider-free/Codex-relative nhưng không đưa ra claim chi phí mới.
|
|
101
108
|
- `1.6.0`: context evidence khóa đúng turn/session/task run; WebUI có canonical
|
|
102
109
|
live state, watchdog và Stop an toàn qua reload/multi-tab; chat chỉ hiện kết
|
|
103
110
|
quả thành công còn retry/lỗi nằm trong Activity; deep-logic benchmark có bài
|
|
@@ -63,6 +63,18 @@ và stress projection ở ba cỡ repository. Receipt của read-only control ph
|
|
|
63
63
|
`modelCallObserved=false`; nếu runtime vô tình mở model turn, gate trả
|
|
64
64
|
`effect-unknown` thay vì claim 0 token.
|
|
65
65
|
|
|
66
|
+
Terminal settlement của Gateway mô tả trạng thái vận chuyển/UI, không tự suy
|
|
67
|
+
diễn ý nghĩa câu trả lời. Safety-refusal phải kết thúc `completed` với một
|
|
68
|
+
response bền vững để UI hiển thị; `blocked` vẫn dành cho completion gate/task
|
|
69
|
+
chưa hoàn tất và không được tính như refusal. Outcome `refused` của benchmark
|
|
70
|
+
được hard-gate bằng fixture không đổi, scope sạch, không lộ secret và hidden
|
|
71
|
+
grade; runner không parse keyword trong lời model để đoán refusal.
|
|
72
|
+
|
|
73
|
+
Token và subagent accounting của WebUI chỉ đọc Pi session JSONL dưới runtime
|
|
74
|
+
`sessions/`. Gateway admission/index/lease journals không phải provider session
|
|
75
|
+
và không được phép làm tăng session count; thiếu hoặc sai session header vẫn
|
|
76
|
+
fail-closed.
|
|
77
|
+
|
|
66
78
|
Khi cần đo solver logic sâu theo baseline lịch sử Luna/medium với `codex-cli`:
|
|
67
79
|
|
|
68
80
|
```bash
|
|
@@ -124,8 +136,115 @@ mỗi family và 2 surface, tổng cộng 108 model session. Bộ này dùng đ
|
|
|
124
136
|
regression của harness/model policy, không tự chứng minh generalization hoặc độ
|
|
125
137
|
ổn định production.
|
|
126
138
|
|
|
127
|
-
|
|
128
|
-
|
|
139
|
+
### Production-v2: Luna medium Fast và net-35 all-in
|
|
140
|
+
|
|
141
|
+
Track mới chạy bằng `npm run benchmark:production-v2 -- --dry-run` rồi theo các
|
|
142
|
+
mốc S12/S18/S54/S108. Ma trận vẫn là 108 session: 9 task family × 3 structural
|
|
143
|
+
variant × 2 repeat × 2 surface. Suite khóa cùng
|
|
144
|
+
`openai-codex/gpt-5.6-luna`, `medium` và Fast mode cho cả hai surface. Ở wire
|
|
145
|
+
OpenAI, Fast được ánh xạ thành `service_tier=priority`; literal `fast` không phải
|
|
146
|
+
giá trị hợp lệ của Responses API và benchmark phải fail closed nếu quan sát thấy nó.
|
|
147
|
+
Piagent lẫn controlled `codex-cli`; resume/replay, spend-control và configuration
|
|
148
|
+
digest đều giữ nguyên ba giá trị này. Cổng tổng hợp là **Fast execution
|
|
149
|
+
configuration parity**: Piagent phải có outbound telemetry ánh xạ ý định Fast
|
|
150
|
+
sang wire tier `priority` đầy đủ cho mọi provider start/wire event. Surface
|
|
151
|
+
controlled `codex-cli`
|
|
152
|
+
phải có receipt của argv thực tế cho lượt đầu, gồm `--strict-config`,
|
|
153
|
+
`service_tier="fast"`, feature `fast_mode`, executable identity, isolated
|
|
154
|
+
`CODEX_HOME`, stdout `thread.started`, exact usage và rollout
|
|
155
|
+
`session_meta`/`turn_context` khớp thread, workspace, model, thinking. Mỗi lượt
|
|
156
|
+
resume tiếp theo phải có cùng invocation receipt và đúng một effective
|
|
157
|
+
`thread_settings_applied` tier `priority`; tổng coverage bắt buộc là một initial
|
|
158
|
+
receipt cộng `providerStartedAttempts - 1` resume-settings event. Thiếu hoặc
|
|
159
|
+
mâu thuẫn một bằng chứng, hay thấy `default`, đều làm claim fail closed. Rollout
|
|
160
|
+
Codex không phát `thread_settings_applied` cho initial `exec`, vì vậy benchmark
|
|
161
|
+
không được nhầm một session chỉ có một lượt thành Fast failure, cũng không được
|
|
162
|
+
dùng command binding đơn lẻ nếu thiếu các identity/outcome binding nói trên.
|
|
163
|
+
|
|
164
|
+
Hai cổng token độc lập cùng phải pass ở S108:
|
|
165
|
+
|
|
166
|
+
- cận trên 95% của primary fixed-workload family ratio vẫn `<= 0.60`;
|
|
167
|
+
- pooled fresh token của **mọi accepted attempt cộng mọi exact failed/retry
|
|
168
|
+
attempt** phải `<= 0.65` so với `codex-cli`, tương ứng net reduction ít nhất
|
|
169
|
+
35%. Unknown attempt usage không được trừ hao hay bỏ khỏi mẫu; nó làm gate
|
|
170
|
+
fail-closed.
|
|
171
|
+
|
|
172
|
+
Chuỗi chạy chính thức của track này là S0 rồi mở đúng từng cửa sổ mới
|
|
173
|
+
`12/6/36/54`; không chạy lại session đã có và chỉ S108 mới có quyền claim:
|
|
174
|
+
|
|
175
|
+
```bash
|
|
176
|
+
npm run benchmark:production-v2 -- --preflight-only
|
|
177
|
+
npm run benchmark:production-v2 -- --max-sessions 12 --stop-after-failed-pair --output /path/to/report-dir --yes
|
|
178
|
+
npm run benchmark:production-v2 -- --resume /path/to/report-dir --max-sessions 6 --yes
|
|
179
|
+
npm run benchmark:production-v2 -- --resume /path/to/report-dir --max-sessions 36 --yes
|
|
180
|
+
npm run benchmark:production-v2 -- --resume /path/to/report-dir --max-sessions 54 --yes
|
|
181
|
+
```
|
|
182
|
+
|
|
183
|
+
S0 dùng `providerFreeConfigurationDigest` riêng: nó vẫn bind source/tree,
|
|
184
|
+
suite, model, thinking, Fast tier, seed/order, runtime, timeout và retry policy,
|
|
185
|
+
nhưng loại các trường chỉ thuộc invocation như private credential-vault ID,
|
|
186
|
+
output, resume và kích thước stage window. Vì vậy S12/S18/S54/S108 reuse nguyên
|
|
187
|
+
receipt S0; thay đổi semantic, source hoặc lane bytes vẫn làm cache miss
|
|
188
|
+
fail-closed. Measurement `configurationDigest` đầy đủ vẫn giữ private vault ID
|
|
189
|
+
để khóa ledger, campaign và resume lineage, nên tối ưu cache này không nới
|
|
190
|
+
quyền hay trộn hai paid run.
|
|
191
|
+
|
|
192
|
+
Khi operator muốn **đo đủ 108 phiên trước rồi mới sửa**, có thể chủ động chọn
|
|
193
|
+
`--measurement-only` thay cho chuỗi release theo giai đoạn:
|
|
194
|
+
|
|
195
|
+
```bash
|
|
196
|
+
node scripts/benchmark-runner.mjs --suite production-v2 --measurement-only --max-sessions 108 --keep-workspaces --output /path/to/measurement-report --yes
|
|
197
|
+
```
|
|
198
|
+
|
|
199
|
+
Chế độ này chỉ áp dụng cho ma trận production-v2 đầy đủ, controlled Codex và
|
|
200
|
+
Pi release-defaults. Bài, thứ tự, seed, model/medium/Fast, hai repeat, zero retry,
|
|
201
|
+
chấm điểm, ràng buộc source sạch, bốn lane S0 và sổ mọi provider attempt vẫn
|
|
202
|
+
giữ nguyên. Operator cấp một cửa sổ `0→108`; điểm thấp, thất bại của agent và tỷ
|
|
203
|
+
lệ token xấu không kết thúc sớm cửa sổ đó. Lỗi hạ tầng, source thay đổi hoặc
|
|
204
|
+
usage không xác định vẫn không được bỏ qua. Không kết hợp với lọc bài, replay,
|
|
205
|
+
giới hạn thời gian toàn lượt hay `--stop-after-failed-pair`.
|
|
206
|
+
|
|
207
|
+
Lựa chọn được khóa vào configuration digest, manifest, preflight và report;
|
|
208
|
+
không thể chuyển một campaign release cũ sang chế độ này khi resume. Các số đo,
|
|
209
|
+
PASS/FAIL và release gate trong report vẫn là số thật, nhưng report luôn ghi
|
|
210
|
+
measurement-only, campaign kết thúc `no-claim`, không cấp token-saving hay
|
|
211
|
+
generalization claim. Exit code có thể khác 0 dù đã đo đủ 108, nếu release gate
|
|
212
|
+
không đạt; phải kiểm tra report và ledger thay vì gọi đó là benchmark chưa chạy.
|
|
213
|
+
Đây không phải chứng nhận full offline qualification hay production readiness.
|
|
214
|
+
|
|
215
|
+
Production-v2 bind một paid campaign vào exact suite, candidate, configuration
|
|
216
|
+
và output directory. Nếu campaign đã khởi động provider nhưng dừng giữa chừng,
|
|
217
|
+
fail gate hoặc kết thúc `no-claim`, cùng lineage chỉ được resume đúng output đó;
|
|
218
|
+
không được mở output mới để chọn lại mẫu đẹp hơn. Candidate/configuration thực
|
|
219
|
+
sự đổi mới được mở campaign mới, nhưng campaign cũ được giữ nguyên ledger và
|
|
220
|
+
đóng bằng disposition `superseded-changed-lineage-no-claim`. Report tách rõ
|
|
221
|
+
all-attempt ledger của campaign hiện tại dùng cho net-35 với lịch sử chi tiêu
|
|
222
|
+
campaign trước; lịch sử cũ không bị cộng vào tỷ lệ candidate hiện tại và cũng
|
|
223
|
+
không bị xóa. Known exact token được cộng thành subtotal riêng, còn chỉ một
|
|
224
|
+
prior/current attempt thiếu exact usage cũng phải hiện tổng usage là
|
|
225
|
+
`unavailable`; runner không tự retry unknown-cost attempt. Reservation chưa hề
|
|
226
|
+
khởi động provider vẫn có thể được supersede mà không tạo paid-history giả.
|
|
227
|
+
|
|
228
|
+
Pi host hiện chứng minh được outbound request Fast; surface controlled
|
|
229
|
+
`codex-cli` chứng minh strict
|
|
230
|
+
initial invocation cộng effective settings của toàn bộ lượt resume. Hai nguồn đó
|
|
231
|
+
chỉ cho phép claim execution-configuration parity, không cho phép suy ra actual
|
|
232
|
+
provider processing tier.
|
|
233
|
+
Pi host hiện chưa expose trường `response.service_tier`, nên report giữ provider
|
|
234
|
+
processing tier ở `unavailable`. Nếu response tier được host expose về sau, chỉ
|
|
235
|
+
`fast|priority` được chấp nhận; `default` là downgrade.
|
|
236
|
+
Fast của GPT-5.6 được report bằng hai mức **tham chiếu** riêng: ChatGPT
|
|
237
|
+
subscription credits `2.5x` và API Fast token pricing `2x`. Billing mode và
|
|
238
|
+
multiplier thực áp dụng cho run vẫn là `unverified` nếu chưa có bằng chứng độc
|
|
239
|
+
lập; cả hai reference đều non-blocking và tuyệt đối không nhân/chia vào
|
|
240
|
+
provider-reported token ratio.
|
|
241
|
+
|
|
242
|
+
### Production-v1 legacy: fixed-workload 40%
|
|
243
|
+
|
|
244
|
+
Phần contract dưới đây chỉ áp dụng cho `production-v1`: efficiency claim được
|
|
245
|
+
xét ở **S108**, sau khi có đủ 18 family × 3 repeat × 2 surface. Claim phải qua
|
|
246
|
+
hai trục độc lập. Primary fresh-token
|
|
247
|
+
estimand được khai báo trước là
|
|
129
248
|
`fixed-workload-family-ratio`: trong từng family, cộng fresh token chính xác của
|
|
130
249
|
đủ ba attempt đã định trước ở mỗi surface, gồm cả usage của failed attempt đã
|
|
131
250
|
khởi động provider; sau đó lấy geometric mean của 18 tỷ lệ family và CI 95% trên
|
|
@@ -142,6 +261,25 @@ phải có exact terminal token buckets; thiếu một attempt/family hoặc unk
|
|
|
142
261
|
usage của accepted/failed attempt làm primary evidence không đầy đủ và chặn
|
|
143
262
|
claim.
|
|
144
263
|
|
|
264
|
+
Production còn có hard gate ngân sách subagent độc lập với normalized cost:
|
|
265
|
+
mỗi provider attempt của Piagent được phép tối đa một child session, tổng token
|
|
266
|
+
traffic của child không vượt `5%` tổng token traffic candidate, và `sessions`
|
|
267
|
+
phải được giải thích chính xác bằng một root session cộng số child session. Gate
|
|
268
|
+
này tính cả accepted attempt lẫn provider-started failed attempt; thiếu ledger,
|
|
269
|
+
thiếu exact child-token bucket hoặc session không giải thích được đều chặn stage
|
|
270
|
+
và claim, kể cả khi `requireNormalizedCostClaim=false`.
|
|
271
|
+
|
|
272
|
+
Diagnostic Codex-relative thứ hai đo mục tiêu chi phí vận hành: cùng task,
|
|
273
|
+
fixture, model và thinking, cộng **toàn bộ provider token traffic** gồm fresh
|
|
274
|
+
input, output, cache read và cache write của accepted attempt lẫn
|
|
275
|
+
provider-started failed/retry attempt. Contract tùy chọn cho một suite tương lai
|
|
276
|
+
sẽ chỉ cho phép nói "rẻ hơn `codex-cli` ít nhất 30%" khi point estimate lẫn cận
|
|
277
|
+
trên 95% của total-traffic ratio và API-equivalent cost ratio không vượt `0.70`,
|
|
278
|
+
đồng thời chất lượng/task continuity đều đạt. `production-v1` hiện giữ
|
|
279
|
+
`requireNormalizedCostClaim=false`, nên metric này chỉ là diagnostic và không
|
|
280
|
+
được dùng để claim 30–40% cost; hard claim S108 của v1 vẫn là fresh-token ratio
|
|
281
|
+
upper-95 không vượt `0.60`.
|
|
282
|
+
|
|
145
283
|
Hai hard non-regression axis còn lại là paired model intelligence và task
|
|
146
284
|
continuity. Piagent phải dùng đúng cùng model/thinking với controlled baseline CLI,
|
|
147
285
|
không thấp điểm hơn ở bất kỳ paired grade nào, đạt mọi quality/safety/
|
|
@@ -150,14 +288,16 @@ Piagent session phải resolved với đầy đủ workflow cùng causal lifecyc
|
|
|
150
288
|
evidence. Một task bị đứt, timeout, orphan, terminal state không rõ hoặc thiếu
|
|
151
289
|
evidence không thể được bù bằng token saving ở task khác.
|
|
152
290
|
|
|
153
|
-
Codex OAuth không cung cấp billed monetary cost, nên
|
|
154
|
-
Production-v1 đo riêng **API-equivalent text-token
|
|
291
|
+
Codex OAuth không cung cấp billed monetary cost, nên không thể suy tỷ lệ phần
|
|
292
|
+
trăm subscription từ report. Production-v1 đo riêng **API-equivalent text-token
|
|
293
|
+
cost** bằng pricing snapshot
|
|
155
294
|
có version trong suite: GPT-5.6 Luna ở `$0.20/M` fresh input, `$0.02/M` cached
|
|
156
295
|
input, `$1.20/M` output và cache write bằng `1.25x` fresh-input rate. Đây là
|
|
157
|
-
|
|
158
|
-
|
|
159
|
-
|
|
160
|
-
|
|
296
|
+
diagnostic quan sát của `production-v1`, không phải hóa đơn OAuth và không
|
|
297
|
+
khẳng định mức trừ quota subscription. Chỉ một suite tương lai bật explicit
|
|
298
|
+
cost claim và có usage từng request đầy đủ mới được nâng nó thành hard gate.
|
|
299
|
+
Metric chỉ chuẩn hóa
|
|
300
|
+
input/cache/output text token, không bao gồm tool-specific charge. Snapshot dẫn nguồn
|
|
161
301
|
[OpenAI GPT-5.6 Luna model page](https://developers.openai.com/api/docs/models/gpt-5.6-luna).
|
|
162
302
|
|
|
163
303
|
Long-context multiplier là thuộc tính từng request: request input trên 272K
|
|
@@ -165,8 +305,8 @@ dùng input `2x` và output `1.5x`. Report chỉ dùng standard tier khi tổng
|
|
|
165
305
|
tokens của run không vượt 272K, vì tổng đó là upper bound của từng request. Nếu
|
|
166
306
|
tổng lớn hơn nhưng không có exact per-request usage, applicability là `unknown`
|
|
167
307
|
và normalized-cost diagnostic ghi `unavailable`; runner không nhân mù trên
|
|
168
|
-
aggregate
|
|
169
|
-
|
|
308
|
+
aggregate. Điều này không phủ quyết exact token-traffic measurement, nhưng chặn
|
|
309
|
+
mọi optional Codex-relative cost claim thay vì giả định một mức giá có lợi. Nhãn
|
|
170
310
|
`steady-state` ở suite này nghĩa là project đã được onboarding/build Context
|
|
171
311
|
Engine trước một request mới; nó không phải bằng chứng multi-turn hay session
|
|
172
312
|
continuity trong công việc thực tế.
|
|
@@ -187,9 +327,12 @@ session.
|
|
|
187
327
|
|
|
188
328
|
Production suite có thể chạy lâu vì mọi session chạy tuần tự để giữ baseline
|
|
189
329
|
sạch. Chạy theo các mốc tích lũy `S0/12/36/72/108`; chỉ `S108` được xét claim.
|
|
190
|
-
Mọi stage trước chỉ là spend-control diagnostic
|
|
191
|
-
|
|
192
|
-
|
|
330
|
+
Mọi stage trước chỉ là spend-control diagnostic, không cấp early-success
|
|
331
|
+
verdict. Từ S12 và tại mỗi partial stage kế tiếp (S36, S72), runner vẫn dừng
|
|
332
|
+
chi tiêu nếu pooled fresh-token ratio tính trên exact accepted + failed-attempt
|
|
333
|
+
usage vượt `1.10`, hoặc bất kỳ family đã quan sát nào vượt `1.25`. Duration,
|
|
334
|
+
host load và normalized cost luôn là observational. `--max-sessions` tính số
|
|
335
|
+
session mới của chunk hiện tại, vì vậy
|
|
193
336
|
các lần resume lần lượt dùng `24`, `36`, `36`:
|
|
194
337
|
|
|
195
338
|
```bash
|
|
@@ -214,12 +357,30 @@ piagent-benchmark --resume /path/to/report-dir --max-sessions 36 --yes
|
|
|
214
357
|
piagent-benchmark --resume /path/to/report-dir --max-sessions 36 --yes
|
|
215
358
|
```
|
|
216
359
|
|
|
360
|
+
Trước provider preflight đầu tiên, S0 tự chạy bốn lane provider-free trên đúng
|
|
361
|
+
candidate hiện tại: `architecture-conformance-v1` chạy fail-fast cho dependency
|
|
362
|
+
boundary và line budget, `runtime-conformance-v1`, `long-horizon-v1` (tối thiểu
|
|
363
|
+
30 phút wall-clock) và `webui-parity-v1` gồm chín deterministic UI-stability suite.
|
|
364
|
+
Receipt có completion time và bind exact clean Git commit, candidate tree,
|
|
365
|
+
production configuration, cùng digest của từng lane config/runner. Receipt được
|
|
366
|
+
cache riêng tư theo toàn bộ binding; resume/S12 chỉ reuse khi mọi digest vẫn
|
|
367
|
+
khớp, còn source/config/runner đổi sẽ bắt buộc chạy lại S0. Vì vậy lần
|
|
368
|
+
`--preflight-only` production đầu tiên trên một binding sạch có thể mất hơn 30
|
|
369
|
+
phút nhưng không gọi provider và không dùng model token.
|
|
370
|
+
|
|
217
371
|
Không mở stage kế tiếp nếu có Piagent unresolved/score không vượt floor,
|
|
218
372
|
baseline-pass/Piagent-fail, unknown provider-attempt usage, infrastructure retry,
|
|
219
|
-
model/thinking/provider-wire drift
|
|
220
|
-
|
|
221
|
-
|
|
222
|
-
|
|
373
|
+
model/thinking/provider-wire drift, candidate provenance drift, subagent vượt
|
|
374
|
+
ngân sách, provider-free receipt sai binding, adaptive-context coverage
|
|
375
|
+
`partial`, hoặc catastrophic partial-stage ratio vượt ngưỡng trên. Runtime
|
|
376
|
+
coverage `not-observed` chỉ được chấp nhận khi lane provider-free cùng binding
|
|
377
|
+
đã phủ ca đó. Early success không phải stopping rule: chưa đủ 108 session thì
|
|
378
|
+
tuyệt đối không claim đạt 40%. Fresh ratio dưới ngưỡng catastrophic ở partial
|
|
379
|
+
stage vẫn chỉ là diagnostic; duration chậm, normalized-cost ratio xấu hoặc host
|
|
380
|
+
load cao không tự đóng stage. Ở S108, `production-v1` dùng hard gate fresh-token
|
|
381
|
+
đã khai báo cùng các quality/continuity/evidence gate độc lập;
|
|
382
|
+
total-traffic và normalized-cost Codex-relative vẫn observational cho tới khi có
|
|
383
|
+
suite version mới bật explicit cost claim và exact per-request pricing evidence.
|
|
223
384
|
File spend-control là contract được test; runner đọc trực tiếp các mốc session,
|
|
224
385
|
từ chối chunk đầu hoặc chunk resume không đúng phần còn lại của window đã duyệt.
|
|
225
386
|
Seed, surface, model, thinking, repeat, zero-retry và terminal pair-stop cũng được
|
|
@@ -236,9 +397,13 @@ infrastructure/unknown-usage và provenance có đường dừng/abort tự đ
|
|
|
236
397
|
diagnostic từ ledger đã chấp nhận và từ chối chạy thêm model session nếu
|
|
237
398
|
`stageAdvanceAllowed` không phải `true`; không thể vượt gate chỉ bằng cách sửa
|
|
238
399
|
file diagnostic đã ghi ở lần pause.
|
|
239
|
-
Artifact provider-free
|
|
400
|
+
Artifact provider-free tại mỗi pause kiểm tra pair boundary, candidate outcome floor,
|
|
240
401
|
baseline-pass/Piagent-fail, observed paired grade non-inferiority, exact accepted
|
|
241
|
-
usage, model/thinking/provider-wire
|
|
402
|
+
và failed-attempt usage, model/thinking/provider-wire, subagent budget,
|
|
403
|
+
source-bound S0 receipts, adaptive-context coverage và retry/unknown usage. Từ
|
|
404
|
+
S12, artifact còn hard-gate pooled ratio `<=1.10` và mọi observed family
|
|
405
|
+
`<=1.25`; S36/S72 phải tính lại trên toàn ledger hiện có, không kế thừa một lần
|
|
406
|
+
pass cũ. Pricing
|
|
242
407
|
applicability, duration và host load không nằm trong `blockingReasons`.
|
|
243
408
|
Mỗi Piagent record còn phải có causal context receipt hoàn chỉnh. Receipt chỉ
|
|
244
409
|
giữ aggregate, không giữ prompt, path, hash hay ID; nó bind provenance của
|
|
@@ -250,10 +415,12 @@ managed-prefix compaction, successful direct-path reread và số shell call sau
|
|
|
250
415
|
injection. Shell count được nêu riêng vì reread bên trong command không bị diễn
|
|
251
416
|
giải nhầm thành số 0 đã chứng minh.
|
|
252
417
|
Artifact vẫn liệt kê observed pair/family fresh-token, API-equivalent text-token
|
|
253
|
-
cost và duration ratio để review.
|
|
254
|
-
`decisionRole=final-only`;
|
|
255
|
-
`decisionRole=
|
|
256
|
-
|
|
418
|
+
cost và duration ratio để review. Primary S108 fresh-token check có
|
|
419
|
+
`decisionRole=final-only`; catastrophic partial-stage check có
|
|
420
|
+
`decisionRole=blocking` từ S12; cost, duration và host load có
|
|
421
|
+
`decisionRole=observational`. Metric observational không chặn stage; hard gate
|
|
422
|
+
catastrophic có thể từ chối mở window kế tiếp nhưng không cấp quyền claim sớm.
|
|
423
|
+
Diagnostic luôn có
|
|
257
424
|
`diagnosticOnly=true`, `claimEligible=false`; dù kết quả sớm tốt cũng không được
|
|
258
425
|
dùng làm stopping rule hay claim release.
|
|
259
426
|
|
|
@@ -281,11 +448,32 @@ Từ lớp benchmark matrix trong package, Piagent phân ba band:
|
|
|
281
448
|
| `deep-logic` | phát triển solver/workflow/WebUI logic | `deep-logic-v1`, 7 bài large với interacting invariants, 42 paired session; capability-tier full-suite gate, không phải production claim |
|
|
282
449
|
| `production` | release candidate, đổi model policy, đổi harness | `production-v1`, 18 public-regression scenario, paired baseline, confidence gate; không phải generalization claim |
|
|
283
450
|
| `capability` | tìm trần năng lực sau thay đổi harness | `capability-v1`, 6 bài multi-file/multi-component chưa bão hòa; dùng hill-climbing, không phải release gate |
|
|
451
|
+
| `architecture-conformance` | thay đổi module boundary hoặc file có line budget | Lane deterministic provider-free chạy fail-fast; bắt buộc mọi source được gán layer, dependency boundary và line budget đều pass, 0 provider call và 0 model token |
|
|
452
|
+
| `runtime-conformance` | thay đổi context governor, retry/settlement WebUI, emission hoặc edit freshness | `runtime-conformance-v1`, 9 ca deterministic provider-free; bắt buộc 0 provider call, 0 model token và mọi safety gate pass; không phải token/quality claim |
|
|
284
453
|
| `long-horizon` | thay đổi recovery/context lớn | Lane provider-free chạy ít nhất 30 phút cho hard crash/resume, compaction, handoff, continuation bounded và state-growth; dedicated paid suite chưa phát hành |
|
|
285
454
|
| `private-holdout` | readiness E3 và exact-RC FS7-01 | Tối thiểu 6 family từ 6 repository lineage, giữ ngoài workspace tác giả; chỉ custodian execute-only và human-calibration receipt được chấp nhận |
|
|
286
455
|
|
|
287
456
|
Hiện `core-v1`, `deep-logic-v1`, `production-v1`, `capability-v1` và `e2-framework-v1` chạy được bằng CLI. Thay đổi
|
|
288
457
|
recovery/context phải chạy `production-v1` cùng deterministic recovery tests.
|
|
458
|
+
Trước mọi canary trả phí sau thay đổi runtime, chạy lane không dùng model:
|
|
459
|
+
|
|
460
|
+
```bash
|
|
461
|
+
node evals/runtime-conformance-v1/runner.mjs \
|
|
462
|
+
--output .pi/benchmarks/runtime-conformance-v1-latest.json
|
|
463
|
+
```
|
|
464
|
+
|
|
465
|
+
Lệnh trên là vòng lặp developer nhanh, không thay S0 của production. Trước
|
|
466
|
+
provider session đầu tiên, production runner tự chạy hoặc exact-cache-hit cả
|
|
467
|
+
architecture conformance, runtime conformance, long-horizon tối thiểu 30 phút
|
|
468
|
+
và WebUI parity; cả bốn phải cùng clean source/tree/config/runner binding.
|
|
469
|
+
|
|
470
|
+
Lane chỉ đạt khi cả 9 ca pass, provider/model usage bằng 0, projection không tạo
|
|
471
|
+
tool orphan, retry sau output/tool-call không được chấp nhận, mỗi operation chỉ
|
|
472
|
+
có một terminal settlement, final response không bị emission guard lọc và stale
|
|
473
|
+
edit bị chặn cho tới khi đọc lại. Sau đó mới chạy canary chẩn đoán có chọn
|
|
474
|
+
scenario; chỉ candidate Git sạch đã qua canary mới được mở S12 của
|
|
475
|
+
`production-v1`. Không sửa task hoặc gate của canonical 108-session suite để
|
|
476
|
+
giữ khả năng so sánh lịch sử.
|
|
289
477
|
Lane `evals/long-horizon-v1` hiện là `runnable-provider-free`; nó chứng minh
|
|
290
478
|
lifecycle durability và local-state bounds, không tạo model quality, token,
|
|
291
479
|
latency, 90-minute wall-clock, generalization hay release claim. Dedicated paid
|
|
@@ -553,6 +741,88 @@ Root seed nằm trong `report.json` riêng tư để điều tra/reproduce. Khô
|
|
|
553
741
|
report production công khai khi chưa loại trường này, vì suite công khai có thể
|
|
554
742
|
dùng seed để tái tạo synthetic secret.
|
|
555
743
|
|
|
744
|
+
## Snapshot public regression của v1.6.0
|
|
745
|
+
|
|
746
|
+
Snapshot này là aggregate public-safe của release gate `production-v1` hiện
|
|
747
|
+
hành. Benchmark chạy trên exact clean commit đã được tag `v1.6.0`; số liệu dưới
|
|
748
|
+
đây dùng primary estimand fixed-workload đã khai báo trước khi quan sát kết quả.
|
|
749
|
+
Raw report, root seed, local path, provider/session identity và ledger theo từng
|
|
750
|
+
run vẫn là dữ liệu riêng tư, không phải public artifact.
|
|
751
|
+
|
|
752
|
+
| Thuộc tính | Giá trị |
|
|
753
|
+
|---|---|
|
|
754
|
+
| Release | `v1.6.0` |
|
|
755
|
+
| Exact source SHA | `3bba8f0b3ff521bc2a355e1f6bef6d1bbdc09511` |
|
|
756
|
+
| Run | `production-v1-20260824T040017Z-05b7cf` |
|
|
757
|
+
| Suite digest | `308dc2f0a4656cb272421949a01972df2b0717b4ffeb564306ae12aa669ae6b8` |
|
|
758
|
+
| Model | GPT-5.6 Luna cho cả Piagent và `codex-cli` |
|
|
759
|
+
| Thinking | `medium` cho cả hai surface |
|
|
760
|
+
| Ma trận | 18 scenario family x 3 repeat x 2 surface = 108 session |
|
|
761
|
+
| Baseline | `codex-cli` controlled mode |
|
|
762
|
+
| Accounting | 108/108 accepted attempt có exact token bucket; 0 infrastructure retry |
|
|
763
|
+
|
|
764
|
+
### Outcome, chất lượng và continuity
|
|
765
|
+
|
|
766
|
+
| Measurement | Piagent | `codex-cli` | Vai trò |
|
|
767
|
+
|---|---:|---:|---|
|
|
768
|
+
| Resolved outcome | **54/54** | 48/54 | Quality/continuity gate độc lập với token |
|
|
769
|
+
| Quality | **10.00** | không công bố aggregate score trong snapshot này | Paired no-quality-regression pass |
|
|
770
|
+
| Safety | **10.00** | không công bố aggregate score trong snapshot này | Scope/output-safety pass |
|
|
771
|
+
| Reliability | **10.00** | không công bố aggregate score trong snapshot này | Mọi Piagent session resolved |
|
|
772
|
+
| Workflow | **9.85** | n/a | Candidate continuity và workflow gate pass |
|
|
773
|
+
| Efficiency | **10.00** | 5.00 baseline | Fixed-workload efficiency gate pass |
|
|
774
|
+
| Overall | **9.97** | n/a | Production gate pass |
|
|
775
|
+
|
|
776
|
+
Piagent giải đủ 54 task trong khi baseline giải 48. Sáu baseline outcome không
|
|
777
|
+
resolved không bị loại khỏi token sample: token exact của chúng vẫn nằm trong
|
|
778
|
+
workload cố định. Vì vậy kết quả token không được cải thiện giả tạo bằng cách chỉ
|
|
779
|
+
giữ các cặp mà cả hai bên cùng thành công. Production gate và token-claim gate
|
|
780
|
+
đều pass; kết luận chất lượng vẫn là một hard gate riêng, không được suy ra từ
|
|
781
|
+
tỷ lệ token.
|
|
782
|
+
|
|
783
|
+
### Primary fresh-token estimand
|
|
784
|
+
|
|
785
|
+
Primary estimand là `fixed-workload-family-ratio`:
|
|
786
|
+
|
|
787
|
+
1. Với từng family, cộng fresh token exact của ba repeat đã định trước cho mỗi
|
|
788
|
+
surface, bao gồm mọi accepted outcome dù resolved hay unresolved.
|
|
789
|
+
2. Lấy tỷ lệ tổng Piagent / tổng `codex-cli` trong family đó.
|
|
790
|
+
3. Lấy geometric mean của 18 family ratio; confidence interval cluster theo 18
|
|
791
|
+
family, không giả ba repeat thành ba đơn vị mẫu độc lập.
|
|
792
|
+
|
|
793
|
+
| Measurement | Giá trị | Decision role |
|
|
794
|
+
|---|---:|---|
|
|
795
|
+
| Primary fixed-workload family ratio | **0.3857** | Blocking |
|
|
796
|
+
| Primary fresh-token delta | **-61.43%** | Blocking |
|
|
797
|
+
| 95% family-clustered CI | **0.3073..0.4840** | Blocking |
|
|
798
|
+
| Mức giảm tại cận bảo thủ 95% | **51.60%** | Diễn giải từ upper ratio 0.4840 |
|
|
799
|
+
| Family coverage | **18/18** | Blocking |
|
|
800
|
+
| All-attempt fresh token, Piagent | **421,119** | Descriptive aggregate |
|
|
801
|
+
| All-attempt fresh token, `codex-cli` | **951,172** | Descriptive aggregate |
|
|
802
|
+
| Aggregate all-attempt fresh-token ratio | **0.4427** | Descriptive, không điều khiển gate |
|
|
803
|
+
|
|
804
|
+
Cận trên CI `0.4840` thấp hơn threshold `0.60`, nên snapshot cho phép bounded
|
|
805
|
+
claim: trong workload public-regression đã quan sát, point estimate giảm 61.43%
|
|
806
|
+
fresh token và cận bảo thủ của phép đo tương ứng giảm 51.60%. Không chia hai tổng
|
|
807
|
+
token `421,119 / 951,172` để thay primary estimator; ratio `0.4427` chỉ giúp đọc
|
|
808
|
+
quy mô và sẽ khiến family lớn có trọng số cao hơn family nhỏ.
|
|
809
|
+
|
|
810
|
+
### Phạm vi của claim
|
|
811
|
+
|
|
812
|
+
Tên “production gate” chỉ nói đây là release gate của suite, không phải bằng
|
|
813
|
+
chứng rằng độ ổn định production dài hạn đã được chứng minh. Đây là synthetic
|
|
814
|
+
public regression do maintainer xây dựng, không phải independent benchmark và
|
|
815
|
+
không cho phép generalization claim. Snapshot không nói Piagent **luôn** tiết
|
|
816
|
+
kiệm đúng 61.43%, không bảo đảm thắng ở mọi family/session/repository/model, và
|
|
817
|
+
không thay thế family-disjoint holdout, shadow/canary task thực tế hoặc theo dõi
|
|
818
|
+
incident dài hạn.
|
|
819
|
+
|
|
820
|
+
Fresh token cũng không đồng nghĩa subscription spend hoặc provider-billed cost.
|
|
821
|
+
Duration, API-equivalent cost và host load nếu có trong private report chỉ là
|
|
822
|
+
diagnostic; chúng không điều khiển primary token verdict của contract này.
|
|
823
|
+
Bản trực quan aggregate nằm tại
|
|
824
|
+
[piagent.io.vn/benchmark](https://piagent.io.vn/benchmark).
|
|
825
|
+
|
|
556
826
|
## Snapshot public regression lịch sử của v1.2.12
|
|
557
827
|
|
|
558
828
|
Snapshot dưới đây là public-regression evidence đầu tiên của `production-v1`. Candidate
|
|
@@ -691,6 +961,12 @@ Runner chỉ cho phép kết luận tiết kiệm token khi:
|
|
|
691
961
|
report vẫn phải công khai mọi workflow check bị hụt;
|
|
692
962
|
- mọi Piagent session resolved, không timeout/orphan/unknown terminal state và
|
|
693
963
|
có complete causal context receipt;
|
|
964
|
+
- S0 có đủ bốn provider-free lane receipt cùng exact clean source/tree/config/runner
|
|
965
|
+
binding và completion time hợp lệ; adaptive-context `partial` luôn fail;
|
|
966
|
+
- mỗi Piagent provider attempt có tối đa một subagent, tổng subagent token
|
|
967
|
+
traffic không quá `5%`, và không có session/failed-attempt usage không giải thích;
|
|
968
|
+
- tại S12/S36/S72, pooled exact fresh ratio không vượt `1.10` và mọi observed
|
|
969
|
+
family không vượt `1.25`;
|
|
694
970
|
- ở S108, cận trên 95% của family-clustered fresh-token ratio không vượt `0.60`.
|
|
695
971
|
|
|
696
972
|
Production-v1 vẫn report token ratio theo band/family, normalized
|
|
@@ -34,7 +34,7 @@ npm install -g @piagent/platform
|
|
|
34
34
|
piagent-setup
|
|
35
35
|
```
|
|
36
36
|
|
|
37
|
-
Chạy `piagent-setup` ngay trong thư mục project. Nó tự cài đúng Pi Coding Agent `0.
|
|
37
|
+
Chạy `piagent-setup` ngay trong thư mục project. Nó tự cài đúng Pi Coding Agent `0.86.1` mà release này pin, cài Pi package, khởi tạo `.pi/`, rồi chạy doctor. Nó cũng cài MCP baseline, subagents, và Herdr Pi integration nếu `herdr` đã có sẵn trên `PATH`; thêm `--no-mcp`, `--no-subagents`, `--no-herdr` nếu không cần, hoặc `--global-only` nếu chưa muốn đụng project nào.
|
|
38
38
|
|
|
39
39
|
Nếu dùng [Herdr](https://herdr.dev/docs/install/) thì cài Herdr **trước** `piagent-setup`:
|
|
40
40
|
|
|
@@ -149,7 +149,7 @@ Muốn chạy nhiều agent song song thì gõ `herdr` thay vì `pi`, rồi mở
|
|
|
149
149
|
| `/workflow be-to-fe <việc>` | Backend read-only, làm FE. |
|
|
150
150
|
| `/workflow commit <message>` | Commit local có kiểm soát, không push. |
|
|
151
151
|
| `/workflow pr <title>` | Tạo PR, hỏi xác nhận trước khi push. |
|
|
152
|
-
| `/fresh
|
|
152
|
+
| `/fresh <workflow> <việc>` | Session đang nặng hoặc tràn context; nhận mọi workflow canonical, xem bằng `/fresh help`. |
|
|
153
153
|
|
|
154
154
|
`/commands` liệt kê hết. Các alias cũ như `/task`, `/scout`, `/be-to-fe`, `/fresh-task`, `/context-index`, `/logs` vẫn chạy nhưng không còn là đường onboard chính. Giải thích từng lệnh: [command-reference-vietnamese.md](command-reference-vietnamese.md). Các workflow ép shape rõ (`/parallel-review`, `/review-loop`, `/parallel-research`, `/parallel-context-build`): [subagents-and-multiagent.md](subagents-and-multiagent.md). Runtime gate tools và cách agent tự dùng chúng: [operator-manual-vietnamese.md](operator-manual-vietnamese.md).
|
|
155
155
|
|
|
@@ -7,11 +7,34 @@ Pi Agent Platform uses explicit release sources for team rollout. Personal machi
|
|
|
7
7
|
|
|
8
8
|
This file is the canonical install, update, rollback, and release checklist. Other docs link here instead of maintaining a second release procedure.
|
|
9
9
|
|
|
10
|
+
## v1.7.1 release boundary
|
|
11
|
+
|
|
12
|
+
The operator closed the paid benchmark cycle on 2026-09-22. This release uses
|
|
13
|
+
provider-free source, package, runtime, browser, and platform checks; it does
|
|
14
|
+
not require another paid smoke or 108-session run. The historical full run and
|
|
15
|
+
selected 14-attempt diagnostic rerun remain separate. Three diagnostic tasks
|
|
16
|
+
received clearer public API contracts and checks. Passing that subset does not
|
|
17
|
+
establish a new full-suite result, a token-saving claim, or production stability.
|
|
18
|
+
This explicit release boundary replaces the paid-run prerequisite below for
|
|
19
|
+
v1.7.1 only; ordinary package and CI gates remain required.
|
|
20
|
+
|
|
21
|
+
Acceptance proof is diagnostic by default in the installed v1.7.1 policy.
|
|
22
|
+
Unproved criteria stay pending in the task record and completion states that
|
|
23
|
+
there is no quality claim. The task contract, declared edit scope, current
|
|
24
|
+
passing verification, trace, and other operational gates remain enforced.
|
|
25
|
+
Projects requiring every criterion to be proved before completion must select
|
|
26
|
+
`acceptanceProofMode: "enforce"` in a reviewed package policy. Diagnostic
|
|
27
|
+
completion is an operational handoff, not evidence that the requested behavior
|
|
28
|
+
is correct or that benchmark performance improved.
|
|
29
|
+
The benchmark runner treats the installed diagnostic default as measurement-only
|
|
30
|
+
and withholds token and production claims even when the operator selects the
|
|
31
|
+
ordinary `release-defaults` treatment.
|
|
32
|
+
|
|
10
33
|
## Supported runtime matrix
|
|
11
34
|
|
|
12
|
-
All supported environments require Node.js `>=22.19.0` and Pi Coding Agent `0.
|
|
35
|
+
All supported environments require Node.js `>=22.19.0` and Pi Coding Agent `0.86.1`. The Pi host is installed as a Node CLI; Pi Agent Platform still defines its own release matrix because the terminal helpers and shell policy rely on Bash/POSIX behavior.
|
|
13
36
|
|
|
14
|
-
| Surface | Status for v1.
|
|
37
|
+
| Surface | Status for v1.7.1 | Rollout guidance |
|
|
15
38
|
|---|---|---|
|
|
16
39
|
| macOS Apple Silicon (`darwin/arm64`) + Bash | Verified for this release. | Safe default for team rollout after normal project smoke tests. |
|
|
17
40
|
| Linux x64 + Bash | Verified in GitHub Actions. | Safe default for CI/server usage after normal project smoke tests. |
|
|
@@ -106,7 +129,7 @@ These three components are versioned independently. A full install, update, or r
|
|
|
106
129
|
|
|
107
130
|
| Channel | Source shape | Mutability | Use when |
|
|
108
131
|
|---|---|---:|---|
|
|
109
|
-
| `stable` | `git:github.com/Vt-mmm/piagent@<resolved-commit-sha>` from `v1.
|
|
132
|
+
| `stable` | `git:github.com/Vt-mmm/piagent@<resolved-commit-sha>` from `v1.7.1` | Fixed after resolution | Default for team rollout. |
|
|
110
133
|
| `exact` | Tag, reviewed commit, or a tag resolved with `--resolve-tag` | Fixed when using a commit SHA | Pi-package-only roll forward, rollback, or reproduction. |
|
|
111
134
|
| `dev` | `git:github.com/Vt-mmm/piagent` | Moving | Personal machine or sandbox only. |
|
|
112
135
|
| `local` | `/path/to/piagent` | Local workspace | Platform development and dry-run validation. |
|
|
@@ -125,8 +148,8 @@ Use this flow when the team needs both terminal commands and the Pi package:
|
|
|
125
148
|
|
|
126
149
|
```bash
|
|
127
150
|
node --version # >= 22.19.0
|
|
128
|
-
npm install -g --ignore-scripts @earendil-works/pi-coding-agent@0.
|
|
129
|
-
npm install -g --ignore-scripts @piagent/platform@1.
|
|
151
|
+
npm install -g --ignore-scripts @earendil-works/pi-coding-agent@0.86.1
|
|
152
|
+
npm install -g --ignore-scripts @piagent/platform@1.7.1
|
|
130
153
|
piagent-install --stable --dry-run
|
|
131
154
|
piagent-install --stable
|
|
132
155
|
```
|
|
@@ -134,8 +157,8 @@ piagent-install --stable
|
|
|
134
157
|
The stable preview and apply output includes:
|
|
135
158
|
|
|
136
159
|
```text
|
|
137
|
-
currentRelease: v1.
|
|
138
|
-
tag: v1.
|
|
160
|
+
currentRelease: v1.7.1 (helper package version)
|
|
161
|
+
tag: v1.7.1
|
|
139
162
|
resolvedCommit: <40-char-sha>
|
|
140
163
|
source: git:github.com/Vt-mmm/piagent@<40-char-sha>
|
|
141
164
|
```
|
|
@@ -152,7 +175,7 @@ bash scripts/install-global.sh --stable
|
|
|
152
175
|
Use this only when terminal commands are not needed:
|
|
153
176
|
|
|
154
177
|
```bash
|
|
155
|
-
pi install git:github.com/Vt-mmm/piagent@v1.
|
|
178
|
+
pi install git:github.com/Vt-mmm/piagent@v1.7.1
|
|
156
179
|
```
|
|
157
180
|
|
|
158
181
|
Direct `pi install` does not create `piagent-*` commands on `PATH`.
|
|
@@ -217,7 +240,7 @@ Running it from a git checkout is refused rather than replacing that checkout's
|
|
|
217
240
|
The same sequence by hand, which must keep this order because `piagent-install` fails against a host that does not match the version it pins and does not install one itself:
|
|
218
241
|
|
|
219
242
|
```bash
|
|
220
|
-
npm install -g --ignore-scripts @earendil-works/pi-coding-agent@0.
|
|
243
|
+
npm install -g --ignore-scripts @earendil-works/pi-coding-agent@0.86.1
|
|
221
244
|
npm install -g --ignore-scripts @piagent/platform@X.Y.Z
|
|
222
245
|
piagent-install --stable --dry-run
|
|
223
246
|
piagent-install --stable
|