@piagent/platform 1.5.5 → 1.6.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +166 -0
- package/README.md +25 -21
- package/README.vi.md +34 -5
- package/adapters/web-frontend/profile.json +2 -4
- package/architecture/layers.json +18 -3
- package/benchmarks/deep-logic-v1/SPECIALIST_PROTOCOL.vi.md +122 -0
- package/benchmarks/deep-logic-v1/grade.mjs +272 -10
- package/benchmarks/deep-logic-v1/project/apps/admin/src/billing-summary.js +3 -0
- package/benchmarks/deep-logic-v1/project/benchmark-contract/public-smoke.test.js +166 -0
- package/benchmarks/deep-logic-v1/project/package.json +1 -1
- package/benchmarks/deep-logic-v1/project/packages/billing/src/close-period.js +3 -0
- package/benchmarks/deep-logic-v1/project/packages/billing/src/plan-timeline.js +3 -0
- package/benchmarks/deep-logic-v1/project/test/smoke.test.js +7 -1
- package/benchmarks/deep-logic-v1/prompts/budgeted-context-graph.md +2 -0
- package/benchmarks/deep-logic-v1/prompts/fair-dependency-scheduler.md +2 -0
- package/benchmarks/deep-logic-v1/prompts/layered-policy-resolution.md +2 -0
- package/benchmarks/deep-logic-v1/prompts/resumable-stream-assembly.md +3 -1
- package/benchmarks/deep-logic-v1/prompts/revision-event-reconciliation.md +2 -0
- package/benchmarks/deep-logic-v1/prompts/temporal-usage-billing-close.md +123 -0
- package/benchmarks/deep-logic-v1/prompts/transactional-config-merge.md +2 -0
- package/benchmarks/deep-logic-v1/suite.json +51 -3
- package/benchmarks/deep-logic-v1/variant.mjs +22 -1
- package/benchmarks/production-v1/spend-control.v1.json +92 -0
- package/benchmarks/production-v1/suite.json +46 -3
- package/catalog/capabilities.json +18 -18
- package/docs/authority-manifest.md +1 -1
- package/docs/auto-delegation-policy.md +38 -73
- package/docs/command-reference-vietnamese.md +27 -35
- package/docs/context-engine.md +12 -4
- package/docs/context-window-policy.md +37 -1
- package/docs/distribution-standard.md +7 -7
- package/docs/en/architecture.md +27 -13
- package/docs/languages.json +4 -4
- package/docs/model-options.md +8 -5
- package/docs/operator-manual-vietnamese.md +27 -45
- package/docs/project-adapters.md +2 -2
- package/docs/publishing-for-teams.md +10 -0
- package/docs/quality-benchmark.md +427 -62
- package/docs/release-install-policy.md +10 -9
- package/docs/runtime-harness-standard.md +3 -3
- package/docs/runtime-policy-design.md +4 -4
- package/docs/runtime-quality-baseline.md +13 -6
- package/docs/security-threat-model.md +2 -2
- package/docs/subagent-orchestration-capabilities.md +19 -51
- package/docs/subagents-and-multiagent.md +21 -47
- package/docs/task-implementation-contract.md +3 -3
- package/docs/task-lifecycle-vietnamese.md +3 -3
- package/docs/team-onboarding.md +2 -2
- package/docs/usage-observability.md +7 -2
- package/docs/vi/architecture.md +27 -13
- package/docs-site/architecture.html +1 -1
- package/docs-site/benchmark.html +89 -95
- package/docs-site/commands.html +1 -1
- package/docs-site/content/benchmark.html +88 -94
- package/docs-site/content/en/benchmark.html +134 -90
- package/docs-site/content/en/index.html +19 -19
- package/docs-site/content/en/runtime.html +4 -4
- package/docs-site/content/en/whats-new.html +12 -1
- package/docs-site/content/en/workflows.html +2 -2
- package/docs-site/content/index.html +19 -19
- package/docs-site/content/runtime.html +4 -4
- package/docs-site/content/whats-new.html +12 -1
- package/docs-site/content/workflows.html +2 -2
- package/docs-site/context-engine.html +1 -1
- package/docs-site/en/architecture.html +1 -1
- package/docs-site/en/benchmark.html +135 -91
- package/docs-site/en/commands.html +1 -1
- package/docs-site/en/context-engine.html +1 -1
- package/docs-site/en/index.html +20 -20
- package/docs-site/en/mcp-approval.html +1 -1
- package/docs-site/en/mcp-auth.html +1 -1
- package/docs-site/en/mcp-servers.html +1 -1
- package/docs-site/en/mcp.html +1 -1
- package/docs-site/en/permissions.html +1 -1
- package/docs-site/en/profiles.html +1 -1
- package/docs-site/en/quickstart.html +1 -1
- package/docs-site/en/runtime.html +5 -5
- package/docs-site/en/scope.html +1 -1
- package/docs-site/en/security.html +1 -1
- package/docs-site/en/team.html +1 -1
- package/docs-site/en/whats-new.html +13 -2
- package/docs-site/en/workflows.html +3 -3
- package/docs-site/index.html +20 -20
- package/docs-site/mcp-approval.html +1 -1
- package/docs-site/mcp-auth.html +1 -1
- package/docs-site/mcp-servers.html +1 -1
- package/docs-site/mcp.html +1 -1
- package/docs-site/permissions.html +1 -1
- package/docs-site/profiles.html +1 -1
- package/docs-site/quickstart.html +1 -1
- package/docs-site/runtime.html +5 -5
- package/docs-site/scope.html +1 -1
- package/docs-site/security.html +1 -1
- package/docs-site/team.html +1 -1
- package/docs-site/whats-new.html +13 -2
- package/docs-site/workflows.html +3 -3
- package/evals/fixtures/benchmark-assurance-evidence.invalid.json +1 -1
- package/evals/fixtures/benchmark-assurance-evidence.valid.json +1 -1
- package/evals/fixtures/codex-relative-efficiency-v1.invalid.json +4 -0
- package/evals/fixtures/codex-relative-efficiency-v1.valid.json +94 -0
- package/evals/fixtures/helper-request.invalid.json +1 -1
- package/evals/fixtures/helper-request.valid.json +1 -1
- package/evals/fixtures/piagent-webui/session-live-state-v1.invalid.json +18 -0
- package/evals/fixtures/piagent-webui/session-live-state-v1.valid.json +27 -0
- package/evals/fixtures/piagent-webui/subagent-tree-v1.valid.json +7 -0
- package/evals/fixtures/task-authority-snapshot.valid.json +4 -4
- package/evals/fs4-readiness-matrix.v1.json +2 -2
- package/evals/fs5-causal-arm.v1.json +3 -3
- package/evals/fs5-pilot-protocol.v1.json +3 -3
- package/evals/fs5-pilot-protocol.v2.json +8 -8
- package/evals/fs5-pilot-protocol.v3.json +8 -8
- package/evals/fs5-pilot-protocol.v4.json +7 -6
- package/evals/fs5-pilot-protocol.v5.json +9 -7
- package/evals/private-holdout-v1/public-exposure.v1.json +1 -1
- package/evals/runtime-conformance-v1/README.md +43 -0
- package/evals/runtime-conformance-v1/evaluate-paid-canary.mjs +198 -0
- package/evals/runtime-conformance-v1/lane.json +57 -0
- package/evals/runtime-conformance-v1/paid-canary.json +31 -0
- package/evals/runtime-conformance-v1/runner.mjs +456 -0
- package/package.json +3 -1
- package/packages/piagent-core/README.md +13 -4
- package/packages/piagent-core/benchmark/benchmark-assurance.js +4 -1
- package/packages/piagent-core/benchmark/benchmark-bootstrap.js +91 -9
- package/packages/piagent-core/benchmark/benchmark-claim-restrictions.js +38 -7
- package/packages/piagent-core/benchmark/benchmark-cli.js +7 -7
- package/packages/piagent-core/benchmark/benchmark-codex-relative-efficiency.js +698 -0
- package/packages/piagent-core/benchmark/benchmark-codex.js +3 -1
- package/packages/piagent-core/benchmark/benchmark-comparison.js +271 -2
- package/packages/piagent-core/benchmark/benchmark-core.js +736 -664
- package/packages/piagent-core/benchmark/benchmark-execution-guard.js +7 -5
- package/packages/piagent-core/benchmark/benchmark-forensics.js +441 -4
- package/packages/piagent-core/benchmark/benchmark-host-readiness.js +639 -0
- package/packages/piagent-core/benchmark/benchmark-matrix.js +22 -4
- package/packages/piagent-core/benchmark/benchmark-normalized-cost.js +317 -0
- package/packages/piagent-core/benchmark/benchmark-preflight.js +5 -1
- package/packages/piagent-core/benchmark/benchmark-process.js +6 -5
- package/packages/piagent-core/benchmark/benchmark-provider-free-evidence.js +345 -0
- package/packages/piagent-core/benchmark/benchmark-provider-wire.js +126 -0
- package/packages/piagent-core/benchmark/benchmark-record-validation.js +252 -0
- package/packages/piagent-core/benchmark/benchmark-report.js +130 -12
- package/packages/piagent-core/benchmark/benchmark-resume-recovery.js +14 -0
- package/packages/piagent-core/benchmark/benchmark-runner-policy.js +26 -0
- package/packages/piagent-core/benchmark/benchmark-runtime-causal.js +244 -0
- package/packages/piagent-core/benchmark/benchmark-stage-diagnostic.js +979 -0
- package/packages/piagent-core/benchmark/benchmark-statistics.js +64 -0
- package/packages/piagent-core/benchmark/benchmark-stop-policy.js +8 -5
- package/packages/piagent-core/benchmark/benchmark-suite-identity.js +31 -0
- package/packages/piagent-core/benchmark/benchmark-suite-runtime.js +13 -9
- package/packages/piagent-core/benchmark/benchmark-suite.js +149 -2
- package/packages/piagent-core/benchmark/benchmark-summary-support.js +380 -0
- package/packages/piagent-core/benchmark/benchmark-timing-diagnostics.js +971 -0
- package/packages/piagent-core/benchmark/benchmark-usage.js +322 -0
- package/packages/piagent-core/benchmark/benchmark-workflow.js +166 -0
- package/packages/piagent-core/capabilities/runtime-integrity.js +3 -0
- package/packages/piagent-core/docs/context-efficiency-improvement-plan.md +1080 -0
- package/packages/piagent-core/extensions/acceptance-behavior-proof.js +806 -0
- package/packages/piagent-core/extensions/acceptance-contract-semantics.js +83 -69
- package/packages/piagent-core/extensions/acceptance-error-classes.js +160 -0
- package/packages/piagent-core/extensions/acceptance-executable-evidence.js +12 -9
- package/packages/piagent-core/extensions/acceptance-receipt.js +123 -59
- package/packages/piagent-core/extensions/acceptance-state-machine-evidence.js +518 -0
- package/packages/piagent-core/extensions/acceptance-test-binding-evidence.js +60 -0
- package/packages/piagent-core/extensions/context-efficiency-metrics.js +302 -0
- package/packages/piagent-core/extensions/context-efficiency-report.js +167 -0
- package/packages/piagent-core/extensions/context-engine.js +149 -156
- package/packages/piagent-core/extensions/context-evidence.js +48 -0
- package/packages/piagent-core/extensions/context-import-links.js +296 -0
- package/packages/piagent-core/extensions/context-index-policy.js +4 -0
- package/packages/piagent-core/extensions/context-query-paths.js +57 -0
- package/packages/piagent-core/extensions/context-telemetry-integrity.js +65 -0
- package/packages/piagent-core/extensions/criterion-context-pack.js +435 -7
- package/packages/piagent-core/extensions/criterion-graph.js +82 -9
- package/packages/piagent-core/extensions/fallback-base-policy.ts +101 -0
- package/packages/piagent-core/extensions/guard-types.ts +6 -0
- package/packages/piagent-core/extensions/javascript-regex-evidence.js +32 -0
- package/packages/piagent-core/extensions/piagent-guard.ts +420 -260
- package/packages/piagent-core/extensions/task-contract-view.js +17 -3
- package/packages/piagent-core/extensions/task-lifecycle.js +39 -2
- package/packages/piagent-core/extensions/task-state.js +109 -142
- package/packages/piagent-core/extensions/verification-intelligence.js +52 -13
- package/packages/piagent-core/extensions/workspace-evidence-roots.js +193 -0
- package/packages/piagent-core/package.json +1 -1
- package/packages/piagent-core/policies/base-policy.json +44 -2
- package/packages/piagent-core/policy/authority-manifest.v1.json +3 -3
- package/packages/piagent-core/prompts/be-to-fe.md +2 -8
- package/packages/piagent-core/prompts/plan.md +1 -1
- package/packages/piagent-core/prompts/platform-improve.md +2 -6
- package/packages/piagent-core/prompts/review.md +2 -7
- package/packages/piagent-core/prompts/scout.md +1 -1
- package/packages/piagent-core/prompts/task.md +4 -3
- package/packages/piagent-core/runtime/context/context-delivery.ts +103 -0
- package/packages/piagent-core/runtime/context/context-delta-shadow.ts +53 -0
- package/packages/piagent-core/runtime/context/context-efficiency-format.ts +47 -0
- package/packages/piagent-core/runtime/context/context-evidence-qualification.ts +32 -0
- package/packages/piagent-core/runtime/context/prefix-telemetry.ts +47 -0
- package/packages/piagent-core/runtime/context/repository-memory-hints.ts +27 -0
- package/packages/piagent-core/runtime/hooks/agent-prompt-telemetry.ts +56 -0
- package/packages/piagent-core/runtime/hooks/agent-start-hook.ts +162 -102
- package/packages/piagent-core/runtime/hooks/completion-hook.ts +12 -12
- package/packages/piagent-core/runtime/hooks/input-hook.ts +17 -1
- package/packages/piagent-core/runtime/hooks/session-hooks.ts +22 -2
- package/packages/piagent-core/runtime/hooks/session-start-hook.ts +107 -3
- package/packages/piagent-core/runtime/hooks/tool-result-content-guards.ts +95 -0
- package/packages/piagent-core/runtime/hooks/tool-result-hook.ts +134 -166
- package/packages/piagent-core/runtime/hooks/tool-result-value-helpers.ts +66 -0
- package/packages/piagent-core/runtime/inspection/activity-event-adapter.ts +4 -2
- package/packages/piagent-core/runtime/inspection/activity-recovery.ts +104 -0
- package/packages/piagent-core/runtime/inspection/bounded-emission-guard.ts +286 -0
- package/packages/piagent-core/runtime/inspection/runtime-event-store.ts +37 -7
- package/packages/piagent-core/runtime/inspection/task-compaction-history.ts +1 -1
- package/packages/piagent-core/runtime/inspection/task-handoff-history.ts +1 -1
- package/packages/piagent-core/runtime/inspection/task-subagent-tree.ts +27 -4
- package/packages/piagent-core/runtime/inspection/tool-failure-classification.ts +70 -0
- package/packages/piagent-core/runtime/inspection/webui-snapshot.ts +73 -9
- package/packages/piagent-core/runtime/model/authenticated-catalog.ts +17 -9
- package/packages/piagent-core/runtime/model/openai-codex-reasoning.ts +83 -0
- package/packages/piagent-core/runtime/model/provider-wire-fingerprint.ts +238 -0
- package/packages/piagent-core/runtime/orchestration/helper-lifecycle.ts +16 -12
- package/packages/piagent-core/runtime/orchestration/minimal-delegation-policy.ts +71 -0
- package/packages/piagent-core/runtime/orchestration/owned-work-budget.ts +28 -20
- package/packages/piagent-core/runtime/orchestration/role-policy.ts +27 -9
- package/packages/piagent-core/runtime/orchestration/subagent-tool-policy.ts +329 -0
- package/packages/piagent-core/runtime/policy/block-remedy.ts +0 -4
- package/packages/piagent-core/runtime/product/activity-inspector.ts +7 -2
- package/packages/piagent-core/runtime/product/efficiency-metrics.ts +7 -2
- package/packages/piagent-core/runtime/quality/edit-freshness-guard.ts +102 -0
- package/packages/piagent-core/runtime/quality/exact-output-contract.ts +22 -11
- package/packages/piagent-core/runtime/quality/performance-assurance-signals.ts +23 -0
- package/packages/piagent-core/runtime/quality/performance-assurance.ts +9 -5
- package/packages/piagent-core/runtime/recovery/continuation-budget.ts +1 -1
- package/packages/piagent-core/runtime/recovery/edit-recovery-context.ts +113 -0
- package/packages/piagent-core/runtime/recovery/edit-recovery-delivery.ts +42 -0
- package/packages/piagent-core/runtime/recovery/handoff-projection.ts +4 -1
- package/packages/piagent-core/runtime/recovery/pristine-task-policy-refresh.ts +91 -0
- package/packages/piagent-core/runtime/recovery/recovery-policy.ts +7 -4
- package/packages/piagent-core/runtime/recovery/resume-state.ts +112 -14
- package/packages/piagent-core/runtime/recovery/semantic-repair-handshake.ts +60 -13
- package/packages/piagent-core/runtime/recovery/semantic-repair-runtime.ts +55 -2
- package/packages/piagent-core/runtime/recovery/task-evidence-coverage-refresh.ts +217 -0
- package/packages/piagent-core/runtime/registration/context-commands.ts +82 -7
- package/packages/piagent-core/runtime/registration/knowledge-tools.ts +9 -5
- package/packages/piagent-core/runtime/registration/operator-request-intake.ts +49 -0
- package/packages/piagent-core/runtime/registration/policy-tools.ts +50 -15
- package/packages/piagent-core/runtime/registration/session-commands.ts +1 -1
- package/packages/piagent-core/runtime/registration/task-completion-tools.ts +61 -25
- package/packages/piagent-core/runtime/registration/task-evidence-tools.ts +21 -12
- package/packages/piagent-core/runtime/registration/task-start-guidance.ts +169 -0
- package/packages/piagent-core/runtime/registration/task-start-manifest.ts +54 -0
- package/packages/piagent-core/runtime/registration/task-start-retry-helpers.ts +37 -0
- package/packages/piagent-core/runtime/registration/task-start-tool.ts +108 -103
- package/packages/piagent-core/runtime/runtime-limits.ts +16 -2
- package/packages/piagent-core/runtime/session/adaptive-context-analysis.ts +461 -0
- package/packages/piagent-core/runtime/session/adaptive-context-governor.ts +464 -0
- package/packages/piagent-core/runtime/session/adaptive-context-ledger.ts +265 -0
- package/packages/piagent-core/runtime/session/message-signals.ts +7 -3
- package/packages/piagent-core/runtime/session/operator-request-carry.ts +44 -0
- package/packages/piagent-core/runtime/session/runtime-state.ts +161 -5
- package/packages/piagent-core/runtime/session/source-checkout-read-grants.ts +35 -0
- package/packages/piagent-core/runtime/session/system-prompt.ts +76 -14
- package/packages/piagent-core/runtime/session/task-contract-presentation.ts +39 -0
- package/packages/piagent-core/runtime/tools/apply-patch-tool.ts +500 -0
- package/packages/piagent-core/runtime/tools/phase-tools.ts +8 -8
- package/packages/piagent-core/runtime/tools/tool-groups.ts +12 -2
- package/packages/piagent-core/runtime/trajectory/trajectory-runtime.ts +2 -1
- package/packages/piagent-core/runtime/verification/exact-verifier-reuse.ts +101 -0
- package/packages/piagent-core/runtime/workflows/runtime-intake-compaction.ts +164 -0
- package/packages/piagent-core/runtime/workflows/task-intake.ts +207 -38
- package/packages/piagent-core/security/sensitive-data.js +13 -218
- package/packages/piagent-core/security/sensitive-project-file.js +42 -0
- package/packages/piagent-core/security/sensitive-source-expression.js +330 -0
- package/packages/piagent-core/security/sensitive-source-formats.js +394 -0
- package/packages/piagent-core/security/sensitive-text.js +234 -0
- package/packages/piagent-core/subagents/piagent-oracle.md +5 -3
- package/packages/piagent-core/subagents/piagent-planner.md +6 -4
- package/packages/piagent-core/subagents/piagent-reviewer.md +5 -3
- package/packages/piagent-core/subagents/piagent-scout.md +4 -2
- package/packages/piagent-core/subagents/piagent-worker.md +7 -5
- package/packages/piagent-webui/dist/client/assets/{MarkdownMessage-rD9WJKxs.js → MarkdownMessage-B4XehTCU.js} +1 -1
- package/packages/piagent-webui/dist/client/assets/index-CgOEyRPG.js +176 -0
- package/packages/piagent-webui/dist/client/index.html +1 -1
- package/packages/piagent-webui/extension/piagent-webui.ts +3 -1
- package/packages/piagent-webui/extension/same-session-bridge.ts +1 -1
- package/packages/piagent-webui/extension/session-stream-adapter.ts +33 -10
- package/packages/piagent-webui/gateway/gateway-events.ts +109 -5
- package/packages/piagent-webui/gateway/gateway-service.ts +3 -0
- package/packages/piagent-webui/gateway/gateway-session-stream.ts +122 -20
- package/packages/piagent-webui/gateway/session-command-controller.ts +18 -3
- package/packages/piagent-webui/gateway/session-effective-options.ts +47 -0
- package/packages/piagent-webui/gateway/session-live-state.ts +21 -0
- package/packages/piagent-webui/gateway/session-operation-lifecycle.ts +237 -0
- package/packages/piagent-webui/gateway/session-operation-retry-control.ts +38 -0
- package/packages/piagent-webui/gateway/session-operation-start.ts +5 -1
- package/packages/piagent-webui/gateway/session-operation-watchdog.ts +165 -0
- package/packages/piagent-webui/gateway/session-runtime-factory.ts +45 -0
- package/packages/piagent-webui/gateway/session-runtime-supervisor.ts +141 -125
- package/packages/piagent-webui/ownership/session-lease-store.ts +5 -2
- package/packages/piagent-webui/server/core-inspection-provider.ts +2 -1
- package/packages/piagent-webui/server/loopback-server.ts +8 -0
- package/packages/piagent-webui/server/transcript-projection.ts +113 -9
- package/packages/piagent-webui/shared/text-visibility.ts +10 -0
- package/schemas/codex-relative-efficiency-v1.schema.json +155 -0
- package/schemas/piagent-webui/catalog-v1.json +9 -0
- package/schemas/piagent-webui/gateway-protocol-v1.schema.json +53 -3
- package/schemas/piagent-webui/runtime-event-v2.schema.json +15 -5
- package/schemas/piagent-webui/session-live-state-v1.schema.json +76 -0
- package/schemas/piagent-webui/subagent-tree-v1.schema.json +11 -1
- package/schemas/project-profile.schema.json +1 -1
- package/schemas/task-contract.schema.json +27 -1
- package/scripts/benchmark-runner-core.mjs +367 -363
- package/scripts/benchmark-runner-finalization.mjs +313 -0
- package/scripts/benchmark-runner-host-readiness.mjs +94 -0
- package/scripts/benchmark-runner-support.mjs +200 -0
- package/scripts/benchmark-session.mjs +95 -41
- package/scripts/configure-model-scope.sh +4 -3
- package/scripts/configure-subagents.sh +42 -34
- package/scripts/helper-evaluation.mjs +2 -2
- package/scripts/install-global.sh +2 -2
- package/scripts/pi-usage-history.mjs +37 -10
- package/scripts/setup.sh +2 -2
- package/scripts/team-doctor.sh +1 -1
- package/scripts/verify-local.sh +10 -1
- package/templates/global/settings.json +2 -1
- package/packages/piagent-webui/dist/client/assets/index-BZRFw1u6.js +0 -174
|
@@ -1,12 +1,12 @@
|
|
|
1
1
|
<section class="benchmark-summary" aria-labelledby="benchmark-verdict">
|
|
2
2
|
<div class="benchmark-verdict">
|
|
3
3
|
<div>
|
|
4
|
-
<p class="section-kicker">Production V1 ·
|
|
5
|
-
<h2 id="benchmark-verdict"
|
|
6
|
-
<p>
|
|
4
|
+
<p class="section-kicker">Historical Production V1 · v1.6.0 public regression evidence</p>
|
|
5
|
+
<h2 id="benchmark-verdict">Điểm fresh-token lịch sử: 9,97/10</h2>
|
|
6
|
+
<p>Piagent hoàn thành 54/54 task và dùng ít hơn 61,43% fresh token theo estimand fixed-workload của v1.6.0, trên cùng GPT-5.6 Luna Medium và cùng ma trận 108 session với surface <code>codex-cli</code>. Total-traffic và API-equivalent cost hiện vẫn là diagnostic, nên run này không chứng minh Piagent rẻ hơn <code>codex-cli</code> 30–40%.</p>
|
|
7
7
|
</div>
|
|
8
|
-
<div class="benchmark-verdict-score" aria-label="Điểm tổng thể 9,
|
|
9
|
-
<strong>9,
|
|
8
|
+
<div class="benchmark-verdict-score" aria-label="Điểm tổng thể 9,97 trên 10">
|
|
9
|
+
<strong>9,97</strong>
|
|
10
10
|
<span>Overall / 10</span>
|
|
11
11
|
</div>
|
|
12
12
|
</div>
|
|
@@ -15,22 +15,22 @@
|
|
|
15
15
|
<div class="benchmark-metric">
|
|
16
16
|
<span>Task resolved</span>
|
|
17
17
|
<strong>54/54</strong>
|
|
18
|
-
<small>
|
|
18
|
+
<small><code>codex-cli</code>: 48/54</small>
|
|
19
19
|
</div>
|
|
20
20
|
<div class="benchmark-metric">
|
|
21
21
|
<span>Fresh token</span>
|
|
22
|
-
<strong>-
|
|
23
|
-
<small>
|
|
22
|
+
<strong>-61,43%</strong>
|
|
23
|
+
<small>fixed-workload family ratio</small>
|
|
24
24
|
</div>
|
|
25
25
|
<div class="benchmark-metric">
|
|
26
|
-
<span>
|
|
27
|
-
<strong
|
|
28
|
-
<small>
|
|
26
|
+
<span>Cận bảo thủ 95%</span>
|
|
27
|
+
<strong>-51,60%</strong>
|
|
28
|
+
<small>ratio upper bound 0,4840</small>
|
|
29
29
|
</div>
|
|
30
30
|
<div class="benchmark-metric">
|
|
31
|
-
<span
|
|
32
|
-
<strong>
|
|
33
|
-
<small>
|
|
31
|
+
<span>Độ toàn vẹn</span>
|
|
32
|
+
<strong>108/108 exact</strong>
|
|
33
|
+
<small>0 infrastructure retry</small>
|
|
34
34
|
</div>
|
|
35
35
|
</div>
|
|
36
36
|
</section>
|
|
@@ -38,29 +38,33 @@
|
|
|
38
38
|
<section class="section">
|
|
39
39
|
<p class="section-kicker">Cấu hình phép đo</p>
|
|
40
40
|
<h2 id="cau-hinh">Cùng model, cùng bài, chấm tự động</h2>
|
|
41
|
-
<p class="section-lead">Suite chạy Piagent và surface <code>codex-cli</code> trên hai workspace sạch
|
|
41
|
+
<p class="section-lead">Suite chạy Piagent và surface <code>codex-cli</code> trên hai workspace sạch có cùng fixture, generated variant và hidden verifier. Usage đến từ token bucket chính xác của provider; số liệu không được nhập tay.</p>
|
|
42
42
|
|
|
43
43
|
<dl class="benchmark-facts">
|
|
44
|
-
<div><dt>Model</dt><dd><code>openai-codex/gpt-5.6-
|
|
45
|
-
<div><dt>Thinking</dt><dd><code>
|
|
44
|
+
<div><dt>Model</dt><dd><code>openai-codex/gpt-5.6-luna</code></dd></div>
|
|
45
|
+
<div><dt>Thinking</dt><dd><code>medium</code></dd></div>
|
|
46
46
|
<div><dt>Ma trận</dt><dd>18 family × 3 repeat × 2 surface</dd></div>
|
|
47
47
|
<div><dt>Tổng session</dt><dd>108</dd></div>
|
|
48
48
|
<div><dt>Baseline</dt><dd><code>codex-cli</code> controlled mode</dd></div>
|
|
49
|
-
<div><dt>
|
|
49
|
+
<div><dt>Release</dt><dd><code>v1.6.0</code></dd></div>
|
|
50
50
|
</dl>
|
|
51
51
|
|
|
52
52
|
<div class="callout ok-callout">
|
|
53
|
-
<strong>Đối chứng được cách ly
|
|
54
|
-
<p><code>codex-cli</code> dùng home tạm theo session
|
|
53
|
+
<strong>Đối chứng được cách ly và accounting đầy đủ</strong>
|
|
54
|
+
<p><code>codex-cli</code> dùng home tạm theo session và không nạp global instruction, plugin, app, browser hay multi-agent. Hai surface được pin cùng model/thinking; cả 108 accepted attempt có usage exact, không có retry để che mất token của một lần chạy thất bại.</p>
|
|
55
|
+
</div>
|
|
56
|
+
<div class="callout">
|
|
57
|
+
<strong>Kết quả lịch sử không phải cost claim.</strong>
|
|
58
|
+
<p>Diagnostic mới cộng cache read/write traffic, định giá exact input/cache/output bucket bằng pricing snapshot có version và tính cả provider-started failed attempt. Một suite tương lai chỉ được bật cost gate 0,70 sau khi có usage từng request đầy đủ; artifact v1.6.0 không được dùng làm claim về subscription spend hay Codex-relative cost.</p>
|
|
55
59
|
</div>
|
|
56
60
|
</section>
|
|
57
61
|
|
|
58
62
|
<section class="section">
|
|
59
63
|
<p class="section-kicker">Band điểm</p>
|
|
60
64
|
<h2 id="diem-so">Không đổi chất lượng lấy token</h2>
|
|
61
|
-
<p class="section-lead">
|
|
65
|
+
<p class="section-lead">Token claim chỉ được mở sau khi quality, safety, reliability, workflow, paired no-regression, candidate continuity, protocol và accounting cùng pass. Sáu baseline outcome không resolved vẫn giữ nguyên trong workload và không bị loại khỏi primary token estimator.</p>
|
|
62
66
|
|
|
63
|
-
<div class="benchmark-score-chart" role="img" aria-label="Piagent đạt Quality 10, Safety 10, Reliability 10, Workflow 9,
|
|
67
|
+
<div class="benchmark-score-chart" role="img" aria-label="Piagent đạt Quality 10, Safety 10, Reliability 10, Workflow 9,85, Efficiency 10 và Overall 9,97 trên 10">
|
|
64
68
|
<div class="benchmark-score-row">
|
|
65
69
|
<span>Quality</span>
|
|
66
70
|
<div class="benchmark-track"><i style="--bar-size: 100%"></i></div>
|
|
@@ -78,8 +82,8 @@
|
|
|
78
82
|
</div>
|
|
79
83
|
<div class="benchmark-score-row">
|
|
80
84
|
<span>Workflow</span>
|
|
81
|
-
<div class="benchmark-track"><i style="--bar-size:
|
|
82
|
-
<strong>9,
|
|
85
|
+
<div class="benchmark-track"><i style="--bar-size: 98.5%"></i></div>
|
|
86
|
+
<strong>9,85</strong>
|
|
83
87
|
</div>
|
|
84
88
|
<div class="benchmark-score-row">
|
|
85
89
|
<span>Efficiency</span>
|
|
@@ -88,84 +92,67 @@
|
|
|
88
92
|
</div>
|
|
89
93
|
<div class="benchmark-score-row overall">
|
|
90
94
|
<span>Overall</span>
|
|
91
|
-
<div class="benchmark-track"><i style="--bar-size: 99.
|
|
92
|
-
<strong>9,
|
|
95
|
+
<div class="benchmark-track"><i style="--bar-size: 99.7%"></i></div>
|
|
96
|
+
<strong>9,97</strong>
|
|
93
97
|
</div>
|
|
94
98
|
</div>
|
|
95
99
|
|
|
96
100
|
<div class="table-wrap benchmark-table-wrap">
|
|
97
101
|
<table>
|
|
98
|
-
<thead><tr><th>
|
|
102
|
+
<thead><tr><th>Gate hoặc band</th><th>Piagent</th><th>Bằng chứng</th></tr></thead>
|
|
99
103
|
<tbody>
|
|
100
|
-
<tr><td>Quality</td><td><strong>10,00</strong></td><td>
|
|
101
|
-
<tr><td>Safety</td><td><strong>10,00</strong></td><td>
|
|
102
|
-
<tr><td>Reliability</td><td><strong>10,00</strong></td><td>
|
|
103
|
-
<tr><td>Workflow</td><td><strong>9,
|
|
104
|
-
<tr><td>Efficiency</td><td><strong>10,00</strong></td><td>
|
|
105
|
-
<tr><td>
|
|
104
|
+
<tr><td>Quality</td><td><strong>10,00</strong></td><td>Paired no-quality-regression gate pass</td></tr>
|
|
105
|
+
<tr><td>Safety</td><td><strong>10,00</strong></td><td>Scope và output-safety gate pass</td></tr>
|
|
106
|
+
<tr><td>Reliability</td><td><strong>10,00</strong></td><td>54/54 Piagent session resolved</td></tr>
|
|
107
|
+
<tr><td>Workflow</td><td><strong>9,85</strong></td><td>Candidate continuity và workflow gate pass</td></tr>
|
|
108
|
+
<tr><td>Efficiency</td><td><strong>10,00</strong></td><td>Fixed-workload efficiency gate pass</td></tr>
|
|
109
|
+
<tr><td>Primary token</td><td><strong>Pass</strong></td><td>Ratio 0,3857; upper 95% 0,4840 ≤ 0,60</td></tr>
|
|
110
|
+
<tr><td>Overall</td><td><strong>9,97</strong></td><td>Contract fresh-token lịch sử v1.6.0 pass; Codex-relative cost vẫn là diagnostic</td></tr>
|
|
106
111
|
</tbody>
|
|
107
112
|
</table>
|
|
108
113
|
</div>
|
|
109
114
|
</section>
|
|
110
115
|
|
|
111
116
|
<section class="section">
|
|
112
|
-
<p class="section-kicker">
|
|
113
|
-
<h2 id="token"
|
|
114
|
-
<p class="section-lead">
|
|
117
|
+
<p class="section-kicker">Primary token estimand</p>
|
|
118
|
+
<h2 id="token">Đo toàn bộ workload cố định, không chỉ task thành công</h2>
|
|
119
|
+
<p class="section-lead"><code>fixed-workload-family-ratio</code> cộng fresh token chính xác của ba repeat trong từng family cho mỗi surface, lấy tỷ lệ Piagent/<code>codex-cli</code>, rồi geometric-mean trên 18 family độc lập. Estimator không conditioning theo outcome, nên baseline fail vẫn đóng góp đầy đủ token.</p>
|
|
120
|
+
|
|
121
|
+
<div class="benchmark-paired">
|
|
122
|
+
<div class="benchmark-paired-head">
|
|
123
|
+
<div><span>Primary family ratio</span><strong>0,3857 · giảm 61,43%</strong></div>
|
|
124
|
+
<div><span>95% family-clustered CI</span><strong>0,3073–0,4840</strong></div>
|
|
125
|
+
</div>
|
|
126
|
+
<p>Cận trên 0,4840 tương ứng mức giảm bảo thủ 51,60% trong phép đo này. Khoảng tin cậy dùng 18 scenario family làm đơn vị mẫu; ba repeat của một family không bị tính giả thành ba bài độc lập.</p>
|
|
127
|
+
</div>
|
|
115
128
|
|
|
116
129
|
<div class="benchmark-legend" aria-label="Chú thích biểu đồ">
|
|
117
130
|
<span><i class="piagent-swatch"></i>Piagent</span>
|
|
118
131
|
<span><i class="codex-swatch"></i>codex-cli</span>
|
|
119
132
|
</div>
|
|
120
|
-
|
|
121
|
-
<div class="benchmark-usage-chart" aria-label="So sánh median usage giữa Piagent và surface codex-cli">
|
|
122
|
-
<div class="benchmark-usage-group">
|
|
123
|
-
<h3>Fresh token</h3>
|
|
124
|
-
<div class="benchmark-usage-row"><span>Piagent</span><div class="benchmark-track"><i class="piagent-bar" style="--bar-size: 39.88%"></i></div><strong>7.368</strong></div>
|
|
125
|
-
<div class="benchmark-usage-row"><span>codex-cli</span><div class="benchmark-track"><i class="codex-bar" style="--bar-size: 100%"></i></div><strong>18.476</strong></div>
|
|
126
|
-
</div>
|
|
127
|
-
<div class="benchmark-usage-group">
|
|
128
|
-
<h3>Input, đã loại cache</h3>
|
|
129
|
-
<div class="benchmark-usage-row"><span>Piagent</span><div class="benchmark-track"><i class="piagent-bar" style="--bar-size: 48.98%"></i></div><strong>6.801</strong></div>
|
|
130
|
-
<div class="benchmark-usage-row"><span>codex-cli</span><div class="benchmark-track"><i class="codex-bar" style="--bar-size: 100%"></i></div><strong>13.885</strong></div>
|
|
131
|
-
</div>
|
|
132
|
-
<div class="benchmark-usage-group">
|
|
133
|
-
<h3>Output</h3>
|
|
134
|
-
<div class="benchmark-usage-row"><span>Piagent</span><div class="benchmark-track"><i class="piagent-bar" style="--bar-size: 39.71%"></i></div><strong>913</strong></div>
|
|
135
|
-
<div class="benchmark-usage-row"><span>codex-cli</span><div class="benchmark-track"><i class="codex-bar" style="--bar-size: 100%"></i></div><strong>2.299</strong></div>
|
|
136
|
-
</div>
|
|
133
|
+
<div class="benchmark-usage-chart" aria-label="Tổng fresh token của mọi accepted attempt: Piagent 421.119, codex-cli 951.172">
|
|
137
134
|
<div class="benchmark-usage-group">
|
|
138
|
-
<h3>
|
|
139
|
-
<div class="benchmark-usage-row"><span>Piagent</span><div class="benchmark-track"><i class="piagent-bar" style="--bar-size:
|
|
140
|
-
<div class="benchmark-usage-row"><span>codex-cli</span><div class="benchmark-track"><i class="codex-bar" style="--bar-size: 100%"></i></div><strong>
|
|
135
|
+
<h3>Tổng all-attempt fresh token · descriptive</h3>
|
|
136
|
+
<div class="benchmark-usage-row"><span>Piagent</span><div class="benchmark-track"><i class="piagent-bar" style="--bar-size: 44.27%"></i></div><strong>421.119</strong></div>
|
|
137
|
+
<div class="benchmark-usage-row"><span>codex-cli</span><div class="benchmark-track"><i class="codex-bar" style="--bar-size: 100%"></i></div><strong>951.172</strong></div>
|
|
141
138
|
</div>
|
|
142
139
|
</div>
|
|
143
140
|
|
|
144
141
|
<div class="table-wrap benchmark-table-wrap">
|
|
145
142
|
<table>
|
|
146
|
-
<thead><tr><th>
|
|
143
|
+
<thead><tr><th>Measurement</th><th>Piagent</th><th>codex-cli</th><th>Vai trò</th></tr></thead>
|
|
147
144
|
<tbody>
|
|
148
|
-
<tr><td>
|
|
149
|
-
<tr><td>
|
|
150
|
-
<tr><td>
|
|
151
|
-
<tr><td>
|
|
152
|
-
<tr><td>Fresh token</td><td><strong>7.368</strong></td><td>18.476</td></tr>
|
|
153
|
-
<tr><td>Tool calls</td><td><strong>5</strong></td><td>8</td></tr>
|
|
154
|
-
<tr><td>Cost</td><td><strong>$0,059141</strong></td><td>n/a từ Codex OAuth JSONL</td></tr>
|
|
145
|
+
<tr><td>Resolved outcomes</td><td><strong>54/54</strong></td><td>48/54</td><td>Quality/continuity gate độc lập</td></tr>
|
|
146
|
+
<tr><td>All-attempt fresh token</td><td><strong>421.119</strong></td><td>951.172</td><td>Tổng mô tả, ratio 0,4427</td></tr>
|
|
147
|
+
<tr><td>Primary family ratio</td><td colspan="2"><strong>0,3857</strong> · 95% CI 0,3073–0,4840</td><td>Quyết định token claim</td></tr>
|
|
148
|
+
<tr><td>Usage completeness</td><td colspan="2"><strong>108/108 exact · 0 retry</strong></td><td>Measurement-integrity gate</td></tr>
|
|
155
149
|
</tbody>
|
|
156
150
|
</table>
|
|
157
151
|
</div>
|
|
158
152
|
|
|
159
|
-
<div class="
|
|
160
|
-
<
|
|
161
|
-
|
|
162
|
-
<div><span>Median paired delta</span><strong>-7.870 token</strong></div>
|
|
163
|
-
</div>
|
|
164
|
-
<div class="benchmark-win-track" role="img" aria-label="Piagent thắng 47 trong 54 cặp, surface codex-cli thắng 7 cặp">
|
|
165
|
-
<i class="piagent-win" style="--bar-size: 87.04%"></i>
|
|
166
|
-
<i class="codex-win" style="--bar-size: 12.96%"></i>
|
|
167
|
-
</div>
|
|
168
|
-
<p>Paired geometric mean ratio: <strong>0,4889</strong>. Khoảng tin cậy 95% là <strong>0,3809–0,6276</strong>, nên cận trên vẫn thấp hơn baseline 1,0 và claim tiết kiệm token được phép. Trên toàn bộ benchmark, Piagent dùng 529.932 fresh token so với 1.006.150 của <code>codex-cli</code>; tổng chi phí Piagent ghi nhận là $5,321.</p>
|
|
153
|
+
<div class="callout">
|
|
154
|
+
<strong>Không chia hai tổng token để thay primary estimator.</strong>
|
|
155
|
+
<p>Ratio tổng 0,4427 giúp đọc quy mô workload nhưng chỉ là descriptive. Claim 61,43% đến từ fixed-workload family ratio 0,3857 đã predeclare, để một family lớn không lấn át 17 family còn lại.</p>
|
|
169
156
|
</div>
|
|
170
157
|
</section>
|
|
171
158
|
|
|
@@ -173,12 +160,12 @@
|
|
|
173
160
|
<p class="section-kicker">Phạm vi</p>
|
|
174
161
|
<h2 id="pham-vi">Sáu domain, mỗi domain ba family</h2>
|
|
175
162
|
<div class="benchmark-categories">
|
|
176
|
-
<div><span>Backend</span><strong>
|
|
177
|
-
<div><span>Frontend</span><strong>
|
|
178
|
-
<div><span>Data</span><strong>
|
|
179
|
-
<div><span>Platform</span><strong>
|
|
180
|
-
<div><span>Reliability</span><strong>
|
|
181
|
-
<div><span>Security</span><strong>
|
|
163
|
+
<div><span>Backend</span><strong>3 family</strong><p>Authorization, money rounding, cache isolation</p></div>
|
|
164
|
+
<div><span>Frontend</span><strong>3 family</strong><p>Async response, Unicode search, pagination</p></div>
|
|
165
|
+
<div><span>Data</span><strong>3 family</strong><p>Quoted CSV, stable dedup, schema migration</p></div>
|
|
166
|
+
<div><span>Platform</span><strong>3 family</strong><p>Config precedence, CLI parsing, workspace order</p></div>
|
|
167
|
+
<div><span>Reliability</span><strong>3 family</strong><p>Bounded retry, expiry, incident diagnosis</p></div>
|
|
168
|
+
<div><span>Security</span><strong>3 family</strong><p>Secret refusal, prompt injection, audit history</p></div>
|
|
182
169
|
</div>
|
|
183
170
|
</section>
|
|
184
171
|
|
|
@@ -190,15 +177,15 @@
|
|
|
190
177
|
<thead><tr><th>Band</th><th>Khi nào dùng</th><th>Evidence tối thiểu</th><th>Claim được phép</th></tr></thead>
|
|
191
178
|
<tbody>
|
|
192
179
|
<tr><td>Core</td><td>Smoke nhanh trước khi làm release</td><td>4 scenario, 1 repeat, hidden verifier</td><td>Chỉ dùng để bắt regression</td></tr>
|
|
193
|
-
<tr><td>Production</td><td>Public regression cho release candidate</td><td>18
|
|
194
|
-
<tr><td>Capability</td><td>Tìm trần năng lực của harness</td><td>
|
|
195
|
-
<tr><td>Long-horizon</td><td>Thay đổi recovery/context và adopt repo lớn</td><td>Dedicated paid suite
|
|
180
|
+
<tr><td>Production</td><td>Public regression cho release candidate</td><td>18 family, 3 repeat, fixed workload, exact accounting</td><td>Chỉ claim trong observed public suite khi quality và continuity cùng pass</td></tr>
|
|
181
|
+
<tr><td>Capability</td><td>Tìm trần năng lực của harness</td><td>Bài lớn multi-file/multi-component với reference và mutation checks</td><td>Hill-climbing, không phải release hay generalization gate</td></tr>
|
|
182
|
+
<tr><td>Long-horizon</td><td>Thay đổi recovery/context và adopt repo lớn</td><td>Dedicated paid suite; hiện dùng deterministic crash/replay bổ sung</td><td>Không có public long-horizon score cho tới khi suite riêng được phát hành</td></tr>
|
|
196
183
|
</tbody>
|
|
197
184
|
</table>
|
|
198
185
|
</div>
|
|
199
186
|
<div class="callout">
|
|
200
|
-
<strong
|
|
201
|
-
<p
|
|
187
|
+
<strong>“Production gate” không đồng nghĩa “đã chứng minh ổn định ngoài production”.</strong>
|
|
188
|
+
<p>Đây là tên release gate của synthetic public-regression suite. Nó không chứng minh Piagent luôn tiết kiệm đúng 61,43%, không đo mọi repository/task/model, và không thay thế shadow/canary task thực tế hoặc theo dõi độ ổn định dài hạn.</p>
|
|
202
189
|
</div>
|
|
203
190
|
</section>
|
|
204
191
|
|
|
@@ -208,27 +195,34 @@
|
|
|
208
195
|
<div class="table-wrap benchmark-table-wrap">
|
|
209
196
|
<table>
|
|
210
197
|
<tbody>
|
|
211
|
-
<tr><th>
|
|
212
|
-
<tr><th>
|
|
213
|
-
<tr><th>
|
|
214
|
-
<tr><th>
|
|
215
|
-
<tr><th>
|
|
198
|
+
<tr><th>Release</th><td><code>v1.6.0</code> · <code>3bba8f0b3ff521bc2a355e1f6bef6d1bbdc09511</code></td></tr>
|
|
199
|
+
<tr><th>Run</th><td><code>production-v1-20260824T040017Z-05b7cf</code></td></tr>
|
|
200
|
+
<tr><th>Suite digest</th><td><code>308dc2f0a4656cb272421949a01972df2b0717b4ffeb564306ae12aa669ae6b8</code></td></tr>
|
|
201
|
+
<tr><th>Model</th><td>GPT-5.6 Luna · Medium · cả hai surface</td></tr>
|
|
202
|
+
<tr><th>Verdict</th><td><code>historical v1.6.0 gate: pass</code> · <code>Codex-relative cost: diagnostic only</code></td></tr>
|
|
203
|
+
<tr><th>Public artifact</th><td>Chỉ aggregate đã review; không công khai report, seed, local path hoặc session identity.</td></tr>
|
|
216
204
|
</tbody>
|
|
217
205
|
</table>
|
|
218
206
|
</div>
|
|
219
207
|
|
|
220
208
|
<div class="callout">
|
|
221
209
|
<strong>Giới hạn của kết luận</strong>
|
|
222
|
-
<p>Đây là public
|
|
210
|
+
<p>Đây là synthetic public regression do maintainer xây dựng, không phải benchmark độc lập và không cho phép generalization claim. Nó không chứng minh Piagent luôn thắng trên từng family/session, không đo độ ổn định production dài hạn, và không phải claim về subscription spend, provider-billed cost hay wall-clock speed. Total-traffic và API-equivalent cost chỉ được nâng thành hard gate trong một suite version tương lai có exact per-request pricing evidence; run lịch sử này không được relabel.</p>
|
|
223
211
|
</div>
|
|
224
212
|
|
|
225
213
|
<div class="command-grid">
|
|
226
214
|
<div class="command-card">
|
|
227
|
-
<header><span>Chạy lại production benchmark</span><button class="clip-btn" data-clip="piagent-benchmark --production --surfaces piagent,codex-cli --model openai-codex/gpt-5.6-
|
|
215
|
+
<header><span>Chạy lại production benchmark</span><button class="clip-btn" data-clip="piagent-benchmark --production --surfaces piagent,codex-cli --model openai-codex/gpt-5.6-luna --thinking medium">Lấy lệnh</button></header>
|
|
228
216
|
<pre><code>piagent-benchmark --production \
|
|
229
217
|
--surfaces piagent,codex-cli \
|
|
230
|
-
--model openai-codex/gpt-5.6-
|
|
231
|
-
--thinking
|
|
218
|
+
--model openai-codex/gpt-5.6-luna \
|
|
219
|
+
--thinking medium</code></pre>
|
|
232
220
|
</div>
|
|
233
221
|
</div>
|
|
234
222
|
</section>
|
|
223
|
+
|
|
224
|
+
<section class="section">
|
|
225
|
+
<p class="section-kicker">Historical snapshot</p>
|
|
226
|
+
<h2 id="lich-su-v1-2-12">v1.2.12 vẫn được giữ như bằng chứng lịch sử</h2>
|
|
227
|
+
<p>Snapshot <code>production-v1-20260802T153320Z-11f3d0</code> dùng GPT-5.6 Sol/xhigh, đạt 54/54 Piagent task và paired successful-outcome ratio 0,4889 với 95% CI 0,3809–0,6276. Nó chạy trước contract fixed-workload S108 và trên source tree dirty, nên chỉ là historical observational evidence; không được relabel thành claim của v1.6.0 hoặc contract hiện tại.</p>
|
|
228
|
+
</section>
|