oh-my-knowledge 1.0.0-beta.12 → 1.0.0-beta.14
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +23 -132
- package/README.zh.md +23 -132
- package/dist/assets/agent-skills/omk/SKILL.md +6 -8
- package/dist/assets/agent-skills/omk/references/commands.md +44 -128
- package/dist/cli/commands/eval/index.d.ts +0 -1
- package/dist/cli/commands/eval/index.js +0 -6
- package/dist/cli/commands/eval/task.d.ts +13 -0
- package/dist/cli/commands/eval/task.js +42 -0
- package/dist/cli/commands/evolve.js +5 -43
- package/dist/cli/commands/init.js +1 -1
- package/dist/cli/commands/install.d.ts +1 -1
- package/dist/cli/commands/install.js +25 -55
- package/dist/cli/commands/observe/index.d.ts +0 -1
- package/dist/cli/commands/observe/index.js +2 -60
- package/dist/cli/commands/observe/knowledge.d.ts +8 -0
- package/dist/cli/commands/observe/knowledge.js +58 -12
- package/dist/cli/commands/studio.js +2 -6
- package/dist/cli/lib/cell-format.d.ts +1 -5
- package/dist/cli/lib/cell-format.js +1 -5
- package/dist/cli/lib/i18n-dict/common.d.ts +1 -1
- package/dist/cli/lib/i18n-dict/common.js +0 -8
- package/dist/cli/lib/i18n-dict/evolve.d.ts +1 -1
- package/dist/cli/lib/i18n-dict/evolve.js +2 -6
- package/dist/cli/lib/i18n-dict/install.d.ts +1 -1
- package/dist/cli/lib/i18n-dict/install.js +2 -6
- package/dist/cli/lib/i18n-dict.d.ts +1 -4
- package/dist/cli/lib/i18n-dict.js +0 -6
- package/dist/cli/lib/prepare-evaluation.js +1 -1
- package/dist/cli/lib/resolve-skill-input.d.ts +0 -1
- package/dist/cli/lib/run-core-evaluation.js +0 -12
- package/dist/dsh-plugin/core-command.js +1 -8
- package/dist/dsh-plugin/index.js +0 -1
- package/dist/eval-core/analysis/bootstrap.d.ts +1 -1
- package/dist/eval-workflows/hosts/application.d.ts +4 -10
- package/dist/eval-workflows/hosts/application.js +2 -17
- package/dist/eval-workflows/hosts/carrier-measurement.d.ts +18 -0
- package/dist/eval-workflows/hosts/carrier-measurement.js +249 -0
- package/dist/eval-workflows/hosts/composition/evolution-evaluation.js +0 -1
- package/dist/eval-workflows/hosts/input-resolution/node-cli-evaluation-resolver.js +0 -1
- package/dist/eval-workflows/hosts/local-task/acceptance.d.ts +13 -0
- package/dist/eval-workflows/hosts/local-task/acceptance.js +101 -0
- package/dist/eval-workflows/hosts/local-task/application.d.ts +99 -0
- package/dist/eval-workflows/hosts/local-task/application.js +177 -0
- package/dist/eval-workflows/hosts/local-task/diagnostics.d.ts +27 -0
- package/dist/eval-workflows/hosts/local-task/diagnostics.js +30 -0
- package/dist/eval-workflows/hosts/local-task/executor.d.ts +19 -0
- package/dist/eval-workflows/hosts/local-task/executor.js +135 -0
- package/dist/eval-workflows/hosts/local-task/files.d.ts +15 -0
- package/dist/eval-workflows/hosts/local-task/files.js +88 -0
- package/dist/eval-workflows/hosts/local-task/workspace.d.ts +6 -0
- package/dist/eval-workflows/hosts/local-task/workspace.js +32 -0
- package/dist/{cli/lib/evaluation-composition.d.ts → eval-workflows/hosts/node-environment.d.ts} +1 -1
- package/dist/{cli/lib/evaluation-composition.js → eval-workflows/hosts/node-environment.js} +1 -1
- package/dist/eval-workflows/input-compilation/compile.js +0 -2
- package/dist/eval-workflows/input-compilation/parse.js +0 -6
- package/dist/eval-workflows/input-compilation/registry.d.ts +1 -1
- package/dist/eval-workflows/input-compilation/registry.js +0 -3
- package/dist/eval-workflows/input-compilation/types.d.ts +2 -4
- package/dist/eval-workflows/input-compilation/types.js +2 -2
- package/dist/eval-workflows/inputs/contracts/local-task-evidence.d.ts +46 -0
- package/dist/eval-workflows/inputs/contracts/local-task-evidence.js +26 -0
- package/dist/eval-workflows/inputs/contracts/local-task.d.ts +50 -0
- package/dist/eval-workflows/inputs/contracts/local-task.js +33 -0
- package/dist/eval-workflows/inputs/contracts/sample.d.ts +2 -2
- package/dist/eval-workflows/instruments/prompts/judge-prompts.js +1 -1
- package/dist/eval-workflows/orchestration/evaluation-service.d.ts +2 -0
- package/dist/eval-workflows/orchestration/evaluation-service.js +4 -0
- package/dist/eval-workflows/projections/carrier-measurement.d.ts +72 -0
- package/dist/eval-workflows/projections/contracts.d.ts +1 -46
- package/dist/eval-workflows/projections/contracts.js +0 -1
- package/dist/eval-workflows/projections/index.d.ts +0 -1
- package/dist/eval-workflows/projections/index.js +0 -1
- package/dist/eval-workflows/projections/local-task.d.ts +23 -0
- package/dist/eval-workflows/projections/local-task.js +25 -0
- package/dist/evidence/storage/directories.d.ts +2 -2
- package/dist/evidence/storage/directories.js +4 -4
- package/dist/evidence/storage/layout.d.ts +0 -2
- package/dist/evidence/storage/layout.js +0 -3
- package/dist/executors/openai/codex/protocol.js +1 -1
- package/dist/index.d.ts +1 -0
- package/dist/index.js +1 -0
- package/dist/knowledge/contracts.d.ts +4 -4
- package/dist/knowledge/entities/contracts.d.ts +327 -0
- package/dist/knowledge/entities/contracts.js +42 -0
- package/dist/knowledge/entities/history.d.ts +4 -0
- package/dist/knowledge/entities/history.js +61 -0
- package/dist/knowledge/entities/identity.d.ts +48 -0
- package/dist/knowledge/entities/identity.js +101 -0
- package/dist/knowledge/entities/validation.d.ts +6 -0
- package/dist/knowledge/entities/validation.js +62 -0
- package/dist/knowledge/history.js +1 -1
- package/dist/knowledge/library/contracts.d.ts +161 -0
- package/dist/knowledge/library/contracts.js +38 -0
- package/dist/knowledge/library/history.d.ts +3 -0
- package/dist/knowledge/library/history.js +46 -0
- package/dist/knowledge/store.d.ts +12 -4
- package/dist/knowledge/store.js +2 -1
- package/dist/knowledge/tags.d.ts +12 -0
- package/dist/knowledge/tags.js +6 -0
- package/dist/knowledge-artifacts/authoring/core-evolver.d.ts +0 -1
- package/dist/knowledge-artifacts/authoring/core-evolver.js +1 -1
- package/dist/knowledge-artifacts/authoring/knowledge-content.d.ts +19 -0
- package/dist/knowledge-artifacts/authoring/knowledge-content.js +151 -0
- package/dist/knowledge-artifacts/authoring/knowledge-review.d.ts +9 -0
- package/dist/knowledge-artifacts/authoring/knowledge-review.js +38 -0
- package/dist/knowledge-artifacts/authoring/library-contracts.d.ts +98 -0
- package/dist/knowledge-artifacts/authoring/library-contracts.js +1 -0
- package/dist/knowledge-artifacts/authoring/library.d.ts +18 -0
- package/dist/knowledge-artifacts/authoring/library.js +159 -0
- package/dist/knowledge-artifacts/doctor/messages.js +6 -6
- package/dist/knowledge-artifacts/doctor/rules.d.ts +1 -1
- package/dist/knowledge-artifacts/doctor/rules.js +1 -1
- package/dist/knowledge-artifacts/sources/artifact-resolution.js +2 -4
- package/dist/knowledge-artifacts/sources/content-hash.js +1 -1
- package/dist/knowledge-artifacts/sources/install-source.d.ts +4 -14
- package/dist/knowledge-artifacts/sources/install-source.js +6 -14
- package/dist/knowledge-artifacts/sources/materialize-copy.d.ts +1 -1
- package/dist/observability/analysis/gap-analyzer.d.ts +1 -1
- package/dist/observability/analysis/gap-analyzer.js +1 -1
- package/dist/observability/application.d.ts +9 -0
- package/dist/observability/application.js +6 -0
- package/dist/observability/contracts/experience-evidence-schema.d.ts +29 -29
- package/dist/observability/knowledge-extraction/adapters/entity-store.d.ts +12 -0
- package/dist/observability/knowledge-extraction/adapters/entity-store.js +94 -0
- package/dist/observability/knowledge-extraction/adapters/executor.js +2 -1
- package/dist/observability/knowledge-extraction/adapters/knowledge-store.d.ts +2 -1
- package/dist/observability/knowledge-extraction/adapters/knowledge-store.js +25 -12
- package/dist/observability/knowledge-extraction/adapters/knowledge-tags.d.ts +12 -0
- package/dist/observability/knowledge-extraction/adapters/knowledge-tags.js +67 -0
- package/dist/observability/knowledge-extraction/adapters/library-store.d.ts +11 -0
- package/dist/observability/knowledge-extraction/adapters/library-store.js +72 -0
- package/dist/observability/knowledge-extraction/adapters/run-store.d.ts +2 -1
- package/dist/observability/knowledge-extraction/adapters/run-store.js +26 -10
- package/dist/observability/knowledge-extraction/adapters/storage-state.d.ts +11 -0
- package/dist/observability/knowledge-extraction/adapters/storage-state.js +92 -0
- package/dist/observability/knowledge-extraction/application.d.ts +1309 -40
- package/dist/observability/knowledge-extraction/application.js +191 -22
- package/dist/observability/knowledge-extraction/auto-extraction.d.ts +140 -0
- package/dist/observability/knowledge-extraction/auto-extraction.js +316 -0
- package/dist/observability/knowledge-extraction/conversation-source.d.ts +41 -0
- package/dist/observability/knowledge-extraction/conversation-source.js +55 -0
- package/dist/observability/knowledge-extraction/entities.d.ts +65 -0
- package/dist/observability/knowledge-extraction/entities.js +123 -0
- package/dist/observability/knowledge-extraction/entity-catalog.d.ts +89 -0
- package/dist/observability/knowledge-extraction/entity-catalog.js +41 -0
- package/dist/observability/knowledge-extraction/library.d.ts +392 -0
- package/dist/observability/knowledge-extraction/library.js +197 -0
- package/dist/observability/knowledge-extraction/local.js +6 -2
- package/dist/observability/knowledge-extraction/prompt.d.ts +1 -1
- package/dist/observability/knowledge-extraction/prompt.js +35 -8
- package/dist/observability/knowledge-extraction/proposals.d.ts +15 -160
- package/dist/observability/knowledge-extraction/proposals.js +17 -51
- package/dist/observability/knowledge-extraction/quote-occurrence.d.ts +9 -0
- package/dist/observability/knowledge-extraction/quote-occurrence.js +31 -0
- package/dist/observability/knowledge-extraction/runs.d.ts +120 -6
- package/dist/observability/knowledge-extraction/runs.js +74 -2
- package/dist/observability/knowledge-extraction/window-proposals.d.ts +198 -0
- package/dist/observability/knowledge-extraction/window-proposals.js +88 -0
- package/dist/observability/skill-health/analyzer.d.ts +1 -2
- package/dist/observability/skill-health/analyzer.js +1 -2
- package/dist/observability/skill-health/persistence.d.ts +0 -8
- package/dist/observability/skill-health/persistence.js +0 -22
- package/dist/studio/application/conversations/conversation-extraction.d.ts +1 -41
- package/dist/studio/application/conversations/conversation-extraction.js +1 -53
- package/dist/studio/application/directory-sources.d.ts +1 -3
- package/dist/studio/application/directory-sources.js +0 -1
- package/dist/studio/application/display/conversation-label.d.ts +1 -1
- package/dist/studio/application/display/conversation-label.js +15 -2
- package/dist/studio/application/knowledge/artifact-authoring.d.ts +42 -0
- package/dist/studio/application/knowledge/artifact-authoring.js +85 -0
- package/dist/studio/application/knowledge/auto-extraction.d.ts +42 -0
- package/dist/studio/application/knowledge/auto-extraction.js +18 -0
- package/dist/studio/application/knowledge/candidate-review.d.ts +5 -0
- package/dist/studio/application/knowledge/candidate-review.js +20 -0
- package/dist/studio/application/knowledge/doctor-format.d.ts +1 -1
- package/dist/studio/application/knowledge/knowledge-candidates.js +44 -18
- package/dist/studio/application/knowledge/knowledge-library.d.ts +338 -0
- package/dist/studio/application/knowledge/knowledge-library.js +23 -0
- package/dist/studio/application/knowledge/library-view.d.ts +22 -0
- package/dist/studio/application/knowledge/library-view.js +7 -0
- package/dist/studio/application/measure/carrier-measurement.d.ts +20 -0
- package/dist/studio/application/measure/carrier-measurement.js +51 -0
- package/dist/studio/application/measure/core-run-format.d.ts +12 -1
- package/dist/studio/application/measure/core-run-format.js +71 -2
- package/dist/studio/application/measure/core-run-projection.js +12 -0
- package/dist/studio/http/contracts.d.ts +0 -2
- package/dist/studio/http/next-context.d.ts +0 -2
- package/dist/studio/http/next-context.js +0 -1
- package/dist/studio/http/next-server.js +12 -32
- package/dist/studio/http/page-paths.d.ts +2 -2
- package/dist/studio/http/page-paths.js +2 -2
- package/dist/studio/http/pages/knowledge-page.d.ts +1 -1
- package/dist/studio/http/pages/knowledge-page.js +3 -3
- package/dist/studio/http/pages/measure-page.d.ts +3 -2
- package/dist/studio/http/pages/measure-page.js +5 -3
- package/dist/studio/http/request-handler.d.ts +1 -1
- package/dist/studio/http/request-handler.js +19 -6
- package/dist/studio/http/routes/artifact-authoring.d.ts +1 -0
- package/dist/studio/http/routes/artifact-authoring.js +34 -0
- package/dist/studio/http/routes/carrier-measurement.d.ts +8 -0
- package/dist/studio/http/routes/carrier-measurement.js +34 -0
- package/dist/studio/http/routes/knowledge-candidates.d.ts +2 -2
- package/dist/studio/http/routes/knowledge-candidates.js +41 -31
- package/dist/studio/http/routes/knowledge.d.ts +1 -2
- package/dist/studio/http/routes/knowledge.js +1 -14
- package/dist/studio/view-models/display/tone.d.ts +1 -2
- package/dist/studio/view-models/knowledge/artifact-authoring.d.ts +2 -0
- package/dist/studio/view-models/knowledge/artifact-authoring.js +1 -0
- package/dist/studio/view-models/knowledge/knowledge-candidates.d.ts +55 -12
- package/dist/studio/view-models/knowledge/knowledge-library.d.ts +4 -0
- package/dist/studio/view-models/knowledge/knowledge-library.js +1 -0
- package/dist/studio/view-models/measure/carrier-measurement.d.ts +1 -0
- package/dist/studio/view-models/measure/carrier-measurement.js +1 -0
- package/dist/studio/view-models/measure/core-runs.d.ts +38 -0
- package/dist/studio/web/.next/BUILD_ID +1 -1
- package/dist/studio/web/.next/app-path-routes-manifest.json +2 -2
- package/dist/studio/web/.next/build-manifest.json +5 -5
- package/dist/studio/web/.next/next-minimal-server.js.nft.json +1 -1
- package/dist/studio/web/.next/next-server.js.nft.json +1 -1
- package/dist/studio/web/.next/prerender-manifest.json +4 -4
- package/dist/studio/web/.next/required-server-files.js +16 -1
- package/dist/studio/web/.next/required-server-files.json +16 -1
- package/dist/studio/web/.next/routes-manifest.json +9 -11
- package/dist/studio/web/.next/server/app/_global-error/page.js +2 -2
- package/dist/studio/web/.next/server/app/_global-error/page.js.nft.json +1 -1
- package/dist/studio/web/.next/server/app/_global-error/page_client-reference-manifest.js +1 -1
- package/dist/studio/web/.next/server/app/_global-error.html +1 -1
- package/dist/studio/web/.next/server/app/_global-error.meta +8 -0
- package/dist/studio/web/.next/server/app/_global-error.rsc +30 -18
- package/dist/studio/web/.next/server/app/_global-error.segments/_full.segment.rsc +30 -18
- package/dist/studio/web/.next/server/app/_global-error.segments/_global-error/__PAGE__.segment.rsc +36 -24
- package/dist/studio/web/.next/server/app/_global-error.segments/_tree.segment.rsc +3 -1
- package/dist/studio/web/.next/server/app/_not-found/page.js +1 -1
- package/dist/studio/web/.next/server/app/_not-found/page.js.nft.json +1 -1
- package/dist/studio/web/.next/server/app/_not-found/page_client-reference-manifest.js +1 -1
- package/dist/studio/web/.next/server/app/agents/page.js +1 -1
- package/dist/studio/web/.next/server/app/agents/page.js.nft.json +1 -1
- package/dist/studio/web/.next/server/app/agents/page_client-reference-manifest.js +1 -1
- package/dist/studio/web/.next/server/app/knowledge/candidates/page.js +1 -1
- package/dist/studio/web/.next/server/app/knowledge/candidates/page.js.nft.json +1 -1
- package/dist/studio/web/.next/server/app/knowledge/candidates/page_client-reference-manifest.js +1 -1
- package/dist/studio/web/.next/server/app/knowledge/entities/page.js +1 -0
- package/dist/studio/web/.next/server/app/knowledge/entities/page.js.nft.json +1 -0
- package/dist/studio/web/.next/server/app/knowledge/entities/page_client-reference-manifest.js +1 -0
- package/dist/studio/web/.next/server/app/knowledge/library/page.js +1 -0
- package/dist/studio/web/.next/server/app/knowledge/library/page.js.nft.json +1 -0
- package/dist/studio/web/.next/server/app/knowledge/library/page_client-reference-manifest.js +1 -0
- package/dist/studio/web/.next/server/app/knowledge/page.js +1 -1
- package/dist/studio/web/.next/server/app/knowledge/page.js.nft.json +1 -1
- package/dist/studio/web/.next/server/app/knowledge/page_client-reference-manifest.js +1 -1
- package/dist/studio/web/.next/server/app/knowledge/skills/[skillName]/page.js +1 -1
- package/dist/studio/web/.next/server/app/knowledge/skills/[skillName]/page.js.nft.json +1 -1
- package/dist/studio/web/.next/server/app/knowledge/skills/[skillName]/page_client-reference-manifest.js +1 -1
- package/dist/studio/web/.next/server/app/measure/[runId]/page.js +1 -1
- package/dist/studio/web/.next/server/app/measure/[runId]/page.js.nft.json +1 -1
- package/dist/studio/web/.next/server/app/measure/[runId]/page_client-reference-manifest.js +1 -1
- package/dist/studio/web/.next/server/app/measure/page.js +1 -1
- package/dist/studio/web/.next/server/app/measure/page.js.nft.json +1 -1
- package/dist/studio/web/.next/server/app/measure/page_client-reference-manifest.js +1 -1
- package/dist/studio/web/.next/server/app/observe/conversations/[threadId]/page.js +1 -1
- package/dist/studio/web/.next/server/app/observe/conversations/[threadId]/page.js.nft.json +1 -1
- package/dist/studio/web/.next/server/app/observe/conversations/[threadId]/page_client-reference-manifest.js +1 -1
- package/dist/studio/web/.next/server/app/observe/conversations/[threadId]/tasks/[turnId]/page.js +1 -1
- package/dist/studio/web/.next/server/app/observe/conversations/[threadId]/tasks/[turnId]/page.js.nft.json +1 -1
- package/dist/studio/web/.next/server/app/observe/conversations/[threadId]/tasks/[turnId]/page_client-reference-manifest.js +1 -1
- package/dist/studio/web/.next/server/app/observe/health/[analysisId]/page.js +1 -1
- package/dist/studio/web/.next/server/app/observe/health/[analysisId]/page.js.nft.json +1 -1
- package/dist/studio/web/.next/server/app/observe/health/[analysisId]/page_client-reference-manifest.js +1 -1
- package/dist/studio/web/.next/server/app/observe/health/page.js +1 -1
- package/dist/studio/web/.next/server/app/observe/health/page.js.nft.json +1 -1
- package/dist/studio/web/.next/server/app/observe/health/page_client-reference-manifest.js +1 -1
- package/dist/studio/web/.next/server/app/observe/health-diff/page.js +1 -1
- package/dist/studio/web/.next/server/app/observe/health-diff/page.js.nft.json +1 -1
- package/dist/studio/web/.next/server/app/observe/health-diff/page_client-reference-manifest.js +1 -1
- package/dist/studio/web/.next/server/app/observe/inbox/page.js +2 -2
- package/dist/studio/web/.next/server/app/observe/inbox/page.js.nft.json +1 -1
- package/dist/studio/web/.next/server/app/observe/inbox/page_client-reference-manifest.js +1 -1
- package/dist/studio/web/.next/server/app/observe/page.js +1 -1
- package/dist/studio/web/.next/server/app/observe/page.js.nft.json +1 -1
- package/dist/studio/web/.next/server/app/observe/page_client-reference-manifest.js +1 -1
- package/dist/studio/web/.next/server/app/observe/skill-trend/[skillName]/page.js +1 -1
- package/dist/studio/web/.next/server/app/observe/skill-trend/[skillName]/page.js.nft.json +1 -1
- package/dist/studio/web/.next/server/app/observe/skill-trend/[skillName]/page_client-reference-manifest.js +1 -1
- package/dist/studio/web/.next/server/app-paths-manifest.json +2 -2
- package/dist/studio/web/.next/server/chunks/132.js +1 -0
- package/dist/studio/web/.next/server/chunks/272.js +1 -0
- package/dist/studio/web/.next/server/chunks/{374.js → 285.js} +2 -2
- package/dist/studio/web/.next/server/chunks/312.js +1 -0
- package/dist/studio/web/.next/server/chunks/33.js +1 -0
- package/dist/studio/web/.next/server/chunks/335.js +2 -14
- package/dist/studio/web/.next/server/chunks/{584.js → 34.js} +5 -2
- package/dist/studio/web/.next/server/chunks/388.js +1 -1
- package/dist/studio/web/.next/server/chunks/464.js +2 -2
- package/dist/studio/web/.next/server/chunks/499.js +1 -1
- package/dist/studio/web/.next/server/chunks/562.js +1 -0
- package/dist/studio/web/.next/server/chunks/57.js +10 -0
- package/dist/studio/web/.next/server/chunks/671.js +1 -0
- package/dist/studio/web/.next/server/chunks/757.js +4 -0
- package/dist/studio/web/.next/server/chunks/772.js +1 -1
- package/dist/studio/web/.next/server/chunks/777.js +1 -0
- package/dist/studio/web/.next/server/chunks/78.js +1 -0
- package/dist/studio/web/.next/server/chunks/793.js +907 -0
- package/dist/studio/web/.next/server/chunks/803.js +1 -0
- package/dist/studio/web/.next/server/chunks/811.js +1 -0
- package/dist/studio/web/.next/server/chunks/84.js +3 -3
- package/dist/studio/web/.next/server/chunks/{767.js → 845.js} +1 -1
- package/dist/studio/web/.next/server/chunks/949.js +55 -0
- package/dist/studio/web/.next/server/chunks/987.js +1 -0
- package/dist/studio/web/.next/server/middleware-build-manifest.js +1 -1
- package/dist/studio/web/.next/server/pages/500.html +1 -1
- package/dist/studio/web/.next/server/preview-props.json +5 -0
- package/dist/studio/web/.next/server/server-reference-manifest.json +1 -1
- package/dist/studio/web/.next/server/webpack-runtime.js +1 -1
- package/dist/studio/web/.next/static/chunks/0937d497-cb7a9ff884a082ab.js +1 -0
- package/dist/studio/web/.next/static/chunks/1550-8655e6e988ed925d.js +55 -0
- package/dist/studio/web/.next/static/chunks/1858-ae2f35e65c0ca7d5.js +52 -0
- package/dist/studio/web/.next/static/chunks/2038-39b8b64415693d72.js +1 -0
- package/dist/studio/web/.next/static/chunks/2192-3a82fac42d5470cb.js +16 -0
- package/dist/studio/web/.next/static/chunks/{285-6d4538bae9d2657f.js → 285-6bae73aced9b94d9.js} +4 -4
- package/dist/studio/web/.next/static/chunks/2953-ecd3f863c308edd6.js +41 -0
- package/dist/studio/web/.next/static/chunks/3435-00b4fbf4aa14a9af.js +1 -0
- package/dist/studio/web/.next/static/chunks/3958-1fa29558b4d99167.js +1 -0
- package/dist/studio/web/.next/static/chunks/3978-415a489ab1667812.js +1 -0
- package/dist/studio/web/.next/static/chunks/4-efa96fd3354dd00f.js +1 -0
- package/dist/studio/web/.next/static/chunks/5014-d863a9f62fbce3d9.js +1 -0
- package/dist/studio/web/.next/static/chunks/5382-1b919cde624bb761.js +1 -0
- package/dist/studio/web/.next/static/chunks/5669-c7c2d55e48ca0654.js +4 -0
- package/dist/studio/web/.next/static/chunks/5686-889bc419951f97b0.js +10 -0
- package/dist/studio/web/.next/static/chunks/5834-8ae3cace4e65870b.js +1 -0
- package/dist/studio/web/.next/static/chunks/7095-82772c89aecce311.js +19 -0
- package/dist/studio/web/.next/static/chunks/7103-1245dcb14501dcbe.js +1 -0
- package/dist/studio/web/.next/static/chunks/7703-3f2eeb40539b244a.js +1 -0
- package/dist/studio/web/.next/static/chunks/7754-4a1e255edea968a8.js +4 -0
- package/dist/studio/web/.next/static/chunks/{7576-c700fccfc712c394.js → 7936-1fe24cff93665d92.js} +9 -9
- package/dist/studio/web/.next/static/chunks/7956-961871b7f06d5154.js +6 -0
- package/dist/studio/web/.next/static/chunks/8284-61d4bd3af6cde82f.js +1 -0
- package/dist/studio/web/.next/static/chunks/8704-6257f6e867d6298a.js +10 -0
- package/dist/studio/web/.next/static/chunks/{8791-628c2e7b0dab299a.js → 8791-cc9640eb97b0ac98.js} +1 -1
- package/dist/studio/web/.next/static/chunks/8908-d585f523c5616336.js +1 -0
- package/dist/studio/web/.next/static/chunks/9066-417bfe2622f7c6c6.js +1 -0
- package/dist/studio/web/.next/static/chunks/9688-8fc2ea8f15ab0642.js +1 -0
- package/dist/studio/web/.next/static/chunks/9978-2b5578a391a0f389.js +9 -0
- package/dist/studio/web/.next/static/chunks/app/agents/page-ccd392fdc4feb767.js +1 -0
- package/dist/studio/web/.next/static/chunks/app/{error-66775c241a4b5db1.js → error-b4cdd259571bfddc.js} +1 -1
- package/dist/studio/web/.next/static/chunks/app/knowledge/candidates/page-87818ef4fbceab6a.js +1 -0
- package/dist/studio/web/.next/static/chunks/app/knowledge/entities/page-685a1b293b46298d.js +1 -0
- package/dist/studio/web/.next/static/chunks/app/knowledge/library/page-fd56dc775a86e423.js +1 -0
- package/dist/studio/web/.next/static/chunks/app/knowledge/page-d81f232d6f4b4a9c.js +1 -0
- package/dist/studio/web/.next/static/chunks/app/knowledge/skills/[skillName]/page-e55ee423ad3af267.js +1 -0
- package/dist/studio/web/.next/static/chunks/app/layout-33179810f5d93c07.js +1 -0
- package/dist/studio/web/.next/static/chunks/app/{loading-cc65be1028090c98.js → loading-5eff71aa13fa6fdb.js} +1 -1
- package/dist/studio/web/.next/static/chunks/app/measure/[runId]/page-68897c54cc7e35a9.js +1 -0
- package/dist/studio/web/.next/static/chunks/app/measure/page-a867aa25d5970346.js +1 -0
- package/dist/studio/web/.next/static/chunks/app/{not-found-bcac3c26cbb1b3ed.js → not-found-42b8668344a5414a.js} +1 -1
- package/dist/studio/web/.next/static/chunks/app/observe/conversations/[threadId]/page-62e3f9d8baf73de3.js +1 -0
- package/dist/studio/web/.next/static/chunks/app/observe/conversations/[threadId]/tasks/[turnId]/page-b9e50731b2d36271.js +1 -0
- package/dist/studio/web/.next/static/chunks/app/observe/health/[analysisId]/page-b4533c8059fa01e6.js +1 -0
- package/dist/studio/web/.next/static/chunks/app/observe/health/page-c2b2ba39a7cb1f6f.js +1 -0
- package/dist/studio/web/.next/static/chunks/app/observe/health-diff/page-3ee1e330242c46c3.js +1 -0
- package/dist/studio/web/.next/static/chunks/app/observe/inbox/page-fe295ccd0fa2cb10.js +1 -0
- package/dist/studio/web/.next/static/chunks/app/observe/page-8f4dec4a52794fae.js +1 -0
- package/dist/studio/web/.next/static/chunks/app/observe/skill-trend/[skillName]/page-be013760e79d259a.js +1 -0
- package/dist/studio/web/.next/static/chunks/framework-ba3537adc78ec474.js +1 -0
- package/dist/studio/web/.next/static/chunks/main-66b6ab45aa0fce29.js +5 -0
- package/dist/studio/web/.next/static/chunks/webpack-ac24233801701b11.js +1 -0
- package/dist/studio/web/.next/static/css/43b8660429d21bfd.css +1 -0
- package/dist/studio/web/.next/static/vi-Wf9wVz6KtDrndi6cz6/_buildManifest.js +1 -0
- package/dist/studio/web/.next/trace +92 -42
- package/dist/studio/web/.next/trace-build +1 -1
- package/package.json +7 -5
- package/dist/cli/commands/list.d.ts +0 -26
- package/dist/cli/commands/list.js +0 -121
- package/dist/cli/commands/promote.d.ts +0 -24
- package/dist/cli/commands/promote.js +0 -141
- package/dist/cli/commands/rollback.d.ts +0 -20
- package/dist/cli/commands/rollback.js +0 -87
- package/dist/cli/lib/actor.d.ts +0 -2
- package/dist/cli/lib/actor.js +0 -13
- package/dist/cli/lib/i18n-dict/list.d.ts +0 -3
- package/dist/cli/lib/i18n-dict/list.js +0 -40
- package/dist/cli/lib/i18n-dict/promote.d.ts +0 -3
- package/dist/cli/lib/i18n-dict/promote.js +0 -46
- package/dist/cli/lib/i18n-dict/rollback.d.ts +0 -3
- package/dist/cli/lib/i18n-dict/rollback.js +0 -22
- package/dist/eval-workflows/projections/managed.d.ts +0 -8
- package/dist/eval-workflows/projections/managed.js +0 -105
- package/dist/knowledge-artifacts/governance/contracts.d.ts +0 -158
- package/dist/knowledge-artifacts/governance/evidence.d.ts +0 -25
- package/dist/knowledge-artifacts/governance/evidence.js +0 -111
- package/dist/knowledge-artifacts/governance/evolve-outcome.d.ts +0 -16
- package/dist/knowledge-artifacts/governance/evolve-outcome.js +0 -41
- package/dist/knowledge-artifacts/governance/index.d.ts +0 -11
- package/dist/knowledge-artifacts/governance/index.js +0 -11
- package/dist/knowledge-artifacts/governance/install.d.ts +0 -29
- package/dist/knowledge-artifacts/governance/install.js +0 -63
- package/dist/knowledge-artifacts/governance/list-query.d.ts +0 -7
- package/dist/knowledge-artifacts/governance/list-query.js +0 -11
- package/dist/knowledge-artifacts/governance/list-view.d.ts +0 -67
- package/dist/knowledge-artifacts/governance/list-view.js +0 -77
- package/dist/knowledge-artifacts/governance/observe-feedback.d.ts +0 -73
- package/dist/knowledge-artifacts/governance/observe-feedback.js +0 -59
- package/dist/knowledge-artifacts/governance/promote-gate.d.ts +0 -34
- package/dist/knowledge-artifacts/governance/promote-gate.js +0 -32
- package/dist/knowledge-artifacts/governance/source-probe.d.ts +0 -15
- package/dist/knowledge-artifacts/governance/source-probe.js +0 -129
- package/dist/knowledge-artifacts/governance/store.d.ts +0 -145
- package/dist/knowledge-artifacts/governance/store.js +0 -594
- package/dist/studio/application/knowledge/managed-format.d.ts +0 -58
- package/dist/studio/application/knowledge/managed-format.js +0 -113
- package/dist/studio/http/managed-root.d.ts +0 -12
- package/dist/studio/http/managed-root.js +0 -19
- package/dist/studio/http/pages/managed-page.d.ts +0 -30
- package/dist/studio/http/pages/managed-page.js +0 -44
- package/dist/studio/web/.next/server/app/knowledge/managed/[managedId]/page.js +0 -1
- package/dist/studio/web/.next/server/app/knowledge/managed/[managedId]/page.js.nft.json +0 -1
- package/dist/studio/web/.next/server/app/knowledge/managed/[managedId]/page_client-reference-manifest.js +0 -1
- package/dist/studio/web/.next/server/app/knowledge/managed/page.js +0 -1
- package/dist/studio/web/.next/server/app/knowledge/managed/page.js.nft.json +0 -1
- package/dist/studio/web/.next/server/app/knowledge/managed/page_client-reference-manifest.js +0 -1
- package/dist/studio/web/.next/server/chunks/209.js +0 -1
- package/dist/studio/web/.next/server/chunks/3.js +0 -2
- package/dist/studio/web/.next/server/chunks/384.js +0 -1
- package/dist/studio/web/.next/server/chunks/42.js +0 -1
- package/dist/studio/web/.next/server/chunks/475.js +0 -1
- package/dist/studio/web/.next/server/chunks/827.js +0 -583
- package/dist/studio/web/.next/server/chunks/881.js +0 -1
- package/dist/studio/web/.next/server/chunks/955.js +0 -1
- package/dist/studio/web/.next/static/chunks/0937d497-e4b3c577da4da67b.js +0 -1
- package/dist/studio/web/.next/static/chunks/1858-c24dcd678cdcae50.js +0 -52
- package/dist/studio/web/.next/static/chunks/2038-fe4b8b7ee5f7cd19.js +0 -1
- package/dist/studio/web/.next/static/chunks/258-9e85d3d73100f7d7.js +0 -10
- package/dist/studio/web/.next/static/chunks/2666-2770e8e4b4caab0e.js +0 -4
- package/dist/studio/web/.next/static/chunks/2953-a2797c8e2c97e052.js +0 -53
- package/dist/studio/web/.next/static/chunks/4684-f60cec1af16cc02a.js +0 -1
- package/dist/studio/web/.next/static/chunks/5834-4a1f3c2c259a1918.js +0 -1
- package/dist/studio/web/.next/static/chunks/6250-1c80598e5a04a823.js +0 -2
- package/dist/studio/web/.next/static/chunks/6651-3212253f7d2d141f.js +0 -16
- package/dist/studio/web/.next/static/chunks/6698-fe3dadb4c5aa013d.js +0 -9
- package/dist/studio/web/.next/static/chunks/8038-9d97f8fe79c7f7d4.js +0 -6
- package/dist/studio/web/.next/static/chunks/8284-dca5d2249647425f.js +0 -1
- package/dist/studio/web/.next/static/chunks/900-afd29ea08f2e1714.js +0 -1
- package/dist/studio/web/.next/static/chunks/9386-d62507b1afffde3c.js +0 -1
- package/dist/studio/web/.next/static/chunks/9688-568cb3f8978b37e8.js +0 -1
- package/dist/studio/web/.next/static/chunks/9804-2d943d62c12ddbd6.js +0 -16
- package/dist/studio/web/.next/static/chunks/9953-e991c2f9674aeb7b.js +0 -1
- package/dist/studio/web/.next/static/chunks/app/agents/page-3cd33e679bd540fb.js +0 -1
- package/dist/studio/web/.next/static/chunks/app/knowledge/candidates/page-4202293fa248f263.js +0 -1
- package/dist/studio/web/.next/static/chunks/app/knowledge/managed/[managedId]/page-9f18fce00bf621dc.js +0 -1
- package/dist/studio/web/.next/static/chunks/app/knowledge/managed/page-4e9b40acd4e5130b.js +0 -1
- package/dist/studio/web/.next/static/chunks/app/knowledge/page-673896d1f93ec57d.js +0 -1
- package/dist/studio/web/.next/static/chunks/app/knowledge/skills/[skillName]/page-28c63ecbe6a8d515.js +0 -1
- package/dist/studio/web/.next/static/chunks/app/layout-26d16d7c66539fc1.js +0 -1
- package/dist/studio/web/.next/static/chunks/app/measure/[runId]/page-f6b816f8eb408bb9.js +0 -1
- package/dist/studio/web/.next/static/chunks/app/measure/page-8d42458a7c786a5a.js +0 -1
- package/dist/studio/web/.next/static/chunks/app/observe/conversations/[threadId]/page-ebc25fa3c7ad85c3.js +0 -1
- package/dist/studio/web/.next/static/chunks/app/observe/conversations/[threadId]/tasks/[turnId]/page-2602b9d82e415bfc.js +0 -1
- package/dist/studio/web/.next/static/chunks/app/observe/health/[analysisId]/page-b32cc1278399d1a0.js +0 -1
- package/dist/studio/web/.next/static/chunks/app/observe/health/page-3d8f7c136a55c349.js +0 -1
- package/dist/studio/web/.next/static/chunks/app/observe/health-diff/page-3ca3d158cd147ef5.js +0 -1
- package/dist/studio/web/.next/static/chunks/app/observe/inbox/page-5003e5561490047b.js +0 -1
- package/dist/studio/web/.next/static/chunks/app/observe/page-4a9a6d1984a94eff.js +0 -1
- package/dist/studio/web/.next/static/chunks/app/observe/skill-trend/[skillName]/page-1a9d9d1ac593f16d.js +0 -1
- package/dist/studio/web/.next/static/chunks/framework-9d2daf55218bfcdb.js +0 -1
- package/dist/studio/web/.next/static/chunks/main-c9db6abe2bb89249.js +0 -5
- package/dist/studio/web/.next/static/chunks/webpack-040077c7c5b63775.js +0 -1
- package/dist/studio/web/.next/static/css/b1a43ef7dccd6013.css +0 -1
- package/dist/studio/web/.next/static/d2gceAJH4KOAP1AWstMW0/_buildManifest.js +0 -1
- /package/dist/{knowledge-artifacts/governance/contracts.js → eval-workflows/projections/carrier-measurement.js} +0 -0
- /package/dist/studio/web/.next/static/{d2gceAJH4KOAP1AWstMW0 → vi-Wf9wVz6KtDrndi6cz6}/_ssgManifest.js +0 -0
package/README.md
CHANGED
|
@@ -1,163 +1,54 @@
|
|
|
1
1
|
# OMK
|
|
2
2
|
|
|
3
|
-
[](https://www.npmjs.com/package/oh-my-knowledge)
|
|
3
|
+
[](https://www.npmjs.com/package/oh-my-knowledge?activeTab=versions)
|
|
5
4
|
[](https://github.com/lizhiyao/oh-my-knowledge/actions/workflows/ci.yml)
|
|
6
5
|
[](./LICENSE)
|
|
7
|
-
[](https://nodejs.org)
|
|
8
6
|
|
|
9
7
|
**English** | [简体中文](./README.zh.md)
|
|
10
8
|
|
|
11
|
-
**Observe. Measure. Know.**
|
|
9
|
+
**Observe. Measure. Know.** Turn working experience into knowledge you can keep maintaining.
|
|
12
10
|
|
|
13
|
-
OMK is
|
|
11
|
+
OMK is for agent users and AI application developers. Extract candidates from real work, review sources and conditions, accumulate and revise knowledge around objects, then update the skills or prompts that reference it. When you need evidence about a change, compare artifact versions under controlled conditions independently.
|
|
14
12
|
|
|
15
|
-
|
|
13
|
+
## Start with local work records
|
|
16
14
|
|
|
17
|
-
|
|
18
|
-
|
|
19
|
-

|
|
20
|
-
|
|
21
|
-
## Choose how to use OMK
|
|
22
|
-
|
|
23
|
-
| Interface | Use it for |
|
|
24
|
-
|---|---|
|
|
25
|
-
| **CLI** | Run checks, evaluations, observation, and improvement workflows from a terminal, coding agent, or CI |
|
|
26
|
-
| **Studio** | Browse task trajectories, review knowledge items, and inspect reports and source evidence in a local workbench |
|
|
27
|
-
| **eval-runtime** | Embed execution, scoring, and version comparison in your Node.js service or platform, without going through the CLI or starting Studio |
|
|
28
|
-
| **DSH plugin** | Use `/omk eval` and `/omk observe` inside DeepSeek Harness with the current profile’s model, credentials, tools, and sandbox; see [host plugin setup](docs/reference/executors.md#deepseek-harness-prefer-the-host-plugin) |
|
|
29
|
-
|
|
30
|
-
## Start with your goal
|
|
31
|
-
|
|
32
|
-
| Goal | Entry point | What you get |
|
|
33
|
-
|---|---|---|
|
|
34
|
-
| Understand a real task | [Studio and task trajectories](docs/guides/observe-production.md) | Conversation, execution, results, and knowledge lanes with inspectable source records |
|
|
35
|
-
| Preserve knowledge from work | [Extract knowledge from logs](docs/guides/extract-knowledge.md) | Candidate knowledge with sources and conditions; revise, retain, or discard it |
|
|
36
|
-
| Record a confirmed knowledge problem | [MCP feedback](docs/guides/mcp-integration.md) | An observation for review; draft a case after confirming a real issue |
|
|
37
|
-
| Decide whether to adopt a change | [Evaluation quickstart](docs/quickstart-skill-eval.md) | A version decision, uncertainty, failed cases, and scoring evidence |
|
|
38
|
-
| Try improving a skill automatically | [Iterative improvement](docs/guides/auto-improve-skills.md) | Candidate versions screened through controlled comparisons |
|
|
39
|
-
| Embed evaluation in a service or platform | [Node.js service](docs/guides/eval-runtime.md) · [Platform host](docs/guides/platform-host-integration.md) | Composable execution, scoring, and comparison interfaces |
|
|
40
|
-
|
|
41
|
-
## Quick start
|
|
42
|
-
|
|
43
|
-
Installation requires Node.js >=22. Model calls also require an authenticated runtime; see [Requirements](#requirements).
|
|
15
|
+
Requires **Node.js ≥22**. The library, artifact authoring, and change review described here require **1.0.0-beta.14 or later**, from the **`@next` channel**; npm `latest` is a separate stable channel. Beta.13 does not include this maintenance UI. Read the [migration guide](docs/guides/maintenance/v1-preview-migration.md) before upgrading an older installation.
|
|
44
16
|
|
|
45
17
|
```bash
|
|
46
18
|
npm i -g oh-my-knowledge@next
|
|
47
|
-
|
|
48
|
-
|
|
49
|
-
### Inspect an existing task
|
|
50
|
-
|
|
51
|
-
```bash
|
|
19
|
+
omk --version
|
|
52
20
|
omk studio
|
|
53
21
|
```
|
|
54
22
|
|
|
55
|
-
Open the local URL returned by the command and
|
|
23
|
+
Open the local URL returned by the command and inspect an existing Codex task and its source records. This step makes no model call; Studio offers source and collection guidance when no conversations exist. Follow the [observation guide](docs/guides/observe/observe-production.md) for other log sources.
|
|
56
24
|
|
|
57
|
-
|
|
25
|
+
Next, choose a conversation and turns under “Knowledge → Candidate review”, inspect the material to send, and extract candidates. **Extraction calls a model**, so prepare an [authenticated runtime](docs/reference/integration/executors.md#prerequisites) first. Link sources in the library, revise outdated content, then explicitly generate and save an artifact. Its detail view lets you review knowledge changes and old and new references. Follow the [knowledge maintenance workflow](docs/guides/knowledge/extract-knowledge.md).
|
|
58
26
|
|
|
59
|
-
|
|
27
|
+
## When knowledge changes, review its artifacts
|
|
60
28
|
|
|
61
|
-
|
|
62
|
-
omk init demo
|
|
63
|
-
cd demo
|
|
64
|
-
omk eval --control code-review-v1 --treatment code-review-v2 --dry-run
|
|
65
|
-
```
|
|
29
|
+

|
|
66
30
|
|
|
67
|
-
|
|
31
|
+
In the existing SDK maintenance case, old statements were limited to their historical context, one item was discarded, and another gained a clearer boundary for its static observations. v4 retains three historical references and shows two changes; v5 explicitly selects two currently retained items, while old content and references remain available. [Read the case, sources, and review steps](docs/guides/knowledge/sdk-maintenance-case.md).
|
|
68
32
|
|
|
69
|
-
|
|
70
|
-
omk eval --control code-review-v1 --treatment code-review-v2
|
|
71
|
-
```
|
|
33
|
+
This verifies maintenance and reference behavior. It does not verify dynamic SDK effects, time saved, or cross-agent reuse benefits. Retaining knowledge, saving artifacts, using them, and verifying effects are separate records. Complete automatic management and reuse across agents remain in development.
|
|
72
34
|
|
|
73
|
-
|
|
35
|
+
## Continue with your task
|
|
74
36
|
|
|
75
|
-
|
|
37
|
+
- **Compare two artifacts directly**: preview the plan in the [evaluation quickstart](docs/quickstart-skill-eval.md), configure a runtime, then call the model. Fix models and cases, record execution conditions, and inspect decisions, uncertainty, and failed-case evidence.
|
|
38
|
+
- **Embed evaluation in a service**: begin with the [offline Node example](docs/guides/integration/eval-runtime.md), complete a traceable comparison, then choose models and configuration as needed.
|
|
39
|
+
- **Use OMK inside agents or DSH**: [install the official Skill](docs/quickstart-skill-eval.md#use-inside-an-agent), [submit MCP feedback](docs/guides/integration/mcp-integration.md), or use the [DSH host plugin](docs/reference/integration/executors.md#deepseek-harness-prefer-the-host-plugin).
|
|
40
|
+
- **Verify an agent’s file changes**: use independent checks in [local task acceptance](docs/guides/evaluation/local-tasks.md), or screen candidate versions with [iterative improvement](docs/guides/evaluation/auto-improve-skills.md).
|
|
76
41
|
|
|
77
|
-
|
|
42
|
+
Starter cases check the workflow; `UNDERPOWERED` is expected. Release decisions need your own domain cases and independent evidence. Observation signals do not establish causality; passing an evaluation does not mean an artifact took effect or a version was published.
|
|
78
43
|
|
|
79
|
-
|
|
44
|
+
## Look up details and upgrade
|
|
80
45
|
|
|
81
|
-
|
|
82
|
-
omk install omk-agent-skill
|
|
83
|
-
```
|
|
46
|
+
[Documentation start](docs/README.md) · [Website](https://oh-my-knowledge.pages.dev/) · [CLI](docs/reference/cli.md) · [Runtimes and executors](docs/reference/integration/executors.md) · [Settings and environment variables](docs/reference/shared/settings.md) · [Examples](examples/README.md)
|
|
84
47
|
|
|
85
|
-
|
|
86
|
-
|
|
87
|
-
The [MCP integration](docs/guides/mcp-integration.md) accepts user-authorized knowledge feedback. It records partial evidence submitted at its tool boundary; it does not automatically monitor complete conversations.
|
|
88
|
-
|
|
89
|
-
### DeepSeek Harness plugin
|
|
90
|
-
|
|
91
|
-
If you already use DSH, add OMK to an existing profile. For example, use the command-enabled `web` profile:
|
|
92
|
-
|
|
93
|
-
```bash
|
|
94
|
-
dsh plugin --profile web add oh-my-knowledge
|
|
95
|
-
dsh --profile web
|
|
96
|
-
```
|
|
97
|
-
|
|
98
|
-
Inside DSH, run:
|
|
99
|
-
|
|
100
|
-
```text
|
|
101
|
-
/omk eval eval.yaml
|
|
102
|
-
/omk observe
|
|
103
|
-
/omk observe <session-id>
|
|
104
|
-
```
|
|
105
|
-
|
|
106
|
-
Evaluation reuses the host’s model, credentials, tools, and sandbox, creating an isolated session for each case. Observation reads snapshots of completed sessions and returns a Studio task-trajectory URL; it does not currently live-follow running DSH sessions. See [DSH integration](docs/reference/executors.md#deepseek-harness-prefer-the-host-plugin) for configuration requirements and current plugin limitations.
|
|
107
|
-
|
|
108
|
-
## Use the evidence
|
|
109
|
-
|
|
110
|
-
A knowledge item is a reviewable fact, experience, or method. An artifact is a prompt, document, skill, or other carrier of that content. Candidate knowledge describes content awaiting review; a candidate version describes a proposed artifact version.
|
|
111
|
-
|
|
112
|
-
1. **Observe and review**: inspect tasks and sources in Studio; extract knowledge or confirm observations, preserving conditions and review reasons.
|
|
113
|
-
2. **Prepare a measurable change**: manually apply selected content to an artifact and turn reproducible problems into evaluation cases. Candidates do not take effect automatically.
|
|
114
|
-
3. **Compare under control**: `doctor` performs preflight checks; `eval` compares control and treatment with a Decision, coverage, failed cases, and costs.
|
|
115
|
-
4. **Adopt or improve further**: use evidence to `promote` or `rollback` managed skills. `evolve` screens candidate versions through A/B gates and compares again before writing back.
|
|
116
|
-
|
|
117
|
-
These paths compose; they are not a mandatory linear state machine. Passing an evaluation does not mean knowledge has been written or a version published.
|
|
118
|
-
|
|
119
|
-
Conclusions depend on the cases, scoring criteria, and execution environment. Observation signals are not causal conclusions, and generated cases are not an independent release-validation set. See [statistical rigor](docs/explanation/statistical-rigor.md) and the [three-stage workflow](docs/explanation/three-stage-workflow.md) for the method and limits.
|
|
120
|
-
|
|
121
|
-
Project evaluation and observation evidence lives under `.omk/`; machine-level state lives under `~/.oh-my-knowledge/`. Extracted knowledge items live in the explicitly selected knowledge workspace. The current version neither reads nor migrates the old storage layout. Back up before upgrading and follow the [migration guide](docs/guides/v1-preview-migration.md) to establish new evidence.
|
|
122
|
-
|
|
123
|
-
## Documentation
|
|
124
|
-
|
|
125
|
-
[Documentation index](docs/README.md) · [Online docs](https://oh-my-knowledge.pages.dev) · [CLI reference](docs/reference/cli.md) · [Sample format](docs/reference/eval-sample-format.md) · [Executors](docs/reference/executors.md) · [How OMK understands knowledge](docs/explanation/knowledge.md)
|
|
126
|
-
|
|
127
|
-
## Environment variables
|
|
128
|
-
|
|
129
|
-
| Variable | Description |
|
|
130
|
-
|---|---|
|
|
131
|
-
| `OMK_EXECUTOR` | default executor preference, e.g. `codex` / `codex-sdk` / `claude` |
|
|
132
|
-
| `OMK_MODEL` | default evaluated model; Codex reads local `config.toml` when unset |
|
|
133
|
-
| `OMK_JUDGE_MODELS` | default judge list in `executor:model[,...]` format |
|
|
134
|
-
| `CCV_PROXY_URL` | proxy requests through cc-viewer for live eval-traffic visualization |
|
|
135
|
-
| `OMK_REPORT_PORT` | report server port (default: 7799) |
|
|
136
|
-
|
|
137
|
-
## Requirements
|
|
138
|
-
|
|
139
|
-
- Node.js >= 22
|
|
140
|
-
- At least one authenticated model runtime:
|
|
141
|
-
- Codex: install and authenticate the Codex CLI (`npm i -g @openai/codex`); Codex tasks in the ChatGPT desktop app select it automatically
|
|
142
|
-
- Claude: install and authenticate [Claude Code](https://claude.ai/code)
|
|
143
|
-
- API / other executors: configure them as described in [Executors](docs/reference/executors.md)
|
|
144
|
-
- Advanced `claude-sdk` / `codex-sdk` executors are optional and are not downloaded by the base OMK install. Install the matching SDK in the same local project or global npm prefix only when you select one; see [Executor prerequisites](docs/reference/executors.md#prerequisites).
|
|
48
|
+
Beta APIs and storage contracts may change. Knowledge stays in the explicitly selected workspace; execution evidence and machine preferences have their own storage scopes. Back up before upgrading, then establish new evidence through the migration guide.
|
|
145
49
|
|
|
146
50
|
## Security notice
|
|
147
51
|
|
|
148
|
-
|
|
149
|
-
|
|
150
|
-
| Feature | Risk | Scope |
|
|
151
|
-
|---|---|---|
|
|
152
|
-
| **Custom assertions** (`custom`) | dynamically loads and executes user-specified `.mjs` files | only use assertion files you authored or reviewed |
|
|
153
|
-
| **eval-samples.json** | assertion configs can reference external file paths | don't use sample files from untrusted sources |
|
|
154
|
-
|
|
155
|
-
**Recommendations:**
|
|
156
|
-
|
|
157
|
-
- Do not expose the local report server on the public internet (no auth)
|
|
158
|
-
- Don't use third-party eval-samples you haven't vetted
|
|
159
|
-
- Custom assertions have a 30-second timeout but no sandbox isolation
|
|
160
|
-
|
|
161
|
-
---
|
|
52
|
+
Use a trusted local environment. Tasks, verifiers, and custom assertions execute local code and should be reviewed first; workspace copies are not security sandboxes. Inspect the material before a model call: source records and artifacts may contain sensitive information. The local report server has no authentication and should not be exposed publicly.
|
|
162
53
|
|
|
163
|
-
See [GitHub Releases](https://github.com/lizhiyao/oh-my-knowledge/releases) for release notes
|
|
54
|
+
See [GitHub Releases](https://github.com/lizhiyao/oh-my-knowledge/releases) for release notes and [CONTRIBUTING](./CONTRIBUTING.md) for the contribution workflow.
|
package/README.zh.md
CHANGED
|
@@ -1,163 +1,54 @@
|
|
|
1
1
|
# OMK
|
|
2
2
|
|
|
3
|
-
[](https://www.npmjs.com/package/oh-my-knowledge)
|
|
3
|
+
[](https://www.npmjs.com/package/oh-my-knowledge?activeTab=versions)
|
|
5
4
|
[](https://github.com/lizhiyao/oh-my-knowledge/actions/workflows/ci.yml)
|
|
6
5
|
[](./LICENSE)
|
|
7
|
-
[](https://nodejs.org)
|
|
8
6
|
|
|
9
7
|
[English](./README.md) | **简体中文**
|
|
10
8
|
|
|
11
|
-
**Observe. Measure. Know.**
|
|
9
|
+
**Observe. Measure. Know.** 把工作中的经验,沉淀为可持续维护的知识。
|
|
12
10
|
|
|
13
|
-
OMK
|
|
11
|
+
OMK 面向 Agent 使用者和 AI 应用开发者。从真实工作记录中提炼候选,核对来源与适用条件,围绕对象持续积累和修订,再更新引用它们的 skill 或 prompt。需要判断改动效果时,可以独立开展受控版本比较。
|
|
14
12
|
|
|
15
|
-
|
|
13
|
+
## 从本地工作记录开始
|
|
16
14
|
|
|
17
|
-
|
|
18
|
-
|
|
19
|
-

|
|
20
|
-
|
|
21
|
-
## 选择使用方式
|
|
22
|
-
|
|
23
|
-
| 入口 | 适合什么场景 |
|
|
24
|
-
|---|---|
|
|
25
|
-
| **CLI** | 在终端、coding agent 或 CI 中执行检查、评测、观测与迭代工作流 |
|
|
26
|
-
| **Studio** | 在本地工作台浏览任务轨迹、复核知识内容,查看报告与原始证据 |
|
|
27
|
-
| **eval-runtime** | 通过 Node.js API 将执行、评分与版本比较嵌入自己的服务或平台;无需通过 CLI 或启动 Studio |
|
|
28
|
-
| **DSH 插件** | 在 DeepSeek Harness 内用 `/omk eval` 和 `/omk observe`,复用当前 profile 的模型、凭证、工具与 sandbox;见[宿主插件接入](docs/zh/reference/executors.md#deepseek-harness-优先使用宿主插件) |
|
|
29
|
-
|
|
30
|
-
## 从你的目标开始
|
|
31
|
-
|
|
32
|
-
| 想做什么 | 入口 | 得到什么 |
|
|
33
|
-
|---|---|---|
|
|
34
|
-
| 看清一次真实任务 | [Studio 与任务轨迹](docs/zh/guides/observe-production.md) | 对话、执行、结果、知识四条泳道,以及可核对的原始记录 |
|
|
35
|
-
| 把工作经验沉淀为知识 | [从日志提炼知识](docs/zh/guides/extract-knowledge.md) | 带来源和适用条件的候选知识,支持修订、保留和舍弃 |
|
|
36
|
-
| 记录已确认的知识问题 | [MCP 主动反馈](docs/zh/guides/mcp-integration.md) | 待复核 observation;确认真实问题后再草拟用例 |
|
|
37
|
-
| 判断一版改动是否值得采用 | [评测快速上手](docs/zh/quickstart-skill-eval.md) | 版本判定、不确定性、失败用例和评分依据 |
|
|
38
|
-
| 自动尝试改进 skill | [迭代改进](docs/zh/guides/auto-improve-skills.md) | 经受控比较筛选的候选版本 |
|
|
39
|
-
| 将评测接入服务或平台 | [Node.js 服务](docs/zh/guides/eval-runtime.md) · [平台宿主](docs/zh/guides/platform-host-integration.md) | 可组合的执行、评分与比较接口 |
|
|
40
|
-
|
|
41
|
-
## 快速开始
|
|
42
|
-
|
|
43
|
-
安装需要 Node.js >=22。调用模型前还需配置已认证的 runtime,详见[系统要求](#系统要求)。
|
|
15
|
+
需要 **Node.js ≥22**。本页的知识库、载体生成与变化核对需要 **1.0.0-beta.14 或更新版本**,使用 **`@next` 通道**;npm 的 `latest` 是另一条稳定通道。Beta.13 不包含这里的维护界面。旧版用户先阅读[迁移指南](docs/zh/guides/maintenance/v1-preview-migration.md)。
|
|
44
16
|
|
|
45
17
|
```bash
|
|
46
18
|
npm i -g oh-my-knowledge@next
|
|
47
|
-
|
|
48
|
-
|
|
49
|
-
### 先看已有任务
|
|
50
|
-
|
|
51
|
-
```bash
|
|
19
|
+
omk --version
|
|
52
20
|
omk studio
|
|
53
21
|
```
|
|
54
22
|
|
|
55
|
-
|
|
23
|
+
打开命令返回的本地地址,从已有 Codex 对话核对任务与原始记录。这一步不调用模型;没有对话时,Studio 提供来源与采集入口。其他日志来源按[观测指南](docs/zh/guides/observe/observe-production.md)接入。
|
|
56
24
|
|
|
57
|
-
|
|
25
|
+
接下来,在“知识 → 候选核对”选择会话和轮次,核对发送范围后提炼候选。**提炼会调用模型**,需先准备[已认证的运行时](docs/zh/reference/integration/executors.md#前置要求)。在知识库关联来源、修订过时内容,再明确生成和保存载体;载体详情可核对知识变化和新旧引用。完整步骤见[知识维护动线](docs/zh/guides/knowledge/extract-knowledge.md)。
|
|
58
26
|
|
|
59
|
-
|
|
27
|
+
## 知识变化,载体也需要核对
|
|
60
28
|
|
|
61
|
-
|
|
62
|
-
omk init demo
|
|
63
|
-
cd demo
|
|
64
|
-
omk eval --control code-review-v1 --treatment code-review-v2 --dry-run
|
|
65
|
-
```
|
|
29
|
+

|
|
66
30
|
|
|
67
|
-
|
|
31
|
+
在已有 SDK 维护案例中,旧说法限定为历史场景,一条不再适用的知识被舍弃,另一条补充了静态观察的范围。v4 保留三条旧引用并提示两项变化;v5 明确选择两条当前保留知识,旧版本正文与引用继续保留。[查看案例、来源和核对步骤](docs/zh/guides/knowledge/sdk-maintenance-case.md)。
|
|
68
32
|
|
|
69
|
-
|
|
70
|
-
omk eval --control code-review-v1 --treatment code-review-v2
|
|
71
|
-
```
|
|
33
|
+
这证明维护与引用链路可核对,没有验证 SDK 动态效果、节省时间或跨 Agent 复用收益。保留知识、保存载体、实际使用和验证效果分别记录;完整跨 Agent 自动管理与复用仍在建设中。
|
|
72
34
|
|
|
73
|
-
|
|
35
|
+
## 按当前任务继续
|
|
74
36
|
|
|
75
|
-
[
|
|
37
|
+
- **直接比较两版载体**:从[评测快速上手](docs/zh/quickstart-skill-eval.md)预览计划,配置运行时后再调用模型。固定模型与用例,记录运行条件,核对判定、不确定性和失败证据。
|
|
38
|
+
- **嵌入自己的服务**:从[离线 Node 示例](docs/zh/guides/integration/eval-runtime.md)开始,完成第一轮可回查的比较,再按需选择模型与配置。
|
|
39
|
+
- **在 Agent 或 DSH 中使用**:[安装官方 Skill](docs/zh/quickstart-skill-eval.md#在-agent-中使用)、[MCP 主动反馈](docs/zh/guides/integration/mcp-integration.md)和[DSH 宿主插件](docs/zh/reference/integration/executors.md#deepseek-harness-优先使用宿主插件)各有独立入口。
|
|
40
|
+
- **验收 Agent 修改的文件**:使用[本地任务验收](docs/zh/guides/evaluation/local-tasks.md)的独立检查;用[迭代改进](docs/zh/guides/evaluation/auto-improve-skills.md)筛选候选版本。
|
|
76
41
|
|
|
77
|
-
|
|
42
|
+
入门用例只检查流程,`UNDERPOWERED` 符合预期。真实发布判断需要自己的领域用例和独立证据;观测信号不能证明因果,一次评测通过也不等于载体已经生效或版本已发布。
|
|
78
43
|
|
|
79
|
-
|
|
44
|
+
## 查阅与升级
|
|
80
45
|
|
|
81
|
-
|
|
82
|
-
omk install omk-agent-skill
|
|
83
|
-
```
|
|
46
|
+
[文档入口](docs/zh/README.md) · [官网](https://oh-my-knowledge.pages.dev/zh/) · [CLI](docs/zh/reference/cli.md) · [运行时与执行器](docs/zh/reference/integration/executors.md) · [配置与环境变量](docs/zh/reference/shared/settings.md) · [示例](examples/README.zh.md)
|
|
84
47
|
|
|
85
|
-
|
|
86
|
-
|
|
87
|
-
[MCP 集成](docs/zh/guides/mcp-integration.md)提供用户授权的主动知识反馈入口。它仅记录提交到工具边界的部分证据,不自动监听完整对话。
|
|
88
|
-
|
|
89
|
-
### DeepSeek Harness 插件
|
|
90
|
-
|
|
91
|
-
已有 DSH 环境时,把 OMK 加入现有 profile。以支持命令适配的 `web` profile 为例:
|
|
92
|
-
|
|
93
|
-
```bash
|
|
94
|
-
dsh plugin --profile web add oh-my-knowledge
|
|
95
|
-
dsh --profile web
|
|
96
|
-
```
|
|
97
|
-
|
|
98
|
-
在 DSH 内执行:
|
|
99
|
-
|
|
100
|
-
```text
|
|
101
|
-
/omk eval eval.yaml
|
|
102
|
-
/omk observe
|
|
103
|
-
/omk observe <session-id>
|
|
104
|
-
```
|
|
105
|
-
|
|
106
|
-
评测复用当前宿主的模型、凭证、工具和 sandbox,并为每条用例创建隔离 session。观测读取已结束 session 的快照并返回 Studio 任务轨迹地址;目前不实时跟随正在运行的 DSH session。配置要求与插件当前限制见[DSH 接入](docs/zh/reference/executors.md#deepseek-harness-优先使用宿主插件)。
|
|
107
|
-
|
|
108
|
-
## 如何使用证据
|
|
109
|
-
|
|
110
|
-
知识内容是一条可复核的事实、经验或方法;知识载体是承载内容的 prompt、文档、skill 等。候选知识是内容的待复核状态,候选版本是拟采用的载体版本,两者不能混为一谈。
|
|
111
|
-
|
|
112
|
-
1. **观测与复核**:在 Studio 核对任务与来源;提炼知识或确认 observation,留下适用条件和处理理由。
|
|
113
|
-
2. **形成可测改动**:人工把需要采纳的内容落实到载体,把可复现的问题整理为正式用例;候选不会自动生效。
|
|
114
|
-
3. **受控比较**:`doctor` 做前置检查,`eval` 比较 control 与 treatment,检查 Decision、覆盖、失败样本与成本。
|
|
115
|
-
4. **采纳或继续改进**:受管 skill 可按证据 `promote`/`rollback`;`evolve` 通过 A/B 门禁筛选候选版本,写回前再次比较。
|
|
116
|
-
|
|
117
|
-
这是可组合的工作路径,不是强制的单向状态机。一次评测通过也不等于知识已写入或版本已发布。
|
|
118
|
-
|
|
119
|
-
结论受用例、评分准则和执行环境约束。观测信号不等于因果结论,生成的样本也不能直接充当独立发布验证集。原理与限制见[统计严谨性](docs/zh/explanation/statistical-rigor.md)和[三阶段工作流](docs/zh/explanation/three-stage-workflow.md)。
|
|
120
|
-
|
|
121
|
-
项目评测与观测证据保存在 `.omk/`,机器级状态位于 `~/.oh-my-knowledge/`;提炼的知识内容保存在显式选择的知识工作区。当前版本不读取或迁移旧存储布局;升级前备份,按[迁移指南](docs/zh/guides/v1-preview-migration.md)重新建立证据。
|
|
122
|
-
|
|
123
|
-
## 文档
|
|
124
|
-
|
|
125
|
-
[完整文档与导航](docs/zh/README.md) · [在线文档](https://oh-my-knowledge.pages.dev/zh/) · [CLI 参考](docs/zh/reference/cli.md) · [用例格式](docs/zh/reference/eval-sample-format.md) · [执行器](docs/zh/reference/executors.md) · [OMK 如何理解知识](docs/zh/explanation/knowledge.md)
|
|
126
|
-
|
|
127
|
-
## 环境变量
|
|
128
|
-
|
|
129
|
-
| 变量 | 说明 |
|
|
130
|
-
|------|------|
|
|
131
|
-
| `OMK_EXECUTOR` | 默认执行器偏好,例如 `codex` / `codex-sdk` / `claude` |
|
|
132
|
-
| `OMK_MODEL` | 默认被测模型;Codex 未设置时读取本机 `config.toml` |
|
|
133
|
-
| `OMK_JUDGE_MODELS` | 默认评委列表,格式 `executor:model[,...]` |
|
|
134
|
-
| `CCV_PROXY_URL` | 通过 cc-viewer 代理请求,实时可视化评测流量 |
|
|
135
|
-
| `OMK_REPORT_PORT` | 报告服务端口(默认 7799) |
|
|
136
|
-
|
|
137
|
-
## 系统要求
|
|
138
|
-
|
|
139
|
-
- Node.js >= 22
|
|
140
|
-
- 至少一个已认证的模型 runtime:
|
|
141
|
-
- Codex:安装并登录 Codex CLI(`npm i -g @openai/codex`);ChatGPT desktop 的 Codex 任务会自动选择它
|
|
142
|
-
- Claude:安装并登录 [Claude Code](https://claude.ai/code)
|
|
143
|
-
- API / 其它执行器:按[执行器文档](docs/zh/reference/executors.md)配置
|
|
144
|
-
- 高级 `claude-sdk`/`codex-sdk` 执行器是可选能力,OMK 基础安装不再下载它们。仅在明确选择对应 SDK 时,才在 OMK 所在的本地项目或全局 npm prefix 安装;详见[执行器前置要求](docs/zh/reference/executors.md#前置要求)。
|
|
48
|
+
Beta 接口和存储契约仍可能变化。知识在显式选定的工作区维护;运行证据与机器偏好各有自己的存储范围。升级前备份,再按迁移指南建立新证据。
|
|
145
49
|
|
|
146
50
|
## 安全说明
|
|
147
51
|
|
|
148
|
-
|
|
149
|
-
|
|
150
|
-
| 功能 | 风险 | 适用场景 |
|
|
151
|
-
|------|------|----------|
|
|
152
|
-
| **自定义断言**(`custom`) | 动态加载并执行用户指定的 `.mjs` 文件 | 仅使用自己编写或审查过的断言文件 |
|
|
153
|
-
| **eval-samples.json** | 断言配置可引用外部文件路径 | 不要使用来源不明的用例文件 |
|
|
154
|
-
|
|
155
|
-
**建议:**
|
|
156
|
-
|
|
157
|
-
- 不要将本地报告服务暴露到公网(无身份认证)
|
|
158
|
-
- 不使用未经审查的第三方 eval-samples
|
|
159
|
-
- 自定义断言有 30 秒超时,但无沙箱隔离
|
|
160
|
-
|
|
161
|
-
---
|
|
52
|
+
用于本地可信环境。任务、验收程序和自定义断言会执行本地代码,应先审查;工作区副本不是安全沙箱。调用模型前核对发送范围,原始记录与产物可能含敏感内容。本地报告服务没有身份认证,不应暴露到公网。
|
|
162
53
|
|
|
163
|
-
|
|
54
|
+
发布说明见 [GitHub Releases](https://github.com/lizhiyao/oh-my-knowledge/releases)。贡献流程见 [CONTRIBUTING](./CONTRIBUTING.md)。
|
|
@@ -4,7 +4,7 @@ description: |
|
|
|
4
4
|
OMK(Observe. Measure. Know.)让 AI 应用的知识改动有据可依。观测真实表现,受控测量 prompt / RAG / skill / agent / workflow 的版本差异,判断改动是否有效、版本能否发布,并支持自动迭代改进。
|
|
5
5
|
Use when: 用户提到"评测"、"测评"、"eval"、"benchmark"、"对比 skill"、"改进 skill"、"evolve"、"生成测试用例"、"gen-samples"、"知识反馈"、"feedback"、"omk"。
|
|
6
6
|
user-invocable: true
|
|
7
|
-
argument-hint: "<agents|doctor|eval|evolve|init|install|
|
|
7
|
+
argument-hint: "<agents|doctor|eval|evolve|init|install|observe|sample|studio> [options]"
|
|
8
8
|
---
|
|
9
9
|
|
|
10
10
|
# OMK — Observe. Measure. Know.
|
|
@@ -19,7 +19,7 @@ argument-hint: "<agents|doctor|eval|evolve|init|install|list|observe|promote|rol
|
|
|
19
19
|
2. 该显式调用本身视为用户确认。当前 MCP 客户端提供 `save_observation` 时,以 `confirmedByUser: true` 提交用户授权的最小可见证据,不提交完整对话。
|
|
20
20
|
3. 如果没有明确候选,或同时存在多个无法唯一判断的候选,只追问要记录哪一项;确认目标前不调用工具。
|
|
21
21
|
4. 如果当前客户端没有 `save_observation`,明确说明 OMK MCP 尚未连接;不要回退为 CLI 写文件,也不要声称已经保存。
|
|
22
|
-
5. 快捷入口只保存 observation,不自动复核、生成 sample
|
|
22
|
+
5. 快捷入口只保存 observation,不自动复核、生成 sample 或写入 gold set。
|
|
23
23
|
|
|
24
24
|
## 第一步:检查环境
|
|
25
25
|
|
|
@@ -29,7 +29,7 @@ argument-hint: "<agents|doctor|eval|evolve|init|install|list|observe|promote|rol
|
|
|
29
29
|
npm i -g oh-my-knowledge@next
|
|
30
30
|
```
|
|
31
31
|
|
|
32
|
-
omk CLI 顶层命令包括:`init` / `install` / `
|
|
32
|
+
omk CLI 顶层命令包括:`init` / `install` / `doctor` / `eval` / `observe` / `evolve` / `sample` / `studio`。没有 `bench` / `improve` / `gen-samples` 这些旧子命令名 —— 如果你在历史 SKILL / 文档里看到了,那是 v0.30 命令树重构之前的写法。
|
|
33
33
|
|
|
34
34
|
### 在 Codex / 支持 MCP 的客户端中
|
|
35
35
|
|
|
@@ -44,7 +44,7 @@ Codex 是 omk 的一等 runtime。运行在 Codex 任务中时,`omk eval` / `d
|
|
|
44
44
|
- 用户明确说「记录这个问题」「把刚才的失败存下来」时,才以 `confirmedByUser: true` 调用 `save_observation`;只提交用户授权的最小可见证据。
|
|
45
45
|
- 用户只是纠正答案、指出知识不足或遇到重复工具失败时,可以建议记录并请求确认;确认前不要调用 `save_observation`。这条启发式路径是 best-effort,不能声称覆盖全部对话。
|
|
46
46
|
- 普通追问、假设性例子、泛泛的不满意或没有明确知识缺口的反馈,不要记录 observation。
|
|
47
|
-
- 只有人工复核为 `real_issue` 后才能调用 `draft_sample_from_observation`;候选草稿不等于正式 eval sample
|
|
47
|
+
- 只有人工复核为 `real_issue` 后才能调用 `draft_sample_from_observation`;候选草稿不等于正式 eval sample,不要自动写入正式样本集。
|
|
48
48
|
- 需要对话内复核时,先 `get_observation`,再 `review_observation`。所有结果都按 `coverageStatus: partial` 解读,不推断未提交的上下文、其它工具调用或隐藏推理。
|
|
49
49
|
|
|
50
50
|
### 在 DeepSeek Harness 中
|
|
@@ -66,8 +66,6 @@ Codex 是 omk 的一等 runtime。运行在 Codex 任务中时,`omk eval` / `d
|
|
|
66
66
|
| 体检 skill 写法 | → `omk doctor` |
|
|
67
67
|
| 浏览对话、任务轨迹与报告 | → `omk studio`(启动本地知识工作台) |
|
|
68
68
|
| 看真实使用 trace | → `omk observe` |
|
|
69
|
-
| 查看受管 skill 状态 | → `omk list` |
|
|
70
|
-
| 按证据接受 / 回退某版本 | → `omk promote` / `omk rollback` |
|
|
71
69
|
|
|
72
70
|
如果用户意图不明确,先扫描当前项目结构(skills/ 目录、项目级 eval-samples 文件、目录 skill 私有 `.omk/eval-samples.*`),然后推荐最合适的操作。
|
|
73
71
|
|
|
@@ -205,7 +203,7 @@ Studio 首页直接索引本机 Codex 对话。先选择对话,再选择任务
|
|
|
205
203
|
2. **质量分数**:各 variant 的平均综合分(0-5 分)+ Δ + 95% CI
|
|
206
204
|
3. **成本对比**:token 消耗、execCostUSD、评委花费、diagnostic 花费
|
|
207
205
|
4. **低分样本**:哪些样本两个版本差异最大,rubric 期望 vs 实际差在哪
|
|
208
|
-
5. **下一步动作**:基于 verdict 给出动作;`PROGRESS`
|
|
206
|
+
5. **下一步动作**:基于 verdict 给出动作;`PROGRESS` 时明确说明可以进入发布流程、留存报告作为发布证据;其它 verdict 给出扩样 / 修复 / 重跑建议
|
|
209
207
|
|
|
210
208
|
示例输出:
|
|
211
209
|
|
|
@@ -214,7 +212,7 @@ v2 比 v1 更好(verdict: PROGRESS,Δ=+0.7,95% CI [+0.3, +1.1]):
|
|
|
214
212
|
- 质量:v2 平均 4.5 分 vs v1 平均 3.8 分(+18%)
|
|
215
213
|
- 成本:v2 略高($0.15 vs $0.12),因为输出更详细
|
|
216
214
|
- 亮点:v2 在 s002(错误处理)上显著提升(2.5 → 4.5),因为新增了"列出所有缺失的错误处理场景"指令
|
|
217
|
-
- 建议:v2
|
|
215
|
+
- 建议:v2 可以进入发布流程;留存本次报告作为发布证据。s003(XSS 检测)仍然可以作为下一轮优化点。
|
|
218
216
|
```
|
|
219
217
|
|
|
220
218
|
### evolve 模式
|