oh-my-knowledge 1.0.0-beta.12 → 1.0.0-beta.14

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (469) hide show
  1. package/README.md +23 -132
  2. package/README.zh.md +23 -132
  3. package/dist/assets/agent-skills/omk/SKILL.md +6 -8
  4. package/dist/assets/agent-skills/omk/references/commands.md +44 -128
  5. package/dist/cli/commands/eval/index.d.ts +0 -1
  6. package/dist/cli/commands/eval/index.js +0 -6
  7. package/dist/cli/commands/eval/task.d.ts +13 -0
  8. package/dist/cli/commands/eval/task.js +42 -0
  9. package/dist/cli/commands/evolve.js +5 -43
  10. package/dist/cli/commands/init.js +1 -1
  11. package/dist/cli/commands/install.d.ts +1 -1
  12. package/dist/cli/commands/install.js +25 -55
  13. package/dist/cli/commands/observe/index.d.ts +0 -1
  14. package/dist/cli/commands/observe/index.js +2 -60
  15. package/dist/cli/commands/observe/knowledge.d.ts +8 -0
  16. package/dist/cli/commands/observe/knowledge.js +58 -12
  17. package/dist/cli/commands/studio.js +2 -6
  18. package/dist/cli/lib/cell-format.d.ts +1 -5
  19. package/dist/cli/lib/cell-format.js +1 -5
  20. package/dist/cli/lib/i18n-dict/common.d.ts +1 -1
  21. package/dist/cli/lib/i18n-dict/common.js +0 -8
  22. package/dist/cli/lib/i18n-dict/evolve.d.ts +1 -1
  23. package/dist/cli/lib/i18n-dict/evolve.js +2 -6
  24. package/dist/cli/lib/i18n-dict/install.d.ts +1 -1
  25. package/dist/cli/lib/i18n-dict/install.js +2 -6
  26. package/dist/cli/lib/i18n-dict.d.ts +1 -4
  27. package/dist/cli/lib/i18n-dict.js +0 -6
  28. package/dist/cli/lib/prepare-evaluation.js +1 -1
  29. package/dist/cli/lib/resolve-skill-input.d.ts +0 -1
  30. package/dist/cli/lib/run-core-evaluation.js +0 -12
  31. package/dist/dsh-plugin/core-command.js +1 -8
  32. package/dist/dsh-plugin/index.js +0 -1
  33. package/dist/eval-core/analysis/bootstrap.d.ts +1 -1
  34. package/dist/eval-workflows/hosts/application.d.ts +4 -10
  35. package/dist/eval-workflows/hosts/application.js +2 -17
  36. package/dist/eval-workflows/hosts/carrier-measurement.d.ts +18 -0
  37. package/dist/eval-workflows/hosts/carrier-measurement.js +249 -0
  38. package/dist/eval-workflows/hosts/composition/evolution-evaluation.js +0 -1
  39. package/dist/eval-workflows/hosts/input-resolution/node-cli-evaluation-resolver.js +0 -1
  40. package/dist/eval-workflows/hosts/local-task/acceptance.d.ts +13 -0
  41. package/dist/eval-workflows/hosts/local-task/acceptance.js +101 -0
  42. package/dist/eval-workflows/hosts/local-task/application.d.ts +99 -0
  43. package/dist/eval-workflows/hosts/local-task/application.js +177 -0
  44. package/dist/eval-workflows/hosts/local-task/diagnostics.d.ts +27 -0
  45. package/dist/eval-workflows/hosts/local-task/diagnostics.js +30 -0
  46. package/dist/eval-workflows/hosts/local-task/executor.d.ts +19 -0
  47. package/dist/eval-workflows/hosts/local-task/executor.js +135 -0
  48. package/dist/eval-workflows/hosts/local-task/files.d.ts +15 -0
  49. package/dist/eval-workflows/hosts/local-task/files.js +88 -0
  50. package/dist/eval-workflows/hosts/local-task/workspace.d.ts +6 -0
  51. package/dist/eval-workflows/hosts/local-task/workspace.js +32 -0
  52. package/dist/{cli/lib/evaluation-composition.d.ts → eval-workflows/hosts/node-environment.d.ts} +1 -1
  53. package/dist/{cli/lib/evaluation-composition.js → eval-workflows/hosts/node-environment.js} +1 -1
  54. package/dist/eval-workflows/input-compilation/compile.js +0 -2
  55. package/dist/eval-workflows/input-compilation/parse.js +0 -6
  56. package/dist/eval-workflows/input-compilation/registry.d.ts +1 -1
  57. package/dist/eval-workflows/input-compilation/registry.js +0 -3
  58. package/dist/eval-workflows/input-compilation/types.d.ts +2 -4
  59. package/dist/eval-workflows/input-compilation/types.js +2 -2
  60. package/dist/eval-workflows/inputs/contracts/local-task-evidence.d.ts +46 -0
  61. package/dist/eval-workflows/inputs/contracts/local-task-evidence.js +26 -0
  62. package/dist/eval-workflows/inputs/contracts/local-task.d.ts +50 -0
  63. package/dist/eval-workflows/inputs/contracts/local-task.js +33 -0
  64. package/dist/eval-workflows/inputs/contracts/sample.d.ts +2 -2
  65. package/dist/eval-workflows/instruments/prompts/judge-prompts.js +1 -1
  66. package/dist/eval-workflows/orchestration/evaluation-service.d.ts +2 -0
  67. package/dist/eval-workflows/orchestration/evaluation-service.js +4 -0
  68. package/dist/eval-workflows/projections/carrier-measurement.d.ts +72 -0
  69. package/dist/eval-workflows/projections/contracts.d.ts +1 -46
  70. package/dist/eval-workflows/projections/contracts.js +0 -1
  71. package/dist/eval-workflows/projections/index.d.ts +0 -1
  72. package/dist/eval-workflows/projections/index.js +0 -1
  73. package/dist/eval-workflows/projections/local-task.d.ts +23 -0
  74. package/dist/eval-workflows/projections/local-task.js +25 -0
  75. package/dist/evidence/storage/directories.d.ts +2 -2
  76. package/dist/evidence/storage/directories.js +4 -4
  77. package/dist/evidence/storage/layout.d.ts +0 -2
  78. package/dist/evidence/storage/layout.js +0 -3
  79. package/dist/executors/openai/codex/protocol.js +1 -1
  80. package/dist/index.d.ts +1 -0
  81. package/dist/index.js +1 -0
  82. package/dist/knowledge/contracts.d.ts +4 -4
  83. package/dist/knowledge/entities/contracts.d.ts +327 -0
  84. package/dist/knowledge/entities/contracts.js +42 -0
  85. package/dist/knowledge/entities/history.d.ts +4 -0
  86. package/dist/knowledge/entities/history.js +61 -0
  87. package/dist/knowledge/entities/identity.d.ts +48 -0
  88. package/dist/knowledge/entities/identity.js +101 -0
  89. package/dist/knowledge/entities/validation.d.ts +6 -0
  90. package/dist/knowledge/entities/validation.js +62 -0
  91. package/dist/knowledge/history.js +1 -1
  92. package/dist/knowledge/library/contracts.d.ts +161 -0
  93. package/dist/knowledge/library/contracts.js +38 -0
  94. package/dist/knowledge/library/history.d.ts +3 -0
  95. package/dist/knowledge/library/history.js +46 -0
  96. package/dist/knowledge/store.d.ts +12 -4
  97. package/dist/knowledge/store.js +2 -1
  98. package/dist/knowledge/tags.d.ts +12 -0
  99. package/dist/knowledge/tags.js +6 -0
  100. package/dist/knowledge-artifacts/authoring/core-evolver.d.ts +0 -1
  101. package/dist/knowledge-artifacts/authoring/core-evolver.js +1 -1
  102. package/dist/knowledge-artifacts/authoring/knowledge-content.d.ts +19 -0
  103. package/dist/knowledge-artifacts/authoring/knowledge-content.js +151 -0
  104. package/dist/knowledge-artifacts/authoring/knowledge-review.d.ts +9 -0
  105. package/dist/knowledge-artifacts/authoring/knowledge-review.js +38 -0
  106. package/dist/knowledge-artifacts/authoring/library-contracts.d.ts +98 -0
  107. package/dist/knowledge-artifacts/authoring/library-contracts.js +1 -0
  108. package/dist/knowledge-artifacts/authoring/library.d.ts +18 -0
  109. package/dist/knowledge-artifacts/authoring/library.js +159 -0
  110. package/dist/knowledge-artifacts/doctor/messages.js +6 -6
  111. package/dist/knowledge-artifacts/doctor/rules.d.ts +1 -1
  112. package/dist/knowledge-artifacts/doctor/rules.js +1 -1
  113. package/dist/knowledge-artifacts/sources/artifact-resolution.js +2 -4
  114. package/dist/knowledge-artifacts/sources/content-hash.js +1 -1
  115. package/dist/knowledge-artifacts/sources/install-source.d.ts +4 -14
  116. package/dist/knowledge-artifacts/sources/install-source.js +6 -14
  117. package/dist/knowledge-artifacts/sources/materialize-copy.d.ts +1 -1
  118. package/dist/observability/analysis/gap-analyzer.d.ts +1 -1
  119. package/dist/observability/analysis/gap-analyzer.js +1 -1
  120. package/dist/observability/application.d.ts +9 -0
  121. package/dist/observability/application.js +6 -0
  122. package/dist/observability/contracts/experience-evidence-schema.d.ts +29 -29
  123. package/dist/observability/knowledge-extraction/adapters/entity-store.d.ts +12 -0
  124. package/dist/observability/knowledge-extraction/adapters/entity-store.js +94 -0
  125. package/dist/observability/knowledge-extraction/adapters/executor.js +2 -1
  126. package/dist/observability/knowledge-extraction/adapters/knowledge-store.d.ts +2 -1
  127. package/dist/observability/knowledge-extraction/adapters/knowledge-store.js +25 -12
  128. package/dist/observability/knowledge-extraction/adapters/knowledge-tags.d.ts +12 -0
  129. package/dist/observability/knowledge-extraction/adapters/knowledge-tags.js +67 -0
  130. package/dist/observability/knowledge-extraction/adapters/library-store.d.ts +11 -0
  131. package/dist/observability/knowledge-extraction/adapters/library-store.js +72 -0
  132. package/dist/observability/knowledge-extraction/adapters/run-store.d.ts +2 -1
  133. package/dist/observability/knowledge-extraction/adapters/run-store.js +26 -10
  134. package/dist/observability/knowledge-extraction/adapters/storage-state.d.ts +11 -0
  135. package/dist/observability/knowledge-extraction/adapters/storage-state.js +92 -0
  136. package/dist/observability/knowledge-extraction/application.d.ts +1309 -40
  137. package/dist/observability/knowledge-extraction/application.js +191 -22
  138. package/dist/observability/knowledge-extraction/auto-extraction.d.ts +140 -0
  139. package/dist/observability/knowledge-extraction/auto-extraction.js +316 -0
  140. package/dist/observability/knowledge-extraction/conversation-source.d.ts +41 -0
  141. package/dist/observability/knowledge-extraction/conversation-source.js +55 -0
  142. package/dist/observability/knowledge-extraction/entities.d.ts +65 -0
  143. package/dist/observability/knowledge-extraction/entities.js +123 -0
  144. package/dist/observability/knowledge-extraction/entity-catalog.d.ts +89 -0
  145. package/dist/observability/knowledge-extraction/entity-catalog.js +41 -0
  146. package/dist/observability/knowledge-extraction/library.d.ts +392 -0
  147. package/dist/observability/knowledge-extraction/library.js +197 -0
  148. package/dist/observability/knowledge-extraction/local.js +6 -2
  149. package/dist/observability/knowledge-extraction/prompt.d.ts +1 -1
  150. package/dist/observability/knowledge-extraction/prompt.js +35 -8
  151. package/dist/observability/knowledge-extraction/proposals.d.ts +15 -160
  152. package/dist/observability/knowledge-extraction/proposals.js +17 -51
  153. package/dist/observability/knowledge-extraction/quote-occurrence.d.ts +9 -0
  154. package/dist/observability/knowledge-extraction/quote-occurrence.js +31 -0
  155. package/dist/observability/knowledge-extraction/runs.d.ts +120 -6
  156. package/dist/observability/knowledge-extraction/runs.js +74 -2
  157. package/dist/observability/knowledge-extraction/window-proposals.d.ts +198 -0
  158. package/dist/observability/knowledge-extraction/window-proposals.js +88 -0
  159. package/dist/observability/skill-health/analyzer.d.ts +1 -2
  160. package/dist/observability/skill-health/analyzer.js +1 -2
  161. package/dist/observability/skill-health/persistence.d.ts +0 -8
  162. package/dist/observability/skill-health/persistence.js +0 -22
  163. package/dist/studio/application/conversations/conversation-extraction.d.ts +1 -41
  164. package/dist/studio/application/conversations/conversation-extraction.js +1 -53
  165. package/dist/studio/application/directory-sources.d.ts +1 -3
  166. package/dist/studio/application/directory-sources.js +0 -1
  167. package/dist/studio/application/display/conversation-label.d.ts +1 -1
  168. package/dist/studio/application/display/conversation-label.js +15 -2
  169. package/dist/studio/application/knowledge/artifact-authoring.d.ts +42 -0
  170. package/dist/studio/application/knowledge/artifact-authoring.js +85 -0
  171. package/dist/studio/application/knowledge/auto-extraction.d.ts +42 -0
  172. package/dist/studio/application/knowledge/auto-extraction.js +18 -0
  173. package/dist/studio/application/knowledge/candidate-review.d.ts +5 -0
  174. package/dist/studio/application/knowledge/candidate-review.js +20 -0
  175. package/dist/studio/application/knowledge/doctor-format.d.ts +1 -1
  176. package/dist/studio/application/knowledge/knowledge-candidates.js +44 -18
  177. package/dist/studio/application/knowledge/knowledge-library.d.ts +338 -0
  178. package/dist/studio/application/knowledge/knowledge-library.js +23 -0
  179. package/dist/studio/application/knowledge/library-view.d.ts +22 -0
  180. package/dist/studio/application/knowledge/library-view.js +7 -0
  181. package/dist/studio/application/measure/carrier-measurement.d.ts +20 -0
  182. package/dist/studio/application/measure/carrier-measurement.js +51 -0
  183. package/dist/studio/application/measure/core-run-format.d.ts +12 -1
  184. package/dist/studio/application/measure/core-run-format.js +71 -2
  185. package/dist/studio/application/measure/core-run-projection.js +12 -0
  186. package/dist/studio/http/contracts.d.ts +0 -2
  187. package/dist/studio/http/next-context.d.ts +0 -2
  188. package/dist/studio/http/next-context.js +0 -1
  189. package/dist/studio/http/next-server.js +12 -32
  190. package/dist/studio/http/page-paths.d.ts +2 -2
  191. package/dist/studio/http/page-paths.js +2 -2
  192. package/dist/studio/http/pages/knowledge-page.d.ts +1 -1
  193. package/dist/studio/http/pages/knowledge-page.js +3 -3
  194. package/dist/studio/http/pages/measure-page.d.ts +3 -2
  195. package/dist/studio/http/pages/measure-page.js +5 -3
  196. package/dist/studio/http/request-handler.d.ts +1 -1
  197. package/dist/studio/http/request-handler.js +19 -6
  198. package/dist/studio/http/routes/artifact-authoring.d.ts +1 -0
  199. package/dist/studio/http/routes/artifact-authoring.js +34 -0
  200. package/dist/studio/http/routes/carrier-measurement.d.ts +8 -0
  201. package/dist/studio/http/routes/carrier-measurement.js +34 -0
  202. package/dist/studio/http/routes/knowledge-candidates.d.ts +2 -2
  203. package/dist/studio/http/routes/knowledge-candidates.js +41 -31
  204. package/dist/studio/http/routes/knowledge.d.ts +1 -2
  205. package/dist/studio/http/routes/knowledge.js +1 -14
  206. package/dist/studio/view-models/display/tone.d.ts +1 -2
  207. package/dist/studio/view-models/knowledge/artifact-authoring.d.ts +2 -0
  208. package/dist/studio/view-models/knowledge/artifact-authoring.js +1 -0
  209. package/dist/studio/view-models/knowledge/knowledge-candidates.d.ts +55 -12
  210. package/dist/studio/view-models/knowledge/knowledge-library.d.ts +4 -0
  211. package/dist/studio/view-models/knowledge/knowledge-library.js +1 -0
  212. package/dist/studio/view-models/measure/carrier-measurement.d.ts +1 -0
  213. package/dist/studio/view-models/measure/carrier-measurement.js +1 -0
  214. package/dist/studio/view-models/measure/core-runs.d.ts +38 -0
  215. package/dist/studio/web/.next/BUILD_ID +1 -1
  216. package/dist/studio/web/.next/app-path-routes-manifest.json +2 -2
  217. package/dist/studio/web/.next/build-manifest.json +5 -5
  218. package/dist/studio/web/.next/next-minimal-server.js.nft.json +1 -1
  219. package/dist/studio/web/.next/next-server.js.nft.json +1 -1
  220. package/dist/studio/web/.next/prerender-manifest.json +4 -4
  221. package/dist/studio/web/.next/required-server-files.js +16 -1
  222. package/dist/studio/web/.next/required-server-files.json +16 -1
  223. package/dist/studio/web/.next/routes-manifest.json +9 -11
  224. package/dist/studio/web/.next/server/app/_global-error/page.js +2 -2
  225. package/dist/studio/web/.next/server/app/_global-error/page.js.nft.json +1 -1
  226. package/dist/studio/web/.next/server/app/_global-error/page_client-reference-manifest.js +1 -1
  227. package/dist/studio/web/.next/server/app/_global-error.html +1 -1
  228. package/dist/studio/web/.next/server/app/_global-error.meta +8 -0
  229. package/dist/studio/web/.next/server/app/_global-error.rsc +30 -18
  230. package/dist/studio/web/.next/server/app/_global-error.segments/_full.segment.rsc +30 -18
  231. package/dist/studio/web/.next/server/app/_global-error.segments/_global-error/__PAGE__.segment.rsc +36 -24
  232. package/dist/studio/web/.next/server/app/_global-error.segments/_tree.segment.rsc +3 -1
  233. package/dist/studio/web/.next/server/app/_not-found/page.js +1 -1
  234. package/dist/studio/web/.next/server/app/_not-found/page.js.nft.json +1 -1
  235. package/dist/studio/web/.next/server/app/_not-found/page_client-reference-manifest.js +1 -1
  236. package/dist/studio/web/.next/server/app/agents/page.js +1 -1
  237. package/dist/studio/web/.next/server/app/agents/page.js.nft.json +1 -1
  238. package/dist/studio/web/.next/server/app/agents/page_client-reference-manifest.js +1 -1
  239. package/dist/studio/web/.next/server/app/knowledge/candidates/page.js +1 -1
  240. package/dist/studio/web/.next/server/app/knowledge/candidates/page.js.nft.json +1 -1
  241. package/dist/studio/web/.next/server/app/knowledge/candidates/page_client-reference-manifest.js +1 -1
  242. package/dist/studio/web/.next/server/app/knowledge/entities/page.js +1 -0
  243. package/dist/studio/web/.next/server/app/knowledge/entities/page.js.nft.json +1 -0
  244. package/dist/studio/web/.next/server/app/knowledge/entities/page_client-reference-manifest.js +1 -0
  245. package/dist/studio/web/.next/server/app/knowledge/library/page.js +1 -0
  246. package/dist/studio/web/.next/server/app/knowledge/library/page.js.nft.json +1 -0
  247. package/dist/studio/web/.next/server/app/knowledge/library/page_client-reference-manifest.js +1 -0
  248. package/dist/studio/web/.next/server/app/knowledge/page.js +1 -1
  249. package/dist/studio/web/.next/server/app/knowledge/page.js.nft.json +1 -1
  250. package/dist/studio/web/.next/server/app/knowledge/page_client-reference-manifest.js +1 -1
  251. package/dist/studio/web/.next/server/app/knowledge/skills/[skillName]/page.js +1 -1
  252. package/dist/studio/web/.next/server/app/knowledge/skills/[skillName]/page.js.nft.json +1 -1
  253. package/dist/studio/web/.next/server/app/knowledge/skills/[skillName]/page_client-reference-manifest.js +1 -1
  254. package/dist/studio/web/.next/server/app/measure/[runId]/page.js +1 -1
  255. package/dist/studio/web/.next/server/app/measure/[runId]/page.js.nft.json +1 -1
  256. package/dist/studio/web/.next/server/app/measure/[runId]/page_client-reference-manifest.js +1 -1
  257. package/dist/studio/web/.next/server/app/measure/page.js +1 -1
  258. package/dist/studio/web/.next/server/app/measure/page.js.nft.json +1 -1
  259. package/dist/studio/web/.next/server/app/measure/page_client-reference-manifest.js +1 -1
  260. package/dist/studio/web/.next/server/app/observe/conversations/[threadId]/page.js +1 -1
  261. package/dist/studio/web/.next/server/app/observe/conversations/[threadId]/page.js.nft.json +1 -1
  262. package/dist/studio/web/.next/server/app/observe/conversations/[threadId]/page_client-reference-manifest.js +1 -1
  263. package/dist/studio/web/.next/server/app/observe/conversations/[threadId]/tasks/[turnId]/page.js +1 -1
  264. package/dist/studio/web/.next/server/app/observe/conversations/[threadId]/tasks/[turnId]/page.js.nft.json +1 -1
  265. package/dist/studio/web/.next/server/app/observe/conversations/[threadId]/tasks/[turnId]/page_client-reference-manifest.js +1 -1
  266. package/dist/studio/web/.next/server/app/observe/health/[analysisId]/page.js +1 -1
  267. package/dist/studio/web/.next/server/app/observe/health/[analysisId]/page.js.nft.json +1 -1
  268. package/dist/studio/web/.next/server/app/observe/health/[analysisId]/page_client-reference-manifest.js +1 -1
  269. package/dist/studio/web/.next/server/app/observe/health/page.js +1 -1
  270. package/dist/studio/web/.next/server/app/observe/health/page.js.nft.json +1 -1
  271. package/dist/studio/web/.next/server/app/observe/health/page_client-reference-manifest.js +1 -1
  272. package/dist/studio/web/.next/server/app/observe/health-diff/page.js +1 -1
  273. package/dist/studio/web/.next/server/app/observe/health-diff/page.js.nft.json +1 -1
  274. package/dist/studio/web/.next/server/app/observe/health-diff/page_client-reference-manifest.js +1 -1
  275. package/dist/studio/web/.next/server/app/observe/inbox/page.js +2 -2
  276. package/dist/studio/web/.next/server/app/observe/inbox/page.js.nft.json +1 -1
  277. package/dist/studio/web/.next/server/app/observe/inbox/page_client-reference-manifest.js +1 -1
  278. package/dist/studio/web/.next/server/app/observe/page.js +1 -1
  279. package/dist/studio/web/.next/server/app/observe/page.js.nft.json +1 -1
  280. package/dist/studio/web/.next/server/app/observe/page_client-reference-manifest.js +1 -1
  281. package/dist/studio/web/.next/server/app/observe/skill-trend/[skillName]/page.js +1 -1
  282. package/dist/studio/web/.next/server/app/observe/skill-trend/[skillName]/page.js.nft.json +1 -1
  283. package/dist/studio/web/.next/server/app/observe/skill-trend/[skillName]/page_client-reference-manifest.js +1 -1
  284. package/dist/studio/web/.next/server/app-paths-manifest.json +2 -2
  285. package/dist/studio/web/.next/server/chunks/132.js +1 -0
  286. package/dist/studio/web/.next/server/chunks/272.js +1 -0
  287. package/dist/studio/web/.next/server/chunks/{374.js → 285.js} +2 -2
  288. package/dist/studio/web/.next/server/chunks/312.js +1 -0
  289. package/dist/studio/web/.next/server/chunks/33.js +1 -0
  290. package/dist/studio/web/.next/server/chunks/335.js +2 -14
  291. package/dist/studio/web/.next/server/chunks/{584.js → 34.js} +5 -2
  292. package/dist/studio/web/.next/server/chunks/388.js +1 -1
  293. package/dist/studio/web/.next/server/chunks/464.js +2 -2
  294. package/dist/studio/web/.next/server/chunks/499.js +1 -1
  295. package/dist/studio/web/.next/server/chunks/562.js +1 -0
  296. package/dist/studio/web/.next/server/chunks/57.js +10 -0
  297. package/dist/studio/web/.next/server/chunks/671.js +1 -0
  298. package/dist/studio/web/.next/server/chunks/757.js +4 -0
  299. package/dist/studio/web/.next/server/chunks/772.js +1 -1
  300. package/dist/studio/web/.next/server/chunks/777.js +1 -0
  301. package/dist/studio/web/.next/server/chunks/78.js +1 -0
  302. package/dist/studio/web/.next/server/chunks/793.js +907 -0
  303. package/dist/studio/web/.next/server/chunks/803.js +1 -0
  304. package/dist/studio/web/.next/server/chunks/811.js +1 -0
  305. package/dist/studio/web/.next/server/chunks/84.js +3 -3
  306. package/dist/studio/web/.next/server/chunks/{767.js → 845.js} +1 -1
  307. package/dist/studio/web/.next/server/chunks/949.js +55 -0
  308. package/dist/studio/web/.next/server/chunks/987.js +1 -0
  309. package/dist/studio/web/.next/server/middleware-build-manifest.js +1 -1
  310. package/dist/studio/web/.next/server/pages/500.html +1 -1
  311. package/dist/studio/web/.next/server/preview-props.json +5 -0
  312. package/dist/studio/web/.next/server/server-reference-manifest.json +1 -1
  313. package/dist/studio/web/.next/server/webpack-runtime.js +1 -1
  314. package/dist/studio/web/.next/static/chunks/0937d497-cb7a9ff884a082ab.js +1 -0
  315. package/dist/studio/web/.next/static/chunks/1550-8655e6e988ed925d.js +55 -0
  316. package/dist/studio/web/.next/static/chunks/1858-ae2f35e65c0ca7d5.js +52 -0
  317. package/dist/studio/web/.next/static/chunks/2038-39b8b64415693d72.js +1 -0
  318. package/dist/studio/web/.next/static/chunks/2192-3a82fac42d5470cb.js +16 -0
  319. package/dist/studio/web/.next/static/chunks/{285-6d4538bae9d2657f.js → 285-6bae73aced9b94d9.js} +4 -4
  320. package/dist/studio/web/.next/static/chunks/2953-ecd3f863c308edd6.js +41 -0
  321. package/dist/studio/web/.next/static/chunks/3435-00b4fbf4aa14a9af.js +1 -0
  322. package/dist/studio/web/.next/static/chunks/3958-1fa29558b4d99167.js +1 -0
  323. package/dist/studio/web/.next/static/chunks/3978-415a489ab1667812.js +1 -0
  324. package/dist/studio/web/.next/static/chunks/4-efa96fd3354dd00f.js +1 -0
  325. package/dist/studio/web/.next/static/chunks/5014-d863a9f62fbce3d9.js +1 -0
  326. package/dist/studio/web/.next/static/chunks/5382-1b919cde624bb761.js +1 -0
  327. package/dist/studio/web/.next/static/chunks/5669-c7c2d55e48ca0654.js +4 -0
  328. package/dist/studio/web/.next/static/chunks/5686-889bc419951f97b0.js +10 -0
  329. package/dist/studio/web/.next/static/chunks/5834-8ae3cace4e65870b.js +1 -0
  330. package/dist/studio/web/.next/static/chunks/7095-82772c89aecce311.js +19 -0
  331. package/dist/studio/web/.next/static/chunks/7103-1245dcb14501dcbe.js +1 -0
  332. package/dist/studio/web/.next/static/chunks/7703-3f2eeb40539b244a.js +1 -0
  333. package/dist/studio/web/.next/static/chunks/7754-4a1e255edea968a8.js +4 -0
  334. package/dist/studio/web/.next/static/chunks/{7576-c700fccfc712c394.js → 7936-1fe24cff93665d92.js} +9 -9
  335. package/dist/studio/web/.next/static/chunks/7956-961871b7f06d5154.js +6 -0
  336. package/dist/studio/web/.next/static/chunks/8284-61d4bd3af6cde82f.js +1 -0
  337. package/dist/studio/web/.next/static/chunks/8704-6257f6e867d6298a.js +10 -0
  338. package/dist/studio/web/.next/static/chunks/{8791-628c2e7b0dab299a.js → 8791-cc9640eb97b0ac98.js} +1 -1
  339. package/dist/studio/web/.next/static/chunks/8908-d585f523c5616336.js +1 -0
  340. package/dist/studio/web/.next/static/chunks/9066-417bfe2622f7c6c6.js +1 -0
  341. package/dist/studio/web/.next/static/chunks/9688-8fc2ea8f15ab0642.js +1 -0
  342. package/dist/studio/web/.next/static/chunks/9978-2b5578a391a0f389.js +9 -0
  343. package/dist/studio/web/.next/static/chunks/app/agents/page-ccd392fdc4feb767.js +1 -0
  344. package/dist/studio/web/.next/static/chunks/app/{error-66775c241a4b5db1.js → error-b4cdd259571bfddc.js} +1 -1
  345. package/dist/studio/web/.next/static/chunks/app/knowledge/candidates/page-87818ef4fbceab6a.js +1 -0
  346. package/dist/studio/web/.next/static/chunks/app/knowledge/entities/page-685a1b293b46298d.js +1 -0
  347. package/dist/studio/web/.next/static/chunks/app/knowledge/library/page-fd56dc775a86e423.js +1 -0
  348. package/dist/studio/web/.next/static/chunks/app/knowledge/page-d81f232d6f4b4a9c.js +1 -0
  349. package/dist/studio/web/.next/static/chunks/app/knowledge/skills/[skillName]/page-e55ee423ad3af267.js +1 -0
  350. package/dist/studio/web/.next/static/chunks/app/layout-33179810f5d93c07.js +1 -0
  351. package/dist/studio/web/.next/static/chunks/app/{loading-cc65be1028090c98.js → loading-5eff71aa13fa6fdb.js} +1 -1
  352. package/dist/studio/web/.next/static/chunks/app/measure/[runId]/page-68897c54cc7e35a9.js +1 -0
  353. package/dist/studio/web/.next/static/chunks/app/measure/page-a867aa25d5970346.js +1 -0
  354. package/dist/studio/web/.next/static/chunks/app/{not-found-bcac3c26cbb1b3ed.js → not-found-42b8668344a5414a.js} +1 -1
  355. package/dist/studio/web/.next/static/chunks/app/observe/conversations/[threadId]/page-62e3f9d8baf73de3.js +1 -0
  356. package/dist/studio/web/.next/static/chunks/app/observe/conversations/[threadId]/tasks/[turnId]/page-b9e50731b2d36271.js +1 -0
  357. package/dist/studio/web/.next/static/chunks/app/observe/health/[analysisId]/page-b4533c8059fa01e6.js +1 -0
  358. package/dist/studio/web/.next/static/chunks/app/observe/health/page-c2b2ba39a7cb1f6f.js +1 -0
  359. package/dist/studio/web/.next/static/chunks/app/observe/health-diff/page-3ee1e330242c46c3.js +1 -0
  360. package/dist/studio/web/.next/static/chunks/app/observe/inbox/page-fe295ccd0fa2cb10.js +1 -0
  361. package/dist/studio/web/.next/static/chunks/app/observe/page-8f4dec4a52794fae.js +1 -0
  362. package/dist/studio/web/.next/static/chunks/app/observe/skill-trend/[skillName]/page-be013760e79d259a.js +1 -0
  363. package/dist/studio/web/.next/static/chunks/framework-ba3537adc78ec474.js +1 -0
  364. package/dist/studio/web/.next/static/chunks/main-66b6ab45aa0fce29.js +5 -0
  365. package/dist/studio/web/.next/static/chunks/webpack-ac24233801701b11.js +1 -0
  366. package/dist/studio/web/.next/static/css/43b8660429d21bfd.css +1 -0
  367. package/dist/studio/web/.next/static/vi-Wf9wVz6KtDrndi6cz6/_buildManifest.js +1 -0
  368. package/dist/studio/web/.next/trace +92 -42
  369. package/dist/studio/web/.next/trace-build +1 -1
  370. package/package.json +7 -5
  371. package/dist/cli/commands/list.d.ts +0 -26
  372. package/dist/cli/commands/list.js +0 -121
  373. package/dist/cli/commands/promote.d.ts +0 -24
  374. package/dist/cli/commands/promote.js +0 -141
  375. package/dist/cli/commands/rollback.d.ts +0 -20
  376. package/dist/cli/commands/rollback.js +0 -87
  377. package/dist/cli/lib/actor.d.ts +0 -2
  378. package/dist/cli/lib/actor.js +0 -13
  379. package/dist/cli/lib/i18n-dict/list.d.ts +0 -3
  380. package/dist/cli/lib/i18n-dict/list.js +0 -40
  381. package/dist/cli/lib/i18n-dict/promote.d.ts +0 -3
  382. package/dist/cli/lib/i18n-dict/promote.js +0 -46
  383. package/dist/cli/lib/i18n-dict/rollback.d.ts +0 -3
  384. package/dist/cli/lib/i18n-dict/rollback.js +0 -22
  385. package/dist/eval-workflows/projections/managed.d.ts +0 -8
  386. package/dist/eval-workflows/projections/managed.js +0 -105
  387. package/dist/knowledge-artifacts/governance/contracts.d.ts +0 -158
  388. package/dist/knowledge-artifacts/governance/evidence.d.ts +0 -25
  389. package/dist/knowledge-artifacts/governance/evidence.js +0 -111
  390. package/dist/knowledge-artifacts/governance/evolve-outcome.d.ts +0 -16
  391. package/dist/knowledge-artifacts/governance/evolve-outcome.js +0 -41
  392. package/dist/knowledge-artifacts/governance/index.d.ts +0 -11
  393. package/dist/knowledge-artifacts/governance/index.js +0 -11
  394. package/dist/knowledge-artifacts/governance/install.d.ts +0 -29
  395. package/dist/knowledge-artifacts/governance/install.js +0 -63
  396. package/dist/knowledge-artifacts/governance/list-query.d.ts +0 -7
  397. package/dist/knowledge-artifacts/governance/list-query.js +0 -11
  398. package/dist/knowledge-artifacts/governance/list-view.d.ts +0 -67
  399. package/dist/knowledge-artifacts/governance/list-view.js +0 -77
  400. package/dist/knowledge-artifacts/governance/observe-feedback.d.ts +0 -73
  401. package/dist/knowledge-artifacts/governance/observe-feedback.js +0 -59
  402. package/dist/knowledge-artifacts/governance/promote-gate.d.ts +0 -34
  403. package/dist/knowledge-artifacts/governance/promote-gate.js +0 -32
  404. package/dist/knowledge-artifacts/governance/source-probe.d.ts +0 -15
  405. package/dist/knowledge-artifacts/governance/source-probe.js +0 -129
  406. package/dist/knowledge-artifacts/governance/store.d.ts +0 -145
  407. package/dist/knowledge-artifacts/governance/store.js +0 -594
  408. package/dist/studio/application/knowledge/managed-format.d.ts +0 -58
  409. package/dist/studio/application/knowledge/managed-format.js +0 -113
  410. package/dist/studio/http/managed-root.d.ts +0 -12
  411. package/dist/studio/http/managed-root.js +0 -19
  412. package/dist/studio/http/pages/managed-page.d.ts +0 -30
  413. package/dist/studio/http/pages/managed-page.js +0 -44
  414. package/dist/studio/web/.next/server/app/knowledge/managed/[managedId]/page.js +0 -1
  415. package/dist/studio/web/.next/server/app/knowledge/managed/[managedId]/page.js.nft.json +0 -1
  416. package/dist/studio/web/.next/server/app/knowledge/managed/[managedId]/page_client-reference-manifest.js +0 -1
  417. package/dist/studio/web/.next/server/app/knowledge/managed/page.js +0 -1
  418. package/dist/studio/web/.next/server/app/knowledge/managed/page.js.nft.json +0 -1
  419. package/dist/studio/web/.next/server/app/knowledge/managed/page_client-reference-manifest.js +0 -1
  420. package/dist/studio/web/.next/server/chunks/209.js +0 -1
  421. package/dist/studio/web/.next/server/chunks/3.js +0 -2
  422. package/dist/studio/web/.next/server/chunks/384.js +0 -1
  423. package/dist/studio/web/.next/server/chunks/42.js +0 -1
  424. package/dist/studio/web/.next/server/chunks/475.js +0 -1
  425. package/dist/studio/web/.next/server/chunks/827.js +0 -583
  426. package/dist/studio/web/.next/server/chunks/881.js +0 -1
  427. package/dist/studio/web/.next/server/chunks/955.js +0 -1
  428. package/dist/studio/web/.next/static/chunks/0937d497-e4b3c577da4da67b.js +0 -1
  429. package/dist/studio/web/.next/static/chunks/1858-c24dcd678cdcae50.js +0 -52
  430. package/dist/studio/web/.next/static/chunks/2038-fe4b8b7ee5f7cd19.js +0 -1
  431. package/dist/studio/web/.next/static/chunks/258-9e85d3d73100f7d7.js +0 -10
  432. package/dist/studio/web/.next/static/chunks/2666-2770e8e4b4caab0e.js +0 -4
  433. package/dist/studio/web/.next/static/chunks/2953-a2797c8e2c97e052.js +0 -53
  434. package/dist/studio/web/.next/static/chunks/4684-f60cec1af16cc02a.js +0 -1
  435. package/dist/studio/web/.next/static/chunks/5834-4a1f3c2c259a1918.js +0 -1
  436. package/dist/studio/web/.next/static/chunks/6250-1c80598e5a04a823.js +0 -2
  437. package/dist/studio/web/.next/static/chunks/6651-3212253f7d2d141f.js +0 -16
  438. package/dist/studio/web/.next/static/chunks/6698-fe3dadb4c5aa013d.js +0 -9
  439. package/dist/studio/web/.next/static/chunks/8038-9d97f8fe79c7f7d4.js +0 -6
  440. package/dist/studio/web/.next/static/chunks/8284-dca5d2249647425f.js +0 -1
  441. package/dist/studio/web/.next/static/chunks/900-afd29ea08f2e1714.js +0 -1
  442. package/dist/studio/web/.next/static/chunks/9386-d62507b1afffde3c.js +0 -1
  443. package/dist/studio/web/.next/static/chunks/9688-568cb3f8978b37e8.js +0 -1
  444. package/dist/studio/web/.next/static/chunks/9804-2d943d62c12ddbd6.js +0 -16
  445. package/dist/studio/web/.next/static/chunks/9953-e991c2f9674aeb7b.js +0 -1
  446. package/dist/studio/web/.next/static/chunks/app/agents/page-3cd33e679bd540fb.js +0 -1
  447. package/dist/studio/web/.next/static/chunks/app/knowledge/candidates/page-4202293fa248f263.js +0 -1
  448. package/dist/studio/web/.next/static/chunks/app/knowledge/managed/[managedId]/page-9f18fce00bf621dc.js +0 -1
  449. package/dist/studio/web/.next/static/chunks/app/knowledge/managed/page-4e9b40acd4e5130b.js +0 -1
  450. package/dist/studio/web/.next/static/chunks/app/knowledge/page-673896d1f93ec57d.js +0 -1
  451. package/dist/studio/web/.next/static/chunks/app/knowledge/skills/[skillName]/page-28c63ecbe6a8d515.js +0 -1
  452. package/dist/studio/web/.next/static/chunks/app/layout-26d16d7c66539fc1.js +0 -1
  453. package/dist/studio/web/.next/static/chunks/app/measure/[runId]/page-f6b816f8eb408bb9.js +0 -1
  454. package/dist/studio/web/.next/static/chunks/app/measure/page-8d42458a7c786a5a.js +0 -1
  455. package/dist/studio/web/.next/static/chunks/app/observe/conversations/[threadId]/page-ebc25fa3c7ad85c3.js +0 -1
  456. package/dist/studio/web/.next/static/chunks/app/observe/conversations/[threadId]/tasks/[turnId]/page-2602b9d82e415bfc.js +0 -1
  457. package/dist/studio/web/.next/static/chunks/app/observe/health/[analysisId]/page-b32cc1278399d1a0.js +0 -1
  458. package/dist/studio/web/.next/static/chunks/app/observe/health/page-3d8f7c136a55c349.js +0 -1
  459. package/dist/studio/web/.next/static/chunks/app/observe/health-diff/page-3ca3d158cd147ef5.js +0 -1
  460. package/dist/studio/web/.next/static/chunks/app/observe/inbox/page-5003e5561490047b.js +0 -1
  461. package/dist/studio/web/.next/static/chunks/app/observe/page-4a9a6d1984a94eff.js +0 -1
  462. package/dist/studio/web/.next/static/chunks/app/observe/skill-trend/[skillName]/page-1a9d9d1ac593f16d.js +0 -1
  463. package/dist/studio/web/.next/static/chunks/framework-9d2daf55218bfcdb.js +0 -1
  464. package/dist/studio/web/.next/static/chunks/main-c9db6abe2bb89249.js +0 -5
  465. package/dist/studio/web/.next/static/chunks/webpack-040077c7c5b63775.js +0 -1
  466. package/dist/studio/web/.next/static/css/b1a43ef7dccd6013.css +0 -1
  467. package/dist/studio/web/.next/static/d2gceAJH4KOAP1AWstMW0/_buildManifest.js +0 -1
  468. /package/dist/{knowledge-artifacts/governance/contracts.js → eval-workflows/projections/carrier-measurement.js} +0 -0
  469. /package/dist/studio/web/.next/static/{d2gceAJH4KOAP1AWstMW0 → vi-Wf9wVz6KtDrndi6cz6}/_ssgManifest.js +0 -0
package/README.md CHANGED
@@ -1,163 +1,54 @@
1
1
  # OMK
2
2
 
3
- [![npm version](https://img.shields.io/npm/v/oh-my-knowledge.svg)](https://www.npmjs.com/package/oh-my-knowledge)
4
- [![npm weekly downloads](https://img.shields.io/npm/dw/oh-my-knowledge.svg)](https://www.npmjs.com/package/oh-my-knowledge)
3
+ [![Beta @next](https://img.shields.io/npm/v/oh-my-knowledge/next.svg?label=Beta)](https://www.npmjs.com/package/oh-my-knowledge?activeTab=versions)
5
4
  [![CI](https://github.com/lizhiyao/oh-my-knowledge/actions/workflows/ci.yml/badge.svg)](https://github.com/lizhiyao/oh-my-knowledge/actions/workflows/ci.yml)
6
5
  [![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](./LICENSE)
7
- [![Node.js Version](https://img.shields.io/node/v/oh-my-knowledge.svg)](https://nodejs.org)
8
6
 
9
7
  **English** | [简体中文](./README.zh.md)
10
8
 
11
- **Observe. Measure. Know.** Make knowledge changes in your AI application evidence-backed.
9
+ **Observe. Measure. Know.** Turn working experience into knowledge you can keep maintaining.
12
10
 
13
- OMK is a toolkit for observing, evaluating, and improving knowledge in AI applications. Inspect how real tasks ran, extract reviewable knowledge items from work logs, and measure changes to prompts, RAG, skills, agents, or workflows to inform adoption, rollback, and further improvement.
11
+ OMK is for agent users and AI application developers. Extract candidates from real work, review sources and conditions, accumulate and revise knowledge around objects, then update the skills or prompts that reference it. When you need evidence about a change, compare artifact versions under controlled conditions independently.
14
12
 
15
- **Observe** preserves real behavior and its sources. **Measure** compares knowledge artifacts with the same model, cases, and execution conditions. **Know** connects decisions back to evidence. If you already have two artifact versions, start directly with evaluation; logs are not a prerequisite.
13
+ ## Start with local work records
16
14
 
17
- Version 1.0 is still **in Beta iteration**; APIs and storage contracts may change. Read the [migration guide](docs/guides/v1-preview-migration.md) before upgrading an older installation.
18
-
19
- ![OMK: from controlled evaluation to real-world feedback](./docs/public/omk-knowledge-flow-en-animated.gif)
20
-
21
- ## Choose how to use OMK
22
-
23
- | Interface | Use it for |
24
- |---|---|
25
- | **CLI** | Run checks, evaluations, observation, and improvement workflows from a terminal, coding agent, or CI |
26
- | **Studio** | Browse task trajectories, review knowledge items, and inspect reports and source evidence in a local workbench |
27
- | **eval-runtime** | Embed execution, scoring, and version comparison in your Node.js service or platform, without going through the CLI or starting Studio |
28
- | **DSH plugin** | Use `/omk eval` and `/omk observe` inside DeepSeek Harness with the current profile’s model, credentials, tools, and sandbox; see [host plugin setup](docs/reference/executors.md#deepseek-harness-prefer-the-host-plugin) |
29
-
30
- ## Start with your goal
31
-
32
- | Goal | Entry point | What you get |
33
- |---|---|---|
34
- | Understand a real task | [Studio and task trajectories](docs/guides/observe-production.md) | Conversation, execution, results, and knowledge lanes with inspectable source records |
35
- | Preserve knowledge from work | [Extract knowledge from logs](docs/guides/extract-knowledge.md) | Candidate knowledge with sources and conditions; revise, retain, or discard it |
36
- | Record a confirmed knowledge problem | [MCP feedback](docs/guides/mcp-integration.md) | An observation for review; draft a case after confirming a real issue |
37
- | Decide whether to adopt a change | [Evaluation quickstart](docs/quickstart-skill-eval.md) | A version decision, uncertainty, failed cases, and scoring evidence |
38
- | Try improving a skill automatically | [Iterative improvement](docs/guides/auto-improve-skills.md) | Candidate versions screened through controlled comparisons |
39
- | Embed evaluation in a service or platform | [Node.js service](docs/guides/eval-runtime.md) · [Platform host](docs/guides/platform-host-integration.md) | Composable execution, scoring, and comparison interfaces |
40
-
41
- ## Quick start
42
-
43
- Installation requires Node.js >=22. Model calls also require an authenticated runtime; see [Requirements](#requirements).
15
+ Requires **Node.js ≥22**. The library, artifact authoring, and change review described here require **1.0.0-beta.14 or later**, from the **`@next` channel**; npm `latest` is a separate stable channel. Beta.13 does not include this maintenance UI. Read the [migration guide](docs/guides/maintenance/v1-preview-migration.md) before upgrading an older installation.
44
16
 
45
17
  ```bash
46
18
  npm i -g oh-my-knowledge@next
47
- ```
48
-
49
- ### Inspect an existing task
50
-
51
- ```bash
19
+ omk --version
52
20
  omk studio
53
21
  ```
54
22
 
55
- Open the local URL returned by the command and select a local Codex conversation to inspect its task trajectory. No prior ingest or model call is needed; active tasks support live following. Claude Code, OpenClaw, and markdown logs enter observation reports through `omk observe`; see the [observation guide](docs/guides/observe-production.md).
23
+ Open the local URL returned by the command and inspect an existing Codex task and its source records. This step makes no model call; Studio offers source and collection guidance when no conversations exist. Follow the [observation guide](docs/guides/observe/observe-production.md) for other log sources.
56
24
 
57
- To preserve reusable knowledge, choose “Extract knowledge from work logs” on the knowledge page. Select a workspace and a Codex log excerpt, inspect the source, then generate candidates. Generation calls a model. Retaining a candidate means you intend to maintain it, not that it is verified; it does not automatically update AGENTS.md or skills. See the [extraction guide](docs/guides/extract-knowledge.md).
25
+ Next, choose a conversation and turns under “Knowledge → Candidate review”, inspect the material to send, and extract candidates. **Extraction calls a model**, so prepare an [authenticated runtime](docs/reference/integration/executors.md#prerequisites) first. Link sources in the library, revise outdated content, then explicitly generate and save an artifact. Its detail view lets you review knowledge changes and old and new references. Follow the [knowledge maintenance workflow](docs/guides/knowledge/extract-knowledge.md).
58
26
 
59
- ### Or compare two skills directly
27
+ ## When knowledge changes, review its artifacts
60
28
 
61
- ```bash
62
- omk init demo
63
- cd demo
64
- omk eval --control code-review-v1 --treatment code-review-v2 --dry-run
65
- ```
29
+ ![SDK historical artifact changes in the Studio reader, captured from the Chinese case](./docs/public/sdk-maintenance-review.png)
66
30
 
67
- After checking the plan and estimated calls, run the evaluation (this calls the model):
31
+ In the existing SDK maintenance case, old statements were limited to their historical context, one item was discarded, and another gained a clearer boundary for its static observations. v4 retains three historical references and shows two changes; v5 explicitly selects two currently retained items, while old content and references remain available. [Read the case, sources, and review steps](docs/guides/knowledge/sdk-maintenance-case.md).
68
32
 
69
- ```bash
70
- omk eval --control code-review-v1 --treatment code-review-v2
71
- ```
33
+ This verifies maintenance and reference behavior. It does not verify dynamic SDK effects, time saved, or cross-agent reuse benefits. Retaining knowledge, saving artifacts, using them, and verifying effects are separate records. Complete automatic management and reuse across agents remain in development.
72
34
 
73
- The scaffold contains two skills and three cases. This small default set checks the workflow; `UNDERPOWERED` is expected. Starter cases are marked `llm-generated`. Even the full pack created with `omk init demo-full --samples 20` only meets the default heuristic evidence floor, not an a priori power plan or a release-evidence requirement. Review and replace starter cases with real domain cases before relying on the results.
35
+ ## Continue with your task
74
36
 
75
- The [full walkthrough](docs/quickstart-skill-eval.md) covers runtime selection, your own skills, and interpreting results. The [example gallery](examples/README.md) offers more runnable scenarios.
37
+ - **Compare two artifacts directly**: preview the plan in the [evaluation quickstart](docs/quickstart-skill-eval.md), configure a runtime, then call the model. Fix models and cases, record execution conditions, and inspect decisions, uncertainty, and failed-case evidence.
38
+ - **Embed evaluation in a service**: begin with the [offline Node example](docs/guides/integration/eval-runtime.md), complete a traceable comparison, then choose models and configuration as needed.
39
+ - **Use OMK inside agents or DSH**: [install the official Skill](docs/quickstart-skill-eval.md#use-inside-an-agent), [submit MCP feedback](docs/guides/integration/mcp-integration.md), or use the [DSH host plugin](docs/reference/integration/executors.md#deepseek-harness-prefer-the-host-plugin).
40
+ - **Verify an agent’s file changes**: use independent checks in [local task acceptance](docs/guides/evaluation/local-tasks.md), or screen candidate versions with [iterative improvement](docs/guides/evaluation/auto-improve-skills.md).
76
41
 
77
- ## Use inside agents and DSH
42
+ Starter cases check the workflow; `UNDERPOWERED` is expected. Release decisions need your own domain cases and independent evidence. Observation signals do not establish causality; passing an evaluation does not mean an artifact took effect or a version was published.
78
43
 
79
- ### Agent Skill and MCP
44
+ ## Look up details and upgrade
80
45
 
81
- ```bash
82
- omk install omk-agent-skill
83
- ```
46
+ [Documentation start](docs/README.md) · [Website](https://oh-my-knowledge.pages.dev/) · [CLI](docs/reference/cli.md) · [Runtimes and executors](docs/reference/integration/executors.md) · [Settings and environment variables](docs/reference/shared/settings.md) · [Examples](examples/README.md)
84
47
 
85
- Install the Skill, then ask your coding agent: “Use omk to compare these two skills; preview the plan first.” See the [quickstart](docs/quickstart-skill-eval.md#use-inside-an-agent) for installation targets and usage.
86
-
87
- The [MCP integration](docs/guides/mcp-integration.md) accepts user-authorized knowledge feedback. It records partial evidence submitted at its tool boundary; it does not automatically monitor complete conversations.
88
-
89
- ### DeepSeek Harness plugin
90
-
91
- If you already use DSH, add OMK to an existing profile. For example, use the command-enabled `web` profile:
92
-
93
- ```bash
94
- dsh plugin --profile web add oh-my-knowledge
95
- dsh --profile web
96
- ```
97
-
98
- Inside DSH, run:
99
-
100
- ```text
101
- /omk eval eval.yaml
102
- /omk observe
103
- /omk observe <session-id>
104
- ```
105
-
106
- Evaluation reuses the host’s model, credentials, tools, and sandbox, creating an isolated session for each case. Observation reads snapshots of completed sessions and returns a Studio task-trajectory URL; it does not currently live-follow running DSH sessions. See [DSH integration](docs/reference/executors.md#deepseek-harness-prefer-the-host-plugin) for configuration requirements and current plugin limitations.
107
-
108
- ## Use the evidence
109
-
110
- A knowledge item is a reviewable fact, experience, or method. An artifact is a prompt, document, skill, or other carrier of that content. Candidate knowledge describes content awaiting review; a candidate version describes a proposed artifact version.
111
-
112
- 1. **Observe and review**: inspect tasks and sources in Studio; extract knowledge or confirm observations, preserving conditions and review reasons.
113
- 2. **Prepare a measurable change**: manually apply selected content to an artifact and turn reproducible problems into evaluation cases. Candidates do not take effect automatically.
114
- 3. **Compare under control**: `doctor` performs preflight checks; `eval` compares control and treatment with a Decision, coverage, failed cases, and costs.
115
- 4. **Adopt or improve further**: use evidence to `promote` or `rollback` managed skills. `evolve` screens candidate versions through A/B gates and compares again before writing back.
116
-
117
- These paths compose; they are not a mandatory linear state machine. Passing an evaluation does not mean knowledge has been written or a version published.
118
-
119
- Conclusions depend on the cases, scoring criteria, and execution environment. Observation signals are not causal conclusions, and generated cases are not an independent release-validation set. See [statistical rigor](docs/explanation/statistical-rigor.md) and the [three-stage workflow](docs/explanation/three-stage-workflow.md) for the method and limits.
120
-
121
- Project evaluation and observation evidence lives under `.omk/`; machine-level state lives under `~/.oh-my-knowledge/`. Extracted knowledge items live in the explicitly selected knowledge workspace. The current version neither reads nor migrates the old storage layout. Back up before upgrading and follow the [migration guide](docs/guides/v1-preview-migration.md) to establish new evidence.
122
-
123
- ## Documentation
124
-
125
- [Documentation index](docs/README.md) · [Online docs](https://oh-my-knowledge.pages.dev) · [CLI reference](docs/reference/cli.md) · [Sample format](docs/reference/eval-sample-format.md) · [Executors](docs/reference/executors.md) · [How OMK understands knowledge](docs/explanation/knowledge.md)
126
-
127
- ## Environment variables
128
-
129
- | Variable | Description |
130
- |---|---|
131
- | `OMK_EXECUTOR` | default executor preference, e.g. `codex` / `codex-sdk` / `claude` |
132
- | `OMK_MODEL` | default evaluated model; Codex reads local `config.toml` when unset |
133
- | `OMK_JUDGE_MODELS` | default judge list in `executor:model[,...]` format |
134
- | `CCV_PROXY_URL` | proxy requests through cc-viewer for live eval-traffic visualization |
135
- | `OMK_REPORT_PORT` | report server port (default: 7799) |
136
-
137
- ## Requirements
138
-
139
- - Node.js >= 22
140
- - At least one authenticated model runtime:
141
- - Codex: install and authenticate the Codex CLI (`npm i -g @openai/codex`); Codex tasks in the ChatGPT desktop app select it automatically
142
- - Claude: install and authenticate [Claude Code](https://claude.ai/code)
143
- - API / other executors: configure them as described in [Executors](docs/reference/executors.md)
144
- - Advanced `claude-sdk` / `codex-sdk` executors are optional and are not downloaded by the base OMK install. Install the matching SDK in the same local project or global npm prefix only when you select one; see [Executor prerequisites](docs/reference/executors.md#prerequisites).
48
+ Beta APIs and storage contracts may change. Knowledge stays in the explicitly selected workspace; execution evidence and machine preferences have their own storage scopes. Back up before upgrading, then establish new evidence through the migration guide.
145
49
 
146
50
  ## Security notice
147
51
 
148
- This tool is designed for **local trusted environments** (dev machines, CI pipelines). The following features execute local code — make sure inputs come from a trusted source:
149
-
150
- | Feature | Risk | Scope |
151
- |---|---|---|
152
- | **Custom assertions** (`custom`) | dynamically loads and executes user-specified `.mjs` files | only use assertion files you authored or reviewed |
153
- | **eval-samples.json** | assertion configs can reference external file paths | don't use sample files from untrusted sources |
154
-
155
- **Recommendations:**
156
-
157
- - Do not expose the local report server on the public internet (no auth)
158
- - Don't use third-party eval-samples you haven't vetted
159
- - Custom assertions have a 30-second timeout but no sandbox isolation
160
-
161
- ---
52
+ Use a trusted local environment. Tasks, verifiers, and custom assertions execute local code and should be reviewed first; workspace copies are not security sandboxes. Inspect the material before a model call: source records and artifacts may contain sensitive information. The local report server has no authentication and should not be exposed publicly.
162
53
 
163
- See [GitHub Releases](https://github.com/lizhiyao/oh-my-knowledge/releases) for release notes. Contributions welcome — see [CONTRIBUTING](./CONTRIBUTING.md).
54
+ See [GitHub Releases](https://github.com/lizhiyao/oh-my-knowledge/releases) for release notes and [CONTRIBUTING](./CONTRIBUTING.md) for the contribution workflow.
package/README.zh.md CHANGED
@@ -1,163 +1,54 @@
1
1
  # OMK
2
2
 
3
- [![npm version](https://img.shields.io/npm/v/oh-my-knowledge.svg)](https://www.npmjs.com/package/oh-my-knowledge)
4
- [![npm weekly downloads](https://img.shields.io/npm/dw/oh-my-knowledge.svg)](https://www.npmjs.com/package/oh-my-knowledge)
3
+ [![Beta @next](https://img.shields.io/npm/v/oh-my-knowledge/next.svg?label=Beta)](https://www.npmjs.com/package/oh-my-knowledge?activeTab=versions)
5
4
  [![CI](https://github.com/lizhiyao/oh-my-knowledge/actions/workflows/ci.yml/badge.svg)](https://github.com/lizhiyao/oh-my-knowledge/actions/workflows/ci.yml)
6
5
  [![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](./LICENSE)
7
- [![Node.js Version](https://img.shields.io/node/v/oh-my-knowledge.svg)](https://nodejs.org)
8
6
 
9
7
  [English](./README.md) | **简体中文**
10
8
 
11
- **Observe. Measure. Know.** 让 AI 应用的知识改动有据可依。
9
+ **Observe. Measure. Know.** 把工作中的经验,沉淀为可持续维护的知识。
12
10
 
13
- OMK 是面向 AI 应用作者与维护者的知识观测、评测与改进工具体系。查看真实任务如何执行,从工作日志提炼可复核的知识内容,再测量 prompt、RAG、skill、agent 或 workflow 的载体改动是否有效,为采纳、回退和继续改进提供证据。
11
+ OMK 面向 Agent 使用者和 AI 应用开发者。从真实工作记录中提炼候选,核对来源与适用条件,围绕对象持续积累和修订,再更新引用它们的 skill 或 prompt。需要判断改动效果时,可以独立开展受控版本比较。
14
12
 
15
- **Observe** 保留真实表现与来源,**Measure** 在相同模型、用例与运行条件下比较知识载体,**Know** 让决定可以回到证据核对。已有两版载体时,可以直接开始评测;不必先收集日志。
13
+ ## 从本地工作记录开始
16
14
 
17
- 当前 1.0 仍处于 **Beta 迭代期**,接口与存储契约可能继续变化。从旧版本升级前,请先阅读[迁移指南](docs/zh/guides/v1-preview-migration.md)。
18
-
19
- ![OMK:从受控评测到真实使用反馈](./docs/public/omk-knowledge-flow-animated.gif)
20
-
21
- ## 选择使用方式
22
-
23
- | 入口 | 适合什么场景 |
24
- |---|---|
25
- | **CLI** | 在终端、coding agent 或 CI 中执行检查、评测、观测与迭代工作流 |
26
- | **Studio** | 在本地工作台浏览任务轨迹、复核知识内容,查看报告与原始证据 |
27
- | **eval-runtime** | 通过 Node.js API 将执行、评分与版本比较嵌入自己的服务或平台;无需通过 CLI 或启动 Studio |
28
- | **DSH 插件** | 在 DeepSeek Harness 内用 `/omk eval` 和 `/omk observe`,复用当前 profile 的模型、凭证、工具与 sandbox;见[宿主插件接入](docs/zh/reference/executors.md#deepseek-harness-优先使用宿主插件) |
29
-
30
- ## 从你的目标开始
31
-
32
- | 想做什么 | 入口 | 得到什么 |
33
- |---|---|---|
34
- | 看清一次真实任务 | [Studio 与任务轨迹](docs/zh/guides/observe-production.md) | 对话、执行、结果、知识四条泳道,以及可核对的原始记录 |
35
- | 把工作经验沉淀为知识 | [从日志提炼知识](docs/zh/guides/extract-knowledge.md) | 带来源和适用条件的候选知识,支持修订、保留和舍弃 |
36
- | 记录已确认的知识问题 | [MCP 主动反馈](docs/zh/guides/mcp-integration.md) | 待复核 observation;确认真实问题后再草拟用例 |
37
- | 判断一版改动是否值得采用 | [评测快速上手](docs/zh/quickstart-skill-eval.md) | 版本判定、不确定性、失败用例和评分依据 |
38
- | 自动尝试改进 skill | [迭代改进](docs/zh/guides/auto-improve-skills.md) | 经受控比较筛选的候选版本 |
39
- | 将评测接入服务或平台 | [Node.js 服务](docs/zh/guides/eval-runtime.md) · [平台宿主](docs/zh/guides/platform-host-integration.md) | 可组合的执行、评分与比较接口 |
40
-
41
- ## 快速开始
42
-
43
- 安装需要 Node.js >=22。调用模型前还需配置已认证的 runtime,详见[系统要求](#系统要求)。
15
+ 需要 **Node.js ≥22**。本页的知识库、载体生成与变化核对需要 **1.0.0-beta.14 或更新版本**,使用 **`@next` 通道**;npm 的 `latest` 是另一条稳定通道。Beta.13 不包含这里的维护界面。旧版用户先阅读[迁移指南](docs/zh/guides/maintenance/v1-preview-migration.md)。
44
16
 
45
17
  ```bash
46
18
  npm i -g oh-my-knowledge@next
47
- ```
48
-
49
- ### 先看已有任务
50
-
51
- ```bash
19
+ omk --version
52
20
  omk studio
53
21
  ```
54
22
 
55
- 打开命令返回的本地地址,从本机 Codex 对话进入任务轨迹;无需先 ingest,也不调用模型。进行中的任务支持实时跟随。Claude Code、OpenClaw 与 markdown 日志通过 `omk observe` 进入观测报告,见[观测指南](docs/zh/guides/observe-production.md)。
23
+ 打开命令返回的本地地址,从已有 Codex 对话核对任务与原始记录。这一步不调用模型;没有对话时,Studio 提供来源与采集入口。其他日志来源按[观测指南](docs/zh/guides/observe/observe-production.md)接入。
56
24
 
57
- 需要沉淀经验时,在知识页面选择“从工作日志提炼知识”,选定工作区与 Codex 日志片段,核对来源后再生成。生成会调用模型;保留候选表示愿意维护,不等于已证实,也不会自动写入 AGENTS.md 或 skill。步骤见[提炼指南](docs/zh/guides/extract-knowledge.md)。
25
+ 接下来,在“知识 → 候选核对”选择会话和轮次,核对发送范围后提炼候选。**提炼会调用模型**,需先准备[已认证的运行时](docs/zh/reference/integration/executors.md#前置要求)。在知识库关联来源、修订过时内容,再明确生成和保存载体;载体详情可核对知识变化和新旧引用。完整步骤见[知识维护动线](docs/zh/guides/knowledge/extract-knowledge.md)。
58
26
 
59
- ### 或者,直接比较两版 skill
27
+ ## 知识变化,载体也需要核对
60
28
 
61
- ```bash
62
- omk init demo
63
- cd demo
64
- omk eval --control code-review-v1 --treatment code-review-v2 --dry-run
65
- ```
29
+ ![Studio 中 SDK 历史载体的知识变化核对阅读区](./docs/public/sdk-maintenance-review.png)
66
30
 
67
- 检查计划和预估调用次数后,执行评测(会调用模型):
31
+ 在已有 SDK 维护案例中,旧说法限定为历史场景,一条不再适用的知识被舍弃,另一条补充了静态观察的范围。v4 保留三条旧引用并提示两项变化;v5 明确选择两条当前保留知识,旧版本正文与引用继续保留。[查看案例、来源和核对步骤](docs/zh/guides/knowledge/sdk-maintenance-case.md)。
68
32
 
69
- ```bash
70
- omk eval --control code-review-v1 --treatment code-review-v2
71
- ```
33
+ 这证明维护与引用链路可核对,没有验证 SDK 动态效果、节省时间或跨 Agent 复用收益。保留知识、保存载体、实际使用和验证效果分别记录;完整跨 Agent 自动管理与复用仍在建设中。
72
34
 
73
- 脚手架包含两版 skill 和三条用例。默认小样本用于检查流程,出现 `UNDERPOWERED` 符合预期。官方起步用例标记为 `llm-generated`;即使用 `omk init demo-full --samples 20` 创建完整起步集,也只是达到默认启发式证据下限,不等于完成功效规划或具备发布证据。实际使用前应人工复核并替换为真实领域用例。
35
+ ## 按当前任务继续
74
36
 
75
- [完整教程](docs/zh/quickstart-skill-eval.md)介绍模型选择、换成自己的 skill 和结果解读;[示例画廊](examples/README.zh.md)提供更多可运行场景。
37
+ - **直接比较两版载体**:从[评测快速上手](docs/zh/quickstart-skill-eval.md)预览计划,配置运行时后再调用模型。固定模型与用例,记录运行条件,核对判定、不确定性和失败证据。
38
+ - **嵌入自己的服务**:从[离线 Node 示例](docs/zh/guides/integration/eval-runtime.md)开始,完成第一轮可回查的比较,再按需选择模型与配置。
39
+ - **在 Agent 或 DSH 中使用**:[安装官方 Skill](docs/zh/quickstart-skill-eval.md#在-agent-中使用)、[MCP 主动反馈](docs/zh/guides/integration/mcp-integration.md)和[DSH 宿主插件](docs/zh/reference/integration/executors.md#deepseek-harness-优先使用宿主插件)各有独立入口。
40
+ - **验收 Agent 修改的文件**:使用[本地任务验收](docs/zh/guides/evaluation/local-tasks.md)的独立检查;用[迭代改进](docs/zh/guides/evaluation/auto-improve-skills.md)筛选候选版本。
76
41
 
77
- ## 在 Agent 与 DSH 中使用
42
+ 入门用例只检查流程,`UNDERPOWERED` 符合预期。真实发布判断需要自己的领域用例和独立证据;观测信号不能证明因果,一次评测通过也不等于载体已经生效或版本已发布。
78
43
 
79
- ### Agent Skill 与 MCP
44
+ ## 查阅与升级
80
45
 
81
- ```bash
82
- omk install omk-agent-skill
83
- ```
46
+ [文档入口](docs/zh/README.md) · [官网](https://oh-my-knowledge.pages.dev/zh/) · [CLI](docs/zh/reference/cli.md) · [运行时与执行器](docs/zh/reference/integration/executors.md) · [配置与环境变量](docs/zh/reference/shared/settings.md) · [示例](examples/README.zh.md)
84
47
 
85
- 安装 Skill 后,可以对 coding agent 说:“用 omk 比较这两版 skill,先预览计划。”安装目标与使用方法见[快速上手](docs/zh/quickstart-skill-eval.md#在-agent-中使用)。
86
-
87
- [MCP 集成](docs/zh/guides/mcp-integration.md)提供用户授权的主动知识反馈入口。它仅记录提交到工具边界的部分证据,不自动监听完整对话。
88
-
89
- ### DeepSeek Harness 插件
90
-
91
- 已有 DSH 环境时,把 OMK 加入现有 profile。以支持命令适配的 `web` profile 为例:
92
-
93
- ```bash
94
- dsh plugin --profile web add oh-my-knowledge
95
- dsh --profile web
96
- ```
97
-
98
- 在 DSH 内执行:
99
-
100
- ```text
101
- /omk eval eval.yaml
102
- /omk observe
103
- /omk observe <session-id>
104
- ```
105
-
106
- 评测复用当前宿主的模型、凭证、工具和 sandbox,并为每条用例创建隔离 session。观测读取已结束 session 的快照并返回 Studio 任务轨迹地址;目前不实时跟随正在运行的 DSH session。配置要求与插件当前限制见[DSH 接入](docs/zh/reference/executors.md#deepseek-harness-优先使用宿主插件)。
107
-
108
- ## 如何使用证据
109
-
110
- 知识内容是一条可复核的事实、经验或方法;知识载体是承载内容的 prompt、文档、skill 等。候选知识是内容的待复核状态,候选版本是拟采用的载体版本,两者不能混为一谈。
111
-
112
- 1. **观测与复核**:在 Studio 核对任务与来源;提炼知识或确认 observation,留下适用条件和处理理由。
113
- 2. **形成可测改动**:人工把需要采纳的内容落实到载体,把可复现的问题整理为正式用例;候选不会自动生效。
114
- 3. **受控比较**:`doctor` 做前置检查,`eval` 比较 control 与 treatment,检查 Decision、覆盖、失败样本与成本。
115
- 4. **采纳或继续改进**:受管 skill 可按证据 `promote`/`rollback`;`evolve` 通过 A/B 门禁筛选候选版本,写回前再次比较。
116
-
117
- 这是可组合的工作路径,不是强制的单向状态机。一次评测通过也不等于知识已写入或版本已发布。
118
-
119
- 结论受用例、评分准则和执行环境约束。观测信号不等于因果结论,生成的样本也不能直接充当独立发布验证集。原理与限制见[统计严谨性](docs/zh/explanation/statistical-rigor.md)和[三阶段工作流](docs/zh/explanation/three-stage-workflow.md)。
120
-
121
- 项目评测与观测证据保存在 `.omk/`,机器级状态位于 `~/.oh-my-knowledge/`;提炼的知识内容保存在显式选择的知识工作区。当前版本不读取或迁移旧存储布局;升级前备份,按[迁移指南](docs/zh/guides/v1-preview-migration.md)重新建立证据。
122
-
123
- ## 文档
124
-
125
- [完整文档与导航](docs/zh/README.md) · [在线文档](https://oh-my-knowledge.pages.dev/zh/) · [CLI 参考](docs/zh/reference/cli.md) · [用例格式](docs/zh/reference/eval-sample-format.md) · [执行器](docs/zh/reference/executors.md) · [OMK 如何理解知识](docs/zh/explanation/knowledge.md)
126
-
127
- ## 环境变量
128
-
129
- | 变量 | 说明 |
130
- |------|------|
131
- | `OMK_EXECUTOR` | 默认执行器偏好,例如 `codex` / `codex-sdk` / `claude` |
132
- | `OMK_MODEL` | 默认被测模型;Codex 未设置时读取本机 `config.toml` |
133
- | `OMK_JUDGE_MODELS` | 默认评委列表,格式 `executor:model[,...]` |
134
- | `CCV_PROXY_URL` | 通过 cc-viewer 代理请求,实时可视化评测流量 |
135
- | `OMK_REPORT_PORT` | 报告服务端口(默认 7799) |
136
-
137
- ## 系统要求
138
-
139
- - Node.js >= 22
140
- - 至少一个已认证的模型 runtime:
141
- - Codex:安装并登录 Codex CLI(`npm i -g @openai/codex`);ChatGPT desktop 的 Codex 任务会自动选择它
142
- - Claude:安装并登录 [Claude Code](https://claude.ai/code)
143
- - API / 其它执行器:按[执行器文档](docs/zh/reference/executors.md)配置
144
- - 高级 `claude-sdk`/`codex-sdk` 执行器是可选能力,OMK 基础安装不再下载它们。仅在明确选择对应 SDK 时,才在 OMK 所在的本地项目或全局 npm prefix 安装;详见[执行器前置要求](docs/zh/reference/executors.md#前置要求)。
48
+ Beta 接口和存储契约仍可能变化。知识在显式选定的工作区维护;运行证据与机器偏好各有自己的存储范围。升级前备份,再按迁移指南建立新证据。
145
49
 
146
50
  ## 安全说明
147
51
 
148
- 本工具设计用于**本地可信环境**(开发机、CI 流水线)。以下功能会执行本地代码,请确保输入来源可信:
149
-
150
- | 功能 | 风险 | 适用场景 |
151
- |------|------|----------|
152
- | **自定义断言**(`custom`) | 动态加载并执行用户指定的 `.mjs` 文件 | 仅使用自己编写或审查过的断言文件 |
153
- | **eval-samples.json** | 断言配置可引用外部文件路径 | 不要使用来源不明的用例文件 |
154
-
155
- **建议:**
156
-
157
- - 不要将本地报告服务暴露到公网(无身份认证)
158
- - 不使用未经审查的第三方 eval-samples
159
- - 自定义断言有 30 秒超时,但无沙箱隔离
160
-
161
- ---
52
+ 用于本地可信环境。任务、验收程序和自定义断言会执行本地代码,应先审查;工作区副本不是安全沙箱。调用模型前核对发送范围,原始记录与产物可能含敏感内容。本地报告服务没有身份认证,不应暴露到公网。
162
53
 
163
- 发布日志见 [GitHub Releases](https://github.com/lizhiyao/oh-my-knowledge/releases)。欢迎贡献 —— 见 [CONTRIBUTING](./CONTRIBUTING.md)。
54
+ 发布说明见 [GitHub Releases](https://github.com/lizhiyao/oh-my-knowledge/releases)。贡献流程见 [CONTRIBUTING](./CONTRIBUTING.md)。
@@ -4,7 +4,7 @@ description: |
4
4
  OMK(Observe. Measure. Know.)让 AI 应用的知识改动有据可依。观测真实表现,受控测量 prompt / RAG / skill / agent / workflow 的版本差异,判断改动是否有效、版本能否发布,并支持自动迭代改进。
5
5
  Use when: 用户提到"评测"、"测评"、"eval"、"benchmark"、"对比 skill"、"改进 skill"、"evolve"、"生成测试用例"、"gen-samples"、"知识反馈"、"feedback"、"omk"。
6
6
  user-invocable: true
7
- argument-hint: "<agents|doctor|eval|evolve|init|install|list|observe|promote|rollback|sample|studio> [options]"
7
+ argument-hint: "<agents|doctor|eval|evolve|init|install|observe|sample|studio> [options]"
8
8
  ---
9
9
 
10
10
  # OMK — Observe. Measure. Know.
@@ -19,7 +19,7 @@ argument-hint: "<agents|doctor|eval|evolve|init|install|list|observe|promote|rol
19
19
  2. 该显式调用本身视为用户确认。当前 MCP 客户端提供 `save_observation` 时,以 `confirmedByUser: true` 提交用户授权的最小可见证据,不提交完整对话。
20
20
  3. 如果没有明确候选,或同时存在多个无法唯一判断的候选,只追问要记录哪一项;确认目标前不调用工具。
21
21
  4. 如果当前客户端没有 `save_observation`,明确说明 OMK MCP 尚未连接;不要回退为 CLI 写文件,也不要声称已经保存。
22
- 5. 快捷入口只保存 observation,不自动复核、生成 sample、写入 gold set 或 promote。
22
+ 5. 快捷入口只保存 observation,不自动复核、生成 sample 或写入 gold set。
23
23
 
24
24
  ## 第一步:检查环境
25
25
 
@@ -29,7 +29,7 @@ argument-hint: "<agents|doctor|eval|evolve|init|install|list|observe|promote|rol
29
29
  npm i -g oh-my-knowledge@next
30
30
  ```
31
31
 
32
- omk CLI 顶层命令包括:`init` / `install` / `list` / `promote` / `rollback` / `doctor` / `eval` / `observe` / `evolve` / `sample` / `studio`。没有 `bench` / `improve` / `gen-samples` 这些旧子命令名 —— 如果你在历史 SKILL / 文档里看到了,那是 v0.30 命令树重构之前的写法。
32
+ omk CLI 顶层命令包括:`init` / `install` / `doctor` / `eval` / `observe` / `evolve` / `sample` / `studio`。没有 `bench` / `improve` / `gen-samples` 这些旧子命令名 —— 如果你在历史 SKILL / 文档里看到了,那是 v0.30 命令树重构之前的写法。
33
33
 
34
34
  ### 在 Codex / 支持 MCP 的客户端中
35
35
 
@@ -44,7 +44,7 @@ Codex 是 omk 的一等 runtime。运行在 Codex 任务中时,`omk eval` / `d
44
44
  - 用户明确说「记录这个问题」「把刚才的失败存下来」时,才以 `confirmedByUser: true` 调用 `save_observation`;只提交用户授权的最小可见证据。
45
45
  - 用户只是纠正答案、指出知识不足或遇到重复工具失败时,可以建议记录并请求确认;确认前不要调用 `save_observation`。这条启发式路径是 best-effort,不能声称覆盖全部对话。
46
46
  - 普通追问、假设性例子、泛泛的不满意或没有明确知识缺口的反馈,不要记录 observation。
47
- - 只有人工复核为 `real_issue` 后才能调用 `draft_sample_from_observation`;候选草稿不等于正式 eval sample,不要自动 promote 或写入正式样本集。
47
+ - 只有人工复核为 `real_issue` 后才能调用 `draft_sample_from_observation`;候选草稿不等于正式 eval sample,不要自动写入正式样本集。
48
48
  - 需要对话内复核时,先 `get_observation`,再 `review_observation`。所有结果都按 `coverageStatus: partial` 解读,不推断未提交的上下文、其它工具调用或隐藏推理。
49
49
 
50
50
  ### 在 DeepSeek Harness 中
@@ -66,8 +66,6 @@ Codex 是 omk 的一等 runtime。运行在 Codex 任务中时,`omk eval` / `d
66
66
  | 体检 skill 写法 | → `omk doctor` |
67
67
  | 浏览对话、任务轨迹与报告 | → `omk studio`(启动本地知识工作台) |
68
68
  | 看真实使用 trace | → `omk observe` |
69
- | 查看受管 skill 状态 | → `omk list` |
70
- | 按证据接受 / 回退某版本 | → `omk promote` / `omk rollback` |
71
69
 
72
70
  如果用户意图不明确,先扫描当前项目结构(skills/ 目录、项目级 eval-samples 文件、目录 skill 私有 `.omk/eval-samples.*`),然后推荐最合适的操作。
73
71
 
@@ -205,7 +203,7 @@ Studio 首页直接索引本机 Codex 对话。先选择对话,再选择任务
205
203
  2. **质量分数**:各 variant 的平均综合分(0-5 分)+ Δ + 95% CI
206
204
  3. **成本对比**:token 消耗、execCostUSD、评委花费、diagnostic 花费
207
205
  4. **低分样本**:哪些样本两个版本差异最大,rubric 期望 vs 实际差在哪
208
- 5. **下一步动作**:基于 verdict 给出动作;`PROGRESS` 时明确说明可以进入发布流程、留存报告作为发布证据,受管 skill 继续 `omk promote`;其它 verdict 给出扩样 / 修复 / 重跑建议
206
+ 5. **下一步动作**:基于 verdict 给出动作;`PROGRESS` 时明确说明可以进入发布流程、留存报告作为发布证据;其它 verdict 给出扩样 / 修复 / 重跑建议
209
207
 
210
208
  示例输出:
211
209
 
@@ -214,7 +212,7 @@ v2 比 v1 更好(verdict: PROGRESS,Δ=+0.7,95% CI [+0.3, +1.1]):
214
212
  - 质量:v2 平均 4.5 分 vs v1 平均 3.8 分(+18%)
215
213
  - 成本:v2 略高($0.15 vs $0.12),因为输出更详细
216
214
  - 亮点:v2 在 s002(错误处理)上显著提升(2.5 → 4.5),因为新增了"列出所有缺失的错误处理场景"指令
217
- - 建议:v2 可以进入发布流程;留存本次报告作为发布证据。如果这是受管 skill,继续运行 `omk promote` 记录接受决定。s003(XSS 检测)仍然可以作为下一轮优化点。
215
+ - 建议:v2 可以进入发布流程;留存本次报告作为发布证据。s003(XSS 检测)仍然可以作为下一轮优化点。
218
216
  ```
219
217
 
220
218
  ### evolve 模式