agentic-qe 3.10.9 → 3.11.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.claude/agents/v3/qe-learning-coordinator.md +1 -1
- package/.claude/commands/agents/README.md +50 -0
- package/.claude/commands/agents/agent-capabilities.md +140 -0
- package/.claude/commands/agents/agent-coordination.md +28 -0
- package/.claude/commands/agents/agent-spawning.md +28 -0
- package/.claude/commands/agents/agent-types.md +216 -0
- package/.claude/commands/agents/health.md +139 -0
- package/.claude/commands/agents/list.md +100 -0
- package/.claude/commands/agents/logs.md +130 -0
- package/.claude/commands/agents/metrics.md +122 -0
- package/.claude/commands/agents/pool.md +127 -0
- package/.claude/commands/agents/spawn.md +140 -0
- package/.claude/commands/agents/status.md +115 -0
- package/.claude/commands/agents/stop.md +102 -0
- package/.claude/commands/claude-flow-help.md +1 -1
- package/.claude/commands/coordination/README.md +9 -0
- package/.claude/commands/coordination/agent-spawn.md +25 -0
- package/.claude/commands/coordination/init.md +44 -0
- package/.claude/commands/coordination/orchestrate.md +43 -0
- package/.claude/commands/coordination/spawn.md +45 -0
- package/.claude/commands/coordination/swarm-init.md +85 -0
- package/.claude/commands/coordination/task-orchestrate.md +25 -0
- package/.claude/commands/github/code-review-swarm.md +1 -1
- package/.claude/commands/github/issue-tracker.md +3 -3
- package/.claude/commands/github/release-manager.md +5 -3
- package/.claude/commands/github/release-swarm.md +1 -1
- package/.claude/commands/github/repo-architect.md +2 -2
- package/.claude/commands/github/swarm-issue.md +4 -1
- package/.claude/commands/github/swarm-pr.md +6 -3
- package/.claude/commands/github/sync-coordinator.md +3 -1
- package/.claude/commands/github/workflow-automation.md +2 -2
- package/.claude/commands/hive-mind/README.md +17 -0
- package/.claude/commands/hive-mind/hive-mind-consensus.md +8 -0
- package/.claude/commands/hive-mind/hive-mind-init.md +18 -0
- package/.claude/commands/hive-mind/hive-mind-memory.md +8 -0
- package/.claude/commands/hive-mind/hive-mind-metrics.md +8 -0
- package/.claude/commands/hive-mind/hive-mind-resume.md +8 -0
- package/.claude/commands/hive-mind/hive-mind-sessions.md +8 -0
- package/.claude/commands/hive-mind/hive-mind-spawn.md +21 -0
- package/.claude/commands/hive-mind/hive-mind-status.md +8 -0
- package/.claude/commands/hive-mind/hive-mind-stop.md +8 -0
- package/.claude/commands/hive-mind/hive-mind-wizard.md +8 -0
- package/.claude/commands/hive-mind/hive-mind.md +27 -0
- package/.claude/commands/memory/README.md +9 -0
- package/.claude/commands/memory/memory-persist.md +25 -0
- package/.claude/commands/memory/memory-search.md +25 -0
- package/.claude/commands/memory/memory-usage.md +25 -0
- package/.claude/commands/memory/neural.md +47 -0
- package/.claude/commands/swarm/README.md +15 -0
- package/.claude/commands/swarm/analysis.md +95 -0
- package/.claude/commands/swarm/development.md +96 -0
- package/.claude/commands/swarm/examples.md +168 -0
- package/.claude/commands/swarm/maintenance.md +102 -0
- package/.claude/commands/swarm/optimization.md +117 -0
- package/.claude/commands/swarm/research.md +136 -0
- package/.claude/commands/swarm/swarm-analysis.md +8 -0
- package/.claude/commands/swarm/swarm-background.md +8 -0
- package/.claude/commands/swarm/swarm-init.md +19 -0
- package/.claude/commands/swarm/swarm-modes.md +8 -0
- package/.claude/commands/swarm/swarm-monitor.md +8 -0
- package/.claude/commands/swarm/swarm-spawn.md +19 -0
- package/.claude/commands/swarm/swarm-status.md +8 -0
- package/.claude/commands/swarm/swarm-strategies.md +8 -0
- package/.claude/commands/swarm/swarm.md +87 -0
- package/.claude/commands/swarm/testing.md +131 -0
- package/.claude/commands/workflows/README.md +9 -0
- package/.claude/commands/workflows/development.md +78 -0
- package/.claude/commands/workflows/research.md +63 -0
- package/.claude/commands/workflows/workflow-create.md +25 -0
- package/.claude/commands/workflows/workflow-execute.md +25 -0
- package/.claude/commands/workflows/workflow-export.md +25 -0
- package/.claude/helpers/auto-commit.sh +1 -1
- package/.claude/helpers/auto-memory-hook.mjs +37 -4
- package/.claude/helpers/github-safe.js +90 -40
- package/.claude/helpers/github-setup.sh +30 -13
- package/.claude/helpers/hook-handler.cjs +68 -49
- package/.claude/helpers/intelligence.cjs +156 -27
- package/.claude/helpers/post-commit +1 -1
- package/.claude/helpers/pre-commit +1 -1
- package/.claude/helpers/quick-start.sh +4 -4
- package/.claude/helpers/router.js +70 -31
- package/.claude/helpers/ruflo-hook.cjs +59 -0
- package/.claude/helpers/session.js +28 -6
- package/.claude/helpers/setup-mcp.sh +3 -3
- package/.claude/helpers/statusline.cjs +584 -468
- package/.claude/helpers/statusline.js +47 -11
- package/.claude/skills/README.md +2 -2
- package/.claude/skills/agentic-quality-engineering/SKILL.md +6 -5
- package/.claude/skills/agentic-quality-engineering/schemas/output.json +7 -3
- package/.claude/skills/github-code-review/SKILL.md +2 -17
- package/.claude/skills/github-multi-repo/SKILL.md +4 -16
- package/.claude/skills/github-project-management/SKILL.md +18 -33
- package/.claude/skills/github-release-management/SKILL.md +4 -21
- package/.claude/skills/github-workflow-automation/SKILL.md +8 -26
- package/.claude/skills/holistic-testing-pact/SKILL.md +50 -17
- package/.claude/skills/pair-programming/SKILL.md +2 -2
- package/.claude/skills/reasoningbank-intelligence/SKILL.md +2 -2
- package/.claude/skills/skill-builder/SKILL.md +0 -103
- package/.claude/skills/skills-manifest.json +6 -6
- package/.claude/skills/sparc-methodology/SKILL.md +2 -11
- package/.claude/skills/stream-chain/SKILL.md +0 -3
- package/.claude/skills/swarm-advanced/SKILL.md +2 -5
- package/.claude/skills/swarm-orchestration/SKILL.md +1 -1
- package/.claude/skills/verification-quality/SKILL.md +121 -93
- package/.opencode/skills/qe-agentic-quality-engineering.yaml +5 -5
- package/.opencode/skills/qe-holistic-testing-pact.yaml +11 -11
- package/CHANGELOG.md +100 -0
- package/README.md +17 -0
- package/assets/agents/v3/qe-learning-coordinator.md +1 -1
- package/assets/skills/README.md +2 -2
- package/assets/skills/agentic-quality-engineering/SKILL.md +6 -5
- package/assets/skills/agentic-quality-engineering/schemas/output.json +7 -3
- package/assets/skills/holistic-testing-pact/SKILL.md +50 -17
- package/assets/skills/pair-programming/SKILL.md +2 -2
- package/assets/skills/skills-manifest.json +6 -6
- package/assets/skills/verification-quality/SKILL.md +121 -93
- package/dist/audit/witness-chain.d.ts +1 -1
- package/dist/audit/witness-findings.d.ts +50 -0
- package/dist/audit/witness-findings.js +41 -0
- package/dist/cli/bundle.js +5 -5
- package/dist/cli/chunks/adapter-A6GCBONS.js +2 -0
- package/dist/cli/chunks/{agent-booster-wasm-RPAOJXZ3.js → agent-booster-wasm-3OJAT664.js} +2 -2
- package/dist/cli/chunks/{agent-handler-SMD5CAS6.js → agent-handler-6TCTI5AT.js} +2 -2
- package/dist/cli/chunks/{agent-memory-branch-3IOQIQ7Y.js → agent-memory-branch-FAWCYEGJ.js} +2 -2
- package/dist/cli/chunks/aqe-learning-engine-FRCSXNMG.js +2 -0
- package/dist/cli/chunks/{arena-AP2J62WO.js → arena-O2TCUQBF.js} +4 -4
- package/dist/cli/chunks/{arena-GT3D6EAO.js → arena-UVYIGYUF.js} +2 -2
- package/dist/cli/chunks/{audit-Q3GJ5354.js → audit-AYESKHAJ.js} +2 -2
- package/dist/cli/chunks/base-CZ3EHBU5.js +2 -0
- package/dist/cli/chunks/{hnswlib-node-YTK7S7GL.js → better-sqlite3-MJNUEPYB.js} +2 -2
- package/dist/cli/chunks/{brain-handler-2Z4ILQF3.js → brain-handler-KSJBVTHZ.js} +3 -3
- package/dist/cli/chunks/{branch-enumerator-EZWGL4UM.js → branch-enumerator-4O3S42EG.js} +2 -2
- package/dist/cli/chunks/{browser-YZELFPLJ.js → browser-5VXK323P.js} +2 -2
- package/dist/cli/chunks/browser-workflow-EKTGQQBQ.js +2 -0
- package/dist/cli/chunks/{chunk-CDJIYJIA.js → chunk-22FHOXEE.js} +1 -1
- package/dist/cli/chunks/{chunk-OIN3Y4BY.js → chunk-2RE32VOF.js} +1 -1
- package/dist/cli/chunks/{chunk-RSWQY4NZ.js → chunk-3D4HNUZM.js} +2 -2
- package/dist/cli/chunks/{chunk-6TR3OM7C.js → chunk-3DS7ZHA7.js} +2 -2
- package/dist/cli/chunks/{chunk-HGKZOSAI.js → chunk-3G25ZBQ6.js} +1 -1
- package/dist/cli/chunks/{chunk-QHPLU5BU.js → chunk-3IMEDZIS.js} +3 -3
- package/dist/cli/chunks/{chunk-EL6F72JN.js → chunk-3V5DAM37.js} +2 -2
- package/dist/cli/chunks/{chunk-IR7PJUO7.js → chunk-3XCEFSUK.js} +2 -2
- package/dist/cli/chunks/{chunk-L5NEEGKO.js → chunk-437XL5VZ.js} +2 -2
- package/dist/cli/chunks/{chunk-C6GQIUKW.js → chunk-44HXRFOP.js} +2 -2
- package/dist/cli/chunks/{chunk-KAMFT25W.js → chunk-4565IIF6.js} +2 -2
- package/dist/cli/chunks/{chunk-X7677BX3.js → chunk-4BMPFEEG.js} +2 -2
- package/dist/cli/chunks/{chunk-3YKJGKOY.js → chunk-4G4GTF36.js} +4 -4
- package/dist/cli/chunks/{chunk-352W5G4G.js → chunk-4OYC5TIZ.js} +2 -2
- package/dist/cli/chunks/{chunk-VHCHBMZC.js → chunk-4RUS5E3Q.js} +2 -2
- package/dist/cli/chunks/{chunk-QHICG2NI.js → chunk-4S3UIY3G.js} +2 -2
- package/dist/cli/chunks/{chunk-FD37QFXW.js → chunk-4UHWZ47M.js} +1 -1
- package/dist/cli/chunks/{chunk-UU7OCRZM.js → chunk-56PICCZN.js} +2 -2
- package/dist/cli/chunks/chunk-57WGS6BI.js +2 -0
- package/dist/cli/chunks/{chunk-RRSJ7BMF.js → chunk-5LDUW2FD.js} +1 -1
- package/dist/cli/chunks/{chunk-J6GKKXCP.js → chunk-5PSIKJL5.js} +2 -2
- package/dist/cli/chunks/{chunk-QE3CZGAC.js → chunk-5QFZEEJ2.js} +3 -3
- package/dist/cli/chunks/{chunk-RHOBDQXA.js → chunk-5Y7GXQOM.js} +2 -2
- package/dist/cli/chunks/{chunk-5X73HV2P.js → chunk-6CH7476R.js} +1 -1
- package/dist/cli/chunks/{chunk-BG2FN5K2.js → chunk-6WNYBIPS.js} +2 -2
- package/dist/cli/chunks/{chunk-G4KVGUQN.js → chunk-6YNXH6H4.js} +2 -2
- package/dist/cli/chunks/{chunk-2WRVNEIR.js → chunk-6ZAUNPAI.js} +2 -2
- package/dist/cli/chunks/{chunk-2I5QLMQF.js → chunk-72UPBNVF.js} +2 -2
- package/dist/cli/chunks/{chunk-VDL277DX.js → chunk-76UVJLPM.js} +2 -2
- package/dist/cli/chunks/{chunk-4EJTE5TL.js → chunk-7DQLYWLR.js} +1 -1
- package/dist/cli/chunks/{chunk-4D3LVXUD.js → chunk-7GP7ZG3K.js} +2 -2
- package/dist/cli/chunks/{chunk-757YHKIJ.js → chunk-7OAKIXNM.js} +2 -2
- package/dist/cli/chunks/{chunk-7S6D5K4X.js → chunk-7QICU44H.js} +2 -2
- package/dist/cli/chunks/{chunk-ABJPFKHE.js → chunk-7SRSOZMP.js} +1 -1
- package/dist/cli/chunks/{chunk-2WSEJHFQ.js → chunk-7WQKKYYG.js} +1 -1
- package/dist/cli/chunks/{chunk-7NT34MLU.js → chunk-AEZMNFXM.js} +1 -1
- package/dist/cli/chunks/{chunk-MDED3HJI.js → chunk-AG4BYKUV.js} +2 -2
- package/dist/cli/chunks/{chunk-QL7OOCPO.js → chunk-AL54LED5.js} +2 -2
- package/dist/cli/chunks/{chunk-I7RTTJH5.js → chunk-ATQTTGSE.js} +2 -2
- package/dist/cli/chunks/{chunk-HQZX4XYH.js → chunk-B5EE63VE.js} +2 -2
- package/dist/cli/chunks/{chunk-QWXJRZEH.js → chunk-B6U56VWG.js} +1 -1
- package/dist/cli/chunks/{chunk-5HLOQEKL.js → chunk-BOQNPFO5.js} +1 -1
- package/dist/cli/chunks/{chunk-I5C7O5IQ.js → chunk-BR4ERWVD.js} +2 -2
- package/dist/cli/chunks/{chunk-GPALZJD3.js → chunk-BVFNF3RW.js} +1 -1
- package/dist/cli/chunks/{chunk-NYBAH76S.js → chunk-BXLWERBR.js} +3 -3
- package/dist/cli/chunks/{chunk-YQBL5XTM.js → chunk-C27UV6DO.js} +1 -1
- package/dist/cli/chunks/{chunk-UUA2NVUN.js → chunk-C7FYDE5F.js} +244 -233
- package/dist/cli/chunks/{chunk-6HPI6YX3.js → chunk-CIDTFU3C.js} +2 -2
- package/dist/cli/chunks/{chunk-VIHFC67B.js → chunk-CII57TME.js} +1 -1
- package/dist/cli/chunks/{chunk-57XCLC55.js → chunk-CN2HMHIY.js} +2 -2
- package/dist/cli/chunks/{chunk-CREORFJV.js → chunk-CXIFCN6G.js} +1 -1
- package/dist/cli/chunks/{chunk-EYGRNXQT.js → chunk-CZU5G6J4.js} +1 -1
- package/dist/cli/chunks/{chunk-HZSYCVLC.js → chunk-D4DAZ3P2.js} +2 -2
- package/dist/cli/chunks/{chunk-3HT4CT6F.js → chunk-D6MPGK7R.js} +2 -2
- package/dist/cli/chunks/{chunk-DK6WWNCL.js → chunk-DZT4A7R3.js} +2 -2
- package/dist/cli/chunks/{chunk-H7AQ7M3J.js → chunk-EFRIMR74.js} +1 -1
- package/dist/cli/chunks/{chunk-S73EBPI5.js → chunk-EJSDQQZH.js} +3 -3
- package/dist/cli/chunks/{chunk-X6YUGKMM.js → chunk-EQYDPF52.js} +1 -1
- package/dist/cli/chunks/{chunk-BYVARYGB.js → chunk-EZBXCEBV.js} +2 -2
- package/dist/cli/chunks/{chunk-L5IO7QNO.js → chunk-FBOPSWF6.js} +2 -2
- package/dist/cli/chunks/{chunk-K23XK33X.js → chunk-FK3XYV3A.js} +2 -2
- package/dist/cli/chunks/{chunk-4BB75U6N.js → chunk-FOD6JEEU.js} +2 -2
- package/dist/cli/chunks/{chunk-TIR3Z6TE.js → chunk-GUSW3OGX.js} +1 -1
- package/dist/cli/chunks/{chunk-2K2X75UF.js → chunk-H4V6WCF7.js} +2 -2
- package/dist/cli/chunks/{chunk-AHUX7QSE.js → chunk-H5GCRC2D.js} +2 -2
- package/dist/cli/chunks/{chunk-R2M3RMCN.js → chunk-HMVL55QX.js} +2 -2
- package/dist/cli/chunks/{chunk-NOWGQ6YZ.js → chunk-HOFEAA4R.js} +1 -1
- package/dist/cli/chunks/{chunk-PFGH7TWL.js → chunk-HYT5EMES.js} +2 -2
- package/dist/cli/chunks/{chunk-AU4DQMLJ.js → chunk-IAHJ62JS.js} +4 -4
- package/dist/cli/chunks/{chunk-ZVF7QY4R.js → chunk-IIX5Y7BO.js} +1 -1
- package/dist/cli/chunks/{chunk-QAP5S7YC.js → chunk-ILZHECWZ.js} +3 -3
- package/dist/cli/chunks/{chunk-ZT2DGSIO.js → chunk-IUVAWWQG.js} +2 -2
- package/dist/cli/chunks/{chunk-ABVBHH7P.js → chunk-IVZVVZZ3.js} +3 -3
- package/dist/cli/chunks/{chunk-DZWZASDV.js → chunk-J2LAYCYZ.js} +1 -1
- package/dist/cli/chunks/{chunk-G7V2HDTH.js → chunk-JGHEGMLD.js} +3 -3
- package/dist/cli/chunks/{chunk-QFIKEZB5.js → chunk-K3BBLIWW.js} +2 -2
- package/dist/cli/chunks/{chunk-BSMUT672.js → chunk-K7XPKGOL.js} +2 -2
- package/dist/cli/chunks/{chunk-YHFCLJMY.js → chunk-KIBP3LGY.js} +1 -1
- package/dist/cli/chunks/{chunk-U6TZVACK.js → chunk-KRUKMGPF.js} +2 -2
- package/dist/cli/chunks/{chunk-UX4UHYLE.js → chunk-L2QHZFC3.js} +1 -1
- package/dist/cli/chunks/{chunk-O36VC7B7.js → chunk-LNV76GGB.js} +2 -2
- package/dist/cli/chunks/{chunk-NMQEU4BG.js → chunk-LOPM3YIO.js} +2 -2
- package/dist/cli/chunks/{chunk-LT6QHDPK.js → chunk-LSZLXLZA.js} +2 -2
- package/dist/cli/chunks/{chunk-NLUWPS2H.js → chunk-MILWEZSZ.js} +3 -3
- package/dist/cli/chunks/{chunk-LHKQW72O.js → chunk-MX6M2VPB.js} +1 -1
- package/dist/cli/chunks/{chunk-KRAWWBX5.js → chunk-N4OWZLH5.js} +2 -2
- package/dist/cli/chunks/{chunk-4MUZGQPE.js → chunk-N52WQO3G.js} +2 -2
- package/dist/cli/chunks/{chunk-246Z3PH6.js → chunk-N6NSZG7Z.js} +2 -2
- package/dist/cli/chunks/{chunk-OQUH7657.js → chunk-N6RSJGTW.js} +5 -5
- package/dist/cli/chunks/{chunk-WOGWIMQK.js → chunk-NKCL6RAF.js} +2 -2
- package/dist/cli/chunks/{chunk-C6JULAWA.js → chunk-NVJIOCS5.js} +5 -5
- package/dist/cli/chunks/{chunk-TKZABUHO.js → chunk-NYWK7ZSX.js} +1 -1
- package/dist/cli/chunks/{chunk-DNE6MVNA.js → chunk-O5NF6BBD.js} +1 -1
- package/dist/cli/chunks/{chunk-CWRSQQHV.js → chunk-O75SVMMB.js} +2 -2
- package/dist/cli/chunks/{chunk-OD4OIPXO.js → chunk-OHBZON7T.js} +1 -1
- package/dist/cli/chunks/{chunk-CLJNAQXB.js → chunk-OUBYADPD.js} +2 -2
- package/dist/cli/chunks/{chunk-PYQZ4OA3.js → chunk-OUSD2RWO.js} +2 -2
- package/dist/cli/chunks/{chunk-TVU6NMO3.js → chunk-OX2PGDUM.js} +3 -3
- package/dist/cli/chunks/{chunk-XLK4GP3I.js → chunk-P7CMWL7Y.js} +2 -2
- package/dist/cli/chunks/{chunk-7C5HI4ZA.js → chunk-PY4YQDBM.js} +4 -4
- package/dist/cli/chunks/{chunk-5U5SEO7C.js → chunk-QEDS3MOJ.js} +2 -2
- package/dist/cli/chunks/{chunk-WPBVLIWQ.js → chunk-QMN563LV.js} +18 -18
- package/dist/cli/chunks/{chunk-D2JCSWYM.js → chunk-QOR4YAZY.js} +2 -2
- package/dist/cli/chunks/{chunk-H4SHHYRD.js → chunk-QUTKELAS.js} +2 -2
- package/dist/cli/chunks/{chunk-42FBJF73.js → chunk-QXDZN2WX.js} +1 -1
- package/dist/cli/chunks/{chunk-OSP5AJAB.js → chunk-S456W64P.js} +2 -2
- package/dist/cli/chunks/{chunk-VHYNRISI.js → chunk-S7IHSELP.js} +2 -2
- package/dist/cli/chunks/{chunk-62MH7QAQ.js → chunk-S7ZHD6VN.js} +2 -2
- package/dist/cli/chunks/{chunk-QL6ZJ7RV.js → chunk-SU4YXUVK.js} +2 -2
- package/dist/cli/chunks/{chunk-JZNMU63B.js → chunk-SZPTUV3B.js} +2 -2
- package/dist/cli/chunks/{chunk-FALB6Z2Y.js → chunk-T7PUM6OY.js} +1 -1
- package/dist/cli/chunks/{chunk-BVEQPMOF.js → chunk-TCKBICJ3.js} +2 -2
- package/dist/cli/chunks/{chunk-Z6FRNWQA.js → chunk-TOQJWLJV.js} +2 -2
- package/dist/cli/chunks/{chunk-YB3PQ3UV.js → chunk-TUEDIQHY.js} +1 -1
- package/dist/cli/chunks/{chunk-CVRTXIYP.js → chunk-U5GCSSYX.js} +1 -1
- package/dist/cli/chunks/{chunk-WWGGL3TR.js → chunk-UDLN2THT.js} +1 -1
- package/dist/cli/chunks/{chunk-CLSHSVMY.js → chunk-V6YDM37M.js} +1 -1
- package/dist/cli/chunks/{chunk-ILPIH4Z6.js → chunk-VGR65B4Y.js} +1 -1
- package/dist/cli/chunks/{chunk-XEMP2PNW.js → chunk-VRHLHGKR.js} +2 -2
- package/dist/cli/chunks/{chunk-BM52ZEAD.js → chunk-VS2G6LX5.js} +2 -2
- package/dist/cli/chunks/{chunk-TOGD2JH2.js → chunk-W6RS5S4Q.js} +2 -2
- package/dist/cli/chunks/{chunk-UJBIHPU5.js → chunk-WEPZOCN7.js} +1 -1
- package/dist/cli/chunks/{chunk-OF3EMOWN.js → chunk-WIC5UZCQ.js} +2 -2
- package/dist/cli/chunks/{chunk-D7NWDUY3.js → chunk-X2OVUBF6.js} +2 -2
- package/dist/cli/chunks/{chunk-XYRJL7YN.js → chunk-X4GKYSOH.js} +2 -2
- package/dist/cli/chunks/{chunk-TXWUV3S5.js → chunk-XEVUW4QL.js} +2 -2
- package/dist/cli/chunks/{chunk-HAC7NB6R.js → chunk-XMDZRULK.js} +2 -2
- package/dist/cli/chunks/{chunk-UPGKS6Z3.js → chunk-YFY35CSD.js} +2 -2
- package/dist/cli/chunks/{chunk-7D5JE46U.js → chunk-Z6ADE3KJ.js} +2 -2
- package/dist/cli/chunks/{chunk-KJA5A3TV.js → chunk-ZKPOKMJZ.js} +2 -2
- package/dist/cli/chunks/{chunk-7PYEJ4NV.js → chunk-ZRWAFMM7.js} +2 -2
- package/dist/cli/chunks/{ci-KDEFR2X3.js → ci-KTWY7BZT.js} +2 -2
- package/dist/cli/chunks/{ci-output-Z3WXRRFI.js → ci-output-WOX6QBMS.js} +2 -2
- package/dist/cli/chunks/{circuit-breaker-GS44DEW2.js → circuit-breaker-6XKOSFIF.js} +2 -2
- package/dist/cli/chunks/{claude-flow-setup-OHVMHAAH.js → claude-flow-setup-5JA4MNE4.js} +2 -2
- package/dist/cli/chunks/client-X3KUJ6R5.js +2 -0
- package/dist/cli/chunks/{cline-installer-5TCF4MZD.js → cline-installer-Z2ANHEKW.js} +2 -2
- package/dist/cli/chunks/{code-3KCGTG7Z.js → code-NO4ZKNDU.js} +2 -2
- package/dist/cli/chunks/{code-index-extractor-LJBI54MZ.js → code-index-extractor-VV4OEPG7.js} +2 -2
- package/dist/cli/chunks/{codex-installer-IB62Z6LA.js → codex-installer-BP7Y2NYR.js} +2 -2
- package/dist/cli/chunks/{completions-JDXX7KKB.js → completions-YULJQUF4.js} +2 -2
- package/dist/cli/chunks/{complexity-analyzer-6JVDXXXP.js → complexity-analyzer-D7XYPQ76.js} +2 -2
- package/dist/cli/chunks/{continuedev-installer-PUB45QVR.js → continuedev-installer-E3L7UF72.js} +2 -2
- package/dist/cli/chunks/{copilot-installer-QWJ36P22.js → copilot-installer-5TRUMJC5.js} +2 -2
- package/dist/cli/chunks/core-handlers-A2EQB3UH.js +2 -0
- package/dist/cli/chunks/{cost-tracker-J3KEJDL5.js → cost-tracker-QTYSJMSV.js} +2 -2
- package/dist/cli/chunks/{coverage-FWKRI2EY.js → coverage-D5DKZ3XT.js} +3 -3
- package/dist/cli/chunks/cross-domain-router-OKZ2PDHT.js +2 -0
- package/dist/cli/chunks/{cursor-installer-2HYCUCTH.js → cursor-installer-UDBHGUIG.js} +2 -2
- package/dist/cli/chunks/{daemon-G3DBRWDQ.js → daemon-2GXYN7F7.js} +3 -3
- package/dist/cli/chunks/{daemon-BVP66DIZ.js → daemon-IVWUMQKL.js} +4 -4
- package/dist/cli/chunks/{dag-attention-scheduler-2AQLNB4B.js → dag-attention-scheduler-PWXR4QTU.js} +2 -2
- package/dist/cli/chunks/{detect-RUM5SHNE.js → detect-C6P7ONFB.js} +2 -2
- package/dist/cli/chunks/{dist-node-GX7MJHFT.js → dist-node-2BUFM2JK.js} +2 -2
- package/dist/cli/chunks/{domain-handler-OFBGZ2U5.js → domain-handler-Q2GWZLDM.js} +2 -2
- package/dist/cli/chunks/{domain-transfer-6CGRPRGR.js → domain-transfer-GMUBAM3J.js} +2 -2
- package/dist/cli/chunks/dream-ZBP4Z5C3.js +2 -0
- package/dist/cli/chunks/{embed-and-insert-pattern-MUOEVQX2.js → embed-and-insert-pattern-EFUERRM2.js} +2 -2
- package/dist/cli/chunks/{eval-SJMG67DE.js → eval-24FIC43F.js} +2 -2
- package/dist/cli/chunks/{experience-capture-middleware-ICKN6IXX.js → experience-capture-middleware-R4UP2Q2M.js} +3 -3
- package/dist/cli/chunks/{fast-paths-HXLBG3J4.js → fast-paths-RQCGGTXB.js} +2 -2
- package/dist/cli/chunks/{feature-flags-CRUB2ASU.js → feature-flags-APTWWVNQ.js} +2 -2
- package/dist/cli/chunks/{feature-flags-JYZSSQJC.js → feature-flags-SOXVYIBN.js} +2 -2
- package/dist/cli/chunks/{file-discovery-YHHC7NTJ.js → file-discovery-66KRMXVF.js} +2 -2
- package/dist/cli/chunks/{fleet-2VGDL4YL.js → fleet-EMBNKO5Q.js} +3 -3
- package/dist/cli/chunks/{gnn-wrapper-7ZAGD4S4.js → gnn-wrapper-6TKDWFJF.js} +2 -2
- package/dist/cli/chunks/{heartbeat-handler-HAW3JRHN.js → heartbeat-handler-4ODKJ75H.js} +4 -4
- package/dist/cli/chunks/heartbeat-scheduler-6JUWQXWG.js +2 -0
- package/dist/cli/chunks/hnsw-adapter-JT4BU7XJ.js +2 -0
- package/dist/cli/chunks/hnsw-index-JC5YELJX.js +2 -0
- package/dist/cli/chunks/{hnsw-legacy-bridge-BO325POX.js → hnsw-legacy-bridge-25KFCLUC.js} +2 -2
- package/dist/cli/chunks/{better-sqlite3-6A6EAXAT.js → hnswlib-node-FUWQTM2D.js} +2 -2
- package/dist/cli/chunks/{hooks-HKM3JTFQ.js → hooks-JIDA2COE.js} +10 -10
- package/dist/cli/chunks/hybrid-router-SLTXHUFG.js +2 -0
- package/dist/cli/chunks/{hypergraph-engine-LGLGHK6B.js → hypergraph-engine-3YDFDPE3.js} +2 -2
- package/dist/cli/chunks/{hypergraph-handler-6QDVREZA.js → hypergraph-handler-VWZX2OJX.js} +3 -3
- package/dist/cli/chunks/impact-analyzer-JXHCMZXY.js +2 -0
- package/dist/cli/chunks/{init-handler-XUQ7XHIE.js → init-handler-DH7VQAMF.js} +6 -6
- package/dist/cli/chunks/init-wizard-EX37TYOG.js +2 -0
- package/dist/cli/chunks/kernel-JPHAG27D.js +2 -0
- package/dist/cli/chunks/{kilocode-installer-6CEZLVIX.js → kilocode-installer-2W2KZCGH.js} +2 -2
- package/dist/cli/chunks/{kiro-installer-6CJGATOS.js → kiro-installer-E5KP7OMD.js} +2 -2
- package/dist/cli/chunks/knowledge-graph-5QJZIRYB.js +2 -0
- package/dist/cli/chunks/{learning-EIYTYZJY.js → learning-XJRUVPLF.js} +3 -3
- package/dist/cli/chunks/{llm-router-J4CI7VHU.js → llm-router-AEEKEMF5.js} +4 -4
- package/dist/cli/chunks/llm-router-service-SE2RO4P5.js +2 -0
- package/dist/cli/chunks/{load-CQPWGLQQ.js → load-PZ4YOTBJ.js} +2 -2
- package/dist/cli/chunks/load-test-LOTBWIIS.js +2 -0
- package/dist/cli/chunks/{mcp-THOATWCO.js → mcp-IVA6LC2S.js} +2 -2
- package/dist/cli/chunks/{memory-NZHMHMRK.js → memory-Y3DHXFQE.js} +5 -5
- package/dist/cli/chunks/memory-backend-BSDKTFAN.js +2 -0
- package/dist/cli/chunks/{memory-handlers-L2J54AQE.js → memory-handlers-V5PXEJWL.js} +2 -2
- package/dist/cli/chunks/{multi-model-executor-3P5E773H.js → multi-model-executor-646G4S4Y.js} +2 -2
- package/dist/cli/chunks/{opencode-installer-IRZMKSNG.js → opencode-installer-P6KOOTUS.js} +2 -2
- package/dist/cli/chunks/{orchestrator-UADLXTKP.js → orchestrator-T2GVKYMX.js} +5 -5
- package/dist/cli/chunks/pattern-null-store-LRSXCZWM.js +2 -0
- package/dist/cli/chunks/{pipeline-QEH3XHXJ.js → pipeline-CK2ON45P.js} +2 -2
- package/dist/cli/chunks/{platform-NEZ3NXLT.js → platform-OQNSD3A3.js} +2 -2
- package/dist/cli/chunks/{plugin-O33HR2VO.js → plugin-UOG6RNRM.js} +2 -2
- package/dist/cli/chunks/{prime-radiant-advanced-wasm-MBUMFEX7.js → prime-radiant-advanced-wasm-37UE6TG5.js} +2 -2
- package/dist/cli/chunks/protocol-executor-WPUVJEL7.js +2 -0
- package/dist/cli/chunks/{protocol-handler-L455UOUT.js → protocol-handler-V722S6YH.js} +2 -2
- package/dist/cli/chunks/{prove-3XA3SMAA.js → prove-ANGY6W3W.js} +2 -2
- package/dist/cli/chunks/provider-manager-EVPWSH3E.js +2 -0
- package/dist/cli/chunks/qe-reasoning-bank-IH63FG33.js +2 -0
- package/dist/cli/chunks/{quality-H6Z5JH5B.js → quality-KG4ALI2L.js} +2 -2
- package/dist/cli/chunks/queen-coordinator-TTCAGYQO.js +2 -0
- package/dist/cli/chunks/{real-embeddings-5DNJ4KEM.js → real-embeddings-GUZDO5UN.js} +2 -2
- package/dist/cli/chunks/{roocode-installer-KHXKR2FK.js → roocode-installer-WROAR6MJ.js} +2 -2
- package/dist/cli/chunks/router-64Q4ILOQ.js +2 -0
- package/dist/cli/chunks/routing-feedback-KCZV4XXC.js +2 -0
- package/dist/cli/chunks/{routing-handler-WAMGESEM.js → routing-handler-UFPSSS5D.js} +2 -2
- package/dist/cli/chunks/{ruvector-commands-4J7XC6XY.js → ruvector-commands-XJQMKDRM.js} +2 -2
- package/dist/cli/chunks/{rvf-dual-writer-3PZEN6XN.js → rvf-dual-writer-QPRMDKYX.js} +2 -2
- package/dist/cli/chunks/{rvf-migration-adapter-OIUNRQSU.js → rvf-migration-adapter-SOHBK23K.js} +2 -2
- package/dist/cli/chunks/{rvf-migration-coordinator-QZXDI4I5.js → rvf-migration-coordinator-MTWUSPEJ.js} +2 -2
- package/dist/cli/chunks/rvf-native-adapter-GNJKMURU.js +2 -0
- package/dist/cli/chunks/safe-db-6VBZQIJI.js +2 -0
- package/dist/cli/chunks/schedule-4V7O5IPX.js +2 -0
- package/dist/cli/chunks/scheduler-CQDMHEHN.js +2 -0
- package/dist/cli/chunks/{security-5NY77AMD.js → security-5MAMQKP6.js} +3 -3
- package/dist/cli/chunks/{shared-rvf-adapter-MHPUZIMW.js → shared-rvf-adapter-YEUBSRNN.js} +2 -2
- package/dist/cli/chunks/{shared-rvf-dual-writer-ITLDYHCX.js → shared-rvf-dual-writer-DBQJHG42.js} +2 -2
- package/dist/cli/chunks/sqlite-persistence-7DHUFTHL.js +2 -0
- package/dist/cli/chunks/{status-handler-7RBRIXZD.js → status-handler-ZUB2UKQZ.js} +2 -2
- package/dist/cli/chunks/{structural-health-MQPY6GA6.js → structural-health-B2GHENWX.js} +2 -2
- package/dist/cli/chunks/{sync-66KCEANE.js → sync-7VMXJTR2.js} +2 -2
- package/dist/cli/chunks/{sync-USVQTHKN.js → sync-YCUUW3IP.js} +2 -2
- package/dist/cli/chunks/{task-handler-4UI4FPPW.js → task-handler-N7LJTXZM.js} +2 -2
- package/dist/cli/chunks/{task-handlers-KRII3GVV.js → task-handlers-GDHNJV2E.js} +3 -3
- package/dist/cli/chunks/{test-JHN2MVEG.js → test-6COGC5KI.js} +4 -4
- package/dist/cli/chunks/{test-scheduling-ZWTEGS3S.js → test-scheduling-CUERHJMF.js} +3 -3
- package/dist/cli/chunks/{token-bootstrap-YWXL6AS5.js → token-bootstrap-JTGSL6PP.js} +2 -2
- package/dist/cli/chunks/{token-usage-INII2XM3.js → token-usage-LSG3JYGX.js} +2 -2
- package/dist/cli/chunks/{transformers-DVFGDNZC.js → transformers-ODIITRCT.js} +2 -2
- package/dist/cli/chunks/{tree-sitter-wasm-parser-W2XJT3XF.js → tree-sitter-wasm-parser-KSP7ZZ5H.js} +2 -2
- package/dist/cli/chunks/{types-GBZ5Q2GP.js → types-6N6SUU2O.js} +2 -2
- package/dist/cli/chunks/unified-memory-MQA72NLP.js +2 -0
- package/dist/cli/chunks/unified-memory-hnsw-K7HA3CWV.js +2 -0
- package/dist/cli/chunks/unified-persistence-2DXB4OE4.js +2 -0
- package/dist/cli/chunks/{upgrade-2JEXEGQX.js → upgrade-7SCVOCPS.js} +2 -2
- package/dist/cli/chunks/{validate-GDCM5YTS.js → validate-762ISH2Y.js} +2 -2
- package/dist/cli/chunks/{validate-swarm-QZ5RSJEU.js → validate-swarm-R6WYYXGO.js} +2 -2
- package/dist/cli/chunks/{vibium-I5BMT734.js → vibium-5GZYSUDQ.js} +2 -2
- package/dist/cli/chunks/visual-security-UD6CARIJ.js +2 -0
- package/dist/cli/chunks/{web-tree-sitter-3QY2LMLP.js → web-tree-sitter-VYYVAJTY.js} +2 -2
- package/dist/cli/chunks/{windsurf-installer-V7OBPLOB.js → windsurf-installer-RRIOR3B6.js} +2 -2
- package/dist/cli/chunks/witness-chain-LWALPPMC.js +2 -0
- package/dist/cli/chunks/{witness-chain-BNJ4VSZX.js → witness-chain-SRVBEKDB.js} +2 -2
- package/dist/cli/chunks/{workflow-3FJSNLPI.js → workflow-XNUDHGEC.js} +4 -4
- package/dist/cli/chunks/workflow-orchestrator-QU652FLH.js +2 -0
- package/dist/cli/chunks/{wrappers-ERTQNIPK.js → wrappers-3STST7QW.js} +2 -2
- package/dist/domains/requirements-validation/coordinator.d.ts +16 -2
- package/dist/domains/requirements-validation/coordinator.js +112 -7
- package/dist/domains/requirements-validation/plugin.js +20 -1
- package/dist/domains/test-generation/coordinator.d.ts +26 -1
- package/dist/domains/test-generation/coordinator.js +119 -2
- package/dist/domains/test-generation/plugin.js +23 -1
- package/dist/integrations/darwin/index.d.ts +10 -0
- package/dist/integrations/darwin/index.js +2 -0
- package/dist/integrations/darwin/qe-fitness.d.ts +83 -0
- package/dist/integrations/darwin/qe-fitness.js +147 -0
- package/dist/integrations/darwin/types.d.ts +69 -0
- package/dist/integrations/darwin/types.js +21 -0
- package/dist/mcp/bundle.js +390 -379
- package/dist/mcp/tool-scoping.d.ts +8 -2
- package/dist/mcp/tool-scoping.js +13 -0
- package/dist/routing/escalation/auto-escalation-tracker.d.ts +34 -15
- package/dist/routing/escalation/auto-escalation-tracker.js +24 -15
- package/dist/routing/free-tier/coordinator-support.d.ts +90 -0
- package/dist/routing/free-tier/coordinator-support.js +78 -0
- package/dist/routing/free-tier/executor.d.ts +161 -0
- package/dist/routing/free-tier/executor.js +182 -0
- package/dist/routing/free-tier/feedback-sink.d.ts +49 -0
- package/dist/routing/free-tier/feedback-sink.js +52 -0
- package/dist/routing/free-tier/index.d.ts +15 -0
- package/dist/routing/free-tier/index.js +6 -0
- package/dist/routing/free-tier/ladder.d.ts +41 -0
- package/dist/routing/free-tier/ladder.js +78 -0
- package/dist/routing/free-tier/provider.d.ts +57 -0
- package/dist/routing/free-tier/provider.js +111 -0
- package/dist/routing/free-tier/types.d.ts +80 -0
- package/dist/routing/free-tier/types.js +16 -0
- package/dist/routing/value-score.d.ts +49 -0
- package/dist/routing/value-score.js +54 -0
- package/dist/shared/optional-module.d.ts +23 -0
- package/dist/shared/optional-module.js +46 -0
- package/dist/verification/adversarial-verify/calibrate.d.ts +32 -0
- package/dist/verification/adversarial-verify/calibrate.js +33 -0
- package/dist/verification/adversarial-verify/gate.d.ts +38 -0
- package/dist/verification/adversarial-verify/gate.js +32 -0
- package/dist/verification/adversarial-verify/index.d.ts +20 -0
- package/dist/verification/adversarial-verify/index.js +6 -0
- package/dist/verification/adversarial-verify/prompts.d.ts +14 -0
- package/dist/verification/adversarial-verify/prompts.js +17 -0
- package/dist/verification/adversarial-verify/synthesize.d.ts +18 -0
- package/dist/verification/adversarial-verify/synthesize.js +35 -0
- package/dist/verification/adversarial-verify/types.d.ts +59 -0
- package/dist/verification/adversarial-verify/types.js +10 -0
- package/dist/verification/adversarial-verify/verify.d.ts +20 -0
- package/dist/verification/adversarial-verify/verify.js +34 -0
- package/package.json +14 -1
- package/dist/cli/chunks/adapter-TRSV37EA.js +0 -2
- package/dist/cli/chunks/aqe-learning-engine-CVJRJOSO.js +0 -2
- package/dist/cli/chunks/base-BX4A2D4V.js +0 -2
- package/dist/cli/chunks/browser-workflow-O3RL7EYT.js +0 -2
- package/dist/cli/chunks/chunk-OPKEQYAC.js +0 -2
- package/dist/cli/chunks/client-T263ZXVV.js +0 -2
- package/dist/cli/chunks/core-handlers-ODKKGCFK.js +0 -2
- package/dist/cli/chunks/cross-domain-router-APU725GC.js +0 -2
- package/dist/cli/chunks/dream-PJ5GKY3J.js +0 -2
- package/dist/cli/chunks/heartbeat-scheduler-4ZHUIW3Q.js +0 -2
- package/dist/cli/chunks/hnsw-adapter-UVJJ6TTP.js +0 -2
- package/dist/cli/chunks/hnsw-index-K6HS34JZ.js +0 -2
- package/dist/cli/chunks/hybrid-router-25S7OH2Y.js +0 -2
- package/dist/cli/chunks/impact-analyzer-UP4RDMJH.js +0 -2
- package/dist/cli/chunks/init-wizard-2PAJ3GEC.js +0 -2
- package/dist/cli/chunks/kernel-7WOQGMMT.js +0 -2
- package/dist/cli/chunks/knowledge-graph-FN2AWHGR.js +0 -2
- package/dist/cli/chunks/llm-router-service-C3UPBAS3.js +0 -2
- package/dist/cli/chunks/load-test-PQSGLDXJ.js +0 -2
- package/dist/cli/chunks/memory-backend-6FR4RT5O.js +0 -2
- package/dist/cli/chunks/pattern-null-store-B2UX4NZY.js +0 -2
- package/dist/cli/chunks/protocol-executor-OQ6SL7SR.js +0 -2
- package/dist/cli/chunks/provider-manager-DQWHW2RG.js +0 -2
- package/dist/cli/chunks/qe-reasoning-bank-3JS2CZAE.js +0 -2
- package/dist/cli/chunks/queen-coordinator-KXCWEM3Y.js +0 -2
- package/dist/cli/chunks/router-OVLIKT55.js +0 -2
- package/dist/cli/chunks/routing-feedback-2BYCXNXX.js +0 -2
- package/dist/cli/chunks/rvf-native-adapter-YNUYOQ5C.js +0 -2
- package/dist/cli/chunks/safe-db-6TYYEU7C.js +0 -2
- package/dist/cli/chunks/schedule-XVH7RTVY.js +0 -2
- package/dist/cli/chunks/scheduler-DHZBN5HA.js +0 -2
- package/dist/cli/chunks/sqlite-persistence-NR5WXTPN.js +0 -2
- package/dist/cli/chunks/unified-memory-WJEZ5YAK.js +0 -2
- package/dist/cli/chunks/unified-memory-hnsw-6ZA2PMYO.js +0 -2
- package/dist/cli/chunks/unified-persistence-SWH6R7MA.js +0 -2
- package/dist/cli/chunks/visual-security-PH5JQZCZ.js +0 -2
- package/dist/cli/chunks/witness-chain-WYMBNGSL.js +0 -2
- package/dist/cli/chunks/workflow-orchestrator-56JIXCI4.js +0 -2
|
@@ -1,9 +1,7 @@
|
|
|
1
1
|
---
|
|
2
|
-
name: "
|
|
3
|
-
description:
|
|
4
|
-
|
|
5
|
-
category: "quality-assurance"
|
|
6
|
-
tags: ["verification", "truth-scoring", "quality", "rollback", "metrics", "ci-cd"]
|
|
2
|
+
name: "Verification & Quality Assurance"
|
|
3
|
+
description: |
|
|
4
|
+
Comprehensive truth scoring, code quality verification, and automatic rollback system with 0.95 accuracy threshold for ensuring high-quality agent outputs and codebase reliability.
|
|
7
5
|
---
|
|
8
6
|
|
|
9
7
|
# Verification & Quality Assurance Skill
|
|
@@ -19,26 +17,70 @@ This skill provides a comprehensive verification and quality assurance system th
|
|
|
19
17
|
- **CI/CD Integration**: Export capabilities for continuous integration pipelines
|
|
20
18
|
- **Real-time Monitoring**: Live dashboards and watch modes for ongoing verification
|
|
21
19
|
|
|
20
|
+
> **Shipped vs. aspirational.** The *concrete, in-CI* verification stack — the 6 regression-guard jobs + the witness manifest + the tool-discoverability audit — is real and runs on every push. The truth-scoring / auto-rollback / WebSocket-dashboard surface described later in this doc is partly shipped (`ruflo verify` runs the witness checks) and partly design — treat the "CI Guards" section below as the authoritative current state.
|
|
21
|
+
|
|
22
|
+
## CI Guards — what's actually shipped (current state)
|
|
23
|
+
|
|
24
|
+
Ruflo's regression protection is three layers, all gated before publish. Authoritative reference: [`verification/README.md`](../../../verification/README.md).
|
|
25
|
+
|
|
26
|
+
| Layer | What | CI job(s) in `.github/workflows/v3-ci.yml` | ADR |
|
|
27
|
+
|---|---|---|---|
|
|
28
|
+
| **1 — install/behavioral smoke** | Exercise user-visible failure modes against a real build | `smoke-install-no-bsqlite` (npm install on platforms w/o prebuilds), `plugin-hooks-smoke` (#1859/#1862 — hook flag parsing), `mcp-protocol-smoke` (#1874 — HTTP MCP wire format), `memory-import-smoke` (#1883/#1884 — WSL path + key sanitization), `mcp-roundtrip-smoke` (#1889 paired-tool round-trip + #1863 cli-no-crash + ADR-095 G2 consensus-transport) | ADR-102 |
|
|
29
|
+
| **1 — discoverability gate** | Every MCP tool description must answer "use this over native when?" | `tool-descriptions-audit` — `scripts/audit-tool-descriptions.mjs`, baseline at `verification/mcp-tool-baseline.json` (monotone-decreasing: noGuidance / tooShort / duplicates) | ADR-112 |
|
|
30
|
+
| **2 — cryptographic witness** | Every documented fix's load-bearing marker must still be present in dist; Ed25519-signed, per-OS bundles | `witness-verify` (ubuntu/macos/windows) — `plugins/ruflo-core/scripts/witness/verify.mjs` against `verification/<os>/manifest.md.json` | ADR-103 |
|
|
31
|
+
| **3 — temporal history** | When was a regression introduced | `verification/<os>/history.jsonl` + `history.mjs` (`summary` / `regressions` / `timeline`) | ADR-103 |
|
|
32
|
+
|
|
33
|
+
### Run the guards locally
|
|
34
|
+
|
|
35
|
+
```bash
|
|
36
|
+
# Tool-description discoverability audit (ADR-112)
|
|
37
|
+
node scripts/audit-tool-descriptions.mjs # fails if any baseline count rises
|
|
38
|
+
node scripts/audit-tool-descriptions.mjs --update-baseline # lock the new floor after a fix lands
|
|
39
|
+
|
|
40
|
+
# Behavioral smokes (each builds what it needs; safe to run individually)
|
|
41
|
+
node plugins/ruflo-core/scripts/test-hooks.mjs "node $PWD/v3/@claude-flow/cli/bin/cli.js"
|
|
42
|
+
node plugins/ruflo-core/scripts/test-mcp-protocol.mjs
|
|
43
|
+
node plugins/ruflo-core/scripts/test-memory-import.mjs
|
|
44
|
+
node plugins/ruflo-core/scripts/test-mcp-roundtrips.mjs # #1889 paired-tool round-trip
|
|
45
|
+
node plugins/ruflo-core/scripts/test-cli-no-crash.mjs # #1863 unhandled-exception class
|
|
46
|
+
node plugins/ruflo-core/scripts/test-consensus-transport.mjs # ADR-095 G2 consensus transport
|
|
47
|
+
|
|
48
|
+
# Witness manifest — regenerate + verify
|
|
49
|
+
node scripts/regen-witness.mjs
|
|
50
|
+
node plugins/ruflo-core/scripts/witness/verify.mjs --manifest verification/macos/manifest.md.json
|
|
51
|
+
|
|
52
|
+
# Temporal history
|
|
53
|
+
node plugins/ruflo-core/scripts/witness/history.mjs --history verification/macos/history.jsonl summary
|
|
54
|
+
node plugins/ruflo-core/scripts/witness/history.mjs --history verification/macos/history.jsonl regressions
|
|
55
|
+
```
|
|
56
|
+
|
|
57
|
+
### Adding a new guard
|
|
58
|
+
|
|
59
|
+
1. **Behavioral smoke** → write `plugins/ruflo-core/scripts/test-<name>.mjs`. Pattern: static dist-scan first (fast, always completes), behavioral probe second with an internal timeout + a process-level watchdog so CI never hangs. Add a step to the relevant job in `v3-ci.yml`.
|
|
60
|
+
2. **Static gate with a baseline** → write `scripts/audit-<name>.mjs` that scans, counts violations, and fails if the count exceeds a monotone-decreasing baseline in `verification/<name>-baseline.json`. Support `--update-baseline`. Add a CI job; wire it into `witness-verify` `needs[]` if it should gate `publish`.
|
|
61
|
+
3. **Documented-fix marker** → append `{ id, desc, file, marker }` to `verification/witness-fixes.json`, run `node scripts/regen-witness.mjs`. The marker must be a substring the fix specifically creates (not a generic pattern like `'function'`).
|
|
62
|
+
|
|
22
63
|
## Prerequisites
|
|
23
64
|
|
|
24
|
-
-
|
|
65
|
+
- Ruflo installed (`npx ruflo@alpha`)
|
|
25
66
|
- Git repository (for rollback features)
|
|
26
67
|
- Node.js 18+ (for dashboard features)
|
|
68
|
+
- `@noble/ed25519` (for the witness verifier — a single runtime dep, `npm i @noble/ed25519`)
|
|
27
69
|
|
|
28
70
|
## Quick Start
|
|
29
71
|
|
|
30
72
|
```bash
|
|
31
73
|
# View current truth scores
|
|
32
|
-
npx
|
|
74
|
+
npx ruflo@alpha truth
|
|
33
75
|
|
|
34
76
|
# Run verification check
|
|
35
|
-
npx
|
|
77
|
+
npx ruflo@alpha verify check
|
|
36
78
|
|
|
37
79
|
# Verify specific file with custom threshold
|
|
38
|
-
npx
|
|
80
|
+
npx ruflo@alpha verify check --file src/app.js --threshold 0.98
|
|
39
81
|
|
|
40
82
|
# Rollback last failed verification
|
|
41
|
-
npx
|
|
83
|
+
npx ruflo@alpha verify rollback --last-good
|
|
42
84
|
```
|
|
43
85
|
|
|
44
86
|
---
|
|
@@ -54,40 +96,40 @@ Display comprehensive quality and reliability metrics for your codebase and agen
|
|
|
54
96
|
**Basic Usage:**
|
|
55
97
|
```bash
|
|
56
98
|
# View current truth scores (default: table format)
|
|
57
|
-
npx
|
|
99
|
+
npx ruflo@alpha truth
|
|
58
100
|
|
|
59
101
|
# View scores for specific time period
|
|
60
|
-
npx
|
|
102
|
+
npx ruflo@alpha truth --period 7d
|
|
61
103
|
|
|
62
104
|
# View scores for specific agent
|
|
63
|
-
npx
|
|
105
|
+
npx ruflo@alpha truth --agent coder --period 24h
|
|
64
106
|
|
|
65
107
|
# Find files/tasks below threshold
|
|
66
|
-
npx
|
|
108
|
+
npx ruflo@alpha truth --threshold 0.8
|
|
67
109
|
```
|
|
68
110
|
|
|
69
111
|
**Output Formats:**
|
|
70
112
|
```bash
|
|
71
113
|
# Table format (default)
|
|
72
|
-
npx
|
|
114
|
+
npx ruflo@alpha truth --format table
|
|
73
115
|
|
|
74
116
|
# JSON for programmatic access
|
|
75
|
-
npx
|
|
117
|
+
npx ruflo@alpha truth --format json
|
|
76
118
|
|
|
77
119
|
# CSV for spreadsheet analysis
|
|
78
|
-
npx
|
|
120
|
+
npx ruflo@alpha truth --format csv
|
|
79
121
|
|
|
80
122
|
# HTML report with visualizations
|
|
81
|
-
npx
|
|
123
|
+
npx ruflo@alpha truth --format html --export report.html
|
|
82
124
|
```
|
|
83
125
|
|
|
84
126
|
**Real-time Monitoring:**
|
|
85
127
|
```bash
|
|
86
128
|
# Watch mode with live updates
|
|
87
|
-
npx
|
|
129
|
+
npx ruflo@alpha truth --watch
|
|
88
130
|
|
|
89
131
|
# Export metrics automatically
|
|
90
|
-
npx
|
|
132
|
+
npx ruflo@alpha truth --export .claude-flow/metrics/truth-$(date +%Y%m%d).json
|
|
91
133
|
```
|
|
92
134
|
|
|
93
135
|
#### Truth Score Dashboard
|
|
@@ -143,40 +185,40 @@ Execute comprehensive verification checks on code, tasks, or agent outputs.
|
|
|
143
185
|
**File Verification:**
|
|
144
186
|
```bash
|
|
145
187
|
# Verify single file
|
|
146
|
-
npx
|
|
188
|
+
npx ruflo@alpha verify check --file src/app.js
|
|
147
189
|
|
|
148
190
|
# Verify directory recursively
|
|
149
|
-
npx
|
|
191
|
+
npx ruflo@alpha verify check --directory src/
|
|
150
192
|
|
|
151
193
|
# Verify with auto-fix enabled
|
|
152
|
-
npx
|
|
194
|
+
npx ruflo@alpha verify check --file src/utils.js --auto-fix
|
|
153
195
|
|
|
154
196
|
# Verify current working directory
|
|
155
|
-
npx
|
|
197
|
+
npx ruflo@alpha verify check
|
|
156
198
|
```
|
|
157
199
|
|
|
158
200
|
**Task Verification:**
|
|
159
201
|
```bash
|
|
160
202
|
# Verify specific task output
|
|
161
|
-
npx
|
|
203
|
+
npx ruflo@alpha verify check --task task-123
|
|
162
204
|
|
|
163
205
|
# Verify with custom threshold
|
|
164
|
-
npx
|
|
206
|
+
npx ruflo@alpha verify check --task task-456 --threshold 0.99
|
|
165
207
|
|
|
166
208
|
# Verbose output for debugging
|
|
167
|
-
npx
|
|
209
|
+
npx ruflo@alpha verify check --task task-789 --verbose
|
|
168
210
|
```
|
|
169
211
|
|
|
170
212
|
**Batch Verification:**
|
|
171
213
|
```bash
|
|
172
214
|
# Verify multiple files in parallel
|
|
173
|
-
npx
|
|
215
|
+
npx ruflo@alpha verify batch --files "*.js" --parallel
|
|
174
216
|
|
|
175
217
|
# Verify with pattern matching
|
|
176
|
-
npx
|
|
218
|
+
npx ruflo@alpha verify batch --pattern "src/**/*.ts"
|
|
177
219
|
|
|
178
220
|
# Integration test suite
|
|
179
|
-
npx
|
|
221
|
+
npx ruflo@alpha verify integration --test-suite full
|
|
180
222
|
```
|
|
181
223
|
|
|
182
224
|
#### Verification Criteria
|
|
@@ -217,7 +259,7 @@ The verification system evaluates:
|
|
|
217
259
|
|
|
218
260
|
```bash
|
|
219
261
|
# Get structured JSON output
|
|
220
|
-
npx
|
|
262
|
+
npx ruflo@alpha verify check --json > verification.json
|
|
221
263
|
|
|
222
264
|
# Example JSON structure:
|
|
223
265
|
{
|
|
@@ -249,25 +291,25 @@ Automatically revert changes that fail verification checks.
|
|
|
249
291
|
**Basic Rollback:**
|
|
250
292
|
```bash
|
|
251
293
|
# Rollback to last known good state
|
|
252
|
-
npx
|
|
294
|
+
npx ruflo@alpha verify rollback --last-good
|
|
253
295
|
|
|
254
296
|
# Rollback to specific commit
|
|
255
|
-
npx
|
|
297
|
+
npx ruflo@alpha verify rollback --to-commit abc123
|
|
256
298
|
|
|
257
299
|
# Interactive rollback with preview
|
|
258
|
-
npx
|
|
300
|
+
npx ruflo@alpha verify rollback --interactive
|
|
259
301
|
```
|
|
260
302
|
|
|
261
303
|
**Smart Rollback:**
|
|
262
304
|
```bash
|
|
263
305
|
# Rollback only failed files (preserve good changes)
|
|
264
|
-
npx
|
|
306
|
+
npx ruflo@alpha verify rollback --selective
|
|
265
307
|
|
|
266
308
|
# Rollback with automatic backup
|
|
267
|
-
npx
|
|
309
|
+
npx ruflo@alpha verify rollback --backup-first
|
|
268
310
|
|
|
269
311
|
# Dry-run mode (preview without executing)
|
|
270
|
-
npx
|
|
312
|
+
npx ruflo@alpha verify rollback --dry-run
|
|
271
313
|
```
|
|
272
314
|
|
|
273
315
|
**Rollback Performance:**
|
|
@@ -284,31 +326,31 @@ Create detailed verification reports with metrics and visualizations.
|
|
|
284
326
|
**Report Formats:**
|
|
285
327
|
```bash
|
|
286
328
|
# JSON report
|
|
287
|
-
npx
|
|
329
|
+
npx ruflo@alpha verify report --format json
|
|
288
330
|
|
|
289
331
|
# HTML report with charts
|
|
290
|
-
npx
|
|
332
|
+
npx ruflo@alpha verify report --export metrics.html --format html
|
|
291
333
|
|
|
292
334
|
# CSV for data analysis
|
|
293
|
-
npx
|
|
335
|
+
npx ruflo@alpha verify report --format csv --export metrics.csv
|
|
294
336
|
|
|
295
337
|
# Markdown summary
|
|
296
|
-
npx
|
|
338
|
+
npx ruflo@alpha verify report --format markdown
|
|
297
339
|
```
|
|
298
340
|
|
|
299
341
|
**Time-based Reports:**
|
|
300
342
|
```bash
|
|
301
343
|
# Last 24 hours
|
|
302
|
-
npx
|
|
344
|
+
npx ruflo@alpha verify report --period 24h
|
|
303
345
|
|
|
304
346
|
# Last 7 days
|
|
305
|
-
npx
|
|
347
|
+
npx ruflo@alpha verify report --period 7d
|
|
306
348
|
|
|
307
349
|
# Last 30 days with trends
|
|
308
|
-
npx
|
|
350
|
+
npx ruflo@alpha verify report --period 30d --include-trends
|
|
309
351
|
|
|
310
352
|
# Custom date range
|
|
311
|
-
npx
|
|
353
|
+
npx ruflo@alpha verify report --from 2025-01-01 --to 2025-01-31
|
|
312
354
|
```
|
|
313
355
|
|
|
314
356
|
**Report Content:**
|
|
@@ -328,16 +370,16 @@ Run interactive web-based verification dashboard with real-time updates.
|
|
|
328
370
|
|
|
329
371
|
```bash
|
|
330
372
|
# Launch dashboard on default port (3000)
|
|
331
|
-
npx
|
|
373
|
+
npx ruflo@alpha verify dashboard
|
|
332
374
|
|
|
333
375
|
# Custom port
|
|
334
|
-
npx
|
|
376
|
+
npx ruflo@alpha verify dashboard --port 8080
|
|
335
377
|
|
|
336
378
|
# Export dashboard data
|
|
337
|
-
npx
|
|
379
|
+
npx ruflo@alpha verify dashboard --export
|
|
338
380
|
|
|
339
381
|
# Dashboard with auto-refresh
|
|
340
|
-
npx
|
|
382
|
+
npx ruflo@alpha verify dashboard --refresh 5s
|
|
341
383
|
```
|
|
342
384
|
|
|
343
385
|
**Dashboard Features:**
|
|
@@ -392,13 +434,13 @@ Set verification preferences in `.claude-flow/config.json`:
|
|
|
392
434
|
**Adjust verification strictness:**
|
|
393
435
|
```bash
|
|
394
436
|
# Strict mode (99% accuracy required)
|
|
395
|
-
npx
|
|
437
|
+
npx ruflo@alpha verify check --threshold 0.99
|
|
396
438
|
|
|
397
439
|
# Lenient mode (90% acceptable)
|
|
398
|
-
npx
|
|
440
|
+
npx ruflo@alpha verify check --threshold 0.90
|
|
399
441
|
|
|
400
442
|
# Set default threshold
|
|
401
|
-
npx
|
|
443
|
+
npx ruflo@alpha config set verification.threshold 0.98
|
|
402
444
|
```
|
|
403
445
|
|
|
404
446
|
**Per-environment thresholds:**
|
|
@@ -428,14 +470,14 @@ jobs:
|
|
|
428
470
|
verify:
|
|
429
471
|
runs-on: ubuntu-latest
|
|
430
472
|
steps:
|
|
431
|
-
- uses: actions/checkout@
|
|
473
|
+
- uses: actions/checkout@v4
|
|
432
474
|
|
|
433
475
|
- name: Install Dependencies
|
|
434
476
|
run: npm install
|
|
435
477
|
|
|
436
478
|
- name: Run Verification
|
|
437
479
|
run: |
|
|
438
|
-
npx
|
|
480
|
+
npx ruflo@alpha verify check --json > verification.json
|
|
439
481
|
|
|
440
482
|
- name: Check Truth Score
|
|
441
483
|
run: |
|
|
@@ -457,7 +499,7 @@ jobs:
|
|
|
457
499
|
verify:
|
|
458
500
|
stage: test
|
|
459
501
|
script:
|
|
460
|
-
- npx
|
|
502
|
+
- npx ruflo@alpha verify check --threshold 0.95 --json > verification.json
|
|
461
503
|
- |
|
|
462
504
|
score=$(jq '.overallScore' verification.json)
|
|
463
505
|
if [ $(echo "$score < 0.95" | bc) -eq 1 ]; then
|
|
@@ -477,13 +519,13 @@ Run verification automatically during swarm operations:
|
|
|
477
519
|
|
|
478
520
|
```bash
|
|
479
521
|
# Swarm with verification enabled
|
|
480
|
-
npx
|
|
522
|
+
npx ruflo@alpha swarm --verify --threshold 0.98
|
|
481
523
|
|
|
482
524
|
# Hive Mind with auto-rollback
|
|
483
|
-
npx
|
|
525
|
+
npx ruflo@alpha hive-mind --verify --rollback-on-fail
|
|
484
526
|
|
|
485
527
|
# Training pipeline with verification
|
|
486
|
-
npx
|
|
528
|
+
npx ruflo@alpha train --verify --threshold 0.99
|
|
487
529
|
```
|
|
488
530
|
|
|
489
531
|
#### Pair Programming Integration
|
|
@@ -492,10 +534,10 @@ Enable real-time verification during collaborative development:
|
|
|
492
534
|
|
|
493
535
|
```bash
|
|
494
536
|
# Pair with verification
|
|
495
|
-
npx
|
|
537
|
+
npx ruflo@alpha pair --verify --real-time
|
|
496
538
|
|
|
497
539
|
# Pair with custom threshold
|
|
498
|
-
npx
|
|
540
|
+
npx ruflo@alpha pair --verify --threshold 0.97 --auto-fix
|
|
499
541
|
```
|
|
500
542
|
|
|
501
543
|
### Advanced Workflows
|
|
@@ -506,13 +548,13 @@ Monitor codebase continuously during development:
|
|
|
506
548
|
|
|
507
549
|
```bash
|
|
508
550
|
# Watch directory for changes
|
|
509
|
-
npx
|
|
551
|
+
npx ruflo@alpha verify watch --directory src/
|
|
510
552
|
|
|
511
553
|
# Watch with auto-fix
|
|
512
|
-
npx
|
|
554
|
+
npx ruflo@alpha verify watch --directory src/ --auto-fix
|
|
513
555
|
|
|
514
556
|
# Watch with notifications
|
|
515
|
-
npx
|
|
557
|
+
npx ruflo@alpha verify watch --notify --threshold 0.95
|
|
516
558
|
```
|
|
517
559
|
|
|
518
560
|
#### Monitoring Integration
|
|
@@ -521,18 +563,18 @@ Send metrics to external monitoring systems:
|
|
|
521
563
|
|
|
522
564
|
```bash
|
|
523
565
|
# Export to Prometheus
|
|
524
|
-
npx
|
|
566
|
+
npx ruflo@alpha truth --format json | \
|
|
525
567
|
curl -X POST https://pushgateway.example.com/metrics/job/claude-flow \
|
|
526
568
|
-d @-
|
|
527
569
|
|
|
528
570
|
# Send to DataDog
|
|
529
|
-
npx
|
|
571
|
+
npx ruflo@alpha verify report --format json | \
|
|
530
572
|
curl -X POST "https://api.datadoghq.com/api/v1/series?api_key=${DD_API_KEY}" \
|
|
531
573
|
-H "Content-Type: application/json" \
|
|
532
574
|
-d @-
|
|
533
575
|
|
|
534
576
|
# Custom webhook
|
|
535
|
-
npx
|
|
577
|
+
npx ruflo@alpha truth --format json | \
|
|
536
578
|
curl -X POST https://metrics.example.com/api/truth \
|
|
537
579
|
-H "Content-Type: application/json" \
|
|
538
580
|
-d @-
|
|
@@ -544,16 +586,16 @@ Automatically verify before commits:
|
|
|
544
586
|
|
|
545
587
|
```bash
|
|
546
588
|
# Install pre-commit hook
|
|
547
|
-
npx
|
|
589
|
+
npx ruflo@alpha verify install-hook --pre-commit
|
|
548
590
|
|
|
549
591
|
# .git/hooks/pre-commit example:
|
|
550
592
|
#!/bin/bash
|
|
551
|
-
npx
|
|
593
|
+
npx ruflo@alpha verify check --threshold 0.95 --json > /tmp/verify.json
|
|
552
594
|
|
|
553
595
|
score=$(jq '.overallScore' /tmp/verify.json)
|
|
554
596
|
if (( $(echo "$score < 0.95" | bc -l) )); then
|
|
555
597
|
echo "❌ Verification failed with score: $score"
|
|
556
|
-
echo "Run 'npx
|
|
598
|
+
echo "Run 'npx ruflo@alpha verify check --verbose' for details"
|
|
557
599
|
exit 1
|
|
558
600
|
fi
|
|
559
601
|
|
|
@@ -585,13 +627,13 @@ echo "✅ Verification passed with score: $score"
|
|
|
585
627
|
**Low Truth Scores:**
|
|
586
628
|
```bash
|
|
587
629
|
# Get detailed breakdown
|
|
588
|
-
npx
|
|
630
|
+
npx ruflo@alpha truth --verbose --threshold 0.0
|
|
589
631
|
|
|
590
632
|
# Check specific criteria
|
|
591
|
-
npx
|
|
633
|
+
npx ruflo@alpha verify check --verbose
|
|
592
634
|
|
|
593
635
|
# View agent-specific issues
|
|
594
|
-
npx
|
|
636
|
+
npx ruflo@alpha truth --agent <agent-name> --format json
|
|
595
637
|
```
|
|
596
638
|
|
|
597
639
|
**Rollback Failures:**
|
|
@@ -600,7 +642,7 @@ npx claude-flow@alpha truth --agent <agent-name> --format json
|
|
|
600
642
|
git status
|
|
601
643
|
|
|
602
644
|
# View rollback history
|
|
603
|
-
npx
|
|
645
|
+
npx ruflo@alpha verify rollback --history
|
|
604
646
|
|
|
605
647
|
# Manual rollback
|
|
606
648
|
git reset --hard HEAD~1
|
|
@@ -609,10 +651,10 @@ git reset --hard HEAD~1
|
|
|
609
651
|
**Verification Timeouts:**
|
|
610
652
|
```bash
|
|
611
653
|
# Increase timeout
|
|
612
|
-
npx
|
|
654
|
+
npx ruflo@alpha verify check --timeout 60s
|
|
613
655
|
|
|
614
656
|
# Verify in batches
|
|
615
|
-
npx
|
|
657
|
+
npx ruflo@alpha verify batch --batch-size 10
|
|
616
658
|
```
|
|
617
659
|
|
|
618
660
|
### Exit Codes
|
|
@@ -625,10 +667,10 @@ Verification commands return standard exit codes:
|
|
|
625
667
|
|
|
626
668
|
### Related Commands
|
|
627
669
|
|
|
628
|
-
- `npx
|
|
629
|
-
- `npx
|
|
630
|
-
- `npx
|
|
631
|
-
- `npx
|
|
670
|
+
- `npx ruflo@alpha pair` - Collaborative development with verification
|
|
671
|
+
- `npx ruflo@alpha train` - Training with verification feedback
|
|
672
|
+
- `npx ruflo@alpha swarm` - Multi-agent coordination with quality checks
|
|
673
|
+
- `npx ruflo@alpha report` - Generate comprehensive project reports
|
|
632
674
|
|
|
633
675
|
### Best Practices
|
|
634
676
|
|
|
@@ -641,20 +683,6 @@ Verification commands return standard exit codes:
|
|
|
641
683
|
7. **Review Rollbacks**: Understand why changes were rejected
|
|
642
684
|
8. **Train Agents**: Use verification feedback to improve agent performance
|
|
643
685
|
|
|
644
|
-
## Skill Composition
|
|
645
|
-
|
|
646
|
-
- **Before verification** → Run `/qe-test-generation` and `/qe-coverage-analysis` first
|
|
647
|
-
- **If verification fails** → Use `/test-failure-investigator` for root cause analysis
|
|
648
|
-
- **Ship decision** → Feed into `/qe-quality-assessment` for final assessment
|
|
649
|
-
|
|
650
|
-
## Gotchas
|
|
651
|
-
|
|
652
|
-
- Verification is the HIGHEST-VALUE skill category (Anthropic: "worth having an engineer spend a week making verification skills excellent")
|
|
653
|
-
- "Success is silent, only failures are verbose" — swallow passing test output, surface only errors to avoid context window flooding
|
|
654
|
-
- Agent completion claims are unreliable — always include programmatic assertions on state, not just "looks right"
|
|
655
|
-
- Have Claude record a video of its output so you can see exactly what it tested (Playwright trace, screenshot evidence)
|
|
656
|
-
- Hardcoded values are the #1 completion theater pattern — grep for literals that should be dynamic
|
|
657
|
-
|
|
658
686
|
### Additional Resources
|
|
659
687
|
|
|
660
688
|
- Truth Scoring Algorithm: See `/docs/truth-scoring.md`
|
|
@@ -1,13 +1,13 @@
|
|
|
1
1
|
name: qe-agentic-quality-engineering
|
|
2
|
-
description: "
|
|
2
|
+
description: "Use when orchestrating QE agents, understanding PACTS principles, configuring the AQE v3 fleet, or leveraging AI agents as force multipliers for quality work."
|
|
3
3
|
minModelTier: tier1-any
|
|
4
|
-
tags: ["
|
|
4
|
+
tags: ["pacts", "agents", "fleet", "coordination", "autonomous", "structured", "foundational", "qe", "quality-engineering", "qe-core"]
|
|
5
5
|
steps:
|
|
6
|
-
- name:
|
|
7
|
-
description: "
|
|
6
|
+
- name: pacts-principles
|
|
7
|
+
description: "PACTS Principles"
|
|
8
8
|
tools: ["bash", "read", "edit"]
|
|
9
9
|
prompt: |
|
|
10
|
-
|
|
10
|
+
PACTS Principles
|
|
11
11
|
- name: 19-agent-fleet
|
|
12
12
|
description: "19-Agent Fleet"
|
|
13
13
|
tools: ["bash", "read"]
|
|
@@ -1,28 +1,28 @@
|
|
|
1
1
|
name: qe-holistic-testing-pact
|
|
2
|
-
description: "Apply the Holistic Testing Model evolved with
|
|
2
|
+
description: "Apply the Holistic Testing Model evolved with PACTS (Proactive, Autonomous, Collaborative, Targeted, Structured) principles. Use when designing comprehensive test strategies for Classical, AI-assisted, Agent based, or Agentic Systems building quality into the team, or implementing whole-team quality"
|
|
3
3
|
minModelTier: tier1-any
|
|
4
|
-
tags: ["holistic", "
|
|
4
|
+
tags: ["holistic", "pacts", "quality", "whole-team", "proactive", "autonomous", "collaborative", "targeted", "structured", "qe", "quality-engineering", "testing-methodologies"]
|
|
5
5
|
steps:
|
|
6
|
-
- name:
|
|
7
|
-
description: "
|
|
6
|
+
- name: pacts-principles
|
|
7
|
+
description: "PACTS Principles"
|
|
8
8
|
tools: ["bash", "read", "grep"]
|
|
9
9
|
prompt: |
|
|
10
|
-
|
|
10
|
+
PACTS Principles
|
|
11
11
|
- name: holistic-testing-quadrants
|
|
12
12
|
description: "Holistic Testing Quadrants"
|
|
13
13
|
tools: ["bash", "read", "grep"]
|
|
14
14
|
prompt: |
|
|
15
15
|
Holistic Testing Quadrants
|
|
16
|
-
- name: agent-selection-by-
|
|
17
|
-
description: "Agent Selection by
|
|
16
|
+
- name: agent-selection-by-pacts-quadrant
|
|
17
|
+
description: "Agent Selection by PACTS + Quadrant"
|
|
18
18
|
tools: ["bash", "read"]
|
|
19
19
|
prompt: |
|
|
20
|
-
Agent Selection by
|
|
21
|
-
- name:
|
|
22
|
-
description: "
|
|
20
|
+
Agent Selection by PACTS + Quadrant
|
|
21
|
+
- name: pacts-in-practice
|
|
22
|
+
description: "PACTS in Practice"
|
|
23
23
|
tools: ["bash", "read"]
|
|
24
24
|
prompt: |
|
|
25
|
-
|
|
25
|
+
PACTS in Practice
|
|
26
26
|
- name: proactive-test-before-bugs
|
|
27
27
|
description: "Proactive: Test Before Bugs"
|
|
28
28
|
tools: ["bash", "read"]
|
package/CHANGELOG.md
CHANGED
|
@@ -5,6 +5,106 @@ All notable changes to the Agentic QE project will be documented in this file.
|
|
|
5
5
|
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
|
|
6
6
|
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
|
|
7
7
|
|
|
8
|
+
## [3.11.1] - 2026-06-25
|
|
9
|
+
|
|
10
|
+
Benchmark-driven deepening of the opt-in "cheap-first" test generation from
|
|
11
|
+
v3.11.0. We ran real model-vs-model benchmarks scored by a real oracle (mutation
|
|
12
|
+
kill-rate + coverage) and shipped only what the measurements earned: **best-of-k**
|
|
13
|
+
generation, **cross-model** diversity, and a **self-test Goodhart guard** — plus a
|
|
14
|
+
reusable adversarial-verification gate, MCP self-governance, and signed provenance
|
|
15
|
+
for delivered findings. Everything stays **opt-in and off by default**.
|
|
16
|
+
|
|
17
|
+
See the new [Darwin-QE Self-Learning guide](docs/guides/darwin-qe-self-learning.md)
|
|
18
|
+
for the benchmarks, what we learned, and how to use it.
|
|
19
|
+
|
|
20
|
+
### Added
|
|
21
|
+
|
|
22
|
+
- **Best-of-k generation** — tries a few diverse candidates and keeps the first
|
|
23
|
+
that passes the objective check; the extra call happens only when the first one
|
|
24
|
+
fails. Enable via `freeTierBestOfK`.
|
|
25
|
+
- **Cross-model best-of-k (opt-in)** — draw those candidates from *different* model
|
|
26
|
+
families (e.g. a local model + a cloud model) so they cover each other's failures.
|
|
27
|
+
Measured **~+6 quality points** over a single model. Configure with
|
|
28
|
+
`freeTierCandidateProviders`.
|
|
29
|
+
- **Cheap-first lane broadened beyond test generation** — now also covers
|
|
30
|
+
requirements → BDD/Gherkin scenario generation (opt-in), with an off-topic
|
|
31
|
+
relevance gate so generic boilerplate is rejected.
|
|
32
|
+
- **`@ruvector/adversarial-verify`** — a host-agnostic blind-refuter verification
|
|
33
|
+
primitive (N independent refuters, majority-kill, default-refuted on uncertainty)
|
|
34
|
+
plus an opt-in **`verifyGate`** output gate that drops unverified findings before
|
|
35
|
+
they're emitted. New `agentic-qe/verification/adversarial-verify` export.
|
|
36
|
+
- **MCP self-governance** — a default-deny policy for AQE's own MCP tool surface
|
|
37
|
+
(`.harness/mcp-policy.json`) with a CI gate that fails on any high-severity finding.
|
|
38
|
+
- **Cost-Pareto value scoring** — rank models by quality-per-dollar (and compute the
|
|
39
|
+
non-dominated frontier) from *measured* data, not vendor claims. New
|
|
40
|
+
`agentic-qe/routing/value-score` export.
|
|
41
|
+
- **Witnessed finding delivery** — delivered findings are recorded in the Ed25519
|
|
42
|
+
hash-chained witness log with fail-closed verification (tampering throws).
|
|
43
|
+
- **Graceful optional-module loading** — native/optional dependencies now degrade
|
|
44
|
+
instead of crashing when a platform binary is absent, with a CI "absent drill"
|
|
45
|
+
that proves the degraded path (and never masks a real load failure).
|
|
46
|
+
|
|
47
|
+
### Changed
|
|
48
|
+
|
|
49
|
+
- **Default free-tier model is now `qwen3:30b-a3b`** (was `qwen3:8b`). A benchmark
|
|
50
|
+
showed the 8B model is below the test-generation quality floor; the 30B clears it
|
|
51
|
+
(~89% mutation kill). Set `freeTierModel` to fit your hardware — small-RAM users
|
|
52
|
+
get escalation-only value. Only affects users who opt into the free tier.
|
|
53
|
+
- **Goodhart guard** — only an *objective* check (real test run, coverage, mutation,
|
|
54
|
+
schema) can lift routing confidence; a model's own self-authored "passing" test
|
|
55
|
+
never does.
|
|
56
|
+
|
|
57
|
+
## [3.11.0] - 2026-06-20
|
|
58
|
+
|
|
59
|
+
Run test generation on **free local models first**, falling back to paid models
|
|
60
|
+
only when needed. This release adds an opt-in "cheap-first" path: a local model
|
|
61
|
+
(Ollama, OpenRouter free tier, or any OpenAI-compatible endpoint) attempts test
|
|
62
|
+
generation with an automatic repair loop, and only the hard cases escalate up to
|
|
63
|
+
your normal LLM tiers — so most routine generation can run at $0. Every cheap-vs-
|
|
64
|
+
escalated outcome feeds routing feedback, so model selection improves over time.
|
|
65
|
+
|
|
66
|
+
Off by default; nothing changes unless you opt in. Inspired by the "the harness
|
|
67
|
+
matters as much as the model" economics from Ruv's MetaHarness Darwin Mode.
|
|
68
|
+
|
|
69
|
+
### Added
|
|
70
|
+
|
|
71
|
+
- **Free-tier local test generation (opt-in).** Enable with `AQE_FREE_TIER=1`
|
|
72
|
+
(or `enableFreeTier` in the test-generation coordinator config) to generate
|
|
73
|
+
tests on a free/local model before any paid LLM call. Default model `qwen3:8b`.
|
|
74
|
+
See the [Free-Tier Local Models guide](docs/guides/free-tier-local-models.md).
|
|
75
|
+
- **Configurable free-tier providers** — local Ollama, cloud Ollama, OpenRouter
|
|
76
|
+
free models, or any OpenAI-compatible endpoint (vLLM, LM Studio, Groq, …). API
|
|
77
|
+
keys are read from named environment variables and never stored.
|
|
78
|
+
- **Repair loop** — when the local model's first output isn't a valid test, the
|
|
79
|
+
failure is fed back and it retries before falling back (configurable retries).
|
|
80
|
+
- **Automatic escalation** — hard cases the local model + repair can't solve
|
|
81
|
+
escalate up the existing model ladder (Haiku → Sonnet → Opus) via the router.
|
|
82
|
+
- **Self-learning routing feedback** — free-tier outcomes feed the routing
|
|
83
|
+
calibrator and escalation tracker, improving model-tier confidence over time.
|
|
84
|
+
- **`agentic-qe/routing/free-tier` package export** for programmatic configuration.
|
|
85
|
+
|
|
86
|
+
### Fixed
|
|
87
|
+
|
|
88
|
+
- **Restored `@ruvector/ruvllm-*` optional platform packages** dropped from the
|
|
89
|
+
lockfile by a Dependabot update, which could break `npm ci` for consumers. (#541)
|
|
90
|
+
- **Multi-file test-generation requests** now correctly fall back to the full
|
|
91
|
+
generation path so every requested file is covered (the free-tier path handles
|
|
92
|
+
the single-file case).
|
|
93
|
+
- Security bump of the transitive `hono` dev dependency. (#541)
|
|
94
|
+
|
|
95
|
+
### Changed
|
|
96
|
+
|
|
97
|
+
- **Auto-escalation tracker is now ladder-configurable** (generic over tier
|
|
98
|
+
names) so a free local tier can sit below the paid tiers. Fully backward
|
|
99
|
+
compatible — existing behavior and the default Claude ladder are unchanged.
|
|
100
|
+
- **QE framework evolved PACT → PACTS** — adds a fifth principle, **Structured**
|
|
101
|
+
(governance, observability, and explainability of agent behavior; measure
|
|
102
|
+
*confidence*, not trust), inspired by DORA's research on AI-assisted delivery.
|
|
103
|
+
Ships with a playbook + readiness-assessment guide. The skill id/dir
|
|
104
|
+
`holistic-testing-pact` and schema slugs are unchanged (cross-repo stable); the
|
|
105
|
+
output schema gains an **optional** `structured` dimension (non-breaking).
|
|
106
|
+
PACT originated with Reuven Cohen (Agentics Foundation); PACTS adds Structured. (#545)
|
|
107
|
+
|
|
8
108
|
## [3.10.9] - 2026-06-17
|
|
9
109
|
|
|
10
110
|
MCP server reliability and database-free completeness, all from community-reported
|