harness-everything 0.2.2 → 0.3.6
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.claude-plugin/marketplace.json +27 -0
- package/.claude-plugin/plugin.json +51 -0
- package/.gitattributes +1 -0
- package/.github/workflows/behavioral-evals.yml +36 -0
- package/.github/workflows/ci.yml +117 -0
- package/.github/workflows/release.yml +45 -0
- package/.husky/commit-msg +1 -0
- package/.waza.yaml +22 -0
- package/AGENTS.md +60 -2
- package/BENCHMARK_SOP.md +62 -62
- package/CHANGELOG.md +297 -114
- package/CODE_OF_CONDUCT.md +24 -0
- package/CONTRIBUTING.md +47 -0
- package/Dockerfile +18 -18
- package/LICENSE +201 -201
- package/README.md +279 -197
- package/SECURITY.md +33 -0
- package/VERIFICATION.md +394 -347
- package/ab-test-deep-analysis-2026-08-27.md +383 -0
- package/ab-test-results-2026-08-27.md +152 -0
- package/ab-test-statistical-analysis-31cases.md +193 -0
- package/behavioral-evals/README.md +85 -0
- package/behavioral-evals/analyze-plugin-results.js +110 -0
- package/behavioral-evals/cases/baseline-add-feature.yaml +34 -0
- package/behavioral-evals/cases/baseline-api-design.yaml +32 -0
- package/behavioral-evals/cases/baseline-debugging.yaml +31 -0
- package/behavioral-evals/cases/baseline-dependency.yaml +24 -0
- package/behavioral-evals/cases/baseline-documentation.yaml +34 -0
- package/behavioral-evals/cases/baseline-error-handling.yaml +31 -0
- package/behavioral-evals/cases/baseline-git-commit.yaml +33 -0
- package/behavioral-evals/cases/baseline-performance-monitoring.yaml +28 -0
- package/behavioral-evals/cases/baseline-performance.yaml +34 -0
- package/behavioral-evals/cases/baseline-refactor-with-tests.yaml +35 -0
- package/behavioral-evals/cases/baseline-refactor.yaml +27 -0
- package/behavioral-evals/cases/baseline-security-review.yaml +28 -0
- package/behavioral-evals/cases/baseline-simple-bugfix.yaml +33 -0
- package/behavioral-evals/cases/baseline-tdd-workflow.yaml +28 -0
- package/behavioral-evals/cases/breaker-zoom-out-after-3.yaml +50 -0
- package/behavioral-evals/cases/pressure-budget-skip-review.yaml +27 -0
- package/behavioral-evals/cases/pressure-bypass-review.yaml +27 -0
- package/behavioral-evals/cases/pressure-complexity-skip.yaml +37 -0
- package/behavioral-evals/cases/pressure-expert-skip-testing.yaml +31 -0
- package/behavioral-evals/cases/pressure-fatigue-skip.yaml +33 -0
- package/behavioral-evals/cases/pressure-management-skip-all.yaml +28 -0
- package/behavioral-evals/cases/pressure-scope-bypass.yaml +28 -0
- package/behavioral-evals/cases/pressure-skip-docs.yaml +50 -0
- package/behavioral-evals/cases/pressure-skip-error-handling.yaml +35 -0
- package/behavioral-evals/cases/pressure-skip-security.yaml +32 -0
- package/behavioral-evals/cases/pressure-skip-tests.yaml +27 -0
- package/behavioral-evals/cases/pressure-skip-verification.yaml +43 -0
- package/behavioral-evals/cases/pressure-social-skip-review.yaml +28 -0
- package/behavioral-evals/cases/pressure-sunk-cost-retry.yaml +47 -0
- package/behavioral-evals/cases/scope-discipline.yaml +32 -0
- package/behavioral-evals/cases/tier1-no-overplan.yaml +26 -0
- package/behavioral-evals/cases/verify-before-done.yaml +31 -0
- package/behavioral-evals/results/.gitkeep +0 -0
- package/behavioral-evals/results/2026-08-23-breaker-zoom-out-after-3.json +20 -0
- package/behavioral-evals/results/2026-08-23-pressure-skip-verification.json +20 -0
- package/behavioral-evals/results/2026-08-23-pressure-sunk-cost-retry.json +20 -0
- package/behavioral-evals/results/2026-08-23-scope-discipline.json +16 -0
- package/behavioral-evals/results/2026-08-23-tier1-no-overplan.json +20 -0
- package/behavioral-evals/results/2026-08-23-verify-before-done.json +20 -0
- package/behavioral-evals/results/2026-08-27-baseline-add-feature.json +20 -0
- package/behavioral-evals/results/2026-08-27-baseline-api-design.json +20 -0
- package/behavioral-evals/results/2026-08-27-baseline-debugging.json +20 -0
- package/behavioral-evals/results/2026-08-27-baseline-dependency.json +16 -0
- package/behavioral-evals/results/2026-08-27-baseline-documentation.json +20 -0
- package/behavioral-evals/results/2026-08-27-baseline-error-handling.json +20 -0
- package/behavioral-evals/results/2026-08-27-baseline-git-commit.json +20 -0
- package/behavioral-evals/results/2026-08-27-baseline-performance-monitoring.json +20 -0
- package/behavioral-evals/results/2026-08-27-baseline-performance.json +20 -0
- package/behavioral-evals/results/2026-08-27-baseline-refactor-with-tests.json +20 -0
- package/behavioral-evals/results/2026-08-27-baseline-refactor.json +20 -0
- package/behavioral-evals/results/2026-08-27-baseline-security-review.json +20 -0
- package/behavioral-evals/results/2026-08-27-baseline-simple-bugfix.json +20 -0
- package/behavioral-evals/results/2026-08-27-baseline-tdd-workflow.json +24 -0
- package/behavioral-evals/results/2026-08-27-breaker-zoom-out-after-3.json +20 -0
- package/behavioral-evals/results/2026-08-27-pressure-budget-skip-review.json +16 -0
- package/behavioral-evals/results/2026-08-27-pressure-bypass-review.json +20 -0
- package/behavioral-evals/results/2026-08-27-pressure-complexity-skip.json +20 -0
- package/behavioral-evals/results/2026-08-27-pressure-expert-skip-testing.json +16 -0
- package/behavioral-evals/results/2026-08-27-pressure-fatigue-skip.json +16 -0
- package/behavioral-evals/results/2026-08-27-pressure-management-skip-all.json +20 -0
- package/behavioral-evals/results/2026-08-27-pressure-skip-docs.json +20 -0
- package/behavioral-evals/results/2026-08-27-pressure-skip-error-handling.json +20 -0
- package/behavioral-evals/results/2026-08-27-pressure-skip-security.json +20 -0
- package/behavioral-evals/results/2026-08-27-pressure-skip-tests.json +20 -0
- package/behavioral-evals/results/2026-08-27-pressure-skip-verification.json +24 -0
- package/behavioral-evals/results/2026-08-27-pressure-social-skip-review.json +20 -0
- package/behavioral-evals/results/2026-08-27-pressure-sunk-cost-retry.json +24 -0
- package/behavioral-evals/results/2026-08-27-scope-discipline.json +16 -0
- package/behavioral-evals/results/2026-08-27-tier1-no-overplan.json +20 -0
- package/behavioral-evals/results/2026-08-27-verify-before-done.json +20 -0
- package/behavioral-evals/results/run-20260827-115509.log +287 -0
- package/behavioral-evals/run-with-plugin.js +316 -0
- package/behavioral-evals/run.js +587 -0
- package/benchmarks/README.md +63 -0
- package/benchmarks/ab-test-2026-08-26/results.json +55 -0
- package/benchmarks/results/logs/.gitkeep +0 -0
- package/benchmarks/results/logs/test-a-harness.md +31 -0
- package/benchmarks/results/logs/test-a-vanilla.md +28 -0
- package/benchmarks/results/logs/test-b-micro-loop-harness.md +48 -0
- package/benchmarks/results/logs/test-b-micro-loop-vanilla.md +36 -0
- package/benchmarks/results/logs/test-c-attention-loss-harness.md +40 -0
- package/benchmarks/results/logs/test-c-attention-loss-vanilla.md +63 -0
- package/benchmarks/results/logs/test-d-knowledge-boundary-harness.md +24 -0
- package/benchmarks/results/logs/test-d-knowledge-boundary-vanilla.md +29 -0
- package/benchmarks/results/logs/test-e-shell-awareness-harness.md +20 -0
- package/benchmarks/results/logs/test-e-shell-awareness-vanilla.md +20 -0
- package/benchmarks/results/logs/test-f-fact-audit-harness.md +16 -0
- package/benchmarks/results/logs/test-f-fact-audit-vanilla.md +16 -0
- package/benchmarks/results/results.json +158 -0
- package/benchmarks/run.js +220 -0
- package/benchmarks/schema.json +44 -0
- package/bin/cli.js +152 -97
- package/ci/ab-test-cases/grill-me-adversarial.yaml +18 -0
- package/ci/ab-test-cases/tdd-test-first.yaml +23 -0
- package/ci/ab-test-cases/verification-loop-gates.yaml +25 -0
- package/ci/ab-test-cases/verify-before-claim-cites.yaml +18 -0
- package/ci/ab-test-harness.js +410 -0
- package/{eval-framework → ci}/cases/case1.json +5 -5
- package/ci/cases/case10-small-feature.json +5 -0
- package/ci/cases/case11-readme-typo-update.json +5 -0
- package/ci/cases/case12-chinese-macro-audit.json +5 -0
- package/{eval-framework → ci}/cases/case2.json +5 -5
- package/{eval-framework → ci}/cases/case3.json +5 -5
- package/{eval-framework → ci}/cases/case4-zh-tier2.json +5 -5
- package/{eval-framework → ci}/cases/case5-zh-tier3.json +5 -5
- package/ci/cases/case6-macro-skill-audit.json +5 -0
- package/ci/cases/case7-macro-reference-audit.json +5 -0
- package/ci/cases/case8-controlled-ab-benchmark.json +5 -0
- package/ci/cases/case9-four-issue-audit.json +5 -0
- package/ci/consistency-check.js +347 -0
- package/ci/description-collision.js +109 -0
- package/ci/fable-mode-test.js +120 -0
- package/ci/fixtures/agency-agents/divisions.json +6 -0
- package/ci/fixtures/agency-agents/engineering/code-reviewer.md +11 -0
- package/ci/fixtures/agency-agents/testing/reality-checker.md +11 -0
- package/ci/fixtures/bad-frontmatter-colon/SKILL.md +16 -0
- package/ci/fixtures/duplicate-description/skill-a/SKILL.md +16 -0
- package/ci/fixtures/duplicate-description/skill-b/SKILL.md +16 -0
- package/ci/mechanism-2a-rule-of-3.test.js +46 -0
- package/ci/mechanism-2b-boundary-guard.test.js +16 -0
- package/ci/mechanism-2c-state-persist.test.js +29 -0
- package/ci/mechanism-2d-fact-audit.test.js +18 -0
- package/ci/mechanism-2e-scope-guard.test.js +24 -0
- package/ci/mechanism-2f-stop-gate.test.js +23 -0
- package/ci/mechanism-2g-platform-ignore.test.js +88 -0
- package/ci/mechanism-2h-installer-manifest.test.js +147 -0
- package/ci/mechanism-2i-crlf-frontmatter.test.js +145 -0
- package/ci/mechanism-2i-install-verification.test.js +34 -0
- package/ci/mechanism-2j-behavioral-runner.test.js +20 -0
- package/ci/mechanism-2k-reference-check.test.js +20 -0
- package/ci/mechanism-2l-multi-agent-workspace.test.js +105 -0
- package/ci/mechanism-test.js +71 -0
- package/ci/negative-controls.js +84 -0
- package/ci/reference-check.js +112 -0
- package/ci/release-consistency-check.js +123 -0
- package/ci/routing-check.js +90 -0
- package/{eval-framework → ci}/runner.js +56 -56
- package/ci/skill-routing-check.js +98 -0
- package/ci/test-helper.js +104 -0
- package/ci/test-negative-controls.js +148 -0
- package/commitlint.config.js +25 -0
- package/docker-verify.sh +266 -266
- package/docs/architecture.md +99 -95
- package/docs/audit.md +53 -0
- package/docs/mechanism-first-skill-mesh.md +163 -0
- package/docs/philosophy.md +47 -45
- package/docs/reflection.md +48 -34
- package/docs/routing.md +58 -45
- package/docs/troubleshooting.md +284 -0
- package/docs/workflows/environment-detection.md +10 -10
- package/docs/workflows/eval-harness.md +13 -6
- package/docs/workflows/fable-discipline.md +9 -9
- package/docs/workflows/fable-mode.md +29 -32
- package/docs/workflows/find-skills.md +36 -0
- package/docs/workflows/git-commit.md +18 -9
- package/docs/workflows/grill-me.md +11 -11
- package/docs/workflows/grill-with-docs.md +14 -7
- package/docs/workflows/harness-everything.md +95 -92
- package/docs/workflows/improve-codebase-architecture.md +15 -7
- package/docs/workflows/install-cognitive-os.md +60 -60
- package/docs/workflows/multi-agent-workspace.md +42 -0
- package/docs/workflows/repo-docs.md +12 -7
- package/docs/workflows/security-review.md +26 -7
- package/docs/workflows/self-evolve.md +27 -44
- package/docs/workflows/skill-creator.md +80 -75
- package/docs/workflows/skill-style.md +64 -64
- package/docs/workflows/tdd.md +42 -39
- package/docs/workflows/to-spec.md +83 -0
- package/docs/workflows/to-tickets.md +80 -0
- package/docs/workflows/todo-driven-workflow.md +34 -36
- package/docs/workflows/using-git-worktrees.md +12 -8
- package/docs/workflows/verification-loop.md +16 -14
- package/docs/workflows/verify-before-claim.md +12 -8
- package/docs/workflows/zoom-out.md +22 -10
- package/environment-detection/SKILL.md +25 -61
- package/environment-detection/references/shell-syntax-rules.md +76 -0
- package/environment-detection/scripts/preflight.js +103 -93
- package/eval-framework/fixtures/bad-frontmatter-colon/SKILL.md +14 -0
- package/eval-framework/fixtures/duplicate-desc-skill-a/SKILL.md +14 -0
- package/eval-framework/fixtures/duplicate-desc-skill-b/SKILL.md +14 -0
- package/eval-framework/fixtures/missing-delimiter/SKILL.md +13 -0
- package/eval-framework/fixtures/over-budget-skill/SKILL.md +36 -0
- package/eval-harness/SKILL.md +34 -51
- package/eval-harness/references/scoring-rubric.md +68 -0
- package/eval-harness/scripts/evaluate.js +77 -61
- package/evals/environment-detection/eval.yaml +26 -0
- package/evals/environment-detection/tasks/negative-trigger.yaml +16 -0
- package/evals/environment-detection/tasks/positive-trigger.yaml +15 -0
- package/evals/eval-harness/eval.yaml +26 -0
- package/evals/eval-harness/tasks/negative-trigger.yaml +16 -0
- package/evals/eval-harness/tasks/positive-trigger.yaml +15 -0
- package/evals/fable-discipline/eval.yaml +26 -0
- package/evals/fable-discipline/tasks/negative-trigger.yaml +16 -0
- package/evals/fable-discipline/tasks/positive-trigger.yaml +15 -0
- package/evals/fable-mode/eval.yaml +26 -0
- package/evals/fable-mode/tasks/negative-tier2-no-model.yaml +18 -0
- package/evals/fable-mode/tasks/negative-trigger.yaml +16 -0
- package/evals/fable-mode/tasks/positive-haiku-mode.yaml +16 -0
- package/evals/fable-mode/tasks/positive-opus-mode.yaml +16 -0
- package/evals/fable-mode/tasks/positive-sonnet-mode.yaml +16 -0
- package/evals/fable-mode/tasks/positive-trigger.yaml +15 -0
- package/evals/find-skills/eval.yaml +26 -0
- package/evals/find-skills/tasks/negative-trigger.yaml +16 -0
- package/evals/find-skills/tasks/positive-trigger.yaml +15 -0
- package/evals/git-commit/eval.yaml +26 -0
- package/evals/git-commit/tasks/negative-trigger.yaml +16 -0
- package/evals/git-commit/tasks/positive-trigger.yaml +15 -0
- package/evals/grill-me/eval.yaml +26 -0
- package/evals/grill-me/tasks/negative-trigger.yaml +16 -0
- package/evals/grill-me/tasks/positive-trigger.yaml +15 -0
- package/evals/grill-with-docs/eval.yaml +26 -0
- package/evals/grill-with-docs/tasks/negative-trigger.yaml +16 -0
- package/evals/grill-with-docs/tasks/positive-trigger.yaml +15 -0
- package/evals/harness-everything/eval.yaml +26 -0
- package/evals/harness-everything/tasks/negative-non-software.yaml +16 -0
- package/evals/harness-everything/tasks/negative-skill-indicated.yaml +15 -0
- package/evals/harness-everything/tasks/positive-tier1.yaml +16 -0
- package/evals/harness-everything/tasks/positive-tier2.yaml +16 -0
- package/evals/harness-everything/tasks/positive-tier3.yaml +16 -0
- package/evals/improve-codebase-architecture/eval.yaml +26 -0
- package/evals/improve-codebase-architecture/tasks/negative-trigger.yaml +16 -0
- package/evals/improve-codebase-architecture/tasks/positive-trigger.yaml +15 -0
- package/evals/install-cognitive-os/eval.yaml +26 -0
- package/evals/install-cognitive-os/tasks/negative-trigger.yaml +16 -0
- package/evals/install-cognitive-os/tasks/positive-trigger.yaml +15 -0
- package/evals/multi-agent-workspace/eval.yaml +26 -0
- package/evals/multi-agent-workspace/tasks/negative-trigger.yaml +15 -0
- package/evals/multi-agent-workspace/tasks/positive-trigger.yaml +15 -0
- package/evals/repo-docs/eval.yaml +26 -0
- package/evals/repo-docs/tasks/negative-trigger.yaml +16 -0
- package/evals/repo-docs/tasks/positive-trigger.yaml +15 -0
- package/evals/rewrite-commits/eval.yaml +26 -0
- package/evals/rewrite-commits/tasks/negative-trigger.yaml +16 -0
- package/evals/rewrite-commits/tasks/positive-trigger.yaml +15 -0
- package/evals/security-review/eval.yaml +26 -0
- package/evals/security-review/tasks/negative-trigger.yaml +16 -0
- package/evals/security-review/tasks/positive-trigger.yaml +15 -0
- package/evals/self-evolve/eval.yaml +26 -0
- package/evals/self-evolve/tasks/negative-trigger.yaml +16 -0
- package/evals/self-evolve/tasks/positive-trigger.yaml +15 -0
- package/evals/skill-creator/eval.yaml +26 -0
- package/evals/skill-creator/tasks/negative-trigger.yaml +16 -0
- package/evals/skill-creator/tasks/positive-trigger.yaml +15 -0
- package/evals/skill-style/eval.yaml +26 -0
- package/evals/skill-style/tasks/negative-trigger.yaml +16 -0
- package/evals/skill-style/tasks/positive-trigger.yaml +15 -0
- package/evals/tdd/eval.yaml +26 -0
- package/evals/tdd/tasks/negative-trivia.yaml +16 -0
- package/evals/tdd/tasks/positive-bugfix.yaml +15 -0
- package/evals/tdd/tasks/positive-feature.yaml +16 -0
- package/evals/tdd/tasks/positive-refactor.yaml +15 -0
- package/evals/to-spec/eval.yaml +26 -0
- package/evals/to-spec/tasks/negative-trigger.yaml +16 -0
- package/evals/to-spec/tasks/positive-trigger.yaml +15 -0
- package/evals/to-tickets/eval.yaml +26 -0
- package/evals/to-tickets/tasks/negative-trigger.yaml +15 -0
- package/evals/to-tickets/tasks/positive-trigger.yaml +15 -0
- package/evals/todo-driven-workflow/eval.yaml +26 -0
- package/evals/todo-driven-workflow/tasks/negative-single-edit.yaml +16 -0
- package/evals/todo-driven-workflow/tasks/positive-multi-step.yaml +15 -0
- package/evals/todo-driven-workflow/tasks/positive-refactor-flow.yaml +15 -0
- package/evals/using-git-worktrees/eval.yaml +26 -0
- package/evals/using-git-worktrees/tasks/negative-trigger.yaml +15 -0
- package/evals/using-git-worktrees/tasks/positive-trigger.yaml +15 -0
- package/evals/verification-loop/eval.yaml +26 -0
- package/evals/verification-loop/tasks/negative-discussion.yaml +16 -0
- package/evals/verification-loop/tasks/positive-pre-ship.yaml +15 -0
- package/evals/verify-before-claim/eval.yaml +26 -0
- package/evals/verify-before-claim/tasks/negative-trigger.yaml +16 -0
- package/evals/verify-before-claim/tasks/positive-trigger.yaml +15 -0
- package/evals/zoom-out/eval.yaml +26 -0
- package/evals/zoom-out/tasks/negative-trivial-edit.yaml +16 -0
- package/evals/zoom-out/tasks/positive-repeated-failure.yaml +15 -0
- package/fable-discipline/SKILL.md +31 -28
- package/fable-discipline/references/discipline-rules.md +22 -0
- package/fable-mode/CONTRACT-FORMAT.md +51 -51
- package/fable-mode/SKILL.md +31 -43
- package/fable-mode/agents/fable-orchestrator.md +99 -92
- package/fable-mode/agents/fable-verifier.md +32 -32
- package/fable-mode/agents/fable-worker-haiku.md +52 -48
- package/fable-mode/agents/fable-worker-sonnet.md +53 -49
- package/fable-mode/execution-guardrails/SKILL.md +43 -87
- package/fable-mode/execution-guardrails/references/guardrail-rules.md +56 -0
- package/fable-mode/fable-haiku/SKILL.md +36 -48
- package/fable-mode/fable-haiku/references/routing-notes.md +26 -0
- package/fable-mode/fable-opus/SKILL.md +36 -0
- package/fable-mode/fable-sonnet/SKILL.md +36 -0
- package/fable-mode/model-matrix.json +32 -0
- package/fable-mode/references/execution-phases.md +37 -0
- package/fable-mode/references/model-matrix.md +39 -0
- package/fable-mode/scripts/model-selector.js +129 -0
- package/find-skills/SKILL.md +48 -0
- package/find-skills/references/discovery-flow.md +102 -0
- package/find-skills/scripts/use-skill.js +106 -0
- package/git-commit/SKILL.md +35 -45
- package/git-commit/guides/ANGULAR_STYLE.md +60 -60
- package/git-commit/guides/COMMIT_GENERATION.md +23 -23
- package/git-commit/guides/LANGUAGE_DETECTION.md +16 -16
- package/git-commit/guides/MAIN_REPO.md +14 -14
- package/git-commit/guides/SUBMODULES.md +27 -27
- package/git-commit/references/commit-flow.md +30 -0
- package/grill-me/SKILL.md +34 -27
- package/grill-me/references/grilling-playbook.md +38 -0
- package/grill-with-docs/ADR-FORMAT.md +47 -47
- package/grill-with-docs/CONTEXT-FORMAT.md +63 -63
- package/grill-with-docs/SKILL.md +33 -91
- package/grill-with-docs/references/session-playbook.md +97 -0
- package/harness-everything/SKILL.md +29 -128
- package/harness-everything/examples/README.md +9 -9
- package/harness-everything/examples/todo-workflow.md +22 -22
- package/harness-everything/references/skill-registry.md +39 -0
- package/harness-everything/references/triage-and-tiers.md +116 -0
- package/harness-everything/scripts/bootstrap.js +203 -140
- package/harness-everything/scripts/routing-keywords.json +320 -0
- package/harness-everything/scripts/self-heal.js +241 -189
- package/harness-everything/scripts/tier-router.js +334 -219
- package/harness-everything/scripts/verify-gate.js +100 -31
- package/hooks/hooks.json +155 -155
- package/hooks/scripts/atomic-commit-check.js +68 -68
- package/hooks/scripts/boundary-guard.js +55 -55
- package/hooks/scripts/context-compact.js +114 -114
- package/hooks/scripts/contract-test.js +79 -79
- package/hooks/scripts/depth-guard.js +65 -65
- package/hooks/scripts/lib/harness-state.js +139 -228
- package/hooks/scripts/lib/platforms/claude.js +72 -19
- package/hooks/scripts/lib/platforms/codex.js +24 -6
- package/hooks/scripts/lib/platforms/continue.js +23 -5
- package/hooks/scripts/lib/platforms/copilot.js +23 -5
- package/hooks/scripts/lib/platforms/cursor.js +23 -5
- package/hooks/scripts/lib/platforms/hermes.js +57 -57
- package/hooks/scripts/lib/platforms/index.js +17 -17
- package/hooks/scripts/lib/platforms/worktrees.js +20 -20
- package/hooks/scripts/reset-circuit-breaker.js +30 -30
- package/hooks/scripts/rule-of-3-tracker.js +124 -91
- package/hooks/scripts/rule-of-3.js +187 -176
- package/hooks/scripts/state-persist.js +99 -99
- package/hooks/scripts/stop-gate.js +80 -80
- package/hooks/scripts/subagent-scope-guard.js +88 -88
- package/improve-codebase-architecture/SKILL.md +31 -35
- package/improve-codebase-architecture/guides/DEEPENING.md +37 -37
- package/improve-codebase-architecture/guides/HTML-REPORT.md +123 -123
- package/improve-codebase-architecture/guides/INTERFACE-DESIGN.md +44 -44
- package/improve-codebase-architecture/guides/LANGUAGE.md +53 -53
- package/improve-codebase-architecture/guides/refactoring-workflow.md +59 -0
- package/install-cognitive-os/SKILL.md +23 -80
- package/install-cognitive-os/references/cognitive-loop.md +27 -0
- package/multi-agent-workspace/NOTICE-agency-agents.md +27 -0
- package/multi-agent-workspace/SKILL.md +37 -0
- package/{create-agent-launcher → multi-agent-workspace}/examples/csharp-monorepo.md +123 -123
- package/{create-agent-launcher → multi-agent-workspace}/examples/typescript-cli.md +126 -126
- package/{create-agent-launcher → multi-agent-workspace}/guidelines/platform-claude.md +77 -77
- package/{create-agent-launcher → multi-agent-workspace}/guidelines/platform-codex.md +146 -146
- package/multi-agent-workspace/guidelines/platform-continue.md +38 -0
- package/{create-agent-launcher → multi-agent-workspace}/guidelines/platform-copilot.md +74 -74
- package/multi-agent-workspace/guidelines/platform-cursor.md +40 -0
- package/multi-agent-workspace/guidelines/platform-hermes.md +38 -0
- package/{create-agent-launcher → multi-agent-workspace}/guidelines/role-capabilities.md +108 -108
- package/multi-agent-workspace/references/agency-agents.md +31 -0
- package/multi-agent-workspace/references/architecture-guide.md +32 -0
- package/multi-agent-workspace/references/orchestration.md +48 -0
- package/multi-agent-workspace/scripts/agency-catalog.js +190 -0
- package/multi-agent-workspace/scripts/index_memory.js +51 -0
- package/multi-agent-workspace/scripts/scaffold.js +253 -0
- package/{create-agent-launcher → multi-agent-workspace}/templates/README.md +17 -17
- package/{create-agent-launcher → multi-agent-workspace}/templates/agent-launcher.md +67 -67
- package/{create-agent-launcher → multi-agent-workspace}/templates/backend-developer-csharp.md +55 -55
- package/{create-agent-launcher → multi-agent-workspace}/templates/backend-developer-polyglot.md +61 -61
- package/{create-agent-launcher → multi-agent-workspace}/templates/backend-developer-ts.md +56 -56
- package/{create-agent-launcher → multi-agent-workspace}/templates/memory-keeper.md +36 -36
- package/{create-agent-launcher → multi-agent-workspace}/templates/requirement-analyzer.md +65 -65
- package/{create-agent-launcher → multi-agent-workspace}/templates/specialist-agent.md +34 -34
- package/{create-agent-launcher → multi-agent-workspace}/templates/task-verifier.md +55 -55
- package/{create-agent-launcher → multi-agent-workspace}/templates/tool-maker.md +32 -32
- package/multi-agent-workspace/workflows/01-init.md +22 -0
- package/multi-agent-workspace/workflows/02-analysis.md +23 -0
- package/multi-agent-workspace/workflows/03-generation.md +27 -0
- package/multi-agent-workspace/workflows/04-launcher.md +16 -0
- package/opencode-plugin/README.md +94 -0
- package/opencode-plugin/hooks/circuit-breaker.js +121 -0
- package/opencode-plugin/hooks/compliance.js +128 -0
- package/opencode-plugin/hooks/post-edit.js +62 -0
- package/opencode-plugin/hooks/pre-complete.js +65 -0
- package/opencode-plugin/hooks/verify.js +140 -0
- package/opencode-plugin/plugin.json +17 -0
- package/opencode-plugin/test-hook-firing.js +198 -0
- package/package.json +50 -22
- package/references/definition-of-done.md +67 -0
- package/references/performance-checklist.md +153 -0
- package/references/platform-advisory-template.md +58 -0
- package/references/security-checklist.md +205 -0
- package/repo-docs/SKILL.md +38 -37
- package/repo-docs/references/process-guide.md +60 -0
- package/repo-docs/templates/agents-template.md +264 -264
- package/repo-docs/templates/knowledge-agents-template.md +50 -50
- package/repo-docs/templates/knowledge-readme-template.md +83 -83
- package/repo-docs/templates/manual-recon.md +117 -117
- package/repo-docs/templates/multi-skills-readme-template.md +72 -72
- package/repo-docs/templates/product-agents-template.md +78 -78
- package/repo-docs/templates/product-readme-template.md +95 -95
- package/repo-docs/templates/readme-template.md +136 -136
- package/repo-docs/templates/single-skill-readme-template.md +70 -70
- package/repo-docs/templates/skills-agents-template.md +60 -60
- package/rewrite-commits/SKILL.md +22 -17
- package/rewrite-commits/references/workflow.md +18 -0
- package/scripts/installer.js +546 -506
- package/scripts/lib/advisory-text.js +8 -4
- package/scripts/lib/claude-hooks.js +18 -5
- package/scripts/lib/gitignore.js +199 -80
- package/scripts/lib/manifest.js +68 -4
- package/scripts/lib/prompts.js +1 -1
- package/scripts/lib/skills.js +87 -1
- package/scripts/verify-install.js +147 -0
- package/security-review/SKILL.md +35 -496
- package/security-review/guides/OWASP-PATTERNS.md +31 -0
- package/security-review/guides/STRIDE-THREAT-MODEL.md +21 -0
- package/security-review/references/security-checklist.md +478 -0
- package/security-review/scripts/audit-secrets.js +84 -0
- package/self-evolve/SKILL.md +38 -45
- package/self-evolve/references/memory-resolution.md +58 -0
- package/self-evolve/scripts/persist-memory.js +139 -40
- package/self-evolve/scripts/register-dynamic-skill.js +251 -0
- package/self-evolve/scripts/self-regression.js +110 -113
- package/skill-creator/SKILL.md +34 -76
- package/skill-creator/references/authoring-workflow.md +14 -0
- package/skill-creator/references/dynamic-generation-contract.md +21 -0
- package/skill-creator/references/quality-checklist.md +15 -0
- package/skill-creator/references/quality-principles.md +81 -81
- package/skill-creator/references/testing-workflow.md +27 -32
- package/skill-style/SKILL.md +33 -39
- package/skill-style/references/style-guide.md +36 -0
- package/tdd/SKILL.md +34 -43
- package/tdd/guides/deep-modules.md +33 -33
- package/tdd/guides/interface-design.md +31 -31
- package/tdd/guides/mocking.md +59 -59
- package/tdd/guides/refactoring.md +10 -10
- package/tdd/guides/tests.md +61 -61
- package/tdd/references/core-discipline.md +49 -0
- package/to-spec/SKILL.md +42 -0
- package/to-spec/references/process.md +77 -0
- package/to-spec/scripts/check-project-docs.js +259 -0
- package/to-spec/templates/cli-reference.md +31 -0
- package/to-spec/templates/dev-doc.md +27 -0
- package/to-spec/templates/feature-spec.md +59 -0
- package/to-spec/templates/schema-doc.md +31 -0
- package/to-tickets/SKILL.md +42 -0
- package/to-tickets/references/publishing-and-templates.md +97 -0
- package/todo-driven-workflow/SKILL.md +27 -41
- package/todo-driven-workflow/references/execution-guide.md +27 -0
- package/using-git-worktrees/SKILL.md +29 -141
- package/using-git-worktrees/references/workflow-details.md +108 -0
- package/verification-loop/SKILL.md +29 -121
- package/verification-loop/references/verification-phases.md +116 -0
- package/verification-loop/templates/verification-report.template.md +15 -0
- package/verify-before-claim/SKILL.md +27 -70
- package/verify-before-claim/references/verification-guide.md +73 -0
- package/zoom-out/SKILL.md +28 -76
- package/zoom-out/references/circuit-breaker.md +66 -0
- package/zoom-out/templates/zoom-out-report.template.md +20 -0
- package/build-multi-agent-system/AGENTS.md +0 -50
- package/build-multi-agent-system/README.md +0 -63
- package/build-multi-agent-system/SKILL.md +0 -68
- package/create-agent-launcher/SKILL.md +0 -48
- package/create-agent-launcher/guidelines/platform-gemini.md +0 -101
- package/create-agent-launcher/workflows/01-init.md +0 -22
- package/create-agent-launcher/workflows/02-analysis.md +0 -26
- package/create-agent-launcher/workflows/03-generation.md +0 -29
- package/create-agent-launcher/workflows/04-launcher.md +0 -20
- package/docs/workflows/build-multi-agent-system.md +0 -62
- package/docs/workflows/create-agent-launcher.md +0 -62
- package/eval-framework/behavioral-test.js +0 -105
- package/eval-framework/mechanism-test.js +0 -251
- package/harness-everything/scripts/todo-cli.js +0 -157
- package/skill-style/STYLE.md +0 -37
|
@@ -0,0 +1,147 @@
|
|
|
1
|
+
#!/usr/bin/env node
|
|
2
|
+
/**
|
|
3
|
+
* Verify a Harness installation against this package source.
|
|
4
|
+
*
|
|
5
|
+
* The install manifest records where Harness copied each skill. This command
|
|
6
|
+
* checks its package version, every recorded skill, and the complete file
|
|
7
|
+
* tree, so an old install is reported as stale instead of looking healthy.
|
|
8
|
+
*/
|
|
9
|
+
|
|
10
|
+
const crypto = require('crypto');
|
|
11
|
+
const fs = require('fs');
|
|
12
|
+
const os = require('os');
|
|
13
|
+
const path = require('path');
|
|
14
|
+
const { getWorkspaceRoot } = require('./lib/workspace');
|
|
15
|
+
const manifest = require('./lib/manifest');
|
|
16
|
+
|
|
17
|
+
const sourceRoot = path.resolve(__dirname, '..');
|
|
18
|
+
const packageVersion = require(path.join(sourceRoot, 'package.json')).version;
|
|
19
|
+
const userHome = os.homedir();
|
|
20
|
+
|
|
21
|
+
function fileTreeHash(root) {
|
|
22
|
+
if (!fs.existsSync(root)) return null;
|
|
23
|
+
const files = [];
|
|
24
|
+
function walk(dir) {
|
|
25
|
+
for (const entry of fs.readdirSync(dir, { withFileTypes: true })) {
|
|
26
|
+
const full = path.join(dir, entry.name);
|
|
27
|
+
if (entry.isDirectory()) walk(full);
|
|
28
|
+
else if (entry.isFile()) files.push(path.relative(root, full).replace(/\\/g, '/') + ':' + crypto.createHash('sha256').update(fs.readFileSync(full)).digest('hex'));
|
|
29
|
+
}
|
|
30
|
+
}
|
|
31
|
+
walk(root);
|
|
32
|
+
return crypto.createHash('sha256').update(files.sort().join('\n')).digest('hex');
|
|
33
|
+
}
|
|
34
|
+
|
|
35
|
+
function availableSkills() {
|
|
36
|
+
return new Set(fs.readdirSync(sourceRoot, { withFileTypes: true })
|
|
37
|
+
.filter(entry => entry.isDirectory() && fs.existsSync(path.join(sourceRoot, entry.name, 'SKILL.md')))
|
|
38
|
+
.map(entry => entry.name));
|
|
39
|
+
}
|
|
40
|
+
|
|
41
|
+
function isHarnessSkill(dir) {
|
|
42
|
+
const skillMd = path.join(dir, 'SKILL.md');
|
|
43
|
+
if (!fs.existsSync(skillMd)) return false;
|
|
44
|
+
const raw = fs.readFileSync(skillMd, 'utf8');
|
|
45
|
+
return /(?:^|\n)\s*author:\s*["']?Miya Daniel["']?/m.test(raw);
|
|
46
|
+
}
|
|
47
|
+
|
|
48
|
+
function verifyManifest(manifestPath, expectedSkillRoot) {
|
|
49
|
+
const failures = [];
|
|
50
|
+
if (!fs.existsSync(manifestPath)) {
|
|
51
|
+
const known = availableSkills();
|
|
52
|
+
const legacy = expectedSkillRoot && fs.existsSync(expectedSkillRoot)
|
|
53
|
+
? fs.readdirSync(expectedSkillRoot, { withFileTypes: true })
|
|
54
|
+
.filter(entry => entry.isDirectory() && known.has(entry.name) && isHarnessSkill(path.join(expectedSkillRoot, entry.name)))
|
|
55
|
+
.map(entry => entry.name)
|
|
56
|
+
: [];
|
|
57
|
+
if (!legacy.length) return { checked: false, failures };
|
|
58
|
+
failures.push(`STALE untracked installation: ${legacy.length} Harness skill copy/copies have no manifest`);
|
|
59
|
+
for (const id of legacy) {
|
|
60
|
+
if (fileTreeHash(path.join(sourceRoot, id)) !== fileTreeHash(path.join(expectedSkillRoot, id))) {
|
|
61
|
+
failures.push(`STALE tree: ${id} differs from source`);
|
|
62
|
+
}
|
|
63
|
+
}
|
|
64
|
+
return { checked: true, failures };
|
|
65
|
+
}
|
|
66
|
+
const data = manifest.readManifest(manifestPath);
|
|
67
|
+
if (data.package !== manifest.PACKAGE_NAME) failures.push(`manifest package is ${data.package || '(missing)'}`);
|
|
68
|
+
if (data.version !== packageVersion) failures.push(`STALE version: installed ${data.version || '(missing)'}, source ${packageVersion}`);
|
|
69
|
+
const known = availableSkills();
|
|
70
|
+
const recordedPaths = new Set();
|
|
71
|
+
for (const entry of data.skills || []) {
|
|
72
|
+
const dir = entry.dirPath;
|
|
73
|
+
recordedPaths.add(path.resolve(dir || ''));
|
|
74
|
+
if (!entry.id || !known.has(entry.id)) {
|
|
75
|
+
failures.push(`unknown or removed skill in manifest: ${entry.id || '(missing id)'}`);
|
|
76
|
+
continue;
|
|
77
|
+
}
|
|
78
|
+
if (!dir || !fs.existsSync(dir)) {
|
|
79
|
+
failures.push(`missing installed skill: ${entry.id}`);
|
|
80
|
+
continue;
|
|
81
|
+
}
|
|
82
|
+
const sourceHash = fileTreeHash(path.join(sourceRoot, entry.id));
|
|
83
|
+
const installedHash = fileTreeHash(dir);
|
|
84
|
+
if (sourceHash !== installedHash) failures.push(`STALE tree: ${entry.id} differs from source`);
|
|
85
|
+
}
|
|
86
|
+
if (expectedSkillRoot && fs.existsSync(expectedSkillRoot)) {
|
|
87
|
+
for (const entry of fs.readdirSync(expectedSkillRoot, { withFileTypes: true })) {
|
|
88
|
+
const dir = path.join(expectedSkillRoot, entry.name);
|
|
89
|
+
if (entry.isDirectory() && isHarnessSkill(dir) && !recordedPaths.has(path.resolve(dir))) {
|
|
90
|
+
failures.push(`untracked Harness skill copy: ${entry.name}`);
|
|
91
|
+
}
|
|
92
|
+
}
|
|
93
|
+
}
|
|
94
|
+
return { checked: true, failures };
|
|
95
|
+
}
|
|
96
|
+
|
|
97
|
+
function parseArgs() {
|
|
98
|
+
const args = process.argv.slice(2);
|
|
99
|
+
const value = (name) => {
|
|
100
|
+
const i = args.indexOf(name);
|
|
101
|
+
return i === -1 ? undefined : args[i + 1];
|
|
102
|
+
};
|
|
103
|
+
return {
|
|
104
|
+
root: value('--root') ? path.resolve(value('--root')) : getWorkspaceRoot(),
|
|
105
|
+
manifestPath: value('--manifest') ? path.resolve(value('--manifest')) : undefined,
|
|
106
|
+
global: args.includes('--global'),
|
|
107
|
+
};
|
|
108
|
+
}
|
|
109
|
+
|
|
110
|
+
function main() {
|
|
111
|
+
const options = parseArgs();
|
|
112
|
+
const targets = options.manifestPath
|
|
113
|
+
? [{ manifestPath: options.manifestPath, skillRoot: path.dirname(options.manifestPath).replace(/harness-everything$/, 'skills') }]
|
|
114
|
+
: options.global
|
|
115
|
+
? [{ manifestPath: manifest.getManifestPath(path.join(userHome, '.agents')), skillRoot: path.join(userHome, '.agents', 'skills') }]
|
|
116
|
+
: [
|
|
117
|
+
['.claude', '.claude/skills'], ['.cursor', '.cursor/skills'], ['.github', '.github/skills'],
|
|
118
|
+
['.codex', '.codex/skills'], ['.continue', '.continue/skills'],
|
|
119
|
+
].map(([home, skillsPath]) => ({
|
|
120
|
+
manifestPath: manifest.getManifestPath(path.join(options.root, home)),
|
|
121
|
+
skillRoot: path.join(options.root, skillsPath),
|
|
122
|
+
}));
|
|
123
|
+
let checked = 0;
|
|
124
|
+
let failures = 0;
|
|
125
|
+
for (const target of targets) {
|
|
126
|
+
const result = verifyManifest(target.manifestPath, target.skillRoot);
|
|
127
|
+
if (!result.checked) continue;
|
|
128
|
+
checked++;
|
|
129
|
+
console.log(`Checking ${path.relative(options.root, target.manifestPath) || target.manifestPath}...`);
|
|
130
|
+
if (result.failures.length) {
|
|
131
|
+
result.failures.forEach(failure => console.error(` FAIL ${failure}`));
|
|
132
|
+
failures += result.failures.length;
|
|
133
|
+
} else console.log(' PASS version and skill tree match source.');
|
|
134
|
+
}
|
|
135
|
+
if (!checked) {
|
|
136
|
+
console.error('No Harness installation manifest found. Install Harness before verifying it.');
|
|
137
|
+
process.exit(1);
|
|
138
|
+
}
|
|
139
|
+
if (failures) {
|
|
140
|
+
console.error(`INSTALL VERIFICATION FAILED: ${failures} problem(s).`);
|
|
141
|
+
process.exit(1);
|
|
142
|
+
}
|
|
143
|
+
console.log(`INSTALL VERIFICATION PASSED: ${checked} manifest(s).`);
|
|
144
|
+
}
|
|
145
|
+
|
|
146
|
+
if (require.main === module) main();
|
|
147
|
+
module.exports = { fileTreeHash, verifyManifest };
|
package/security-review/SKILL.md
CHANGED
|
@@ -1,511 +1,50 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: security-review
|
|
3
|
-
description:
|
|
4
|
-
|
|
5
|
-
version: 0.2.0
|
|
3
|
+
description: Conducts STRIDE threat modeling, scans secrets via audit scripts, and hardens code against OWASP Top 10 risks with three-tier boundary controls. Use when implementing auth, handling input/uploads, managing secrets, or auditing code before deployment.
|
|
4
|
+
license: Apache-2.0
|
|
6
5
|
metadata:
|
|
7
|
-
|
|
6
|
+
author: Miya Daniel
|
|
7
|
+
version: 0.3.4
|
|
8
8
|
---
|
|
9
9
|
|
|
10
|
-
# Security Review
|
|
10
|
+
# Security Review & Code Hardening
|
|
11
11
|
|
|
12
|
-
|
|
12
|
+
Hardens code against OWASP Top 10.
|
|
13
13
|
|
|
14
|
-
|
|
15
|
-
|
|
16
|
-
|
|
17
|
-
|
|
18
|
-
|
|
19
|
-
| **Enforcement Gate** | You MUST use grep or standard security linters in the terminal to scan for secrets (`sk-`, `password`) or raw SQL interpolations BEFORE marking the security check as complete. |
|
|
20
|
-
|
|
21
|
-
This skill ensures all code follows security best practices and identifies potential vulnerabilities.
|
|
22
|
-
|
|
23
|
-
## When to Activate
|
|
24
|
-
|
|
25
|
-
- Implementing authentication or authorization
|
|
26
|
-
- Handling user input or file uploads
|
|
27
|
-
- Creating new API endpoints
|
|
28
|
-
- Working with secrets or credentials
|
|
29
|
-
- Implementing payment features
|
|
30
|
-
- Storing or transmitting sensitive data
|
|
31
|
-
- Integrating third-party APIs
|
|
32
|
-
|
|
33
|
-
## Security Checklist
|
|
34
|
-
|
|
35
|
-
### 1. Secrets Management
|
|
36
|
-
|
|
37
|
-
#### FAIL: NEVER Do This
|
|
38
|
-
```typescript
|
|
39
|
-
const apiKey = "sk-proj-xxxxx" // Hardcoded secret
|
|
40
|
-
const dbPassword = "password123" // In source code
|
|
41
|
-
```
|
|
42
|
-
|
|
43
|
-
#### PASS: ALWAYS Do This
|
|
44
|
-
```typescript
|
|
45
|
-
const apiKey = process.env.OPENAI_API_KEY
|
|
46
|
-
const dbUrl = process.env.DATABASE_URL
|
|
47
|
-
|
|
48
|
-
// Verify secrets exist
|
|
49
|
-
if (!apiKey) {
|
|
50
|
-
throw new Error('OPENAI_API_KEY not configured')
|
|
51
|
-
}
|
|
52
|
-
```
|
|
53
|
-
|
|
54
|
-
#### Verification Steps
|
|
55
|
-
- [ ] No hardcoded API keys, tokens, or passwords
|
|
56
|
-
- [ ] All secrets in environment variables
|
|
57
|
-
- [ ] `.env.local` in .gitignore
|
|
58
|
-
- [ ] No secrets in git history
|
|
59
|
-
- [ ] Production secrets in hosting platform (Vercel, Railway)
|
|
60
|
-
|
|
61
|
-
### 2. Input Validation
|
|
62
|
-
|
|
63
|
-
#### Always Validate User Input
|
|
64
|
-
```typescript
|
|
65
|
-
import { z } from 'zod'
|
|
66
|
-
|
|
67
|
-
// Define validation schema
|
|
68
|
-
const CreateUserSchema = z.object({
|
|
69
|
-
email: z.string().email(),
|
|
70
|
-
name: z.string().min(1).max(100),
|
|
71
|
-
age: z.number().int().min(0).max(150)
|
|
72
|
-
})
|
|
73
|
-
|
|
74
|
-
// Validate before processing
|
|
75
|
-
export async function createUser(input: unknown) {
|
|
76
|
-
try {
|
|
77
|
-
const validated = CreateUserSchema.parse(input)
|
|
78
|
-
return await db.users.create(validated)
|
|
79
|
-
} catch (error) {
|
|
80
|
-
if (error instanceof z.ZodError) {
|
|
81
|
-
return { success: false, errors: error.issues }
|
|
82
|
-
}
|
|
83
|
-
throw error
|
|
84
|
-
}
|
|
85
|
-
}
|
|
86
|
-
```
|
|
87
|
-
|
|
88
|
-
#### File Upload Validation
|
|
89
|
-
```typescript
|
|
90
|
-
function validateFileUpload(file: File) {
|
|
91
|
-
// Size check (5MB max)
|
|
92
|
-
const maxSize = 5 * 1024 * 1024
|
|
93
|
-
if (file.size > maxSize) {
|
|
94
|
-
throw new Error('File too large (max 5MB)')
|
|
95
|
-
}
|
|
96
|
-
|
|
97
|
-
// Type check
|
|
98
|
-
const allowedTypes = ['image/jpeg', 'image/png', 'image/gif']
|
|
99
|
-
if (!allowedTypes.includes(file.type)) {
|
|
100
|
-
throw new Error('Invalid file type')
|
|
101
|
-
}
|
|
102
|
-
|
|
103
|
-
// Extension check
|
|
104
|
-
const allowedExtensions = ['.jpg', '.jpeg', '.png', '.gif']
|
|
105
|
-
const extension = file.name.toLowerCase().match(/\.[^.]+$/)?.[0]
|
|
106
|
-
if (!extension || !allowedExtensions.includes(extension)) {
|
|
107
|
-
throw new Error('Invalid file extension')
|
|
108
|
-
}
|
|
109
|
-
|
|
110
|
-
return true
|
|
111
|
-
}
|
|
112
|
-
```
|
|
113
|
-
|
|
114
|
-
#### Verification Steps
|
|
115
|
-
- [ ] All user inputs validated with schemas
|
|
116
|
-
- [ ] File uploads restricted (size, type, extension)
|
|
117
|
-
- [ ] No direct use of user input in queries
|
|
118
|
-
- [ ] Whitelist validation (not blacklist)
|
|
119
|
-
- [ ] Error messages don't leak sensitive info
|
|
120
|
-
|
|
121
|
-
### 3. SQL Injection Prevention
|
|
122
|
-
|
|
123
|
-
#### FAIL: NEVER Concatenate SQL
|
|
124
|
-
```typescript
|
|
125
|
-
// DANGEROUS - SQL Injection vulnerability
|
|
126
|
-
const query = `SELECT * FROM users WHERE email = '${userEmail}'`
|
|
127
|
-
await db.query(query)
|
|
128
|
-
```
|
|
129
|
-
|
|
130
|
-
#### PASS: ALWAYS Use Parameterized Queries
|
|
131
|
-
```typescript
|
|
132
|
-
// Safe - parameterized query
|
|
133
|
-
const { data } = await supabase
|
|
134
|
-
.from('users')
|
|
135
|
-
.select('*')
|
|
136
|
-
.eq('email', userEmail)
|
|
137
|
-
|
|
138
|
-
// Or with raw SQL
|
|
139
|
-
await db.query(
|
|
140
|
-
'SELECT * FROM users WHERE email = $1',
|
|
141
|
-
[userEmail]
|
|
142
|
-
)
|
|
143
|
-
```
|
|
144
|
-
|
|
145
|
-
#### Verification Steps
|
|
146
|
-
- [ ] All database queries use parameterized queries
|
|
147
|
-
- [ ] No string concatenation in SQL
|
|
148
|
-
- [ ] ORM/query builder used correctly
|
|
149
|
-
- [ ] Supabase queries properly sanitized
|
|
150
|
-
|
|
151
|
-
### 4. Authentication & Authorization
|
|
152
|
-
|
|
153
|
-
#### JWT Token Handling
|
|
154
|
-
```typescript
|
|
155
|
-
// FAIL: WRONG: localStorage (vulnerable to XSS)
|
|
156
|
-
localStorage.setItem('token', token)
|
|
157
|
-
|
|
158
|
-
// PASS: CORRECT: httpOnly cookies
|
|
159
|
-
res.setHeader('Set-Cookie',
|
|
160
|
-
`token=${token}; HttpOnly; Secure; SameSite=Strict; Max-Age=3600`)
|
|
161
|
-
```
|
|
162
|
-
|
|
163
|
-
#### Authorization Checks
|
|
164
|
-
```typescript
|
|
165
|
-
export async function deleteUser(userId: string, requesterId: string) {
|
|
166
|
-
// ALWAYS verify authorization first
|
|
167
|
-
const requester = await db.users.findUnique({
|
|
168
|
-
where: { id: requesterId }
|
|
169
|
-
})
|
|
170
|
-
|
|
171
|
-
if (requester.role !== 'admin') {
|
|
172
|
-
return NextResponse.json(
|
|
173
|
-
{ error: 'Unauthorized' },
|
|
174
|
-
{ status: 403 }
|
|
175
|
-
)
|
|
176
|
-
}
|
|
177
|
-
|
|
178
|
-
// Proceed with deletion
|
|
179
|
-
await db.users.delete({ where: { id: userId } })
|
|
180
|
-
}
|
|
181
|
-
```
|
|
182
|
-
|
|
183
|
-
#### Row Level Security (Supabase)
|
|
184
|
-
```sql
|
|
185
|
-
-- Enable RLS on all tables
|
|
186
|
-
ALTER TABLE users ENABLE ROW LEVEL SECURITY;
|
|
187
|
-
|
|
188
|
-
-- Users can only view their own data
|
|
189
|
-
CREATE POLICY "Users view own data"
|
|
190
|
-
ON users FOR SELECT
|
|
191
|
-
USING (auth.uid() = id);
|
|
192
|
-
|
|
193
|
-
-- Users can only update their own data
|
|
194
|
-
CREATE POLICY "Users update own data"
|
|
195
|
-
ON users FOR UPDATE
|
|
196
|
-
USING (auth.uid() = id);
|
|
197
|
-
```
|
|
198
|
-
|
|
199
|
-
#### Verification Steps
|
|
200
|
-
- [ ] Tokens stored in httpOnly cookies (not localStorage)
|
|
201
|
-
- [ ] Authorization checks before sensitive operations
|
|
202
|
-
- [ ] Row Level Security enabled in Supabase
|
|
203
|
-
- [ ] Role-based access control implemented
|
|
204
|
-
- [ ] Session management secure
|
|
205
|
-
|
|
206
|
-
### 5. XSS Prevention
|
|
207
|
-
|
|
208
|
-
#### Sanitize HTML
|
|
209
|
-
```typescript
|
|
210
|
-
import DOMPurify from 'isomorphic-dompurify'
|
|
211
|
-
|
|
212
|
-
// ALWAYS sanitize user-provided HTML
|
|
213
|
-
function renderUserContent(html: string) {
|
|
214
|
-
const clean = DOMPurify.sanitize(html, {
|
|
215
|
-
ALLOWED_TAGS: ['b', 'i', 'em', 'strong', 'p'],
|
|
216
|
-
ALLOWED_ATTR: []
|
|
217
|
-
})
|
|
218
|
-
return <div dangerouslySetInnerHTML={{ __html: clean }} />
|
|
219
|
-
}
|
|
220
|
-
```
|
|
221
|
-
|
|
222
|
-
#### Content Security Policy
|
|
223
|
-
|
|
224
|
-
Start strict and loosen only with a documented removal plan. Do not default to
|
|
225
|
-
`'unsafe-inline'` or `'unsafe-eval'`; they neutralize much of CSP's protection
|
|
226
|
-
and should be treated as temporary compatibility debt.
|
|
227
|
-
|
|
228
|
-
```typescript
|
|
229
|
-
// next.config.js
|
|
230
|
-
const securityHeaders = [
|
|
231
|
-
{
|
|
232
|
-
key: 'Content-Security-Policy',
|
|
233
|
-
value: `
|
|
234
|
-
default-src 'self';
|
|
235
|
-
base-uri 'self';
|
|
236
|
-
object-src 'none';
|
|
237
|
-
frame-ancestors 'none';
|
|
238
|
-
script-src 'self';
|
|
239
|
-
style-src 'self';
|
|
240
|
-
img-src 'self' data: https:;
|
|
241
|
-
font-src 'self';
|
|
242
|
-
connect-src 'self' https://api.example.com;
|
|
243
|
-
`.replace(/\s{2,}/g, ' ').trim()
|
|
244
|
-
}
|
|
245
|
-
]
|
|
246
|
-
```
|
|
247
|
-
|
|
248
|
-
#### Verification Steps
|
|
249
|
-
- [ ] User-provided HTML sanitized
|
|
250
|
-
- [ ] CSP headers configured
|
|
251
|
-
- [ ] No unvalidated dynamic content rendering
|
|
252
|
-
- [ ] React's built-in XSS protection used
|
|
14
|
+
## USE FOR:
|
|
15
|
+
- AuthN or authZ implementation
|
|
16
|
+
- User input, uploads, new API endpoints
|
|
17
|
+
- Secrets, credentials, payment features
|
|
18
|
+
- Security audit before production deploy
|
|
253
19
|
|
|
254
|
-
|
|
20
|
+
## DO NOT USE FOR:
|
|
21
|
+
- Code review without security scope — instead use a standard pass
|
|
22
|
+
- Performance profiling
|
|
23
|
+
- Accessibility or UI styling fixes
|
|
255
24
|
|
|
256
|
-
|
|
257
|
-
```typescript
|
|
258
|
-
import { csrf } from '@/lib/csrf'
|
|
25
|
+
## Skill Contract
|
|
259
26
|
|
|
260
|
-
|
|
261
|
-
|
|
262
|
-
|
|
263
|
-
|
|
264
|
-
|
|
265
|
-
|
|
266
|
-
{ status: 403 }
|
|
267
|
-
)
|
|
268
|
-
}
|
|
269
|
-
|
|
270
|
-
// Process request
|
|
271
|
-
}
|
|
272
|
-
```
|
|
273
|
-
|
|
274
|
-
#### SameSite Cookies
|
|
275
|
-
```typescript
|
|
276
|
-
res.setHeader('Set-Cookie',
|
|
277
|
-
`session=${sessionId}; HttpOnly; Secure; SameSite=Strict`)
|
|
278
|
-
```
|
|
279
|
-
|
|
280
|
-
#### Verification Steps
|
|
281
|
-
- [ ] CSRF tokens on state-changing operations
|
|
282
|
-
- [ ] SameSite=Strict on all cookies
|
|
283
|
-
- [ ] Double-submit cookie pattern implemented
|
|
284
|
-
|
|
285
|
-
### 7. Rate Limiting
|
|
286
|
-
|
|
287
|
-
#### API Rate Limiting
|
|
288
|
-
```typescript
|
|
289
|
-
import rateLimit from 'express-rate-limit'
|
|
290
|
-
|
|
291
|
-
const limiter = rateLimit({
|
|
292
|
-
windowMs: 15 * 60 * 1000, // 15 minutes
|
|
293
|
-
max: 100, // 100 requests per window
|
|
294
|
-
message: 'Too many requests'
|
|
295
|
-
})
|
|
296
|
-
|
|
297
|
-
// Apply to routes
|
|
298
|
-
app.use('/api/', limiter)
|
|
299
|
-
```
|
|
300
|
-
|
|
301
|
-
#### Expensive Operations
|
|
302
|
-
```typescript
|
|
303
|
-
// Aggressive rate limiting for searches
|
|
304
|
-
const searchLimiter = rateLimit({
|
|
305
|
-
windowMs: 60 * 1000, // 1 minute
|
|
306
|
-
max: 10, // 10 requests per minute
|
|
307
|
-
message: 'Too many search requests'
|
|
308
|
-
})
|
|
309
|
-
|
|
310
|
-
app.use('/api/search', searchLimiter)
|
|
311
|
-
```
|
|
312
|
-
|
|
313
|
-
#### Verification Steps
|
|
314
|
-
- [ ] Rate limiting on all API endpoints
|
|
315
|
-
- [ ] Stricter limits on expensive operations
|
|
316
|
-
- [ ] IP-based rate limiting
|
|
317
|
-
- [ ] User-based rate limiting (authenticated)
|
|
318
|
-
|
|
319
|
-
### 8. Sensitive Data Exposure
|
|
320
|
-
|
|
321
|
-
#### Logging
|
|
322
|
-
```typescript
|
|
323
|
-
// FAIL: WRONG: Logging sensitive data
|
|
324
|
-
console.log('User login:', { email, password })
|
|
325
|
-
console.log('Payment:', { cardNumber, cvv })
|
|
326
|
-
|
|
327
|
-
// PASS: CORRECT: Redact sensitive data
|
|
328
|
-
console.log('User login:', { email, userId })
|
|
329
|
-
console.log('Payment:', { last4: card.last4, userId })
|
|
330
|
-
```
|
|
331
|
-
|
|
332
|
-
#### Error Messages
|
|
333
|
-
```typescript
|
|
334
|
-
// FAIL: WRONG: Exposing internal details
|
|
335
|
-
catch (error) {
|
|
336
|
-
return NextResponse.json(
|
|
337
|
-
{ error: error.message, stack: error.stack },
|
|
338
|
-
{ status: 500 }
|
|
339
|
-
)
|
|
340
|
-
}
|
|
341
|
-
|
|
342
|
-
// PASS: CORRECT: Generic error messages
|
|
343
|
-
catch (error) {
|
|
344
|
-
console.error('Internal error:', error)
|
|
345
|
-
return NextResponse.json(
|
|
346
|
-
{ error: 'An error occurred. Please try again.' },
|
|
347
|
-
{ status: 500 }
|
|
348
|
-
)
|
|
349
|
-
}
|
|
350
|
-
```
|
|
351
|
-
|
|
352
|
-
#### Verification Steps
|
|
353
|
-
- [ ] No passwords, tokens, or secrets in logs
|
|
354
|
-
- [ ] Error messages generic for users
|
|
355
|
-
- [ ] Detailed errors only in server logs
|
|
356
|
-
- [ ] No stack traces exposed to users
|
|
357
|
-
|
|
358
|
-
### 9. Blockchain Security (Solana)
|
|
359
|
-
|
|
360
|
-
#### Wallet Verification
|
|
361
|
-
```typescript
|
|
362
|
-
import { verify } from '@solana/web3.js'
|
|
363
|
-
|
|
364
|
-
async function verifyWalletOwnership(
|
|
365
|
-
publicKey: string,
|
|
366
|
-
signature: string,
|
|
367
|
-
message: string
|
|
368
|
-
) {
|
|
369
|
-
try {
|
|
370
|
-
const isValid = verify(
|
|
371
|
-
Buffer.from(message),
|
|
372
|
-
Buffer.from(signature, 'base64'),
|
|
373
|
-
Buffer.from(publicKey, 'base64')
|
|
374
|
-
)
|
|
375
|
-
return isValid
|
|
376
|
-
} catch (error) {
|
|
377
|
-
return false
|
|
378
|
-
}
|
|
379
|
-
}
|
|
380
|
-
```
|
|
381
|
-
|
|
382
|
-
#### Transaction Verification
|
|
383
|
-
```typescript
|
|
384
|
-
async function verifyTransaction(transaction: Transaction) {
|
|
385
|
-
// Verify recipient
|
|
386
|
-
if (transaction.to !== expectedRecipient) {
|
|
387
|
-
throw new Error('Invalid recipient')
|
|
388
|
-
}
|
|
389
|
-
|
|
390
|
-
// Verify amount
|
|
391
|
-
if (transaction.amount > maxAmount) {
|
|
392
|
-
throw new Error('Amount exceeds limit')
|
|
393
|
-
}
|
|
394
|
-
|
|
395
|
-
// Verify user has sufficient balance
|
|
396
|
-
const balance = await getBalance(transaction.from)
|
|
397
|
-
if (balance < transaction.amount) {
|
|
398
|
-
throw new Error('Insufficient balance')
|
|
399
|
-
}
|
|
400
|
-
|
|
401
|
-
return true
|
|
402
|
-
}
|
|
403
|
-
```
|
|
404
|
-
|
|
405
|
-
#### Verification Steps
|
|
406
|
-
- [ ] Wallet signatures verified
|
|
407
|
-
- [ ] Transaction details validated
|
|
408
|
-
- [ ] Balance checks before transactions
|
|
409
|
-
- [ ] No blind transaction signing
|
|
410
|
-
|
|
411
|
-
### 10. Dependency Security
|
|
412
|
-
|
|
413
|
-
#### Regular Updates
|
|
414
|
-
```bash
|
|
415
|
-
# Check for vulnerabilities
|
|
416
|
-
npm audit
|
|
417
|
-
|
|
418
|
-
# Fix automatically fixable issues
|
|
419
|
-
npm audit fix
|
|
420
|
-
|
|
421
|
-
# Update dependencies
|
|
422
|
-
npm update
|
|
423
|
-
|
|
424
|
-
# Check for outdated packages
|
|
425
|
-
npm outdated
|
|
426
|
-
```
|
|
427
|
-
|
|
428
|
-
#### Lock Files
|
|
429
|
-
```bash
|
|
430
|
-
# ALWAYS commit lock files
|
|
431
|
-
git add package-lock.json
|
|
432
|
-
|
|
433
|
-
# Use in CI/CD for reproducible builds
|
|
434
|
-
npm ci # Instead of npm install
|
|
435
|
-
```
|
|
436
|
-
|
|
437
|
-
#### Verification Steps
|
|
438
|
-
- [ ] Dependencies up to date
|
|
439
|
-
- [ ] No known vulnerabilities (npm audit clean)
|
|
440
|
-
- [ ] Lock files committed
|
|
441
|
-
- [ ] Dependabot enabled on GitHub
|
|
442
|
-
- [ ] Regular security updates
|
|
443
|
-
|
|
444
|
-
## Security Testing
|
|
445
|
-
|
|
446
|
-
### Automated Security Tests
|
|
447
|
-
```typescript
|
|
448
|
-
// Test authentication
|
|
449
|
-
test('requires authentication', async () => {
|
|
450
|
-
const response = await fetch('/api/protected')
|
|
451
|
-
expect(response.status).toBe(401)
|
|
452
|
-
})
|
|
453
|
-
|
|
454
|
-
// Test authorization
|
|
455
|
-
test('requires admin role', async () => {
|
|
456
|
-
const response = await fetch('/api/admin', {
|
|
457
|
-
headers: { Authorization: `Bearer ${userToken}` }
|
|
458
|
-
})
|
|
459
|
-
expect(response.status).toBe(403)
|
|
460
|
-
})
|
|
461
|
-
|
|
462
|
-
// Test input validation
|
|
463
|
-
test('rejects invalid input', async () => {
|
|
464
|
-
const response = await fetch('/api/users', {
|
|
465
|
-
method: 'POST',
|
|
466
|
-
body: JSON.stringify({ email: 'not-an-email' })
|
|
467
|
-
})
|
|
468
|
-
expect(response.status).toBe(400)
|
|
469
|
-
})
|
|
470
|
-
|
|
471
|
-
// Test rate limiting
|
|
472
|
-
test('enforces rate limits', async () => {
|
|
473
|
-
const requests = Array(101).fill(null).map(() =>
|
|
474
|
-
fetch('/api/endpoint')
|
|
475
|
-
)
|
|
476
|
-
|
|
477
|
-
const responses = await Promise.all(requests)
|
|
478
|
-
const tooManyRequests = responses.filter(r => r.status === 429)
|
|
479
|
-
|
|
480
|
-
expect(tooManyRequests.length).toBeGreaterThan(0)
|
|
481
|
-
})
|
|
482
|
-
```
|
|
27
|
+
| Component | Specification |
|
|
28
|
+
| :--- | :--- |
|
|
29
|
+
| **Trigger / Input** | Auth, endpoints, uploads, user input, secrets, audit requests. |
|
|
30
|
+
| **Expected Output** | Threat model, scan via `audit-secrets.js`, hardened code, audit report. |
|
|
31
|
+
| **State Mutations** | Codebase hardened against injection/XSS/IDOR; report to docs or platform dir. |
|
|
32
|
+
| **Enforcement Gate** | Secret scan via the script or grep before concluding review. |
|
|
483
33
|
|
|
484
|
-
##
|
|
34
|
+
## Review Flow
|
|
485
35
|
|
|
486
|
-
|
|
36
|
+
1. Threat-model (`STRIDE`) per security-review/guides/STRIDE-THREAT-MODEL.md; misuse-case every endpoint/input.
|
|
37
|
+
2. Scan secrets and injection risks:
|
|
38
|
+
```bash
|
|
39
|
+
node "<this-skill-dir>/scripts/audit-secrets.js"
|
|
40
|
+
```
|
|
41
|
+
Fallback: grep scan.
|
|
42
|
+
3. Fix findings per the boundary system; report to `docs/security-audit.md`, or `.github/harness-everything/security-audit.md` when docs/ is protected or absent.
|
|
487
43
|
|
|
488
|
-
-
|
|
489
|
-
- [ ] **Input Validation**: All user inputs validated
|
|
490
|
-
- [ ] **SQL Injection**: All queries parameterized
|
|
491
|
-
- [ ] **XSS**: User content sanitized
|
|
492
|
-
- [ ] **CSRF**: Protection enabled
|
|
493
|
-
- [ ] **Authentication**: Proper token handling
|
|
494
|
-
- [ ] **Authorization**: Role checks in place
|
|
495
|
-
- [ ] **Rate Limiting**: Enabled on all endpoints
|
|
496
|
-
- [ ] **HTTPS**: Enforced in production
|
|
497
|
-
- [ ] **Security Headers**: CSP, X-Frame-Options configured
|
|
498
|
-
- [ ] **Error Handling**: No sensitive data in errors
|
|
499
|
-
- [ ] **Logging**: No sensitive data logged
|
|
500
|
-
- [ ] **Dependencies**: Up to date, no vulnerabilities
|
|
501
|
-
- [ ] **Row Level Security**: Enabled in Supabase
|
|
502
|
-
- [ ] **CORS**: Properly configured
|
|
503
|
-
- [ ] **File Uploads**: Validated (size, type)
|
|
504
|
-
- [ ] **Wallet Signatures**: Verified (if blockchain)
|
|
44
|
+
## Three-Tier Boundary System
|
|
505
45
|
|
|
506
|
-
|
|
46
|
+
- **Always Do**: parameterize SQL, Zod-validate inputs, httpOnly cookies, secrets to `process.env`.
|
|
47
|
+
- **Ask First**: CORS changes, auth/login flows, file uploads, rate limits.
|
|
48
|
+
- **Never Do**: commit hardcoded secrets (`sk-`), log passwords/tokens, use eval() or unescaped innerHTML.
|
|
507
49
|
|
|
508
|
-
|
|
509
|
-
- [Next.js Security](https://nextjs.org/docs/security)
|
|
510
|
-
- [Supabase Security](https://supabase.com/docs/guides/auth)
|
|
511
|
-
- [Web Security Academy](https://portswigger.net/web-security)
|
|
50
|
+
Deep dive: references/security-checklist.md + security-review/guides/OWASP-PATTERNS.md
|