@cbartens/bkit 5.5.1 → 6.1.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.bkit/README.md +167 -154
- package/.bkit/core/.agents/context.md +95 -29
- package/.bkit/core/.agents/docs.md +18 -15
- package/.bkit/core/.agents/plugins/bkit/hooks/bkit-gateguard.cjs +1 -0
- package/.bkit/core/.agents/plugins/bkit/hooks/bkit-guardrails.cjs +6 -5
- package/.bkit/core/.agents/plugins/bkit/hooks/bkit-readguard.cjs +1 -0
- package/.bkit/core/.agents/plugins/bkit/hooks/bkit-rules.cjs +65 -0
- package/.bkit/core/.agents/rules.md +112 -102
- package/.bkit/core/.agents/skills.md +63 -15
- package/.bkit/core/.bkit/README.md +167 -154
- package/.bkit/core/.bkit/authoring.md +747 -0
- package/.bkit/core/.bkit/cli.md +407 -0
- package/.bkit/core/.bkit/cloud.md +283 -195
- package/.bkit/core/.bkit/comparison.md +45 -43
- package/.bkit/core/.bkit/install.md +166 -95
- package/.bkit/core/.bkit/jsonl.md +339 -196
- package/.bkit/core/.bkit/pipeline.md +142 -145
- package/.bkit/core/.bkit/prompts.md +295 -264
- package/.bkit/core/.bkit/providers.md +460 -277
- package/.bkit/core/.bkit/router.md +69 -0
- package/.bkit/core/.bkit/templates.md +530 -256
- package/.bkit/core/.bkit/trackers.md +116 -65
- package/.bkit/core/.bkit/workflows.md +742 -618
- package/.bkit/core/.claude/hooks/bkit-gateguard.cjs +2 -2
- package/.bkit/core/.claude/hooks/bkit-guardrails.cjs +3 -3
- package/.bkit/core/.claude/hooks/bkit-preflight.sh +45 -14
- package/.bkit/core/.codex/hooks/bkit-guardrails.cjs +3 -3
- package/.bkit/core/.codex/hooks/bkit-rules.cjs +57 -0
- package/.bkit/core/.cursor/hooks/bkit-guardrails.cjs +7 -7
- package/.bkit/core/.cursor/hooks/bkit-preflight.sh +47 -12
- package/.bkit/core/.opencode/plugin/bkit-rules.js +89 -0
- package/.bkit/core/AGENTS.md +6 -80
- package/.bkit/core/docs/templates/bkit-audit-accessibility.md +128 -130
- package/.bkit/core/docs/templates/bkit-audit-adoption.md +104 -94
- package/.bkit/core/docs/templates/bkit-audit-agents.md +96 -98
- package/.bkit/core/docs/templates/bkit-audit-aio-seo.md +100 -103
- package/.bkit/core/docs/templates/bkit-audit-analytics.md +141 -107
- package/.bkit/core/docs/templates/bkit-audit-annotations.md +99 -97
- package/.bkit/core/docs/templates/bkit-audit-app-performance.md +122 -121
- package/.bkit/core/docs/templates/bkit-audit-app-store.md +158 -101
- package/.bkit/core/docs/templates/bkit-audit-architecture.md +114 -96
- package/.bkit/core/docs/templates/bkit-audit-ci-performance.md +76 -97
- package/.bkit/core/docs/templates/bkit-audit-config.md +123 -101
- package/.bkit/core/docs/templates/bkit-audit-cost.md +86 -99
- package/.bkit/core/docs/templates/bkit-audit-coverage.md +76 -93
- package/.bkit/core/docs/templates/bkit-audit-database.md +102 -95
- package/.bkit/core/docs/templates/bkit-audit-dead-code.md +165 -108
- package/.bkit/core/docs/templates/bkit-audit-deferrals.md +115 -109
- package/.bkit/core/docs/templates/bkit-audit-dependencies.md +265 -113
- package/.bkit/core/docs/templates/bkit-audit-documentation.md +119 -118
- package/.bkit/core/docs/templates/bkit-audit-duplication.md +140 -111
- package/.bkit/core/docs/templates/bkit-audit-failures.md +111 -106
- package/.bkit/core/docs/templates/bkit-audit-flakes.md +100 -99
- package/.bkit/core/docs/templates/bkit-audit-gates.md +107 -103
- package/.bkit/core/docs/templates/bkit-audit-issues.md +105 -105
- package/.bkit/core/docs/templates/bkit-audit-llm.md +134 -85
- package/.bkit/core/docs/templates/bkit-audit-logs.md +124 -125
- package/.bkit/core/docs/templates/bkit-audit-models.md +99 -78
- package/.bkit/core/docs/templates/bkit-audit-privacy.md +56 -76
- package/.bkit/core/docs/templates/bkit-audit-prompts.md +63 -78
- package/.bkit/core/docs/templates/bkit-audit-red-team.md +125 -93
- package/.bkit/core/docs/templates/bkit-audit-reliability.md +97 -96
- package/.bkit/core/docs/templates/bkit-audit-repo.md +170 -98
- package/.bkit/core/docs/templates/bkit-audit-security.md +207 -121
- package/.bkit/core/docs/templates/bkit-audit-slop.md +78 -95
- package/.bkit/core/docs/templates/bkit-audit-testing.md +163 -139
- package/.bkit/core/docs/templates/bkit-audit-usability.md +114 -96
- package/.bkit/core/docs/templates/bkit-plan.md +158 -281
- package/.bkit/core/engine/checks/after/auth.ts +40 -37
- package/.bkit/core/engine/checks/after/ci-yml.ts +104 -31
- package/.bkit/core/engine/checks/after/github.ts +95 -17
- package/.bkit/core/engine/checks/after/index.ts +21 -8
- package/.bkit/core/engine/checks/after/suppression.ts +8 -5
- package/.bkit/core/engine/checks/after/tools.ts +125 -123
- package/.bkit/core/engine/checks/before/context-fetch.ts +227 -33
- package/.bkit/core/engine/checks/before/env.ts +3 -3
- package/.bkit/core/engine/checks/before/files.ts +5 -4
- package/.bkit/core/engine/checks/before/index.ts +25 -1
- package/.bkit/core/engine/checks/before/repo.ts +208 -2
- package/.bkit/core/engine/checks/status-holes.ts +916 -123
- package/.bkit/core/engine/checks/tips/catalogue.ts +82 -20
- package/.bkit/core/engine/checks/tips/detect.ts +66 -0
- package/.bkit/core/engine/checks/tips/index.ts +52 -11
- package/.bkit/core/engine/cli.ts +251 -130
- package/.bkit/core/engine/commands/analysis.ts +282 -199
- package/.bkit/core/engine/commands/ci/ci.ts +363 -29
- package/.bkit/core/engine/commands/ci/pins.ts +172 -0
- package/.bkit/core/engine/commands/ci/push-gate.ts +223 -0
- package/.bkit/core/engine/commands/comply.ts +77 -103
- package/.bkit/core/engine/commands/install/doctor.ts +2 -2
- package/.bkit/core/engine/commands/install/install.ts +57 -18
- package/.bkit/core/engine/commands/install/uninstall.ts +86 -55
- package/.bkit/core/engine/commands/install/upgrade.ts +32 -15
- package/.bkit/core/engine/commands/land.ts +139 -18
- package/.bkit/core/engine/commands/lib.ts +381 -22
- package/.bkit/core/engine/commands/registry.ts +10 -2
- package/.bkit/core/engine/commands/setup/setup.ts +8 -7
- package/.bkit/core/engine/commands/stats.ts +260 -0
- package/.bkit/core/engine/commands/tips.ts +10 -5
- package/.bkit/core/engine/commands/workflow/branches.ts +2215 -176
- package/.bkit/core/engine/commands/workflow/challenge.ts +748 -0
- package/.bkit/core/engine/commands/workflow/completeness.ts +109 -0
- package/.bkit/core/engine/commands/workflow/context.ts +1249 -47
- package/.bkit/core/engine/commands/workflow/counters.ts +483 -95
- package/.bkit/core/engine/commands/workflow/decisions.ts +585 -0
- package/.bkit/core/engine/commands/workflow/disk.ts +238 -56
- package/.bkit/core/engine/commands/workflow/fids.ts +811 -33
- package/.bkit/core/engine/commands/workflow/issues.ts +413 -64
- package/.bkit/core/engine/commands/workflow/ledgers.ts +1333 -36
- package/.bkit/core/engine/commands/workflow/locks.ts +28 -2
- package/.bkit/core/engine/commands/workflow/plan-blocks.ts +691 -0
- package/.bkit/core/engine/commands/workflow/plan-versions.ts +21 -0
- package/.bkit/core/engine/commands/workflow/plans.ts +257 -0
- package/.bkit/core/engine/commands/workflow/prs.ts +178 -33
- package/.bkit/core/engine/commands/workflow/repo.ts +66 -8
- package/.bkit/core/engine/commands/workflow/roadmap.ts +72 -22
- package/.bkit/core/engine/commands/workflow/run-facts.ts +492 -0
- package/.bkit/core/engine/commands/workflow/runs.ts +827 -79
- package/.bkit/core/engine/commands/workflow/runtime.ts +25 -1
- package/.bkit/core/engine/commands/workflow/skills.ts +1 -0
- package/.bkit/core/engine/commands/workflow/status.ts +329 -33
- package/.bkit/core/engine/commands/workflow/step-table.ts +381 -0
- package/.bkit/core/engine/commands/workflow/steps.ts +841 -105
- package/.bkit/core/engine/commands/workflow/summary-findings.ts +177 -0
- package/.bkit/core/engine/commands/workflow/summary.ts +544 -0
- package/.bkit/core/engine/commands/workflow/tasks.ts +409 -0
- package/.bkit/core/engine/commands/workflow/test-blocks.ts +254 -0
- package/.bkit/core/engine/commands/workflow/tests-changed.ts +201 -0
- package/.bkit/core/engine/commands/workflow/tests.ts +2124 -330
- package/.bkit/core/engine/commands/workflow/tracker.ts +1195 -0
- package/.bkit/core/engine/commands/workflow/workflows.ts +1197 -235
- package/.bkit/core/engine/commands/workflow/worktrees.ts +543 -24
- package/.bkit/core/engine/install/cloud-env.ts +251 -121
- package/.bkit/core/engine/install/context-ci-workflow.ts +102 -0
- package/.bkit/core/engine/install/manifest.ts +67 -17
- package/.bkit/core/engine/install/modules/antigravity.ts +3 -2
- package/.bkit/core/engine/install/modules/cloud.ts +24 -16
- package/.bkit/core/engine/install/modules/codex.ts +15 -2
- package/.bkit/core/engine/install/modules/core.ts +1196 -45
- package/.bkit/core/engine/install/modules/cursor.ts +6 -6
- package/.bkit/core/engine/install/modules/opencode.ts +18 -6
- package/.bkit/core/engine/install/template-notes.ts +130 -0
- package/.bkit/core/engine/install/version-file.ts +9 -4
- package/.bkit/core/engine/install/write.ts +5 -0
- package/.bkit/core/engine/ledgers/compact.ts +124 -0
- package/.bkit/core/engine/ledgers/journal.ts +291 -0
- package/.bkit/core/engine/ledgers/migrate.ts +92 -0
- package/.bkit/core/engine/ledgers/status.ts +249 -21
- package/.bkit/core/engine/ledgers/telemetry.ts +1397 -253
- package/.bkit/core/engine/render/hosts.ts +118 -14
- package/.bkit/core/engine/render/models.ts +12 -0
- package/.bkit/core/engine/shared/bkit-latest.ts +26 -4
- package/.bkit/core/engine/shared/branches.ts +4 -1
- package/.bkit/core/engine/shared/dep-updater.ts +60 -0
- package/.bkit/core/engine/shared/egress.ts +8 -1
- package/.bkit/core/engine/shared/json.ts +25 -7
- package/.bkit/core/engine/shared/package-manager.ts +9 -0
- package/.bkit/core/engine/shared/settings.ts +243 -31
- package/.bkit/core/engine/shared/text.ts +361 -0
- package/.bkit/core/engine/shared/timeouts.ts +2 -0
- package/.bkit/core/engine/tools/cli-doc.ts +111 -0
- package/.bkit/core/engine/tools/grammar-density.ts +215 -0
- package/.bkit/core/engine/tools/instructions-sources.ts +832 -0
- package/.bkit/core/engine/tools/instructions.ts +1802 -0
- package/.bkit/core/hooks/antigravity-hook.js +25 -10
- package/.bkit/core/hooks/gateguard-engine.js +54 -29
- package/.bkit/core/hooks/guardrails-shell.js +4 -5
- package/.bkit/core/hooks/guardrails-tiers.js +10 -4
- package/.bkit/core/hooks/preflight-linear.sh +9 -9
- package/.bkit/core/hooks/preflight-rules.sh +8 -0
- package/.bkit/core/hooks/readguard-engine.js +29 -10
- package/.bkit/core/hooks/session-rules-advisory.js +61 -0
- package/.bkit/core/prompts/bkit-audit-generate.md +202 -94
- package/.bkit/core/prompts/bkit-build-challenge-1.md +76 -34
- package/.bkit/core/prompts/bkit-build-challenge-2.md +85 -38
- package/.bkit/core/prompts/bkit-build-install-skills.md +50 -28
- package/.bkit/core/prompts/bkit-build-plan-convert.md +85 -0
- package/.bkit/core/prompts/bkit-build-plan-current.md +59 -36
- package/.bkit/core/prompts/bkit-build-plan-gaps-remediate.md +101 -36
- package/.bkit/core/prompts/bkit-build-plan-tasks.md +149 -0
- package/.bkit/core/prompts/bkit-build-plan-tests.md +120 -0
- package/.bkit/core/prompts/bkit-build-plan-verify.md +104 -43
- package/.bkit/core/prompts/bkit-debug-abort-handover.md +47 -32
- package/.bkit/core/prompts/bkit-debug-failure-diagnose.md +109 -57
- package/.bkit/core/prompts/bkit-debug-failure-remediate.md +65 -39
- package/.bkit/core/prompts/bkit-debug-failure-reproduce.md +53 -31
- package/.bkit/core/prompts/bkit-debug-failure-soak.md +65 -34
- package/.bkit/core/prompts/bkit-design-brainstorm-ideate-1.md +46 -31
- package/.bkit/core/prompts/bkit-design-brainstorm-ideate-2.md +45 -31
- package/.bkit/core/prompts/bkit-design-brainstorm-ideate-3.md +43 -30
- package/.bkit/core/prompts/bkit-design-generate.md +80 -46
- package/.bkit/core/prompts/bkit-design-organise.md +83 -32
- package/.bkit/core/prompts/bkit-design-review-1.md +70 -50
- package/.bkit/core/prompts/bkit-design-review-2.md +65 -46
- package/.bkit/core/prompts/bkit-design-spike.md +64 -40
- package/.bkit/core/prompts/bkit-design-update.md +53 -28
- package/.bkit/core/prompts/bkit-plan-generate.md +101 -29
- package/.bkit/core/prompts/bkit-plan-review-1.md +78 -41
- package/.bkit/core/prompts/bkit-plan-review-2.md +78 -35
- package/.bkit/core/prompts/bkit-plan-scope-check.md +116 -0
- package/.bkit/core/prompts/bkit-plan-update.md +86 -31
- package/.bkit/core/prompts/bkit-ship-conflict-resolve.md +94 -50
- package/.bkit/core/prompts/bkit-ship-deferred-sweep.md +91 -41
- package/.bkit/core/prompts/bkit-ship-update-docs.md +45 -24
- package/.bkit/core/prompts/bkit-utility-compress-markdown.md +65 -49
- package/.bkit/core/prompts/bkit-utility-update-decisions.md +87 -42
- package/.bkit/core/prompts/bkit-utility-update-deferrals.md +81 -37
- package/.bkit/core/prompts/bkit-utility-update-documentation.md +43 -25
- package/.bkit/core/prompts/bkit-utility-update-failures.md +84 -37
- package/.bkit/core/prompts/bkit-utility-update-knowledge.md +88 -42
- package/.bkit/core/prompts/bkit-utility-update-roadmap.md +92 -39
- package/.bkit/core/prompts/bkit-utility-update-tracker.md +159 -60
- package/.bkit/core/workflows/bkit-auto.md +89 -58
- package/.bkit/core/workflows/bkit-build.md +967 -517
- package/.bkit/core/workflows/bkit-debug.md +555 -387
- package/.bkit/core/workflows/bkit-design.md +319 -283
- package/.bkit/core/workflows/bkit-plan.md +319 -342
- package/.bkit/core/workflows/bkit-ship.md +525 -328
- package/.bkit/shared/.agents/plugins/bkit/hooks.json +10 -0
- package/.bkit/shared/.bkit/.env.example +2 -2
- package/.bkit/shared/.claude/bkit-cloud.md +12 -10
- package/.bkit/shared/.claude/settings.json +14 -0
- package/.bkit/shared/.codex/bkit-cloud.md +98 -0
- package/.bkit/shared/.codex/hooks.json +20 -0
- package/.bkit/shared/.cursor/bkit-cloud.md +3 -3
- package/.bkit/shared/.cursor/mcp.json +1 -1
- package/.bkit/shared/.cursor/rules/bkit-rules.mdc +1 -1
- package/.bkit/shared/.gitattributes +1 -1
- package/.bkit/shared/.mcp.json +1 -1
- package/.bkit/shared/.opencode/opencode.json +12 -1
- package/.bkit/shared/CLAUDE.md +6 -2
- package/.bkit/shared/GEMINI.md +5 -2
- package/.bkit/shared/docs/architecture.md +4 -7
- package/.bkit/shared/docs/data-schema.md +4 -7
- package/.bkit/shared/docs/deployments.md +241 -168
- package/.bkit/shared/docs/design.md +11 -12
- package/.bkit/shared/docs/noise.md +8 -7
- package/.bkit/shared/docs/observability.md +5 -8
- package/.bkit/shared/docs/security.md +35 -17
- package/.bkit/shared/docs/setup.md +29 -18
- package/.bkit/shared/docs/technology.md +3 -6
- package/.bkit/shared/docs/testing.md +289 -174
- package/.bkit/shared/gitignore +6 -2
- package/.bkit/templates/.claude/hooks/bkit-cloud-bootstrap.sh +15 -16
- package/.bkit/templates/.cursor/Dockerfile +12 -8
- package/.bkit/templates/.cursor/environment.json +1 -1
- package/.bkit/templates/.github/ISSUE_TEMPLATE/bkit-bug.yml +10 -8
- package/.bkit/templates/.github/ISSUE_TEMPLATE/bkit-change.yml +45 -12
- package/.bkit/templates/.github/ISSUE_TEMPLATE/bkit-idea.yml +3 -3
- package/.bkit/templates/.github/renovate.json5 +34 -6
- package/.bkit/templates/.github/workflows/bkit-ci.yml +54 -51
- package/.bkit/templates/.github/workflows/bkit-cloud.yml +34 -33
- package/.bkit/templates/.github/workflows/bkit-health.yml +97 -0
- package/.bkit/templates/.github/workflows/bkit-renovate.yml +5 -4
- package/.bkit/templates/.github/workflows/bkit-trivy.yml +5 -4
- package/.bkit/templates/.husky/pre-commit +2 -2
- package/.bkit/templates/.husky/pre-push +96 -36
- package/.bkit/templates/.prettierignore +6 -0
- package/.bkit/templates/.vale.ini +27 -27
- package/.bkit/templates/context/bkit-cloudrun.md +23 -15
- package/.bkit/templates/context/bkit-expo.md +70 -52
- package/.bkit/templates/context/bkit-github.md +93 -56
- package/.bkit/templates/context/bkit-inngest.md +21 -15
- package/.bkit/templates/context/bkit-maestro.md +22 -16
- package/.bkit/templates/context/bkit-playwright.md +23 -17
- package/.bkit/templates/context/bkit-resend.md +12 -10
- package/.bkit/templates/context/bkit-sentry.md +30 -20
- package/.bkit/templates/context/bkit-serena.md +8 -7
- package/.bkit/templates/context/bkit-stripe.md +14 -13
- package/.bkit/templates/context/bkit-supabase.md +16 -13
- package/.bkit/templates/context/bkit-tavily.md +14 -11
- package/.bkit/templates/context/bkit-vercel.md +27 -18
- package/.bkit/templates/docs/capabilities.md +15 -14
- package/.bkit/templates/scripts/ci/{check-accepted-divergences.mjs → bkit-check-accepted-divergences.mjs} +6 -3
- package/.bkit/templates/scripts/ci/{check-accepted-divergences.test.mjs → bkit-check-accepted-divergences.test.mjs} +3 -3
- package/.bkit/templates/scripts/ci/{check-capstone.mjs → bkit-check-capstone.mjs} +2 -2
- package/.bkit/templates/scripts/ci/{check-capstone.test.mjs → bkit-check-capstone.test.mjs} +4 -4
- package/.bkit/templates/scripts/ci/{check-dependency-audit.mjs → bkit-check-dependency-audit.mjs} +103 -18
- package/.bkit/templates/scripts/ci/{check-dependency-audit.test.mjs → bkit-check-dependency-audit.test.mjs} +31 -3
- package/.bkit/templates/scripts/ci/bkit-machine-lock.sh +387 -0
- package/.bkit/templates/scripts/ci/bkit-test-awake.mjs +75 -0
- package/.bkit/templates/scripts/ci/bkit-test-awake.test.mjs +160 -0
- package/.bkit/templates/scripts/ci/lanes/{resolve-push-base.mjs → bkit-resolve-push-base.mjs} +3 -3
- package/.bkit/templates/scripts/ci/lanes/{resolve-push-base.test.mjs → bkit-resolve-push-base.test.mjs} +4 -4
- package/.bkit/templates/scripts/cleanup/bkit-disk-prune.mjs +10 -2
- package/.bkit/templates/scripts/graphify/bkit-graph-drift.py +1 -1
- package/.bkit/templates/scripts/graphify/bkit-graph-eager.py +3 -3
- package/.bkit/templates/scripts/graphify/bkit-graph-embed.py +63 -0
- package/.bkit/templates/scripts/graphify/bkit-graph-imports.py +2 -2
- package/.bkit/templates/scripts/graphify/bkit-graph-pre-push.sh +69 -18
- package/.bkit/templates/scripts/graphify/bkit-graph-repair.py +3 -3
- package/.bkit/templates/scripts/graphify/bkit-graph-surface.py +1 -1
- package/.bkit/templates/scripts/graphify/bkit-graphify-graphml.py +1 -1
- package/.bkit/templates/scripts/graphify/bkit-graphify-rollup.py +197 -126
- package/.bkit/templates/scripts/graphify/bkit-graphify.sh +64 -41
- package/.bkit/templates/scripts/slop/bkit-slop-type-suppression.mjs +23 -7
- package/.bkit/templates/slop-scan.config.json +9 -2
- package/CHANGELOG.md +231 -0
- package/README.md +278 -89
- package/dist/checks/after/auth.js +36 -33
- package/dist/checks/after/ci-yml.js +91 -30
- package/dist/checks/after/github.js +91 -17
- package/dist/checks/after/index.js +22 -11
- package/dist/checks/after/suppression.js +8 -5
- package/dist/checks/after/tools.js +111 -114
- package/dist/checks/before/context-fetch.js +218 -33
- package/dist/checks/before/env.js +3 -3
- package/dist/checks/before/files.js +5 -3
- package/dist/checks/before/index.js +20 -3
- package/dist/checks/before/repo.js +197 -2
- package/dist/checks/status-holes.js +739 -114
- package/dist/checks/tips/catalogue.js +70 -19
- package/dist/checks/tips/detect.js +62 -0
- package/dist/checks/tips/index.js +51 -9
- package/dist/cli.js +234 -124
- package/dist/commands/analysis.js +174 -141
- package/dist/commands/ci/ci.js +302 -25
- package/dist/commands/ci/pins.js +142 -0
- package/dist/commands/ci/push-gate.js +194 -0
- package/dist/commands/comply.js +54 -91
- package/dist/commands/install/doctor.js +2 -2
- package/dist/commands/install/install.js +50 -19
- package/dist/commands/install/uninstall.js +82 -55
- package/dist/commands/install/upgrade.js +21 -11
- package/dist/commands/land.js +137 -17
- package/dist/commands/lib.js +295 -21
- package/dist/commands/registry.js +10 -2
- package/dist/commands/setup/setup.js +8 -7
- package/dist/commands/stats.js +175 -0
- package/dist/commands/tips.js +7 -3
- package/dist/commands/workflow/branches.js +1873 -152
- package/dist/commands/workflow/challenge.js +609 -0
- package/dist/commands/workflow/completeness.js +97 -0
- package/dist/commands/workflow/context.js +1045 -46
- package/dist/commands/workflow/counters.js +385 -86
- package/dist/commands/workflow/decisions.js +484 -0
- package/dist/commands/workflow/disk.js +214 -56
- package/dist/commands/workflow/fids.js +706 -33
- package/dist/commands/workflow/issues.js +349 -59
- package/dist/commands/workflow/ledgers.js +1123 -37
- package/dist/commands/workflow/locks.js +26 -2
- package/dist/commands/workflow/plan-blocks.js +501 -0
- package/dist/commands/workflow/plan-versions.js +22 -0
- package/dist/commands/workflow/plans.js +205 -0
- package/dist/commands/workflow/prs.js +154 -35
- package/dist/commands/workflow/repo.js +58 -8
- package/dist/commands/workflow/roadmap.js +58 -23
- package/dist/commands/workflow/run-facts.js +421 -0
- package/dist/commands/workflow/runs.js +670 -72
- package/dist/commands/workflow/runtime.js +15 -1
- package/dist/commands/workflow/skills.js +1 -0
- package/dist/commands/workflow/status.js +282 -34
- package/dist/commands/workflow/step-table.js +308 -0
- package/dist/commands/workflow/steps.js +703 -96
- package/dist/commands/workflow/summary-findings.js +117 -0
- package/dist/commands/workflow/summary.js +388 -0
- package/dist/commands/workflow/tasks.js +378 -0
- package/dist/commands/workflow/test-blocks.js +231 -0
- package/dist/commands/workflow/tests-changed.js +172 -0
- package/dist/commands/workflow/tests.js +1695 -305
- package/dist/commands/workflow/tracker.js +983 -0
- package/dist/commands/workflow/workflows.js +1014 -222
- package/dist/commands/workflow/worktrees.js +432 -26
- package/dist/install/cloud-env.js +233 -99
- package/dist/install/context-ci-workflow.js +85 -0
- package/dist/install/manifest.js +64 -17
- package/dist/install/modules/antigravity.js +3 -2
- package/dist/install/modules/cloud.js +25 -16
- package/dist/install/modules/codex.js +12 -2
- package/dist/install/modules/core.js +1090 -48
- package/dist/install/modules/cursor.js +6 -6
- package/dist/install/modules/opencode.js +13 -7
- package/dist/install/template-notes.js +116 -0
- package/dist/install/version-file.js +9 -4
- package/dist/ledgers/compact.js +87 -0
- package/dist/ledgers/journal.js +233 -0
- package/dist/ledgers/migrate.js +81 -0
- package/dist/ledgers/status.js +176 -13
- package/dist/ledgers/telemetry.js +1010 -125
- package/dist/render/hosts.js +104 -14
- package/dist/render/models.js +12 -0
- package/dist/shared/bkit-latest.js +26 -4
- package/dist/shared/branches.js +3 -1
- package/dist/shared/dep-updater.js +49 -0
- package/dist/shared/egress.js +8 -1
- package/dist/shared/json.js +20 -7
- package/dist/shared/package-manager.js +6 -0
- package/dist/shared/settings.js +181 -24
- package/dist/shared/text.js +333 -0
- package/dist/shared/timeouts.js +2 -0
- package/dist/tools/cli-doc.js +97 -0
- package/dist/tools/grammar-density.js +183 -0
- package/dist/tools/instructions-sources.js +720 -0
- package/dist/tools/instructions.js +1623 -0
- package/package.json +156 -51
- package/.bkit/core/.bkit/lite.md +0 -73
- package/.bkit/core/engine/commands/harvest.ts +0 -459
- package/.bkit/core/engine/commands/workflow/workstreams.ts +0 -166
- package/.bkit/core/engine/tools/wording.ts +0 -748
- package/.bkit/core/prompts/bkit-build-challenge-reconcile.md +0 -69
- package/.bkit/core/prompts/bkit-build-challenge-remediate.md +0 -71
- package/.bkit/core/prompts/bkit-build-challenge-tests.md +0 -74
- package/.bkit/core/prompts/bkit-build-plan-execute.md +0 -76
- package/.bkit/core/prompts/bkit-build-summary.md +0 -94
- package/.bkit/core/prompts/bkit-debug-summary.md +0 -96
- package/.bkit/core/prompts/bkit-design-summary.md +0 -107
- package/.bkit/core/prompts/bkit-plan-complexity-check.md +0 -67
- package/.bkit/core/prompts/bkit-plan-complexity-split.md +0 -88
- package/.bkit/core/prompts/bkit-plan-review-3.md +0 -93
- package/.bkit/core/prompts/bkit-plan-scope-check-1.md +0 -85
- package/.bkit/core/prompts/bkit-plan-scope-check-2.md +0 -85
- package/.bkit/core/prompts/bkit-plan-summary.md +0 -107
- package/.bkit/core/prompts/bkit-ship-summary.md +0 -78
- package/.bkit/templates/scripts/ci/bkit-local-stack-lock.sh +0 -194
- package/dist/commands/harvest.js +0 -353
- package/dist/commands/workflow/workstreams.js +0 -143
- package/dist/tools/wording.js +0 -680
- /package/.bkit/templates/.vale/styles/{House → Bkit}/Filler.yml +0 -0
- /package/.bkit/templates/.vale/styles/{House → Bkit}/Hedging.yml +0 -0
- /package/.bkit/templates/.vale/styles/{House → Bkit}/LLMSlop.yml +0 -0
- /package/.bkit/templates/.vale/styles/{House → Bkit}/Verbose.yml +0 -0
- /package/.bkit/templates/scripts/ci/{accepted-advisories.json → bkit-accepted-advisories.json} +0 -0
- /package/.bkit/templates/scripts/ci/{accepted-divergences.json → bkit-accepted-divergences.json} +0 -0
- /package/.bkit/templates/scripts/launchd/{launchd.env.example → bkit-launchd.env.example} +0 -0
- /package/.bkit/templates/scripts/launchd/{ai.bkit.launchd.plist → bkit-launchd.plist} +0 -0
|
@@ -1,41 +1,40 @@
|
|
|
1
|
-
<!-- Note: Reports live at `docs/audits/{YYYYMM}/{slug}.md`. `{YYYYMM}` = UTC month of this run. `{slug}` = template basename without `bkit-audit-` and `.md`. **If** that month already has `{slug}.md` or `{slug}-{TIMESTAMP}.md` → write `{slug}-{TIMESTAMP}.md` (`{TIMESTAMP}` = `date -u +%Y%m%dT%H%M%SZ`). Never overwrite. The report is stamped with a `bkit:anchor` block recording the audited commit (`baseSha`) and branch (`baseRef`); never hand-author or edit it. `@bkit-audit-generate` fills this template. -->
|
|
2
|
-
|
|
3
1
|
<!-- bkit:start -->
|
|
4
2
|
|
|
5
3
|
{{BKIT_MANAGED_MARKER}}
|
|
6
4
|
|
|
5
|
+
<!-- Note: @bkit-audit-generate fills this template. The report lives at `docs/audits/{YYYYMM}/{slug}.md`, where `{YYYYMM}` is the UTC month of the run and `{slug}` is this file's name without `bkit-audit-` and `.md`. **If** that month already has `{slug}.md` or `{slug}-{TIMESTAMP}.md` → write `{slug}-{TIMESTAMP}.md`, where `{TIMESTAMP}` is the output of `date -u +%Y%m%dT%H%M%SZ`. NEVER overwrite an earlier report. The report is stamped with a `bkit:anchor` block that records the audited commit (`baseSha`) and branch (`baseRef`). NEVER write or edit that block by hand. -->
|
|
6
|
+
|
|
7
7
|
# Red Team Audit
|
|
8
8
|
|
|
9
9
|
> [!CAUTION]
|
|
10
|
-
> **Purpose:** Active adversarial exploitation of a non-production deployment: one hostile request per probe, the request and response kept, then
|
|
10
|
+
> **Purpose:** Active adversarial exploitation of a non-production deployment: one hostile request per probe, with the request and response kept, then cleanup.
|
|
11
11
|
>
|
|
12
12
|
> **Rules:**
|
|
13
13
|
>
|
|
14
|
-
> -
|
|
15
|
-
> -
|
|
16
|
-
> -
|
|
17
|
-
> -
|
|
18
|
-
> -
|
|
19
|
-
> -
|
|
20
|
-
> -
|
|
21
|
-
> -
|
|
22
|
-
> -
|
|
23
|
-
> -
|
|
24
|
-
> - never copy a working token or a personal-data value into the report. Record the route, the input shape, and the response.
|
|
14
|
+
> - Probe a non-production deployment only.
|
|
15
|
+
> - NEVER probe production, the release branch, or a third party's own platform beyond the calls the app already makes.
|
|
16
|
+
> - Use synthetic identities only.
|
|
17
|
+
> - Creating and deleting those identities is the only data write, and they are deleted before the report finishes.
|
|
18
|
+
> - Send one request per probe.
|
|
19
|
+
> - Send no load, no volume fuzzing, and no spend past a single cap.
|
|
20
|
+
> - Stop at proof, and do not pivot.
|
|
21
|
+
> - NEVER copy a working token into the report.
|
|
22
|
+
> - NEVER copy a personal-data value into the report.
|
|
23
|
+
> - Record the route, the input shape and the response.
|
|
25
24
|
|
|
26
25
|
## Universal Instructions
|
|
27
26
|
|
|
28
27
|
### Context & Goals
|
|
29
28
|
|
|
30
|
-
Three
|
|
29
|
+
Three kinds of failure do not show up in a source read. A row-security denial looks like an empty result. A middleware check is not visible in the route file. A prompt injection shows only when the model runs. The failure this audit targets is a control that holds in the source and fails on a request. Examples: a mixed tenant-id list is clamped to the caller's rows instead of refused, a revoked token is still accepted, or a message makes the model delete items it does not mention. The static suspicions come from `bkit-audit-security` and `bkit-audit-llm`, and this audit sends the request.
|
|
31
30
|
|
|
32
|
-
**Applies when:** non-production deployment can be called, and the system has auth, tenancy, or a public free-text model surface.
|
|
31
|
+
**Applies when:** a non-production deployment can be called, and the system has auth, tenancy, or a public free-text model surface. **If** it has none → write one `N/A` row with its evidence, and never report the surface as "clean".
|
|
33
32
|
|
|
34
|
-
**Cadence:** once before launch, then
|
|
33
|
+
**Cadence:** Run once before launch, then once a quarter. Run an extra pass after any change to authentication, a route that takes an id, the inbound pipeline, or a machine-client tool.
|
|
35
34
|
|
|
36
|
-
**Anchor Standards:**
|
|
35
|
+
**Anchor Standards:**
|
|
37
36
|
|
|
38
|
-
- OWASP Web Security Testing Guide (e.g
|
|
37
|
+
- OWASP Web Security Testing Guide (e.g., WSTG v4.2; record if a newer stable release exists).
|
|
39
38
|
- Penetration Testing Execution Standard (PTES): pre-engagement, intelligence gathering, threat modelling, vulnerability analysis, exploitation, post-exploitation, reporting.
|
|
40
39
|
- When a probe drives a model: OWASP GenAI Red Teaming Guide, OWASP AI Testing Guide, MITRE ATLAS.
|
|
41
40
|
- OWASP Mobile Application Security Testing Guide (MASTG), when the native build is in scope.
|
|
@@ -43,17 +42,20 @@ Three shapes do not show up in a source read: row-security denial looks like emp
|
|
|
43
42
|
|
|
44
43
|
### Scope
|
|
45
44
|
|
|
46
|
-
-
|
|
47
|
-
-
|
|
48
|
-
- Retest
|
|
49
|
-
-
|
|
50
|
-
-
|
|
51
|
-
-
|
|
52
|
-
-
|
|
53
|
-
-
|
|
54
|
-
-
|
|
55
|
-
-
|
|
56
|
-
-
|
|
45
|
+
- Write the in-list and the out-list for this run, and what each platform's testing page allows.
|
|
46
|
+
- Diff the attack surface against the previous report, and give everything new at least one probe.
|
|
47
|
+
- Retest every earlier break whose fix has landed.
|
|
48
|
+
- Probe cross-tenant reads through the app.
|
|
49
|
+
- Probe cross-tenant reads separately through the data API with the client public key.
|
|
50
|
+
- Probe acting above a role.
|
|
51
|
+
- Probe every way a removed member could get back in.
|
|
52
|
+
- Probe authentication, session end and off-site redirects.
|
|
53
|
+
- Probe hostile inbound content: unauthorised writes, leaks, internal fetches, impersonation and caps.
|
|
54
|
+
- Probe machine-client tool misuse.
|
|
55
|
+
- Probe injection at the render, search and webhook boundaries.
|
|
56
|
+
- Cross each rate-limit and cost cap once.
|
|
57
|
+
- Probe off-topic use of public model surfaces.
|
|
58
|
+
- Clean up every identity this run created.
|
|
57
59
|
|
|
58
60
|
### Out of Scope
|
|
59
61
|
|
|
@@ -69,77 +71,107 @@ Three shapes do not show up in a source read: row-security denial looks like emp
|
|
|
69
71
|
|
|
70
72
|
### Verdicts
|
|
71
73
|
|
|
72
|
-
|
|
74
|
+
Each probe gets one verdict, on its `Probes` row.
|
|
73
75
|
|
|
74
|
-
- **HELD:** control did what it should.
|
|
75
|
-
- **BROKE:** control failed
|
|
76
|
-
- **INCONCLUSIVE:** blocked, skipped, or no clear answer. Say why.
|
|
77
|
-
- **FIXED** / **STILL BROKE:** retest of earlier `BROKE
|
|
78
|
-
- **OTHER:** fits
|
|
76
|
+
- **HELD:** the control did what it should. A held probe is a result, not a blank. **If** no test proves it → route it to `bkit-audit-testing`. It is not a finding.
|
|
77
|
+
- **BROKE:** the control failed, and that is a finding. Record the blast radius by reasoning, not by pivoting.
|
|
78
|
+
- **INCONCLUSIVE:** the probe was blocked, skipped, or gave no clear answer. Say why. It stays in `Probes`, because a skipped check otherwise reads as passed. **If** a `BROKE` has no kept response → mark it `INCONCLUSIVE` until a later run reproduces it.
|
|
79
|
+
- **FIXED** / **STILL BROKE:** use these only for a retest of an earlier `BROKE`, with the fix commit.
|
|
80
|
+
- **OTHER:** it fits no other verdict. Say why. **If** the same `OTHER` shows up on 2 runs → propose a new verdict in `Process Improvements`.
|
|
79
81
|
|
|
80
82
|
### Pre-Flight / Dependencies
|
|
81
83
|
|
|
82
|
-
**Checkpoint:** Check off all core items. Check conditional items only when applicable. Each item: available → tool and version; missing → fallback, gap in `Not Checked`, fix in `Process Improvements`. Unnamed gap reads as passed. never abort for a missing capability.
|
|
83
|
-
|
|
84
|
-
**Credentials:** probe direnv before marking a token / env var missing: `direnv exec . sh -c '[ -n "${VAR}" ] && echo set || echo unset'`; `unset` = missing. Run credentialed CLIs as `direnv exec . <cmd>`. No direnv (cloud session) → plain env check. Report names, never values.
|
|
85
|
-
|
|
86
84
|
#### Core
|
|
87
85
|
|
|
88
|
-
|
|
89
|
-
|
|
90
|
-
- [ ] **
|
|
91
|
-
- [ ] **
|
|
92
|
-
- [ ] **Identities:** Steps 2, 5–12, 15 — create and delete synthetic users and tenants, guarded so a non-synthetic identity cannot be deleted. Fallback: none. Do not probe with real accounts.
|
|
93
|
-
- [ ] **Web:** Steps 2, 14 — each platform's penetration-testing page, and anchor standards. Fallback: policy unread → do not send probes; record why.
|
|
86
|
+
- [ ] **Permissions:** every blocked call is recorded.
|
|
87
|
+
- [ ] **Target:** Steps 2-13 — a non-production deployment of this commit, resolved by commit SHA and confirmed serving. Fallback: none, so the probes stay `INCONCLUSIVE`. NEVER point them at production.
|
|
88
|
+
- [ ] **Identities:** Steps 2, 5-12, 15 — create and delete synthetic users and tenants, with a guard so that a non-synthetic identity cannot be deleted. Fallback: none. Do not probe with real accounts.
|
|
89
|
+
- [ ] **Web:** Steps 2, 14 — read each platform's penetration-testing page and the anchor standards. Fallback: **If** a platform's policy is unread → send no probes, and record why.
|
|
94
90
|
|
|
95
91
|
#### Conditional
|
|
96
92
|
|
|
97
|
-
|
|
98
|
-
|
|
99
|
-
- [ ] **
|
|
100
|
-
- [ ] **
|
|
101
|
-
- [ ] **
|
|
102
|
-
- [ ] **Native Build:** This run includes the native client → Step 8 — cached data and sync on a device or emulator. Fallback: web only; device path `Not Checked`.
|
|
103
|
-
- [ ] **Model Spend:** A probe drives a model → Steps 10, 13 — budget for one crossing of one cap. Fallback: do not send the cost probe; `INCONCLUSIVE`.
|
|
93
|
+
- [ ] **Data API:** **If** the client public key plus a user token can call the data API directly → Step 6 — e.g., PostgREST, Storage, Realtime. Fallback: probe through the app routes only, and mark the direct path `Not Checked`.
|
|
94
|
+
- [ ] **Inbound Mail:** **If** the synthetic tenant has an inbound address → Step 10. Fallback: skip the step, and mark it `Not Checked`.
|
|
95
|
+
- [ ] **Machine Client:** **If** a token-gated tool endpoint exists → Steps 2, 11. Fallback: skip with evidence.
|
|
96
|
+
- [ ] **Native Build:** **If** this run includes the native client → Step 8 — cached data and sync on a device or emulator. Fallback: test the web only, and mark the device path `Not Checked`.
|
|
97
|
+
- [ ] **Model Spend:** **If** a probe drives a model → Steps 10, 13 — a budget for one crossing of one cap. Fallback: do not send the cost probe, and mark it `INCONCLUSIVE`.
|
|
104
98
|
|
|
105
99
|
### 🔒 Gate 1: Prerequisites Check
|
|
106
100
|
|
|
107
|
-
|
|
108
|
-
|
|
109
|
-
- [ ] **Gaps named:** every missing item names its fallback and `Not Checked` entry.
|
|
110
|
-
- [ ] **Gate 1 - Verified:** All Core items checked. All applicable Conditional items checked.
|
|
101
|
+
- [ ] **Gaps named:** every missing item names its fallback and its `Not Checked` entry.
|
|
102
|
+
- [ ] **Gate 1 — Verified:** every item above, every Core item and every applicable Conditional item is checked.
|
|
111
103
|
|
|
112
104
|
### Probe Steps
|
|
113
105
|
|
|
114
|
-
- [ ] **Step 1 — Previous Run:**
|
|
115
|
-
- [ ] **Step 2 — Engage:** Record commit and non-production URL deployed for it
|
|
116
|
-
-
|
|
117
|
-
-
|
|
118
|
-
-
|
|
119
|
-
-
|
|
120
|
-
-
|
|
121
|
-
-
|
|
122
|
-
-
|
|
123
|
-
-
|
|
124
|
-
-
|
|
125
|
-
-
|
|
126
|
-
-
|
|
127
|
-
-
|
|
128
|
-
-
|
|
106
|
+
- [ ] **Step 1 — Previous Run:** **Done when:** `Previous Run` holds the closure rate, or the run is marked baseline.
|
|
107
|
+
- [ ] **Step 2 — Engage:** Record the commit and the non-production URL deployed for it.
|
|
108
|
+
- Use the deployment the live lane resolves for that SHA, not a branch alias, which may be stale.
|
|
109
|
+
- Confirm it is serving.
|
|
110
|
+
- Write the scope in `Scope`:
|
|
111
|
+
- The in-list covers: the non-production web URL (e.g., preview deploy, staging), the API host, the machine-client endpoint, the inbound mail domain, the data API via the client public key, the background-job serve endpoint, and the native build if it is tested.
|
|
112
|
+
- The out-list covers: production, the release branch, the persistent demo tenant, every third party's own platform, and anything not on the in-list.
|
|
113
|
+
- Read the current penetration-testing page of each platform the probes touch: the app host, the database, and the native vendor when the native build is in scope.
|
|
114
|
+
- Record what each allows and the plan tier.
|
|
115
|
+
- **If** a page forbids a probe → do not send it, and mark it `INCONCLUSIVE`.
|
|
116
|
+
- Create two synthetic tenants, attacker and victim, each with the roles the product distinguishes.
|
|
117
|
+
- Issue a machine-client token for each owner where the product has one, on a plan the feature allows.
|
|
118
|
+
- Seed the victim with a few records, one recurring record and an attachment.
|
|
119
|
+
- Do not touch the persistent demo tenant.
|
|
120
|
+
- Read the newest `bkit-audit-security` and `bkit-audit-llm` reports.
|
|
121
|
+
- Give each finding they could not prove a probe.
|
|
122
|
+
- Give each of the model audit's prompt-only rules a probe.
|
|
123
|
+
- Give each trust boundary the threat model names at least one probe.
|
|
124
|
+
- **If** there is no threat model → say so in `Scope`.
|
|
125
|
+
- Before a destructive probe, confirm that no other live test holds the target database, and record the window. Do not wait for a named approver.
|
|
126
|
+
- **If** a later probe degrades the target, touches non-synthetic data, or reaches a third party → stop the remaining probes, and record the stop in `Scope`.
|
|
127
|
+
- Each later probe gets a `Probes` row with: the request with tokens redacted, the response status, the relevant body and the verdict. A `BROKE` row adds the blast radius by reasoning, not by pivoting.
|
|
128
|
+
|
|
129
|
+
**Done when:** `Scope` holds the URL, the commit, the in-list, the out-list, the platform rules, the plan tier, the identities (no tokens) and the suspicion list.
|
|
130
|
+
|
|
131
|
+
- [ ] **Step 3 — Surface:** List the attack surface at this commit: routes, server actions, machine-client tools, webhooks, and the response headers of each in-scope origin. Diff it against the previous report's list. Give everything new at least one probe. **Done when:** `Surface` holds the list and the diff.
|
|
132
|
+
- [ ] **Step 4 — Retest:** Re-run every earlier `BROKE` whose fix has landed, from its recorded reproduction. Mark it `FIXED` or `STILL BROKE`, with the fix commit. Confirm that the regression test the prior run named exists. **If** it does not → route it to `bkit-audit-testing`. **Done when:** `Retests` has a row per prior break, or says `none`.
|
|
133
|
+
- [ ] **Step 5 — Cross-Tenant:** As the attacker, request the victim's records by id on every route that takes one: items, attachments, download URLs, members, invitations and machine-client read tools. A mixed list of own and foreign ids must be refused, not clamped to the attacker's rows. Expected: denial or not-found, and no victim field in any part of the response, errors included. **Done when:** `Probes` has a row per route, in the Step 2 row shape.
|
|
134
|
+
- [ ] **Step 6 — Direct API:** Step 5 goes through the app, and an attacker can skip the app. With the attacker's token and the client public key, ask the data API for the victim's tenant: each tenant-scoped table, privileged routines, GraphQL if enabled, file-storage list and download, and realtime subscribe. Expected: no victim row, object or event. **If** a denial looks like an empty result → send the same request once as the victim, to show it would have returned data. **Done when:** `Probes` has a row per surface, including the victim-control request, or the step is skipped with evidence that the direct API is not exposed.
|
|
135
|
+
- [ ] **Step 7 — Roles:** Inside the attacker tenant, have the low role try what only a higher role may do: invite, remove a member, change the plan, issue a machine-client token, delete a record that is not theirs, and delete the tenant. Check each against the role matrix. **Done when:** `Probes` has a row per operation.
|
|
136
|
+
- [ ] **Step 8 — Removed:** The realistic attacker is a former tenant member. Remove the attacker's second member, then try every way back in: the web session, native cached data and sync, a machine-client token they issued, invitation links they sent, signed attachment URLs they were given, a capability URL (a calendar feed or equivalent), and mail to the tenant address. Expected: every path fails on the next request, and mail from a removed member gets no more trust than a stranger's. **Done when:** `Probes` has a row per path.
|
|
137
|
+
- [ ] **Step 9 — Authentication:** Probe an expired token and a revoked one. A revoked machine token must fail on the next call, with no grace period unless the product records one. A token for a plan that excludes the feature must be refused. Probe a cookie-authenticated write with no `Origin`, and one with a foreign `Origin`. Probe redirect parameters that point off-site. Check that sign-out-all ends every other session. **Done when:** `Probes` has a row per case.
|
|
138
|
+
- [ ] **Step 10 — Inbound:** Send mail to the synthetic tenant's inbound address, from the attacker's address, trying to make the model: delete or change records the message does not mention; leak other records into the reply; fetch an internal address (`http://169.254.169.254/`, localhost, private ranges); claim to be a member (by address or display name) from a domain that fails or lacks SPF and DKIM; and exceed the link and attachment caps. Use a payload corpus (e.g., promptfoo, garak), and record which. On a shared inbound provider, use the environment tag the project documents, so the message cannot land in production. Expected: only the records the message genuinely describes are written, nothing else changes, no internal fetch happens, and every cap fires. Check the action log for what was written. The cost probe crosses one limit, once. **Done when:** `Probes` has a row per attempt, with action-log evidence, or `INCONCLUSIVE` where model spend is unavailable.
|
|
139
|
+
- [ ] **Step 11 — Tools:** With the attacker's token, act as a client that ignores the rules: set fields the allow-list excludes, pass the victim's ids, change a recurring record without the required scope, send oversized arguments, and repeat a create to test the idempotency key. **Done when:** `Probes` has a row per case, or the step is skipped with evidence that there are no machine-client tools.
|
|
140
|
+
- [ ] **Step 12 — Boundaries:** Put script and markup in text fields, and check how they render on the web, in the native client and in a reply. Send injection through the search query and the filters that reach the search routine. Webhook endpoints: no signature must get a denial, and a wrong signature must get the same denial plus an error log. Rate limits: the documented thresholds must fire, then stop. **Done when:** `Probes` has a row per boundary.
|
|
141
|
+
- [ ] **Step 13 — Off-Topic:** For each public free-text model surface (from `bkit-audit-llm` `Job Scope`, or from `Surface` when that report lists none), act as an anonymous or synthetic visitor and send one ask per probe: general coding (e.g., "write a Python function that…"), homework, an essay, and an off-topic ask wrapped in an on-topic frame (e.g., "for my trip, write a script that…"). Then send one greeting as a control. Expected: a redirect per the surface's stated job and no off-topic answer, while the greeting gets a normal reply. **If** an off-topic ask is answered → mark it `BROKE`, and record what was meant to bound it (prompt, grounding gate, classifier). **Done when:** `Probes` has a row per surface x ask, or the step is skipped with evidence that there is no public free-text model surface.
|
|
142
|
+
- [ ] **Step 14 — Standards:** Confirm the current version of each anchor standard, and read what changed since the previous report's version. Give `Standards Coverage` one row per WSTG category (INFO, CONF, IDNT, ATHN, ATHZ, SESS, INPV, ERRH, CRYP, BUSL, CLNT, APIT), and one per ATLAS tactic a model probe touched, each marked checked (naming the step), not applicable (saying why) or finding. Give each bkit anchor (a doc section, rule or issue shape) one row, marked followed (with the step or evidence), not applicable (saying why) or finding. A departure with no recorded reason (e.g., a `docs/decisions.jsonl` row or an accepted-divergence entry) is a finding. Mark each recommended practice the project does not apply as adopt (with a proposed step), reject (saying why) or not applicable. **Done when:** no row is empty.
|
|
143
|
+
- [ ] **Step 15 — Anything Else:** (a) Give a one-line verdict on each change since the previous report's commit that touches the attack surface: routes, server actions, machine-client tools, webhooks, response headers, inbound handling, and what the client public key can reach. The Step 3 diff is the starting list.
|
|
144
|
+
- (b) In a bounded pass of about 30 minutes, note what a senior penetration tester would flag that no step asks about. Read what happened since the previous run (incidents, `bkit-audit-logs` reports, new `docs/failures.jsonl` rows, vendor status incidents), and ask what no step would catch.
|
|
145
|
+
- Probes these passes send follow the Rules, use identities made for this run, and go in `Probes`.
|
|
146
|
+
- Then delete every identity this run created with the guarded delete, which also reaps any tenant it would strand.
|
|
147
|
+
- Confirm that the orphan sweep finds nothing left.
|
|
148
|
+
- Record where the full request and response evidence is kept, for how long, and the redaction applied.
|
|
149
|
+
- `Expected` names where the finding goes, and recommends the safer fix.
|
|
150
|
+
- This run files nothing. It does write the `docs/failures.jsonl` rows.
|
|
151
|
+
- Route each result as follows:
|
|
152
|
+
- `BROKE` → a plan from this report, a `docs/failures.jsonl` row, and a regression test (ideally at the deployed boundary) so that `bkit-audit-testing` keeps it fixed.
|
|
153
|
+
- `HELD` with no test → `bkit-audit-testing`.
|
|
154
|
+
- A model result → `bkit-audit-llm`, against the finding it tested.
|
|
155
|
+
- `STILL BROKE` → the original finding, with the retest and the fix commit.
|
|
156
|
+
- `INCONCLUSIVE` → the next run's Step 2 suspicion list, with what blocked it.
|
|
157
|
+
- `OTHER` → this report, and a second run proposes a verdict.
|
|
158
|
+
- A vulnerability in the database product itself, not in the project's use of it → the vendor, per that vendor's testing page, plus this report.
|
|
159
|
+
- A stop condition → the remaining probes stop, and the stop is recorded in `Scope`.
|
|
160
|
+
|
|
161
|
+
**Done when:** `Beyond the Steps` holds both passes, or says `none`. `Cleanup` confirms that every identity this run created is gone. **If** one class of issue is seen on 2 runs → propose a step for it in `Process Improvements`.
|
|
129
162
|
|
|
130
163
|
### 🔒 Gate 2: Probes Check
|
|
131
164
|
|
|
132
|
-
**
|
|
133
|
-
|
|
134
|
-
- [ ] **
|
|
135
|
-
- [ ] **
|
|
136
|
-
- [ ] **
|
|
137
|
-
- [ ] **
|
|
138
|
-
- [ ] **Gate 2 - Verified:** Every checkbox above independently verified and checked off.
|
|
165
|
+
- [ ] **Steps complete:** every step is `[x]`, or skipped with evidence that its surface is absent.
|
|
166
|
+
- [ ] **Evidence:** every finding cites evidence someone can check again, and the tool that produced it.
|
|
167
|
+
- [ ] **Target:** no probe was sent to production, the release branch, a third-party platform, or a non-synthetic identity.
|
|
168
|
+
- [ ] **Cleanup:** every identity this run created is deleted.
|
|
169
|
+
- [ ] **No tokens:** no token value appears in the report.
|
|
170
|
+
- [ ] **Gate 2 — Verified:** every item above holds.
|
|
139
171
|
|
|
140
172
|
## Findings
|
|
141
173
|
|
|
142
|
-
`HELD` probe stays in `Probes`. Every `BROKE` is finding, shares probe ID. `Expected` carries WSTG id, CWE, likelihood and impact
|
|
174
|
+
A `HELD` probe stays in `Probes`. Every `BROKE` is a finding, and shares its probe ID. `Expected` carries the WSTG id, the CWE, and the reasoning for likelihood and impact. A model finding also names its OWASP Top 10 for LLM / agentic applications category and its MITRE ATLAS technique, the vocabulary `bkit-audit-llm` uses.
|
|
143
175
|
|
|
144
176
|
<!-- prettier-ignore -->
|
|
145
177
|
| Severity | Use |
|
|
@@ -149,14 +181,14 @@ Verify only when applicable.
|
|
|
149
181
|
| `MEDIUM` | A mixed id list is clamped instead of refused; a rate limit or size cap does not fire; markup renders unsanitised on one surface; a public model surface answers an off-topic ask |
|
|
150
182
|
| `LOW` | Status differs from expected, and the response exposes no data and grants no action |
|
|
151
183
|
|
|
152
|
-
|
|
184
|
+
Within a severity, list cross-tenant findings first. A break on the non-production target keeps the severity it would have in production.
|
|
153
185
|
|
|
154
186
|
<!-- prettier-ignore -->
|
|
155
187
|
| ID | Severity | Verdict | Location | Evidence | Expected |
|
|
156
188
|
| --- | --- | --- | --- | --- | --- |
|
|
157
189
|
| PENDING | PENDING | PENDING | PENDING | PENDING | PENDING |
|
|
158
190
|
|
|
159
|
-
|
|
191
|
+
**If** the run finds nothing → write one row: `None`.
|
|
160
192
|
|
|
161
193
|
## Report
|
|
162
194
|
|
|
@@ -217,17 +249,17 @@ PENDING
|
|
|
217
249
|
|
|
218
250
|
### 🔒 Gate 3: Report Check
|
|
219
251
|
|
|
220
|
-
**
|
|
221
|
-
|
|
222
|
-
- [ ] **
|
|
223
|
-
- [ ] **
|
|
224
|
-
- [ ] **
|
|
225
|
-
- [ ] **Writes:** only this report
|
|
226
|
-
- [ ] **
|
|
227
|
-
- [ ] **
|
|
228
|
-
- [ ] **
|
|
229
|
-
|
|
230
|
-
|
|
252
|
+
- [ ] **No placeholders:** no `PENDING` is left.
|
|
253
|
+
- [ ] **Summary:** `Summary` gives the count per severity.
|
|
254
|
+
- [ ] **Probe counts:** `Summary` gives the probe counts (`HELD` / `BROKE` / `INCONCLUSIVE`).
|
|
255
|
+
- [ ] **Cleanup stated:** `Cleanup` states that every identity this run created is deleted.
|
|
256
|
+
- [ ] **Evidence kept:** `Cleanup` states where the redacted evidence is kept.
|
|
257
|
+
- [ ] **Writes:** this run changed only this report, the template's `Project Instructions` and its own `docs/failures.jsonl` rows.
|
|
258
|
+
- [ ] **Throwaways removed:** every throwaway worktree or remote target is removed.
|
|
259
|
+
- [ ] **Process Improvements:** `Universal` and `Project` are both filled.
|
|
260
|
+
- [ ] **Suggested Issues:** every `MEDIUM`+ finding ID is in exactly one `Suggested Issues` row.
|
|
261
|
+
- [ ] **Next Step:** every `Suggested Issues` row has a `Next Step`.
|
|
262
|
+
- [ ] **Gate 3 — Verified:** every item above holds.
|
|
231
263
|
|
|
232
264
|
<!-- bkit:end -->
|
|
233
265
|
|