@cbartens/bkit 5.2.3 → 5.3.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.bkit/README.md +29 -12
- package/.bkit/core/.agents/context.md +1 -1
- package/.bkit/core/.agents/docs.md +1 -1
- package/.bkit/core/.agents/plugins/bkit/hooks/bkit-guardrails.cjs +1 -1
- package/.bkit/core/.agents/rules.md +11 -0
- package/.bkit/core/.bkit/README.md +28 -11
- package/.bkit/core/.bkit/cloud.md +9 -8
- package/.bkit/core/.bkit/comparison.md +68 -345
- package/.bkit/core/.bkit/install.md +15 -9
- package/.bkit/core/.bkit/lite.md +73 -0
- package/.bkit/core/.bkit/pipeline.md +345 -0
- package/.bkit/core/.bkit/prompts.md +88 -73
- package/.bkit/core/.bkit/providers.md +41 -22
- package/.bkit/core/.bkit/templates.md +125 -18
- package/.bkit/core/.bkit/trackers.md +47 -1
- package/.bkit/core/.bkit/workflows.md +51 -45
- package/.bkit/core/.claude/hooks/bkit-guardrails.cjs +1 -1
- package/.bkit/core/.codex/hooks/bkit-guardrails.cjs +7 -4
- package/.bkit/core/.cursor/hooks/bkit-guardrails.cjs +8 -5
- package/.bkit/core/docs/templates/bkit-audit-accessibility.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-adoption.md +10 -2
- package/.bkit/core/docs/templates/bkit-audit-agents.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-aio-seo.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-analytics.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-annotations.md +10 -2
- package/.bkit/core/docs/templates/bkit-audit-app-performance.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-app-store.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-architecture.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-ci-performance.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-config.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-cost.md +10 -2
- package/.bkit/core/docs/templates/bkit-audit-coverage.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-database.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-dead-code.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-deferrals.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-dependencies.md +22 -10
- package/.bkit/core/docs/templates/bkit-audit-documentation.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-duplication.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-failures.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-flakes.md +10 -2
- package/.bkit/core/docs/templates/bkit-audit-gates.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-issues.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-llm.md +29 -15
- package/.bkit/core/docs/templates/bkit-audit-logs.md +10 -2
- package/.bkit/core/docs/templates/bkit-audit-models.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-privacy.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-prompts.md +11 -3
- package/.bkit/core/docs/templates/bkit-audit-red-team.md +19 -9
- package/.bkit/core/docs/templates/bkit-audit-reliability.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-repo.md +10 -2
- package/.bkit/core/docs/templates/bkit-audit-security.md +13 -5
- package/.bkit/core/docs/templates/bkit-audit-slop.md +9 -1
- package/.bkit/core/docs/templates/bkit-audit-testing.md +14 -5
- package/.bkit/core/docs/templates/bkit-audit-usability.md +9 -1
- package/.bkit/core/docs/templates/bkit-plan.md +8 -6
- package/.bkit/core/engine/checks/after/auth.ts +9 -9
- package/.bkit/core/engine/checks/after/ci-yml.ts +14 -12
- package/.bkit/core/engine/checks/after/github.ts +29 -120
- package/.bkit/core/engine/checks/after/index.ts +2 -2
- package/.bkit/core/engine/checks/after/managed.ts +8 -28
- package/.bkit/core/engine/checks/after/tools.ts +3 -15
- package/.bkit/core/engine/checks/before/context-fetch.ts +1 -21
- package/.bkit/core/engine/checks/before/index.ts +7 -43
- package/.bkit/core/engine/checks/before/mcp.ts +17 -8
- package/.bkit/core/engine/checks/before/repo.ts +9 -12
- package/.bkit/core/engine/checks/status-holes.ts +4 -5
- package/.bkit/core/engine/checks/tips/catalogue.ts +70 -24
- package/.bkit/core/engine/checks/tips/detect.ts +45 -2
- package/.bkit/core/engine/checks/tips/index.ts +37 -8
- package/.bkit/core/engine/cli.ts +39 -16
- package/.bkit/core/engine/commands/analysis.ts +36 -26
- package/.bkit/core/engine/commands/comply.ts +17 -16
- package/.bkit/core/engine/commands/harvest.ts +12 -12
- package/.bkit/core/engine/commands/install/doctor.ts +57 -28
- package/.bkit/core/engine/commands/install/install.ts +62 -126
- package/.bkit/core/engine/commands/install/uninstall.ts +191 -33
- package/.bkit/core/engine/commands/install/upgrade.ts +58 -53
- package/.bkit/core/engine/commands/lib.ts +35 -10
- package/.bkit/core/engine/commands/tips.ts +8 -5
- package/.bkit/core/engine/commands/workflow/branches.ts +65 -11
- package/.bkit/core/engine/commands/workflow/counters.ts +21 -12
- package/.bkit/core/engine/commands/workflow/fids.ts +46 -0
- package/.bkit/core/engine/commands/workflow/ledgers.ts +3 -1
- package/.bkit/core/engine/commands/workflow/prs.ts +4 -2
- package/.bkit/core/engine/commands/workflow/repo.ts +18 -4
- package/.bkit/core/engine/commands/workflow/roadmap.ts +4 -3
- package/.bkit/core/engine/commands/workflow/runs.ts +8 -7
- package/.bkit/core/engine/commands/workflow/steps.ts +1 -0
- package/.bkit/core/engine/commands/workflow/tests.ts +17 -5
- package/.bkit/core/engine/commands/workflow/workflows.ts +19 -17
- package/.bkit/core/engine/commands/workflow/workstreams.ts +2 -1
- package/.bkit/core/engine/commands/workflow/worktrees.ts +13 -5
- package/.bkit/core/engine/install/cloud-env.ts +10 -31
- package/.bkit/core/engine/install/manifest.ts +14 -7
- package/.bkit/core/engine/install/modules/antigravity.ts +15 -26
- package/.bkit/core/engine/install/modules/claude.ts +20 -28
- package/.bkit/core/engine/install/modules/cloud.ts +5 -2
- package/.bkit/core/engine/install/modules/codex.ts +15 -29
- package/.bkit/core/engine/install/modules/core.ts +91 -70
- package/.bkit/core/engine/install/modules/cursor.ts +6 -20
- package/.bkit/core/engine/install/modules/index.ts +7 -1
- package/.bkit/core/engine/install/modules/opencode.ts +48 -70
- package/.bkit/core/engine/install/network-allowlist.ts +73 -0
- package/.bkit/core/engine/install/placeholders.ts +3 -18
- package/.bkit/core/engine/install/write.ts +59 -12
- package/.bkit/core/engine/ledgers/telemetry.ts +6 -4
- package/.bkit/core/engine/render/hosts.ts +47 -67
- package/.bkit/core/engine/render/models.ts +29 -11
- package/.bkit/core/engine/shared/bkit-latest.ts +164 -0
- package/.bkit/core/engine/shared/branches.ts +13 -0
- package/.bkit/core/engine/shared/egress.ts +3 -3
- package/.bkit/core/engine/shared/json.ts +18 -1
- package/.bkit/core/engine/shared/package-json.ts +63 -0
- package/.bkit/core/engine/shared/package-roots.ts +0 -10
- package/.bkit/core/engine/shared/protected-paths.ts +5 -130
- package/.bkit/core/engine/shared/settings.ts +36 -0
- package/.bkit/core/engine/shared/timeouts.ts +6 -0
- package/.bkit/core/hooks/antigravity-hook.js +1 -0
- package/.bkit/core/hooks/guardrails-shell.js +186 -40
- package/.bkit/core/hooks/guardrails-tiers.js +5 -78
- package/.bkit/core/prompts/bkit-audit-generate.md +65 -10
- package/.bkit/core/prompts/bkit-build-challenge-1.md +1 -1
- package/.bkit/core/prompts/bkit-build-challenge-2.md +1 -1
- package/.bkit/core/prompts/bkit-build-challenge-reconcile.md +1 -1
- package/.bkit/core/prompts/bkit-build-challenge-remediate.md +1 -1
- package/.bkit/core/prompts/bkit-build-challenge-tests.md +1 -1
- package/.bkit/core/prompts/bkit-build-install-skills.md +1 -1
- package/.bkit/core/prompts/bkit-build-plan-current.md +1 -1
- package/.bkit/core/prompts/bkit-build-plan-execute.md +4 -4
- package/.bkit/core/prompts/bkit-build-plan-gaps-remediate.md +1 -1
- package/.bkit/core/prompts/bkit-build-plan-verify.md +2 -2
- package/.bkit/core/prompts/bkit-debug-abort-handover.md +1 -1
- package/.bkit/core/prompts/bkit-debug-failure-diagnose.md +1 -1
- package/.bkit/core/prompts/bkit-debug-failure-remediate.md +1 -1
- package/.bkit/core/prompts/bkit-debug-failure-reproduce.md +78 -0
- package/.bkit/core/prompts/bkit-debug-failure-soak.md +1 -1
- package/.bkit/core/prompts/bkit-debug-summary.md +3 -3
- package/.bkit/core/prompts/bkit-design-spike.md +1 -1
- package/.bkit/core/prompts/bkit-design-summary.md +2 -2
- package/.bkit/core/prompts/bkit-design-update.md +1 -1
- package/.bkit/core/prompts/bkit-plan-complexity-check.md +1 -1
- package/.bkit/core/prompts/bkit-plan-generate.md +1 -1
- package/.bkit/core/prompts/bkit-plan-scope-check-1.md +1 -1
- package/.bkit/core/prompts/bkit-plan-scope-check-2.md +1 -1
- package/.bkit/core/prompts/bkit-plan-summary.md +1 -1
- package/.bkit/core/prompts/bkit-plan-update.md +1 -1
- package/.bkit/core/prompts/bkit-ship-conflict-resolve.md +1 -1
- package/.bkit/core/prompts/bkit-ship-deferred-sweep.md +1 -1
- package/.bkit/core/prompts/bkit-ship-update-docs.md +1 -1
- package/.bkit/core/prompts/bkit-utility-update-decisions.md +9 -2
- package/.bkit/core/prompts/bkit-utility-update-deferrals.md +9 -2
- package/.bkit/core/prompts/bkit-utility-update-documentation.md +2 -1
- package/.bkit/core/prompts/bkit-utility-update-failures.md +9 -2
- package/.bkit/core/prompts/bkit-utility-update-knowledge.md +9 -2
- package/.bkit/core/prompts/bkit-utility-update-roadmap.md +11 -4
- package/.bkit/core/workflows/bkit-build.md +4 -4
- package/.bkit/core/workflows/bkit-debug.md +70 -34
- package/.bkit/core/workflows/bkit-design.md +3 -3
- package/.bkit/core/workflows/bkit-plan.md +12 -5
- package/.bkit/core/workflows/bkit-ship.md +6 -6
- package/.bkit/shared/.claude/bkit-cloud.md +46 -13
- package/.bkit/shared/.claude/settings.json +18 -0
- package/.bkit/shared/.cursor/mcp.json +2 -1
- package/.bkit/shared/.opencode/opencode.json +19 -1
- package/.bkit/shared/docs/deployments.md +20 -4
- package/.bkit/shared/docs/security.md +8 -6
- package/.bkit/shared/docs/testing.md +9 -5
- package/.bkit/templates/.cursor/Dockerfile +30 -16
- package/.bkit/templates/.github/ISSUE_TEMPLATE/bkit-bug.yml +78 -0
- package/.bkit/templates/.github/ISSUE_TEMPLATE/bkit-change.yml +91 -0
- package/.bkit/templates/.github/ISSUE_TEMPLATE/bkit-idea.yml +56 -0
- package/.bkit/templates/.github/renovate.json5 +91 -12
- package/.bkit/templates/.github/workflows/bkit-ci.yml +66 -53
- package/.bkit/templates/.github/workflows/bkit-cloud.yml +3 -1
- package/.bkit/templates/.github/workflows/bkit-renovate.yml +8 -1
- package/.bkit/templates/.github/workflows/bkit-trivy.yml +67 -0
- package/.bkit/templates/.husky/pre-push +15 -3
- package/.bkit/templates/.oxlintrc.json +21 -0
- package/.bkit/templates/docs/capabilities.md +1 -1
- package/.bkit/templates/scripts/ci/check-capstone.mjs +176 -0
- package/.bkit/templates/scripts/ci/check-capstone.test.mjs +311 -0
- package/.bkit/templates/scripts/cleanup/bkit-tmp-prune.mjs +115 -0
- package/.bkit/templates/scripts/graphify/bkit-graph-eager.py +2 -2
- package/.bkit/templates/scripts/graphify/bkit-graph-imports.py +43 -20
- package/.bkit/templates/scripts/graphify/bkit-graph-pre-push.sh +33 -11
- package/.bkit/templates/scripts/graphify/bkit-graph-repair.py +3 -2
- package/.bkit/templates/scripts/graphify/bkit-graphify-rollup.py +5 -5
- package/.bkit/templates/scripts/graphify/bkit-graphify.sh +79 -19
- package/CHANGELOG.md +67 -3
- package/README.md +258 -129
- package/dist/checks/after/auth.js +10 -11
- package/dist/checks/after/ci-yml.js +11 -14
- package/dist/checks/after/github.js +32 -125
- package/dist/checks/after/index.js +3 -2
- package/dist/checks/after/managed.js +8 -24
- package/dist/checks/after/tools.js +3 -16
- package/dist/checks/before/context-fetch.js +1 -21
- package/dist/checks/before/index.js +6 -42
- package/dist/checks/before/mcp.js +14 -9
- package/dist/checks/before/repo.js +8 -11
- package/dist/checks/status-holes.js +5 -6
- package/dist/checks/tips/catalogue.js +60 -18
- package/dist/checks/tips/detect.js +41 -2
- package/dist/checks/tips/index.js +25 -5
- package/dist/cli.js +34 -14
- package/dist/commands/analysis.js +21 -5
- package/dist/commands/comply.js +20 -18
- package/dist/commands/harvest.js +12 -13
- package/dist/commands/install/doctor.js +55 -23
- package/dist/commands/install/install.js +62 -118
- package/dist/commands/install/uninstall.js +165 -31
- package/dist/commands/install/upgrade.js +55 -49
- package/dist/commands/lib.js +32 -10
- package/dist/commands/tips.js +6 -3
- package/dist/commands/workflow/branches.js +57 -13
- package/dist/commands/workflow/counters.js +17 -7
- package/dist/commands/workflow/fids.js +39 -0
- package/dist/commands/workflow/ledgers.js +3 -1
- package/dist/commands/workflow/prs.js +3 -3
- package/dist/commands/workflow/repo.js +16 -4
- package/dist/commands/workflow/roadmap.js +4 -4
- package/dist/commands/workflow/runs.js +5 -5
- package/dist/commands/workflow/steps.js +1 -0
- package/dist/commands/workflow/tests.js +16 -3
- package/dist/commands/workflow/workflows.js +19 -18
- package/dist/commands/workflow/workstreams.js +2 -1
- package/dist/commands/workflow/worktrees.js +4 -5
- package/dist/install/cloud-env.js +10 -23
- package/dist/install/manifest.js +14 -7
- package/dist/install/modules/antigravity.js +15 -26
- package/dist/install/modules/claude.js +17 -21
- package/dist/install/modules/cloud.js +6 -2
- package/dist/install/modules/codex.js +15 -29
- package/dist/install/modules/core.js +82 -63
- package/dist/install/modules/cursor.js +6 -9
- package/dist/install/modules/index.js +6 -1
- package/dist/install/modules/opencode.js +41 -72
- package/dist/install/network-allowlist.js +62 -0
- package/dist/install/placeholders.js +3 -16
- package/dist/install/write.js +55 -15
- package/dist/ledgers/telemetry.js +5 -4
- package/dist/render/hosts.js +30 -55
- package/dist/render/models.js +20 -9
- package/dist/shared/bkit-latest.js +150 -0
- package/dist/shared/branches.js +11 -0
- package/dist/shared/egress.js +0 -2
- package/dist/shared/json.js +14 -0
- package/dist/shared/package-json.js +61 -0
- package/dist/shared/package-roots.js +0 -8
- package/dist/shared/protected-paths.js +5 -122
- package/dist/shared/settings.js +18 -1
- package/dist/shared/timeouts.js +6 -0
- package/package.json +21 -17
- package/.bkit/core/.agents/shortcuts.md +0 -73
|
@@ -77,7 +77,7 @@
|
|
|
77
77
|
|
|
78
78
|
Always verify.
|
|
79
79
|
|
|
80
|
-
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`. never retry or reword a blocked call to get past it.
|
|
80
|
+
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied (here or in any step) → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`; run every step the remaining tools allow; work needing blocked call → `Not Checked`. never stop the run for a blocked call; never retry or reword a blocked call to get past it.
|
|
81
81
|
- [ ] **Live Fetch:** Steps 2–9 — request public URLs, headers, and HTML, e.g. `curl`, a browser. Fallback: source read; live claims = hypotheses.
|
|
82
82
|
- [ ] **Web:** Step 10 — fetch anchor standards. Fallback: versions recorded as unread.
|
|
83
83
|
|
|
@@ -208,6 +208,13 @@ PENDING
|
|
|
208
208
|
|
|
209
209
|
PENDING
|
|
210
210
|
|
|
211
|
+
### Suggested Issues
|
|
212
|
+
|
|
213
|
+
<!-- prettier-ignore -->
|
|
214
|
+
| # | Title | Findings | Severity | Next Step | Reason |
|
|
215
|
+
| --- | --- | --- | --- | --- | --- |
|
|
216
|
+
| PENDING | PENDING | PENDING | PENDING | PENDING | PENDING |
|
|
217
|
+
|
|
211
218
|
### Process Improvements
|
|
212
219
|
|
|
213
220
|
PENDING
|
|
@@ -221,6 +228,7 @@ PENDING
|
|
|
221
228
|
- [ ] **Series:** mention and citation share, and console query deltas, beside the previous report's numbers, or marked baseline.
|
|
222
229
|
- [ ] **Writes:** only this report and template `Project Instructions` changed; throwaway worktrees / remote targets removed.
|
|
223
230
|
- [ ] **Process Improvements:** `Universal` = proposed step changes, template untouched; `Project` = edits applied below `bkit:end`; each `none` if empty.
|
|
231
|
+
- [ ] **Suggested Issues:** every `MEDIUM`+ finding ID in exactly one row; every row has a `Next Step`.
|
|
224
232
|
- [ ] **Gate 3 - Verified:** Every checkbox above independently verified and checked off.
|
|
225
233
|
|
|
226
234
|
> `Project Instructions` below `bkit:end` are consumer-owned — `bkit install` never overwrites them, `bkit check` drift stays clean. Add project-specific tools, paths, commands, and checks there, keyed by section or step title; never results.
|
|
@@ -83,7 +83,7 @@ Tracking decays quietly: one-sided renames, funnel steps that stop after refacto
|
|
|
83
83
|
|
|
84
84
|
Always verify.
|
|
85
85
|
|
|
86
|
-
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`. never retry or reword a blocked call to get past it.
|
|
86
|
+
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied (here or in any step) → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`; run every step the remaining tools allow; work needing blocked call → `Not Checked`. never stop the run for a blocked call; never retry or reword a blocked call to get past it.
|
|
87
87
|
- [ ] **Web:** Step 18 — fetch anchor standards. Fallback: versions recorded as unread.
|
|
88
88
|
|
|
89
89
|
#### Conditional
|
|
@@ -247,6 +247,13 @@ PENDING
|
|
|
247
247
|
|
|
248
248
|
PENDING
|
|
249
249
|
|
|
250
|
+
### Suggested Issues
|
|
251
|
+
|
|
252
|
+
<!-- prettier-ignore -->
|
|
253
|
+
| # | Title | Findings | Severity | Next Step | Reason |
|
|
254
|
+
| --- | --- | --- | --- | --- | --- |
|
|
255
|
+
| PENDING | PENDING | PENDING | PENDING | PENDING | PENDING |
|
|
256
|
+
|
|
250
257
|
### Process Improvements
|
|
251
258
|
|
|
252
259
|
PENDING
|
|
@@ -260,6 +267,7 @@ PENDING
|
|
|
260
267
|
- [ ] **Series:** `Dashboards` shares and the `Container` diff beside previous report's, or marked baseline.
|
|
261
268
|
- [ ] **Writes:** only this report and template `Project Instructions` changed; throwaway worktrees / remote targets removed.
|
|
262
269
|
- [ ] **Process Improvements:** `Universal` = proposed step changes, template untouched; `Project` = edits applied below `bkit:end`; each `none` if empty.
|
|
270
|
+
- [ ] **Suggested Issues:** every `MEDIUM`+ finding ID in exactly one row; every row has a `Next Step`.
|
|
263
271
|
- [ ] **Gate 3 - Verified:** Every checkbox above independently verified and checked off.
|
|
264
272
|
|
|
265
273
|
> `Project Instructions` below `bkit:end` are consumer-owned — `bkit install` never overwrites them, `bkit check` drift stays clean. Add project-specific tools, paths, commands, and checks there, keyed by section or step title; never results.
|
|
@@ -83,7 +83,7 @@ One per annotation. **SILENT FAILURE** outranks every other verdict.
|
|
|
83
83
|
|
|
84
84
|
Always verify.
|
|
85
85
|
|
|
86
|
-
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`. never retry or reword a blocked call to get past it.
|
|
86
|
+
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied (here or in any step) → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`; run every step the remaining tools allow; work needing blocked call → `Not Checked`. never stop the run for a blocked call; never retry or reword a blocked call to get past it.
|
|
87
87
|
- [ ] **CI Read:** Steps 2, 5, 11 — annotations and step logs for recent runs of every workflow, e.g. `gh api` check-run annotations, `gh run view --log`, GitLab job-trace API. Log access: `.agents/context.md` `context-fetch` blocks below `bkit:end` are ready-made read-only readers (`bkit context list-blocks` → each block's `context` and `body`); set a body's `# Customise:` knobs to the audit window; run it via `direnv exec . bash`. Fallback: saved logs; runs not fetched `Not Checked`.
|
|
88
88
|
- [ ] **Workflow Files:** Steps 4, 6, 8 — workflows, composite actions, reusable workflows on disk. Fallback: none.
|
|
89
89
|
- [ ] **Web:** Steps 3, 12 — vendor changelog, runner-image announcements, anchor standards. Fallback: versions recorded as unread.
|
|
@@ -111,7 +111,7 @@ Verify only when applicable.
|
|
|
111
111
|
- [ ] **Step 4 — Runtimes:** Every `uses:` (or the CI system's equivalent) in workflows, local composite actions, and reusable workflows — resolved version and declared runtime (e.g. `runs.using`). Action declaring removed runtime (e.g. `node20` after runners dropped it) runs on forced runtime with no opt-out → finding, unless seen working there. List leftover opt-out env keys that no longer change anything. **Done when:** `Runtimes` row per action: version · declared runtime · verdict, plus leftover keys.
|
|
112
112
|
- [ ] **Step 5 — Log Warnings:** Some deprecations print only to log. Grep same runs' step logs for deprecation markers (e.g. `DeprecationWarning`, `[DEP0`, `npm warn deprecated`, `WARN deprecated`, `will be removed`) and CLI outdated notices (e.g. EAS, Expo, Vercel). Verdict each as if annotation. Agree with `bkit-audit-logs` which sweep owns each line — triage once. **Done when:** `Log Warnings` row per line: verdict or owning sweep.
|
|
113
113
|
- [ ] **Step 6 — Static Analysis:** Run workflow linters every sweep, not only to verify a fix. Each new finding = annotation: shell issues in `run:` blocks, expression typos, template injection, excessive permissions, unpinned `uses:`. Grep workflows/scripts for deprecated workflow commands (e.g. GitHub Actions `::set-output`, `::save-state`, `::set-env`, `::add-path`) and opt-in re-enabling them (e.g. `ACTIONS_ALLOW_UNSECURE_COMMANDS`). Runner warns on some only at execute — conditional lane hides them. **Done when:** `Static Analysis` row per finding with verdict.
|
|
114
|
-
- [ ] **Step 7 — Classify:** One verdict each from `Verdicts`. SILENT FAILURE on sight, e.g. GitHub `Unexpected input(s) '…', valid inputs are …` (misspelled input key, ignored); `No files were found with the provided path` (artifact never uploaded). No forced fit → OTHER. Destinations (next step; this run does not send): real defect → `docs/failures.jsonl` row
|
|
114
|
+
- [ ] **Step 7 — Classify:** One verdict each from `Verdicts`. SILENT FAILURE on sight, e.g. GitHub `Unexpected input(s) '…', valid inputs are …` (misspelled input key, ignored); `No files were found with the provided path` (artifact never uploaded). No forced fit → OTHER. Destinations (next step; this run does not send; the audit agent writes `docs/failures.jsonl` rows): real defect → `docs/failures.jsonl` row; SILENT FAILURE → root cause, fix, guard (`Silent Failures`); DEPRECATION → date and bump, dependency bot first; LINT WARNING → fix or why it stands; DEAD SUPPRESSION → delete directive, wrong-node flag; flake → `bkit-audit-flakes`; runtime error or log-sweep line → `bkit-audit-logs`; standing rule → sentence for testing or deployments doc; workflow change → recommendation needing explicit human confirmation; ACCEPTED → nothing, cite record. **Done when:** every annotation in `Annotations` has verdict and destination.
|
|
115
115
|
- [ ] **Step 8 — Silent Failures:** Root-cause each SILENT FAILURE vs runner rules. Annotation = platform vocabulary symptom. Examples (GitHub Actions): `$GITHUB_ENV` blocklists some names (`NODE_OPTIONS` among them) — set as static job-level `env:` keys; `env` context unavailable to job-level `env:` value → shortened form resolves empty, fails quiet; step-level `env:` replaces job-level map (no merge) — overriding one key restates others; managed blocks revert in-marker edits — check key inside managed marker before recommending move. Other CI → equivalent (masked variables, non-merging env, platform-rewritten config). Report names guard fix should carry, proven red by reintroducing bug; where deleting mechanism leaves lane quiet and knob-less → second guard that replacement knob exists. Writing fix = next step. **Done when:** `Silent Failures` names root cause, fix, guard for each.
|
|
116
116
|
- [ ] **Step 9 — Lint Node:** Lint annotation or in-code suppression → node rule fires on; count change if directive removed. Reason from per-file diagnostics; do not edit; do not whole-repo typecheck/lint for one file. Language server = one language; workflow files = text search. Dead disable at annotation line with effect further down (comment only) → DEAD SUPPRESSION on wrong node (live rule = LINT WARNING). **Done when:** `Lint` row per warning: node · directive · verdict.
|
|
117
117
|
- [ ] **Step 10 — Matchers:** Problem matchers or annotation reporters for typecheck, lint, test output in CI (e.g. `tsc`, ESLint, Vitest). Without them warnings stay in logs — LINT WARNING under-counted. Confirm deprecated-API lint enabled (e.g. `@typescript-eslint/no-deprecated`). Deprecated framework API calls = code-side same deadline. **Done when:** `Matchers` names each reporter and deprecated-API rule: present or absent.
|
|
@@ -210,6 +210,13 @@ PENDING
|
|
|
210
210
|
|
|
211
211
|
PENDING
|
|
212
212
|
|
|
213
|
+
### Suggested Issues
|
|
214
|
+
|
|
215
|
+
<!-- prettier-ignore -->
|
|
216
|
+
| # | Title | Findings | Severity | Next Step | Reason |
|
|
217
|
+
| --- | --- | --- | --- | --- | --- |
|
|
218
|
+
| PENDING | PENDING | PENDING | PENDING | PENDING | PENDING |
|
|
219
|
+
|
|
213
220
|
### Process Improvements
|
|
214
221
|
|
|
215
222
|
PENDING
|
|
@@ -224,6 +231,7 @@ PENDING
|
|
|
224
231
|
- [ ] **Verified:** states what was checked locally and what still needs a real run.
|
|
225
232
|
- [ ] **Writes:** only this report and template `Project Instructions` changed; throwaway worktrees / remote targets removed.
|
|
226
233
|
- [ ] **Process Improvements:** `Universal` = proposed step changes, template untouched; `Project` = edits applied below `bkit:end`; each `none` if empty.
|
|
234
|
+
- [ ] **Suggested Issues:** every `MEDIUM`+ finding ID in exactly one row; every row has a `Next Step`.
|
|
227
235
|
- [ ] **Gate 3 - Verified:** Every checkbox above independently verified and checked off.
|
|
228
236
|
|
|
229
237
|
> `Project Instructions` below `bkit:end` are consumer-owned — `bkit install` never overwrites them, `bkit check` drift stays clean. Add project-specific tools, paths, commands, and checks there, keyed by section or step title; never results.
|
|
@@ -77,7 +77,7 @@ Performance numbers only matter beside the prior number, same method; unfixed me
|
|
|
77
77
|
|
|
78
78
|
Always verify.
|
|
79
79
|
|
|
80
|
-
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`. never retry or reword a blocked call to get past it.
|
|
80
|
+
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied (here or in any step) → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`; run every step the remaining tools allow; work needing blocked call → `Not Checked`. never stop the run for a blocked call; never retry or reword a blocked call to get past it.
|
|
81
81
|
- [ ] **Monitoring:** Steps 2–4, 6, 9, 11–13, 15 — field traces, vitals, spans per environment, e.g. Sentry, Datadog RUM, New Relic. Fallback: lab and static only; field rows `Not Checked`.
|
|
82
82
|
- [ ] **Build Output:** Steps 8, 10 — production build with per-route size and render mode, e.g. `next build`, `vite build` with bundle analyser. Fallback: source read only; sizes `Not Checked`.
|
|
83
83
|
- [ ] **Web:** Steps 4, 17 — fetch anchor standards and published thresholds. Fallback: versions and thresholds recorded as unread.
|
|
@@ -251,6 +251,13 @@ PENDING
|
|
|
251
251
|
|
|
252
252
|
PENDING
|
|
253
253
|
|
|
254
|
+
### Suggested Issues
|
|
255
|
+
|
|
256
|
+
<!-- prettier-ignore -->
|
|
257
|
+
| # | Title | Findings | Severity | Next Step | Reason |
|
|
258
|
+
| --- | --- | --- | --- | --- | --- |
|
|
259
|
+
| PENDING | PENDING | PENDING | PENDING | PENDING | PENDING |
|
|
260
|
+
|
|
254
261
|
### Process Improvements
|
|
255
262
|
|
|
256
263
|
PENDING
|
|
@@ -264,6 +271,7 @@ PENDING
|
|
|
264
271
|
- [ ] **Series:** every series beside previous report's numbers, or marked baseline.
|
|
265
272
|
- [ ] **Writes:** only this report and template `Project Instructions` changed; throwaway worktrees / remote targets removed.
|
|
266
273
|
- [ ] **Process Improvements:** `Universal` = proposed step changes, template untouched; `Project` = edits applied below `bkit:end`; each `none` if empty.
|
|
274
|
+
- [ ] **Suggested Issues:** every `MEDIUM`+ finding ID in exactly one row; every row has a `Next Step`.
|
|
267
275
|
- [ ] **Gate 3 - Verified:** Every checkbox above independently verified and checked off.
|
|
268
276
|
|
|
269
277
|
> `Project Instructions` below `bkit:end` are consumer-owned — `bkit install` never overwrites them, `bkit check` drift stays clean. Add project-specific tools, paths, commands, and checks there, keyed by section or step title; never results.
|
|
@@ -84,7 +84,7 @@ Stores change rules on their own schedule. New target API, higher upload SDK, pr
|
|
|
84
84
|
|
|
85
85
|
Always verify.
|
|
86
86
|
|
|
87
|
-
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`. never retry or reword a blocked call to get past it.
|
|
87
|
+
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied (here or in any step) → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`; run every step the remaining tools allow; work needing blocked call → `Not Checked`. never stop the run for a blocked call; never retry or reword a blocked call to get past it.
|
|
88
88
|
- [ ] **Build Config:** Steps 2–6, 10 — app config and build profiles in repo, e.g. `app.json`, `eas.json`, `project.pbxproj`. Fallback: none; missing config = finding.
|
|
89
89
|
- [ ] **Web:** Step 12 — fetch anchor standards and deadline pages. Fallback: versions and dates recorded as unread.
|
|
90
90
|
|
|
@@ -235,6 +235,13 @@ PENDING
|
|
|
235
235
|
|
|
236
236
|
PENDING
|
|
237
237
|
|
|
238
|
+
### Suggested Issues
|
|
239
|
+
|
|
240
|
+
<!-- prettier-ignore -->
|
|
241
|
+
| # | Title | Findings | Severity | Next Step | Reason |
|
|
242
|
+
| --- | --- | --- | --- | --- | --- |
|
|
243
|
+
| PENDING | PENDING | PENDING | PENDING | PENDING | PENDING |
|
|
244
|
+
|
|
238
245
|
### Process Improvements
|
|
239
246
|
|
|
240
247
|
PENDING
|
|
@@ -248,6 +255,7 @@ PENDING
|
|
|
248
255
|
- [ ] **Series:** ratings and the listing conversion funnel beside previous report's, or marked baseline / not live.
|
|
249
256
|
- [ ] **Writes:** only this report and template `Project Instructions` changed; throwaway worktrees / remote targets removed.
|
|
250
257
|
- [ ] **Process Improvements:** `Universal` = proposed step changes, template untouched; `Project` = edits applied below `bkit:end`; each `none` if empty.
|
|
258
|
+
- [ ] **Suggested Issues:** every `MEDIUM`+ finding ID in exactly one row; every row has a `Next Step`.
|
|
251
259
|
- [ ] **Gate 3 - Verified:** Every checkbox above independently verified and checked off.
|
|
252
260
|
|
|
253
261
|
> `Project Instructions` below `bkit:end` are consumer-owned — `bkit install` never overwrites them, `bkit check` drift stays clean. Add project-specific tools, paths, commands, and checks there, keyed by section or step title; never results.
|
|
@@ -78,7 +78,7 @@ File reading cannot answer acyclic package graph, hub modules, or copied types.
|
|
|
78
78
|
|
|
79
79
|
Always verify.
|
|
80
80
|
|
|
81
|
-
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`. never retry or reword a blocked call to get past it.
|
|
81
|
+
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied (here or in any step) → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`; run every step the remaining tools allow; work needing blocked call → `Not Checked`. never stop the run for a blocked call; never retry or reword a blocked call to get past it.
|
|
82
82
|
- [ ] **Code Graph:** Steps 2–4 — local code-only extractor, e.g. graphify via a wrapper that strips API keys. Fallback: dependency linter and text search; graph counts `Not Checked`.
|
|
83
83
|
- [ ] **Dependency Linter:** Steps 5–6 — resolves through the compiler, e.g. dependency-cruiser, import-linter. Fallback: read import statements; say so per claim.
|
|
84
84
|
- [ ] **Git History:** Steps 1, 9, 13 — change coupling and the diff since the previous report. Fallback: change coupling `Not Checked`.
|
|
@@ -202,6 +202,13 @@ PENDING
|
|
|
202
202
|
|
|
203
203
|
PENDING
|
|
204
204
|
|
|
205
|
+
### Suggested Issues
|
|
206
|
+
|
|
207
|
+
<!-- prettier-ignore -->
|
|
208
|
+
| # | Title | Findings | Severity | Next Step | Reason |
|
|
209
|
+
| --- | --- | --- | --- | --- | --- |
|
|
210
|
+
| PENDING | PENDING | PENDING | PENDING | PENDING | PENDING |
|
|
211
|
+
|
|
205
212
|
### Process Improvements
|
|
206
213
|
|
|
207
214
|
PENDING
|
|
@@ -215,6 +222,7 @@ PENDING
|
|
|
215
222
|
- [ ] **Series:** node, edge, and cross-package counts, and the coupling table, beside previous report's numbers, or marked baseline.
|
|
216
223
|
- [ ] **Writes:** only this report and template `Project Instructions` changed; throwaway worktrees / remote targets removed.
|
|
217
224
|
- [ ] **Process Improvements:** `Universal` = proposed step changes, template untouched; `Project` = edits applied below `bkit:end`; each `none` if empty.
|
|
225
|
+
- [ ] **Suggested Issues:** every `MEDIUM`+ finding ID in exactly one row; every row has a `Next Step`.
|
|
218
226
|
- [ ] **Gate 3 - Verified:** Every checkbox above independently verified and checked off.
|
|
219
227
|
|
|
220
228
|
> `Project Instructions` below `bkit:end` are consumer-owned — `bkit install` never overwrites them, `bkit check` drift stays clean. Add project-specific tools, paths, commands, and checks there, keyed by section or step title; never results.
|
|
@@ -79,7 +79,7 @@ CI time gets re-argued from impressions. Two mistakes recur:
|
|
|
79
79
|
|
|
80
80
|
Always verify.
|
|
81
81
|
|
|
82
|
-
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`. never retry or reword a blocked call to get past it.
|
|
82
|
+
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied (here or in any step) → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`; run every step the remaining tools allow; work needing blocked call → `Not Checked`. never stop the run for a blocked call; never retry or reword a blocked call to get past it.
|
|
83
83
|
- [ ] **CI API:** Steps 2–6, 10–11 — read-only run and job metadata, e.g. `gh run view`, `gh api`. Fallback: workflow files only; timings `Not Checked`.
|
|
84
84
|
- [ ] **Workflow Files:** Steps 3, 7–10 — workflows, task graph, cache config readable. Fallback: none; those steps `Not Checked`.
|
|
85
85
|
- [ ] **Web:** Step 12 — fetch anchor standards and current runner prices. Fallback: versions and prices unread. never reuse a previous report's prices.
|
|
@@ -222,6 +222,13 @@ PENDING
|
|
|
222
222
|
|
|
223
223
|
PENDING
|
|
224
224
|
|
|
225
|
+
### Suggested Issues
|
|
226
|
+
|
|
227
|
+
<!-- prettier-ignore -->
|
|
228
|
+
| # | Title | Findings | Severity | Next Step | Reason |
|
|
229
|
+
| --- | --- | --- | --- | --- | --- |
|
|
230
|
+
| PENDING | PENDING | PENDING | PENDING | PENDING | PENDING |
|
|
231
|
+
|
|
225
232
|
### Process Improvements
|
|
226
233
|
|
|
227
234
|
PENDING
|
|
@@ -235,6 +242,7 @@ PENDING
|
|
|
235
242
|
- [ ] **Series:** every series beside previous report's numbers, or marked baseline.
|
|
236
243
|
- [ ] **Writes:** only this report and template `Project Instructions` changed; throwaway worktrees / remote targets removed.
|
|
237
244
|
- [ ] **Process Improvements:** `Universal` = proposed step changes, template untouched; `Project` = edits applied below `bkit:end`; each `none` if empty.
|
|
245
|
+
- [ ] **Suggested Issues:** every `MEDIUM`+ finding ID in exactly one row; every row has a `Next Step`.
|
|
238
246
|
- [ ] **Gate 3 - Verified:** Every checkbox above independently verified and checked off.
|
|
239
247
|
|
|
240
248
|
> `Project Instructions` below `bkit:end` are consumer-owned — `bkit install` never overwrites them, `bkit check` drift stays clean. Add project-specific tools, paths, commands, and checks there, keyed by section or step title; never results.
|
|
@@ -79,7 +79,7 @@ Code is reviewed; dashboards are not. Dashboard changes (hosting, database, paym
|
|
|
79
79
|
|
|
80
80
|
Always verify.
|
|
81
81
|
|
|
82
|
-
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`. never retry or reword a blocked call to get past it.
|
|
82
|
+
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied (here or in any step) → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`; run every step the remaining tools allow; work needing blocked call → `Not Checked`. never stop the run for a blocked call; never retry or reword a blocked call to get past it.
|
|
83
83
|
- [ ] **Variable Listing:** Steps 2, 3 — names per environment from every host, CI, and secret store (e.g. `vercel env ls`, `gh secret list` / `gh variable list`, `gcloud secrets list`, `eas env:list`). Fallback: repo-declared names only; environments `Not Checked`.
|
|
84
84
|
- [ ] **Platform Read:** Steps 4–6 — read-only dashboard / CLI / management API per platform (e.g. Vercel API, Supabase Management API, Stripe CLI, Sentry API). Fallback: repo and docs only; platform side `Not Checked`.
|
|
85
85
|
- [ ] **Audit Logs:** Step 6 — per-platform settings-change history (e.g. Vercel team activity, Supabase org audit log, GitHub org / repo audit log). Fallback: snapshot diff only; set-and-reverted changes `Not Checked`.
|
|
@@ -211,6 +211,13 @@ PENDING
|
|
|
211
211
|
|
|
212
212
|
PENDING
|
|
213
213
|
|
|
214
|
+
### Suggested Issues
|
|
215
|
+
|
|
216
|
+
<!-- prettier-ignore -->
|
|
217
|
+
| # | Title | Findings | Severity | Next Step | Reason |
|
|
218
|
+
| --- | --- | --- | --- | --- | --- |
|
|
219
|
+
| PENDING | PENDING | PENDING | PENDING | PENDING | PENDING |
|
|
220
|
+
|
|
214
221
|
### Process Improvements
|
|
215
222
|
|
|
216
223
|
PENDING
|
|
@@ -224,6 +231,7 @@ PENDING
|
|
|
224
231
|
- [ ] **Series:** `Snapshot` diffed against previous report's, or marked baseline.
|
|
225
232
|
- [ ] **Writes:** only this report and template `Project Instructions` changed; throwaway worktrees / remote targets removed.
|
|
226
233
|
- [ ] **Process Improvements:** `Universal` = proposed step changes, template untouched; `Project` = edits applied below `bkit:end`; each `none` if empty.
|
|
234
|
+
- [ ] **Suggested Issues:** every `MEDIUM`+ finding ID in exactly one row; every row has a `Next Step`.
|
|
227
235
|
- [ ] **Gate 3 - Verified:** Every checkbox above independently verified and checked off.
|
|
228
236
|
|
|
229
237
|
> `Project Instructions` below `bkit:end` are consumer-owned — `bkit install` never overwrites them, `bkit check` drift stays clean. Add project-specific tools, paths, commands, and checks there, keyed by section or step title; never results.
|
|
@@ -81,7 +81,7 @@ One per vendor, and one per paid resource inside a vendor that has several.
|
|
|
81
81
|
|
|
82
82
|
Always verify.
|
|
83
83
|
|
|
84
|
-
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`. never retry or reword a blocked call to get past it.
|
|
84
|
+
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied (here or in any step) → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`; run every step the remaining tools allow; work needing blocked call → `Not Checked`. never stop the run for a blocked call; never retry or reword a blocked call to get past it.
|
|
85
85
|
- [ ] **Bills:** Steps 3–5, 8 — invoices or billing export (e.g. FOCUS), read-only plan/usage/cap pages (e.g. host dashboard, cloud billing console, vendor API). Fallback: unread vendor = `ASK`; tax, foreign exchange, and card fees `Not Checked`.
|
|
86
86
|
- [ ] **Code Search:** Steps 3, 6, 7 — SDKs, outbound hosts, reference checks (e.g. ripgrep, language-server references). Fallback: docs and invoices only; `REMOVE` proof marked incomplete.
|
|
87
87
|
- [ ] **Web:** Step 9 — fetch anchor standards. Fallback: versions recorded as unread.
|
|
@@ -107,7 +107,7 @@ Verify only when applicable.
|
|
|
107
107
|
- [ ] **Step 3 — Inventory:** Build list from code (SDKs, outbound hosts), docs (vendor list, secrets list), and owner-shared invoices; compare. In code, not docs = finding (doc fix → `bkit-audit-documentation`). On invoice, nowhere in code = `REMOVE` candidate. Count non-vendor-plan fees (card-processor, app-store commission): grow with paying accounts; no vendor dashboard. Replaced platform still billing after replacement shipped = `REMOVE` candidate. **Done when:** `Vendors` lists every vendor with its sources.
|
|
108
108
|
- [ ] **Step 4 — Plans:** Per vendor: plan, billing model (flat, per seat, per use), spend last three months, usage driver, plan limit, proximity to limit. Split by environment; preview/dev billed like production = finding. Per usage-billed vendor: preview/E2E/CI vs production share, by feature where vendor can tell. Log audit environment split → start from `bkit-audit-logs`. E2E-driven usage on usage-billed vendor = `RIGHT-SIZE` candidate. Every free-tier resource production/CI depends on; behavior at limit (e.g. free DB pauses, free monitor stops). Free tier failing hard = finding even at $0 today. Compare monthly vs annual, prepaid credits, startup programmes, committed-use discounts; propose commitment only if usage stable ≥3 months. Record billing currency, card FX fees, sales tax/VAT/GST/reverse-charge correctness (invoice + card statement, not dashboards). **Done when:** `Vendors` row per vendor: verdict · plan · billing model · three-month spend · change since previous report · driver · limit · environment split. Total spend included.
|
|
109
109
|
- [ ] **Step 5 — Unit Cost:** Total monthly cost ÷ active accounts and active users; split fixed/variable. Per metered feature, cost per action (e.g. per model assist, per inbound message). Series vs previous report: without unit cost, bill health is undecidable as usage grows. vs revenue: price × assumed conversion, less processor fees and store commission, vs cost per account. Account costing more than it pays = finding with assumptions. **Done when:** `Unit Cost` holds figures, trend, assumptions.
|
|
110
|
-
- [ ] **Step 6 — Drivers:** Per usage-billed service: code driving the meter and worst case (retry, tenant fan-out, cron frequency). Multiplier with no upper bound = finding. Model-call multiplier also names `bkit-audit-llm` (in-code limits); other unbounded multipliers
|
|
110
|
+
- [ ] **Step 6 — Drivers:** Per usage-billed service: code driving the meter and worst case (retry, tenant fan-out, cron frequency). Multiplier with no upper bound = finding. Model-call multiplier also names `bkit-audit-llm` (in-code limits); other unbounded multipliers → `docs/failures.jsonl` row, which the audit agent writes. Egress/data transfer own line: grow with users, unnamed in code (DB egress, cached egress, host data transfer, origin transfer, storage transforms, log-drain egress); top routes/buckets by bytes. Observability metered: log drains, host observability events, replay, trace sample rates in code. From drivers, forecast monthly cost at 10× and 100× today's active accounts; name first vendor whose tier breaks and month at current growth. CI minutes → `bkit-audit-ci-performance`; do not analyse here. **Done when:** `Drivers` row per meter; `Forecast` holds 10×, 100×, first tier break, month.
|
|
111
111
|
- [ ] **Step 7 — Leftovers:** Seats for people who no longer need them — cost only here; access → `bkit-audit-security`. Idle resources: projects, DBs, monitors, buckets, domains from experiments. Duplicates: two vendors, one job. **Done when:** `Leftovers` row per hit with monthly amount and verdict.
|
|
112
112
|
- [ ] **Step 8 — Caps:** Per usage-billed vendor: spend cap or budget alert, amount, recipients. No cap and no alert = finding even when spend is small. When hit:
|
|
113
113
|
- Notify, stop spend, or pause service; whether hit = outage. Notify-only may leave production serving; pause may take production down (e.g. host spend limit notifies unless production deploys paused). Record check frequency; lag → overshoot.
|
|
@@ -199,6 +199,13 @@ PENDING
|
|
|
199
199
|
|
|
200
200
|
PENDING
|
|
201
201
|
|
|
202
|
+
### Suggested Issues
|
|
203
|
+
|
|
204
|
+
<!-- prettier-ignore -->
|
|
205
|
+
| # | Title | Findings | Severity | Next Step | Reason |
|
|
206
|
+
| --- | --- | --- | --- | --- | --- |
|
|
207
|
+
| PENDING | PENDING | PENDING | PENDING | PENDING | PENDING |
|
|
208
|
+
|
|
202
209
|
### Process Improvements
|
|
203
210
|
|
|
204
211
|
PENDING
|
|
@@ -212,6 +219,7 @@ PENDING
|
|
|
212
219
|
- [ ] **Series:** `Vendors` spend, `Unit Cost`, and `Forecast` beside previous report's numbers, or marked baseline.
|
|
213
220
|
- [ ] **Writes:** only this report and template `Project Instructions` changed; throwaway worktrees / remote targets removed.
|
|
214
221
|
- [ ] **Process Improvements:** `Universal` = proposed step changes, template untouched; `Project` = edits applied below `bkit:end`; each `none` if empty.
|
|
222
|
+
- [ ] **Suggested Issues:** every `MEDIUM`+ finding ID in exactly one row; every row has a `Next Step`.
|
|
215
223
|
- [ ] **Gate 3 - Verified:** Every checkbox above independently verified and checked off.
|
|
216
224
|
|
|
217
225
|
> `Project Instructions` below `bkit:end` are consumer-owned — `bkit install` never overwrites them, `bkit check` drift stays clean. Add project-specific tools, paths, commands, and checks there, keyed by section or step title; never results.
|
|
@@ -72,7 +72,7 @@ Static floor: coverage climbs, gate far below, large drop passes green. One-run
|
|
|
72
72
|
|
|
73
73
|
Always verify.
|
|
74
74
|
|
|
75
|
-
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`. never retry or reword a blocked call to get past it.
|
|
75
|
+
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied (here or in any step) → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`; run every step the remaining tools allow; work needing blocked call → `Not Checked`. never stop the run for a blocked call; never retry or reword a blocked call to get past it.
|
|
76
76
|
- [ ] **CI History:** Steps 4, 5, 7, 10 — branch coverage from full CI runs, e.g. `gh run list` / `gh run download`, GitLab pipelines, Codecov. Fallback: local re-runs fill gap; mark every local observation.
|
|
77
77
|
- [ ] **Coverage Artifacts:** Steps 6, 7, 11, 12 — summary and per-file coverage, e.g. `coverage-summary.json`, `coverage-final.json`, lcov. Fallback: percentages only; file-level claims `Not Checked`.
|
|
78
78
|
- [ ] **Git History:** Steps 3, 9, 15 — `git log -L` / `git log -p` on floor values and coverage config. Fallback: current tree only; history `Not Checked`.
|
|
@@ -202,6 +202,13 @@ PENDING
|
|
|
202
202
|
|
|
203
203
|
PENDING
|
|
204
204
|
|
|
205
|
+
### Suggested Issues
|
|
206
|
+
|
|
207
|
+
<!-- prettier-ignore -->
|
|
208
|
+
| # | Title | Findings | Severity | Next Step | Reason |
|
|
209
|
+
| --- | --- | --- | --- | --- | --- |
|
|
210
|
+
| PENDING | PENDING | PENDING | PENDING | PENDING | PENDING |
|
|
211
|
+
|
|
205
212
|
### Process Improvements
|
|
206
213
|
|
|
207
214
|
PENDING
|
|
@@ -215,6 +222,7 @@ PENDING
|
|
|
215
222
|
- [ ] **Series:** `Sample` spreads and the floor series beside previous report's numbers, or marked baseline.
|
|
216
223
|
- [ ] **Writes:** only this report and template `Project Instructions` changed; throwaway worktrees / remote targets removed.
|
|
217
224
|
- [ ] **Process Improvements:** `Universal` = proposed step changes, template untouched; `Project` = edits applied below `bkit:end`; each `none` if empty.
|
|
225
|
+
- [ ] **Suggested Issues:** every `MEDIUM`+ finding ID in exactly one row; every row has a `Next Step`.
|
|
218
226
|
- [ ] **Gate 3 - Verified:** Every checkbox above independently verified and checked off.
|
|
219
227
|
|
|
220
228
|
> `Project Instructions` below `bkit:end` are consumer-owned — `bkit install` never overwrites them, `bkit check` drift stays clean. Add project-specific tools, paths, commands, and checks there, keyed by section or step title; never results.
|
|
@@ -71,7 +71,7 @@ Migrations and integration tests exercise queries; neither verifies privileges,
|
|
|
71
71
|
|
|
72
72
|
Always verify.
|
|
73
73
|
|
|
74
|
-
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`. never retry or reword a blocked call to get past it.
|
|
74
|
+
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied (here or in any step) → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`; run every step the remaining tools allow; work needing blocked call → `Not Checked`. never stop the run for a blocked call; never retry or reword a blocked call to get past it.
|
|
75
75
|
- [ ] **Catalogue Read:** Steps 3–16 — read-only SQL (or store's read-only API) per environment, e.g. platform MCP `execute_sql`, `psql` as read-only role. Fallback: local DB from migrations; remote claims = hypotheses.
|
|
76
76
|
- [ ] **Local DB:** Steps 2, 10, 14 — replayable from migrations. Fallback: rolled-back transactions and remote re-check.
|
|
77
77
|
- [ ] **Web:** Step 18 — fetch anchor standards. Fallback: versions recorded as unread.
|
|
@@ -210,6 +210,13 @@ PENDING
|
|
|
210
210
|
|
|
211
211
|
PENDING
|
|
212
212
|
|
|
213
|
+
### Suggested Issues
|
|
214
|
+
|
|
215
|
+
<!-- prettier-ignore -->
|
|
216
|
+
| # | Title | Findings | Severity | Next Step | Reason |
|
|
217
|
+
| --- | --- | --- | --- | --- | --- |
|
|
218
|
+
| PENDING | PENDING | PENDING | PENDING | PENDING | PENDING |
|
|
219
|
+
|
|
213
220
|
### Process Improvements
|
|
214
221
|
|
|
215
222
|
PENDING
|
|
@@ -223,6 +230,7 @@ PENDING
|
|
|
223
230
|
- [ ] **Series:** every series beside previous report's numbers, or marked baseline.
|
|
224
231
|
- [ ] **Writes:** only this report and template `Project Instructions` changed; throwaway worktrees / remote targets removed.
|
|
225
232
|
- [ ] **Process Improvements:** `Universal` = proposed step changes, template untouched; `Project` = edits applied below `bkit:end`; each `none` if empty.
|
|
233
|
+
- [ ] **Suggested Issues:** every `MEDIUM`+ finding ID in exactly one row; every row has a `Next Step`.
|
|
226
234
|
- [ ] **Gate 3 - Verified:** Every checkbox above independently verified and checked off.
|
|
227
235
|
|
|
228
236
|
> `Project Instructions` below `bkit:end` are consumer-owned — `bkit install` never overwrites them, `bkit check` drift stays clean. Add project-specific tools, paths, commands, and checks there, keyed by section or step title; never results.
|
|
@@ -81,7 +81,7 @@ Dead code = control that looks live, is not: limiter on unset env var; E2E asser
|
|
|
81
81
|
|
|
82
82
|
Always verify.
|
|
83
83
|
|
|
84
|
-
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`. never retry or reword a blocked call to get past it.
|
|
84
|
+
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied (here or in any step) → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`; run every step the remaining tools allow; work needing blocked call → `Not Checked`. never stop the run for a blocked call; never retry or reword a blocked call to get past it.
|
|
85
85
|
- [ ] **Clean Tree:** Steps 2–17 — clean `git status` at recorded commit; one checkout all steps. Fallback: detached worktree off integration branch; dirty-path candidates = hypotheses.
|
|
86
86
|
- [ ] **Text Search:** Steps 5–14 — repo search (`git grep`, ripgrep). Fallback: none → those steps `Not Checked`.
|
|
87
87
|
- [ ] **Reachability Scanner:** Steps 3–4 — ad hoc, not committed dependency (e.g. `pnpm dlx knip`, vulture). Fallback: language-server refs + text search; scanner categories `Not Checked`.
|
|
@@ -232,6 +232,13 @@ PENDING
|
|
|
232
232
|
|
|
233
233
|
PENDING
|
|
234
234
|
|
|
235
|
+
### Suggested Issues
|
|
236
|
+
|
|
237
|
+
<!-- prettier-ignore -->
|
|
238
|
+
| # | Title | Findings | Severity | Next Step | Reason |
|
|
239
|
+
| --- | --- | --- | --- | --- | --- |
|
|
240
|
+
| PENDING | PENDING | PENDING | PENDING | PENDING | PENDING |
|
|
241
|
+
|
|
235
242
|
### Process Improvements
|
|
236
243
|
|
|
237
244
|
PENDING
|
|
@@ -245,6 +252,7 @@ PENDING
|
|
|
245
252
|
- [ ] **Series:** `Reachability` counts and `Runtime` zeroes beside previous report's numbers, or marked baseline.
|
|
246
253
|
- [ ] **Writes:** only this report and template `Project Instructions` changed; throwaway worktrees / remote targets removed.
|
|
247
254
|
- [ ] **Process Improvements:** `Universal` = proposed step changes, template untouched; `Project` = edits applied below `bkit:end`; each `none` if empty.
|
|
255
|
+
- [ ] **Suggested Issues:** every `MEDIUM`+ finding ID in exactly one row; every row has a `Next Step`.
|
|
248
256
|
- [ ] **Gate 3 - Verified:** Every checkbox above independently verified and checked off.
|
|
249
257
|
|
|
250
258
|
> `Project Instructions` below `bkit:end` are consumer-owned — `bkit install` never overwrites them, `bkit check` drift stays clean. Add project-specific tools, paths, commands, and checks there, keyed by section or step title; never results.
|
|
@@ -99,7 +99,7 @@ Never set `unjustified` while repairing a missing or illegal `reason`. That repa
|
|
|
99
99
|
|
|
100
100
|
Always verify.
|
|
101
101
|
|
|
102
|
-
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`. never retry or reword a blocked call to get past it.
|
|
102
|
+
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied (here or in any step) → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`; run every step the remaining tools allow; work needing blocked call → `Not Checked`. never stop the run for a blocked call; never retry or reword a blocked call to get past it.
|
|
103
103
|
- [ ] **Ledger:** Steps 3–9 — `docs/deferrals.jsonl` and `.bkit/jsonl.md`. Fallback: file absent → one `N/A` row after Step 3 and STOP.
|
|
104
104
|
- [ ] **Git History:** Steps 2, 7 — commits since the previous report, 90-day churn. Fallback: closures and churn `Not Checked`.
|
|
105
105
|
- [ ] **Web:** Step 10 — fetch anchor standards. Fallback: versions recorded as unread.
|
|
@@ -264,6 +264,13 @@ PENDING
|
|
|
264
264
|
|
|
265
265
|
PENDING
|
|
266
266
|
|
|
267
|
+
### Suggested Issues
|
|
268
|
+
|
|
269
|
+
<!-- prettier-ignore -->
|
|
270
|
+
| # | Title | Findings | Severity | Next Step | Reason |
|
|
271
|
+
| --- | --- | --- | --- | --- | --- |
|
|
272
|
+
| PENDING | PENDING | PENDING | PENDING | PENDING | PENDING |
|
|
273
|
+
|
|
267
274
|
### Process Improvements
|
|
268
275
|
|
|
269
276
|
PENDING
|
|
@@ -277,6 +284,7 @@ PENDING
|
|
|
277
284
|
- [ ] **Series:** `Trend` open count, inflow, and outflow beside previous report's numbers, or marked baseline.
|
|
278
285
|
- [ ] **Writes:** only this report and template `Project Instructions` changed; throwaway worktrees / remote targets removed.
|
|
279
286
|
- [ ] **Process Improvements:** `Universal` = proposed step changes, template untouched; `Project` = edits applied below `bkit:end`; each `none` if empty.
|
|
287
|
+
- [ ] **Suggested Issues:** every `MEDIUM`+ finding ID in exactly one row; every row has a `Next Step`.
|
|
280
288
|
- [ ] **Gate 3 - Verified:** Every checkbox above independently verified and checked off.
|
|
281
289
|
|
|
282
290
|
> `Project Instructions` below `bkit:end` are consumer-owned — `bkit install` never overwrites them, `bkit check` drift stays clean. Add project-specific tools, paths, commands, and checks there, keyed by section or step title; never results.
|
|
@@ -7,7 +7,7 @@
|
|
|
7
7
|
# Dependency Triage
|
|
8
8
|
|
|
9
9
|
> [!CAUTION]
|
|
10
|
-
> **Purpose:** Batch open dependency-update PRs for verification; judge supply-chain settings, advisories, licences,
|
|
10
|
+
> **Purpose:** Batch open dependency-update PRs for verification; judge supply-chain settings, advisories, licences, end of life, off-manifest CLIs.
|
|
11
11
|
>
|
|
12
12
|
> **Rules:**
|
|
13
13
|
>
|
|
@@ -40,7 +40,7 @@ Every dependency PR rewrites the lockfile. Unbatched → PRs stale against each
|
|
|
40
40
|
- Registry provenance and trusted publishing (e.g. npm provenance).
|
|
41
41
|
- OpenSSF Scorecard; record version.
|
|
42
42
|
- OpenSSF Concise Guide for Evaluating Open Source Software; record revision date.
|
|
43
|
-
- Vulnerability scanner and advisory database (e.g. OSV-Scanner, GitHub Advisory Database).
|
|
43
|
+
- Vulnerability scanner and advisory database (e.g. Trivy, OSV-Scanner, GitHub Advisory Database).
|
|
44
44
|
- Lockfile-integrity linter (e.g. lockfile-lint). Unreadable format → apply checks by hand.
|
|
45
45
|
- Runtime end-of-life catalogue (e.g. endoflife.date); record the date read.
|
|
46
46
|
- SPDX License List; record version.
|
|
@@ -55,6 +55,7 @@ Every dependency PR rewrites the lockfile. Unbatched → PRs stale against each
|
|
|
55
55
|
- Settings that multiply PRs and CI runs.
|
|
56
56
|
- Supply-chain screen of the batch diff.
|
|
57
57
|
- Advisories the bot does not see, fix latency, unmaintained, and deprecated packages, licences.
|
|
58
|
+
- Off-manifest CLIs: pin, distance from latest, bot coverage.
|
|
58
59
|
- Runtime and framework end of life.
|
|
59
60
|
|
|
60
61
|
### Out of Scope
|
|
@@ -65,6 +66,8 @@ Every dependency PR rewrites the lockfile. Unbatched → PRs stale against each
|
|
|
65
66
|
| Store submission deadlines | Store sweep | `bkit-audit-app-store` |
|
|
66
67
|
| Dependencies nothing uses | Dead-code sweep | `bkit-audit-dead-code` |
|
|
67
68
|
| Whether a vulnerable function is reachable, beyond naming the call | Security sweep | `bkit-audit-security` |
|
|
69
|
+
| Tool-server packages (e.g. MCP) | Agent config sweep | `bkit-audit-agents` |
|
|
70
|
+
| CLI outdated notices in CI logs | Annotations sweep | `bkit-audit-annotations` |
|
|
68
71
|
| Landing the batch, or labelling, closing, or commenting on PRs | Audit reports only | Plan from this report |
|
|
69
72
|
|
|
70
73
|
### Verdicts
|
|
@@ -92,11 +95,11 @@ Batch verdict, in `Summary`, not per PR. The landing push's CI is the next step'
|
|
|
92
95
|
|
|
93
96
|
Always verify.
|
|
94
97
|
|
|
95
|
-
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`. never retry or reword a blocked call to get past it.
|
|
98
|
+
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied (here or in any step) → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`; run every step the remaining tools allow; work needing blocked call → `Not Checked`. never stop the run for a blocked call; never retry or reword a blocked call to get past it. Call that ran but the API refused (e.g. HTTP 403 from an endpoint needing another token type, such as GitHub `GET /user/installations`) → not a block; `Not Checked` only, no allow rule.
|
|
96
99
|
- [ ] **Git Host:** Steps 2, 3, 11, 12 — open PRs by head-ref prefix, CI runs, behind-count, e.g. `gh`, GitLab API. Fallback: none; PR steps `Not Checked`, batch verdict `FAIL`.
|
|
97
100
|
- [ ] **Package Manager:** Steps 5, 8–10 — install, lockfile, registry metadata, e.g. pnpm, npm. Fallback: none; `Batch` and `Verification` `Not Checked`, batch verdict `FAIL`.
|
|
98
101
|
- [ ] **Clean Worktree:** Steps 8–10 — detached worktree off the integration branch, removed before the report finishes. Fallback: none; do not build the batch in the main checkout.
|
|
99
|
-
- [ ] **Web:** Steps
|
|
102
|
+
- [ ] **Web:** Steps 13–15 — latest CLI releases, anchor standards, end-of-life dates, vendor support policy. Fallback: versions and days-left recorded as unread.
|
|
100
103
|
|
|
101
104
|
#### Conditional
|
|
102
105
|
|
|
@@ -104,7 +107,7 @@ Verify only when applicable.
|
|
|
104
107
|
|
|
105
108
|
- [ ] **Bot Dashboard:** Bot publishes a dashboard → Step 3 — blocked and will-not-rebase entries. Fallback: open PRs only; stopped-rebase set `Not Checked`.
|
|
106
109
|
- [ ] **Config Validator:** Bot ships one → Step 3 — e.g. `renovate-config-validator`, on the config as the default branch has it. Fallback: read the files; validity `Not Checked`.
|
|
107
|
-
- [ ] **Vulnerability Scanner:** Lockfile, image, or requirements file → Step 13 — e.g. OSV-Scanner, `npm audit`, host advisory API. Fallback: one source only; the missing source `Not Checked`.
|
|
110
|
+
- [ ] **Vulnerability Scanner:** Lockfile, image, or requirements file → Step 13 — e.g. Trivy (`trivy fs --include-dev-deps`), OSV-Scanner, `npm audit`, host advisory API. Fallback: one source only; the missing source `Not Checked`.
|
|
108
111
|
|
|
109
112
|
### 🔒 Gate 1: Prerequisites Check
|
|
110
113
|
|
|
@@ -119,12 +122,13 @@ Verify only when applicable.
|
|
|
119
122
|
- [ ] **Step 2 — Inventory:** From previous report, list deferred PRs and why. Deferred major whose blocker cleared → first candidate. Select open PRs by head-ref prefix from updater config (`branchPrefix`, default `renovate/`; Dependabot `dependabot/`), never title or author. Token-authored PR on prefix = in scope; record author as evidence, not selector. Per PR: number, title, head ref, head SHA, mergeable, merge state, files, labels, commits behind integration branch, latest CI run (finished only; in-progress ≠ result). **Done when:** `Inventory` names prefix and config source, lists every open PR on prefix, or `none`.
|
|
120
123
|
- [ ] **Step 3 — Bot Health:** No dependency updater config = CRITICAL. Examples: Renovate (`.github/renovate.json` or `.github/renovate.json5`; rules example `.bkit/templates/.github/renovate.json5`, self-hosted runner example `.bkit/templates/.github/workflows/bkit-renovate.yml`) or Dependabot (`.github/dependabot.yml`; example `.bkit/templates/.github/dependabot.yml`). See `docs/deployments.md` § Dependency updaters. Both configs = finding; keep one. Bot dashboard: gather-only (bot rewrites). Record blocked entries and will-not-auto-rebase notices → stale until person acts. Bot reads presets from default branch, not integration. Fence / group on integration branch inactive until release carries it. Base-config edits on integration apply only if bot merges base-branch config — option read from default branch. PR proposes what integration config blocks → read default-branch copy before debugging rule; promotion-lag when branches differ = signal. Validate configs as default branch has them. Dashboard + logs: config errors, PRs held by concurrency / hourly limits, awaiting approval, open config-migration PRs. Broken config ≈ quiet week. **Done when:** `Bot Health` holds blocked PRs, config read branch, validator result, held / awaiting-approval items.
|
|
121
124
|
- [ ] **Step 4 — Supply Chain:** Read settings as default branch has them. Record each vs bot best-practice preset and package manager supply-chain page. Bot: minimum release age >= three days (e.g. Renovate `minimumReleaseAge` / `security:minimumReleaseAgeNpm` + `internalChecksFilter: "strict"`; Dependabot `cooldown`); actions / images digest-pinned; abandonment flagging (e.g. Renovate abandonments preset); config-migration PRs enabled, where bot offers them. Package manager, where offered (e.g. pnpm): trust policy no-downgrade, exotic subdeps blocked, explicit install-script allowlist, strict dependency builds; none offered → `N/A` with evidence. Release-age 0 on package manager = recorded trade-off where docs say so; re-deciding = person (`DECISION`). Gap: bot release age does not apply to lockfile-maintenance PRs (package manager makes changes; gate off → no cooldown) → batch with no cooldown; `Cooldown` stands in; `Screen` first. Missing / weaker setting → `Recommendations` row + line to add. **Done when:** `Supply Chain` row per setting: value · standard · verdict.
|
|
122
|
-
- [ ] **Step 5 — Cooldown:** Package-manager cooldown off or absent → lockfile-maintenance PRs: no automerge; same age wait as other updates before land. Bot opens no lockfile-maintenance PRs (e.g. Dependabot) → those checks `N/A`. Check: lockfile-maintenance block + matching rules → no automerge; each merged lockfile-maintenance since previous run waited >= bot release age (e.g. Renovate `minimumReleaseAge`; newest version publish → merge); open younger → EXCLUDED + eligible date. Same wait on other open non-security PRs: release-age check pending (e.g. `renovate/stability-days`) or newest version younger than bot release age → EXCLUDED + eligible date. Security PRs bypass (Step 13). Lockfile-maintenance automerged or landed before release age = finding. **Done when:** `Cooldown` holds automerge, each merged PR wait, each open PR eligible date.
|
|
123
|
-
- [ ] **Step 6 — Volume:** Each bot PR = lockfile rewrite + preview + CI; each rebase = another CI. Read on default branch; record what each setting would change; lines to add → project-owned bot config. Grouping: related packages one PR (`group:monorepos`, `group:allNonMajor`, or equivalent). List solo opens that should group + catching rule. Schedule: one window; note outside opens (non-security) + why. Limits: concurrent, hourly, branch-concurrent; record held-back PRs. Rebase policy: conflict-only rebases skip CI on every integration move; unset → record default + count rebase pushes since previous run. Lockfile PR conflicts with most dependency merges; lockfile maintenance own schedule, not every bot run. Automerge: low-risk groups passing CI via platform automerge; lockfile maintenance must not automerge while `Cooldown` off. Majors await dashboard approval; unset → major PR + CI before decision. Setting cutting PRs / CI → `Recommendations` + line + PRs saved this run. **Done when:** `Volume` row per setting: value · what it would change · PRs saved.
|
|
125
|
+
- [ ] **Step 5 — Cooldown:** Package-manager cooldown off or absent → lockfile-maintenance PRs: no automerge; same age wait as other updates before land. Bot opens no lockfile-maintenance PRs (e.g. Dependabot) → those checks `N/A`. Check: lockfile-maintenance block + matching rules → no automerge; each merged lockfile-maintenance since previous run waited >= bot release age (e.g. Renovate `minimumReleaseAge`; newest version publish → merge); open younger → EXCLUDED + eligible date. Automerge groups that rewrite the lockfile: bot release-age check ages named packages only → newest transitive version in the PR's lockfile diff vs bot release age; younger → EXCLUDED + eligible date; automerge with package-manager cooldown off = finding. Same wait on other open non-security PRs: release-age check pending (e.g. `renovate/stability-days`) or newest version younger than bot release age → EXCLUDED + eligible date. Security PRs bypass (Step 13). Lockfile-maintenance automerged or landed before release age = finding. **Done when:** `Cooldown` holds automerge, each merged PR wait, each open PR eligible date.
|
|
126
|
+
- [ ] **Step 6 — Volume:** Each bot PR = lockfile rewrite + preview + CI; each rebase = another CI. Read on default branch; record what each setting would change; lines to add → project-owned bot config. Grouping: related packages one PR (`group:monorepos`, `group:allNonMajor`, or equivalent). List solo opens that should group + catching rule. Schedule: one window; note outside opens (non-security) + why. Limits: concurrent, hourly, branch-concurrent; record held-back PRs. Rebase policy: conflict-only rebases skip CI on every integration move; unset → record default + count rebase pushes since previous run. Lockfile PR conflicts with most dependency merges; lockfile maintenance own schedule, not every bot run. Automerge: low-risk groups passing CI via platform automerge; lockfile maintenance must not automerge while `Cooldown` off. Majors await dashboard approval; unset → major PR + CI before decision. Scan scope: read bot's detected-file list (e.g. Renovate dashboard) for archived evidence, fixtures, test trees; repo-level ignore list replaces preset defaults (e.g. Renovate `ignorePaths` drops `:ignoreModulesAndTests`) → list paths + PRs touching only them. Setting cutting PRs / CI → `Recommendations` + line + PRs saved this run. **Done when:** `Volume` row per setting: value · what it would change · PRs saved.
|
|
124
127
|
- [ ] **Step 7 — Classify:** Every PR that is not green. Quote the evidence line from the log. When nothing matches, the class is C.
|
|
125
128
|
- **A — infrastructure:** preview-deploy wait timeout, registry fetch failure, a cold service refusing, a cancelled runner. Confirm: the same job passed on a neighbouring run or a retry of the same commit.
|
|
126
129
|
- **B — stale:** outdated lockfile, lockfile config mismatch, a merge conflict, merge state dirty, behind the integration branch. Confirm: behind-count. Being behind says nothing about the dependency itself.
|
|
127
130
|
- **C — real:** the failure survives a clean rebase onto the integration branch. Confirm: reproduce it on the batch worktree. Only C keeps a PR out of the batch.
|
|
131
|
+
- **C, copy parity:** a test requires two copies of a file to stay identical and the bot updates only the copy it scans (other copy on an ignored path). Fails by design; fix = mirror the change into the other copy. Count recurrence in Step 16.
|
|
128
132
|
|
|
129
133
|
Batch = green + A + B past bot release age. C → EXCLUDED → `Excluded`. Breaking major → DECISION even if IN BATCH. Non-security inside release age → EXCLUDED even if IN BATCH (Step 5). **Done when:** `Classes` row per non-green PR: class · behind-count · quoted evidence · verdict.
|
|
130
134
|
|
|
@@ -133,7 +137,7 @@ Verify only when applicable.
|
|
|
133
137
|
- [ ] **Step 10 — Verify:** `git status --porcelain` empty first (trap (1) in dirty tree). Frozen install → static / unit / integration gate → local E2E per app (store build vs deployed env tests none of batch — use local-build substrate). Beyond green typecheck: framework dependency doctor, where the framework ships one (e.g. `expo-doctor`; SDK-out-of-range packages compile/typecheck then break native/app); single-version check for runtime packages in `Project Instructions` (two versions = trap (3) — report + one version everywhere). Red may be stale install — clear installed deps (e.g. `node_modules`, `.venv`, `target/`), frozen install, re-run before blaming bump. Red check → drop suspect PR, rebuild batch, re-run; no single PR explains → FAIL. **Done when:** `Verification` quotes every command and exit code; `Summary` has PASS, CONCERNS, or FAIL.
|
|
134
138
|
- [ ] **Step 11 — Plan:** Report asks and stops — no push, merge, close, label. Direct-push integration branch → batch lands without feature-branch PR. Deployed-boundary checks on push only → landing push = batch meets external services. Never merge bot PRs one-by-one: N sequential → N integration runs + rebase per open PR after each; N one push → one integration run. `Plan` table columns: `Wave`, `PRs`, `Commits`, `Why together, or why apart`, `Pushes`, `CI runs`. Rules: (1) Default one wave — all IN BATCH in one push; commit series (not squash): non-major groups, then one commit per major each with install matching manifests; each commit revert/bisect point; CI once on push head — `Verify` head; earlier commits → frozen install + typecheck. (2) Second wave only for named reason — bisectability not enough; reason = production watch before next land (SDK / framework / native major, store build/submission, DB-client major); extra wave = +push, +integration run, rebase on open PRs — cost in row. (3) Order: security → non-majors → majors; within majors dependency before dependents (language before linter; UI lib + types together). (4) Unmerged automerge group → batch; self-merge first = separate push + rebases — fold in and close at push; merged pre-landing → rebase batch, drop from plan. (5) Close carried PRs right after push with `Excluded` comment → landing commit; bot auto-close next run only — until then may rebase + CI. (6) Land after bot weekly window, no mid-landing opens/rebases, no queued integration push. (7) List excluded/deferred PRs landing will rebase + CI cost; multi-cycle exclude → rebase each later push — recommend close + dashboard when wanted. (8) No skip-CI on dependency change; required checks test batch. Then ordered landing commands: push, close PRs + comments, labels for open. Cost one-by-one vs batch + CI already spent on branch PRs. Post-land watch: error-tracker release, error-rate / crash-free revert thresholds commit-by-commit — do not invent thresholds. **Done when:** `Plan` holds table, commands, both costs, watch.
|
|
135
139
|
- [ ] **Step 12 — Excluded:** Report lists only — no label, comment, close. C-class + blocked stay open. Report supplies comment text (break + fix) and labels (deferred; major label on major). Comments start with marker in `Project Instructions`; next step finds marker and edits existing comment. Batch-carried PRs → close after land with batch pointer. Breaking major / migration = DECISION → `Recommendations`; real work → issue to open. DECISION evidence (not bare PR): migration guide, breaking changes vs codebase + hit counts, codemods, peer-dep matrix, rollback path. **Done when:** `Excluded` row per out-of-batch PR: verdict · labels · comment text or DECISION evidence.
|
|
136
|
-
- [ ] **Step 13 — Unseen:** Bot-blind surfaces. (a) New advisories vs committed baseline — delta script: not in baseline + stale entries; batch fix → remove baseline entry same commit. Security PRs bypass release-age — confirm landing not queued; same as `bkit-audit-security`, do not duplicate. (b) Second vuln source — scanner on lockfile, language requirements, shipped images + host alerts; lockfile scanners reading first doc only → empty without fail — confirm full read. Classify each advisory shipped, server-only, or dev-only, and say whether the vulnerable function is reachable. Destination for an advisory: `bkit-audit-security`. (c) Fix latency — shipped deps: publication → integration land; CRITICAL ≤7d, HIGH ≤30d; breach = finding, list first. (d) Container installing from bot-bumped manifest covered; second install line bypassing manifest = gap, back. (e) Unused deps → `bkit-audit-dead-code`; unmaintained (no release >1y or archived) on new deps since last pass → `Recommendations`. (f) Deprecated / abandoned whole tree — dashboard abandoned + frozen-install warnings. (g) Licences — new deps since last pass; copyleft (GPL, AGPL) or missing in shipped → `Recommendations`. Production tree licence diff vs previous (BSL, SSPL, commercial upgrades too). Shipped app notices regenerated on dep change; bundled fonts/icons/images — licence + ship terms. **Done when:** `Unseen` holds advisories, latency, container install path, deprecated packages, licence diffs.
|
|
140
|
+
- [ ] **Step 13 — Unseen:** Bot-blind surfaces. (a) New advisories vs committed baseline — delta script: not in baseline + stale entries; batch fix → remove baseline entry same commit. Security PRs bypass release-age — confirm landing not queued; same as `bkit-audit-security`, do not duplicate. (b) Second vuln source — scanner on lockfile, language requirements, shipped images + host alerts; lockfile scanners reading first doc only → empty without fail — confirm full read. Classify each advisory shipped, server-only, or dev-only, and say whether the vulnerable function is reachable. Destination for an advisory: `bkit-audit-security`. (c) Fix latency — shipped deps: publication → integration land; CRITICAL ≤7d, HIGH ≤30d; breach = finding, list first. (d) Container installing from bot-bumped manifest covered; second install line bypassing manifest = gap, back. (e) Unused deps → `bkit-audit-dead-code`; unmaintained (no release >1y or archived) on new deps since last pass → `Recommendations`. (f) Deprecated / abandoned whole tree — dashboard abandoned + frozen-install warnings. (g) Licences — new deps since last pass; copyleft (GPL, AGPL) or missing in shipped → `Recommendations`. Production tree licence diff vs previous (BSL, SSPL, commercial upgrades too). Shipped app notices regenerated on dep change; bundled fonts/icons/images — licence + ship terms. (h) Off-manifest CLIs — bot reads manifests only. Sources: CI `run:` (global installs, `npx` / `pnpm dlx`, `curl | sh`, system packages), setup-action version inputs (e.g. `supabase/setup-cli` `version:`), build-service CLI pin (e.g. `eas.json` `cli.version`), Dockerfiles, build images, version files (e.g. `.tool-versions`), repo scripts, global-install setup docs. Per CLI: location · pin or `floating` (unpinned, `latest`, open range) · latest release, read live · majors behind · bot-watched (manifest entry or bot rule, e.g. Renovate `customManagers`) yes / no. Floating in CI / build image = finding (unreviewed version each run, bypasses release age). Major behind = finding; end of life → Step 14. Unwatched → `Recommendations`: move into manifest or add bot rule. **Done when:** `Unseen` holds advisories, latency, container install path, deprecated packages, licence diffs, row per off-manifest CLI.
|
|
137
141
|
- [ ] **Step 14 — End of Life:** Compare versions in use with the end-of-life catalogue and each vendor's support policy. Record days left for the runtime, the framework, the native SDK, the package manager, the language, the database major, and container base images the project ships (sources in `Project Instructions`). An end of life inside 90 days is DECISION, and the report names the issue to open. **Done when:** `End of Life` row per runtime: version · days left · verdict.
|
|
138
142
|
- [ ] **Step 15 — Standards:** Confirm current version per anchor standard; read changes since previous report's version. `Standards Coverage`: one row per bot preset, package-manager supply-chain setting, and Concise Guide rule → checked (name step) / not applicable (why) / finding. Unapplied recommended practice → adopt (propose step) / reject (why) / not applicable. **Done when:** no empty row.
|
|
139
143
|
- [ ] **Step 16 — Anything Else:** (a) Since previous report commit — dependency-touching changes (manifests, workspace file, bot configs, workflow `uses:`, Dockerfiles, requirements, runtime-version files, build-image, hosting runtime) → one-line verdict each. (b) ~30 min bounded pass — senior supply-chain gaps no step covers; since previous run: incidents, new `docs/failures.jsonl`, `bkit-audit-logs` reports, vendor status — what no step catches? **Done when:** `Beyond the Steps` holds both passes, or `none`. Class seen on 2 runs → propose step in `Process Improvements`.
|
|
@@ -155,8 +159,8 @@ Verify only when applicable.
|
|
|
155
159
|
| --- | --- |
|
|
156
160
|
| `CRITICAL` | No dependency updater config; shipped dependency with a known-bad install script or a publisher change the trust policy should have refused; lockfile entry with no integrity hash, or a tarball off the configured registry; CRITICAL advisory in a shipped dependency older than 7 days |
|
|
157
161
|
| `HIGH` | HIGH advisory in a shipped dependency older than 30 days; lockfile-maintenance update that automerged or landed inside the release-age window; copyleft or missing licence on a shipped dependency |
|
|
158
|
-
| `MEDIUM` | Updater config that
|
|
159
|
-
| `LOW` | Bot stopped rebasing a PR; grouping miss with no failure; shipped licence notice not regenerated |
|
|
162
|
+
| `MEDIUM` | Updater config that scans bkit-owned trees (`.bkit/templates/**`, `.agents/skills/**`); supply-chain setting missing or weaker than the standard; setting that multiplies PR or CI runs; unmaintained or deprecated shipped dependency; end of life inside 90 days; two versions of one runtime package; off-manifest CLI floating in CI / build image, or a major behind |
|
|
163
|
+
| `LOW` | Bot stopped rebasing a PR; grouping miss with no failure; shipped licence notice not regenerated; unwatched off-manifest CLI |
|
|
160
164
|
|
|
161
165
|
Scale per `.bkit/jsonl.md` § Severity. Within a severity: shipped exposure first.
|
|
162
166
|
|
|
@@ -249,6 +253,13 @@ PENDING
|
|
|
249
253
|
|
|
250
254
|
PENDING
|
|
251
255
|
|
|
256
|
+
### Suggested Issues
|
|
257
|
+
|
|
258
|
+
<!-- prettier-ignore -->
|
|
259
|
+
| # | Title | Findings | Severity | Next Step | Reason |
|
|
260
|
+
| --- | --- | --- | --- | --- | --- |
|
|
261
|
+
| PENDING | PENDING | PENDING | PENDING | PENDING | PENDING |
|
|
262
|
+
|
|
252
263
|
### Process Improvements
|
|
253
264
|
|
|
254
265
|
PENDING
|
|
@@ -262,6 +273,7 @@ PENDING
|
|
|
262
273
|
- [ ] **Series:** security-fix latency and end-of-life days beside previous report's numbers, or marked baseline.
|
|
263
274
|
- [ ] **Writes:** only this report and template `Project Instructions` changed; throwaway worktrees / remote targets removed.
|
|
264
275
|
- [ ] **Process Improvements:** `Universal` = proposed step changes, template untouched; `Project` = edits applied below `bkit:end`; each `none` if empty.
|
|
276
|
+
- [ ] **Suggested Issues:** every `MEDIUM`+ finding ID in exactly one row; every row has a `Next Step`.
|
|
265
277
|
- [ ] **Gate 3 - Verified:** Every checkbox above independently verified and checked off.
|
|
266
278
|
|
|
267
279
|
> `Project Instructions` below `bkit:end` are consumer-owned — `bkit install` never overwrites them, `bkit check` drift stays clean. Add project-specific tools, paths, commands, and checks there, keyed by section or step title; never results.
|