@cbartens/bkit 5.5.0 → 6.0.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.bkit/README.md +30 -20
- package/.bkit/core/.agents/docs.md +1 -0
- package/.bkit/core/.agents/rules.md +51 -26
- package/.bkit/core/.bkit/README.md +29 -19
- package/.bkit/core/.bkit/authoring.md +117 -0
- package/.bkit/core/.bkit/cloud.md +11 -11
- package/.bkit/core/.bkit/comparison.md +5 -5
- package/.bkit/core/.bkit/install.md +20 -20
- package/.bkit/core/.bkit/jsonl.md +202 -122
- package/.bkit/core/.bkit/lite.md +1 -1
- package/.bkit/core/.bkit/pipeline.md +49 -52
- package/.bkit/core/.bkit/prompts.md +106 -167
- package/.bkit/core/.bkit/providers.md +29 -32
- package/.bkit/core/.bkit/templates.md +44 -18
- package/.bkit/core/.bkit/trackers.md +60 -28
- package/.bkit/core/.bkit/workflows.md +399 -359
- package/.bkit/core/AGENTS.md +16 -22
- package/.bkit/core/docs/templates/bkit-audit-accessibility.md +14 -38
- package/.bkit/core/docs/templates/bkit-audit-adoption.md +16 -40
- package/.bkit/core/docs/templates/bkit-audit-agents.md +19 -43
- package/.bkit/core/docs/templates/bkit-audit-aio-seo.md +16 -40
- package/.bkit/core/docs/templates/bkit-audit-analytics.md +14 -38
- package/.bkit/core/docs/templates/bkit-audit-annotations.md +11 -35
- package/.bkit/core/docs/templates/bkit-audit-app-performance.md +15 -39
- package/.bkit/core/docs/templates/bkit-audit-app-store.md +12 -36
- package/.bkit/core/docs/templates/bkit-audit-architecture.md +16 -40
- package/.bkit/core/docs/templates/bkit-audit-ci-performance.md +16 -40
- package/.bkit/core/docs/templates/bkit-audit-config.md +18 -42
- package/.bkit/core/docs/templates/bkit-audit-cost.md +16 -40
- package/.bkit/core/docs/templates/bkit-audit-coverage.md +15 -39
- package/.bkit/core/docs/templates/bkit-audit-database.md +16 -40
- package/.bkit/core/docs/templates/bkit-audit-dead-code.md +15 -39
- package/.bkit/core/docs/templates/bkit-audit-deferrals.md +15 -38
- package/.bkit/core/docs/templates/bkit-audit-dependencies.md +16 -40
- package/.bkit/core/docs/templates/bkit-audit-documentation.md +11 -35
- package/.bkit/core/docs/templates/bkit-audit-duplication.md +18 -42
- package/.bkit/core/docs/templates/bkit-audit-failures.md +13 -37
- package/.bkit/core/docs/templates/bkit-audit-flakes.md +12 -36
- package/.bkit/core/docs/templates/bkit-audit-gates.md +14 -38
- package/.bkit/core/docs/templates/bkit-audit-issues.md +15 -39
- package/.bkit/core/docs/templates/bkit-audit-llm.md +16 -40
- package/.bkit/core/docs/templates/bkit-audit-logs.md +14 -38
- package/.bkit/core/docs/templates/bkit-audit-models.md +12 -36
- package/.bkit/core/docs/templates/bkit-audit-privacy.md +12 -36
- package/.bkit/core/docs/templates/bkit-audit-prompts.md +15 -39
- package/.bkit/core/docs/templates/bkit-audit-red-team.md +15 -39
- package/.bkit/core/docs/templates/bkit-audit-reliability.md +15 -39
- package/.bkit/core/docs/templates/bkit-audit-repo.md +12 -36
- package/.bkit/core/docs/templates/bkit-audit-security.md +13 -37
- package/.bkit/core/docs/templates/bkit-audit-slop.md +14 -38
- package/.bkit/core/docs/templates/bkit-audit-testing.md +12 -36
- package/.bkit/core/docs/templates/bkit-audit-usability.md +16 -40
- package/.bkit/core/docs/templates/bkit-plan.md +97 -226
- package/.bkit/core/engine/checks/after/ci-yml.ts +39 -30
- package/.bkit/core/engine/checks/after/github.ts +101 -72
- package/.bkit/core/engine/checks/after/index.ts +10 -12
- package/.bkit/core/engine/checks/after/suppression.ts +8 -5
- package/.bkit/core/engine/checks/after/tools.ts +47 -92
- package/.bkit/core/engine/checks/before/env.ts +2 -2
- package/.bkit/core/engine/checks/before/files.ts +5 -4
- package/.bkit/core/engine/checks/before/index.ts +18 -1
- package/.bkit/core/engine/checks/before/repo.ts +168 -2
- package/.bkit/core/engine/checks/tips/catalogue.ts +16 -5
- package/.bkit/core/engine/checks/tips/detect.ts +34 -0
- package/.bkit/core/engine/checks/tips/index.ts +10 -7
- package/.bkit/core/engine/cli.ts +20 -53
- package/.bkit/core/engine/commands/analysis.ts +171 -140
- package/.bkit/core/engine/commands/ci/ci.ts +6 -6
- package/.bkit/core/engine/commands/comply.ts +77 -103
- package/.bkit/core/engine/commands/install/doctor.ts +2 -2
- package/.bkit/core/engine/commands/install/install.ts +57 -18
- package/.bkit/core/engine/commands/install/uninstall.ts +65 -28
- package/.bkit/core/engine/commands/land.ts +18 -12
- package/.bkit/core/engine/commands/lib.ts +79 -17
- package/.bkit/core/engine/commands/registry.ts +4 -0
- package/.bkit/core/engine/commands/setup/setup.ts +7 -7
- package/.bkit/core/engine/commands/stats.ts +204 -0
- package/.bkit/core/engine/commands/tips.ts +10 -5
- package/.bkit/core/engine/commands/workflow/branches.ts +741 -62
- package/.bkit/core/engine/commands/workflow/challenge.ts +673 -0
- package/.bkit/core/engine/commands/workflow/context.ts +853 -29
- package/.bkit/core/engine/commands/workflow/counters.ts +267 -84
- package/.bkit/core/engine/commands/workflow/decisions.ts +541 -0
- package/.bkit/core/engine/commands/workflow/disk.ts +2 -2
- package/.bkit/core/engine/commands/workflow/fids.ts +793 -33
- package/.bkit/core/engine/commands/workflow/issues.ts +427 -105
- package/.bkit/core/engine/commands/workflow/ledgers.ts +884 -27
- package/.bkit/core/engine/commands/workflow/locks.ts +26 -2
- package/.bkit/core/engine/commands/workflow/plan-blocks.ts +582 -0
- package/.bkit/core/engine/commands/workflow/plan-versions.ts +21 -0
- package/.bkit/core/engine/commands/workflow/prs.ts +166 -30
- package/.bkit/core/engine/commands/workflow/repo.ts +59 -7
- package/.bkit/core/engine/commands/workflow/roadmap.ts +16 -7
- package/.bkit/core/engine/commands/workflow/run-facts.ts +501 -0
- package/.bkit/core/engine/commands/workflow/runs.ts +179 -49
- package/.bkit/core/engine/commands/workflow/runtime.ts +22 -1
- package/.bkit/core/engine/commands/workflow/status.ts +142 -29
- package/.bkit/core/engine/commands/workflow/step-table.ts +339 -0
- package/.bkit/core/engine/commands/workflow/steps.ts +213 -88
- package/.bkit/core/engine/commands/workflow/summary.ts +398 -0
- package/.bkit/core/engine/commands/workflow/tests.ts +1013 -148
- package/.bkit/core/engine/commands/workflow/tracker.ts +1195 -0
- package/.bkit/core/engine/commands/workflow/workflows.ts +984 -207
- package/.bkit/core/engine/commands/workflow/workstreams.ts +11 -5
- package/.bkit/core/engine/commands/workflow/worktrees.ts +276 -22
- package/.bkit/core/engine/install/manifest.ts +11 -9
- package/.bkit/core/engine/install/modules/cloud.ts +21 -13
- package/.bkit/core/engine/install/modules/core.ts +325 -7
- package/.bkit/core/engine/install/modules/opencode.ts +2 -2
- package/.bkit/core/engine/install/version-file.ts +6 -2
- package/.bkit/core/engine/ledgers/migrate.ts +92 -0
- package/.bkit/core/engine/ledgers/status.ts +92 -15
- package/.bkit/core/engine/ledgers/telemetry.ts +1261 -254
- package/.bkit/core/engine/render/hosts.ts +4 -0
- package/.bkit/core/engine/render/models.ts +12 -0
- package/.bkit/core/engine/shared/branches.ts +4 -1
- package/.bkit/core/engine/shared/egress.ts +7 -0
- package/.bkit/core/engine/shared/json.ts +25 -7
- package/.bkit/core/engine/shared/settings.ts +202 -33
- package/.bkit/core/engine/shared/text.ts +361 -0
- package/.bkit/core/engine/tools/grammar-density.ts +215 -0
- package/.bkit/core/engine/tools/instructions-sources.ts +834 -0
- package/.bkit/core/engine/tools/instructions.ts +1751 -0
- package/.bkit/core/hooks/gateguard-engine.js +24 -23
- package/.bkit/core/hooks/guardrails-shell.js +2 -3
- package/.bkit/core/hooks/guardrails-tiers.js +7 -1
- package/.bkit/core/hooks/readguard-engine.js +2 -2
- package/.bkit/core/prompts/bkit-audit-generate.md +62 -25
- package/.bkit/core/prompts/bkit-build-challenge-1.md +40 -17
- package/.bkit/core/prompts/bkit-build-challenge-2.md +44 -17
- package/.bkit/core/prompts/bkit-build-install-skills.md +26 -13
- package/.bkit/core/prompts/bkit-build-plan-convert.md +74 -0
- package/.bkit/core/prompts/bkit-build-plan-current.md +26 -13
- package/.bkit/core/prompts/bkit-build-plan-execute.md +74 -26
- package/.bkit/core/prompts/bkit-build-plan-gaps-remediate.md +64 -23
- package/.bkit/core/prompts/bkit-build-plan-verify.md +57 -33
- package/.bkit/core/prompts/bkit-debug-abort-handover.md +30 -14
- package/.bkit/core/prompts/bkit-debug-failure-diagnose.md +34 -14
- package/.bkit/core/prompts/bkit-debug-failure-remediate.md +34 -17
- package/.bkit/core/prompts/bkit-debug-failure-reproduce.md +26 -13
- package/.bkit/core/prompts/bkit-debug-failure-soak.md +31 -16
- package/.bkit/core/prompts/bkit-design-brainstorm-ideate-1.md +21 -11
- package/.bkit/core/prompts/bkit-design-brainstorm-ideate-2.md +20 -11
- package/.bkit/core/prompts/bkit-design-brainstorm-ideate-3.md +20 -11
- package/.bkit/core/prompts/bkit-design-generate.md +33 -13
- package/.bkit/core/prompts/bkit-design-organise.md +25 -12
- package/.bkit/core/prompts/bkit-design-review-1.md +31 -15
- package/.bkit/core/prompts/bkit-design-review-2.md +28 -13
- package/.bkit/core/prompts/bkit-design-spike.md +30 -13
- package/.bkit/core/prompts/bkit-design-update.md +33 -19
- package/.bkit/core/prompts/bkit-plan-generate.md +75 -19
- package/.bkit/core/prompts/bkit-plan-review-1.md +50 -27
- package/.bkit/core/prompts/bkit-plan-review-2.md +59 -28
- package/.bkit/core/prompts/bkit-plan-scope-check.md +109 -0
- package/.bkit/core/prompts/bkit-plan-update.md +61 -24
- package/.bkit/core/prompts/bkit-ship-conflict-resolve.md +27 -15
- package/.bkit/core/prompts/bkit-ship-deferred-sweep.md +31 -16
- package/.bkit/core/prompts/bkit-ship-update-docs.md +30 -15
- package/.bkit/core/prompts/bkit-utility-compress-markdown.md +24 -14
- package/.bkit/core/prompts/bkit-utility-update-decisions.md +32 -14
- package/.bkit/core/prompts/bkit-utility-update-deferrals.md +29 -14
- package/.bkit/core/prompts/bkit-utility-update-documentation.md +28 -13
- package/.bkit/core/prompts/bkit-utility-update-failures.md +31 -14
- package/.bkit/core/prompts/bkit-utility-update-knowledge.md +33 -14
- package/.bkit/core/prompts/bkit-utility-update-roadmap.md +38 -17
- package/.bkit/core/prompts/bkit-utility-update-tracker.md +43 -20
- package/.bkit/core/workflows/bkit-auto.md +54 -46
- package/.bkit/core/workflows/bkit-build.md +577 -458
- package/.bkit/core/workflows/bkit-debug.md +348 -333
- package/.bkit/core/workflows/bkit-design.md +201 -237
- package/.bkit/core/workflows/bkit-plan.md +210 -321
- package/.bkit/core/workflows/bkit-ship.md +328 -278
- package/.bkit/shared/.bkit/.env.example +2 -2
- package/.bkit/shared/.claude/settings.json +11 -0
- package/.bkit/shared/.cursor/mcp.json +1 -1
- package/.bkit/shared/.cursor/rules/bkit-rules.mdc +1 -1
- package/.bkit/shared/.gitattributes +1 -1
- package/.bkit/shared/.mcp.json +1 -1
- package/.bkit/shared/.opencode/opencode.json +11 -0
- package/.bkit/shared/CLAUDE.md +2 -2
- package/.bkit/shared/GEMINI.md +2 -2
- package/.bkit/shared/docs/architecture.md +1 -1
- package/.bkit/shared/docs/data-schema.md +1 -1
- package/.bkit/shared/docs/deployments.md +16 -28
- package/.bkit/shared/docs/design.md +1 -1
- package/.bkit/shared/docs/noise.md +1 -1
- package/.bkit/shared/docs/observability.md +2 -2
- package/.bkit/shared/docs/security.md +1 -1
- package/.bkit/shared/docs/setup.md +1 -1
- package/.bkit/shared/docs/technology.md +1 -1
- package/.bkit/shared/docs/testing.md +27 -10
- package/.bkit/templates/.claude/hooks/bkit-cloud-bootstrap.sh +1 -1
- package/.bkit/templates/.github/ISSUE_TEMPLATE/bkit-change.yml +26 -5
- package/.bkit/templates/.github/workflows/bkit-ci.yml +22 -84
- package/.bkit/templates/.github/workflows/bkit-cloud.yml +21 -19
- package/.bkit/templates/.husky/pre-push +52 -13
- package/.bkit/templates/.prettierignore +7 -0
- package/.bkit/templates/scripts/ci/bkit-local-stack-lock.sh +194 -0
- package/.bkit/templates/scripts/ci/check-capstone.mjs +2 -4
- package/.bkit/templates/scripts/ci/check-capstone.test.mjs +4 -23
- package/.bkit/templates/scripts/ci/lanes/resolve-push-base.mjs +104 -23
- package/.bkit/templates/scripts/ci/lanes/resolve-push-base.test.mjs +103 -6
- package/.bkit/templates/scripts/cleanup/bkit-disk-prune.mjs +1 -1
- package/.bkit/templates/scripts/graphify/bkit-graph-pre-push.sh +3 -1
- package/.bkit/templates/scripts/prettier/bkit-insert-ignore.mjs +49 -29
- package/CHANGELOG.md +142 -0
- package/README.md +58 -34
- package/dist/checks/after/ci-yml.js +39 -29
- package/dist/checks/after/github.js +99 -72
- package/dist/checks/after/index.js +11 -13
- package/dist/checks/after/suppression.js +8 -5
- package/dist/checks/after/tools.js +40 -83
- package/dist/checks/before/env.js +2 -2
- package/dist/checks/before/files.js +5 -3
- package/dist/checks/before/index.js +15 -2
- package/dist/checks/before/repo.js +163 -2
- package/dist/checks/tips/catalogue.js +14 -5
- package/dist/checks/tips/detect.js +32 -0
- package/dist/checks/tips/index.js +7 -5
- package/dist/cli.js +19 -47
- package/dist/commands/analysis.js +109 -100
- package/dist/commands/ci/ci.js +6 -6
- package/dist/commands/comply.js +54 -91
- package/dist/commands/install/doctor.js +2 -2
- package/dist/commands/install/install.js +50 -19
- package/dist/commands/install/uninstall.js +59 -28
- package/dist/commands/land.js +16 -12
- package/dist/commands/lib.js +51 -16
- package/dist/commands/registry.js +4 -0
- package/dist/commands/setup/setup.js +7 -7
- package/dist/commands/stats.js +136 -0
- package/dist/commands/tips.js +7 -3
- package/dist/commands/workflow/branches.js +656 -56
- package/dist/commands/workflow/challenge.js +556 -0
- package/dist/commands/workflow/context.js +709 -30
- package/dist/commands/workflow/counters.js +208 -75
- package/dist/commands/workflow/decisions.js +441 -0
- package/dist/commands/workflow/disk.js +2 -2
- package/dist/commands/workflow/fids.js +689 -33
- package/dist/commands/workflow/issues.js +362 -99
- package/dist/commands/workflow/ledgers.js +762 -27
- package/dist/commands/workflow/locks.js +24 -2
- package/dist/commands/workflow/plan-blocks.js +437 -0
- package/dist/commands/workflow/plan-versions.js +22 -0
- package/dist/commands/workflow/prs.js +142 -32
- package/dist/commands/workflow/repo.js +52 -7
- package/dist/commands/workflow/roadmap.js +9 -7
- package/dist/commands/workflow/run-facts.js +426 -0
- package/dist/commands/workflow/runs.js +144 -43
- package/dist/commands/workflow/runtime.js +12 -1
- package/dist/commands/workflow/status.js +130 -29
- package/dist/commands/workflow/step-table.js +276 -0
- package/dist/commands/workflow/steps.js +171 -80
- package/dist/commands/workflow/summary.js +275 -0
- package/dist/commands/workflow/tests.js +834 -136
- package/dist/commands/workflow/tracker.js +983 -0
- package/dist/commands/workflow/workflows.js +834 -195
- package/dist/commands/workflow/workstreams.js +11 -5
- package/dist/commands/workflow/worktrees.js +221 -22
- package/dist/install/manifest.js +11 -9
- package/dist/install/modules/cloud.js +22 -13
- package/dist/install/modules/core.js +326 -7
- package/dist/install/modules/opencode.js +2 -2
- package/dist/install/version-file.js +6 -2
- package/dist/ledgers/migrate.js +81 -0
- package/dist/ledgers/status.js +61 -8
- package/dist/ledgers/telemetry.js +905 -124
- package/dist/render/hosts.js +4 -0
- package/dist/render/models.js +12 -0
- package/dist/shared/branches.js +3 -1
- package/dist/shared/egress.js +7 -0
- package/dist/shared/json.js +20 -7
- package/dist/shared/settings.js +147 -26
- package/dist/shared/text.js +333 -0
- package/dist/tools/grammar-density.js +183 -0
- package/dist/tools/instructions-sources.js +721 -0
- package/dist/tools/instructions.js +1579 -0
- package/package.json +114 -23
- package/.bkit/core/engine/commands/harvest.ts +0 -459
- package/.bkit/core/engine/tools/wording.ts +0 -748
- package/.bkit/core/prompts/bkit-build-challenge-reconcile.md +0 -69
- package/.bkit/core/prompts/bkit-build-challenge-remediate.md +0 -71
- package/.bkit/core/prompts/bkit-build-challenge-tests.md +0 -74
- package/.bkit/core/prompts/bkit-build-summary.md +0 -94
- package/.bkit/core/prompts/bkit-debug-summary.md +0 -96
- package/.bkit/core/prompts/bkit-design-summary.md +0 -107
- package/.bkit/core/prompts/bkit-plan-complexity-check.md +0 -67
- package/.bkit/core/prompts/bkit-plan-complexity-split.md +0 -88
- package/.bkit/core/prompts/bkit-plan-review-3.md +0 -93
- package/.bkit/core/prompts/bkit-plan-scope-check-1.md +0 -85
- package/.bkit/core/prompts/bkit-plan-scope-check-2.md +0 -85
- package/.bkit/core/prompts/bkit-plan-summary.md +0 -107
- package/.bkit/core/prompts/bkit-ship-summary.md +0 -78
- package/.bkit/templates/scripts/ci/lanes/check-tree-cache.mjs +0 -138
- package/.bkit/templates/scripts/ci/lanes/check-tree-cache.test.mjs +0 -181
- package/dist/commands/harvest.js +0 -353
- package/dist/tools/wording.js +0 -680
|
@@ -11,14 +11,6 @@
|
|
|
11
11
|
>
|
|
12
12
|
> **Rules:**
|
|
13
13
|
>
|
|
14
|
-
> - Read-only audit; never edit code, config, or data.
|
|
15
|
-
> - `Universal Instructions` apply to all projects; `Project Instructions` apply only to this project.
|
|
16
|
-
> - Local audit instructions / overrides → `Project Instructions` below the bkit-managed block; universal instructions stay in-block.
|
|
17
|
-
> - Any tools mentioned in `Universal Instructions` are examples only; swap for actual tools in final output; drop inapplicable.
|
|
18
|
-
> - Use dense token-efficient phrasing; no filler / hedging / restating; tables > prose, bullets > paragraphs.
|
|
19
|
-
> - Read `.agents/docs.md` → load docs for workflow / step / task; skip missing; cite docs inline where required.
|
|
20
|
-
> - Every claim cites this run's evidence (`file:line`, or command / query and its output) and tool behind it; a previous report's figure, list, or status is a lead, not evidence.
|
|
21
|
-
> - Read this document once at session start; do not trust session memory; do not re-read on every loop iteration.
|
|
22
14
|
> - never change search-console, webmaster, robots, sitemap, IndexNow, or firewall settings; record the owner's decision.
|
|
23
15
|
> - Name a personal-data field and its page for `bkit-audit-privacy`; never copy a personal-data value into the report.
|
|
24
16
|
|
|
@@ -34,7 +26,7 @@
|
|
|
34
26
|
|
|
35
27
|
**Cadence:** quarterly. Extra pass when routing, locales, or the public site change.
|
|
36
28
|
|
|
37
|
-
**Anchor Standards:**
|
|
29
|
+
**Anchor Standards:**
|
|
38
30
|
|
|
39
31
|
- Search essentials and the search-documentation updates log (e.g. Google Search Essentials, Bing Webmaster Guidelines); record the date of the newest entry read.
|
|
40
32
|
- The engine's AI-features and generative-AI optimisation guides (e.g. Google's AI features and your website); record each page's last-updated date.
|
|
@@ -69,22 +61,14 @@
|
|
|
69
61
|
|
|
70
62
|
### Pre-Flight / Dependencies
|
|
71
63
|
|
|
72
|
-
**Checkpoint:** Check off all core items. Check conditional items only when applicable. Each item: available → tool and version; missing → fallback, gap in `Not Checked`, fix in `Process Improvements`. Unnamed gap reads as passed. never abort for a missing capability.
|
|
73
|
-
|
|
74
|
-
**Credentials:** probe direnv before marking a token / env var missing: `direnv exec . sh -c '[ -n "${VAR}" ] && echo set || echo unset'`; `unset` = missing. Run credentialed CLIs as `direnv exec . <cmd>`. No direnv (cloud session) → plain env check. Report names, never values.
|
|
75
|
-
|
|
76
64
|
#### Core
|
|
77
65
|
|
|
78
|
-
|
|
79
|
-
|
|
80
|
-
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied (here or in any step) → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`; run every step the remaining tools allow; work needing blocked call → `Not Checked`. never stop the run for a blocked call; never retry or reword a blocked call to get past it.
|
|
81
|
-
- [ ] **Live Fetch:** Steps 2–9 — request public URLs, headers, and HTML, e.g. `curl`, a browser. Fallback: source read; live claims = hypotheses.
|
|
66
|
+
- [ ] **Permissions:** blocked calls recorded
|
|
67
|
+
- [ ] **Live Fetch:** Steps 2-9 — request public URLs, headers, and HTML, e.g. `curl`, a browser. Fallback: source read; live claims = hypotheses.
|
|
82
68
|
- [ ] **Web:** Step 10 — fetch anchor standards. Fallback: versions recorded as unread.
|
|
83
69
|
|
|
84
70
|
#### Conditional
|
|
85
71
|
|
|
86
|
-
Verify only when applicable.
|
|
87
|
-
|
|
88
72
|
- [ ] **Search Consoles:** Indexable public pages → Step 9 — e.g. Google Search Console, Bing Webmaster Tools. Fallback: none; consoles missing while indexable pages exist = finding.
|
|
89
73
|
- [ ] **Edge Logs:** Bot firewall or CDN → Step 6 — crawler status codes, e.g. Vercel Firewall, Cloudflare. Fallback: `robots.txt` only; log rows `Not Checked`.
|
|
90
74
|
- [ ] **Schema Validators:** Structured data present → Step 5 — rich-results test and a schema.org validator, e.g. Google Rich Results Test, Schema Markup Validator. Fallback: read required properties from the engine's docs.
|
|
@@ -92,22 +76,20 @@ Verify only when applicable.
|
|
|
92
76
|
|
|
93
77
|
### 🔒 Gate 1: Prerequisites Check
|
|
94
78
|
|
|
95
|
-
**Checkpoint.** Verify and check `[x]` all applicable boxes above, then continue to `Probe Steps` without asking.
|
|
96
|
-
|
|
97
79
|
- [ ] **Gaps named:** every missing item names its fallback and `Not Checked` entry.
|
|
98
|
-
- [ ] **Gate 1
|
|
80
|
+
- [ ] **Gate 1 — Verified:** All Core items checked. All applicable Conditional items checked.
|
|
99
81
|
|
|
100
82
|
### Probe Steps
|
|
101
83
|
|
|
102
|
-
- [ ] **Step 1 — Previous Run:**
|
|
84
|
+
- [ ] **Step 1 — Previous Run:** **Done when:** closure rate in `Previous Run`, or run marked baseline.
|
|
103
85
|
- [ ] **Step 2 — Public URLs:** List public URLs from sitemap if present, else crawl from home. Record production host and tools available in `Checked`. First: no preview deployment indexable (`X-Robots-Tag: noindex` or host deployment protection); crawled preview competes with production and can expose unreleased pages. Marketing site outside repo → name where; audit from live URL. **Done when:** host, URL list, preview verdict in `Public URLs`. No web origin → `N/A` and STOP. No indexable page → say so; `Indexing` still runs; steps needing indexable page skip with evidence in `Not Checked`.
|
|
104
|
-
- [ ] **Step 3 — Indexing:** `robots.txt` + sitemap: present, valid, public URLs only. `lastmod` only when that page's content changes — trusted only when consistently accurate. Sitemap submitted in each webmaster console. Robots meta + `X-Robots-Tag` per page type: auth/previews `noindex`, public indexable. No `noindex` also `Disallow`ed: blocked crawler never sees `noindex` → URL can stay indexed from links. Canonicals: absolute, production host, one per page. Host canonicalisation: `http`→`https`, apex↔`www`, trailing-slash policy each one hop; HSTS set; sitemap uses canonical form only. Status codes: chain
|
|
86
|
+
- [ ] **Step 3 — Indexing:** `robots.txt` + sitemap: present, valid, public URLs only. `lastmod` only when that page's content changes — trusted only when consistently accurate. Sitemap submitted in each webmaster console. Robots meta + `X-Robots-Tag` per page type: auth/previews `noindex`, public indexable. No `noindex` also `Disallow`ed: blocked crawler never sees `noindex` → URL can stay indexed from links. Canonicals: absolute, production host, one per page. Host canonicalisation: `http`→`https`, apex↔`www`, trailing-slash policy each one hop; HSTS set; sitemap uses canonical form only. Status codes: chain <=1 hop, no loops, missing →404. Locales: `hreflang` per variant → existing pages; `hreflang="x-default"`; sets reciprocal and include self; canonical same-locale, never another locale; no forced `/` redirect by `Accept-Language` or IP — crawler without `Accept-Language` from one country (e.g. Googlebot) must see other locales. Content in HTML without JavaScript. Rendered HTML: one URL per page type — no-JS view vs engine render after JS (e.g. URL Inspection). Mobile/desktop same content when engine indexes mobile (e.g. Google). **Done when:** `Indexing` row per check: met / finding / not applicable (why).
|
|
105
87
|
- [ ] **Step 4 — Metadata:** Indexable public page → title + description present, unique, right length. Open Graph + Twitter card tags; images exist, right size. `lang`, favicon, web manifest. Store listings → Smart App Banner (`apple-itunes-app`); `apple-app-site-association` + `assetlinks.json` reachable so search opens app. Link target screen → `bkit-audit-app-store`. **Done when:** `Metadata` row per page: tag · verdict, or skip in `Not Checked`.
|
|
106
|
-
- [ ] **Step 5 — Structured Data:** Indexable public page → JSON-LD per page type: `Organization`, `WebSite`, `SoftwareApplication` or `MobileApplication` with store links, `FAQPage` only mirroring on-page Q&A, `BreadcrumbList` where depth exists. Validate each block; must match visible page — disagreeing markup worse than none. Engine rich-results test (supported) + schema.org validator (vocabulary). App types: engine software-app required props + `operatingSystem`, `applicationCategory`. Ratings from real on-page user ratings, never self-assigned. Retired rich-result type (`Project Instructions`) missing
|
|
88
|
+
- [ ] **Step 5 — Structured Data:** Indexable public page → JSON-LD per page type: `Organization`, `WebSite`, `SoftwareApplication` or `MobileApplication` with store links, `FAQPage` only mirroring on-page Q&A, `BreadcrumbList` where depth exists. Validate each block; must match visible page — disagreeing markup worse than none. Engine rich-results test (supported) + schema.org validator (vocabulary). App types: engine software-app required props + `operatingSystem`, `applicationCategory`. Ratings from real on-page user ratings, never self-assigned. Retired rich-result type (`Project Instructions`) missing != finding. Generative answers need no special markup; structured data earns rich results and states facts plainly. **Done when:** `Structured Data` row per block: type · valid · agrees with page · verdict, or skip in `Not Checked`.
|
|
107
89
|
- [ ] **Step 6 — Answer Engines:**
|
|
108
|
-
- `llms.txt` / `llms-full.txt` optional. Engines ignore or use unevenly → missing file
|
|
90
|
+
- `llms.txt` / `llms-full.txt` optional. Engines ignore or use unevenly → missing file != finding. If present: current, links to existing pages; stale = `LOW`.
|
|
109
91
|
- Indexable page → plain facts in HTML text (not only images/scripts): product, audience, cost, platforms. Direct Q&A near top of owning page. One name for product/company across site, store, social. Off-site description/pricing/platforms match store, reviews, forums, press — answer engines often cite these over product site. List third-party sources prompt pass cited.
|
|
110
|
-
- AI crawler policy: `robots.txt` per group. Allow/block both fine; no recorded decision = finding. Owner decides; report records. Blocking one group
|
|
92
|
+
- AI crawler policy: `robots.txt` per group. Allow/block both fine; no recorded decision = finding. Owner decides; report records. Blocking one group != blocking others. Training: GPTBot, ClaudeBot, Google-Extended, Applebot-Extended, CCBot. Search: OAI-SearchBot, Claude-SearchBot, PerplexityBot, Bingbot (feeds some assistants) — block → out of those answers. User-triggered: ChatGPT-User, Claude-User, Perplexity-User; some vendors say may not follow `robots.txt`. "Block training, allow search" common; write per group.
|
|
111
93
|
- Edge/firewall + CDN "block AI bots" agree with `robots.txt`. Firewall `403` to allowed search crawler overrides `robots.txt` silently. Check edge/server logs for each search crawler requests + status codes, not `robots.txt` alone.
|
|
112
94
|
- Search-console control for generative answers inclusion/exclusion. Owner decides; report records. Does not govern training.
|
|
113
95
|
- Indexable page → same questions to same answer engines. Record date, each answer, citations. Answers drift daily → signal not test; wrong answer = finding about these pages, not the engine. Repeatable: fixed prompts (brand, category, named competitor comparison, pricing); fixed engine set from ChatGPT search, Perplexity, Gemini, Google AI Mode, Copilot, Claude; signed out; verbatim answers + cited URLs; mention/citation share vs previous report or baseline.
|
|
@@ -123,13 +105,11 @@ Verify only when applicable.
|
|
|
123
105
|
|
|
124
106
|
### 🔒 Gate 2: Probes Check
|
|
125
107
|
|
|
126
|
-
**Checkpoint.** Verify and check `[x]` all boxes below, then continue to `Findings` without asking.
|
|
127
|
-
|
|
128
108
|
- [ ] **Steps complete:** every step `[x]`, or explicit skip with evidence the surface is absent.
|
|
129
109
|
- [ ] **Evidence:** every finding cites re-checkable evidence and the tool behind it.
|
|
130
110
|
- [ ] **Settings untouched:** no search-console, webmaster, robots, sitemap, IndexNow, or firewall setting changed.
|
|
131
111
|
- [ ] **No values:** no personal-data value anywhere in the report.
|
|
132
|
-
- [ ] **Gate 2
|
|
112
|
+
- [ ] **Gate 2 — Verified:** Every checkbox above independently verified and checked off.
|
|
133
113
|
|
|
134
114
|
## Findings
|
|
135
115
|
|
|
@@ -141,7 +121,7 @@ Verify only when applicable.
|
|
|
141
121
|
| `MEDIUM` | Wrong or missing metadata; structured data that disagrees with the page; canonical, `hreflang`, or redirect defect; consoles absent while indexable pages exist; an answer engine states a wrong fact taken from these pages; off-site listing disagrees with the site |
|
|
142
122
|
| `LOW` | Stale `llms.txt`; naming drift that does not change which page is indexed. A missing `llms.txt`, or a missing retired rich-result type, is not a finding |
|
|
143
123
|
|
|
144
|
-
|
|
124
|
+
Within a severity: indexing first.
|
|
145
125
|
|
|
146
126
|
<!-- prettier-ignore -->
|
|
147
127
|
| ID | Severity | Location | Evidence | Expected |
|
|
@@ -221,17 +201,13 @@ PENDING
|
|
|
221
201
|
|
|
222
202
|
### 🔒 Gate 3: Report Check
|
|
223
203
|
|
|
224
|
-
|
|
225
|
-
|
|
226
|
-
- [ ] **No placeholders:** Findings table and every `Report` section have no `PENDING`.
|
|
204
|
+
- [ ] **No placeholders:** no `PENDING` left
|
|
227
205
|
- [ ] **Summary:** names count per severity, whether any indexable public page exists, and the production host.
|
|
228
|
-
- [ ] **Series:** mention and citation share, and console query deltas, beside
|
|
229
|
-
- [ ] **Writes:** only this report
|
|
230
|
-
- [ ] **Process Improvements:** `Universal`
|
|
206
|
+
- [ ] **Series:** mention and citation share, and console query deltas, beside previous report's numbers, or marked baseline.
|
|
207
|
+
- [ ] **Writes:** only this report, template `Project Instructions`, and ledger rows changed; throwaway worktrees / remote targets removed.
|
|
208
|
+
- [ ] **Process Improvements:** `Universal` and `Project` filled
|
|
231
209
|
- [ ] **Suggested Issues:** every `MEDIUM`+ finding ID in exactly one row; every row has a `Next Step`.
|
|
232
|
-
- [ ] **Gate 3
|
|
233
|
-
|
|
234
|
-
> `Project Instructions` below `bkit:end` are consumer-owned — `bkit install` never overwrites them, `bkit check` drift stays clean. Add project-specific tools, paths, commands, and checks there, keyed by section or step title; never results.
|
|
210
|
+
- [ ] **Gate 3 — Verified:** Every checkbox above independently verified and checked off.
|
|
235
211
|
|
|
236
212
|
<!-- bkit:end -->
|
|
237
213
|
|
|
@@ -11,14 +11,6 @@
|
|
|
11
11
|
>
|
|
12
12
|
> **Rules:**
|
|
13
13
|
>
|
|
14
|
-
> - Read-only audit; never edit code, config, or data.
|
|
15
|
-
> - `Universal Instructions` apply to all projects; `Project Instructions` apply only to this project.
|
|
16
|
-
> - Local audit instructions / overrides → `Project Instructions` below the bkit-managed block; universal instructions stay in-block.
|
|
17
|
-
> - Any tools mentioned in `Universal Instructions` are examples only; swap for actual tools in final output; drop inapplicable.
|
|
18
|
-
> - Use dense token-efficient phrasing; no filler / hedging / restating; tables > prose, bullets > paragraphs.
|
|
19
|
-
> - Read `.agents/docs.md` → load docs for workflow / step / task; skip missing; cite docs inline where required.
|
|
20
|
-
> - Every claim cites this run's evidence (`file:line`, or command / query and its output) and tool behind it; a previous report's figure, list, or status is a lead, not evidence.
|
|
21
|
-
> - Read this document once at session start; do not trust session memory; do not re-read on every loop iteration.
|
|
22
14
|
> - Name the field and where it lives; never copy a personal-data value into the report.
|
|
23
15
|
> - Vendor consoles are read-only: NEVER publish a container, change a property, or send a live collection hit.
|
|
24
16
|
> - Every container, property, and capture names the environment it ran against.
|
|
@@ -33,7 +25,7 @@ Tracking decays quietly: one-sided renames, funnel steps that stop after refacto
|
|
|
33
25
|
|
|
34
26
|
**Cadence:** quarterly. Extra pass after a change to a core flow, and on the run that first finds product tracking (mark baseline).
|
|
35
27
|
|
|
36
|
-
**Anchor Standards:**
|
|
28
|
+
**Anchor Standards:**
|
|
37
29
|
|
|
38
30
|
- Product-analytics collection docs (e.g. GA4 developer guides, Analytics Help: collection/config limits, user-id, recommended events, Measurement Protocol, warehouse export). Record date read.
|
|
39
31
|
- Tag-manager docs (e.g. GTM Help: workspaces, environments, preview, tag diagnostics). Record date read.
|
|
@@ -75,38 +67,28 @@ Tracking decays quietly: one-sided renames, funnel steps that stop after refacto
|
|
|
75
67
|
|
|
76
68
|
### Pre-Flight / Dependencies
|
|
77
69
|
|
|
78
|
-
**Checkpoint:** Check off all core items. Check conditional items only when applicable. Each item: available → tool and version; missing → fallback, gap in `Not Checked`, fix in `Process Improvements`. Unnamed gap reads as passed. never abort for a missing capability.
|
|
79
|
-
|
|
80
|
-
**Credentials:** probe direnv before marking a token / env var missing: `direnv exec . sh -c '[ -n "${VAR}" ] && echo set || echo unset'`; `unset` = missing. Run credentialed CLIs as `direnv exec . <cmd>`. No direnv (cloud session) → plain env check. Report names, never values.
|
|
81
|
-
|
|
82
70
|
#### Core
|
|
83
71
|
|
|
84
|
-
|
|
85
|
-
|
|
86
|
-
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied (here or in any step) → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`; run every step the remaining tools allow; work needing blocked call → `Not Checked`. never stop the run for a blocked call; never retry or reword a blocked call to get past it.
|
|
72
|
+
- [ ] **Permissions:** blocked calls recorded
|
|
87
73
|
- [ ] **Web:** Step 18 — fetch anchor standards. Fallback: versions recorded as unread.
|
|
88
74
|
|
|
89
75
|
#### Conditional
|
|
90
76
|
|
|
91
|
-
Verify only when applicable.
|
|
92
|
-
|
|
93
77
|
- [ ] **Request Capture:** Product tracking in code → Step 12 — browser network panel or a test-runner intercept, e.g. Playwright `page.route`, Cypress `intercept`. Fallback: code only; firing claims = hypotheses in `Not Checked`.
|
|
94
78
|
- [ ] **Tag Manager:** A tag manager sits between app and vendor → Steps 5, 6, 10, 12 — container export, preview, and diagnostics, e.g. GTM JSON export, Tag Assistant. Fallback: code and network only; container diff `Not Checked`.
|
|
95
79
|
- [ ] **Analytics Admin:** A hosted property exists → Steps 9, 11, 13, 14 — retention, filters, redaction, and user-deletion, e.g. GA4 Admin API, Firebase console, Amplitude settings. Fallback: none; settings `Not Checked`.
|
|
96
|
-
- [ ] **Native Debug:** A native analytics SDK exists → Steps 10
|
|
80
|
+
- [ ] **Native Debug:** A native analytics SDK exists → Steps 10-12 — debug view, e.g. Firebase DebugView. Fallback: `Not Checked`. Confirm debug flags never ship in a release build.
|
|
97
81
|
- [ ] **Warehouse:** An export is linked → Step 17 — row counts, e.g. BigQuery, Snowflake. Fallback: vendor-UI counts only; reconciliation `Not Checked`.
|
|
98
82
|
|
|
99
83
|
### 🔒 Gate 1: Prerequisites Check
|
|
100
84
|
|
|
101
|
-
**Checkpoint.** Verify and check `[x]` all applicable boxes above, then continue to `Probe Steps` without asking.
|
|
102
|
-
|
|
103
85
|
- [ ] **Gaps named:** every missing item names its fallback and `Not Checked` entry.
|
|
104
|
-
- [ ] **Gate 1
|
|
86
|
+
- [ ] **Gate 1 — Verified:** All Core items checked. All applicable Conditional items checked.
|
|
105
87
|
|
|
106
88
|
### Probe Steps
|
|
107
89
|
|
|
108
|
-
- [ ] **Step 1 — Previous Run:**
|
|
109
|
-
- [ ] **Step 2 — Detect:** Find every analytics SDK, tag-manager snippet, and event call on web, native, and server — vendor packages, hosts, wrapper. Error-tracker SDKs are not product analytics. None → docs claiming tracking; unmet claim = finding → `bkit-audit-documentation`; then `N/A` and STOP. Record tools in `Checked`. **Done when:** surfaces in `Checked`, or `N/A` and STOP
|
|
90
|
+
- [ ] **Step 1 — Previous Run:** **Done when:** closure rate in `Previous Run`, or run marked baseline.
|
|
91
|
+
- [ ] **Step 2 — Detect:** Find every analytics SDK, tag-manager snippet, and event call on web, native, and server — vendor packages, hosts, wrapper. Error-tracker SDKs are not product analytics. None → docs claiming tracking; unmet claim = finding → `bkit-audit-documentation`; then `N/A` and STOP. Record tools in `Checked`. **Done when:** surfaces in `Checked`, or `N/A` and **STOP**.
|
|
110
92
|
- [ ] **Step 3 — Events:** Every code-sent event: name, fire site, property types = tracking plan as implemented. No written intended plan = finding (Step 4). **Done when:** `Events` lists every event and change since the previous run, or marked baseline.
|
|
111
93
|
- [ ] **Step 4 — Plan:** Each business question: owner + map to named events, key events, custom dimensions. Event without question wastes limits = finding; question without event = gap. Intended plan `Events` compares to. **Done when:** `Plan` row per question: owner · events · verdict against `Events`.
|
|
112
94
|
- [ ] **Step 5 — Data Layer:** Tag manager between app and vendor (e.g. GA4 through GTM) → (a) Push to data layer only via one typed wrapper; tag manager picks destinations. Direct vendor calls (e.g. `gtag(`), in-component SDK calls, bypass pushes = finding. (b) Layer retains keys across pushes → leak without reset; clear prior object before each commerce push (e.g. `ecommerce: null`). (c) One page view per navigation: non-full-load router sends `page_view` from history auto **or** manual virtual, never both; preview five routes → five hits with new location/title. (d) Snippet once from root layout, after Step 10 consent defaults, only after grant; each deploy loads `Container` environment expected. No tag manager → skip with evidence. **Done when:** `Data Layer` holds the five-route count and each breach = finding.
|
|
@@ -118,22 +100,20 @@ Verify only when applicable.
|
|
|
118
100
|
- [ ] **Step 11 — Identity:** Login → internal user id only (never email/personal), via vendor's user-id mechanism only (e.g. GA4 `user_id` config parameter) — never event param, user property, or registered custom dimension; sent every page load while signed in. Logout → null, not `""`, `" "`, or `"null"`; never-signed-in → no user id. Native mirrors login/logout. One property stitches web+app (e.g. Blended/Observed); household model documented (e.g. low-cardinality user property). Never register per-household/per-user id as custom dimension. Verify sign-in/nav/sign-out in preview (web) + debug view (native); record user-id presence/shape, never value. Personal id or post-logout survival → plan from this report + `bkit-audit-privacy` if personal data left. **Done when:** `Identity` row per stage: signed out · signed in · after logout · never signed in.
|
|
119
101
|
- [ ] **Step 12 — Firing:** Run each core flow (E2E or manual) → capture requests vs `Events`. Events in code that never fire = dead tracking; fire-not-in-code = auto-collection decision; payload mismatch = bug. Web: tag-manager preview + network. Per flow: tags + consent state, data layer per push, outgoing hits. Native: debug view; debug flags never in release. One screen view per screen (name/class match web routes) + auto events (e.g. `first_open`, `session_start`, Android `app_remove`). **Done when:** `Firing` row per core flow: expected · captured · verdict.
|
|
120
102
|
- [ ] **Step 13 — Dashboards:** Vendor reports/conversions use existing events; internal/test filtered. Each run: unset page/landing shares, collapsed high-cardinality size, unassigned channel, self-referrals + delta vs previous run. Alert on core-flow key event → zero between runs. Tracking-changing releases annotated. Dashboard on dead event → owner with report + event. **Done when:** `Dashboards` holds quality shares, alerts, and annotations.
|
|
121
|
-
- [ ] **Step 14 — Property:** Hosted property (e.g. GA4) → screenshot or admin API dump per setting; name property. (a) Deliberate retention (past short default) + reset-on-new-activity vs `bkit-audit-privacy` rules. (b) Internal/dev traffic filters active (not testing); permanent exclusions; app streams exclude at source (CI/synthetic/test). (c) Unwanted referrals: checkout, OAuth, auth hosts — else sign-in/purchase credit lost. (d) Each `Coverage` completion = key event (non-trivial); counting method chosen; within doc limit (record limit). (e) Report params registered as custom dims/metrics within limits; no high-cardinality ids. (f) Auto-collection toggles: SPA form noise; site-search param names; downloads may leak filenames (personal). (g) Signals/demographics threshold risk — record decision; off or device identity if core data hidden. (h) Granular location/device + user-provided data per region; user-provided off unless enhanced conversions. (i) TZ/currency match business; session/engaged timers; cross-domain if marketing
|
|
103
|
+
- [ ] **Step 14 — Property:** Hosted property (e.g. GA4) → screenshot or admin API dump per setting; name property. (a) Deliberate retention (past short default) + reset-on-new-activity vs `bkit-audit-privacy` rules. (b) Internal/dev traffic filters active (not testing); permanent exclusions; app streams exclude at source (CI/synthetic/test). (c) Unwanted referrals: checkout, OAuth, auth hosts — else sign-in/purchase credit lost. (d) Each `Coverage` completion = key event (non-trivial); counting method chosen; within doc limit (record limit). (e) Report params registered as custom dims/metrics within limits; no high-cardinality ids. (f) Auto-collection toggles: SPA form noise; site-search param names; downloads may leak filenames (personal). (g) Signals/demographics threshold risk — record decision; off or device identity if core data hidden. (h) Granular location/device + user-provided data per region; user-provided off unless enhanced conversions. (i) TZ/currency match business; session/engaged timers; cross-domain if marketing != app domain. Other vendor → equivalent settings or skip. Undecided drift → owner + diff/screenshot. **Done when:** `Property` row per setting: value · decided · verdict.
|
|
122
104
|
- [ ] **Step 15 — Server Events:** List server-protocol sends (e.g. webhook subscription lifecycle, inbound message, job outcomes). Reuse client id (web) or app instance id (native); session id only in vendor window. Validate via vendor debug endpoint; API secret in secrets store, rotated. No client twin or shared dedup key (e.g. `transaction_id`); subscription revenue from webhook, not client success page. Server strips personal data (redaction N/A). Document first-party script + same-origin path (e.g. `/metrics`) via host/CDN + server container strip; no decision = finding; if adopted check domain, prod instance count vs vendor guidance, strip rules. **Done when:** `Server Events` row per event: client id reused · deduped · personal data stripped · verdict.
|
|
123
105
|
- [ ] **Step 16 — Campaigns:** Written UTM taxonomy: lowercase fixed source/medium vocabulary + campaign id matching vendor channel groups; no internal UTMs; invite/reply/reset links carry UTMs. Auth redirects preserve params (e.g. `utm_*`, `gclid`, `gbraid`, `wbraid`) through sign-up → confirm → callback → first landing; test tagged sign-up + first page view/sign-up hit. Record attribution model, key-event lookbacks, custom channel groups (incl. assistant-referrer for `bkit-audit-aio-seo`). Installs: store referrer, campaign links, deferred invite deep links → first open. Lost params/untagged email → plan, name flow. **Done when:** `Campaigns` row per item: written · tested · verdict.
|
|
124
|
-
- [ ] **Step 17 — Integrations:** Search Console when public pages exist. Warehouse export → project observability stack, daily (+ streaming if needed), all streams; record region/expiry/cost; daily volume vs export limit (record limit; chronic exceed → pause risk). One processed day: vendor UI count vs warehouse rows (device id identity, matched TZ); doc gap (e.g. 2
|
|
106
|
+
- [ ] **Step 17 — Integrations:** Search Console when public pages exist. Warehouse export → project observability stack, daily (+ streaming if needed), all streams; record region/expiry/cost; daily volume vs export limit (record limit; chronic exceed → pause risk). One processed day: vendor UI count vs warehouse rows (device id identity, matched TZ); doc gap (e.g. 2-5%) OK, more = finding. Ads + auto-tagging/enhanced conversions only if paid acquisition else "not linked". Link native projects + store billing if IAP. Missing link → owner. **Done when:** `Integrations` row per link: linked / not linked / not applicable.
|
|
125
107
|
- [ ] **Step 18 — Standards:** Confirm current version per anchor standard; read changes since previous report's version. `Standards Coverage`: row per consent signal, collection/config limit, user-id rule, tag-manager governance, server-protocol requirement → checked (name step) / not applicable (why) / finding. Unapplied recommended practice → adopt (propose step) / reject (why) / not applicable. **Done when:** no empty row.
|
|
126
108
|
- [ ] **Step 19 — Anything Else:** (a) Since previous commit, every tracking touch (events, data-layer wrapper, container, property/stream, consent banner/mode, native config, server events, auth redirects) → one-line verdict. (b) ~30 min senior pass + incidents/`bkit-audit-logs`/`docs/failures.jsonl`/vendor status since last run — gaps no step covers. **Done when:** `Beyond the Steps` holds both passes, or `none`. Class seen on 2 runs → propose step in `Process Improvements`.
|
|
127
109
|
|
|
128
110
|
### 🔒 Gate 2: Probes Check
|
|
129
111
|
|
|
130
|
-
**Checkpoint.** Verify and check `[x]` all boxes below, then continue to `Findings` without asking.
|
|
131
|
-
|
|
132
112
|
- [ ] **Steps complete:** every step `[x]`, or explicit skip with evidence the surface is absent.
|
|
133
113
|
- [ ] **Evidence:** every finding cites re-checkable evidence and the tool behind it.
|
|
134
114
|
- [ ] **No values:** no personal-data value anywhere in the report.
|
|
135
115
|
- [ ] **Consoles untouched:** no container published, no property setting changed, no live collection hit sent.
|
|
136
|
-
- [ ] **Gate 2
|
|
116
|
+
- [ ] **Gate 2 — Verified:** Every checkbox above independently verified and checked off.
|
|
137
117
|
|
|
138
118
|
## Findings
|
|
139
119
|
|
|
@@ -145,7 +125,7 @@ Verify only when applicable.
|
|
|
145
125
|
| `MEDIUM` | Dead, duplicate, or misshapen event; client mismatch; no measurement plan; key event missing or trivial; filter left in testing; campaign parameters stripped; dashboard on a dead event |
|
|
146
126
|
| `LOW` | Naming drift that changes no report; missing annotation; unused paused tag |
|
|
147
127
|
|
|
148
|
-
|
|
128
|
+
Within a severity: personal data / consent first. Personal data in an event, a tag that loads before consent, consent defaults that are not denied before the snippet, and a user id that is personal data are each at least `HIGH`. `Expected` names where it goes.
|
|
149
129
|
|
|
150
130
|
<!-- prettier-ignore -->
|
|
151
131
|
| Finding | Goes to |
|
|
@@ -260,17 +240,13 @@ PENDING
|
|
|
260
240
|
|
|
261
241
|
### 🔒 Gate 3: Report Check
|
|
262
242
|
|
|
263
|
-
|
|
264
|
-
|
|
265
|
-
- [ ] **No placeholders:** Findings table and every `Report` section have no `PENDING`.
|
|
243
|
+
- [ ] **No placeholders:** no `PENDING` left
|
|
266
244
|
- [ ] **Summary:** names count per severity, whether the audit applied, and the event-list change vs the previous run (or baseline).
|
|
267
245
|
- [ ] **Series:** `Dashboards` shares and the `Container` diff beside previous report's, or marked baseline.
|
|
268
|
-
- [ ] **Writes:** only this report
|
|
269
|
-
- [ ] **Process Improvements:** `Universal`
|
|
246
|
+
- [ ] **Writes:** only this report, template `Project Instructions`, and ledger rows changed; throwaway worktrees / remote targets removed.
|
|
247
|
+
- [ ] **Process Improvements:** `Universal` and `Project` filled
|
|
270
248
|
- [ ] **Suggested Issues:** every `MEDIUM`+ finding ID in exactly one row; every row has a `Next Step`.
|
|
271
|
-
- [ ] **Gate 3
|
|
272
|
-
|
|
273
|
-
> `Project Instructions` below `bkit:end` are consumer-owned — `bkit install` never overwrites them, `bkit check` drift stays clean. Add project-specific tools, paths, commands, and checks there, keyed by section or step title; never results.
|
|
249
|
+
- [ ] **Gate 3 — Verified:** Every checkbox above independently verified and checked off.
|
|
274
250
|
|
|
275
251
|
<!-- bkit:end -->
|
|
276
252
|
|
|
@@ -11,14 +11,6 @@
|
|
|
11
11
|
>
|
|
12
12
|
> **Rules:**
|
|
13
13
|
>
|
|
14
|
-
> - Read-only audit; never edit code, config, or data.
|
|
15
|
-
> - `Universal Instructions` apply to all projects; `Project Instructions` apply only to this project.
|
|
16
|
-
> - Local audit instructions / overrides → `Project Instructions` below the bkit-managed block; universal instructions stay in-block.
|
|
17
|
-
> - Any tools mentioned in `Universal Instructions` are examples only; swap for actual tools in final output; drop inapplicable.
|
|
18
|
-
> - Use dense token-efficient phrasing; no filler / hedging / restating; tables > prose, bullets > paragraphs.
|
|
19
|
-
> - Read `.agents/docs.md` → load docs for workflow / step / task; skip missing; cite docs inline where required.
|
|
20
|
-
> - Every claim cites this run's evidence (`file:line`, or command / query and its output) and tool behind it; a previous report's figure, list, or status is a lead, not evidence.
|
|
21
|
-
> - Read this document once at session start; do not trust session memory; do not re-read on every loop iteration.
|
|
22
14
|
> - never edit a workflow, composite action, or other CI config; a recommended change is a finding for a human.
|
|
23
15
|
> - NEVER dispatch a workflow, push, or otherwise start a run to verify a fix.
|
|
24
16
|
|
|
@@ -32,7 +24,7 @@ Green CI hides costly warnings. Two failure modes: step success while the operat
|
|
|
32
24
|
|
|
33
25
|
**Cadence:** weekly, and before every release to the production branch. In-passing sweeps are not a control. Extra pass when: CI-vendor deprecation/retirement post or runner-image announcement touches these workflows; workflow, composite action, or reusable workflow changes (conditional lane annotates only when it runs); deprecation deadline before next weekly sweep.
|
|
34
26
|
|
|
35
|
-
**Anchor Standards:**
|
|
27
|
+
**Anchor Standards:**
|
|
36
28
|
|
|
37
29
|
- CI vendor changelog, deprecation, and retirement posts (e.g. GitHub Changelog deprecation label). Living; record the date read.
|
|
38
30
|
- Runner-image announcements (e.g. `actions/runner-images` Announcement label). Living; record the date read.
|
|
@@ -75,37 +67,27 @@ One per annotation. **SILENT FAILURE** outranks every other verdict.
|
|
|
75
67
|
|
|
76
68
|
### Pre-Flight / Dependencies
|
|
77
69
|
|
|
78
|
-
**Checkpoint:** Check off all core items. Check conditional items only when applicable. Each item: available → tool and version; missing → fallback, gap in `Not Checked`, fix in `Process Improvements`. Unnamed gap reads as passed. never abort for a missing capability.
|
|
79
|
-
|
|
80
|
-
**Credentials:** probe direnv before marking a token / env var missing: `direnv exec . sh -c '[ -n "${VAR}" ] && echo set || echo unset'`; `unset` = missing. Run credentialed CLIs as `direnv exec . <cmd>`. No direnv (cloud session) → plain env check. Report names, never values.
|
|
81
|
-
|
|
82
70
|
#### Core
|
|
83
71
|
|
|
84
|
-
|
|
85
|
-
|
|
86
|
-
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied (here or in any step) → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`; run every step the remaining tools allow; work needing blocked call → `Not Checked`. never stop the run for a blocked call; never retry or reword a blocked call to get past it.
|
|
72
|
+
- [ ] **Permissions:** blocked calls recorded
|
|
87
73
|
- [ ] **CI Read:** Steps 2, 5, 11 — annotations and step logs for recent runs of every workflow, e.g. `gh api` check-run annotations, `gh run view --log`, GitLab job-trace API. Log access: `.agents/context.md` `context-fetch` blocks below `bkit:end` are ready-made read-only readers (`bkit context list-blocks` → each block's `context` and `body`); set a body's `# Customise:` knobs to the audit window; run it via `direnv exec . bash`. Fallback: saved logs; runs not fetched `Not Checked`.
|
|
88
74
|
- [ ] **Workflow Files:** Steps 4, 6, 8 — workflows, composite actions, reusable workflows on disk. Fallback: none.
|
|
89
75
|
- [ ] **Web:** Steps 3, 12 — vendor changelog, runner-image announcements, anchor standards. Fallback: versions recorded as unread.
|
|
90
76
|
|
|
91
77
|
#### Conditional
|
|
92
78
|
|
|
93
|
-
Verify only when applicable.
|
|
94
|
-
|
|
95
79
|
- [ ] **Workflow Linters:** Workflows on disk → Step 6 — e.g. actionlint, zizmor, shellcheck. Fallback: read the workflows; name each check skipped.
|
|
96
80
|
- [ ] **Language Server:** Typed language and a lint annotation → Step 9 — per-file diagnostics, e.g. Serena, `tsserver`. Fallback: lint that file; say so. Empty is inconclusive; corroborate with text search.
|
|
97
81
|
- [ ] **Deprecated-API Lint:** Typed language → Step 10 — e.g. `@typescript-eslint/no-deprecated`. Fallback: text search for known deprecated calls; under-count recorded.
|
|
98
82
|
|
|
99
83
|
### 🔒 Gate 1: Prerequisites Check
|
|
100
84
|
|
|
101
|
-
**Checkpoint.** Verify and check `[x]` all applicable boxes above, then continue to `Probe Steps` without asking.
|
|
102
|
-
|
|
103
85
|
- [ ] **Gaps named:** every missing item names its fallback and `Not Checked` entry.
|
|
104
|
-
- [ ] **Gate 1
|
|
86
|
+
- [ ] **Gate 1 — Verified:** All Core items checked. All applicable Conditional items checked.
|
|
105
87
|
|
|
106
88
|
### Probe Steps
|
|
107
89
|
|
|
108
|
-
- [ ] **Step 1 — Previous Run:**
|
|
90
|
+
- [ ] **Step 1 — Previous Run:** **Done when:** closure rate in `Previous Run`, or run marked baseline.
|
|
109
91
|
- [ ] **Step 2 — Collect:** No CI → one `N/A` row with evidence and STOP. Else read annotation lists for recent runs of every workflow, not last run of one pipeline. Deprecations surface on whichever workflow uses the old action. Include scheduled, manual, and bot-triggered runs. Collect mechanically, not by eye from the UI. Window = since previous report, and at least latest completed run of each workflow. Save list; diff vs previous report: new, resolved, persisting. Annotations capped (e.g. GitHub: 10 warnings, 10 errors, and 10 notices per step, and 50 per job). Step at cap → grep raw job log for warning and error markers; triage overflow. Record run ids and commit. Id, run, or path you cannot re-open → do not cite it. **Done when:** `Annotations` holds diff (new, resolved, persisting) and run ids.
|
|
110
92
|
- [ ] **Step 3 — Deprecations:** Read vendor deprecation/retirement posts and runner-image announcements since previous report. List every dated change touching these workflows: runtimes, runner images, events, actions. Changelog notice precedes run notice. Each → DEPRECATION with date and bump. Dependency bot already tracks bump → say so; schedule rest next step. **Done when:** `Deprecations` row per dated change: what · date · bump · bot already tracking?
|
|
111
93
|
- [ ] **Step 4 — Runtimes:** Every `uses:` (or the CI system's equivalent) in workflows, local composite actions, and reusable workflows — resolved version and declared runtime (e.g. `runs.using`). Action declaring removed runtime (e.g. `node20` after runners dropped it) runs on forced runtime with no opt-out → finding, unless seen working there. List leftover opt-out env keys that no longer change anything. **Done when:** `Runtimes` row per action: version · declared runtime · verdict, plus leftover keys.
|
|
@@ -121,13 +103,11 @@ Verify only when applicable.
|
|
|
121
103
|
|
|
122
104
|
### 🔒 Gate 2: Probes Check
|
|
123
105
|
|
|
124
|
-
**Checkpoint.** Verify and check `[x]` all boxes below, then continue to `Findings` without asking.
|
|
125
|
-
|
|
126
106
|
- [ ] **Steps complete:** every step `[x]`, or explicit skip with evidence the surface is absent.
|
|
127
107
|
- [ ] **Evidence:** every finding cites re-checkable evidence and the tool behind it.
|
|
128
108
|
- [ ] **Workflows untouched:** no workflow, composite action, or CI config edited.
|
|
129
109
|
- [ ] **No dispatch:** no workflow run triggered, and no push.
|
|
130
|
-
- [ ] **Gate 2
|
|
110
|
+
- [ ] **Gate 2 — Verified:** Every checkbox above independently verified and checked off.
|
|
131
111
|
|
|
132
112
|
## Findings
|
|
133
113
|
|
|
@@ -139,7 +119,7 @@ Verify only when applicable.
|
|
|
139
119
|
| `MEDIUM` | Lint warning that points at code; deprecation with a deadline still after the next release; dead suppression; static-analysis finding that is not itself a silent failure |
|
|
140
120
|
| `LOW` | Leftover env key that changes nothing; accepted annotation with no written record; cosmetic notice |
|
|
141
121
|
|
|
142
|
-
|
|
122
|
+
Within a severity: silent failures first.
|
|
143
123
|
|
|
144
124
|
<!-- prettier-ignore -->
|
|
145
125
|
| ID | Severity | Verdict | Location | Evidence | Expected |
|
|
@@ -223,18 +203,14 @@ PENDING
|
|
|
223
203
|
|
|
224
204
|
### 🔒 Gate 3: Report Check
|
|
225
205
|
|
|
226
|
-
|
|
227
|
-
|
|
228
|
-
- [ ] **No placeholders:** Findings table and every `Report` section have no `PENDING`.
|
|
206
|
+
- [ ] **No placeholders:** no `PENDING` left
|
|
229
207
|
- [ ] **Summary:** names count per severity and the runs read.
|
|
230
|
-
- [ ] **Series:** new / resolved / persisting counts beside previous report's, or marked baseline.
|
|
208
|
+
- [ ] **Series:** new / resolved / persisting counts beside previous report's numbers, or marked baseline.
|
|
231
209
|
- [ ] **Verified:** states what was checked locally and what still needs a real run.
|
|
232
|
-
- [ ] **Writes:** only this report
|
|
233
|
-
- [ ] **Process Improvements:** `Universal`
|
|
210
|
+
- [ ] **Writes:** only this report, template `Project Instructions`, and ledger rows changed; throwaway worktrees / remote targets removed.
|
|
211
|
+
- [ ] **Process Improvements:** `Universal` and `Project` filled
|
|
234
212
|
- [ ] **Suggested Issues:** every `MEDIUM`+ finding ID in exactly one row; every row has a `Next Step`.
|
|
235
|
-
- [ ] **Gate 3
|
|
236
|
-
|
|
237
|
-
> `Project Instructions` below `bkit:end` are consumer-owned — `bkit install` never overwrites them, `bkit check` drift stays clean. Add project-specific tools, paths, commands, and checks there, keyed by section or step title; never results.
|
|
213
|
+
- [ ] **Gate 3 — Verified:** Every checkbox above independently verified and checked off.
|
|
238
214
|
|
|
239
215
|
<!-- bkit:end -->
|
|
240
216
|
|
|
@@ -11,14 +11,6 @@
|
|
|
11
11
|
>
|
|
12
12
|
> **Rules:**
|
|
13
13
|
>
|
|
14
|
-
> - Read-only audit; never edit code, config, or data.
|
|
15
|
-
> - `Universal Instructions` apply to all projects; `Project Instructions` apply only to this project.
|
|
16
|
-
> - Local audit instructions / overrides → `Project Instructions` below the bkit-managed block; universal instructions stay in-block.
|
|
17
|
-
> - Any tools mentioned in `Universal Instructions` are examples only; swap for actual tools in final output; drop inapplicable.
|
|
18
|
-
> - Use dense token-efficient phrasing; no filler / hedging / restating; tables > prose, bullets > paragraphs.
|
|
19
|
-
> - Read `.agents/docs.md` → load docs for workflow / step / task; skip missing; cite docs inline where required.
|
|
20
|
-
> - Every claim cites this run's evidence (`file:line`, or command / query and its output) and tool behind it; a previous report's figure, list, or status is a lead, not evidence.
|
|
21
|
-
> - Read this document once at session start; do not trust session memory; do not re-read on every loop iteration.
|
|
22
14
|
> - never change sampling rates, dashboards, or project settings to take a measurement; a gap = finding.
|
|
23
15
|
> - Every figure names environment, window, percentile, and `n`.
|
|
24
16
|
|
|
@@ -32,7 +24,7 @@ Performance numbers only matter beside the prior number, same method; unfixed me
|
|
|
32
24
|
|
|
33
25
|
**Cadence:** quarterly. Extra pass when production first gets real traffic, after instrument fixes (`Re-baseline`), or network-shape change (region pin, prefetch policy, server-data seeding). Changed sampling, dashboards, window, or percentile → new baseline; run one then.
|
|
34
26
|
|
|
35
|
-
**Anchor Standards:**
|
|
27
|
+
**Anchor Standards:**
|
|
36
28
|
|
|
37
29
|
- Core Web Vitals (LCP, INP, CLS at p75, mobile, and desktop apart) and supporting FCP, TTFB (e.g. web.dev); check its changelog.
|
|
38
30
|
- Field dataset (e.g. Chrome UX Report, PageSpeed Insights).
|
|
@@ -69,23 +61,15 @@ Performance numbers only matter beside the prior number, same method; unfixed me
|
|
|
69
61
|
|
|
70
62
|
### Pre-Flight / Dependencies
|
|
71
63
|
|
|
72
|
-
**Checkpoint:** Check off all core items. Check conditional items only when applicable. Each item: available → tool and version; missing → fallback, gap in `Not Checked`, fix in `Process Improvements`. Unnamed gap reads as passed. never abort for a missing capability.
|
|
73
|
-
|
|
74
|
-
**Credentials:** probe direnv before marking a token / env var missing: `direnv exec . sh -c '[ -n "${VAR}" ] && echo set || echo unset'`; `unset` = missing. Run credentialed CLIs as `direnv exec . <cmd>`. No direnv (cloud session) → plain env check. Report names, never values.
|
|
75
|
-
|
|
76
64
|
#### Core
|
|
77
65
|
|
|
78
|
-
|
|
79
|
-
|
|
80
|
-
- [ ] **Permissions:** Before Step 1 — one cheap read-only call per tool this run uses (every item below, every rule under `Project Instructions` `Permissions`), e.g. `gh run list --limit 1`, one MCP read, one anchor-standard fetch. Blocked / denied (here or in any step) → record call verbatim and narrow allow rule clearing it (e.g. `Bash(gh run list *)`) in `Not Checked`, `Process Improvements`, and `Project Instructions` `Permissions`; run every step the remaining tools allow; work needing blocked call → `Not Checked`. never stop the run for a blocked call; never retry or reword a blocked call to get past it.
|
|
81
|
-
- [ ] **Monitoring:** Steps 2–4, 6, 9, 11–13, 15 — field traces, vitals, spans per environment, e.g. Sentry, Datadog RUM, New Relic. Fallback: lab and static only; field rows `Not Checked`.
|
|
66
|
+
- [ ] **Permissions:** blocked calls recorded
|
|
67
|
+
- [ ] **Monitoring:** Steps 2-4, 6, 9, 11-13, 15 — field traces, vitals, spans per environment, e.g. Sentry, Datadog RUM, New Relic. Fallback: lab and static only; field rows `Not Checked`.
|
|
82
68
|
- [ ] **Build Output:** Steps 8, 10 — production build with per-route size and render mode, e.g. `next build`, `vite build` with bundle analyser. Fallback: source read only; sizes `Not Checked`.
|
|
83
69
|
- [ ] **Web:** Steps 4, 17 — fetch anchor standards and published thresholds. Fallback: versions and thresholds recorded as unread.
|
|
84
70
|
|
|
85
71
|
#### Conditional
|
|
86
72
|
|
|
87
|
-
Verify only when applicable.
|
|
88
|
-
|
|
89
73
|
- [ ] **Lab Runner:** Deployed web app → Steps 5, 10 — e.g. Lighthouse CI, WebPageTest; record version and profile. Fallback: none; `Lab Baseline` `Not Checked`.
|
|
90
74
|
- [ ] **Browser DevTools:** Web app → Steps 10, 11, 14 — back/forward cache, Long Animation Frames, heap snapshots, e.g. Chrome DevTools, Playwright over CDP. Fallback: those rows `Not Checked`.
|
|
91
75
|
- [ ] **Field Dataset:** Production origin with traffic → Step 6 — e.g. CrUX via PageSpeed Insights, search console Core Web Vitals report. Fallback: monitoring production rows only.
|
|
@@ -100,22 +84,20 @@ Verify only when applicable.
|
|
|
100
84
|
|
|
101
85
|
### 🔒 Gate 1: Prerequisites Check
|
|
102
86
|
|
|
103
|
-
**Checkpoint.** Verify and check `[x]` all applicable boxes above, then continue to `Probe Steps` without asking.
|
|
104
|
-
|
|
105
87
|
- [ ] **Gaps named:** every missing item names its fallback and `Not Checked` entry.
|
|
106
|
-
- [ ] **Gate 1
|
|
88
|
+
- [ ] **Gate 1 — Verified:** All Core items checked. All applicable Conditional items checked.
|
|
107
89
|
|
|
108
90
|
### Probe Steps
|
|
109
91
|
|
|
110
|
-
- [ ] **Step 1 — Previous Run:**
|
|
111
|
-
- [ ] **Step 2 — Measurement Basis:** Record dashboards (IDs, owned vs vendor-prebuilt — prebuilt = not editable), exact query per table; window, percentile, `n` per row; environment split plain, production count even when 0; one linked reference trace. Window or percentile
|
|
112
|
-
- [ ] **Step 3 — Instrument:** Confirm before trusting; state each result — missing metric reads fine otherwise. Preview deploys (if any) with injected overlays (e.g. toolbars, comment widgets) → off at project level, else pageloads carry their requests. Every vital collected (INP `null` every route = gap). Native screen transactions and frame tracking; warm start slower than cold = untrustworthy dataset. `n` per row large enough (few hundred events on one transaction
|
|
92
|
+
- [ ] **Step 1 — Previous Run:** **Done when:** closure rate in `Previous Run`, or run marked baseline.
|
|
93
|
+
- [ ] **Step 2 — Measurement Basis:** Record dashboards (IDs, owned vs vendor-prebuilt — prebuilt = not editable), exact query per table; window, percentile, `n` per row; environment split plain, production count even when 0; one linked reference trace. Window or percentile != previous report → new baseline, not comparison. **Done when:** all in `Measurement Basis`.
|
|
94
|
+
- [ ] **Step 3 — Instrument:** Confirm before trusting; state each result — missing metric reads fine otherwise. Preview deploys (if any) with injected overlays (e.g. toolbars, comment widgets) → off at project level, else pageloads carry their requests. Every vital collected (INP `null` every route = gap). Native screen transactions and frame tracking; warm start slower than cold = untrustworthy dataset. `n` per row large enough (few hundred events on one transaction != baseline). Client-side navigations measured: navigation transactions, LCP / INP after soft navigation. Fallback / degraded-path rate measured, or named blind spot. Field data CI / preview only → shape transfers, absolute times do not; say so. Each failure = finding, outranks app — until instrument honest, no fix provable. **Done when:** `Instrument` line per check.
|
|
113
95
|
- [ ] **Step 4 — Field Baseline:** One table per surface, p75, ordered by load count. Web per route: LCP, INP, CLS, FCP, TTFB. Native per screen: cold / warm start, time to initial / full display, slow / frozen frames. Uncollected → `not collected`, never blank. Verdict per p75 good / needs improvement / poor vs source thresholds; mobile and desktop split; read thresholds each run, never memory; write in table header. Plus navigation table: navigation transactions per route; LCP / INP after soft navigation where reported. **Done when:** every row has verdict or `not collected` in `Field Baseline`.
|
|
114
96
|
- [ ] **Step 5 — Lab Baseline:** Field data CI / preview → lab = reproducible number. Lab runner on production, never preview, on `Field Baseline` web routes: fixed throttling (mid-tier mobile, slow 4G), 5 runs per route, median. Record tool version and profile; change to either → new series. Lab cannot measure INP → Total Blocking Time stand-in. Keep third-party summary for `Static`. **Done when:** series per route in `Lab Baseline`.
|
|
115
97
|
- [ ] **Step 6 — Production:** Production users → their numbers count. Production sampling ~1,000 events per route per window; record production `n` per route. Field dataset (e.g. CrUX via PageSpeed Insights) for production origin once qualified; search console Core Web Vitals report (shared with `bkit-audit-aio-seo`). No production traffic → `no production traffic`, never omit. **Done when:** `Production` holds `n` per route and field-dataset rows, or `no production traffic`.
|
|
116
98
|
- [ ] **Step 7 — Native Vitals:** Native app → read beyond monitoring SDK. Android store vitals: slow cold / warm starts, slow / frozen frames, ANR rate, excessive partial wake locks (store visibility). iOS organizer: launch time, hang rate, energy. Low-end device: memory over primary flow; OTA update layer on cold start, if shipped (e.g. `expo-updates`, CodePush). Not in stores → `not published` for store rows. **Done when:** `Native Vitals` row per metric, or `not published`.
|
|
117
99
|
- [ ] **Step 8 — Budgets:** Delta vs previous says moved, not good enough → report delta vs budget: per-route shipped client code (e.g. first-load JS, gzipped), LCP and INP targets per route, native bundle / binary size, bundle size cap. Unset budget → propose from this run; owner decides. **Done when:** `Budgets` row per budget: target · actual · delta, or proposed target.
|
|
118
|
-
- [ ] **Step 9 — Waterfall:** Table says slow route; trace says why. Per worst route open reference trace; count: round trips, sequential vs concurrent (concurrent in codebase = model to copy); pageload requests for data one interaction needs; duplicate work (e.g. two nav components each prefetching every route); fixed floor under every call (primary-key lookup same cost as token validation = network toll, not slow query). Resolve where DB and functions run before query rewrite — region pin beats every rewrite. Several findings, one toll → one finding (six sequential calls, one toll
|
|
100
|
+
- [ ] **Step 9 — Waterfall:** Table says slow route; trace says why. Per worst route open reference trace; count: round trips, sequential vs concurrent (concurrent in codebase = model to copy); pageload requests for data one interaction needs; duplicate work (e.g. two nav components each prefetching every route); fixed floor under every call (primary-key lookup same cost as token validation = network toll, not slow query). Resolve where DB and functions run before query rewrite — region pin beats every rewrite. Several findings, one toll → one finding (six sequential calls, one toll != six fixes). Language-server references on hook / fetcher → one call site or many; on shared client / helper → what else pays toll. Pace queries — back-to-back collapse to partial results, under-count shrinks blast radius; re-run small caller sets; config / JSON wiring = text search. Structural questions (hub module, cold-start graph) → code graph. Each finding carries explanation or links the one that has it. **Done when:** `Waterfall` row per worst route: round trips · shape · tolls · call sites · merged findings.
|
|
119
101
|
- [ ] **Step 10 — Static:** Baseline covers routes with traffic and collected metrics; source shows causes before run. Each item only where its surface (web, server, native) exists and the stack has the mechanism; else `N/A` with evidence:
|
|
120
102
|
- Client bundle: size per route from build output; heavy deps in client-side code (e.g. React client components); barrel imports dragging whole package. Record as series.
|
|
121
103
|
- Media: missing width / height (CLS), no lazy below fold, no responsive sizes.
|
|
@@ -136,19 +118,17 @@ Verify only when applicable.
|
|
|
136
118
|
- [ ] **Step 13 — Server Latency:** `Waterfall` only traced routes → read app-wide: p75 / p95 per server endpoint (e.g. server action, route handler, controller action, DB RPC) from spans; slow queries from DB statistics and platform advisor; background-job step durations and queue lag; LLM calls per model and call site — time to first token, total duration, timeouts, retries, user-facing calls stream or not. **Done when:** `Server Latency` tables per source.
|
|
137
119
|
- [ ] **Step 14 — Long Sessions:** Screens open hours (calendar, dashboard) → open each 30 min, heap snapshots; record memory growth, realtime subscription count, polling intervals. **Done when:** `Long Sessions` row per screen.
|
|
138
120
|
- [ ] **Step 15 — Re-baseline:** Instrument fixes since previous report → pre-fix baseline not reference; re-take `Field Baseline` and `Lab Baseline`; mark figures moved by instrument change, not app. **Done when:** moves marked in `Field Baseline`, or no instrument fix since previous report recorded.
|
|
139
|
-
- [ ] **Step 16 — Closed Follow-Ups:** Follow-ups from previous reports close with decisions only in threads. Read each closed since previous report; sort: A = not done, blocked on owner → named action and blocker; B = deliberately dropped, reasoning holds → recorded so nobody reopens; C = real work nobody owns → new tracker item or named home in scheduled work. Neither tracker nor scheduled work → `docs/deferrals.jsonl` row named. Comment on closed item
|
|
121
|
+
- [ ] **Step 16 — Closed Follow-Ups:** Follow-ups from previous reports close with decisions only in threads. Read each closed since previous report; sort: A = not done, blocked on owner → named action and blocker; B = deliberately dropped, reasoning holds → recorded so nobody reopens; C = real work nobody owns → new tracker item or named home in scheduled work. Neither tracker nor scheduled work → `docs/deferrals.jsonl` row named. Comment on closed item != register. **Done when:** `Closed Follow-Ups` row per item: group · destination.
|
|
140
122
|
- [ ] **Step 17 — Standards:** Confirm current version per anchor standard; read changes since previous report's version. `Standards Coverage`: one row per Core Web Vital and supporting web metric (LCP, INP, CLS, FCP, TTFB), Android vital, iOS organizer metric, framework production-checklist item → checked (name step) / not applicable (why) / finding. Unapplied recommended practice → adopt (propose step) / reject (why) / not applicable. **Done when:** no empty row.
|
|
141
123
|
- [ ] **Step 18 — Anything Else:** (a) Everything changed since previous report's commit touching performance (routes and layouts, client-side code and dependencies, third-party scripts, server endpoints, DB queries and RPCs, background jobs, LLM call sites, region, and caching config, monitoring sampling, native app entry) → one-line verdict each. (b) Bounded ~30 min pass: what a senior performance engineer flags that no step asks; read since previous run (incidents, new `docs/failures.jsonl` rows) — what would no step catch? **Done when:** `Beyond the Steps` holds both passes, or `none`. Class seen on 2 runs → propose step in `Process Improvements`.
|
|
142
124
|
|
|
143
125
|
### 🔒 Gate 2: Probes Check
|
|
144
126
|
|
|
145
|
-
**Checkpoint.** Verify and check `[x]` all boxes below, then continue to `Findings` without asking.
|
|
146
|
-
|
|
147
127
|
- [ ] **Steps complete:** every step `[x]`, or explicit skip with evidence the surface is absent.
|
|
148
128
|
- [ ] **Evidence:** every finding cites re-checkable evidence and the tool behind it.
|
|
149
129
|
- [ ] **Environments:** every figure names environment, window, percentile, and `n`.
|
|
150
130
|
- [ ] **Settings untouched:** no sampling rate, dashboard, or project setting changed.
|
|
151
|
-
- [ ] **Gate 2
|
|
131
|
+
- [ ] **Gate 2 — Verified:** Every checkbox above independently verified and checked off.
|
|
152
132
|
|
|
153
133
|
## Findings
|
|
154
134
|
|
|
@@ -160,7 +140,7 @@ Verify only when applicable.
|
|
|
160
140
|
| `MEDIUM` | Vital `needs improvement`; duplicate or wasted prefetch; unexpected dynamic rendering; main route not back/forward-cache eligible; third party loading before interactive; slow query, job step, or LLM call off the primary path; unvirtualised long list |
|
|
161
141
|
| `LOW` | Static risk signal without measured impact; size drift within budget; series gap |
|
|
162
142
|
|
|
163
|
-
|
|
143
|
+
Within a severity: what unblocks the next measurement first — instrument / pollution, one-line config (region, project settings), contained client trims, decisions, or packages shared with native, needs local repro. Needs diagnosis before sizing → `Expected` says so.
|
|
164
144
|
|
|
165
145
|
<!-- prettier-ignore -->
|
|
166
146
|
| ID | Severity | Location | Evidence | Expected |
|
|
@@ -264,17 +244,13 @@ PENDING
|
|
|
264
244
|
|
|
265
245
|
### 🔒 Gate 3: Report Check
|
|
266
246
|
|
|
267
|
-
|
|
268
|
-
|
|
269
|
-
- [ ] **No placeholders:** Findings table and every `Report` section have no `PENDING`.
|
|
247
|
+
- [ ] **No placeholders:** no `PENDING` left
|
|
270
248
|
- [ ] **Summary:** names count per severity, environments measured, and production `n`.
|
|
271
249
|
- [ ] **Series:** every series beside previous report's numbers, or marked baseline.
|
|
272
|
-
- [ ] **Writes:** only this report
|
|
273
|
-
- [ ] **Process Improvements:** `Universal`
|
|
250
|
+
- [ ] **Writes:** only this report, template `Project Instructions`, and ledger rows changed; throwaway worktrees / remote targets removed.
|
|
251
|
+
- [ ] **Process Improvements:** `Universal` and `Project` filled
|
|
274
252
|
- [ ] **Suggested Issues:** every `MEDIUM`+ finding ID in exactly one row; every row has a `Next Step`.
|
|
275
|
-
- [ ] **Gate 3
|
|
276
|
-
|
|
277
|
-
> `Project Instructions` below `bkit:end` are consumer-owned — `bkit install` never overwrites them, `bkit check` drift stays clean. Add project-specific tools, paths, commands, and checks there, keyed by section or step title; never results.
|
|
253
|
+
- [ ] **Gate 3 — Verified:** Every checkbox above independently verified and checked off.
|
|
278
254
|
|
|
279
255
|
<!-- bkit:end -->
|
|
280
256
|
|