ronce-racine 0.5.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/AGENTS.md +90 -0
- package/LICENSE +21 -0
- package/README.md +281 -0
- package/agents/code-reviewer.md +33 -0
- package/agents/qa-tester.md +28 -0
- package/dist/hooks/README.md +182 -0
- package/dist/hooks/bash-npm-silent.mjs +81 -0
- package/dist/hooks/session-inject.mjs +53 -0
- package/dist/hooks/session-precompact.mjs +36 -0
- package/dist/hooks/session-writer.mjs +142 -0
- package/dist/hooks/skill-reminder.mjs +89 -0
- package/dist/hooks/truncate-bash-output.mjs +46 -0
- package/dist/hooks/truncate-output.mjs +88 -0
- package/dist/hooks/worktree-env-setup.mjs +123 -0
- package/dist/install.js +962 -0
- package/docs/adopting-a-repo.md +80 -0
- package/docs/architecture.md +76 -0
- package/docs/decisions.md +72 -0
- package/docs/developing.md +143 -0
- package/docs/evaluating-skills.md +41 -0
- package/docs/git-worktrees.md +62 -0
- package/docs/rules/clean-architecture-deps.md +66 -0
- package/docs/rules/commits.md +59 -0
- package/docs/rules/detection-gap-protocol.md +55 -0
- package/docs/rules/error-handling-discipline.md +62 -0
- package/docs/rules/minimal-code.md +58 -0
- package/docs/rules/no-raw-sql-interpolation.md +57 -0
- package/docs/rules/pre-commit-secret-detection.md +54 -0
- package/docs/rules/secure-logging.md +53 -0
- package/docs/rules/sql-migrations-discipline.md +58 -0
- package/docs/rules/subscription-cleanup.md +63 -0
- package/docs/rules/test-discipline.md +66 -0
- package/docs/rules/ui-states-complete.md +52 -0
- package/docs/templates/SKILL.template.md +66 -0
- package/docs/templates/rule.template.md +16 -0
- package/docs/writing-a-rule.md +43 -0
- package/docs/writing-a-skill.md +118 -0
- package/package.json +45 -0
- package/rules/clean-architecture-deps.md +20 -0
- package/rules/commits.md +16 -0
- package/rules/detection-gap-protocol.md +35 -0
- package/rules/error-handling-discipline.md +23 -0
- package/rules/minimal-code.md +32 -0
- package/rules/no-raw-sql-interpolation.md +20 -0
- package/rules/pre-commit-secret-detection.md +14 -0
- package/rules/secure-logging.md +16 -0
- package/rules/sql-migrations-discipline.md +18 -0
- package/rules/subscription-cleanup.md +22 -0
- package/rules/test-discipline.md +20 -0
- package/rules/ui-states-complete.md +23 -0
- package/scripts/subscription-leak-scan.ts +53 -0
- package/skills/adversarial-feature-challenge/README.md +65 -0
- package/skills/adversarial-feature-challenge/SKILL.md +96 -0
- package/skills/adversarial-feature-challenge/assets/fuzz-payloads.txt +60 -0
- package/skills/adversarial-feature-challenge/templates/challenge-report.md +42 -0
- package/skills/api-contract-versioning/README.md +62 -0
- package/skills/api-contract-versioning/SKILL.md +76 -0
- package/skills/api-contract-versioning/templates/consumer-inventory.md +29 -0
- package/skills/audit-architecture/README.md +56 -0
- package/skills/audit-architecture/SKILL.md +97 -0
- package/skills/audit-architecture/reference/ar-architecture.md +275 -0
- package/skills/audit-architecture/reference/di-disponibilite.md +252 -0
- package/skills/audit-architecture/reference/im-incidents.md +217 -0
- package/skills/audit-architecture/reference/pa-pannes.md +362 -0
- package/skills/audit-architecture/reference/re-recuperation.md +300 -0
- package/skills/audit-architecture/reference/sc-scalabilite.md +173 -0
- package/skills/audit-architecture/reference/su-support.md +180 -0
- package/skills/audit-ci-cd/README.md +54 -0
- package/skills/audit-ci-cd/SKILL.md +124 -0
- package/skills/audit-ci-cd/reference/artefacts.md +39 -0
- package/skills/audit-ci-cd/reference/deploiement.md +100 -0
- package/skills/audit-ci-cd/reference/dora.md +94 -0
- package/skills/audit-ci-cd/reference/iac.md +40 -0
- package/skills/audit-ci-cd/reference/pipeline-ci.md +36 -0
- package/skills/audit-ci-cd/reference/supply-chain.md +44 -0
- package/skills/audit-compliance/README.md +69 -0
- package/skills/audit-compliance/SKILL.md +176 -0
- package/skills/audit-compliance/reference/conformite-rgpd.md +295 -0
- package/skills/audit-compliance/reference/finops.md +318 -0
- package/skills/audit-compliance/reference/gouvernance-donnees.md +238 -0
- package/skills/audit-industrialisation/README.md +53 -0
- package/skills/audit-industrialisation/SKILL.md +251 -0
- package/skills/audit-observability/README.md +64 -0
- package/skills/audit-observability/SKILL.md +134 -0
- package/skills/audit-observability/reference/alerting.md +214 -0
- package/skills/audit-observability/reference/logging.md +114 -0
- package/skills/audit-observability/reference/metriques.md +166 -0
- package/skills/audit-observability/reference/traces-dashboards.md +90 -0
- package/skills/audit-performance-frontend/README.md +91 -0
- package/skills/audit-performance-frontend/SKILL.md +194 -0
- package/skills/audit-performance-frontend/reference/assets-cache-network.md +129 -0
- package/skills/audit-performance-frontend/reference/css-rendering-pipeline.md +154 -0
- package/skills/audit-performance-frontend/reference/html-critical-path.md +128 -0
- package/skills/audit-performance-frontend/reference/js-engine-runtime.md +280 -0
- package/skills/audit-performance-frontend/reference/memory-gc.md +126 -0
- package/skills/audit-performance-frontend/reference/profiling-tooling.md +98 -0
- package/skills/audit-quality/README.md +85 -0
- package/skills/audit-quality/SKILL.md +126 -0
- package/skills/audit-quality/reference/qa-devops.md +539 -0
- package/skills/audit-quality/reference/qu-qualite-donnees.md +402 -0
- package/skills/audit-report/README.md +72 -0
- package/skills/audit-report/SKILL.md +241 -0
- package/skills/audit-report/reference/scoring-model.md +45 -0
- package/skills/audit-security/README.md +72 -0
- package/skills/audit-security/SKILL.md +140 -0
- package/skills/audit-security/reference/auth-identite.md +98 -0
- package/skills/audit-security/reference/autorisation.md +66 -0
- package/skills/audit-security/reference/chiffrement-tls.md +97 -0
- package/skills/audit-security/reference/detection-patching.md +67 -0
- package/skills/audit-security/reference/incident-response.md +98 -0
- package/skills/audit-security/reference/reseau-conteneurs.md +72 -0
- package/skills/audit-security/reference/secrets.md +36 -0
- package/skills/audit-testing/README.md +82 -0
- package/skills/audit-testing/SKILL.md +131 -0
- package/skills/audit-testing/reference/golden-dataset.md +65 -0
- package/skills/audit-testing/reference/resilience-chaos.md +93 -0
- package/skills/audit-testing/reference/tests-contractuels.md +65 -0
- package/skills/audit-testing/reference/tests-e2e-flaky.md +67 -0
- package/skills/audit-testing/reference/tests-unit-integ-ci.md +125 -0
- package/skills/bug-ticket-root-cause/README.md +67 -0
- package/skills/bug-ticket-root-cause/SKILL.md +86 -0
- package/skills/bug-ticket-root-cause/templates/bug-ticket.md +43 -0
- package/skills/bug-triage-structured/README.md +63 -0
- package/skills/bug-triage-structured/SKILL.md +104 -0
- package/skills/bug-triage-structured/templates/bug-triage.md +38 -0
- package/skills/ci-pipeline-orchestration/README.md +55 -0
- package/skills/ci-pipeline-orchestration/SKILL.md +110 -0
- package/skills/commit-readiness-review/README.md +66 -0
- package/skills/commit-readiness-review/SKILL.md +82 -0
- package/skills/commit-readiness-review/scripts/precommit-scan.ts +81 -0
- package/skills/comprehensive-test-strategy/README.md +64 -0
- package/skills/comprehensive-test-strategy/SKILL.md +108 -0
- package/skills/comprehensive-test-strategy/reference/testing-advanced.md +85 -0
- package/skills/daily-workflow-optimization/README.md +56 -0
- package/skills/daily-workflow-optimization/SKILL.md +80 -0
- package/skills/database-schema-evolution/README.md +54 -0
- package/skills/database-schema-evolution/SKILL.md +107 -0
- package/skills/ddd-backend-implementation/README.md +63 -0
- package/skills/ddd-backend-implementation/SKILL.md +95 -0
- package/skills/design-system-component-lifecycle/README.md +56 -0
- package/skills/design-system-component-lifecycle/SKILL.md +97 -0
- package/skills/design-system-component-lifecycle/templates/component-contract.md +43 -0
- package/skills/detection-sweep/README.md +58 -0
- package/skills/detection-sweep/SKILL.md +93 -0
- package/skills/detection-sweep/scripts/sweep.ts +80 -0
- package/skills/domain-modeling-design/README.md +57 -0
- package/skills/domain-modeling-design/SKILL.md +83 -0
- package/skills/frontend-fullstack-implementation/README.md +60 -0
- package/skills/frontend-fullstack-implementation/SKILL.md +133 -0
- package/skills/frontend-spec-call-site-audit/README.md +66 -0
- package/skills/frontend-spec-call-site-audit/SKILL.md +82 -0
- package/skills/frontend-spec-call-site-audit/scripts/audit-entry-points.ts +79 -0
- package/skills/frontend-spec-call-site-audit/templates/ticket-frontend.md +32 -0
- package/skills/merge-request-review/README.md +60 -0
- package/skills/merge-request-review/SKILL.md +77 -0
- package/skills/merge-request-review/templates/mr-review-report.md +29 -0
- package/skills/production-incident-diagnostic/README.md +63 -0
- package/skills/production-incident-diagnostic/SKILL.md +103 -0
- package/skills/production-incident-diagnostic/templates/incident-report.md +33 -0
- package/skills/qa-session-intake/README.md +56 -0
- package/skills/qa-session-intake/SKILL.md +78 -0
- package/skills/recording-decisions/README.md +91 -0
- package/skills/recording-decisions/SKILL.md +84 -0
- package/skills/recurring-bug-root-cause/README.md +64 -0
- package/skills/recurring-bug-root-cause/SKILL.md +93 -0
- package/skills/recurring-bug-root-cause/scripts/detect-recurring-fixes.ts +46 -0
- package/skills/recurring-bug-root-cause/templates/postmortem-recidive.md +37 -0
- package/skills/refactoring-shared-component-api/README.md +50 -0
- package/skills/refactoring-shared-component-api/SKILL.md +84 -0
- package/skills/refactoring-shared-component-api/scripts/sweep-call-sites.ts +85 -0
- package/skills/refactoring-shared-component-api/templates/migration-checklist.md +19 -0
- package/skills/validating-features-end-to-end/README.md +50 -0
- package/skills/validating-features-end-to-end/SKILL.md +90 -0
- package/skills/visual-regression-check/README.md +51 -0
- package/skills/visual-regression-check/SKILL.md +89 -0
- package/skills/writing-robust-tests/README.md +53 -0
- package/skills/writing-robust-tests/SKILL.md +88 -0
- package/templates/.adopted.example +8 -0
- package/templates/anti-drift.gitlab-ci.yml +23 -0
|
@@ -0,0 +1,539 @@
|
|
|
1
|
+
# Audit grid - QA & DevOps section
|
|
2
|
+
|
|
3
|
+
16 questions. Tests, CI/CD, code quality, dependency security, observability, code review, DORA metrics.
|
|
4
|
+
|
|
5
|
+
## Table of contents
|
|
6
|
+
|
|
7
|
+
- [QA-01 - Coverage measurement and tracking (unit + integration)](#qa-01--coverage-measurement-and-tracking-unit--integration--criticality-must)
|
|
8
|
+
- [QA-01a - Test strategy by criticality](#qa-01a--test-strategy-by-criticality--criticality-should)
|
|
9
|
+
- [QA-02 - Post-deployment smoke tests](#qa-02--post-deployment-smoke-tests--criticality-must)
|
|
10
|
+
- [QA-03 - Single artifact promotion](#qa-03--single-artifact-promotion--criticality-should)
|
|
11
|
+
- [QA-04 - CI/CD quality gates](#qa-04--cicd-quality-gates--criticality-must)
|
|
12
|
+
- [QA-05 - CI/CD feedback speed](#qa-05--cicd-feedback-speed--criticality-should)
|
|
13
|
+
- [QA-06 - Code quality & debt](#qa-06--code-quality--debt--criticality-should)
|
|
14
|
+
- [QA-07 - Dependency security (SCA)](#qa-07--dependency-security-sca--criticality-must)
|
|
15
|
+
- [QA-07a - Dependency update process](#qa-07a--dependency-update-process--criticality-should)
|
|
16
|
+
- [QA-08 - Incident reproducibility](#qa-08--incident-reproducibility--criticality-should)
|
|
17
|
+
- [QA-09 - Realistic test datasets](#qa-09--realistic-test-datasets--criticality-should)
|
|
18
|
+
- [QA-10 - Application profiling](#qa-10--application-profiling--criticality-could)
|
|
19
|
+
- [QA-11 - CI/CD security](#qa-11--cicd-security--criticality-must)
|
|
20
|
+
- [QA-12 - Product-oriented observability](#qa-12--product-oriented-observability--criticality-should)
|
|
21
|
+
- [QA-13 - Code review process](#qa-13--code-review-process--criticality-must)
|
|
22
|
+
- [QA-14 - DORA metrics](#qa-14--dora-metrics--criticality-should)
|
|
23
|
+
|
|
24
|
+
---
|
|
25
|
+
|
|
26
|
+
### QA-01 - Coverage measurement and tracking (unit + integration) - Criticality: **must**
|
|
27
|
+
|
|
28
|
+
**Analyze:** Coverage tools (Istanbul/nyc, JaCoCo, coverage.py, PCOV), coverage quality gates, mutation testing
|
|
29
|
+
|
|
30
|
+
**Check:**
|
|
31
|
+
- Line AND branch coverage measured
|
|
32
|
+
- Coverage reporting in CI (Codecov, Coveralls, SonarQube)
|
|
33
|
+
- Coverage thresholds defined (quality gate)
|
|
34
|
+
- Mutation testing as a complement (Stryker, PIT)
|
|
35
|
+
- Coverage on changed code (clean as you code)
|
|
36
|
+
|
|
37
|
+
**Commands:**
|
|
38
|
+
```bash
|
|
39
|
+
# Look for coverage configs
|
|
40
|
+
ls .nycrc* jest.config* vitest.config* phpunit.xml* 2>/dev/null
|
|
41
|
+
grep -ri "coverage" package.json composer.json 2>/dev/null
|
|
42
|
+
grep -ri "codecov\|coveralls\|sonar" .github/ .gitlab-ci.yml 2>/dev/null
|
|
43
|
+
# Look for mutation testing
|
|
44
|
+
grep -ri "stryker\|infection" package.json composer.json 2>/dev/null
|
|
45
|
+
```
|
|
46
|
+
|
|
47
|
+
**Levels:**
|
|
48
|
+
| Level | Criteria |
|
|
49
|
+
|-------|----------|
|
|
50
|
+
| 0 | No coverage measurement. Tests optional. |
|
|
51
|
+
| 1 | Coverage measured but not tracked. No threshold. |
|
|
52
|
+
| 2 | Coverage > 60% overall. Reporting in CI. No gate. |
|
|
53
|
+
| 3 | Coverage > 80% on critical code. Quality gate. Trending visible. Branch coverage. |
|
|
54
|
+
| 4 | Coverage > 90%. Mutation testing. Coverage by risk area. Continuous improvement tracked. |
|
|
55
|
+
|
|
56
|
+
---
|
|
57
|
+
|
|
58
|
+
### QA-01a - Test strategy by criticality - Criticality: **should**
|
|
59
|
+
|
|
60
|
+
**Analyze:** Test prioritization by business risk, criticality mapping, differentiated coverage by area
|
|
61
|
+
|
|
62
|
+
**Check:**
|
|
63
|
+
- Critical areas identified (payment, auth, personal data)
|
|
64
|
+
- Coverage differentiated by criticality
|
|
65
|
+
- Critical path coverage (critical user journeys at 100%)
|
|
66
|
+
- Risk-based testing documented
|
|
67
|
+
|
|
68
|
+
**Commands:**
|
|
69
|
+
```bash
|
|
70
|
+
# Identify critical code areas
|
|
71
|
+
ls -d **/payment* **/auth* **/billing* **/checkout* 2>/dev/null
|
|
72
|
+
# Check whether criticality tags exist
|
|
73
|
+
grep -ri "critical\|high-risk\|business-critical" tests/ 2>/dev/null | head -10
|
|
74
|
+
```
|
|
75
|
+
|
|
76
|
+
**Levels:**
|
|
77
|
+
| Level | Criteria |
|
|
78
|
+
|-------|----------|
|
|
79
|
+
| 0 | No prioritization. Uniform or random tests. |
|
|
80
|
+
| 1 | Focus on new code. Legacy not covered. |
|
|
81
|
+
| 2 | Mapping of critical areas. Differentiated coverage. |
|
|
82
|
+
| 3 | Risk-based testing. Business impact analysis. Critical paths fully covered. |
|
|
83
|
+
| 4 | Automated risk assessment. Test generation for high-risk areas. Coverage intelligence. |
|
|
84
|
+
|
|
85
|
+
---
|
|
86
|
+
|
|
87
|
+
### QA-02 - Post-deployment smoke tests - Criticality: **must**
|
|
88
|
+
|
|
89
|
+
**Analyze:** Post-deploy smoke-test scripts, health checks, automatic rollback
|
|
90
|
+
|
|
91
|
+
**Check:**
|
|
92
|
+
- Automated smoke tests after every deployment
|
|
93
|
+
- Verification of critical journeys (auth, payment, core features)
|
|
94
|
+
- Execution in < 5 minutes
|
|
95
|
+
- Automatic rollback if smoke tests fail
|
|
96
|
+
- Continuous synthetic monitoring in production
|
|
97
|
+
|
|
98
|
+
**Commands:**
|
|
99
|
+
```bash
|
|
100
|
+
# Look for smoke tests or health checks
|
|
101
|
+
find . -name "*smoke*" -o -name "*health*" -o -name "*sanity*" 2>/dev/null | head -10
|
|
102
|
+
grep -ri "smoke\|health.check\|post.deploy" .github/ .gitlab-ci.yml scripts/ 2>/dev/null
|
|
103
|
+
grep -ri "rollback" .github/ .gitlab-ci.yml scripts/ 2>/dev/null
|
|
104
|
+
```
|
|
105
|
+
|
|
106
|
+
**Levels:**
|
|
107
|
+
| Level | Criteria |
|
|
108
|
+
|-------|----------|
|
|
109
|
+
| 0 | No smoke tests. Validation by users. |
|
|
110
|
+
| 1 | Manual verification of the main endpoints. |
|
|
111
|
+
| 2 | Automated smoke tests for the happy path. < 5 min. |
|
|
112
|
+
| 3 | Complete smoke tests (auth, payment, critical flows). Auto rollback on failure. |
|
|
113
|
+
| 4 | Continuous synthetic monitoring. Real user validation. Progressive rollout gated by smoke tests. |
|
|
114
|
+
|
|
115
|
+
---
|
|
116
|
+
|
|
117
|
+
### QA-03 - Single artifact promotion - Criticality: **should**
|
|
118
|
+
|
|
119
|
+
**Analyze:** Build pipeline, artifact registry, promotion strategy across environments
|
|
120
|
+
|
|
121
|
+
**Check:**
|
|
122
|
+
- Single build (Docker image, JAR) promoted across environments
|
|
123
|
+
- Externalized configuration (env vars, secret manager)
|
|
124
|
+
- No rebuild per environment
|
|
125
|
+
- Artifact signing (Cosign, Docker Content Trust)
|
|
126
|
+
- SLSA provenance
|
|
127
|
+
|
|
128
|
+
**Commands:**
|
|
129
|
+
```bash
|
|
130
|
+
# Check build/deploy pipeline
|
|
131
|
+
grep -ri "build\|push\|deploy\|promote" .github/workflows/ .gitlab-ci.yml 2>/dev/null | head -20
|
|
132
|
+
# Check externalized config
|
|
133
|
+
ls .env* docker-compose*.yml 2>/dev/null
|
|
134
|
+
grep -ri "vault\|secret.manager\|ssm\|configmap" . --include="*.yml" --include="*.yaml" 2>/dev/null | head -10
|
|
135
|
+
# Check signing
|
|
136
|
+
grep -ri "cosign\|content.trust\|slsa" .github/ .gitlab-ci.yml 2>/dev/null
|
|
137
|
+
```
|
|
138
|
+
|
|
139
|
+
**Levels:**
|
|
140
|
+
| Level | Criteria |
|
|
141
|
+
|-------|----------|
|
|
142
|
+
| 0 | Rebuild per environment. Different images in prod. |
|
|
143
|
+
| 1 | Same code promoted but rebuilt. Different config. |
|
|
144
|
+
| 2 | Single artifact (Docker image, JAR). Externalized config. Manual promotion. |
|
|
145
|
+
| 3 | Automated promotion pipeline. Immutable artifacts. Signed images. |
|
|
146
|
+
| 4 | GitOps with declarative promotion. Artifact provenance (SLSA). Supply chain security. |
|
|
147
|
+
|
|
148
|
+
---
|
|
149
|
+
|
|
150
|
+
### QA-04 - CI/CD quality gates - Criticality: **must**
|
|
151
|
+
|
|
152
|
+
**Analyze:** Branch protection, SonarQube quality gates, mandatory CI before merge
|
|
153
|
+
|
|
154
|
+
**Check:**
|
|
155
|
+
- CI must pass to merge (branch protection)
|
|
156
|
+
- Strict quality gates (tests, lint, coverage, security)
|
|
157
|
+
- Bypass impossible or tracked and exceptional
|
|
158
|
+
- Progressive gates (stricter toward prod)
|
|
159
|
+
- CODEOWNERS configured
|
|
160
|
+
|
|
161
|
+
**Commands:**
|
|
162
|
+
```bash
|
|
163
|
+
# Branch protection and CI config
|
|
164
|
+
ls .github/workflows/ .gitlab-ci.yml Jenkinsfile 2>/dev/null
|
|
165
|
+
cat CODEOWNERS .github/CODEOWNERS 2>/dev/null
|
|
166
|
+
# Quality gates
|
|
167
|
+
grep -ri "sonar\|quality.gate" sonar-project.properties .github/ 2>/dev/null
|
|
168
|
+
# Check branch protection via the API if possible
|
|
169
|
+
gh api repos/{owner}/{repo}/branches/main/protection 2>/dev/null | head -20
|
|
170
|
+
```
|
|
171
|
+
|
|
172
|
+
**Levels:**
|
|
173
|
+
| Level | Criteria |
|
|
174
|
+
|-------|----------|
|
|
175
|
+
| 0 | No quality gates. Merge possible even if CI is red. |
|
|
176
|
+
| 1 | CI must pass to merge. Gates manually bypassable. |
|
|
177
|
+
| 2 | Strict quality gates (tests, lint). Bypass tracked and exceptional. |
|
|
178
|
+
| 3 | Complete gates (unit, integration, SAST, coverage). No bypass possible. Branch protection. |
|
|
179
|
+
| 4 | ML-powered quality prediction. Risk-based gates. Automated security review. DAST integrated. |
|
|
180
|
+
|
|
181
|
+
---
|
|
182
|
+
|
|
183
|
+
### QA-05 - CI/CD feedback speed - Criticality: **should**
|
|
184
|
+
|
|
185
|
+
**Analyze:** CI pipeline duration, parallelization, caching, flaky tests
|
|
186
|
+
|
|
187
|
+
**Check:**
|
|
188
|
+
- CI pipeline time (target < 10 min)
|
|
189
|
+
- Job parallelization (lint, tests, SAST in parallel)
|
|
190
|
+
- Caching of dependencies and build
|
|
191
|
+
- Flaky-test handling (quarantine)
|
|
192
|
+
- Predictive test selection
|
|
193
|
+
|
|
194
|
+
**Commands:**
|
|
195
|
+
```bash
|
|
196
|
+
# Analyze the pipeline structure
|
|
197
|
+
cat .github/workflows/*.yml .gitlab-ci.yml 2>/dev/null | grep -E "cache|parallel|needs:|depends_on" | head -20
|
|
198
|
+
# Check caching
|
|
199
|
+
grep -ri "cache\|turbo\|nx" .github/ .gitlab-ci.yml package.json 2>/dev/null | head -10
|
|
200
|
+
# Duration of the last builds
|
|
201
|
+
gh run list --limit 5 2>/dev/null
|
|
202
|
+
```
|
|
203
|
+
|
|
204
|
+
**Levels:**
|
|
205
|
+
| Level | Criteria |
|
|
206
|
+
|-------|----------|
|
|
207
|
+
| 0 | CI > 30 min. Devs do not wait for the result. |
|
|
208
|
+
| 1 | CI 15-30 min. Frequent context switch. |
|
|
209
|
+
| 2 | CI < 15 min. Basic optimizations (cache, parallelism). |
|
|
210
|
+
| 3 | CI < 10 min. Test parallelization. Incremental builds. Flaky test quarantine. |
|
|
211
|
+
| 4 | CI < 5 min for fast feedback. Predictive test selection. Distributed builds. Real-time feedback. |
|
|
212
|
+
|
|
213
|
+
---
|
|
214
|
+
|
|
215
|
+
### QA-06 - Code quality & debt - Criticality: **should**
|
|
216
|
+
|
|
217
|
+
**Analyze:** ESLint/Biome/Pylint configs, SonarQube, cyclomatic complexity, duplication, code smells
|
|
218
|
+
|
|
219
|
+
**Check:**
|
|
220
|
+
- Linter configured and active
|
|
221
|
+
- Formatter configured (Prettier, Black, rustfmt)
|
|
222
|
+
- Complexity measurement (cyclomatic, cognitive)
|
|
223
|
+
- Code duplication measured
|
|
224
|
+
- Technical debt tracked (SonarQube, CodeClimate)
|
|
225
|
+
- Pre-commit hooks (husky, lint-staged, lefthook)
|
|
226
|
+
|
|
227
|
+
**Commands:**
|
|
228
|
+
```bash
|
|
229
|
+
# Linters and formatters
|
|
230
|
+
ls .eslintrc* eslint.config.* .prettierrc* biome.json .phpcs.xml* 2>/dev/null
|
|
231
|
+
# Pre-commit hooks
|
|
232
|
+
ls .husky/ .lefthook.yml 2>/dev/null
|
|
233
|
+
grep "lint-staged\|husky\|lefthook" package.json 2>/dev/null
|
|
234
|
+
# SonarQube
|
|
235
|
+
ls sonar-project.properties .sonarcloud.properties 2>/dev/null
|
|
236
|
+
# Complexity
|
|
237
|
+
grep -ri "complexity\|max-depth\|max-lines" eslint.config.* .eslintrc* 2>/dev/null
|
|
238
|
+
```
|
|
239
|
+
|
|
240
|
+
**Levels:**
|
|
241
|
+
| Level | Criteria |
|
|
242
|
+
|-------|----------|
|
|
243
|
+
| 0 | No quality measurement. Code review is the only source of feedback. |
|
|
244
|
+
| 1 | Basic lint (ESLint, Prettier). No complexity measurement. |
|
|
245
|
+
| 2 | SonarQube or equivalent. Metrics visible. No gate. |
|
|
246
|
+
| 3 | Quality gate on new issues. Technical debt ratio tracked. Clean as you code. |
|
|
247
|
+
| 4 | Quality metrics in the IDE. Automated refactoring suggestions. Architecture compliance. Cognitive complexity limits. |
|
|
248
|
+
|
|
249
|
+
---
|
|
250
|
+
|
|
251
|
+
### QA-07 - Dependency security (SCA) - Criticality: **must**
|
|
252
|
+
|
|
253
|
+
**Analyze:** SCA tools (Snyk, Trivy, Dependabot), SBOM, license compliance
|
|
254
|
+
|
|
255
|
+
**Check:**
|
|
256
|
+
- Dependency scanning in CI (npm audit, Snyk, Trivy)
|
|
257
|
+
- Gate on critical/high vulnerabilities
|
|
258
|
+
- SBOM generated (CycloneDX, SPDX)
|
|
259
|
+
- Remediation SLA by severity
|
|
260
|
+
- License compliance
|
|
261
|
+
|
|
262
|
+
**Commands:**
|
|
263
|
+
```bash
|
|
264
|
+
# SCA tools
|
|
265
|
+
grep -ri "snyk\|trivy\|dependabot\|dependency.check" .github/ .gitlab-ci.yml 2>/dev/null
|
|
266
|
+
ls .github/dependabot.yml renovate.json .snyk 2>/dev/null
|
|
267
|
+
# Check npm audit
|
|
268
|
+
npm audit --json 2>/dev/null | head -5
|
|
269
|
+
# SBOM
|
|
270
|
+
grep -ri "sbom\|cyclonedx\|spdx" .github/ Makefile 2>/dev/null
|
|
271
|
+
```
|
|
272
|
+
|
|
273
|
+
**Levels:**
|
|
274
|
+
| Level | Criteria |
|
|
275
|
+
|-------|----------|
|
|
276
|
+
| 0 | No dependency scanning. Vulnerabilities unknown. |
|
|
277
|
+
| 1 | npm audit / dependabot enabled. Alerts often ignored. |
|
|
278
|
+
| 2 | SCA in CI (Snyk, Trivy). Gate on critical vulnerabilities. |
|
|
279
|
+
| 3 | SCA with remediation guidance. Fix SLA by severity. SBOM generated. |
|
|
280
|
+
| 4 | Continuous monitoring. License compliance. Malicious package detection. VEX. |
|
|
281
|
+
|
|
282
|
+
---
|
|
283
|
+
|
|
284
|
+
### QA-07a - Dependency update process - Criticality: **should**
|
|
285
|
+
|
|
286
|
+
**Analyze:** Dependabot/Renovate, auto-merge patches, upgrade sprints
|
|
287
|
+
|
|
288
|
+
**Check:**
|
|
289
|
+
- Automatic PRs for updates (Dependabot, Renovate)
|
|
290
|
+
- Auto-merge for security patches
|
|
291
|
+
- Dedicated sprints for major updates
|
|
292
|
+
- Compatibility tests on update PRs
|
|
293
|
+
- No dependencies frozen for > 1 year
|
|
294
|
+
|
|
295
|
+
**Commands:**
|
|
296
|
+
```bash
|
|
297
|
+
# Dependabot / Renovate config
|
|
298
|
+
cat .github/dependabot.yml renovate.json 2>/dev/null
|
|
299
|
+
# Check the age of dependencies
|
|
300
|
+
npm outdated 2>/dev/null | head -20
|
|
301
|
+
composer outdated 2>/dev/null | head -20
|
|
302
|
+
```
|
|
303
|
+
|
|
304
|
+
**Levels:**
|
|
305
|
+
| Level | Criteria |
|
|
306
|
+
|-------|----------|
|
|
307
|
+
| 0 | Manual and rare updates. Frequent breaking changes. |
|
|
308
|
+
| 1 | Dependabot/Renovate enabled. Automatic PRs but slow manual review. |
|
|
309
|
+
| 2 | Auto-merge for patches. Review for minors/majors. |
|
|
310
|
+
| 3 | Automated testing of updates. Scheduled upgrade sprints. Changelog review. |
|
|
311
|
+
| 4 | Continuous dependency updates. Automated compatibility testing. Zero-day patch automation. |
|
|
312
|
+
|
|
313
|
+
---
|
|
314
|
+
|
|
315
|
+
### QA-08 - Incident reproducibility - Criticality: **should**
|
|
316
|
+
|
|
317
|
+
**Analyze:** Staging environment, snapshots, request replay, debug tools
|
|
318
|
+
|
|
319
|
+
**Check:**
|
|
320
|
+
- Staging close to prod (infra, anonymized data)
|
|
321
|
+
- Ability to replay the requests that triggered a bug
|
|
322
|
+
- Restorable state snapshots
|
|
323
|
+
- Time-travel debugging available
|
|
324
|
+
- Documented reproduction procedure
|
|
325
|
+
|
|
326
|
+
**Commands:**
|
|
327
|
+
```bash
|
|
328
|
+
# Environments
|
|
329
|
+
grep -ri "staging\|preprod\|sandbox" docker-compose*.yml .env* 2>/dev/null | head -10
|
|
330
|
+
# Replay/debug tools
|
|
331
|
+
grep -ri "goreplay\|replay\|debug" scripts/ 2>/dev/null
|
|
332
|
+
# Data seeds / fixtures
|
|
333
|
+
find . -name "*seed*" -o -name "*fixture*" -o -name "*factory*" 2>/dev/null | head -10
|
|
334
|
+
```
|
|
335
|
+
|
|
336
|
+
**Levels:**
|
|
337
|
+
| Level | Criteria |
|
|
338
|
+
|-------|----------|
|
|
339
|
+
| 0 | No reproducibility. Debugging in prod. |
|
|
340
|
+
| 1 | Logs for analysis. Manual reproduction difficult. |
|
|
341
|
+
| 2 | Staging environment close to prod. Reproduction possible with effort. |
|
|
342
|
+
| 3 | Restorable client-state snapshot. Request replay. Non-intrusive debugging. |
|
|
343
|
+
| 4 | Time-travel debugging. Production replay in sandbox. Automated reproduction. Observability-driven debugging. |
|
|
344
|
+
|
|
345
|
+
---
|
|
346
|
+
|
|
347
|
+
### QA-09 - Realistic test datasets - Criticality: **should**
|
|
348
|
+
|
|
349
|
+
**Analyze:** Fixtures, seeds, anonymized data, synthetic data generation, property-based testing
|
|
350
|
+
|
|
351
|
+
**Check:**
|
|
352
|
+
- Datasets representative of prod (volume, diversity)
|
|
353
|
+
- Anonymization of prod data for tests
|
|
354
|
+
- Synthetic data generation (Faker, etc.)
|
|
355
|
+
- Property-based testing (fast-check, Hypothesis)
|
|
356
|
+
- Edge cases covered (unicode, boundary values, volumes)
|
|
357
|
+
|
|
358
|
+
**Commands:**
|
|
359
|
+
```bash
|
|
360
|
+
# Seeds / factories
|
|
361
|
+
find . -name "*seed*" -o -name "*factory*" -o -name "*faker*" 2>/dev/null | head -10
|
|
362
|
+
grep -ri "faker\|factory\|seed" package.json composer.json 2>/dev/null
|
|
363
|
+
# Property-based testing
|
|
364
|
+
grep -ri "fast-check\|hypothesis\|quickcheck\|property.test" package.json tests/ 2>/dev/null
|
|
365
|
+
```
|
|
366
|
+
|
|
367
|
+
**Levels:**
|
|
368
|
+
| Level | Criteria |
|
|
369
|
+
|-------|----------|
|
|
370
|
+
| 0 | Minimal or nonexistent test data. Happy path only. |
|
|
371
|
+
| 1 | Manual fixtures. Not representative of prod. |
|
|
372
|
+
| 2 | Golden dataset anonymized from prod. Occasional refresh. |
|
|
373
|
+
| 3 | Realistic data generation. Edge cases covered. Property-based testing. |
|
|
374
|
+
| 4 | Synthetic data generation. Prod-like distribution. Continuous data quality. Chaos data injection. |
|
|
375
|
+
|
|
376
|
+
---
|
|
377
|
+
|
|
378
|
+
### QA-10 - Application profiling - Criticality: **could**
|
|
379
|
+
|
|
380
|
+
**Analyze:** APM (Datadog, New Relic), continuous profiling, flame graphs, SQL query analysis
|
|
381
|
+
|
|
382
|
+
**Check:**
|
|
383
|
+
- APM configured (Datadog, New Relic, Elastic APM)
|
|
384
|
+
- Dev profiling available (xdebug, Chrome DevTools)
|
|
385
|
+
- Continuous profiling in prod (Pyroscope, Datadog Profiler)
|
|
386
|
+
- SQL query analysis (slow queries, N+1 detection)
|
|
387
|
+
- Memory leak detection
|
|
388
|
+
|
|
389
|
+
**Commands:**
|
|
390
|
+
```bash
|
|
391
|
+
# APM / profiling
|
|
392
|
+
grep -ri "datadog\|newrelic\|elastic.apm\|sentry\|pyroscope" package.json composer.json .env* 2>/dev/null
|
|
393
|
+
grep -ri "xdebug\|blackfire" php.ini docker-compose*.yml 2>/dev/null
|
|
394
|
+
# N+1 detection
|
|
395
|
+
grep -ri "bullet\|nplusone\|telescope" composer.json package.json 2>/dev/null
|
|
396
|
+
```
|
|
397
|
+
|
|
398
|
+
**Levels:**
|
|
399
|
+
| Level | Criteria |
|
|
400
|
+
|-------|----------|
|
|
401
|
+
| 0 | No profiling. Performance issues discovered in prod. |
|
|
402
|
+
| 1 | Ad-hoc profiling when a problem is reported. |
|
|
403
|
+
| 2 | Basic APM (New Relic, Datadog). Main metrics visible. |
|
|
404
|
+
| 3 | Continuous profiling. Flame graphs. SQL query analysis. Memory leak detection. |
|
|
405
|
+
| 4 | Always-on profiling in prod. Performance regression detection. Automated optimization suggestions. |
|
|
406
|
+
|
|
407
|
+
---
|
|
408
|
+
|
|
409
|
+
### QA-11 - CI/CD security - Criticality: **must**
|
|
410
|
+
|
|
411
|
+
**Analyze:** Secret scanning, ephemeral runners, signed commits, SLSA compliance
|
|
412
|
+
|
|
413
|
+
**Check:**
|
|
414
|
+
- Secret scanning in CI (GitLeaks, TruffleHog)
|
|
415
|
+
- Secrets in a secret manager (not in plaintext env vars)
|
|
416
|
+
- Ephemeral runners (no persistence between jobs)
|
|
417
|
+
- Signed commits for protected branches
|
|
418
|
+
- SAST integrated into the pipeline (Semgrep, CodeQL)
|
|
419
|
+
|
|
420
|
+
**Commands:**
|
|
421
|
+
```bash
|
|
422
|
+
# Secret scanning
|
|
423
|
+
grep -ri "gitleaks\|trufflehog\|secret.scan" .github/ .gitlab-ci.yml .pre-commit-config.yaml 2>/dev/null
|
|
424
|
+
# SAST
|
|
425
|
+
grep -ri "semgrep\|codeql\|sast\|bandit\|phpstan\|psalm" .github/ .gitlab-ci.yml 2>/dev/null
|
|
426
|
+
# Signed commits
|
|
427
|
+
git log --show-signature -1 2>/dev/null | head -5
|
|
428
|
+
# Check whether secrets are in plaintext in the repo
|
|
429
|
+
grep -ri "password\|secret\|api.key" .env 2>/dev/null | head -5
|
|
430
|
+
```
|
|
431
|
+
|
|
432
|
+
**Levels:**
|
|
433
|
+
| Level | Criteria |
|
|
434
|
+
|-------|----------|
|
|
435
|
+
| 0 | Shared runners. Secrets in environment variables. No scan. |
|
|
436
|
+
| 1 | Dedicated runners. Secrets in a secret manager. No scan. |
|
|
437
|
+
| 2 | Secret scanning in CI (GitLeaks). Basic SAST. Least privilege for runners. |
|
|
438
|
+
| 3 | SAST + DAST. Signed commits. Versioned pipeline-as-code. Audit trail. |
|
|
439
|
+
| 4 | Zero-trust CI/CD. Ephemeral runners. SLSA Level 3+. Supply chain attestation. Hermetic builds. |
|
|
440
|
+
|
|
441
|
+
---
|
|
442
|
+
|
|
443
|
+
### QA-12 - Product-oriented observability - Criticality: **should**
|
|
444
|
+
|
|
445
|
+
**Analyze:** Business SLOs, customer-impact dashboards, feature usage tracking, technical-business correlation
|
|
446
|
+
|
|
447
|
+
**Check:**
|
|
448
|
+
- Business KPIs defined (conversion rate, activation, retention)
|
|
449
|
+
- Unified technical + business dashboard
|
|
450
|
+
- SLOs on user journeys (not only on infra)
|
|
451
|
+
- Alerts on business-metric degradation
|
|
452
|
+
- Feature usage tracking (Amplitude, Mixpanel, PostHog)
|
|
453
|
+
|
|
454
|
+
**Commands:**
|
|
455
|
+
```bash
|
|
456
|
+
# Product analytics
|
|
457
|
+
grep -ri "amplitude\|mixpanel\|posthog\|segment\|analytics" package.json .env* 2>/dev/null
|
|
458
|
+
# SLOs
|
|
459
|
+
grep -ri "slo\|error.budget\|conversion\|funnel" . --include="*.yml" --include="*.yaml" 2>/dev/null | head -10
|
|
460
|
+
# Feature flags
|
|
461
|
+
grep -ri "launchdarkly\|feature.flag\|unleash\|flagsmith" package.json .env* 2>/dev/null
|
|
462
|
+
```
|
|
463
|
+
|
|
464
|
+
**Levels:**
|
|
465
|
+
| Level | Criteria |
|
|
466
|
+
|-------|----------|
|
|
467
|
+
| 0 | Technical metrics only. No business view. |
|
|
468
|
+
| 1 | A few business metrics in separate dashboards. |
|
|
469
|
+
| 2 | Business KPIs defined. Unified technical + business dashboard. |
|
|
470
|
+
| 3 | Business SLOs (conversion, activation). Alerts on business degradation. Customer impact visible. |
|
|
471
|
+
| 4 | Product analytics integrated. Feature usage tracking. Business impact correlation. Data-driven decisions. |
|
|
472
|
+
|
|
473
|
+
---
|
|
474
|
+
|
|
475
|
+
### QA-13 - Code review process - Criticality: **must**
|
|
476
|
+
|
|
477
|
+
**Analyze:** PR workflow, CODEOWNERS, review SLA, review guidelines
|
|
478
|
+
|
|
479
|
+
**Check:**
|
|
480
|
+
- Mandatory reviews via PR before merge
|
|
481
|
+
- At least 1 reviewer required (2 for critical code)
|
|
482
|
+
- CODEOWNERS configured
|
|
483
|
+
- Review guidelines documented
|
|
484
|
+
- Review SLA < 4h tracked
|
|
485
|
+
- PR size < 400 lines
|
|
486
|
+
|
|
487
|
+
**Commands:**
|
|
488
|
+
```bash
|
|
489
|
+
# CODEOWNERS
|
|
490
|
+
cat CODEOWNERS .github/CODEOWNERS 2>/dev/null
|
|
491
|
+
# Branch protection
|
|
492
|
+
gh api repos/{owner}/{repo}/branches/main/protection 2>/dev/null | head -20
|
|
493
|
+
# Review guidelines
|
|
494
|
+
ls CONTRIBUTING.md .github/CONTRIBUTING.md .github/pull_request_template.md 2>/dev/null
|
|
495
|
+
# Size of recent PRs
|
|
496
|
+
gh pr list --state merged --limit 5 --json additions,deletions 2>/dev/null
|
|
497
|
+
```
|
|
498
|
+
|
|
499
|
+
**Levels:**
|
|
500
|
+
| Level | Criteria |
|
|
501
|
+
|-------|----------|
|
|
502
|
+
| 0 | No code review. Direct merge to the main branch. |
|
|
503
|
+
| 1 | Optional reviews. No guidelines. Review time not tracked. |
|
|
504
|
+
| 2 | Mandatory reviews via PR. At least 1 reviewer required. Basic guidelines. |
|
|
505
|
+
| 3 | Documented guidelines. SLA on review time. Multiple reviewers for critical paths. CODEOWNERS. |
|
|
506
|
+
| 4 | Automated assistance (AI/linters). Review metrics tracked. Reviewer rotation. Pair/mob programming. |
|
|
507
|
+
|
|
508
|
+
---
|
|
509
|
+
|
|
510
|
+
### QA-14 - DORA metrics - Criticality: **should**
|
|
511
|
+
|
|
512
|
+
**Analyze:** Deployment Frequency, Lead Time for Changes, Change Failure Rate, MTTR
|
|
513
|
+
|
|
514
|
+
**Check:**
|
|
515
|
+
- The 4 DORA metrics are known to the team
|
|
516
|
+
- Automated measurement (Sleuth, LinearB, Jellyfish, DORA dashboard)
|
|
517
|
+
- Targets defined per metric
|
|
518
|
+
- Dashboards visible to the team
|
|
519
|
+
- Improvement cycles based on the metrics
|
|
520
|
+
|
|
521
|
+
**Commands:**
|
|
522
|
+
```bash
|
|
523
|
+
# Deployment frequency (approximation)
|
|
524
|
+
gh release list --limit 10 2>/dev/null
|
|
525
|
+
git log --oneline --since="1 month ago" --merges 2>/dev/null | wc -l
|
|
526
|
+
# Lead time (approximation via PRs)
|
|
527
|
+
gh pr list --state merged --limit 5 --json createdAt,mergedAt 2>/dev/null
|
|
528
|
+
```
|
|
529
|
+
|
|
530
|
+
**Levels:**
|
|
531
|
+
| Level | Criteria |
|
|
532
|
+
|-------|----------|
|
|
533
|
+
| 0 | No delivery metric tracked. |
|
|
534
|
+
| 1 | Awareness of DORA metrics but no measurement in place. |
|
|
535
|
+
| 2 | Manual measurement of some metrics (e.g. deployment frequency). |
|
|
536
|
+
| 3 | Automated tracking of the 4 metrics. Visible dashboards. Targets defined. |
|
|
537
|
+
| 4 | Improvement cycles driven by the metrics. Elite targets. Predictive analytics on delivery performance. |
|
|
538
|
+
|
|
539
|
+
---
|