dojo.md 0.1.0 → 0.2.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/courses/GENERATION_LOG.md +27 -0
- package/courses/api-error-handling/course.yaml +16 -0
- package/courses/api-error-handling/scenarios/level-1/error-response-format.yaml +131 -0
- package/courses/api-error-handling/scenarios/level-1/http-status-codes-basics.yaml +90 -0
- package/courses/api-error-handling/scenarios/level-1/rate-limiting-basics.yaml +135 -0
- package/courses/api-error-handling/scenarios/level-1/request-validation-errors.yaml +208 -0
- package/courses/api-error-handling/scenarios/level-2/circuit-breaker-pattern.yaml +189 -0
- package/courses/api-error-handling/scenarios/level-2/idempotency-retry-logic.yaml +159 -0
- package/courses/api-error-handling/scenarios/level-2/rfc-7807-problem-details.yaml +178 -0
- package/courses/api-error-handling/scenarios/level-2/webhook-error-handling.yaml +211 -0
- package/courses/api-error-handling/scenarios/level-3/distributed-tracing-errors.yaml +275 -0
- package/courses/github-actions-cicd/course.yaml +10 -0
- package/courses/github-actions-cicd/scenarios/level-1/actions-and-runners.yaml +58 -0
- package/courses/github-actions-cicd/scenarios/level-1/basic-workflow-syntax.yaml +52 -0
- package/courses/github-actions-cicd/scenarios/level-1/branch-protection-checks.yaml +63 -0
- package/courses/github-actions-cicd/scenarios/level-1/environment-variables-secrets.yaml +65 -0
- package/courses/github-actions-cicd/scenarios/level-1/first-cicd-shift.yaml +62 -0
- package/courses/github-actions-cicd/scenarios/level-1/job-dependencies-outputs.yaml +62 -0
- package/courses/github-actions-cicd/scenarios/level-1/simple-ci-pipeline.yaml +57 -0
- package/courses/github-actions-cicd/scenarios/level-1/workflow-debugging.yaml +90 -0
- package/courses/github-actions-cicd/scenarios/level-1/workflow-status-notifications.yaml +59 -0
- package/courses/github-actions-cicd/scenarios/level-1/workflow-triggers.yaml +56 -0
- package/courses/github-actions-cicd/scenarios/level-2/concurrency-control.yaml +58 -0
- package/courses/github-actions-cicd/scenarios/level-2/conditional-execution.yaml +60 -0
- package/courses/github-actions-cicd/scenarios/level-2/custom-actions-development.yaml +55 -0
- package/courses/github-actions-cicd/scenarios/level-2/dependency-caching.yaml +58 -0
- package/courses/github-actions-cicd/scenarios/level-2/deployment-workflows.yaml +61 -0
- package/courses/github-actions-cicd/scenarios/level-2/github-packages-publishing.yaml +59 -0
- package/courses/github-actions-cicd/scenarios/level-2/intermediate-cicd-shift.yaml +68 -0
- package/courses/github-actions-cicd/scenarios/level-2/matrix-builds.yaml +59 -0
- package/courses/github-actions-cicd/scenarios/level-2/reusable-workflows.yaml +61 -0
- package/courses/github-actions-cicd/scenarios/level-2/workflow-cost-optimization.yaml +61 -0
- package/courses/github-actions-cicd/scenarios/level-3/advanced-cicd-shift.yaml +64 -0
- package/courses/github-actions-cicd/scenarios/level-3/compliance-automation.yaml +68 -0
- package/courses/github-actions-cicd/scenarios/level-3/docker-action-development.yaml +65 -0
- package/courses/github-actions-cicd/scenarios/level-3/github-environments.yaml +65 -0
- package/courses/github-actions-cicd/scenarios/level-3/monorepo-ci.yaml +68 -0
- package/courses/github-actions-cicd/scenarios/level-3/oidc-cloud-deployments.yaml +55 -0
- package/courses/github-actions-cicd/scenarios/level-3/release-automation.yaml +61 -0
- package/courses/github-actions-cicd/scenarios/level-3/security-hardening.yaml +63 -0
- package/courses/github-actions-cicd/scenarios/level-3/self-hosted-runners.yaml +60 -0
- package/courses/github-actions-cicd/scenarios/level-3/workflow-optimization.yaml +59 -0
- package/courses/github-actions-cicd/scenarios/level-4/cicd-data-architecture.yaml +63 -0
- package/courses/github-actions-cicd/scenarios/level-4/cicd-economics-roi.yaml +63 -0
- package/courses/github-actions-cicd/scenarios/level-4/cicd-executive-communication.yaml +58 -0
- package/courses/github-actions-cicd/scenarios/level-4/cicd-incident-response.yaml +60 -0
- package/courses/github-actions-cicd/scenarios/level-4/cicd-org-design.yaml +59 -0
- package/courses/github-actions-cicd/scenarios/level-4/cicd-platform-architecture.yaml +63 -0
- package/courses/github-actions-cicd/scenarios/level-4/cicd-training-program.yaml +65 -0
- package/courses/github-actions-cicd/scenarios/level-4/cicd-vendor-evaluation.yaml +59 -0
- package/courses/github-actions-cicd/scenarios/level-4/enterprise-cicd-governance.yaml +55 -0
- package/courses/github-actions-cicd/scenarios/level-4/expert-cicd-shift.yaml +60 -0
- package/courses/github-actions-cicd/scenarios/level-5/cicd-ai-future.yaml +63 -0
- package/courses/github-actions-cicd/scenarios/level-5/cicd-behavioral-science.yaml +70 -0
- package/courses/github-actions-cicd/scenarios/level-5/cicd-board-strategy.yaml +56 -0
- package/courses/github-actions-cicd/scenarios/level-5/cicd-consulting-engagement.yaml +61 -0
- package/courses/github-actions-cicd/scenarios/level-5/cicd-industry-benchmarks.yaml +63 -0
- package/courses/github-actions-cicd/scenarios/level-5/cicd-ma-integration.yaml +73 -0
- package/courses/github-actions-cicd/scenarios/level-5/cicd-product-development.yaml +68 -0
- package/courses/github-actions-cicd/scenarios/level-5/cicd-regulatory-landscape.yaml +72 -0
- package/courses/github-actions-cicd/scenarios/level-5/comprehensive-cicd-system.yaml +66 -0
- package/courses/github-actions-cicd/scenarios/level-5/master-cicd-shift.yaml +76 -0
- package/courses/github-pr-review/scenarios/level-2/api-change-review.yaml +82 -0
- package/courses/github-pr-review/scenarios/level-2/automated-review-tooling.yaml +53 -0
- package/courses/github-pr-review/scenarios/level-2/cross-team-review.yaml +61 -0
- package/courses/github-pr-review/scenarios/level-2/intermediate-review-shift.yaml +66 -0
- package/courses/github-pr-review/scenarios/level-2/performance-review-patterns.yaml +99 -0
- package/courses/github-pr-review/scenarios/level-2/review-disagreement-resolution.yaml +64 -0
- package/courses/github-pr-review/scenarios/level-2/review-metrics-analysis.yaml +63 -0
- package/courses/github-pr-review/scenarios/level-2/review-turnaround-sla.yaml +54 -0
- package/courses/github-pr-review/scenarios/level-2/stacked-pr-review.yaml +65 -0
- package/courses/github-pr-review/scenarios/level-3/advanced-review-shift.yaml +65 -0
- package/courses/github-pr-review/scenarios/level-3/ai-powered-review.yaml +58 -0
- package/courses/github-pr-review/scenarios/level-3/compliance-review-process.yaml +64 -0
- package/courses/github-pr-review/scenarios/level-3/cross-functional-review.yaml +60 -0
- package/courses/github-pr-review/scenarios/level-3/incident-driven-review.yaml +63 -0
- package/courses/github-pr-review/scenarios/level-3/large-scale-review-operations.yaml +55 -0
- package/courses/github-pr-review/scenarios/level-3/monorepo-review-process.yaml +68 -0
- package/courses/github-pr-review/scenarios/level-3/review-automation-platform.yaml +61 -0
- package/courses/github-pr-review/scenarios/level-3/review-culture-design.yaml +62 -0
- package/courses/github-pr-review/scenarios/level-3/review-data-pipeline.yaml +62 -0
- package/courses/github-pr-review/scenarios/level-4/enterprise-review-operations.yaml +61 -0
- package/courses/github-pr-review/scenarios/level-4/expert-review-shift.yaml +62 -0
- package/courses/github-pr-review/scenarios/level-4/review-data-architecture.yaml +69 -0
- package/courses/github-pr-review/scenarios/level-4/review-economics-roi.yaml +63 -0
- package/courses/github-pr-review/scenarios/level-4/review-executive-communication.yaml +61 -0
- package/courses/github-pr-review/scenarios/level-4/review-incident-postmortem.yaml +69 -0
- package/courses/github-pr-review/scenarios/level-4/review-org-design.yaml +62 -0
- package/courses/github-pr-review/scenarios/level-4/review-platform-architecture.yaml +64 -0
- package/courses/github-pr-review/scenarios/level-4/review-training-program.yaml +66 -0
- package/courses/github-pr-review/scenarios/level-4/review-vendor-evaluation.yaml +76 -0
- package/courses/github-pr-review/scenarios/level-5/comprehensive-review-system.yaml +68 -0
- package/courses/github-pr-review/scenarios/level-5/master-review-shift.yaml +73 -0
- package/courses/github-pr-review/scenarios/level-5/review-ai-future.yaml +69 -0
- package/courses/github-pr-review/scenarios/level-5/review-behavioral-science.yaml +66 -0
- package/courses/github-pr-review/scenarios/level-5/review-board-strategy.yaml +62 -0
- package/courses/github-pr-review/scenarios/level-5/review-consulting-engagement.yaml +62 -0
- package/courses/github-pr-review/scenarios/level-5/review-devtools-product.yaml +71 -0
- package/courses/github-pr-review/scenarios/level-5/review-industry-benchmarks.yaml +64 -0
- package/courses/github-pr-review/scenarios/level-5/review-ma-integration.yaml +76 -0
- package/courses/github-pr-review/scenarios/level-5/review-regulatory-landscape.yaml +78 -0
- package/courses/postgresql-query-optimization/course.yaml +11 -0
- package/courses/postgresql-query-optimization/scenarios/level-1/explain-analyze-basics.yaml +80 -0
- package/courses/postgresql-query-optimization/scenarios/level-1/first-optimization-shift.yaml +77 -0
- package/courses/postgresql-query-optimization/scenarios/level-1/index-fundamentals.yaml +76 -0
- package/courses/postgresql-query-optimization/scenarios/level-1/join-basics.yaml +73 -0
- package/courses/postgresql-query-optimization/scenarios/level-1/n-plus-one-queries.yaml +62 -0
- package/courses/postgresql-query-optimization/scenarios/level-1/query-rewriting-basics.yaml +69 -0
- package/courses/postgresql-query-optimization/scenarios/level-1/select-star-problems.yaml +69 -0
- package/courses/postgresql-query-optimization/scenarios/level-1/slow-query-diagnosis.yaml +63 -0
- package/courses/postgresql-query-optimization/scenarios/level-1/vacuum-and-statistics.yaml +62 -0
- package/courses/postgresql-query-optimization/scenarios/level-1/where-clause-optimization.yaml +74 -0
- package/courses/postgresql-query-optimization/scenarios/level-2/autovacuum-tuning.yaml +76 -0
- package/courses/postgresql-query-optimization/scenarios/level-2/composite-index-design.yaml +81 -0
- package/courses/postgresql-query-optimization/scenarios/level-2/covering-indexes.yaml +74 -0
- package/courses/postgresql-query-optimization/scenarios/level-2/cte-optimization.yaml +83 -0
- package/courses/postgresql-query-optimization/scenarios/level-2/intermediate-optimization-shift.yaml +66 -0
- package/courses/postgresql-query-optimization/scenarios/level-2/join-optimization.yaml +72 -0
- package/courses/postgresql-query-optimization/scenarios/level-2/partial-and-expression-indexes.yaml +75 -0
- package/courses/postgresql-query-optimization/scenarios/level-2/query-planner-settings.yaml +62 -0
- package/courses/postgresql-query-optimization/scenarios/level-2/subquery-optimization.yaml +67 -0
- package/courses/postgresql-query-optimization/scenarios/level-2/window-function-optimization.yaml +63 -0
- package/courses/postgresql-query-optimization/scenarios/level-3/advanced-optimization-shift.yaml +71 -0
- package/courses/postgresql-query-optimization/scenarios/level-3/connection-pooling.yaml +60 -0
- package/courses/postgresql-query-optimization/scenarios/level-3/full-text-search-optimization.yaml +66 -0
- package/courses/postgresql-query-optimization/scenarios/level-3/jsonb-optimization.yaml +88 -0
- package/courses/postgresql-query-optimization/scenarios/level-3/lock-contention-analysis.yaml +80 -0
- package/courses/postgresql-query-optimization/scenarios/level-3/materialized-view-optimization.yaml +73 -0
- package/courses/postgresql-query-optimization/scenarios/level-3/parallel-query-execution.yaml +74 -0
- package/courses/postgresql-query-optimization/scenarios/level-3/partitioning-strategies.yaml +71 -0
- package/courses/postgresql-query-optimization/scenarios/level-3/specialized-index-types.yaml +67 -0
- package/courses/postgresql-query-optimization/scenarios/level-3/write-optimization.yaml +65 -0
- package/courses/postgresql-query-optimization/scenarios/level-4/data-architecture-analytics.yaml +64 -0
- package/courses/postgresql-query-optimization/scenarios/level-4/database-executive-communication.yaml +64 -0
- package/courses/postgresql-query-optimization/scenarios/level-4/database-migration-planning.yaml +57 -0
- package/courses/postgresql-query-optimization/scenarios/level-4/enterprise-database-governance.yaml +52 -0
- package/courses/postgresql-query-optimization/scenarios/level-4/expert-optimization-shift.yaml +73 -0
- package/courses/postgresql-query-optimization/scenarios/level-4/high-availability-architecture.yaml +62 -0
- package/courses/postgresql-query-optimization/scenarios/level-4/optimizer-internals.yaml +69 -0
- package/courses/postgresql-query-optimization/scenarios/level-4/performance-sla-design.yaml +58 -0
- package/courses/postgresql-query-optimization/scenarios/level-4/read-replica-optimization.yaml +62 -0
- package/courses/postgresql-query-optimization/scenarios/level-4/vendor-evaluation.yaml +73 -0
- package/courses/rest-api-error-handling/course.yaml +11 -0
- package/courses/rest-api-error-handling/scenarios/level-1/authentication-errors.yaml +71 -0
- package/courses/rest-api-error-handling/scenarios/level-1/content-negotiation-errors.yaml +63 -0
- package/courses/rest-api-error-handling/scenarios/level-1/error-logging-basics.yaml +63 -0
- package/courses/rest-api-error-handling/scenarios/level-1/error-response-format.yaml +58 -0
- package/courses/rest-api-error-handling/scenarios/level-1/first-error-handling-shift.yaml +67 -0
- package/courses/rest-api-error-handling/scenarios/level-1/http-status-codes.yaml +46 -0
- package/courses/rest-api-error-handling/scenarios/level-1/not-found-errors.yaml +52 -0
- package/courses/rest-api-error-handling/scenarios/level-1/rate-limiting-errors.yaml +56 -0
- package/courses/rest-api-error-handling/scenarios/level-1/request-validation-errors.yaml +59 -0
- package/courses/rest-api-error-handling/scenarios/level-1/server-error-handling.yaml +55 -0
- package/courses/rest-api-error-handling/scenarios/level-2/api-versioning-errors.yaml +66 -0
- package/courses/rest-api-error-handling/scenarios/level-2/batch-request-errors.yaml +61 -0
- package/courses/rest-api-error-handling/scenarios/level-2/circuit-breaker-pattern.yaml +52 -0
- package/courses/rest-api-error-handling/scenarios/level-2/error-code-taxonomy.yaml +62 -0
- package/courses/rest-api-error-handling/scenarios/level-2/error-monitoring-alerting.yaml +53 -0
- package/courses/rest-api-error-handling/scenarios/level-2/intermediate-error-shift.yaml +69 -0
- package/courses/rest-api-error-handling/scenarios/level-2/pagination-errors.yaml +66 -0
- package/courses/rest-api-error-handling/scenarios/level-2/retry-and-idempotency.yaml +60 -0
- package/courses/rest-api-error-handling/scenarios/level-2/rfc7807-problem-details.yaml +60 -0
- package/courses/rest-api-error-handling/scenarios/level-2/webhook-error-handling.yaml +55 -0
- package/courses/rest-api-error-handling/scenarios/level-3/advanced-error-shift.yaml +72 -0
- package/courses/rest-api-error-handling/scenarios/level-3/api-gateway-errors.yaml +71 -0
- package/courses/rest-api-error-handling/scenarios/level-3/async-api-errors.yaml +67 -0
- package/courses/rest-api-error-handling/scenarios/level-3/caching-error-scenarios.yaml +65 -0
- package/courses/rest-api-error-handling/scenarios/level-3/chaos-engineering-apis.yaml +62 -0
- package/courses/rest-api-error-handling/scenarios/level-3/database-error-handling.yaml +79 -0
- package/courses/rest-api-error-handling/scenarios/level-3/distributed-error-propagation.yaml +63 -0
- package/courses/rest-api-error-handling/scenarios/level-3/error-budgets-sre.yaml +61 -0
- package/courses/rest-api-error-handling/scenarios/level-3/error-correlation.yaml +58 -0
- package/courses/rest-api-error-handling/scenarios/level-3/graphql-vs-rest-errors.yaml +73 -0
- package/courses/rest-api-error-handling/scenarios/level-4/compliance-error-handling.yaml +65 -0
- package/courses/rest-api-error-handling/scenarios/level-4/enterprise-error-governance.yaml +62 -0
- package/courses/rest-api-error-handling/scenarios/level-4/error-analytics-platform.yaml +65 -0
- package/courses/rest-api-error-handling/scenarios/level-4/error-cost-optimization.yaml +63 -0
- package/courses/rest-api-error-handling/scenarios/level-4/error-executive-communication.yaml +60 -0
- package/courses/rest-api-error-handling/scenarios/level-4/error-handling-architecture.yaml +67 -0
- package/courses/rest-api-error-handling/scenarios/level-4/error-org-design.yaml +68 -0
- package/courses/rest-api-error-handling/scenarios/level-4/error-sla-design.yaml +65 -0
- package/courses/rest-api-error-handling/scenarios/level-4/error-training-program.yaml +61 -0
- package/courses/rest-api-error-handling/scenarios/level-4/expert-error-shift.yaml +63 -0
- package/courses/rest-api-error-handling/scenarios/level-5/comprehensive-error-system.yaml +68 -0
- package/courses/rest-api-error-handling/scenarios/level-5/error-ai-future.yaml +75 -0
- package/courses/rest-api-error-handling/scenarios/level-5/error-behavioral-science.yaml +73 -0
- package/courses/rest-api-error-handling/scenarios/level-5/error-board-strategy.yaml +60 -0
- package/courses/rest-api-error-handling/scenarios/level-5/error-consulting-engagement.yaml +58 -0
- package/courses/rest-api-error-handling/scenarios/level-5/error-industry-benchmarks.yaml +72 -0
- package/courses/rest-api-error-handling/scenarios/level-5/error-ma-integration.yaml +68 -0
- package/courses/rest-api-error-handling/scenarios/level-5/error-product-development.yaml +66 -0
- package/courses/rest-api-error-handling/scenarios/level-5/error-regulatory-landscape.yaml +80 -0
- package/courses/rest-api-error-handling/scenarios/level-5/master-error-shift.yaml +73 -0
- package/dist/cli/commands/add.d.ts.map +1 -1
- package/dist/cli/commands/add.js +6 -5
- package/dist/cli/commands/add.js.map +1 -1
- package/dist/cli/commands/generate.d.ts.map +1 -1
- package/dist/cli/commands/generate.js +4 -0
- package/dist/cli/commands/generate.js.map +1 -1
- package/dist/cli/commands/list.d.ts.map +1 -1
- package/dist/cli/commands/list.js +6 -18
- package/dist/cli/commands/list.js.map +1 -1
- package/dist/cli/commands/train.d.ts.map +1 -1
- package/dist/cli/commands/train.js +18 -18
- package/dist/cli/commands/train.js.map +1 -1
- package/dist/cli/index.js +93 -55
- package/dist/cli/index.js.map +1 -1
- package/dist/cli/run-demo.js +2 -1
- package/dist/cli/run-demo.js.map +1 -1
- package/dist/cli/setup.d.ts +18 -0
- package/dist/cli/setup.d.ts.map +1 -0
- package/dist/cli/setup.js +154 -0
- package/dist/cli/setup.js.map +1 -0
- package/dist/engine/agent-bridge.d.ts +5 -2
- package/dist/engine/agent-bridge.d.ts.map +1 -1
- package/dist/engine/agent-bridge.js +36 -9
- package/dist/engine/agent-bridge.js.map +1 -1
- package/dist/engine/loader.d.ts +21 -0
- package/dist/engine/loader.d.ts.map +1 -1
- package/dist/engine/loader.js +54 -1
- package/dist/engine/loader.js.map +1 -1
- package/dist/engine/training-loop.d.ts.map +1 -1
- package/dist/engine/training-loop.js +1 -0
- package/dist/engine/training-loop.js.map +1 -1
- package/dist/engine/training.d.ts.map +1 -1
- package/dist/engine/training.js +1 -0
- package/dist/engine/training.js.map +1 -1
- package/dist/generator/skill-generator.d.ts +1 -1
- package/dist/generator/skill-generator.d.ts.map +1 -1
- package/dist/generator/skill-generator.js +21 -2
- package/dist/generator/skill-generator.js.map +1 -1
- package/dist/mcp/server.d.ts.map +1 -1
- package/dist/mcp/server.js +11 -26
- package/dist/mcp/server.js.map +1 -1
- package/dist/mcp/session-manager.d.ts +3 -1
- package/dist/mcp/session-manager.d.ts.map +1 -1
- package/dist/mcp/session-manager.js +44 -22
- package/dist/mcp/session-manager.js.map +1 -1
- package/dist/types/schemas.d.ts +38 -13
- package/dist/types/schemas.d.ts.map +1 -1
- package/dist/types/schemas.js +9 -5
- package/dist/types/schemas.js.map +1 -1
- package/package.json +1 -1
|
@@ -0,0 +1,69 @@
|
|
|
1
|
+
meta:
|
|
2
|
+
id: review-ai-future
|
|
3
|
+
level: 5
|
|
4
|
+
course: github-pr-review
|
|
5
|
+
type: output
|
|
6
|
+
description: "Design the future of AI-powered review — architect next-generation review systems where AI and humans collaborate on code quality"
|
|
7
|
+
tags: [github, pr-review, AI, future, ML-systems, architecture, master]
|
|
8
|
+
|
|
9
|
+
state: {}
|
|
10
|
+
|
|
11
|
+
trigger: |
|
|
12
|
+
You're the VP of AI/ML at a developer tools company building the
|
|
13
|
+
next generation of AI-powered code review. Your product serves 10,000
|
|
14
|
+
organizations and reviews 2M PRs per month. You need to design the
|
|
15
|
+
AI system that will define how code review works in 2027-2030.
|
|
16
|
+
|
|
17
|
+
Current capabilities (baseline):
|
|
18
|
+
- Style and formatting checks (commoditized, 95% accuracy)
|
|
19
|
+
- Common bug pattern detection (70% accuracy, 15% false positive rate)
|
|
20
|
+
- Automated review comment generation (50% helpfulness rating)
|
|
21
|
+
- PR risk scoring based on file types and historical data
|
|
22
|
+
|
|
23
|
+
Target capabilities (next 3 years):
|
|
24
|
+
1. Semantic code understanding: Understand what code does (not just
|
|
25
|
+
syntax), detect logical errors, and reason about business logic
|
|
26
|
+
2. Repository-aware review: Understand the full codebase context,
|
|
27
|
+
architectural patterns, and team conventions
|
|
28
|
+
3. Personalized review: Adapt review depth and style to the author's
|
|
29
|
+
experience level and team's preferences
|
|
30
|
+
4. Predictive review: Flag potential issues before they become bugs
|
|
31
|
+
based on historical patterns and similar code in other repos
|
|
32
|
+
5. Review orchestration: Dynamically assign human reviewers based on
|
|
33
|
+
what AI can vs cannot confidently review, optimizing human time
|
|
34
|
+
|
|
35
|
+
Constraints:
|
|
36
|
+
- Customer code must never leave their tenant (privacy-critical)
|
|
37
|
+
- False positives destroy trust — must be under 5%
|
|
38
|
+
- Must work with GitHub's review UI (not a separate tool)
|
|
39
|
+
- Must handle 2M PRs/month at current scale, 10M at target scale
|
|
40
|
+
- Enterprise customers require explainable AI decisions
|
|
41
|
+
|
|
42
|
+
Ethical considerations:
|
|
43
|
+
- AI review shouldn't replace the learning benefits of human review
|
|
44
|
+
- AI shouldn't create surveillance of developer performance
|
|
45
|
+
- AI decisions on code quality must be transparent and contestable
|
|
46
|
+
- AI training data must not leak code between customers
|
|
47
|
+
|
|
48
|
+
Task: Design the next-generation AI review system. Write: the product
|
|
49
|
+
vision (what review looks like in 2030), the technical architecture
|
|
50
|
+
(models, training, inference, privacy), the human-AI collaboration
|
|
51
|
+
model (when AI leads, when humans lead, how they interact), the
|
|
52
|
+
ethical framework (principles, guardrails, transparency mechanisms),
|
|
53
|
+
and the go-to-market roadmap (what to ship when, how to build trust
|
|
54
|
+
progressively). Include the key technical challenges and proposed
|
|
55
|
+
solutions.
|
|
56
|
+
|
|
57
|
+
assertions:
|
|
58
|
+
- type: llm_judge
|
|
59
|
+
criteria: "Product vision is compelling and specific — paints a concrete picture of review in 2030 (not vague 'AI will review everything'), with specific scenarios showing human-AI collaboration, and acknowledges what AI will and won't be able to do"
|
|
60
|
+
weight: 0.35
|
|
61
|
+
description: "Compelling specific product vision"
|
|
62
|
+
- type: llm_judge
|
|
63
|
+
criteria: "Technical architecture handles constraints — solves the privacy problem (per-tenant models or federated learning), scales to 10M PRs/month, keeps false positives under 5% with confidence calibration, and integrates with GitHub's UI natively"
|
|
64
|
+
weight: 0.35
|
|
65
|
+
description: "Constraint-handling technical architecture"
|
|
66
|
+
- type: llm_judge
|
|
67
|
+
criteria: "Ethical framework is substantive — goes beyond platitudes to specific guardrails (e.g., AI review scores are never used in performance reviews, developers can always override AI, AI explanations are required for any blocking comment), with enforcement mechanisms"
|
|
68
|
+
weight: 0.30
|
|
69
|
+
description: "Substantive ethical framework"
|
|
@@ -0,0 +1,66 @@
|
|
|
1
|
+
meta:
|
|
2
|
+
id: review-behavioral-science
|
|
3
|
+
level: 5
|
|
4
|
+
course: github-pr-review
|
|
5
|
+
type: output
|
|
6
|
+
description: "Apply behavioral science to code review — use psychology and behavioral economics to improve review quality, speed, and developer experience"
|
|
7
|
+
tags: [github, pr-review, behavioral-science, psychology, nudges, master]
|
|
8
|
+
|
|
9
|
+
state: {}
|
|
10
|
+
|
|
11
|
+
trigger: |
|
|
12
|
+
You're the Head of Developer Experience applying behavioral science
|
|
13
|
+
principles to code review. Despite having good tools, processes, and
|
|
14
|
+
training, review quality and speed haven't improved in 18 months.
|
|
15
|
+
You hypothesize that cognitive biases and behavioral patterns are the
|
|
16
|
+
root cause.
|
|
17
|
+
|
|
18
|
+
Observed behavioral patterns:
|
|
19
|
+
1. Authority bias: Senior engineers' PRs get approved 2x faster with
|
|
20
|
+
50% fewer comments than junior engineers' identical code changes
|
|
21
|
+
(tested with anonymized blind reviews)
|
|
22
|
+
2. Anchoring effect: The first reviewer's decision heavily influences
|
|
23
|
+
subsequent reviewers — if the first review is "LGTM," 85% of
|
|
24
|
+
second reviewers also approve without substantive feedback
|
|
25
|
+
3. Sunk cost fallacy: Large PRs that have been in review for days
|
|
26
|
+
get approved despite issues because "we've already invested so
|
|
27
|
+
much time reviewing this"
|
|
28
|
+
4. Status quo bias: Reviewers are 3x more likely to approve code that
|
|
29
|
+
follows existing patterns (even bad patterns) than code that
|
|
30
|
+
introduces better but unfamiliar patterns
|
|
31
|
+
5. Social loafing: PRs with 3+ required reviewers get less thorough
|
|
32
|
+
individual reviews than PRs with 1 required reviewer (diffusion
|
|
33
|
+
of responsibility)
|
|
34
|
+
6. Peak-end rule: Developers' overall satisfaction with review is
|
|
35
|
+
determined by their worst review experience and their most recent
|
|
36
|
+
experience, not the average
|
|
37
|
+
|
|
38
|
+
Available data:
|
|
39
|
+
- 2 years of review data (50,000 PRs) with timestamps, comments,
|
|
40
|
+
outcomes, and post-merge incident correlation
|
|
41
|
+
- Developer satisfaction surveys (quarterly, 600 respondents)
|
|
42
|
+
- Blind review experiment results (100 anonymized PRs)
|
|
43
|
+
- Focus group transcripts from 8 teams
|
|
44
|
+
|
|
45
|
+
Task: Design a behavioral intervention program. For each bias, write:
|
|
46
|
+
the evidence from your data, the behavioral intervention (nudge,
|
|
47
|
+
choice architecture, or environmental design), the implementation
|
|
48
|
+
plan (how to embed the intervention in the review workflow), and the
|
|
49
|
+
measurement approach (A/B test design to prove the intervention works).
|
|
50
|
+
Then write the unified "Behavioral Code Review" framework that ties
|
|
51
|
+
all interventions together, and the ethical considerations (when does
|
|
52
|
+
nudging become manipulation?).
|
|
53
|
+
|
|
54
|
+
assertions:
|
|
55
|
+
- type: llm_judge
|
|
56
|
+
criteria: "Behavioral interventions are evidence-based — each intervention addresses a specific bias with a specific mechanism (e.g., randomized review order to reduce anchoring, blind review for authority bias, single-reviewer assignment to reduce social loafing), not generic 'educate people about biases'"
|
|
57
|
+
weight: 0.35
|
|
58
|
+
description: "Evidence-based interventions"
|
|
59
|
+
- type: llm_judge
|
|
60
|
+
criteria: "A/B test designs are rigorous — each intervention has a testable hypothesis, control group, sample size consideration, and success metric. The experiment design accounts for confounding variables and ethical review"
|
|
61
|
+
weight: 0.35
|
|
62
|
+
description: "Rigorous A/B test designs"
|
|
63
|
+
- type: llm_judge
|
|
64
|
+
criteria: "Ethical framework is thoughtful — distinguishes between nudging (preserving choice) and manipulation, addresses transparency (should developers know they're being nudged?), and sets limits on behavioral interventions in the workplace"
|
|
65
|
+
weight: 0.30
|
|
66
|
+
description: "Thoughtful ethical framework"
|
|
@@ -0,0 +1,62 @@
|
|
|
1
|
+
meta:
|
|
2
|
+
id: review-board-strategy
|
|
3
|
+
level: 5
|
|
4
|
+
course: github-pr-review
|
|
5
|
+
type: output
|
|
6
|
+
description: "Board-level review strategy — present code review as a strategic capability to the board of directors of a public company"
|
|
7
|
+
tags: [github, pr-review, board, strategy, governance, master]
|
|
8
|
+
|
|
9
|
+
state: {}
|
|
10
|
+
|
|
11
|
+
trigger: |
|
|
12
|
+
You're the CTO of a $3B public company presenting to the board of
|
|
13
|
+
directors. The board has 3 agenda items related to code review, driven
|
|
14
|
+
by recent events.
|
|
15
|
+
|
|
16
|
+
Agenda Item 1 — Risk governance after a competitor's review failure:
|
|
17
|
+
A competitor had a catastrophic production failure (48-hour outage,
|
|
18
|
+
$200M revenue impact) traced to a code change that bypassed review.
|
|
19
|
+
The board wants assurance that "it can't happen here." They want to
|
|
20
|
+
understand your change management controls and whether code review
|
|
21
|
+
is a governance strength or weakness.
|
|
22
|
+
|
|
23
|
+
Your data:
|
|
24
|
+
- 99.7% of production changes go through code review
|
|
25
|
+
- 0.3% are emergency changes with post-deployment review
|
|
26
|
+
- No review-related incidents exceeded $500K in the last 3 years
|
|
27
|
+
- SOC 2, PCI DSS, and SOX compliance are current
|
|
28
|
+
- Review process is audited quarterly
|
|
29
|
+
|
|
30
|
+
Agenda Item 2 — AI strategy for code review:
|
|
31
|
+
The board read about AI replacing code review in a McKinsey report.
|
|
32
|
+
They want to know: (a) Should the company invest in AI-powered review?
|
|
33
|
+
(b) What's the competitive advantage? (c) What are the risks of AI
|
|
34
|
+
reviewing code that handles $50B in annual transactions?
|
|
35
|
+
|
|
36
|
+
Agenda Item 3 — M&A due diligence:
|
|
37
|
+
The company is acquiring a 200-engineer startup. During due diligence,
|
|
38
|
+
you discovered the startup has no formal code review process — they
|
|
39
|
+
rely on pair programming and trust. The board wants to know the
|
|
40
|
+
integration risk and timeline to bring them to your review standards.
|
|
41
|
+
|
|
42
|
+
Task: Prepare the board presentation. For each agenda item, write:
|
|
43
|
+
the board-ready materials (1-page brief per item), the data
|
|
44
|
+
visualizations you would present (described in text), the Q&A
|
|
45
|
+
preparation (likely board questions and answers), and the governance
|
|
46
|
+
recommendations (what the board should approve or direct). End with
|
|
47
|
+
a unified strategic narrative connecting all 3 items to the company's
|
|
48
|
+
competitive position.
|
|
49
|
+
|
|
50
|
+
assertions:
|
|
51
|
+
- type: llm_judge
|
|
52
|
+
criteria: "Risk governance answer is reassuring without being complacent — presents strong controls with data, acknowledges the competitor's failure couldn't 'absolutely never happen' but shows defense-in-depth, and proposes board-level oversight mechanisms (quarterly review health reports)"
|
|
53
|
+
weight: 0.35
|
|
54
|
+
description: "Reassuring risk governance"
|
|
55
|
+
- type: llm_judge
|
|
56
|
+
criteria: "AI strategy is pragmatic — doesn't over-promise AI capabilities, identifies specific use cases where AI review adds value ($50B transaction context requires human judgment for business logic), proposes a measured adoption approach, and addresses the risk question honestly"
|
|
57
|
+
weight: 0.35
|
|
58
|
+
description: "Pragmatic AI strategy"
|
|
59
|
+
- type: llm_judge
|
|
60
|
+
criteria: "M&A integration plan is realistic — acknowledges that pair programming has value (not just 'they're doing it wrong'), proposes a phased integration (not day-1 mandate), quantifies the risk timeline, and connects to the AI strategy (AI tools can accelerate integration)"
|
|
61
|
+
weight: 0.30
|
|
62
|
+
description: "Realistic M&A integration plan"
|
|
@@ -0,0 +1,62 @@
|
|
|
1
|
+
meta:
|
|
2
|
+
id: review-consulting-engagement
|
|
3
|
+
level: 5
|
|
4
|
+
course: github-pr-review
|
|
5
|
+
type: output
|
|
6
|
+
description: "Lead a review consulting engagement — diagnose and transform a client's broken code review process as an external consultant"
|
|
7
|
+
tags: [github, pr-review, consulting, transformation, engagement, master]
|
|
8
|
+
|
|
9
|
+
state: {}
|
|
10
|
+
|
|
11
|
+
trigger: |
|
|
12
|
+
You're a senior engineering consultant hired for a 16-week, $250K
|
|
13
|
+
engagement to transform code review at a 400-engineer fintech company.
|
|
14
|
+
They've had 5 production incidents in 6 months traced to review
|
|
15
|
+
failures, lost 2 enterprise customers due to compliance gaps, and
|
|
16
|
+
their Glassdoor reviews specifically mention "toxic code reviews."
|
|
17
|
+
|
|
18
|
+
Client diagnostic findings (Week 1):
|
|
19
|
+
- 12 teams, 3 GitHub organizations, no consistent review process
|
|
20
|
+
- Average merge time: 5.2 days (industry benchmark: 1.5 days)
|
|
21
|
+
- 28% of PRs are abandoned (never merged)
|
|
22
|
+
- Developer satisfaction with review: 32% (industry benchmark: 70%)
|
|
23
|
+
- Top reviewer does 40% of all reviews (single point of failure)
|
|
24
|
+
- No reviewer training program exists
|
|
25
|
+
- CODEOWNERS files exist but 60% are outdated (point to departed employees)
|
|
26
|
+
- Branch protection varies: some repos require 0 approvals, payment
|
|
27
|
+
repos require 4 approvals (both extremes are problematic)
|
|
28
|
+
- The security team does a "security review gate" that adds 2 weeks
|
|
29
|
+
to any PR touching auth/payment code
|
|
30
|
+
- 15% of review comments contain personal attacks or dismissive
|
|
31
|
+
language (analyzed via NLP on comment history)
|
|
32
|
+
- No review metrics are tracked or reported
|
|
33
|
+
|
|
34
|
+
Client stakeholders:
|
|
35
|
+
- CTO: "Fix this fast, we can't keep losing customers"
|
|
36
|
+
- VP Engineering: "My team leads don't see this as their problem"
|
|
37
|
+
- Head of Security: "If we relax security reviews, we'll get breached"
|
|
38
|
+
- Engineering Manager (vocal critic): "We tried improving review
|
|
39
|
+
before. Consultants don't understand our codebase."
|
|
40
|
+
|
|
41
|
+
Task: Design the complete consulting engagement. Write: the client
|
|
42
|
+
diagnostic report (executive summary, findings, risk assessment), the
|
|
43
|
+
16-week transformation roadmap (phased, with milestones and
|
|
44
|
+
deliverables each sprint), the quick wins for Week 2-4 (to build
|
|
45
|
+
credibility), the organizational change management plan (handling
|
|
46
|
+
resistance from the vocal critic and security team), and the handoff
|
|
47
|
+
package (what you leave behind so improvements stick after you leave).
|
|
48
|
+
Include the success metrics and the "after" state you're targeting.
|
|
49
|
+
|
|
50
|
+
assertions:
|
|
51
|
+
- type: llm_judge
|
|
52
|
+
criteria: "Diagnostic is comprehensive and data-driven — quantifies every problem (merge time, satisfaction, abandonment rate), benchmarks against industry, identifies root causes (not just symptoms), and presents findings without blame. The risk assessment connects review failures to business impact ($)"
|
|
53
|
+
weight: 0.35
|
|
54
|
+
description: "Comprehensive data-driven diagnostic"
|
|
55
|
+
- type: llm_judge
|
|
56
|
+
criteria: "Transformation roadmap is realistic for 16 weeks — quick wins build credibility (Weeks 2-4: fix CODEOWNERS, add basic branch protection, address toxic comments), middle phase tackles process (Weeks 5-10: SLAs, automation, training), final phase embeds sustainability (Weeks 11-16: metrics, governance, handoff)"
|
|
57
|
+
weight: 0.35
|
|
58
|
+
description: "Realistic 16-week roadmap"
|
|
59
|
+
- type: llm_judge
|
|
60
|
+
criteria: "Change management handles real resistance — addresses the vocal critic by involving them (not overriding), negotiates with security team on risk-based reviews (not just faster reviews), builds team lead ownership, and the handoff package ensures improvements survive the consultant's departure"
|
|
61
|
+
weight: 0.30
|
|
62
|
+
description: "Resistance-handling change management"
|
|
@@ -0,0 +1,71 @@
|
|
|
1
|
+
meta:
|
|
2
|
+
id: review-devtools-product
|
|
3
|
+
level: 5
|
|
4
|
+
course: github-pr-review
|
|
5
|
+
type: output
|
|
6
|
+
description: "Build a review DevTools product — design and launch a code review SaaS product as a startup co-founder"
|
|
7
|
+
tags: [github, pr-review, product, startup, SaaS, go-to-market, master]
|
|
8
|
+
|
|
9
|
+
state: {}
|
|
10
|
+
|
|
11
|
+
trigger: |
|
|
12
|
+
You're the co-founder/CPO of a startup building "ReviewIQ" — an
|
|
13
|
+
AI-powered code review platform. You've raised $5M in seed funding
|
|
14
|
+
and have 12 months of runway. Your thesis: code review is broken at
|
|
15
|
+
scale and the market is ready for a purpose-built solution.
|
|
16
|
+
|
|
17
|
+
Market analysis:
|
|
18
|
+
- TAM: $4.2B (developer productivity tools market)
|
|
19
|
+
- SAM: $800M (code review and quality tools)
|
|
20
|
+
- SOM: $80M (AI-powered review for GitHub-based teams)
|
|
21
|
+
- Competitors: CodeRabbit ($12M ARR), Sourcery ($5M ARR), GitHub
|
|
22
|
+
Copilot code review (free, basic), Graphite (focused on stacking)
|
|
23
|
+
- Gap: No tool combines AI review + analytics + workflow automation
|
|
24
|
+
in a single platform
|
|
25
|
+
|
|
26
|
+
Product vision:
|
|
27
|
+
1. AI Reviewer: Catches bugs, security issues, and style violations
|
|
28
|
+
with <5% false positive rate
|
|
29
|
+
2. Review Analytics: Team-level and org-level metrics with benchmarks
|
|
30
|
+
3. Smart Assignment: Expertise-based reviewer assignment with load
|
|
31
|
+
balancing
|
|
32
|
+
4. Review Workflow: Custom review workflows (different rules per repo,
|
|
33
|
+
team, risk level)
|
|
34
|
+
5. Developer Experience: Integrates into GitHub's native review UI
|
|
35
|
+
|
|
36
|
+
Technical constraints:
|
|
37
|
+
- Must work with GitHub (80% of target market)
|
|
38
|
+
- Customer code must never leave their environment (enterprise
|
|
39
|
+
requirement)
|
|
40
|
+
- Must handle repos with 500K+ lines without timeout
|
|
41
|
+
- Must work with monorepos and polyglot codebases
|
|
42
|
+
|
|
43
|
+
Go-to-market constraints:
|
|
44
|
+
- 12-month runway ($5M, burn rate $400K/month)
|
|
45
|
+
- 6-person engineering team (including you)
|
|
46
|
+
- Need to reach $1M ARR to raise Series A
|
|
47
|
+
- Developer-led growth (PLG) is the primary motion
|
|
48
|
+
|
|
49
|
+
Task: Design the complete product strategy. Write: the product
|
|
50
|
+
roadmap (MVP scope for Month 1-3, growth features for Month 4-8,
|
|
51
|
+
enterprise features for Month 9-12), the technical architecture
|
|
52
|
+
(handle the privacy constraint with on-prem or edge deployment), the
|
|
53
|
+
pricing strategy (free tier, team, enterprise — with specific limits),
|
|
54
|
+
the PLG go-to-market plan (developer adoption → team adoption →
|
|
55
|
+
enterprise sale), and the competitive positioning (how to win against
|
|
56
|
+
GitHub Copilot's free review and funded competitors). Include the
|
|
57
|
+
metrics dashboard for the board and the 12-month financial projection.
|
|
58
|
+
|
|
59
|
+
assertions:
|
|
60
|
+
- type: llm_judge
|
|
61
|
+
criteria: "MVP scope is achievable by a 6-person team in 3 months — focuses on one killer feature (likely AI review or analytics, not everything), defers enterprise features, and the scope decision is justified with competitive analysis"
|
|
62
|
+
weight: 0.35
|
|
63
|
+
description: "Achievable MVP scope"
|
|
64
|
+
- type: llm_judge
|
|
65
|
+
criteria: "Technical architecture solves the privacy constraint — proposes a viable approach for keeping customer code private (edge deployment, customer-hosted inference, or GitHub App with minimal data transmission), and this doesn't compromise the AI quality"
|
|
66
|
+
weight: 0.35
|
|
67
|
+
description: "Privacy-solving technical architecture"
|
|
68
|
+
- type: llm_judge
|
|
69
|
+
criteria: "GTM strategy reaches $1M ARR in 12 months — the PLG funnel is realistic (free users → team conversion → enterprise expansion), pricing tiers incentivize team adoption, and the competitive positioning against GitHub Copilot is credible (not just 'we're better')"
|
|
70
|
+
weight: 0.30
|
|
71
|
+
description: "ARR-reaching GTM strategy"
|
|
@@ -0,0 +1,64 @@
|
|
|
1
|
+
meta:
|
|
2
|
+
id: review-industry-benchmarks
|
|
3
|
+
level: 5
|
|
4
|
+
course: github-pr-review
|
|
5
|
+
type: output
|
|
6
|
+
description: "Publish industry benchmarks — create the definitive 'State of Code Review' report with cross-industry analysis and strategic insights"
|
|
7
|
+
tags: [github, pr-review, benchmarks, research, industry-analysis, master]
|
|
8
|
+
|
|
9
|
+
state: {}
|
|
10
|
+
|
|
11
|
+
trigger: |
|
|
12
|
+
You're the Head of Engineering Research at a developer tools company
|
|
13
|
+
publishing the annual "State of Code Review 2026" report. This report
|
|
14
|
+
is read by 50,000+ engineering leaders and influences industry
|
|
15
|
+
practices. You have survey data from 2,500 organizations.
|
|
16
|
+
|
|
17
|
+
Raw data highlights:
|
|
18
|
+
- Average merge time by company size:
|
|
19
|
+
Startup (<50 eng): 0.8 days | Mid (50-500): 2.1 days |
|
|
20
|
+
Enterprise (500+): 4.3 days
|
|
21
|
+
- Review practices adoption:
|
|
22
|
+
Required reviews: 89% | CODEOWNERS: 52% | AI review tools: 34% |
|
|
23
|
+
Review training: 18% | Review metrics: 27%
|
|
24
|
+
- Developer satisfaction with review:
|
|
25
|
+
Very satisfied: 15% | Satisfied: 35% | Neutral: 25% |
|
|
26
|
+
Dissatisfied: 18% | Very dissatisfied: 7%
|
|
27
|
+
- Correlation data:
|
|
28
|
+
Teams with review training: 2.3x fewer review-related incidents
|
|
29
|
+
Teams using AI review: 35% faster first review, no change in bug
|
|
30
|
+
detection rate
|
|
31
|
+
Teams with stale review dismissal: 40% fewer post-merge issues
|
|
32
|
+
Teams tracking review metrics: 1.8x faster improvement velocity
|
|
33
|
+
- Industry breakdown (merge time):
|
|
34
|
+
Fintech: 3.2 days | Healthcare: 4.8 days | SaaS: 1.5 days |
|
|
35
|
+
Gaming: 0.9 days | Government: 7.1 days | E-commerce: 1.8 days
|
|
36
|
+
- Emerging trends:
|
|
37
|
+
28% considering "review-free" paths for AI-generated code
|
|
38
|
+
45% exploring AI as first reviewer before human review
|
|
39
|
+
62% report "review fatigue" as top developer experience issue
|
|
40
|
+
33% have reduced required approvals in the last year
|
|
41
|
+
|
|
42
|
+
Task: Write the "State of Code Review 2026" report. Include: the
|
|
43
|
+
executive summary (key findings in 1 page), the benchmarking
|
|
44
|
+
methodology (how data was collected, limitations, statistical
|
|
45
|
+
significance), the cross-industry analysis (why healthcare and
|
|
46
|
+
government are slow, what gaming and SaaS do differently), the
|
|
47
|
+
emerging trends analysis (AI review, review-free paths, review
|
|
48
|
+
fatigue — with predictions), and the strategic recommendations by
|
|
49
|
+
company size. Each section should include data visualizations
|
|
50
|
+
described in text and key takeaways.
|
|
51
|
+
|
|
52
|
+
assertions:
|
|
53
|
+
- type: llm_judge
|
|
54
|
+
criteria: "Benchmarking methodology is credible — describes data collection, sample sizes, statistical methods, and explicitly states limitations (survival bias, self-selection, correlation ≠ causation). The methodology section would withstand peer review"
|
|
55
|
+
weight: 0.35
|
|
56
|
+
description: "Credible benchmarking methodology"
|
|
57
|
+
- type: llm_judge
|
|
58
|
+
criteria: "Cross-industry analysis reveals insights — explains why industries differ (healthcare: compliance overhead, gaming: rapid iteration culture, government: audit requirements), identifies transferable practices, and doesn't just present data but interprets it"
|
|
59
|
+
weight: 0.35
|
|
60
|
+
description: "Insightful cross-industry analysis"
|
|
61
|
+
- type: llm_judge
|
|
62
|
+
criteria: "Predictions and recommendations are bold but grounded — makes specific predictions about AI review adoption, review-free paths, and review fatigue trends, with recommendations tailored by company size and industry. Addresses the controversial 'review-free for AI code' trend thoughtfully"
|
|
63
|
+
weight: 0.30
|
|
64
|
+
description: "Bold grounded predictions"
|
|
@@ -0,0 +1,76 @@
|
|
|
1
|
+
meta:
|
|
2
|
+
id: review-ma-integration
|
|
3
|
+
level: 5
|
|
4
|
+
course: github-pr-review
|
|
5
|
+
type: output
|
|
6
|
+
description: "M&A review integration — harmonize code review processes across acquired companies with different engineering cultures"
|
|
7
|
+
tags: [github, pr-review, M&A, integration, culture, harmonization, master]
|
|
8
|
+
|
|
9
|
+
state: {}
|
|
10
|
+
|
|
11
|
+
trigger: |
|
|
12
|
+
You're the CTO overseeing the technical integration of 3 recently
|
|
13
|
+
acquired companies into the parent company. Each has a radically
|
|
14
|
+
different code review culture, and you need to create a unified
|
|
15
|
+
review process that preserves the best of each while meeting the
|
|
16
|
+
parent company's compliance requirements.
|
|
17
|
+
|
|
18
|
+
Parent company (800 engineers):
|
|
19
|
+
- GitHub Enterprise, strict 2-reviewer requirement
|
|
20
|
+
- CODEOWNERS, branch protection, SOC 2/PCI DSS compliance
|
|
21
|
+
- Average merge time: 2 days, developer satisfaction: 72%
|
|
22
|
+
- Strong tooling: automated review assignment, SLA tracking, analytics
|
|
23
|
+
- Weakness: perceived as "bureaucratic" by some teams
|
|
24
|
+
|
|
25
|
+
Acquisition A — Fast-moving SaaS startup (120 engineers):
|
|
26
|
+
- GitHub Cloud, 1-reviewer requirement, frequent self-merges
|
|
27
|
+
- No CODEOWNERS, minimal branch protection
|
|
28
|
+
- Average merge time: 4 hours, developer satisfaction: 85%
|
|
29
|
+
- Culture: "Ship fast, fix fast," trunk-based development
|
|
30
|
+
- Strength: Incredible velocity. Weakness: 3x incident rate
|
|
31
|
+
|
|
32
|
+
Acquisition B — Enterprise security company (200 engineers):
|
|
33
|
+
- GitLab self-hosted, 3-reviewer requirement including mandatory
|
|
34
|
+
security review
|
|
35
|
+
- Average merge time: 8 days, developer satisfaction: 45%
|
|
36
|
+
- Culture: "Every line must be perfect." Zero incidents but very slow
|
|
37
|
+
- Strength: Security rigor. Weakness: Engineering burnout, 30% attrition
|
|
38
|
+
|
|
39
|
+
Acquisition C — AI/ML research lab (80 engineers):
|
|
40
|
+
- Mix of GitHub and Jupyter notebooks in shared drives
|
|
41
|
+
- No formal review process — pair programming and "demo day" reviews
|
|
42
|
+
- No merge times (no PRs), developer satisfaction: 90%
|
|
43
|
+
- Culture: Academic, collaborative, experimental
|
|
44
|
+
- Strength: Innovation. Weakness: Production code quality varies wildly
|
|
45
|
+
|
|
46
|
+
Integration constraints:
|
|
47
|
+
- Must unify on GitHub Enterprise within 12 months
|
|
48
|
+
- Must achieve SOC 2 compliance across all entities within 18 months
|
|
49
|
+
- Must not lose more than 10% of acquired talent (especially from A
|
|
50
|
+
and C where culture change risk is highest)
|
|
51
|
+
- Must maintain each acquisition's product velocity during integration
|
|
52
|
+
- Budget: $1.5M for integration tooling and training
|
|
53
|
+
|
|
54
|
+
Task: Design the M&A review integration strategy. Write: the
|
|
55
|
+
assessment of each acquisition's review culture (strengths to preserve,
|
|
56
|
+
gaps to close), the unified review framework (minimum standard +
|
|
57
|
+
team-specific extensions), the migration plan for each acquisition
|
|
58
|
+
(phased, with specific milestones and risk mitigations), the culture
|
|
59
|
+
integration approach (how to merge 4 different review cultures without
|
|
60
|
+
destroying what works), and the retention risk mitigation plan.
|
|
61
|
+
Include the 18-month timeline and the executive dashboard for tracking
|
|
62
|
+
integration progress.
|
|
63
|
+
|
|
64
|
+
assertions:
|
|
65
|
+
- type: llm_judge
|
|
66
|
+
criteria: "Assessment preserves strengths — Acquisition A's velocity practices are identified for adoption (not just compliance), B's security rigor informs the security review standard, and C's collaborative culture inspires pair/mob programming practices. Integration isn't one-way assimilation"
|
|
67
|
+
weight: 0.35
|
|
68
|
+
description: "Strength-preserving assessment"
|
|
69
|
+
- type: llm_judge
|
|
70
|
+
criteria: "Migration plans are tailored — A gets gradual compliance addition without killing velocity (start with CODEOWNERS, then branch protection), B gets process streamlining (reduce from 3 to 2 reviewers, optimize security review), C gets formalization without bureaucracy (lightweight PR process for production code, freedom for research)"
|
|
71
|
+
weight: 0.35
|
|
72
|
+
description: "Tailored migration plans"
|
|
73
|
+
- type: llm_judge
|
|
74
|
+
criteria: "Retention risk is specifically addressed — identifies flight risks (A's engineers who value speed, C's researchers who value freedom), proposes specific retention mechanisms (cultural ambassadors, review process autonomy periods, transparent timeline), and the 10% attrition target is tracked"
|
|
75
|
+
weight: 0.30
|
|
76
|
+
description: "Specific retention risk mitigation"
|
|
@@ -0,0 +1,78 @@
|
|
|
1
|
+
meta:
|
|
2
|
+
id: review-regulatory-landscape
|
|
3
|
+
level: 5
|
|
4
|
+
course: github-pr-review
|
|
5
|
+
type: output
|
|
6
|
+
description: "Navigate the regulatory landscape for code review — analyze how global regulations shape review requirements and prepare for emerging compliance frameworks"
|
|
7
|
+
tags: [github, pr-review, regulatory, compliance, global, master]
|
|
8
|
+
|
|
9
|
+
state: {}
|
|
10
|
+
|
|
11
|
+
trigger: |
|
|
12
|
+
You're the Chief Compliance Officer of a global software company
|
|
13
|
+
operating in 35 countries. You need to map the regulatory landscape
|
|
14
|
+
for code review and change management, as regulations increasingly
|
|
15
|
+
require demonstrable software quality controls.
|
|
16
|
+
|
|
17
|
+
Current regulatory requirements affecting code review:
|
|
18
|
+
|
|
19
|
+
1. EU AI Act (effective 2026):
|
|
20
|
+
- High-risk AI systems require documented development processes
|
|
21
|
+
- Code changes to AI models need traceable review and testing
|
|
22
|
+
- Your AI-powered recommendation engine and fraud detection system
|
|
23
|
+
are classified as "high-risk"
|
|
24
|
+
- Penalty: up to 7% of global annual turnover
|
|
25
|
+
|
|
26
|
+
2. SEC Cybersecurity Rules (2024+):
|
|
27
|
+
- Material cybersecurity incidents must be disclosed within 4 days
|
|
28
|
+
- Board must demonstrate oversight of cybersecurity risk management
|
|
29
|
+
- Code review is part of the "reasonable controls" expectation
|
|
30
|
+
- Your financial reporting software processes $50B annually
|
|
31
|
+
|
|
32
|
+
3. DORA (Digital Operational Resilience Act, EU):
|
|
33
|
+
- ICT change management must be documented and tested
|
|
34
|
+
- Third-party ICT risk (including code review tools) must be managed
|
|
35
|
+
- Incident response must include root cause analysis of code changes
|
|
36
|
+
- Applies to your financial services customers in the EU
|
|
37
|
+
|
|
38
|
+
4. India's DPDP Act + China's PIPL:
|
|
39
|
+
- Data processing code changes must have privacy review
|
|
40
|
+
- Cross-border data flow code must have additional scrutiny
|
|
41
|
+
- You have engineering teams in Bangalore and Shanghai
|
|
42
|
+
|
|
43
|
+
5. Proposed US legislation:
|
|
44
|
+
- "Software Liability Act" draft would make companies liable for
|
|
45
|
+
known vulnerabilities that passed code review
|
|
46
|
+
- Bipartisan support, expected to pass within 2 years
|
|
47
|
+
- Would require "reasonable review practices" (undefined)
|
|
48
|
+
|
|
49
|
+
Emerging trends:
|
|
50
|
+
- Supply chain security regulations (NIST SSDF, EU CRA)
|
|
51
|
+
- AI-specific code review requirements (model governance)
|
|
52
|
+
- "Software bill of materials" requirements affecting dependency PRs
|
|
53
|
+
- Insurance underwriters requiring code review evidence for cyber
|
|
54
|
+
insurance renewals
|
|
55
|
+
|
|
56
|
+
Task: Map the regulatory landscape. Write: the regulatory matrix
|
|
57
|
+
(which regulations apply to which codebases, by jurisdiction and risk
|
|
58
|
+
level), the compliance gap analysis (where current review practices
|
|
59
|
+
fall short), the unified compliance framework (one review process
|
|
60
|
+
that satisfies all applicable regulations), the future-proofing
|
|
61
|
+
strategy (how to prepare for proposed and emerging regulations), and
|
|
62
|
+
the executive brief for the board on regulatory risk and investment
|
|
63
|
+
needed. Include the timeline for compliance milestones and the
|
|
64
|
+
consequences of non-compliance.
|
|
65
|
+
|
|
66
|
+
assertions:
|
|
67
|
+
- type: llm_judge
|
|
68
|
+
criteria: "Regulatory matrix is comprehensive — maps each regulation to affected codebases, identifies overlapping requirements (e.g., EU AI Act + DORA both require documentation), and notes jurisdictional complexity (different requirements in EU, US, India, China)"
|
|
69
|
+
weight: 0.35
|
|
70
|
+
description: "Comprehensive regulatory matrix"
|
|
71
|
+
- type: llm_judge
|
|
72
|
+
criteria: "Unified framework satisfies all regulations efficiently — doesn't create separate review processes per regulation, identifies the superset of requirements, and implements the most stringent standard as the baseline with lighter paths for lower-risk code"
|
|
73
|
+
weight: 0.35
|
|
74
|
+
description: "Efficient unified compliance framework"
|
|
75
|
+
- type: llm_judge
|
|
76
|
+
criteria: "Future-proofing strategy is forward-looking — prepares for the Software Liability Act, supply chain regulations, and AI governance requirements before they take effect, with a regulatory monitoring process that detects new requirements early"
|
|
77
|
+
weight: 0.30
|
|
78
|
+
description: "Forward-looking future-proofing"
|
|
@@ -0,0 +1,11 @@
|
|
|
1
|
+
id: postgresql-query-optimization
|
|
2
|
+
name: "Database Query Optimization (PostgreSQL)"
|
|
3
|
+
description: >
|
|
4
|
+
Master PostgreSQL query optimization from reading execution plans to
|
|
5
|
+
enterprise database architecture. Learn indexing strategies, JOIN
|
|
6
|
+
optimization, partitioning, parallel queries, connection pooling,
|
|
7
|
+
write optimization, monitoring, and high-availability configurations
|
|
8
|
+
for large-scale PostgreSQL deployments.
|
|
9
|
+
levels: 5
|
|
10
|
+
scenarios_per_level: 10
|
|
11
|
+
tags: [development, PostgreSQL, database, query-optimization, performance, SQL, DevOps]
|
|
@@ -0,0 +1,80 @@
|
|
|
1
|
+
meta:
|
|
2
|
+
id: explain-analyze-basics
|
|
3
|
+
level: 1
|
|
4
|
+
course: postgresql-query-optimization
|
|
5
|
+
type: output
|
|
6
|
+
description: "Read EXPLAIN ANALYZE output — interpret PostgreSQL query execution plans to identify performance bottlenecks"
|
|
7
|
+
tags: [PostgreSQL, EXPLAIN, execution-plan, query-optimization, beginner]
|
|
8
|
+
|
|
9
|
+
state: {}
|
|
10
|
+
|
|
11
|
+
trigger: |
|
|
12
|
+
You're a junior developer working on an e-commerce app. The product
|
|
13
|
+
listing page takes 8 seconds to load. Your tech lead asks you to
|
|
14
|
+
run EXPLAIN ANALYZE on the query and figure out what's slow.
|
|
15
|
+
|
|
16
|
+
The query:
|
|
17
|
+
SELECT p.id, p.name, p.price, c.name as category,
|
|
18
|
+
AVG(r.rating) as avg_rating
|
|
19
|
+
FROM products p
|
|
20
|
+
JOIN categories c ON c.id = p.category_id
|
|
21
|
+
LEFT JOIN reviews r ON r.product_id = p.id
|
|
22
|
+
WHERE p.active = true AND p.price BETWEEN 10 AND 100
|
|
23
|
+
GROUP BY p.id, p.name, p.price, c.name
|
|
24
|
+
ORDER BY avg_rating DESC NULLS LAST
|
|
25
|
+
LIMIT 20;
|
|
26
|
+
|
|
27
|
+
EXPLAIN ANALYZE output:
|
|
28
|
+
Limit (cost=45892.12..45892.17 rows=20 width=76)
|
|
29
|
+
(actual time=8234.521..8234.534 rows=20 loops=1)
|
|
30
|
+
-> Sort (cost=45892.12..46142.12 rows=100000 width=76)
|
|
31
|
+
(actual time=8234.519..8234.527 rows=20 loops=1)
|
|
32
|
+
Sort Key: (avg(r.rating)) DESC NULLS LAST
|
|
33
|
+
Sort Method: top-N heapsort Memory: 27kB
|
|
34
|
+
-> HashAggregate (cost=42391.50..43391.50 rows=100000 width=76)
|
|
35
|
+
(actual time=7891.234..8102.456 rows=85000 loops=1)
|
|
36
|
+
Group Key: p.id, p.name, p.price, c.name
|
|
37
|
+
-> Hash Left Join (cost=3456.78..38141.50 rows=850000 width=48)
|
|
38
|
+
(actual time=234.567..5678.901 rows=850000 loops=1)
|
|
39
|
+
Hash Cond: (r.product_id = p.id)
|
|
40
|
+
-> Seq Scan on reviews r (cost=0..28456.00 rows=1200000
|
|
41
|
+
width=12) (actual time=0.023..1234.567 rows=1200000
|
|
42
|
+
loops=1)
|
|
43
|
+
-> Hash (cost=3206.78..3206.78 rows=20000 width=44)
|
|
44
|
+
(actual time=234.123..234.123 rows=18500 loops=1)
|
|
45
|
+
Buckets: 32768 Batches: 1 Memory Usage: 1234kB
|
|
46
|
+
-> Hash Join (cost=12.50..3206.78 rows=20000 width=44)
|
|
47
|
+
(actual time=0.345..198.765 rows=18500 loops=1)
|
|
48
|
+
Hash Cond: (p.category_id = c.id)
|
|
49
|
+
-> Seq Scan on products p (cost=0..3125.00
|
|
50
|
+
rows=20000 width=40)
|
|
51
|
+
(actual time=0.012..178.234 rows=18500
|
|
52
|
+
loops=1)
|
|
53
|
+
Filter: (active AND (price >= 10)
|
|
54
|
+
AND (price <= 100))
|
|
55
|
+
Rows Removed by Filter: 81500
|
|
56
|
+
-> Hash (cost=10.00..10.00 rows=200 width=12)
|
|
57
|
+
(actual time=0.234..0.234 rows=200 loops=1)
|
|
58
|
+
|
|
59
|
+
Table sizes: products (100K rows), reviews (1.2M rows),
|
|
60
|
+
categories (200 rows).
|
|
61
|
+
|
|
62
|
+
Task: Analyze this execution plan. Explain: what each node means
|
|
63
|
+
(in plain English), where the time is being spent, why it's doing
|
|
64
|
+
sequential scans, what indexes would help, and write the optimized
|
|
65
|
+
version of this query with the recommended indexes. Explain the
|
|
66
|
+
difference between estimated and actual rows.
|
|
67
|
+
|
|
68
|
+
assertions:
|
|
69
|
+
- type: llm_judge
|
|
70
|
+
criteria: "Execution plan is correctly interpreted — identifies that the sequential scan on reviews (1.2M rows) is the biggest bottleneck, explains cost vs actual time, estimated vs actual rows, and each node type (Seq Scan, Hash Join, HashAggregate, Sort, Limit). The explanation is in plain English a junior developer can understand"
|
|
71
|
+
weight: 0.35
|
|
72
|
+
description: "Correct plan interpretation"
|
|
73
|
+
- type: llm_judge
|
|
74
|
+
criteria: "Optimization recommendations are specific — suggests index on reviews(product_id) for the JOIN, index on products(active, price) for the filter, and explains why these indexes would replace sequential scans with index scans. May suggest a materialized view or covering index for further optimization"
|
|
75
|
+
weight: 0.35
|
|
76
|
+
description: "Specific optimization recommendations"
|
|
77
|
+
- type: llm_judge
|
|
78
|
+
criteria: "Explains key EXPLAIN ANALYZE concepts — cost units (arbitrary but relative), actual time (milliseconds), loops, rows removed by filter, sort methods, hash bucket sizing, and how to identify the slowest node by looking at actual time differences between parent and child nodes"
|
|
79
|
+
weight: 0.30
|
|
80
|
+
description: "Key concepts explained"
|