@humanbased/crosscheck 0.15.1-beta.3 → 0.16.0-beta.24
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +7 -3
- package/crosscheck.config.example.yml +6 -0
- package/dist/__tests__/board.test.js +27 -0
- package/dist/__tests__/board.test.js.map +1 -1
- package/dist/__tests__/clone.test.d.ts +2 -0
- package/dist/__tests__/clone.test.d.ts.map +1 -0
- package/dist/__tests__/clone.test.js +9 -0
- package/dist/__tests__/clone.test.js.map +1 -0
- package/dist/__tests__/error-classification.test.js +14 -0
- package/dist/__tests__/error-classification.test.js.map +1 -1
- package/dist/__tests__/fix.test.js +45 -0
- package/dist/__tests__/fix.test.js.map +1 -1
- package/dist/__tests__/optimize.test.js +1 -0
- package/dist/__tests__/optimize.test.js.map +1 -1
- package/dist/__tests__/remediation.test.d.ts +2 -0
- package/dist/__tests__/remediation.test.d.ts.map +1 -0
- package/dist/__tests__/remediation.test.js +53 -0
- package/dist/__tests__/remediation.test.js.map +1 -0
- package/dist/__tests__/reviewer-error.test.js +20 -3
- package/dist/__tests__/reviewer-error.test.js.map +1 -1
- package/dist/cli.js +2 -0
- package/dist/cli.js.map +1 -1
- package/dist/commands/diagnose.d.ts +1 -0
- package/dist/commands/diagnose.d.ts.map +1 -1
- package/dist/commands/diagnose.js +327 -0
- package/dist/commands/diagnose.js.map +1 -1
- package/dist/commands/issue.d.ts +6 -0
- package/dist/commands/issue.d.ts.map +1 -1
- package/dist/commands/issue.js +221 -0
- package/dist/commands/issue.js.map +1 -1
- package/dist/commands/kickass.d.ts.map +1 -1
- package/dist/commands/kickass.js +20 -3
- package/dist/commands/kickass.js.map +1 -1
- package/dist/commands/run.d.ts.map +1 -1
- package/dist/commands/run.js +64 -13
- package/dist/commands/run.js.map +1 -1
- package/dist/commands/watch.d.ts.map +1 -1
- package/dist/commands/watch.js +34 -0
- package/dist/commands/watch.js.map +1 -1
- package/dist/config/schema.d.ts +67 -0
- package/dist/config/schema.d.ts.map +1 -1
- package/dist/config/schema.js +10 -0
- package/dist/config/schema.js.map +1 -1
- package/dist/lib/board.d.ts.map +1 -1
- package/dist/lib/board.js +15 -1
- package/dist/lib/board.js.map +1 -1
- package/dist/lib/clone.d.ts +1 -0
- package/dist/lib/clone.d.ts.map +1 -1
- package/dist/lib/clone.js +21 -5
- package/dist/lib/clone.js.map +1 -1
- package/dist/lib/issue-queue.d.ts +18 -0
- package/dist/lib/issue-queue.d.ts.map +1 -0
- package/dist/lib/issue-queue.js +35 -0
- package/dist/lib/issue-queue.js.map +1 -0
- package/dist/lib/logger.d.ts.map +1 -1
- package/dist/lib/logger.js +3 -2
- package/dist/lib/logger.js.map +1 -1
- package/dist/lib/remediation.d.ts +3 -0
- package/dist/lib/remediation.d.ts.map +1 -0
- package/dist/lib/remediation.js +34 -0
- package/dist/lib/remediation.js.map +1 -0
- package/dist/lib/reviewer-error.d.ts.map +1 -1
- package/dist/lib/reviewer-error.js +17 -2
- package/dist/lib/reviewer-error.js.map +1 -1
- package/dist/lib/runner.d.ts +1 -0
- package/dist/lib/runner.d.ts.map +1 -1
- package/dist/lib/runner.js +44 -26
- package/dist/lib/runner.js.map +1 -1
- package/dist/reviewers/codex.d.ts.map +1 -1
- package/dist/reviewers/codex.js +4 -2
- package/dist/reviewers/codex.js.map +1 -1
- package/dist/reviewers/fix.d.ts.map +1 -1
- package/dist/reviewers/fix.js +2 -1
- package/dist/reviewers/fix.js.map +1 -1
- package/docs/growth/agent-execution.md +144 -0
- package/docs/growth/cycle-01-assets.md +198 -0
- package/docs/growth/cycle-2026-06-03.md +170 -0
- package/docs/proof-demo.md +12 -0
- package/get-started.md +10 -4
- package/package.json +2 -3
|
@@ -0,0 +1,144 @@
|
|
|
1
|
+
# Agent Execution Protocol
|
|
2
|
+
|
|
3
|
+
Crosscheck growth runs as a reviewed workflow: a builder agent ships a narrow artifact, an evaluator agent critiques it against evidence, and the builder iterates before the work is promoted.
|
|
4
|
+
|
|
5
|
+
## Weekly cadence
|
|
6
|
+
|
|
7
|
+
1. Pick one weekly bet.
|
|
8
|
+
2. Assign one builder agent and one evaluator agent.
|
|
9
|
+
3. Builder ships the smallest artifact that could produce the target user action.
|
|
10
|
+
4. Evaluator returns `ship`, `iterate`, or `stop`.
|
|
11
|
+
5. Builder applies the evaluator's top fixes.
|
|
12
|
+
6. Human owner makes the final call.
|
|
13
|
+
7. Adoption Agent records the evidence and next experiment.
|
|
14
|
+
|
|
15
|
+
## Decision rules
|
|
16
|
+
|
|
17
|
+
- Prefer activated usage over attention. A completed review is stronger than a like, star, or install.
|
|
18
|
+
- Do not broaden distribution until onboarding and proof are good enough to absorb new users.
|
|
19
|
+
- Treat repeated confusion as a product/docs bug, not a user flaw.
|
|
20
|
+
- Every public claim must be backed by a demo, repo artifact, or dogfooding data.
|
|
21
|
+
- Every shipped piece should make Crosscheck more clearly associated with Humanbased's complete agentic software delivery commitment.
|
|
22
|
+
|
|
23
|
+
## Base agent prompt
|
|
24
|
+
|
|
25
|
+
```text
|
|
26
|
+
You are the [Agent Name] for Crosscheck by Humanbased.
|
|
27
|
+
|
|
28
|
+
Mission:
|
|
29
|
+
Grow Crosscheck as proof of Humanbased's commitment to complete agentic software delivery: implementation, independent review, repair, and recheck until code is genuinely merge-ready.
|
|
30
|
+
|
|
31
|
+
Current weekly bet:
|
|
32
|
+
[Paste weekly bet]
|
|
33
|
+
|
|
34
|
+
Role:
|
|
35
|
+
[Builder or evaluator]
|
|
36
|
+
|
|
37
|
+
Evaluate against:
|
|
38
|
+
- activated usage, not vanity attention
|
|
39
|
+
- clarity of the Review -> Fix -> Recheck loop
|
|
40
|
+
- trust, permission boundaries, and responsible automation
|
|
41
|
+
- whether this improves the next user's first successful review
|
|
42
|
+
|
|
43
|
+
Output:
|
|
44
|
+
1. Decision: ship / iterate / stop
|
|
45
|
+
2. Top 3 findings
|
|
46
|
+
3. Concrete edits or actions
|
|
47
|
+
4. Metric to inspect next
|
|
48
|
+
```
|
|
49
|
+
|
|
50
|
+
## Agent roles
|
|
51
|
+
|
|
52
|
+
### Positioning Agent
|
|
53
|
+
|
|
54
|
+
Owns message, ICP, promise, objections, and the Humanbased narrative.
|
|
55
|
+
|
|
56
|
+
Evaluator question: Can a developer explain what Crosscheck is, when to use it, and why it is not just another AI reviewer within 10 seconds?
|
|
57
|
+
|
|
58
|
+
### Onboarding Agent
|
|
59
|
+
|
|
60
|
+
Owns install, prerequisites, first command, fixture PR, and setup docs.
|
|
61
|
+
|
|
62
|
+
Evaluator question: Can a new user reach a useful review verdict in under 10 minutes?
|
|
63
|
+
|
|
64
|
+
### Proof Agent
|
|
65
|
+
|
|
66
|
+
Owns demo PRs, videos, screenshots, dogfooding reports, and evidence quality.
|
|
67
|
+
|
|
68
|
+
Evaluator question: Does the proof show starting PR -> blocking finding -> fix -> recheck -> merge-ready?
|
|
69
|
+
|
|
70
|
+
### Distribution Agent
|
|
71
|
+
|
|
72
|
+
Owns GitHub, npm, release notes, channel sequencing, and launch surfaces.
|
|
73
|
+
|
|
74
|
+
Evaluator question: Does the channel produce activated users, not just attention?
|
|
75
|
+
|
|
76
|
+
### Content Agent
|
|
77
|
+
|
|
78
|
+
Owns essays, tutorials, comparison posts, templates, and search/share strategy.
|
|
79
|
+
|
|
80
|
+
Evaluator question: Is the content searchable, shareable, or both, and does it drive one clear action?
|
|
81
|
+
|
|
82
|
+
### Community Agent
|
|
83
|
+
|
|
84
|
+
Owns HN, X, LinkedIn, Reddit, Discord, GitHub Discussions, and reply mining.
|
|
85
|
+
|
|
86
|
+
Evaluator question: Did the conversation reveal objections, use cases, bugs, or testimonials?
|
|
87
|
+
|
|
88
|
+
### Trust Agent
|
|
89
|
+
|
|
90
|
+
Owns permissions, telemetry, mutation boundaries, webhook behavior, and safety copy.
|
|
91
|
+
|
|
92
|
+
Evaluator question: Can a cautious team explain what Crosscheck can and cannot touch?
|
|
93
|
+
|
|
94
|
+
### Adoption Agent
|
|
95
|
+
|
|
96
|
+
Owns metrics, issue labels, weekly report, and bottleneck diagnosis.
|
|
97
|
+
|
|
98
|
+
Evaluator question: Which step loses users: install, onboard, review, fix, or recheck?
|
|
99
|
+
|
|
100
|
+
### Partnership Agent
|
|
101
|
+
|
|
102
|
+
Owns borrowed-audience experiments with OSS maintainers, tutorial creators, newsletters, and devtool communities.
|
|
103
|
+
|
|
104
|
+
Evaluator question: Did borrowed attention convert into owned audience or repeat usage?
|
|
105
|
+
|
|
106
|
+
## Weekly review template
|
|
107
|
+
|
|
108
|
+
```markdown
|
|
109
|
+
## Growth Review: YYYY-MM-DD
|
|
110
|
+
|
|
111
|
+
### Weekly Bet
|
|
112
|
+
Segment:
|
|
113
|
+
Promise:
|
|
114
|
+
Channel:
|
|
115
|
+
Asset:
|
|
116
|
+
Conversion:
|
|
117
|
+
|
|
118
|
+
### Shipped
|
|
119
|
+
-
|
|
120
|
+
|
|
121
|
+
### Evidence
|
|
122
|
+
Installs:
|
|
123
|
+
Onboard completed:
|
|
124
|
+
Reviews completed:
|
|
125
|
+
Fix loops completed:
|
|
126
|
+
Rechecks completed:
|
|
127
|
+
Weekly active repos:
|
|
128
|
+
Top failure:
|
|
129
|
+
Best user quote:
|
|
130
|
+
|
|
131
|
+
### Agent Decisions
|
|
132
|
+
Positioning Agent:
|
|
133
|
+
Onboarding Agent:
|
|
134
|
+
Proof Agent:
|
|
135
|
+
Distribution Agent:
|
|
136
|
+
Trust Agent:
|
|
137
|
+
Adoption Agent:
|
|
138
|
+
|
|
139
|
+
### Decision
|
|
140
|
+
Double down:
|
|
141
|
+
Iterate:
|
|
142
|
+
Stop:
|
|
143
|
+
Next experiment:
|
|
144
|
+
```
|
|
@@ -0,0 +1,198 @@
|
|
|
1
|
+
# Cycle 01 Assets
|
|
2
|
+
|
|
3
|
+
These are the first assets to build, evaluate, and iterate before broad distribution.
|
|
4
|
+
|
|
5
|
+
## Asset 1: Try Without Production Risk
|
|
6
|
+
|
|
7
|
+
Builder agent: Onboarding Agent.
|
|
8
|
+
|
|
9
|
+
Evaluator agent: Adoption Agent.
|
|
10
|
+
|
|
11
|
+
### Goal
|
|
12
|
+
|
|
13
|
+
Let a new user prove Crosscheck on one controlled PR before connecting it to a real production workflow.
|
|
14
|
+
|
|
15
|
+
### Draft flow
|
|
16
|
+
|
|
17
|
+
```bash
|
|
18
|
+
npm install -g @humanbased/crosscheck
|
|
19
|
+
gh auth login
|
|
20
|
+
codex login --device-auth
|
|
21
|
+
crosscheck status
|
|
22
|
+
crosscheck onboard
|
|
23
|
+
crosscheck review https://github.com/humanbased-ai/crosscheck-proof-fixture/pull/1 --reviewer codex
|
|
24
|
+
```
|
|
25
|
+
|
|
26
|
+
If a public fixture repo is not ready yet, use a friendly user's real PR and label the guide "Bring one safe PR".
|
|
27
|
+
|
|
28
|
+
### Required fixture behavior
|
|
29
|
+
|
|
30
|
+
- The PR should contain one realistic AI-slop failure:
|
|
31
|
+
- subtle regression
|
|
32
|
+
- incomplete edge-case handling
|
|
33
|
+
- premature "fixed" state
|
|
34
|
+
- The expected review should produce one blocking or needs-work finding.
|
|
35
|
+
- The fixture should include a follow-up fix commit.
|
|
36
|
+
- The recheck should approve or clearly explain the remaining gap.
|
|
37
|
+
|
|
38
|
+
### Evaluation
|
|
39
|
+
|
|
40
|
+
- A new user knows the prerequisites before running the command.
|
|
41
|
+
- The command path does not require watch mode, webhooks, or team setup.
|
|
42
|
+
- Failure modes point to one next action.
|
|
43
|
+
- The output makes the Review -> Fix -> Recheck concept visible.
|
|
44
|
+
|
|
45
|
+
### Iterate when
|
|
46
|
+
|
|
47
|
+
- Users ask which PR to use.
|
|
48
|
+
- Users get blocked by GitHub or agent CLI auth.
|
|
49
|
+
- Users complete review but do not understand how to run fix/recheck.
|
|
50
|
+
|
|
51
|
+
## Asset 2: Proof Demo
|
|
52
|
+
|
|
53
|
+
Builder agent: Proof Agent.
|
|
54
|
+
|
|
55
|
+
Evaluator agent: Trust Agent.
|
|
56
|
+
|
|
57
|
+
### Goal
|
|
58
|
+
|
|
59
|
+
Show Crosscheck turning a plausible AI-authored PR into a merge-ready patch.
|
|
60
|
+
|
|
61
|
+
### 90-second script
|
|
62
|
+
|
|
63
|
+
1. Show the PR title and diff. Say: "This PR looks done, but it has a subtle regression."
|
|
64
|
+
2. Run:
|
|
65
|
+
|
|
66
|
+
```bash
|
|
67
|
+
crosscheck review <fixture-pr-url> --reviewer codex
|
|
68
|
+
```
|
|
69
|
+
|
|
70
|
+
3. Show the GitHub review comment with the concrete blocking finding.
|
|
71
|
+
4. Run:
|
|
72
|
+
|
|
73
|
+
```bash
|
|
74
|
+
crosscheck run <fixture-pr-url> --steps fix,recheck --fixer claude --reviewer codex
|
|
75
|
+
```
|
|
76
|
+
|
|
77
|
+
5. Show the fix commit.
|
|
78
|
+
6. Show the recheck verdict.
|
|
79
|
+
7. End with:
|
|
80
|
+
|
|
81
|
+
```bash
|
|
82
|
+
npm install -g @humanbased/crosscheck
|
|
83
|
+
```
|
|
84
|
+
|
|
85
|
+
### Launch-ready proof checklist
|
|
86
|
+
|
|
87
|
+
- Shows the starting bug.
|
|
88
|
+
- Shows the Crosscheck finding.
|
|
89
|
+
- Shows the fix.
|
|
90
|
+
- Shows the recheck.
|
|
91
|
+
- Uses Humanbased wording once, lightly: "Built by Humanbased for complete agentic software delivery."
|
|
92
|
+
- Does not imply fully autonomous merge or guaranteed correctness.
|
|
93
|
+
|
|
94
|
+
### Iterate when
|
|
95
|
+
|
|
96
|
+
- The demo looks like a toy.
|
|
97
|
+
- The finding is too vague.
|
|
98
|
+
- The fix/recheck part is missing or rushed.
|
|
99
|
+
- Viewers understand the concept but do not know what to run.
|
|
100
|
+
|
|
101
|
+
## Asset 3: Narrow Distribution Kit
|
|
102
|
+
|
|
103
|
+
Builder agent: Distribution Agent.
|
|
104
|
+
|
|
105
|
+
Evaluator agent: Community Agent.
|
|
106
|
+
|
|
107
|
+
### Goal
|
|
108
|
+
|
|
109
|
+
Invite the right builders to run the fixture/demo path and report where it breaks.
|
|
110
|
+
|
|
111
|
+
### GitHub pinned issue draft
|
|
112
|
+
|
|
113
|
+
```markdown
|
|
114
|
+
# Crosscheck has moved to Humanbased
|
|
115
|
+
|
|
116
|
+
Crosscheck now lives at `@humanbased/crosscheck` and `github.com/humanbased-ai/crosscheck`.
|
|
117
|
+
|
|
118
|
+
The mission is the same and sharper: combat AI slop by turning agent-written PRs into merge-ready patches through a Review -> Fix -> Recheck loop.
|
|
119
|
+
|
|
120
|
+
Install:
|
|
121
|
+
|
|
122
|
+
```bash
|
|
123
|
+
npm install -g @humanbased/crosscheck
|
|
124
|
+
```
|
|
125
|
+
|
|
126
|
+
For the first growth cycle, we are looking for feedback on one thing:
|
|
127
|
+
|
|
128
|
+
Can you complete one useful review in under 10 minutes?
|
|
129
|
+
|
|
130
|
+
Please share:
|
|
131
|
+
- your agent CLI setup
|
|
132
|
+
- the command you ran
|
|
133
|
+
- where you got stuck
|
|
134
|
+
- whether the review finding was useful
|
|
135
|
+
```
|
|
136
|
+
|
|
137
|
+
### X / LinkedIn post draft
|
|
138
|
+
|
|
139
|
+
```text
|
|
140
|
+
We analyzed 295 agentic PRs from Humanbased's own monorepo.
|
|
141
|
+
|
|
142
|
+
The lesson was not "AI review everything harder."
|
|
143
|
+
|
|
144
|
+
It was: route review strength based on PR shape, keep review/fix/recheck visible, and measure where agentic workflows actually fail.
|
|
145
|
+
|
|
146
|
+
That's why we built Crosscheck.
|
|
147
|
+
|
|
148
|
+
Read the field report:
|
|
149
|
+
https://blog.humanbased.ai/posts/agentic-pr-quality-crosscheck/
|
|
150
|
+
|
|
151
|
+
Try the fixture:
|
|
152
|
+
npm install -g @humanbased/crosscheck
|
|
153
|
+
crosscheck review https://github.com/humanbased-ai/crosscheck-proof-fixture/pull/1 --reviewer codex
|
|
154
|
+
```
|
|
155
|
+
|
|
156
|
+
### Hacker News / Show HN draft
|
|
157
|
+
|
|
158
|
+
```text
|
|
159
|
+
We published a field report from 295 agentic PRs at Humanbased.
|
|
160
|
+
|
|
161
|
+
The useful finding was that agentic code review needs to be treated as a workflow: review routing, fix loops, rechecks, and post-merge measurement. A single "AI reviewer comment" is too shallow.
|
|
162
|
+
|
|
163
|
+
Crosscheck is the open-source CLI we built from that work. It runs a Review -> Fix -> Recheck loop through Claude Code or Codex.
|
|
164
|
+
|
|
165
|
+
Blog:
|
|
166
|
+
https://blog.humanbased.ai/posts/agentic-pr-quality-crosscheck/
|
|
167
|
+
|
|
168
|
+
I'm especially looking for feedback from people already using coding agents: can you get one useful review verdict on the fixture PR in under 10 minutes?
|
|
169
|
+
```
|
|
170
|
+
|
|
171
|
+
### Reddit / Discord-style post draft
|
|
172
|
+
|
|
173
|
+
```text
|
|
174
|
+
I'm looking for workflow critique from people using Claude Code, Codex, or other coding agents on real PRs.
|
|
175
|
+
|
|
176
|
+
Crosscheck is an open-source CLI from Humanbased that adds a Review -> Fix -> Recheck loop around agent-written PRs. The use case is catching "early victory" PRs: patches that look done but still have regressions, missing edge cases, or shallow fixes.
|
|
177
|
+
|
|
178
|
+
The thing I want to validate first is activation:
|
|
179
|
+
Can a new user get one useful review verdict in under 10 minutes?
|
|
180
|
+
|
|
181
|
+
Install:
|
|
182
|
+
npm install -g @humanbased/crosscheck
|
|
183
|
+
|
|
184
|
+
What would make you trust or reject this workflow?
|
|
185
|
+
```
|
|
186
|
+
|
|
187
|
+
### Evaluation
|
|
188
|
+
|
|
189
|
+
- Each post asks for a concrete action.
|
|
190
|
+
- Each post leads to install, fixture/demo path, or a specific critique.
|
|
191
|
+
- Each reply is tagged as objection, use case, bug, competitor, testimonial, or noise.
|
|
192
|
+
|
|
193
|
+
### Iterate when
|
|
194
|
+
|
|
195
|
+
- Replies debate the concept but nobody runs it.
|
|
196
|
+
- Users install but fail before review.
|
|
197
|
+
- Users ask about trust boundaries.
|
|
198
|
+
- People mistake Crosscheck for hosted AI review.
|
|
@@ -0,0 +1,170 @@
|
|
|
1
|
+
# Growth Cycle 01: Activation Before Amplification
|
|
2
|
+
|
|
3
|
+
Date: 2026-06-03
|
|
4
|
+
|
|
5
|
+
## Weekly bet
|
|
6
|
+
|
|
7
|
+
**Segment:** Solo developers and technical founders already using Claude Code, Codex, or both.
|
|
8
|
+
|
|
9
|
+
**Promise:** Crosscheck stops agent-written PRs from reaching merge too early by adding an independent Review -> Fix -> Recheck loop.
|
|
10
|
+
|
|
11
|
+
**Channel:** GitHub README, npm package page, one fixture/demo path, then narrow community posts only after proof is ready.
|
|
12
|
+
|
|
13
|
+
**Asset:** A first-run activation path that proves Crosscheck on one PR without risking a production repo.
|
|
14
|
+
|
|
15
|
+
**Conversion:** A new user installs `@humanbased/crosscheck` and completes one useful review verdict.
|
|
16
|
+
|
|
17
|
+
## Agent assignments
|
|
18
|
+
|
|
19
|
+
| Step | Builder agent | Evaluator agent | Artifact | Decision gate |
|
|
20
|
+
| --- | --- | --- | --- | --- |
|
|
21
|
+
| 1. First-run activation | Onboarding Agent | Adoption Agent | Install-to-review guide and fixture PR path | User can complete one review in under 10 minutes |
|
|
22
|
+
| 2. Proof demo | Proof Agent | Trust Agent | Demo script showing PR -> finding -> fix -> recheck | Demo shows real value without overstating safety |
|
|
23
|
+
| 3. Narrow distribution | Distribution Agent | Community Agent | Channel-specific posts | Post asks for a concrete run, critique, or install |
|
|
24
|
+
| 4. Weekly review | Adoption Agent | Positioning Agent | Growth review log | One bottleneck and next experiment are clear |
|
|
25
|
+
|
|
26
|
+
## Execution order
|
|
27
|
+
|
|
28
|
+
### Day 1: Activation
|
|
29
|
+
|
|
30
|
+
Ship:
|
|
31
|
+
|
|
32
|
+
- Add a "try without production risk" guide.
|
|
33
|
+
- Identify or create a public fixture PR.
|
|
34
|
+
- Confirm the install and review command path.
|
|
35
|
+
|
|
36
|
+
Evaluate:
|
|
37
|
+
|
|
38
|
+
- Can a clean user answer "what do I run next?"
|
|
39
|
+
- Does setup fail with actionable diagnostics?
|
|
40
|
+
- Is the first successful result visible in GitHub?
|
|
41
|
+
|
|
42
|
+
Iteration rule:
|
|
43
|
+
|
|
44
|
+
- If users cannot complete a review, do not launch broadly. Fix docs, config, or diagnostics first.
|
|
45
|
+
|
|
46
|
+
### Day 2: Proof
|
|
47
|
+
|
|
48
|
+
Ship:
|
|
49
|
+
|
|
50
|
+
- One short demo script.
|
|
51
|
+
- One screenshot or terminal transcript plan.
|
|
52
|
+
- One evidence checklist.
|
|
53
|
+
|
|
54
|
+
Evaluate:
|
|
55
|
+
|
|
56
|
+
- Does the proof show a concrete bug or incomplete fix?
|
|
57
|
+
- Does it show the repair and recheck, not just a review comment?
|
|
58
|
+
- Does it avoid implying automatic merge or guaranteed correctness?
|
|
59
|
+
|
|
60
|
+
Iteration rule:
|
|
61
|
+
|
|
62
|
+
- If proof feels abstract, use a real PR with sensitive details removed.
|
|
63
|
+
|
|
64
|
+
### Day 3: Narrow distribution
|
|
65
|
+
|
|
66
|
+
Ship:
|
|
67
|
+
|
|
68
|
+
- GitHub pinned issue draft.
|
|
69
|
+
- HN/X/LinkedIn/Reddit-style post drafts.
|
|
70
|
+
- One clear user action per post.
|
|
71
|
+
|
|
72
|
+
Evaluate:
|
|
73
|
+
|
|
74
|
+
- Does each post drive to the fixture/demo path?
|
|
75
|
+
- Does it invite critique from builders instead of generic attention?
|
|
76
|
+
- Is the Humanbased mission present without crowding out the tool?
|
|
77
|
+
|
|
78
|
+
Iteration rule:
|
|
79
|
+
|
|
80
|
+
- If attention does not convert to completed reviews, narrow the audience and improve the first-run path.
|
|
81
|
+
|
|
82
|
+
### Day 4: Community response
|
|
83
|
+
|
|
84
|
+
Ship:
|
|
85
|
+
|
|
86
|
+
- Reply bank for common objections.
|
|
87
|
+
- Issue labels for onboarding, trust, docs, and distribution signals.
|
|
88
|
+
|
|
89
|
+
Evaluate:
|
|
90
|
+
|
|
91
|
+
- Which objections repeat?
|
|
92
|
+
- Which users are actually trying the tool?
|
|
93
|
+
- Which failure category blocks activation?
|
|
94
|
+
|
|
95
|
+
Iteration rule:
|
|
96
|
+
|
|
97
|
+
- Turn repeated objections into docs and repeated failures into product fixes.
|
|
98
|
+
|
|
99
|
+
### Day 5: Weekly review
|
|
100
|
+
|
|
101
|
+
Ship:
|
|
102
|
+
|
|
103
|
+
- Growth review log.
|
|
104
|
+
- Next experiment proposal.
|
|
105
|
+
|
|
106
|
+
Evaluate:
|
|
107
|
+
|
|
108
|
+
- Did the weekly bet produce activated usage?
|
|
109
|
+
- What is the single biggest bottleneck?
|
|
110
|
+
- Which agent owns the next fix?
|
|
111
|
+
|
|
112
|
+
Iteration rule:
|
|
113
|
+
|
|
114
|
+
- Double down only when reviews complete. Otherwise fix the bottleneck before increasing distribution.
|
|
115
|
+
|
|
116
|
+
## Initial success metrics
|
|
117
|
+
|
|
118
|
+
| Metric | Target for Cycle 01 | Why it matters |
|
|
119
|
+
| --- | --- | --- |
|
|
120
|
+
| Fixture/demo review completed | 3 successful external or friendly-user runs | Proves first value |
|
|
121
|
+
| Time to first review verdict | Under 10 minutes after prerequisites | Proves activation |
|
|
122
|
+
| Top failure category identified | 1 clearly named category | Guides product/docs fix |
|
|
123
|
+
| Public proof asset ready | 1 launch-ready demo | Enables distribution |
|
|
124
|
+
| Qualified community replies | 5 specific objections/use cases | Improves positioning |
|
|
125
|
+
|
|
126
|
+
## Weekly review log
|
|
127
|
+
|
|
128
|
+
### Shipped
|
|
129
|
+
|
|
130
|
+
- Product marketing context for Crosscheck by Humanbased.
|
|
131
|
+
- Agent execution protocol with reusable builder/evaluator prompts.
|
|
132
|
+
- Cycle 01 activation-before-amplification runbook.
|
|
133
|
+
- Cycle 01 asset drafts for onboarding proof, demo proof, and narrow distribution.
|
|
134
|
+
- `crosscheck status` fix: webhook secret now reports as auto-managed instead of missing.
|
|
135
|
+
- README first screen now includes a one-shot "first useful review in 10 minutes" path.
|
|
136
|
+
- Get-started guide now leads with `status` and single-PR review before `watch`/`serve`.
|
|
137
|
+
- Proof demo and fixture PR docs.
|
|
138
|
+
- Public fixture repo created at `https://github.com/humanbased-ai/crosscheck-proof-fixture`.
|
|
139
|
+
- Fixture PR opened at `https://github.com/humanbased-ai/crosscheck-proof-fixture/pull/1` with secure `main` and buggy `add-transaction-pagination` branch.
|
|
140
|
+
- Humanbased field report published: `https://blog.humanbased.ai/posts/agentic-pr-quality-crosscheck/`.
|
|
141
|
+
- Fixture review completed with `VERDICT: BLOCK`: `https://github.com/humanbased-ai/crosscheck-proof-fixture/pull/1#issuecomment-4633226342`.
|
|
142
|
+
- Clone error redaction patched after a failed HTTPS clone exposed that authenticated clone URLs must be sanitized before printing.
|
|
143
|
+
|
|
144
|
+
### Evidence
|
|
145
|
+
|
|
146
|
+
- Installs: Pending.
|
|
147
|
+
- Onboard completed: Pending.
|
|
148
|
+
- Reviews completed: 1 fixture review completed with `BLOCK`.
|
|
149
|
+
- Fix loops completed: Pending.
|
|
150
|
+
- Rechecks completed: Pending.
|
|
151
|
+
- Weekly active repos: Pending.
|
|
152
|
+
- Top failure: Fix/recheck could not start because GitHub clone failed twice: HTTPS timed out, then SSH failed because this machine lacks GitHub SSH key access.
|
|
153
|
+
- Best user quote: Pending.
|
|
154
|
+
|
|
155
|
+
### Agent decisions
|
|
156
|
+
|
|
157
|
+
- Positioning Agent: Use Humanbased as the primary brand and tie Crosscheck to complete agentic software delivery.
|
|
158
|
+
- Onboarding Agent: Iterate. Lead with one-shot review, require only one AI CLI, clarify config path, and fix webhook-secret false failure.
|
|
159
|
+
- Proof Agent: Iterate. Use a public fixture PR plus 60-90 second video showing BLOCK -> fix -> recheck -> APPROVE.
|
|
160
|
+
- Content Agent: Use the published field report as proof-led top of funnel: blog -> README quick start -> fixture review -> first useful verdict.
|
|
161
|
+
- Distribution Agent: Hold broad launch. Start GitHub/X/Reddit/LinkedIn narrow wave only after 3 successful first-run reviews and public proof.
|
|
162
|
+
- Trust Agent: Pending full permissions/trust doc pass.
|
|
163
|
+
- Adoption Agent: Treat completed reviews as the activation metric; pause outreach if the same setup issue blocks two users.
|
|
164
|
+
|
|
165
|
+
### Decision
|
|
166
|
+
|
|
167
|
+
- Double down: First-run review path and fixture-backed proof.
|
|
168
|
+
- Iterate: Restore GitHub clone reliability, run fix/recheck on the public fixture PR, capture the BLOCK -> fix -> recheck proof, and update README with the proof asset once recorded.
|
|
169
|
+
- Stop: Do not run HN broad launch yet.
|
|
170
|
+
- Next experiment: Get three friendly users through `crosscheck status` -> `crosscheck review <fixture-pr>`.
|
package/docs/proof-demo.md
CHANGED
|
@@ -2,6 +2,18 @@
|
|
|
2
2
|
|
|
3
3
|
The first public proof asset should be a real GitHub PR timeline plus a 60-90 second narrated screen recording. The video creates attention, but the public PR is the evidence.
|
|
4
4
|
|
|
5
|
+
Use the Humanbased field report as the proof-led top of funnel:
|
|
6
|
+
|
|
7
|
+
```text
|
|
8
|
+
Blog -> README quick start -> fixture PR review -> first useful verdict -> optional fix/recheck -> onboarding/watch
|
|
9
|
+
```
|
|
10
|
+
|
|
11
|
+
Field report:
|
|
12
|
+
|
|
13
|
+
```text
|
|
14
|
+
https://blog.humanbased.ai/posts/agentic-pr-quality-crosscheck/
|
|
15
|
+
```
|
|
16
|
+
|
|
5
17
|
The intended chain is:
|
|
6
18
|
|
|
7
19
|
```text
|
package/get-started.md
CHANGED
|
@@ -159,16 +159,16 @@ crosscheck init
|
|
|
159
159
|
|
|
160
160
|
## Step 2 — Get one useful review
|
|
161
161
|
|
|
162
|
-
Before
|
|
162
|
+
Before using a production PR, run the public fixture from the Humanbased field report:
|
|
163
163
|
|
|
164
164
|
```bash
|
|
165
|
-
crosscheck review https://github.com/
|
|
165
|
+
crosscheck review https://github.com/humanbased-ai/crosscheck-proof-fixture/pull/1 --reviewer codex
|
|
166
166
|
```
|
|
167
167
|
|
|
168
|
-
This clones the PR branch, runs Codex review against the base branch, and posts a comment to the PR.
|
|
168
|
+
This clones the PR branch, runs Codex review against the base branch, and posts a comment to the PR. Use `--reviewer claude` if Claude Code is your authenticated reviewer. Once the fixture produces a useful verdict, run the same command against one low-risk PR from your own repo:
|
|
169
169
|
|
|
170
170
|
```bash
|
|
171
|
-
crosscheck review https://github.com/owner/repo/pull/123 --reviewer
|
|
171
|
+
crosscheck review https://github.com/owner/repo/pull/123 --reviewer codex
|
|
172
172
|
```
|
|
173
173
|
|
|
174
174
|
If this step fails, fix the specific auth, clone, reviewer, or comment-posting error before enabling `watch` or `serve`.
|
|
@@ -1070,6 +1070,12 @@ post_review:
|
|
|
1070
1070
|
pr_title: "fix: address CR issues in #{original_pr_title}"
|
|
1071
1071
|
label: cr-autofix # GitHub label applied to the fix PR
|
|
1072
1072
|
|
|
1073
|
+
# ── Watch ─────────────────────────────────────────────────────────────────────
|
|
1074
|
+
# watch:
|
|
1075
|
+
# idle_issue:
|
|
1076
|
+
# enabled: true # when watch is idle for timeout_min minutes, prompt to file an improvement ticket
|
|
1077
|
+
# timeout_min: 30 # minutes of no PR activity before the idle prompt fires (min: 5)
|
|
1078
|
+
|
|
1073
1079
|
# ── Backtrace ─────────────────────────────────────────────────────────────────
|
|
1074
1080
|
# On startup, scan all open PRs in the monitored scope and review any that
|
|
1075
1081
|
# haven't received a [crosscheck] comment yet. Off by default.
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "@humanbased/crosscheck",
|
|
3
|
-
"version": "0.
|
|
3
|
+
"version": "0.16.0-beta.24",
|
|
4
4
|
"description": "AI code review pipeline that turns agent-written PRs into merge-ready patches",
|
|
5
5
|
"bin": {
|
|
6
6
|
"crosscheck": "dist/cli.js",
|
|
@@ -16,8 +16,7 @@
|
|
|
16
16
|
"README.zh.md",
|
|
17
17
|
"get-started.md",
|
|
18
18
|
"get-started.zh.md",
|
|
19
|
-
"docs
|
|
20
|
-
"docs/proof-demo.md",
|
|
19
|
+
"docs",
|
|
21
20
|
"assets"
|
|
22
21
|
],
|
|
23
22
|
"engines": {
|