forgedock 1.0.19 → 1.0.21
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +16 -1
- package/commands/ci-audit.md +469 -0
- package/commands/orchestrate.md +563 -156
- package/commands/quality-gate.md +79 -1
- package/commands/review-pr-agents.md +48 -0
- package/docs/comparison.md +135 -0
- package/docs/design/developer-objections-ai-context-tools.md +244 -0
- package/docs/design/messaging-angles-research.md +179 -0
- package/docs/design/show-hn-draft.md +86 -0
- package/package.json +2 -2
|
@@ -0,0 +1,179 @@
|
|
|
1
|
+
# Messaging Angles Research: Codebase LLM Wiki
|
|
2
|
+
|
|
3
|
+
**Issue**: #1092
|
|
4
|
+
**Date**: 2026-06-25
|
|
5
|
+
**Method**: Cross-platform engagement analysis (HN, Product Hunt, GitHub, developer surveys, blogs)
|
|
6
|
+
|
|
7
|
+
---
|
|
8
|
+
|
|
9
|
+
## Summary
|
|
10
|
+
|
|
11
|
+
Five candidate messaging angles were evaluated for the "GitHub as a Codebase LLM Wiki" concept. Research covered Hacker News engagement patterns, Karpathy's LLM Wiki viral moment, Stack Overflow 2025 Developer Survey data, Product Hunt launches, and GitHub stars across competing tools.
|
|
12
|
+
|
|
13
|
+
**Verdict**: Candidate #4 ("Agent Memory that Lives in GitHub") has the strongest backing. Candidate #1 ("Codebase Wiki for AI Agents") has the strongest direct vocabulary alignment with Karpathy's viral LLM Wiki gist.
|
|
14
|
+
|
|
15
|
+
---
|
|
16
|
+
|
|
17
|
+
## Key Event: Karpathy's LLM Wiki (April 4, 2026)
|
|
18
|
+
|
|
19
|
+
Andrej Karpathy published a GitHub Gist titled **"LLM Wiki"** on April 4, 2026. Results within days:
|
|
20
|
+
|
|
21
|
+
- **17 million views**
|
|
22
|
+
- **5,000+ GitHub stars**
|
|
23
|
+
- **4,282 forks**
|
|
24
|
+
- Dozens of independent implementations (agentmemory 20K+ stars, llm-wiki repo, LLM Wiki v2 gist)
|
|
25
|
+
- VentureBeat coverage, commercial SaaS products launched off the pattern
|
|
26
|
+
|
|
27
|
+
**Karpathy's exact framing**: *"incrementally builds and maintains a persistent wiki"*, *"compiled knowledge layer"*, *"the human curates; the LLM maintains"*, *"stop re-deriving, start compiling"*
|
|
28
|
+
|
|
29
|
+
This is the largest single organic engagement signal in this exact vocabulary space in 2025–2026. The term "LLM Wiki" now has category-level developer awareness.
|
|
30
|
+
|
|
31
|
+
---
|
|
32
|
+
|
|
33
|
+
## Key Event: "Context Engineering" Goes Viral (June 25, 2025)
|
|
34
|
+
|
|
35
|
+
Karpathy posted endorsing "context engineering" over "prompt engineering" — *"the delicate art and science of filling the context window with just the right information for the next step."* Shopify CEO Tobi Lütke amplified. Gartner declared 2026 "the year of context."
|
|
36
|
+
|
|
37
|
+
Within months: conference talks, job titles, blog posts, a GitHub Awesome-Context-Engineering repo.
|
|
38
|
+
|
|
39
|
+
**Implication for ForgeDock**: "Context Layer" (candidate #2) deploys this already-activated vocabulary. Developers now have a crystallized pain around *filling context with the right information*. ForgeDock directly solves this.
|
|
40
|
+
|
|
41
|
+
---
|
|
42
|
+
|
|
43
|
+
## Developer Pain: Quantified
|
|
44
|
+
|
|
45
|
+
From the Stack Overflow 2025 Developer Survey (84% of devs using AI tools):
|
|
46
|
+
|
|
47
|
+
- **66%** cite "AI solutions that are almost right, but not quite" as primary frustration — directly caused by missing codebase context
|
|
48
|
+
- **54%** report AI misses relevance even when context is manually selected
|
|
49
|
+
- Context pain scales with seniority: **41% junior → 52% senior** developers
|
|
50
|
+
- Only **29%** trust AI outputs (down from 40% in 2024) — credibility gap driven by context failures
|
|
51
|
+
|
|
52
|
+
From Augment Code/Cerbos research: *"The bottleneck is not model quality — it's what context you feed the model."*
|
|
53
|
+
|
|
54
|
+
From "The Goldfish Effect" (viral Medium, Jan 2026): agents forget constraints set minutes earlier. This exact pain is already named and circulating in developer communities.
|
|
55
|
+
|
|
56
|
+
---
|
|
57
|
+
|
|
58
|
+
## Engagement Data: Competing Tools (GitHub Stars)
|
|
59
|
+
|
|
60
|
+
| Tool | Framing | Stars |
|
|
61
|
+
|------|---------|-------|
|
|
62
|
+
| Mem0 | "agent memory" | ~48,000 |
|
|
63
|
+
| agentmemory | "LLM Wiki pattern" | ~20,000 |
|
|
64
|
+
| Cognee | "knowledge graph" | ~12,000 |
|
|
65
|
+
| codebase-memory-mcp | "persistent knowledge graph" | growing |
|
|
66
|
+
|
|
67
|
+
**Memory dominates raw adoption. Context Engineering dominates cultural vocabulary.**
|
|
68
|
+
|
|
69
|
+
---
|
|
70
|
+
|
|
71
|
+
## Candidate Angle Rankings
|
|
72
|
+
|
|
73
|
+
### 1. Candidate #4: "Agent Memory that Lives in GitHub" — STRONGEST
|
|
74
|
+
|
|
75
|
+
**Evidence**:
|
|
76
|
+
- "Memory" is the dominant vocabulary: Mem0 at 48K stars, agentmemory at 20K stars
|
|
77
|
+
- Stack Overflow: 66% of devs cite context-missing as #1 frustration
|
|
78
|
+
- Goldfish Effect framing: directly names the felt pain developers articulate
|
|
79
|
+
- GitHub-native framing adds open-source/no-vendor-lock-in signal (HN community rewards this)
|
|
80
|
+
|
|
81
|
+
**Suggested headline**: *"Your AI agents forget everything. ForgeDock gives them memory that lives in GitHub."*
|
|
82
|
+
|
|
83
|
+
**Suggested subhead**: *"Issues, PRs, and labels become a queryable knowledge graph your agents read and write across every session. No proprietary database. No vendor lock-in."*
|
|
84
|
+
|
|
85
|
+
**Why it works**: Names the pain directly ("forget"), names the solution directly ("memory"), names the platform ("GitHub"), and adds the differentiator ("no vendor lock-in"). Zero explanation required.
|
|
86
|
+
|
|
87
|
+
---
|
|
88
|
+
|
|
89
|
+
### 2. Candidate #1: "Codebase Wiki for AI Agents" — VERY STRONG
|
|
90
|
+
|
|
91
|
+
**Evidence**:
|
|
92
|
+
- Karpathy's "LLM Wiki" gist: 17M views, 5K stars, 4K forks
|
|
93
|
+
- Direct vocabulary alignment — developers are actively searching "LLM wiki" and "codebase wiki" post-Karpathy
|
|
94
|
+
- agentmemory (20K stars) explicitly positions as "Karpathy's LLM Wiki pattern — implemented and shipped"
|
|
95
|
+
|
|
96
|
+
**Best use**: HN Show HN title and README hero headline — maps directly to the activated cultural artifact.
|
|
97
|
+
|
|
98
|
+
**Suggested Show HN title**: *"Show HN: ForgeDock — Codebase LLM Wiki for AI agents, built on GitHub Issues"*
|
|
99
|
+
|
|
100
|
+
**Suggested subhead**: *"Every investigation, decision, and review becomes structured context your agent reads back after compaction. No external memory layer — just GitHub."*
|
|
101
|
+
|
|
102
|
+
**Why it works**: The term "LLM Wiki" has 17M views of cultural priming. Developers who saw the Karpathy post immediately understand "codebase LLM Wiki" as a specific, desirable thing.
|
|
103
|
+
|
|
104
|
+
---
|
|
105
|
+
|
|
106
|
+
### 3. Candidate #2: "Context Layer" — STRONG
|
|
107
|
+
|
|
108
|
+
**Evidence**:
|
|
109
|
+
- "Context engineering" went viral via Karpathy (June 2025); Gartner baked it into 2026 briefings
|
|
110
|
+
- Atlan markets itself as "the Context Layer for AI"
|
|
111
|
+
- Weavable (Product Hunt) used "persistent work context" framing successfully
|
|
112
|
+
|
|
113
|
+
**Best use**: Technical subtitle, developer documentation, and LinkedIn/technical-blog positioning.
|
|
114
|
+
|
|
115
|
+
**Suggested technical positioning**: *"The context engineering layer for autonomous AI pipelines."*
|
|
116
|
+
|
|
117
|
+
**Caution**: "Context Layer" is accurate and vocabulary-correct but abstract. Works better as a subtitle after the emotional hook of "memory" or "wiki."
|
|
118
|
+
|
|
119
|
+
---
|
|
120
|
+
|
|
121
|
+
### 4. Candidate #3: "Knowledge Graph on GitHub" — MODERATE
|
|
122
|
+
|
|
123
|
+
**Evidence**:
|
|
124
|
+
- Harness.io blog *"Your Repo Is a Knowledge Graph. You Just Don't Query It Yet"* got organic traction with the negation-pattern headline
|
|
125
|
+
- codebase-memory-mcp (arxiv 2603.27277, March 2026): 83% answer quality at 120x fewer tokens using graph framing
|
|
126
|
+
- Cognee (12K stars), Graphiti both use knowledge graph vocabulary for technical credibility
|
|
127
|
+
|
|
128
|
+
**Best use**: Technical documentation, README architecture section, developer-to-developer credibility. Not a hero headline — requires explanation.
|
|
129
|
+
|
|
130
|
+
**Caution**: Knowledge graph vocabulary signals technical depth but triggers "sounds complex" reactions in non-graph-native developers. Use as a credibility signal after the hook, not as the hook.
|
|
131
|
+
|
|
132
|
+
---
|
|
133
|
+
|
|
134
|
+
### 5. Candidate #5: "Self-Documenting Codebase" — WEAKEST
|
|
135
|
+
|
|
136
|
+
**Evidence**:
|
|
137
|
+
- Dev.to/GitHub Blog posts on auto-doc-gen get organic traffic but no breakout engagement
|
|
138
|
+
- divar-ir/ai-doc-gen and similar tools use this framing without notable viral moments
|
|
139
|
+
- GitHub Octoverse 2025: 4.3M AI repos, 178% YoY growth — the space is crowded with this framing
|
|
140
|
+
|
|
141
|
+
**Why it ranks last**: Passive/descriptive rather than pain-naming. Developers don't search for "a system that documents my code" — they search for something that stops their agent from losing context. "Self-documenting" solves an imagined problem; "agent memory" solves the felt one. Also: documentation tools are a crowded category with no differentiation angle.
|
|
142
|
+
|
|
143
|
+
---
|
|
144
|
+
|
|
145
|
+
## Open Source / No Vendor Lock-in Amplifier
|
|
146
|
+
|
|
147
|
+
OpenCode (open-source Claude Code alternative): 162K+ GitHub stars. The HN community is explicitly hostile to vendor lock-in. The following sub-messages consistently add lift to any primary angle:
|
|
148
|
+
|
|
149
|
+
- "No proprietary database"
|
|
150
|
+
- "Your data stays in GitHub"
|
|
151
|
+
- "Works with your own API key"
|
|
152
|
+
- "AGPL — always free for the pipeline"
|
|
153
|
+
|
|
154
|
+
These amplify candidates #4 and #1 most strongly because those angles already imply GitHub as the storage layer.
|
|
155
|
+
|
|
156
|
+
---
|
|
157
|
+
|
|
158
|
+
## Recommended Messaging Stack
|
|
159
|
+
|
|
160
|
+
| Layer | Copy |
|
|
161
|
+
|-------|------|
|
|
162
|
+
| Hero Headline | "Your AI agents forget everything. ForgeDock gives them memory that lives in GitHub." |
|
|
163
|
+
| Subhead | "Issues, PRs, and labels become a queryable knowledge graph your agents read and write across every session. No proprietary database. No vendor lock-in." |
|
|
164
|
+
| Show HN Title | "Show HN: ForgeDock — Codebase LLM Wiki for AI agents, built on GitHub Issues" |
|
|
165
|
+
| Technical Subtitle | "The context engineering layer for autonomous AI pipelines." |
|
|
166
|
+
| One-liner | "GitHub as structured agent memory. Every decision survives context reset." |
|
|
167
|
+
|
|
168
|
+
---
|
|
169
|
+
|
|
170
|
+
## Sources and Evidence Links
|
|
171
|
+
|
|
172
|
+
- Karpathy LLM Wiki gist: https://gist.github.com/karpathy/442a6bf555914893e9891c11519de94f
|
|
173
|
+
- Karpathy "context engineering" tweet: https://x.com/karpathy/status/1937902205765607626
|
|
174
|
+
- Stack Overflow 2025 Developer Survey (AI section): https://survey.stackoverflow.co/2025/ai/
|
|
175
|
+
- Mem0 State of AI Agent Memory 2026: https://mem0.ai/blog/state-of-ai-agent-memory-2026
|
|
176
|
+
- Harness.io "Your Repo Is a Knowledge Graph": https://www.harness.io/blog/your-repo-is-a-knowledge-graph-you-just-dont-query-it-yet
|
|
177
|
+
- codebase-memory-mcp arxiv paper: https://arxiv.org/abs/2603.27277
|
|
178
|
+
- Developer context pain (Augment Code): https://www.augmentcode.com/guides/why-ai-agents-repeat-questions
|
|
179
|
+
- Context Engineering from tweet to infrastructure: https://thecontextgraph.co/memos/context-engineering-2026-from-tweet-to-infrastructure
|
|
@@ -0,0 +1,86 @@
|
|
|
1
|
+
# Show HN Draft
|
|
2
|
+
|
|
3
|
+
<!-- Updated by #1092: messaging angles research (2026-06-25) -->
|
|
4
|
+
<!-- Updated by #1099: context-rot pain framing (2026-06-27) -->
|
|
5
|
+
<!-- Research: "LLM Wiki" vocabulary = 17M views / 5K stars (Karpathy gist, April 2026).
|
|
6
|
+
"Context rot" is now mainstream community vocabulary (MindStudio, Augment Code, Stack Overflow, 2025-2026).
|
|
7
|
+
Lead with context rot pain; use LLM Wiki vocabulary as the HN title hook. Full research: docs/design/messaging-angles-research.md -->
|
|
8
|
+
|
|
9
|
+
## Title (choose one)
|
|
10
|
+
|
|
11
|
+
**Option D** (research-backed — RECOMMENDED for HN):
|
|
12
|
+
```
|
|
13
|
+
Show HN: ForgeDock — Codebase LLM Wiki for AI agents, built on GitHub Issues
|
|
14
|
+
```
|
|
15
|
+
*Rationale: "LLM Wiki" has 17M views of cultural priming from Karpathy's April 2026 gist. Developers
|
|
16
|
+
searching for the pattern recognize it immediately. Direct vocabulary alignment with the activated term.*
|
|
17
|
+
|
|
18
|
+
**Option E** (pain-first — RECOMMENDED for product pages and README hero):
|
|
19
|
+
```
|
|
20
|
+
Show HN: ForgeDock — AI agents forget everything. This gives them memory that lives in GitHub.
|
|
21
|
+
```
|
|
22
|
+
*Rationale: "Memory" is the #1 vocabulary by adoption (Mem0 48K stars). Names the felt pain ("forget")
|
|
23
|
+
directly. No explanation required.*
|
|
24
|
+
|
|
25
|
+
**Option A** (technical):
|
|
26
|
+
```
|
|
27
|
+
Show HN: ForgeDock – Open-source pipeline that turns Claude Code into a deterministic dev team
|
|
28
|
+
```
|
|
29
|
+
|
|
30
|
+
**Option B** (problem-first):
|
|
31
|
+
```
|
|
32
|
+
Show HN: ForgeDock – GitHub as institutional memory for AI coding agents
|
|
33
|
+
```
|
|
34
|
+
|
|
35
|
+
**Option C** (concise):
|
|
36
|
+
```
|
|
37
|
+
Show HN: ForgeDock – Autonomous investigate-build-review-merge pipeline for Claude Code
|
|
38
|
+
```
|
|
39
|
+
|
|
40
|
+
---
|
|
41
|
+
|
|
42
|
+
## URL
|
|
43
|
+
|
|
44
|
+
https://github.com/RapierCraftStudios/ForgeDock
|
|
45
|
+
|
|
46
|
+
---
|
|
47
|
+
|
|
48
|
+
## Maker Comment (post immediately after submission)
|
|
49
|
+
|
|
50
|
+
Hi HN. AI coding agents suffer from context rot: the gradual degradation of output quality as context fills with noise, stale file contents, and conventions re-explained from scratch every session. Every context reset, the agent forgets what it investigated, what decisions it made, what it already tried. You end up re-explaining your codebase every time.
|
|
51
|
+
|
|
52
|
+
Most teams try to fight context rot with config files — CLAUDE.md, AGENTS.md, .cursorrules, Copilot instructions, Kiro steering. Five files, five formats, five things to keep in sync, and the agent still can't reconstruct what happened in the last PR.
|
|
53
|
+
|
|
54
|
+
ForgeDock takes a different approach: it turns GitHub itself into the agent's persistent memory. When the pipeline runs on an issue, each stage (investigate, build, review, merge) posts a machine-readable FORGE: annotation to the issue/PR. Downstream stages read what upstream stages wrote. When context compacts, the agent runs `gh issue view` and reconstructs full state from GitHub alone — no external memory layer, no proprietary database, no vendor lock-in.
|
|
55
|
+
|
|
56
|
+
Unlike DeepWiki (which generates a documentation snapshot of your codebase once), ForgeDock writes structured annotations during each pipeline execution — so context reflects the current state of every open issue and in-flight decision, not a snapshot that goes stale.
|
|
57
|
+
|
|
58
|
+
It's the LLM Wiki pattern (Karpathy's April 2026 gist), but applied to your entire development pipeline: issues are the wiki entries, FORGE: annotations are the structured knowledge, and GitHub's API is the query interface.
|
|
59
|
+
|
|
60
|
+
The pipeline has 9 phases, a 9-agent specialist review system (security, database, auth, concurrency, etc.), and a 14-domain quality gate — all running as Claude Code slash commands. It's not a wrapper or thin CLI; the command specs are 50KB+ prompt engineering documents that constrain agent behavior at every step.
|
|
61
|
+
|
|
62
|
+
Some technical details:
|
|
63
|
+
- Zero runtime code — just markdown command specs symlinked into Claude Code
|
|
64
|
+
- Install: `npx forgedock`
|
|
65
|
+
- Uses `gh` CLI and `yq` as only dependencies
|
|
66
|
+
- AGPL licensed, free forever for the core pipeline
|
|
67
|
+
- Currently Claude Code only, investigating multi-model support
|
|
68
|
+
|
|
69
|
+
Known limitations:
|
|
70
|
+
- Claude Code only (no Cursor/Codex/Aider support yet)
|
|
71
|
+
- Token-heavy on first run before adaptive scripts cache project patterns
|
|
72
|
+
- The pipeline is opinionated — it enforces a specific workflow that may not fit every team
|
|
73
|
+
|
|
74
|
+
I'm a solo developer building this to solve my own problems. Happy to answer questions about the architecture, the FORGE annotation protocol, or the prompt engineering behind the command specs.
|
|
75
|
+
|
|
76
|
+
---
|
|
77
|
+
|
|
78
|
+
## Posting Guidelines
|
|
79
|
+
|
|
80
|
+
- **When**: Tuesday–Thursday, 9AM–12PM ET
|
|
81
|
+
- **First 60 minutes**: Respond to every comment
|
|
82
|
+
- **Tone**: Technical, honest, no marketing language
|
|
83
|
+
- **If asked about monetization**: "Open-core model — the pipeline is AGPL and always free. Planning a commercial dashboard for pipeline observability."
|
|
84
|
+
- **If compared to Devin**: "Devin is a cloud service; ForgeDock runs locally with your own API key. Different trade-offs — Devin is turnkey, ForgeDock gives you full control and traceability."
|
|
85
|
+
- **If compared to DeepWiki**: "DeepWiki generates a documentation snapshot of your repo. ForgeDock writes structured annotations during each pipeline run — context stays current with your actual work, not a snapshot."
|
|
86
|
+
- **If asked about scale**: Be honest about current adoption. Don't inflate numbers.
|
package/package.json
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "forgedock",
|
|
3
|
-
"version": "1.0.
|
|
4
|
-
"description": "GitHub as
|
|
3
|
+
"version": "1.0.21",
|
|
4
|
+
"description": "Autonomous dev pipeline for Claude Code. GitHub as institutional memory — every issue, PR, and annotation survives context resets and makes the next agent smarter.",
|
|
5
5
|
"bin": {
|
|
6
6
|
"forgedock": "bin/forgedock.mjs"
|
|
7
7
|
},
|