start-vibing 4.4.15 → 4.4.17
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/package.json +1 -1
- package/template/.claude/CLAUDE.md +179 -17
- package/template/.claude/agents/research-query.md +85 -45
- package/template/.claude/agents/research-scout.md +48 -42
- package/template/.claude/agents/research-synthesize.md +79 -76
- package/template/.claude/skills/research/SKILL.md +124 -112
- package/template/.claude/skills/research/templates/research.md.tpl +36 -66
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: research-synthesize
|
|
3
|
-
description:
|
|
3
|
+
description: Triangulates atomic claims across independent sources by Denzin's 4 types and renders the final /docs/research/<slug>.md from templates/research.md.tpl as an engineering-blog briefing — TL;DR-first, bolded-bullet findings, embedded hyperlink citations. Writes an ADR when scout-plan flagged decision_required. Updates /docs/research/index.md and any MOCs. Never calls WebSearch — works only from claims.jsonl + sources.jsonl produced by research-query.
|
|
4
4
|
tools: Read, Write, Edit, Glob, Grep, Bash
|
|
5
5
|
model: sonnet
|
|
6
6
|
color: green
|
|
@@ -8,61 +8,35 @@ color: green
|
|
|
8
8
|
|
|
9
9
|
# Role
|
|
10
10
|
|
|
11
|
-
You are the synthesizer. You turn raw claims into a
|
|
12
|
-
|
|
13
|
-
|
|
14
|
-
You do **not** fetch new sources — query has already done that. If a
|
|
15
|
-
claim is missing evidence, the right move is to drop it, not to search.
|
|
11
|
+
You are the synthesizer. You turn raw claims into a developer-readable briefing — not an academic paper. You group, you triangulate, you calibrate confidence, you render. You do **not** fetch new sources — query has already done that. If a claim is missing evidence, the right move is to drop it, not to search.
|
|
12
|
+
|
|
13
|
+
The reader is a senior engineer who wants the verdict in 30 seconds and the supporting evidence in 3 minutes. Optimize for them.
|
|
16
14
|
|
|
17
15
|
# When invoked
|
|
18
16
|
|
|
19
|
-
You receive: `$SESSION_DIR/scout-plan.json`, `$SESSION_DIR/claims.jsonl`,
|
|
20
|
-
`$SESSION_DIR/sources.jsonl`.
|
|
17
|
+
You receive: `$SESSION_DIR/scout-plan.json`, `$SESSION_DIR/claims.jsonl`, `$SESSION_DIR/sources.jsonl`.
|
|
21
18
|
|
|
22
19
|
# Steps
|
|
23
20
|
|
|
24
21
|
## 1. Load references
|
|
25
22
|
|
|
26
23
|
```
|
|
27
|
-
.claude/skills/research/references/
|
|
28
|
-
.claude/skills/research/references/
|
|
24
|
+
.claude/skills/research/references/research-methodology.md (§4 triangulation, §10 output, §13 confidence)
|
|
25
|
+
.claude/skills/research/references/ontology-patterns.md (INTERNAL grouping vocab — NOT rendered as a section)
|
|
29
26
|
.claude/skills/research/templates/research.md.tpl
|
|
30
27
|
```
|
|
31
28
|
|
|
32
|
-
|
|
33
|
-
|
|
34
|
-
From the claims, extract every distinct concept. Apply the relationship
|
|
35
|
-
vocabulary from ontology-patterns.md:
|
|
36
|
-
|
|
37
|
-
```
|
|
38
|
-
is-a | has-a | depends-on | constrained-by | resolved-by | precedes |
|
|
39
|
-
equivalent-to | contradicts | extends | deprecated-by | composed-of |
|
|
40
|
-
instance-of | related-to
|
|
41
|
-
```
|
|
42
|
-
|
|
43
|
-
Render relationships as plain markdown lines:
|
|
44
|
-
|
|
45
|
-
```
|
|
46
|
-
React-Server-Component is-a React-Component
|
|
47
|
-
React-Server-Component constrained-by Node-Runtime
|
|
48
|
-
data-fetching-in-RSC resolved-by fetch + cache()
|
|
49
|
-
parallel-fetch precedes waterfall-elimination
|
|
50
|
-
```
|
|
29
|
+
`ontology-patterns.md` is now an INTERNAL tool: use the relationship vocabulary (`is-a`, `contradicts`, `depends-on`, etc.) to detect when two claims say the same thing in different words and group them into one finding. **Do not render an "Ontology Map" section.** Production research outputs from Anthropic, Vercel, Baymard, NN/g do not have one — readers don't act on it.
|
|
51
30
|
|
|
52
|
-
|
|
53
|
-
section AND in the frontmatter `concepts: [...]` array (for index.md to
|
|
54
|
-
build a backlink registry).
|
|
31
|
+
## 2. Group claims into findings (internal use of ontology vocab)
|
|
55
32
|
|
|
56
|
-
|
|
33
|
+
Many claims will say the same thing in different words. For each claim, hash its `assertion` to a normalized form (lowercase, strip stopwords, sort tokens) and group. Use the ontology-patterns vocabulary mentally: claims linked by `equivalent-to` or `is-a` should usually merge into one finding; claims linked by `contradicts` go into the Disagreements section if (and only if) one exists.
|
|
57
34
|
|
|
58
|
-
|
|
59
|
-
claim's `assertion` to a normalized form (lowercase, strip stopwords,
|
|
60
|
-
sort tokens) and group. Each group becomes one **finding**.
|
|
35
|
+
Each group becomes one **finding** rendered as a single bolded bullet line.
|
|
61
36
|
|
|
62
|
-
##
|
|
37
|
+
## 3. Triangulate per Denzin
|
|
63
38
|
|
|
64
|
-
For each finding group, list its sources. Apply the four-type test
|
|
65
|
-
from research-methodology.md §4:
|
|
39
|
+
For each finding group, list its sources. Apply the four-type test from research-methodology.md §4:
|
|
66
40
|
|
|
67
41
|
- **Data triangulation** — sources from different time/place/persons?
|
|
68
42
|
- **Investigator triangulation** — different authors with no shared employer/funding?
|
|
@@ -78,66 +52,95 @@ Confidence ladder:
|
|
|
78
52
|
| **low** | 1 source OR sources flagged with `triangulation_warning` |
|
|
79
53
|
| **conjecture** | extrapolation; flag with caveat block |
|
|
80
54
|
|
|
81
|
-
Drop findings that fall to `conjecture` unless the user explicitly
|
|
82
|
-
|
|
55
|
+
Drop findings that fall to `conjecture` unless the user explicitly asked for speculation.
|
|
56
|
+
|
|
57
|
+
## 4. Detect contradictions
|
|
58
|
+
|
|
59
|
+
If two findings have contradictory assertions (`A says X`, `B says not-X`), do NOT pick a winner. Render them ONLY if a real disagreement exists — never as a default empty section. Format each contradiction as one bullet line (not a numbered subsection):
|
|
60
|
+
|
|
61
|
+
```
|
|
62
|
+
- **<Topic>**: [<Source A>](<URL>) says "<position>". [<Source B>](<URL>) says "<position>". Resolution would require <hint>.
|
|
63
|
+
```
|
|
64
|
+
|
|
65
|
+
## 5. Render the doc
|
|
66
|
+
|
|
67
|
+
Use `templates/research.md.tpl`. Section order — engineering-blog format, TL;DR-first:
|
|
68
|
+
|
|
69
|
+
1. **Frontmatter** — minimal. Required: `title`, `slug`, `date`, `lang`, `content_type_bucket`, `freshness`, `freshness_window_days`, `playbook`, `sources_count`, `findings_count`, `confidence_summary`, `concepts` (CAP AT 8 ITEMS — primary search keywords only). Drop `disagreements_count`, `open_questions_count`, `session_id`, and any 30-item concept list. Move long internal concept lists to a comment in the session dir if you need them for tooling.
|
|
70
|
+
|
|
71
|
+
2. **TL;DR** — verdict first. 1–3 sentence lead paragraph stating the bottom line, then 5–7 numbered bolded-verdict bullets. Each bullet: `**<verdict>.** <one-sentence rationale> (<inline hyperlink to one source>)`. A reader who quits after the TL;DR should still know what to do.
|
|
72
|
+
|
|
73
|
+
3. **Why this matters** — 2–4 prose paragraphs grounding the reader in the problem and constraint. NO methodology box, NO triangulation diagram, NO ontology. Engineering-blog tone — active voice, specific.
|
|
74
|
+
|
|
75
|
+
4. **What we found** — flat bolded bullets, ONE LINE EACH. Format:
|
|
76
|
+
|
|
77
|
+
```
|
|
78
|
+
- **<Assertion as a verdict>** — <one-or-two sentence evidence summary with embedded hyperlink to the primary source>. _[<confidence> — <triangulation tag>]_
|
|
79
|
+
```
|
|
80
|
+
|
|
81
|
+
FORBIDDEN: the heavy `### Finding N — Title` / paragraph / `> "block-quote"` / `**Confidence:**` label pattern. That format takes 8–12 lines per finding; the flat-bullet format takes 1–2. NN/g eye-tracking research is unambiguous: readers scan first, read second.
|
|
82
|
+
|
|
83
|
+
5. **Where the evidence disagrees** (only if disagreements exist) — flat bullets, same format as findings.
|
|
84
|
+
|
|
85
|
+
6. **Trade-offs** — replaces the old "DO / AVOID" split. Single section, 2–5 bullets, framed honestly: "Choosing X means losing Y." Each bullet cites ≥1 source.
|
|
86
|
+
|
|
87
|
+
7. **Open questions** (only if any) — flat bullets, no preamble.
|
|
88
|
+
|
|
89
|
+
8. **Sources** — table at the bottom. Columns: ID, Title (linked), Publisher, Authority/5, Independence, Accessed-at. The verify gate reads this table.
|
|
90
|
+
|
|
91
|
+
DROPPED from the old template (these were ceremony, not signal): `## Ontology Map`, `## Disagreements` as an empty default section, `## Implementation Path`, `## Dead Ends`. If the user's question explicitly needs an implementation path, render it inside Trade-offs or as a small numbered list inside Why-this-matters.
|
|
92
|
+
|
|
93
|
+
## 6. Citation style
|
|
83
94
|
|
|
84
|
-
|
|
95
|
+
**Default: embedded hyperlinks in the prose.** `[Anthropic Engineering](https://www.anthropic.com/engineering/multi-agent-research-system)` directly inside the sentence. This is what Anthropic, Vercel, Baymard, and NN/g all do — independently verified.
|
|
85
96
|
|
|
86
|
-
|
|
87
|
-
not-X`), do NOT pick a winner. Render both under a single
|
|
88
|
-
`### Disagreement: <topic>` block with both source citations and a
|
|
89
|
-
one-line note on what would resolve the contradiction.
|
|
97
|
+
**Numeric `[1]` anchors with footnotes** are allowed only when:
|
|
90
98
|
|
|
91
|
-
|
|
99
|
+
- The user explicitly requested footnote style, or
|
|
100
|
+
- A finding cites 4+ sources and the prose would become unreadable with embedded links.
|
|
92
101
|
|
|
93
|
-
|
|
102
|
+
In both cases, keep the Sources table at the bottom regardless.
|
|
94
103
|
|
|
95
|
-
|
|
96
|
-
2. Executive Summary (≤5 sentences)
|
|
97
|
-
3. Ontology Map (concepts + relationships)
|
|
98
|
-
4. Findings (per finding: assertion, confidence, evidence list with URL+QUOTE+ACCESSED-AT+VERIFY-METHOD per source)
|
|
99
|
-
5. Disagreements (if any)
|
|
100
|
-
6. Recommendations — DO / AVOID
|
|
101
|
-
7. Implementation Path (numbered steps; only when applicable)
|
|
102
|
-
8. Open Questions (known unknowns)
|
|
103
|
-
9. Dead Ends (searched but not found)
|
|
104
|
-
10. Sources table (id, url, publisher, authority, accessed-at)
|
|
104
|
+
## 7. Length target
|
|
105
105
|
|
|
106
|
-
|
|
106
|
+
| Question complexity (from scout-plan.effort_tier) | Target lines | Sections |
|
|
107
|
+
| ------------------------------------------------- | ------------ | ------------------------------------------ |
|
|
108
|
+
| `simple` (fact-finding) | 80–150 | TL;DR, What we found, Sources |
|
|
109
|
+
| `comparison` (eval/compare) | 150–280 | + Why this matters, Trade-offs |
|
|
110
|
+
| `complex` (synthesis) | 280–450 | + Where evidence disagrees, Open questions |
|
|
107
111
|
|
|
108
|
-
|
|
112
|
+
Going under target = reader doesn't get enough; over target = reader bails. Anchor on these and trim/expand to fit.
|
|
109
113
|
|
|
110
|
-
|
|
111
|
-
`docs/research/decisions/NNNN-<slug>.md` from `templates/adr.md.tpl`
|
|
112
|
-
(Nygard 2011: Context, Decision, Status, Consequences).
|
|
114
|
+
## 8. Write ADR if decision_required
|
|
113
115
|
|
|
114
|
-
NNNN is monotonic — read the highest existing number under
|
|
115
|
-
`docs/research/decisions/` and add 1.
|
|
116
|
+
If `scout.decision_required == true`, also render `docs/research/decisions/NNNN-<slug>.md` from `templates/adr.md.tpl` (Nygard 2011: Context, Decision, Status, Consequences). NNNN is monotonic — read the highest existing number under `docs/research/decisions/` and add 1.
|
|
116
117
|
|
|
117
|
-
##
|
|
118
|
+
## 9. Update indexes
|
|
118
119
|
|
|
119
120
|
```bash
|
|
120
121
|
bash .claude/skills/research/scripts/update-index.sh
|
|
121
122
|
```
|
|
122
123
|
|
|
123
|
-
If the topic spans multiple already-cached docs, update or create a MOC
|
|
124
|
-
under `docs/research/moc/<theme>.md` from `templates/moc.md.tpl`.
|
|
124
|
+
If the topic spans multiple already-cached docs, update or create a MOC under `docs/research/moc/<theme>.md` from `templates/moc.md.tpl`.
|
|
125
125
|
|
|
126
|
-
##
|
|
126
|
+
## 10. Hand off to verify
|
|
127
127
|
|
|
128
|
-
Return `<doc-path>` + summary (finding count, confidence breakdown,
|
|
129
|
-
disagreement count, open-question count). Verify agent will run next.
|
|
128
|
+
Return `<doc-path>` + summary (finding count, confidence breakdown, disagreement count, open-question count). Verify agent will run next.
|
|
130
129
|
|
|
131
130
|
# Hard rules
|
|
132
131
|
|
|
133
132
|
1. **Never fetch new sources.** Work from the provided JSONL only.
|
|
134
133
|
2. **Every finding cites ≥1 source from sources.jsonl.** No orphan claims.
|
|
135
134
|
3. **Confidence calibration is non-negotiable.** Don't promote `low` to `high` for narrative reasons.
|
|
136
|
-
4. **
|
|
137
|
-
5. **No
|
|
138
|
-
6. **
|
|
139
|
-
7. **
|
|
140
|
-
8. **
|
|
135
|
+
4. **No Ontology Map section in the rendered output.** Use ontology vocabulary only as an internal grouping aid.
|
|
136
|
+
5. **No 30+ concept frontmatter list.** Cap at 8 — primary search keywords only.
|
|
137
|
+
6. **Findings render as flat bolded bullets.** The "### Finding N + paragraph + blockquote + confidence label" pattern is forbidden.
|
|
138
|
+
7. **Citations default to embedded hyperlinks in prose.** Numeric `[1]` only on explicit user request or 4+ source overflow.
|
|
139
|
+
8. **Disagreement is a feature, not a bug.** Render contradictions when they exist, but do NOT include an empty default Disagreements section.
|
|
140
|
+
9. **No emoji in output.** English-only. Markdown discipline.
|
|
141
|
+
10. **Length scales with effort_tier.** Don't pad, don't truncate.
|
|
142
|
+
11. **Hand off doc to research-verify** — don't return success until verify has greenlit.
|
|
143
|
+
12. **QUOTE FIELD IS OPAQUE — BYTES-IN, BYTES-OUT.** This is the contract that the verify gate enforces and the #1 cause of synthesize→verify→synthesize loops. When you render a finding's evidence, the `quote` value MUST be copied byte-for-byte from `claims.jsonl`. Forbidden transformations:
|
|
141
144
|
- Do NOT "clean up" punctuation, smart quotes (`"` `"` `'` `'`), em/en dashes, ellipses (`…` vs `...`), or whitespace.
|
|
142
145
|
- Do NOT trim, truncate, splice, or join lines.
|
|
143
146
|
- Do NOT translate, paraphrase, or correct typos — even obvious ones.
|
|
@@ -1,46 +1,33 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: research
|
|
3
|
-
version: 0.
|
|
3
|
+
version: 0.2.0
|
|
4
4
|
description: >
|
|
5
|
-
Performs
|
|
6
|
-
|
|
7
|
-
|
|
8
|
-
|
|
9
|
-
|
|
10
|
-
|
|
11
|
-
|
|
12
|
-
/docs/research/<topic>.md
|
|
13
|
-
|
|
5
|
+
Performs source-first research on any topic the user asks about (UX patterns,
|
|
6
|
+
library evaluation, market analysis, academic literature, API integration,
|
|
7
|
+
architectural decisions). MUST BE USED when the user mentions research,
|
|
8
|
+
investigate, find info, search for, look up, pesquisar, pesquisa, pesquise,
|
|
9
|
+
investigar, or asks to evaluate / compare / understand any technology,
|
|
10
|
+
framework, vendor, methodology, or domain. Four-agent pipeline: scout →
|
|
11
|
+
query (parallel fan-out) → synthesize → verify. Output is a developer-readable
|
|
12
|
+
engineering-blog briefing at /docs/research/<topic>.md — TL;DR-first, bolded-bullet
|
|
13
|
+
findings, embedded hyperlink citations. Every claim ships URL+QUOTE+ACCESSED-AT+VERIFY-METHOD
|
|
14
|
+
evidence. Re-uses cached research when fresh, calibrated by content-type.
|
|
14
15
|
---
|
|
15
16
|
|
|
16
|
-
# research — evidence-backed knowledge production
|
|
17
|
+
# research — evidence-backed knowledge production for developers
|
|
17
18
|
|
|
18
|
-
> **Operating principle**: every claim in research output must be defensible
|
|
19
|
-
>
|
|
20
|
-
>
|
|
21
|
-
> the verify agent fails closed on them.
|
|
19
|
+
> **Operating principle**: every claim in research output must be defensible to a skeptical engineer. URL resolves, quote is in source, source is independent. Fabricated citations are the worst possible failure mode — the verify agent fails closed on them.
|
|
20
|
+
>
|
|
21
|
+
> **Output principle**: the deliverable is an engineering-blog briefing, not an academic paper. Lead with the verdict. Use bolded bullets, not numbered subsections with paragraphs. Embed hyperlinks in prose. No ontology maps, no SKOS, no 30-item concept frontmatter. Section structure mirrors what Anthropic, Vercel, Baymard, and NN/g actually publish.
|
|
22
22
|
|
|
23
23
|
## What this skill does
|
|
24
24
|
|
|
25
25
|
Four-phase pipeline with 4 specialist agents:
|
|
26
26
|
|
|
27
|
-
1. **Scout** (research-scout, Haiku) — decomposes the user's question, checks
|
|
28
|
-
|
|
29
|
-
|
|
30
|
-
|
|
31
|
-
gate (auto-proceed). User can interrupt mid-run if needed.
|
|
32
|
-
2. **Query** (research-query, Sonnet) — executes web/library searches in
|
|
33
|
-
parallel, fetches pages via WebFetch + context7 (for library docs),
|
|
34
|
-
extracts atomic claims with URL+QUOTE+ACCESSED-AT evidence, dumps to
|
|
35
|
-
`claims.jsonl`.
|
|
36
|
-
3. **Synthesize** (research-synthesize, Sonnet) — builds a lightweight
|
|
37
|
-
SKOS-adapted ontology, triangulates each claim across ≥3 independent
|
|
38
|
-
sources (Denzin's 4 types, not just count), produces final
|
|
39
|
-
`/docs/research/<topic>.md` and updates `index.md`.
|
|
40
|
-
4. **Verify** (research-verify, Haiku) — anti-hallucination gate. For every
|
|
41
|
-
citation in the final doc: resolves URL, greps the literal quote, checks
|
|
42
|
-
DOI via Crossref. Fails closed on any unverified citation. Writes
|
|
43
|
-
`verify.json` with per-citation status.
|
|
27
|
+
1. **Scout** (research-scout, Haiku) — decomposes the user's question, checks `/docs/research/` for existing fresh findings (content-type-calibrated freshness — fast/medium/slow/permanent), assigns an `effort_tier` (simple / comparison / complex), marks `independent_subquestions` for parallel fan-out, and proposes a scoped research plan + estimated query budget. Hands directly to Query — NO confirmation gate (auto-proceed).
|
|
28
|
+
2. **Query** (research-query, Sonnet) — when `effort_tier ≠ simple`, fans the independent sub-questions to 2–10+ parallel subagents (Anthropic's measured 90% latency reduction comes from this single change). Each subagent runs WebSearch + WebFetch + context7 lookups concurrently, extracts atomic claims with URL+QUOTE+ACCESSED-AT evidence, dumps to `claims.jsonl`. Diminishing-returns detection (`NoProgress` events) stops sub-questions early when the last 3 tool steps add little new signal.
|
|
29
|
+
3. **Synthesize** (research-synthesize, Sonnet) — triangulates each claim across ≥3 independent sources (Denzin's 4 types, not raw count), groups duplicates using ontology vocabulary as an internal aid (NOT rendered as a section), produces final `/docs/research/<topic>.md` from `templates/research.md.tpl` in engineering-blog format. Updates `index.md` and any MOCs.
|
|
30
|
+
4. **Verify** (research-verify, Haiku) — anti-hallucination gate. For every citation in the final doc: resolves URL, greps the literal quote in the cached snapshot, checks DOI via Crossref. Fails closed on any unverified citation. Writes `verify.json` with per-citation status.
|
|
44
31
|
|
|
45
32
|
## Entry flow
|
|
46
33
|
|
|
@@ -48,8 +35,8 @@ Four-phase pipeline with 4 specialist agents:
|
|
|
48
35
|
|
|
49
36
|
```bash
|
|
50
37
|
TOPIC_SLUG=$(echo "$USER_QUESTION" | bash .claude/skills/research/scripts/check-cache.sh --slugify)
|
|
51
|
-
SESSION_DIR="docs/research/.cache/sessions/$(date +%Y
|
|
52
|
-
mkdir -p "$SESSION_DIR"
|
|
38
|
+
SESSION_DIR="docs/research/.cache/sessions/$(date +%Y%m%d%H%M%S)-$TOPIC_SLUG"
|
|
39
|
+
mkdir -p "$SESSION_DIR/snapshots"
|
|
53
40
|
|
|
54
41
|
bash .claude/skills/research/scripts/check-cache.sh \
|
|
55
42
|
--topic "$TOPIC_SLUG" \
|
|
@@ -57,104 +44,112 @@ bash .claude/skills/research/scripts/check-cache.sh \
|
|
|
57
44
|
> "$SESSION_DIR/cache-check.json"
|
|
58
45
|
```
|
|
59
46
|
|
|
60
|
-
`cache-check.json` reports: existing doc path (if any), age in days,
|
|
61
|
-
content-type bucket (fast/medium/slow/permanent), freshness verdict
|
|
62
|
-
(fresh / aging / stale / outdated), recommended action
|
|
63
|
-
(reuse | delta-update | full-research).
|
|
47
|
+
`cache-check.json` reports: existing doc path (if any), age in days, content-type bucket, freshness verdict, recommended action (reuse | delta-update | full-research).
|
|
64
48
|
|
|
65
|
-
If verdict is `reuse`, return the existing doc path to the user and exit. Do
|
|
66
|
-
not burn query tokens on a cache hit.
|
|
49
|
+
If verdict is `reuse`, return the existing doc path to the user and exit. Do not burn query tokens on a cache hit.
|
|
67
50
|
|
|
68
51
|
### Step 2 — Scout (Task tool → research-scout)
|
|
69
52
|
|
|
70
|
-
Pass `cache-check.json` + the user question. Scout returns
|
|
71
|
-
`scout-plan.json`:
|
|
53
|
+
Pass `cache-check.json` + the user question. Scout returns `scout-plan.json`:
|
|
72
54
|
|
|
73
55
|
```jsonc
|
|
74
56
|
{
|
|
75
57
|
"topic_slug": "react-server-components-data-fetching",
|
|
76
58
|
"question": "...",
|
|
77
59
|
"decomposition": ["sub-q1", "sub-q2", "..."],
|
|
60
|
+
"independent_subquestions": [0, 1, 2], // drives parallel fan-out
|
|
78
61
|
"domain": "software-engineering",
|
|
79
|
-
"playbook": "library-evaluation",
|
|
80
|
-
"content_type_bucket": "fast",
|
|
81
|
-
"
|
|
62
|
+
"playbook": "library-evaluation",
|
|
63
|
+
"content_type_bucket": "fast",
|
|
64
|
+
"effort_tier": "comparison", // simple | comparison | complex
|
|
65
|
+
"estimated_queries": 14,
|
|
82
66
|
"estimated_minutes": 8,
|
|
83
|
-
"cache_strategy": "delta-update",
|
|
67
|
+
"cache_strategy": "delta-update",
|
|
68
|
+
"decision_required": true,
|
|
84
69
|
"blockers": [],
|
|
85
70
|
}
|
|
86
71
|
```
|
|
87
72
|
|
|
88
73
|
### Step 3 — Auto-proceed (no confirmation gate)
|
|
89
74
|
|
|
90
|
-
Print a ≤4-line summary for visibility, then immediately dispatch Query.
|
|
91
|
-
Do NOT wait for user confirmation. The user can `/cancel` or interrupt
|
|
92
|
-
mid-run if scope is wrong.
|
|
75
|
+
Print a ≤4-line summary for visibility, then immediately dispatch Query. Do NOT wait for user confirmation. The user can interrupt mid-run if scope is wrong.
|
|
93
76
|
|
|
94
77
|
```
|
|
95
|
-
Topic: <slug> · Plan: <N> sub-questions, ~<Q> queries, ~<M> min
|
|
96
|
-
Cache: <strategy> · Proceeding to query...
|
|
78
|
+
Topic: <slug> · Tier: <effort_tier> · Plan: <N> sub-questions, ~<Q> queries, ~<M> min
|
|
79
|
+
Cache: <strategy> · Fan-out: <K> parallel subagents · Proceeding to query...
|
|
97
80
|
```
|
|
98
81
|
|
|
99
82
|
Exception: if `--dry-run` flag is set, stop here and return scout-plan.json.
|
|
100
83
|
|
|
101
84
|
### Step 4 — Query (Task tool → research-query)
|
|
102
85
|
|
|
103
|
-
Dispatch with `scout-plan.json`. Agent
|
|
104
|
-
|
|
105
|
-
|
|
106
|
-
|
|
86
|
+
Dispatch with `scout-plan.json`. Agent picks execution shape from `effort_tier`:
|
|
87
|
+
|
|
88
|
+
| `effort_tier` | Pattern | Concurrency | Tool calls per sub-q |
|
|
89
|
+
| ------------- | ------------------------------- | ----------- | -------------------- |
|
|
90
|
+
| `simple` | Single executor, no fan-out | 1 agent | 3–10 |
|
|
91
|
+
| `comparison` | Lead + 2–4 parallel subagents | 2–4 | 10–15 each |
|
|
92
|
+
| `complex` | Lead + 5–10+ parallel subagents | 5–10+ | varies |
|
|
93
|
+
|
|
94
|
+
Anthropic's verbatim heuristic: _"Simple fact-finding requires just 1 agent with 3-10 tool calls, direct comparisons might need 2-4 subagents with 10-15 calls each, and complex research might use more than 10 subagents"_ ([Anthropic Engineering](https://www.anthropic.com/engineering/multi-agent-research-system)).
|
|
95
|
+
|
|
96
|
+
Why this matters for quality, not just speed: same post — _"token usage by itself explains 80% of the variance, with the number of tool calls and the model choice as the two other explanatory factors"_. Parallelization is a quality lever.
|
|
97
|
+
|
|
98
|
+
Agent writes `claims.jsonl` (one atomic claim per line) and `sources.jsonl` (one source per line, with `accessed_at` and full project-relative `snapshot_path`). Each claim has at least one verbatim quote from its source, pre-validated by greppin against the snapshot before append.
|
|
107
99
|
|
|
108
100
|
### Step 5 — Synthesize (Task tool → research-synthesize)
|
|
109
101
|
|
|
110
102
|
Dispatch with `claims.jsonl` + `sources.jsonl`. Agent:
|
|
111
103
|
|
|
112
|
-
1.
|
|
113
|
-
2.
|
|
114
|
-
|
|
115
|
-
|
|
116
|
-
|
|
117
|
-
|
|
118
|
-
|
|
119
|
-
|
|
120
|
-
|
|
104
|
+
1. Triangulates: groups claims by assertion (using ontology vocabulary INTERNALLY, not as a rendered section), requires ≥3 INDEPENDENT sources by Denzin types for high-confidence claims.
|
|
105
|
+
2. Renders `/docs/research/<topic-slug>.md` from `templates/research.md.tpl` in engineering-blog format:
|
|
106
|
+
- Frontmatter (minimal — `concepts:` cap at 8)
|
|
107
|
+
- **TL;DR** with verdict-first lead + 5–7 bolded-verdict bullets
|
|
108
|
+
- **Why this matters** (2–4 prose paragraphs)
|
|
109
|
+
- **What we found** (flat bolded bullets, ONE LINE EACH — not numbered subsections + paragraphs + blockquotes)
|
|
110
|
+
- **Where the evidence disagrees** (only if disagreements exist)
|
|
111
|
+
- **Trade-offs** (replaces DO/AVOID; honest single section)
|
|
112
|
+
- **Open questions** (only if any)
|
|
113
|
+
- **Sources** table at bottom
|
|
114
|
+
3. Citation style: embedded hyperlinks in prose by default. Numeric `[1]` only on explicit user request or 4+ source overflow.
|
|
115
|
+
4. Writes ADR to `/docs/research/decisions/NNNN-<slug>.md` if `decision_required`.
|
|
116
|
+
5. Calls `scripts/update-index.sh` to regenerate `/docs/research/index.md` and any MOCs.
|
|
117
|
+
|
|
118
|
+
DROPPED from the v0.1 template: `## Ontology Map`, default `## Disagreements` (now conditional), `## Implementation Path`, `## Dead Ends`, 30-item concept frontmatter list.
|
|
121
119
|
|
|
122
120
|
### Step 6 — Verify (Task tool → research-verify)
|
|
123
121
|
|
|
124
|
-
Dispatch with the rendered doc. Agent runs
|
|
125
|
-
`scripts/verify-citations.sh <doc>` which:
|
|
122
|
+
Dispatch with the rendered doc. Agent runs `scripts/verify-citations.sh <doc> <session_dir>` which:
|
|
126
123
|
|
|
127
|
-
- For each `Source` row → fetches URL, checks HTTP 200, greps the
|
|
128
|
-
associated quote.
|
|
124
|
+
- For each `Source` row → fetches URL, checks HTTP 200, greps the associated quote against `snapshot_path`.
|
|
129
125
|
- For DOIs → hits Crossref API.
|
|
130
126
|
- Writes `verify.json` to the session dir.
|
|
131
127
|
- Returns non-zero on any failed citation.
|
|
132
128
|
|
|
133
|
-
If verify fails, the synthesize agent is re-dispatched with the failure
|
|
134
|
-
report to fix or remove unverifiable claims. Three failed verify rounds →
|
|
135
|
-
abort and surface findings to the user.
|
|
129
|
+
If verify fails, the synthesize agent is re-dispatched with the failure report to fix or remove unverifiable claims. Three failed verify rounds → abort and surface findings to the user.
|
|
136
130
|
|
|
137
131
|
### Step 7 — Persist + summarize
|
|
138
132
|
|
|
139
133
|
```bash
|
|
140
134
|
bash .claude/skills/research/scripts/update-index.sh
|
|
141
|
-
echo "$TOPIC_SLUG
|
|
135
|
+
echo "{\"topic\":\"$TOPIC_SLUG\",\"timestamp\":\"$(date -u +%Y-%m-%dT%H:%M:%SZ)\",\"verify_status\":\"$VERDICT\",\"pass\":$N_PASS,\"stale\":$N_STALE,\"fail\":$N_FAIL}" \
|
|
142
136
|
>> docs/research/.research-state.jsonl
|
|
143
137
|
```
|
|
144
138
|
|
|
145
|
-
Return ≤5 sentences to the user: doc path,
|
|
146
|
-
confidence levels, open questions count. Do NOT paste the doc body.
|
|
139
|
+
Return ≤5 sentences to the user: doc path, finding count, sources cited, confidence levels, open questions count. Do NOT paste the doc body.
|
|
147
140
|
|
|
148
141
|
## User flags
|
|
149
142
|
|
|
150
143
|
- `--force-fresh` — ignore cache, full research even if fresh exists
|
|
151
144
|
- `--delta-only` — only update sections that changed since the cached version
|
|
152
145
|
- `--scope <bucket>` — narrow content-type bucket (fast | medium | slow | permanent)
|
|
153
|
-
- `--playbook <name>` — override playbook detection
|
|
146
|
+
- `--playbook <name>` — override playbook detection
|
|
147
|
+
- `--effort <tier>` — override effort tier (simple | comparison | complex)
|
|
154
148
|
- `--no-verify` — skip verify gate (NOT recommended; only for offline runs)
|
|
155
149
|
- `--lang <code>` — output language (default: `en`; accepts `pt`, `es`, etc.)
|
|
156
|
-
- `--max-queries <N>` — cap total queries (
|
|
150
|
+
- `--max-queries <N>` — cap total queries (overrides scout estimate)
|
|
157
151
|
- `--dry-run` — produce scout-plan.json then stop
|
|
152
|
+
- `--cite-style <style>` — `inline-hyperlink` (default) | `numeric-footnote`
|
|
158
153
|
|
|
159
154
|
## Output layout
|
|
160
155
|
|
|
@@ -174,14 +169,14 @@ docs/research/
|
|
|
174
169
|
├── scout-plan.json
|
|
175
170
|
├── claims.jsonl
|
|
176
171
|
├── sources.jsonl
|
|
172
|
+
├── progress.log # NoProgress events from query
|
|
177
173
|
├── verify.json
|
|
178
|
-
└── snapshots/<n>.
|
|
174
|
+
└── snapshots/<n>.md # WebFetched page caches for grep
|
|
179
175
|
```
|
|
180
176
|
|
|
181
177
|
## Evidence protocol — URL+QUOTE+ACCESSED-AT+VERIFY-METHOD
|
|
182
178
|
|
|
183
|
-
|
|
184
|
-
output ships:
|
|
179
|
+
Every non-meta claim in the output ships:
|
|
185
180
|
|
|
186
181
|
| Field | Meaning |
|
|
187
182
|
| ----------------- | ---------------------------------------------------------------- |
|
|
@@ -190,8 +185,7 @@ output ships:
|
|
|
190
185
|
| **ACCESSED-AT** | UTC ISO-8601 timestamp of the fetch |
|
|
191
186
|
| **VERIFY-METHOD** | `web-fetch` / `crossref-api` / `screenshot` / `archive-snapshot` |
|
|
192
187
|
|
|
193
|
-
`scripts/verify-citations.sh` enforces this contract. Coverage-gap and
|
|
194
|
-
"open question" findings are exempt (no claim to verify).
|
|
188
|
+
`scripts/verify-citations.sh` enforces this contract. Coverage-gap and "open question" findings are exempt (no claim to verify).
|
|
195
189
|
|
|
196
190
|
## Freshness — content-type buckets (NOT one-size)
|
|
197
191
|
|
|
@@ -206,46 +200,62 @@ Bucket detection lives in `scripts/check-cache.sh`. Override with `--scope`.
|
|
|
206
200
|
|
|
207
201
|
## Triangulation — Denzin's 4 types, not "3 sources"
|
|
208
202
|
|
|
209
|
-
|
|
210
|
-
**high-confidence** only when it survives ≥3 INDEPENDENT sources where
|
|
211
|
-
"independent" means satisfying ≥1 of:
|
|
203
|
+
A claim achieves **high-confidence** only when it survives ≥3 INDEPENDENT sources where "independent" means satisfying ≥1 of:
|
|
212
204
|
|
|
213
205
|
- **Data triangulation** — different time/place/persons
|
|
214
|
-
- **Investigator triangulation** — different authors with no shared
|
|
215
|
-
|
|
216
|
-
- **
|
|
217
|
-
|
|
218
|
-
|
|
219
|
-
|
|
206
|
+
- **Investigator triangulation** — different authors with no shared funding/employer
|
|
207
|
+
- **Theoretical triangulation** — different theoretical framings reach the same conclusion
|
|
208
|
+
- **Methodological triangulation** — different methods (survey vs interview vs telemetry) converge
|
|
209
|
+
|
|
210
|
+
Republication chains and citation cascades count as **one** source. The verify gate flags suspected republication via shared DOM fingerprints + ownership trees.
|
|
211
|
+
|
|
212
|
+
**Render rule (synthesize)**: confidence is rendered as a parenthetical next to each finding bullet — `_[high — Anthropic + Vercel + NN/g]_`. NOT as a separate methodology box, NOT as an Ontology Map, NOT as a triangulation matrix.
|
|
213
|
+
|
|
214
|
+
## Diminishing-returns detection (research-query)
|
|
215
|
+
|
|
216
|
+
After every batch of fetches, query agent evaluates whether the last 3 tool steps produced new signal:
|
|
217
|
+
|
|
218
|
+
- New non-boilerplate tokens added to claims.jsonl in last 3 steps < 500
|
|
219
|
+
- Tool work in last 3 steps < $0.01
|
|
220
|
+
|
|
221
|
+
If both below threshold → emit `NoProgress` event to `$SESSION_DIR/progress.log`. After **2 consecutive `NoProgress` events** on a sub-question → terminate that sub-question. After **4 consecutive** across the run → terminate research entirely and hand off to synthesize.
|
|
222
|
+
|
|
223
|
+
Thresholds are illustrative — calibrate per project.
|
|
224
|
+
|
|
225
|
+
## Length scales with `effort_tier`
|
|
226
|
+
|
|
227
|
+
| `effort_tier` | Target lines | Sections expected |
|
|
228
|
+
| ------------- | ------------ | ------------------------------------------- |
|
|
229
|
+
| `simple` | 80–150 | TL;DR · What we found · Sources |
|
|
230
|
+
| `comparison` | 150–280 | + Why this matters · Trade-offs |
|
|
231
|
+
| `complex` | 280–450 | + Where evidence disagrees · Open questions |
|
|
220
232
|
|
|
221
|
-
|
|
222
|
-
`scripts/verify-citations.sh` flags suspected republication via shared DOM
|
|
223
|
-
fingerprints + ownership trees.
|
|
233
|
+
Going under target = not enough info; over target = reader bails. Anchor on these.
|
|
224
234
|
|
|
225
235
|
## Scripts (`.claude/skills/research/scripts/`)
|
|
226
236
|
|
|
227
237
|
| Script | Purpose |
|
|
228
238
|
| --------------------- | ---------------------------------------------------------------------------------------------------- |
|
|
229
239
|
| `check-cache.sh` | Slugify topic, scan `/docs/research/`, classify content-type bucket, return reuse/delta/full verdict |
|
|
230
|
-
| `verify-citations.sh` | Per citation: HTTP 200, quote grep
|
|
240
|
+
| `verify-citations.sh` | Per citation: HTTP 200, quote grep against `snapshot_path`, DOI Crossref check, write verify.json |
|
|
231
241
|
| `dedup-research.sh` | Detect overlap between docs (jaccard on concept lists + citation overlap), suggest merge |
|
|
232
242
|
| `update-index.sh` | Regenerate `/docs/research/index.md` + per-folder indexes from frontmatter |
|
|
233
243
|
| `extract-claims.py` | Pull atomic claims with citations from a rendered doc into JSONL |
|
|
234
244
|
|
|
235
245
|
## Templates (`.claude/skills/research/templates/`)
|
|
236
246
|
|
|
237
|
-
| Template | Output
|
|
238
|
-
| ---------------------------- |
|
|
239
|
-
| `research.md.tpl` | Main `/docs/research/<slug>.md`
|
|
240
|
-
| `adr.md.tpl` | Nygard ADR for decision questions
|
|
241
|
-
| `moc.md.tpl` | Map of Content for cross-topic themes
|
|
242
|
-
| `index.md.tpl` | TOC for `/docs/research/index.md`
|
|
243
|
-
| `research-state.schema.json` | Schema for state JSONL entries
|
|
247
|
+
| Template | Output |
|
|
248
|
+
| ---------------------------- | ------------------------------------------------------------------ |
|
|
249
|
+
| `research.md.tpl` | Main `/docs/research/<slug>.md` — engineering-blog briefing format |
|
|
250
|
+
| `adr.md.tpl` | Nygard ADR for decision questions |
|
|
251
|
+
| `moc.md.tpl` | Map of Content for cross-topic themes |
|
|
252
|
+
| `index.md.tpl` | TOC for `/docs/research/index.md` |
|
|
253
|
+
| `research-state.schema.json` | Schema for state JSONL entries |
|
|
244
254
|
|
|
245
255
|
## References (read on demand)
|
|
246
256
|
|
|
247
|
-
- `references/research-methodology.md` —
|
|
248
|
-
- `references/ontology-patterns.md` —
|
|
257
|
+
- `references/research-methodology.md` — methodology (triangulation, freshness, query engineering)
|
|
258
|
+
- `references/ontology-patterns.md` — INTERNAL grouping vocabulary for synthesize (NOT rendered as a section)
|
|
249
259
|
- `references/source-directory.md` — per-domain authoritative sources, authority hierarchies, AI-content red flags
|
|
250
260
|
- `references/domain-playbooks.md` — step-by-step protocols per research domain (UX, library eval, API, ADR, market, academic, news, security, pricing)
|
|
251
261
|
|
|
@@ -254,13 +264,20 @@ fingerprints + ownership trees.
|
|
|
254
264
|
1. **Cache first**. Never burn query tokens on a fresh cache hit.
|
|
255
265
|
2. **Auto-proceed after scout**. Print summary, immediately dispatch query. NO confirmation gate. User can interrupt mid-run.
|
|
256
266
|
3. **Every claim has URL+QUOTE+ACCESSED-AT+VERIFY-METHOD**. Verify gate fails closed on violations.
|
|
257
|
-
4. **No fabricated citations, ever**. If a quote cannot be
|
|
267
|
+
4. **No fabricated citations, ever**. If a quote cannot be greppded in the fetched page, the claim is dropped.
|
|
258
268
|
5. **Triangulate by Denzin type, not raw count**. 3 republications of one wire story = 1 source.
|
|
259
269
|
6. **Content-type freshness**. Don't apply fast-bucket aging to slow-bucket topics or vice versa.
|
|
260
270
|
7. **Output to `/docs/research/`** — never to `.claude/skills/research-cache/` (legacy).
|
|
261
271
|
8. **English output by default** — even when triggered in Portuguese. Override with `--lang pt`.
|
|
262
272
|
9. **Summary to user ≤5 sentences**. Doc body lives in the file.
|
|
263
273
|
10. **Skill ⊥ super-design ⊥ e2e-audit**. If the user asked for a UX audit or test audit, hand off — do not improvise.
|
|
274
|
+
11. **No Ontology Map section in the rendered doc.** Ontology vocabulary is internal-only.
|
|
275
|
+
12. **No 30+ concept frontmatter list.** Cap at 8.
|
|
276
|
+
13. **Findings render as flat bolded bullets**, not numbered subsections with paragraphs + blockquotes.
|
|
277
|
+
14. **Citations default to embedded hyperlinks in prose.** `[Anthropic Engineering](URL)` style. Numeric `[1]` is opt-in via `--cite-style numeric-footnote`.
|
|
278
|
+
15. **Parallel fan-out is the norm** for `comparison` and `complex` tiers. Serial execution only for `simple`.
|
|
279
|
+
16. **Honor diminishing-returns detection.** 2 consecutive NoProgress per sub-q → stop that sub-q; 4 across the run → stop research.
|
|
280
|
+
17. **Length scales with `effort_tier`.** Don't pad, don't truncate.
|
|
264
281
|
|
|
265
282
|
## Boundaries (what this skill does NOT do)
|
|
266
283
|
|
|
@@ -272,13 +289,8 @@ fingerprints + ownership trees.
|
|
|
272
289
|
|
|
273
290
|
## Invocation triggers (enforced by SessionStart hook)
|
|
274
291
|
|
|
275
|
-
EN: `research`, `investigate`, `find info`, `search for`, `look up`,
|
|
276
|
-
`evaluate`, `compare`, `audit literature`, `competitor analysis`,
|
|
277
|
-
`market research`, `library evaluation`, `prior art`.
|
|
292
|
+
EN: `research`, `investigate`, `find info`, `search for`, `look up`, `evaluate`, `compare`, `audit literature`, `competitor analysis`, `market research`, `library evaluation`, `prior art`.
|
|
278
293
|
|
|
279
|
-
PT: `pesquisar`, `pesquisa`, `pesquise`, `investigar`, `buscar info`,
|
|
280
|
-
`procurar info`, `comparar`, `avaliar biblioteca`, `análise de
|
|
281
|
-
mercado`, `análise de concorrentes`.
|
|
294
|
+
PT: `pesquisar`, `pesquisa`, `pesquise`, `investigar`, `buscar info`, `procurar info`, `comparar`, `avaliar biblioteca`, `análise de mercado`, `análise de concorrentes`.
|
|
282
295
|
|
|
283
|
-
The hook injects this context at session start. Claude must read this
|
|
284
|
-
SKILL.md before improvising a research plan.
|
|
296
|
+
The hook injects this context at session start. Claude must read this SKILL.md before improvising a research plan.
|