@nurix/etna 0.19.41 → 0.19.42
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/data/harness-index.json +1 -1
- package/data/harnesses/discover/codex/agents/api.toml +24 -0
- package/data/harnesses/discover/codex/agents/codebase.toml +24 -0
- package/data/harnesses/discover/codex/agents/community.toml +24 -0
- package/data/harnesses/discover/codex/agents/deployed-client-bundle.toml +24 -0
- package/data/harnesses/discover/codex/agents/distribution-artifacts.toml +24 -0
- package/data/harnesses/discover/codex/agents/docs.toml +27 -1
- package/data/harnesses/discover/codex/agents/infra-backend-fingerprint.toml +24 -0
- package/data/harnesses/discover/codex/agents/packages.toml +24 -0
- package/data/harnesses/discover/codex/agents/session.toml +40 -0
- package/data/harnesses/discover/codex/agents/website.toml +24 -0
- package/data/harnesses/discover/codex/agents/wire-capture.toml +40 -0
- package/data/harnesses/discover/harness.json +2 -2
- package/data/harnesses/discover/rules/calibration.md +219 -0
- package/data/harnesses/discover/rules/tooling.md +205 -0
- package/package.json +2 -2
package/data/harness-index.json
CHANGED
|
@@ -30,4 +30,28 @@ You collect a target's documented machine interface into `research/<target>/dime
|
|
|
30
30
|
A one-paragraph headline (the API surface in a sentence) + endpoint-family counts + the auth model. Flag overlap with the packages/docs dimensions (the published SDK often wraps this API) and especially any drift vs. the session dimension's _observed_ wire surface, for synthesis.
|
|
31
31
|
|
|
32
32
|
**Discipline:** the spec is the load-bearing artifact — capture it accurately, digest if huge. Redact any embedded keys/example tokens. A disabled-introspection or undocumented API is a finding, recorded as an Open question, not a guess.
|
|
33
|
+
|
|
34
|
+
---
|
|
35
|
+
|
|
36
|
+
## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
|
|
37
|
+
|
|
38
|
+
**MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
|
|
39
|
+
the served spec **exactly as served** (`openapi.json` / SDL / introspection result) saved with `curl -o` — never a re-typed table; plus each probed endpoint's raw response body.
|
|
40
|
+
|
|
41
|
+
Three rules bind this, and they override any instinct to summarise:
|
|
42
|
+
|
|
43
|
+
1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
|
|
44
|
+
count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
|
|
45
|
+
medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
|
|
46
|
+
the citation will outlive its evidence.
|
|
47
|
+
2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
|
|
48
|
+
`_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
|
|
49
|
+
essay, not a capture.
|
|
50
|
+
3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
|
|
51
|
+
straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
|
|
52
|
+
bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
|
|
53
|
+
discard evidence.
|
|
54
|
+
|
|
55
|
+
**Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
|
|
56
|
+
regardless of how good the prose is.
|
|
33
57
|
'''
|
|
@@ -40,4 +40,28 @@ Return a **per-unit work-list** as a compact table so the main session can dispa
|
|
|
40
40
|
Plus a one-paragraph headline of what the codebase reveals. The main session will dispatch readers that each write `raw/<unit>.md` (install/exports/key-files/architecture for that unit).
|
|
41
41
|
|
|
42
42
|
**Discipline:** breadth over depth; digest large trees; never read or write secrets (scan `.env*`, config, fixtures for credentials and redact before quoting). An empty/over-large area is an Open question, not a guess.
|
|
43
|
+
|
|
44
|
+
---
|
|
45
|
+
|
|
46
|
+
## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
|
|
47
|
+
|
|
48
|
+
**MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
|
|
49
|
+
the resolved manifests (`package.json`, `pyproject.toml`, lockfile summaries) and the structure map — the clone in `source/<target>/` is itself the artifact.
|
|
50
|
+
|
|
51
|
+
Three rules bind this, and they override any instinct to summarise:
|
|
52
|
+
|
|
53
|
+
1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
|
|
54
|
+
count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
|
|
55
|
+
medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
|
|
56
|
+
the citation will outlive its evidence.
|
|
57
|
+
2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
|
|
58
|
+
`_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
|
|
59
|
+
essay, not a capture.
|
|
60
|
+
3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
|
|
61
|
+
straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
|
|
62
|
+
bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
|
|
63
|
+
discard evidence.
|
|
64
|
+
|
|
65
|
+
**Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
|
|
66
|
+
regardless of how good the prose is.
|
|
43
67
|
'''
|
|
@@ -28,4 +28,28 @@ You collect a target's living signal into `research/<target>/dimensions/communit
|
|
|
28
28
|
A one-paragraph headline (where the product is heading + its biggest acknowledged gap) + the top 3–5 themes. This feeds the competitive-positioning and product-features rollups.
|
|
29
29
|
|
|
30
30
|
**Discipline:** themes over threads; cite representative examples, don't dump feeds. Respect rate limits and TOS. Mark anything paywalled/private as an Open question.
|
|
31
|
+
|
|
32
|
+
---
|
|
33
|
+
|
|
34
|
+
## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
|
|
35
|
+
|
|
36
|
+
**MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
|
|
37
|
+
the changelog / issue / release payloads **as fetched** — JSON wherever an API exists (GitHub API, RSS, Featurebase/Canny), not only a themed digest.
|
|
38
|
+
|
|
39
|
+
Three rules bind this, and they override any instinct to summarise:
|
|
40
|
+
|
|
41
|
+
1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
|
|
42
|
+
count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
|
|
43
|
+
medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
|
|
44
|
+
the citation will outlive its evidence.
|
|
45
|
+
2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
|
|
46
|
+
`_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
|
|
47
|
+
essay, not a capture.
|
|
48
|
+
3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
|
|
49
|
+
straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
|
|
50
|
+
bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
|
|
51
|
+
discard evidence.
|
|
52
|
+
|
|
53
|
+
**Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
|
|
54
|
+
regardless of how good the prose is.
|
|
31
55
|
'''
|
|
@@ -50,4 +50,28 @@ Then Method / Findings (framework, build tool, route count, endpoint count — t
|
|
|
50
50
|
Return a one-paragraph headline of what the deployed shell reveals — framework + build tool, route count, the shape of the API surface it calls, whether source maps were shipped (and the confidence that implies). **Cross-checks:** flag that `dimensions/_shared/api-path-catalog.md` and `dimensions/_shared/feature-flags.md` are the SHARED seam artifacts (§6, one physical file each) — `session`/`wire`/`distribution` append to the same files with `source: session | wire | distribution`, and evaluation owns the adaptive static-vs-observed diff. Surface any endpoint or flag that looks authed/internal but is statically declared in the unauth bundle — that gap is the dimension's highest-value output.
|
|
51
51
|
|
|
52
52
|
**Discipline:** breadth over depth; digest large chunks, never paste them; check for a source map before string-mining (it upgrades confidence); REDACT every env value before any `raw/` write and log it in `_meta.redactions`; obey the seam rule — one canonical shared catalog name, never a private fork. An absent bundle, obfuscated route table, or missing source map is an Open question, not a guess.
|
|
53
|
+
|
|
54
|
+
---
|
|
55
|
+
|
|
56
|
+
## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
|
|
57
|
+
|
|
58
|
+
**MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
|
|
59
|
+
the entry bundle itself (`curl -o raw/bundle.js`, gzip is fine) and any `.map` — the route table, API-path catalog and flag extracts are written **in addition**, never instead.
|
|
60
|
+
|
|
61
|
+
Three rules bind this, and they override any instinct to summarise:
|
|
62
|
+
|
|
63
|
+
1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
|
|
64
|
+
count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
|
|
65
|
+
medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
|
|
66
|
+
the citation will outlive its evidence.
|
|
67
|
+
2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
|
|
68
|
+
`_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
|
|
69
|
+
essay, not a capture.
|
|
70
|
+
3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
|
|
71
|
+
straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
|
|
72
|
+
bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
|
|
73
|
+
discard evidence.
|
|
74
|
+
|
|
75
|
+
**Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
|
|
76
|
+
regardless of how good the prose is.
|
|
53
77
|
'''
|
|
@@ -55,4 +55,28 @@ Then write the per-type raw files that apply — `raw/{extension-manifest.md, el
|
|
|
55
55
|
Return a **one-paragraph headline** of what the shipped client reveals — its declared hosts, permission surface, embedded vendor SDKs, and how much richer (or not) it is than the web app. The API paths and feature flags you appended feed the **seam rule (§6)**: your `dimensions/_shared/api-path-catalog.md` rows carry `source: distribution` so evaluation can run its adaptive diff against `deployed-client-bundle` (`source: bundle`), `session`, and `wire-capture`. The hosts and SDK list cross-check **infra-backend-fingerprint** (a host the binary calls that DNS/CT didn't surface is a finding); the runtime hosts also seed **wire-capture** targets (the binary says what it _might_ call; the capture says what it _does_).
|
|
56
56
|
|
|
57
57
|
**Discipline:** EULA before extraction — restrictive license ⇒ Open question, never silent decompile. Manifests/strings only; no protected-logic reversing. Redact every embedded key before any `raw/` write (§7 rule 3). Digest large bundles (§5). A missing artifact type is a recorded gap, not a guess.
|
|
58
|
+
|
|
59
|
+
---
|
|
60
|
+
|
|
61
|
+
## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
|
|
62
|
+
|
|
63
|
+
**MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
|
|
64
|
+
the manifests verbatim (`manifest.json`, `Info.plist`, `AndroidManifest.xml`) and the extracted file listing.
|
|
65
|
+
|
|
66
|
+
Three rules bind this, and they override any instinct to summarise:
|
|
67
|
+
|
|
68
|
+
1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
|
|
69
|
+
count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
|
|
70
|
+
medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
|
|
71
|
+
the citation will outlive its evidence.
|
|
72
|
+
2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
|
|
73
|
+
`_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
|
|
74
|
+
essay, not a capture.
|
|
75
|
+
3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
|
|
76
|
+
straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
|
|
77
|
+
bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
|
|
78
|
+
discard evidence.
|
|
79
|
+
|
|
80
|
+
**Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
|
|
81
|
+
regardless of how good the prose is.
|
|
58
82
|
'''
|
|
@@ -32,5 +32,31 @@ You collect a target's docs into `research/<target>/dimensions/docs/`. Read `.cl
|
|
|
32
32
|
|
|
33
33
|
A one-paragraph headline (the product's documented surface in a sentence) + the section list with page counts + anything that overlaps the api/packages dimensions (flag it so synthesis can cross-check).
|
|
34
34
|
|
|
35
|
-
**Discipline:** distill
|
|
35
|
+
**Discipline:** distill **in addition to**, never instead of. Save each captured page's source form under `raw/pages/` (md or html, as fetched) — that is the evidence layer — and build the navigable map + load-bearing content as the narrative layer beside it (ingestion §5.1). A distilled section whose source page was never saved is unverifiable by the next run (§5.3).
|
|
36
|
+
|
|
37
|
+
**Do not mirror the SITE:** A 300-page docs site becomes a navigable map + the load-bearing content, not 300 verbatim files. Record paywalled/gated docs as Open questions.
|
|
38
|
+
|
|
39
|
+
---
|
|
40
|
+
|
|
41
|
+
## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
|
|
42
|
+
|
|
43
|
+
**MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
|
|
44
|
+
each captured page's source form under `raw/pages/` (md or html, as fetched).
|
|
45
|
+
|
|
46
|
+
Three rules bind this, and they override any instinct to summarise:
|
|
47
|
+
|
|
48
|
+
1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
|
|
49
|
+
count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
|
|
50
|
+
medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
|
|
51
|
+
the citation will outlive its evidence.
|
|
52
|
+
2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
|
|
53
|
+
`_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
|
|
54
|
+
essay, not a capture.
|
|
55
|
+
3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
|
|
56
|
+
straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
|
|
57
|
+
bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
|
|
58
|
+
discard evidence.
|
|
59
|
+
|
|
60
|
+
**Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
|
|
61
|
+
regardless of how good the prose is.
|
|
36
62
|
'''
|
|
@@ -61,4 +61,28 @@ Return a **one-paragraph headline** of the reconstructed backend — origin clou
|
|
|
61
61
|
**Discipline:** read-only public recon — never scan, brute-force, or hit a non-public host; respect crt.sh/WHOIS rate limits and back off; redact any credential-shaped value before writing (contract §7 rule 3 — DSNs, verification tokens, embedded keys surfaced in headers/TXT). An unresolvable host or a missing sub-processor page is an Open question, not a guess.
|
|
62
62
|
|
|
63
63
|
**Verify an absence before asserting it (contract §7 rule 10).** Before reporting any host as **NXDOMAIN / absent** — especially `api.<target>` or any host a sibling dimension (bundle / session / wire) reports actually hitting — re-resolve via a **second resolver** (`dig @1.1.1.1 <host>`, `dig @8.8.8.8 <host>`) **and** a direct `curl -sI https://<host>`. An HTTP 4xx/5xx response means the host **resolves** → report it **present**, not absent. A single negative resolver result is recorded as _tentative_, never stated as fact and never used to instruct sibling dimensions. Likewise, an _inferred_ backend engine (e.g. "looks like Hasura/Supabase from the CNAME") is phrased as an inference and yields to a runtime-observing dimension (`session`/`deployed-client-bundle`) that names the engine directly.
|
|
64
|
+
|
|
65
|
+
---
|
|
66
|
+
|
|
67
|
+
## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
|
|
68
|
+
|
|
69
|
+
**MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
|
|
70
|
+
the raw `dig`, `crt.sh` and HTTP header responses as returned; the decoded table is the narrative layer beside them.
|
|
71
|
+
|
|
72
|
+
Three rules bind this, and they override any instinct to summarise:
|
|
73
|
+
|
|
74
|
+
1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
|
|
75
|
+
count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
|
|
76
|
+
medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
|
|
77
|
+
the citation will outlive its evidence.
|
|
78
|
+
2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
|
|
79
|
+
`_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
|
|
80
|
+
essay, not a capture.
|
|
81
|
+
3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
|
|
82
|
+
straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
|
|
83
|
+
bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
|
|
84
|
+
discard evidence.
|
|
85
|
+
|
|
86
|
+
**Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
|
|
87
|
+
regardless of how good the prose is.
|
|
64
88
|
'''
|
|
@@ -27,4 +27,28 @@ You collect a target's installable artifacts into `research/<target>/dimensions/
|
|
|
27
27
|
A one-paragraph headline (the package family in a sentence) + the package table + which packages are the core public API (so synthesis can anchor the SDK surface). Flag overlap with the docs api-reference and the codebase dimensions for cross-check.
|
|
28
28
|
|
|
29
29
|
**Discipline:** the exports map + type defs are the load-bearing artifact — prioritize them over download-count trivia. Digest huge `.d.ts` to signatures. Redact any registry tokens.
|
|
30
|
+
|
|
31
|
+
---
|
|
32
|
+
|
|
33
|
+
## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
|
|
34
|
+
|
|
35
|
+
**MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
|
|
36
|
+
per package: the registry metadata JSON (`npm view <pkg> --json > raw/<pkg>.registry.json`, PyPI `/pypi/<pkg>/json`) and the `.d.ts` / exports surface as fetched.
|
|
37
|
+
|
|
38
|
+
Three rules bind this, and they override any instinct to summarise:
|
|
39
|
+
|
|
40
|
+
1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
|
|
41
|
+
count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
|
|
42
|
+
medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
|
|
43
|
+
the citation will outlive its evidence.
|
|
44
|
+
2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
|
|
45
|
+
`_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
|
|
46
|
+
essay, not a capture.
|
|
47
|
+
3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
|
|
48
|
+
straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
|
|
49
|
+
bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
|
|
50
|
+
discard evidence.
|
|
51
|
+
|
|
52
|
+
**Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
|
|
53
|
+
regardless of how good the prose is.
|
|
30
54
|
'''
|
|
@@ -38,4 +38,44 @@ Under `research/<target>/dimensions/session/`:
|
|
|
38
38
|
A one-paragraph headline (the auth model + transport + the single most load-bearing wire finding) + the phase coverage + which passes ran. Flag drift between the _observed_ wire surface and the _published_ api/packages surface — that drift is the highest-value synthesis input. If Pass 2 was needed but not authorized, list the open write-side questions; never fabricate request bodies.
|
|
39
39
|
|
|
40
40
|
**Discipline:** ethics first, always. Redact before writing. Confirm before any state change. No destructive actions. No exfiltration. A gap is an Open question, never a guess.
|
|
41
|
+
|
|
42
|
+
---
|
|
43
|
+
|
|
44
|
+
## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
|
|
45
|
+
|
|
46
|
+
**MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
|
|
47
|
+
≥3 verbatim envelopes as `raw/*.json` — the identity read, one canonical list read, and the primary write (request + response) — per ingestion §8.
|
|
48
|
+
|
|
49
|
+
Three rules bind this, and they override any instinct to summarise:
|
|
50
|
+
|
|
51
|
+
1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
|
|
52
|
+
count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
|
|
53
|
+
medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
|
|
54
|
+
the citation will outlive its evidence.
|
|
55
|
+
2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
|
|
56
|
+
`_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
|
|
57
|
+
essay, not a capture.
|
|
58
|
+
3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
|
|
59
|
+
straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
|
|
60
|
+
bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
|
|
61
|
+
discard evidence.
|
|
62
|
+
|
|
63
|
+
**Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
|
|
64
|
+
regardless of how good the prose is.
|
|
65
|
+
|
|
66
|
+
## Visual capture (ingestion §5.5) — screenshot generously
|
|
67
|
+
|
|
68
|
+
You drive a real browser, so you carry the visual-evidence obligation. **Capture continuously, not
|
|
69
|
+
one-image-per-surface:** every surface, plus every materially different state within it — empty vs
|
|
70
|
+
populated, modal/drawer open, dropdown expanded, error and validation states, permission/plan walls,
|
|
71
|
+
loading/in-flight, and the before/after pair around any authorized state change.
|
|
72
|
+
|
|
73
|
+
This is **not** scored — `screenshot_coverage` is a narrow Mode-5 floor. The beneficiary is the human
|
|
74
|
+
reading this corpus weeks later for a purpose nobody anticipated. The product's past state is the one thing
|
|
75
|
+
a later run genuinely cannot reproduce.
|
|
76
|
+
|
|
77
|
+
**Redact in the DOM before the shutter** (`tradecraft.md` §1c) — a leaked pixel is undetectable afterwards.
|
|
78
|
+
**Check the corners of the frame**, not just the content: support-chat widgets, toasts, presence avatars and
|
|
79
|
+
member lists routinely carry *another human's* name and message. Then look at the saved image, and record
|
|
80
|
+
`redacted: <what>` in `screens/_index.md` rather than a blanket zero-PII claim.
|
|
41
81
|
'''
|
|
@@ -33,4 +33,28 @@ You collect a target's public-facing site into `research/<target>/dimensions/web
|
|
|
33
33
|
A one-paragraph headline (the positioning in a sentence) + the pricing tiers + the headline feature claims. Flag claims that should be cross-checked against the codebase/docs (marketing often over-claims) so synthesis can reconcile.
|
|
34
34
|
|
|
35
35
|
**Discipline:** quote positioning verbatim; capture pricing precisely (numbers + limits); separate _claims_ from verified capability — the reconciliation happens in synthesis. Respect robots.txt and rate limits; this is read-only public crawling, not scraping at scale.
|
|
36
|
+
|
|
37
|
+
---
|
|
38
|
+
|
|
39
|
+
## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
|
|
40
|
+
|
|
41
|
+
**MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
|
|
42
|
+
the raw HTML or extracted text per captured page, and the pricing table as structured data.
|
|
43
|
+
|
|
44
|
+
Three rules bind this, and they override any instinct to summarise:
|
|
45
|
+
|
|
46
|
+
1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
|
|
47
|
+
count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
|
|
48
|
+
medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
|
|
49
|
+
the citation will outlive its evidence.
|
|
50
|
+
2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
|
|
51
|
+
`_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
|
|
52
|
+
essay, not a capture.
|
|
53
|
+
3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
|
|
54
|
+
straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
|
|
55
|
+
bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
|
|
56
|
+
discard evidence.
|
|
57
|
+
|
|
58
|
+
**Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
|
|
59
|
+
regardless of how good the prose is.
|
|
36
60
|
'''
|
|
@@ -42,4 +42,44 @@ Then the captures + raw artifacts (per `discovery` Part C (wire-capture)):
|
|
|
42
42
|
Return a **one-paragraph headline** of what the wire reveals — the real hosts contacted, the envelope/auth scheme, and the rung used (so the reader knows how much to trust it). Then a compact table of observed endpoints. **Flag the seam rule (§6):** every `api-path-catalog.md` row is `source: wire`, so evaluation can diff _actually-called_ (wire) against _statically-declared_ (`bundle` / `distribution-artifacts`) and _browser-observed_ (`session`) — a host or path the binary declares but the wire never hits is a finding, not noise; the inverse (called but undeclared) is a stronger one. If only rung 1 was authorized, say so and name what rungs 2/3 would unlock so the main session can request authorization.
|
|
43
43
|
|
|
44
44
|
**Discipline:** lowest privilege first; never self-escalate the ladder; never install a CA or tap third-party traffic; never run Wireshark; redact every body before disk and log it in `_meta`. An unauthorized higher rung is an Open question, not an excuse to guess what the wire would show.
|
|
45
|
+
|
|
46
|
+
---
|
|
47
|
+
|
|
48
|
+
## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
|
|
49
|
+
|
|
50
|
+
**MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
|
|
51
|
+
the flow log itself (HAR or the tap's JSON export), not only the decoded narrative.
|
|
52
|
+
|
|
53
|
+
Three rules bind this, and they override any instinct to summarise:
|
|
54
|
+
|
|
55
|
+
1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
|
|
56
|
+
count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
|
|
57
|
+
medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
|
|
58
|
+
the citation will outlive its evidence.
|
|
59
|
+
2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
|
|
60
|
+
`_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
|
|
61
|
+
essay, not a capture.
|
|
62
|
+
3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
|
|
63
|
+
straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
|
|
64
|
+
bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
|
|
65
|
+
discard evidence.
|
|
66
|
+
|
|
67
|
+
**Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
|
|
68
|
+
regardless of how good the prose is.
|
|
69
|
+
|
|
70
|
+
## Visual capture (ingestion §5.5) — screenshot generously
|
|
71
|
+
|
|
72
|
+
You drive a real browser, so you carry the visual-evidence obligation. **Capture continuously, not
|
|
73
|
+
one-image-per-surface:** every surface, plus every materially different state within it — empty vs
|
|
74
|
+
populated, modal/drawer open, dropdown expanded, error and validation states, permission/plan walls,
|
|
75
|
+
loading/in-flight, and the before/after pair around any authorized state change.
|
|
76
|
+
|
|
77
|
+
This is **not** scored — `screenshot_coverage` is a narrow Mode-5 floor. The beneficiary is the human
|
|
78
|
+
reading this corpus weeks later for a purpose nobody anticipated. The product's past state is the one thing
|
|
79
|
+
a later run genuinely cannot reproduce.
|
|
80
|
+
|
|
81
|
+
**Redact in the DOM before the shutter** (`tradecraft.md` §1c) — a leaked pixel is undetectable afterwards.
|
|
82
|
+
**Check the corners of the frame**, not just the content: support-chat widgets, toasts, presence avatars and
|
|
83
|
+
member lists routinely carry *another human's* name and message. Then look at the saved image, and record
|
|
84
|
+
`redacted: <what>` in `screens/_index.md` rather than a blanket zero-PII claim.
|
|
45
85
|
'''
|
|
@@ -0,0 +1,219 @@
|
|
|
1
|
+
# Calibration Reference — Blind Re-runs · Disposition · The Fleet Ledger
|
|
2
|
+
|
|
3
|
+
The reference for the harness's **only external signal**. Everything else in this harness is self-assessment:
|
|
4
|
+
collectors grade their own `confidence` and `completeness_pct`, Evaluation weights those self-grades, and
|
|
5
|
+
Mode 5 scores the result against a checklist the same system authored. That loop can converge on a corpus
|
|
6
|
+
that is confidently, well-provenanced, and wrong.
|
|
7
|
+
|
|
8
|
+
**Calibration is the one procedure that can tell you whether any of it is true.** It re-derives claims a
|
|
9
|
+
prior run published, blind, and records what survived.
|
|
10
|
+
|
|
11
|
+
> **The measured position, as of 2026-07-28.** One target has ever been re-run (`emergent`, 2026-06-25 →
|
|
12
|
+
> 2026-07-28). Of 16 claims re-tested: **7 refuted, 4 corrected, 5 confirmed** — a 44% flat-falsification
|
|
13
|
+
> rate — and **4 of the 7 refutations came from lanes the prior run had graded `confidence: high`.** The
|
|
14
|
+
> prior run had self-scored **88/100 "strong"** and `stopped_on: converged`.
|
|
15
|
+
>
|
|
16
|
+
> That is **n=1**. It is the entire empirical basis of this harness. Every rule in `.claude/rules/` is
|
|
17
|
+
> currently a hypothesis with n=0 on any target it did not come from. The purpose of this file is to make
|
|
18
|
+
> n grow.
|
|
19
|
+
|
|
20
|
+
---
|
|
21
|
+
|
|
22
|
+
## Two tiers — pick the one that will actually happen
|
|
23
|
+
|
|
24
|
+
A metric too expensive to run leaves `n` at 1 forever. The cheap tier is the important one.
|
|
25
|
+
|
|
26
|
+
| Tier | Cadence | Cost | What it measures |
|
|
27
|
+
| --- | --- | --- | --- |
|
|
28
|
+
| **A — Claim spot-check** | monthly | ~1 session, no full ingestion | the refutation rate, and whether `confidence` tracks truth |
|
|
29
|
+
| **B — Full blind re-run** | quarterly, or when a rule set changes materially | a complete run | everything Tier A does, plus coverage drift and whether new rules changed behaviour |
|
|
30
|
+
|
|
31
|
+
**Tier A is the default. Do not skip it waiting for capacity to do Tier B** — a monthly spot-check of 15–20
|
|
32
|
+
claims across one target produces the regression that matters, and produces it twelve times a year.
|
|
33
|
+
|
|
34
|
+
---
|
|
35
|
+
|
|
36
|
+
## Selection — rotate, never choose
|
|
37
|
+
|
|
38
|
+
**The target is selected by rotation, not by judgment.** Take the least-recently-calibrated target in the
|
|
39
|
+
corpus root; break ties by oldest `captured_at`. Record the selection rule alongside the result.
|
|
40
|
+
|
|
41
|
+
A human (or a run) choosing which target to re-check will choose the one it feels good about. That single
|
|
42
|
+
substitution destroys the metric, because the sample stops being representative of the fleet and starts
|
|
43
|
+
being representative of the harness's confidence — which is the very thing under test.
|
|
44
|
+
|
|
45
|
+
---
|
|
46
|
+
|
|
47
|
+
## THE BLIND RULE (this is what makes it evidence)
|
|
48
|
+
|
|
49
|
+
**Capture first. Read the prior corpus only after your own observation is written down.**
|
|
50
|
+
|
|
51
|
+
1. Select the target. **Do not open its corpus.**
|
|
52
|
+
2. Draw the claim sample (below) — a list of *questions*, not answers. Someone or something other than the
|
|
53
|
+
re-deriving agent extracts the questions, or the questions are extracted mechanically from claim
|
|
54
|
+
anchors, so the sample carries no prior conclusions.
|
|
55
|
+
3. **Re-derive each claim from the live product**, from scratch, recording what you observe and the method.
|
|
56
|
+
4. **Only then** open the prior corpus and diff.
|
|
57
|
+
|
|
58
|
+
> **This deliberately overrides `discovery.md` Step 00 for calibration runs.** Step 00 tells a run to find a
|
|
59
|
+
> prior corpus, restore it, and reconcile against it — correct for a normal re-run, where the prior corpus
|
|
60
|
+
> is a genuine corroboration lane and re-deriving everything from zero is waste. **It is wrong here.** A run
|
|
61
|
+
> that reads the prior claim first will anchor on it: it will look for confirmation, find it, and report a
|
|
62
|
+
> confirmation rate that measures its own suggestibility. Anchoring is the specific failure this protocol
|
|
63
|
+
> exists to avoid, so for a calibration run Step 00 is deferred until after step 3, and the run records
|
|
64
|
+
> `blind: true`.
|
|
65
|
+
>
|
|
66
|
+
> If a run cannot honestly attest that it re-derived before reading, it must record `blind: false` — and
|
|
67
|
+
> the result is then a **consistency check, not a calibration**, and does not enter the ledger's refutation
|
|
68
|
+
> rate.
|
|
69
|
+
|
|
70
|
+
**Sampling the claims.** 15–20 per target, drawn to make the regression computable, not to be flattering:
|
|
71
|
+
|
|
72
|
+
- **Stratify by the prior run's stated `confidence`** — roughly equal numbers of `high`, `medium`, `low`.
|
|
73
|
+
Without this the regression cannot be computed, and the regression is the point.
|
|
74
|
+
- **Include the load-bearing ones** — claims a README headline rests on, and claims a reader would act on
|
|
75
|
+
(pricing, limits, guarantees, auth model, what the product can and cannot do).
|
|
76
|
+
- **Include at least 3 negative claims** ("no public SDK", "no realtime layer", "not supported"). Negatives
|
|
77
|
+
are the harness's demonstrated weak spot: **5 of the 7 refutations in the one data point were negatives.**
|
|
78
|
+
- **Exclude** anything whose truth cannot change and cannot be re-checked (a historical funding round).
|
|
79
|
+
|
|
80
|
+
---
|
|
81
|
+
|
|
82
|
+
## Disposition — five values, and the fifth is the one the old schema lacked
|
|
83
|
+
|
|
84
|
+
Every sampled claim resolves to exactly one:
|
|
85
|
+
|
|
86
|
+
| Disposition | Meaning | What it says about the harness |
|
|
87
|
+
| --- | --- | --- |
|
|
88
|
+
| **confirmed** | independently re-derived, same conclusion | the method worked |
|
|
89
|
+
| **corrected** | right direction, wrong detail (a count, a version, a name) | the method worked; the reading was imprecise |
|
|
90
|
+
| **refuted** | the claim was **wrong when it was made** | **the method failed — this is the signal** |
|
|
91
|
+
| **stale** | the claim was **true when made; the product changed** | the method worked; the corpus has a shelf life |
|
|
92
|
+
| **unverifiable** | cannot be re-checked now (surface gone, plan changed, gated) | no signal either way; excluded from the rate |
|
|
93
|
+
|
|
94
|
+
> **`refuted` and `stale` are the distinction the original artifact had no slot for, and they mean opposite
|
|
95
|
+
> things.** A high `refuted` rate means *the instrument is unreliable* and the rules need work. A high
|
|
96
|
+
> `stale` rate means *the instrument is fine and the corpus decays* — which calls for shorter shelf-lives
|
|
97
|
+
> and `volatility` tagging, not methodology changes. Conflating them makes the harness fix the wrong
|
|
98
|
+
> problem. When you cannot tell which it is — no dated evidence either way — record **`refuted`**. The
|
|
99
|
+
> conservative reading is the one that keeps the harness honest about itself.
|
|
100
|
+
>
|
|
101
|
+
> (Origin: `emergent/00-prior-run-reconciliation.md` — a genuinely good artifact whose section A had to be
|
|
102
|
+
> titled *"REFUTED (prior claim was wrong, not merely stale)"* precisely because the schema gave it nowhere
|
|
103
|
+
> else to put the distinction.)
|
|
104
|
+
|
|
105
|
+
**The refutation rate** = `refuted ÷ (confirmed + corrected + refuted + stale)`. `unverifiable` is excluded
|
|
106
|
+
from the denominator, and its count is reported so a shrinking sample is visible.
|
|
107
|
+
|
|
108
|
+
---
|
|
109
|
+
|
|
110
|
+
## The regression — the actual question
|
|
111
|
+
|
|
112
|
+
For each calibration, record the disposition **against the prior run's stated confidence for that claim**:
|
|
113
|
+
|
|
114
|
+
| prior confidence | n | confirmed | corrected | refuted | stale | refutation rate |
|
|
115
|
+
| --- | --- | --- | --- | --- | --- | --- |
|
|
116
|
+
| high | | | | | | |
|
|
117
|
+
| medium | | | | | | |
|
|
118
|
+
| low | | | | | | |
|
|
119
|
+
|
|
120
|
+
**If `high` claims are refuted at a similar rate to `low` claims, the `confidence` field carries no signal
|
|
121
|
+
and `ingestion.md` §3's method→confidence table is decorative.** That is the single most consequential thing
|
|
122
|
+
this harness could learn about itself, and it is unknowable without this table.
|
|
123
|
+
|
|
124
|
+
Also record refutation rate **by `method`** once n is large enough — that tells you which of the 17 methods
|
|
125
|
+
in §3 are over-graded, which is directly actionable (a method's band gets lowered).
|
|
126
|
+
|
|
127
|
+
---
|
|
128
|
+
|
|
129
|
+
## Artifacts
|
|
130
|
+
|
|
131
|
+
### Per calibration — `research/<target>/00-prior-run-reconciliation.md`
|
|
132
|
+
|
|
133
|
+
Formalizes the shape `emergent` invented. **This file is part of the output contract** whenever a prior
|
|
134
|
+
corpus exists.
|
|
135
|
+
|
|
136
|
+
```markdown
|
|
137
|
+
---
|
|
138
|
+
target: <slug>
|
|
139
|
+
reconciled_at: <YYYY-MM-DD>
|
|
140
|
+
prior_run_date: <YYYY-MM-DD>
|
|
141
|
+
prior_run_commit: <sha>
|
|
142
|
+
prior_run_score: <n>
|
|
143
|
+
tier: A | B # spot-check or full blind re-run
|
|
144
|
+
blind: true | false # false ⇒ consistency check only, excluded from the rate
|
|
145
|
+
selection_rule: rotation # or: named-by-user (record it either way)
|
|
146
|
+
sampled: <n>
|
|
147
|
+
confirmed: <n>
|
|
148
|
+
corrected: <n>
|
|
149
|
+
refuted: <n>
|
|
150
|
+
stale: <n>
|
|
151
|
+
unverifiable: <n>
|
|
152
|
+
refutation_rate: <0-100>
|
|
153
|
+
by_confidence: # the regression — REQUIRED
|
|
154
|
+
high: { n: <n>, refuted: <n> }
|
|
155
|
+
medium: { n: <n>, refuted: <n> }
|
|
156
|
+
low: { n: <n>, refuted: <n> }
|
|
157
|
+
---
|
|
158
|
+
|
|
159
|
+
## A. REFUTED — wrong when made (claim · what was observed · lane that refuted it · prior confidence)
|
|
160
|
+
## B. STALE — true when made, changed (claim · what changed · evidence of the change being NEW)
|
|
161
|
+
## C. CORRECTED — right, imprecise
|
|
162
|
+
## D. CONFIRMED — independently re-derived
|
|
163
|
+
## E. UNVERIFIABLE — and why
|
|
164
|
+
## F. What this says about the METHOD (which lanes/methods produced the refutations, and whether a
|
|
165
|
+
§3 confidence band should be lowered)
|
|
166
|
+
```
|
|
167
|
+
|
|
168
|
+
### Fleet-level — `research/_calibration/ledger.md`
|
|
169
|
+
|
|
170
|
+
**The metric itself.** One row per calibration, accumulating across targets and time. This is the file to
|
|
171
|
+
read when asking "does this harness work?" It is never rewritten, only appended to.
|
|
172
|
+
|
|
173
|
+
---
|
|
174
|
+
|
|
175
|
+
## What a result CHANGES (otherwise this is just bookkeeping)
|
|
176
|
+
|
|
177
|
+
A calibration that produces a number and no action is theatre. Each outcome routes:
|
|
178
|
+
|
|
179
|
+
| Finding | Action |
|
|
180
|
+
| --- | --- |
|
|
181
|
+
| A **method** shows a high refutation rate | lower its band in `ingestion.md` §3, and record the calibration as the origin |
|
|
182
|
+
| **Negative claims** refute disproportionately | tighten the absence rules (`ingestion.md` §7 rule 10, `discovery.md` Part B) — the `blind_to:` direction |
|
|
183
|
+
| `high` refutes ≈ as often as `low` | **the confidence field is not carrying signal** — this is a structural finding about the harness, and it goes to the user, not into a rule tweak |
|
|
184
|
+
| A **rule added after the prior run** would have prevented a refutation | evidence the improvement loop works — record it, it is the only such evidence that exists |
|
|
185
|
+
| A refutation recurs **after** a rule was added to prevent it | evidence a rule did **not** change behaviour; escalate to the user rather than adding another rule |
|
|
186
|
+
| High **stale** rate | shorten shelf-life expectations and tag volatile claims; **not** a methodology problem |
|
|
187
|
+
|
|
188
|
+
---
|
|
189
|
+
|
|
190
|
+
## How to run one (Tier A, the monthly default)
|
|
191
|
+
|
|
192
|
+
1. **Select** by rotation from `research/_calibration/ledger.md`. Record the target and the rule.
|
|
193
|
+
2. **Extract the sample** mechanically — pull claim anchors from the target's `evaluation/*.md`, stratify by
|
|
194
|
+
the cited confidence, and write them as **questions with the answers stripped**.
|
|
195
|
+
3. **Re-derive blind.** Do not open the corpus. Use whatever lanes the access vector allows; record method
|
|
196
|
+
and observation per claim.
|
|
197
|
+
4. **Diff and disposition** each claim into the five values.
|
|
198
|
+
5. **Write** `00-prior-run-reconciliation.md` (append a new dated section if one already exists — never
|
|
199
|
+
overwrite a prior calibration).
|
|
200
|
+
6. **Append one row** to the fleet ledger, and update its running totals.
|
|
201
|
+
7. **Route** every finding through the table above. Anything that becomes a rule change goes through the
|
|
202
|
+
normal Mode-5 approval gate.
|
|
203
|
+
|
|
204
|
+
**Cost/state discipline is unchanged:** a calibration is read-only unless the user authorizes otherwise; a
|
|
205
|
+
claim that can only be re-derived by spending money or mutating state is recorded `unverifiable` with the
|
|
206
|
+
reason, never quietly exercised.
|
|
207
|
+
|
|
208
|
+
---
|
|
209
|
+
|
|
210
|
+
## How the harness uses this reference
|
|
211
|
+
|
|
212
|
+
Calibration is a **cross-run process**, not a mode of a single run — nothing in Modes 1–5 triggers it, and it
|
|
213
|
+
must not be folded into them (a run cannot calibrate itself; that is the circularity it exists to break).
|
|
214
|
+
Mode 5 reads the fleet ledger as *context* when weighing a proposal — a rule contradicted by calibration
|
|
215
|
+
data should not be promoted — but Mode 5 never writes to it.
|
|
216
|
+
|
|
217
|
+
> **Do not attach calibration to the Mode-5 score.** The moment `refutation_rate` becomes a rubric input,
|
|
218
|
+
> the run acquires an interest in the number, and the one uncorrupted signal in the system is gone. It
|
|
219
|
+
> measures the **harness**, not the run. Publish it; never grade with it.
|
|
@@ -0,0 +1,205 @@
|
|
|
1
|
+
# Tooling Reference — Host Capability · Tiers · The Bright Line
|
|
2
|
+
|
|
3
|
+
The reference for **Step 0** (`discover` harness, run once per corpus folder before Mode 1). Capture depth
|
|
4
|
+
is bounded by host tooling most machines lack. This file carries the **tier lists** (what to recommend),
|
|
5
|
+
the **ethics classification** (clean · gated · avoid), the **per-dimension gap map** (what a bare host
|
|
6
|
+
cannot do), and the **install caveats** that have actually bitten.
|
|
7
|
+
|
|
8
|
+
**Nothing here is ever installed automatically.** The harness detects what is present, recommends only what
|
|
9
|
+
is missing, and records the result in `.claude/discover-tooling.json` so it never re-prompts in the same
|
|
10
|
+
folder. The harness recommends; the user decides. A user who declines proceeds to Mode 1 on whatever is
|
|
11
|
+
present — a missing capability is re-surfaced at the Mode 2 capability-gap checkpoint (`ingestion.md` §8),
|
|
12
|
+
never silently degraded.
|
|
13
|
+
|
|
14
|
+
A host almost always arrives strong on languages and package managers (node, pnpm, python, uv, cargo, gh,
|
|
15
|
+
jq, ripgrep) and **bare on capture/analysis tooling**. That gap is the difference between a shallow capture
|
|
16
|
+
and a deep one.
|
|
17
|
+
|
|
18
|
+
---
|
|
19
|
+
|
|
20
|
+
## The three classes (this is an ethics classification, not a convenience one)
|
|
21
|
+
|
|
22
|
+
| Class | Meaning | Rule |
|
|
23
|
+
| --- | --- | --- |
|
|
24
|
+
| **clean** | passive / local-only; always in-bounds | recommend freely, offer the one-paste block |
|
|
25
|
+
| **gated** | in-bounds **only** first-party / user-owned / opt-in — the user installs the CA, routes *their own* client, owns the keys | surface the command, **never run it for the user** |
|
|
26
|
+
| **avoid** | crosses the harness bright line (active scanning, exploitation, third-party interception) | never recommend; listed so it is not added by reflex |
|
|
27
|
+
|
|
28
|
+
The harness is for **spec-writing / integration / competitive analysis** — passive or first-party only,
|
|
29
|
+
respecting TOS and robots (`ingestion.md` §7). No tool changes that; the gated ones simply need the user in
|
|
30
|
+
the loop, exactly as `session` Pass-2 and `wire-capture` rung 3 do.
|
|
31
|
+
|
|
32
|
+
---
|
|
33
|
+
|
|
34
|
+
## Why this file matters more since the §5 rewrite
|
|
35
|
+
|
|
36
|
+
`ingestion.md` §5 now requires **verbatim dumping** — the artifact lands on disk whole, and the digest is
|
|
37
|
+
written *beside* it, never *instead* of it. The obvious objection is "a 6 MB spec is unusable." **These
|
|
38
|
+
tools are the answer to that objection.** They are what make a verbatim corpus queryable, which is what
|
|
39
|
+
makes dumping-not-digesting practical:
|
|
40
|
+
|
|
41
|
+
| Instead of digesting… | Dump verbatim, then |
|
|
42
|
+
| --- | --- |
|
|
43
|
+
| a 6 MB OpenAPI spec → a hand-typed endpoint table | `curl -o raw/spec.json` → **spectral** to catalog, **oasdiff** to diff, **gron** to grep |
|
|
44
|
+
| a 9 MB minified bundle → prose about the routes | `curl -o raw/bundle.js` → **webcrack** / **source-map-explorer** to read, **ast-grep** to query |
|
|
45
|
+
| a HAR → a narrative of the calls | keep `raw/flows.har` → **gron** to flatten and grep |
|
|
46
|
+
| a docs site → distilled sections only | keep the page sources → **trafilatura** / **pandoc** to render |
|
|
47
|
+
| a package's exports → string-mined prose | `npm view --json` → **typescript + attw + publint**, **griffe** for Python |
|
|
48
|
+
|
|
49
|
+
**A digest is a lossy compression you cannot undo; a verbatim artifact plus a query tool is lossless.**
|
|
50
|
+
Recommend Tier 1 on that basis, not as a nice-to-have.
|
|
51
|
+
|
|
52
|
+
---
|
|
53
|
+
|
|
54
|
+
## Tier 1 — clean, install now (broad leverage)
|
|
55
|
+
|
|
56
|
+
Highest-consensus, always in-bounds. Offer as one paste:
|
|
57
|
+
|
|
58
|
+
```bash
|
|
59
|
+
# Homebrew (CLI analysis + data-wrangling + web→text)
|
|
60
|
+
brew install gron pandoc ast-grep scc universal-ctags oasdiff fd yq dasel monolith tokei sevenzip
|
|
61
|
+
# Rust
|
|
62
|
+
cargo install htmlq
|
|
63
|
+
# Python (via uv — pipx is typically absent; uv tool install is the path)
|
|
64
|
+
uv tool install trafilatura && uv tool install griffe
|
|
65
|
+
# Node global (JS/TS surface + bundle de-obfuscation + spec lint)
|
|
66
|
+
npm i -g webcrack source-map-explorer @arethetypeswrong/cli publint @electron/asar typescript @stoplight/spectral-cli
|
|
67
|
+
# Headless browser for JS-rendered docs/marketing (clean — the user's own headless instance)
|
|
68
|
+
npm i -g playwright && npx playwright install chromium
|
|
69
|
+
```
|
|
70
|
+
|
|
71
|
+
| Tool | Unlocks | Dimensions served |
|
|
72
|
+
| --- | --- | --- |
|
|
73
|
+
| **gron** | flatten any JSON → greppable/diffable `path = value` (specs, captures, manifests, HAR, configs) | **7** (codebase, api, session, bundle, infra, wire, cross-cutting) |
|
|
74
|
+
| **trafilatura** | boilerplate-stripped main content + dates from HTML → clean markdown; feed/sitemap discovery | **4** (docs, website, community, infra) |
|
|
75
|
+
| **pandoc** | deterministic HTML→GFM (headings, tables, code fences) at scale | 3 (docs, website, community) |
|
|
76
|
+
| **ast-grep** | tree-sitter structural search/count across many files + langs (call sites, routes, exports) — catches what regex misses | 2 (codebase, bundle) |
|
|
77
|
+
| **oasdiff** | structured breaking-vs-non-breaking OpenAPI diff — makes the published-vs-app-own diff machine-checked | 2 (api, cross-cutting) |
|
|
78
|
+
| **webcrack** | un-minify / un-webpack / de-obfuscate SPA & Electron JS into readable modules | 2 (bundle, distribution) |
|
|
79
|
+
| **scc** | instant LOC-by-language + complexity census of a fresh clone (JSON) — the codebase opening move | 1 (codebase) |
|
|
80
|
+
| **universal-ctags** | real multi-lang JSON symbol index (the host's BSD ctags is broken for this) | 1 (codebase) |
|
|
81
|
+
| **htmlq** | surgical CSS-selector extraction (pricing cards, feature tables) instead of regex | 1 (website) |
|
|
82
|
+
| **source-map-explorer** | reassemble a shipped `.map` → original `src/` tree (the `source-map-reassembly` method) | 1 (bundle) |
|
|
83
|
+
| **spectral** | validate/resolve an OpenAPI/AsyncAPI spec → structured endpoint/security/`$ref` catalog | 1 (api) |
|
|
84
|
+
| **griffe** | extract a PyPI package's full public API (the `.d.ts` equivalent for Python) | 1 (packages) |
|
|
85
|
+
| **@arethetypeswrong/cli + typescript + publint** | parse the real `.d.ts`/exports type graph + grade the publish surface (verbatim, not string-mined) | 1 (packages) |
|
|
86
|
+
| **@electron/asar** | extract Electron `app.asar` → JS module tree (the distribution step the playbook names but cannot otherwise run) | 1 (distribution) |
|
|
87
|
+
| **fd · yq · dasel · monolith · tokei · sevenzip** | gitignore-aware file discovery · YAML/XML/TOML query · RSS/XML→JSON · single-file page archive · LOC cross-check · multi-format extract | several |
|
|
88
|
+
|
|
89
|
+
---
|
|
90
|
+
|
|
91
|
+
## Tier 2 — gated, install when a run needs them (first-party / passive only)
|
|
92
|
+
|
|
93
|
+
The capture lanes. In-bounds **only** for the user's own session, the user's own first-party clients, or
|
|
94
|
+
passive sources. **Surface these; never run them for the user.**
|
|
95
|
+
|
|
96
|
+
```bash
|
|
97
|
+
brew install mitmproxy websocat grpcurl subfinder tlsx testssl jadx apktool
|
|
98
|
+
npm i -g chrome-remote-interface get-graphql-schema
|
|
99
|
+
# one-time, USER-RUN: expose a CDP port on the user's own Chrome (closes the WS-frame blind spot)
|
|
100
|
+
# open -na "Google Chrome" --args --remote-debugging-port=9222
|
|
101
|
+
# mobile-only, the user's own device + explicit opt-in: uv tool install frida-tools
|
|
102
|
+
```
|
|
103
|
+
|
|
104
|
+
| Tool | Unlocks | Ethics note |
|
|
105
|
+
| --- | --- | --- |
|
|
106
|
+
| **mitmproxy** | decode full HTTPS + WebSocket flows of any **first-party** client (CLI/desktop/mobile/SDK) — the `wire-capture` rung-3 keystone (`ingestion.md` §7.1) | user installs the CA and routes *their own* client only |
|
|
107
|
+
| **chrome-remote-interface** | raw CDP → `Network.webSocketFrameReceived`/`Created`, SSE, full bodies — **captures the on-load WS frames the browser MCP's HTTP-only `read_network_requests` drops** | the user's own logged-in session |
|
|
108
|
+
| **websocat** | curl-for-WebSockets: connect / frame / replay / hexdump a realtime endpoint outside the browser | first-party endpoint |
|
|
109
|
+
| **grpcurl** | list services + invoke RPCs via gRPC server reflection → readable op/message catalog | first-party endpoint |
|
|
110
|
+
| **get-graphql-schema** | introspect a first-party GraphQL endpoint → full SDL | first-party endpoint |
|
|
111
|
+
| **subfinder · tlsx · testssl.sh** | passive CT/DNS subdomain breadth + structured TLS posture (vs hand-rolled crt.sh + openssl text) | passive aggregation; respect rate limits |
|
|
112
|
+
| **jadx · apktool** | decompile Android `.apk`/`.dex` → Java + decode `AndroidManifest`/resources (capability map) | public binary; read the EULA first (`ingestion.md` §7.2) |
|
|
113
|
+
| **frida-tools** | cert-pinning bypass to capture **the user's own** mobile client's wire | the user's own device + explicit opt-in only |
|
|
114
|
+
|
|
115
|
+
> **The single biggest unlock for a realtime target** is `chrome-remote-interface` + a Chrome
|
|
116
|
+
> `--remote-debugging-port` + `websocat` + `mitmproxy` together: they give `session`/`wire-capture` a real
|
|
117
|
+
> WebSocket/SSE capture path instead of a client-side-remount workaround. The browser MCP's
|
|
118
|
+
> `read_network_requests` is **HTTP-only** — that is *why* a realtime tap comes back empty until the remount
|
|
119
|
+
> trick (`tradecraft.md` gotcha #13, `ingestion.md` §9.4). A CDP port removes the injection-timing problem
|
|
120
|
+
> entirely rather than working around it.
|
|
121
|
+
>
|
|
122
|
+
> (Origin: Emergent — with no CDP port open, the run fell back to in-page taps. That worked, but a
|
|
123
|
+
> post-boot `window.WebSocket` wrapper is structurally blind to a library socket opened at boot, and the
|
|
124
|
+
> prior run published a false negative because of it.)
|
|
125
|
+
|
|
126
|
+
---
|
|
127
|
+
|
|
128
|
+
## AVOID — never recommend (this is the bright line)
|
|
129
|
+
|
|
130
|
+
Out-of-bounds for a spec-writing / competitive-analysis harness. Listed so they are not added by reflex:
|
|
131
|
+
|
|
132
|
+
- **`nmap`, `masscan`, `naabu`** — active port sweeps / service-version probing of remote hosts.
|
|
133
|
+
- **`nuclei`** — template-based remote vulnerability scanning.
|
|
134
|
+
- **`sqlmap`** — injection / exploitation.
|
|
135
|
+
- **`amass` (active mode)** — active DNS brute-forcing. Its *passive* mode overlaps subfinder; prefer subfinder.
|
|
136
|
+
- **`mitmproxy` or `frida` against a third party**, **`socat` as a public relay** — intercepting traffic the
|
|
137
|
+
user does not own is the line this harness will not cross.
|
|
138
|
+
|
|
139
|
+
These stay absent **by design**. The recon ethics depend on it, and a tool absent from the host is a
|
|
140
|
+
stronger guarantee than a rule telling the agent not to use it.
|
|
141
|
+
|
|
142
|
+
---
|
|
143
|
+
|
|
144
|
+
## Per-dimension gap map (what a bare host cannot do)
|
|
145
|
+
|
|
146
|
+
| Dimension | Biggest capability gap on a bare host | Top addition(s) |
|
|
147
|
+
| --- | --- | --- |
|
|
148
|
+
| **codebase** | no LOC census, no AST search; the host's BSD ctags is broken for this | scc · ast-grep · universal-ctags (+ fd) |
|
|
149
|
+
| **docs** | no HTML/MDX→md, no JS render → client-rendered docs come back empty | pandoc · trafilatura · playwright |
|
|
150
|
+
| **packages** | the real `.d.ts`/exports surface is string-mined, not parsed | typescript + attw + publint · griffe (Py) · yq |
|
|
151
|
+
| **api** | can fetch a spec but cannot lint / diff / introspect / exercise it | spectral · oasdiff · get-graphql-schema · grpcurl · websocat |
|
|
152
|
+
| **website** | no JS render, no clean table/text extraction → misses pricing and feature grids | trafilatura · htmlq · playwright |
|
|
153
|
+
| **community** | no clean changelog/blog→text, no RSS→JSON | trafilatura · pandoc · dasel |
|
|
154
|
+
| **session** | **structurally blind to WebSocket/SSE frames** (HTTP-only MCP, no CDP port) | chrome-remote-interface · mitmproxy · websocat |
|
|
155
|
+
| **deployed-client-bundle** | a minified/obfuscated blob stays opaque; no source-map reassembly | webcrack · source-map-explorer · ast-grep · gron |
|
|
156
|
+
| **infra-backend-fingerprint** | shallow CT coverage, TLS posture by hand, sub-processor pages scraped raw | subfinder · tlsx · trafilatura (passive only) |
|
|
157
|
+
| **wire-capture** | the keystone (mitmproxy) plus every non-browser replay/decode client is absent | mitmproxy · websocat · grpcurl |
|
|
158
|
+
| **distribution-artifacts** | only CRX/Mach-O readable; no Electron or Android decoders | @electron/asar · jadx · apktool · webcrack · sevenzip |
|
|
159
|
+
| **external-reputation / hiring-intel** | bot-walled review and ATS pages return 403 to plain fetch | playwright (own headless instance) · trafilatura · dasel |
|
|
160
|
+
| **cross-cutting (synthesis)** | no structured diff for the N-way seam reconciliation; no out-of-band WS capture | gron · oasdiff · chrome-remote-interface · yq |
|
|
161
|
+
|
|
162
|
+
---
|
|
163
|
+
|
|
164
|
+
## Known install caveats (each of these has actually bitten)
|
|
165
|
+
|
|
166
|
+
- **`webcrack` needs Node 22.** Its hard dependency `isolated-vm` is a native (node-gyp) addon that fails to
|
|
167
|
+
build against Node 26, and `--omit=optional` does not help — the dep is non-optional. Run it under a Node
|
|
168
|
+
22 LTS shim (`npx -y webcrack@latest …` in a Node-22 env), or lean on the already-clean
|
|
169
|
+
`source-map-explorer` (the preferred `source-map-reassembly` path whenever the SPA ships `.map` files)
|
|
170
|
+
plus `ast-grep`. De-obfuscating a **no-maps, minified** bundle is the only gap this leaves.
|
|
171
|
+
- **`chrome-remote-interface` is a library, not a CLI.** It installs as a Node module and is invoked from a
|
|
172
|
+
script, not a shell binary. **Detect it with `npm ls -g chrome-remote-interface`, not `command -v`** — a
|
|
173
|
+
`command -v` probe reports it missing when it is installed, and the run then wrongly records a capability
|
|
174
|
+
gap.
|
|
175
|
+
- **`pipx` is typically absent; use `uv tool install`** for Python CLIs (uv is present). Simpler than adding pipx.
|
|
176
|
+
- **`playwright` is clean** — the user's own headless instance. It unblocks JS-rendered docs and marketing
|
|
177
|
+
for `docs` + `website` **without contending for the gated `session` Chrome**, which matters because the
|
|
178
|
+
browser is a singleton (`ingestion.md` §7 rule 9).
|
|
179
|
+
|
|
180
|
+
---
|
|
181
|
+
|
|
182
|
+
## How Step 0 uses this reference
|
|
183
|
+
|
|
184
|
+
Once per corpus folder, before Mode 1. If `.claude/discover-tooling.json` exists, tooling was already
|
|
185
|
+
reviewed here — **skip straight to Mode 1 and never re-prompt.** If it is absent:
|
|
186
|
+
|
|
187
|
+
1. Read this file — the tier lists, the classification, the AVOID list.
|
|
188
|
+
2. **Detect before recommending** — `command -v <tool>` per tool, and `npm ls -g <pkg>` for the Node
|
|
189
|
+
libraries that ship no binary (see the caveat above). Detection only; nothing is installed at this step.
|
|
190
|
+
3. **Recommend only what is missing**, grouped **clean** (offer the Tier-1 one-paste block) vs **gated**
|
|
191
|
+
(surface the command, never run it). Never suggest anything on the AVOID list. If nothing is missing,
|
|
192
|
+
say so in one line.
|
|
193
|
+
4. Write the state file so the harness never asks again in this folder:
|
|
194
|
+
```json
|
|
195
|
+
{ "checked": "<ISO date>", "present": ["gron", "pandoc"], "missing": ["mitmproxy"], "recommended": true }
|
|
196
|
+
```
|
|
197
|
+
|
|
198
|
+
The state file is **host-local** (tools live on the machine, not the repo) — gitignore it in a shared
|
|
199
|
+
folder; delete it to force a fresh check after installing a batch. **This step never blocks a run.**
|
|
200
|
+
|
|
201
|
+
> **Maintenance loop.** When a run hits a capability wall — a format nothing on the host can read, a
|
|
202
|
+
> capture lane that needed a tool that was not listed, an install that failed in a new way — fold it back
|
|
203
|
+
> in here: the tool into the right tier with its ethics class, or the failure into the caveats. This file
|
|
204
|
+
> only stays useful if every new wall is recorded (the same loop `ingestion.md` §7.0 carries for redaction
|
|
205
|
+
> patterns).
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "@nurix/etna",
|
|
3
|
-
"version": "0.19.
|
|
3
|
+
"version": "0.19.42",
|
|
4
4
|
"description": "Bootstrap a project with a Nurix harness — copies the harness's CLAUDE.md, skills, agents, rules, and hooks directly into the project from a bundled payload (no marketplace fetch, no network).",
|
|
5
5
|
"type": "module",
|
|
6
6
|
"bin": {
|
|
@@ -41,5 +41,5 @@
|
|
|
41
41
|
"agent",
|
|
42
42
|
"plugin"
|
|
43
43
|
],
|
|
44
|
-
"etnaFingerprint": "
|
|
44
|
+
"etnaFingerprint": "e47ee7aac58b"
|
|
45
45
|
}
|