@nurix/etna 0.19.41 → 0.19.42

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
@@ -1,5 +1,5 @@
1
1
  {
2
- "fingerprint": "c96b6524c5e6",
2
+ "fingerprint": "e47ee7aac58b",
3
3
  "harnesses": {
4
4
  "code": {
5
5
  "plugin": "code",
@@ -30,4 +30,28 @@ You collect a target's documented machine interface into `research/<target>/dime
30
30
  A one-paragraph headline (the API surface in a sentence) + endpoint-family counts + the auth model. Flag overlap with the packages/docs dimensions (the published SDK often wraps this API) and especially any drift vs. the session dimension's _observed_ wire surface, for synthesis.
31
31
 
32
32
  **Discipline:** the spec is the load-bearing artifact — capture it accurately, digest if huge. Redact any embedded keys/example tokens. A disabled-introspection or undocumented API is a finding, recorded as an Open question, not a guess.
33
+
34
+ ---
35
+
36
+ ## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
37
+
38
+ **MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
39
+ the served spec **exactly as served** (`openapi.json` / SDL / introspection result) saved with `curl -o` — never a re-typed table; plus each probed endpoint's raw response body.
40
+
41
+ Three rules bind this, and they override any instinct to summarise:
42
+
43
+ 1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
44
+ count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
45
+ medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
46
+ the citation will outlive its evidence.
47
+ 2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
48
+ `_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
49
+ essay, not a capture.
50
+ 3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
51
+ straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
52
+ bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
53
+ discard evidence.
54
+
55
+ **Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
56
+ regardless of how good the prose is.
33
57
  '''
@@ -40,4 +40,28 @@ Return a **per-unit work-list** as a compact table so the main session can dispa
40
40
  Plus a one-paragraph headline of what the codebase reveals. The main session will dispatch readers that each write `raw/<unit>.md` (install/exports/key-files/architecture for that unit).
41
41
 
42
42
  **Discipline:** breadth over depth; digest large trees; never read or write secrets (scan `.env*`, config, fixtures for credentials and redact before quoting). An empty/over-large area is an Open question, not a guess.
43
+
44
+ ---
45
+
46
+ ## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
47
+
48
+ **MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
49
+ the resolved manifests (`package.json`, `pyproject.toml`, lockfile summaries) and the structure map — the clone in `source/<target>/` is itself the artifact.
50
+
51
+ Three rules bind this, and they override any instinct to summarise:
52
+
53
+ 1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
54
+ count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
55
+ medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
56
+ the citation will outlive its evidence.
57
+ 2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
58
+ `_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
59
+ essay, not a capture.
60
+ 3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
61
+ straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
62
+ bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
63
+ discard evidence.
64
+
65
+ **Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
66
+ regardless of how good the prose is.
43
67
  '''
@@ -28,4 +28,28 @@ You collect a target's living signal into `research/<target>/dimensions/communit
28
28
  A one-paragraph headline (where the product is heading + its biggest acknowledged gap) + the top 3–5 themes. This feeds the competitive-positioning and product-features rollups.
29
29
 
30
30
  **Discipline:** themes over threads; cite representative examples, don't dump feeds. Respect rate limits and TOS. Mark anything paywalled/private as an Open question.
31
+
32
+ ---
33
+
34
+ ## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
35
+
36
+ **MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
37
+ the changelog / issue / release payloads **as fetched** — JSON wherever an API exists (GitHub API, RSS, Featurebase/Canny), not only a themed digest.
38
+
39
+ Three rules bind this, and they override any instinct to summarise:
40
+
41
+ 1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
42
+ count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
43
+ medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
44
+ the citation will outlive its evidence.
45
+ 2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
46
+ `_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
47
+ essay, not a capture.
48
+ 3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
49
+ straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
50
+ bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
51
+ discard evidence.
52
+
53
+ **Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
54
+ regardless of how good the prose is.
31
55
  '''
@@ -50,4 +50,28 @@ Then Method / Findings (framework, build tool, route count, endpoint count — t
50
50
  Return a one-paragraph headline of what the deployed shell reveals — framework + build tool, route count, the shape of the API surface it calls, whether source maps were shipped (and the confidence that implies). **Cross-checks:** flag that `dimensions/_shared/api-path-catalog.md` and `dimensions/_shared/feature-flags.md` are the SHARED seam artifacts (§6, one physical file each) — `session`/`wire`/`distribution` append to the same files with `source: session | wire | distribution`, and evaluation owns the adaptive static-vs-observed diff. Surface any endpoint or flag that looks authed/internal but is statically declared in the unauth bundle — that gap is the dimension's highest-value output.
51
51
 
52
52
  **Discipline:** breadth over depth; digest large chunks, never paste them; check for a source map before string-mining (it upgrades confidence); REDACT every env value before any `raw/` write and log it in `_meta.redactions`; obey the seam rule — one canonical shared catalog name, never a private fork. An absent bundle, obfuscated route table, or missing source map is an Open question, not a guess.
53
+
54
+ ---
55
+
56
+ ## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
57
+
58
+ **MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
59
+ the entry bundle itself (`curl -o raw/bundle.js`, gzip is fine) and any `.map` — the route table, API-path catalog and flag extracts are written **in addition**, never instead.
60
+
61
+ Three rules bind this, and they override any instinct to summarise:
62
+
63
+ 1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
64
+ count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
65
+ medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
66
+ the citation will outlive its evidence.
67
+ 2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
68
+ `_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
69
+ essay, not a capture.
70
+ 3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
71
+ straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
72
+ bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
73
+ discard evidence.
74
+
75
+ **Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
76
+ regardless of how good the prose is.
53
77
  '''
@@ -55,4 +55,28 @@ Then write the per-type raw files that apply — `raw/{extension-manifest.md, el
55
55
  Return a **one-paragraph headline** of what the shipped client reveals — its declared hosts, permission surface, embedded vendor SDKs, and how much richer (or not) it is than the web app. The API paths and feature flags you appended feed the **seam rule (§6)**: your `dimensions/_shared/api-path-catalog.md` rows carry `source: distribution` so evaluation can run its adaptive diff against `deployed-client-bundle` (`source: bundle`), `session`, and `wire-capture`. The hosts and SDK list cross-check **infra-backend-fingerprint** (a host the binary calls that DNS/CT didn't surface is a finding); the runtime hosts also seed **wire-capture** targets (the binary says what it _might_ call; the capture says what it _does_).
56
56
 
57
57
  **Discipline:** EULA before extraction — restrictive license ⇒ Open question, never silent decompile. Manifests/strings only; no protected-logic reversing. Redact every embedded key before any `raw/` write (§7 rule 3). Digest large bundles (§5). A missing artifact type is a recorded gap, not a guess.
58
+
59
+ ---
60
+
61
+ ## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
62
+
63
+ **MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
64
+ the manifests verbatim (`manifest.json`, `Info.plist`, `AndroidManifest.xml`) and the extracted file listing.
65
+
66
+ Three rules bind this, and they override any instinct to summarise:
67
+
68
+ 1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
69
+ count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
70
+ medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
71
+ the citation will outlive its evidence.
72
+ 2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
73
+ `_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
74
+ essay, not a capture.
75
+ 3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
76
+ straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
77
+ bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
78
+ discard evidence.
79
+
80
+ **Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
81
+ regardless of how good the prose is.
58
82
  '''
@@ -32,5 +32,31 @@ You collect a target's docs into `research/<target>/dimensions/docs/`. Read `.cl
32
32
 
33
33
  A one-paragraph headline (the product's documented surface in a sentence) + the section list with page counts + anything that overlaps the api/packages dimensions (flag it so synthesis can cross-check).
34
34
 
35
- **Discipline:** distill, don't mirror. A 300-page docs site becomes a navigable map + the load-bearing content, not 300 verbatim files. Record paywalled/gated docs as Open questions.
35
+ **Discipline:** distill **in addition to**, never instead of. Save each captured page's source form under `raw/pages/` (md or html, as fetched) — that is the evidence layer — and build the navigable map + load-bearing content as the narrative layer beside it (ingestion §5.1). A distilled section whose source page was never saved is unverifiable by the next run (§5.3).
36
+
37
+ **Do not mirror the SITE:** A 300-page docs site becomes a navigable map + the load-bearing content, not 300 verbatim files. Record paywalled/gated docs as Open questions.
38
+
39
+ ---
40
+
41
+ ## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
42
+
43
+ **MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
44
+ each captured page's source form under `raw/pages/` (md or html, as fetched).
45
+
46
+ Three rules bind this, and they override any instinct to summarise:
47
+
48
+ 1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
49
+ count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
50
+ medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
51
+ the citation will outlive its evidence.
52
+ 2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
53
+ `_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
54
+ essay, not a capture.
55
+ 3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
56
+ straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
57
+ bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
58
+ discard evidence.
59
+
60
+ **Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
61
+ regardless of how good the prose is.
36
62
  '''
@@ -61,4 +61,28 @@ Return a **one-paragraph headline** of the reconstructed backend — origin clou
61
61
  **Discipline:** read-only public recon — never scan, brute-force, or hit a non-public host; respect crt.sh/WHOIS rate limits and back off; redact any credential-shaped value before writing (contract §7 rule 3 — DSNs, verification tokens, embedded keys surfaced in headers/TXT). An unresolvable host or a missing sub-processor page is an Open question, not a guess.
62
62
 
63
63
  **Verify an absence before asserting it (contract §7 rule 10).** Before reporting any host as **NXDOMAIN / absent** — especially `api.<target>` or any host a sibling dimension (bundle / session / wire) reports actually hitting — re-resolve via a **second resolver** (`dig @1.1.1.1 <host>`, `dig @8.8.8.8 <host>`) **and** a direct `curl -sI https://<host>`. An HTTP 4xx/5xx response means the host **resolves** → report it **present**, not absent. A single negative resolver result is recorded as _tentative_, never stated as fact and never used to instruct sibling dimensions. Likewise, an _inferred_ backend engine (e.g. "looks like Hasura/Supabase from the CNAME") is phrased as an inference and yields to a runtime-observing dimension (`session`/`deployed-client-bundle`) that names the engine directly.
64
+
65
+ ---
66
+
67
+ ## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
68
+
69
+ **MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
70
+ the raw `dig`, `crt.sh` and HTTP header responses as returned; the decoded table is the narrative layer beside them.
71
+
72
+ Three rules bind this, and they override any instinct to summarise:
73
+
74
+ 1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
75
+ count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
76
+ medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
77
+ the citation will outlive its evidence.
78
+ 2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
79
+ `_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
80
+ essay, not a capture.
81
+ 3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
82
+ straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
83
+ bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
84
+ discard evidence.
85
+
86
+ **Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
87
+ regardless of how good the prose is.
64
88
  '''
@@ -27,4 +27,28 @@ You collect a target's installable artifacts into `research/<target>/dimensions/
27
27
  A one-paragraph headline (the package family in a sentence) + the package table + which packages are the core public API (so synthesis can anchor the SDK surface). Flag overlap with the docs api-reference and the codebase dimensions for cross-check.
28
28
 
29
29
  **Discipline:** the exports map + type defs are the load-bearing artifact — prioritize them over download-count trivia. Digest huge `.d.ts` to signatures. Redact any registry tokens.
30
+
31
+ ---
32
+
33
+ ## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
34
+
35
+ **MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
36
+ per package: the registry metadata JSON (`npm view <pkg> --json > raw/<pkg>.registry.json`, PyPI `/pypi/<pkg>/json`) and the `.d.ts` / exports surface as fetched.
37
+
38
+ Three rules bind this, and they override any instinct to summarise:
39
+
40
+ 1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
41
+ count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
42
+ medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
43
+ the citation will outlive its evidence.
44
+ 2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
45
+ `_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
46
+ essay, not a capture.
47
+ 3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
48
+ straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
49
+ bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
50
+ discard evidence.
51
+
52
+ **Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
53
+ regardless of how good the prose is.
30
54
  '''
@@ -38,4 +38,44 @@ Under `research/<target>/dimensions/session/`:
38
38
  A one-paragraph headline (the auth model + transport + the single most load-bearing wire finding) + the phase coverage + which passes ran. Flag drift between the _observed_ wire surface and the _published_ api/packages surface — that drift is the highest-value synthesis input. If Pass 2 was needed but not authorized, list the open write-side questions; never fabricate request bodies.
39
39
 
40
40
  **Discipline:** ethics first, always. Redact before writing. Confirm before any state change. No destructive actions. No exfiltration. A gap is an Open question, never a guess.
41
+
42
+ ---
43
+
44
+ ## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
45
+
46
+ **MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
47
+ ≥3 verbatim envelopes as `raw/*.json` — the identity read, one canonical list read, and the primary write (request + response) — per ingestion §8.
48
+
49
+ Three rules bind this, and they override any instinct to summarise:
50
+
51
+ 1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
52
+ count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
53
+ medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
54
+ the citation will outlive its evidence.
55
+ 2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
56
+ `_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
57
+ essay, not a capture.
58
+ 3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
59
+ straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
60
+ bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
61
+ discard evidence.
62
+
63
+ **Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
64
+ regardless of how good the prose is.
65
+
66
+ ## Visual capture (ingestion §5.5) — screenshot generously
67
+
68
+ You drive a real browser, so you carry the visual-evidence obligation. **Capture continuously, not
69
+ one-image-per-surface:** every surface, plus every materially different state within it — empty vs
70
+ populated, modal/drawer open, dropdown expanded, error and validation states, permission/plan walls,
71
+ loading/in-flight, and the before/after pair around any authorized state change.
72
+
73
+ This is **not** scored — `screenshot_coverage` is a narrow Mode-5 floor. The beneficiary is the human
74
+ reading this corpus weeks later for a purpose nobody anticipated. The product's past state is the one thing
75
+ a later run genuinely cannot reproduce.
76
+
77
+ **Redact in the DOM before the shutter** (`tradecraft.md` §1c) — a leaked pixel is undetectable afterwards.
78
+ **Check the corners of the frame**, not just the content: support-chat widgets, toasts, presence avatars and
79
+ member lists routinely carry *another human's* name and message. Then look at the saved image, and record
80
+ `redacted: <what>` in `screens/_index.md` rather than a blanket zero-PII claim.
41
81
  '''
@@ -33,4 +33,28 @@ You collect a target's public-facing site into `research/<target>/dimensions/web
33
33
  A one-paragraph headline (the positioning in a sentence) + the pricing tiers + the headline feature claims. Flag claims that should be cross-checked against the codebase/docs (marketing often over-claims) so synthesis can reconcile.
34
34
 
35
35
  **Discipline:** quote positioning verbatim; capture pricing precisely (numbers + limits); separate _claims_ from verified capability — the reconciliation happens in synthesis. Respect robots.txt and rate limits; this is read-only public crawling, not scraping at scale.
36
+
37
+ ---
38
+
39
+ ## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
40
+
41
+ **MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
42
+ the raw HTML or extracted text per captured page, and the pricing table as structured data.
43
+
44
+ Three rules bind this, and they override any instinct to summarise:
45
+
46
+ 1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
47
+ count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
48
+ medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
49
+ the citation will outlive its evidence.
50
+ 2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
51
+ `_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
52
+ essay, not a capture.
53
+ 3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
54
+ straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
55
+ bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
56
+ discard evidence.
57
+
58
+ **Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
59
+ regardless of how good the prose is.
36
60
  '''
@@ -42,4 +42,44 @@ Then the captures + raw artifacts (per `discovery` Part C (wire-capture)):
42
42
  Return a **one-paragraph headline** of what the wire reveals — the real hosts contacted, the envelope/auth scheme, and the rung used (so the reader knows how much to trust it). Then a compact table of observed endpoints. **Flag the seam rule (§6):** every `api-path-catalog.md` row is `source: wire`, so evaluation can diff _actually-called_ (wire) against _statically-declared_ (`bundle` / `distribution-artifacts`) and _browser-observed_ (`session`) — a host or path the binary declares but the wire never hits is a finding, not noise; the inverse (called but undeclared) is a stronger one. If only rung 1 was authorized, say so and name what rungs 2/3 would unlock so the main session can request authorization.
43
43
 
44
44
  **Discipline:** lowest privilege first; never self-escalate the ladder; never install a CA or tap third-party traffic; never run Wireshark; redact every body before disk and log it in `_meta`. An unauthorized higher rung is an Open question, not an excuse to guess what the wire would show.
45
+
46
+ ---
47
+
48
+ ## Dump manifest (ingestion §5.3–5.4) — evidence before narrative
49
+
50
+ **MUST land in `raw/` as verbatim, redacted files before this dimension may be `status: complete`:**
51
+ the flow log itself (HAR or the tap's JSON export), not only the decoded narrative.
52
+
53
+ Three rules bind this, and they override any instinct to summarise:
54
+
55
+ 1. **If you cite it, dump it (§5.3).** Every value that reaches your `_summary.md` — a version, a path, a
56
+ count, a price, a field name — must be traceable to a file on disk. **The session is not a storage
57
+ medium:** a number you extracted from a response you did not save is unverifiable by the next run, and
58
+ the citation will outlive its evidence.
59
+ 2. **Digest IN ADDITION, never INSTEAD (§5.1).** `raw/` is the evidence layer and may be unreadable;
60
+ `_summary.md` is the narrative layer. A readable digest whose source artifact was never written is an
61
+ essay, not a capture.
62
+ 3. **Size is a routing problem (§5.2).** Never read a large artifact into context to save it — pipe it
63
+ straight to disk (`curl -o`, `| gzip >`, or the clipboard channel for in-page captures). If you must
64
+ bound an unbounded source, record the bound in `_meta.sampling`. Context budget is never a reason to
65
+ discard evidence.
66
+
67
+ **Self-check before returning:** count the verbatim files in `raw/`. Zero ⇒ the dimension is `partial`,
68
+ regardless of how good the prose is.
69
+
70
+ ## Visual capture (ingestion §5.5) — screenshot generously
71
+
72
+ You drive a real browser, so you carry the visual-evidence obligation. **Capture continuously, not
73
+ one-image-per-surface:** every surface, plus every materially different state within it — empty vs
74
+ populated, modal/drawer open, dropdown expanded, error and validation states, permission/plan walls,
75
+ loading/in-flight, and the before/after pair around any authorized state change.
76
+
77
+ This is **not** scored — `screenshot_coverage` is a narrow Mode-5 floor. The beneficiary is the human
78
+ reading this corpus weeks later for a purpose nobody anticipated. The product's past state is the one thing
79
+ a later run genuinely cannot reproduce.
80
+
81
+ **Redact in the DOM before the shutter** (`tradecraft.md` §1c) — a leaked pixel is undetectable afterwards.
82
+ **Check the corners of the frame**, not just the content: support-chat widgets, toasts, presence avatars and
83
+ member lists routinely carry *another human's* name and message. Then look at the saved image, and record
84
+ `redacted: <what>` in `screens/_index.md` rather than a blanket zero-PII claim.
45
85
  '''
@@ -1,11 +1,11 @@
1
1
  {
2
2
  "harness": "discover",
3
3
  "name": "discover",
4
- "version": "0.1.13",
4
+ "version": "0.1.14",
5
5
  "files": [
6
6
  ".prettierignore",
7
7
  ".prettierrc.json",
8
8
  ".vscode/settings.json"
9
9
  ],
10
- "digest": "3272a670df3c"
10
+ "digest": "4ab9f67f0d67"
11
11
  }
@@ -0,0 +1,219 @@
1
+ # Calibration Reference — Blind Re-runs · Disposition · The Fleet Ledger
2
+
3
+ The reference for the harness's **only external signal**. Everything else in this harness is self-assessment:
4
+ collectors grade their own `confidence` and `completeness_pct`, Evaluation weights those self-grades, and
5
+ Mode 5 scores the result against a checklist the same system authored. That loop can converge on a corpus
6
+ that is confidently, well-provenanced, and wrong.
7
+
8
+ **Calibration is the one procedure that can tell you whether any of it is true.** It re-derives claims a
9
+ prior run published, blind, and records what survived.
10
+
11
+ > **The measured position, as of 2026-07-28.** One target has ever been re-run (`emergent`, 2026-06-25 →
12
+ > 2026-07-28). Of 16 claims re-tested: **7 refuted, 4 corrected, 5 confirmed** — a 44% flat-falsification
13
+ > rate — and **4 of the 7 refutations came from lanes the prior run had graded `confidence: high`.** The
14
+ > prior run had self-scored **88/100 "strong"** and `stopped_on: converged`.
15
+ >
16
+ > That is **n=1**. It is the entire empirical basis of this harness. Every rule in `.claude/rules/` is
17
+ > currently a hypothesis with n=0 on any target it did not come from. The purpose of this file is to make
18
+ > n grow.
19
+
20
+ ---
21
+
22
+ ## Two tiers — pick the one that will actually happen
23
+
24
+ A metric too expensive to run leaves `n` at 1 forever. The cheap tier is the important one.
25
+
26
+ | Tier | Cadence | Cost | What it measures |
27
+ | --- | --- | --- | --- |
28
+ | **A — Claim spot-check** | monthly | ~1 session, no full ingestion | the refutation rate, and whether `confidence` tracks truth |
29
+ | **B — Full blind re-run** | quarterly, or when a rule set changes materially | a complete run | everything Tier A does, plus coverage drift and whether new rules changed behaviour |
30
+
31
+ **Tier A is the default. Do not skip it waiting for capacity to do Tier B** — a monthly spot-check of 15–20
32
+ claims across one target produces the regression that matters, and produces it twelve times a year.
33
+
34
+ ---
35
+
36
+ ## Selection — rotate, never choose
37
+
38
+ **The target is selected by rotation, not by judgment.** Take the least-recently-calibrated target in the
39
+ corpus root; break ties by oldest `captured_at`. Record the selection rule alongside the result.
40
+
41
+ A human (or a run) choosing which target to re-check will choose the one it feels good about. That single
42
+ substitution destroys the metric, because the sample stops being representative of the fleet and starts
43
+ being representative of the harness's confidence — which is the very thing under test.
44
+
45
+ ---
46
+
47
+ ## THE BLIND RULE (this is what makes it evidence)
48
+
49
+ **Capture first. Read the prior corpus only after your own observation is written down.**
50
+
51
+ 1. Select the target. **Do not open its corpus.**
52
+ 2. Draw the claim sample (below) — a list of *questions*, not answers. Someone or something other than the
53
+ re-deriving agent extracts the questions, or the questions are extracted mechanically from claim
54
+ anchors, so the sample carries no prior conclusions.
55
+ 3. **Re-derive each claim from the live product**, from scratch, recording what you observe and the method.
56
+ 4. **Only then** open the prior corpus and diff.
57
+
58
+ > **This deliberately overrides `discovery.md` Step 00 for calibration runs.** Step 00 tells a run to find a
59
+ > prior corpus, restore it, and reconcile against it — correct for a normal re-run, where the prior corpus
60
+ > is a genuine corroboration lane and re-deriving everything from zero is waste. **It is wrong here.** A run
61
+ > that reads the prior claim first will anchor on it: it will look for confirmation, find it, and report a
62
+ > confirmation rate that measures its own suggestibility. Anchoring is the specific failure this protocol
63
+ > exists to avoid, so for a calibration run Step 00 is deferred until after step 3, and the run records
64
+ > `blind: true`.
65
+ >
66
+ > If a run cannot honestly attest that it re-derived before reading, it must record `blind: false` — and
67
+ > the result is then a **consistency check, not a calibration**, and does not enter the ledger's refutation
68
+ > rate.
69
+
70
+ **Sampling the claims.** 15–20 per target, drawn to make the regression computable, not to be flattering:
71
+
72
+ - **Stratify by the prior run's stated `confidence`** — roughly equal numbers of `high`, `medium`, `low`.
73
+ Without this the regression cannot be computed, and the regression is the point.
74
+ - **Include the load-bearing ones** — claims a README headline rests on, and claims a reader would act on
75
+ (pricing, limits, guarantees, auth model, what the product can and cannot do).
76
+ - **Include at least 3 negative claims** ("no public SDK", "no realtime layer", "not supported"). Negatives
77
+ are the harness's demonstrated weak spot: **5 of the 7 refutations in the one data point were negatives.**
78
+ - **Exclude** anything whose truth cannot change and cannot be re-checked (a historical funding round).
79
+
80
+ ---
81
+
82
+ ## Disposition — five values, and the fifth is the one the old schema lacked
83
+
84
+ Every sampled claim resolves to exactly one:
85
+
86
+ | Disposition | Meaning | What it says about the harness |
87
+ | --- | --- | --- |
88
+ | **confirmed** | independently re-derived, same conclusion | the method worked |
89
+ | **corrected** | right direction, wrong detail (a count, a version, a name) | the method worked; the reading was imprecise |
90
+ | **refuted** | the claim was **wrong when it was made** | **the method failed — this is the signal** |
91
+ | **stale** | the claim was **true when made; the product changed** | the method worked; the corpus has a shelf life |
92
+ | **unverifiable** | cannot be re-checked now (surface gone, plan changed, gated) | no signal either way; excluded from the rate |
93
+
94
+ > **`refuted` and `stale` are the distinction the original artifact had no slot for, and they mean opposite
95
+ > things.** A high `refuted` rate means *the instrument is unreliable* and the rules need work. A high
96
+ > `stale` rate means *the instrument is fine and the corpus decays* — which calls for shorter shelf-lives
97
+ > and `volatility` tagging, not methodology changes. Conflating them makes the harness fix the wrong
98
+ > problem. When you cannot tell which it is — no dated evidence either way — record **`refuted`**. The
99
+ > conservative reading is the one that keeps the harness honest about itself.
100
+ >
101
+ > (Origin: `emergent/00-prior-run-reconciliation.md` — a genuinely good artifact whose section A had to be
102
+ > titled *"REFUTED (prior claim was wrong, not merely stale)"* precisely because the schema gave it nowhere
103
+ > else to put the distinction.)
104
+
105
+ **The refutation rate** = `refuted ÷ (confirmed + corrected + refuted + stale)`. `unverifiable` is excluded
106
+ from the denominator, and its count is reported so a shrinking sample is visible.
107
+
108
+ ---
109
+
110
+ ## The regression — the actual question
111
+
112
+ For each calibration, record the disposition **against the prior run's stated confidence for that claim**:
113
+
114
+ | prior confidence | n | confirmed | corrected | refuted | stale | refutation rate |
115
+ | --- | --- | --- | --- | --- | --- | --- |
116
+ | high | | | | | | |
117
+ | medium | | | | | | |
118
+ | low | | | | | | |
119
+
120
+ **If `high` claims are refuted at a similar rate to `low` claims, the `confidence` field carries no signal
121
+ and `ingestion.md` §3's method→confidence table is decorative.** That is the single most consequential thing
122
+ this harness could learn about itself, and it is unknowable without this table.
123
+
124
+ Also record refutation rate **by `method`** once n is large enough — that tells you which of the 17 methods
125
+ in §3 are over-graded, which is directly actionable (a method's band gets lowered).
126
+
127
+ ---
128
+
129
+ ## Artifacts
130
+
131
+ ### Per calibration — `research/<target>/00-prior-run-reconciliation.md`
132
+
133
+ Formalizes the shape `emergent` invented. **This file is part of the output contract** whenever a prior
134
+ corpus exists.
135
+
136
+ ```markdown
137
+ ---
138
+ target: <slug>
139
+ reconciled_at: <YYYY-MM-DD>
140
+ prior_run_date: <YYYY-MM-DD>
141
+ prior_run_commit: <sha>
142
+ prior_run_score: <n>
143
+ tier: A | B # spot-check or full blind re-run
144
+ blind: true | false # false ⇒ consistency check only, excluded from the rate
145
+ selection_rule: rotation # or: named-by-user (record it either way)
146
+ sampled: <n>
147
+ confirmed: <n>
148
+ corrected: <n>
149
+ refuted: <n>
150
+ stale: <n>
151
+ unverifiable: <n>
152
+ refutation_rate: <0-100>
153
+ by_confidence: # the regression — REQUIRED
154
+ high: { n: <n>, refuted: <n> }
155
+ medium: { n: <n>, refuted: <n> }
156
+ low: { n: <n>, refuted: <n> }
157
+ ---
158
+
159
+ ## A. REFUTED — wrong when made (claim · what was observed · lane that refuted it · prior confidence)
160
+ ## B. STALE — true when made, changed (claim · what changed · evidence of the change being NEW)
161
+ ## C. CORRECTED — right, imprecise
162
+ ## D. CONFIRMED — independently re-derived
163
+ ## E. UNVERIFIABLE — and why
164
+ ## F. What this says about the METHOD (which lanes/methods produced the refutations, and whether a
165
+ §3 confidence band should be lowered)
166
+ ```
167
+
168
+ ### Fleet-level — `research/_calibration/ledger.md`
169
+
170
+ **The metric itself.** One row per calibration, accumulating across targets and time. This is the file to
171
+ read when asking "does this harness work?" It is never rewritten, only appended to.
172
+
173
+ ---
174
+
175
+ ## What a result CHANGES (otherwise this is just bookkeeping)
176
+
177
+ A calibration that produces a number and no action is theatre. Each outcome routes:
178
+
179
+ | Finding | Action |
180
+ | --- | --- |
181
+ | A **method** shows a high refutation rate | lower its band in `ingestion.md` §3, and record the calibration as the origin |
182
+ | **Negative claims** refute disproportionately | tighten the absence rules (`ingestion.md` §7 rule 10, `discovery.md` Part B) — the `blind_to:` direction |
183
+ | `high` refutes ≈ as often as `low` | **the confidence field is not carrying signal** — this is a structural finding about the harness, and it goes to the user, not into a rule tweak |
184
+ | A **rule added after the prior run** would have prevented a refutation | evidence the improvement loop works — record it, it is the only such evidence that exists |
185
+ | A refutation recurs **after** a rule was added to prevent it | evidence a rule did **not** change behaviour; escalate to the user rather than adding another rule |
186
+ | High **stale** rate | shorten shelf-life expectations and tag volatile claims; **not** a methodology problem |
187
+
188
+ ---
189
+
190
+ ## How to run one (Tier A, the monthly default)
191
+
192
+ 1. **Select** by rotation from `research/_calibration/ledger.md`. Record the target and the rule.
193
+ 2. **Extract the sample** mechanically — pull claim anchors from the target's `evaluation/*.md`, stratify by
194
+ the cited confidence, and write them as **questions with the answers stripped**.
195
+ 3. **Re-derive blind.** Do not open the corpus. Use whatever lanes the access vector allows; record method
196
+ and observation per claim.
197
+ 4. **Diff and disposition** each claim into the five values.
198
+ 5. **Write** `00-prior-run-reconciliation.md` (append a new dated section if one already exists — never
199
+ overwrite a prior calibration).
200
+ 6. **Append one row** to the fleet ledger, and update its running totals.
201
+ 7. **Route** every finding through the table above. Anything that becomes a rule change goes through the
202
+ normal Mode-5 approval gate.
203
+
204
+ **Cost/state discipline is unchanged:** a calibration is read-only unless the user authorizes otherwise; a
205
+ claim that can only be re-derived by spending money or mutating state is recorded `unverifiable` with the
206
+ reason, never quietly exercised.
207
+
208
+ ---
209
+
210
+ ## How the harness uses this reference
211
+
212
+ Calibration is a **cross-run process**, not a mode of a single run — nothing in Modes 1–5 triggers it, and it
213
+ must not be folded into them (a run cannot calibrate itself; that is the circularity it exists to break).
214
+ Mode 5 reads the fleet ledger as *context* when weighing a proposal — a rule contradicted by calibration
215
+ data should not be promoted — but Mode 5 never writes to it.
216
+
217
+ > **Do not attach calibration to the Mode-5 score.** The moment `refutation_rate` becomes a rubric input,
218
+ > the run acquires an interest in the number, and the one uncorrupted signal in the system is gone. It
219
+ > measures the **harness**, not the run. Publish it; never grade with it.
@@ -0,0 +1,205 @@
1
+ # Tooling Reference — Host Capability · Tiers · The Bright Line
2
+
3
+ The reference for **Step 0** (`discover` harness, run once per corpus folder before Mode 1). Capture depth
4
+ is bounded by host tooling most machines lack. This file carries the **tier lists** (what to recommend),
5
+ the **ethics classification** (clean · gated · avoid), the **per-dimension gap map** (what a bare host
6
+ cannot do), and the **install caveats** that have actually bitten.
7
+
8
+ **Nothing here is ever installed automatically.** The harness detects what is present, recommends only what
9
+ is missing, and records the result in `.claude/discover-tooling.json` so it never re-prompts in the same
10
+ folder. The harness recommends; the user decides. A user who declines proceeds to Mode 1 on whatever is
11
+ present — a missing capability is re-surfaced at the Mode 2 capability-gap checkpoint (`ingestion.md` §8),
12
+ never silently degraded.
13
+
14
+ A host almost always arrives strong on languages and package managers (node, pnpm, python, uv, cargo, gh,
15
+ jq, ripgrep) and **bare on capture/analysis tooling**. That gap is the difference between a shallow capture
16
+ and a deep one.
17
+
18
+ ---
19
+
20
+ ## The three classes (this is an ethics classification, not a convenience one)
21
+
22
+ | Class | Meaning | Rule |
23
+ | --- | --- | --- |
24
+ | **clean** | passive / local-only; always in-bounds | recommend freely, offer the one-paste block |
25
+ | **gated** | in-bounds **only** first-party / user-owned / opt-in — the user installs the CA, routes *their own* client, owns the keys | surface the command, **never run it for the user** |
26
+ | **avoid** | crosses the harness bright line (active scanning, exploitation, third-party interception) | never recommend; listed so it is not added by reflex |
27
+
28
+ The harness is for **spec-writing / integration / competitive analysis** — passive or first-party only,
29
+ respecting TOS and robots (`ingestion.md` §7). No tool changes that; the gated ones simply need the user in
30
+ the loop, exactly as `session` Pass-2 and `wire-capture` rung 3 do.
31
+
32
+ ---
33
+
34
+ ## Why this file matters more since the §5 rewrite
35
+
36
+ `ingestion.md` §5 now requires **verbatim dumping** — the artifact lands on disk whole, and the digest is
37
+ written *beside* it, never *instead* of it. The obvious objection is "a 6 MB spec is unusable." **These
38
+ tools are the answer to that objection.** They are what make a verbatim corpus queryable, which is what
39
+ makes dumping-not-digesting practical:
40
+
41
+ | Instead of digesting… | Dump verbatim, then |
42
+ | --- | --- |
43
+ | a 6 MB OpenAPI spec → a hand-typed endpoint table | `curl -o raw/spec.json` → **spectral** to catalog, **oasdiff** to diff, **gron** to grep |
44
+ | a 9 MB minified bundle → prose about the routes | `curl -o raw/bundle.js` → **webcrack** / **source-map-explorer** to read, **ast-grep** to query |
45
+ | a HAR → a narrative of the calls | keep `raw/flows.har` → **gron** to flatten and grep |
46
+ | a docs site → distilled sections only | keep the page sources → **trafilatura** / **pandoc** to render |
47
+ | a package's exports → string-mined prose | `npm view --json` → **typescript + attw + publint**, **griffe** for Python |
48
+
49
+ **A digest is a lossy compression you cannot undo; a verbatim artifact plus a query tool is lossless.**
50
+ Recommend Tier 1 on that basis, not as a nice-to-have.
51
+
52
+ ---
53
+
54
+ ## Tier 1 — clean, install now (broad leverage)
55
+
56
+ Highest-consensus, always in-bounds. Offer as one paste:
57
+
58
+ ```bash
59
+ # Homebrew (CLI analysis + data-wrangling + web→text)
60
+ brew install gron pandoc ast-grep scc universal-ctags oasdiff fd yq dasel monolith tokei sevenzip
61
+ # Rust
62
+ cargo install htmlq
63
+ # Python (via uv — pipx is typically absent; uv tool install is the path)
64
+ uv tool install trafilatura && uv tool install griffe
65
+ # Node global (JS/TS surface + bundle de-obfuscation + spec lint)
66
+ npm i -g webcrack source-map-explorer @arethetypeswrong/cli publint @electron/asar typescript @stoplight/spectral-cli
67
+ # Headless browser for JS-rendered docs/marketing (clean — the user's own headless instance)
68
+ npm i -g playwright && npx playwright install chromium
69
+ ```
70
+
71
+ | Tool | Unlocks | Dimensions served |
72
+ | --- | --- | --- |
73
+ | **gron** | flatten any JSON → greppable/diffable `path = value` (specs, captures, manifests, HAR, configs) | **7** (codebase, api, session, bundle, infra, wire, cross-cutting) |
74
+ | **trafilatura** | boilerplate-stripped main content + dates from HTML → clean markdown; feed/sitemap discovery | **4** (docs, website, community, infra) |
75
+ | **pandoc** | deterministic HTML→GFM (headings, tables, code fences) at scale | 3 (docs, website, community) |
76
+ | **ast-grep** | tree-sitter structural search/count across many files + langs (call sites, routes, exports) — catches what regex misses | 2 (codebase, bundle) |
77
+ | **oasdiff** | structured breaking-vs-non-breaking OpenAPI diff — makes the published-vs-app-own diff machine-checked | 2 (api, cross-cutting) |
78
+ | **webcrack** | un-minify / un-webpack / de-obfuscate SPA & Electron JS into readable modules | 2 (bundle, distribution) |
79
+ | **scc** | instant LOC-by-language + complexity census of a fresh clone (JSON) — the codebase opening move | 1 (codebase) |
80
+ | **universal-ctags** | real multi-lang JSON symbol index (the host's BSD ctags is broken for this) | 1 (codebase) |
81
+ | **htmlq** | surgical CSS-selector extraction (pricing cards, feature tables) instead of regex | 1 (website) |
82
+ | **source-map-explorer** | reassemble a shipped `.map` → original `src/` tree (the `source-map-reassembly` method) | 1 (bundle) |
83
+ | **spectral** | validate/resolve an OpenAPI/AsyncAPI spec → structured endpoint/security/`$ref` catalog | 1 (api) |
84
+ | **griffe** | extract a PyPI package's full public API (the `.d.ts` equivalent for Python) | 1 (packages) |
85
+ | **@arethetypeswrong/cli + typescript + publint** | parse the real `.d.ts`/exports type graph + grade the publish surface (verbatim, not string-mined) | 1 (packages) |
86
+ | **@electron/asar** | extract Electron `app.asar` → JS module tree (the distribution step the playbook names but cannot otherwise run) | 1 (distribution) |
87
+ | **fd · yq · dasel · monolith · tokei · sevenzip** | gitignore-aware file discovery · YAML/XML/TOML query · RSS/XML→JSON · single-file page archive · LOC cross-check · multi-format extract | several |
88
+
89
+ ---
90
+
91
+ ## Tier 2 — gated, install when a run needs them (first-party / passive only)
92
+
93
+ The capture lanes. In-bounds **only** for the user's own session, the user's own first-party clients, or
94
+ passive sources. **Surface these; never run them for the user.**
95
+
96
+ ```bash
97
+ brew install mitmproxy websocat grpcurl subfinder tlsx testssl jadx apktool
98
+ npm i -g chrome-remote-interface get-graphql-schema
99
+ # one-time, USER-RUN: expose a CDP port on the user's own Chrome (closes the WS-frame blind spot)
100
+ # open -na "Google Chrome" --args --remote-debugging-port=9222
101
+ # mobile-only, the user's own device + explicit opt-in: uv tool install frida-tools
102
+ ```
103
+
104
+ | Tool | Unlocks | Ethics note |
105
+ | --- | --- | --- |
106
+ | **mitmproxy** | decode full HTTPS + WebSocket flows of any **first-party** client (CLI/desktop/mobile/SDK) — the `wire-capture` rung-3 keystone (`ingestion.md` §7.1) | user installs the CA and routes *their own* client only |
107
+ | **chrome-remote-interface** | raw CDP → `Network.webSocketFrameReceived`/`Created`, SSE, full bodies — **captures the on-load WS frames the browser MCP's HTTP-only `read_network_requests` drops** | the user's own logged-in session |
108
+ | **websocat** | curl-for-WebSockets: connect / frame / replay / hexdump a realtime endpoint outside the browser | first-party endpoint |
109
+ | **grpcurl** | list services + invoke RPCs via gRPC server reflection → readable op/message catalog | first-party endpoint |
110
+ | **get-graphql-schema** | introspect a first-party GraphQL endpoint → full SDL | first-party endpoint |
111
+ | **subfinder · tlsx · testssl.sh** | passive CT/DNS subdomain breadth + structured TLS posture (vs hand-rolled crt.sh + openssl text) | passive aggregation; respect rate limits |
112
+ | **jadx · apktool** | decompile Android `.apk`/`.dex` → Java + decode `AndroidManifest`/resources (capability map) | public binary; read the EULA first (`ingestion.md` §7.2) |
113
+ | **frida-tools** | cert-pinning bypass to capture **the user's own** mobile client's wire | the user's own device + explicit opt-in only |
114
+
115
+ > **The single biggest unlock for a realtime target** is `chrome-remote-interface` + a Chrome
116
+ > `--remote-debugging-port` + `websocat` + `mitmproxy` together: they give `session`/`wire-capture` a real
117
+ > WebSocket/SSE capture path instead of a client-side-remount workaround. The browser MCP's
118
+ > `read_network_requests` is **HTTP-only** — that is *why* a realtime tap comes back empty until the remount
119
+ > trick (`tradecraft.md` gotcha #13, `ingestion.md` §9.4). A CDP port removes the injection-timing problem
120
+ > entirely rather than working around it.
121
+ >
122
+ > (Origin: Emergent — with no CDP port open, the run fell back to in-page taps. That worked, but a
123
+ > post-boot `window.WebSocket` wrapper is structurally blind to a library socket opened at boot, and the
124
+ > prior run published a false negative because of it.)
125
+
126
+ ---
127
+
128
+ ## AVOID — never recommend (this is the bright line)
129
+
130
+ Out-of-bounds for a spec-writing / competitive-analysis harness. Listed so they are not added by reflex:
131
+
132
+ - **`nmap`, `masscan`, `naabu`** — active port sweeps / service-version probing of remote hosts.
133
+ - **`nuclei`** — template-based remote vulnerability scanning.
134
+ - **`sqlmap`** — injection / exploitation.
135
+ - **`amass` (active mode)** — active DNS brute-forcing. Its *passive* mode overlaps subfinder; prefer subfinder.
136
+ - **`mitmproxy` or `frida` against a third party**, **`socat` as a public relay** — intercepting traffic the
137
+ user does not own is the line this harness will not cross.
138
+
139
+ These stay absent **by design**. The recon ethics depend on it, and a tool absent from the host is a
140
+ stronger guarantee than a rule telling the agent not to use it.
141
+
142
+ ---
143
+
144
+ ## Per-dimension gap map (what a bare host cannot do)
145
+
146
+ | Dimension | Biggest capability gap on a bare host | Top addition(s) |
147
+ | --- | --- | --- |
148
+ | **codebase** | no LOC census, no AST search; the host's BSD ctags is broken for this | scc · ast-grep · universal-ctags (+ fd) |
149
+ | **docs** | no HTML/MDX→md, no JS render → client-rendered docs come back empty | pandoc · trafilatura · playwright |
150
+ | **packages** | the real `.d.ts`/exports surface is string-mined, not parsed | typescript + attw + publint · griffe (Py) · yq |
151
+ | **api** | can fetch a spec but cannot lint / diff / introspect / exercise it | spectral · oasdiff · get-graphql-schema · grpcurl · websocat |
152
+ | **website** | no JS render, no clean table/text extraction → misses pricing and feature grids | trafilatura · htmlq · playwright |
153
+ | **community** | no clean changelog/blog→text, no RSS→JSON | trafilatura · pandoc · dasel |
154
+ | **session** | **structurally blind to WebSocket/SSE frames** (HTTP-only MCP, no CDP port) | chrome-remote-interface · mitmproxy · websocat |
155
+ | **deployed-client-bundle** | a minified/obfuscated blob stays opaque; no source-map reassembly | webcrack · source-map-explorer · ast-grep · gron |
156
+ | **infra-backend-fingerprint** | shallow CT coverage, TLS posture by hand, sub-processor pages scraped raw | subfinder · tlsx · trafilatura (passive only) |
157
+ | **wire-capture** | the keystone (mitmproxy) plus every non-browser replay/decode client is absent | mitmproxy · websocat · grpcurl |
158
+ | **distribution-artifacts** | only CRX/Mach-O readable; no Electron or Android decoders | @electron/asar · jadx · apktool · webcrack · sevenzip |
159
+ | **external-reputation / hiring-intel** | bot-walled review and ATS pages return 403 to plain fetch | playwright (own headless instance) · trafilatura · dasel |
160
+ | **cross-cutting (synthesis)** | no structured diff for the N-way seam reconciliation; no out-of-band WS capture | gron · oasdiff · chrome-remote-interface · yq |
161
+
162
+ ---
163
+
164
+ ## Known install caveats (each of these has actually bitten)
165
+
166
+ - **`webcrack` needs Node 22.** Its hard dependency `isolated-vm` is a native (node-gyp) addon that fails to
167
+ build against Node 26, and `--omit=optional` does not help — the dep is non-optional. Run it under a Node
168
+ 22 LTS shim (`npx -y webcrack@latest …` in a Node-22 env), or lean on the already-clean
169
+ `source-map-explorer` (the preferred `source-map-reassembly` path whenever the SPA ships `.map` files)
170
+ plus `ast-grep`. De-obfuscating a **no-maps, minified** bundle is the only gap this leaves.
171
+ - **`chrome-remote-interface` is a library, not a CLI.** It installs as a Node module and is invoked from a
172
+ script, not a shell binary. **Detect it with `npm ls -g chrome-remote-interface`, not `command -v`** — a
173
+ `command -v` probe reports it missing when it is installed, and the run then wrongly records a capability
174
+ gap.
175
+ - **`pipx` is typically absent; use `uv tool install`** for Python CLIs (uv is present). Simpler than adding pipx.
176
+ - **`playwright` is clean** — the user's own headless instance. It unblocks JS-rendered docs and marketing
177
+ for `docs` + `website` **without contending for the gated `session` Chrome**, which matters because the
178
+ browser is a singleton (`ingestion.md` §7 rule 9).
179
+
180
+ ---
181
+
182
+ ## How Step 0 uses this reference
183
+
184
+ Once per corpus folder, before Mode 1. If `.claude/discover-tooling.json` exists, tooling was already
185
+ reviewed here — **skip straight to Mode 1 and never re-prompt.** If it is absent:
186
+
187
+ 1. Read this file — the tier lists, the classification, the AVOID list.
188
+ 2. **Detect before recommending** — `command -v <tool>` per tool, and `npm ls -g <pkg>` for the Node
189
+ libraries that ship no binary (see the caveat above). Detection only; nothing is installed at this step.
190
+ 3. **Recommend only what is missing**, grouped **clean** (offer the Tier-1 one-paste block) vs **gated**
191
+ (surface the command, never run it). Never suggest anything on the AVOID list. If nothing is missing,
192
+ say so in one line.
193
+ 4. Write the state file so the harness never asks again in this folder:
194
+ ```json
195
+ { "checked": "<ISO date>", "present": ["gron", "pandoc"], "missing": ["mitmproxy"], "recommended": true }
196
+ ```
197
+
198
+ The state file is **host-local** (tools live on the machine, not the repo) — gitignore it in a shared
199
+ folder; delete it to force a fresh check after installing a batch. **This step never blocks a run.**
200
+
201
+ > **Maintenance loop.** When a run hits a capability wall — a format nothing on the host can read, a
202
+ > capture lane that needed a tool that was not listed, an install that failed in a new way — fold it back
203
+ > in here: the tool into the right tier with its ethics class, or the failure into the caveats. This file
204
+ > only stays useful if every new wall is recorded (the same loop `ingestion.md` §7.0 carries for redaction
205
+ > patterns).
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "@nurix/etna",
3
- "version": "0.19.41",
3
+ "version": "0.19.42",
4
4
  "description": "Bootstrap a project with a Nurix harness — copies the harness's CLAUDE.md, skills, agents, rules, and hooks directly into the project from a bundled payload (no marketplace fetch, no network).",
5
5
  "type": "module",
6
6
  "bin": {
@@ -41,5 +41,5 @@
41
41
  "agent",
42
42
  "plugin"
43
43
  ],
44
- "etnaFingerprint": "c96b6524c5e6"
44
+ "etnaFingerprint": "e47ee7aac58b"
45
45
  }