@polycode-projects/the-mechanical-code-talker 1.5.4 → 1.8.3

package/corpus/README.md

@@ -39,6 +39,9 @@ loudly instead of seeding garbage.
 | `tier2/manifest.json` | tier-2: index of specialised corpuses (id, kind, description, source, sha256, size) | — | MPL-2.0 |
 | `tier2/generate.mjs` | tier-2: the curated-corpus generator + manifest writer (+ opt-in network-fetch path) | — | MPL-2.0 |
 | `tier2/{aws,python,java,general}.jsonl` | tier-2 SAMPLE corpuses — same fact shape as the tier-1 slice, loadable via the same path (`general` is the one deliberately non-code-domain bundle) | ~4-6 KB each | MPL-2.0 |
+| `tier2/human.jsonl` | the DEFAULT active bundle (archive/PLAN_SEED.md): the everyday "human-world" persona, Small tier (664 facts) — hand-curated from Open English WordNet, bridged to Schema.org's top-level classes (archive/PLAN_SEED.md §3, §8) | ~80 KB | MPL-2.0 (hand-authored fact set; not a verbatim WordNet/Schema.org excerpt — see `tier2/generate.mjs`'s own header comment) |
+| `tier2/human-medium.jsonl` / `tier2/human-large.jsonl` | SIZE tiers of the SAME `human` bundle (archive/PLAN_SEED.md §3) — each holds ONLY the facts that size adds beyond the previous one; both shipped INACTIVE by default, activated via `tmct init --persona-size medium\|large`. Built by `scripts/build-persona-tiers.mjs` from the same WordNet source, automatically curated (sense-ranked, blocklist/denylist-filtered) rather than hand-typed one at a time, given the scale (944 / ~12,000 facts) | ~111 KB / ~1.4 MB | MPL-2.0 (same "hand-authored in homage to the source's shape" basis as `human.jsonl`) |
+| `tier2/human-examples.jsonl` / `tier2/human-examples-medium.jsonl` / `tier2/human-examples-large.jsonl` | the example-sentence corpus (archive/PLAN_SEED.md §9) — real natural-language sentences mapped to the same curated vocabulary, NOT fact triples. Small/Medium tiers are 100% WordNet's own inline `example:` field (same CC-BY-4.0 basis as the fact bundles). Large tier ALSO includes a SemCor-filtered supplement (real Brown Corpus text, re-tagged to modern OEWN senses) for categories where WordNet's own inline coverage is thin (`human-nature` especially — `noun.animal.yaml`'s inline rate is under 1%, archive/PLAN_SEED.md §9's own measurement) | ~11 KB / ~43 KB / ~257 KB | **The WordNet-inline entries**: CC-BY-4.0 (Princeton WordNet + Open English WordNet team), reproduced verbatim (these ARE the source's own example sentences, not a paraphrase). **The `source: "semcor:…"` entries**: CC-BY-4.0 per this SemCor fork's own `LICENSE.md` (`~/projects/globalwordnet/semcor/`, real Brown Corpus text re-tagged to modern senses — the original 1960s Brown Corpus permissions aren't independently re-verified beyond that fork's own license statement; proceeding with attribution was an explicit operator decision, archive/PLAN_SEED.md §9) — each entry's own `source` field names its origin file (`semcor:<genre>/<file>.yaml`) for exactly this reason |
 
 And alongside (same phase, different directory because it is tmct-original
 data, not a derived corpus):

package/corpus/generated/README.md

@@ -0,0 +1,43 @@
+# corpus/generated/ — mechanically-generated ACE surface variants
+
+`ace-surface-variants.jsonl` — PLAN_BREADTH_FIRST_NLU.md §6a's raw material for
+tmct's "richer template/surface-realization variety" goal. Never an LLM, never
+invented text: every row is a real seed sentence with one word swapped for a
+real WordNet synset sibling, or a real sentence's alternate ACE-grammar-
+declared surface form. Every row is self-verified — it re-parses against
+tmct's own `parseAce` (`src/grammar/ace.mjs`) before being written; a swap
+that doesn't re-parse is dropped, never committed.
+
+Regenerate: `node scripts/generate-template-variants.mjs`. Coverage
+measurement: `node scripts/template-coverage.mjs` (baseline) and
+`node scripts/template-coverage.mjs --rescue corpus/generated/ace-surface-variants.jsonl`
+(after). See `archive/PLAN_TEMPLATE_COVERAGE.md` for the design and the real
+before/after numbers.
+
+## Row shapes
+
+| `kind` | What | Fields |
+|---|---|---|
+| `rescue` | A real docs-corpus sentence that almost fit the ACE grammar (exactly one undeclared word), rescued by substituting a WordNet synonym of that word that's ALSO already declared in `src/grammar/lexicon-core.json` | `sentence`, `rescued`, `from`, `to`, `pos`, `synsetId`, `sourceFile` |
+| `variant` | A real WordNet/SemCor example sentence (`corpus/tier2/human-examples*.jsonl`) that already hits `parseAce`, with one content word swapped for a same-synset sibling (both ends independently declared in tmct's own lexicon) | `seed`, `generated`, `from`, `to`, `pos`, `synsetId`, `sourceCorpus` |
+| `alt-phrasing` | A possessive-pattern (#7) hit rewritten in the ACE grammar's OTHER declared surface form for the same triple (`"X's Y is Z"` <-> `"the Y of X is Z"`, both routed through `buildPossessive` in `src/grammar/ace.mjs`) | `seed`, `generated`, `pattern`, `form` |
+
+Every row also carries `provenance` (`wordnet:<synsetId>` or
+`grammar:ace.mjs pattern 7 (possessive) — …`).
+
+## Not wired into the product path
+
+This corpus is not loaded by `src/chat.mjs`/`src/ask.mjs` or any other
+product code — it is committed raw material, verified by
+`scripts/template-coverage.mjs`, per PLAN_BREADTH_FIRST_NLU.md §6's explicit
+non-goal. Wiring it into live answer rendering is a separate, future phase.
+
+## Licence
+
+Open English WordNet content (synset `members`/`example` fields) is
+CC-BY-4.0; SemCor-derived sentences (`corpus/tier2/human-examples-large.jsonl`)
+are CC-BY-4.0 per that fork's own `LICENSE.md` (same basis `corpus/README.md`
+already documents for that file). A `variant`/`rescue` row is a one-word
+derivative of that material — CC-BY-4.0. An `alt-phrasing` row is a pure
+grammar-level rephrasing of the same source sentence — CC-BY-4.0 also, no new
+creative content introduced either way.

package/corpus/generated/ace-surface-variants.jsonl

@@ -0,0 +1,17 @@
+{"kind":"variant","seed":"the ace of trumps is a sure winner","generated":"the one of trumps is a sure winner","from":"ace","to":"one","pos":"noun","synsetId":"13764713-n","sourceCorpus":"corpus/tier2/human-examples-large.jsonl","provenance":"wordnet:13764713-n"}
+{"kind":"variant","seed":"the ace of trumps is a sure winner","generated":"the single of trumps is a sure winner","from":"ace","to":"single","pos":"noun","synsetId":"13764713-n","sourceCorpus":"corpus/tier2/human-examples-large.jsonl","provenance":"wordnet:13764713-n"}
+{"kind":"variant","seed":"the ace of trumps is a sure winner","generated":"the unity of trumps is a sure winner","from":"ace","to":"unity","pos":"noun","synsetId":"13764713-n","sourceCorpus":"corpus/tier2/human-examples-large.jsonl","provenance":"wordnet:13764713-n"}
+{"kind":"variant","seed":"the ace of trumps is a sure winner","generated":"the ace of trumps is a sure victor","from":"winner","to":"victor","pos":"noun","synsetId":"10802616-n","sourceCorpus":"corpus/tier2/human-examples-large.jsonl","provenance":"wordnet:10802616-n"}
+{"kind":"variant","seed":"the piece has a fast rhythm","generated":"the piece has a fast beat","from":"rhythm","to":"beat","pos":"noun","synsetId":"07100710-n","sourceCorpus":"corpus/tier2/human-examples-large.jsonl","provenance":"wordnet:07100710-n"}
+{"kind":"variant","seed":"the quality of mercy is not strained","generated":"the quality of mercifulness is not strained","from":"mercy","to":"mercifulness","pos":"noun","synsetId":"01073335-n","sourceCorpus":"corpus/tier2/human-examples-large.jsonl","provenance":"wordnet:01073335-n"}
+{"kind":"variant","seed":"the purpose of art is the arousal of emotions","generated":"the intent of art is the arousal of emotions","from":"purpose","to":"intent","pos":"noun","synsetId":"05991037-n","sourceCorpus":"corpus/tier2/human-examples-large.jsonl","provenance":"wordnet:05991037-n"}
+{"kind":"variant","seed":"the purpose of art is the arousal of emotions","generated":"the intention of art is the arousal of emotions","from":"purpose","to":"intention","pos":"noun","synsetId":"05991037-n","sourceCorpus":"corpus/tier2/human-examples-large.jsonl","provenance":"wordnet:05991037-n"}
+{"kind":"variant","seed":"the purpose of art is the arousal of emotions","generated":"the aim of art is the arousal of emotions","from":"purpose","to":"aim","pos":"noun","synsetId":"05991037-n","sourceCorpus":"corpus/tier2/human-examples-large.jsonl","provenance":"wordnet:05991037-n"}
+{"kind":"variant","seed":"the purpose of art is the arousal of emotions","generated":"the design of art is the arousal of emotions","from":"purpose","to":"design","pos":"noun","synsetId":"05991037-n","sourceCorpus":"corpus/tier2/human-examples-large.jsonl","provenance":"wordnet:05991037-n"}
+{"kind":"variant","seed":"the moral of the story is to love thy neighbor","generated":"the lesson of the story is to love thy neighbor","from":"moral","to":"lesson","pos":"noun","synsetId":"06618397-n","sourceCorpus":"corpus/tier2/human-examples-large.jsonl","provenance":"wordnet:06618397-n"}
+{"kind":"variant","seed":"the moral of the story is to love thy neighbor","generated":"the moral of the narration is to love thy neighbor","from":"story","to":"narration","pos":"noun","synsetId":"07235754-n","sourceCorpus":"corpus/tier2/human-examples-large.jsonl","provenance":"wordnet:07235754-n"}
+{"kind":"variant","seed":"the moral of the story is to love thy neighbor","generated":"the moral of the tale is to love thy neighbor","from":"story","to":"tale","pos":"noun","synsetId":"07235754-n","sourceCorpus":"corpus/tier2/human-examples-large.jsonl","provenance":"wordnet:07235754-n"}
+{"kind":"variant","seed":"the moral of the story is to love thy neighbor","generated":"the moral of the story is to love thy neighbour","from":"neighbor","to":"neighbour","pos":"noun","synsetId":"10372030-n","sourceCorpus":"corpus/tier2/human-examples-large.jsonl","provenance":"wordnet:10372030-n"}
+{"kind":"alt-phrasing","seed":"the ace of trumps is a sure winner","generated":"trumps's ace is a sure winner","pattern":"possessive","form":"apostrophe","provenance":"grammar:ace.mjs pattern 7 (possessive) — both surface forms route through buildPossessive"}
+{"kind":"alt-phrasing","seed":"the quality of mercy is not strained","generated":"mercy's quality is not strained","pattern":"possessive","form":"apostrophe","provenance":"grammar:ace.mjs pattern 7 (possessive) — both surface forms route through buildPossessive"}
+{"kind":"alt-phrasing","seed":"the purpose of art is the arousal of emotions","generated":"art's purpose is the arousal of emotions","pattern":"possessive","form":"apostrophe","provenance":"grammar:ace.mjs pattern 7 (possessive) — both surface forms route through buildPossessive"}

package/corpus/generated/manifest.json

@@ -0,0 +1,9 @@
+{
+  "version": 1,
+  "generated": "by scripts/generate-template-variants.mjs",
+  "file": "ace-surface-variants.jsonl",
+  "rows": 17,
+  "bytes": 4774,
+  "sha256": "5364415f73f7a366371f1fdcc072b5059f81871ef48b106088f05b1441def569",
+  "license": "CC-BY-4.0 (WordNet-derived synonym substitutions of Open English WordNet / SemCor example sentences and this repo's own MPL-2.0 docs prose — see corpus/generated/README.md)"
+}