@polycode-projects/the-mechanical-code-talker 3.0.5 → 3.0.7

package/README.md

@@ -17,6 +17,30 @@ Teach it a fact in plain English and it mints a node. Ask it a question and
 it answers from what it was seeded with, what you taught it, and what it can
 derive by rule from both. Every answer is either grounded or an honest miss.
 
+## Repository layout
+
+| directory | contains |
+|---|---|
+| `bin/` | the CLI entrypoint (`tmct.mjs`) |
+| `src/` | the shipped product: `domain/` (pure logic), `adapters/` (I/O, storage, providers), `services/` (chat, adventure, research, ledger, plan), `surfaces/` (CLI, HTTP, TUI, web), `index/` (repo indexing) |
+| `corpus/` | committed corpus and template data (ConceptNet, WordNet, NameNet, the generated persona vocab) |
+| `data/` | seed data assets: sprites, phrasebook, games, response templates |
+| `ontology/` | the software ontology (`tmct-core.ttl`) and memory shapes, in Turtle |
+| `scripts/` | build, check, and maintenance scripts (`npm run` targets live here) |
+| `examples/` | runnable example scripts and fixture repos used by the README's own examples and the test suite |
+| `demo/` | standalone demo scripts (e.g. the agentic-loop demo) |
+| `electron/` | the Electron desktop app wrapper |
+| `docs/` | reference docs: the adapter/repository-interface contracts, bibliography |
+| `test/` | the unit, corpus, and estate-guard test suite (`npm test`) |
+| `test-e2e/` | the end-to-end suite: real CLI/TUI spawns and Playwright browser journeys (`npm run test:e2e`) |
+| `test-benchmarks/` | the benchmark harnesses (agentbench, chatbench, idxbench, infbench, ingestbench, researchbench, synthbench) and their shared `benchlib/` |
+| `reports/` | benchmark write-ups (`BENCHMARK_*.md`) and `PAGE_WEIGHTS.md` — see the root `STATUS.md` for the one-page summary these feed |
+| `playtests/` | numbered playtest session logs, one edge found and fixed per entry |
+| `archive/` | delivered `PLAN_*.md`/`BENCHMARK_*.md` docs, kept for history |
+| `public/` | the built demo site — a gitignored output of `npm run demo:build`, never hand-edited |
+
+`node_modules/` (dependencies) and dotfiles/hidden tooling directories are omitted above.
+
 ## Teach it, then ask it to reason
 
 This is real, runnable output. No cherry-picking, no model anywhere in the
@@ -227,7 +251,7 @@ resolves to a real graph traversal or declines cleanly:
   (*because/although/while*), conditionals, and false-premise flags ("why
   does X still import Y" when it no longer does).
 
-The full catalog with measured coverage lives in the `BENCHMARK_*.md`
+The full catalog with measured coverage lives in the `reports/BENCHMARK_*.md`
 reports.
 
 **Response finishing.** Before an answer prints, it is segmented into typed
@@ -1179,18 +1203,20 @@ service. The LLM agent stays outside tmct, as the no-LLM ethos requires.
 
 ## Measuring it
 
-What the 2.7.11/2.7.12 cycle measured, on 2026-07-19. Each figure links to its
-method and carries, in the same row, the caveat that changes what it means.
-The full tables, judge scores, and transcripts are in the linked write-ups.
+**For the latest measured numbers, see `STATUS.md`** — a one-page summary of the most
+recent full sweep, citing its source reports by name. What follows here is what the 2.7.11/2.7.12
+cycle measured, on 2026-07-19, kept for its own detail. Each figure links to its method and
+carries, in the same row, the caveat that changes what it means. The full tables, judge scores,
+and transcripts are in the linked write-ups.
 
 | What it does | Result (2.7.12) | Read the number with this | Method |
 |---|---|---|---|
-| Multi-hop entailment | 379/379 chat cases and 100/100 kernel cases, 0% fabrication, all bands pass | The case set is unchanged from 2.6.0 (same templates, same counts). The one real move this cycle is INF-4's ceiling-graded count dropping 35→30: five cases that now pass as genuine capability instead of against the declared honest-miss floor. | `BENCHMARK_INFERENCE_2.7.12.md` |
-| Tool-call planning | 68/68 cases, 100% plan-completion, 100% result-completion, 0% hallucination, every rung A0→C2 | Goal driver. 2.6.0 gated at TOOL-7 (62/66, 94%). This cycle's router uplift (a guarded RECOVER step, a tied-candidate composer) cleared it: a real capability move, not a ruler change. | `BENCHMARK_AGENT_2.7.12.md` |
-| Groundedness | Every answer carries a source, and an empty graph reports itself empty. Judge-scored mean 1.809/2 over 138 cases, 5 hard fails, 136/138 tier-1. | Judged (`claude-haiku-4-5-20251001`, `judge-prompt-v2`) at N=1. The judge prompt moved v1→v2 since 2.6.0, so this is a measurement, not a clean lever comparison against the prior cycle. The judge runs in the offline eval harness, never in the product. | `BENCHMARK_CEFR_ENGLISH_2.7.12.md` |
-| Abstention (the honest miss) | 0% fabrication across 479 inference rows (379 chat + 100 kernel) and 0% hallucination across 272 agent rows | Structural, not a tuned threshold. tmct abstains because nothing matched, so the rows test a property of a no-model design rather than a score. | `BENCHMARK_INFERENCE_2.7.12.md`, `BENCHMARK_AGENT_2.7.12.md` |
-| Determinism | Byte-identical on rerun: a 379-case `--replay` clean across 2 runs, no LLM, no network, $0 per turn | A property of the no-model pipeline. | `BENCHMARK_INFERENCE_2.7.12.md` |
-| Dialogue robustness (persona sweep) | A 6-persona sweep (textbook logician, casual newcomer, new developer, adversarial sceptic, returning user, planning user) fixed 25 of the prior cycle's 29 routed findings (21 clean, 4 with a residual noted); 4 remain broken, 2 in a shape distinct from the original complaint | Free exploration across all six personas surfaced roughly 60 fresh findings beyond the ratchet check. The single highest-signal pattern: tmct's own suggested repair text was itself frequently broken when followed verbatim (since fixed, see `NEXT.md`). | `BENCHMARK_CONVERSATION_2.7.11.md` |
+| Multi-hop entailment | 379/379 chat cases and 100/100 kernel cases, 0% fabrication, all bands pass | The case set is unchanged from 2.6.0 (same templates, same counts). The one real move this cycle is INF-4's ceiling-graded count dropping 35→30: five cases that now pass as genuine capability instead of against the declared honest-miss floor. | `archive/BENCHMARK_INFERENCE_2.7.12.md` |
+| Tool-call planning | 68/68 cases, 100% plan-completion, 100% result-completion, 0% hallucination, every rung A0→C2 | Goal driver. 2.6.0 gated at TOOL-7 (62/66, 94%). This cycle's router uplift (a guarded RECOVER step, a tied-candidate composer) cleared it: a real capability move, not a ruler change. | `archive/BENCHMARK_AGENT_2.7.12.md` |
+| Groundedness | Every answer carries a source, and an empty graph reports itself empty. Judge-scored mean 1.809/2 over 138 cases, 5 hard fails, 136/138 tier-1. | Judged (`claude-haiku-4-5-20251001`, `judge-prompt-v2`) at N=1. The judge prompt moved v1→v2 since 2.6.0, so this is a measurement, not a clean lever comparison against the prior cycle. The judge runs in the offline eval harness, never in the product. | `archive/BENCHMARK_CEFR_ENGLISH_2.7.12.md` |
+| Abstention (the honest miss) | 0% fabrication across 479 inference rows (379 chat + 100 kernel) and 0% hallucination across 272 agent rows | Structural, not a tuned threshold. tmct abstains because nothing matched, so the rows test a property of a no-model design rather than a score. | `archive/BENCHMARK_INFERENCE_2.7.12.md`, `archive/BENCHMARK_AGENT_2.7.12.md` |
+| Determinism | Byte-identical on rerun: a 379-case `--replay` clean across 2 runs, no LLM, no network, $0 per turn | A property of the no-model pipeline. | `archive/BENCHMARK_INFERENCE_2.7.12.md` |
+| Dialogue robustness (persona sweep) | A 6-persona sweep (textbook logician, casual newcomer, new developer, adversarial sceptic, returning user, planning user) fixed 25 of the prior cycle's 29 routed findings (21 clean, 4 with a residual noted); 4 remain broken, 2 in a shape distinct from the original complaint | Free exploration across all six personas surfaced roughly 60 fresh findings beyond the ratchet check. The single highest-signal pattern: tmct's own suggested repair text was itself frequently broken when followed verbatim (since fixed, see `NEXT.md`). | `archive/BENCHMARK_CONVERSATION_2.7.11.md` |
 
 Three offline benchmark rigs live in a clone (they are not in the npm
 package). Each replays a committed case set through the real product and
@@ -1208,10 +1234,10 @@ The smallest real slice of each, the same invocations the test suite's
 bench-smoke lane replays:
 
 ```bash cwd=repo
-node chatbench/run.mjs --stamp smoke --only g-a1-naming-1 --out /tmp/chatbench-smoke
-node infbench/generate-cases.mjs --out /tmp/infbench-cases.jsonl
-node infbench/run.mjs --cases /tmp/infbench-cases.jsonl --only inf-1-lookup-subClassOf-001 --stamp smoke --out /tmp/infbench-smoke
-node agentbench/run.mjs --stamp smoke --driver stub --only ab-a0-describe-widget --out /tmp/agentbench-smoke
+node test-benchmarks/chatbench/run.mjs --stamp smoke --only g-a1-naming-1 --out /tmp/chatbench-smoke
+node test-benchmarks/infbench/generate-cases.mjs --out /tmp/infbench-cases.jsonl
+node test-benchmarks/infbench/run.mjs --cases /tmp/infbench-cases.jsonl --only inf-1-lookup-subClassOf-001 --stamp smoke --out /tmp/infbench-smoke
+node test-benchmarks/agentbench/run.mjs --stamp smoke --driver stub --only ab-a0-describe-widget --out /tmp/agentbench-smoke
 ```
 
 Grading beyond tier 1 uses an LLM as judge. The offline eval harness is the
@@ -1229,7 +1255,6 @@ hardened:
 - CI runs **SAST and secret detection**.
 - A nightly **`npm audit` + OSV-Scanner** job watches dependencies.
 - Releases are published with **npm provenance** (`--provenance`).
-- A coordinated-disclosure `SECURITY.md` policy covers reports.
 
 The content-address hash is single-sourced in `src/domain/hash.mjs`, so the
 cross-version-stable fact-id contract has exactly one definition.
@@ -1291,7 +1316,7 @@ edition, the retrieval date, the terms tmct uses, and what could not be verified
 
 | source | edition | what tmct uses it for |
 |---|---|---|
-| Council of Europe, CEFR — Companion volume | 2020, ISBN 978-92-871-8621-8 | The band labels A1–C2 the chat benchmark grades against. CEFR measures what a *person* can do communicatively; grading the difficulty of *prompts* by band is tmct's adaptation, not a CEFR-validated use. The band descriptions in `chatbench/GRADED.md` are tmct's own prose. |
+| Council of Europe, CEFR — Companion volume | 2020, ISBN 978-92-871-8621-8 | The band labels A1–C2 the chat benchmark grades against. CEFR measures what a *person* can do communicatively; grading the difficulty of *prompts* by band is tmct's adaptation, not a CEFR-validated use. The band descriptions in `test-benchmarks/chatbench/GRADED.md` are tmct's own prose. |
 | Reiter, "On Closed World Data Bases" | *Logic and Data Bases*, Plenum, 1978, pp. 55–76 | Both halves of the honest miss. The planner's operator model is **closed-world**, which is what makes a plan checkable. The chat layer is **open-world**: it will not read "no matching rule" as "the answer is no". |
 | Chow, "On optimum recognition error and reject tradeoff" | *IEEE Trans. Information Theory* 16(1), 1970 | Prior art for the goal. The literature calls a refusal **abstention**, or selective prediction, and Chow's reject option is its root. Those methods threshold a confidence score; tmct has none, and abstains because nothing matched — which is why the row above names the mechanism. |
 | Ji et al., "Survey of Hallucination in Natural Language Generation" | *ACM Computing Surveys* 55(12), 2023 | Groundedness, and what tmct is avoiding by having no model to hallucinate with. |

package/bin/tmct.mjs

@@ -467,7 +467,7 @@ async function activatePluggableInput(repoRoot, resolved) {
   }
   if (resolved.manifestEntry) {
     // Preserve the ORIGINAL `--corpus <tier2-id>` wording byte-for-byte
-    // (e2e/init-cli.test.mjs asserts on this exact shape).
+    // (test-e2e/init-cli.test.mjs asserts on this exact shape).
     return `seeded tier-2 corpus "${resolved.manifestEntry.id}" (${resolved.manifestEntry.kind}) — ${seeded.appended} fact(s) added`
       + `${seeded.skipped ? `, ${seeded.skipped} already present` : ""}. Source: corpus/tier2/${resolved.manifestEntry.file} (${resolved.manifestEntry.license}). `
       + `Activated in tmct.toml — future \`tmct init\`/chat sessions seed it automatically.\n`;

package/corpus/child/README.md

@@ -20,7 +20,7 @@ Layout (mirrors corpus/reference/):
   budgets, the acceptance metrics, and a sha256 for every emitted file.
 - `LICENSE-NOTICE` — CC-BY-SA 4.0; read it before reusing these files.
 
-47267 terms, 93161 keyed facts. Built 2026-07-18.
+46883 terms, 92638 keyed facts. Built 2026-07-24.
 
 Predicates are already mapped into tmct's vocabulary
 (conceptnet-map.toml): `rdfs:subClassOf`, `mgx:capableOf`,
@@ -63,7 +63,7 @@ acceptance test — the plan's hand-counted baseline drifted once). Numbers belo
 are for this committed pack:
 
 ```
-Measured over this pack: 69620 facts
+Measured over this pack: 69140 facts
   kinds of bird            1881  [abbott's booby, abyssinian woodpecker, acadian flycatcher, accipiter, acorn woodpecker, acridotheres, acrocephalus, actitis, adélie penguin, african black duck, african cuckoo hawk, african finfoot, african fish eagle, african marsh harrier, african penguin, african pygmy goose, african sacred ibis, african skimmer, aix, akiapola au]
   capabilities on birds    71  [bird can attempt to fly, chicken can become food, bird can build nest, bird can call with chirps, bird can chirp, bird can eat grasshopper, bird can experience flight, bird can eye fish, bird can fall from sky, bird can fly, bird can fly high, bird can head south, bird can kill fish, bird can land on beach, bird can land on branch, bird can land on tree, bird can learn to fly, bird can listen to insect, bird can person's pet, bird can pet]
   things that can fly      39  [animals, ants, bat, bats, bats and birds, bee, beetles, bird, butterfly, doves, dragon, dragonfly, flies, frisbee, geese, gnat, goose, helicoptors, hoatzins, insects]

package/corpus/child/manifest.json

@@ -14,30 +14,30 @@
     "version": "5.7.0",
     "sha256": "accd65fe94038584295574ddc26e1500c1919c8c4532bf771811cafd0948af7e"
   },
-  "built": "2026-07-18",
+  "built": "2026-07-24",
   "pack": "conceptnet",
   "shardCount": 32,
   "counts": {
-    "terms": 47267,
-    "facts": 93161,
+    "terms": 46883,
+    "facts": 92638,
     "shards": 32
   },
   "budgets": {
     "facts": {
-      "used": 93161,
+      "used": 92638,
       "max": 120000
     },
     "shardsGzBytes": {
-      "used": 1104132,
+      "used": 1097302,
       "max": 3145728
     },
     "indexGzBytes": {
-      "used": 466600,
+      "used": 463262,
       "max": 716800
     }
   },
   "acceptance": {
-    "totalFacts": 69620,
+    "totalFacts": 69140,
     "kindsOfBird": {
       "count": 1881,
       "sample": [
@@ -136,8 +136,8 @@
   "files": [
     {
       "file": "index.json.gz",
-      "bytes": 466600,
-      "sha256": "8c5940d2f888841a89a6d891c034a357d9f568175610d7ba723d82c0b3789375"
+      "bytes": 463262,
+      "sha256": "cfe726d696e7a3bd37a33171943b4cbee79f6be38441f0ba8425b8e303c97076"
     },
     {
       "file": "LICENSE-NOTICE",
@@ -147,167 +147,167 @@
     {
       "file": "README.md",
       "bytes": 4728,
-      "sha256": "4bc27cc68ece52930fee4fc18fd65966ebdc1fe9e39d9c5497a579e9a7de7ebb"
+      "sha256": "b4a0916b8315b2276df7dc0c612136e241c8e24b3f4debbdbbce5ae4082a6de2"
     },
     {
       "file": "shards/child-00.jsonl.gz",
-      "bytes": 32103,
-      "sha256": "9ccb587b8bcbaf4cd250620b7455b347ad48632c9a74a58576ad53bea7661cba"
+      "bytes": 31885,
+      "sha256": "8fa0c70c391a7cd06262358fe32d52ac35d9e8ef40b976373f1b341cecf19758"
     },
     {
       "file": "shards/child-01.jsonl.gz",
-      "bytes": 33579,
-      "sha256": "72cc98f950493cd74c108275fc4fd2375673d4bb518ef5dc18a792e2e0dc4314"
+      "bytes": 33446,
+      "sha256": "7f33ec49bb0d1a33b1ed4e44d66609a72b88af16d48f7ccb354e2936af042081"
     },
     {
       "file": "shards/child-02.jsonl.gz",
-      "bytes": 39506,
-      "sha256": "66509505127314f56ba97d91bf8eb16f8041e79372967686fe4bd12f7836fa12"
+      "bytes": 39355,
+      "sha256": "56d731fad9aabc630c7d8794424513f99f4abbde84580f24a0aad6cbd6d57a73"
     },
     {
       "file": "shards/child-03.jsonl.gz",
-      "bytes": 31952,
-      "sha256": "718cf034eea6eedd8dfa28308b88707b783188096740493cfe9dcc2fc099715c"
+      "bytes": 31745,
+      "sha256": "b14ddc87a2fe7434701e8ada94673d9b20b2c0ccceb00e49168a33f198cadfce"
     },
     {
       "file": "shards/child-04.jsonl.gz",
-      "bytes": 33426,
-      "sha256": "789c98cac46582609bd0f8fe10714992b6142845ceef7595d1344817b3828a22"
+      "bytes": 33202,
+      "sha256": "7890d1a63601132a9fd1054a8b088065bd41d9e2a26ab908582b1858beae0c36"
     },
     {
       "file": "shards/child-05.jsonl.gz",
-      "bytes": 35162,
-      "sha256": "76145b77126d0ad589de1024036d56e363a205ae1d214407f377328adbb78e38"
+      "bytes": 34872,
+      "sha256": "0bb756c6e78d598a31fe7c57385785c26f7f7ddbab16f3a5143f715cfff76fb1"
     },
     {
       "file": "shards/child-06.jsonl.gz",
-      "bytes": 36407,
-      "sha256": "2eef507004137e8ce92d56e043e8c5e4065c9a03ae00022422ee36fbd3cfcbba"
+      "bytes": 36268,
+      "sha256": "bd150f3d13b0519cb97155657bd5edac4860b338d988db7c05c74e2d6b9dc440"
     },
     {
       "file": "shards/child-07.jsonl.gz",
-      "bytes": 33893,
-      "sha256": "9a889f73e18a800725333df87702642d658a442e5b957dfb40eb7c70127ae5cc"
+      "bytes": 33641,
+      "sha256": "797a5dd7a575c633ebae145b6811750b401f527e558b034d84761e9e8fa08df8"
     },
     {
       "file": "shards/child-08.jsonl.gz",
-      "bytes": 34136,
-      "sha256": "d8bb02bcc35d0303178f296ca47251fe0133227553b806ebda459377fdd57fcd"
+      "bytes": 34071,
+      "sha256": "2c39d8f05e5246a26efe84a479484f992a49eb2125d82ad01ad94c49e2a9a573"
     },
     {
       "file": "shards/child-09.jsonl.gz",
-      "bytes": 35965,
-      "sha256": "7d86341fedf002c8838bccd766e425b0a67f502d031fd53d4e07f1c6f12aa19f"
+      "bytes": 35865,
+      "sha256": "9d8363f3c04cfe80643b2c1e1cd4222544c8e80c347ea0042789df7b752287f8"
     },
     {
       "file": "shards/child-0a.jsonl.gz",
-      "bytes": 34735,
-      "sha256": "206a813208895488b15f4b57ae142472b23eedc98337c1960bc002247ab1ec19"
+      "bytes": 34618,
+      "sha256": "17a5cd9946fc6a19f69e51277f9486c92c8d43e3953439580adf71e90736376d"
     },
     {
       "file": "shards/child-0b.jsonl.gz",
-      "bytes": 32343,
-      "sha256": "13e94bddc1c1dfadb3d15f3cf437f8bc6fdee4aba34e146f855b592dfc3cb29e"
+      "bytes": 31978,
+      "sha256": "f447a23e7e3191f5247a0d2cbfc187ba707f347d4fca01c4fedd3ef6446e1996"
     },
     {
       "file": "shards/child-0c.jsonl.gz",
-      "bytes": 32843,
-      "sha256": "5004d2abe2a52616bad4b7b55989f3d4feea8c6bb156154be700d6d5102fc1a4"
+      "bytes": 32540,
+      "sha256": "d333ca1ca7167fa22f8af37fd0a493e735ff5b993f76d8f8d975c1f9bf2ef188"
     },
     {
       "file": "shards/child-0d.jsonl.gz",
-      "bytes": 33100,
-      "sha256": "fb16a8d7812e93f5d7b54792ae376f424c03cb67bb38205e9a352fd3761f862e"
+      "bytes": 32826,
+      "sha256": "f52920d032e74322750dd6420e6dc8cea57a023a515b81b7f77ade63e25e952d"
     },
     {
       "file": "shards/child-0e.jsonl.gz",
-      "bytes": 37434,
-      "sha256": "34ed35347c1e05d662791f547dc487a1ea106a144c6722105249113ae17144e0"
+      "bytes": 37216,
+      "sha256": "55688d2f5233345816403611cd9e9e9990a5566b1df08c061529bfa8fcf89575"
     },
     {
       "file": "shards/child-0f.jsonl.gz",
-      "bytes": 33042,
-      "sha256": "128fe45227c40a020b017d62ed267bbbc537308903a637bed7e3a730c77167a5"
+      "bytes": 32817,
+      "sha256": "f767faeb048dab56a018e1a547a8063b1bd907b256b8110f56b6da3b58c3a5a6"
     },
     {
       "file": "shards/child-10.jsonl.gz",
-      "bytes": 36325,
-      "sha256": "f464aa705b6f805e939d8b755e1b7459dfa1567d227d42fbb45966cca77911b2"
+      "bytes": 36194,
+      "sha256": "bd90001e185c2b84239d7362ad7765593c7f94fb422f60a35a86bb9330903f12"
     },
     {
       "file": "shards/child-11.jsonl.gz",
-      "bytes": 37037,
-      "sha256": "9d42260cd01eb000bfd05f3589162e02b473a8e0d67153164f6309a64161af1c"
+      "bytes": 36842,
+      "sha256": "f5a603e3290b29a463af799258838ec692933db492a0d372dd2dab32bbdc3868"
     },
     {
       "file": "shards/child-12.jsonl.gz",
-      "bytes": 34979,
-      "sha256": "007e234d9ef074bbf2ca01e974b78cf92275c395709d8ceca4f9143610db8a35"
+      "bytes": 34716,
+      "sha256": "daba6bd6859ded6d016418a01fe89699803b87d5f1629cd2ebca5e7fc97cb3f4"
     },
     {
       "file": "shards/child-13.jsonl.gz",
-      "bytes": 35807,
-      "sha256": "61157570ac6a5744c12852f8f918315efc388c099ca931f4ddd51ed7a968fd15"
+      "bytes": 35643,
+      "sha256": "914501ada0aa3cdd959603ec095597bed731b649e5c26477f390b3db4f8db93f"
     },
     {
       "file": "shards/child-14.jsonl.gz",
-      "bytes": 34486,
-      "sha256": "c06be6bfc64cfeb385b2e6654813b3bafc885242ff67157ef36f3cb319603fdf"
+      "bytes": 34171,
+      "sha256": "343285630b15e1b5a221dcc23770d2430c366ef320429f6ff38ef64e9c1b338b"
     },
     {
       "file": "shards/child-15.jsonl.gz",
-      "bytes": 35086,
-      "sha256": "684f17882e97c9a00008d7601ebce936e9acadea655ae79a84ade493db071da1"
+      "bytes": 34878,
+      "sha256": "8541b35ca94f56f49c58abcf99dbeaff5a576aaba11802fb9851239daee07b2f"
     },
     {
       "file": "shards/child-16.jsonl.gz",
-      "bytes": 36486,
-      "sha256": "a730cd4e15f0dd221a0b1de8a4f7d675dfb51aa330d4f5bd5d31362eb3261e04"
+      "bytes": 36348,
+      "sha256": "54139274ab7d073126f9bec37cc02c67fbaf41b62aa507c487096d98168966a8"
     },
     {
       "file": "shards/child-17.jsonl.gz",
-      "bytes": 35087,
-      "sha256": "f3aede1ef18acc53e96791eb05511ce7cd1e9fadc78901913026350c26ddb40a"
+      "bytes": 34902,
+      "sha256": "2874b45a1dc8dc829f960f9fafa05b15d7b8b5801cccdf9e490242c830466e93"
     },
     {
       "file": "shards/child-18.jsonl.gz",
-      "bytes": 33768,
-      "sha256": "ba858cd656f5e27c5a6afaf47d1932eb12a568abe24ab88103eea043051320ac"
+      "bytes": 33492,
+      "sha256": "e248f9137d314573917469b958bfbb1d3e6393feae119488976d9ce32d9707bf"
     },
     {
       "file": "shards/child-19.jsonl.gz",
-      "bytes": 35857,
-      "sha256": "30ab1d0dfb61decd5d43e7f30e5a7d35e4360d3fa4b8de2e2792d213fe0fa040"
+      "bytes": 35739,
+      "sha256": "f84e5b6584d5e46bb5566a39ba941c71e293ed9f8cc83f0eb627eff6dfddd32b"
     },
     {
       "file": "shards/child-1a.jsonl.gz",
-      "bytes": 32457,
-      "sha256": "835831e995b3457de2420e6980b4d32dd8dedeefeccfa9ad8437b709d7615260"
+      "bytes": 32215,
+      "sha256": "f59bc66d6b5dfe8c50e95636098c15afa2430c4bc1973a2a71855b41e87c191e"
     },
     {
       "file": "shards/child-1b.jsonl.gz",
-      "bytes": 33232,
-      "sha256": "cc703f2de00ce184271d75c54c199df6d0de5628386458001c97b1e440b2ff35"
+      "bytes": 32942,
+      "sha256": "0ab7e4649c448ef556b54384575ffdd112877444969f7634b4f6c5195b08ccce"
     },
     {
       "file": "shards/child-1c.jsonl.gz",
-      "bytes": 34490,
-      "sha256": "92ed3c10f60d74c5273734c3dd200977be3902c2afb2d53932e41419585ae1fa"
+      "bytes": 34145,
+      "sha256": "336e70ce7e06d55fbf97b306a65f817e424b5c0beada5921013d1b8fc80f43a4"
     },
     {
       "file": "shards/child-1d.jsonl.gz",
-      "bytes": 32293,
-      "sha256": "a02fd0b0c3167fd8ce2209338ca90700e48a133c0d7b169d7c5c87bdd85778ee"
+      "bytes": 31999,
+      "sha256": "880b79cff62cf3a3a1b8cc9f1a6c45c5a3e9dd5b88893740a59bd1574a6ba0a9"
     },
     {
       "file": "shards/child-1e.jsonl.gz",
-      "bytes": 32991,
-      "sha256": "bd631352a9abdc46fc4a2d79c0134bbbd235b4dc6cc5a6af598b21aaec1d7e55"
+      "bytes": 32844,
+      "sha256": "ddefecf98f3d44a41e0899db9794be105a509ffae02e56d2b83dc5c47819fba0"
     },
     {
       "file": "shards/child-1f.jsonl.gz",
-      "bytes": 34125,
-      "sha256": "23e47bef6b0c9e7671155b59a117e5c94701ea38665a602af024fbf1f443143d"
+      "bytes": 33887,
+      "sha256": "2b5abd6c51d20eedbba38c65e0679aea9842ba9f28ae4fb7b76cfabac1643301"
     }
   ]
 }

package/corpus/conceptnet/quality-filter.mjs

@@ -23,13 +23,19 @@
 //   3. sentence fragment     — bare term is >= 4 underscore-words on EITHER
 //                              endpoint ("taloned_grip_of_owl",
 //                              "worlds_largest_interconnected_network_of_networks")
-//   4. definitional phrase   — /r/DefinedAs whose object is >= 3 words
+//   4. trailing-preposition fragment — bare term is a 2-3 underscore-word
+//                              endpoint whose LAST word is a preposition
+//                              ("pot_in") — a truncated crowd-sourced
+//                              prepositional-phrase fragment, not a concept
+//   5. known misspelling     — bare endpoint is in a small, hand-curated
+//                              KNOWN_MISSPELLINGS set ("vessle")
+//   6. definitional phrase   — /r/DefinedAs whose object is >= 3 words
 //                              (real DefinedAs is a synonym: cpu->processor)
-//   5. opinion object        — /r/IsA or /r/DefinedAs whose object is one of a
+//   7. opinion object        — /r/IsA or /r/DefinedAs whose object is one of a
 //                              small, evidence-based OPINION set (adjectives /
 //                              value words that never name a class)
 //
-// Rules 1-3 apply to every relation (they only ever remove junk); 4-5 are the
+// Rules 1-5 apply to every relation (they only ever remove junk); 6-7 are the
 // definitional band the sims flagged. Stats land on stderr; JSONL on stdout.
 
 import { readFile, writeFile } from "node:fs/promises";
@@ -46,6 +52,19 @@ export const OPINION_OBJECTS = new Set([
   "elegance", "evil", "gloom", "unreality", "universalism", "dumb", "free", "junk",
 ]);
 
+// A short, closed preposition set. A 2-3 underscore-word endpoint ending in
+// one of these ("pot_in") is a truncated crowd-sourced prepositional-phrase
+// fragment, not a standalone concept.
+const TRAILING_PREPOSITIONS = new Set(["in", "on", "at", "of", "for", "with", "to", "from", "by"]);
+
+// Evidence-based: crowd-sourced misspellings seen in the committed slice.
+// Kept explicit (not a spellcheck dependency — wink-nlp carries no spellcheck
+// signal, so a general heuristic here would risk cutting a legitimate but
+// unfamiliar word) so it never cuts anything but a confirmed typo.
+export const KNOWN_MISSPELLINGS = new Set([
+  "vessle",
+]);
+
 /** Why this row is noise, or null to keep it. Pure function of the row shape. */
 export function cutReason(row) {
   const s = bareTerm(row.start);
@@ -53,7 +72,12 @@ export function cutReason(row) {
   for (const t of [s, e]) {
     if (/^\d+$/.test(t)) return "numeric-endpoint";
     if (t.length <= 1) return "single-char-endpoint";
-    if (words(t) >= 4) return "sentence-fragment";
+    const parts = t.split("_").filter(Boolean);
+    if (parts.length >= 4) return "sentence-fragment";
+    if (parts.length >= 2 && parts.length <= 3 && TRAILING_PREPOSITIONS.has(parts[parts.length - 1])) {
+      return "trailing-preposition-fragment";
+    }
+    if (KNOWN_MISSPELLINGS.has(t)) return "known-misspelling";
   }
   if (row.rel === "/r/DefinedAs" && words(e) >= 3) return "definitional-phrase";
   if ((row.rel === "/r/IsA" || row.rel === "/r/DefinedAs") && OPINION_OBJECTS.has(e)) return "opinion-object";