@polycode-projects/the-mechanical-code-talker 0.8.1 → 0.9.0

package/README.md

@@ -42,6 +42,20 @@ is refused outright). Reversible-passive questions traverse the right direction:
 "what is imported by Y" and "what does Y import" are understood as opposite
 edges, not the same one.
 
+**Finding by description.** "find me the payment class" searches by type and a
+fuzzy match against the entity's own properties, instead of making you name it
+exactly. It checks the type itself and its subclasses first. Only if nothing
+matches there does it widen to a related type, and when it does, it says so
+plainly rather than presenting the looser match as exact.
+
+**Synonyms and everyday phrasing.** tmct matches many of the words people
+actually use for the same idea, from a curated synonym list plus a filtered
+ConceptNet slice. A slightly different word for the same concept still
+resolves. It also follows a few common sentence shapes: clauses starting with
+*because/although/while*, and conditionals ("if X were removed, what
+breaks"). It flags a question whose premise doesn't hold, too: "why does X
+still import Y" when it no longer does.
+
 **Response finishing.** Before an answer is printed it is segmented into typed
 spans — prose versus *protected* entities, paths, numbers, code, provenance, and
 receipts — and a small data-driven grammar pass runs on the prose spans only,

package/ROADMAP.md

@@ -12,43 +12,98 @@ mapped into them (item numbers retained for traceability); the seven sketches
 formerly held in `code-talker-ideas.txt` are folded into items 8–11 below and
 the file has been deleted.
 
-## Where we are now (2026-07-06)
-
-**Built: v0.8.1 — Phase 11 deepened (0.8.0 shipped + published; 0.8.1 push held for the operator).**
-`npm test` green (**916**). 0.8.1 hardened the router with real *reasoning* measurement and closed the
-frontier stages, all under the same demonstrated-vs-designed honesty discipline:
-
-- **AGENTBENCH now grades the executed composed RESULT, not just the call-plan** (retires the headline
-  0.8.0 caveat). Under result-grading the resolver is **97% plan / 91% result / 0% hallucination**; the
-  honest gap lands exactly where reasoning is hard (C1, C2).
-- **Stage 5 — the C2 goal-reasoner** (BDI + Goal-Driven Autonomy) genuinely lifts result-completion.
-  The honest, **like-for-like** figure is the *driver swap on the identical 39-case ladder*
-  (`AGENTBENCH_0.8.1_001`): resolver **85% → goal-reasoner 95% result** (+10pp, purely the driver, 0%
-  hallucination). C2 is **cleared for one declared coverage-invariant goal-rule** — real and
-  phrasing-robust (validated by held-out phrasings graded blind, no request-string literals), but
-  **thinly sampled, not rule-general**; the open-world case is honestly **refused**. *(NB: the
-  cross-release "0→83% C2" reads on a grown 6-case C2 ladder whose 4 new cases exercise the
-  goal-reasoner — not a like-for-like rate; the same-basket win is one case fixed, 0→50% original C2.)*
-- **Stage 2 — imperative intent frames + ACE reach** (`AGENTBENCH_0.8.1_002`, goal driver): **100% plan
-  / 95% result / 0% hallucination**. `tmct_calls` is now **genuinely NL-reachable** via a distinct
-  edge-dump frame (not by un-tagging — bidirectional conformance enforces it; `NOT_NL_REACHABLE` is now
-  `{}`). ACE is wired **async** into the interpret pipeline so the synchronous CHATBENCH parse spine is
-  **byte-identical** — ACE is inert in the shipped product path (`interpret()` is called nowhere in
-  chat/ask/server/bin), reach without regression.
-- **Chat surface (CHATBENCH_0.8.1):** quick wins (singular "what is a test", friendly commit-author
-  refs, "No tests cover X" honest-empty, the chatbench discourse-count flake root-caused + scrubbed) +
-  two playtests (coverage-survey + authorship routing; **6 frozen `chatflow-*` transcripts** total).
-  Joint deterministic CHATBENCH (both new frame tables together): **no tier-1 regression vs 0.7.1.**
-  Judged tags touched by the text changes were re-judged (not blanket-reused) — see `CHATBENCH_0.8.1`.
-
-**Shipped earlier in v0.8.0 (published):** all five Phase-11 tracks — the `/v1/messages` shim + Stage-0
-registry + resolver/guardrail/planner (`AGENTBENCH_0.8.0_001`: 96% *plan* completion, 0% hallucination,
-closed-world C1); the three chat levers (`CHATBENCH_0.8.0`: tier-1 331→333); the `../bedrock-meter` `$0`
-rung (rank 0 below nova-micro, £0 metered e2e); the playtest; and the Stage-2/Stage-5 research notes.
-
-**Next:** grow the thin C2/coverage sampling to a second goal-rule; author→commit querying (a dead-end
-the friendly-commit-ref quick win opened); AGENTBENCH ladder depth; the tier-4/tier-5 Phase LATER long
-tail. See Phase 11 below and `HANDOVER.md` for the full open-follow-up list.
+## Where we are now (2026-07-07)
+
+`npm test` green (**1033**). A version bump to reflect this session's wave is imminent; see
+`HANDOVER.md` for the exact release status.
+
+### Now: shipped this session
+
+- **5 bugs fixed.** Recall half-match replay + staple-onto-wall; 4 wall-kindness gaps (orientation
+  blurb repeat, "thanks, `<clause>`" walls, a reexports vocabulary leak, `/describe` not surfacing
+  taught facts); grain-aware entity resolution (fixes the fuzzy-entity false-empty and a
+  function/module coverage contradiction); module-grain overview gap. Full list in `HANDOVER.md`.
+- **A new feature: predicate-based "find" queries.** "find me the payment class" now works:
+  type-filtered, fuzzy property-surface matching, with a narrow-then-broaden inheritance-aware
+  cascade and a boolean-fold generalization for compositional predicate queries. Design:
+  `PLAN_PREDICATE_QUERIES.md`.
+- **Two research tracks landed as code.** The ontology plan's two inert synonym resources
+  (ConceptNet synonym/similar-to rows, phrasebook synonym families) are now wired into query-time
+  matching, and the disjointness premise set plus numeric vocabulary grew
+  (`PLAN_ontology-hierarchies.md`). The advanced-grammar plan's closed-frame subordination and
+  conditional support, plus presupposition honest-nudges, landed (`PLAN_ADVANCED_GRAMMAR.md`); the
+  graded pool grew 925 to 1075 cases across 6 new construction families (`chatbench/GRADED.md`).
+- **A new benchmark: infbench.** A 6-band classical-logic ladder (INF-A1..C2), mechanically
+  generated, first baseline in `INFBENCH_0.8.2.md`. Kernel A1/A2 clean; chat A1 100%, A2 exactly
+  50% (the cax-sco gap, now measured). The ladder gates at B1 (33%) because the disjointness proof
+  rule doesn't exist yet.
+- **A new demo** (`demo/agentic-loop-demo.mjs`) shows the zero-LLM deduce-plan-execute-compose loop
+  end to end, and surfaced a real goal-reasoner honesty gap (Bug 8, below).
+- **A session-loop fix.** A throwing turn no longer aborts a piped/non-interactive session.
+- **4 new plan docs.** `PLAN_ontology-hierarchies.md`, `PLAN_INFERENCE_TESTING.md` (revised so
+  infbench generation is mechanical, not hand-authored), `PLAN_PREDICATE_QUERIES.md`, and
+  `PLAN_CODE.md` (new, program synthesis over tmct's closed DSLs, gated on explicit operator
+  sign-off per track, not built yet).
+
+### Next: the open follow-ups
+
+In priority order (full detail and measured targets in `HANDOVER.md`):
+
+1. **Bug 8.** The goal-reasoner's global-mode deduction answers requests unrelated to any deduced
+   goal with false confidence, once no focus entity binds (`src/router/goal-reasoner.mjs:226`).
+   The most serious open issue: a genuine confident-wrong failure in the flagship
+   zero-hallucination capability. Needs a real semantic gate.
+2. **Bug 6.** Scoped listing false-empty: "list modules in `<pkg>`" returns empty though the
+   unscoped lister shows matches. Found dogfooding a 191k-entity monorepo graph.
+3. **Bug 7.** A modal auxiliary ("should") survives the fuzzy-correction cascade and misreads as
+   "hold". The diagnosed fix is adding modals to `STOPWORDS`.
+4. **`PLAN_TMCT_ECOSYSTEM_INTEGRATION.md`.** A separate concurrent session is drafting this
+   3-part tmct/bedrock-meter/marginalia integration plan. Check for completion and finalize.
+5. **`PLAN_CODE.md`'s sign-off decision.** Track 1 (rule/frame synthesis) is the lowest-risk
+   candidate; decide with the operator whether to greenlight it.
+6. Smaller chat-feel residuals from the 0.8.2 confirmation playtest, the Track-1 trio (pronoun,
+   temporal, discourse-count, measured red sets), `edgesOfKind` memoization for monorepo-scale
+   latency, and the version bump plus push.
+
+### Later: deferred by design, staged inside each plan
+
+Each plan doc stages its own later phases; this list just points to them rather than repeating
+their tables.
+
+- **infbench stages 1-5** (`PLAN_INFERENCE_TESTING.md` §4). The disjointness proof rule (unlocks
+  B1), proof-chain materialization, cardinality entailment, consistency checking.
+- **Advanced-grammar tracks b/d/e** (`PLAN_ADVANCED_GRAMMAR.md`). The constructions not landed
+  this wave: stacked modality/passive, implicit arguments, and the rest of the CEFR inventory
+  audit table.
+- **Ontology stage 3+** (`PLAN_ontology-hierarchies.md`). Beyond the synonym-wiring and
+  disjointness growth landed this wave.
+- **`PLAN_CODE.md` tracks 2/3.** Small JS-function synthesis and HTML/CSS-fragment synthesis, both
+  via a Playwright-sandboxed headless browser. Explicitly staged well behind Track 1, each gated
+  on its own operator sign-off.
+
+### History — what shipped in earlier releases
+
+**v0.8.2** (the chat-feel wave + rule-general C2): tier-1 CHATBENCH 334/334 (draw A) + 285/285
+(draw B), zero regressions; the cycle-1 hard-fail `gq-functions-call-fnalpha` flipped green.
+Landed recall hygiene, preamble/politeness frames, calls∪callsSymbol + grain/meta fallbacks, the
+author lane, wall kindness + honest capability nudges, teach-lane widening, receipt tails
+prose→detail, plus a live-found scale hotfix (`edgesOfKind` argument-spread overflow past ~100k
+edges). AGENTBENCH ladder grew 43→56 cases; goal driver 100% plan / 98% result / 0% hallucination,
+all rungs gate-PASS; resolver floor clean A0–C1 100/100; C2 became rule-general (two declared
+goal-rules, pure `applicableRules` selection). Full detail: `CHATBENCH_0.8.2.md`,
+`AGENTBENCH_0.8.2.md`.
+
+**v0.8.1** (published): AGENTBENCH grades the executed composed result, not just the call-plan.
+Resolver 97% plan / 91% result / 0% hallucination. Stage 5 (the C2 goal-reasoner, BDI + Goal-Driven
+Autonomy) lifted result-completion +10pp on a like-for-like driver swap. Stage 2 (imperative intent
+frames + ACE reach) shipped at 100% plan / 95% result / 0% hallucination, `tmct_calls` genuinely
+NL-reachable. Chat surface: quick wins + two frozen playtest transcripts, no tier-1 regression vs
+0.7.1. Full detail: `CHATBENCH_0.8.1.md`, `AGENTBENCH_0.8.1.md`.
+
+**v0.8.0** (published): all five Phase-11 tracks. The `/v1/messages` shim + Stage-0 registry +
+resolver/guardrail/planner (96% plan completion, 0% hallucination, closed-world C1); three chat
+levers; the `../bedrock-meter` $0 rung; the playtest; Stage-2/Stage-5 research notes. Full detail:
+`CHATBENCH_0.8.0.md`, `AGENTBENCH_0.8.0.md`.
 
 ## The umbrella product definition (item 1)
 
@@ -635,7 +690,7 @@ you toward precision" promise on the conversational surface.
   with new graded cells for the miss / empty-graph / concept-touch surfaces so these become
   regression-protected levers, not one-off polish.
 
-## Phase 11 — The capability router & the agentic bench (0.8.0 shipped · 0.8.1 deepened)
+## Phase 11 — The capability router & the agentic bench (0.8.0 shipped · 0.8.1 deepened · 0.8.2 feel + rule-general C2)
 
 *(Operator-directed 2026-07-06; built the same day across five concurrent tracks.)* tmct as a **deterministic, no-LLM
 tool router** behind an Anthropic-compatible API — the workstream specified in
@@ -657,6 +712,14 @@ real deliverable. The five tracks below are all built; the two research-agent st
 remain designed-not-built by intent.
 
 ### Track 1 — chat-surface levers (next CHATBENCH; all three)
+
+> **STATUS (0.8.2):** the surrounding feel surface landed — PLAN_CHAT_FEEL items **1–5, 7, 8**
+> (recall hygiene, preamble frames, call-relation self-consistency, author lane, wall kindness,
+> teach-lane widening, honest nudges) shipped and gate-verified deterministically. **The trio
+> below is DEFERRED post-release with measured targets** (advisor tick-4): pronoun red set = 18
+> g-b1-pron ids; temporal = g-b1-temp ×5 + g-c1-temp ×9; discourse-count re-measure first — it
+> sampled 0/5 red and is likely already green. See HANDOVER follow-up #3.
+
 The three levers `CHATBENCH_0.7.1` measured + ranked — which **double as router prerequisites** (they
 gate the A2→B1→C1 rungs, per Phase B of the router plan):
 1. **Pronoun / focus binding** — the "it → Commit" mis-bind (`B1 pron 1.24`); biggest movable mass.
@@ -666,6 +729,12 @@ gate the A2→B1→C1 rungs, per Phase B of the router plan):
 Land all three (not just #1); they raise the chat floor *and* the router's floor at once.
 
 ### Track 2 — the router build (the within-horizon slice, in order)
+
+> **STATUS (0.8.2):** the C1 composition gap closed — the **member-filter HTN method + per-member
+> callees hop** flips the standing C1 red in both drivers (resolver floor A0–C1 all 100/100); the
+> ladder grew 43→56 fixture-linted cases; the bench-import smell is inverted
+> (`src/router/call-validator.mjs` + `set-algebra.mjs`).
+
 Buildable now with a frontier model as co-author (see PLAN §"solved vs unsolved"):
 - **Phase A — the shim.** An Anthropic Messages API endpoint (`/v1/messages`, `tool_use`/`tool_result`
   blocks). **Extended:** also present as a **`bedrock-meter`-compatible routing target** (see below).
@@ -704,6 +773,12 @@ critical build path:
 - **Stage 5 — goal-reasoner, closed-world C2** — BDI + Goal-Driven Autonomy: deduce-goals (long-chain
   deduction) → plan-each (C1) → threat-aware, *persistent* first-step arbitration.
 
+> **STATUS (0.8.2):** both research stages are now BUILT and measured. Stage 2 landed in 0.8.1_002;
+> Stage 5's 0.8.1 "one thin rule" caveat is retired — **C2 is rule-general**: two declared
+> goal-rules (`coverage-invariant`, `cochange-risk-invariant`) selected by pure `applicableRules`
+> deduction with honest refusals at both failure modes (0 applicable = open-world, >1 = ambiguous),
+> zero request keywords. Goal driver: 100% plan / 98% result / 0% hallucination over 56 cases.
+
 ## Phase LATER — recognized, deferred, not now
 
 Features we have deliberately shaped seams for but will not build until the phases above have

package/corpus/seon/concepts.jsonl

@@ -236,3 +236,45 @@
 {"start":"/c/en/memory_graph","rel":"/r/HasA","end":"/c/en/fact","weight":2}
 {"start":"/c/en/fact","rel":"/r/PartOf","end":"/c/en/memory_graph","weight":2}
 {"start":"/c/en/seon","rel":"/r/IsA","end":"/c/en/ontology","weight":2}
+{"start":"/c/en/class","rel":"/r/DistinctFrom","end":"/c/en/interface","weight":2}
+{"start":"/c/en/class","rel":"/r/DistinctFrom","end":"/c/en/enum","weight":2}
+{"start":"/c/en/interface","rel":"/r/DistinctFrom","end":"/c/en/enum","weight":2}
+{"start":"/c/en/structure","rel":"/r/DistinctFrom","end":"/c/en/interface","weight":2}
+{"start":"/c/en/structure","rel":"/r/DistinctFrom","end":"/c/en/enum","weight":2}
+{"start":"/c/en/class","rel":"/r/DistinctFrom","end":"/c/en/structure","weight":2}
+{"start":"/c/en/constructor","rel":"/r/DistinctFrom","end":"/c/en/destructor","weight":2}
+{"start":"/c/en/constructor","rel":"/r/DistinctFrom","end":"/c/en/getter","weight":2}
+{"start":"/c/en/constructor","rel":"/r/DistinctFrom","end":"/c/en/setter","weight":2}
+{"start":"/c/en/destructor","rel":"/r/DistinctFrom","end":"/c/en/getter","weight":2}
+{"start":"/c/en/destructor","rel":"/r/DistinctFrom","end":"/c/en/setter","weight":2}
+{"start":"/c/en/getter","rel":"/r/DistinctFrom","end":"/c/en/setter","weight":2}
+{"start":"/c/en/controller","rel":"/r/DistinctFrom","end":"/c/en/model","weight":2}
+{"start":"/c/en/controller","rel":"/r/DistinctFrom","end":"/c/en/view","weight":2}
+{"start":"/c/en/model","rel":"/r/DistinctFrom","end":"/c/en/view","weight":2}
+{"start":"/c/en/string","rel":"/r/DistinctFrom","end":"/c/en/number","weight":2}
+{"start":"/c/en/string","rel":"/r/DistinctFrom","end":"/c/en/object","weight":2}
+{"start":"/c/en/string","rel":"/r/DistinctFrom","end":"/c/en/list","weight":2}
+{"start":"/c/en/string","rel":"/r/DistinctFrom","end":"/c/en/array","weight":2}
+{"start":"/c/en/number","rel":"/r/DistinctFrom","end":"/c/en/object","weight":2}
+{"start":"/c/en/number","rel":"/r/DistinctFrom","end":"/c/en/list","weight":2}
+{"start":"/c/en/number","rel":"/r/DistinctFrom","end":"/c/en/array","weight":2}
+{"start":"/c/en/object","rel":"/r/DistinctFrom","end":"/c/en/list","weight":2}
+{"start":"/c/en/object","rel":"/r/DistinctFrom","end":"/c/en/array","weight":2}
+{"start":"/c/en/compiler","rel":"/r/DistinctFrom","end":"/c/en/linter","weight":2}
+{"start":"/c/en/compiler","rel":"/r/DistinctFrom","end":"/c/en/formatter","weight":2}
+{"start":"/c/en/compiler","rel":"/r/DistinctFrom","end":"/c/en/parser","weight":2}
+{"start":"/c/en/linter","rel":"/r/DistinctFrom","end":"/c/en/formatter","weight":2}
+{"start":"/c/en/linter","rel":"/r/DistinctFrom","end":"/c/en/parser","weight":2}
+{"start":"/c/en/formatter","rel":"/r/DistinctFrom","end":"/c/en/parser","weight":2}
+{"start":"/c/en/constant","rel":"/r/DistinctFrom","end":"/c/en/attribute","weight":2}
+{"start":"/c/en/constant","rel":"/r/DistinctFrom","end":"/c/en/parameter","weight":2}
+{"start":"/c/en/attribute","rel":"/r/DistinctFrom","end":"/c/en/parameter","weight":2}
+{"start":"/c/en/field","rel":"/r/DistinctFrom","end":"/c/en/property","weight":2}
+{"start":"/c/en/loop","rel":"/r/DistinctFrom","end":"/c/en/expression","weight":2}
+{"start":"/c/en/assertion","rel":"/r/DistinctFrom","end":"/c/en/loop","weight":2}
+{"start":"/c/en/header","rel":"/r/DistinctFrom","end":"/c/en/script","weight":2}
+{"start":"/c/en/client","rel":"/r/DistinctFrom","end":"/c/en/server","weight":2}
+{"start":"/c/en/request","rel":"/r/DistinctFrom","end":"/c/en/response","weight":2}
+{"start":"/c/en/question","rel":"/r/DistinctFrom","end":"/c/en/answer","weight":2}
+{"start":"/c/en/bug","rel":"/r/DistinctFrom","end":"/c/en/feature","weight":2}
+{"start":"/c/en/issue","rel":"/r/DistinctFrom","end":"/c/en/requirement","weight":2}

package/data/templates/responses.jsonl

@@ -60,7 +60,7 @@
 {"id":"conversational-greeting-good-evening","class":"conversational","register":"friendly","template":"Good evening. Ask me about this codebase, or /help."}
 {"id":"conversational-thanks","class":"conversational","register":"friendly","template":"Any time. Ask another, or /help for what I can do."}
 {"id":"conversational-farewell","class":"conversational","register":"friendly","template":"Bye — flushing the session log. Come back with a question any time."}
-{"id":"orientation-friendly","class":"orientation","register":"friendly","template":"I answer questions about THIS codebase's structure — imports, calls, definitions,\nhistory and counts. For example:\n  which modules import walk.mjs\n  what calls buildContextBundle\n  how many classes are there\n/help for commands, /stats for an overview of the graph."}
+{"id":"orientation-friendly","class":"orientation","register":"friendly","template":"I answer questions about THIS codebase's structure — imports, calls, definitions,\nhistory and counts. For example:\n  which modules import {example1}\n  what calls {example2}\n  how many classes are there\n/help for commands, /stats for an overview of the graph."}
 {"id":"miss-no-previous-answer","class":"miss","register":"friendly","template":"No previous answer to expand yet — ask me a question first, then say \"why\" or \"say more\"."}
 {"id":"conversational-greeting-empty","class":"conversational","register":"friendly","template":"Hi. There's no code graph loaded here — for code structure (imports, calls, definitions) I need a `.tmct/graph.json`: point me at one with `--repo <path>`, or try the shipped example `npm run example:mini`. (tmct reads graphs; it doesn't index code itself.) For general vocabulary, `tmct init` seeds concepts — try \"what is a cache\". /help for commands."}
 {"id":"orientation-empty","class":"orientation","register":"friendly","template":"There's no code graph loaded here, so I can't answer structure questions (imports, calls, definitions) yet.\nFor those I need a `.tmct/graph.json` produced by a graph producer — point me at one with `--repo <path>`, or try the shipped example `npm run example:mini`. tmct reads graphs; it doesn't index code itself.\nFor general vocabulary, `tmct init` seeds concepts — try \"what is a cache\". /help for commands, /memory for what I remember."}

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@polycode-projects/the-mechanical-code-talker",
-  "version": "0.8.1",
+  "version": "0.9.0",
   "private": false,
   "type": "module",
   "description": "The Mechanical Code Talker (tmct) — a tolerant, offline, $0 chat surface that guides you toward precision queries about a software repository. ELIZA/PARRY-style but domain-obsessed with code. No model calls; no codebase index of its own.",
@@ -87,6 +87,7 @@
     "chatbench:judge": "node chatbench/judge.mjs",
     "serve": "node bin/tmct.mjs serve",
     "agentbench:run": "node agentbench/run.mjs",
+    "infbench": "node infbench/generate-cases.mjs && node infbench/run.mjs",
     "audit": "npm audit --audit-level=high",
     "audit:fix": "npm audit fix"
   },