@hyperfixi/types-browser 4.5.0 → 4.7.0

package/CHANGELOG.md

@@ -7,6 +7,216 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 ## [Unreleased]
 
+## [4.7.0] - 2026-10-16
+
+### Added
+
+- **`@lokascript/framework`: the matcher's skeleton, `MatchSkeleton`** (domains rethink Phase 4.3), with
+  its seam (`ValueReader`, `MatchView`, `RoleSlot`) and the `ConfidenceModel` / `ConfidenceContext` /
+  `ConfidenceBreakdown` interfaces, all exported. It is the skeleton semantic's hyperscript matcher runs:
+  `@lokascript/semantic`'s `PatternMatcher` now extends it and passes `HyperscriptValueReader`, and its
+  confidence types are framework's narrowed to hyperscript's names. Framework's pattern types take the
+  fields semantic's carried alone (`LanguagePattern.parseOnly`, `LiteralPatternToken.renderSuppress`,
+  `RolePatternToken.valueShape`, `GroupPatternToken.renderRequired`, `ExtractionRule.valueIsExpression`,
+  `PatternMatchResult.roleStarts` / `eventSource`). `createMultilingualDSL` still uses its own matcher.
+  Every hyperscript parse is unchanged (27,194 checked); semantic's browser bundles grew ~150 bytes
+  gzipped.
+- **`@lokascript/framework`: `createSchemaPatternGenerator`** (domains rethink Phase 4.4), the pattern
+  generator semantic's hyperscript parser runs, moved from `@lokascript/semantic`: the main pattern per
+  command and language and its variants (simple, omit-role, widened-type, required-role, SOV verb-first,
+  value-prefix-literal), with the grammar's hook `positionOrder` (`'ascending'`: hyperscript's 1-based
+  positions; `'descending'`: a domain's, as framework's `generatePattern` reads them). Also exported:
+  `withoutVariantOnlyRoles`, `resolveMarkerForRole`, `schemaMarkerAlternatives`,
+  `legacyMarkerAlternatives`. semantic's `generatePattern` / `generatePatternVariants` / … keep their
+  names and signatures over it; its fused event-handler patterns stay in semantic. Every generated
+  pattern in all 24 languages is byte-identical (5,899), and every parse unchanged (27,194).
+- **`@lokascript/framework`: rendering through patterns, and the translation-loss checks** (domains
+  rethink Phase 4.5), moved from `@lokascript/semantic`. `selectRenderPattern` scores a language's
+  patterns for a node (role coverage, values a pattern pins) and `renderPattern` walks the chosen one;
+  a grammar's preferences and its value writing are `PatternRenderHooks`. `findTranslationLoss` runs
+  the fail-loud checks in order (unread input, forms nothing writes, a read-back that does not read or
+  differs, verbatim values) with a grammar's `TranslationLossRules`; `LossyTranslationError`,
+  `TranslationLoss` and `unconsumedSpans` moved with it (semantic re-exports them, so `instanceof`
+  holds). semantic's renderer and `translate` run them with hyperscript's hooks and rules; its
+  collision rule (`verified-render`) stays in semantic. Every translation of every command-shape case
+  in all 24 languages is unchanged, rendered (27,240) and with refusals on (704 refused, the same
+  kinds and losses).
+- **`@lokascript/framework/testing/gate`: the round-trip gate kit and the grammar linter** (domains
+  rethink Phase 4.6), moved from lokascript-domains: `runRoundTrip` renders every command of a
+  grammar in each of its languages and reads it back (`pass` / `refused` / `silent`, plus each render
+  with an unknown word after it, which must be refused); `compare` / `listingOf` / `countsOf` keep a
+  shrink-only baseline and `snapshotOf` / `snapshotChanges` a parse snapshot; `lintDomain` runs the
+  domain-toolkit rules R1–R10, its schema-structure rule on the validator the input passes
+  (`validateSchema`; framework cannot import semantic). No test runner needed. On the 8 domains, with
+  their own fixtures, it reads 3,488 of 3,488 cases as the domains' gate does, with no drift from
+  their baseline.
+- **`@lokascript/framework`: the stock value reader and confidence model for domain grammars** (domains
+  rethink Phase 4.7a). `createStockReader()` (`StockValueReader`) is a `ValueReader` for the matcher's
+  skeleton: a greedy slot reads up to the next marker its pattern owes (`readGreedy`,
+  `greedyStopMarkers`), any other slot one value (`readRoleValue`: a selector, a quoted string, a number,
+  a boolean, a duration, a URL, an identifier, or a dotted or called form, checked against the slot's
+  types), a required slot never takes the marker its pattern wants next, and an optional one may be
+  skipped for it. `stockConfidenceModel` scores as the old matcher did. Both are the old matcher's code,
+  moved: `createMultilingualDSL`'s matcher calls them, and the domain gate on this build moves no case
+  and no parse. `createSchemaPatternGenerator` also takes a domain schema's `greedy`, its
+  post-verb `sovSlot` and its `markerPosition` (hyperscript's patterns: unchanged, 5,899).
+- **`@lokascript/framework`: `engine: 'core'`, a domain DSL on the core** (domains rethink Phase 4.7b):
+  a `DSLConfig` option. `createMultilingualDSL({ ...config, engine: 'core' })` returns the same
+  `MultilingualDSL`, read by the core semantic's hyperscript parser runs: patterns from
+  `createSchemaPatternGenerator` (positions descending), matched by `MatchSkeleton` with the stock
+  reader and confidence model, and rendered through those patterns where the domain's own renderer
+  declines. Parsing's whole-input rule, the refusals, translation's read-back, compile, explicit syntax
+  and extensions are shared with the default, `engine: 'classic'`, which is unchanged; any other engine
+  name throws. The stock reader also gives a required slot back the value an optional, marker-less slot
+  just before it read (the old matcher's backtrack). Measured on the 8 domains, each on the core
+  (the domain gate on a packed build): 0 cases worse, 30 better (behaviorspec 306 → 336
+  round trips), no case silent that was not before.
+
+### Changed
+
+- **`@lokascript/intent`: one schema type for every grammar** (domains rethink Phase 4.1). `RoleSpec` and
+  `CommandSchema` now hold the fields hyperscript's schemas use as well as the domains' (`valueShape`,
+  `variantOnly`, `markerOptional`, `markerLegacy`, `valuePrefixLiteral`; `bareKeyword`, `structuralOnly`
+  and the `omitRoleVariants` / `widenTypeVariants` / `rolePrefixLiteralVariants` / `requiredRoleVariants`
+  lists), each documented with the code that reads it, and take type parameters for a grammar's action,
+  role, value and category names. The parameters default to today's types, so a domain schema reads as
+  before; framework's `docs/API_SURFACE.md` prints them spelled out. `@lokascript/semantic`'s `RoleSpec`
+  is this type with hyperscript's names, and its `CommandSchema` extends it with the fields only its AST
+  builder and error docs read (`ast`, `errorCodes`, `preconditions`, `recoveryHints`). One field keeps two
+  meanings for now: framework's generator sorts `svoPosition` / `sovPosition` descending (higher =
+  earlier), semantic's ascending; the field doc says so.
+- **`@lokascript/semantic`: the pattern matcher reads every value through a seam** (domains rethink
+  Phase 4.2). The matcher is now a grammar-neutral skeleton (`parser/match-skeleton.ts`: literals,
+  groups and their rollback, the speculative skip of an optional slot, spans, ranking, confidence) and
+  hyperscript's `HyperscriptValueReader`, which reads each role slot and answers the skeleton's grammar
+  hooks (`parser/value-reader.ts`). `PatternMatcher` keeps its constructor, methods and import path. Every
+  parse is unchanged (27,194 checked).
+
+## [4.6.0] - 2026-10-15
+
+### Added
+
+- **`@lokascript/semantic`: `ask` and `answer`** in every language's own word (es `preguntar` /
+  `responder`, ja `尋ねる` / `答える`, de `frage` / `antworte`): upstream's two dialog commands
+  (`ask "Name?"` prompts; `answer "Save?" with "Yes" or "No"` confirms, the choices after the language's
+  `with`). Both were refused in every language. Listed for native review in
+  `packages/semantic/NATIVE_REVIEW_NEEDED.md`.
+- **`@lokascript/semantic`: `scroll … by` with a direction** in every language's own words
+  (`scroll #box down by 200px`: es `desplazamiento #box abajo por 200px`, ja `#boxを 下 200px スクロール`,
+  ru `прокрутить #box вниз 200px`). Upstream's relative scroll was refused in every language: no
+  direction had a word, and scroll's schema modeled `scroll to <el>` alone. Listed for native review in
+  `packages/semantic/NATIVE_REVIEW_NEEDED.md`.
+
+### Changed
+
+- **`@lokascript/framework`: a domain DSL's parse refuses input it did not read.**
+  `createMultilingualDSL`'s `parse` (and so `compile`, `validate`, `translate`) tries every pattern and
+  takes the best match that reads the WHOLE input: highest priority, then confidence. When the only
+  matches leave input unread, it throws `UnreadInputError` (exported; `code: 'unread-input'`, with the
+  longest match's `reading` and the `unread` text). It used to return the first match however much it
+  read, so a trailing word was dropped without a word: the domain gate (lokascript-domains) found
+  1,744 of 1,744 renders accepted with an unknown word after them, and `ask what is 2+2` asked the
+  model "what". Against the gate (domains 4.0.0, measured unpublished with `gate:upstream`): 1,527
+  cases better, 62 worse, every one `pass → refused` (a value such as `click`'s that the generator
+  ignored, now refused as unread rather than dropped); no case became silent, and no accepted parse
+  changed its reading. A multi-word llm question is quoted: `ask "what is 2+2"`.
+- **`@lokascript/framework`: a domain DSL's `translate` refuses a rendering that does not read
+  back.** It reads its output in the target language and requires the source command: the same
+  action and role values, or the same compiled code. Otherwise it throws `TranslationReadBackError`
+  (exported; the text under `partial`, what it reads as under `reading`), unless `{ lossy: 'allow' }`,
+  as semantic's `translate`. `DomainRegistry`'s tools (the MCP `parse_` / `compile_` / `validate_` /
+  `translate_<domain>` tools) report refusals as `ok: false` with an `UNREAD_INPUT` or
+  `TRANSLATION_DOES_NOT_READ_BACK` diagnostic instead of a generic tool error, and `translate_<domain>`
+  reads its own rendering back the same way. Translating every domain gate command from English: 46
+  renders that used to be returned are now refused (45 do not parse in the target language).
+- **`@lokascript/semantic`: the parser is split into modules.** `semantic-parser.ts` went from 9,680
+  lines to 751, across 22 modules under `parser/`, and each question about an end word (does it close a
+  block, does it stop a clause) has one reader. Each step was checked against 27,194 parses; the steps
+  that change a reading are listed under Fixed. `SemanticParseError` keeps its import path.
+
+### Fixed
+
+- **`@lokascript/semantic`: a handler's count** (`on click 1 …`, the first click only; `on click 2 …`)
+  is read in every language. The renders already wrote it (es `al clic 1 ocultar`), but every reader
+  outside English dropped it, so the translation was refused in all 23 languages. Bengali, Italian and
+  Thai also read every clause between a handler's event and its body (`on click elsewhere`,
+  `on mutation of attributes`, `on foo queue first`), which their head pattern skipped. In the command-shape
+  gate, 375 lanes that were refused now pass.
+- **`@lokascript/semantic`: a query of a pseudo-class alone** (`<:checked/>`, `<:not(.done)/>`) reads
+  as a query in every language, English too. Every tokenizer read `<` and then a local variable
+  `:checked`, so a translation was refused. In the command-shape gate, 161 lanes that were refused now
+  pass.
+- **`@lokascript/semantic`: value spellings from upstream's own tests** read in every language,
+  English too: an escaped class name (`.group-\[:nth-of-type\(3\)_\&\]:block`), a query of several
+  selectors (`<#d1, #d2/>`), a unit after parentheses (`(startWidth)px`), `[@data-foo]` and an
+  attribute after a pronoun (`set it @disabled to true`, written `its @disabled`), a dotted property
+  before `of` (`set parentNode.innerHTML of #d1 to "foo"`), and `set {bar: 2, baz: 3} on obj`. Each was
+  refused. `get` no longer has a destination slot, which no reader used and which took Italian's `in`:
+  `get #p1 in me` read back as `get #p1 on me` in Italian, and `get result as JSONString` was refused
+  in Quechua. In the command-shape gate, 202 lanes are better, 3 of them silent before.
+- **`@lokascript/semantic`: upstream's collection expressions** read in English and translate:
+  `set :items to <span/> in #box where it matches .a`,
+  `put matches mapped to its textContent into #out`, `repeat for x in :items where x.val > 10 …`. They were refused in every language, English
+  too, or kept as an English clause after the command. A translation writes the language's own `where`,
+  as it already did in a condition (es `donde`, de `wo`), and keeps `mapped to` in English until native
+  review. Also read now: an element-scoped variable (`:items`) inside a longer value, the article in
+  `in the closest <table/>` and `checked of the :boxes`, and zh/tl's `no` before a sigil variable. Quechua and
+  Vietnamese read their own `where` back (it read as `target`, or split at its `_`), which also clears a
+  silent pair in each. In the command-shape gate, 154 lanes are better, 2 of them silent before.
+- **`@lokascript/semantic`: a query's scope inside a phrase** reads in English and translates:
+  `put the length of <:checked/> in #box into me` (the value ended at the query and `in` was taken as
+  put's marker), `bind $n to the length of <:checked/> in the next <tbody/> …` (a positional scope),
+  `put <span/> in #box where it matches .a into me` (English came back silently as `… into #box …`), and
+  `put the length of <p/> into #out` and `put 'x' into the next <div/>'s textContent`, which the lossy
+  check refused because it read the `'s` after `<p/>` as a quote. In the command-shape gate, 63 lanes are
+  better, 1 of them silent before.
+- **`@lokascript/semantic`: no translation reads back as other English without saying so.** The
+  command-shape gate's last five silent pairs read back as their source: pl's `closest .bar to .foo`
+  (pl's own `to` is "it"), `closest @foo` in pl and sw, a Quechua chain of `'s` (`$data's inner's val`,
+  read as a string), and Indonesian's `saya punya @data-x`. English `set closest @foo to "doh"` and
+  `put closest @foo into me`, refused in all 24 languages, read now too.
+- **`@lokascript/semantic`: commands that semantic already models, refused in some languages,** read
+  and translate. In the command-shape gate, 168 lanes that were refused now pass; with the rows above,
+  the refused lanes of shapes semantic models went from 911 to 86, and the gate reads 26,531 pass,
+  709 refused and 0 silent. The commands:
+  - `fetch $u as JSON`, with a `$` or `:` variable as the URL (23 languages);
+  - `toggle my *display`, `*opacity` and `*visibility` (ar, de, fr, he, ja, tr);
+  - a `js(…) … end` block after `then` behind a handler head (bn, es, it, ko, pl, ru, th, tl, uk);
+  - a snake_case name (`call global_function()`), which 11 tokenizers split at its `_`;
+  - a custom event after a handler head's `or` (`on click or foo`: bn, it, ja, ko, th, tr, zh). English
+    no longer drops the second event of `on foo or bar`;
+  - `put … at end of` in Vietnamese, and in bn, hi, ja, qu and tr after a bare name
+    (`put response at end of #results`);
+  - a `set` target with no marker after it, in it, pl, ru and uk (`set .divs.innerHTML to "foo"`,
+    `#d1.parentNode`, `bar["count"]`), and `on keydown[key=="Enter"]` in ar, de, fr and he;
+  - `fetch … as Object` and `as Number` behind a bn, hi or ko handler head;
+  - a top-level `for item in items …`, which bn, hi, ko and sw read as a handler on `item`;
+  - a loop's bottom test (`repeat … until x is 3 end`) in de, fr and ko;
+  - a Korean second handler on a parameterized event (`on exception(error)`), and Polish
+    `then throw` after `do` (Polish for `into`);
+  - bn, th and vi's own word for `checked`.
+- **`@lokascript/semantic`: `at end of` inside a behavior or a def** reads in every language:
+  `behavior B on click put "x" at end of me end` was refused, English to English too, because the
+  `end` of `at end of` closed the block. A variable spelled like an end word in such a body reads too
+  (es `fin`).
+- **`@lokascript/semantic`: two copied type lists that had lost `property-path`.** Chinese reads
+  `put the textContent of last <.picked/> in #list`, which it refused, and ja, ko and zh write the count
+  of `repeat the textContent of #a times` in their own words (`#aのtextContent`), not English.
+- **`@lokascript/semantic`: Quechua's `repeat until event … from …`** writes Quechua
+  (`kama ruway pointerup ta kutipay #box manta …`), not a leftover of the retired i18n transformer with
+  English `until event` and `repeat` in it.
+- **Test runs no longer fill the temp directory**: `scripts/vitest-run.sh` gives each run its own
+  `TMPDIR` and removes it. Vitest 5.0.2 leaves a copy of every transformed module in `$TMPDIR` per run.
+
+### Removed
+
+- **`@hyperfixi/mcp-server`: the jsx domain's four tools** (`parse_jsx`, `compile_jsx`, `validate_jsx`,
+  `translate_jsx`), and `jsx` as a `domain` for `lse_validate_and_feedback`, `generate_training_data`
+  and the `lse_generate` prompt. The server now depends on `@lokascript/domains` ^4.0.0, which retired
+  jsx with six other preview domains (`docs-internal/DOMAINS_RETHINK.md`, D1). 8 domains remain (sql,
+  bdd, behaviorspec, llm, flow, voice, todo, learn): 32 domain tools, 102 tools defined, 97 listed by
+  default.
+
 ## [4.5.0] - 2026-10-11
 
 Pronouns, suffixes and handler heads read as their language. In 4.4.0 every translation wrote `me` and
@@ -32,9 +242,9 @@ review in `packages/semantic/NATIVE_REVIEW_NEEDED.md`; none has been reviewed ye
 
 - **`@lokascript/semantic` writes a pronoun in the case its marker takes.** Free forms: es `en mí`,
   pt `a mim`, it `a me`, tl `sa akin`, pl `do mnie`, ru `ко мне` / `во мне`, uk `до мене`, de `zu mir`
-  / `in mich` (direction) / `auf mir` (location), hi `मुझ में`; `it` after a marker (ru `к этому`, pl `do
-  tego`, de `dazu` / `darin` / `darauf`, fr `à lui`, hi `इस में`); `me` as a verb's object (de `zeige
-  mich`, ru `покажи меня`). Fused forms: tr `bana` / `beni` / `benden`, `ona` / `onu`; ar `إليّ` / `فيه`;
+  / `in mich` (direction) / `auf mir` (location), hi `मुझ में`; `it` after a marker (ru `к этому`, pl
+  `do tego`, de `dazu` / `darin` / `darauf`, fr `à lui`, hi `इस में`); `me` as a verb's object (de
+  `zeige mich`, ru `покажи меня`). Fused forms: tr `bana` / `beni` / `benden`, `ona` / `onu`; ar `إليّ` / `فيه`;
   he `אליי` / `ממני`; bn `আমাকে` / `আমাতে`; hi `मुझे`; tl `dito`; pt `nele`. Object clitics on the verb:
   es `mostrarme`, it `metterlo`, pt `colocá-lo`, ar `ضعه`; fr writes the object pronoun before the
   infinitive (`le mettre`, `l'afficher`, `me cacher`). Every reader takes the nominative and the English
@@ -88,8 +298,8 @@ language has a word for. The words are the owner's vocabulary sheet
   counts, per render, the English grammar words (the tokens the engine's own parser matched in the
   source), English event names the language's lexicon has a word for, and a nominative `me` beside a
   marker in the 13 languages where that case is wrong. Two shrink-only baselines (the corpus, in
-  `test:canonical`, and the command-shape cases, in their shards); `tools/regen-english-leaks-baseline.ts
-  --report` prints each language against M2's targets. An English alternative a profile keeps for
+  `test:canonical`, and the command-shape cases, in their shards);
+  `tools/regen-english-leaks-baseline.ts --report` prints each language against M2's targets. An English alternative a profile keeps for
   code-switched input, beside a primary that is the language's own, counts as English.
 - **`@lokascript/semantic`: `transition … from … to`** reads and writes in every language (a `source`
   role), and the bare command reads in English. The schema's `destination` role is gone: upstream has
@@ -106,8 +316,8 @@ language has a word for. The words are the owner's vocabulary sheet
   back in English as upstream's first person), `does not match`, `fetch … do not throw`, `on first`,
   `go back`, `from elsewhere`, a loop's `index`, `start view transition`, a query's `in`, a conversion's
   `as` (the type name stays English), `the X of Y` inside an expression (es `valor de #price`, ja
-  `#priceの値`), `catch` and `finally`, `element x`, and `def` (as the noun "function", es `función
-  greet(name)`). bn, th and vi have their own `document` and `window`; he has its own words for all of
+  `#priceの値`), `catch` and `finally`, `element x`, and `def` (as the noun "function", es
+  `función greet(name)`). bn, th and vi have their own `document` and `window`; he has its own words for all of
   these and for `matches`, `exists`, `or`, `not`, `first`, `next`, `previous`, `closest`, `empty`, `is`,
   `document` and `window`; and the 15 languages that wrote English `forever` have their own (es
   `repetir siempre`, de `endlos`, ja `ずっと`). Every reader still takes the English words. Where a word
@@ -1611,7 +1821,9 @@ _Synchronized version release. See git history for details._
 - npm access token stored in GitHub Secrets
 - 2FA recommended for npm organization
 
-[Unreleased]: https://github.com/codetalcott/hyperfixi/compare/v4.4.0...HEAD
+[Unreleased]: https://github.com/codetalcott/hyperfixi/compare/v4.7.0...HEAD
+[4.7.0]: https://github.com/codetalcott/hyperfixi/compare/v4.6.0...v4.7.0
+[4.6.0]: https://github.com/codetalcott/hyperfixi/compare/v4.5.0...v4.6.0
 [4.5.0]: https://github.com/codetalcott/hyperfixi/compare/v4.4.0...v4.5.0
 [4.4.0]: https://github.com/codetalcott/hyperfixi/compare/v4.3.0...v4.4.0
 [4.3.0]: https://github.com/codetalcott/hyperfixi/compare/v4.2.0...v4.3.0

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@hyperfixi/types-browser",
-  "version": "4.5.0",
+  "version": "4.7.0",
   "description": "TypeScript definitions for the hyperfixi browser globals: window.hyperfixi / window._hyperscript (the engine), LokaScriptSemantic, LokaScriptI18n",
   "type": "module",
   "types": "dist/index.d.ts",
@@ -30,7 +30,7 @@
   "author": "LokaScript Contributors",
   "license": "MIT",
   "devDependencies": {
-    "@hyperfixi/engine": "^4.5.0",
+    "@hyperfixi/engine": "^4.7.0",
     "typescript": "^5.8.3"
   },
   "publishConfig": {