@ai-matrx/content-ir 0.14.0 → 0.14.2

package/CHANGELOG.md

@@ -1,5 +1,35 @@
 # Changelog
 
+## 0.14.2 — 2026-09-25
+
+**`/source` — a tilde fence locks what the renderer draws inside it**
+(verify-RC-B3 residual R5). The renderer's splitter does not know `~~~`
+fences, so a ```` ``` ```` fence (or an XML section, a JSON block) that starts
+inside one can run past the tilde closer — and the tokenizer had left that
+overflow as editable prose. A tilde island now extends over every block the
+renderer would detect starting inside it (the union of both readings). Found
+by matrx-frontend's new `source-covers-renderer` property test (every fenced
+block the renderer draws must sit inside one tokenizer island; red on 0.14.1,
+green on 0.14.2 over 80k generated documents with tilde, nested-markdown,
+CRLF and exotic-whitespace fences). Guard here: 3 cases in
+`__tests__/source-verify-findings.test.ts`.
+
+**Consumer action:** none.
+
+## 0.14.1 — 2026-09-25
+
+**Single-dollar math: an adversarial review of the widened rule** (RC-B2's
+single-letter shapes, shipped in 0.14.0). Stored-text impact, every row diffed
+0.13.0 → 0.14.x: 11 chat text parts gain 37 math spans, 0 lost; notes, agent
+messages, templates and skills unchanged; every gained span is a real shape
+(`f(x)`, `(x, y)`, `(-x, y)`, `f(x-y)`). Two synthetic false positives found
+by probing (none in stored data) are closed: a contraction (`$I'm$` — a prime
+is never followed by a letter) and an abbreviation (`$e.g. (x)$` — a lone
+letter is never followed by a period) stay text. Guard: 6 new cases in
+`__tests__/single-dollar-math.test.ts` (3 red before).
+
+**Consumer action:** none.
+
 ## 0.14.0 — 2026-09-25
 
 **`/source` — RC-B3 polish: the re-verification residuals, and the verifier's

package/dist/index.cjs

@@ -5239,6 +5239,7 @@ function isMathShape(content) {
   const words = content.match(/[A-Za-z]+/g);
   if (!words) return false;
   if (!words.every((w) => w.length === 1 || FUNCTION_NAMES.has(w))) return false;
+  if (/[A-Za-z]'+[A-Za-z]/.test(content) || /(?:^|[\s(,])[A-Za-z]\.(?:[A-Za-z]\.|\s|$)/.test(content)) return false;
   return /[A-Za-z]'*\(|[A-Za-z]'|\b[A-Za-z]\s+[A-Za-z]\b|\([^)]*[A-Za-z][^)]*\)/.test(content);
 }
 function isSingleDollarMath(content, after) {
@@ -6004,11 +6005,41 @@ var Tokenizer = class {
     for (let k = li + 1; k < this.lineCount; k++) {
       if (this.isOpenTail(k)) continue;
       if (close.test(this.lineText(k))) {
-        return this.island("fence", p, this.contentEnds[k], true, meta);
+        const tildeEnd = this.contentEnds[k];
+        const end = this.rendererOverflow(li + 1, k, tildeEnd);
+        return this.island("fence", p, end, end === this.n ? this.overflowComplete : true, meta);
       }
     }
     return this.island("fence", p, this.n, false, meta);
   }
+  /** Completion of the last `rendererOverflow` that ran to the end of the text. */
+  overflowComplete = true;
+  /**
+   * The renderer's splitter does not know ~~~ fences: it reads the lines inside
+   * one as ordinary lines, so a ```` ``` ```` fence (or an XML section, a JSON
+   * block…) that STARTS inside the tilde fence can run past its closer. The
+   * editor must lock at least what the renderer draws (verify-RC-B3 residual
+   * R5), so a tilde island extends over every block the renderer would detect
+   * starting inside it. Returns the island's end.
+   */
+  rendererOverflow(firstLine, closeLine, tildeEnd) {
+    let end = tildeEnd;
+    this.overflowComplete = true;
+    for (let j = firstLine; j <= closeLine && j < this.lineCount; j++) {
+      const start = this.lineStarts[j];
+      if (this.lineIsBlank(j)) continue;
+      if (this.lineText(j).trimStart().startsWith("~~~")) continue;
+      const inner = this.detectBlockUncached(start, j, false);
+      if (!inner) continue;
+      if (inner.end > end) {
+        end = inner.end;
+        this.overflowComplete = inner.complete;
+      }
+      const lastLine = this.lineOf(Math.max(start, inner.end - 1));
+      if (lastLine > j) j = lastLine;
+    }
+    return end;
+  }
   /**
    * A line-leading `$$` that OPENS a math pair (source/math-pairs.ts — the
    * core's rule). A closer, an unpaired `$$`, or a prose pair is never a block: