@ai-matrx/content-ir 0.14.1 → 0.14.2

package/CHANGELOG.md

@@ -1,5 +1,21 @@
 # Changelog
 
+## 0.14.2 — 2026-09-25
+
+**`/source` — a tilde fence locks what the renderer draws inside it**
+(verify-RC-B3 residual R5). The renderer's splitter does not know `~~~`
+fences, so a ```` ``` ```` fence (or an XML section, a JSON block) that starts
+inside one can run past the tilde closer — and the tokenizer had left that
+overflow as editable prose. A tilde island now extends over every block the
+renderer would detect starting inside it (the union of both readings). Found
+by matrx-frontend's new `source-covers-renderer` property test (every fenced
+block the renderer draws must sit inside one tokenizer island; red on 0.14.1,
+green on 0.14.2 over 80k generated documents with tilde, nested-markdown,
+CRLF and exotic-whitespace fences). Guard here: 3 cases in
+`__tests__/source-verify-findings.test.ts`.
+
+**Consumer action:** none.
+
 ## 0.14.1 — 2026-09-25
 
 **Single-dollar math: an adversarial review of the widened rule** (RC-B2's

package/dist/index.cjs

@@ -6005,11 +6005,41 @@ var Tokenizer = class {
     for (let k = li + 1; k < this.lineCount; k++) {
       if (this.isOpenTail(k)) continue;
       if (close.test(this.lineText(k))) {
-        return this.island("fence", p, this.contentEnds[k], true, meta);
+        const tildeEnd = this.contentEnds[k];
+        const end = this.rendererOverflow(li + 1, k, tildeEnd);
+        return this.island("fence", p, end, end === this.n ? this.overflowComplete : true, meta);
       }
     }
     return this.island("fence", p, this.n, false, meta);
   }
+  /** Completion of the last `rendererOverflow` that ran to the end of the text. */
+  overflowComplete = true;
+  /**
+   * The renderer's splitter does not know ~~~ fences: it reads the lines inside
+   * one as ordinary lines, so a ```` ``` ```` fence (or an XML section, a JSON
+   * block…) that STARTS inside the tilde fence can run past its closer. The
+   * editor must lock at least what the renderer draws (verify-RC-B3 residual
+   * R5), so a tilde island extends over every block the renderer would detect
+   * starting inside it. Returns the island's end.
+   */
+  rendererOverflow(firstLine, closeLine, tildeEnd) {
+    let end = tildeEnd;
+    this.overflowComplete = true;
+    for (let j = firstLine; j <= closeLine && j < this.lineCount; j++) {
+      const start = this.lineStarts[j];
+      if (this.lineIsBlank(j)) continue;
+      if (this.lineText(j).trimStart().startsWith("~~~")) continue;
+      const inner = this.detectBlockUncached(start, j, false);
+      if (!inner) continue;
+      if (inner.end > end) {
+        end = inner.end;
+        this.overflowComplete = inner.complete;
+      }
+      const lastLine = this.lineOf(Math.max(start, inner.end - 1));
+      if (lastLine > j) j = lastLine;
+    }
+    return end;
+  }
   /**
    * A line-leading `$$` that OPENS a math pair (source/math-pairs.ts — the
    * core's rule). A closer, an unpaired `$$`, or a prose pair is never a block: