satteri 0.9.2 → 0.9.4

package/README.md

@@ -2,6 +2,8 @@
 
 Native-enhanced Markdown parsing and processing for JavaScript. Parse and compile in Rust, create flexible plugins in JavaScript.
 
+Check out the [documentation](https://satteri.bruits.org/docs/) for [installation instructions](https://satteri.bruits.org/docs/installation/), the [API reference](https://satteri.bruits.org/docs/entry-points/), and [usage examples](https://satteri.bruits.org/docs/quick-start/), try it online on the [playground](https://satteri.bruits.org/playground), or join us on [Discord](https://discord.com/invite/84pd4QtmzA)!
+
 ## Install
 
 ```sh
@@ -17,7 +19,7 @@ pnpm add satteri
 ```ts
 import { markdownToHtml } from "satteri";
 
-const html = markdownToHtml("# Hello\n\nWorld");
+const { html } = markdownToHtml("# Hello\n\nWorld");
 // <h1>Hello</h1>\n<p>World</p>
 ```
 
@@ -26,345 +28,31 @@ const html = markdownToHtml("# Hello\n\nWorld");
 ```ts
 import { mdxToJs } from "satteri";
 
-const js = mdxToJs("# Hello\n\n<MyComponent />");
+const { code } = mdxToJs("# Hello\n\n<MyComponent />");
 ```
 
 ### With plugins
 
-Both functions accept `mdastPlugins` (operate on the Markdown AST before conversion to HAST) and `hastPlugins` (operate on the HAST before output).
-
-```ts
-import { markdownToHtml } from "satteri";
-import { removeHeadings } from "./my-mdast-plugins.js";
-import { addLinkClasses } from "./my-hast-plugins.js";
-
-const html = markdownToHtml("# Hello\n\n[link](https://example.com)", {
-  mdastPlugins: [removeHeadings],
-  hastPlugins: [addLinkClasses],
-});
-```
-
-If you're familiar with the unified ecosystem, mdast and hast plugins would be similar to remark and rehype plugins, respectively, and re-uses the same AST shape for both. This project does not currently have an equivalent of micromark or recma plugins.
-
-## Plugins
-
-### MDAST plugins
-
-MDAST plugins run on the Markdown syntax tree, allowing you to do things like replace emoji shortcodes, unwrap images from paragraphs, or collect headings for a table of contents before Markdown is transformed to HTML / JS. Define visitor methods named after node types (`heading`, `code`, `link`, `image`, etc.). Each visitor receives the node and a context object for mutations.
-
-```ts
-const emojis = defineMdastPlugin({
-  name: "emojis",
-  text(node, ctx) {
-    if (node.value.includes(":wave:")) {
-      ctx.setProperty(node, "value", node.value.replaceAll(":wave:", "\u{1F44B}"));
-    }
-  },
-});
-```
-
-Visitors can alternatively return a replacement node, raw Markdown, or raw HTML. This is useful when the replacement can't be expressed as property changes on the original node:
-
-```ts
-const highlightCode = defineMdastPlugin({
-  name: "highlight-code",
-  code(node) {
-    return { rawHtml: `<pre class="highlighted">${escape(node.value)}</pre>` };
-  },
-});
-```
-
-All standard mdast node types are supported, plus GFM extensions (`table`, `tableRow`, `tableCell`, `delete`, `footnoteDefinition`, `footnoteReference`) and MDX nodes (`mdxJsxFlowElement`, `mdxJsxTextElement`, `mdxFlowExpression`, `mdxTextExpression`, `mdxjsEsm`) if enabled. For more information on the AST shape and node types, see the [mdast spec](https://github.com/syntax-tree/mdast).
-
-### HAST plugins
-
-HAST plugins run on the HTML syntax tree after mdast-to-hast conversion, allowing you to do things like add classes to elements, set attributes on links, or wrap HTML elements with other elements, etc. Element visitors use a `filter` array to specify which tag names (or component names for MDX) to match.
-
-```ts
-const addLinkClasses = defineHastPlugin({
-  name: "add-link-classes",
-  element: {
-    filter: ["a"],
-    visit(node, ctx) {
-      ctx.setProperty(node, "class", "link");
-      ctx.setProperty(node, "target", "_blank");
-    },
-  },
-});
-```
-
-Multiple filter groups on the same node type:
-
-```ts
-const multiFilter = defineHastPlugin({
-  name: "multi-filter",
-  element: [
-    {
-      filter: ["h1", "h2", "h3"],
-      visit(node, ctx) {
-        ctx.setProperty(node, "class", "heading");
-      },
-    },
-    {
-      filter: ["a"],
-      visit(node, ctx) {
-        ctx.setProperty(node, "target", "_blank");
-      },
-    },
-  ],
-});
-```
-
-An empty filter matches all elements, but can quickly become expensive when used on large documents, so use with caution:
-
-```ts
-const allElements = defineHastPlugin({
-  name: "all-elements",
-  element: {
-    filter: [],
-    visit(node, ctx) {
-      ctx.setProperty(node, "data-visited", "true");
-    },
-  },
-});
-```
-
-Non-element visitors (`text`, `comment`, `raw`, `doctype`, MDX expression types) use bare functions instead of filter objects:
-
-```ts
-const uppercaseText = defineHastPlugin({
-  name: "uppercase-text",
-  text(node, ctx) {
-    ctx.setProperty(node, "value", node.value.toUpperCase());
-  },
-});
-```
-
-For more information on the AST shape and node types, see the [hast spec](https://github.com/syntax-tree/hast).
-
-### Mutating nodes
-
-Unlike remark and rehype plugins, nodes in Sätteri inside plugins are read-only. The AST lives in Rust memory and JavaScript only has a "view" over the different nodes, so direct mutations like `node.value = "new text"` have no effect. Use the context methods (`ctx.setProperty`, `ctx.removeNode`, `ctx.replaceNode`, etc.) instead, which send changes back to Rust in an efficient way.
-
-```ts
-// Won't work
-heading(node, ctx) {
-  node.depth = 2; // no effect, TypeScript will also complain that the node is readonly
-}
-
-// Do this instead
-heading(node, ctx) {
-  ctx.setProperty(node, "depth", 2);
-}
-
-// Or return a new node to replace it entirely, but this is less efficient and generally not recommended
-heading(node) {
-  return { ..node, depth: 2 };
-}
-```
-
-### Sharing data between plugins
-
-Each context exposes a `data` object, a document-scoped grab bag shared across every visitor in the compile. Writes from one plugin are visible to later plugins, and the bag persists across the mdast→hast boundary, so hast plugins can read what mdast plugins wrote. After compilation the final state is returned on `result.data`, making it suitable for things like extracting a table of contents.
-
-```ts
-const collectHeadings = defineMdastPlugin({
-  name: "collect-headings",
-  heading(node, ctx) {
-    const list = (ctx.data.headings as string[]) ?? [];
-    const first = node.children[0];
-    if (first && "value" in first) list.push(first.value as string);
-    ctx.data.headings = list;
-  },
-});
-
-const { html, data } = markdownToHtml("# A\n\n# B", { mdastPlugins: [collectHeadings] });
-console.log(data?.headings); // ["A", "B"]
-```
-
-The bag lives entirely on the JS side, so any value is allowed, including functions, class instances, and `Map`/`Set`. References are preserved across plugins and across the mdast→hast boundary. A fresh, empty bag is created for every compile unless you seed one with the `data` option.
-
-To seed data into the bag before plugins run, pass an object to the `data` option. The same object is available in all plugins and returned as `result.data` after compilation, so you can pre-populate it with values or methods that plugins can read and update.
-
-```ts
-const data = { title: "Hello" };
-const rewriteTitle = defineMdastPlugin({
-  name: "rewrite-title",
-  heading(_node, ctx) {
-    ctx.data.title = "Updated";
-  },
-});
-
-const result = markdownToHtml("# A", { mdastPlugins: [rewriteTitle], data });
-console.log(result.data === data); // true, the seeded object is returned
-console.log(data.title); // "Updated"
-```
-
-By default keys are typed as `unknown`. To give a key a type, augment the `DataMap` interface:
-
-```ts
-declare module "satteri" {
-  interface DataMap {
-    headings: string[];
-  }
-}
-
-// now ctx.data.headings and result.data.headings are typed as string[] | undefined
-```
-
-Unregistered keys stay `unknown`, so the bag remains open-ended.
-
-### How transforms compose
-
-Unlike remark and rehype, which re-walk the tree until it stops changing, each Sätteri plugin walks the tree **once**. Within that single pass:
-
-- **Passed-through children keep their identity.** When a visitor returns a replacement that reuses the original node's children (e.g. `{ ...node, children: [...node.children] }`), those children are spliced back unchanged — so a transform the same pass queues on a nested one still applies. This is what lets a `containerDirective` visitor turn both an outer `:::note` and a nested `:::tip` into asides in one go.
-- **A plugin's own freshly-built nodes are not re-walked by that plugin.** If a visitor returns a brand-new node (one that didn't come from the tree), the same plugin won't visit it. Produce its final shape directly, or hand it off to a later plugin — every plugin runs over the fully materialized output of the ones before it.
-- **Dropping a subtree drops transforms queued inside it.** If one visitor removes or replaces a node while another (in the same pass) had queued a transform on something inside that subtree, the orphaned transform is dropped and a warning is logged. This is usually intentional — you discarded that subtree on purpose — but the warning helps catch the cases where it isn't.
-
-### Async plugins
-
-Visitors can optionally be async. When any visitor is async, `markdownToHtml` and `mdxToJs` return a `Promise<string>` instead of `string`. For performance reasons, it is typically best to avoid async visitors, especially if your visitor matches a large number of nodes.
-
-````ts
-const highlighter = await createHighlighter({ themes: ["github-dark"], langs: ["js", "ts"] });
-
-const asyncHighlight = defineMdastPlugin({
-  name: "async-highlight",
-  async code(node) {
-    const html = await highlighter.codeToHtml(node.value, {
-      lang: node.lang,
-      theme: "github-dark",
-    });
-    return { rawHtml: html };
-  },
-});
-
-// Returns Promise<string> when async plugins are used
-const html = await markdownToHtml("```js\ncode\n```", {
-  mdastPlugins: [asyncHighlight],
-});
-````
-
-## API
-
-### `markdownToHtml(source: string, options?: CompileOptions)`
-
-Parse Markdown and compile to HTML. Returns `string` if all plugins are sync, `Promise<string>` if any are async.
+Both functions accept `mdastPlugins` (operate on the Markdown AST) and `hastPlugins` (operate on the HTML AST). A plugin is an object with a `name` and a visitor per node type; `defineMdastPlugin` / `defineHastPlugin` add type inference.
 
 ```ts
-const html = markdownToHtml("# Hello\n\nWorld");
-// <h1>Hello</h1>\n<p>World</p>
-```
-
-### `mdxToJs(source: string, options?: MdxCompileOptions)`
+import { markdownToHtml, defineMdastPlugin } from "satteri";
 
-Parse MDX and compile to JavaScript module code. Same sync/async return behavior.
-
-```ts
-const js = mdxToJs("# Hello\n\n<MyComponent />");
-```
-
-#### Static optimization
-
-The `optimizeStatic` option for MDX collapses static subtrees into pre-rendered HTML strings, reducing the number of JSX element calls in the output and increasing rendering performance. Dynamic content (JSX components, expressions) is preserved as normal JSX calls.
-
-```ts
-// Astro-style: wraps static HTML in <Fragment set:html="...">
-const js = mdxToJs("# Hello\n\nWorld", {
-  optimizeStatic: {
-    component: "Fragment",
-    prop: "set:html",
+const stripInlineCode = defineMdastPlugin({
+  name: "strip-inline-code",
+  inlineCode(node, ctx) {
+    ctx.replaceNode(node, { type: "text", value: node.value });
   },
 });
 
-// React-style: wraps in <div dangerouslySetInnerHTML={{ __html: "..." }}>
-const js = mdxToJs("# Hello\n\nWorld", {
-  optimizeStatic: {
-    component: "div",
-    prop: "dangerouslySetInnerHTML",
-    wrapPropValue: true,
-  },
+const { html } = markdownToHtml("Use `let` instead of `var`.", {
+  mdastPlugins: [stripInlineCode],
 });
+// <p>Use let instead of var.</p>
 ```
 
-The `ignoreElements` option can be used to exclude specific elements from collapsing.
-
-Shoutout to [Bjorn Lu](https://bjornlu.com) for originally developing this optimization for [Astro](https://astro.build/).
-
-### `markdownToMdast(source: string)`
-
-Parse Markdown and return a complete mdast tree. This can be useful if you wanted to benefit from the fast native parsing of Sätteri, but ultimately wanted another pipeline to handle transformations and compilation, e.g. using remark plugins and `remark-stringify` to convert back to Markdown after processing.
-
-```ts
-import { markdownToMdast } from "satteri";
-
-const tree = markdownToMdast("# Hello\n\nWorld");
-// tree.children[0].type === "heading"
-// tree.children[0].depth === 1
-```
-
-### `mdxToMdast(source: string)`
-
-Parse MDX and return a complete mdast tree.
-
-```ts
-const tree = mdxToMdast('<Component foo="bar" />');
-// tree.children[0].type === "mdxJsxFlowElement"
-// tree.children[0].name === "Component"
-```
-
-### `markdownToHast(source: string)`
-
-Parse Markdown, convert to hast, and return a complete hast tree.
-
-```ts
-const tree = markdownToHast("# Hello\n\nWorld");
-// tree.children[0].type === "element"
-// tree.children[0].tagName === "h1"
-```
-
-### `mdxToHast(source: string)`
-
-Parse MDX, convert to hast, and return a complete hast tree.
-
-```ts
-const tree = mdxToHast("<MyComponent />");
-// tree.children[0].type === "mdxJsxFlowElement"
-// tree.children[0].name === "MyComponent"
-```
-
-### `defineMdastPlugin(definition: MdastPluginDefinition)`
-
-Type-safe wrapper for MDAST plugin definitions.
-
-### `defineHastPlugin(definition: HastPluginDefinition)`
-
-Type-safe wrapper for HAST plugin definitions.
-
-### `CompileOptions`
-
-```ts
-interface CompileOptions {
-  mdastPlugins?: MdastPluginDefinition[];
-  hastPlugins?: HastPluginDefinition[];
-  features?: Features;
-  fileURL?: URL;
-  data?: Data;
-}
-
-// mdxToJs accepts MdxCompileOptions, which extends CompileOptions
-interface MdxCompileOptions extends CompileOptions {
-  optimizeStatic?: OptimizeStaticConfig;
-}
-```
-
-`fileURL` is the `URL` of the document being processed, surfaced to plugins as `ctx.fileURL` (a `URL`, or `undefined` when omitted). Pass a file URL such as Astro's `fileURL`, or convert a filesystem path with Node's `pathToFileURL`; read it back with `fileURLToPath(ctx.fileURL)`.
-
-`data` seeds the document-level data bag before plugins run, surfaced as `ctx.data` and returned as `result.data`. See [Sharing data between plugins](#sharing-data-between-plugins).
-
-`Features` controls the Markdown extensions Sätteri's parser recognizes: `gfm`, `frontmatter`, `math`, `directive`, `smartPunctuation`, etc. `gfm`, `math`, and `smartPunctuation` also accept granular options. For example, `math: { singleDollarTextMath: false }` keeps single `$` as literal text. See the [Features reference](https://satteri.dev/docs/features/) for the full list.
+If you're familiar with the unified ecosystem, mdast and hast plugins are similar to remark and rehype plugins, respectively, reusing the same AST shapes.
 
-## License
+## Development
 
-MIT
+Refer to [CONTRIBUTING.md](https://github.com/bruits/satteri/blob/main/CONTRIBUTING.md) for development setup and workflow details.

package/dist/binding.browser.d.ts

@@ -1 +1 @@
-export { applyCommandsAndConvertToHastHandle, applyCommandsToHandle, applyCommandsToMdastHandle, compileHandle, compileMdx, convertMdastToHastHandle, createHastHandle, createMdastHandle, createMdxHastHandle, createMdxMdastHandle, dropHandle, getHandleSource, getMdastFrontmatter, getNodeData, mdastTextContentHandle, parseEsm, parseExpression, parseToHtml, renderHandle, serializeHandle, setNodeData, textContentHandle, walkHandle, walkMdastHandle, } from "../satteri_napi.wasi-browser.js";
+export { applyCommandsAndConvertToHastHandle, applyCommandsToHandle, applyCommandsToMdastHandle, compileHandle, compileMdx, convertMdastToHastHandle, createHastHandle, createMdastHandle, createMdxHastHandle, createMdxMdastHandle, dropHandle, getHandleSource, getMdastFrontmatter, getNodeData, mdastTextContentHandle, parseEsm, parseExpression, parseToHtml, renderHandle, serializeHandle, setNodeData, textContentHandle, walkHandle, walkMdastHandle, } from "../browser.js";

package/dist/binding.browser.js

@@ -1,2 +1,2 @@
 // @ts-nocheck — WASM browser binding has no type declarations
-export { applyCommandsAndConvertToHastHandle, applyCommandsToHandle, applyCommandsToMdastHandle, compileHandle, compileMdx, convertMdastToHastHandle, createHastHandle, createMdastHandle, createMdxHastHandle, createMdxMdastHandle, dropHandle, getHandleSource, getMdastFrontmatter, getNodeData, mdastTextContentHandle, parseEsm, parseExpression, parseToHtml, renderHandle, serializeHandle, setNodeData, textContentHandle, walkHandle, walkMdastHandle, } from "../satteri_napi.wasi-browser.js";
+export { applyCommandsAndConvertToHastHandle, applyCommandsToHandle, applyCommandsToMdastHandle, compileHandle, compileMdx, convertMdastToHastHandle, createHastHandle, createMdastHandle, createMdxHastHandle, createMdxMdastHandle, dropHandle, getHandleSource, getMdastFrontmatter, getNodeData, mdastTextContentHandle, parseEsm, parseExpression, parseToHtml, renderHandle, serializeHandle, setNodeData, textContentHandle, walkHandle, walkMdastHandle, } from "../browser.js";

package/dist/generated/arena-layout.d.ts

@@ -30,8 +30,8 @@ export declare const HEADER: {
     readonly children_offset: 24;
     readonly type_data_len: 28;
     readonly type_data_offset: 32;
-    readonly source_len: 36;
-    readonly source_offset: 40;
+    readonly string_pool_len: 36;
+    readonly string_pool_offset: 40;
     readonly node_data_count: 44;
     readonly node_data_offset: 48;
 };

package/dist/generated/arena-layout.js

@@ -34,8 +34,8 @@ export const HEADER = {
     children_offset: 24,
     type_data_len: 28,
     type_data_offset: 32,
-    source_len: 36,
-    source_offset: 40,
+    string_pool_len: 36,
+    string_pool_offset: 40,
     node_data_count: 44,
     node_data_offset: 48,
 };

package/dist/hast/hast-reader.d.ts

@@ -29,8 +29,9 @@ export declare class HastReader {
     getNodeData(nodeId: number): string | null;
     get nodeCount(): number;
     get header(): BufferHeader;
-    /** Get the full source string (string pool). */
-    getSource(): string;
+    /** The full string pool (original input + interning heap). Not the document
+     * source as written; for that, read `ctx.source` from a plugin. */
+    getStringPool(): string;
     /** Read a substring from the string pool by byte offset and length. */
     getString(offset: number, len: number): string;
     /** Get position data for a node. */

package/dist/hast/hast-reader.js

@@ -19,7 +19,7 @@ export class HastReader {
     #view;
     #header;
     #textDecoder;
-    #sourceCache = null;
+    #stringPoolCache = null;
     constructor(buffer) {
         if (buffer instanceof Uint8Array) {
             this.#view = new DataView(buffer.buffer, buffer.byteOffset, buffer.byteLength);
@@ -49,8 +49,8 @@ export class HastReader {
             childrenOffset: v.getUint32(HEADER.children_offset, true),
             typeDataLen: v.getUint32(HEADER.type_data_len, true),
             typeDataOffset: v.getUint32(HEADER.type_data_offset, true),
-            sourceLen: v.getUint32(HEADER.source_len, true),
-            sourceOffset: v.getUint32(HEADER.source_offset, true),
+            stringPoolLen: v.getUint32(HEADER.string_pool_len, true),
+            stringPoolOffset: v.getUint32(HEADER.string_pool_offset, true),
             nodeDataCount: v.getUint32(HEADER.node_data_count, true),
             nodeDataOffset: v.getUint32(HEADER.node_data_offset, true),
         };
@@ -87,21 +87,22 @@ export class HastReader {
     get header() {
         return { ...this.#header };
     }
-    /** Get the full source string (string pool). */
-    getSource() {
-        if (this.#sourceCache === null) {
-            const { sourceOffset, sourceLen } = this.#header;
-            const bytes = new Uint8Array(this.#view.buffer, this.#view.byteOffset + sourceOffset, sourceLen);
-            this.#sourceCache = this.#textDecoder.decode(bytes);
+    /** The full string pool (original input + interning heap). Not the document
+     * source as written; for that, read `ctx.source` from a plugin. */
+    getStringPool() {
+        if (this.#stringPoolCache === null) {
+            const { stringPoolOffset, stringPoolLen } = this.#header;
+            const bytes = new Uint8Array(this.#view.buffer, this.#view.byteOffset + stringPoolOffset, stringPoolLen);
+            this.#stringPoolCache = this.#textDecoder.decode(bytes);
         }
-        return this.#sourceCache;
+        return this.#stringPoolCache;
     }
     /** Read a substring from the string pool by byte offset and length. */
     getString(offset, len) {
         if (len === 0)
             return "";
-        const { sourceOffset } = this.#header;
-        const bytes = new Uint8Array(this.#view.buffer, this.#view.byteOffset + sourceOffset + offset, len);
+        const { stringPoolOffset } = this.#header;
+        const bytes = new Uint8Array(this.#view.buffer, this.#view.byteOffset + stringPoolOffset + offset, len);
         return this.#textDecoder.decode(bytes);
     }
     /** Get position data for a node. */

package/dist/index.d.ts

@@ -5,7 +5,7 @@ export type { MdastPluginDefinition, HastPluginDefinition, MdastPluginInput, Has
 export type { HastVisitorInstance, HastVisitorContext, HastFilteredVisitor, HastContent, EstreeProgram, } from "./hast/hast-visitor.js";
 export type { MdastNode, HastNode, DataMap, Data, Position, Point, MdxJsxAttributeNode, MdxJsxExpressionAttributeNode, MdxJsxAttributeValueExpressionNode, MdxJsxAttributeUnion, MdxJsxFlowElement, MdxJsxTextElement, MdxFlowExpression, MdxTextExpression, MdxjsEsm, MdxJsxFlowElementHast, MdxJsxTextElementHast, MdxFlowExpressionHast, MdxTextExpressionHast, MdxjsEsmHast, } from "./types.js";
 export { visitMdastHandle, resolveMdastSubscriptions } from "./mdast/mdast-visitor.js";
-export type { MdastPluginInstance, MdastContent } from "./mdast/mdast-visitor.js";
+export type { MdastPluginInstance, MdastVisitorContext, MdastContent, } from "./mdast/mdast-visitor.js";
 export { visitHastHandle, resolveSubscriptions as resolveHastSubscriptions, } from "./hast/hast-visitor.js";
 export { MdastReader } from "./mdast/mdast-reader.js";
 export { materializeMdastTree } from "./mdast/mdast-materializer.js";

package/dist/mdast/mdast-reader.d.ts

@@ -9,7 +9,9 @@ export declare class MdastReader {
     getNodeData(nodeId: number): string | null;
     get nodeCount(): number;
     get header(): BufferHeader;
-    getSource(): string;
+    /** The full string pool (original input + interning heap). Not the document
+     * source as written; for that, read `ctx.source` from a plugin. */
+    getStringPool(): string;
     getString(offset: number, len: number): string;
     getNode(nodeId: number): MdastNodeRaw;
     /** Fast path: read only the type byte for a node. */

package/dist/mdast/mdast-reader.js

@@ -8,7 +8,7 @@ export class MdastReader {
     #view;
     #header;
     #textDecoder;
-    #sourceCache = null;
+    #stringPoolCache = null;
     constructor(buffer) {
         if (buffer instanceof Uint8Array) {
             this.#view = new DataView(buffer.buffer, buffer.byteOffset, buffer.byteLength);
@@ -38,8 +38,8 @@ export class MdastReader {
             childrenOffset: v.getUint32(HEADER.children_offset, true),
             typeDataLen: v.getUint32(HEADER.type_data_len, true),
             typeDataOffset: v.getUint32(HEADER.type_data_offset, true),
-            sourceLen: v.getUint32(HEADER.source_len, true),
-            sourceOffset: v.getUint32(HEADER.source_offset, true),
+            stringPoolLen: v.getUint32(HEADER.string_pool_len, true),
+            stringPoolOffset: v.getUint32(HEADER.string_pool_offset, true),
             nodeDataCount: v.getUint32(HEADER.node_data_count, true),
             nodeDataOffset: v.getUint32(HEADER.node_data_offset, true),
         };
@@ -73,19 +73,21 @@ export class MdastReader {
     get header() {
         return { ...this.#header };
     }
-    getSource() {
-        if (this.#sourceCache === null) {
-            const { sourceOffset, sourceLen } = this.#header;
-            const bytes = new Uint8Array(this.#view.buffer, this.#view.byteOffset + sourceOffset, sourceLen);
-            this.#sourceCache = this.#textDecoder.decode(bytes);
+    /** The full string pool (original input + interning heap). Not the document
+     * source as written; for that, read `ctx.source` from a plugin. */
+    getStringPool() {
+        if (this.#stringPoolCache === null) {
+            const { stringPoolOffset, stringPoolLen } = this.#header;
+            const bytes = new Uint8Array(this.#view.buffer, this.#view.byteOffset + stringPoolOffset, stringPoolLen);
+            this.#stringPoolCache = this.#textDecoder.decode(bytes);
         }
-        return this.#sourceCache;
+        return this.#stringPoolCache;
     }
     getString(offset, len) {
         if (len === 0)
             return "";
-        const { sourceOffset } = this.#header;
-        const bytes = new Uint8Array(this.#view.buffer, this.#view.byteOffset + sourceOffset + offset, len);
+        const { stringPoolOffset } = this.#header;
+        const bytes = new Uint8Array(this.#view.buffer, this.#view.byteOffset + stringPoolOffset + offset, len);
         return this.#textDecoder.decode(bytes);
     }
     getNode(nodeId) {

package/dist/types.d.ts

@@ -109,8 +109,8 @@ export interface BufferHeader {
     childrenOffset: number;
     typeDataLen: number;
     typeDataOffset: number;
-    sourceLen: number;
-    sourceOffset: number;
+    stringPoolLen: number;
+    stringPoolOffset: number;
     /** Number of nodes that carry an extra JSON `data` blob. */
     nodeDataCount: number;
     /** Offset of the node-data section: `[id u32][len u32][bytes...]` repeated. */

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "satteri",
-  "version": "0.9.2",
+  "version": "0.9.4",
   "description": "High-performance Markdown and MDX processing",
   "repository": {
     "type": "git",
@@ -84,15 +84,15 @@
     ]
   },
   "optionalDependencies": {
-    "@bruits/satteri-linux-x64-gnu": "0.9.2",
-    "@bruits/satteri-linux-arm64-gnu": "0.9.2",
-    "@bruits/satteri-linux-x64-musl": "0.9.2",
-    "@bruits/satteri-linux-arm64-musl": "0.9.2",
-    "@bruits/satteri-darwin-x64": "0.9.2",
-    "@bruits/satteri-darwin-arm64": "0.9.2",
-    "@bruits/satteri-win32-x64-msvc": "0.9.2",
-    "@bruits/satteri-win32-arm64-msvc": "0.9.2",
-    "@bruits/satteri-wasm32-wasi": "0.9.2"
+    "@bruits/satteri-linux-x64-gnu": "0.9.4",
+    "@bruits/satteri-linux-arm64-gnu": "0.9.4",
+    "@bruits/satteri-linux-x64-musl": "0.9.4",
+    "@bruits/satteri-linux-arm64-musl": "0.9.4",
+    "@bruits/satteri-darwin-x64": "0.9.4",
+    "@bruits/satteri-darwin-arm64": "0.9.4",
+    "@bruits/satteri-win32-x64-msvc": "0.9.4",
+    "@bruits/satteri-win32-arm64-msvc": "0.9.4",
+    "@bruits/satteri-wasm32-wasi": "0.9.4"
   },
   "scripts": {
     "build:binary:wasm": "napi build --manifest-path ../../crates/satteri-napi-binding/Cargo.toml --output-dir . --platform --release --esm --strip --target wasm32-wasip1-threads",