stream-markdown-parser 0.0.41 → 0.0.43

package/README.md

@@ -4,11 +4,11 @@
 [![中文版](https://img.shields.io/badge/docs-中文文档-blue)](README.zh-CN.md)
 [![NPM downloads](https://img.shields.io/npm/dm/stream-markdown-parser)](https://www.npmjs.com/package/stream-markdown-parser)
 [![Bundle size](https://img.shields.io/bundlephobia/minzip/stream-markdown-parser)](https://bundlephobia.com/package/stream-markdown-parser)
-[![License](https://img.shields.io/npm/l/stream-markdown-parser)](./LICENSE)
+[![License](https://img.shields.io/npm/l/stream-markdown-parser)](https://github.com/Simon-He95/markstream-vue/blob/main/license)
 
 Pure markdown parser and renderer utilities with streaming support - framework agnostic.
 
-This package contains the core markdown parsing logic extracted from `stream-markdown-parser`, making it usable in any JavaScript/TypeScript project without Vue dependencies.
+This package contains the core markdown parsing logic extracted from `markstream-vue`, making it usable in any JavaScript/TypeScript project without Vue dependencies.
 
 ## Features
 
@@ -42,7 +42,7 @@ yarn add stream-markdown-parser
 
 ## Quick API (TL;DR)
 
-- `getMarkdown(options)` — create a `markdown-it-ts` instance with built-in plugins (task lists, sub/sup, math helpers, etc.). Also accepts `plugin`, `apply`, and `i18n` options.
+- `getMarkdown(msgId?, options?)` — create a `markdown-it-ts` instance with built-in plugins (task lists, sub/sup, math helpers, etc.). Also accepts `plugin`, `apply`, and `i18n` options.
 - `registerMarkdownPlugin(plugin)` / `clearRegisteredMarkdownPlugins()` — add or remove global plugins that run for every `getMarkdown()` call (useful for feature flags or tests).
 - `parseMarkdownToStructure(markdown, md, parseOptions)` — convert Markdown into the streaming-friendly AST consumed by `markstream-vue` and other renderers.
 - `processTokens(tokens)` / `parseInlineTokens(children, content)` — low-level helpers if you want to bypass the built-in AST pipeline.
@@ -59,7 +59,7 @@ parseMarkdownToStructure() → AST (ParsedNode[])
    ↓ feed into your renderer (markstream-vue, custom UI, workers)
 ```
 
-Reuse the same `md` instance when parsing multiple documents—plugin setup is the heaviest step. When integrating with [`markstream-vue`](../../README.md), pass the AST to `<MarkdownRender :nodes="nodes" />` or supply raw `content` and hand it the same parser options.
+Reuse the same `md` instance when parsing multiple documents—plugin setup is the heaviest step. When integrating with [`markstream-vue`](https://www.npmjs.com/package/markstream-vue), pass the AST to `<MarkdownRender :nodes="nodes" />` or supply raw `content` and hand it the same parser options.
 
 ### Incremental / streaming example
 
@@ -78,7 +78,7 @@ async function handleChunk(chunk: string) {
 }
 ```
 
-In the UI layer, render `nodes` with `<MarkdownRender :nodes="nodes" />` to avoid re-parsing. See the [docs usage guide](../../docs/guide/usage.md) for end-to-end wiring.
+In the UI layer, render `nodes` with `<MarkdownRender :nodes="nodes" />` to avoid re-parsing. See the [docs usage guide](https://markstream-vue-docs.simonhe.me/guide/usage) for end-to-end wiring.
 
 ### Basic example
 
@@ -301,7 +301,7 @@ Find the matching closing delimiter in a string, handling nested pairs.
 - **Reuse parser instances**: cache `getMarkdown()` results per worker/request to avoid re-registering plugins.
 - **Server-side parsing**: run `parseMarkdownToStructure` on the server, ship the AST to the client, and hydrate with `markstream-vue` for deterministic output.
 - **Custom HTML widgets**: pre-extract `<MyWidget>` blocks before parsing (replace with placeholders) and reinject them during rendering instead of mutating `html_block` nodes post-parse.
-- **Styling**: when piping nodes into `markstream-vue`, follow the docs [CSS checklist](../../docs/guide/troubleshooting.md#css-looks-wrong-start-here) so Tailwind/UnoCSS don’t override library styles.
+- **Styling**: when piping nodes into `markstream-vue`, follow the docs [CSS checklist](https://markstream-vue-docs.simonhe.me/guide/troubleshooting#css-looks-wrong-start-here) so Tailwind/UnoCSS don’t override library styles.
 - **Error handling**: the `apply` hook swallows exceptions to maintain backwards compatibility. If you want strict mode, wrap your mutators before passing them in and rethrow/log as needed.
 
 #### `parseFenceToken(token)`
@@ -424,7 +424,7 @@ This package comes with the following markdown-it plugins pre-configured:
 While this package is framework-agnostic, it's designed to work seamlessly with:
 
 - ✅ **Node.js** - Server-side rendering
-- ✅ **Vue 3** - Use with `stream-markdown-parser`
+- ✅ **Vue 3** - Use with `markstream-vue` (or your own renderer)
 - ✅ **React** - Use parsed nodes for custom rendering
 - ✅ **Vanilla JS** - Direct HTML rendering
 - ✅ **Any framework** - Parse to AST and render as needed
@@ -464,26 +464,30 @@ worker.addEventListener('message', (event) => {
 
 This pattern keeps Markdown-it work off the main thread and lets you reuse the same AST in any framework.
 
-## Migration from `stream-markdown-parser`
+## Migration from `markstream-vue` (parser exports)
 
-If you're migrating from using the markdown utils in `stream-markdown-parser`:
+If you're currently importing parser helpers from `markstream-vue`, you can switch to the dedicated package:
 
 ```typescript
+// before
+import { getMarkdown } from 'markstream-vue'
+
+// after
 import { getMarkdown } from 'stream-markdown-parser'
 ```
 
-All APIs remain the same. See [migration guide](../../docs/monorepo-migration.md) for details.
+All APIs remain the same. See the [migration guide](https://markstream-vue-docs.simonhe.me/monorepo-migration) for details.
 
 ## Performance
 
 - **Lightweight**: ~65KB minified (13KB gzipped)
 - **Fast**: Optimized for real-time parsing
 - **Tree-shakeable**: Only import what you need
-- **Zero dependencies**: Except for markdown-it and its plugins
+- **Few dependencies**: `markdown-it-ts` + a small set of markdown-it plugins
 
 ## Contributing
 
-Issues and PRs welcome! Please read the [contribution guidelines](../../AGENTS.md).
+Issues and PRs welcome! Please read the [contribution guidelines](https://github.com/Simon-He95/markstream-vue/blob/main/CONTRIBUTING.md).
 
 ## License
 
@@ -491,4 +495,4 @@ MIT © Simon He
 
 ## Related
 
-- [stream-markdown-parser](https://github.com/Simon-He95/markstream-vue) - Full-featured Vue 3 Markdown renderer
+- [markstream-vue](https://www.npmjs.com/package/markstream-vue) - Full-featured Vue 3 Markdown renderer

package/README.zh-CN.md

@@ -4,11 +4,11 @@
 [![English Docs](https://img.shields.io/badge/docs-English-blue)](README.md)
 [![NPM downloads](https://img.shields.io/npm/dm/stream-markdown-parser)](https://www.npmjs.com/package/stream-markdown-parser)
 [![Bundle size](https://img.shields.io/bundlephobia/minzip/stream-markdown-parser)](https://bundlephobia.com/package/stream-markdown-parser)
-[![License](https://img.shields.io/npm/l/stream-markdown-parser)](./LICENSE)
+[![License](https://img.shields.io/npm/l/stream-markdown-parser)](https://github.com/Simon-He95/markstream-vue/blob/main/license)
 
 纯 JavaScript Markdown 解析器和渲染工具，支持流式处理 - 框架无关。
 
-该包包含从 `stream-markdown-parser` 中提取的核心 Markdown 解析逻辑，使其可以在任何 JavaScript/TypeScript 项目中使用，无需 Vue 依赖。
+该包包含从 `markstream-vue` 中提取的核心 Markdown 解析逻辑，使其可以在任何 JavaScript/TypeScript 项目中使用，无需 Vue 依赖。
 
 ## 特性
 
@@ -42,7 +42,7 @@ yarn add stream-markdown-parser
 
 ## 快速 API 速览
 
-- `getMarkdown(options)` — 返回一个预配置的 `markdown-it-ts` 实例；支持 `plugin`、`apply`、`i18n` 等选项（内置任务列表、上下标、数学等插件）。
+- `getMarkdown(msgId?, options?)` — 返回一个预配置的 `markdown-it-ts` 实例；支持 `plugin`、`apply`、`i18n` 等选项（内置任务列表、上下标、数学等插件）。
 - `registerMarkdownPlugin(plugin)` / `clearRegisteredMarkdownPlugins()` — 全局注册/清除插件，在所有 `getMarkdown()` 调用中生效（适合特性开关或测试环境）。
 - `parseMarkdownToStructure(markdown, md, parseOptions)` — 将 Markdown 转换为可供 `markstream-vue` 等渲染器使用的 AST。
 - `processTokens(tokens)` / `parseInlineTokens(children, content)` — 更底层的 token → 节点工具，方便自定义管线。
@@ -59,7 +59,7 @@ parseMarkdownToStructure() → AST (ParsedNode[])
    ↓ 交给你的渲染器（markstream-vue、自定义 UI、Worker 等）
 ```
 
-多次解析时复用同一个 `md` 实例可以避免重复注册插件。与 [`markstream-vue`](../../README.zh-CN.md) 一起使用时，你可以把 AST 传给 `<MarkdownRender :nodes="nodes" />`，或仅传入原始 `content` 并共享同一套解析配置。
+多次解析时复用同一个 `md` 实例可以避免重复注册插件。与 [`markstream-vue`](https://www.npmjs.com/package/markstream-vue) 一起使用时，你可以把 AST 传给 `<MarkdownRender :nodes="nodes" />`，或仅传入原始 `content` 并共享同一套解析配置。
 
 ### 增量 / 流式示例
 
@@ -78,7 +78,7 @@ async function handleChunk(chunk: string) {
 }
 ```
 
-在前端通过 `<MarkdownRender :nodes="nodes" />` 渲染即可避免重复解析。具体串联示例见[文档用法指南](../../docs/zh/guide/usage.md)。
+在前端通过 `<MarkdownRender :nodes="nodes" />` 渲染即可避免重复解析。具体串联示例见[文档用法指南](https://markstream-vue-docs.simonhe.me/zh/guide/usage)。
 
 ### 基础示例
 
@@ -300,7 +300,7 @@ const parseOptions = {
 - **复用解析实例**：缓存 `getMarkdown()` 的结果，避免重复注册插件。
 - **服务端解析**：在服务端运行 `parseMarkdownToStructure` 后把 AST 下发给客户端，配合 `markstream-vue` 实现确定性输出。
 - **自定义 HTML 组件**：在解析前先把 `<MyWidget>` 这类片段替换为占位符，渲染时再注入，避免在 `html_block` 上进行脆弱的字符串操作。
-- **样式提示**：如果将节点交给 `markstream-vue`，务必按照文档的 [CSS 排查清单](../../docs/zh/guide/troubleshooting.md#css-looks-wrong-start-here) 调整 reset / layer，防止 Tailwind/UnoCSS 覆盖样式。
+- **样式提示**：如果将节点交给 `markstream-vue`，务必按照文档的 [CSS 排查清单](https://markstream-vue-docs.simonhe.me/zh/guide/troubleshooting#css-looks-wrong-start-here) 调整 reset / layer，防止 Tailwind/UnoCSS 覆盖样式。
 - **错误处理**：`apply` 钩子内部默认捕获异常后打印日志，如需在 CI/生产中抛出错误，可在传入前自行封装并 rethrow。
 
 #### `parseFenceToken(token)`
@@ -423,31 +423,35 @@ import type {
 虽然该包与框架无关，但它被设计为可以无缝配合以下框架使用：
 
 - ✅ **Node.js** - 服务器端渲染
-- ✅ **Vue 3** - 配合 `stream-markdown-parser` 使用
+- ✅ **Vue 3** - 配合 `markstream-vue`（或你的自定义渲染层）使用
 - ✅ **React** - 使用解析的节点进行自定义渲染
 - ✅ **Vanilla JS** - 直接 HTML 渲染
 - ✅ **任何框架** - 解析为 AST 并按需渲染
 
-## 从 `stream-markdown-parser` 迁移
+## 从 `markstream-vue` 迁移（解析器导出）
 
-如果你正在从 `stream-markdown-parser` 中的 markdown 工具迁移：
+如果你当前是从 `markstream-vue` 引入解析器相关 helper，可以切换为使用独立包：
 
 ```typescript
+// 之前
+import { getMarkdown } from 'markstream-vue'
+
+// 现在
 import { getMarkdown } from 'stream-markdown-parser'
 ```
 
-所有 API 保持不变。详见[迁移指南](../../docs/monorepo-migration.md)。
+所有 API 保持不变。详见[迁移指南](https://markstream-vue-docs.simonhe.me/zh/monorepo-migration)。
 
 ## 性能
 
 - **轻量级**: ~65KB 压缩后（13KB gzipped）
 - **快速**: 针对实时解析优化
 - **Tree-shakeable**: 只导入你需要的部分
-- **零依赖**: 除了 markdown-it 及其插件
+- **依赖很少**: `markdown-it-ts` + 少量 markdown-it 插件
 
 ## 贡献
 
-欢迎提交 Issues 和 PRs！请阅读[贡献指南](../../AGENTS.md)。
+欢迎提交 Issues 和 PRs！请阅读[贡献指南](https://github.com/Simon-He95/markstream-vue/blob/main/CONTRIBUTING.md)。
 
 ## 许可证
 
@@ -455,4 +459,4 @@ MIT © Simon He
 
 ## 相关项目
 
-- [stream-markdown-parser](https://github.com/Simon-He95/markstream-vue) - 功能完整的 Vue 3 Markdown 渲染器
+- [markstream-vue](https://www.npmjs.com/package/markstream-vue) - 功能完整的 Vue 3 Markdown 渲染器

package/dist/index.js

@@ -601,7 +601,7 @@ var require_markdown_it_task_checkbox = /* @__PURE__ */ __commonJS({ "../../node
 }) });
 
 //#endregion
-//#region ../../node_modules/.pnpm/markdown-it-ts@0.0.2/node_modules/markdown-it-ts/dist/chunk-Bp6m_JJh.js
+//#region ../../node_modules/.pnpm/markdown-it-ts@0.0.3/node_modules/markdown-it-ts/dist/chunk-Bp6m_JJh.js
 var import_markdown_it_task_checkbox = /* @__PURE__ */ __toESM(require_markdown_it_task_checkbox(), 1);
 var __defProp = Object.defineProperty;
 var __export = (all) => {
@@ -2187,7 +2187,7 @@ var require_punycode = /* @__PURE__ */ __commonJS({ "../../node_modules/.pnpm/pu
 }) });
 
 //#endregion
-//#region ../../node_modules/.pnpm/markdown-it-ts@0.0.2/node_modules/markdown-it-ts/dist/index.js
+//#region ../../node_modules/.pnpm/markdown-it-ts@0.0.3/node_modules/markdown-it-ts/dist/index.js
 var import_punycode = /* @__PURE__ */ __toESM(require_punycode(), 1);
 var utils_exports = /* @__PURE__ */ __export({
 	arrayReplaceAt: () => arrayReplaceAt,
@@ -5302,35 +5302,20 @@ var StateInline = class {
 		const { src, posMax } = this;
 		const marker = src.charCodeAt(start);
 		let pos = start;
-		let count = 0;
-		while (pos < posMax && src.charCodeAt(pos) === marker) {
-			count++;
-			pos++;
-		}
+		while (pos < posMax && src.charCodeAt(pos) === marker) pos++;
+		const count = pos - start;
 		if (count < 1) return null;
 		const lastChar = start > 0 ? src.charCodeAt(start - 1) : 32;
 		const nextChar = pos < posMax ? src.charCodeAt(pos) : 32;
-		const isLastPunctChar = lastChar === 32 || lastChar === 10;
-		const isNextPunctChar = nextChar === 32 || nextChar === 10;
-		const isLastWhiteSpace = lastChar === 32;
-		const isNextWhiteSpace = nextChar === 32;
-		let can_open = true;
-		let can_close = true;
-		if (isNextWhiteSpace) can_open = false;
-		else if (isNextPunctChar) {
-			if (!(isLastWhiteSpace || isLastPunctChar)) can_open = false;
-		}
-		if (isLastWhiteSpace) can_close = false;
-		else if (isLastPunctChar) {
-			if (!(isNextWhiteSpace || isNextPunctChar)) can_close = false;
-		}
-		if (!canSplitWord) {
-			can_open = can_open && (!isLastPunctChar || isLastWhiteSpace);
-			can_close = can_close && (!isNextPunctChar || isNextWhiteSpace);
-		}
+		const isLastPunctChar = isMdAsciiPunct(lastChar) || isPunctChar(String.fromCharCode(lastChar));
+		const isNextPunctChar = isMdAsciiPunct(nextChar) || isPunctChar(String.fromCharCode(nextChar));
+		const isLastWhiteSpace = isWhiteSpace(lastChar);
+		const isNextWhiteSpace = isWhiteSpace(nextChar);
+		const left_flanking = !isNextWhiteSpace && (!isNextPunctChar || isLastWhiteSpace || isLastPunctChar);
+		const right_flanking = !isLastWhiteSpace && (!isLastPunctChar || isNextWhiteSpace || isNextPunctChar);
 		return {
-			can_open,
-			can_close,
+			can_open: left_flanking && (canSplitWord || !right_flanking || isLastPunctChar),
+			can_close: right_flanking && (canSplitWord || !left_flanking || isNextPunctChar),
 			length: count
 		};
 	}
@@ -9638,6 +9623,10 @@ function parseInlineTokens(tokens, raw, pPreToken, options) {
 			case "reference":
 				handleReference(token);
 				break;
+			case "text_special":
+				pushText(String(token.content ?? ""), String(token.content ?? ""));
+				i++;
+				break;
 			default:
 				pushToken(token);
 				i++;