stream-markdown-parser 0.0.40 → 0.0.42

package/README.md

@@ -4,11 +4,11 @@
 [![中文版](https://img.shields.io/badge/docs-中文文档-blue)](README.zh-CN.md)
 [![NPM downloads](https://img.shields.io/npm/dm/stream-markdown-parser)](https://www.npmjs.com/package/stream-markdown-parser)
 [![Bundle size](https://img.shields.io/bundlephobia/minzip/stream-markdown-parser)](https://bundlephobia.com/package/stream-markdown-parser)
-[![License](https://img.shields.io/npm/l/stream-markdown-parser)](./LICENSE)
+[![License](https://img.shields.io/npm/l/stream-markdown-parser)](https://github.com/Simon-He95/markstream-vue/blob/main/license)
 
 Pure markdown parser and renderer utilities with streaming support - framework agnostic.
 
-This package contains the core markdown parsing logic extracted from `stream-markdown-parser`, making it usable in any JavaScript/TypeScript project without Vue dependencies.
+This package contains the core markdown parsing logic extracted from `markstream-vue`, making it usable in any JavaScript/TypeScript project without Vue dependencies.
 
 ## Features
 
@@ -42,7 +42,7 @@ yarn add stream-markdown-parser
 
 ## Quick API (TL;DR)
 
-- `getMarkdown(options)` — create a `markdown-it-ts` instance with built-in plugins (task lists, sub/sup, math helpers, etc.). Also accepts `plugin`, `apply`, and `i18n` options.
+- `getMarkdown(msgId?, options?)` — create a `markdown-it-ts` instance with built-in plugins (task lists, sub/sup, math helpers, etc.). Also accepts `plugin`, `apply`, and `i18n` options.
 - `registerMarkdownPlugin(plugin)` / `clearRegisteredMarkdownPlugins()` — add or remove global plugins that run for every `getMarkdown()` call (useful for feature flags or tests).
 - `parseMarkdownToStructure(markdown, md, parseOptions)` — convert Markdown into the streaming-friendly AST consumed by `markstream-vue` and other renderers.
 - `processTokens(tokens)` / `parseInlineTokens(children, content)` — low-level helpers if you want to bypass the built-in AST pipeline.
@@ -59,7 +59,7 @@ parseMarkdownToStructure() → AST (ParsedNode[])
    ↓ feed into your renderer (markstream-vue, custom UI, workers)
 ```
 
-Reuse the same `md` instance when parsing multiple documents—plugin setup is the heaviest step. When integrating with [`markstream-vue`](../../README.md), pass the AST to `<MarkdownRender :nodes="nodes" />` or supply raw `content` and hand it the same parser options.
+Reuse the same `md` instance when parsing multiple documents—plugin setup is the heaviest step. When integrating with [`markstream-vue`](https://www.npmjs.com/package/markstream-vue), pass the AST to `<MarkdownRender :nodes="nodes" />` or supply raw `content` and hand it the same parser options.
 
 ### Incremental / streaming example
 
@@ -78,7 +78,7 @@ async function handleChunk(chunk: string) {
 }
 ```
 
-In the UI layer, render `nodes` with `<MarkdownRender :nodes="nodes" />` to avoid re-parsing. See the [docs usage guide](../../docs/guide/usage.md) for end-to-end wiring.
+In the UI layer, render `nodes` with `<MarkdownRender :nodes="nodes" />` to avoid re-parsing. See the [docs usage guide](https://markstream-vue-docs.simonhe.me/guide/usage) for end-to-end wiring.
 
 ### Basic example
 
@@ -301,7 +301,7 @@ Find the matching closing delimiter in a string, handling nested pairs.
 - **Reuse parser instances**: cache `getMarkdown()` results per worker/request to avoid re-registering plugins.
 - **Server-side parsing**: run `parseMarkdownToStructure` on the server, ship the AST to the client, and hydrate with `markstream-vue` for deterministic output.
 - **Custom HTML widgets**: pre-extract `<MyWidget>` blocks before parsing (replace with placeholders) and reinject them during rendering instead of mutating `html_block` nodes post-parse.
-- **Styling**: when piping nodes into `markstream-vue`, follow the docs [CSS checklist](../../docs/guide/troubleshooting.md#css-looks-wrong-start-here) so Tailwind/UnoCSS don’t override library styles.
+- **Styling**: when piping nodes into `markstream-vue`, follow the docs [CSS checklist](https://markstream-vue-docs.simonhe.me/guide/troubleshooting#css-looks-wrong-start-here) so Tailwind/UnoCSS don’t override library styles.
 - **Error handling**: the `apply` hook swallows exceptions to maintain backwards compatibility. If you want strict mode, wrap your mutators before passing them in and rethrow/log as needed.
 
 #### `parseFenceToken(token)`
@@ -424,7 +424,7 @@ This package comes with the following markdown-it plugins pre-configured:
 While this package is framework-agnostic, it's designed to work seamlessly with:
 
 - ✅ **Node.js** - Server-side rendering
-- ✅ **Vue 3** - Use with `stream-markdown-parser`
+- ✅ **Vue 3** - Use with `markstream-vue` (or your own renderer)
 - ✅ **React** - Use parsed nodes for custom rendering
 - ✅ **Vanilla JS** - Direct HTML rendering
 - ✅ **Any framework** - Parse to AST and render as needed
@@ -464,26 +464,30 @@ worker.addEventListener('message', (event) => {
 
 This pattern keeps Markdown-it work off the main thread and lets you reuse the same AST in any framework.
 
-## Migration from `stream-markdown-parser`
+## Migration from `markstream-vue` (parser exports)
 
-If you're migrating from using the markdown utils in `stream-markdown-parser`:
+If you're currently importing parser helpers from `markstream-vue`, you can switch to the dedicated package:
 
 ```typescript
+// before
+import { getMarkdown } from 'markstream-vue'
+
+// after
 import { getMarkdown } from 'stream-markdown-parser'
 ```
 
-All APIs remain the same. See [migration guide](../../docs/monorepo-migration.md) for details.
+All APIs remain the same. See the [migration guide](https://markstream-vue-docs.simonhe.me/monorepo-migration) for details.
 
 ## Performance
 
 - **Lightweight**: ~65KB minified (13KB gzipped)
 - **Fast**: Optimized for real-time parsing
 - **Tree-shakeable**: Only import what you need
-- **Zero dependencies**: Except for markdown-it and its plugins
+- **Few dependencies**: `markdown-it-ts` + a small set of markdown-it plugins
 
 ## Contributing
 
-Issues and PRs welcome! Please read the [contribution guidelines](../../AGENTS.md).
+Issues and PRs welcome! Please read the [contribution guidelines](https://github.com/Simon-He95/markstream-vue/blob/main/CONTRIBUTING.md).
 
 ## License
 
@@ -491,4 +495,4 @@ MIT © Simon He
 
 ## Related
 
-- [stream-markdown-parser](https://github.com/Simon-He95/markstream-vue) - Full-featured Vue 3 Markdown renderer
+- [markstream-vue](https://www.npmjs.com/package/markstream-vue) - Full-featured Vue 3 Markdown renderer

package/README.zh-CN.md

@@ -4,11 +4,11 @@
 [![English Docs](https://img.shields.io/badge/docs-English-blue)](README.md)
 [![NPM downloads](https://img.shields.io/npm/dm/stream-markdown-parser)](https://www.npmjs.com/package/stream-markdown-parser)
 [![Bundle size](https://img.shields.io/bundlephobia/minzip/stream-markdown-parser)](https://bundlephobia.com/package/stream-markdown-parser)
-[![License](https://img.shields.io/npm/l/stream-markdown-parser)](./LICENSE)
+[![License](https://img.shields.io/npm/l/stream-markdown-parser)](https://github.com/Simon-He95/markstream-vue/blob/main/license)
 
 纯 JavaScript Markdown 解析器和渲染工具，支持流式处理 - 框架无关。
 
-该包包含从 `stream-markdown-parser` 中提取的核心 Markdown 解析逻辑，使其可以在任何 JavaScript/TypeScript 项目中使用，无需 Vue 依赖。
+该包包含从 `markstream-vue` 中提取的核心 Markdown 解析逻辑，使其可以在任何 JavaScript/TypeScript 项目中使用，无需 Vue 依赖。
 
 ## 特性
 
@@ -42,7 +42,7 @@ yarn add stream-markdown-parser
 
 ## 快速 API 速览
 
-- `getMarkdown(options)` — 返回一个预配置的 `markdown-it-ts` 实例；支持 `plugin`、`apply`、`i18n` 等选项（内置任务列表、上下标、数学等插件）。
+- `getMarkdown(msgId?, options?)` — 返回一个预配置的 `markdown-it-ts` 实例；支持 `plugin`、`apply`、`i18n` 等选项（内置任务列表、上下标、数学等插件）。
 - `registerMarkdownPlugin(plugin)` / `clearRegisteredMarkdownPlugins()` — 全局注册/清除插件，在所有 `getMarkdown()` 调用中生效（适合特性开关或测试环境）。
 - `parseMarkdownToStructure(markdown, md, parseOptions)` — 将 Markdown 转换为可供 `markstream-vue` 等渲染器使用的 AST。
 - `processTokens(tokens)` / `parseInlineTokens(children, content)` — 更底层的 token → 节点工具，方便自定义管线。
@@ -59,7 +59,7 @@ parseMarkdownToStructure() → AST (ParsedNode[])
    ↓ 交给你的渲染器（markstream-vue、自定义 UI、Worker 等）
 ```
 
-多次解析时复用同一个 `md` 实例可以避免重复注册插件。与 [`markstream-vue`](../../README.zh-CN.md) 一起使用时，你可以把 AST 传给 `<MarkdownRender :nodes="nodes" />`，或仅传入原始 `content` 并共享同一套解析配置。
+多次解析时复用同一个 `md` 实例可以避免重复注册插件。与 [`markstream-vue`](https://www.npmjs.com/package/markstream-vue) 一起使用时，你可以把 AST 传给 `<MarkdownRender :nodes="nodes" />`，或仅传入原始 `content` 并共享同一套解析配置。
 
 ### 增量 / 流式示例
 
@@ -78,7 +78,7 @@ async function handleChunk(chunk: string) {
 }
 ```
 
-在前端通过 `<MarkdownRender :nodes="nodes" />` 渲染即可避免重复解析。具体串联示例见[文档用法指南](../../docs/zh/guide/usage.md)。
+在前端通过 `<MarkdownRender :nodes="nodes" />` 渲染即可避免重复解析。具体串联示例见[文档用法指南](https://markstream-vue-docs.simonhe.me/zh/guide/usage)。
 
 ### 基础示例
 
@@ -300,7 +300,7 @@ const parseOptions = {
 - **复用解析实例**：缓存 `getMarkdown()` 的结果，避免重复注册插件。
 - **服务端解析**：在服务端运行 `parseMarkdownToStructure` 后把 AST 下发给客户端，配合 `markstream-vue` 实现确定性输出。
 - **自定义 HTML 组件**：在解析前先把 `<MyWidget>` 这类片段替换为占位符，渲染时再注入，避免在 `html_block` 上进行脆弱的字符串操作。
-- **样式提示**：如果将节点交给 `markstream-vue`，务必按照文档的 [CSS 排查清单](../../docs/zh/guide/troubleshooting.md#css-looks-wrong-start-here) 调整 reset / layer，防止 Tailwind/UnoCSS 覆盖样式。
+- **样式提示**：如果将节点交给 `markstream-vue`，务必按照文档的 [CSS 排查清单](https://markstream-vue-docs.simonhe.me/zh/guide/troubleshooting#css-looks-wrong-start-here) 调整 reset / layer，防止 Tailwind/UnoCSS 覆盖样式。
 - **错误处理**：`apply` 钩子内部默认捕获异常后打印日志，如需在 CI/生产中抛出错误，可在传入前自行封装并 rethrow。
 
 #### `parseFenceToken(token)`
@@ -423,31 +423,35 @@ import type {
 虽然该包与框架无关，但它被设计为可以无缝配合以下框架使用：
 
 - ✅ **Node.js** - 服务器端渲染
-- ✅ **Vue 3** - 配合 `stream-markdown-parser` 使用
+- ✅ **Vue 3** - 配合 `markstream-vue`（或你的自定义渲染层）使用
 - ✅ **React** - 使用解析的节点进行自定义渲染
 - ✅ **Vanilla JS** - 直接 HTML 渲染
 - ✅ **任何框架** - 解析为 AST 并按需渲染
 
-## 从 `stream-markdown-parser` 迁移
+## 从 `markstream-vue` 迁移（解析器导出）
 
-如果你正在从 `stream-markdown-parser` 中的 markdown 工具迁移：
+如果你当前是从 `markstream-vue` 引入解析器相关 helper，可以切换为使用独立包：
 
 ```typescript
+// 之前
+import { getMarkdown } from 'markstream-vue'
+
+// 现在
 import { getMarkdown } from 'stream-markdown-parser'
 ```
 
-所有 API 保持不变。详见[迁移指南](../../docs/monorepo-migration.md)。
+所有 API 保持不变。详见[迁移指南](https://markstream-vue-docs.simonhe.me/zh/monorepo-migration)。
 
 ## 性能
 
 - **轻量级**: ~65KB 压缩后（13KB gzipped）
 - **快速**: 针对实时解析优化
 - **Tree-shakeable**: 只导入你需要的部分
-- **零依赖**: 除了 markdown-it 及其插件
+- **依赖很少**: `markdown-it-ts` + 少量 markdown-it 插件
 
 ## 贡献
 
-欢迎提交 Issues 和 PRs！请阅读[贡献指南](../../AGENTS.md)。
+欢迎提交 Issues 和 PRs！请阅读[贡献指南](https://github.com/Simon-He95/markstream-vue/blob/main/CONTRIBUTING.md)。
 
 ## 许可证
 
@@ -455,4 +459,4 @@ MIT © Simon He
 
 ## 相关项目
 
-- [stream-markdown-parser](https://github.com/Simon-He95/markstream-vue) - 功能完整的 Vue 3 Markdown 渲染器
+- [markstream-vue](https://www.npmjs.com/package/markstream-vue) - 功能完整的 Vue 3 Markdown 渲染器

package/dist/index.js

@@ -6888,7 +6888,24 @@ const BASE_COMMON_HTML_TAGS = new Set([
 ]);
 const OPEN_TAG_RE = /<([A-Z][\w-]*)(?=[\s/>]|$)/gi;
 const CLOSE_TAG_RE = /<\/\s*([A-Z][\w-]*)(?=[\s/>]|$)/gi;
-const FULL_TAG_RE = /^<\s*(?:\/\s*)?([A-Z][\w-]*)(?:\s[^>]*?)?\/?>/i;
+const TAG_NAME_AT_START_RE = /^<\s*(?:\/\s*)?([A-Z][\w-]*)/i;
+function findTagCloseIndexOutsideQuotes(html) {
+	let inSingle = false;
+	let inDouble = false;
+	for (let i = 0; i < html.length; i++) {
+		const ch = html[i];
+		if (ch === "\"" && !inSingle) {
+			inDouble = !inDouble;
+			continue;
+		}
+		if (ch === "'" && !inDouble) {
+			inSingle = !inSingle;
+			continue;
+		}
+		if (ch === ">" && !inSingle && !inDouble) return i;
+	}
+	return -1;
+}
 function tokenToRaw$1(token) {
 	const shape = token;
 	return String(shape.raw ?? shape.content ?? shape.markup ?? "");
@@ -6916,7 +6933,7 @@ function findFirstIncompleteTag(content, tagSet) {
 		if (idx < 0) continue;
 		const tag = (m[1] ?? "").toLowerCase();
 		if (!tagSet.has(tag)) continue;
-		if (content.slice(idx).includes(">")) continue;
+		if (findTagCloseIndexOutsideQuotes(content.slice(idx)) !== -1) continue;
 		if (!first || idx < first.index) first = {
 			index: idx,
 			tag,
@@ -6928,7 +6945,7 @@ function findFirstIncompleteTag(content, tagSet) {
 		if (idx < 0) continue;
 		const tag = (m[1] ?? "").toLowerCase();
 		if (!isCommonHtmlTagOrPrefix(tag, tagSet)) continue;
-		if (content.slice(idx).includes(">")) continue;
+		if (findTagCloseIndexOutsideQuotes(content.slice(idx)) !== -1) continue;
 		if (!first || idx < first.index) first = {
 			index: idx,
 			tag,
@@ -6987,14 +7004,21 @@ function fixStreamingHtmlInlineChildren(children, tagSet) {
 				break;
 			}
 			pushTextPart(chunk.slice(cursor, lt), baseToken);
-			const fullMatch = chunk.slice(lt).match(FULL_TAG_RE);
-			if (!fullMatch) {
+			const sub = chunk.slice(lt);
+			const tagMatch = sub.match(TAG_NAME_AT_START_RE);
+			if (!tagMatch) {
+				pushTextPart("<", baseToken);
+				cursor = lt + 1;
+				continue;
+			}
+			const closeIdx = findTagCloseIndexOutsideQuotes(sub);
+			if (closeIdx === -1) {
 				pushTextPart("<", baseToken);
 				cursor = lt + 1;
 				continue;
 			}
-			const tagText = fullMatch[0];
-			const tagName = (fullMatch[1] ?? "").toLowerCase();
+			const tagText = sub.slice(0, closeIdx + 1);
+			const tagName = (tagMatch[1] ?? "").toLowerCase();
 			if (tagSet.has(tagName)) out.push({
 				type: "html_inline",
 				tag: "",
@@ -7025,7 +7049,7 @@ function fixStreamingHtmlInlineChildren(children, tagSet) {
 		if (pending) {
 			pending.buffer += tokenToRaw$1(child);
 			pendingAtEnd = pending.buffer;
-			const closeIdx = pending.buffer.indexOf(">");
+			const closeIdx = findTagCloseIndexOutsideQuotes(pending.buffer);
 			if (closeIdx === -1) continue;
 			const tagChunk = pending.buffer.slice(0, closeIdx + 1);
 			const afterChunk = pending.buffer.slice(closeIdx + 1);
@@ -7040,6 +7064,19 @@ function fixStreamingHtmlInlineChildren(children, tagSet) {
 			if (afterChunk) processTextChunk(afterChunk);
 			continue;
 		}
+		if (child.type === "html_inline") {
+			const content = tokenToRaw$1(child);
+			const tagName = (content.match(TAG_NAME_AT_START_RE)?.[1] ?? "").toLowerCase();
+			if (tagName && tagSet.has(tagName) && findTagCloseIndexOutsideQuotes(content) === -1) {
+				pending = {
+					tag: tagName,
+					buffer: content,
+					closing: /^<\s*\//.test(content)
+				};
+				pendingAtEnd = pending.buffer;
+				continue;
+			}
+		}
 		if (child.type === "text") {
 			const content = String(child.content ?? "");
 			if (!content.includes("<")) {
@@ -7165,16 +7202,26 @@ function applyFixHtmlInlineTokens(md, options = {}) {
 					attrs.push([attrName, attrValue]);
 				}
 				if (customTagSet.has(tag)) {
-					const contentMatch = t.content?.match(new RegExp(`<\\s*${tag}[^>]*>([\\s\\S]*?)<\\s*\\/\\s*${tag}\\s*>`, "i"));
+					const contentMatch = t.content?.match(new RegExp(`<\\s*${tag}[^>]*>([\\s\\S]*)`, "i"));
 					const raw$1 = t.content;
+					const endTagRegex = new RegExp(`</\\s*${tag}\\s*>`, "i");
+					const endTagIndex = t.content?.toLowerCase().indexOf(`</${tag}>`) ?? -1;
 					t.children = [{
 						type: tag,
-						content: contentMatch ? contentMatch[1] : "",
+						content: endTagIndex !== -1 ? contentMatch[1].split(endTagRegex)[0] ? contentMatch ? contentMatch[1] : "" : "" : contentMatch ? contentMatch[1].replace(/<.*$/, "") : "",
 						raw: raw$1,
 						attrs,
 						tag,
 						loading
 					}];
+					if (endTagIndex !== -1) {
+						const afterContent = t.content?.slice(endTagIndex + tag.length + 3) || "";
+						if (afterContent.trim()) toks.splice(i + 1, 0, {
+							type: "text",
+							content: afterContent,
+							raw: afterContent
+						});
+					}
 				} else t.children = [{
 					type: "html_block",
 					content: t.content,
@@ -9591,6 +9638,10 @@ function parseInlineTokens(tokens, raw, pPreToken, options) {
 			case "reference":
 				handleReference(token);
 				break;
+			case "text_special":
+				pushText(String(token.content ?? ""), String(token.content ?? ""));
+				i++;
+				break;
 			default:
 				pushToken(token);
 				i++;