llmtxt 2026.4.1 → 2026.4.4

package/CHANGELOG.md

@@ -7,6 +7,61 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 ## [Unreleased]
 
+## [2026.4.3] - 2026-04-13
+
+### Added
+- **multi-diff**: `multiWayDiff()` — LCS-aligned N-way comparison across up to 5 versions with per-line consensus, divergence, and insertion detection. WASM-backed via `multi_way_diff_wasm`
+- **merge**: `cherryPickMerge()` — section-based cherry-pick merge from multiple versions. Heading-keyed claims, fill-from for unclaimed sections, provenance tracking. WASM-backed via `cherry_pick_merge_wasm`
+- **types**: `MultiDiffResult`, `MultiDiffLine`, `MultiDiffVariant`, `MultiDiffStats`, `CherryPickResult`, `CherryPickProvenance`, `CherryPickStats` interfaces
+- **types**: `"insertion"` line type added to `MultiDiffLine.type` union
+- **backend**: `GET /documents/:slug/multi-diff?versions=2,3,4,5` — multi-version comparison endpoint
+- **backend**: `POST /documents/:slug/merge` — cherry-pick merge endpoint with provenance in changelog
+- **backend**: `agentId` alias accepted on PUT and POST /compress (maps to `createdBy`)
+- **backend**: `targetState` alias accepted on POST /transition (maps to `state`)
+- **backend**: HTTP 423 Locked response on PUT/merge/patch for LOCKED and ARCHIVED documents
+- **backend**: `requireOwnerAllowAnon` middleware — anonymous doc owners can create signed URLs and transition state
+- **backend**: Concurrent version creation wrapped in `BEGIN IMMEDIATE` transactions with retry on UNIQUE violation
+- **backend**: Duplicate approval/rejection prevention (409 Conflict on second attempt from same reviewer)
+- **backend**: Rejections cleared on REVIEW to DRAFT transition for fresh review cycles
+- **backend**: autoLock race protection with atomic `WHERE state=REVIEW` check
+- **frontend**: `MultiDiffViewer` component — version selector, consensus visualization, expandable divergent variants, insertion line rendering
+- **frontend**: `MergeBuilder` component — cherry-pick merge UI with preview, provenance colors, inline validation
+- **frontend**: Version selector dropdown on Content tab with "Version N of M" indicator
+- **frontend**: Token stats clearly label original vs compressed counts
+- **frontend**: Favicons, OG meta tags, Twitter cards, per-page dynamic OG tags
+- **infra**: Cloudflare Configuration Rule bypassing bot detection for api.llmtxt.my
+
+### Changed
+- **backend**: Anonymous sessions can now use lifecycle transitions, approvals, rejections, patches, and signed URL creation
+- **backend**: Merge provenance `fromVersion` uses actual DB version numbers instead of 0-based indices
+- **backend**: Similarity results use `title` field instead of `sectionTitle` (consistent with overview/plan-retrieval)
+- **frontend**: Renamed `state` variable to `docState` to avoid Svelte 5 `$state` rune collision (77 svelte-check errors resolved)
+
+### Fixed
+- Multi-diff false divergence when versions have line insertions/deletions (LCS alignment rewrite)
+- Cherry-pick merge false "Overlapping line ranges" error on multi-version section merge
+- Cherry-pick merge section duplication with hierarchical headings
+- Concurrent version creation race condition (transaction + retry)
+- HTTP 500 from async transaction callbacks in better-sqlite3 (switched to synchronous)
+- Rejection permanently blocking consensus (now cleared on REVIEW to DRAFT)
+- autoLock creating duplicate state transition records on simultaneous approvals
+- LOCKED documents accepting write operations
+
+## [2026.4.2] - 2026-04-01
+
+### Added
+- **diff**: `structuredDiff()` — WASM-backed structured line-level diff returning interleaved `{type, content, oldLine, newLine}` lines with summary counts. Replaces client-side patch parsing and backend set-based diff computation
+- **types**: `StructuredDiffLine` and `StructuredDiffResult` interfaces exported from `llmtxt`
+
+### Changed
+- **diff**: Backend `/documents/:slug/diff` endpoint now returns `lines` array (structured diff) instead of `addedLines`/`removedLines` string arrays
+- **diff**: Frontend `DiffViewer` consumes structured diff lines directly from API — no more client-side unified diff parsing
+- **backend**: PUT `/documents/:slug` now upserts contributor records with accurate token stats via `structuredDiff()`
+- **frontend**: `Contributor` type aligned to actual DB schema fields (`agentId`, `versionsAuthored`, `lastContribution`)
+- **frontend**: Version list redesigned as compact table rows with columns for version, changelog, tokens, contributor, and date
+- **frontend**: Side-by-side comparison view now highlights added/removed lines vs base version
+- **frontend**: Edit page uses `invalidateAll()` before navigation to prevent stale data
+
 ## [2026.4.1] - 2026-03-31
 
 ### Added

package/README.md

@@ -17,6 +17,7 @@ npm install llmtxt
 import {
   compress, decompress, generateId, hashContent,
   createPatch, applyPatch, generateSignedUrl,
+  multiWayDiff, cherryPickMerge,
 } from 'llmtxt';
 
 const compressed = await compress('Hello world');
@@ -28,6 +29,27 @@ const patch = createPatch('hello\n', 'hello world\n');
 const rebuilt = applyPatch('hello\n', patch);
 ```
 
+## Multi-Way Diff and Cherry-Pick Merge
+
+```ts
+import { multiWayDiff, cherryPickMerge } from 'llmtxt';
+
+// Compare multiple agent versions against a base using LCS alignment
+const diff = multiWayDiff(base, JSON.stringify([v2Content, v3Content, v4Content]));
+// Returns MultiDiffResult: { sections, totalVersions, baseTokenCount }
+
+// Selectively merge sections from different versions
+const merged = cherryPickMerge(
+  base,
+  JSON.stringify([v2Content, v3Content]),
+  JSON.stringify([
+    { section: 'Introduction', fromVersion: 1 },
+    { section: 'API Reference', fromVersion: 2 },
+  ])
+);
+// Returns CherryPickResult: { content, provenance, stats }
+```
+
 ## SDK (Collaborative Documents)
 
 ```ts
@@ -50,6 +72,8 @@ import { buildGraph } from 'llmtxt/graph';
 - Compression, hashing, base62, token estimation (Rust WASM)
 - Signed URL generation and verification
 - Unified diff patch creation, application, version reconstruction
+- Multi-way diff across up to 5 agent versions (LCS-aligned, WASM)
+- Cherry-pick merge: selectively assemble sections from multiple versions (WASM)
 - Progressive disclosure: overview, section extraction, content search
 - Collaborative document lifecycle (DRAFT, REVIEW, LOCKED, ARCHIVED)
 - Version stack management with attribution tracking

package/dist/compression.d.ts

@@ -4,6 +4,6 @@
  * All portable primitives delegate to the Rust WASM module — single
  * source of truth, zero drift between TypeScript and Rust consumers.
  */
-export { encodeBase62, decodeBase62, compress, decompress, generateId, hashContent, calculateTokens, calculateCompressionRatio, computeDiff, } from './wasm.js';
-export type { DiffResult } from './wasm.js';
+export { encodeBase62, decodeBase62, compress, decompress, generateId, hashContent, calculateTokens, calculateCompressionRatio, computeDiff, structuredDiff, } from './wasm.js';
+export type { DiffResult, StructuredDiffLine, StructuredDiffResult } from './wasm.js';
 //# sourceMappingURL=compression.d.ts.map

package/dist/compression.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"compression.d.ts","sourceRoot":"","sources":["../src/compression.ts"],"names":[],"mappings":"AAAA;;;;;GAKG;AACH,OAAO,EACL,YAAY,EACZ,YAAY,EACZ,QAAQ,EACR,UAAU,EACV,UAAU,EACV,WAAW,EACX,eAAe,EACf,yBAAyB,EACzB,WAAW,GACZ,MAAM,WAAW,CAAC;AAEnB,YAAY,EAAE,UAAU,EAAE,MAAM,WAAW,CAAC"}
+{"version":3,"file":"compression.d.ts","sourceRoot":"","sources":["../src/compression.ts"],"names":[],"mappings":"AAAA;;;;;GAKG;AACH,OAAO,EACL,YAAY,EACZ,YAAY,EACZ,QAAQ,EACR,UAAU,EACV,UAAU,EACV,WAAW,EACX,eAAe,EACf,yBAAyB,EACzB,WAAW,EACX,cAAc,GACf,MAAM,WAAW,CAAC;AAEnB,YAAY,EAAE,UAAU,EAAE,kBAAkB,EAAE,oBAAoB,EAAE,MAAM,WAAW,CAAC"}

package/dist/compression.js

@@ -4,5 +4,5 @@
  * All portable primitives delegate to the Rust WASM module — single
  * source of truth, zero drift between TypeScript and Rust consumers.
  */
-export { encodeBase62, decodeBase62, compress, decompress, generateId, hashContent, calculateTokens, calculateCompressionRatio, computeDiff, } from './wasm.js';
+export { encodeBase62, decodeBase62, compress, decompress, generateId, hashContent, calculateTokens, calculateCompressionRatio, computeDiff, structuredDiff, } from './wasm.js';
 //# sourceMappingURL=compression.js.map

package/dist/compression.js.map

@@ -1 +1 @@
-{"version":3,"file":"compression.js","sourceRoot":"","sources":["../src/compression.ts"],"names":[],"mappings":"AAAA;;;;;GAKG;AACH,OAAO,EACL,YAAY,EACZ,YAAY,EACZ,QAAQ,EACR,UAAU,EACV,UAAU,EACV,WAAW,EACX,eAAe,EACf,yBAAyB,EACzB,WAAW,GACZ,MAAM,WAAW,CAAC"}
+{"version":3,"file":"compression.js","sourceRoot":"","sources":["../src/compression.ts"],"names":[],"mappings":"AAAA;;;;;GAKG;AACH,OAAO,EACL,YAAY,EACZ,YAAY,EACZ,QAAQ,EACR,UAAU,EACV,UAAU,EACV,WAAW,EACX,eAAe,EACf,yBAAyB,EACzB,WAAW,EACX,cAAc,GACf,MAAM,WAAW,CAAC"}

package/dist/disclosure.d.ts

@@ -1,3 +1,13 @@
+/**
+ * Progressive disclosure: structural analysis, section extraction,
+ * line-range access, content search, and JSONPath queries.
+ *
+ * All logic now lives in `crates/llmtxt-core::disclosure` (Rust/WASM).
+ * This module is a thin TypeScript wrapper that delegates to the WASM
+ * entry-points via `wasm.ts`.
+ *
+ * @see {@link https://github.com/kryptobaseddev/llmtxt/tree/main/crates/llmtxt-core/src/disclosure}
+ */
 /**
  * A logical section identified within a document.
  *
@@ -81,135 +91,5 @@ export interface LineRangeResult {
     /** Number of tokens saved by extracting only this range. */
     tokensSaved: number;
 }
-/**
- * Extract a range of lines from a document, returning content and token statistics.
- *
- * @remarks
- * Line numbers are 1-based and clamped to the document boundaries. This
- * enables agents to request only the portion of a document they need,
- * reducing token consumption.
- *
- * @param content - The full document content.
- * @param start - The 1-based starting line number.
- * @param end - The 1-based ending line number (inclusive).
- * @returns A {@link LineRangeResult} with the extracted content and token savings.
- *
- * @example
- * ```ts
- * const range = getLineRange(doc, 10, 25);
- * console.log(`Saved ${range.tokensSaved} tokens`);
- * ```
- */
-export declare function getLineRange(content: string, start: number, end: number): LineRangeResult;
-/**
- * Search document content for lines matching a query string or regex.
- *
- * @remarks
- * Supports plain-text substring matching (case-insensitive) and regex
- * patterns delimited with slashes (e.g. `/pattern/i`). Results include
- * configurable surrounding context lines to help agents understand each
- * match in context.
- *
- * @param content - The full document content to search.
- * @param query - A plain-text substring or `/regex/flags` pattern.
- * @param contextLines - Number of context lines before and after each match (default: 2).
- * @param maxResults - Maximum number of matches to return (default: 20).
- * @returns An array of {@link SearchResult} objects for each matching line.
- *
- * @example
- * ```ts
- * const hits = searchContent(doc, 'TODO', 3, 10);
- * ```
- */
-export declare function searchContent(content: string, query: string, contextLines?: number, maxResults?: number): SearchResult[];
-/**
- * Detect the structural format of a document using content heuristics.
- *
- * @remarks
- * Applies the following precedence: JSON (valid `JSON.parse`), then
- * markdown (2+ markdown signals such as headings, lists, or links), then
- * code (2+ code signals such as `import`, `function`, or arrow syntax),
- * and finally falls back to plain text.
- *
- * @param content - The document content to classify.
- * @returns The detected format: `"json"`, `"markdown"`, `"code"`, or `"text"`.
- *
- * @example
- * ```ts
- * detectDocumentFormat('# Title\n- item'); // "markdown"
- * ```
- */
-export declare function detectDocumentFormat(content: string): 'json' | 'markdown' | 'code' | 'text';
-/**
- * Generate a structural overview of a document for progressive disclosure.
- *
- * @remarks
- * Detects the document format, splits it into logical sections, computes
- * token counts, and extracts format-specific metadata (JSON keys or
- * markdown table of contents). The overview allows agents to decide
- * which sections to request in full, minimizing total token usage.
- *
- * @param content - The full document content to analyze.
- * @returns A {@link DocumentOverview} with format, sections, and token counts.
- *
- * @example
- * ```ts
- * const overview = generateOverview(markdownDoc);
- * console.log(`${overview.sections.length} sections, ${overview.tokenCount} tokens`);
- * ```
- */
-export declare function generateOverview(content: string): DocumentOverview;
-/**
- * Execute a JSONPath-style query against JSON content.
- *
- * @remarks
- * Parses the content as JSON and resolves the dot/bracket path (e.g.
- * `$.messages[0].content` or `data.items`). Supports wildcard (`*`) for
- * arrays and objects. Throws on invalid JSON or missing keys to provide
- * clear error messages to calling agents.
- *
- * @param content - A valid JSON string to query.
- * @param path - A JSONPath expression (e.g. `"$.key"`, `"items[0].name"`).
- * @returns An object containing the resolved `result`, its `tokenCount`, and the original `path`.
- * @throws Error if the JSON is invalid or the path cannot be resolved.
- *
- * @example
- * ```ts
- * const { result } = queryJsonPath('{"a":{"b":42}}', '$.a.b');
- * // result === 42
- * ```
- */
-export declare function queryJsonPath(content: string, path: string): {
-    result: unknown;
-    tokenCount: number;
-    path: string;
-};
-/**
- * Extract a named section from a document by title.
- *
- * @remarks
- * Searches the document's sections (from {@link generateOverview}) for a
- * matching title using progressively looser comparisons: exact match,
- * substring match, and alphanumeric-only substring match. When
- * `depthAll` is `true`, child sections at deeper nesting levels are
- * included in the extracted content.
- *
- * @param content - The full document content.
- * @param sectionName - The section title (or substring) to search for.
- * @param depthAll - When `true`, include all child sections nested under the match (default: `false`).
- * @returns An object with the matched section, extracted content, and token savings, or `null` if not found.
- *
- * @example
- * ```ts
- * const section = getSection(doc, 'Installation', true);
- * if (section) console.log(section.content);
- * ```
- */
-export declare function getSection(content: string, sectionName: string, depthAll?: boolean): {
-    section: Section;
-    content: string;
-    tokenCount: number;
-    totalTokens: number;
-    tokensSaved: number;
-} | null;
+export { detectDocumentFormat, generateOverview, getLineRange, searchContent, queryJsonPath, getSection, } from './wasm.js';
 //# sourceMappingURL=disclosure.d.ts.map

package/dist/disclosure.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"disclosure.d.ts","sourceRoot":"","sources":["../src/disclosure.ts"],"names":[],"mappings":"AAWA;;;;;;GAMG;AACH,MAAM,WAAW,OAAO;IACtB,6EAA6E;IAC7E,KAAK,EAAE,MAAM,CAAC;IACd,+DAA+D;IAC/D,KAAK,EAAE,MAAM,CAAC;IACd,oDAAoD;IACpD,SAAS,EAAE,MAAM,CAAC;IAClB,8DAA8D;IAC9D,OAAO,EAAE,MAAM,CAAC;IAChB,qDAAqD;IACrD,UAAU,EAAE,MAAM,CAAC;IACnB,0CAA0C;IAC1C,IAAI,EAAE,SAAS,GAAG,UAAU,GAAG,YAAY,GAAG,UAAU,GAAG,OAAO,CAAC;CACpE;AAED;;;;;;;GAOG;AACH,MAAM,WAAW,gBAAgB;IAC/B,oCAAoC;IACpC,MAAM,EAAE,MAAM,GAAG,UAAU,GAAG,MAAM,GAAG,MAAM,CAAC;IAC9C,6CAA6C;IAC7C,SAAS,EAAE,MAAM,CAAC;IAClB,2DAA2D;IAC3D,UAAU,EAAE,MAAM,CAAC;IACnB,sDAAsD;IACtD,QAAQ,EAAE,OAAO,EAAE,CAAC;IACpB,4EAA4E;IAC5E,IAAI,CAAC,EAAE,KAAK,CAAC;QAAE,GAAG,EAAE,MAAM,CAAC;QAAC,IAAI,EAAE,MAAM,CAAC;QAAC,OAAO,EAAE,MAAM,CAAA;KAAE,CAAC,CAAC;IAC7D,oEAAoE;IACpE,GAAG,CAAC,EAAE,KAAK,CAAC;QAAE,KAAK,EAAE,MAAM,CAAC;QAAC,KAAK,EAAE,MAAM,CAAC;QAAC,IAAI,EAAE,MAAM,CAAA;KAAE,CAAC,CAAC;CAC7D;AAED;;GAEG;AACH,MAAM,WAAW,YAAY;IAC3B,gDAAgD;IAChD,IAAI,EAAE,MAAM,CAAC;IACb,0CAA0C;IAC1C,OAAO,EAAE,MAAM,CAAC;IAChB,oEAAoE;IACpE,aAAa,EAAE,MAAM,EAAE,CAAC;IACxB,oEAAoE;IACpE,YAAY,EAAE,MAAM,EAAE,CAAC;CACxB;AAED;;GAEG;AACH,MAAM,WAAW,eAAe;IAC9B,4DAA4D;IAC5D,SAAS,EAAE,MAAM,CAAC;IAClB,sEAAsE;IACtE,OAAO,EAAE,MAAM,CAAC;IAChB,+DAA+D;IAC/D,OAAO,EAAE,MAAM,CAAC;IAChB,uDAAuD;IACvD,UAAU,EAAE,MAAM,CAAC;IACnB,kDAAkD;IAClD,UAAU,EAAE,MAAM,CAAC;IACnB,yDAAyD;IACzD,WAAW,EAAE,MAAM,CAAC;IACpB,4DAA4D;IAC5D,WAAW,EAAE,MAAM,CAAC;CACrB;AAID;;;;;;;;;;;;;;;;;;GAkBG;AACH,wBAAgB,YAAY,CAAC,OAAO,EAAE,MAAM,EAAE,KAAK,EAAE,MAAM,EAAE,GAAG,EAAE,MAAM,GAAG,eAAe,CAqBzF;AAID;;;;;;;;;;;;;;;;;;;GAmBG;AACH,wBAAgB,aAAa,CAC3B,OAAO,EAAE,MAAM,EACf,KAAK,EAAE,MAAM,EACb,YAAY,SAAI,EAChB,UAAU,SAAK,GACd,YAAY,EAAE,CAoChB;AAID;;;;;;;;;;;;;;;;GAgBG;AACH,wBAAgB,oBAAoB,CAAC,OAAO,EAAE,MAAM,GAAG,MAAM,GAAG,UAAU,GAAG,MAAM,GAAG,MAAM,CA6B3F;AAID;;;;;;;;;;;;;;;;;GAiBG;AACH,wBAAgB,gBAAgB,CAAC,OAAO,EAAE,MAAM,GAAG,gBAAgB,CA0BlE;AAID;;;;;;;;;;;;;;;;;;;GAmBG;AACH,wBAAgB,aAAa,CAAC,OAAO,EAAE,MAAM,EAAE,IAAI,EAAE,MAAM,GAAG;IAC5D,MAAM,EAAE,OAAO,CAAC;IAChB,UAAU,EAAE,MAAM,CAAC;IACnB,IAAI,EAAE,MAAM,CAAC;CACd,CASA;AAID;;;;;;;;;;;;;;;;;;;;GAoBG;AACH,wBAAgB,UAAU,CAAC,OAAO,EAAE,MAAM,EAAE,WAAW,EAAE,MAAM,EAAE,QAAQ,UAAQ,GAAG;IAClF,OAAO,EAAE,OAAO,CAAC;IACjB,OAAO,EAAE,MAAM,CAAC;IAChB,UAAU,EAAE,MAAM,CAAC;IACnB,WAAW,EAAE,MAAM,CAAC;IACpB,WAAW,EAAE,MAAM,CAAC;CACrB,GAAG,IAAI,CA2CP"}
+{"version":3,"file":"disclosure.d.ts","sourceRoot":"","sources":["../src/disclosure.ts"],"names":[],"mappings":"AAAA;;;;;;;;;GASG;AAIH;;;;;;GAMG;AACH,MAAM,WAAW,OAAO;IACtB,6EAA6E;IAC7E,KAAK,EAAE,MAAM,CAAC;IACd,+DAA+D;IAC/D,KAAK,EAAE,MAAM,CAAC;IACd,oDAAoD;IACpD,SAAS,EAAE,MAAM,CAAC;IAClB,8DAA8D;IAC9D,OAAO,EAAE,MAAM,CAAC;IAChB,qDAAqD;IACrD,UAAU,EAAE,MAAM,CAAC;IACnB,0CAA0C;IAC1C,IAAI,EAAE,SAAS,GAAG,UAAU,GAAG,YAAY,GAAG,UAAU,GAAG,OAAO,CAAC;CACpE;AAED;;;;;;;GAOG;AACH,MAAM,WAAW,gBAAgB;IAC/B,oCAAoC;IACpC,MAAM,EAAE,MAAM,GAAG,UAAU,GAAG,MAAM,GAAG,MAAM,CAAC;IAC9C,6CAA6C;IAC7C,SAAS,EAAE,MAAM,CAAC;IAClB,2DAA2D;IAC3D,UAAU,EAAE,MAAM,CAAC;IACnB,sDAAsD;IACtD,QAAQ,EAAE,OAAO,EAAE,CAAC;IACpB,4EAA4E;IAC5E,IAAI,CAAC,EAAE,KAAK,CAAC;QAAE,GAAG,EAAE,MAAM,CAAC;QAAC,IAAI,EAAE,MAAM,CAAC;QAAC,OAAO,EAAE,MAAM,CAAA;KAAE,CAAC,CAAC;IAC7D,oEAAoE;IACpE,GAAG,CAAC,EAAE,KAAK,CAAC;QAAE,KAAK,EAAE,MAAM,CAAC;QAAC,KAAK,EAAE,MAAM,CAAC;QAAC,IAAI,EAAE,MAAM,CAAA;KAAE,CAAC,CAAC;CAC7D;AAED;;GAEG;AACH,MAAM,WAAW,YAAY;IAC3B,gDAAgD;IAChD,IAAI,EAAE,MAAM,CAAC;IACb,0CAA0C;IAC1C,OAAO,EAAE,MAAM,CAAC;IAChB,oEAAoE;IACpE,aAAa,EAAE,MAAM,EAAE,CAAC;IACxB,oEAAoE;IACpE,YAAY,EAAE,MAAM,EAAE,CAAC;CACxB;AAED;;GAEG;AACH,MAAM,WAAW,eAAe;IAC9B,4DAA4D;IAC5D,SAAS,EAAE,MAAM,CAAC;IAClB,sEAAsE;IACtE,OAAO,EAAE,MAAM,CAAC;IAChB,+DAA+D;IAC/D,OAAO,EAAE,MAAM,CAAC;IAChB,uDAAuD;IACvD,UAAU,EAAE,MAAM,CAAC;IACnB,kDAAkD;IAClD,UAAU,EAAE,MAAM,CAAC;IACnB,yDAAyD;IACzD,WAAW,EAAE,MAAM,CAAC;IACpB,4DAA4D;IAC5D,WAAW,EAAE,MAAM,CAAC;CACrB;AAQD,OAAO,EACL,oBAAoB,EACpB,gBAAgB,EAChB,YAAY,EACZ,aAAa,EACb,aAAa,EACb,UAAU,GACX,MAAM,WAAW,CAAC"}