npm - @semiont/content - Versions diffs - 0.5.5 → 0.5.7 - Mend

@semiont/content 0.5.5 → 0.5.7

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Files changed (5) hide show

package/README.md CHANGED Viewed

@@ -6,7 +6,7 @@
 [![npm downloads](https://img.shields.io/npm/dm/@semiont/content.svg)](https://www.npmjs.com/package/@semiont/content)
 [![License](https://img.shields.io/npm/l/@semiont/content.svg)](https://github.com/The-AI-Alliance/semiont/blob/main/LICENSE)
-Content-addressed storage using SHA-256 checksums with automatic deduplication and W3C compliance.
+Working-tree storage for project resources, with optional git staging, plus PDF text-layer extraction.
 ## Installation
@@ -16,230 +16,115 @@ npm install @semiont/content
 ## Architecture Context
-**Infrastructure Ownership**: In production applications, the representation store is **created and managed by [@semiont/make-meaning](../make-meaning/)'s `startMakeMeaning()` function**, which serves as the single orchestration point for all infrastructure components (EventStore, GraphDB, RepStore, InferenceClient, JobQueue, Workers).
+**Infrastructure Ownership**: In production applications, the working tree store is **created and managed by [@semiont/make-meaning](../make-meaning/)'s `startMakeMeaning()` function**, which serves as the single orchestration point for all infrastructure components. Backend code accesses it as `knowledgeBase.content`.
-The quick start example below shows direct instantiation for **testing, CLI tools, or content management scripts**. For backend integration, access the representation store through the `makeMeaning` context object.
+The quick start example below shows direct instantiation for **testing, CLI tools, or content management scripts**.
 ## Quick Start
 ```typescript
-import { FilesystemRepresentationStore } from '@semiont/content';
+import { WorkingTreeStore, deriveStorageUri } from '@semiont/content';
+import { SemiontProject } from '@semiont/core/node';
-const store = new FilesystemRepresentationStore({
-  basePath: '/path/to/storage'
-});
+const project = new SemiontProject('/path/to/project');
+const store = new WorkingTreeStore(project);
-// Store content - checksum becomes the address
-const content = Buffer.from('Hello, World!');
-const stored = await store.store(content, {
-  mediaType: 'text/plain',
-  language: 'en',
-  rel: 'original'
-});
+// Derive a stable file:// URI from a resource name
+const uri = deriveStorageUri('My Document', 'text/markdown');
+// => "file://my-document.md"
-console.log(stored.checksum); // sha256:abc123...
+// Write content to the working tree (API/GUI/AI path)
+const stored = await store.store(Buffer.from('# My Document\n'), uri);
+console.log(stored.checksum);  // SHA-256 hex of the content
+console.log(stored.byteSize);  // 14
-// Retrieve by checksum
-const retrieved = await store.retrieve(stored.checksum, 'text/plain');
-console.log(retrieved.toString()); // "Hello, World!"
+// Register a file that is already on disk (CLI path)
+const registered = await store.register('file://docs/overview.md');
-// Same content = same checksum (deduplication)
-const duplicate = await store.store(content, {
-  mediaType: 'text/plain',
-  rel: 'copy'
-});
+// Read content back by URI
+const content = await store.retrieve(uri);
+console.log(content.toString()); // "# My Document\n"
-console.log(duplicate.checksum === stored.checksum); // true
+// Move and remove files
+await store.move(uri, 'file://docs/my-document.md');
+await store.remove('file://docs/my-document.md');
 ```
-## Features
+## Working Tree Storage
-- 🔐 **Content-Addressed** - SHA-256 checksum as identifier
-- 🎯 **Automatic Deduplication** - Identical content stored once
-- 🗂️ **Smart Sharding** - 65,536 directories for scalability
-- 📊 **W3C Compliant** - Full representation metadata support
-- 🏷️ **MIME Type Support** - 80+ types with proper extensions
-- 🌍 **Multilingual** - Language and encoding metadata
-## Documentation
-- [API Reference](./docs/API.md) - Complete API documentation
-- [Architecture](./docs/ARCHITECTURE.md) - Design principles
-- [Patterns](./docs/PATTERNS.md) - Usage patterns and best practices
-## Examples
-- [Basic Example](./examples/basic.ts) - Storage and retrieval
-- [Deduplication](./examples/deduplication.ts) - Content addressing benefits
-- [Binary Content](./examples/binary.ts) - Images and documents
-## Storage Architecture
-### Content Addressing
-Every piece of content is addressed by its SHA-256 checksum:
-```typescript
-const checksum = calculateChecksum(content);
-// sha256:5aaa0b72c1f4d8e7a9f2c8b3d4e5f6a7b8c9d0e1f2a3b4c5d6e7f8a9b0c1d2e3
-```
-### Storage Path Structure
-In a semiont project, `basePath` is the project root (the directory containing
-`.semiont/`). The `representations/` directory is committed to version control —
-it is the durable content store for the project.
+The working tree (project root) is the source of truth for file content. Resources are identified by their `file://` URI, which is stable across content changes; moves are tracked by events.
 ```
-my-project/               ← basePath (project root)
-└── representations/
-    └── {mediaType}/      # URL-encoded MIME type
-        └── {ab}/         # First 2 hex chars of checksum
-            └── {cd}/     # Next 2 hex chars (65,536 shards)
-                └── rep-{checksum}.{ext}
+my-project/                  ← project root
+├── .semiont/                ← project config and event log
+└── docs/
+    └── overview.md          ← storageUri "file://docs/overview.md"
 ```
-Example paths:
-```
-representations/text~1plain/5a/aa/rep-5aaa0b72...abc.txt
-representations/image~1png/ff/12/rep-ff123456...def.png
-representations/application~1json/ab/cd/rep-abcd1234...123.json
-```
+There are two write paths:
-### Deduplication
+- **`store(content, storageUri)`** — write bytes to disk. Used when the file does not yet exist and the caller provides content (API/GUI/AI path).
+- **`register(storageUri, expectedChecksum?)`** — read an existing file and record its metadata (CLI path). If `expectedChecksum` is provided and does not match, throws `ChecksumMismatchError`.
-Content-addressed storage provides automatic deduplication:
+Both return the same metadata:
 ```typescript
-// Store same content 100 times
-for (let i = 0; i < 100; i++) {
-  await store.store(identicalContent, metadata);
+interface StoredResource {
+  storageUri: string;    // file:// URI (e.g. "file://docs/overview.md")
+  checksum: string;      // SHA-256 hex of content
+  byteSize: number;      // Size in bytes
+  created: string;       // ISO 8601 timestamp
 }
-// Result: Only ONE file on disk
 ```
-## API Overview
+### Git Integration
-### FilesystemRepresentationStore
+When the project has `[git] sync = true` in `.semiont/config`, the store keeps the git index up to date automatically:
-```typescript
-const store = new FilesystemRepresentationStore({
-  basePath: '/data/storage'  // Root storage directory
-});
-```
+- `store()` / `register()` run `git add`
+- `move()` runs `git mv`
+- `remove()` runs `git rm` (or `git rm --cached` with `keepFile: true`)
-### Store Content
+Every method accepts `{ noGit: true }` to skip staging for a single call. Without git sync, the store falls back to plain filesystem operations.
-```typescript
-const stored = await store.store(
-  content: Buffer,
-  metadata: {
-    mediaType: string;      // Required: MIME type
-    filename?: string;      // Optional: Original filename
-    encoding?: string;      // Optional: Character encoding
-    language?: string;      // Optional: ISO language code
-    rel?: string;          // Optional: Relationship type
-  }
-): Promise<StoredRepresentation>
-```
+## PDF Text-Layer Extraction
-### Retrieve Content
+For native (non-scanned) PDFs, `extractPdfTextLayer()` extracts positioned text using [pdfjs-dist](https://www.npmjs.com/package/pdfjs-dist). It returns `null` for scanned/image-only PDFs.
 ```typescript
-const buffer = await store.retrieve(
-  checksum: string,        // SHA-256 checksum
-  mediaType: string        // MIME type for path lookup
-): Promise<Buffer>
-```
+import { extractPdfTextLayer, locate } from '@semiont/content';
-### Types
+const layer = await extractPdfTextLayer(pdfBytes);
+if (layer) {
+  console.log(layer.text);          // Full extracted text
+  console.log(layer.pages.length);  // Page dimensions in PDF points
-```typescript
-interface StoredRepresentation {
-  '@id': string;           // Content URI
-  checksum: string;        // SHA-256 hex (64 chars)
-  byteSize: number;        // Content size in bytes
-  mediaType: string;       // MIME type
-  created: string;         // ISO 8601 timestamp
-  language?: string;       // ISO language code
-  encoding?: string;       // Character encoding
-  rel?: string;           // Relationship type
+  // Find bounding rectangles for a span of the text (one per line)
+  const rects = locate(layer, 120, 178);
+  // => PdfCoordinate[] in PDF point space (origin: bottom-left)
 }
 ```
-## Supported MIME Types
-The package includes 80+ MIME type mappings:
+Coordinates are in PDF point space, originating from the bottom-left of the page. The Y-flip to canvas pixels happens downstream in the browser; the server has no canvas. The `PdfCoordinate` geometry type lives in `@semiont/core` alongside the viewrect FragmentSelector codec.
-| Type | Extensions | Example |
-|------|-----------|---------|
-| Text | `.txt`, `.md`, `.html`, `.csv` | `text/plain` → `.txt` |
-| Documents | `.pdf`, `.doc`, `.docx` | `application/pdf` → `.pdf` |
-| Images | `.png`, `.jpg`, `.gif`, `.webp` | `image/png` → `.png` |
-| Audio | `.mp3`, `.wav`, `.ogg` | `audio/mpeg` → `.mp3` |
-| Video | `.mp4`, `.webm`, `.mov` | `video/mp4` → `.mp4` |
-| Code | `.js`, `.ts`, `.py`, `.java` | `text/javascript` → `.js` |
-| Data | `.json`, `.xml`, `.yaml` | `application/json` → `.json` |
-Unknown types default to `.dat` extension.
-## W3C Compliance
-Full support for W3C representation metadata:
+## Utilities
 ```typescript
-const stored = await store.store(content, {
-  mediaType: 'text/html',
-  language: 'en-US',
-  encoding: 'UTF-8',
-  rel: 'original'
-});
-// W3C-compliant metadata
-{
-  "@id": "urn:sha256:abc123...",
-  "@type": "Representation",
-  "checksum": "sha256:abc123...",
-  "mediaType": "text/html",
-  "language": "en-US",
-  "encoding": "UTF-8",
-  "rel": "original",
-  "byteSize": 1234,
-  "created": "2024-01-01T00:00:00Z"
-}
+import {
+  calculateChecksum,       // SHA-256 hex of a string or Buffer
+  verifyChecksum,          // Compare content against an expected checksum
+  deriveStorageUri,        // ("My Doc", "text/markdown") → "file://my-doc.md"
+} from '@semiont/content';
 ```
-## Performance
+`deriveStorageUri` takes a `SupportedMediaType`; the media-type registry —
+which types are admitted, their extensions, and their capabilities — lives in
+[@semiont/core](../core/)'s `media-types.ts`. See [docs/mime-types.md](./docs/mime-types.md).
-- **SHA-256 Calculation**: ~500 MB/s on modern CPUs
-- **Write Performance**: Limited by filesystem (typically ~100 MB/s)
-- **Read Performance**: O(1) direct path lookup
-- **Sharding**: 65,536 directories prevent filesystem bottlenecks
-- **Deduplication**: 100% space savings for duplicate content
-## Best Practices
-1. **Use Buffers**: Always pass content as Buffer for binary safety
-2. **Specify MIME Types**: Required for proper file extensions
-3. **Add Language Metadata**: Important for multilingual content
-4. **Handle Missing Content**: Check existence before retrieval
-5. **Monitor Storage**: Track disk usage and shard distribution
-## Error Handling
+## Documentation
-```typescript
-try {
-  const retrieved = await store.retrieve(checksum, mediaType);
-} catch (error) {
-  if (error.code === 'ENOENT') {
-    // Content not found
-  } else if (error.code === 'EACCES') {
-    // Permission denied
-  } else {
-    // Other filesystem error
-  }
-}
-```
+- [API Reference](./docs/API.md) - Complete API documentation
+- [Architecture](./docs/architecture.md) - Design principles
 ## Development
@@ -259,4 +144,4 @@ npm run typecheck
 ## License
-Apache-2.0
+Apache-2.0

package/dist/index.d.ts CHANGED Viewed

@@ -1,5 +1,5 @@
 import { SemiontProject } from '@semiont/core/node';
-import { Logger } from '@semiont/core';
+import { Logger, SupportedMediaType, PdfCoordinate } from '@semiont/core';
 /**
  * WorkingTreeStore - Manages files in the project working tree
@@ -129,37 +129,24 @@ declare class ChecksumMismatchError extends Error {
 }
 /**
- * MIME Type to File Extension Mapping
+ * Storage URI Derivation
  *
- * Maps common MIME types to their standard file extensions.
- * Used by RepresentationStore to save files with proper extensions.
+ * Builds the file:// URI a resource lives at in the working tree from its
+ * name and validated media type. Extensions come from the media-type
+ * registry in @semiont/core; formats are validated upstream at the
+ * create/yield boundary, so the lookup is strict — no fallback.
  */
 /**
- * Get file extension for a MIME type
- *
- * @param mediaType - MIME type (e.g., "text/markdown")
- * @returns File extension with leading dot (e.g., ".md") or ".dat" if unknown
+ * Derive a file:// storage URI from a resource name and media type.
  *
- * @example
- * getExtensionForMimeType('text/markdown') // => '.md'
- * getExtensionForMimeType('image/png')     // => '.png'
- * getExtensionForMimeType('unknown/type')  // => '.dat'
- */
-declare function getExtensionForMimeType(mediaType: string): string;
-/**
- * Derive a file:// storage URI from a resource name and MIME type.
+ * The name is lowercased, runs of non-alphanumeric characters collapse to
+ * single hyphens, and leading/trailing hyphens are stripped.
  *
  * @example
  * deriveStorageUri("My Document", "text/markdown") // => "file://my-document.md"
  */
-declare function deriveStorageUri(name: string, format: string): string;
-/**
- * Check if a MIME type has a known extension mapping
- *
- * @param mediaType - MIME type to check
- * @returns true if extension is known, false if would fallback to .dat
- */
-declare function hasKnownExtension(mediaType: string): boolean;
+declare function deriveStorageUri(name: string, format: SupportedMediaType): string;
 /**
  * Checksum utilities for content verification
@@ -178,5 +165,70 @@ declare function calculateChecksum(content: string | Buffer): string;
  */
 declare function verifyChecksum(content: string | Buffer, checksum: string): boolean;
-export { ChecksumMismatchError, WorkingTreeStore, calculateChecksum, deriveStorageUri, getExtensionForMimeType, hasKnownExtension, verifyChecksum };
-export type { StoredResource };
+/**
+ * PDF Text Layer Types
+ *
+ * Represents the extracted text layer from a native PDF, including per-run (word-level)
+ * geometry in PDF point coordinates originating from the bottom-left of the page
+ * (Y increases upward). The Y-flip to canvas pixels happens downstream in the
+ * browser; the server has no canvas.
+ *
+ * `PdfCoordinate` — the geometry `locate()` emits — lives in `@semiont/core`
+ * alongside the viewrect FragmentSelector codec.
+ */
+/**
+ * A single text item (one text run, roughly a word) from the PDF text layer.
+ * Character offsets refer to positions in `PdfTextLayer.text`.
+ */
+interface PdfTextItem {
+    start: number;
+    end: number;
+    page: number;
+    x: number;
+    y: number;
+    width: number;
+    height: number;
+}
+/** Page dimensions in PDF points */
+interface PdfPageInfo {
+    pageNumber: number;
+    widthPt: number;
+    heightPt: number;
+}
+/**
+ * The full extracted text layer for a PDF.
+ * `text` is the reading-order concatenation across all pages.
+ * Each `item` is one text run carrying its character range into `text` plus PDF-point geometry.
+ */
+interface PdfTextLayer {
+    pages: PdfPageInfo[];
+    text: string;
+    items: PdfTextItem[];
+}
+/**
+ * PDF Text Layer Extraction
+ *
+ * Extracts positioned text from native, non-scanned PDFs using pdfjs-dist.
+ * Returns null for scanned/image-only PDFs (no text items).
+ *
+ * Coordinates are in PDF point space, originating from the bottom-left.
+ * The Y-flip to canvas pixels happens downstream.
+ */
+declare function extractPdfTextLayer(bytes: Uint8Array | Buffer): Promise<PdfTextLayer | null>;
+/**
+ * Locates bounding rectangles for a span of text in a PdfTextLayer
+ * (single-line or multi-line).
+ *
+ * Finds all overlapping items [start, end), groups them by page and line,
+ * and records one bounding rectangle per line as a PdfCoordinate.
+ *
+ * Returns array of PdfCoordinate, one per line of text covered by the span.
+ * Returns empty array if no items overlap the span.
+ */
+declare function locate(layer: PdfTextLayer, start: number, end: number): PdfCoordinate[];
+export { ChecksumMismatchError, WorkingTreeStore, calculateChecksum, deriveStorageUri, extractPdfTextLayer, locate, verifyChecksum };
+export type { PdfPageInfo, PdfTextItem, PdfTextLayer, StoredResource };

package/dist/index.js CHANGED Viewed

@@ -190,105 +190,122 @@ The file on disk differs from the recorded checksum. Has it been modified since
     this.actual = actual;
     this.name = "ChecksumMismatchError";
   }
+  storageUri;
+  expected;
+  actual;
 };
-// src/mime-extensions.ts
-var MIME_TO_EXTENSION = {
-  // Text formats
-  "text/plain": ".txt",
-  "text/markdown": ".md",
-  "text/html": ".html",
-  "text/css": ".css",
-  "text/csv": ".csv",
-  "text/xml": ".xml",
-  // Application formats - structured data
-  "application/json": ".json",
-  "application/xml": ".xml",
-  "application/yaml": ".yaml",
-  "application/x-yaml": ".yaml",
-  // Application formats - documents
-  "application/pdf": ".pdf",
-  "application/msword": ".doc",
-  "application/vnd.openxmlformats-officedocument.wordprocessingml.document": ".docx",
-  "application/vnd.ms-excel": ".xls",
-  "application/vnd.openxmlformats-officedocument.spreadsheetml.sheet": ".xlsx",
-  "application/vnd.ms-powerpoint": ".ppt",
-  "application/vnd.openxmlformats-officedocument.presentationml.presentation": ".pptx",
-  // Application formats - archives
-  "application/zip": ".zip",
-  "application/gzip": ".gz",
-  "application/x-tar": ".tar",
-  "application/x-7z-compressed": ".7z",
-  // Application formats - executables/binaries
-  "application/octet-stream": ".bin",
-  "application/wasm": ".wasm",
-  // Image formats
-  "image/png": ".png",
-  "image/jpeg": ".jpg",
-  "image/gif": ".gif",
-  "image/webp": ".webp",
-  "image/svg+xml": ".svg",
-  "image/bmp": ".bmp",
-  "image/tiff": ".tiff",
-  "image/x-icon": ".ico",
-  // Audio formats
-  "audio/mpeg": ".mp3",
-  "audio/wav": ".wav",
-  "audio/ogg": ".ogg",
-  "audio/webm": ".webm",
-  "audio/aac": ".aac",
-  "audio/flac": ".flac",
-  // Video formats
-  "video/mp4": ".mp4",
-  "video/mpeg": ".mpeg",
-  "video/webm": ".webm",
-  "video/ogg": ".ogv",
-  "video/quicktime": ".mov",
-  "video/x-msvideo": ".avi",
-  // Programming languages
-  "text/javascript": ".js",
-  "application/javascript": ".js",
-  "text/x-typescript": ".ts",
-  "application/typescript": ".ts",
-  "text/x-python": ".py",
-  "text/x-java": ".java",
-  "text/x-c": ".c",
-  "text/x-c++": ".cpp",
-  "text/x-csharp": ".cs",
-  "text/x-go": ".go",
-  "text/x-rust": ".rs",
-  "text/x-ruby": ".rb",
-  "text/x-php": ".php",
-  "text/x-swift": ".swift",
-  "text/x-kotlin": ".kt",
-  "text/x-shell": ".sh",
-  // Font formats
-  "font/woff": ".woff",
-  "font/woff2": ".woff2",
-  "font/ttf": ".ttf",
-  "font/otf": ".otf"
-};
-function getExtensionForMimeType(mediaType) {
-  const normalized = mediaType.toLowerCase().split(";")[0].trim();
-  const extension = MIME_TO_EXTENSION[normalized];
-  return extension || ".dat";
-}
+// src/storage-uri.ts
+import { MEDIA_TYPES } from "@semiont/core";
 function deriveStorageUri(name, format) {
   const slug = name.toLowerCase().replace(/[^a-z0-9]+/g, "-").replace(/^-|-$/g, "");
-  const ext = getExtensionForMimeType(format);
-  return `file://${slug}${ext}`;
+  return `file://${slug}${MEDIA_TYPES[format].extension}`;
+}
+// src/extract-pdf-text-layer.ts
+import * as pdfjs from "pdfjs-dist/legacy/build/pdf.mjs";
+async function extractPdfTextLayer(bytes) {
+  const doc = await pdfjs.getDocument({ data: bytes }).promise;
+  try {
+    const pages = [];
+    const items = [];
+    let text = "";
+    let hasAnyTextItems = false;
+    for (let pageNum = 1; pageNum <= doc.numPages; pageNum++) {
+      const page = await doc.getPage(pageNum);
+      const viewport = page.getViewport({ scale: 1 });
+      const content = await page.getTextContent();
+      pages.push({
+        pageNumber: pageNum,
+        widthPt: viewport.width,
+        heightPt: viewport.height
+      });
+      for (const item of content.items) {
+        if (!("str" in item)) continue;
+        if (item.str.trim()) {
+          hasAnyTextItems = true;
+          const start = text.length;
+          text += item.str;
+          const end = text.length;
+          const [, , , , x, y] = item.transform;
+          items.push({
+            start,
+            end,
+            page: pageNum,
+            x,
+            y,
+            width: item.width,
+            height: item.height
+          });
+          text += item.hasEOL ? "\n" : " ";
+        } else if (item.hasEOL) {
+          text += "\n";
+        }
+      }
+      text += "\n";
+    }
+    if (!hasAnyTextItems) return null;
+    return { pages, text, items };
+  } finally {
+    await doc.destroy();
+  }
+}
+// src/locate.ts
+var SAME_LINE_THRESHOLD_PT = 2;
+function locate(layer, start, end) {
+  const overlap = layer.items.filter(
+    (item) => item.start < end && item.end > start
+  );
+  if (overlap.length === 0) return [];
+  const pages = groupItemsByPage(overlap);
+  const rects = [];
+  for (const [page, pageItems] of pages) {
+    const lines = groupItemsByLine(pageItems, SAME_LINE_THRESHOLD_PT);
+    for (const lineItems of lines) {
+      const x = Math.min(...lineItems.map((i) => i.x));
+      const right = Math.max(...lineItems.map((i) => i.x + i.width));
+      const y = Math.min(...lineItems.map((i) => i.y));
+      const top = Math.max(...lineItems.map((i) => i.y + i.height));
+      rects.push({ page, x, y, width: right - x, height: top - y });
+    }
+  }
+  return rects;
 }
-function hasKnownExtension(mediaType) {
-  const normalized = mediaType.toLowerCase().split(";")[0].trim();
-  return normalized in MIME_TO_EXTENSION;
+function groupItemsByPage(items) {
+  const map = /* @__PURE__ */ new Map();
+  for (const item of items) {
+    const existing = map.get(item.page);
+    if (existing) {
+      existing.push(item);
+    } else {
+      map.set(item.page, [item]);
+    }
+  }
+  return map;
+}
+function groupItemsByLine(items, sameLineThreshold) {
+  const sorted = [...items].sort((a, b) => b.y - a.y || a.x - b.x);
+  const lines = [];
+  let currentLine = [];
+  for (const item of sorted) {
+    if (currentLine.length === 0 || Math.abs(item.y - currentLine[0].y) <= sameLineThreshold) {
+      currentLine.push(item);
+    } else {
+      lines.push(currentLine);
+      currentLine = [item];
+    }
+  }
+  if (currentLine.length > 0) lines.push(currentLine);
+  return lines;
 }
 export {
   ChecksumMismatchError,
   WorkingTreeStore,
   calculateChecksum,
   deriveStorageUri,
-  getExtensionForMimeType,
-  hasKnownExtension,
+  extractPdfTextLayer,
+  locate,
   verifyChecksum
 };
 //# sourceMappingURL=index.js.map

package/dist/index.js.map CHANGED Viewed

	@@ -1 +1 @@
1	- {"version":3,"sources":["../src/working-tree-store.ts","../src/checksum.ts","../src/mime-extensions.ts"],"sourcesContent":["/*\n WorkingTreeStore - Manages files in the project working tree\n \n Unlike the old content-addressed RepresentationStore, this store treats\n * the working tree (project root) as the source of truth for file content.\n * Resources are identified by their file:// URI, which is stable across\n * content changes and moves (tracked by events).\n \n Two write paths:\n * - store(content, storageUri): Write bytes to disk (API/GUI/AI path).\n * Used when the file does not yet exist and the caller provides content.\n * - register(storageUri, expectedChecksum?): Read an existing file and\n * return its metadata (CLI path). The file is already on disk; we just\n * verify and record it. If expectedChecksum is provided, throws on mismatch.\n \n Storage layout:\n * {projectRoot}/{path-from-uri}\n \n For example, storageUri \"file://docs/overview.md\" resolves to\n * {projectRoot}/docs/overview.md\n /\n\nimport { promises as fs } from 'fs';\nimport { execFileSync } from 'child_process';\nimport path from 'path';\nimport type { SemiontProject } from '@semiont/core/node';\nimport type { Logger } from '@semiont/core';\nimport { calculateChecksum, verifyChecksum } from './checksum';\n\n/\n Result of store() or register()\n /\nexport interface StoredResource {\n storageUri: string; // file:// URI (e.g. \"file://docs/overview.md\")\n checksum: string; // SHA-256 hex of content\n byteSize: number; // Size in bytes\n created: string; // ISO 8601 timestamp\n}\n\n/\n Manages files in the project working tree\n /\nexport class WorkingTreeStore {\n private projectRoot: string;\n private gitSync: boolean;\n private logger?: Logger;\n\n constructor(project: SemiontProject, logger?: Logger) {\n this.projectRoot = project.root;\n this.gitSync = project.gitSync;\n this.logger = logger;\n }\n\n private shouldRunGit(noGit?: boolean): boolean {\n return this.gitSync && !noGit;\n }\n\n /\n Write content to disk at the location indicated by storageUri.\n \n API/GUI/AI path: caller provides bytes; file may not yet exist.\n \n @param content - Raw bytes to write\n * @param storageUri - file:// URI (e.g. \"file://docs/overview.md\")\n * @returns Stored resource metadata\n /\n async store(content: Buffer, storageUri: string, options?: { noGit?: boolean }): Promise<StoredResource> {\n const filePath = this.resolveUri(storageUri);\n const checksum = calculateChecksum(content);\n\n this.logger?.debug('Storing resource', { storageUri, byteSize: content.length });\n\n await fs.mkdir(path.dirname(filePath), { recursive: true });\n await fs.writeFile(filePath, content);\n\n if (this.shouldRunGit(options?.noGit)) {\n execFileSync('git', ['add', filePath], { cwd: this.projectRoot });\n }\n\n this.logger?.info('Resource stored', { storageUri, checksum, byteSize: content.length });\n\n return {\n storageUri,\n checksum,\n byteSize: content.length,\n created: new Date().toISOString(),\n };\n }\n\n /\n Read an existing file and return its metadata.\n \n CLI path: the file is already on disk. We read it to compute the checksum.\n * If expectedChecksum is provided, throws ChecksumMismatchError on mismatch.\n \n @param storageUri - file:// URI (e.g. \"file://docs/overview.md\")\n * @param expectedChecksum - Optional SHA-256 to verify against\n * @returns Stored resource metadata\n * @throws ChecksumMismatchError if expectedChecksum is provided and does not match\n * @throws Error if file does not exist\n /\n async register(storageUri: string, expectedChecksum?: string, options?: { noGit?: boolean }): Promise<StoredResource> {\n const filePath = this.resolveUri(storageUri);\n\n this.logger?.debug('Registering resource', { storageUri });\n\n const content = await fs.readFile(filePath);\n const checksum = calculateChecksum(content);\n\n if (expectedChecksum !== undefined && !verifyChecksum(content, expectedChecksum)) {\n throw new ChecksumMismatchError(storageUri, expectedChecksum, checksum);\n }\n\n if (this.shouldRunGit(options?.noGit)) {\n execFileSync('git', ['add', filePath], { cwd: this.projectRoot });\n }\n\n this.logger?.info('Resource registered', { storageUri, checksum, byteSize: content.length });\n\n return {\n storageUri,\n checksum,\n byteSize: content.length,\n created: new Date().toISOString(),\n };\n }\n\n /\n Read file content by URI.\n \n @param storageUri - file:// URI\n * @returns Raw bytes\n /\n async retrieve(storageUri: string): Promise<Buffer> {\n const filePath = this.resolveUri(storageUri);\n try {\n return await fs.readFile(filePath);\n } catch (error: any) {\n if (error.code === 'ENOENT') {\n throw new Error(`Resource not found: ${storageUri}`);\n }\n throw error;\n }\n }\n\n /\n Move a file from one URI to another.\n \n If .git/ exists in the project root and noGit is not set, runs `git mv`.\n * Otherwise (no .git/ or noGit: true), runs fs.rename.\n \n @param fromUri - Current file:// URI\n * @param toUri - New file:// URI\n * @param options.noGit - Skip git mv even if .git/ is present\n /\n async move(fromUri: string, toUri: string, options?: { noGit?: boolean }): Promise<void> {\n const fromPath = this.resolveUri(fromUri);\n const toPath = this.resolveUri(toUri);\n\n this.logger?.debug('Moving resource', { fromUri, toUri });\n\n await fs.mkdir(path.dirname(toPath), { recursive: true });\n\n if (this.shouldRunGit(options?.noGit)) {\n // git mv handles both the filesystem rename and the index update\n execFileSync('git', ['mv', fromPath, toPath], { cwd: this.projectRoot });\n } else {\n await fs.rename(fromPath, toPath);\n }\n\n this.logger?.info('Resource moved', { fromUri, toUri });\n }\n\n /\n Remove a file from the working tree.\n \n If .git/ exists and noGit is not set:\n * - keepFile false (default): runs `git rm` (removes from index and disk)\n * - keepFile true: runs `git rm --cached` (removes from index only, file stays on disk)\n * If no .git/ or noGit: true:\n * - keepFile false: runs fs.unlink\n * - keepFile true: no-op on filesystem\n \n @param storageUri - file:// URI\n * @param options.noGit - Skip git rm even if .git/ is present\n * @param options.keepFile - Remove from git index only; leave file on disk\n /\n async remove(storageUri: string, options?: { noGit?: boolean; keepFile?: boolean }): Promise<void> {\n const filePath = this.resolveUri(storageUri);\n const keepFile = options?.keepFile ?? false;\n\n this.logger?.debug('Removing resource', { storageUri, keepFile });\n\n const useGit = this.shouldRunGit(options?.noGit);\n\n if (useGit) {\n const gitArgs = keepFile\n ? ['rm', '--cached', filePath]\n : ['rm', filePath];\n execFileSync('git', gitArgs, { cwd: this.projectRoot });\n this.logger?.info('Resource removed', { storageUri, keepFile, git: true });\n return;\n }\n\n if (keepFile) {\n this.logger?.info('Resource removed from index (file kept on disk)', { storageUri });\n return;\n }\n\n try {\n await fs.unlink(filePath);\n this.logger?.info('Resource removed', { storageUri });\n } catch (error: any) {\n if (error.code === 'ENOENT') {\n this.logger?.warn('Resource file already absent', { storageUri });\n return;\n }\n throw error;\n }\n }\n\n /\n Convert a file:// URI to an absolute filesystem path.\n \n \"file://docs/overview.md\" → \"{projectRoot}/docs/overview.md\"\n \n @param storageUri - file:// URI\n * @returns Absolute path\n /\n resolveUri(storageUri: string): string {\n if (!storageUri.startsWith('file://')) {\n throw new Error(`Invalid storage URI (must start with file://): ${storageUri}`);\n }\n const relativePath = storageUri.slice('file://'.length);\n return path.join(this.projectRoot, relativePath);\n }\n}\n\n/\n Thrown when a registered file's checksum does not match the expected value.\n * This indicates the file on disk differs from what was recorded (e.g. modified\n * after staging, or wrong file path provided).\n /\nexport class ChecksumMismatchError extends Error {\n constructor(\n readonly storageUri: string,\n readonly expected: string,\n readonly actual: string,\n ) {\n super(\n `Checksum mismatch for ${storageUri}: expected ${expected.slice(0, 8)}... but got ${actual.slice(0, 8)}...\\n` +\n `The file on disk differs from the recorded checksum. Has it been modified since staging?`\n );\n this.name = 'ChecksumMismatchError';\n }\n}\n","/\n Checksum utilities for content verification\n /\n\nimport { createHash } from 'crypto';\n\n/\n Calculate SHA-256 checksum of content\n * @param content The content to hash\n * @returns Hex-encoded SHA-256 hash\n /\nexport function calculateChecksum(content: string \| Buffer): string {\n const hash = createHash('sha256');\n hash.update(content);\n return hash.digest('hex');\n}\n\n/\n Verify content against a checksum\n * @param content The content to verify\n * @param checksum The expected checksum\n * @returns True if content matches checksum\n /\nexport function verifyChecksum(content: string \| Buffer, checksum: string): boolean {\n return calculateChecksum(content) === checksum;\n}\n","/\n MIME Type to File Extension Mapping\n \n Maps common MIME types to their standard file extensions.\n * Used by RepresentationStore to save files with proper extensions.\n /\n\n/\n Comprehensive MIME type to extension mapping\n /\nconst MIME_TO_EXTENSION: Record<string, string> = {\n // Text formats\n 'text/plain': '.txt',\n 'text/markdown': '.md',\n 'text/html': '.html',\n 'text/css': '.css',\n 'text/csv': '.csv',\n 'text/xml': '.xml',\n\n // Application formats - structured data\n 'application/json': '.json',\n 'application/xml': '.xml',\n 'application/yaml': '.yaml',\n 'application/x-yaml': '.yaml',\n\n // Application formats - documents\n 'application/pdf': '.pdf',\n 'application/msword': '.doc',\n 'application/vnd.openxmlformats-officedocument.wordprocessingml.document': '.docx',\n 'application/vnd.ms-excel': '.xls',\n 'application/vnd.openxmlformats-officedocument.spreadsheetml.sheet': '.xlsx',\n 'application/vnd.ms-powerpoint': '.ppt',\n 'application/vnd.openxmlformats-officedocument.presentationml.presentation': '.pptx',\n\n // Application formats - archives\n 'application/zip': '.zip',\n 'application/gzip': '.gz',\n 'application/x-tar': '.tar',\n 'application/x-7z-compressed': '.7z',\n\n // Application formats - executables/binaries\n 'application/octet-stream': '.bin',\n 'application/wasm': '.wasm',\n\n // Image formats\n 'image/png': '.png',\n 'image/jpeg': '.jpg',\n 'image/gif': '.gif',\n 'image/webp': '.webp',\n 'image/svg+xml': '.svg',\n 'image/bmp': '.bmp',\n 'image/tiff': '.tiff',\n 'image/x-icon': '.ico',\n\n // Audio formats\n 'audio/mpeg': '.mp3',\n 'audio/wav': '.wav',\n 'audio/ogg': '.ogg',\n 'audio/webm': '.webm',\n 'audio/aac': '.aac',\n 'audio/flac': '.flac',\n\n // Video formats\n 'video/mp4': '.mp4',\n 'video/mpeg': '.mpeg',\n 'video/webm': '.webm',\n 'video/ogg': '.ogv',\n 'video/quicktime': '.mov',\n 'video/x-msvideo': '.avi',\n\n // Programming languages\n 'text/javascript': '.js',\n 'application/javascript': '.js',\n 'text/x-typescript': '.ts',\n 'application/typescript': '.ts',\n 'text/x-python': '.py',\n 'text/x-java': '.java',\n 'text/x-c': '.c',\n 'text/x-c++': '.cpp',\n 'text/x-csharp': '.cs',\n 'text/x-go': '.go',\n 'text/x-rust': '.rs',\n 'text/x-ruby': '.rb',\n 'text/x-php': '.php',\n 'text/x-swift': '.swift',\n 'text/x-kotlin': '.kt',\n 'text/x-shell': '.sh',\n\n // Font formats\n 'font/woff': '.woff',\n 'font/woff2': '.woff2',\n 'font/ttf': '.ttf',\n 'font/otf': '.otf',\n};\n\n/\n Get file extension for a MIME type\n \n @param mediaType - MIME type (e.g., \"text/markdown\")\n * @returns File extension with leading dot (e.g., \".md\") or \".dat\" if unknown\n \n @example\n * getExtensionForMimeType('text/markdown') // => '.md'\n * getExtensionForMimeType('image/png') // => '.png'\n * getExtensionForMimeType('unknown/type') // => '.dat'\n /\nexport function getExtensionForMimeType(mediaType: string): string {\n // Normalize MIME type (lowercase, remove parameters)\n const normalized = mediaType.toLowerCase().split(';')[0]!.trim();\n\n // Look up in mapping\n const extension = MIME_TO_EXTENSION[normalized];\n\n // Return mapped extension or fallback to .dat\n return extension \|\| '.dat';\n}\n\n/\n Derive a file:// storage URI from a resource name and MIME type.\n \n @example\n * deriveStorageUri(\"My Document\", \"text/markdown\") // => \"file://my-document.md\"\n /\nexport function deriveStorageUri(name: string, format: string): string {\n const slug = name\n .toLowerCase()\n .replace(/[^a-z0-9]+/g, '-')\n .replace(/^-\|-$/g, '');\n const ext = getExtensionForMimeType(format);\n return `file://${slug}${ext}`;\n}\n\n/\n Check if a MIME type has a known extension mapping\n \n @param mediaType - MIME type to check\n * @returns true if extension is known, false if would fallback to .dat\n */\nexport function hasKnownExtension(mediaType: string): boolean {\n const normalized = mediaType.toLowerCase().split(';')[0]!.trim();\n return normalized in MIME_TO_EXTENSION;\n}\n"],"mappings":";AAsBA,SAAS,YAAY,UAAU;AAC/B,SAAS,oBAAoB;AAC7B,OAAO,UAAU;;;ACpBjB,SAAS,kBAAkB;AAOpB,SAAS,kBAAkB,SAAkC;AAClE,QAAM,OAAO,WAAW,QAAQ;AAChC,OAAK,OAAO,OAAO;AACnB,SAAO,KAAK,OAAO,KAAK;AAC1B;AAQO,SAAS,eAAe,SAA0B,UAA2B;AAClF,SAAO,kBAAkB,OAAO,MAAM;AACxC;;;ADiBO,IAAM,mBAAN,MAAuB;AAAA,EACpB;AAAA,EACA;AAAA,EACA;AAAA,EAER,YAAY,SAAyB,QAAiB;AACpD,SAAK,cAAc,QAAQ;AAC3B,SAAK,UAAU,QAAQ;AACvB,SAAK,SAAS;AAAA,EAChB;AAAA,EAEQ,aAAa,OAA0B;AAC7C,WAAO,KAAK,WAAW,CAAC;AAAA,EAC1B;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAWA,MAAM,MAAM,SAAiB,YAAoB,SAAwD;AACvG,UAAM,WAAW,KAAK,WAAW,UAAU;AAC3C,UAAM,WAAW,kBAAkB,OAAO;AAE1C,SAAK,QAAQ,MAAM,oBAAoB,EAAE,YAAY,UAAU,QAAQ,OAAO,CAAC;AAE/E,UAAM,GAAG,MAAM,KAAK,QAAQ,QAAQ,GAAG,EAAE,WAAW,KAAK,CAAC;AAC1D,UAAM,GAAG,UAAU,UAAU,OAAO;AAEpC,QAAI,KAAK,aAAa,SAAS,KAAK,GAAG;AACrC,mBAAa,OAAO,CAAC,OAAO,QAAQ,GAAG,EAAE,KAAK,KAAK,YAAY,CAAC;AAAA,IAClE;AAEA,SAAK,QAAQ,KAAK,mBAAmB,EAAE,YAAY,UAAU,UAAU,QAAQ,OAAO,CAAC;AAEvF,WAAO;AAAA,MACL;AAAA,MACA;AAAA,MACA,UAAU,QAAQ;AAAA,MAClB,UAAS,oBAAI,KAAK,GAAE,YAAY;AAAA,IAClC;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAcA,MAAM,SAAS,YAAoB,kBAA2B,SAAwD;AACpH,UAAM,WAAW,KAAK,WAAW,UAAU;AAE3C,SAAK,QAAQ,MAAM,wBAAwB,EAAE,WAAW,CAAC;AAEzD,UAAM,UAAU,MAAM,GAAG,SAAS,QAAQ;AAC1C,UAAM,WAAW,kBAAkB,OAAO;AAE1C,QAAI,qBAAqB,UAAa,CAAC,eAAe,SAAS,gBAAgB,GAAG;AAChF,YAAM,IAAI,sBAAsB,YAAY,kBAAkB,QAAQ;AAAA,IACxE;AAEA,QAAI,KAAK,aAAa,SAAS,KAAK,GAAG;AACrC,mBAAa,OAAO,CAAC,OAAO,QAAQ,GAAG,EAAE,KAAK,KAAK,YAAY,CAAC;AAAA,IAClE;AAEA,SAAK,QAAQ,KAAK,uBAAuB,EAAE,YAAY,UAAU,UAAU,QAAQ,OAAO,CAAC;AAE3F,WAAO;AAAA,MACL;AAAA,MACA;AAAA,MACA,UAAU,QAAQ;AAAA,MAClB,UAAS,oBAAI,KAAK,GAAE,YAAY;AAAA,IAClC;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAQA,MAAM,SAAS,YAAqC;AAClD,UAAM,WAAW,KAAK,WAAW,UAAU;AAC3C,QAAI;AACF,aAAO,MAAM,GAAG,SAAS,QAAQ;AAAA,IACnC,SAAS,OAAY;AACnB,UAAI,MAAM,SAAS,UAAU;AAC3B,cAAM,IAAI,MAAM,uBAAuB,UAAU,EAAE;AAAA,MACrD;AACA,YAAM;AAAA,IACR;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAYA,MAAM,KAAK,SAAiB,OAAe,SAA8C;AACvF,UAAM,WAAW,KAAK,WAAW,OAAO;AACxC,UAAM,SAAS,KAAK,WAAW,KAAK;AAEpC,SAAK,QAAQ,MAAM,mBAAmB,EAAE,SAAS,MAAM,CAAC;AAExD,UAAM,GAAG,MAAM,KAAK,QAAQ,MAAM,GAAG,EAAE,WAAW,KAAK,CAAC;AAExD,QAAI,KAAK,aAAa,SAAS,KAAK,GAAG;AAErC,mBAAa,OAAO,CAAC,MAAM,UAAU,MAAM,GAAG,EAAE,KAAK,KAAK,YAAY,CAAC;AAAA,IACzE,OAAO;AACL,YAAM,GAAG,OAAO,UAAU,MAAM;AAAA,IAClC;AAEA,SAAK,QAAQ,KAAK,kBAAkB,EAAE,SAAS,MAAM,CAAC;AAAA,EACxD;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAgBA,MAAM,OAAO,YAAoB,SAAkE;AACjG,UAAM,WAAW,KAAK,WAAW,UAAU;AAC3C,UAAM,WAAW,SAAS,YAAY;AAEtC,SAAK,QAAQ,MAAM,qBAAqB,EAAE,YAAY,SAAS,CAAC;AAEhE,UAAM,SAAS,KAAK,aAAa,SAAS,KAAK;AAE/C,QAAI,QAAQ;AACV,YAAM,UAAU,WACZ,CAAC,MAAM,YAAY,QAAQ,IAC3B,CAAC,MAAM,QAAQ;AACnB,mBAAa,OAAO,SAAS,EAAE,KAAK,KAAK,YAAY,CAAC;AACtD,WAAK,QAAQ,KAAK,oBAAoB,EAAE,YAAY,UAAU,KAAK,KAAK,CAAC;AACzE;AAAA,IACF;AAEA,QAAI,UAAU;AACZ,WAAK,QAAQ,KAAK,mDAAmD,EAAE,WAAW,CAAC;AACnF;AAAA,IACF;AAEA,QAAI;AACF,YAAM,GAAG,OAAO,QAAQ;AACxB,WAAK,QAAQ,KAAK,oBAAoB,EAAE,WAAW,CAAC;AAAA,IACtD,SAAS,OAAY;AACnB,UAAI,MAAM,SAAS,UAAU;AAC3B,aAAK,QAAQ,KAAK,gCAAgC,EAAE,WAAW,CAAC;AAChE;AAAA,MACF;AACA,YAAM;AAAA,IACR;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAUA,WAAW,YAA4B;AACrC,QAAI,CAAC,WAAW,WAAW,SAAS,GAAG;AACrC,YAAM,IAAI,MAAM,kDAAkD,UAAU,EAAE;AAAA,IAChF;AACA,UAAM,eAAe,WAAW,MAAM,UAAU,MAAM;AACtD,WAAO,KAAK,KAAK,KAAK,aAAa,YAAY;AAAA,EACjD;AACF;AAOO,IAAM,wBAAN,cAAoC,MAAM;AAAA,EAC/C,YACW,YACA,UACA,QACT;AACA;AAAA,MACE,yBAAyB,UAAU,cAAc,SAAS,MAAM,GAAG,CAAC,CAAC,eAAe,OAAO,MAAM,GAAG,CAAC,CAAC;AAAA;AAAA,IAExG;AAPS;AACA;AACA;AAMT,SAAK,OAAO;AAAA,EACd;AACF;;;AErPA,IAAM,oBAA4C;AAAA;AAAA,EAEhD,cAAc;AAAA,EACd,iBAAiB;AAAA,EACjB,aAAa;AAAA,EACb,YAAY;AAAA,EACZ,YAAY;AAAA,EACZ,YAAY;AAAA;AAAA,EAGZ,oBAAoB;AAAA,EACpB,mBAAmB;AAAA,EACnB,oBAAoB;AAAA,EACpB,sBAAsB;AAAA;AAAA,EAGtB,mBAAmB;AAAA,EACnB,sBAAsB;AAAA,EACtB,2EAA2E;AAAA,EAC3E,4BAA4B;AAAA,EAC5B,qEAAqE;AAAA,EACrE,iCAAiC;AAAA,EACjC,6EAA6E;AAAA;AAAA,EAG7E,mBAAmB;AAAA,EACnB,oBAAoB;AAAA,EACpB,qBAAqB;AAAA,EACrB,+BAA+B;AAAA;AAAA,EAG/B,4BAA4B;AAAA,EAC5B,oBAAoB;AAAA;AAAA,EAGpB,aAAa;AAAA,EACb,cAAc;AAAA,EACd,aAAa;AAAA,EACb,cAAc;AAAA,EACd,iBAAiB;AAAA,EACjB,aAAa;AAAA,EACb,cAAc;AAAA,EACd,gBAAgB;AAAA;AAAA,EAGhB,cAAc;AAAA,EACd,aAAa;AAAA,EACb,aAAa;AAAA,EACb,cAAc;AAAA,EACd,aAAa;AAAA,EACb,cAAc;AAAA;AAAA,EAGd,aAAa;AAAA,EACb,cAAc;AAAA,EACd,cAAc;AAAA,EACd,aAAa;AAAA,EACb,mBAAmB;AAAA,EACnB,mBAAmB;AAAA;AAAA,EAGnB,mBAAmB;AAAA,EACnB,0BAA0B;AAAA,EAC1B,qBAAqB;AAAA,EACrB,0BAA0B;AAAA,EAC1B,iBAAiB;AAAA,EACjB,eAAe;AAAA,EACf,YAAY;AAAA,EACZ,cAAc;AAAA,EACd,iBAAiB;AAAA,EACjB,aAAa;AAAA,EACb,eAAe;AAAA,EACf,eAAe;AAAA,EACf,cAAc;AAAA,EACd,gBAAgB;AAAA,EAChB,iBAAiB;AAAA,EACjB,gBAAgB;AAAA;AAAA,EAGhB,aAAa;AAAA,EACb,cAAc;AAAA,EACd,YAAY;AAAA,EACZ,YAAY;AACd;AAaO,SAAS,wBAAwB,WAA2B;AAEjE,QAAM,aAAa,UAAU,YAAY,EAAE,MAAM,GAAG,EAAE,CAAC,EAAG,KAAK;AAG/D,QAAM,YAAY,kBAAkB,UAAU;AAG9C,SAAO,aAAa;AACtB;AAQO,SAAS,iBAAiB,MAAc,QAAwB;AACrE,QAAM,OAAO,KACV,YAAY,EACZ,QAAQ,eAAe,GAAG,EAC1B,QAAQ,UAAU,EAAE;AACvB,QAAM,MAAM,wBAAwB,MAAM;AAC1C,SAAO,UAAU,IAAI,GAAG,GAAG;AAC7B;AAQO,SAAS,kBAAkB,WAA4B;AAC5D,QAAM,aAAa,UAAU,YAAY,EAAE,MAAM,GAAG,EAAE,CAAC,EAAG,KAAK;AAC/D,SAAO,cAAc;AACvB;","names":[]}
1	+ {"version":3,"sources":["../src/working-tree-store.ts","../src/checksum.ts","../src/storage-uri.ts","../src/extract-pdf-text-layer.ts","../src/locate.ts"],"sourcesContent":["/*\n WorkingTreeStore - Manages files in the project working tree\n \n Unlike the old content-addressed RepresentationStore, this store treats\n * the working tree (project root) as the source of truth for file content.\n * Resources are identified by their file:// URI, which is stable across\n * content changes and moves (tracked by events).\n \n Two write paths:\n * - store(content, storageUri): Write bytes to disk (API/GUI/AI path).\n * Used when the file does not yet exist and the caller provides content.\n * - register(storageUri, expectedChecksum?): Read an existing file and\n * return its metadata (CLI path). The file is already on disk; we just\n * verify and record it. If expectedChecksum is provided, throws on mismatch.\n \n Storage layout:\n * {projectRoot}/{path-from-uri}\n \n For example, storageUri \"file://docs/overview.md\" resolves to\n * {projectRoot}/docs/overview.md\n /\n\nimport { promises as fs } from 'fs';\nimport { execFileSync } from 'child_process';\nimport path from 'path';\nimport type { SemiontProject } from '@semiont/core/node';\nimport type { Logger } from '@semiont/core';\nimport { calculateChecksum, verifyChecksum } from './checksum';\n\n/\n Result of store() or register()\n /\nexport interface StoredResource {\n storageUri: string; // file:// URI (e.g. \"file://docs/overview.md\")\n checksum: string; // SHA-256 hex of content\n byteSize: number; // Size in bytes\n created: string; // ISO 8601 timestamp\n}\n\n/\n Manages files in the project working tree\n /\nexport class WorkingTreeStore {\n private projectRoot: string;\n private gitSync: boolean;\n private logger?: Logger;\n\n constructor(project: SemiontProject, logger?: Logger) {\n this.projectRoot = project.root;\n this.gitSync = project.gitSync;\n this.logger = logger;\n }\n\n private shouldRunGit(noGit?: boolean): boolean {\n return this.gitSync && !noGit;\n }\n\n /\n Write content to disk at the location indicated by storageUri.\n \n API/GUI/AI path: caller provides bytes; file may not yet exist.\n \n @param content - Raw bytes to write\n * @param storageUri - file:// URI (e.g. \"file://docs/overview.md\")\n * @returns Stored resource metadata\n /\n async store(content: Buffer, storageUri: string, options?: { noGit?: boolean }): Promise<StoredResource> {\n const filePath = this.resolveUri(storageUri);\n const checksum = calculateChecksum(content);\n\n this.logger?.debug('Storing resource', { storageUri, byteSize: content.length });\n\n await fs.mkdir(path.dirname(filePath), { recursive: true });\n await fs.writeFile(filePath, content);\n\n if (this.shouldRunGit(options?.noGit)) {\n execFileSync('git', ['add', filePath], { cwd: this.projectRoot });\n }\n\n this.logger?.info('Resource stored', { storageUri, checksum, byteSize: content.length });\n\n return {\n storageUri,\n checksum,\n byteSize: content.length,\n created: new Date().toISOString(),\n };\n }\n\n /\n Read an existing file and return its metadata.\n \n CLI path: the file is already on disk. We read it to compute the checksum.\n * If expectedChecksum is provided, throws ChecksumMismatchError on mismatch.\n \n @param storageUri - file:// URI (e.g. \"file://docs/overview.md\")\n * @param expectedChecksum - Optional SHA-256 to verify against\n * @returns Stored resource metadata\n * @throws ChecksumMismatchError if expectedChecksum is provided and does not match\n * @throws Error if file does not exist\n /\n async register(storageUri: string, expectedChecksum?: string, options?: { noGit?: boolean }): Promise<StoredResource> {\n const filePath = this.resolveUri(storageUri);\n\n this.logger?.debug('Registering resource', { storageUri });\n\n const content = await fs.readFile(filePath);\n const checksum = calculateChecksum(content);\n\n if (expectedChecksum !== undefined && !verifyChecksum(content, expectedChecksum)) {\n throw new ChecksumMismatchError(storageUri, expectedChecksum, checksum);\n }\n\n if (this.shouldRunGit(options?.noGit)) {\n execFileSync('git', ['add', filePath], { cwd: this.projectRoot });\n }\n\n this.logger?.info('Resource registered', { storageUri, checksum, byteSize: content.length });\n\n return {\n storageUri,\n checksum,\n byteSize: content.length,\n created: new Date().toISOString(),\n };\n }\n\n /\n Read file content by URI.\n \n @param storageUri - file:// URI\n * @returns Raw bytes\n /\n async retrieve(storageUri: string): Promise<Buffer> {\n const filePath = this.resolveUri(storageUri);\n try {\n return await fs.readFile(filePath);\n } catch (error: any) {\n if (error.code === 'ENOENT') {\n throw new Error(`Resource not found: ${storageUri}`);\n }\n throw error;\n }\n }\n\n /\n Move a file from one URI to another.\n \n If .git/ exists in the project root and noGit is not set, runs `git mv`.\n * Otherwise (no .git/ or noGit: true), runs fs.rename.\n \n @param fromUri - Current file:// URI\n * @param toUri - New file:// URI\n * @param options.noGit - Skip git mv even if .git/ is present\n /\n async move(fromUri: string, toUri: string, options?: { noGit?: boolean }): Promise<void> {\n const fromPath = this.resolveUri(fromUri);\n const toPath = this.resolveUri(toUri);\n\n this.logger?.debug('Moving resource', { fromUri, toUri });\n\n await fs.mkdir(path.dirname(toPath), { recursive: true });\n\n if (this.shouldRunGit(options?.noGit)) {\n // git mv handles both the filesystem rename and the index update\n execFileSync('git', ['mv', fromPath, toPath], { cwd: this.projectRoot });\n } else {\n await fs.rename(fromPath, toPath);\n }\n\n this.logger?.info('Resource moved', { fromUri, toUri });\n }\n\n /\n Remove a file from the working tree.\n \n If .git/ exists and noGit is not set:\n * - keepFile false (default): runs `git rm` (removes from index and disk)\n * - keepFile true: runs `git rm --cached` (removes from index only, file stays on disk)\n * If no .git/ or noGit: true:\n * - keepFile false: runs fs.unlink\n * - keepFile true: no-op on filesystem\n \n @param storageUri - file:// URI\n * @param options.noGit - Skip git rm even if .git/ is present\n * @param options.keepFile - Remove from git index only; leave file on disk\n /\n async remove(storageUri: string, options?: { noGit?: boolean; keepFile?: boolean }): Promise<void> {\n const filePath = this.resolveUri(storageUri);\n const keepFile = options?.keepFile ?? false;\n\n this.logger?.debug('Removing resource', { storageUri, keepFile });\n\n const useGit = this.shouldRunGit(options?.noGit);\n\n if (useGit) {\n const gitArgs = keepFile\n ? ['rm', '--cached', filePath]\n : ['rm', filePath];\n execFileSync('git', gitArgs, { cwd: this.projectRoot });\n this.logger?.info('Resource removed', { storageUri, keepFile, git: true });\n return;\n }\n\n if (keepFile) {\n this.logger?.info('Resource removed from index (file kept on disk)', { storageUri });\n return;\n }\n\n try {\n await fs.unlink(filePath);\n this.logger?.info('Resource removed', { storageUri });\n } catch (error: any) {\n if (error.code === 'ENOENT') {\n this.logger?.warn('Resource file already absent', { storageUri });\n return;\n }\n throw error;\n }\n }\n\n /\n Convert a file:// URI to an absolute filesystem path.\n \n \"file://docs/overview.md\" → \"{projectRoot}/docs/overview.md\"\n \n @param storageUri - file:// URI\n * @returns Absolute path\n /\n resolveUri(storageUri: string): string {\n if (!storageUri.startsWith('file://')) {\n throw new Error(`Invalid storage URI (must start with file://): ${storageUri}`);\n }\n const relativePath = storageUri.slice('file://'.length);\n return path.join(this.projectRoot, relativePath);\n }\n}\n\n/\n Thrown when a registered file's checksum does not match the expected value.\n * This indicates the file on disk differs from what was recorded (e.g. modified\n * after staging, or wrong file path provided).\n /\nexport class ChecksumMismatchError extends Error {\n constructor(\n readonly storageUri: string,\n readonly expected: string,\n readonly actual: string,\n ) {\n super(\n `Checksum mismatch for ${storageUri}: expected ${expected.slice(0, 8)}... but got ${actual.slice(0, 8)}...\\n` +\n `The file on disk differs from the recorded checksum. Has it been modified since staging?`\n );\n this.name = 'ChecksumMismatchError';\n }\n}\n","/\n Checksum utilities for content verification\n /\n\nimport { createHash } from 'crypto';\n\n/\n Calculate SHA-256 checksum of content\n * @param content The content to hash\n * @returns Hex-encoded SHA-256 hash\n /\nexport function calculateChecksum(content: string \| Buffer): string {\n const hash = createHash('sha256');\n hash.update(content);\n return hash.digest('hex');\n}\n\n/\n Verify content against a checksum\n * @param content The content to verify\n * @param checksum The expected checksum\n * @returns True if content matches checksum\n /\nexport function verifyChecksum(content: string \| Buffer, checksum: string): boolean {\n return calculateChecksum(content) === checksum;\n}\n","/\n Storage URI Derivation\n \n Builds the file:// URI a resource lives at in the working tree from its\n * name and validated media type. Extensions come from the media-type\n * registry in @semiont/core; formats are validated upstream at the\n * create/yield boundary, so the lookup is strict — no fallback.\n /\n\nimport { MEDIA_TYPES, type SupportedMediaType } from '@semiont/core';\n\n/\n Derive a file:// storage URI from a resource name and media type.\n \n The name is lowercased, runs of non-alphanumeric characters collapse to\n * single hyphens, and leading/trailing hyphens are stripped.\n \n @example\n * deriveStorageUri(\"My Document\", \"text/markdown\") // => \"file://my-document.md\"\n /\nexport function deriveStorageUri(name: string, format: SupportedMediaType): string {\n const slug = name\n .toLowerCase()\n .replace(/[^a-z0-9]+/g, '-')\n .replace(/^-\|-$/g, '');\n return `file://${slug}${MEDIA_TYPES[format].extension}`;\n}\n","/\n PDF Text Layer Extraction\n \n Extracts positioned text from native, non-scanned PDFs using pdfjs-dist.\n * Returns null for scanned/image-only PDFs (no text items).\n \n Coordinates are in PDF point space, originating from the bottom-left.\n * The Y-flip to canvas pixels happens downstream.\n /\n\nimport as pdfjs from 'pdfjs-dist/legacy/build/pdf.mjs';\nimport type { PdfTextLayer, PdfPageInfo, PdfTextItem } from './pdf-text-layer';\n\nexport async function extractPdfTextLayer(\n bytes: Uint8Array \| Buffer\n): Promise<PdfTextLayer \| null> {\n // pdf.js v5 removed the isEvalSupported option; this path only calls\n // getTextContent (no rendering / no PDF functions).\n const doc = await pdfjs.getDocument({ data: bytes }).promise;\n\n try {\n const pages: PdfPageInfo[] = [];\n const items: PdfTextItem[] = [];\n let text = '';\n let hasAnyTextItems = false;\n\n for (let pageNum = 1; pageNum <= doc.numPages; pageNum++) {\n const page = await doc.getPage(pageNum);\n const viewport = page.getViewport({ scale: 1.0 });\n const content = await page.getTextContent(); // all text items on the page\n\n pages.push({\n pageNumber: pageNum,\n widthPt: viewport.width,\n heightPt: viewport.height,\n });\n\n for (const item of content.items) {\n if (!('str' in item)) continue; // skip marked-content items (no text)\n\n if (item.str.trim()) {\n hasAnyTextItems = true;\n const start = text.length;\n text += item.str;\n const end = text.length; // range covers only this run's own chars\n\n const [, , , , x, y] = item.transform as number[];\n\n items.push({\n start,\n end,\n page: pageNum,\n x,\n y,\n width: item.width,\n height: item.height,\n });\n\n // Separator AFTER recording the run, so its [start, end) never\n // includes it. pdf.js flags the last run on a line with hasEOL —\n // newline there, space between words otherwise, so reading-order\n // lines don't glue (e.g. \"textsecond\").\n text += item.hasEOL ? '\\n' : ' ';\n } else if (item.hasEOL) {\n // Standalone end-of-line marker (empty/whitespace str): keep the\n // line break without letting whitespace-only runs add stray spaces.\n text += '\\n';\n }\n }\n\n text += '\\n'; // page break\n }\n\n if (!hasAnyTextItems) return null;\n\n return { pages, text, items };\n } finally {\n // Release the pdf.js document — Phase 2 runs this in a long-lived worker pool.\n await doc.destroy();\n }\n}\n","import type { PdfCoordinate } from '@semiont/core';\nimport type { PdfTextLayer, PdfTextItem } from './pdf-text-layer';\n\n/*\n Items whose baseline Y is within this many PDF points are treated as being on\n * the same line. Tuned for ~12pt body text; revisit for documents with large or\n * variable font sizes (Phase 4 / #738).\n /\nconst SAME_LINE_THRESHOLD_PT = 2;\n\n/\n Locates bounding rectangles for a span of text in a PdfTextLayer\n * (single-line or multi-line).\n * \n * Finds all overlapping items [start, end), groups them by page and line,\n * and records one bounding rectangle per line as a PdfCoordinate.\n * \n * Returns array of PdfCoordinate, one per line of text covered by the span.\n * Returns empty array if no items overlap the span.\n /\nexport function locate(\n layer: PdfTextLayer,\n start: number,\n end: number\n): PdfCoordinate[] {\n const overlap: PdfTextItem[] = layer.items.filter(\n item => item.start < end && item.end > start\n );\n if (overlap.length === 0) return [];\n\n const pages: Map<number, PdfTextItem[]> = groupItemsByPage(overlap);\n const rects: PdfCoordinate[] = [];\n\n // for each page, group items into lines and compute one rectangle per line\n for (const [page, pageItems] of pages) {\n const lines = groupItemsByLine(pageItems, SAME_LINE_THRESHOLD_PT);\n // Compute one bounding rectangle per line and add it to rects\n for (const lineItems of lines) {\n const x = Math.min(...lineItems.map(i => i.x));\n const right = Math.max(...lineItems.map(i => i.x + i.width));\n const y = Math.min(...lineItems.map(i => i.y));\n const top = Math.max(...lineItems.map(i => i.y + i.height));\n rects.push({page, x, y, width: right - x, height: top - y});\n }\n }\n return rects;\n}\n\nfunction groupItemsByPage(items: PdfTextItem[]): Map<number, PdfTextItem[]> {\n const map = new Map<number, PdfTextItem[]>();\n for (const item of items) {\n const existing = map.get(item.page);\n if (existing) {\n existing.push(item);\n } else {\n map.set(item.page, [item]);\n }\n }\n return map;\n}\n\n\n/\n Sorts text items into lines when their y coordinates are\n * within `sameLineThreshold` points of each other.\n * Sorted top-to-bottom (descending y in PDF space), then left-to-right.\n * \n * Returns 2D array: \n * Outer array = list of lines\n * Inner array = list of items on that line\n*/\nfunction groupItemsByLine(items: PdfTextItem[], sameLineThreshold: number): PdfTextItem[][] {\n // Sort top-to-bottom by y; if y is equal, sort left-to-right by x\n const sorted = [...items].sort((a, b) => b.y - a.y \|\| a.x - b.x);\n const lines: PdfTextItem[][] = [];\n let currentLine: PdfTextItem[] = [];\n\n for (const item of sorted) {\n if (currentLine.length === 0 \|\| Math.abs(item.y - currentLine[0].y) <= sameLineThreshold) {\n currentLine.push(item);\n } else {\n lines.push(currentLine);\n currentLine = [item];\n }\n }\n if (currentLine.length > 0) lines.push(currentLine);\n return lines;\n}\n"],"mappings":";AAsBA,SAAS,YAAY,UAAU;AAC/B,SAAS,oBAAoB;AAC7B,OAAO,UAAU;;;ACpBjB,SAAS,kBAAkB;AAOpB,SAAS,kBAAkB,SAAkC;AAClE,QAAM,OAAO,WAAW,QAAQ;AAChC,OAAK,OAAO,OAAO;AACnB,SAAO,KAAK,OAAO,KAAK;AAC1B;AAQO,SAAS,eAAe,SAA0B,UAA2B;AAClF,SAAO,kBAAkB,OAAO,MAAM;AACxC;;;ADiBO,IAAM,mBAAN,MAAuB;AAAA,EACpB;AAAA,EACA;AAAA,EACA;AAAA,EAER,YAAY,SAAyB,QAAiB;AACpD,SAAK,cAAc,QAAQ;AAC3B,SAAK,UAAU,QAAQ;AACvB,SAAK,SAAS;AAAA,EAChB;AAAA,EAEQ,aAAa,OAA0B;AAC7C,WAAO,KAAK,WAAW,CAAC;AAAA,EAC1B;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAWA,MAAM,MAAM,SAAiB,YAAoB,SAAwD;AACvG,UAAM,WAAW,KAAK,WAAW,UAAU;AAC3C,UAAM,WAAW,kBAAkB,OAAO;AAE1C,SAAK,QAAQ,MAAM,oBAAoB,EAAE,YAAY,UAAU,QAAQ,OAAO,CAAC;AAE/E,UAAM,GAAG,MAAM,KAAK,QAAQ,QAAQ,GAAG,EAAE,WAAW,KAAK,CAAC;AAC1D,UAAM,GAAG,UAAU,UAAU,OAAO;AAEpC,QAAI,KAAK,aAAa,SAAS,KAAK,GAAG;AACrC,mBAAa,OAAO,CAAC,OAAO,QAAQ,GAAG,EAAE,KAAK,KAAK,YAAY,CAAC;AAAA,IAClE;AAEA,SAAK,QAAQ,KAAK,mBAAmB,EAAE,YAAY,UAAU,UAAU,QAAQ,OAAO,CAAC;AAEvF,WAAO;AAAA,MACL;AAAA,MACA;AAAA,MACA,UAAU,QAAQ;AAAA,MAClB,UAAS,oBAAI,KAAK,GAAE,YAAY;AAAA,IAClC;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAcA,MAAM,SAAS,YAAoB,kBAA2B,SAAwD;AACpH,UAAM,WAAW,KAAK,WAAW,UAAU;AAE3C,SAAK,QAAQ,MAAM,wBAAwB,EAAE,WAAW,CAAC;AAEzD,UAAM,UAAU,MAAM,GAAG,SAAS,QAAQ;AAC1C,UAAM,WAAW,kBAAkB,OAAO;AAE1C,QAAI,qBAAqB,UAAa,CAAC,eAAe,SAAS,gBAAgB,GAAG;AAChF,YAAM,IAAI,sBAAsB,YAAY,kBAAkB,QAAQ;AAAA,IACxE;AAEA,QAAI,KAAK,aAAa,SAAS,KAAK,GAAG;AACrC,mBAAa,OAAO,CAAC,OAAO,QAAQ,GAAG,EAAE,KAAK,KAAK,YAAY,CAAC;AAAA,IAClE;AAEA,SAAK,QAAQ,KAAK,uBAAuB,EAAE,YAAY,UAAU,UAAU,QAAQ,OAAO,CAAC;AAE3F,WAAO;AAAA,MACL;AAAA,MACA;AAAA,MACA,UAAU,QAAQ;AAAA,MAClB,UAAS,oBAAI,KAAK,GAAE,YAAY;AAAA,IAClC;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAQA,MAAM,SAAS,YAAqC;AAClD,UAAM,WAAW,KAAK,WAAW,UAAU;AAC3C,QAAI;AACF,aAAO,MAAM,GAAG,SAAS,QAAQ;AAAA,IACnC,SAAS,OAAY;AACnB,UAAI,MAAM,SAAS,UAAU;AAC3B,cAAM,IAAI,MAAM,uBAAuB,UAAU,EAAE;AAAA,MACrD;AACA,YAAM;AAAA,IACR;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAYA,MAAM,KAAK,SAAiB,OAAe,SAA8C;AACvF,UAAM,WAAW,KAAK,WAAW,OAAO;AACxC,UAAM,SAAS,KAAK,WAAW,KAAK;AAEpC,SAAK,QAAQ,MAAM,mBAAmB,EAAE,SAAS,MAAM,CAAC;AAExD,UAAM,GAAG,MAAM,KAAK,QAAQ,MAAM,GAAG,EAAE,WAAW,KAAK,CAAC;AAExD,QAAI,KAAK,aAAa,SAAS,KAAK,GAAG;AAErC,mBAAa,OAAO,CAAC,MAAM,UAAU,MAAM,GAAG,EAAE,KAAK,KAAK,YAAY,CAAC;AAAA,IACzE,OAAO;AACL,YAAM,GAAG,OAAO,UAAU,MAAM;AAAA,IAClC;AAEA,SAAK,QAAQ,KAAK,kBAAkB,EAAE,SAAS,MAAM,CAAC;AAAA,EACxD;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAgBA,MAAM,OAAO,YAAoB,SAAkE;AACjG,UAAM,WAAW,KAAK,WAAW,UAAU;AAC3C,UAAM,WAAW,SAAS,YAAY;AAEtC,SAAK,QAAQ,MAAM,qBAAqB,EAAE,YAAY,SAAS,CAAC;AAEhE,UAAM,SAAS,KAAK,aAAa,SAAS,KAAK;AAE/C,QAAI,QAAQ;AACV,YAAM,UAAU,WACZ,CAAC,MAAM,YAAY,QAAQ,IAC3B,CAAC,MAAM,QAAQ;AACnB,mBAAa,OAAO,SAAS,EAAE,KAAK,KAAK,YAAY,CAAC;AACtD,WAAK,QAAQ,KAAK,oBAAoB,EAAE,YAAY,UAAU,KAAK,KAAK,CAAC;AACzE;AAAA,IACF;AAEA,QAAI,UAAU;AACZ,WAAK,QAAQ,KAAK,mDAAmD,EAAE,WAAW,CAAC;AACnF;AAAA,IACF;AAEA,QAAI;AACF,YAAM,GAAG,OAAO,QAAQ;AACxB,WAAK,QAAQ,KAAK,oBAAoB,EAAE,WAAW,CAAC;AAAA,IACtD,SAAS,OAAY;AACnB,UAAI,MAAM,SAAS,UAAU;AAC3B,aAAK,QAAQ,KAAK,gCAAgC,EAAE,WAAW,CAAC;AAChE;AAAA,MACF;AACA,YAAM;AAAA,IACR;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAUA,WAAW,YAA4B;AACrC,QAAI,CAAC,WAAW,WAAW,SAAS,GAAG;AACrC,YAAM,IAAI,MAAM,kDAAkD,UAAU,EAAE;AAAA,IAChF;AACA,UAAM,eAAe,WAAW,MAAM,UAAU,MAAM;AACtD,WAAO,KAAK,KAAK,KAAK,aAAa,YAAY;AAAA,EACjD;AACF;AAOO,IAAM,wBAAN,cAAoC,MAAM;AAAA,EAC/C,YACW,YACA,UACA,QACT;AACA;AAAA,MACE,yBAAyB,UAAU,cAAc,SAAS,MAAM,GAAG,CAAC,CAAC,eAAe,OAAO,MAAM,GAAG,CAAC,CAAC;AAAA;AAAA,IAExG;AAPS;AACA;AACA;AAMT,SAAK,OAAO;AAAA,EACd;AAAA,EATW;AAAA,EACA;AAAA,EACA;AAQb;;;AEtPA,SAAS,mBAA4C;AAW9C,SAAS,iBAAiB,MAAc,QAAoC;AACjF,QAAM,OAAO,KACV,YAAY,EACZ,QAAQ,eAAe,GAAG,EAC1B,QAAQ,UAAU,EAAE;AACvB,SAAO,UAAU,IAAI,GAAG,YAAY,MAAM,EAAE,SAAS;AACvD;;;AChBA,YAAY,WAAW;AAGvB,eAAsB,oBAClB,OAC4B;AAG5B,QAAM,MAAM,MAAY,kBAAY,EAAE,MAAM,MAAM,CAAC,EAAE;AAErD,MAAI;AACA,UAAM,QAAuB,CAAC;AAC9B,UAAM,QAAuB,CAAC;AAC9B,QAAI,OAAO;AACX,QAAI,kBAAkB;AAEtB,aAAS,UAAU,GAAG,WAAW,IAAI,UAAU,WAAW;AACtD,YAAM,OAAO,MAAM,IAAI,QAAQ,OAAO;AACtC,YAAM,WAAW,KAAK,YAAY,EAAE,OAAO,EAAI,CAAC;AAChD,YAAM,UAAU,MAAM,KAAK,eAAe;AAE1C,YAAM,KAAK;AAAA,QACP,YAAY;AAAA,QACZ,SAAS,SAAS;AAAA,QAClB,UAAU,SAAS;AAAA,MACvB,CAAC;AAED,iBAAW,QAAQ,QAAQ,OAAO;AAC9B,YAAI,EAAE,SAAS,MAAO;AAEtB,YAAI,KAAK,IAAI,KAAK,GAAG;AACjB,4BAAkB;AAClB,gBAAM,QAAQ,KAAK;AACnB,kBAAQ,KAAK;AACb,gBAAM,MAAM,KAAK;AAEjB,gBAAM,CAAC,EAAE,EAAE,EAAE,EAAE,GAAG,CAAC,IAAI,KAAK;AAE5B,gBAAM,KAAK;AAAA,YACP;AAAA,YACA;AAAA,YACA,MAAM;AAAA,YACN;AAAA,YACA;AAAA,YACA,OAAO,KAAK;AAAA,YACZ,QAAQ,KAAK;AAAA,UACjB,CAAC;AAMD,kBAAQ,KAAK,SAAS,OAAO;AAAA,QACjC,WAAW,KAAK,QAAQ;AAGpB,kBAAQ;AAAA,QACZ;AAAA,MACJ;AAEA,cAAQ;AAAA,IACZ;AAEA,QAAI,CAAC,gBAAiB,QAAO;AAE7B,WAAO,EAAE,OAAO,MAAM,MAAM;AAAA,EAChC,UAAE;AAEE,UAAM,IAAI,QAAQ;AAAA,EACtB;AACJ;;;ACxEA,IAAM,yBAAyB;AAYxB,SAAS,OACZ,OACA,OACA,KACe;AACf,QAAM,UAAyB,MAAM,MAAM;AAAA,IACvC,UAAQ,KAAK,QAAQ,OAAO,KAAK,MAAM;AAAA,EAC3C;AACA,MAAI,QAAQ,WAAW,EAAG,QAAO,CAAC;AAElC,QAAM,QAAoC,iBAAiB,OAAO;AAClE,QAAM,QAAyB,CAAC;AAGhC,aAAW,CAAC,MAAM,SAAS,KAAK,OAAO;AACnC,UAAM,QAAQ,iBAAiB,WAAW,sBAAsB;AAEhE,eAAW,aAAa,OAAO;AAC3B,YAAM,IAAI,KAAK,IAAI,GAAG,UAAU,IAAI,OAAK,EAAE,CAAC,CAAC;AAC7C,YAAM,QAAQ,KAAK,IAAI,GAAG,UAAU,IAAI,OAAK,EAAE,IAAI,EAAE,KAAK,CAAC;AAC3D,YAAM,IAAI,KAAK,IAAI,GAAG,UAAU,IAAI,OAAK,EAAE,CAAC,CAAC;AAC7C,YAAM,MAAM,KAAK,IAAI,GAAG,UAAU,IAAI,OAAK,EAAE,IAAI,EAAE,MAAM,CAAC;AAC1D,YAAM,KAAK,EAAC,MAAM,GAAG,GAAG,OAAO,QAAQ,GAAG,QAAQ,MAAM,EAAC,CAAC;AAAA,IAC9D;AAAA,EACJ;AACA,SAAO;AACX;AAEA,SAAS,iBAAiB,OAAkD;AACxE,QAAM,MAAM,oBAAI,IAA2B;AAC3C,aAAW,QAAQ,OAAO;AACtB,UAAM,WAAW,IAAI,IAAI,KAAK,IAAI;AAClC,QAAI,UAAU;AACV,eAAS,KAAK,IAAI;AAAA,IACtB,OAAO;AACH,UAAI,IAAI,KAAK,MAAM,CAAC,IAAI,CAAC;AAAA,IAC7B;AAAA,EACJ;AACA,SAAO;AACX;AAYA,SAAS,iBAAiB,OAAsB,mBAA4C;AAExF,QAAM,SAAS,CAAC,GAAG,KAAK,EAAE,KAAK,CAAC,GAAG,MAAM,EAAE,IAAI,EAAE,KAAK,EAAE,IAAI,EAAE,CAAC;AAC/D,QAAM,QAAyB,CAAC;AAChC,MAAI,cAA6B,CAAC;AAElC,aAAW,QAAQ,QAAQ;AACvB,QAAI,YAAY,WAAW,KAAK,KAAK,IAAI,KAAK,IAAI,YAAY,CAAC,EAAE,CAAC,KAAK,mBAAmB;AACtF,kBAAY,KAAK,IAAI;AAAA,IACzB,OAAO;AACH,YAAM,KAAK,WAAW;AACtB,oBAAc,CAAC,IAAI;AAAA,IACvB;AAAA,EACJ;AACA,MAAI,YAAY,SAAS,EAAG,OAAM,KAAK,WAAW;AAClD,SAAO;AACX;","names":[]}

package/package.json CHANGED Viewed

@@ -1,8 +1,11 @@
 {
   "name": "@semiont/content",
-  "version": "0.5.5",
+  "version": "0.5.7",
+  "engines": {
+    "node": ">=24.0.0"
+  },
   "type": "module",
-  "description": "Content-addressed storage for resource representations",
+  "description": "Working-tree storage for project resources and PDF text-layer extraction",
   "main": "./dist/index.js",
   "types": "./dist/index.d.ts",
   "exports": {
@@ -24,21 +27,24 @@
     "test:coverage": "vitest run --coverage"
   },
   "dependencies": {
-    "@semiont/core": "*"
+    "@semiont/core": "*",
+    "pdfjs-dist": "^5.7.284"
   },
   "devDependencies": {
-    "@vitest/coverage-v8": "^4.1.0",
-    "rollup": "^4.60.3",
+    "@vitest/coverage-v8": "^4.1.8",
+    "pdf-lib": "^1.17.1",
+    "rollup": "^4.61.0",
     "rollup-plugin-dts": "^6.4.1",
     "tsup": "^8.0.1",
-    "typescript": "^6.0.2"
+    "typescript": "^6.0.2",
+    "vitest": "^4.1.8"
   },
   "keywords": [
     "content",
     "storage",
-    "representation",
-    "content-addressed",
-    "deduplication",
+    "working-tree",
+    "checksum",
+    "pdf",
     "semiont"
   ],
   "author": "The AI Alliance",