@robthepcguy/rag-vault 1.0.0

package/LICENSE

@@ -0,0 +1,24 @@
+MIT License
+
+Copyright (c) 2025 RobThePCGuy
+
+Based on mcp-local-rag (https://github.com/shinpr/mcp-local-rag)
+Originally created by Shinsuke Kagawa
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

package/README.md

@@ -0,0 +1,421 @@
+# RAG Vault
+
+[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
+[![TypeScript](https://img.shields.io/badge/TypeScript-5.0-blue.svg?logo=typescript&logoColor=white)](https://www.typescriptlang.org/)
+[![MCP Registry](https://img.shields.io/badge/MCP-Registry-green.svg)](https://registry.modelcontextprotocol.io/servers/io.github.RobThePCGuy/rag-vault)
+
+**Your documents. Your machine. Your control.**
+
+RAG Vault gives AI coding assistants instant access to your private documents—API specs, research papers, internal docs—without ever sending data to the cloud. One command, zero configuration, complete privacy.
+
+## Why RAG Vault?
+
+| Pain Point | RAG Vault Solution |
+|------------|-------------------|
+| "I don't want my docs on someone else's server" | Everything stays local. No API calls after setup. |
+| "Semantic search misses exact code terms" | Hybrid search: meaning + exact matches like `useEffect` |
+| "Setup requires Docker, Python, databases..." | One `npx` command. Done. |
+| "Cloud APIs charge per query" | Free forever. No subscriptions. |
+
+## Security
+
+RAG Vault includes security features for production deployment:
+- **API Authentication** — Optional API key via `RAG_API_KEY`
+- **Rate Limiting** — Configurable request throttling
+- **CORS Control** — Restrict allowed origins
+- **Security Headers** — Helmet.js protection
+
+See [SECURITY.md](SECURITY.md) for complete documentation.
+
+## Get Started in 30 Seconds
+
+### For Cursor
+
+Add to `~/.cursor/mcp.json`:
+
+```json
+{
+  "mcpServers": {
+    "local-rag": {
+      "type": "stdio",
+      "command": "npx",
+      "args": ["-y", "github:RobThePCGuy/rag-vault"],
+      "env": {
+        "BASE_DIR": "/path/to/your/documents"
+      }
+    }
+  }
+}
+```
+
+### For Claude Code
+
+Add to `.mcp.json` in your project directory:
+
+```json
+{
+  "mcpServers": {
+    "local-rag": {
+      "type": "stdio",
+      "command": "npx",
+      "args": ["-y", "github:RobThePCGuy/rag-vault"],
+      "env": {
+        "BASE_DIR": "./documents",
+        "DB_PATH": "./documents/.rag-db",
+        "CACHE_DIR": "./.cache",
+        "RAG_HYBRID_WEIGHT": "0.6",
+        "RAG_GROUPING": "related"
+      }
+    }
+  }
+}
+```
+
+Or add inline via CLI:
+
+```bash
+claude mcp add local-rag --scope user --env BASE_DIR=/path/to/your/documents -- npx -y github:RobThePCGuy/rag-vault
+```
+
+### For Codex
+
+Add to `~/.codex/config.toml`:
+
+```toml
+[mcp_servers.local-rag]
+command = "npx"
+args = ["-y", "github:RobThePCGuy/rag-vault"]
+
+[mcp_servers.local-rag.env]
+BASE_DIR = "/path/to/your/documents"
+```
+
+### Install Skills (Optional)
+
+For enhanced AI guidance on query formulation and result interpretation, install the RAG Vault skills:
+
+```bash
+# Claude Code (project-level - recommended for team projects)
+npx github:RobThePCGuy/rag-vault skills install --claude-code
+
+# Claude Code (user-level - available in all projects)
+npx github:RobThePCGuy/rag-vault skills install --claude-code --global
+
+# Codex (user-level)
+npx github:RobThePCGuy/rag-vault skills install --codex
+
+# Custom location
+npx github:RobThePCGuy/rag-vault skills install --path /your/custom/path
+```
+
+Skills teach Claude best practices for:
+- Query formulation and expansion strategies
+- Score interpretation (< 0.3 = good match, > 0.5 = skip)
+- When to use `ingest_file` vs `ingest_data`
+- HTML ingestion and URL handling
+
+Restart your AI tool, and start talking:
+
+```
+You: "Ingest api-spec.pdf"
+AI:  Successfully ingested api-spec.pdf (47 chunks)
+
+You: "How does authentication work?"
+AI:  Based on section 3.2, authentication uses OAuth 2.0 with JWT tokens...
+```
+
+That's it. No Docker. No Python. No servers.
+
+## Web Interface
+
+RAG Vault includes a full-featured web UI for managing your documents without the command line.
+
+### Launch the Web UI
+
+```bash
+npx github:RobThePCGuy/rag-vault web
+```
+
+Open [http://localhost:3000](http://localhost:3000) in your browser.
+
+### What You Can Do
+
+- **Upload documents** — Drag and drop PDFs, Word docs, Markdown, text files
+- **Search instantly** — Type queries and see results with relevance scores
+- **Preview content** — Click any result to see the full chunk in context
+- **Manage files** — View all indexed documents, delete what you don't need
+- **Switch databases** — Create and switch between multiple knowledge bases
+- **Monitor status** — See document counts, database size, system health
+
+### REST API
+
+The web server exposes a REST API for programmatic access. Set `RAG_API_KEY` to require authentication:
+
+```bash
+# With authentication (when RAG_API_KEY is set)
+curl -X POST "http://localhost:3000/api/v1/search" \
+  -H "Authorization: Bearer your-api-key" \
+  -H "Content-Type: application/json" \
+  -d '{"query": "authentication", "limit": 5}'
+
+# Search documents (no auth required if RAG_API_KEY is not set)
+curl -X POST "http://localhost:3000/api/v1/search" \
+  -H "Content-Type: application/json" \
+  -d '{"query": "authentication", "limit": 5}'
+
+# List all files
+curl "http://localhost:3000/api/v1/files"
+
+# Upload a document
+curl -X POST "http://localhost:3000/api/v1/files/upload" \
+  -F "file=@spec.pdf"
+
+# Delete a file
+curl -X DELETE "http://localhost:3000/api/v1/files" \
+  -H "Content-Type: application/json" \
+  -d '{"filePath": "/path/to/spec.pdf"}'
+
+# Get system status
+curl "http://localhost:3000/api/v1/status"
+
+# Health check (for load balancers)
+curl "http://localhost:3000/api/v1/health"
+```
+
+## Real-World Examples
+
+### Search Your Codebase Documentation
+
+```
+You: "Ingest all the markdown files in /docs"
+AI:  Ingested 23 files (847 chunks total)
+
+You: "What's the retry policy for failed API calls?"
+AI:  According to error-handling.md, failed requests retry 3 times
+     with exponential backoff: 1s, 2s, 4s...
+```
+
+### Index Web Documentation
+
+```
+You: "Fetch https://docs.example.com/api and ingest the HTML"
+AI:  Ingested "docs.example.com/api" (156 chunks)
+
+You: "What rate limits apply to the /users endpoint?"
+AI:  The API limits /users to 100 requests per minute per API key...
+```
+
+### Build a Personal Knowledge Base
+
+```
+You: "Ingest my research papers folder"
+AI:  Ingested 12 PDFs (2,341 chunks)
+
+You: "What do recent studies say about transformer attention mechanisms?"
+AI:  Based on attention-mechanisms-2024.pdf, the key finding is...
+```
+
+### Search Exact Technical Terms
+
+RAG Vault's hybrid search catches both meaning and exact matches:
+
+```
+You: "Search for ERR_CONNECTION_REFUSED"
+AI:  Found 3 results mentioning ERR_CONNECTION_REFUSED:
+     1. troubleshooting.md - "When you see ERR_CONNECTION_REFUSED..."
+     2. network-errors.pdf - "Common causes include..."
+```
+
+Pure semantic search would miss this. RAG Vault finds it.
+
+## How It Works
+
+```
+Document → Parse → Chunk by meaning → Embed locally → Store in LanceDB
+                         ↓
+Query → Embed → Vector search → Keyword boost → Quality filter → Results
+```
+
+**Smart chunking**: Splits by meaning, not character count. Keeps code blocks intact.
+
+**Hybrid search**: Vector similarity finds related content. Keyword boost ranks exact matches higher.
+
+**Quality filtering**: Groups results by relevance gaps instead of arbitrary top-K cutoffs.
+
+**Local everything**: Embeddings via Transformers.js. Storage via LanceDB. No network after model download.
+
+## Supported Formats
+
+| Format | Extension | Notes |
+|--------|-----------|-------|
+| PDF | `.pdf` | Full text extraction, header/footer filtering |
+| Word | `.docx` | Tables, lists, formatting preserved |
+| Markdown | `.md` | Code blocks kept intact |
+| Text | `.txt` | Plain text |
+| JSON | `.json` | Converted to searchable key-value text |
+| HTML | via `ingest_data` | Auto-cleaned with Readability |
+
+## Configuration
+
+### Environment Variables
+
+| Variable | Default | What it does |
+|----------|---------|--------------|
+| `BASE_DIR` | Current directory | Only files under this path can be accessed |
+| `DB_PATH` | `./lancedb/` | Where vectors are stored |
+| `MODEL_NAME` | `Xenova/all-MiniLM-L6-v2` | HuggingFace embedding model |
+| `WEB_PORT` | `3000` | Port for web interface |
+
+### Search Tuning
+
+| Variable | Default | What it does |
+|----------|---------|--------------|
+| `RAG_HYBRID_WEIGHT` | `0.6` | Keyword boost strength. 0 = semantic-only, higher = stronger boost for exact keyword matches |
+| `RAG_GROUPING` | — | `similar` = top group only, `related` = top 2 groups |
+| `RAG_MAX_DISTANCE` | — | Filter out results below this relevance threshold |
+
+### Security (optional)
+
+| Variable | Default | What it does |
+|----------|---------|--------------|
+| `RAG_API_KEY` | — | API key for authentication |
+| `CORS_ORIGINS` | localhost | Allowed origins (comma-separated, or `*`) |
+| `RATE_LIMIT_WINDOW_MS` | `60000` | Rate limit time window (ms) |
+| `RATE_LIMIT_MAX_REQUESTS` | `100` | Max requests per window |
+
+### Advanced
+
+| Variable | Default | What it does |
+|----------|---------|--------------|
+| `ALLOWED_SCAN_ROOTS` | Home directory | Directories allowed for database scanning |
+| `JSON_BODY_LIMIT` | `5mb` | Max request body size |
+| `REQUEST_TIMEOUT_MS` | `30000` | API request timeout |
+| `REQUEST_LOGGING` | `false` | Enable request audit logging |
+
+> Copy [`.env.example`](.env.example) for a complete configuration template.
+
+**For code-heavy content**, try:
+
+```json
+"env": {
+  "RAG_HYBRID_WEIGHT": "0.8",
+  "RAG_GROUPING": "similar"
+}
+```
+
+## Frequently Asked Questions
+
+<details>
+<summary><strong>Is my data really private?</strong></summary>
+
+Yes. After the embedding model downloads (~90MB), RAG Vault makes zero network requests. Everything runs on your machine. Verify with network monitoring.
+
+</details>
+
+<details>
+<summary><strong>Does it work offline?</strong></summary>
+
+Yes, after the first run. The model caches locally.
+
+</details>
+
+<details>
+<summary><strong>What about GPU acceleration?</strong></summary>
+
+Transformers.js runs on CPU. GPU support is experimental but unnecessary for most use cases—queries return in ~1 second even with 10,000 chunks.
+
+</details>
+
+<details>
+<summary><strong>Can I change the embedding model?</strong></summary>
+
+Yes. Set `MODEL_NAME` to any compatible HuggingFace model. But you must delete `DB_PATH` and re-ingest—different models produce incompatible vectors.
+
+**Recommended upgrade:** For better quality and multilingual support, use [EmbeddingGemma](https://huggingface.co/onnx-community/embeddinggemma-300m-ONNX):
+
+```json
+"MODEL_NAME": "onnx-community/embeddinggemma-300m-ONNX"
+```
+
+This 300M parameter model scores 68.36 on MTEB benchmarks and supports 100+ languages, making it ideal for mixed-language or high-quality retrieval needs.
+
+**Other specialized models:**
+- Scientific: `sentence-transformers/allenai-specter`
+- Code: `jinaai/jina-embeddings-v2-base-code`
+
+</details>
+
+<details>
+<summary><strong>How do I back up my data?</strong></summary>
+
+Copy the `DB_PATH` directory (default: `./lancedb/`).
+
+</details>
+
+## Troubleshooting
+
+| Problem | Solution |
+|---------|----------|
+| No results found | Documents must be ingested first. Run "List all ingested files" to check. |
+| Model download failed | Check internet connection. Model is ~90MB from HuggingFace. |
+| File too large | Default limit is 100MB. Set `MAX_FILE_SIZE` higher or split the file. |
+| Path outside BASE_DIR | All file paths must be under `BASE_DIR`. Use absolute paths. |
+| MCP tools not showing | Verify config syntax, restart your AI tool completely (Cmd+Q on Mac). |
+| 401 Unauthorized | API key required. Set `RAG_API_KEY` or use correct header format. |
+| 429 Too Many Requests | Rate limited. Wait for reset or increase `RATE_LIMIT_MAX_REQUESTS`. |
+| CORS errors | Add your origin to `CORS_ORIGINS` environment variable. |
+
+## Development
+
+```bash
+git clone https://github.com/RobThePCGuy/rag-vault.git
+cd rag-vault
+pnpm install
+
+# Run tests
+pnpm test
+
+# Type check + lint + format
+pnpm check:all
+
+# Build
+pnpm build
+
+# Run MCP server locally
+pnpm dev
+
+# Run web server locally
+pnpm web:dev
+```
+
+### Project Structure
+
+```
+src/
+├── server/      # MCP tool handlers
+├── vectordb/    # LanceDB + hybrid search
+├── chunker/     # Semantic text splitting
+├── embedder/    # Transformers.js wrapper
+├── parser/      # PDF, DOCX, HTML parsing
+├── web/         # Express server + REST API
+└── __tests__/   # Test suites
+
+web-ui/          # React frontend
+```
+
+## Documentation
+
+- [SECURITY.md](SECURITY.md) — Security configuration and best practices
+- [.env.example](.env.example) — Complete environment variable template
+
+## License
+
+MIT — free for personal and commercial use.
+
+## Acknowledgments
+
+Built with [Model Context Protocol](https://modelcontextprotocol.io/), [LanceDB](https://lancedb.com/), and [Transformers.js](https://huggingface.co/docs/transformers.js).
+
+> Started as a fork of [mcp-local-rag](https://github.com/shinpr/mcp-local-rag) by [Shinsuke Kagawa](https://github.com/shinpr). Now it’s its own thing.
+> Huge credit to upstream contributors for the foundation, I’ve been iterating hard from there.
+> Local-first dev tools, all the way.

package/dist/bin/install-skills.d.ts

@@ -0,0 +1,20 @@
+/**
+ * MCP Local RAG Skills Installer
+ *
+ * Installs skills to various AI coding assistants:
+ * - Claude Code (project or global)
+ * - OpenAI Codex
+ * - Custom path
+ *
+ * Usage:
+ *   npx rag-vault skills install --claude-code          # Project-level
+ *   npx rag-vault skills install --claude-code --global # User-level
+ *   npx rag-vault skills install --codex                # Codex
+ *   npx rag-vault skills install --path /custom/path    # Custom
+ */
+/**
+ * Run the skills installer with the given arguments
+ * @param args - Command line arguments (after "skills install")
+ */
+export declare function run(args: string[]): void;
+//# sourceMappingURL=install-skills.d.ts.map

package/dist/bin/install-skills.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"install-skills.d.ts","sourceRoot":"","sources":["../../src/bin/install-skills.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;GAaG;AAmLH;;;GAGG;AACH,wBAAgB,GAAG,CAAC,IAAI,EAAE,MAAM,EAAE,GAAG,IAAI,CA+BxC"}

package/dist/bin/install-skills.js

@@ -0,0 +1,196 @@
+"use strict";
+/**
+ * MCP Local RAG Skills Installer
+ *
+ * Installs skills to various AI coding assistants:
+ * - Claude Code (project or global)
+ * - OpenAI Codex
+ * - Custom path
+ *
+ * Usage:
+ *   npx rag-vault skills install --claude-code          # Project-level
+ *   npx rag-vault skills install --claude-code --global # User-level
+ *   npx rag-vault skills install --codex                # Codex
+ *   npx rag-vault skills install --path /custom/path    # Custom
+ */
+Object.defineProperty(exports, "__esModule", { value: true });
+exports.run = run;
+const node_fs_1 = require("node:fs");
+const node_os_1 = require("node:os");
+const node_path_1 = require("node:path");
+// ============================================
+// Constants
+// ============================================
+// Skills source directory (relative to dist/bin when compiled)
+// dist/bin/install-skills.js -> dist/skills/rag-vault
+// But skills are actually in package root: skills/rag-vault
+// So from dist/bin, go up twice: ../.. then skills/rag-vault
+const SKILLS_SOURCE = (0, node_path_1.resolve)(__dirname, '..', '..', 'skills', 'rag-vault');
+// Codex home directory (supports CODEX_HOME environment variable)
+// https://developers.openai.com/codex/local-config/
+const CODEX_HOME = process.env['CODEX_HOME'] || (0, node_path_1.join)((0, node_os_1.homedir)(), '.codex');
+// Installation targets
+const TARGETS = {
+    'claude-code-project': './.claude/skills/rag-vault',
+    'claude-code-global': (0, node_path_1.join)((0, node_os_1.homedir)(), '.claude', 'skills', 'rag-vault'),
+    'codex-project': './.codex/skills/rag-vault',
+    'codex-global': (0, node_path_1.join)(CODEX_HOME, 'skills', 'rag-vault'),
+};
+function parseArgs(args) {
+    const options = {
+        target: 'claude-code-project',
+        help: false,
+    };
+    for (let i = 0; i < args.length; i++) {
+        const arg = args[i];
+        switch (arg) {
+            case '--help':
+            case '-h':
+                options.help = true;
+                break;
+            case '--claude-code':
+                // Check for --global flag
+                if (args[i + 1] === '--global') {
+                    options.target = 'claude-code-global';
+                    i++; // Skip next arg
+                }
+                else {
+                    options.target = 'claude-code-project';
+                }
+                break;
+            case '--codex':
+                // Check for --project or --global flag
+                if (args[i + 1] === '--project') {
+                    options.target = 'codex-project';
+                    i++; // Skip next arg
+                }
+                else if (args[i + 1] === '--global') {
+                    options.target = 'codex-global';
+                    i++; // Skip next arg
+                }
+                else {
+                    // Default to global (matches previous behavior)
+                    options.target = 'codex-global';
+                }
+                break;
+            case '--path': {
+                const pathArg = args[i + 1];
+                if (!pathArg) {
+                    console.error('Error: --path requires a path argument');
+                    process.exit(1);
+                }
+                options.target = 'custom';
+                options.customPath = pathArg;
+                i++; // Skip next arg
+                break;
+            }
+            default:
+                if (arg?.startsWith('-')) {
+                    console.error(`Unknown option: ${arg}`);
+                    process.exit(1);
+                }
+        }
+    }
+    return options;
+}
+// ============================================
+// Help Message
+// ============================================
+function printHelp() {
+    console.log(`
+MCP Local RAG Skills Installer
+
+Usage:
+  npx rag-vault skills install [options]
+
+Options:
+  --claude-code          Install to project-level Claude Code skills
+                         (./.claude/skills/)
+
+  --claude-code --global Install to user-level Claude Code skills
+                         (~/.claude/skills/)
+
+  --codex                Install to user-level Codex skills (default)
+                         ($CODEX_HOME/skills/ or ~/.codex/skills/)
+
+  --codex --project      Install to project-level Codex skills
+                         (./.codex/skills/)
+
+  --codex --global       Install to user-level Codex skills
+                         ($CODEX_HOME/skills/ or ~/.codex/skills/)
+
+  --path <path>          Install to custom path
+
+  --help, -h             Show this help message
+
+Examples:
+  npx rag-vault skills install --claude-code
+  npx rag-vault skills install --claude-code --global
+  npx rag-vault skills install --codex
+  npx rag-vault skills install --codex --project
+  npx rag-vault skills install --path ./my-skills/
+`);
+}
+// ============================================
+// Installation
+// ============================================
+function getTargetPath(options) {
+    if (options.target === 'custom') {
+        if (!options.customPath) {
+            console.error('Error: Custom path not specified');
+            process.exit(1);
+        }
+        return (0, node_path_1.resolve)(options.customPath, 'rag-vault');
+    }
+    return TARGETS[options.target];
+}
+function install(targetPath) {
+    // Check source exists
+    if (!(0, node_fs_1.existsSync)(SKILLS_SOURCE)) {
+        console.error(`Error: Skills source not found at ${SKILLS_SOURCE}`);
+        process.exit(1);
+    }
+    // Create target directory
+    const targetDir = (0, node_path_1.dirname)(targetPath);
+    if (!(0, node_fs_1.existsSync)(targetDir)) {
+        (0, node_fs_1.mkdirSync)(targetDir, { recursive: true });
+        console.log(`Created directory: ${targetDir}`);
+    }
+    // Copy skills
+    (0, node_fs_1.cpSync)(SKILLS_SOURCE, targetPath, { recursive: true });
+    console.log(`Installed skills to: ${targetPath}`);
+}
+// ============================================
+// Exported Run Function
+// ============================================
+/**
+ * Run the skills installer with the given arguments
+ * @param args - Command line arguments (after "skills install")
+ */
+function run(args) {
+    // Default to help if no args
+    if (args.length === 0) {
+        printHelp();
+        process.exit(0);
+    }
+    const options = parseArgs(args);
+    if (options.help) {
+        printHelp();
+        process.exit(0);
+    }
+    const targetPath = getTargetPath(options);
+    console.log('Installing MCP Local RAG skills...');
+    console.log(`Target: ${options.target}`);
+    console.log(`Path: ${targetPath}`);
+    console.log();
+    install(targetPath);
+    console.log();
+    console.log('Installation complete!');
+    console.log();
+    console.log('The following skills are now available:');
+    console.log('  - rag-vault (SKILL.md)');
+    console.log('  - references/html-ingestion.md');
+    console.log('  - references/query-optimization.md');
+    console.log('  - references/result-refinement.md');
+}
+//# sourceMappingURL=install-skills.js.map

package/dist/bin/install-skills.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"install-skills.js","sourceRoot":"","sources":["../../src/bin/install-skills.ts"],"names":[],"mappings":";AAAA;;;;;;;;;;;;;GAaG;;AAuLH,kBA+BC;AApND,qCAAuD;AACvD,qCAAiC;AACjC,yCAAkD;AAElD,+CAA+C;AAC/C,YAAY;AACZ,+CAA+C;AAE/C,+DAA+D;AAC/D,sDAAsD;AACtD,4DAA4D;AAC5D,6DAA6D;AAC7D,MAAM,aAAa,GAAG,IAAA,mBAAO,EAAC,SAAS,EAAE,IAAI,EAAE,IAAI,EAAE,QAAQ,EAAE,WAAW,CAAC,CAAA;AAE3E,kEAAkE;AAClE,oDAAoD;AACpD,MAAM,UAAU,GAAG,OAAO,CAAC,GAAG,CAAC,YAAY,CAAC,IAAI,IAAA,gBAAI,EAAC,IAAA,iBAAO,GAAE,EAAE,QAAQ,CAAC,CAAA;AAEzE,uBAAuB;AACvB,MAAM,OAAO,GAAG;IACd,qBAAqB,EAAE,4BAA4B;IACnD,oBAAoB,EAAE,IAAA,gBAAI,EAAC,IAAA,iBAAO,GAAE,EAAE,SAAS,EAAE,QAAQ,EAAE,WAAW,CAAC;IACvE,eAAe,EAAE,2BAA2B;IAC5C,cAAc,EAAE,IAAA,gBAAI,EAAC,UAAU,EAAE,QAAQ,EAAE,WAAW,CAAC;CAC/C,CAAA;AAYV,SAAS,SAAS,CAAC,IAAc;IAC/B,MAAM,OAAO,GAAY;QACvB,MAAM,EAAE,qBAAqB;QAC7B,IAAI,EAAE,KAAK;KACZ,CAAA;IAED,KAAK,IAAI,CAAC,GAAG,CAAC,EAAE,CAAC,GAAG,IAAI,CAAC,MAAM,EAAE,CAAC,EAAE,EAAE,CAAC;QACrC,MAAM,GAAG,GAAG,IAAI,CAAC,CAAC,CAAC,CAAA;QAEnB,QAAQ,GAAG,EAAE,CAAC;YACZ,KAAK,QAAQ,CAAC;YACd,KAAK,IAAI;gBACP,OAAO,CAAC,IAAI,GAAG,IAAI,CAAA;gBACnB,MAAK;YAEP,KAAK,eAAe;gBAClB,0BAA0B;gBAC1B,IAAI,IAAI,CAAC,CAAC,GAAG,CAAC,CAAC,KAAK,UAAU,EAAE,CAAC;oBAC/B,OAAO,CAAC,MAAM,GAAG,oBAAoB,CAAA;oBACrC,CAAC,EAAE,CAAA,CAAC,gBAAgB;gBACtB,CAAC;qBAAM,CAAC;oBACN,OAAO,CAAC,MAAM,GAAG,qBAAqB,CAAA;gBACxC,CAAC;gBACD,MAAK;YAEP,KAAK,SAAS;gBACZ,uCAAuC;gBACvC,IAAI,IAAI,CAAC,CAAC,GAAG,CAAC,CAAC,KAAK,WAAW,EAAE,CAAC;oBAChC,OAAO,CAAC,MAAM,GAAG,eAAe,CAAA;oBAChC,CAAC,EAAE,CAAA,CAAC,gBAAgB;gBACtB,CAAC;qBAAM,IAAI,IAAI,CAAC,CAAC,GAAG,CAAC,CAAC,KAAK,UAAU,EAAE,CAAC;oBACtC,OAAO,CAAC,MAAM,GAAG,cAAc,CAAA;oBAC/B,CAAC,EAAE,CAAA,CAAC,gBAAgB;gBACtB,CAAC;qBAAM,CAAC;oBACN,gDAAgD;oBAChD,OAAO,CAAC,MAAM,GAAG,cAAc,CAAA;gBACjC,CAAC;gBACD,MAAK;YAEP,KAAK,QAAQ,CAAC,CAAC,CAAC;gBACd,MAAM,OAAO,GAAG,IAAI,CAAC,CAAC,GAAG,CAAC,CAAC,CAAA;gBAC3B,IAAI,CAAC,OAAO,EAAE,CAAC;oBACb,OAAO,CAAC,KAAK,CAAC,wCAAwC,CAAC,CAAA;oBACvD,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAA;gBACjB,CAAC;gBACD,OAAO,CAAC,MAAM,GAAG,QAAQ,CAAA;gBACzB,OAAO,CAAC,UAAU,GAAG,OAAO,CAAA;gBAC5B,CAAC,EAAE,CAAA,CAAC,gBAAgB;gBACpB,MAAK;YACP,CAAC;YAED;gBACE,IAAI,GAAG,EAAE,UAAU,CAAC,GAAG,CAAC,EAAE,CAAC;oBACzB,OAAO,CAAC,KAAK,CAAC,mBAAmB,GAAG,EAAE,CAAC,CAAA;oBACvC,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAA;gBACjB,CAAC;QACL,CAAC;IACH,CAAC;IAED,OAAO,OAAO,CAAA;AAChB,CAAC;AAED,+CAA+C;AAC/C,eAAe;AACf,+CAA+C;AAE/C,SAAS,SAAS;IAChB,OAAO,CAAC,GAAG,CAAC;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;CAgCb,CAAC,CAAA;AACF,CAAC;AAED,+CAA+C;AAC/C,eAAe;AACf,+CAA+C;AAE/C,SAAS,aAAa,CAAC,OAAgB;IACrC,IAAI,OAAO,CAAC,MAAM,KAAK,QAAQ,EAAE,CAAC;QAChC,IAAI,CAAC,OAAO,CAAC,UAAU,EAAE,CAAC;YACxB,OAAO,CAAC,KAAK,CAAC,kCAAkC,CAAC,CAAA;YACjD,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAA;QACjB,CAAC;QACD,OAAO,IAAA,mBAAO,EAAC,OAAO,CAAC,UAAU,EAAE,WAAW,CAAC,CAAA;IACjD,CAAC;IAED,OAAO,OAAO,CAAC,OAAO,CAAC,MAAM,CAAC,CAAA;AAChC,CAAC;AAED,SAAS,OAAO,CAAC,UAAkB;IACjC,sBAAsB;IACtB,IAAI,CAAC,IAAA,oBAAU,EAAC,aAAa,CAAC,EAAE,CAAC;QAC/B,OAAO,CAAC,KAAK,CAAC,qCAAqC,aAAa,EAAE,CAAC,CAAA;QACnE,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAA;IACjB,CAAC;IAED,0BAA0B;IAC1B,MAAM,SAAS,GAAG,IAAA,mBAAO,EAAC,UAAU,CAAC,CAAA;IACrC,IAAI,CAAC,IAAA,oBAAU,EAAC,SAAS,CAAC,EAAE,CAAC;QAC3B,IAAA,mBAAS,EAAC,SAAS,EAAE,EAAE,SAAS,EAAE,IAAI,EAAE,CAAC,CAAA;QACzC,OAAO,CAAC,GAAG,CAAC,sBAAsB,SAAS,EAAE,CAAC,CAAA;IAChD,CAAC;IAED,cAAc;IACd,IAAA,gBAAM,EAAC,aAAa,EAAE,UAAU,EAAE,EAAE,SAAS,EAAE,IAAI,EAAE,CAAC,CAAA;IACtD,OAAO,CAAC,GAAG,CAAC,wBAAwB,UAAU,EAAE,CAAC,CAAA;AACnD,CAAC;AAED,+CAA+C;AAC/C,wBAAwB;AACxB,+CAA+C;AAE/C;;;GAGG;AACH,SAAgB,GAAG,CAAC,IAAc;IAChC,6BAA6B;IAC7B,IAAI,IAAI,CAAC,MAAM,KAAK,CAAC,EAAE,CAAC;QACtB,SAAS,EAAE,CAAA;QACX,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAA;IACjB,CAAC;IAED,MAAM,OAAO,GAAG,SAAS,CAAC,IAAI,CAAC,CAAA;IAE/B,IAAI,OAAO,CAAC,IAAI,EAAE,CAAC;QACjB,SAAS,EAAE,CAAA;QACX,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAA;IACjB,CAAC;IAED,MAAM,UAAU,GAAG,aAAa,CAAC,OAAO,CAAC,CAAA;IAEzC,OAAO,CAAC,GAAG,CAAC,oCAAoC,CAAC,CAAA;IACjD,OAAO,CAAC,GAAG,CAAC,WAAW,OAAO,CAAC,MAAM,EAAE,CAAC,CAAA;IACxC,OAAO,CAAC,GAAG,CAAC,SAAS,UAAU,EAAE,CAAC,CAAA;IAClC,OAAO,CAAC,GAAG,EAAE,CAAA;IAEb,OAAO,CAAC,UAAU,CAAC,CAAA;IAEnB,OAAO,CAAC,GAAG,EAAE,CAAA;IACb,OAAO,CAAC,GAAG,CAAC,wBAAwB,CAAC,CAAA;IACrC,OAAO,CAAC,GAAG,EAAE,CAAA;IACb,OAAO,CAAC,GAAG,CAAC,yCAAyC,CAAC,CAAA;IACtD,OAAO,CAAC,GAAG,CAAC,0BAA0B,CAAC,CAAA;IACvC,OAAO,CAAC,GAAG,CAAC,kCAAkC,CAAC,CAAA;IAC/C,OAAO,CAAC,GAAG,CAAC,sCAAsC,CAAC,CAAA;IACnD,OAAO,CAAC,GAAG,CAAC,qCAAqC,CAAC,CAAA;AACpD,CAAC"}

package/dist/chunker/index.d.ts

@@ -0,0 +1,11 @@
+/**
+ * Text chunk
+ */
+export interface TextChunk {
+    /** Chunk text */
+    text: string;
+    /** Chunk index (zero-based) */
+    index: number;
+}
+export { SemanticChunker } from './semantic-chunker.js';
+//# sourceMappingURL=index.d.ts.map

package/dist/chunker/index.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../../src/chunker/index.ts"],"names":[],"mappings":"AAAA;;GAEG;AACH,MAAM,WAAW,SAAS;IACxB,iBAAiB;IACjB,IAAI,EAAE,MAAM,CAAA;IACZ,+BAA+B;IAC/B,KAAK,EAAE,MAAM,CAAA;CACd;AAED,OAAO,EAAE,eAAe,EAAE,MAAM,uBAAuB,CAAA"}