@sitrozyi/repomix-semantic-compressor 0.1.2

package/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Sitrozyi
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

package/README.md

@@ -0,0 +1,105 @@
+# repomix-semantic-compressor
+
+[![test](https://github.com/Sitrozyi/repomix-semantic-compressor/actions/workflows/test.yml/badge.svg)](https://github.com/Sitrozyi/repomix-semantic-compressor/actions/workflows/test.yml)
+
+Context compressor for Repomix. On tested repositories it reduces prompt tokens by 45–80% by replacing function bodies while preserving type contracts, interfaces, docstrings, and database schemas ([Benchmark](#benchmark)).
+
+- **TypeScript / JavaScript**: Full AST-based compression via Babel. Function bodies are replaced with `throw new Error(...)` (inferred `never` return type), so strict type checkers pass without `any` escapes. React hook dependency arrays (`useEffect`, `useMemo`) are retained. Constructors and setters are the exception: constructors are emptied while preserving `super()` calls, and setters are emptied, since injecting `throw` there would break class initialization or violate the `set` contract.
+- **Python / Go**: Line-based function stubbing. Signatures and leading `"""docstrings"""` are preserved; Python bodies become `raise NotImplementedError`, Go bodies become `panic(...)`.
+- **Focus Mode** currently resolves imports and dependency graphs for TypeScript / JavaScript only. Python and Go files are compressed in full-repo mode but not dependency-traced.
+
+![Demo](./assets/repomix-compressor-demo.gif)
+
+## How It Compresses
+
+- **Action/Event Protocol Extraction (TS/JS)**: For truncated reducers, emitters, and dispatchers, `switch (action.type)` cases, `emitter.emit('X')`, `dispatch({ type: 'X' })`, and `action.payload.foo` destructuring are summarized into a single `@payloads` line (e.g. `LOGIN_USER(userId, authToken)`), preserving the wire contract without the implementation.
+- **Domain Logic Protection**: Keeps implementations intact for utility/logic functions matching `is*`, `has*`, `can*`, `calc*`, `validate*`, `check*`, etc.
+- **Schemas & Assets**: Retains SQL DDL (`CREATE TABLE`) while truncating bulk `INSERT` seeds. Keeps CSS `:root` tokens and layout properties while omitting decorative rules. Truncates long SVG paths and base64 strings.
+- **JSON**: Minifies JSON artifacts by parsing and re-serializing them, stripping redundant whitespace and trailing commas. No structural transformation is applied.
+- **YAML**: Strips full-line comments and collapses blank runs, while leaving block scalars (`|`, `>`) verbatim since their content is string data, not comments.
+- **Dockerfile**: Collapses long multi-line `RUN` instructions while preserving stage structure (`FROM`, `COPY`, `CMD`, `ENTRYPOINT`) and all other directives.
+- **Markdown**: Truncates fenced code blocks longer than 32 lines. Headings, prose, tables, and short examples are preserved verbatim.
+
+## Usage
+
+Run in your repository root. Auto-pack is enabled by default: if `repomix-output.xml` does not exist, it runs `npx repomix` automatically. Pass `--no-auto-pack` to disable this.
+
+```bash
+npx repomix-semantic-compressor
+```
+
+### Options
+
+| Option | Description |
+| :--- | :--- |
+| `-f, --focus <path>` | Retain full implementation for target path/module; skeletonize 1-hop imports; summarize the rest (TS/JS only) |
+| `-o, --output <file>` | Output file path (default: `repomix-optimized.md`) |
+| `-i, --input <file>` | Input artifact path (`.xml` or `.json`) |
+| `-m, --max-preserve-lines <n>` | Max lines to keep without truncation (default: `8`). For TS/JS this counts the whole function including signature; for Python/Go it counts the body only. |
+| `-e, --exact-tokens` | Use the exact `cl100k_base` BPE tokenizer instead of byte approximation |
+| `--no-auto-pack` | Disable automatic Repomix execution if artifact is missing |
+
+### Focus Mode
+
+Keep full code for the module you are editing and reduce everything else to skeletons or summaries:
+
+```bash
+npx repomix-semantic-compressor --focus src/auth -o auth-context.md
+```
+
+Dependency tracing (import resolution, 1-hop dependency skeletons) is currently implemented for TypeScript / JavaScript. Files matching type/contract paths (`types/`, `interfaces/`, `models/`, `schemas/`, `constants/`, `contracts/`, `entities/`, and `*.d.ts`) are transitively followed so that type information stays complete. For Python and Go, Focus Mode still emits full implementations for matched files, but non-focused files are not dependency-resolved.
+
+## MCP Server (Cursor / Claude Desktop / Windsurf)
+
+Exposes semantic skeleton extraction and file inspection as MCP tools. Add to your MCP configuration:
+
+```json
+{
+  "mcpServers": {
+    "repomix-semantic-compressor": {
+      "command": "npx",
+      "args": ["-y", "repomix-semantic-compressor", "--mcp"]
+    }
+  }
+}
+```
+
+### Exposed Tools
+
+- `get_repo_skeleton`: Returns the compressed semantic skeleton of the workspace.
+- `get_file_implementation`: Retrieves uncompressed full source code for a specific file.
+- `compress_repomix_file`: Compresses a repomix artifact to a destination file.
+
+## Benchmark
+
+Measured on 2026-09-12 on real-world repositories. Token counts use byte-length approximation (`bytes / 3.8`); run with `--exact-tokens` for exact `cl100k_base` BPE counts.
+
+| Repository | Language | Size (before) | Size (after) | Tokens (before) | Tokens (after) | Reduction |
+| :--- | :--- | ---: | ---: | ---: | ---: | ---: |
+| `sindresorhus/ky` | TypeScript | 737 kB | 382 kB | 198,637 | 102,929 | **-48.2%** |
+| `honojs/hono` | TypeScript | 2,774 kB | 839 kB | 747,527 | 225,979 | **-69.8%** |
+| `tailwindlabs/tailwindcss` | JS / CSS | 5,138 kB | 2,183 kB | 1,384,441 | 588,376 | **-57.5%** |
+| `gin-gonic/gin` | Go | 849 kB | 454 kB | 228,807 | 122,329 | **-46.5%** |
+
+To reproduce:
+
+```bash
+git clone https://github.com/Sitrozyi/repomix-semantic-compressor
+cd repomix-semantic-compressor
+npm install
+npm run benchmark
+```
+
+`npm run benchmark` runs all four repositories shown in the table above. You can also pass a custom repository URL directly:
+
+```bash
+npm run benchmark -- https://github.com/gin-gonic/gin.git
+```
+
+## Requirements
+
+- Node.js >= 18.3.0 (uses `node:worker_threads` and the global `performance` API).
+
+## License
+
+MIT (c) 2026 Sitrozyi

package/bin/cli.mjs

@@ -0,0 +1,16 @@
+#!/usr/bin/env node
+
+import { main } from '../src/core.mjs';
+import { startMCPServer } from '../src/mcp.mjs';
+
+if (process.argv.includes('--mcp')) {
+  startMCPServer().catch((err) => {
+    console.error(`MCP server fatal error: ${err.message}`);
+    process.exit(1);
+  });
+} else {
+  main().catch((err) => {
+    console.error(`fatal error: ${err.message}`);
+    process.exit(1);
+  });
+}

package/bin/mcp-server.mjs

@@ -0,0 +1,8 @@
+#!/usr/bin/env node
+
+import { startMCPServer } from '../src/mcp.mjs';
+
+startMCPServer().catch((err) => {
+  console.error(`MCP Server fatal error: ${err.message}`);
+  process.exit(1);
+});

package/package.json

@@ -0,0 +1,65 @@
+{
+  "name": "@sitrozyi/repomix-semantic-compressor",
+  "version": "0.1.2",
+  "description": "AST-powered semantic compressor for Repomix. Drastically reduce LLM context token usage while preserving complete schema integrity and core logic.",
+  "main": "src/core.mjs",
+  "exports": {
+    ".": "./src/core.mjs",
+    "./package.json": "./package.json"
+  },
+  "bin": {
+      "repomix-semantic-compressor": "bin/cli.mjs",
+      "repomix-compress": "bin/cli.mjs",
+      "rsc": "bin/cli.mjs",
+      "repomix-compress-mcp": "bin/mcp-server.mjs"
+    },
+  "type": "module",
+  "keywords": [
+    "repomix",
+    "repopack",
+    "llm",
+    "token-reduction",
+    "ast",
+    "babel",
+    "prompt-optimization",
+    "claude",
+    "chatgpt"
+  ],
+  "repository": {
+    "type": "git",
+    "url": "git+https://github.com/Sitrozyi/repomix-semantic-compressor.git"
+  },
+  "bugs": {
+    "url": "https://github.com/Sitrozyi/repomix-semantic-compressor/issues"
+  },
+  "homepage": "https://github.com/Sitrozyi/repomix-semantic-compressor#readme",
+  "author": "Sitrozyi",
+  "license": "MIT",
+  "files": [
+    "bin",
+    "src",
+    "README.md",
+    "LICENSE"
+  ],
+  "scripts": {
+    "test": "vitest run",
+    "test:watch": "vitest",
+    "mcp": "node bin/mcp-server.mjs",
+    "benchmark": "node benchmarks/run.mjs"
+  },
+  "dependencies": {
+    "@babel/generator": "^7.24.0",
+    "@babel/parser": "^7.24.0",
+    "@babel/traverse": "^7.24.0",
+    "@modelcontextprotocol/sdk": "^1.30.0",
+    "fast-xml-parser": "^4.4.0",
+    "js-tiktoken": "^1.0.21",
+    "postcss": "^8.5.26"
+  },
+  "devDependencies": {
+    "vitest": "^1.6.0"
+  },
+  "engines": {
+    "node": ">=18.3.0"
+  }
+}