token-pilot 0.14.1 → 0.15.0

package/CHANGELOG.md

@@ -5,6 +5,23 @@ All notable changes to Token Pilot will be documented in this file.
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+## [0.15.0] - 2026-03-19
+
+### Added
+- **Regex fallback parser** — `smart_read` now works for TS/JS files even without ast-index binary. Parses classes, functions, interfaces, types, enums, and class methods via regex. Zero dependencies, 130 lines. Covers ~80% of new users who fail to download ast-index.
+- **Guide skill** — `/guide` command shows a quick-reference table of all Token Pilot tools with usage examples and recommended workflow.
+- **`hooks.denyThreshold` config** — hook deny threshold is now configurable in `.token-pilot.json` (default: 300, was hardcoded 500). Intercepts ~2x more native Read calls.
+
+### Changed
+- **Compact session analytics** — `session_analytics` report reduced from ~30 lines to ~5 lines. Shows calls, tokens saved, top 5 tools, top 3 files, cache hit rate on a single screen.
+- **`server.ts` refactor** — extracted tool definitions to `server/tool-definitions.ts` and token estimate helpers to `server/token-estimates.ts` (−500 lines from server.ts).
+- **`find_usages` output** — results grouped by file with compact rendering. Single match per file on one line, multiple matches indented under file header.
+- **Stale references** — all `grep_search` hints updated to `Grep` (code-audit, find-unused, find-usages).
+- **409 tests** (was 393).
+
+### Fixed
+- **`npx token-pilot` CLI** — symlink path resolution in `isDirectRun` check. All CLI commands now work correctly via npx.
+
 ## [0.14.1] - 2026-03-14
 
 ### Fixed

package/README.md

@@ -1,6 +1,6 @@
 # Token Pilot
 
-MCP server that reduces token consumption in AI coding assistants by **60-80%** via AST-aware lazy file reading.
+MCP server that reduces token consumption in AI coding assistants by **up to 80%** via AST-aware lazy file reading.
 
 Instead of dumping entire files into the LLM context, Token Pilot returns structural overviews (classes, functions, signatures, line ranges) and lets the AI load only the specific symbols it needs.
 
@@ -13,7 +13,7 @@ Token Pilot:  smart_read("user-service.ts")  →  15-line outline  →  ~200 tok
               After edit: read_diff("user-service.ts")  →  ~20 tokens
 ```
 
-**~80% reduction** in this example. Files under 200 lines are returned in full automatically (no overhead for small files). Real savings start at ~200+ lines.
+**Up to 80% reduction** on large files. Files under 200 lines are returned in full automatically (zero overhead for small files). Typical sessions with a mix of file sizes see **30-50% savings**, scaling higher with repeated reads (session cache, compact reminders) and targeted symbol loading.
 
 ## Installation
 
@@ -132,7 +132,7 @@ npx token-pilot uninstall-hook          # Remove
 When connected, every MCP client receives rules like:
 
 ```
-WHEN TO USE TOKEN PILOT (saves 60-80% tokens):
+WHEN TO USE TOKEN PILOT (saves up to 80% tokens):
 • Reading code files → smart_read (returns structure, not raw content)
 • Need one function/class → read_symbol (loads only that symbol)
 • Exploring a directory → outline (all symbols in one call)
@@ -158,7 +158,7 @@ For more control, you can add rules to your project:
 
 | Tool | Instead of | Description |
 |------|-----------|-------------|
-| `smart_read` | `Read` | AST structural overview: classes, functions, methods with signatures. 60-80% savings. Framework-aware: shows HTTP routes, column types, validation rules. |
+| `smart_read` | `Read` | AST structural overview: classes, functions, methods with signatures. Up to 80% savings on large files. Framework-aware: shows HTTP routes, column types, validation rules. |
 | `read_symbol` | `Read` + scroll | Load source of a specific symbol. Supports `Class.method`. `show` param: full/head/tail/outline. |
 | `read_for_edit` | `Read` before `Edit` | Minimal RAW code around a symbol — copy directly as `old_string` for Edit tool. |
 | `read_range` | `Read` offset | Read a specific line range from a file. |
@@ -280,13 +280,13 @@ When both are configured, Token Pilot automatically:
 - Suggests context-mode for large non-code files
 - Shows combined architecture info in `session_analytics`
 
-**Combined savings: 60-80%** in a typical coding session.
+**Combined savings: up to 80%** in a typical coding session.
 
 ## Supported Languages
 
-Token Pilot supports all 23 languages that [ast-index](https://github.com/defendend/Claude-ast-index-search) supports:
+Token Pilot supports all 29 languages that [ast-index](https://github.com/defendend/Claude-ast-index-search) supports:
 
-TypeScript, JavaScript, Python, Rust, Go, Java, Kotlin, Swift, C#, C++, C, PHP, Ruby, Scala, Dart, Lua, Shell/Bash, SQL, R, Vue, Svelte, Perl, Groovy
+TypeScript, JavaScript, Python, Rust, Go, Java, Kotlin, Swift, Objective-C, C#, C++, C, PHP, Ruby, Scala, Dart, Lua, Shell/Bash, SQL, R, Vue, Svelte, Perl, Groovy, Elixir, Common Lisp, Matlab, Protocol Buffers, BSL (1C:Enterprise)
 
 Plus structural summaries for non-code files: JSON, YAML, Markdown, TOML, XML, CSV.
 
@@ -395,7 +395,7 @@ src/
 
 Token Pilot is built on top of these excellent open-source projects:
 
-- **[ast-index](https://github.com/defendend/Claude-ast-index-search)** by [@defendend](https://github.com/defendend) — Rust-based AST indexing engine with tree-sitter, SQLite FTS5, and support for 23 programming languages. Token Pilot uses it as the backend for all code analysis.
+- **[ast-index](https://github.com/defendend/Claude-ast-index-search)** by [@defendend](https://github.com/defendend) — Rust-based AST indexing engine with tree-sitter, SQLite FTS5, and support for 29 programming languages. Token Pilot uses it as the backend for all code analysis.
 - **[claude-context-mode](https://github.com/mksglu/claude-context-mode)** by [@mksglu](https://github.com/mksglu) — Complementary MCP plugin for shell output and data file processing via sandbox + BM25. Token Pilot integrates with it for maximum combined savings.
 - **[Model Context Protocol](https://modelcontextprotocol.io/)** by Anthropic — The protocol that makes all of this possible.
 

package/dist/ast-index/client.d.ts

@@ -20,21 +20,8 @@ export declare class AstIndexClient {
     init(): Promise<void>;
     ensureIndex(): Promise<void>;
     private buildIndex;
-    /** Mark index as oversized — disables index-dependent tools, outline still works */
     private handleOversizedIndex;
-    /** Extract file count from stats output (JSON or text) */
-    private parseFileCount;
     outline(filePath: string): Promise<FileStructure | null>;
-    /**
-     * Parse text output from `ast-index outline`:
-     *   Outline of src/file.ts:
-     *     :10 ClassName [class]
-     *     :11 propName [property]
-     *     :14 methodName [function]
-     */
-    private parseOutlineText;
-    /** Compute end_line from sequential start positions */
-    private computeEndLines;
     symbol(name: string): Promise<AstIndexSymbolDetail | null>;
     search(query: string, options?: {
         inFile?: string;
@@ -44,119 +31,43 @@ export declare class AstIndexClient {
     usages(symbolName: string): Promise<AstIndexUsageResult[]>;
     implementations(name: string): Promise<AstIndexImplementation[]>;
     hierarchy(name: string): Promise<AstIndexHierarchyNode | null>;
-    private parseImplementationsText;
-    private parseHierarchyText;
     stats(): Promise<string | null>;
-    /**
-     * List all files known to the ast-index.
-     * Parses the `files` command output which lists one file per line.
-     */
     listFiles(): Promise<string[]>;
-    /**
-     * Cross-references: definitions + imports + usages in one call.
-     * Replaces separate symbol() + usages() calls.
-     */
     refs(symbolName: string, limit?: number): Promise<AstIndexRefsResponse>;
-    /**
-     * Project map: directory structure with file counts and symbol kinds.
-     */
     map(options?: {
         module?: string;
         limit?: number;
     }): Promise<AstIndexMapResponse | null>;
-    /**
-     * Detect project conventions: architecture, frameworks, naming patterns.
-     */
     conventions(): Promise<AstIndexConventionsResponse | null>;
-    /**
-     * Find callers of a function.
-     */
     callers(functionName: string, limit?: number): Promise<AstIndexCallerEntry[]>;
-    /**
-     * Show call hierarchy tree (callers tree up).
-     */
     callTree(functionName: string, depth?: number): Promise<AstIndexCallTreeNode | null>;
-    /**
-     * Show changed symbols since base branch (git diff).
-     */
     changed(base?: string): Promise<AstIndexChangedEntry[]>;
-    /**
-     * Find potentially unused symbols.
-     */
     unusedSymbols(options?: {
         module?: string;
         exportOnly?: boolean;
         limit?: number;
     }): Promise<AstIndexUnusedSymbol[]>;
-    /**
-     * Get imports for a specific file.
-     * Parses text output: "  { X, Y } from 'source';"
-     */
     fileImports(filePath: string): Promise<AstIndexImportEntry[]>;
-    private parseImportsText;
-    /** Check if ast-grep (sg) is available for structural pattern search */
     private checkAstGrep;
-    /** Structural pattern search via ast-grep. Requires ast-grep (sg) installed. */
     agrep(pattern: string, options?: {
         lang?: string;
         limit?: number;
     }): Promise<AstIndexAgrepMatch[]>;
-    private parseAgrepText;
-    /** Find TODO/FIXME/HACK comments in the project */
     todo(): Promise<AstIndexTodoEntry[]>;
-    private parseTodoText;
-    /** Find @Deprecated symbols in the project */
     deprecated(): Promise<AstIndexDeprecatedEntry[]>;
-    private parseDeprecatedText;
-    /** Find symbols with a specific annotation/decorator */
     annotations(name: string): Promise<AstIndexAnnotationEntry[]>;
-    private parseAnnotationsText;
-    /** Trigger incremental index update (called by file watcher after edits) */
     incrementalUpdate(): Promise<void>;
-    /** List project modules matching optional pattern */
     modules(pattern?: string): Promise<AstIndexModuleEntry[]>;
-    /** Get dependencies of a module */
     moduleDeps(module: string): Promise<AstIndexModuleDep[]>;
-    /** Get modules that depend on this module */
     moduleDependents(module: string): Promise<AstIndexModuleDep[]>;
-    /** Find unused dependencies of a module */
     unusedDeps(module: string): Promise<AstIndexUnusedDep[]>;
-    /** Get public API of a module */
     moduleApi(module: string): Promise<AstIndexModuleApi[]>;
-    private parseModuleListText;
-    private parseModuleDepText;
-    private parseUnusedDepsText;
-    private parseModuleApiText;
     isAvailable(): boolean;
-    /** Returns true if the index was built but found >50k files (node_modules leak) */
     isOversized(): boolean;
-    /** Returns true if index building is disabled (dangerous root like /) */
     isDisabled(): boolean;
-    /** Disable index building (e.g. project root is / or home dir) */
     disableIndex(): void;
-    /** Re-enable index building after auto-detecting a valid project root */
     enableIndex(): void;
-    /** Update project root (e.g. after auto-detecting from file path) */
     updateProjectRoot(newRoot: string): void;
     private exec;
-    private buildFileStructure;
-    /**
-     * Python: ast-index doesn't return methods inside classes.
-     * Parse file content to extract `def` methods for classes without children.
-     */
-    private enrichPythonClassMethods;
-    /**
-     * PHP: ast-index doesn't return methods inside classes.
-     * Parse file content to extract `function` methods for classes without children.
-     */
-    private enrichPHPClassMethods;
-    /** Fix the last entry's end_line to use actual file line count */
-    private fixLastEndLine;
-    /** Read actual signature lines from file content */
-    private enrichSignatures;
-    private mapOutlineEntry;
-    private mapKind;
-    private mapVisibility;
-    private detectLanguage;
 }
 //# sourceMappingURL=client.d.ts.map