pi-lens 2.2.10 → 3.0.0

package/CHANGELOG.md

@@ -2,6 +2,204 @@
 
 All notable changes to pi-lens will be documented in this file.
 
+## [2.7.0] - 2026-03-31
+
+### Added - New Lint Runners
+
+Three new lint runners with full test coverage:
+
+- **Spellcheck runner** (`clients/dispatch/runners/spellcheck.ts`): Markdown spellchecking
+  - Uses `typos-cli` (Rust-based, fast, low false positives)
+  - Checks `.md` and `.mdx` files
+  - Priority 30, runs after code quality checks
+  - Zero-config by default
+  - Install: `cargo install typos-cli`
+
+- **Oxlint runner** (`clients/dispatch/runners/oxlint.ts`): Fast JS/TS linting
+  - Uses `oxlint` from Oxc project (Rust-based, ~100x faster than ESLint)
+  - Zero-config by default
+  - JSON output with fix suggestions
+  - Priority 12 (between biome=10 and slop=25)
+  - Fallback mode after biome
+  - Install: `npm install -D oxlint` or `cargo install oxlint`
+  - Flag: `--no-oxlint` to disable
+
+- **Shellcheck runner** (`clients/dispatch/runners/shellcheck.ts`): Shell script linting
+  - Industry-standard linter for bash/sh/zsh/fish
+  - Detects syntax errors, undefined variables, quoting issues
+  - Priority 20 (same as type-safety)
+  - JSON output parsing
+  - Install: `apt install shellcheck`, `brew install shellcheck`, or `cargo install shellcheck`
+  - Flag: `--no-shellcheck` to disable
+
+### Changed
+- Updated README.md with new runners in dispatcher diagram and available runners table
+- Added installation instructions for new tools in Dependent Tools section
+- Added new flags to Flag Reference
+
+---
+
+## [2.6.0] - 2026-03-30
+
+### Added - Phase 1: Event Bus Architecture
+- **Event Bus System** (`clients/bus/`): Decoupled pub/sub for diagnostic events
+  - `bus.ts` — Core publish/subscribe with `once()`, `waitFor()`, middleware support
+  - `events.ts` — 12 typed event definitions (DiagnosticFound, RunnerStarted, LspDiagnostic, etc.)
+  - `integration.ts` — Integration hooks for pi-lens index.ts with aggregator state
+- **Bus-integrated dispatcher** (`clients/dispatch/bus-dispatcher.ts`): Concurrent runner execution with event publishing
+- **New flags**: `--lens-bus`, `--lens-bus-debug` for event system control
+
+### Added - Phase 2: Effect-TS Service Layer
+- **Effect-TS infrastructure** (`clients/services/`): Composable async operations
+  - `runner-service.ts` — Concurrent runner execution with timeout handling
+  - `effect-integration.ts` — Bus-integrated Effect dispatch
+- **Structured concurrency**: `Effect.all()` with `{ concurrency: "unbounded" }`
+- **Graceful error recovery**: Individual runner failures don't stop other runners
+- **New flag**: `--lens-effect` for concurrent execution
+
+### Added - Phase 3: Multi-LSP Client (31 Language Servers)
+- **LSP Core** (`clients/lsp/`): Full Language Server Protocol support
+  - `client.ts` — JSON-RPC client with debounced diagnostics (150ms)
+  - `server.ts` — 31 LSP server definitions with root detection
+  - `language.ts` — File extension to LSP language ID mappings
+  - `launch.ts` — LSP process spawning utilities
+  - `index.ts` — Service layer with Effect integration
+  - `config.ts` — Custom LSP configuration support (`.pi-lens/lsp.json`)
+- **Built-in servers** (31 total):
+  - Core: TypeScript, Python, Go, Rust, Ruby, PHP, C#, F#, Java, Kotlin
+  - Native: C/C++, Zig, Swift, Dart, Haskell, OCaml, Lua
+  - Functional: Elixir, Gleam, Clojure
+  - DevOps: Terraform, Nix, Docker, Bash
+  - Config: YAML, JSON, Prisma
+  - Web (NEW): Vue, Svelte, ESLint, CSS/SCSS/Sass/Less
+- **Smart root detection**: `createRootDetector()` walks up tree looking for lockfiles/config
+- **Multi-server support**: Multiple LSP servers can handle same file type
+- **Debounced diagnostics**: 150ms debounce for cascading diagnostics (syntax → semantic)
+- **New flag**: `--lens-lsp` to enable LSP system
+- **Deprecated**: Old `ts-lsp` runner falls back to built-in TypeScriptClient when `--lens-lsp` not set
+
+### Added - Phase 4: Auto-Installation System
+- **Auto-installer** (`clients/installer/`): Automatic tool installation
+  - `index.ts` — Core installation logic for npm/pip packages
+  - `isToolInstalled()` — Check global PATH or local `.pi-lens/tools/`
+  - `installTool()` — Auto-install via npm or pip
+  - `ensureTool()` — Check first, install if missing
+- **Auto-installation for**: typescript-language-server, pyright, ruff, biome, ast-grep
+- **Local tools directory**: `.pi-lens/tools/node_modules/.bin/`
+- **PATH integration**: Local tools automatically added to PATH
+- **LSP integration**: TypeScript and Python servers now use `ensureTool()` before spawning
+
+### Changed - Commands
+- **Disabled**: `/lens-booboo-fix` — Now shows warning "currently disabled. Use /lens-booboo"
+- **Disabled**: `/lens-booboo-delta` — Now shows warning "currently disabled. Use /lens-booboo"
+- **Disabled**: `/lens-booboo-refactor` — Now shows warning "currently disabled. Use /lens-booboo"
+- **Active**: `/lens-booboo` — Full codebase review (only booboo command now)
+
+### Changed - Architecture
+- **Three-phase system**: Bus → Effect → LSP can be enabled independently
+- **Dispatcher priority**: `lens-effect` > `lens-bus` > default (sequential)
+- **LSP deprecation**: Old built-in TypeScriptClient deprecated, LSP client preferred
+
+### Documentation
+- **LSP configuration guide**: `docs/LSP_CONFIG.md` — How to add custom LSP servers
+- **README updated**: Added LSP section, three-phase architecture, 31 language matrix
+- **CHANGELOG restructured**: Now organized by Phase 1/2/3/4
+
+### Technical Details
+- **New dependencies**: `effect` (Phase 2), `vscode-jsonrpc` (Phase 3)
+- **Lines added**: ~6,000 across 4 phases
+- **Test status**: 617 passing (3 flaky unrelated tests)
+- **Backward compatibility**: All new features opt-in via flags
+
+## [2.5.0] - 2026-03-30
+
+### Added
+- **Python tree-sitter support**: 6 structural patterns for Python code analysis
+  - `bare-except` — Detects `except:` that catches SystemExit/KeyboardInterrupt
+  - `mutable-default-arg` — Detects mutable defaults like `def f(x=[])`
+  - `wildcard-import` — Detects `from module import *`
+  - `eval-exec` — Detects `eval()` and `exec()` security risks
+  - `is-vs-equals` — Detects `is "literal"` that should use `==`
+  - `unreachable-except` — Detects unreachable exception handlers
+- **Multi-language tree-sitter architecture**: Query files in `rules/tree-sitter-queries/{language}/`
+  - TypeScript/TSX: 10 patterns
+  - Python: 6 patterns
+- **Tree-sitter query loader**: YAML-based query definitions with multi-line array support
+- **Query file extraction**: Moved TypeScript patterns from embedded code to `rules/tree-sitter-queries/typescript/*.yml`
+
+### Changed
+- **README updated**: Added Python patterns to structural analysis section
+- **Architect client**: Fixed TypeScript errors (`configPath` property declaration)
+
+### Technical Details
+- Downloaded `tree-sitter-python.wasm` (458KB) for Python AST parsing
+- Post-filters for semantic validation (e.g., distinguishing bare except from specific handlers)
+- ~50ms analysis time per file for Python
+
+## [2.4.0] - 2026-03-30
+
+### Added
+- **`safeSpawn` utility**: Cross-platform spawn wrapper that eliminates `DEP0190` deprecation warnings on Windows. Uses command string construction instead of shell+args array.
+- **Runner tracking for `/lens-booboo`**: Each runner now reports execution time and findings count. Summary shows `[1/10] runner name...` progress and final table with `| Runner | Status | Findings | Time |`.
+- **Shared runner utilities**: Extracted `runner-helpers.ts` with:
+  - `createAvailabilityChecker()` - cached tool availability checks
+  - `createConfigFinder()` - rule directory resolution
+  - `createVenvFinder()` - venv-aware command lookup
+  - Shared `isSgAvailable()` for ast-grep
+- **Shared diagnostic parsers**: Extracted `diagnostic-parsers.ts` with:
+  - `createLineParser()` - factory for line-based tool output
+  - `parseRuffOutput`, `parseGoVetOutput`, `createBiomeParser()` - pre-built parsers
+  - `createSimpleParser()` - simplified factory for standard formats
+- **Architect test coverage**: 5 new tests for the architect runner (config loading, size limits, pattern detection, test file exclusion).
+- **Type extraction**: Created `clients/ast-grep-types.ts` to break circular dependencies between `ast-grep-client`, `ast-grep-parser`, and `ast-grep-rule-manager`.
+
+### Changed
+- **26 files refactored to use `safeSpawn`**: Eliminated `shell: process.platform === "win32"` deprecation pattern across all clients and runners.
+- **Updated runners to use shared utilities**:
+  - `ruff.ts`, `pyright.ts` → use `createAvailabilityChecker()`
+  - `python-slop.ts`, `ts-slop.ts` → use `createConfigFinder()` and shared `isSgAvailable()`
+  - `ruff.ts`, `go-vet.ts`, `biome.ts` → use shared diagnostic parsers
+- **Architect runner improvements**:
+  - Added `skipTestFiles: true` to reduce noise from test files
+  - Updated `default-architect.yaml` with per-file-type limits (500 services, 1000 clients, 5000 tests)
+  - Removed `no process.env` rule (too strict for CLI tools)
+  - Relaxed `console.log` rule to only apply to `src/` and `lib/` directories
+- **Test cleanup safety**: Fixed all test files to use `fs.existsSync()` before `fs.unlinkSync()` to prevent ENOENT errors.
+
+### Fixed
+- **Circular dependencies**: Eliminated 2 cycles (`ast-grep-client` ↔ `ast-grep-parser`, `ast-grep-client` ↔ `ast-grep-rule-manager`) by extracting shared types.
+- **Test flakiness**: All 70 test files now pass consistently (666 tests total).
+
+### Code Quality
+- **Lines saved**: ~350 lines of duplicated code removed across utilities and parsers.
+- **Architect violations**: Reduced from 404 to ~50-80 (after test file exclusion + relaxed rules).
+
+## [2.3.0] - 2026-03-30
+
+### Added
+- **NAPI-based runner (`ast-grep-napi`)**: 100x faster TypeScript/JavaScript analysis (~9ms vs ~1200ms). Uses `@ast-grep/napi` for native-speed structural pattern matching. Priority 15, applies to TS/JS files only.
+- **Python slop detection (`python-slop`)**: New CLI runner with ~40 AI slop patterns from slop-code-bench research. Detects chained comparisons, manual min/max, redundant if/else, list comprehension opportunities, etc.
+- **TypeScript slop detection (`ts-slop-rules`)**: ~30 patterns for TS/JS slop detection including `for-index-length`, `empty-array-check`, `redundant-filter-map`, `double-negation`, `unnecessary-array-from`.
+- **`fix-simplified.ts` command**: New streamlined `/lens-booboo-fix` implementation with file-level exclusions (test files, excluded dirs) and anti-slop guidance. Uses `pi.sendUserMessage()` for actionable AI prompts.
+- **Comprehensive test coverage**: 25+ tests added across all runners (NAPI, Python slop, TS slop, YAML loading).
+- **Codebase self-scan**: `scan_codebase.test.ts` for testing the NAPI runner against the pi-lens codebase itself.
+
+### Changed
+- **Architecture documentation**: Updated README with complete architecture overview, runner system diagram, and language support matrix.
+- **Disabled problematic slop rules**: `ts-for-index-length` and `ts-unnecessary-array-isarray` disabled due to false positives on legitimate index-based operations.
+- **Runner registration**: Updated `clients/dispatch/runners/index.ts` with new runner priorities (ts-lsp/pyright at 5, ast-grep-napi at 15, python-slop at 25).
+- **TS slop runner disabled**: CLI runner `ts-slop.ts` disabled in favor of NAPI-based detection (faster, same rules).
+
+### Deprecated
+- **`/lens-rate` command**: Now shows deprecation warning. Needs re-structuring. Users should use `/lens-booboo` instead.
+- **`/lens-metrics` command**: Now shows deprecation warning. Temporarily disabled, will be restructured. Users should use `/lens-booboo` instead.
+
+### Removed
+- **Old implementations removed**: 259 lines of deprecated command code removed from `index.ts`.
+
+### Repository Cleanup
+- **Local-only files removed from GitHub**: `.pisessionsummaries/` and `refactor.md` removed from repo (still in local `.gitignore`).
+
 ## [2.1.1] - 2026-03-29
 
 ### Added