ironcode-ai 1.7.0 → 1.9.0

package/README.md

@@ -22,6 +22,43 @@
 
 ---
 
+## 🎉 What's New
+
+### February 2026 - Streaming Optimizations
+
+**Massive performance and memory improvements through streaming patterns:**
+
+#### File Read Optimization
+
+- ⚡ **1.17-1.56x faster** across all file sizes
+- 💾 **99.7% memory savings** on large files (39MB → 0.13MB for 100K lines)
+- 📖 64KB buffer with pre-allocated capacity eliminates reallocation
+- ✅ **100% identical results** - zero breaking changes
+
+#### Grep Search Optimization
+
+- 💾 **90-99% memory reduction** when searching large files
+- 🔍 Stream lines instead of loading entire files
+- ⚡ Early exit after 1000 matches for efficiency
+- 🎯 Can search **GB-sized files** without running out of memory
+- ✅ **100% identical results** - verified with comprehensive tests
+
+**Why streaming matters:**
+
+- Search 100 files × 1MB each: **100MB → 10MB memory** usage
+- No data loss - regex matches on full line content before display truncation
+- Scales to much larger codebases on memory-constrained systems
+
+### Previous Updates
+
+- **Memory optimization** - 97.6% faster message processing (254ms → 6ms) - Feb 2026
+- **Resource monitoring** - Automatic throttling with 300MB default limit - Feb 2026
+- **PTY/Terminal native** - 15.29x speedup, powers Bash tool - Feb 2026
+- **Edit tool optimization** - 2-6x faster with 9 smart strategies
+- **Archive extraction** - 3-5x faster with s-zip native
+
+---
+
 ## What is IronCode?
 
 IronCode is a **high-performance CLI fork** of [OpenCode](https://github.com/anomalyco/opencode) - an AI coding agent that runs entirely on your machine. This fork focuses on the command-line experience, removes cloud dependencies, and **rewrites performance-critical components in Rust** for dramatically improved speed and efficiency.
@@ -37,6 +74,46 @@ IronCode is a **high-performance CLI fork** of [OpenCode](https://github.com/ano
 
 ### 🚀 Performance Improvements
 
+IronCode delivers exceptional performance through **native Rust components** and **intelligent memory management**:
+
+#### Memory Efficiency & Resource Monitoring
+
+IronCode includes an **automatic resource monitoring system** that keeps memory usage under control:
+
+- 🎯 **Default 300MB limit** - Prevents excessive memory consumption
+- 📊 **Real-time monitoring** - Checks every 5 seconds with three levels (normal/warning/critical)
+- 🚦 **Auto-throttling** - Automatically slows down at 95% memory to prevent crashes
+- ⚡ **Optimized processing** - 98% faster message handling with selective cloning
+- 🔧 **Configurable** - Adjust limits with `--max-memory` flag or disable with `--no-enable-resource-monitor`
+
+**Memory Optimizations:**
+
+| Optimization                     | Impact                 | Speedup                         |
+| -------------------------------- | ---------------------- | ------------------------------- |
+| **Selective Message Cloning**    | 4.1MB saved per step   | 97.6% faster (254ms → 6ms)      |
+| **Array Operation Improvements** | Reduced GC pressure    | 7 optimizations across codebase |
+| **Automatic Throttling**         | Prevents memory spikes | Active at 285MB (95% threshold) |
+
+**Example Usage:**
+
+```bash
+# Default (300MB limit, monitoring enabled)
+ironcode
+
+# Custom memory limit
+ironcode --max-memory 500
+
+# Disable resource monitoring
+ironcode --no-enable-resource-monitor
+
+# Both options
+ironcode --max-memory 400 --enable-resource-monitor
+```
+
+See [RESOURCE-MONITORING.md](./RESOURCE-MONITORING.md) for full documentation.
+
+#### Native Rust Performance
+
 IronCode rewrites key operations in native Rust with **measured real-world performance gains**:
 
 | Operation                 | TypeScript/Node | Rust Native | **Speedup**        | Notes                  |
@@ -55,51 +132,55 @@ IronCode rewrites key operations in native Rust with **measured real-world perfo
 | **File Listing**          | 15.80 ms        | 11.50 ms    | **1.37x faster**   | Native ignore crate    |
 | **File Glob (100 files)** | 9.74 ms         | 3.55 ms     | **2.74x faster**   | Zero spawn overhead    |
 | **Grep Search**           | 34.84 ms        | 19.35 ms    | **1.80x faster**   | Pattern: "function"    |
+| **Grep (streaming)**      | N/A             | Similar     | **90-99% memory**  | Can search GB files    |
 | **VCS Info (git)**        | 17.25 ms        | 9.43 ms     | **1.83x faster**   | libgit2, no spawning   |
 | **Archive (small, 10)**   | 5.48 ms         | 1.93 ms     | **2.8x faster**    | s-zip vs unzip         |
 | **Archive (medium, 100)** | 90.43 ms        | 18.07 ms    | **5.0x faster**    | s-zip vs unzip         |
 | **Archive (large, 500)**  | 740.29 ms       | 142.88 ms   | **5.2x faster**    | s-zip vs unzip         |
-| **Read (500 lines)**      | 18 µs           | 27 µs       | 0.67x              | Raw FFI                |
-| **Read (1K lines)**       | 29 µs           | 47 µs       | 0.62x              | Raw FFI                |
-| **Read (5K lines)**       | 120 µs          | 194 µs      | 0.62x              | Raw FFI                |
-| **Write (1K lines)**      | 49 µs           | 139 µs      | 0.35x              | Raw FFI                |
-| **Write (5K lines)**      | 135 µs          | 408 µs      | 0.33x              | Raw FFI                |
+| **Read (1K lines)**       | 0.06 ms         | 0.04 ms     | **1.50x faster**   | 64KB buffer + capacity |
+| **Read (10K lines)**      | 0.34 ms         | 0.29 ms     | **1.17x faster**   | Pre-allocation         |
+| **Read (50K lines)**      | 1.45 ms         | 0.97 ms     | **1.49x faster**   | Streaming optimized    |
+| **Read (100K lines)**     | 3.71 ms         | 2.38 ms     | **1.56x faster**   | 99.7% memory savings   |
+| **Read (500K lines)**     | 31.50 ms        | 21.55 ms    | **1.46x faster**   | 30MB file              |
 
 **Key Insights:**
 
 - 🎯 **PTY/Terminal**: **15.29x faster** (exceeded 10x target!) - Native ring buffer, zero-copy reads
+- ✅ **File Read**: **1.17-1.56x faster** with **99.7% memory savings** (39MB → 0.13MB for 100K lines) - 64KB buffer + pre-allocation
+- ✅ **Grep Search**: **90-99% memory reduction** with streaming - Can search GB-sized files without OOM
 - ✅ **Edit Tool**: 2-6x faster across all file sizes with all 9 smart replacement strategies
 - ✅ **Bash Parser**: 50-100x faster using native tree-sitter vs WASM (0.020ms per command, no initialization overhead)
 - ✅ **Glob/Grep**: 1.8-2.7x faster by eliminating process spawn overhead
 - ✅ **VCS Info**: 1.83x faster using libgit2 directly (no process spawning, 45% latency reduction)
 - ✅ **Archive Extraction**: 3-5x faster using s-zip vs shell commands (unzip/PowerShell)
-- ⚠️ **File I/O**: Raw FFI is 1.5-3x slower than Bun native due to FFI overhead
-- 📊 **Memory**: Equivalent peak heap usage between Rust and Node.js for file I/O
-- 🎯 **Lesson**: FFI overhead (~50µs) remains; only use Rust when compute > overhead
-- 🔧 **Decision**: We use raw Rust FFI for consistency across native tool suite
+- 📊 **Memory**: Streaming patterns use only 64KB buffer regardless of file size
+- 🎯 **Lesson**: Pre-allocation + streaming + larger buffers = faster I/O with dramatically less memory
 
 **Native Rust Components:**
 
 - ✅ **PTY/Terminal**: Full terminal session management with 2MB ring buffer, zero-copy streaming (15.29x faster) - Powers all Bash tool operations
+- ✅ **File Reading**: Streaming read with 64KB buffer and pre-allocation (1.2-1.6x faster, 99.7% memory savings)
+- ✅ **Grep Search**: Streaming line-by-line search (90-99% memory reduction, scales to GB files)
 - ✅ **Edit Tool**: 9 smart replacement strategies with fuzzy matching (complex compute justifies FFI)
 - ✅ **File Listing**: Native ignore crate for fast directory traversal (eliminates process spawn)
 - ✅ **File Search (Glob)**: Pattern matching with gitignore support (eliminates process spawn)
-- ✅ **Code Search (Grep)**: Regex search across large codebases (eliminates process spawn)
 - ✅ **Archive Extraction**: ZIP file extraction using s-zip streaming reader (3-5x faster, cross-platform)
 - ✅ **Bash Parser**: Native tree-sitter bash command parsing (50-100x faster than WASM, 0.020ms per command)
-- ✅ **File I/O**: Native read/write with optimized raw FFI
 - ✅ **Directory Listing**: Fast recursive directory traversal
 - ✅ **VCS Info**: Lightning-fast git repository information (libgit2 vs subprocess)
 - ✅ **System Stats**: CPU and memory monitoring
 
 **Benefits:**
 
+- 🚀 **1.2-1.6x faster** file reading with 64KB buffer and pre-allocation
+- 💾 **99.7% memory savings** on large files (39MB → 0.13MB for 100K lines)
+- 🔍 **90-99% memory reduction** for grep search - can search GB-sized files
 - 🚀 **Up to 6x faster** text editing with 9 smart replacement strategies (Levenshtein, fuzzy matching)
 - 🚀 **Up to 5x faster** archive extraction (ZIP files) with cross-platform native code
 - 💚 **83% less time** on large file edits (10K lines: 451ms → 75ms)
 - ⚡ **1.83x faster** git operations using libgit2 (no process spawning)
 - 🎯 **2-3x faster** glob/grep by eliminating process spawn overhead
-- 📊 **Optimized I/O**: Raw FFI implementation for consistent performance
+- 📊 **Optimized I/O**: Streaming patterns with single-allocation for minimal memory footprint
 - 🔧 **Consistent tooling**: Native Rust across all file operations for predictable performance
 - 🌐 **Cross-platform**: No external dependencies (unzip/PowerShell) for archive extraction
 
@@ -126,12 +207,16 @@ IronCode rewrites key operations in native Rust with **measured real-world perfo
 **Enhanced:**
 
 - 🚀 **Native Rust performance** for compute-heavy operations (2-6x faster)
+- 💾 **Streaming file reads** with 99.7% memory savings (1.2-1.6x faster)
 - ⚡ **Eliminated process spawns** for glob/grep (2-3x speedup)
 - 🗜️ **Fast archive extraction** with s-zip (3-5x faster, cross-platform native)
 - 💚 **Faster edits** (2-6x improvement, scales with file size)
 - 🔥 **Smart edit strategies** with fuzzy matching and Levenshtein similarity
-- 📊 **Optimized I/O**: Raw FFI implementation for consistent performance
+- 📊 **Optimized I/O**: Streaming read with 64KB buffer and pre-allocation
 - 🔧 **Consistent native tooling**: All file operations use Rust for predictable performance
+- 🎯 **Memory efficiency**: Automatic resource monitoring with 300MB default limit
+- 🚦 **Auto-throttling**: Prevents memory spikes and system crashes
+- ⚡ **98% faster message processing**: Selective cloning optimization (254ms → 6ms)
 
 ---
 
@@ -151,20 +236,36 @@ npx ironcode-ai
 
 ### Homebrew (macOS/Linux)
 
+IronCode is available through a Homebrew tap. The formula automatically installs the appropriate binary for your platform.
+
 ```bash
 # Add the tap
-brew tap KSD-CO/tap
+brew tap KSD-CO/tap https://github.com/KSD-CO/homebrew-tap
 
 # Install IronCode
 brew install ironcode
 
+# Verify installation
+ironcode --version
+
 # Update to latest version
 brew upgrade ironcode
 ```
 
-### Direct Download
+**Supported Platforms:**
+
+- macOS (Intel x64)
+- macOS (Apple Silicon arm64)
+- Linux (x64)
+- Linux (arm64)
+
+The Homebrew formula is auto-generated from releases and maintained at [github.com/KSD-CO/homebrew-tap](https://github.com/KSD-CO/homebrew-tap/blob/main/ironcode.rb).
+
+### Direct Download (Standalone Binary)
 
-Download pre-built binaries for your platform from [GitHub Releases](https://github.com/KSD-CO/IronCode/releases):
+For users who prefer not to use package managers, download the pre-built CLI binary directly from [GitHub Releases](https://github.com/KSD-CO/IronCode/releases).
+
+These are **standalone executables** that require no additional installation - just download, extract, and run:
 
 **Linux (x64):**
 
@@ -231,6 +332,12 @@ _Coming soon - AUR package will be available in the future_
 # Start interactive session in current directory
 ironcode
 
+# Run with custom memory limit (default: 300MB)
+ironcode --max-memory 500
+
+# Run without resource monitoring
+ironcode --no-enable-resource-monitor
+
 # Run with specific model
 ironcode --model anthropic/claude-sonnet-4
 
@@ -327,6 +434,16 @@ bun run typecheck
 # Format code (using prettier)
 bun run format
 
+# Resource monitoring tests
+cd packages/ironcode
+bun test test/resource.test.ts                    # Unit tests
+bun test test/resource-monitor.test.ts            # Allocation test
+bun test test/resource-integration.test.ts        # Server integration
+bun --expose-gc test/clone-optimization.test.ts   # Clone comparison
+bun test test/stress-test.ts                      # Light load test
+bun test test/heavy-test.ts                       # Heavy file ops
+bun test test/extreme-test.ts                     # Conversation simulation
+
 # Benchmark native Rust components
 cd packages/ironcode/native/tool
 cargo bench
@@ -412,6 +529,10 @@ Contributions are welcome! Please read [CONTRIBUTING.md](./CONTRIBUTING.md) befo
 
 **Recent Contributions:**
 
+- ✅ **Streaming read optimization** (1.2-1.6x faster, 99.7% memory savings - Feb 2026)
+- ✅ **Grep streaming optimization** (90-99% memory reduction, GB-file capability - Feb 2026)
+- ✅ **Memory optimization deployed to production** (97.6% faster message processing - Feb 2026)
+- ✅ **Resource monitoring system** (automatic throttling, 300MB default limit - Feb 2026)
 - ✅ **Native PTY/Terminal deployed to production** (15.29x speedup, powers Bash tool - Feb 2026)
 - ✅ Native Rust edit tool with 9 strategies (3-4x speedup)
 - ✅ File Watcher Rust infrastructure (ready but not integrated - @parcel/watcher already native)
@@ -448,6 +569,9 @@ bun ./script/test-integration.ts         # Integration tests
 # PTY/Terminal benchmark (15.29x speedup)
 bun script/bench-pty.ts
 
+# File read benchmark (1.2-1.6x speedup, 99.7% memory savings)
+# See STREAMING-READ-OPTIMIZATION.md for details
+
 # Rust micro-benchmarks
 cd packages/ironcode/native/tool
 cargo bench --bench edit_bench
@@ -492,33 +616,7 @@ _Benchmarked on IronCode repository (dev branch, 100 iterations)_
 
 ---
 
-## Upstream Sync
-
-This fork periodically syncs with [upstream OpenCode](https://github.com/anomalyco/opencode) to incorporate new features and bug fixes.
-
-```bash
-# To sync with upstream
-git remote add upstream https://github.com/anomalyco/opencode.git
-git fetch upstream
-git merge upstream/dev
-```
-
----
-
-## License
-
-This project maintains the same license as [OpenCode](https://github.com/anomalyco/opencode).
-
----
-
 ## Acknowledgments
 
 - **OpenCode Team**: For creating the original open-source AI coding agent
 - All contributors to this fork
-
----
-
-## Links
-
-- [Upstream OpenCode](https://github.com/anomalyco/opencode)
-- [IronCode Documentation](https://ironcode.cloud/docs)

package/package.json

@@ -6,11 +6,11 @@
   "scripts": {
     "postinstall": "bun ./postinstall.mjs || node ./postinstall.mjs"
   },
-  "version": "1.7.0",
+  "version": "1.9.0",
   "license": "MIT",
   "optionalDependencies": {
-    "ironcode-darwin-arm64": "1.7.0",
-    "ironcode-windows-x64": "1.7.0",
-    "ironcode-linux-x64": "1.7.0"
+    "ironcode-darwin-arm64": "1.9.0",
+    "ironcode-windows-x64": "1.9.0",
+    "ironcode-linux-x64": "1.9.0"
   }
 }