rufio 0.33.0 → 0.34.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 225c3d631526c9d005dc935b0ac6f6a2bfb27efbc31211ec4cf319864e0885bb
-  data.tar.gz: 6148268cd607c98f42a9396b499cb5668c6b5f9001b583a245099d47415ab22a
+  metadata.gz: 6d9ba235b051414a23404dd8afdd87f292aef48b07f89612e57f0fcb2c0c99b0
+  data.tar.gz: e9a9273be387d14026c35cd36f7f9d805c0a951814e935f883d4138b0fe302d3
 SHA512:
-  metadata.gz: 67f1e5730ed0eb0e8e71746c89729eaee14b8d0fbe503d8d54de626b4a4b30f3a79c284f73b662e5ec355a00df6806a73e693aa78a6f76ed953afe4ceaf4e889
-  data.tar.gz: 485c7db79703f4f3f698dd64f94e9f383a9b1f1ec3fb4dad46a34ef116b26b15537607f0cf6c7a843adddd79f3b5dfdaa46519d6da75f307f74b631b6c56dd55
+  metadata.gz: 25e64b32573b24ab97c7719c4a3a0ead75e1d6f7965732c6b71ffe6dd753786413f346247ec835d8774ad3333a51caed21efca9b8cc0ee010a4d8944f4d72014
+  data.tar.gz: 3021168e7cb48ffa747d32416a7d24379fd2f8155998a6a74ff6734703818c525bacb1ee545033e65334c1f6b340fbdb49969354ba5ff6c6620bec71f716bb89

data/CHANGELOG.md

@@ -7,19 +7,40 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 ## [Unreleased]
 
-## [0.33.0] - 2026-01-03
-
-### Fixed
-- **🚨 CRITICAL: File Preview Performance Bug**: Fixed severe rendering delays (80ms → 1-2ms)
-  - Root cause: Redundant processing inside rendering loop (38x per frame)
-  - Impact: 97-99% improvement, 40-86x faster file preview
-  - All text file previews now render in < 2ms
+## [0.34.0] - 2026-01-10
 
 ### Added
+- **🚀 Async Scanner Architecture**: Complete async/parallel scanning implementation
+  - **Phase 1: Basic Async Scan**
+    - Zig pthread-based threading implementation
+    - State management (idle → scanning → done/cancelled/failed)
+    - Polling-based completion with progress tracking
+  - **Phase 2: Progress Reporting**
+    - Real-time progress API with mutex protection
+    - Thread-safe cancellation support
+    - Timeout handling for scan operations
+  - **Phase 3: Advanced Features**
+    - Promise-style interface with method chaining
+    - Fiber integration with Async library
+    - Parallel scanner with thread pool optimization
+- **💎 AsyncScannerPromise**: Promise-style interface
+  - Method chaining with `.then()` callbacks
+  - Automatic resource cleanup on completion
+  - Works with both Ruby and Zig backends
+- **🧵 AsyncScannerFiberWrapper**: Async/Fiber integration
+  - Non-blocking I/O with Ruby's Async library
+  - Concurrent scanning support
+  - Progress reporting with fiber-aware sleep
+- **⚡ ParallelScanner**: Parallel scanning optimization
+  - Thread pool management (configurable max_workers)
+  - Batch directory scanning with result merging
+  - Error handling with partial failure support
+  - Backend switching (Ruby/Zig)
 - **⚡ Zig Native Scanner**: Experimental implementation with minimal binary size (52.6 KB)
   - Direct Ruby C API integration (no FFI overhead)
   - Competitive performance (within 6% of fastest implementations)
   - 5.97x smaller than Rust/Magnus implementation
+  - Async-ready handle-based design
 - **📊 YJIT Performance Analysis**: Comprehensive benchmarking of JIT compiler impact
   - Pure Ruby: 2-5% improvement with YJIT
   - Native extensions: No significant impact
@@ -28,7 +49,28 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
   - 4 detailed performance reports
   - Complete implementation comparison
 
-For detailed information, see [CHANGELOG_v0.33.0.md](./docs/CHANGELOG_v0.33.0.md)
+### Fixed
+- **🚨 CRITICAL: File Preview Performance Bug**: Fixed severe rendering delays (80ms → 1-2ms)
+  - Root cause: Redundant processing inside rendering loop (38x per frame)
+  - Impact: 97-99% improvement, 40-86x faster file preview
+  - All text file previews now render in < 2ms
+- **🔧 Zig Cancellation Handling**: Fixed cancelled state not properly propagating
+  - Changed error handling to preserve cancellation state
+  - Prevents "failed" state when scan is intentionally cancelled
+
+### Changed
+- **Ruby 4.0 Compatibility**: Added `fiddle` gem dependency (required in Ruby 4.0+)
+- **Async Library Integration**: Deprecated API warnings resolved
+  - Updated to use `Kernel#sleep` instead of `Async::Task#sleep`
+
+### Technical Details
+- **Test Coverage**: 483 tests, 1899 assertions (100% pass rate)
+- **Async Scanner Tests**: 8 fiber tests, 10 promise tests, 10 parallel tests
+- **Ruby ABI Independence**: Handle-based design (u64) avoids Ruby ABI coupling
+- **Thread Safety**: Pthread mutex protection for all shared state
+- **GVL Freedom**: Native threads run independently of Ruby's GVL
+
+For detailed information, see [CHANGELOG_v0.34.0.md](./docs/CHANGELOG_v0.34.0.md)
 
 ## [0.32.0] - 2026-01-02
 

data/lib/rufio/async_scanner_fiber.rb

@@ -0,0 +1,154 @@
+# frozen_string_literal: true
+
+begin
+  require 'async'
+  ASYNC_GEM_AVAILABLE = true
+rescue LoadError
+  ASYNC_GEM_AVAILABLE = false
+end
+
+module Rufio
+  # Fiber（Asyncライブラリ）統合用ラッパークラス
+  #
+  # Asyncライブラリと統合し、ノンブロッキングで非同期スキャンを実行します。
+  #
+  # 使用例:
+  #   Async do
+  #     scanner = NativeScannerRubyCore.new
+  #     wrapper = AsyncScannerFiberWrapper.new(scanner)
+  #     entries = wrapper.scan_async('/path')
+  #     puts "Found #{entries.length} entries"
+  #   end
+  #
+  class AsyncScannerFiberWrapper
+    def initialize(scanner)
+      @scanner = scanner
+    end
+
+    # 非同期スキャンを開始し、Fiberで完了を待つ
+    #
+    # @param path [String] スキャンするディレクトリのパス
+    # @param timeout [Integer, nil] タイムアウト秒数（オプション）
+    # @return [Array<Hash>] スキャン結果
+    def scan_async(path, timeout: nil)
+      # スキャンを開始
+      @scanner.scan_async(path)
+
+      # Fiberでポーリング
+      poll_until_complete(timeout: timeout)
+    end
+
+    # 高速スキャン（エントリ数制限付き）
+    #
+    # @param path [String] スキャンするディレクトリのパス
+    # @param max_entries [Integer] 最大エントリ数
+    # @param timeout [Integer, nil] タイムアウト秒数（オプション）
+    # @return [Array<Hash>] スキャン結果
+    def scan_fast_async(path, max_entries, timeout: nil)
+      # スキャンを開始
+      @scanner.scan_fast_async(path, max_entries)
+
+      # Fiberでポーリング
+      poll_until_complete(timeout: timeout)
+    end
+
+    # 進捗報告付きスキャン
+    #
+    # @param path [String] スキャンするディレクトリのパス
+    # @param timeout [Integer, nil] タイムアウト秒数（オプション）
+    # @yield [current, total] 進捗情報を受け取るブロック
+    # @return [Array<Hash>] スキャン結果
+    def scan_async_with_progress(path, timeout: nil, &block)
+      # スキャンを開始
+      @scanner.scan_async(path)
+
+      # 進捗付きでポーリング
+      poll_until_complete_with_progress(timeout: timeout, &block)
+    end
+
+    # スキャンをキャンセル
+    def cancel
+      @scanner.cancel
+    end
+
+    # 状態を取得
+    #
+    # @return [Symbol] 現在の状態
+    def get_state
+      @scanner.get_state
+    end
+
+    # 進捗を取得
+    #
+    # @return [Hash] 進捗情報 {current:, total:}
+    def get_progress
+      @scanner.get_progress
+    end
+
+    private
+
+    # 完了までポーリング（Fiberでスリープ）
+    def poll_until_complete(timeout: nil)
+      start_time = Time.now
+
+      loop do
+        state = @scanner.get_state
+
+        case state
+        when :done
+          result = @scanner.get_results
+          @scanner.close
+          return result
+        when :failed
+          @scanner.close
+          raise StandardError, "Scan failed"
+        when :cancelled
+          @scanner.close
+          raise StandardError, "Scan cancelled"
+        end
+
+        if timeout && (Time.now - start_time) > timeout
+          @scanner.close
+          raise StandardError, "Timeout"
+        end
+
+        # Fiberでスリープ（ノンブロッキング）
+        sleep 0.01
+      end
+    end
+
+    # 進捗報告付きでポーリング
+    def poll_until_complete_with_progress(timeout: nil, &block)
+      start_time = Time.now
+
+      loop do
+        state = @scanner.get_state
+        progress = @scanner.get_progress
+
+        # 進捗コールバック実行
+        yield(progress[:current], progress[:total]) if block_given?
+
+        case state
+        when :done
+          result = @scanner.get_results
+          @scanner.close
+          return result
+        when :failed
+          @scanner.close
+          raise StandardError, "Scan failed"
+        when :cancelled
+          @scanner.close
+          raise StandardError, "Scan cancelled"
+        end
+
+        if timeout && (Time.now - start_time) > timeout
+          @scanner.close
+          raise StandardError, "Timeout"
+        end
+
+        # Fiberでスリープ（ノンブロッキング）
+        sleep 0.01
+      end
+    end
+  end
+end

data/lib/rufio/async_scanner_promise.rb

@@ -0,0 +1,66 @@
+# frozen_string_literal: true
+
+module Rufio
+  # Promise風インターフェースで非同期スキャンを扱うクラス
+  #
+  # 使用例:
+  #   scanner = NativeScannerRubyCore.new
+  #   AsyncScannerPromise.new(scanner)
+  #     .scan_async('/path')
+  #     .then { |entries| entries.select { |e| e[:type] == 'file' } }
+  #     .then { |files| files.map { |f| f[:name] } }
+  #     .wait
+  #
+  class AsyncScannerPromise
+    def initialize(scanner)
+      @scanner = scanner
+      @callbacks = []
+    end
+
+    # 非同期スキャンを開始
+    #
+    # @param path [String] スキャンするディレクトリのパス
+    # @return [AsyncScannerPromise] self（メソッドチェーン用）
+    def scan_async(path)
+      @scanner.scan_async(path)
+      self
+    end
+
+    # 高速スキャンを開始（エントリ数制限付き）
+    #
+    # @param path [String] スキャンするディレクトリのパス
+    # @param max_entries [Integer] 最大エントリ数
+    # @return [AsyncScannerPromise] self（メソッドチェーン用）
+    def scan_fast_async(path, max_entries)
+      @scanner.scan_fast_async(path, max_entries)
+      self
+    end
+
+    # コールバックを登録
+    #
+    # @yield [result] 前のステップの結果を受け取るブロック
+    # @return [AsyncScannerPromise] self（メソッドチェーン用）
+    def then(&block)
+      @callbacks << block if block_given?
+      self
+    end
+
+    # スキャン完了を待ち、コールバックを順次実行
+    #
+    # @param timeout [Integer, nil] タイムアウト秒数（オプション）
+    # @return [Object] 最後のコールバックの戻り値、またはスキャン結果
+    def wait(timeout: nil)
+      result = @scanner.wait(timeout: timeout)
+
+      # 登録されたコールバックを順次実行
+      @callbacks.each do |callback|
+        result = callback.call(result)
+      end
+
+      result
+    ensure
+      # 完了後はスキャナーを自動的にクローズ
+      @scanner.close
+    end
+  end
+end

data/lib/rufio/command_logger.rb

@@ -27,6 +27,9 @@ module Rufio
 
       content = format_log_content(command, output, timestamp, success, error)
 
+      # ディレクトリが存在しない場合は作成（バックグラウンドスレッドでの実行時の競合を防ぐ）
+      FileUtils.mkdir_p(@log_dir) unless Dir.exist?(@log_dir)
+
       File.write(filepath, content)
     end