legionio 1.4.8 → 1.4.10

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 6f04739022a1b0f58b820dbcc6be1850a1830cd852b6b253c9069d9f9eba5bb1
-  data.tar.gz: afa47da3a0fabe43c5379e6a21552fdf65270f6a5426f1309b41e7a390281d91
+  metadata.gz: 6daf36d8c0a062f8acf93959c47ce9b3135159dd4242967f52f6b938bec63e88
+  data.tar.gz: fd0b555351df2e91186743e2ec527576ec245f68730126354fafb348aa140bd8
 SHA512:
-  metadata.gz: 89de4e81fc89e8610b7b512390d6864dff9cb152079d1ffd02f084d5afb5086ccdf45f78a5947a5f5a3206158768d77d8651df48644bd7c98ba04c77654d11b6
-  data.tar.gz: b343fa58368cda584954ba83d85b55b64c2c7e64bbe5dbdcdc841ad75ae553781ddb05d22adcf98898345b4afe0a20d3c902e29a7e4fe7e558121f6c89f56d9f
+  metadata.gz: 3ed2e17fad085d4a5b5c2e57f77ef5cba0c52f6454b375d8b50aa36d6a2a5ceebefeb002de9cd835edcffc6e9dd7832c43d400c5a422d0383572ec92657a3980
+  data.tar.gz: d68a39c49e4c24c3c0caae1278a922a42552894945afa665758c08fd30363db24b01f0dfb9c93e57ecc1e5110a88db0a820b0aa6fa61782e794e22cee3828074

data/CHANGELOG.md

@@ -1,5 +1,25 @@
 # Legion Changelog
 
+## [1.4.10] - 2026-03-16
+
+### Fixed
+- API startup no longer crashes when port is already in use (rolling restart support)
+- `setup_api` retries binding up to 10 times with 3s wait (configurable via `api.bind_retries` and `api.bind_retry_wait`)
+- Port bind failure after retries marks API as not-ready instead of killing the thread
+
+## [1.4.9] - 2026-03-16
+
+### Added
+- YJIT enabled at process start for 15-30% runtime throughput improvement (Ruby 3.1+ builds)
+- GC tuning ENV defaults for large gem count workloads (overridable via environment)
+- bootsnap bytecode and load-path caching at `~/.legionio/cache/bootsnap/`
+- Role-based extension profiles: nil (all), core, cognitive, service, dev, custom
+- Extension discovery uses Bundler specs when available for faster boot
+
+### Changed
+- `find_extensions` uses `Bundler.load.specs` instead of `Gem::Specification.all_names` under Bundler
+- `lex-` prefix check uses `start_with?` instead of string slicing
+
 ## v1.4.8
 
 ### Fixed

data/CLAUDE.md

@@ -9,13 +9,21 @@ The primary gem for the LegionIO framework. An extensible async job engine for s
 
 **GitHub**: https://github.com/LegionIO/LegionIO
 **Gem**: `legionio`
-**Version**: 1.4.8
+**Version**: 1.4.9
 **License**: Apache-2.0
 **Docker**: `legionio/legion`
 **Ruby**: >= 3.4
 
 ## Architecture
 
+### Boot Sequence (exe/legion)
+
+Before any Legion code loads, `exe/legion` applies three performance optimizations:
+
+1. **YJIT** — `RubyVM::YJIT.enable` for 15-30% runtime throughput (guarded with `if defined?`)
+2. **GC tuning** — pre-allocates 600k heap slots, raises malloc limits (all `||=` so ENV overrides are respected)
+3. **bootsnap** — caches YARV bytecodes and `$LOAD_PATH` resolution at `~/.legionio/cache/bootsnap/`
+
 ### Startup Sequence
 
 ```
@@ -29,7 +37,7 @@ Legion.start
       ├── 6. setup_data         (legion-data, MySQL/SQLite + migrations, optional)
       ├── 7. setup_llm          (legion-llm, optional)
       ├── 8. setup_supervision  (process supervision)
-      ├── 9. load_extensions    (discover + load LEX gems)
+      ├── 9. load_extensions    (discover + load LEX gems, filtered by role profile)
       ├── 10. Legion::Crypt.cs  (distribute cluster secret)
       └── 11. setup_api         (start Sinatra/Puma on port 4567)
 ```
@@ -192,7 +200,20 @@ Legion (lib/legion.rb)
 
 ### Extension Discovery
 
-`Legion::Extensions.find_extensions` scans `Gem::Specification.all_names` for gems starting with `lex-`. It also processes `Legion::Settings[:extensions]` for explicitly configured extensions, attempting `Gem.install` for missing ones if `auto_install` is enabled.
+`Legion::Extensions.find_extensions` discovers lex-* gems via `Bundler.load.specs` (when running under Bundler) or falls back to `Gem::Specification.all_names`. It also processes `Legion::Settings[:extensions]` for explicitly configured extensions, attempting `Gem.install` for missing ones if `auto_install` is enabled.
+
+**Role-based filtering**: After discovery, `apply_role_filter` prunes extensions based on `Legion::Settings[:role][:profile]`:
+
+| Profile | What loads |
+|---------|-----------|
+| `nil` (default) | Everything — no filtering |
+| `:core` | 14 core operational extensions only |
+| `:cognitive` | core + all agentic extensions |
+| `:service` | core + service + other integrations |
+| `:dev` | core + AI + essential agentic (~20 extensions) |
+| `:custom` | only what's listed in `role[:extensions]` |
+
+Configure via settings JSON: `{"role": {"profile": "dev"}}`
 
 Loader checks per extension:
 - `data_required?` — skipped if legion-data not connected
@@ -368,6 +389,7 @@ legion
 | `lex-node` | Node identity extension |
 | `concurrent-ruby` + `ext` (>= 1.2) | Thread pool, concurrency primitives |
 | `daemons` (>= 1.4) | Process daemonization |
+| `bootsnap` (>= 1.18) | YARV bytecode + load-path caching |
 | `oj` (>= 3.16) | Fast JSON (C extension) |
 | `puma` (>= 6.0) | HTTP server for API |
 | `mcp` (~> 0.8) | MCP server SDK |
@@ -496,7 +518,7 @@ rack-test, rake, rspec, rubocop, rubocop-rspec, simplecov
 | `lib/legion/cli/relationship.rb` | Old relationship commands |
 | `lib/legion/cli/lex/` | Old LEX sub-generators + ERB templates (still used by LexGenerator) |
 | **Executables** | |
-| `exe/legion` | Only executable: `Legion::CLI::Main.start(ARGV)` |
+| `exe/legion` | Executable: YJIT, GC tuning, bootsnap, then `Legion::CLI::Main.start(ARGV)` |
 | `Dockerfile` | Docker build |
 | `docker_deploy.rb` | Build + push Docker image |
 | **Specs** | |
@@ -522,7 +544,7 @@ rack-test, rake, rspec, rubocop, rubocop-rspec, simplecov
 
 ```bash
 bundle install
-bundle exec rspec       # 872 examples, 0 failures
+bundle exec rspec       # 880 examples, 0 failures
 bundle exec rubocop     # 0 offenses
 ```
 

data/exe/legion

@@ -1,6 +1,23 @@
 #!/usr/bin/env ruby
 # frozen_string_literal: true
 
+RubyVM::YJIT.enable if defined?(RubyVM::YJIT)
+
+ENV['RUBY_GC_HEAP_INIT_SLOTS']           ||= '600000'
+ENV['RUBY_GC_HEAP_FREE_SLOTS_MIN_RATIO'] ||= '0.20'
+ENV['RUBY_GC_HEAP_FREE_SLOTS_MAX_RATIO'] ||= '0.40'
+ENV['RUBY_GC_MALLOC_LIMIT']              ||= '64000000'
+ENV['RUBY_GC_MALLOC_LIMIT_MAX']          ||= '128000000'
+
+require 'bootsnap'
+Bootsnap.setup(
+  cache_dir:          File.expand_path('~/.legionio/cache/bootsnap'),
+  development_mode:   false,
+  load_path_cache:    true,
+  compile_cache_iseq: true,
+  compile_cache_yaml: true
+)
+
 $LOAD_PATH.unshift(File.expand_path('../lib', __dir__))
 
 require 'legion/cli'

data/legionio.gemspec

@@ -36,6 +36,7 @@ Gem::Specification.new do |spec|
 
   spec.add_dependency 'mcp', '~> 0.8'
 
+  spec.add_dependency 'bootsnap', '>= 1.18'
   spec.add_dependency 'concurrent-ruby', '>= 1.2'
   spec.add_dependency 'concurrent-ruby-ext', '>= 1.2'
   spec.add_dependency 'daemons', '>= 1.4'

data/lib/legion/extensions.rb

@@ -208,10 +208,65 @@ module Legion
         false
       end
 
+      def gem_names_for_discovery
+        if defined?(Bundler)
+          Bundler.load.specs.map { |s| "#{s.name}-#{s.version}" }
+        else
+          Gem::Specification.all_names
+        end
+      end
+
+      def apply_role_filter
+        role = Legion::Settings[:role]
+        return if role.nil? || role[:profile].nil?
+
+        profile = role[:profile].to_sym
+        allowed = case profile
+                  when :core      then core_extension_names
+                  when :cognitive then core_extension_names + agentic_extension_names
+                  when :service   then core_extension_names + service_extension_names + other_extension_names
+                  when :dev       then core_extension_names + ai_extension_names + dev_agentic_names
+                  when :custom    then Array(role[:extensions]).map(&:to_s)
+                  else return
+                  end
+
+        before = @extensions.count
+        @extensions.select! { |name, _| allowed.include?(name) }
+        Legion::Logging.info "Role profile :#{profile} filtered #{before} -> #{@extensions.count} extensions"
+      end
+
+      def core_extension_names
+        %w[codegen conditioner exec health lex log metering node ping scheduler tasker task_pruner telemetry
+           transformer].freeze
+      end
+
+      def ai_extension_names
+        %w[claude gemini openai].freeze
+      end
+
+      def service_extension_names
+        %w[consul github http microsoft_teams nomad redis s3 tfe vault].freeze
+      end
+
+      def other_extension_names
+        %w[chef elastic_app_search elasticsearch influxdb memcached pagerduty pushbullet pushover slack sleepiq smtp
+           sonos ssh todoist twilio].freeze
+      end
+
+      def dev_agentic_names
+        %w[attention coldstart curiosity dream empathy flow habit memory metacognition mood narrator personality
+           reflection salience temporal tick volition].freeze
+      end
+
+      def agentic_extension_names
+        known = core_extension_names + service_extension_names + other_extension_names + ai_extension_names
+        @extensions.keys.reject { |name| known.include?(name) }
+      end
+
       def find_extensions
         @extensions ||= {}
-        Gem::Specification.all_names.each do |gem|
-          next unless gem[0..3] == 'lex-'
+        gem_names_for_discovery.each do |gem|
+          next unless gem.start_with?('lex-')
 
           lex = gem.split('-')
           @extensions[lex[1]] = { full_gem_name:   gem,
@@ -221,6 +276,8 @@ module Legion
                                   extension_class: "Legion::Extensions::#{lex[1].split('_').collect(&:capitalize).join}" }
         end
 
+        apply_role_filter
+
         enabled = 0
         requested = 0
 

data/lib/legion/service.rb

@@ -122,12 +122,28 @@ module Legion
       bind = api_settings[:bind] || '0.0.0.0'
 
       @api_thread = Thread.new do
-        Legion::API.set :port, port
-        Legion::API.set :bind, bind
-        Legion::API.set :server, :puma
-        Legion::API.set :environment, :production
-        Legion::Logging.info "Starting Legion API on #{bind}:#{port}"
-        Legion::API.run!(traps: false)
+        retries = 0
+        max_retries = api_settings.fetch(:bind_retries, 10)
+        retry_wait = api_settings.fetch(:bind_retry_wait, 3)
+
+        begin
+          Legion::API.set :port, port
+          Legion::API.set :bind, bind
+          Legion::API.set :server, :puma
+          Legion::API.set :environment, :production
+          Legion::Logging.info "Starting Legion API on #{bind}:#{port}"
+          Legion::API.run!(traps: false)
+        rescue Errno::EADDRINUSE
+          retries += 1
+          if retries <= max_retries
+            Legion::Logging.warn "Port #{port} in use, retrying in #{retry_wait}s (attempt #{retries}/#{max_retries})"
+            sleep retry_wait
+            retry
+          else
+            Legion::Logging.error "Port #{port} still in use after #{max_retries} attempts, API disabled"
+            Legion::Readiness.mark_not_ready(:api)
+          end
+        end
       end
       Legion::Readiness.mark_ready(:api)
     rescue LoadError => e

data/lib/legion/version.rb

@@ -1,5 +1,5 @@
 # frozen_string_literal: true
 
 module Legion
-  VERSION = '1.4.8'
+  VERSION = '1.4.10'
 end

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: legionio
 version: !ruby/object:Gem::Version
-  version: 1.4.8
+  version: 1.4.10
 platform: ruby
 authors:
 - Esity
@@ -23,6 +23,20 @@ dependencies:
     - - "~>"
       - !ruby/object:Gem::Version
         version: '0.8'
+- !ruby/object:Gem::Dependency
+  name: bootsnap
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '1.18'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '1.18'
 - !ruby/object:Gem::Dependency
   name: concurrent-ruby
   requirement: !ruby/object:Gem::Requirement