legion-llm 0.5.4 → 0.5.7

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 888d6f2f71dee1e592ffdf92bc132355fcfd7900752e4c8df4151edebc32b8bb
-  data.tar.gz: 1596d8e3819ee82e812aa434ffe6fdb39c5b4418b48bd034ed9da54b3f76e1a8
+  metadata.gz: 3c8ab6d42537aec5471648490e91968d41395206396b69f4cf48d73ac48cf217
+  data.tar.gz: 49ac7e085f62e08b3391e5926e774b920539a1bef03f64b9c7531bc697646ca4
 SHA512:
-  metadata.gz: ee78d1dad4322e967231c1c90dca5082f0e9bfd56e474a0906281cf4507649076b0a75b0eb9cfba9ddb94a7beb54693a2d3dbd3ec1185bc6b15899f2b6f50c66
-  data.tar.gz: e7cab9bfdcb2e602c1d7a1565faf78fca52bbfe18ac8763d82e58949f9f577c14ce3c3e9719035a9739145cab2428e800d2b9df29883da509c4055f7234ae199
+  metadata.gz: eb1f7f99f9edf09cc108a1d3643c9372ca9e07669dc4f89ff3d2c9d1c5305d1a0e26a8d02316f7edebcb5a9bfe3112a4c8a061f19d2af7bce2ba5649d0e7dccc
+  data.tar.gz: 22983edc5b03faa7692d9c71d5a73ca8d3eccadbf6730b1fd0e7ff9edfb5f2e0b1ea8c926045d3ad0bd6cc4d5fa96900c021964472076b0fce71a5a8fb128be8

data/.github/workflows/ci.yml

@@ -3,14 +3,32 @@ on:
   push:
     branches: [main]
   pull_request:
+  schedule:
+    - cron: '0 9 * * 1'
 
 jobs:
   ci:
     uses: LegionIO/.github/.github/workflows/ci.yml@main
 
+  lint:
+    uses: LegionIO/.github/.github/workflows/lint-patterns.yml@main
+
+  security:
+    uses: LegionIO/.github/.github/workflows/security-scan.yml@main
+
+  version-changelog:
+    uses: LegionIO/.github/.github/workflows/version-changelog.yml@main
+
+  dependency-review:
+    uses: LegionIO/.github/.github/workflows/dependency-review.yml@main
+
+  stale:
+    if: github.event_name == 'schedule'
+    uses: LegionIO/.github/.github/workflows/stale.yml@main
+
   release:
-    needs: ci
+    needs: [ci, lint]
     if: github.event_name == 'push' && github.ref == 'refs/heads/main'
     uses: LegionIO/.github/.github/workflows/release.yml@main
     secrets:
-      rubygems-api-key: ${{ secrets.RUBYGEMS_API_KEY }}
+      rubygems-api-key: ${{ secrets.RUBYGEMS_API_KEY }}

data/CHANGELOG.md

@@ -1,5 +1,25 @@
 # Legion LLM Changelog
 
+## [Unreleased]
+
+### Fixed
+- Fix namespace collision: use `::Data.define` instead of `Data.define` in Pipeline Request and Response to prevent resolution to `Legion::Data`
+
+## [0.5.6] - 2026-03-24
+
+### Fixed
+- `AuditPublisher` now uses dedicated `Transport::Messages::AuditEvent` message class instead of `Messages::Dynamic` (Dynamic ignores `exchange:`/`routing_key:` kwargs and requires a `function_id` DB lookup — audit events were never reaching RabbitMQ)
+- Added `Transport::Exchanges::Audit` exchange class for the `llm.audit` topic exchange
+- Added `Transport::Messages::AuditEvent` message class with `routing_key 'llm.audit.complete'`
+
+## [0.5.5] - 2026-03-24
+
+### Changed
+- RAG context step now fires on almost all queries, not just long conversations
+- RAG only skips trivial queries (greetings, pings) when strategy is auto
+- All RAG thresholds configurable via `Legion::Settings[:llm][:rag]`: `full_limit`, `compact_limit`, `min_confidence`, `utilization_compact_threshold`, `utilization_skip_threshold`, `trivial_max_chars`, `trivial_patterns`
+- Strategy logic inverted: low utilization gets full RAG (room for context), high utilization gets compact, very high skips
+
 ## [0.5.4] - 2026-03-24
 
 ### Added

data/CLAUDE.md

@@ -8,7 +8,7 @@
 Core LegionIO gem providing LLM capabilities to all extensions. Wraps ruby_llm to provide a consistent interface for chat, embeddings, tool use, and agents across multiple providers (Bedrock, Anthropic, OpenAI, Gemini, Ollama). Includes a dynamic weighted routing engine that dispatches requests across local, fleet, and cloud tiers based on caller intent, priority rules, time schedules, cost multipliers, and real-time provider health.
 
 **GitHub**: https://github.com/LegionIO/legion-llm
-**Version**: 0.4.1
+**Version**: 0.5.3
 **License**: Apache-2.0
 
 ## Architecture
@@ -110,7 +110,7 @@ Three-tier dispatch model. Local-first avoids unnecessary network hops; fleet of
 
 ### Gateway Integration (lex-llm-gateway)
 
-Gateway delegation removed in v0.4.1. `chat`, `embed`, and `structured` route directly — no `begin/rescue LoadError` block, no `gateway_loaded?` check. The pipeline (when `pipeline_enabled: true`) handles metering and fleet dispatch natively. The `_direct` variants still exist as the canonical non-pipeline path for `chat_direct`, `embed_direct`, `structured_direct`.
+Gateway delegation removed in v0.4.1. `chat`, `embed`, and `structured` route directly — no `begin/rescue LoadError` block, no `gateway_loaded?` check. The pipeline (enabled by default since v0.4.8) handles metering and fleet dispatch natively. The `_direct` variants still exist as the canonical non-pipeline path for `chat_direct`, `embed_direct`, `structured_direct`.
 
 ### Integration with LegionIO
 
@@ -187,7 +187,7 @@ Settings read from `Legion::Settings[:llm]`:
 |-----|------|---------|-------------|
 | `enabled` | Boolean | `true` | Enable LLM support |
 | `connected` | Boolean | `false` | Set to true after successful start |
-| `pipeline_enabled` | Boolean | `false` | Enable 18-step pipeline for chat() dispatch |
+| `pipeline_enabled` | Boolean | `true` | Enable 18-step pipeline for chat() dispatch (enabled by default since v0.4.8) |
 | `default_model` | String | `nil` | Default model ID (auto-detected if nil) |
 | `default_provider` | Symbol | `nil` | Default provider (auto-detected if nil) |
 | `providers` | Hash | See below | Per-provider configuration |
@@ -325,7 +325,7 @@ In-memory signal consumer with pluggable handlers. Adjusts effective priorities
 | `lib/legion/llm/structured_output.rb` | JSON schema enforcement with native response_format and prompt fallback |
 | `lib/legion/llm/errors.rb` | Typed error hierarchy: LLMError base + AuthError, RateLimitError, ContextOverflow, ProviderError, ProviderDown, UnsupportedCapability, PipelineError |
 | `lib/legion/llm/conversation_store.rb` | ConversationStore: in-memory LRU (256 slots) + optional Sequel DB persistence + spool fallback |
-| `lib/legion/llm/version.rb` | Version constant (0.4.2) |
+| `lib/legion/llm/version.rb` | Version constant (0.5.3) |
 | `lib/legion/llm/quality_checker.rb` | QualityChecker module with QualityResult struct |
 | `lib/legion/llm/escalation_history.rb` | EscalationHistory mixin: `escalation_history`, `escalated?`, `final_resolution`, `escalation_chain` |
 | `lib/legion/llm/router/escalation_chain.rb` | EscalationChain value object |
@@ -451,8 +451,8 @@ The legacy `vault_path` per-provider setting was removed in v0.3.1.
 Tests run without the full LegionIO stack. `spec/spec_helper.rb` stubs `Legion::Logging` and `Legion::Settings` with in-memory implementations. Each test resets settings to defaults via `before(:each)`.
 
 ```bash
-bundle exec rspec    # 794 examples, 0 failures
-bundle exec rubocop  # 142 files, 0 offenses
+bundle exec rspec    # 882 examples, 0 failures
+bundle exec rubocop  # 0 offenses
 ```
 
 ## Design Documents

data/LICENSE

@@ -1,11 +1,192 @@
-
                                  Apache License
                            Version 2.0, January 2004
                         http://www.apache.org/licenses/
 
    TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
 
-   Copyright 2026 Esity / Matthew Iverson
+   1. Definitions.
+
+      "License" shall mean the terms and conditions for use, reproduction,
+      and distribution as defined by Sections 1 through 9 of this document.
+
+      "Licensor" shall mean the copyright owner or entity authorized by
+      the copyright owner that is granting the License.
+
+      "Legal Entity" shall mean the union of the acting entity and all
+      other entities that control, are controlled by, or are under common
+      control with that entity. For the purposes of this definition,
+      "control" means (i) the power, direct or indirect, to cause the
+      direction or management of such entity, whether by contract or
+      otherwise, or (ii) ownership of fifty percent (50%) or more of the
+      outstanding shares, or (iii) beneficial ownership of such entity.
+
+      "You" (or "Your") shall mean an individual or Legal Entity
+      exercising permissions granted by this License.
+
+      "Source" form shall mean the preferred form for making modifications,
+      including but not limited to software source code, documentation
+      source, and configuration files.
+
+      "Object" form shall mean any form resulting from mechanical
+      transformation or translation of a Source form, including but
+      not limited to compiled object code, generated documentation,
+      and conversions to other media types.
+
+      "Work" shall mean the work of authorship, whether in Source or
+      Object form, made available under the License, as indicated by a
+      copyright notice that is included in or attached to the work
+      (an example is provided in the Appendix below).
+
+      "Derivative Works" shall mean any work, whether in Source or Object
+      form, that is based on (or derived from) the Work and for which the
+      editorial revisions, annotations, elaborations, or other modifications
+      represent, as a whole, an original work of authorship. For the purposes
+      of this License, Derivative Works shall not include works that remain
+      separable from, or merely link (or bind by name) to the interfaces of,
+      the Work and Derivative Works thereof.
+
+      "Contribution" shall mean any work of authorship, including
+      the original version of the Work and any modifications or additions
+      to that Work or Derivative Works thereof, that is intentionally
+      submitted to Licensor for inclusion in the Work by the copyright owner
+      or by an individual or Legal Entity authorized to submit on behalf of
+      the copyright owner. For the purposes of this definition, "submitted"
+      means any form of electronic, verbal, or written communication sent
+      to the Licensor or its representatives, including but not limited to
+      communication on electronic mailing lists, source code control systems,
+      and issue tracking systems that are managed by, or on behalf of, the
+      Licensor for the purpose of discussing and improving the Work, but
+      excluding communication that is conspicuously marked or otherwise
+      designated in writing by the copyright owner as "Not a Contribution."
+
+      "Contributor" shall mean Licensor and any individual or Legal Entity
+      on behalf of whom a Contribution has been received by Licensor and
+      subsequently incorporated within the Work.
+
+   2. Grant of Copyright License. Subject to the terms and conditions of
+      this License, each Contributor hereby grants to You a perpetual,
+      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+      copyright license to reproduce, prepare Derivative Works of,
+      publicly display, publicly perform, sublicense, and distribute the
+      Work and such Derivative Works in Source or Object form.
+
+   3. Grant of Patent License. Subject to the terms and conditions of
+      this License, each Contributor hereby grants to You a perpetual,
+      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+      (except as stated in this section) patent license to make, have made,
+      use, offer to sell, sell, import, and otherwise transfer the Work,
+      where such license applies only to those patent claims licensable
+      by such Contributor that are necessarily infringed by their
+      Contribution(s) alone or by combination of their Contribution(s)
+      with the Work to which such Contribution(s) was submitted. If You
+      institute patent litigation against any entity (including a
+      cross-claim or counterclaim in a lawsuit) alleging that the Work
+      or a Contribution incorporated within the Work constitutes direct
+      or contributory patent infringement, then any patent licenses
+      granted to You under this License for that Work shall terminate
+      as of the date such litigation is filed.
+
+   4. Redistribution. You may reproduce and distribute copies of the
+      Work or Derivative Works thereof in any medium, with or without
+      modifications, and in Source or Object form, provided that You
+      meet the following conditions:
+
+      (a) You must give any other recipients of the Work or
+          Derivative Works a copy of this License; and
+
+      (b) You must cause any modified files to carry prominent notices
+          stating that You changed the files; and
+
+      (c) You must retain, in the Source form of any Derivative Works
+          that You distribute, all copyright, patent, trademark, and
+          attribution notices from the Source form of the Work,
+          excluding those notices that do not pertain to any part of
+          the Derivative Works; and
+
+      (d) If the Work includes a "NOTICE" text file as part of its
+          distribution, then any Derivative Works that You distribute must
+          include a readable copy of the attribution notices contained
+          within such NOTICE file, excluding those notices that do not
+          pertain to any part of the Derivative Works, in at least one
+          of the following places: within a NOTICE text file distributed
+          as part of the Derivative Works; within the Source form or
+          documentation, if provided along with the Derivative Works; or,
+          within a display generated by the Derivative Works, if and
+          wherever such third-party notices normally appear. The contents
+          of the NOTICE file are for informational purposes only and
+          do not modify the License. You may add Your own attribution
+          notices within Derivative Works that You distribute, alongside
+          or as an addendum to the NOTICE text from the Work, provided
+          that such additional attribution notices cannot be construed
+          as modifying the License.
+
+      You may add Your own copyright statement to Your modifications and
+      may provide additional or different license terms and conditions
+      for use, reproduction, or distribution of Your modifications, or
+      for any such Derivative Works as a whole, provided Your use,
+      reproduction, and distribution of the Work otherwise complies with
+      the conditions stated in this License.
+
+   5. Submission of Contributions. Unless You explicitly state otherwise,
+      any Contribution intentionally submitted for inclusion in the Work
+      by You to the Licensor shall be under the terms and conditions of
+      this License, without any additional terms or conditions.
+      Notwithstanding the above, nothing herein shall supersede or modify
+      the terms of any separate license agreement you may have executed
+      with Licensor regarding such Contributions.
+
+   6. Trademarks. This License does not grant permission to use the trade
+      names, trademarks, service marks, or product names of the Licensor,
+      except as required for reasonable and customary use in describing the
+      origin of the Work and reproducing the content of the NOTICE file.
+
+   7. Disclaimer of Warranty. Unless required by applicable law or
+      agreed to in writing, Licensor provides the Work (and each
+      Contributor provides its Contributions) on an "AS IS" BASIS,
+      WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+      implied, including, without limitation, any warranties or conditions
+      of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
+      PARTICULAR PURPOSE. You are solely responsible for determining the
+      appropriateness of using or redistributing the Work and assume any
+      risks associated with Your exercise of permissions under this License.
+
+   8. Limitation of Liability. In no event and under no legal theory,
+      whether in tort (including negligence), contract, or otherwise,
+      unless required by applicable law (such as deliberate and grossly
+      negligent acts) or agreed to in writing, shall any Contributor be
+      liable to You for damages, including any direct, indirect, special,
+      incidental, or consequential damages of any character arising as a
+      result of this License or out of the use or inability to use the
+      Work (including but not limited to damages for loss of goodwill,
+      work stoppage, computer failure or malfunction, or any and all
+      other commercial damages or losses), even if such Contributor
+      has been advised of the possibility of such damages.
+
+   9. Accepting Warranty or Additional Liability. While redistributing
+      the Work or Derivative Works thereof, You may choose to offer,
+      and charge a fee for, acceptance of support, warranty, indemnity,
+      or other liability obligations and/or rights consistent with this
+      License. However, in accepting such obligations, You may act only
+      on Your own behalf and on Your sole responsibility, not on behalf
+      of any other Contributor, and only if You agree to indemnify,
+      defend, and hold each Contributor harmless for any liability
+      incurred by, or claims asserted against, such Contributor by reason
+      of your accepting any such warranty or additional liability.
+
+   END OF TERMS AND CONDITIONS
+
+   APPENDIX: How to apply the Apache License to your work.
+
+      To apply the Apache License to your work, attach the following
+      boilerplate notice, with the fields enclosed by brackets "[]"
+      replaced with your own identifying information. (Don't include
+      the brackets!)  The text should be enclosed in the appropriate
+      comment syntax for the file format. We also recommend that a
+      file or class name and description of purpose be included on the
+      same "printed page" as the copyright notice for easier
+      identification within third-party archives.
+
+   Copyright 2021 Esity
 
    Licensed under the Apache License, Version 2.0 (the "License");
    you may not use this file except in compliance with the License.

data/README.md

@@ -2,7 +2,7 @@
 
 LLM integration for the [LegionIO](https://github.com/LegionIO/LegionIO) framework. Wraps [ruby_llm](https://github.com/crmne/ruby_llm) to provide chat, embeddings, tool use, and agent capabilities to any Legion extension.
 
-**Version**: 0.3.15
+**Version**: 0.5.3
 
 ## Installation
 
@@ -280,9 +280,32 @@ session.with_tools(CodeAnalyzer, SecurityScanner)
 response = session.ask("Review this PR: #{diff}")
 ```
 
+### Unified Pipeline
+
+All `chat()` calls flow through an 18-step request/response pipeline (enabled by default since v0.4.8). The pipeline handles RBAC, classification, RAG context retrieval, MCP tool discovery, metering, billing, audit, and GAIA advisory in a consistent sequence. Steps are skipped based on the caller profile (`:external`, `:gaia`, `:system`).
+
+```ruby
+# Pipeline is enabled by default — no configuration needed
+result = Legion::LLM.chat(message: "hello")
+
+# Disable pipeline for a specific call (not recommended — use caller: profile instead)
+# Set pipeline_enabled: false in settings to disable globally
+```
+
+The pipeline accepts a `caller:` hash describing the request origin:
+
+```ruby
+Legion::LLM.chat(
+  message: "hello",
+  caller: { requested_by: { identity: "user@example.com", type: :human, credential: :jwt } }
+)
+```
+
+System callers (type: `:system`) derive the `:system` profile, which skips governance steps to prevent recursion.
+
 ### Routing
 
-legion-llm includes a dynamic weighted routing engine that dispatches requests across local, fleet, and cloud tiers based on caller intent, priority rules, time schedules, cost multipliers, and real-time provider health. Routing is **disabled by default** — opt in via settings.
+legion-llm includes a dynamic weighted routing engine that dispatches requests across local, fleet, and cloud tiers based on caller intent, priority rules, time schedules, cost multipliers, and real-time provider health. Routing is **disabled by default** — opt in by setting `routing.enabled: true` in settings.
 
 #### Three Tiers
 
@@ -629,7 +652,7 @@ bundle exec rspec
 Tests use stubbed `Legion::Logging` and `Legion::Settings` modules (no need for the full LegionIO stack):
 
 ```bash
-bundle exec rspec                              # Run all 304 tests
+bundle exec rspec                              # Run all 882 tests
 bundle exec rubocop                            # Lint (0 offenses)
 bundle exec rspec spec/legion/llm_spec.rb      # Run specific test file
 bundle exec rspec spec/legion/llm/router_spec.rb  # Router tests only

data/lib/legion/llm/pipeline/audit_publisher.rb

@@ -34,14 +34,10 @@ module Legion
           event = build_event(request: request, response: response)
 
           begin
-            if defined?(Legion::Transport) &&
-               defined?(Legion::Transport::Messages::Dynamic)
-              Legion::Transport::Messages::Dynamic.new(
-                function:    'llm_audit',
-                opts:        event,
-                exchange:    EXCHANGE,
-                routing_key: ROUTING_KEY
-              ).publish
+            if defined?(Legion::Transport)
+              require 'legion/llm/transport/exchanges/audit'
+              require 'legion/llm/transport/messages/audit_event'
+              Legion::LLM::Transport::Messages::AuditEvent.new(**event).publish
             elsif defined?(Legion::Logging)
               Legion::Logging.debug('audit publish skipped: transport unavailable')
             end

data/lib/legion/llm/pipeline/request.rb

@@ -3,7 +3,7 @@
 module Legion
   module LLM
     module Pipeline
-      Request = Data.define(
+      Request = ::Data.define(
         :id, :conversation_id, :idempotency_key, :schema_version,
         :system, :messages, :tools, :tool_choice,
         :routing, :tokens, :stop, :generation, :thinking,

data/lib/legion/llm/pipeline/response.rb

@@ -3,7 +3,7 @@
 module Legion
   module LLM
     module Pipeline
-      Response = Data.define(
+      Response = ::Data.define(
         :id, :request_id, :conversation_id, :schema_version,
         :message, :routing, :tokens, :thinking, :stop, :tools,
         :stream, :cache, :retry, :timestamps, :cost, :quality,

data/lib/legion/llm/pipeline/steps/rag_context.rb

@@ -6,32 +6,64 @@ module Legion
       module Steps
         module RagContext
           def step_rag_context
-            strategy = select_context_strategy(utilization: estimate_utilization)
-            return if %i[none full].include?(strategy)
+            return unless rag_enabled?
+            return unless substantive_query?
+            return unless apollo_available_or_warn?
 
-            unless apollo_available?
-              @warnings << 'Apollo unavailable for RAG context retrieval'
-              return
-            end
+            strategy = select_context_strategy(utilization: estimate_utilization)
+            return if strategy == :none
 
             query = extract_query
-            return if query.nil? || query.empty?
-
             start_time = Time.now
             result = apollo_retrieve(query: query, strategy: strategy)
+            record_rag_enrichment(result, strategy)
+            record_rag_timeline(result, strategy, start_time)
+          rescue StandardError => e
+            @warnings << "RAG context error: #{e.message}"
+          end
 
-            if result && result[:success] && result[:entries]&.any?
-              @enrichments['rag:context_retrieval'] = {
-                content:   "#{result[:count]} entries retrieved via #{strategy}",
-                data:      {
-                  entries:  result[:entries],
-                  strategy: strategy,
-                  count:    result[:count]
-                },
-                timestamp: Time.now
-              }
-            end
+          private
+
+          def rag_settings
+            @rag_settings ||= if defined?(Legion::Settings) && !Legion::Settings[:llm].nil?
+                                Legion::Settings[:llm][:rag] || {}
+                              else
+                                {}
+                              end
+          end
+
+          def rag_enabled?
+            rag_settings.fetch(:enabled, true)
+          end
+
+          def substantive_query?
+            query = extract_query
+            return false if query.nil? || query.empty?
+
+            auto_strategy = @request.context_strategy.nil? || @request.context_strategy == :auto
+            return true unless auto_strategy
+
+            !trivial_query?(query)
+          end
+
+          def apollo_available_or_warn?
+            return true if apollo_available?
+
+            @warnings << 'Apollo unavailable for RAG context retrieval'
+            false
+          end
+
+          def record_rag_enrichment(result, strategy)
+            return unless result && result[:success] && result[:entries]&.any?
 
+            @enrichments['rag:context_retrieval'] = {
+              content:   "#{result[:count]} entries retrieved via #{strategy}",
+              data:      { entries: result[:entries], strategy: strategy, count: result[:count] },
+              timestamp: Time.now
+            }
+          end
+
+          def record_rag_timeline(result, strategy, start_time)
             @timeline.record(
               category: :enrichment, key: 'rag:context_retrieval',
               direction: :inbound,
@@ -39,20 +71,21 @@ module Legion
               from: 'apollo', to: 'pipeline',
               duration_ms: ((Time.now - start_time) * 1000).to_i
             )
-          rescue StandardError => e
-            @warnings << "RAG context error: #{e.message}"
           end
 
-          private
-
           def select_context_strategy(utilization:)
             explicit = @request.context_strategy
             return explicit if explicit && explicit != :auto
 
-            case utilization
-            when 0...0.3   then :full
-            when 0.3...0.8 then :rag_hybrid
-            else                :rag
+            skip_threshold    = rag_settings.fetch(:utilization_skip_threshold, 0.9)
+            compact_threshold = rag_settings.fetch(:utilization_compact_threshold, 0.7)
+
+            if utilization >= skip_threshold
+              :none
+            elsif utilization >= compact_threshold
+              :rag_compact
+            else
+              :rag
             end
           end
 
@@ -63,15 +96,29 @@ module Legion
             message_tokens.to_f / @request.tokens[:max]
           end
 
+          def trivial_query?(query)
+            max_chars = rag_settings.fetch(:trivial_max_chars, 20)
+            patterns  = rag_settings.fetch(:trivial_patterns, [])
+
+            return false if query.length > max_chars
+
+            normalized = query.strip.downcase.gsub(/[^a-z0-9\s]/, '')
+            patterns.any? { |p| normalized == p }
+          end
+
           def apollo_available?
             defined?(::Legion::Extensions::Apollo::Runners::Knowledge)
           end
 
           def apollo_retrieve(query:, strategy:)
-            opts = { query: query, limit: 10, min_confidence: 0.5 }
-            opts[:limit] = 5 if strategy == :rag_hybrid
+            full_limit    = rag_settings.fetch(:full_limit, 10)
+            compact_limit = rag_settings.fetch(:compact_limit, 5)
+            confidence    = rag_settings.fetch(:min_confidence, 0.5)
 
-            ::Legion::Extensions::Apollo::Runners::Knowledge.retrieve_relevant(**opts)
+            limit = strategy == :rag_compact ? compact_limit : full_limit
+            ::Legion::Extensions::Apollo::Runners::Knowledge.retrieve_relevant(
+              query: query, limit: limit, min_confidence: confidence
+            )
           end
 
           def extract_query

data/lib/legion/llm/settings.rb

@@ -19,7 +19,8 @@ module Legion
           prompt_caching:   prompt_caching_defaults,
           arbitrage:        arbitrage_defaults,
           batch:            batch_defaults,
-          scheduling:       scheduling_defaults
+          scheduling:       scheduling_defaults,
+          rag:              rag_defaults
         }
       end
 
@@ -113,6 +114,19 @@ module Legion
         }
       end
 
+      def self.rag_defaults
+        {
+          enabled:                       true,
+          full_limit:                    10,
+          compact_limit:                 5,
+          min_confidence:                0.5,
+          utilization_compact_threshold: 0.7,
+          utilization_skip_threshold:    0.9,
+          trivial_max_chars:             20,
+          trivial_patterns:              %w[hello hi hey ping pong test ok okay yes no thanks thank]
+        }
+      end
+
       def self.providers
         {
           bedrock:   {

data/lib/legion/llm/transport/exchanges/audit.rb

@@ -0,0 +1,15 @@
+# frozen_string_literal: true
+
+module Legion
+  module LLM
+    module Transport
+      module Exchanges
+        class Audit < ::Legion::Transport::Exchange
+          def exchange_name
+            'llm.audit'
+          end
+        end
+      end
+    end
+  end
+end

data/lib/legion/llm/transport/messages/audit_event.rb

@@ -0,0 +1,19 @@
+# frozen_string_literal: true
+
+module Legion
+  module LLM
+    module Transport
+      module Messages
+        class AuditEvent < ::Legion::Transport::Message
+          def exchange
+            Legion::LLM::Transport::Exchanges::Audit
+          end
+
+          def routing_key
+            'llm.audit.complete'
+          end
+        end
+      end
+    end
+  end
+end

data/lib/legion/llm/version.rb

@@ -2,6 +2,6 @@
 
 module Legion
   module LLM
-    VERSION = '0.5.4'
+    VERSION = '0.5.7'
   end
 end

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: legion-llm
 version: !ruby/object:Gem::Version
-  version: 0.5.4
+  version: 0.5.7
 platform: ruby
 authors:
 - Esity
@@ -255,7 +255,9 @@ files:
 - lib/legion/llm/shadow_eval.rb
 - lib/legion/llm/structured_output.rb
 - lib/legion/llm/tool_registry.rb
+- lib/legion/llm/transport/exchanges/audit.rb
 - lib/legion/llm/transport/exchanges/escalation.rb
+- lib/legion/llm/transport/messages/audit_event.rb
 - lib/legion/llm/transport/messages/escalation_event.rb
 - lib/legion/llm/version.rb
 homepage: https://github.com/LegionIO/legion-llm