lex-llm 0.6.3 → 0.6.8

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: b1d6f2214c5ae415eab2e51068984dfdfb3cc7a35223439573d550d820bf864d
-  data.tar.gz: 23ba380421192e5320c2060fd89e357d26d2cb7958836697970eaa4bba5746fc
+  metadata.gz: 5613f655c5743be588ec5030535de96dc998cb8f03ffb8f8b2be21c95dc55b84
+  data.tar.gz: cba342c0f0662d7612b2d8647791149ddb716878e79e487e84a640dbcd3582cc
 SHA512:
-  metadata.gz: e1fb762ee7588f593a75e81b3a6ebc15f131ba74d0d5a54a6cd030d0367c4e41a1a2240c4287c10de4b7bbf25838f27c7a4ae557f75c67aa0b1e481378f752d8
-  data.tar.gz: 9d29438b9d78732887e081b41b7ee792b2459284d654e80e7c70f12be62fcaa585c3e166213530d7bfa57fd09bc5b9de43e12530daf8a38574172452de30a727
+  metadata.gz: b2eb4840e8f1f39d65690dc9226387d6fecbcc9352845cc796d2421b56b660fddae35e2373abdbb88e5c3b127a5b5a6ba621c33682762bbf2eeb271809ec2beb
+  data.tar.gz: 7cce383baa60095d03479240c16076624706d56d605200efee5943d3de290ba96c5c18c58e7ada252572966657d846107a3f55945d9f95aa278f553c31ac82a2

data/CHANGELOG.md

@@ -1,5 +1,36 @@
 # Changelog
 
+## 0.6.8 - 2026-07-03
+
+### Changed
+- Version bump to publish the `MeteringFlush` actor (0.6.5). Versions 0.6.5–0.6.7 tagged and created GitHub releases but never reached RubyGems: 0.6.5/0.6.6 failed `gem push` on a revoked API key, and 0.6.7 failed because the replacement API key was created with per-key MFA enabled (`gem push` prompted for an OTP a CI runner can't provide). The API key has been recreated without per-key MFA. Because the release workflow skips publishing when a version's tag/release already exists, each failed version must be superseded by a fresh one. No functional changes since 0.6.5.
+
+## 0.6.7 - 2026-07-03
+
+### Changed
+- Version bump attempting to publish the `MeteringFlush` actor. Did not reach RubyGems — the replacement API key carried a per-key MFA requirement, so `gem push` demanded an OTP (superseded by 0.6.8). No functional changes.
+
+## 0.6.6 - 2026-07-03
+
+### Changed
+- Version bump attempting to re-trigger the release pipeline. Did not publish to RubyGems — the `gem push` step failed on a revoked API key (superseded by 0.6.7). No functional changes.
+
+## 0.6.5 - 2026-07-03
+
+### Added
+- **`MeteringFlush` actor drains the LLM metering spool back into RabbitMQ.** legion-llm's `Legion::LLM::Metering` spools metering events to `~/.legionio/data/spool/metering/events.jsonl` whenever transport is down at emit time. Nothing had been draining that spool since `lex-llm-gateway` was retired, so events (chat, embeddings, skills — all funnel through `Legion::LLM::Metering.emit`) accumulated indefinitely. This `Legion::Extensions::Actors::Every` actor ticks every 60s and calls `Legion::LLM::Metering.flush_spool`, which republishes each spooled event to the `llm.metering` exchange and truncates the file. It is a no-op while transport is unavailable, so it is safe to tick continuously. Runs on every node (not a singleton) because each node owns its own spool file and must drain it locally. References legion-llm by string (`'Legion::LLM::Metering'`) so lex-llm — the lower gem — avoids a circular dependency; the constant is resolved at tick time.
+
+## 0.6.4 - 2026-06-30
+
+### Fixed
+- **Canonical Data structs now serialize correctly via MultiJson/Oj/::JSON** — all 10 `Data.define` canonical structs (`ToolCall`, `Message`, `ContentBlock`, `Chunk`, `Params`, `Request`, `Response`, `Thinking`, `ToolDefinition`, `Usage`) now implement `as_json` and `to_json`, delegating to their existing `#to_h` method. Without these callbacks, `MultiJson.dump` (and any JSON encoder) fell back to `obj.to_s` on canonical structs, producing the Ruby `#inspect` dump (e.g. `#<data Legion::Extensions::Llm::Canonical::ToolCall id="toolu_bdrk_...", ...>`) wherever a struct appeared inside a Hash/Array being serialized. This leaked into:
+  - Client responses (`/v1/chat/completions`, `/v1/messages`, `/v1/responses`) — `tool_calls` in assistant message history appeared as inspect strings instead of structured JSON objects, breaking LangGraph/Freelens supervisors that expect structured routing decisions.
+  - Ledger persistence (`llm_message_inference_requests.request_json`) — tool_calls stored as unparseable Ruby inspect strings, breaking history reconstruction on subsequent turns.
+  - AMQP wire payloads — any consumer receiving a message containing canonical structs saw inspect strings instead of structured data.
+  - Debug echo-request (`X-Legion-Debug: echo-request`) — canonical request snapshot contained inspect strings for any `tool_calls` in message history.
+
+  The fix is structural: canonical structs now self-enforce correct JSON serialization at the architectural boundary (per Amendment A of the N×N routing design), so every downstream consumer — ledger, AMQP publisher, client translator, debug formatter — serializes correctly without needing to call `.to_h` explicitly.
+
 ## 0.6.3 - 2026-06-25
 
 ### Fixed

data/lib/legion/extensions/llm/actors/metering_flush.rb

@@ -0,0 +1,60 @@
+# frozen_string_literal: true
+
+module Legion
+  module Extensions
+    module Llm
+      module Actor
+        # Periodically drains the LLM metering spool.
+        #
+        # Metering events are emitted by legion-llm's Legion::LLM::Metering. When
+        # transport is down at emit time they are appended to a durable JSONL
+        # spool (~/.legionio/data/spool/metering/events.jsonl) instead of being
+        # published to the `llm.metering` exchange. Nothing was draining that
+        # spool after lex-llm-gateway was retired, so events accumulated forever.
+        #
+        # flush_spool reads every spooled event — chat, embeddings, skills, all
+        # funnel through Legion::LLM::Metering.emit into the same file — and
+        # republishes each to the exchange, then truncates. It is a no-op when
+        # transport is unavailable, so it is safe to tick every minute.
+        #
+        # runner_class points at legion-llm (the higher gem, always loaded at
+        # full boot). lex-llm must not require legion-llm — that would be circular
+        # (legion-llm depends on lex-llm) — so we reference it by string and let
+        # the actor base resolve the constant at tick time via const_get.
+        #
+        # NOT a singleton actor: every node runs LegionIO independently and owns
+        # its own spool file, so each node must drain its own spool. Leader
+        # election would strand every non-leader node's spool.
+        class MeteringFlush < Legion::Extensions::Actors::Every
+          def runner_class
+            'Legion::LLM::Metering'
+          end
+
+          def runner_function
+            'flush_spool'
+          end
+
+          def time
+            60
+          end
+
+          def run_now?
+            false
+          end
+
+          def use_runner?
+            false
+          end
+
+          def check_subtask?
+            false
+          end
+
+          def generate_task?
+            false
+          end
+        end
+      end
+    end
+  end
+end

data/lib/legion/extensions/llm/canonical/chunk.rb

@@ -162,6 +162,15 @@ module Legion
             }.compact
           end
 
+          # MultiJson/Oj/::JSON callback — prevents Data.define #inspect leak into JSON.
+          def as_json(*)
+            to_h
+          end
+
+          def to_json(*)
+            to_h.to_json(*)
+          end
+
           # Type predicate helpers.
           def text_delta? = type == :text_delta
           def thinking_delta? = type == :thinking_delta

data/lib/legion/extensions/llm/canonical/content_block.rb

@@ -110,6 +110,15 @@ module Legion
             super.compact
           end
 
+          # MultiJson/Oj/::JSON callback — prevents Data.define #inspect leak into JSON.
+          def as_json(*)
+            to_h
+          end
+
+          def to_json(*)
+            to_h.to_json(*)
+          end
+
           # Human-readable string — prevents #inspect leaking into user-facing output.
           def to_s
             return "[tool_use:#{name}]" if type == :tool_use

data/lib/legion/extensions/llm/canonical/message.rb

@@ -123,6 +123,15 @@ module Legion
             super.compact
           end
 
+          # MultiJson/Oj/::JSON callback — prevents Data.define #inspect leak into JSON.
+          def as_json(*)
+            to_h
+          end
+
+          def to_json(*)
+            to_h.to_json(*)
+          end
+
           # Human-readable string — prevents #inspect leaking into user-facing output.
           def to_s
             text

data/lib/legion/extensions/llm/canonical/params.rb

@@ -53,6 +53,15 @@ module Legion
           def to_h
             super.compact
           end
+
+          # MultiJson/Oj/::JSON callback — prevents Data.define #inspect leak into JSON.
+          def as_json(*)
+            to_h
+          end
+
+          def to_json(*)
+            to_h.to_json(*)
+          end
         end
         # rubocop:enable Lint/ConstantDefinitionInBlock
       end

data/lib/legion/extensions/llm/canonical/request.rb

@@ -92,6 +92,15 @@ module Legion
             }.compact
           end
 
+          # MultiJson/Oj/::JSON callback — prevents Data.define #inspect leak into JSON.
+          def as_json(*)
+            to_h
+          end
+
+          def to_json(*)
+            to_h.to_json(*)
+          end
+
           def self.normalize_tools(tools)
             return {} if tools.nil? || tools.empty?
 

data/lib/legion/extensions/llm/canonical/response.rb

@@ -104,6 +104,15 @@ module Legion
             end
           end
 
+          # MultiJson/Oj/::JSON callback — prevents Data.define #inspect leak into JSON.
+          def as_json(*)
+            to_h
+          end
+
+          def to_json(*)
+            to_h.to_json(*)
+          end
+
           # Whether the response includes tool calls.
           def tool_call?
             !tool_calls.nil? && !tool_calls.empty?

data/lib/legion/extensions/llm/canonical/thinking.rb

@@ -31,6 +31,15 @@ module Legion
             super.compact
           end
 
+          # MultiJson/Oj/::JSON callback — prevents Data.define #inspect leak into JSON.
+          def as_json(*)
+            to_h
+          end
+
+          def to_json(*)
+            to_h.to_json(*)
+          end
+
           # Whether this thinking block has any content.
           def empty?
             content.nil? && signature.nil?

data/lib/legion/extensions/llm/canonical/tool_call.rb

@@ -106,6 +106,16 @@ module Legion
             super.compact
           end
 
+          # MultiJson/Oj/::JSON callback for unknown types — without this, fallback is
+          # obj.to_s which for Data.define returns the #inspect dump and leaks into JSON.
+          def as_json(*)
+            to_h
+          end
+
+          def to_json(*)
+            to_h.to_json(*)
+          end
+
           # Subset for audit/ledger emission.
           def to_audit_hash
             {

data/lib/legion/extensions/llm/canonical/tool_definition.rb

@@ -91,6 +91,15 @@ module Legion
               parameters: parameters
             }.compact.reject { |k, v| k == :description && v == '' }
           end
+
+          # MultiJson/Oj/::JSON callback — prevents Data.define #inspect leak into JSON.
+          def as_json(*)
+            to_h
+          end
+
+          def to_json(*)
+            to_h.to_json(*)
+          end
         end
       end
     end

data/lib/legion/extensions/llm/canonical/usage.rb

@@ -61,6 +61,15 @@ module Legion
             super.compact
           end
 
+          # MultiJson/Oj/::JSON callback — prevents Data.define #inspect leak into JSON.
+          def as_json(*)
+            to_h
+          end
+
+          def to_json(*)
+            to_h.to_json(*)
+          end
+
           # Total tokens across all categories.
           def total_tokens
             [input_tokens, output_tokens, cache_read_tokens, cache_write_tokens,

data/lib/legion/extensions/llm/version.rb

@@ -3,7 +3,7 @@
 module Legion
   module Extensions
     module Llm
-      VERSION = '0.6.3'
+      VERSION = '0.6.8'
     end
   end
 end

data/spec/legion/extensions/llm/actor/metering_flush_spec.rb

@@ -0,0 +1,64 @@
+# frozen_string_literal: true
+
+# Stub the actor base class before requiring the real actor — the concrete
+# Legion::Extensions::Actors::Every lives in LegionIO, which lex-llm does not
+# depend on (lex-llm is the lower gem).
+unless defined?(Legion::Extensions::Actors::Every)
+  module Legion
+    module Extensions
+      module Actors
+        class Every; end # rubocop:disable Lint/EmptyClass
+      end
+    end
+  end
+end
+
+$LOADED_FEATURES << 'legion/extensions/actors/every'
+
+require_relative '../../../../../lib/legion/extensions/llm/actors/metering_flush'
+
+RSpec.describe Legion::Extensions::Llm::Actor::MeteringFlush do
+  subject(:actor) { described_class.new }
+
+  describe '#runner_class' do
+    it 'targets the legion-llm metering module that owns the spool' do
+      expect(actor.runner_class).to eq('Legion::LLM::Metering')
+    end
+  end
+
+  describe '#runner_function' do
+    it 'returns flush_spool' do
+      expect(actor.runner_function).to eq('flush_spool')
+    end
+  end
+
+  describe '#time' do
+    it 'flushes once per minute' do
+      expect(actor.time).to eq(60)
+    end
+  end
+
+  describe '#run_now?' do
+    it 'returns false so it does not fire during boot' do
+      expect(actor.run_now?).to be false
+    end
+  end
+
+  describe '#use_runner?' do
+    it 'returns false so it calls the module directly (no AMQP round-trip)' do
+      expect(actor.use_runner?).to be false
+    end
+  end
+
+  describe '#check_subtask?' do
+    it 'returns false' do
+      expect(actor.check_subtask?).to be false
+    end
+  end
+
+  describe '#generate_task?' do
+    it 'returns false' do
+      expect(actor.generate_task?).to be false
+    end
+  end
+end

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: lex-llm
 version: !ruby/object:Gem::Version
-  version: 0.6.3
+  version: 0.6.8
 platform: ruby
 authors:
 - LegionIO
@@ -255,6 +255,7 @@ files:
 - README.md
 - lex-llm.gemspec
 - lib/legion/extensions/llm.rb
+- lib/legion/extensions/llm/actors/metering_flush.rb
 - lib/legion/extensions/llm/agent.rb
 - lib/legion/extensions/llm/aliases.json
 - lib/legion/extensions/llm/aliases.rb
@@ -347,6 +348,7 @@ files:
 - spec/fixtures/ruby.wav
 - spec/fixtures/ruby.xml
 - spec/fixtures/sample.pdf
+- spec/legion/extensions/llm/actor/metering_flush_spec.rb
 - spec/legion/extensions/llm/agent_spec.rb
 - spec/legion/extensions/llm/attachment_spec.rb
 - spec/legion/extensions/llm/auto_registration_spec.rb