rimless 3.1.0 → 3.3.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 04bd2f593f37d4f2a3f287654222585ed5f5c902f65d480b1cf402d910e1fd37
-  data.tar.gz: 1d145a8b9d3004ed637241b37b9a2b3a3c99769d3fa171d5c2df94420783634e
+  metadata.gz: 8b258d50dc6020e58639709dda7cc93bcc0deaf96d53defd689bcc10ae270041
+  data.tar.gz: 82f0ef8f8bed2b01f4fc2577c7a1ca84b13da5526420f264f5d13cbb9afd7af8
 SHA512:
-  metadata.gz: 54d61bd6c58166b90112547553c5a60a1ea660d950f5cb2b1197ce7be531b67741d3a61a178d1708d9e2628a49c69b0cb2b83f71e103606017b8f9f46c3eab74
-  data.tar.gz: fdc7c2aa547c2aaec4e2cc9cbb505b81d109fecab0f89db00ac9632c000ea9ddddce455d6bebdc64f1757501cd4e7ac4d8bb3b9a80d905d8c253235333c6676c
+  metadata.gz: ad93ec539b08cfa0b34daf4cb426a2da1c6c781fa0779e256600a60420536239b83d194ff5a58cfce8f066a4fe644869367bd510c710f86ce8be62fec2e43776
+  data.tar.gz: 1ce1a114e929c2b5fb219343bd42dd44efccd3aa893b9de96445876c94a0f9eb6c80e3aa133e7cf6d1e3b4bb1c710297ad5f12cb313146ad654d23a404d9c8fa

data/CHANGELOG.md

@@ -2,6 +2,18 @@
 
 * TODO: Replace this bullet point with an actual description of a change.
 
+### 3.3.0 (16 April 2026)
+
+* Added a new configuration (`avro_deserializer_parse_datetimes`) which allows
+  to configure the default Apache Avro deserializer to automatically parse
+  date/time/datetime's from deeply nested strings (disabled by default for
+  compatibility) ([#76](https://github.com/hausgold/rimless/pull/76))
+
+### 3.2.0 (7 April 2026)
+
+* Restored non-buffered (`$stdout.sync = true`) logging to stdout ([#75](https://github.com/hausgold/rimless/pull/75))
+* Added a section for topic auto-creation on the upgrading guide ([#75](https://github.com/hausgold/rimless/pull/75))
+
 ### 3.1.0 (1 April 2026)
 
 * Updated the kafka-playground ([#74](https://github.com/hausgold/rimless/pull/74))

data/README.md

@@ -322,13 +322,13 @@ architecture looks like this:
               |
               v
   +-----------------------------+
-  | Karafka/Rimless Consumer    |    +--------------------------------------+
-  |   Shares a single consumer  |--->| ActiveJob                            |
-  |   group, multiple processes |    |   Runs the consumer class (children  |
-  +-----------------------------+    |   of Rimless::BaseConsumer) for each |
-                                     |   message (Rimless::ConsumerJob),    |
-                                     |   one message per job                |
-                                     +--------------------------------------+
+  | Karafka/Rimless Consumer    |    +----------------------------------------+
+  |   Shares a single consumer  |--->| ActiveJob                              |
+  |   group, multiple processes |    |   Runs the consumer class (children    |
+  +-----------------------------+    |   of Rimless::Consumer::Base) for each |
+                                     |   message (Rimless::Consumer::Job),    |
+                                     |   one message per job                  |
+                                     +----------------------------------------+
 ```
 
 This architecture allows the consumer process to run mostly non-blocking and

data/UPGRADING.md

@@ -16,6 +16,7 @@ upgrading from Rimless 2.9.x to 3.0.
   - [Offset Management](#offset-management)
   - [Railtie / Sidekiq Server Initialization](#railtie--sidekiq-server-initialization)
   - [Anonymous Consumer Classes](#anonymous-consumer-classes)
+  - [Topic Auto-Creation](#topic-auto-creation)
 - [Producer Changes](#producer-changes)
 - [Testing Changes](#testing-changes)
   - [Consumer Specs](#consumer-specs)
@@ -341,6 +342,32 @@ Rimless.consumer.topics(
 The `JobBridge.build` method will raise an `ArgumentError` if an anonymous
 class is passed.
 
+### Topic Auto-Creation
+
+Karafka 2 **no longer automatically creates missing topics**. If your
+application relied on Karafka 1's default behavior of creating topics on the
+fly (within the Karafka server/consumer process), you will encounter errors
+like:
+
+```
+[ERROR] Data polling error occurred: Subscribed topic not available:
+production.users-api.properties: Broker: Unknown topic or partition -
+Broker: Unknown topic or partition (unknown_topic_or_part)
+```
+
+Karafka 2 recommends using **Declarative Topics** to manage your topic
+infrastructure. Define your topics in the routing configuration and then run:
+
+```shell
+$ karafka topics migrate
+```
+
+This will create or update topics to match your declared configuration.
+
+See:
+- [Infrastructure Topic Auto-Creation](https://karafka.io/docs/Infrastructure-Topic-Auto-Creation/)
+- [Infrastructure Declarative Topics](https://karafka.io/docs/Infrastructure-Declarative-Topics/)
+
 ## Producer Changes
 
 The public producer API (`Rimless.message`, `Rimless.async_message`,

data/lib/rimless/configuration.rb

@@ -134,6 +134,11 @@ module Rimless
       Rimless::Consumer::AvroDeserializer
     end
 
+    # This configuration allows to configure the default Apache Avro
+    # deserializer to automatically parse date/time/datetime's from deeply
+    # nested strings.
+    config_accessor(:avro_deserializer_parse_datetimes) { false }
+
     # The ActiveJob job queue to use for consuming jobs
     config_accessor(:consumer_job_queue) do
       ENV.fetch(

data/lib/rimless/consumer/app.rb

@@ -81,6 +81,11 @@ module Rimless
           end
         end
 
+        # We configure synchronous logging to stdout as supervising/monitoring
+        # processes await logging outputs to detect the Karafka server process
+        # is up and running properly
+        $stdout.sync = true
+
         # Call the user-configurable block with our configuration
         # for customizations
         setup(&Rimless.configuration.consumer_configure)

data/lib/rimless/consumer/avro_deserializer.rb

@@ -4,6 +4,12 @@ module Rimless
   module Consumer
     # A custom Apache Avro compatible message deserializer.
     class AvroDeserializer
+      # The ISO8601 date/time format
+      ISO_TIME_FORMAT = /\A\d{4}-\d{2}-\d{2}T\d{2}:\d{2}:\d{2}(\.\d+)?/m
+
+      # The ISO8601 date format
+      ISO_DATE_FORMAT = /\A\d{4}-\d{2}-\d{2}\Z/m
+
       # Deserialize an Apache Avro encoded Apache Kafka message.
       #
       # @param message [Karafka::Messages::Message] the Karafka message to
@@ -25,6 +31,36 @@ module Rimless
           .then { |data| data.transform_keys { |key| key.delete('\\') } }
           .then { |data| Unsparsify(data, sparse_array: true) }
           .deep_symbolize_keys
+          .then do |obj|
+            # When the configuration says we should not parse datetimes,
+            # we skip further processing
+            next obj \
+              unless Rimless.configuration.avro_deserializer_parse_datetimes
+
+            # Otherwise we parse them
+            parse_timestamps!(obj)
+          end
+      end
+
+      # Search recursively through the given object for ISO date/time string
+      # values and replace them with their parsed date representation. This
+      # works on hashes, arrays, and combinations of this.
+      #
+      # @param value [Mixed] the input to process
+      # @return [Mixed] the processed input
+      def parse_timestamps!(obj)
+        case obj
+        when Hash
+          obj.each { |key, val| obj[key] = parse_timestamps!(val) }
+        when Array
+          obj.each_with_index { |cur, idx| obj[idx] = parse_timestamps!(cur) }
+        when ISO_TIME_FORMAT
+          Time.zone.parse(obj)
+        when ISO_DATE_FORMAT
+          Date.parse(obj)
+        else
+          obj
+        end
       end
     end
   end

data/lib/rimless/version.rb

@@ -4,8 +4,8 @@
 module Rimless
   # The version of the +rimless+ gem
   # TODO: Change back before release.
-  # VERSION = '3.1.0'
-  VERSION = '3.1.0'
+  # VERSION = '3.3.0'
+  VERSION = '3.3.0'
 
   class << self
     # Returns the version of gem as a string.

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: rimless
 version: !ruby/object:Gem::Version
-  version: 3.1.0
+  version: 3.3.0
 platform: ruby
 authors:
 - Hermann Mayer