job-workflow 0.2.0 → 0.4.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 9ac9f67bfd9ba71b60f98643a5f5ed720423239650bdf80a8bb07de594d9b502
-  data.tar.gz: 6902b370e54d0285721390a40af5ff0a7b459c6ce0a67af6c538dc1877f0df85
+  metadata.gz: 213a0654cb0482f1a2574f4e55d26c72f5274d24b61b933abd04e9e21f4c19d1
+  data.tar.gz: 0f19fce390ff18dcb13d80c8a4c6841dc2e096d4ea7586f0a2d6e2c6a467a45b
 SHA512:
-  metadata.gz: 6c24f513d3c1192513fef902a92d844050a25e095b2739e9f40e774639cde3fb75c4df1a6e2878a50f13583e5df0e665faa6ef803a434e9444d020a81ec2a71b
-  data.tar.gz: 1c7218d7a1c2d45444a111956bd26d152f16b2e1c6f86fb2959fd255c2ab844444d7929863149f3c7e4322073d520ff40ec3ea02ec29a1595135350723ed4a6a
+  metadata.gz: 89e0d194c4f14817bd2866b4b07f2efe3eea0ffdbc74ff4b7c1f5474d59fb0a18749d68fc2c724ea690f370d1b335d1e69bf0f006ab9bb1964f74fcfd689232b
+  data.tar.gz: 49150a706fb10a4ba79a87397b4cbbfcb4554eba5e974d22d6176799d377f5d9814f20862be996bca253328fc1efa6a10429947cc308f4aa3dd884eaadd378d0

data/CHANGELOG.md

@@ -1,5 +1,36 @@
 ## [Unreleased]
 
+## [0.4.0] - 2026-05-12
+
+### Fixed
+
+- Fix `enqueue: true` consumer tasks that read `depends_on` outputs by persisting the parent context before `perform_all_later`, so sub-jobs load the latest dependency outputs instead of stale persisted state
+- Fix sequential `each` task resumption to persist continuation cursor progress at the workflow step level, resume from `step.cursor`, and keep the failed iteration retrying from the same `each_index` without skipping previously collected outputs
+
+### Removed
+
+- Remove the `namespace` DSL and `JobWorkflow::Namespace`, flatten task naming to a single task space, and delete the dedicated namespace guide/example coverage that existed for the removed feature
+
+## [0.3.0] - 2026-03-13
+
+### Added
+
+- Add `fetch_job_contexts(job_ids)` to queue adapter interface (`Abstract`, `SolidQueueAdapter`, `NullAdapter`) for fetching sub-job context data without direct `SolidQueue::Job` dependency from domain classes
+- Add `persist_job_context(job)` to queue adapter interface for persisting task outputs back to SolidQueue job records after execution
+- Add `without_query_cache` private helper to `SolidQueueAdapter` to bypass ActiveRecord query cache during polling queries
+- Add `"job_workflow_context"` key to `find_job` return hash for direct access to workflow context data
+- Add `AcceptanceNoDependencyWaitJob` and acceptance tests for `depends_on` without `dependency_wait` (polling-only mode)
+- Add acceptance test for output aggregation verification in async workflows
+
+### Changed
+
+- **Breaking (internal):** Replace `Output#update_task_outputs_from_db` and `Output#update_task_outputs_from_jobs` with `Output#update_task_outputs_from_contexts` — callers now pass context data hashes instead of `SolidQueue::Job` objects
+- `Runner#update_task_outputs` now routes through `QueueAdapter.current.fetch_job_contexts` instead of directly querying `SolidQueue::Job`
+- `Runner#run` now calls `QueueAdapter.current.persist_job_context(job)` after both sub-job and workflow execution
+- `WorkflowStatus.from_job_data` now reads `job_workflow_context` from top-level data first, falling back to `arguments.first.dig("job_workflow_context")`
+- `reschedule_solid_queue_job` now saves full serialized job hash (`active_job.serialize.deep_stringify_keys`) instead of only `["arguments"]`
+- Wrap `find_job`, `fetch_job_statuses`, `job_status`, `reschedule_job`, and `fetch_job_contexts` with `without_query_cache` to prevent stale reads under SolidQueue executor
+
 ## [0.2.0] - 2026-03-12
 
 ### Added

data/README.md

@@ -1,6 +1,6 @@
 # JobWorkflow
 
-> ⚠️ **Early Stage (v0.1.3):** This library is in active development. APIs and features may change in breaking ways without notice. Use in production at your own risk and expect potential breaking changes in future releases.
+> ⚠️ **Early Stage (v0.4.0):** This library is in active development. APIs and features may change in breaking ways without notice. Use in production at your own risk and expect potential breaking changes in future releases.
 
 ## Overview
 

data/guides/PRODUCTION_DEPLOYMENT.md

@@ -1,6 +1,6 @@
 # Production Deployment
 
-> ⚠️ **Early Stage (v0.1.3):** JobWorkflow is still in early development. While this section outlines potential deployment patterns, please thoroughly test in your specific environment and monitor for any issues before relying on JobWorkflow in critical production systems.
+> ⚠️ **Early Stage (v0.4.0):** JobWorkflow is still in early development. While this section outlines potential deployment patterns, please thoroughly test in your specific environment and monitor for any issues before relying on JobWorkflow in critical production systems.
 
 This section covers suggested settings and patterns for running JobWorkflow in production-like environments.
 

data/guides/README.md

@@ -1,6 +1,6 @@
 # JobWorkflow Guides
 
-> ⚠️ **Early Stage (v0.1.3):** JobWorkflow is in active development. APIs and features may change. The following guides provide patterns and examples for building workflows, but be aware that implementations may need adjustment as the library evolves.
+> ⚠️ **Early Stage (v0.4.0):** JobWorkflow is in active development. APIs and features may change. The following guides provide patterns and examples for building workflows, but be aware that implementations may need adjustment as the library evolves.
 
 Welcome to the JobWorkflow documentation! This directory contains comprehensive guides to help you build robust workflows with JobWorkflow.
 
@@ -67,11 +67,6 @@ Power features for complex workflows:
   - Configuration options (poll_timeout, poll_interval, reschedule_delay)
   - SolidQueue integration
 
-- **[NAMESPACES.md](NAMESPACES.md)** - Organizing large workflows
-  - Basic namespace usage
-  - Nested namespaces
-  - Cross-namespace dependencies
-
 - **[THROTTLING.md](THROTTLING.md)** - Rate limiting and resource control
   - Task-level throttling
   - Runtime throttling

data/lib/job_workflow/context.rb

@@ -108,13 +108,13 @@ module JobWorkflow
       [task_context.parent_job_id, task.task_name].compact.join("/")
     end
 
-    #:  (Task) -> Enumerator[Context]
-    def _with_each_value(task)
+    #:  (Task, ?start_index: Integer?) -> Enumerator[Context]
+    def _with_each_value(task, start_index: nil)
       raise "Nested _with_each_value calls are not allowed" if enabled_with_each_value
 
       self.enabled_with_each_value = true
       Enumerator.new do |y|
-        with_task_context(task, y)
+        with_task_context(task, y, start_index:)
       ensure
         self.enabled_with_each_value = false
       end
@@ -270,11 +270,11 @@ module JobWorkflow
       }
     end
 
-    #:  (Task, Enumerator::Yielder) -> void
-    def with_task_context(task, yielder) # rubocop:disable Metrics/MethodLength
+    #:  (Task, Enumerator::Yielder, ?start_index: Integer?) -> void
+    def with_task_context(task, yielder, start_index: nil) # rubocop:disable Metrics/MethodLength
       reset_task_context_if_task_changed(task)
 
-      with_each_index_and_value(task) do |value, index|
+      with_each_index_and_value(task, start_index:) do |value, index|
         dry_run = calculate_dry_run(task)
         with_retry(task) do |retry_count|
           self.task_context = TaskContext.new(task:, parent_job_id:, index:, value:, retry_count:, dry_run:)
@@ -294,10 +294,12 @@ module JobWorkflow
       self.task_context = TaskContext.new if task_context.task&.task_name != task.task_name
     end
 
-    #:  (Task) { (untyped, Integer) -> void } -> void
-    def with_each_index_and_value(task)
+    #:  (Task, ?start_index: Integer?) { (untyped, Integer) -> void } -> void
+    def with_each_index_and_value(task, start_index: nil)
+      resume_index = start_index || task_context.index
+
       task.each.call(self).each.with_index do |value, index|
-        next if index < task_context.index
+        next if index < resume_index
 
         yield value, index
 

data/lib/job_workflow/dsl.rb

@@ -108,15 +108,9 @@ module JobWorkflow
 
       #:  (Symbol argument_name, String type, ?default: untyped) -> void
       def argument(argument_name, type, default: nil)
-        validate_namespace!
         _workflow.add_argument(ArgumentDef.new(name: argument_name, type:, default:))
       end
 
-      #:  (Symbol) { () -> void } -> void
-      def namespace(namespace_name, &)
-        _workflow.add_namespace(Namespace.new(name: namespace_name), &)
-      end
-
       # rubocop:disable Metrics/ParameterLists
       #
       #:  (
@@ -149,7 +143,6 @@ module JobWorkflow
         new_task = Task.new(
           job_name: name,
           name: task_name,
-          namespace: _workflow.namespace,
           block: block,
           enqueue:,
           each:,
@@ -172,25 +165,21 @@ module JobWorkflow
 
       #:  (*Symbol) { (Context) -> void } -> void
       def before(*task_names, &block)
-        validate_namespace!
         _workflow.add_hook(:before, task_names:, block:)
       end
 
       #:  (*Symbol) { (Context) -> void } -> void
       def after(*task_names, &block)
-        validate_namespace!
         _workflow.add_hook(:after, task_names:, block:)
       end
 
       #:  (*Symbol) { (Context, TaskCallable) -> void } -> void
       def around(*task_names, &block)
-        validate_namespace!
         _workflow.add_hook(:around, task_names:, block:)
       end
 
       #:  (*Symbol) { (Context, StandardError, Task) -> void } -> void
       def on_error(*task_names, &block)
-        validate_namespace!
         _workflow.add_hook(:error, task_names:, block:)
       end
 
@@ -240,7 +229,6 @@ module JobWorkflow
 
       #:  (?bool) ?{ (Context) -> bool } -> void
       def dry_run(value = nil, &block)
-        validate_namespace!
         _workflow.dry_run_config = block || value
       end
 
@@ -254,7 +242,6 @@ module JobWorkflow
       #     ?description: String?
       #   ) -> void
       def schedule(expression, key: nil, queue: nil, priority: nil, args: {}, description: nil)
-        validate_namespace!
         _workflow.add_schedule(
           Schedule.new(
             expression:,
@@ -268,13 +255,6 @@ module JobWorkflow
         )
       end
       # rubocop:enable Metrics/ParameterLists
-
-      private
-
-      #:  () -> void
-      def validate_namespace!
-        raise "cannot be defined within a namespace." unless _workflow.namespace.default?
-      end
     end
   end
 end

data/lib/job_workflow/output.rb

@@ -50,18 +50,10 @@ module JobWorkflow
       task_outputs[task_output.task_name][task_output.each_index] = task_output
     end
 
-    #:  (Array[String], Workflow) -> void
-    def update_task_outputs_from_db(job_ids, workflow)
-      jobs = SolidQueue::Job.where(active_job_id: job_ids)
-      return if jobs.empty?
-
-      update_task_outputs_from_jobs(jobs.to_a, workflow)
-    end
-
-    #:  (Array[SolidQueue::Job], Workflow) -> void
-    def update_task_outputs_from_jobs(jobs, workflow)
-      jobs.each do |job|
-        context = Context.deserialize(job.arguments["job_workflow_context"].merge("workflow" => workflow))
+    #:  (Array[Hash[String, untyped]], Workflow) -> void
+    def update_task_outputs_from_contexts(context_data_list, workflow)
+      context_data_list.each do |context_data|
+        context = Context.deserialize(context_data.merge("workflow" => workflow))
         task_output = context.each_task_output
         next if task_output.nil?
 

data/lib/job_workflow/queue_adapters/abstract.rb

@@ -77,10 +77,18 @@ module JobWorkflow
         raise NotImplementedError, "#{self.class}#find_job must be implemented"
       end
 
+      #:  (Array[String]) -> Array[Hash[String, untyped]]
+      def fetch_job_contexts(_job_ids)
+        raise NotImplementedError, "#{self.class}#fetch_job_contexts must be implemented"
+      end
+
       #:  (DSL, Numeric) -> bool
       def reschedule_job(_job, _wait)
         false
       end
+
+      #:  (DSL) -> void
+      def persist_job_context(_job); end
     end
     # rubocop:enable Naming/PredicateMethod
   end

data/lib/job_workflow/queue_adapters/null_adapter.rb

@@ -90,6 +90,11 @@ module JobWorkflow
         @stored_jobs[job_id]
       end
 
+      #:  (Array[String]) -> Array[Hash[String, untyped]]
+      def fetch_job_contexts(_job_ids)
+        []
+      end
+
       #:  (DSL, Numeric) -> bool
       def reschedule_job(_job, _wait)
         false

data/lib/job_workflow/queue_adapters/solid_queue_adapter.rb

@@ -2,7 +2,7 @@
 
 module JobWorkflow
   module QueueAdapters
-    # rubocop:disable Naming/PredicateMethod
+    # rubocop:disable Naming/PredicateMethod, Metrics/ClassLength
     class SolidQueueAdapter < Abstract
       # @note
       #   - Registry scope: @semaphore_registry is process-scoped (shared across fibers/threads
@@ -74,16 +74,20 @@ module JobWorkflow
       def fetch_job_statuses(job_ids)
         return {} unless defined?(SolidQueue::Job)
 
-        SolidQueue::Job.where(active_job_id: job_ids).index_by(&:active_job_id)
+        without_query_cache do
+          SolidQueue::Job.where(active_job_id: job_ids).index_by(&:active_job_id)
+        end
       end
 
       #:  (untyped) -> Symbol
       def job_status(job)
-        return :failed if job.failed?
-        return :succeeded if job.finished?
-        return :running if job.claimed?
+        without_query_cache do
+          return :failed if job.failed?
+          return :succeeded if job.finished?
+          return :running if job.claimed?
 
-        :pending
+          :pending
+        end
       end
 
       #:  () -> bool
@@ -153,23 +157,40 @@ module JobWorkflow
       def find_job(job_id)
         return unless defined?(SolidQueue::Job)
 
-        job = SolidQueue::Job.find_by(active_job_id: job_id)
+        job = without_query_cache { SolidQueue::Job.find_by(active_job_id: job_id) }
         return if job.nil?
 
+        args = job.arguments
         {
           "job_id" => job.active_job_id,
           "class_name" => job.class_name,
           "queue_name" => job.queue_name,
-          "arguments" => job.arguments.is_a?(Hash) ? job.arguments["arguments"] : job.arguments,
+          "arguments" => args.is_a?(Hash) ? args["arguments"] : args,
+          "job_workflow_context" => args.is_a?(Hash) ? args["job_workflow_context"] : nil,
           "status" => job_status(job)
         }
       end
 
+      # @note
+      #   - Fetches job_workflow_context hashes for the given job IDs.
+      #
+      #:  (Array[String]) -> Array[Hash[String, untyped]]
+      def fetch_job_contexts(job_ids)
+        return [] unless defined?(SolidQueue::Job)
+        return [] if job_ids.empty?
+
+        jobs = without_query_cache { SolidQueue::Job.where(active_job_id: job_ids).to_a }
+        jobs.filter_map do |job|
+          args = job.arguments
+          args.is_a?(Hash) ? args["job_workflow_context"] : nil
+        end
+      end
+
       #:  (DSL, Numeric) -> bool
       def reschedule_job(job, wait)
         return false unless defined?(SolidQueue::Job)
 
-        solid_queue_job = SolidQueue::Job.find_by(active_job_id: job.job_id)
+        solid_queue_job = without_query_cache { SolidQueue::Job.find_by(active_job_id: job.job_id) }
         return false unless solid_queue_job&.claimed?
 
         reschedule_solid_queue_job(solid_queue_job, job, wait)
@@ -177,17 +198,44 @@ module JobWorkflow
         false
       end
 
+      # @note
+      #   - Persists the job's updated context (including task outputs) back
+      #     to the SolidQueue job record after execution completes. Without this,
+      #     outputs computed during job execution would be lost because
+      #     SolidQueue does not re-serialize job arguments after perform.
+      #
+      #:  (DSL) -> void
+      def persist_job_context(job)
+        return unless defined?(SolidQueue::Job)
+
+        solid_queue_job = SolidQueue::Job.find_by(active_job_id: job.job_id)
+        return if solid_queue_job.nil?
+
+        solid_queue_job.update!(arguments: job.serialize.deep_stringify_keys)
+      end
+
       private
 
       attr_reader :semaphore_registry #: Hash[Object, ^(SolidQueue::Worker) -> void]
 
+      # @note
+      #   - Bypasses ActiveRecord query cache for the given block.
+      #   - When running under SolidQueue's executor, SELECT queries are cached
+      #     for the entire job execution. Polling queries must bypass this cache
+      #     to observe status changes made by other threads/processes.
+      #
+      #:  [T] () { () -> T } -> T
+      def without_query_cache(&)
+        defined?(SolidQueue::Job) ? SolidQueue::Job.uncached(&) : yield
+      end
+
       #:  (SolidQueue::Job, DSL, Numeric) -> bool
       def reschedule_solid_queue_job(solid_queue_job, active_job, wait)
         solid_queue_job.with_lock do
           solid_queue_job.claimed_execution&.destroy!
           solid_queue_job.update!(
             scheduled_at: wait.seconds.from_now,
-            arguments: active_job.serialize.deep_stringify_keys["arguments"]
+            arguments: active_job.serialize.deep_stringify_keys
           )
           solid_queue_job.prepare_for_execution
         end
@@ -219,6 +267,6 @@ module JobWorkflow
         end
       end
     end
-    # rubocop:enable Naming/PredicateMethod
+    # rubocop:enable Naming/PredicateMethod, Metrics/ClassLength
   end
 end

data/lib/job_workflow/runner.rb

@@ -13,9 +13,14 @@ module JobWorkflow
     #:  () -> void
     def run
       task = context._task_context.task
-      return run_task(task) if !task.nil? && context.sub_job?
+      if !task.nil? && context.sub_job?
+        run_task(task)
+        persist_current_job_context
+        return
+      end
 
       catch(:rescheduled) { run_workflow }
+      persist_current_job_context
     end
 
     private
@@ -45,7 +50,7 @@ module JobWorkflow
 
           job.step(task.task_name) do |step|
             wait_for_dependent_tasks(task, step)
-            task.enqueue.should_enqueue?(context) ? enqueue_task(task) : run_task(task)
+            task.enqueue.should_enqueue?(context) ? enqueue_task(task) : run_task(task, step:)
           end
         end
       end
@@ -58,11 +63,12 @@ module JobWorkflow
       result
     end
 
-    #:  (Task) -> void
-    def run_task(task)
+    #:  (Task, ?step: ActiveJob::Continuation::Step?) -> void
+    def run_task(task, step: nil)
       context._load_parent_task_output
-      context._with_each_value(task).each do |ctx|
+      context._with_each_value(task, start_index: step&.cursor).each do |ctx|
         run_each_task(task, ctx)
+        step&.set!(ctx._task_context.index + 1)
       rescue StandardError => e
         run_error_hooks(task, ctx, e)
         raise
@@ -107,6 +113,7 @@ module JobWorkflow
     #:  (Task) -> void
     def enqueue_task(task)
       sub_jobs = context._with_each_value(task).map { |ctx| job.class.from_context(ctx) }
+      persist_current_job_context
       ActiveJob.perform_all_later(sub_jobs)
       context.job_status.update_task_job_statuses_from_jobs(task_name: task.task_name, jobs: sub_jobs)
       Instrumentation.notify_task_enqueue(job, task, sub_jobs.size)
@@ -167,7 +174,13 @@ module JobWorkflow
     #:  (Task) -> void
     def update_task_outputs(task)
       finished_job_ids = context.job_status.finished_job_ids(task_name: task.task_name)
-      context.output.update_task_outputs_from_db(finished_job_ids, context.workflow)
+      context_data_list = QueueAdapter.current.fetch_job_contexts(finished_job_ids)
+      context.output.update_task_outputs_from_contexts(context_data_list, context.workflow)
+    end
+
+    #:  () -> void
+    def persist_current_job_context
+      QueueAdapter.current.persist_job_context(job)
     end
   end
 end

data/lib/job_workflow/task.rb

@@ -3,7 +3,6 @@
 module JobWorkflow
   class Task
     attr_reader :job_name #: String
-    attr_reader :namespace #: Namespace
     attr_reader :block #: ^(untyped) -> void
     attr_reader :each #: ^(Context) -> untyped
     attr_reader :enqueue #: TaskEnqueue
@@ -16,11 +15,10 @@ module JobWorkflow
     attr_reader :dependency_wait #: TaskDependencyWait
     attr_reader :dry_run_config #: DryRunConfig
 
-    # rubocop:disable Metrics/ParameterLists, Metrics/MethodLength, Metrics/AbcSize
+    # rubocop:disable Metrics/ParameterLists, Metrics/MethodLength
     #:  (
     #     job_name: String,
     #     name: Symbol,
-    #     namespace: Namespace,
     #     block: ^(untyped) -> void,
     #     ?each: ^(Context) -> untyped,
     #     ?enqueue: true | false | ^(Context) -> bool | Hash[Symbol, untyped],
@@ -36,7 +34,6 @@ module JobWorkflow
     def initialize(
       job_name:,
       name:,
-      namespace:,
       block:,
       each: nil,
       enqueue: nil,
@@ -51,7 +48,6 @@ module JobWorkflow
     )
       @job_name = job_name
       @name = name
-      @namespace = namespace #: Namespace
       @block = block
       @each = each
       @enqueue = TaskEnqueue.from_primitive_value(enqueue)
@@ -64,11 +60,11 @@ module JobWorkflow
       @dependency_wait = TaskDependencyWait.from_primitive_value(dependency_wait)
       @dry_run_config = DryRunConfig.from_primitive_value(dry_run)
     end
-    # rubocop:enable Metrics/ParameterLists, Metrics/MethodLength, Metrics/AbcSize
+    # rubocop:enable Metrics/ParameterLists, Metrics/MethodLength
 
     #:  () -> Symbol
     def task_name
-      [namespace.full_name.to_s, name.to_s].reject(&:empty?).join(":").to_sym
+      name
     end
 
     #:  () -> String

data/lib/job_workflow/version.rb

@@ -1,5 +1,5 @@
 # frozen_string_literal: true
 
 module JobWorkflow
-  VERSION = "0.2.0" # : String
+  VERSION = "0.4.0" # : String
 end

data/lib/job_workflow/workflow.rb

@@ -2,7 +2,6 @@
 
 module JobWorkflow
   class Workflow
-    attr_reader :namespace #: Namespace
     attr_reader :dry_run_config #: DryRunConfig
 
     #:  () -> void
@@ -10,7 +9,6 @@ module JobWorkflow
       @task_graph = TaskGraph.new
       @argument_defs = {} #: Hash[Symbol, ArgumentDef]
       @hook_registry = HookRegistry.new
-      @namespace = Namespace.default #: Namespace
       @schedules = {} #: Hash[Symbol, Schedule]
       @dry_run_config = DryRunConfig.new
     end
@@ -20,15 +18,6 @@ module JobWorkflow
       @dry_run_config = DryRunConfig.from_primitive_value(value)
     end
 
-    #:  (Namespace) { () -> void } -> void
-    def add_namespace(namespace)
-      original_namespace = @namespace
-      @namespace = namespace.update_parent(original_namespace)
-      yield
-    ensure
-      @namespace = original_namespace
-    end
-
     #:  (Task) -> void
     def add_task(task)
       @task_graph.add(task)

data/lib/job_workflow/workflow_status.rb

@@ -34,7 +34,7 @@ module JobWorkflow
         job_class = job_class_name.constantize
         workflow = job_class._workflow
 
-        context_data = data["arguments"].first["job_workflow_context"]
+        context_data = data["job_workflow_context"] || data["arguments"]&.first&.dig("job_workflow_context")
         context = if context_data
                     Context.deserialize(context_data.merge("workflow" => workflow))
                   else

data/lib/job_workflow.rb

@@ -23,7 +23,6 @@ require_relative "job_workflow/task_throttle"
 require_relative "job_workflow/task_enqueue"
 require_relative "job_workflow/task_dependency_wait"
 require_relative "job_workflow/semaphore"
-require_relative "job_workflow/namespace"
 require_relative "job_workflow/hook"
 require_relative "job_workflow/error_hook"
 require_relative "job_workflow/hook_registry"

data/rbs_collection.lock.yaml

@@ -6,7 +6,7 @@ gems:
   source:
     type: git
     name: ruby/gem_rbs_collection
-    revision: 2af46cde7fec5e4130f6c84c5b691c0538af8789
+    revision: 81fa8bd0617286078617a62b6a3229cebfd4af23
     remote: https://github.com/ruby/gem_rbs_collection.git
     repo_dir: gems
 - name: activerecord
@@ -14,7 +14,7 @@ gems:
   source:
     type: git
     name: ruby/gem_rbs_collection
-    revision: 2af46cde7fec5e4130f6c84c5b691c0538af8789
+    revision: 81fa8bd0617286078617a62b6a3229cebfd4af23
     remote: https://github.com/ruby/gem_rbs_collection.git
     repo_dir: gems
 - name: activesupport
@@ -22,7 +22,7 @@ gems:
   source:
     type: git
     name: ruby/gem_rbs_collection
-    revision: 2af46cde7fec5e4130f6c84c5b691c0538af8789
+    revision: 81fa8bd0617286078617a62b6a3229cebfd4af23
     remote: https://github.com/ruby/gem_rbs_collection.git
     repo_dir: gems
 - name: base64
@@ -34,7 +34,7 @@ gems:
   source:
     type: git
     name: ruby/gem_rbs_collection
-    revision: 2af46cde7fec5e4130f6c84c5b691c0538af8789
+    revision: 81fa8bd0617286078617a62b6a3229cebfd4af23
     remote: https://github.com/ruby/gem_rbs_collection.git
     repo_dir: gems
 - name: concurrent-ruby
@@ -42,7 +42,7 @@ gems:
   source:
     type: git
     name: ruby/gem_rbs_collection
-    revision: 2af46cde7fec5e4130f6c84c5b691c0538af8789
+    revision: 81fa8bd0617286078617a62b6a3229cebfd4af23
     remote: https://github.com/ruby/gem_rbs_collection.git
     repo_dir: gems
 - name: connection_pool
@@ -50,7 +50,7 @@ gems:
   source:
     type: git
     name: ruby/gem_rbs_collection
-    revision: 2af46cde7fec5e4130f6c84c5b691c0538af8789
+    revision: 81fa8bd0617286078617a62b6a3229cebfd4af23
     remote: https://github.com/ruby/gem_rbs_collection.git
     repo_dir: gems
 - name: date
@@ -74,7 +74,7 @@ gems:
   source:
     type: git
     name: ruby/gem_rbs_collection
-    revision: 2af46cde7fec5e4130f6c84c5b691c0538af8789
+    revision: 81fa8bd0617286078617a62b6a3229cebfd4af23
     remote: https://github.com/ruby/gem_rbs_collection.git
     repo_dir: gems
 - name: i18n
@@ -82,7 +82,7 @@ gems:
   source:
     type: git
     name: ruby/gem_rbs_collection
-    revision: 2af46cde7fec5e4130f6c84c5b691c0538af8789
+    revision: 81fa8bd0617286078617a62b6a3229cebfd4af23
     remote: https://github.com/ruby/gem_rbs_collection.git
     repo_dir: gems
 - name: json
@@ -98,7 +98,7 @@ gems:
   source:
     type: git
     name: ruby/gem_rbs_collection
-    revision: 2af46cde7fec5e4130f6c84c5b691c0538af8789
+    revision: 81fa8bd0617286078617a62b6a3229cebfd4af23
     remote: https://github.com/ruby/gem_rbs_collection.git
     repo_dir: gems
 - name: monitor
@@ -138,7 +138,7 @@ gems:
   source:
     type: git
     name: ruby/gem_rbs_collection
-    revision: 2af46cde7fec5e4130f6c84c5b691c0538af8789
+    revision: 81fa8bd0617286078617a62b6a3229cebfd4af23
     remote: https://github.com/ruby/gem_rbs_collection.git
     repo_dir: gems
 - name: stringio
@@ -162,7 +162,7 @@ gems:
   source:
     type: git
     name: ruby/gem_rbs_collection
-    revision: 2af46cde7fec5e4130f6c84c5b691c0538af8789
+    revision: 81fa8bd0617286078617a62b6a3229cebfd4af23
     remote: https://github.com/ruby/gem_rbs_collection.git
     repo_dir: gems
 - name: uri

data/sig/generated/job_workflow/context.rbs

@@ -48,8 +48,8 @@ module JobWorkflow
     # :  () -> String?
     def concurrency_key: () -> String?
 
-    # :  (Task) -> Enumerator[Context]
-    def _with_each_value: (Task) -> Enumerator[Context]
+    # :  (Task, ?start_index: Integer?) -> Enumerator[Context]
+    def _with_each_value: (Task, ?start_index: Integer?) -> Enumerator[Context]
 
     # :  () { () -> void } -> void
     def _with_task_throttle: () { () -> void } -> void
@@ -128,14 +128,14 @@ module JobWorkflow
     # :  () -> Hash[String, untyped]
     def serialize_for_sub_job: () -> Hash[String, untyped]
 
-    # :  (Task, Enumerator::Yielder) -> void
-    def with_task_context: (Task, Enumerator::Yielder) -> void
+    # :  (Task, Enumerator::Yielder, ?start_index: Integer?) -> void
+    def with_task_context: (Task, Enumerator::Yielder, ?start_index: Integer?) -> void
 
     # :  (Task) -> void
     def reset_task_context_if_task_changed: (Task) -> void
 
-    # :  (Task) { (untyped, Integer) -> void } -> void
-    def with_each_index_and_value: (Task) { (untyped, Integer) -> void } -> void
+    # :  (Task, ?start_index: Integer?) { (untyped, Integer) -> void } -> void
+    def with_each_index_and_value: (Task, ?start_index: Integer?) { (untyped, Integer) -> void } -> void
 
     # :  () -> void
     def clear_after_each_index_and_value: () -> void

data/sig/generated/job_workflow/dsl.rbs

@@ -62,9 +62,6 @@ module JobWorkflow
       # :  (Symbol argument_name, String type, ?default: untyped) -> void
       def argument: (Symbol argument_name, String type, ?default: untyped) -> void
 
-      # :  (Symbol) { () -> void } -> void
-      def namespace: (Symbol) { () -> void } -> void
-
       # rubocop:disable Metrics/ParameterLists
       #
       # :  (
@@ -139,11 +136,6 @@ module JobWorkflow
       #     ?description: String?
       #   ) -> void
       def schedule: (String expression, ?key: (String | Symbol)?, ?queue: String?, ?priority: Integer?, ?args: Hash[Symbol, untyped], ?description: String?) -> void
-
-      private
-
-      # :  () -> void
-      def validate_namespace!: () -> void
     end
   end
 end

data/sig/generated/job_workflow/output.rbs

@@ -23,11 +23,8 @@ module JobWorkflow
     # :  (TaskOutput) -> void
     def add_task_output: (TaskOutput) -> void
 
-    # :  (Array[String], Workflow) -> void
-    def update_task_outputs_from_db: (Array[String], Workflow) -> void
-
-    # :  (Array[SolidQueue::Job], Workflow) -> void
-    def update_task_outputs_from_jobs: (Array[SolidQueue::Job], Workflow) -> void
+    # :  (Array[Hash[String, untyped]], Workflow) -> void
+    def update_task_outputs_from_contexts: (Array[Hash[String, untyped]], Workflow) -> void
 
     # :  () -> Array[TaskOutput]
     def flat_task_outputs: () -> Array[TaskOutput]

data/sig/generated/job_workflow/queue_adapters/abstract.rbs

@@ -49,8 +49,14 @@ module JobWorkflow
       # :  (String) -> Hash[String, untyped]?
       def find_job: (String) -> Hash[String, untyped]?
 
+      # :  (Array[String]) -> Array[Hash[String, untyped]]
+      def fetch_job_contexts: (Array[String]) -> Array[Hash[String, untyped]]
+
       # :  (DSL, Numeric) -> bool
       def reschedule_job: (DSL, Numeric) -> bool
+
+      # :  (DSL) -> void
+      def persist_job_context: (DSL) -> void
     end
   end
 end

data/sig/generated/job_workflow/queue_adapters/null_adapter.rbs

@@ -51,6 +51,9 @@ module JobWorkflow
       # :  (String) -> Hash[String, untyped]?
       def find_job: (String) -> Hash[String, untyped]?
 
+      # :  (Array[String]) -> Array[Hash[String, untyped]]
+      def fetch_job_contexts: (Array[String]) -> Array[Hash[String, untyped]]
+
       # :  (DSL, Numeric) -> bool
       def reschedule_job: (DSL, Numeric) -> bool
 

data/sig/generated/job_workflow/queue_adapters/solid_queue_adapter.rbs

@@ -2,7 +2,7 @@
 
 module JobWorkflow
   module QueueAdapters
-    # rubocop:disable Naming/PredicateMethod
+    # rubocop:disable Naming/PredicateMethod, Metrics/ClassLength
     class SolidQueueAdapter < Abstract
       # @note
       #   - Registry scope: @semaphore_registry is process-scoped (shared across fibers/threads
@@ -82,13 +82,37 @@ module JobWorkflow
       # :  (String) -> Hash[String, untyped]?
       def find_job: (String) -> Hash[String, untyped]?
 
+      # @note
+      #   - Fetches job_workflow_context hashes for the given job IDs.
+      #
+      # :  (Array[String]) -> Array[Hash[String, untyped]]
+      def fetch_job_contexts: (Array[String]) -> Array[Hash[String, untyped]]
+
       # :  (DSL, Numeric) -> bool
       def reschedule_job: (DSL, Numeric) -> bool
 
+      # @note
+      #   - Persists the job's updated context (including task outputs) back
+      #     to the SolidQueue job record after execution completes. Without this,
+      #     outputs computed during job execution would be lost because
+      #     SolidQueue does not re-serialize job arguments after perform.
+      #
+      # :  (DSL) -> void
+      def persist_job_context: (DSL) -> void
+
       private
 
       attr_reader semaphore_registry: Hash[Object, ^(SolidQueue::Worker) -> void]
 
+      # @note
+      #   - Bypasses ActiveRecord query cache for the given block.
+      #   - When running under SolidQueue's executor, SELECT queries are cached
+      #     for the entire job execution. Polling queries must bypass this cache
+      #     to observe status changes made by other threads/processes.
+      #
+      # :  [T] () { () -> T } -> T
+      def without_query_cache: [T] () { () -> T } -> T
+
       # :  (SolidQueue::Job, DSL, Numeric) -> bool
       def reschedule_solid_queue_job: (SolidQueue::Job, DSL, Numeric) -> bool
 

data/sig/generated/job_workflow/runner.rbs

@@ -30,8 +30,8 @@ module JobWorkflow
     # :  (Task) -> bool
     def skip_task?: (Task) -> bool
 
-    # :  (Task) -> void
-    def run_task: (Task) -> void
+    # :  (Task, ?step: ActiveJob::Continuation::Step?) -> void
+    def run_task: (Task, ?step: ActiveJob::Continuation::Step?) -> void
 
     # :  (Task, Context) -> void
     def run_each_task: (Task, Context) -> void
@@ -62,5 +62,8 @@ module JobWorkflow
 
     # :  (Task) -> void
     def update_task_outputs: (Task) -> void
+
+    # :  () -> void
+    def persist_current_job_context: () -> void
   end
 end

data/sig/generated/job_workflow/task.rbs

@@ -4,8 +4,6 @@ module JobWorkflow
   class Task
     attr_reader job_name: String
 
-    attr_reader namespace: Namespace
-
     attr_reader block: ^(untyped) -> void
 
     attr_reader each: ^(Context) -> untyped
@@ -28,11 +26,10 @@ module JobWorkflow
 
     attr_reader dry_run_config: DryRunConfig
 
-    # rubocop:disable Metrics/ParameterLists, Metrics/MethodLength, Metrics/AbcSize
+    # rubocop:disable Metrics/ParameterLists, Metrics/MethodLength
     # :  (
     #     job_name: String,
     #     name: Symbol,
-    #     namespace: Namespace,
     #     block: ^(untyped) -> void,
     #     ?each: ^(Context) -> untyped,
     #     ?enqueue: true | false | ^(Context) -> bool | Hash[Symbol, untyped],
@@ -45,7 +42,7 @@ module JobWorkflow
     #     ?dependency_wait: Hash[Symbol, untyped],
     #     ?dry_run: bool | ^(Context) -> bool
     #   ) -> void
-    def initialize: (job_name: String, name: Symbol, namespace: Namespace, block: ^(untyped) -> void, condition: ^(Context) -> bool, ?each: ^(Context) -> untyped, ?enqueue: true | false | ^(Context) -> bool | Hash[Symbol, untyped], ?output: Hash[Symbol, String], ?depends_on: Array[Symbol], ?task_retry: Integer | Hash[Symbol, untyped], ?throttle: Integer | Hash[Symbol, untyped], ?timeout: Numeric?, ?dependency_wait: Hash[Symbol, untyped], ?dry_run: bool | ^(Context) -> bool) -> void
+    def initialize: (job_name: String, name: Symbol, block: ^(untyped) -> void, condition: ^(Context) -> bool, ?each: ^(Context) -> untyped, ?enqueue: true | false | ^(Context) -> bool | Hash[Symbol, untyped], ?output: Hash[Symbol, String], ?depends_on: Array[Symbol], ?task_retry: Integer | Hash[Symbol, untyped], ?throttle: Integer | Hash[Symbol, untyped], ?timeout: Numeric?, ?dependency_wait: Hash[Symbol, untyped], ?dry_run: bool | ^(Context) -> bool) -> void
 
     # :  () -> Symbol
     def task_name: () -> Symbol

data/sig/generated/job_workflow/workflow.rbs

@@ -2,8 +2,6 @@
 
 module JobWorkflow
   class Workflow
-    attr_reader namespace: Namespace
-
     attr_reader dry_run_config: DryRunConfig
 
     # :  () -> void
@@ -12,9 +10,6 @@ module JobWorkflow
     # :  (bool | ^(Context) -> bool) -> void
     def dry_run_config=: (bool | ^(Context) -> bool) -> void
 
-    # :  (Namespace) { () -> void } -> void
-    def add_namespace: (Namespace) { () -> void } -> void
-
     # :  (Task) -> void
     def add_task: (Task) -> void
 

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: job-workflow
 version: !ruby/object:Gem::Version
-  version: 0.2.0
+  version: 0.4.0
 platform: ruby
 authors:
 - shoma07
@@ -49,7 +49,6 @@ files:
 - guides/GETTING_STARTED.md
 - guides/INSTRUMENTATION.md
 - guides/LIFECYCLE_HOOKS.md
-- guides/NAMESPACES.md
 - guides/OPENTELEMETRY_INTEGRATION.md
 - guides/PARALLEL_PROCESSING.md
 - guides/PRODUCTION_DEPLOYMENT.md
@@ -84,7 +83,6 @@ files:
 - lib/job_workflow/instrumentation/opentelemetry_subscriber.rb
 - lib/job_workflow/job_status.rb
 - lib/job_workflow/logger.rb
-- lib/job_workflow/namespace.rb
 - lib/job_workflow/output.rb
 - lib/job_workflow/output_def.rb
 - lib/job_workflow/queue.rb
@@ -136,7 +134,6 @@ files:
 - sig/generated/job_workflow/instrumentation/opentelemetry_subscriber.rbs
 - sig/generated/job_workflow/job_status.rbs
 - sig/generated/job_workflow/logger.rbs
-- sig/generated/job_workflow/namespace.rbs
 - sig/generated/job_workflow/output.rbs
 - sig/generated/job_workflow/output_def.rbs
 - sig/generated/job_workflow/queue.rbs

data/guides/NAMESPACES.md

@@ -1,75 +0,0 @@
-# Namespaces
-
-Logically grouping tasks improves readability and maintainability of complex workflows. JobWorkflow provides namespace functionality.
-
-## Basic Namespaces
-
-### namespace DSL
-
-Group related tasks.
-
-```ruby
-class ECommerceOrderJob < ApplicationJob
-  include JobWorkflow::DSL
-  
-  argument :order, "Order"
-  
-  # Payment-related tasks
-  namespace :payment do
-    task :validate do |ctx|
-      order = ctx.arguments.order
-      PaymentValidator.validate(order)
-    end
-    
-    task :charge, depends_on: [:"payment:validate"], output: { payment_result: "Hash" } do |ctx|
-      order = ctx.arguments.order
-      { payment_result: PaymentProcessor.charge(order) }
-    end
-    
-    task :send_receipt, depends_on: [:"payment:charge"] do |ctx|
-      order = ctx.arguments.order
-      payment_result = ctx.output[:"payment:charge"].first.payment_result
-      ReceiptMailer.send(order, payment_result)
-    end
-  end
-  
-  # Inventory-related tasks
-  namespace :inventory do
-    task :check_availability do |ctx|
-      order = ctx.arguments.order
-      InventoryService.check(order.items)
-    end
-    
-    task :reserve, depends_on: [:"inventory:check_availability"], output: { reserved: "bool" } do |ctx|
-      order = ctx.arguments.order
-      { reserved: InventoryService.reserve(order.items) }
-    end
-  end
-  
-  # Shipping-related tasks
-  namespace :shipping do
-    task :calculate_cost, output: { shipping_cost: "Float" } do |ctx|
-      order = ctx.arguments.order
-      { shipping_cost: ShippingCalculator.calculate(order) }
-    end
-    
-    task :create_label, depends_on: [:"shipping:calculate_cost"], output: { shipping_label: "String" } do |ctx|
-      order = ctx.arguments.order
-      { shipping_label: ShippingService.create_label(order) }
-    end
-  end
-end
-```
-
-Tasks in namespaces are identified as `:namespace:task_name` at runtime:
-
-```ruby
-# Executed tasks:
-# - :payment:validate
-# - :payment:charge
-# - :payment:send_receipt
-# - :inventory:check_availability
-# - :inventory:reserve
-# - :shipping:calculate_cost
-# - :shipping:create_label
-```

data/lib/job_workflow/namespace.rb

@@ -1,36 +0,0 @@
-# frozen_string_literal: true
-
-module JobWorkflow
-  class Namespace
-    attr_reader :name #: Symbol
-    attr_reader :parent #: Namespace?
-
-    class << self
-      #:  () -> Namespace
-      def default
-        new(name: :"")
-      end
-    end
-
-    #:  (name: Symbol, ?parent: Namespace?) -> void
-    def initialize(name:, parent: nil)
-      @name = name #: Symbol
-      @parent = parent #: Namespace?
-    end
-
-    #:  () -> bool
-    def default?
-      name.empty?
-    end
-
-    #:  (Namespace) -> Namespace
-    def update_parent(parent)
-      self.class.new(name:, parent:)
-    end
-
-    #:  () -> Symbol
-    def full_name
-      [parent&.full_name, name.to_s].compact.reject(&:empty?).join(":").to_sym
-    end
-  end
-end

data/sig/generated/job_workflow/namespace.rbs

@@ -1,24 +0,0 @@
-# Generated from lib/job_workflow/namespace.rb with RBS::Inline
-
-module JobWorkflow
-  class Namespace
-    attr_reader name: Symbol
-
-    attr_reader parent: Namespace?
-
-    # :  () -> Namespace
-    def self.default: () -> Namespace
-
-    # :  (name: Symbol, ?parent: Namespace?) -> void
-    def initialize: (name: Symbol, ?parent: Namespace?) -> void
-
-    # :  () -> bool
-    def default?: () -> bool
-
-    # :  (Namespace) -> Namespace
-    def update_parent: (Namespace) -> Namespace
-
-    # :  () -> Symbol
-    def full_name: () -> Symbol
-  end
-end