rcrewai-rails 0.3.1 → 0.6.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: de3fd7383b01dfbcf053637b30537fb9e78d3541b0fdf09d0d7c92f0f132525e
-  data.tar.gz: 0f3e47c876aefb405a63abdd5b22ea965afdf438bdc2af46d3154e619d89f42d
+  metadata.gz: 92b441696cd97a26aeca352027a7f8e4bdef639f34c452494599d51cb302b8b6
+  data.tar.gz: 00466757e89f9b12e46956dcdb38d67a40a938bb4a68d43e0292f79babfb6260
 SHA512:
-  metadata.gz: 8c4bdd914f99b4e2f5bb324e2d5658e088698be20834b0f4186a3e6ef7d574330c0de9cdc112970f937858858738800cf80f97cbc88699c1b7397674ba979a2c
-  data.tar.gz: c93205e5e31f6036f796c616ad623711136a6f2ab0f902a149c02737d3ecea902bafc4d564d3f2c36bcf1cfddd754c6bf8a35aefbcc74f3ecabc4165cf767f87
+  metadata.gz: ec0516a3dba432d2b1a6308f89981a65905e110a4ef543ed5a516476ab62f47c9ba86cdc538288e52512841c34e01f5c2e9146970420d6435144922c4e2926a7
+  data.tar.gz: 26fb59a9bed5be7db14f7520a57d037c23e46bf572adf7946c98cf6fbe2d67fd3dd682e85942c84b38d9807e612aeb575b104f4c411f1dcd450f3de2cb8ab7b1

data/CHANGELOG.md

@@ -0,0 +1,123 @@
+# Changelog
+
+All notable changes to this project are documented in this file.
+
+The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/),
+and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
+
+## [Unreleased]
+
+## [0.6.0] - 2026-07-07
+
+Tracks rcrewai 0.7.0: adds the `:consensual` crew process and agent-level
+cognitive memory configuration, and requires `rcrewai ~> 0.7`. Includes a
+schema cleanup that removes unused columns (see Removed + the `009` migration).
+
+### Added
+- Support the rcrewai 0.7.0 `:consensual` crew process: `process_type:
+  "consensual"` is now valid, a nullable `consensus_agents` column is forwarded to
+  the core crew (defaulting to the core's 3 when unset), and the web UI + API
+  permit it. Existing sequential/hierarchical crews are unaffected.
+- Agent memory configuration: enable rcrewai 0.6+ cognitive memory per agent via
+  the existing `memory_enabled` flag, with `memory_scope` /
+  `memory_short_term_limit` columns forwarded to the core agent. The embedder and
+  store come from `RcrewAI::Rails.config.default_memory_embedder` /
+  `default_memory_store` (set in a host initializer). Memory is off by default, so
+  existing agents are unaffected.
+
+### Changed
+- Require `rcrewai ~> 0.7` (was `~> 0.5`).
+
+### Removed
+- Dropped the unused `memory_enabled` and `memory` columns from `rcrewai_crews`.
+  Core memory is agent-level; these crew columns were never wired to anything.
+  **Migration note:** the `009` migration removes them (reversible).
+
+## [0.5.1] - 2026-07-06
+
+### Fixed
+- Exclude internal `docs/superpowers/` design and plan documents from the packaged
+  gem (they were swept in alongside the intended `docs/index.html`). No code
+  changes; first published build carrying the 0.4/0.5 parity work.
+
+## [0.5.0] - 2026-07-06
+
+Adds the second CrewAI pillar — **Flows** — to the Rails engine as a persistence
+layer, completing the rcrewai 0.4/0.5 feature-parity effort. Additive; existing
+crews, agents, and tasks are unaffected.
+
+### Added
+- Flows persistence: `RcrewAI::Rails::ActiveRecordStateStore` backs rcrewai Flow
+  state with a `rcrewai_flow_states` table so flows resume from the DB
+  (`flow.restore(state_id)`), and `RcrewAI::Rails::FlowRun` records each kickoff
+  (status, state id, inputs, result, timing) via `FlowRun.execute(FlowClass,
+  inputs:)`. Flow subclasses are still defined in the host app; the engine adds
+  the persistence layer (#13).
+
+## [0.4.0] - 2026-07-06
+
+Feature-parity release: brings the rcrewai 0.4/0.5 agent, task, and crew
+capabilities to the Rails engine. Requires `rcrewai ~> 0.5`. All additive —
+existing agents, tasks, and crews build unchanged.
+
+### Added
+- Forward rcrewai 0.5.0 agent options through `RcrewAI::Rails::Agent#to_rcrew_agent`:
+  `reasoning`, `max_reasoning_attempts`, `respect_context_window`, and per-agent
+  `llm` (from the `llm_config` column). Also fixes a latent gap where the existing
+  `max_rpm` and `llm_config` columns were never passed to the core agent. New
+  columns are added via a host migration, the install generator, and the test
+  schema; all options are emitted only when set, so existing agents are
+  unaffected (#6).
+- Forward rcrewai 0.4/0.5 task output-processing options through
+  `RcrewAI::Rails::Task#to_rcrew_task`: `output_schema` (structured output),
+  `guardrail` (resolved from `guardrail_class` + `guardrail_method_name`),
+  `guardrail_max_retries`, `output_file`, `create_directory`, `markdown`, and
+  multimodal `attachments`. Options are emitted only when meaningfully set, so
+  existing tasks construct unchanged (#7).
+- Forward rcrewai 0.5.0 crew options through `RcrewAI::Rails::Crew#to_rcrew`:
+  `planning` / `planning_llm`, and `before_kickoff` / `after_kickoff` lifecycle
+  hooks (resolved from `*_class` + `*_method` columns). Options are emitted and
+  hooks registered only when configured, so existing crews build unchanged (#9).
+- Batch crew execution (`kickoff_for_each` parity): `Crew#execute_batch_sync` /
+  `#execute_batch_async` run the crew once per input set, creating one `Execution`
+  per input grouped by a shared `batch_id` (new nullable column). `#batch_executions`
+  returns a batch's runs in order. Existing single-run executions are unaffected (#10).
+- Knowledge (RAG) sources: a polymorphic `RcrewAI::Rails::KnowledgeSource`
+  (owned by an Agent or a Crew) persists `{source_type, value}` for string, file,
+  PDF, CSV, and URL sources. `Agent#to_rcrew_agent` / `Crew#to_rcrew` forward
+  active sources as `knowledge_sources:`; the core embeds them lazily at
+  execution. Emitted only when sources exist, so existing agents/crews are
+  unaffected (#11).
+
+### Changed
+- Require `rcrewai ~> 0.5` (was `~> 0.3`) (#6).
+
+## [0.3.1] - 2026-06-16
+
+### Added
+- GitHub Pages landing + documentation site, served from `/docs` at
+  https://gkosmo.github.io/rcrewai-rails/ (#3).
+
+### Fixed
+- Zeitwerk eager-load failure caused by `lib/` being on the autoload paths (#2).
+
+### Changed
+- Point the gemspec `documentation_uri` at the new GitHub Pages site (#3).
+
+## [0.3.0] - 2026-05-12
+
+### Added
+- Adapt the engine to rcrewai 0.3.
+- Test suite (RSpec) covering models, jobs, builders, and tools.
+- GitHub Actions CI workflow.
+
+### Changed
+- Rename generators from `rcrew_a_i` to `rcrewai` namespacing.
+
+[Unreleased]: https://github.com/gkosmo/rcrewai-rails/compare/v0.6.0...HEAD
+[0.6.0]: https://github.com/gkosmo/rcrewai-rails/compare/v0.5.1...v0.6.0
+[0.5.1]: https://github.com/gkosmo/rcrewai-rails/compare/v0.5.0...v0.5.1
+[0.5.0]: https://github.com/gkosmo/rcrewai-rails/compare/v0.4.0...v0.5.0
+[0.4.0]: https://github.com/gkosmo/rcrewai-rails/compare/v0.3.1...v0.4.0
+[0.3.1]: https://github.com/gkosmo/rcrewai-rails/compare/v0.3.0...v0.3.1
+[0.3.0]: https://github.com/gkosmo/rcrewai-rails/releases/tag/v0.3.0

data/app/controllers/rcrewai/rails/api/v1/crews_controller.rb

@@ -45,7 +45,7 @@ module RcrewAI
           def crew_params
             params.require(:crew).permit(
               :name, :description, :process_type, :verbose,
-              :memory_enabled, :cache_enabled, :max_rpm, :manager_llm, :active
+              :cache_enabled, :max_rpm, :manager_llm, :consensus_agents, :active
             )
           end
         end

data/app/controllers/rcrewai/rails/crews_controller.rb

@@ -59,7 +59,7 @@ module RcrewAI
       def crew_params
         params.require(:crew).permit(
           :name, :description, :process_type, :verbose,
-          :memory_enabled, :cache_enabled, :max_rpm, :manager_llm, :active
+          :cache_enabled, :max_rpm, :manager_llm, :consensus_agents, :active
         )
       end
     end

data/app/jobs/rcrewai/rails/crew_execution_job.rb

@@ -5,10 +5,11 @@ module RcrewAI
 
       retry_on StandardError, wait: :exponentially_longer, attempts: 3
 
-      def perform(crew, inputs = {})
+      def perform(crew, inputs = {}, batch_id: nil)
         execution = crew.executions.create!(
           status: "pending",
-          inputs: inputs
+          inputs: inputs,
+          batch_id: batch_id
         )
 
         begin

data/app/models/rcrewai/rails/active_record_state_store.rb

@@ -0,0 +1,24 @@
+module RcrewAI
+  module Rails
+    # Persists rcrewai Flow state to the DB. Implements the core state-store
+    # contract: save(id, hash) / load(id) => hash or nil. Pass an instance as
+    # +state_store:+ when constructing a Flow.
+    #
+    # State is stored as JSON (see FlowState), so values must be JSON-native —
+    # the same constraint as the core FileStateStore. A single flow run persists
+    # from one process, so saves are effectively serial; a genuinely concurrent
+    # first-write for the same state_id would hit the unique index and raise
+    # ActiveRecord::RecordNotUnique (fail-loud, by design).
+    class ActiveRecordStateStore
+      def save(id, hash)
+        record = FlowState.find_or_initialize_by(state_id: id)
+        record.data = hash
+        record.save!
+      end
+
+      def load(id)
+        FlowState.find_by(state_id: id)&.data
+      end
+    end
+  end
+end

data/app/models/rcrewai/rails/agent.rb

@@ -6,6 +6,7 @@ module RcrewAI
       belongs_to :crew
       has_many :tasks, dependent: :nullify
       has_many :tools, class_name: 'RcrewAI::Rails::Tool', dependent: :destroy
+      has_many :knowledge_sources, as: :owner, class_name: "RcrewAI::Rails::KnowledgeSource", dependent: :destroy
 
       validates :name, presence: true
       validates :role, presence: true
@@ -24,10 +25,44 @@ module RcrewAI
           verbose: verbose,
           allow_delegation: allow_delegation,
           tools: instantiated_tools,
-          max_iterations: max_iterations
+          max_iterations: max_iterations,
+          **agent_options
         )
       end
 
+      # rcrewai 0.5.0 agent options. Only emit a key when it is meaningfully
+      # set, so an all-default record constructs exactly as it did pre-0.5.
+      def agent_options
+        opts = {}
+        opts[:max_rpm] = max_rpm if max_rpm.present? && max_rpm.positive?
+        opts[:reasoning] = reasoning if reasoning
+        opts[:max_reasoning_attempts] = max_reasoning_attempts if reasoning && max_reasoning_attempts
+        opts[:respect_context_window] = respect_context_window if respect_context_window
+        opts[:llm] = llm_config.symbolize_keys if llm_config.present?
+        sources = rcrew_knowledge_sources
+        opts[:knowledge_sources] = sources if sources.any?
+        opts[:memory] = memory_options if memory_enabled
+        opts
+      end
+
+      # Agent memory config (rcrewai 0.6+). Scalars come from columns; embedder
+      # and store come from the engine configuration (set in a host initializer).
+      # May return {} — an empty hash still enables memory with core defaults.
+      def memory_options
+        m = {}
+        m[:scope] = memory_scope if memory_scope.present?
+        m[:short_term_limit] = memory_short_term_limit if memory_short_term_limit.present?
+        embedder = RcrewAI::Rails.config.default_memory_embedder
+        store = RcrewAI::Rails.config.default_memory_store
+        m[:embedder] = embedder if embedder
+        m[:store] = store if store
+        m
+      end
+
+      def rcrew_knowledge_sources
+        knowledge_sources.active.map(&:to_rcrew_source)
+      end
+
       def instantiated_tools
         return [] if tools.blank?
 

data/app/models/rcrewai/rails/crew.rb

@@ -6,12 +6,12 @@ module RcrewAI
       has_many :agents, dependent: :destroy
       has_many :tasks, dependent: :destroy
       has_many :executions, dependent: :destroy
+      has_many :knowledge_sources, as: :owner, class_name: "RcrewAI::Rails::KnowledgeSource", dependent: :destroy
 
       validates :name, presence: true
-      validates :process_type, inclusion: { in: %w[sequential hierarchical] }
+      validates :process_type, inclusion: { in: %w[sequential hierarchical consensual] }
 
       serialize :config, coder: JSON
-      serialize :memory, coder: JSON
 
       scope :active, -> { where(active: true) }
       scope :with_agents, -> { includes(:agents) }
@@ -20,7 +20,8 @@ module RcrewAI
         crew = RCrewAI::Crew.new(
           name,
           process: process_type.to_sym,
-          verbose: verbose
+          verbose: verbose,
+          **crew_planning_options
         )
 
         agents.each do |agent|
@@ -31,9 +32,27 @@ module RcrewAI
           crew.add_task(task.to_rcrew_task)
         end
 
+        register_kickoff_hooks(crew)
         crew
       end
 
+      # Crew construction options (planning, consensus_agents, knowledge). Emit a
+      # key only when meaningfully set, so an all-default crew constructs exactly
+      # as it did before.
+      def crew_planning_options
+        opts = {}
+        opts[:planning] = planning if planning
+        opts[:planning_llm] = planning_llm.to_sym if planning_llm.present?
+        sources = rcrew_knowledge_sources
+        opts[:knowledge_sources] = sources if sources.any?
+        opts[:consensus_agents] = consensus_agents if consensus_agents.present?
+        opts
+      end
+
+      def rcrew_knowledge_sources
+        knowledge_sources.active.map(&:to_rcrew_source)
+      end
+
       def execute_async(inputs = {})
         CrewExecutionJob.perform_later(self, inputs)
       end
@@ -42,6 +61,26 @@ module RcrewAI
         CrewExecutionJob.perform_now(self, inputs)
       end
 
+      def execute_batch_async(inputs_list)
+        batch_id = SecureRandom.uuid
+        normalize_batch_inputs(inputs_list).each do |inputs|
+          CrewExecutionJob.perform_later(self, inputs, batch_id: batch_id)
+        end
+        batch_id
+      end
+
+      def execute_batch_sync(inputs_list)
+        batch_id = SecureRandom.uuid
+        normalize_batch_inputs(inputs_list).each do |inputs|
+          CrewExecutionJob.perform_now(self, inputs, batch_id: batch_id)
+        end
+        { batch_id: batch_id, executions: batch_executions(batch_id).to_a }
+      end
+
+      def batch_executions(batch_id)
+        executions.where(batch_id: batch_id).order(:created_at, :id)
+      end
+
       def last_execution
         executions.order(created_at: :desc).first
       end
@@ -55,6 +94,34 @@ module RcrewAI
           average_duration: executions.successful.average(:duration_seconds)
         }
       end
+
+      private
+
+      # Wraps a single inputs hash into a one-element array; leaves an array of
+      # hashes as-is. Avoids Array()'s hash-destructuring (Array({a:1}) => [[:a,1]]).
+      def normalize_batch_inputs(inputs_list)
+        inputs_list.is_a?(Hash) ? [inputs_list] : Array(inputs_list)
+      end
+
+      # Registers before/after kickoff hooks resolved from *_class + *_method
+      # columns, mirroring the guardrail/callback pattern. No-op when unconfigured.
+      def register_kickoff_hooks(crew)
+        if (before = hook_callable(before_kickoff_class, before_kickoff_method))
+          crew.before_kickoff { |inputs| before.call(inputs) }
+        end
+
+        if (after = hook_callable(after_kickoff_class, after_kickoff_method))
+          crew.after_kickoff { |result| after.call(result) }
+        end
+      end
+
+      # Resolves a *_class + *_method pair to a callable; nil when either is blank.
+      def hook_callable(class_name, method_name)
+        return nil unless class_name.present? && method_name.present?
+
+        klass = class_name.constantize
+        ->(arg) { klass.new.send(method_name, arg) }
+      end
     end
   end
 end

data/app/models/rcrewai/rails/flow_run.rb

@@ -0,0 +1,41 @@
+module RcrewAI
+  module Rails
+    class FlowRun < ApplicationRecord
+      self.table_name = "rcrewai_flow_runs"
+
+      serialize :inputs, coder: JSON
+      serialize :result, coder: JSON
+
+      validates :flow_class, presence: true
+      validates :status, inclusion: { in: %w[pending running completed failed] }
+
+      scope :successful, -> { where(status: "completed") }
+      scope :failed, -> { where(status: "failed") }
+
+      # Runs a Flow subclass (a Class or its String name) with an AR-backed state
+      # store, wrapped in a run record. Returns the run. Re-raises on failure
+      # after recording it.
+      def self.execute(flow_class, inputs: {})
+        klass = flow_class.is_a?(String) ? flow_class.constantize : flow_class
+        run = create!(flow_class: klass.name, status: "pending", inputs: inputs)
+        run.run!(klass, inputs)
+        run
+      end
+
+      def run!(klass, inputs)
+        update!(status: "running", started_at: Time.current)
+        flow = klass.new(state_store: ActiveRecordStateStore.new)
+        state = flow.kickoff(inputs: inputs)
+        update!(
+          status: "completed",
+          state_id: state.id,
+          result: state.to_h,
+          completed_at: Time.current
+        )
+      rescue => e
+        update!(status: "failed", error_message: e.message, completed_at: Time.current)
+        raise
+      end
+    end
+  end
+end

data/app/models/rcrewai/rails/flow_state.rb

@@ -0,0 +1,11 @@
+module RcrewAI
+  module Rails
+    class FlowState < ApplicationRecord
+      self.table_name = "rcrewai_flow_states"
+
+      serialize :data, coder: JSON
+
+      validates :state_id, presence: true, uniqueness: true
+    end
+  end
+end

data/app/models/rcrewai/rails/knowledge_source.rb

@@ -0,0 +1,27 @@
+module RcrewAI
+  module Rails
+    class KnowledgeSource < ApplicationRecord
+      self.table_name = "rcrewai_knowledge_sources"
+
+      TYPE_MAP = {
+        "string" => RCrewAI::Knowledge::StringSource,
+        "file"   => RCrewAI::Knowledge::FileSource,
+        "pdf"    => RCrewAI::Knowledge::PdfSource,
+        "csv"    => RCrewAI::Knowledge::CsvSource,
+        "url"    => RCrewAI::Knowledge::UrlSource,
+      }.freeze
+
+      belongs_to :owner, polymorphic: true
+
+      validates :source_type, inclusion: { in: TYPE_MAP.keys }
+      validates :value, presence: true
+
+      scope :active, -> { where(active: true) }
+
+      # Maps this row to the matching core Source object.
+      def to_rcrew_source
+        TYPE_MAP.fetch(source_type).new(value)
+      end
+    end
+  end
+end

data/app/models/rcrewai/rails/task.rb

@@ -15,6 +15,8 @@ module RcrewAI
       serialize :output_json, coder: JSON
       serialize :output_pydantic, coder: JSON
       serialize :tools, coder: JSON, type: Array
+      serialize :output_schema, coder: JSON
+      serialize :attachments, coder: JSON, type: Array
 
       scope :ordered, -> { order(:order_index) }
 
@@ -27,10 +29,28 @@ module RcrewAI
           context: context,
           async: async_execution,
           tools: instantiated_tools,
-          callback: callback_method
+          callback: callback_method,
+          **task_output_options
         )
       end
 
+      # rcrewai 0.4/0.5 task output-processing options. Only emit a key when it
+      # is meaningfully set, so an all-default record constructs exactly as it
+      # did before these options existed.
+      def task_output_options
+        opts = {}
+        opts[:output_schema] = output_schema.deep_symbolize_keys if output_schema.present?
+        opts[:guardrail] = guardrail_callable if guardrail_callable
+        opts[:guardrail_max_retries] = guardrail_max_retries if guardrail_callable && guardrail_max_retries
+        opts[:output_file] = output_file if output_file.present?
+        # Core defaults create_directory to true; only forward when explicitly
+        # disabled, so an all-default record still emits nothing.
+        opts[:create_directory] = false if create_directory == false
+        opts[:markdown] = markdown if markdown
+        opts[:attachments] = normalized_attachments if attachments.present?
+        opts
+      end
+
 
       def instantiated_tools
         return [] if tools.blank?
@@ -65,6 +85,24 @@ module RcrewAI
         klass = callback_class.constantize
         ->(output) { klass.new.send(callback_method_name, output) }
       end
+
+      # Resolves guardrail_class + guardrail_method_name to a callable returning
+      # the core [ok, value_or_error] contract. Mirrors callback_method. nil when
+      # not configured.
+      def guardrail_callable
+        return nil unless guardrail_class.present? && guardrail_method_name.present?
+
+        klass = guardrail_class.constantize
+        ->(output) { klass.new.send(guardrail_method_name, output) }
+      end
+
+      # Symbolizes each attachment hash so { "type" => "image", "url" => ... }
+      # becomes { type: :image, url: ... } as the core Multimodal builder expects.
+      def normalized_attachments
+        attachments.map do |att|
+          att.symbolize_keys.tap { |h| h[:type] = h[:type].to_sym if h[:type] }
+        end
+      end
     end
   end
 end

data/app/views/rcrewai/rails/crews/edit.html.erb

@@ -34,7 +34,8 @@
       <%= form.select :process_type, 
           options_for_select([
             ['Sequential', 'sequential'],
-            ['Hierarchical', 'hierarchical']
+            ['Hierarchical', 'hierarchical'],
+            ['Consensual', 'consensual']
           ], @crew.process_type), 
           { prompt: 'Select process type' }, 
           { class: "form-select" } %>
@@ -46,12 +47,6 @@
       <span class="form-help">Enable verbose logging</span>
     </div>
 
-    <div class="form-group">
-      <%= form.label :memory_enabled, class: "form-label" %>
-      <%= form.check_box :memory_enabled, class: "form-checkbox" %>
-      <span class="form-help">Enable memory for agents</span>
-    </div>
-
     <div class="form-group">
       <%= form.label :cache_enabled, class: "form-label" %>
       <%= form.check_box :cache_enabled, class: "form-checkbox" %>

data/app/views/rcrewai/rails/crews/new.html.erb

@@ -31,7 +31,8 @@
       <%= form.select :process_type, 
           options_for_select([
             ['Sequential', 'sequential'],
-            ['Hierarchical', 'hierarchical']
+            ['Hierarchical', 'hierarchical'],
+            ['Consensual', 'consensual']
           ], @crew.process_type), 
           { prompt: 'Select process type' }, 
           { class: "form-select" } %>
@@ -43,12 +44,6 @@
       <span class="form-help">Enable verbose logging</span>
     </div>
 
-    <div class="form-group">
-      <%= form.label :memory_enabled, class: "form-label" %>
-      <%= form.check_box :memory_enabled, class: "form-checkbox" %>
-      <span class="form-help">Enable memory for agents</span>
-    </div>
-
     <div class="form-group">
       <%= form.label :cache_enabled, class: "form-label" %>
       <%= form.check_box :cache_enabled, class: "form-checkbox" %>

data/app/views/rcrewai/rails/crews/show.html.erb

@@ -14,9 +14,6 @@
     <div class="meta-item">
       <strong>Process Type:</strong> <%= @crew.process_type %>
     </div>
-    <div class="meta-item">
-      <strong>Memory:</strong> <%= @crew.memory_enabled ? "Enabled" : "Disabled" %>
-    </div>
     <div class="meta-item">
       <strong>Cache:</strong> <%= @crew.cache_enabled ? "Enabled" : "Disabled" %>
     </div>

data/db/migrate/002_add_config_to_rcrewai_agents.rb

@@ -0,0 +1,9 @@
+class AddConfigToRcrewaiAgents < ActiveRecord::Migration[7.0]
+  def change
+    # max_rpm and llm_config already exist on rcrewai_agents from the
+    # original create table; only the 0.5.0 additions are new.
+    add_column :rcrewai_agents, :reasoning, :boolean, default: false, null: false
+    add_column :rcrewai_agents, :max_reasoning_attempts, :integer, default: 3
+    add_column :rcrewai_agents, :respect_context_window, :boolean, default: false, null: false
+  end
+end

data/db/migrate/003_add_output_processing_to_rcrewai_tasks.rb

@@ -0,0 +1,13 @@
+class AddOutputProcessingToRcrewaiTasks < ActiveRecord::Migration[7.0]
+  def change
+    # output_file already exists on rcrewai_tasks from the original create
+    # table; only the new 0.4/0.5 output-processing options are added here.
+    add_column :rcrewai_tasks, :output_schema, :text
+    add_column :rcrewai_tasks, :guardrail_class, :string
+    add_column :rcrewai_tasks, :guardrail_method_name, :string
+    add_column :rcrewai_tasks, :guardrail_max_retries, :integer, default: 3
+    add_column :rcrewai_tasks, :create_directory, :boolean, default: true
+    add_column :rcrewai_tasks, :markdown, :boolean, default: false
+    add_column :rcrewai_tasks, :attachments, :text
+  end
+end

data/db/migrate/004_add_lifecycle_to_rcrewai_crews.rb

@@ -0,0 +1,10 @@
+class AddLifecycleToRcrewaiCrews < ActiveRecord::Migration[7.0]
+  def change
+    add_column :rcrewai_crews, :planning, :boolean, default: false, null: false
+    add_column :rcrewai_crews, :planning_llm, :string
+    add_column :rcrewai_crews, :before_kickoff_class, :string
+    add_column :rcrewai_crews, :before_kickoff_method, :string
+    add_column :rcrewai_crews, :after_kickoff_class, :string
+    add_column :rcrewai_crews, :after_kickoff_method, :string
+  end
+end

data/db/migrate/005_add_batch_id_to_rcrewai_executions.rb

@@ -0,0 +1,6 @@
+class AddBatchIdToRcrewaiExecutions < ActiveRecord::Migration[7.0]
+  def change
+    add_column :rcrewai_executions, :batch_id, :string
+    add_index :rcrewai_executions, :batch_id
+  end
+end

data/db/migrate/006_create_rcrewai_knowledge_sources.rb

@@ -0,0 +1,11 @@
+class CreateRcrewaiKnowledgeSources < ActiveRecord::Migration[7.0]
+  def change
+    create_table :rcrewai_knowledge_sources do |t|
+      t.references :owner, polymorphic: true, null: false
+      t.string :source_type, null: false
+      t.text :value, null: false
+      t.boolean :active, default: true, null: false
+      t.timestamps
+    end
+  end
+end

data/db/migrate/007_create_rcrewai_flows.rb

@@ -0,0 +1,24 @@
+class CreateRcrewaiFlows < ActiveRecord::Migration[7.0]
+  def change
+    create_table :rcrewai_flow_states do |t|
+      t.string :state_id, null: false
+      t.text :data, null: false
+      t.timestamps
+    end
+    add_index :rcrewai_flow_states, :state_id, unique: true
+
+    create_table :rcrewai_flow_runs do |t|
+      t.string :flow_class, null: false
+      t.string :state_id
+      t.string :status, null: false
+      t.text :inputs
+      t.text :result
+      t.string :error_message
+      t.datetime :started_at
+      t.datetime :completed_at
+      t.timestamps
+    end
+    add_index :rcrewai_flow_runs, :status
+    add_index :rcrewai_flow_runs, :state_id
+  end
+end

data/db/migrate/008_add_consensus_agents_to_rcrewai_crews.rb

@@ -0,0 +1,5 @@
+class AddConsensusAgentsToRcrewaiCrews < ActiveRecord::Migration[7.0]
+  def change
+    add_column :rcrewai_crews, :consensus_agents, :integer
+  end
+end

data/db/migrate/009_add_memory_config_to_agents_and_clean_crews.rb

@@ -0,0 +1,10 @@
+class AddMemoryConfigToAgentsAndCleanCrews < ActiveRecord::Migration[7.0]
+  def change
+    add_column :rcrewai_agents, :memory_scope, :string
+    add_column :rcrewai_agents, :memory_short_term_limit, :integer
+
+    # Core memory is agent-level; these crew columns were never used.
+    remove_column :rcrewai_crews, :memory_enabled, :boolean, default: false
+    remove_column :rcrewai_crews, :memory, :text
+  end
+end

data/lib/generators/rcrewai/rails/crew/templates/crew.rb.erb

@@ -7,7 +7,6 @@ class <%= class_name %>Crew
       description: "<%= crew_description %>",
       process_type: "<%= process_type %>",
       verbose: true,
-      memory_enabled: false,
       cache_enabled: true
     )
 

data/lib/generators/rcrewai/rails/install/templates/create_rcrewai_tables.rb

@@ -5,12 +5,17 @@ class CreateRcrewaiTables < ActiveRecord::Migration[7.0]
       t.text :description
       t.string :process_type, default: "sequential"
       t.boolean :verbose, default: false
-      t.boolean :memory_enabled, default: false
       t.boolean :cache_enabled, default: false
       t.integer :max_rpm
       t.string :manager_llm
+      t.integer :consensus_agents
+      t.boolean :planning, default: false, null: false
+      t.string :planning_llm
+      t.string :before_kickoff_class
+      t.string :before_kickoff_method
+      t.string :after_kickoff_class
+      t.string :after_kickoff_method
       t.text :config
-      t.text :memory
       t.boolean :active, default: true
 
       t.timestamps
@@ -26,11 +31,16 @@ class CreateRcrewaiTables < ActiveRecord::Migration[7.0]
       t.text :goal
       t.text :backstory
       t.boolean :memory_enabled, default: false
+      t.string :memory_scope
+      t.integer :memory_short_term_limit
       t.boolean :verbose, default: false
       t.boolean :allow_delegation, default: false
       t.text :tools
       t.integer :max_iterations, default: 25
       t.integer :max_rpm
+      t.boolean :reasoning, default: false, null: false
+      t.integer :max_reasoning_attempts, default: 3
+      t.boolean :respect_context_window, default: false, null: false
       t.text :llm_config
       t.boolean :active, default: true
 
@@ -48,6 +58,13 @@ class CreateRcrewaiTables < ActiveRecord::Migration[7.0]
       t.text :output_json
       t.text :output_pydantic
       t.string :output_file
+      t.text :output_schema
+      t.string :guardrail_class
+      t.string :guardrail_method_name
+      t.integer :guardrail_max_retries, default: 3
+      t.boolean :create_directory, default: true
+      t.boolean :markdown, default: false
+      t.text :attachments
       t.text :tools
       t.string :callback_class
       t.string :callback_method_name
@@ -86,12 +103,14 @@ class CreateRcrewaiTables < ActiveRecord::Migration[7.0]
       t.datetime :started_at
       t.datetime :completed_at
       t.integer :duration_seconds
+      t.string :batch_id
 
       t.timestamps
     end
 
     add_index :rcrewai_executions, :status
     add_index :rcrewai_executions, :created_at
+    add_index :rcrewai_executions, :batch_id
 
     create_table :rcrewai_execution_logs do |t|
       t.references :execution, null: false, foreign_key: { to_table: :rcrewai_executions }
@@ -105,5 +124,37 @@ class CreateRcrewaiTables < ActiveRecord::Migration[7.0]
 
     add_index :rcrewai_execution_logs, :level
     add_index :rcrewai_execution_logs, :timestamp
+
+    create_table :rcrewai_knowledge_sources do |t|
+      t.references :owner, polymorphic: true, null: false
+      t.string :source_type, null: false
+      t.text :value, null: false
+      t.boolean :active, default: true, null: false
+
+      t.timestamps
+    end
+
+    create_table :rcrewai_flow_states do |t|
+      t.string :state_id, null: false
+      t.text :data, null: false
+
+      t.timestamps
+    end
+    add_index :rcrewai_flow_states, :state_id, unique: true
+
+    create_table :rcrewai_flow_runs do |t|
+      t.string :flow_class, null: false
+      t.string :state_id
+      t.string :status, null: false
+      t.text :inputs
+      t.text :result
+      t.string :error_message
+      t.datetime :started_at
+      t.datetime :completed_at
+
+      t.timestamps
+    end
+    add_index :rcrewai_flow_runs, :status
+    add_index :rcrewai_flow_runs, :state_id
   end
 end

data/lib/rcrewai/rails/configuration.rb

@@ -3,7 +3,8 @@ module RcrewAI
     class Configuration
       attr_accessor :job_queue_name, :enable_web_ui, :persistence_backend,
                     :default_llm_provider, :default_llm_model, :max_retries,
-                    :timeout, :enable_logging, :log_level, :async_execution
+                    :timeout, :enable_logging, :log_level, :async_execution,
+                    :default_memory_embedder, :default_memory_store
 
       def initialize
         @job_queue_name = "default"
@@ -16,6 +17,8 @@ module RcrewAI
         @enable_logging = true
         @log_level = :info
         @async_execution = true # Use ActiveJob for async by default
+        @default_memory_embedder = nil
+        @default_memory_store = nil
       end
     end
   end

data/lib/rcrewai/rails/crew_builder.rb

@@ -26,11 +26,6 @@ module RcrewAI
           @process_type || :sequential
         end
 
-        def memory_enabled(enabled = nil)
-          @memory_enabled = enabled unless enabled.nil?
-          @memory_enabled || false
-        end
-
         def cache_enabled(enabled = nil)
           @cache_enabled = enabled unless enabled.nil?
           @cache_enabled || true
@@ -66,7 +61,6 @@ module RcrewAI
         RcrewAI::Rails::Crew.find_or_create_by(name: self.class.crew_name) do |crew|
           crew.description = self.class.crew_description
           crew.process_type = self.class.process_type.to_s
-          crew.memory_enabled = self.class.memory_enabled
           crew.cache_enabled = self.class.cache_enabled
           crew.verbose = verbose?
         end

data/lib/rcrewai/rails/version.rb

@@ -1,6 +1,6 @@
 module RcrewAI
   module Rails
-    VERSION = "0.3.1"
+    VERSION = "0.6.0"
     Version = VERSION
   end
 end

data/rcrewai-rails.gemspec

@@ -28,7 +28,7 @@ Gem::Specification.new do |spec|
 
   spec.metadata["homepage_uri"] = spec.homepage
   spec.metadata["source_code_uri"] = spec.homepage
-  spec.metadata["changelog_uri"] = "#{spec.homepage}/blob/main/CHANGELOG.md"
+  spec.metadata["changelog_uri"] = "#{spec.homepage}/blob/master/CHANGELOG.md"
   spec.metadata["documentation_uri"] = "https://gkosmo.github.io/rcrewai-rails/"
   spec.metadata["bug_tracker_uri"] = "#{spec.homepage}/issues"
   spec.metadata["wiki_uri"] = "#{spec.homepage}/wiki"
@@ -37,7 +37,7 @@ Gem::Specification.new do |spec|
   spec.files = Dir.chdir(__dir__) do
     `git ls-files -z`.split("\x0").reject do |f|
       (File.expand_path(f) == __FILE__) ||
-        f.start_with?(*%w[bin/ test/ spec/ features/ .git .github appveyor Gemfile])
+        f.start_with?(*%w[bin/ test/ spec/ features/ docs/superpowers/ .git .github appveyor Gemfile])
     end
   end
   spec.bindir = "exe"
@@ -45,7 +45,7 @@ Gem::Specification.new do |spec|
   spec.require_paths = ["lib"]
 
   # Core dependency
-  spec.add_dependency "rcrewai", "~> 0.3"
+  spec.add_dependency "rcrewai", "~> 0.7"
   
   # Rails dependencies
   spec.add_dependency "rails", ">= 7.0.0"

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: rcrewai-rails
 version: !ruby/object:Gem::Version
-  version: 0.3.1
+  version: 0.6.0
 platform: ruby
 authors:
 - gkosmo
@@ -15,14 +15,14 @@ dependencies:
     requirements:
     - - "~>"
       - !ruby/object:Gem::Version
-        version: '0.3'
+        version: '0.7'
   type: :runtime
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
     - - "~>"
       - !ruby/object:Gem::Version
-        version: '0.3'
+        version: '0.7'
 - !ruby/object:Gem::Dependency
   name: rails
   requirement: !ruby/object:Gem::Requirement
@@ -195,6 +195,7 @@ extensions: []
 extra_rdoc_files: []
 files:
 - ".tool-versions"
+- CHANGELOG.md
 - MIT-LICENSE
 - README.md
 - Rakefile
@@ -208,11 +209,15 @@ files:
 - app/controllers/rcrewai/rails/tools_controller.rb
 - app/jobs/rcrewai/rails/crew_execution_job.rb
 - app/jobs/rcrewai/rails/task_execution_job.rb
+- app/models/rcrewai/rails/active_record_state_store.rb
 - app/models/rcrewai/rails/agent.rb
 - app/models/rcrewai/rails/application_record.rb
 - app/models/rcrewai/rails/crew.rb
 - app/models/rcrewai/rails/execution.rb
 - app/models/rcrewai/rails/execution_log.rb
+- app/models/rcrewai/rails/flow_run.rb
+- app/models/rcrewai/rails/flow_state.rb
+- app/models/rcrewai/rails/knowledge_source.rb
 - app/models/rcrewai/rails/task.rb
 - app/models/rcrewai/rails/task_assignment.rb
 - app/models/rcrewai/rails/task_dependency.rb
@@ -238,8 +243,15 @@ files:
 - app/views/rcrewai/rails/tools/show.html.erb
 - config/routes.rb
 - db/migrate/001_add_agent_to_tasks.rb
+- db/migrate/002_add_config_to_rcrewai_agents.rb
+- db/migrate/003_add_output_processing_to_rcrewai_tasks.rb
+- db/migrate/004_add_lifecycle_to_rcrewai_crews.rb
+- db/migrate/005_add_batch_id_to_rcrewai_executions.rb
+- db/migrate/006_create_rcrewai_knowledge_sources.rb
+- db/migrate/007_create_rcrewai_flows.rb
+- db/migrate/008_add_consensus_agents_to_rcrewai_crews.rb
+- db/migrate/009_add_memory_config_to_agents_and_clean_crews.rb
 - docs/index.html
-- docs/superpowers/specs/2026-06-16-github-pages-landing-design.md
 - lib/generators/rcrewai/rails/crew/crew_generator.rb
 - lib/generators/rcrewai/rails/crew/templates/agent.rb.erb
 - lib/generators/rcrewai/rails/crew/templates/crew.rb.erb
@@ -265,7 +277,7 @@ licenses:
 metadata:
   homepage_uri: https://github.com/gkosmo/rcrewai-rails
   source_code_uri: https://github.com/gkosmo/rcrewai-rails
-  changelog_uri: https://github.com/gkosmo/rcrewai-rails/blob/main/CHANGELOG.md
+  changelog_uri: https://github.com/gkosmo/rcrewai-rails/blob/master/CHANGELOG.md
   documentation_uri: https://gkosmo.github.io/rcrewai-rails/
   bug_tracker_uri: https://github.com/gkosmo/rcrewai-rails/issues
   wiki_uri: https://github.com/gkosmo/rcrewai-rails/wiki

data/docs/superpowers/specs/2026-06-16-github-pages-landing-design.md

@@ -1,61 +0,0 @@
-# GitHub Pages Landing Site for `rcrewai-rails`
-
-**Date:** 2026-06-16
-**Status:** Approved
-
-## Goal
-
-Publish a polished landing + documentation page for the `rcrewai-rails` gem,
-served via GitHub Pages from the `/docs` folder on `master`. The page gives a
-strong first impression and doubles as practical usage documentation.
-
-## Constraints
-
-- **Single self-contained file:** `docs/index.html`. No build step, no
-  framework, no JavaScript dependencies, no external network requests.
-- **Styling:** Inline `<style>` in the document. Clean light / Rails-y look —
-  off-white background, crimson Rails-style accent, system sans-serif for prose,
-  monospace for code. Code blocks styled with CSS only (dark block, monospace,
-  soft border) — no syntax-token coloring.
-- **Content accuracy:** All copy drawn from the existing `README.md` and
-  `rcrewai-rails.gemspec` so the page stays correct.
-
-## Hosting
-
-GitHub Pages configured to serve from the `master` branch `/docs` folder. The
-resulting URL is `https://gkosmo.github.io/rcrewai-rails/`. (Enabling Pages in
-the repo settings is a manual GitHub step the user performs; this spec only
-produces the file.)
-
-## Page Structure
-
-Single scrolling page with a sticky top navigation:
-
-1. **Sticky header** — gem name, tagline, anchor links (Features · Install ·
-   Usage · Tools · API), GitHub link.
-2. **Hero** — name, one-line pitch, `gem 'rcrewai-rails'` snippet, CTA buttons
-   (GitHub repo, RubyGems).
-3. **Features grid** — 6 cards: ActiveRecord persistence, ActiveJob integration,
-   Rails generators, Web dashboard, Multi-LLM support, Rails-specific tools.
-4. **Installation** — Gemfile, `bundle install`, install generator, `db:migrate`,
-   manual route mounting.
-5. **Configuration** — the initializer example from the README.
-6. **Usage** — generator command, programmatic crew example, async/sync execution.
-7. **Rails Tools** — tool ecosystem (ActiveRecord, ActionMailer, Cache,
-   ActiveStorage, Logger) with the `DataAnalystAgent` example.
-8. **Web UI & Models** — what `/rcrewai` provides + the ActiveRecord model list.
-9. **API endpoints** — the JSON API table.
-10. **Footer** — MIT license, links.
-
-## Additional Change
-
-Update `rcrewai-rails.gemspec`:
-`spec.metadata["documentation_uri"]` from
-`https://gkosmo.github.io/rcrewAI/` to
-`https://gkosmo.github.io/rcrewai-rails/`.
-
-## Out of Scope
-
-- Multi-page docs / Jekyll.
-- JavaScript-driven syntax highlighting.
-- Automated Pages deployment workflow (GitHub builds static `/docs` directly).