after_migrate 0.2.0 → 0.2.2

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: a13db746f7bfcbcb7367f028493efd2b464e564b32f09be5debb62da1326f8bf
-  data.tar.gz: b1f0db683bb9b12ed407f14f3f1b1c0baba0a80cfd445c6182b9bd5ad7378821
+  metadata.gz: 62f5a309584cee52788e0ea45c222648cc58c4db46bc08ce6188c6325f6c62dc
+  data.tar.gz: e36efca18e936086cdace33a4fe422c2d34f63502ddf01c53090cf8048ed92c6
 SHA512:
-  metadata.gz: '085b3be36d4031981294d5a5ddc929aae3d781c9d1c3d8446f4508f7c7c526064c8b6529b68237e3e3517885f22251b3db071839dae1bcdf8df654d1e79b2e70'
-  data.tar.gz: 212614cb1145bbe3f22d9b005e6524af133b5d50f659ca8da2efff0d6416efd7ff90fccf39575719d4237df08029a5dcab6b8ef8dfd5072027bce902bc2b3bd8
+  metadata.gz: 2590c965f71fc07b5171cea88869115516687331138b0a6a20b5c4bdd3008a13be1c7a7382dd8886112a02e076904d57f59e2f24db44bfa23d1c36dd30700b40
+  data.tar.gz: 4a2f1dd2df2bb18e8f663b1ca150db22a6d4d5474b651ea0ee693129640926266ce77168e370921cab4ac214620a601fe02f6204a97829575ec7e417c944a7d4

data/.gitignore

@@ -9,3 +9,6 @@
 
 # rspec failure tracking
 .rspec_status
+.idea/
+/Gemfile.lock
+.private/

data/.rubocop.yml

@@ -1,2 +1,14 @@
 AllCops:
   NewCops: enable
+  SuggestExtensions: false
+
+Style/Documentation:
+  Enabled: false
+
+Metrics/MethodLength:
+  Max: 20
+
+Metrics/BlockLength:
+  Exclude:
+    - 'after_migrate.gemspec'
+    - 'spec/**/*.rb'

data/CHANGELOG.md

@@ -2,6 +2,26 @@
 
 All notable changes to this project will be documented in this file.
 
+## [0.2.2] - 2026-05-31
+
+### Added
+- Configurable store backend via `config.store`, with `:memory` as the default and `:file` for persistence across separate migration task processes
+- `config.store_path` to control where the file-backed store writes collected table names
+- `config.run_id` to isolate persisted file-store data between independent migration runs
+- File-store locking and atomic writes to avoid corrupting persisted table data during concurrent access
+- Specs for file-store persistence, corrupt JSON handling, adapter dispatch, unsupported adapters, and deferred rake task behavior
+
+### Changed
+- `AfterMigrate.affected_tables`, `AfterMigrate.merge_tables`, and `AfterMigrate.reset!` now delegate through the configured store backend
+- Executor resets the store when maintenance is disabled or no tables are pending, but keeps collected tables when adapter optimization raises so a later run can retry
+
+## [0.2.1] - 2026-05-29
+
+### Changed
+- Refactored SQL identifier matching used by the parser without changing supported table-detection behavior
+- Split executor migration logging message construction into a local variable for clearer formatting and maintenance
+- Added RuboCop project configuration for documentation, method length, and spec block length rules
+
 ## [0.2.0] - 2026-04-28
 
 ### Added

data/CLAUDE.md

@@ -0,0 +1,74 @@
+# CLAUDE.md
+
+This file provides guidance to Claude Code (claude.ai/code) when working with code in this repository.
+
+## Commands
+
+```bash
+bundle install          # install dependencies
+bundle exec rspec       # run all tests
+bundle exec rspec spec/after_migrate_spec.rb  # run a single spec file
+bundle exec rake        # default task (runs spec)
+bundle exec rubocop     # lint
+bundle exec rubocop -a  # lint with auto-fix
+rake release            # build and push gem to RubyGems
+```
+
+## Architecture
+
+This is a Rails gem that automatically runs database maintenance (`ANALYZE`, `VACUUM`, `PRAGMA optimize`) after `db:migrate` tasks. The core flow is:
+
+1. **`Railtie`** (`lib/after_migrate/railtie.rb`) — the entry point. On Rails init, it subscribes to `sql.active_record` notifications so every SQL statement during a migration is intercepted. It enhances `db:migrate`, `db:migrate:up`, and `db:migrate:redo` to call `AfterMigrate.run!` when they complete — unless `defer: true` (the default), in which case the rake task only collects. It also registers the `after_migrate:run` task.
+
+2. **`Collector`** (`lib/after_migrate/collector.rb`) — receives every SQL notification, filters to DDL/DML statements (CREATE/ALTER/DROP/INSERT/UPDATE/DELETE), calls the adapter-specific parser, and accumulates table names into `AfterMigrate.affected_tables` (a `Concurrent::Map<schema, Concurrent::Set<table_name>>`).
+
+3. **`AfterMigrate.store`** (`lib/after_migrate/store.rb`) — defaults to an in-memory `Concurrent::Map` wrapped by `AfterMigrate::Stores::Memory`. `AfterMigrate.affected_tables`, `merge_tables`, and `reset!` delegate to the store. The memory store persists across multiple rake task invocations inside one Ruby process and is cleared by `AfterMigrate.run!` (or `AfterMigrate.reset!`). This replaces the old `Current` (`ActiveSupport::CurrentAttributes`) which was reset after every migration.
+
+4. **`Executor`** (`lib/after_migrate/executor.rb`) — iterates `AfterMigrate.affected_tables` and calls the correct adapter's `optimize_tables`. Respects the `analyze` config option (`only_affected_tables` / `all_tables` / `none`). Always calls `AfterMigrate.reset!` in its `ensure` block.
+
+5. **Adapters** (`lib/after_migrate/adapters/`) — one module per database:
+   - `Sql` — shared regex-based table parser (used by MySQL and SQLite, which can't use pg_query)
+   - `Postgresql` — uses `pg_query` gem for accurate SQL parsing; runs `VACUUM` (checking `pg_stat_all_tables` for dead tuples) then `ANALYZE VERBOSE` per table
+   - `Mysql` — runs `ANALYZE TABLE` per table; lists tables from `information_schema`
+   - `Sqlite` — runs `PRAGMA optimize` (SQLite ≥ 3.35.0) or `VACUUM; ANALYZE;`
+
+## Key design decisions
+
+- PostgreSQL uses `pg_query` (the actual Postgres parser) for table extraction, which avoids false positives from regex. MySQL and SQLite fall back to the shared `Sql` regex patterns.
+- `pg_query` is a hard runtime dependency (listed in gemspec), not optional — even though it's only used for PostgreSQL.
+- Table collection uses `Concurrent::Map` + `Concurrent::Set` (from `concurrent-ruby`) for thread-safe accumulation across parallel migration workers.
+- The gem does **not** monkey-patch ActiveRecord. It only uses public `ActiveSupport::Notifications` and `Rake::Task#enhance` APIs.
+- `defer: true` (the default) is the multi-tenant-friendly mode: rake tasks only collect, never execute. Call `AfterMigrate.run!` (or `rake after_migrate:run`) once after all tenant migrations complete.
+- The `app.executor.to_run` unsubscription in `Railtie` ensures the SQL subscription is dropped before the app starts serving web requests, so normal traffic is never collected.
+
+## Configuration
+
+Config values are in `AfterMigrate::Configuration` (initialized in `lib/after_migrate.rb`):
+
+| Option                | Default                  | Values                                             |
+|-----------------------|--------------------------|----------------------------------------------------|
+| `enabled`             | `true`                   | bool                                               |
+| `verbose`             | `true`                   | bool                                               |
+| `vacuum`              | `true`                   | bool (PostgreSQL only)                             |
+| `analyze`             | `"only_affected_tables"` | `"only_affected_tables"`, `"all_tables"`, `"none"` |
+| `rake_tasks_enhanced` | `true`                   | bool                                               |
+| `defer`               | `true`                   | bool — skip auto-run; call `AfterMigrate.run!` manually |
+
+## Multi-tenant usage
+
+```ruby
+# In your tenant migration runner:
+Tenant.each do |tenant|
+  tenant.switch { ActiveRecord::MigrationContext.new(...).migrate }
+end
+# Tables are now accumulated per schema in AfterMigrate.affected_tables
+AfterMigrate.run!           # or: Rake::Task['after_migrate:run'].invoke
+```
+
+Set `defer: false` to restore the v0.1 behaviour of running after each `db:migrate`.
+
+## Dependencies
+
+- Ruby ≥ 3.2, Rails ≥ 7.0
+- `pg_query ≥ 6.1` (required even for non-Postgres installs)
+- Dev: `rspec ~> 3.0`, `rubocop ~> 1.81`, `bundler ~> 4`

data/Gemfile

@@ -11,3 +11,4 @@ gem 'bundler', '~> 4'
 gem 'rake', '~> 13.0'
 gem 'rspec', '~> 3.0'
 gem 'rubocop', '~> 1.81'
+gem 'simplecov', group: 'test'

data/README.md

@@ -83,6 +83,30 @@ end
 ```
 ---
 
+## 🚢 Releasing
+
+Use the guarded helper to make sure git is pushed before RubyGems publish:
+
+```bash
+bin/release
+```
+
+What it does:
+- requires a clean git worktree
+- ensures you are on the default branch (`origin/HEAD` fallback)
+- checks branch sync status vs `origin`
+- runs `bundle exec rspec` and `bundle exec rubocop`
+- pushes the branch first
+- runs `bundle exec rake release` (build/tag/push/publish)
+
+Optional:
+
+```bash
+bin/release --skip-checks
+```
+
+---
+
 ## 🤝 Contributing
 
 Bug reports, feature requests, and pull requests are very welcome!

data/bin/release

@@ -0,0 +1,85 @@
+#!/usr/bin/env bash
+set -euo pipefail
+IFS=$'\n\t'
+
+root_dir=$(cd "$(dirname "$0")/.." && pwd)
+cd "$root_dir"
+
+if [[ "${1:-}" == "--help" || "${1:-}" == "-h" ]]; then
+  cat <<'USAGE'
+Usage: bin/release [--skip-checks]
+
+Runs guardrails before releasing:
+1. Requires a clean git worktree
+2. Requires current branch to match origin/HEAD (or local HEAD fallback)
+3. Requires branch to be in sync with origin
+4. Runs test + lint checks (unless --skip-checks)
+5. Pushes the branch, then runs `bundle exec rake release`
+USAGE
+  exit 0
+fi
+
+skip_checks=false
+if [[ "${1:-}" == "--skip-checks" ]]; then
+  skip_checks=true
+elif [[ $# -gt 0 ]]; then
+  echo "Unknown option: $1" >&2
+  exit 1
+fi
+
+if [[ -n "$(git status --porcelain)" ]]; then
+  echo "Working tree is not clean. Commit or stash changes before releasing." >&2
+  exit 1
+fi
+
+current_branch=$(git rev-parse --abbrev-ref HEAD)
+default_branch=$(git symbolic-ref --quiet --short refs/remotes/origin/HEAD 2>/dev/null | sed 's|^origin/||')
+default_branch=${default_branch:-$current_branch}
+
+if [[ "$current_branch" != "$default_branch" ]]; then
+  echo "Release must run from '$default_branch' (current: '$current_branch')." >&2
+  exit 1
+fi
+
+echo "Fetching latest refs from origin..."
+git fetch origin
+
+local_sha=$(git rev-parse @)
+remote_sha=$(git rev-parse "origin/$default_branch")
+base_sha=$(git merge-base @ "origin/$default_branch")
+
+if [[ "$local_sha" == "$remote_sha" ]]; then
+  echo "Branch is in sync with origin/$default_branch."
+elif [[ "$local_sha" == "$base_sha" ]]; then
+  echo "Local branch is behind origin/$default_branch. Pull/rebase first." >&2
+  exit 1
+elif [[ "$remote_sha" == "$base_sha" ]]; then
+  echo "Local branch is ahead of origin/$default_branch and will be pushed."
+else
+  echo "Local and origin/$default_branch have diverged. Rebase/merge first." >&2
+  exit 1
+fi
+
+version=$(ruby -e 'require_relative "lib/after_migrate/version"; puts AfterMigrate::VERSION')
+tag="v$version"
+
+if git rev-parse "$tag" >/dev/null 2>&1 || git ls-remote --tags origin "$tag" | grep -q "$tag"; then
+  echo "Tag '$tag' already exists locally or on origin. Bump version first." >&2
+  exit 1
+fi
+
+if [[ "$skip_checks" == "false" ]]; then
+  echo "Running specs..."
+  bundle exec rspec
+
+  echo "Running RuboCop..."
+  bundle exec rubocop
+fi
+
+echo "Pushing branch '$default_branch' first..."
+git push origin "$default_branch"
+
+echo "Releasing gem with rake task..."
+bundle exec rake release
+
+echo "Release complete: $tag"

data/lib/after_migrate/adapters/postgresql.rb

@@ -9,7 +9,8 @@ module AfterMigrate
     module_function
 
     def vacuum(table_name, schema: nil, verbose: true)
-      table = ActiveRecord::Base.connection.quote_table_name("#{schema}.#{table_name}")
+      qualified = schema.present? ? "#{schema}.#{table_name}" : table_name
+      table = ActiveRecord::Base.connection.quote_table_name(qualified)
       query = <<~SQL.squish
         VACUUM (#{'VERBOSE, ' if verbose}ANALYZE, INDEX_CLEANUP ON) #{table};
       SQL
@@ -41,10 +42,11 @@ module AfterMigrate
       ActiveRecord::Base.connection.execute(query)
     end
 
-    def run_vacuum(schema:)
+    def run_vacuum(schema:, table_names: nil)
       tables_with_dead_tuples = dead_tuples(schema:).pluck('relname')
+      tables_with_dead_tuples &= Array(table_names) if table_names
       AfterMigrate.log("Vacuuming #{tables_with_dead_tuples.size} tables in schema #{schema}...")
-      tables_with_dead_tuples.each { |t| vacuum(t) }
+      tables_with_dead_tuples.each { |t| vacuum(t, schema:, verbose: AfterMigrate.configuration.verbose) }
       tables_with_dead_tuples
     end
 
@@ -63,7 +65,9 @@ module AfterMigrate
 
     def optimize_tables(table_names:, schema:, **)
       cleaned_tables = []
-      cleaned_tables = run_vacuum(schema:) if AfterMigrate.configuration.vacuum
+      cleaned_tables = run_vacuum(schema:, table_names:) if AfterMigrate.configuration.vacuum
+
+      return if AfterMigrate.configuration.analyze == 'none'
 
       tables = table_names - cleaned_tables
       run_analyze(schema:, tables:)

data/lib/after_migrate/adapters/sql.rb

@@ -3,8 +3,8 @@
 module AfterMigrate
   module Sql
     IDENT = /
-      (?:"[\w]+"|\w+)
-      (?:\.(?:"[\w]+"|\w+))*
+      (?:"\w+"|\w+)
+      (?:\.(?:"\w+"|\w+))*
     /x
 
     PATTERNS = {

data/lib/after_migrate/executor.rb

@@ -12,27 +12,39 @@ module AfterMigrate
     module_function
 
     def call(schema: nil)
+      return reset_store unless maintenance_enabled?
+
       tables = target_tables
-      return if tables.blank?
+      return reset_store if tables.blank?
 
-      if schema.present?
-        run_optimize(schema:, tables: tables[schema]) if tables[schema].present?
-      else
-        tables.each { |s, t| run_optimize(schema: s, tables: t) }
-      end
-    ensure
-      AfterMigrate.reset!
+      run_optimizations(schema:, tables:)
+      reset_store
     end
 
     public :call
 
     private
 
+    def maintenance_enabled?
+      AfterMigrate.configuration.vacuum || AfterMigrate.configuration.analyze != 'none'
+    end
+
+    def reset_store
+      AfterMigrate.reset!
+    end
+
+    def run_optimizations(schema:, tables:)
+      return run_optimize(schema:, tables: tables[schema]) if schema.present? && tables[schema].present?
+
+      tables.each { |s, t| run_optimize(schema: s, tables: t) } unless schema.present?
+    end
+
     def run_optimize(schema:, tables:)
       table_names = tables.to_a.sort
       return if table_names.empty?
 
-      AfterMigrate.log("Migration touched #{table_names.size} table(s) in schema #{schema.inspect}: #{table_names.join(', ')}")
+      message = "Migration touched #{table_names.size} table(s) in schema #{schema.inspect}: #{table_names.join(', ')}"
+      AfterMigrate.log(message)
       optimize_tables(schema:, table_names:)
     end
 
@@ -56,10 +68,9 @@ module AfterMigrate
         AfterMigrate.affected_tables.keys.each_with_object({}) do |schema, hash|
           hash[schema] = all_tables(schema:)
         end
-      when 'only_affected_tables'
-        AfterMigrate.affected_tables
       else
-        {}
+        # 'only_affected_tables' or 'none' — vacuum still needs the affected list
+        AfterMigrate.affected_tables
       end
     end
 

data/lib/after_migrate/store.rb

@@ -0,0 +1,104 @@
+# frozen_string_literal: true
+
+require 'fileutils'
+require 'json'
+
+module AfterMigrate
+  module Stores
+    class Memory
+      attr_reader :affected_tables
+
+      def initialize
+        @affected_tables = Concurrent::Map.new
+      end
+
+      def merge_tables(schema, table_names)
+        return if table_names.blank?
+
+        set = affected_tables.compute_if_absent(schema) { Concurrent::Set.new }
+        set.merge(table_names)
+      end
+
+      def reset!
+        @affected_tables = Concurrent::Map.new
+      end
+    end
+
+    class FileStore < Memory
+      attr_reader :path, :run_id
+
+      def initialize(path:, run_id: nil)
+        super()
+        @path = path.to_s
+        @run_id = run_id.to_s.presence
+      end
+
+      def affected_tables
+        load_into_memory
+        super
+      end
+
+      def merge_tables(schema, table_names)
+        return if table_names.blank?
+
+        with_lock do
+          merge_into_memory(read_schemas)
+          merge_into_memory(schema => table_names)
+          write_schemas(memory_to_hash)
+        end
+      end
+
+      def reset!
+        super
+        with_lock { ::FileUtils.rm_f(path) }
+      end
+
+      private
+
+      def load_into_memory
+        with_lock { merge_into_memory(read_schemas) }
+      end
+
+      def merge_into_memory(schemas)
+        schemas.each do |schema, table_names|
+          set = @affected_tables.compute_if_absent(schema) { Concurrent::Set.new }
+          set.merge(table_names)
+        end
+      end
+
+      def read_schemas
+        return {} unless ::File.exist?(path)
+
+        payload = JSON.parse(::File.read(path))
+        return {} if run_id && payload['run_id'].to_s != run_id
+
+        payload.fetch('schemas', {})
+      rescue JSON::ParserError
+        {}
+      end
+
+      def write_schemas(schemas)
+        ::FileUtils.mkdir_p(::File.dirname(path))
+        temp_path = "#{path}.#{$PROCESS_ID}.tmp"
+        ::File.write(temp_path, JSON.pretty_generate({ run_id:, schemas: }))
+        ::File.rename(temp_path, path)
+      ensure
+        ::FileUtils.rm_f(temp_path) if temp_path && ::File.exist?(temp_path)
+      end
+
+      def memory_to_hash
+        @affected_tables.keys.sort.each_with_object({}) do |schema, hash|
+          hash[schema] = @affected_tables[schema].to_a.sort
+        end.sort.to_h
+      end
+
+      def with_lock
+        ::FileUtils.mkdir_p(::File.dirname(path))
+        ::File.open("#{path}.lock", ::File::RDWR | ::File::CREAT, 0o644) do |file|
+          file.flock(::File::LOCK_EX)
+          yield
+        end
+      end
+    end
+  end
+end

data/lib/after_migrate/version.rb

@@ -1,5 +1,5 @@
 # frozen_string_literal: true
 
 module AfterMigrate
-  VERSION = '0.2.0'
+  VERSION = '0.2.2'
 end

data/lib/after_migrate.rb

@@ -1,13 +1,14 @@
 # frozen_string_literal: true
 
 require 'after_migrate/version'
+require 'after_migrate/store'
 require 'after_migrate/collector'
 require 'after_migrate/executor'
 require 'after_migrate/railtie'
 
 module AfterMigrate
   class Configuration
-    attr_accessor :enabled, :verbose, :vacuum, :analyze, :rake_tasks_enhanced, :defer
+    attr_accessor :enabled, :verbose, :vacuum, :analyze, :rake_tasks_enhanced, :defer, :store, :store_path, :run_id
 
     def initialize
       @enabled = true
@@ -16,6 +17,9 @@ module AfterMigrate
       @analyze = 'only_affected_tables'
       @rake_tasks_enhanced = true
       @defer = true
+      @store = :memory
+      @store_path = 'tmp/after_migrate/affected_tables.json'
+      @run_id = nil
     end
   end
 
@@ -34,14 +38,11 @@ module AfterMigrate
 
     # Persistent cross-migration store: schema_name => Concurrent::Set<table_name>
     def affected_tables
-      @affected_tables ||= Concurrent::Map.new
+      store.affected_tables
     end
 
     def merge_tables(schema, table_names)
-      return if table_names.blank?
-
-      set = affected_tables.compute_if_absent(schema) { Concurrent::Set.new }
-      set.merge(table_names)
+      store.merge_tables(schema, table_names)
     end
 
     # Trigger database maintenance on all collected tables, then clear the store.
@@ -53,7 +54,25 @@ module AfterMigrate
     end
 
     def reset!
-      @affected_tables = nil
+      store.reset!
+    end
+
+    def store
+      key = [configuration.store.to_s, configuration.store_path.to_s, configuration.run_id.to_s]
+      @store = nil if @store_key != key
+      @store_key = key
+      @store ||= build_store
+    end
+
+    private
+
+    def build_store
+      case configuration.store.to_s
+      when 'file'
+        Stores::FileStore.new(path: configuration.store_path, run_id: configuration.run_id)
+      else
+        Stores::Memory.new
+      end
     end
   end
 end

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: after_migrate
 version: !ruby/object:Gem::Version
-  version: 0.2.0
+  version: 0.2.2
 platform: ruby
 authors:
 - Nikolay Moskvin
@@ -53,11 +53,13 @@ files:
 - ".ruby-version"
 - ".travis.yml"
 - CHANGELOG.md
+- CLAUDE.md
 - Gemfile
 - README.md
 - Rakefile
 - after_migrate.gemspec
 - bin/console
+- bin/release
 - bin/setup
 - lib/after_migrate.rb
 - lib/after_migrate/adapters/mysql.rb
@@ -67,6 +69,7 @@ files:
 - lib/after_migrate/collector.rb
 - lib/after_migrate/executor.rb
 - lib/after_migrate/railtie.rb
+- lib/after_migrate/store.rb
 - lib/after_migrate/version.rb
 - logo.png
 homepage: https://github.com/moskvin/after_migrate