percona_migrator 1.0.0 → 1.1.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA1:
-  metadata.gz: 686c3a5b5ab858a587451fba1c6aa0b934f1cf9c
-  data.tar.gz: d01ece64414481d9b43a143a16f748ce134afc7a
+  metadata.gz: df19cbdeb9b3e36074ff5e95ec745afafb5db5f6
+  data.tar.gz: df627f8393513e5699c63d37c84e46237596aea4
 SHA512:
-  metadata.gz: 104039977e6a970cad93bcb93e7ff628a2a00c0a10715543daaf9915fca08a1bf6e1643dc2e2e34e947f494f43abc9662c62a0a3e53ae9c98a0500abf9a9576e
-  data.tar.gz: f7e205f53c0cfd327dd293d0357b8e1e85b64ddf0a7a2cca14679a22607e3d5c8d1731757cb0ed1a25d83c38f31795fe23a74fc9cfd82af5cad1f42e67ce4e84
+  metadata.gz: 6a37c51ca128523a8ab16f9271a76e0612355ccba8e9406557634ccaf77d4e62db25fa29ccc9edf0fc5e7ebf952a6bb7074e870f7fa545c5714b5235212e6d51
+  data.tar.gz: 80a4e55d6136515ee6f742b9053a7dca9d1e11570bdc29d1f1b662e135f210bb88e54d6a09dceb9b3b88d4fee4056464e527dce22dadf6fd10d665b6d698586c

data/.travis.yml

@@ -7,7 +7,7 @@ before_install:
   - sudo apt-get update -qq
   - sudo apt-get install percona-toolkit
   - gem update bundler
-  - bin/setup
+install: bin/setup
 after_success:
   - codeclimate-test-reporter
 

data/CHANGELOG.md

@@ -5,6 +5,22 @@ This project adheres to [Semantic Versioning](http://semver.org/).
 Please follow the format in [Keep a Changelog](http://keepachangelog.com/)
 
 ## [Unreleased]
+## [1.1.0] - 2017-04-07
+
+### Added
+
+- Allow passing any `pt-online-schema-change`'s arguments through the
+   `PERCONA_ARGS` env var when executing a migration with `rake db:migrate:up`
+   or `db:migrate:down`.
+- Allow setting global percona arguments via gem configuration
+- Filter MySQL's password from logs
+
+### Changed
+
+- Enable default pt-online-schema-change replicas discovering mechanism.
+    So far, this was purposely set to `none`. To keep this same behaviour
+    provide the `PERCONA_ARGS=--recursion-method=none` env var when running the
+    migration.
 
 ## [1.0.0] - 2016-11-30
 

data/README.md

@@ -1,6 +1,6 @@
-# Percona Migrator [![Build Status](https://travis-ci.org/redbooth/percona_migrator.svg?branch=master)](https://travis-ci.org/redbooth/percona_migrator) [![Code Climate](https://codeclimate.com/github/redbooth/percona_migrator/badges/gpa.svg)](https://codeclimate.com/github/redbooth/percona_migrator)
+# Departure [![Build Status](https://travis-ci.org/redbooth/departure.svg?branch=master)](https://travis-ci.org/redbooth/percona_migrator) [![Code Climate](https://codeclimate.com/github/redbooth/percona_migrator/badges/gpa.svg)](https://codeclimate.com/github/redbooth/percona_migrator)
 
-Percona Migrator is an **ActiveRecord connection adapter** that allows running
+Departure is an **ActiveRecord connection adapter** that allows running
 **MySQL online and non-blocking DDL** through `ActiveRecord::Migration` without needing
     to use a different DSL other than Rails' migrations DSL.
 
@@ -9,15 +9,38 @@ It uses `pt-online-schema-change` command-line tool of
 Toolkit](https://www.percona.com/doc/percona-toolkit/2.0/pt-online-schema-change.html)
 which runs MySQL alter table statements without downtime.
 
+## Rename from "Percona Migrator"
+
+This project was formerly known as "Percona Migrator", but this incurs in an
+infringement of Percona's trade mark policy and thus has to be renamed. Said
+name is likely to cause confusion as to the source of the wrapper.
+
+The next major versions will use "Departure" as gem name.
+
 ## Installation
 
-Percona Migrator relies on `pt-online-schema-change` from [Percona
+Departure relies on `pt-online-schema-change` from [Percona
 Toolkit](https://www.percona.com/doc/percona-toolkit/2.0/pt-online-schema-change.html)
 
 ### Mac
 
 `brew install percona-toolkit`
 
+If when running a migration you see an error like:
+
+```
+PerconaMigrator::Error: Cannot connect to MySQL: Cannot connect to MySQL because
+the Perl DBI module is not installed or not found.
+```
+
+You also need to install the DBI and DBD::MySQL modules from `cpan`.
+
+```
+$ sudo cpan
+cpan> install DBI
+cpan> install DBD::mysql
+```
+
 ### Linux
 
 #### Ubuntu/Debian based
@@ -59,10 +82,52 @@ All the `ALTER TABLE` statements will be executed with
 `pt-online-schema-change`, which will provide additional output to the
 migration.
 
+### pt-online-schema-change arguments
+
+#### with environment variable
+
+You can specify any `pt-online-schema-change` arguments when running the
+migration. All what you pass in the PERCONA_ARGS env var, will be bypassed to the
+binary, overwriting any default values. Note the format is the same as in
+`pt-online-schema-change`. Check the full list in [Percona Toolkit
+documentation](https://www.percona.com/doc/percona-toolkit/2.2/pt-online-schema-change.html#options)
+
+```ruby
+$ PERCONA_ARGS='--chunk-time=1' bundle exec rake db:migrate:up VERSION=xxx
+```
+
+or even mulitple arguments
+
+```ruby
+$ PERCONA_ARGS='--chunk-time=1 --critical-load=55' bundle exec rake db:migrate:up VERSION=xxx
+```
+
+This however, only works for `db:migrate:up` or `db:migrate:down` rake tasks and
+not with `db:migrate`. The settings you provide can't be generalized as these
+vary depending on the database table and the kind of changes you apply.
+
+#### with global configuration
+
+You can specify any `pt-online-schema-change` arguments in global gem configuration
+using `global_percona_args` option.
+
+```ruby
+PerconaMigrator.configure do |config|
+  config.global_percona_args = '--chunk-time=1 --critical-load=55'
+end
+```
+
+Unlike using `PERCONA_ARGS`, options provided with global configuration will be applied 
+every time sql command is executed via `pt-online-schema-change`.
+ 
+Arguments provided in global configuration can be overwritten with `PERCONA_ARGS` env variable. 
+
+We recommend using this option with caution and only when you understand the consequences.
+
 ### LHM support
 
 If you moved to Soundcloud's [Lhm](https://github.com/soundcloud/lhm) already,
-we got you covered. Percona Migrator overrides Lhm's DSL so that all the alter
+we got you covered. Departure overrides Lhm's DSL so that all the alter
 statements also go through `pt-online-schema-change` as well.
 
 You can keep your Lhm migrations and start using Rails migration's DSL back
@@ -83,7 +148,7 @@ It's strongly recommended to name it after this gems name, such as
 
 ## How it works
 
-When booting your Rails app, Percona Migrator extends the
+When booting your Rails app, Departure extends the
 `ActiveRecord::Migration#migrate` method to reset the connection and reestablish
 it using the `PerconaAdapter` instead of the one you defined in your
 `config/database.yml`.

data/bin/rspec

@@ -0,0 +1,17 @@
+#!/usr/bin/env ruby
+# frozen_string_literal: true
+#
+# This file was generated by Bundler.
+#
+# The application 'rspec' is installed as part of a gem, and
+# this file is here to facilitate running it.
+#
+
+require "pathname"
+ENV["BUNDLE_GEMFILE"] ||= File.expand_path("../../Gemfile",
+  Pathname.new(__FILE__).realpath)
+
+require "rubygems"
+require "bundler/setup"
+
+load Gem.bin_path("rspec-core", "rspec")

data/lib/active_record/connection_adapters/percona_adapter.rb

@@ -13,9 +13,13 @@ module ActiveRecord
 
       config[:username] = 'root' if config[:username].nil?
 
+      connection_details = PerconaMigrator::ConnectionDetails.new(config)
       verbose = ActiveRecord::Migration.verbose
-      percona_logger = PerconaMigrator::LoggerFactory.build(verbose: verbose)
-      cli_generator = PerconaMigrator::CliGenerator.new(config)
+      sanitizers = [
+        PerconaMigrator::LogSanitizers::PasswordSanitizer.new(connection_details)
+      ]
+      percona_logger = PerconaMigrator::LoggerFactory.build(sanitizers: sanitizers, verbose: verbose)
+      cli_generator = PerconaMigrator::CliGenerator.new(connection_details)
 
       runner = PerconaMigrator::Runner.new(
         percona_logger,

data/lib/percona_migrator/cli_generator.rb

@@ -1,54 +1,36 @@
+require 'percona_migrator/dsn'
+require 'percona_migrator/option'
 require 'percona_migrator/alter_argument'
+require 'percona_migrator/connection_details'
+require 'percona_migrator/user_options'
 
 module PerconaMigrator
 
-  # Represents the 'DSN' argument of Percona's pt-online-schema-change
-  # See https://www.percona.com/doc/percona-toolkit/2.0/pt-online-schema-change.html#dsn-options
-  class DSN
-
-    # Constructor
-    #
-    # @param database [String, Symbol]
-    # @param table_name [String, Symbol]
-    def initialize(database, table_name)
-      @database = database
-      @table_name = table_name
-    end
-
-    # Returns the pt-online-schema-change DSN string. See
-    # https://www.percona.com/doc/percona-toolkit/2.0/pt-online-schema-change.html#dsn-options
-    def to_s
-      "D=#{database},t=#{table_name}"
-    end
-
-    private
-
-    attr_reader :table_name, :database
-  end
-
   # Generates the equivalent Percona's pt-online-schema-change command to the
   # given SQL statement
   #
   # --no-check-alter is used to allow running CHANGE COLUMN statements. For
   #   more details, check: www.percona.com/doc/percona-toolkit/2.2/pt-online-schema-change.html#cmdoption-pt-online-schema-change--[no]check-alter
   #
-  class CliGenerator # Command
-    BASE_COMMAND = 'pt-online-schema-change'
-    BASE_OPTIONS = %w(
-      --execute
-      --statistics
-      --recursion-method=none
-      --alter-foreign-keys-method=auto
-      --no-check-alter
-    )
-
-    # Constructor
+  class CliGenerator
+    COMMAND_NAME = 'pt-online-schema-change'.freeze
+    DEFAULT_OPTIONS = Set.new(
+      [
+        Option.new('execute'),
+        Option.new('statistics'),
+        Option.new('alter-foreign-keys-method', 'auto'),
+        Option.new('no-check-alter')
+      ]
+    ).freeze
+
+    # TODO: Better doc.
+    #
+    # Constructor. Specify any arguments to pass to pt-online-schema-change
+    # passing the PERCONA_ARGS env var when executing the migration
     #
     # @param connection_data [Hash]
-    def initialize(connection_data)
-      @connection_data = connection_data
-      init_base_command
-      add_connection_details
+    def initialize(connection_details)
+      @connection_details = connection_details
     end
 
     # Generates the percona command. Fills all the connection credentials from
@@ -62,9 +44,9 @@ module PerconaMigrator
     # @return [String]
     def generate(table_name, statement)
       alter_argument = AlterArgument.new(statement)
-      dsn = DSN.new(database, table_name)
+      dsn = DSN.new(connection_details.database, table_name)
 
-      "#{self} #{dsn} #{alter_argument}"
+      "#{command} #{all_options} #{dsn} #{alter_argument}"
     end
 
     # Generates the percona command for a raw MySQL statement. Fills all the
@@ -77,63 +59,27 @@ module PerconaMigrator
     # @return [String]
     def parse_statement(statement)
       alter_argument = AlterArgument.new(statement)
-      dsn = DSN.new(database, alter_argument.table_name)
+      dsn = DSN.new(connection_details.database, alter_argument.table_name)
 
-      "#{self} #{dsn} #{alter_argument}"
+      "#{command} #{all_options} #{dsn} #{alter_argument}"
     end
 
     private
 
-    attr_reader :connection_data
-
-    # Sets up the command with its options
-    def init_base_command
-      @command = [BASE_COMMAND, BASE_OPTIONS.join(' ')]
-    end
-
-    # Adds the host, user and password, if present, to the command
-    def add_connection_details
-      @command.push("-h #{host}")
-      @command.push("-u #{user}")
-      @command.push("-p #{password}") if password.present?
-    end
-
-    # Returns the command as a string that can be executed in a shell
-    #
-    # @return [String]
-    def to_s
-      @command.join(' ')
-    end
-
-    # Returns the database host name, defaulting to localhost. If PERCONA_DB_HOST
-    # is passed its value will be used instead
-    #
-    # @return [String]
-    def host
-      ENV['PERCONA_DB_HOST'] || connection_data[:host] || 'localhost'
-    end
+    attr_reader :connection_details
 
-    # Returns the database user. If PERCONA_DB_USER is passed its value will be
-    # used instead
-    #
-    # @return [String]
-    def user
-      ENV['PERCONA_DB_USER'] || connection_data[:username]
+    def command
+      "#{COMMAND_NAME} #{connection_details}"
     end
 
-    # Returns the database user's password. If PERCONA_DB_PASSWORD is passed its
-    # value will be used instead
+    # Returns all the arguments to execute pt-online-schema-change with
     #
     # @return [String]
-    def password
-      ENV['PERCONA_DB_PASSWORD'] || connection_data[:password]
-    end
-
-    # TODO: Doesn't the abstract adapter already handle this somehow?
-    # Returns the database name. If PERCONA_DB_NAME is passed its value will be
-    # used instead
-    def database
-      ENV['PERCONA_DB_NAME'] || connection_data[:database]
+    def all_options
+      env_variable_options = UserOptions.new
+      global_configuration_options = UserOptions.new(PerconaMigrator.configuration.global_percona_args)
+      options = env_variable_options.merge(global_configuration_options).merge(DEFAULT_OPTIONS)
+      options.to_a.join(' ')
     end
   end
 end

data/lib/percona_migrator/command.rb

@@ -0,0 +1,102 @@
+module PerconaMigrator
+  # Executes the given command returning it's status and errors
+  class Command
+    COMMAND_NOT_FOUND = 127
+
+    # Constructor
+    #
+    # @param command_line [String]
+    # @param error_log_path [String]
+    # @param logger [#write_no_newline]
+    def initialize(command_line, error_log_path, logger)
+      @command_line = command_line
+      @error_log_path = error_log_path
+      @logger = logger
+    end
+
+    # Executes the command returning its status. It also prints its stdout to
+    # the logger and its stderr to the file specified in error_log_path.
+    #
+    # @raise [NoStatusError] if the spawned process' status can't be retrieved
+    # @raise [SignalError] if the spawned process received a signal
+    # @raise [CommandNotFoundError] if pt-online-schema-change can't be found
+    #
+    # @return [Process::Status]
+    def run
+      log_deprecations
+      log_started
+
+      run_in_process
+
+      log_finished
+
+      validate_status!
+      status
+    end
+
+    private
+
+    attr_reader :command_line, :error_log_path, :logger, :status
+
+    # Runs the command in a separate process, capturing its stdout and
+    # execution status
+    def run_in_process
+      Open3.popen3(full_command) do |_stdin, stdout, _stderr, waith_thr|
+        begin
+          loop do
+            IO.select([stdout])
+            data = stdout.read_nonblock(8)
+            logger.write_no_newline(data)
+          end
+        rescue EOFError
+          # noop
+        ensure
+          @status = waith_thr.value
+        end
+      end
+    end
+
+    # Builds the actual command including stderr redirection to the specified
+    # log file
+    #
+    # @return [String]
+    def full_command
+      "#{command_line} 2> #{error_log_path}"
+    end
+
+    # Validates the status of the execution
+    #
+    # @raise [NoStatusError] if the spawned process' status can't be retrieved
+    # @raise [SignalError] if the spawned process received a signal
+    # @raise [CommandNotFoundError] if pt-online-schema-change can't be found
+    def validate_status!
+      raise SignalError.new(status) if status.signaled?
+      raise CommandNotFoundError if status.exitstatus == COMMAND_NOT_FOUND
+      raise Error, error_message unless status.success?
+    end
+
+    # Returns the error message that appeared in the process' stderr
+    #
+    # @return [String]
+    def error_message
+      File.read(error_log_path)
+    end
+
+    # Logs when the execution started
+    def log_started
+      logger.write("\n")
+      logger.say("Running #{command_line}\n\n", true)
+    end
+
+    # Prints a line break to keep the logs separate from the execution time
+    # print by the migration
+    def log_finished
+      logger.write("\n")
+    end
+
+    def log_deprecations
+      logger.write("\n")
+      logger.write("[DEPRECATION] This gem has been renamed to Departure and will no longer be supported. Please switch to Departure as soon as possible.")
+    end
+  end
+end

data/lib/percona_migrator/configuration.rb

@@ -1,10 +1,11 @@
 module PerconaMigrator
   class Configuration
-    attr_accessor :tmp_path
+    attr_accessor :tmp_path, :global_percona_args
 
     def initialize
       @tmp_path = '.'.freeze
       @error_log_filename = 'percona_migrator_error.log'.freeze
+      @global_percona_args = nil
     end
 
     def error_log_path

data/lib/percona_migrator/connection_details.rb

@@ -0,0 +1,70 @@
+module PerconaMigrator
+  # Holds the parameters of the DB connection and formats them to string
+  class ConnectionDetails
+
+    # Constructor
+    #
+    # @param [Hash] connection parametes as used in #establish_conneciton
+    def initialize(connection_data)
+      @connection_data = connection_data
+    end
+
+    # Returns the details formatted as an string to be used with
+    # pt-online-schema-change. It follows the mysql client's format.
+    #
+    # @return [String]
+    def to_s
+      @to_s ||= "-h #{host} -u #{user} #{password_argument}"
+    end
+
+    # TODO: Doesn't the abstract adapter already handle this somehow?
+    # Returns the database name. If PERCONA_DB_NAME is passed its value will be
+    # used instead
+    #
+    # Returns the database name
+    #
+    # @return [String]
+    def database
+      ENV.fetch('PERCONA_DB_NAME', connection_data[:database])
+    end
+
+    # Returns the password fragment of the details string if a password is passed
+    #
+    # @return [String]
+    def password_argument
+      if password.present?
+        "-p #{password}"
+      else
+        ''
+      end
+    end
+
+    private
+
+    attr_reader :connection_data
+
+    # Returns the database host name, defaulting to localhost. If PERCONA_DB_HOST
+    # is passed its value will be used instead
+    #
+    # @return [String]
+    def host
+      ENV.fetch('PERCONA_DB_HOST', connection_data[:host]) || 'localhost'
+    end
+
+    # Returns the database user. If PERCONA_DB_USER is passed its value will be
+    # used instead
+    #
+    # @return [String]
+    def user
+      ENV.fetch('PERCONA_DB_USER', connection_data[:username])
+    end
+
+    # Returns the database user's password. If PERCONA_DB_PASSWORD is passed its
+    # value will be used instead
+    #
+    # @return [String]
+    def password
+      ENV.fetch('PERCONA_DB_PASSWORD', connection_data[:password])
+    end
+  end
+end

data/lib/percona_migrator/dsn.rb

@@ -0,0 +1,26 @@
+module PerconaMigrator
+
+  # Represents the 'DSN' argument of Percona's pt-online-schema-change
+  # See https://www.percona.com/doc/percona-toolkit/2.0/pt-online-schema-change.html#dsn-options
+  class DSN
+
+    # Constructor
+    #
+    # @param database [String, Symbol]
+    # @param table_name [String, Symbol]
+    def initialize(database, table_name)
+      @database = database
+      @table_name = table_name
+    end
+
+    # Returns the pt-online-schema-change DSN string. See
+    # https://www.percona.com/doc/percona-toolkit/2.0/pt-online-schema-change.html#dsn-options
+    def to_s
+      "D=#{database},t=#{table_name}"
+    end
+
+    private
+
+    attr_reader :table_name, :database
+  end
+end

data/lib/percona_migrator/errors.rb

@@ -32,4 +32,8 @@ module PerconaMigrator
       'Please install pt-online-schema-change. Check: https://www.percona.com/doc/percona-toolkit for further details'
     end
   end
+
+  # Used to prevent running the db:migrate rake task when providing arguments
+  # through PERCONA_ARGS env var
+  class ArgumentsNotSupported < Error; end
 end

data/lib/percona_migrator/log_sanitizers/password_sanitizer.rb

@@ -0,0 +1,21 @@
+module PerconaMigrator
+  module LogSanitizers
+    class PasswordSanitizer
+      PASSWORD_REPLACEMENT = '[filtered_password]'
+
+      delegate :password_argument, to: :connection_details
+
+      def initialize(connection_details)
+        @connection_details = connection_details
+      end
+
+      def execute(log_statement)
+        return log_statement if password_argument.blank?
+        log_statement.gsub(password_argument, PASSWORD_REPLACEMENT)
+      end
+
+      private
+      attr_accessor :connection_details
+    end
+  end
+end

data/lib/percona_migrator/logger.rb

@@ -5,6 +5,10 @@ module PerconaMigrator
   # seen from the connection adapter.
   class Logger
 
+    def initialize(sanitizers)
+      @sanitizers = sanitizers
+    end
+
     # Outputs the message through the stdout, following the
     # ActiveRecord::Migration log format
     #
@@ -18,14 +22,22 @@ module PerconaMigrator
     #
     # @param text [String]
     def write(text = '')
-      puts(text)
+      puts(sanitize(text))
     end
 
     # Outputs the text through the stdout without adding a new line at the end
     #
     # @param text [String]
     def write_no_newline(text)
-      print(text)
+      print(sanitize(text))
+    end
+
+    private
+
+    attr_accessor :sanitizers
+
+    def sanitize(text)
+      sanitizers.inject(text) { |memo, sanitizer| sanitizer.execute(memo) }
     end
   end
 end

data/lib/percona_migrator/logger_factory.rb

@@ -6,9 +6,9 @@ module PerconaMigrator
     #
     # @param verbose [Boolean]
     # @return [#say, #write]
-    def self.build(verbose: true)
+    def self.build(sanitizers: [], verbose: true)
       if verbose
-        PerconaMigrator::Logger.new
+        PerconaMigrator::Logger.new(sanitizers)
       else
         PerconaMigrator::NullLogger.new
       end

data/lib/percona_migrator/option.rb

@@ -0,0 +1,63 @@
+module PerconaMigrator
+  class Option
+    attr_reader :name, :value
+
+    # Builds an instance by parsing its name and value out of the given string.
+    # Note the string must conform to "--<arg>=<value>" format.
+    #
+    # @param string [String]
+    # @return [Option]
+    def self.from_string(string)
+      pair = string.split('=')
+      name = pair[0][2..-1]
+      value = pair[1]
+
+      new(name, value)
+    end
+
+    # Constructor
+    #
+    # @param name [String]
+    # @param optional value [String]
+    def initialize(name, value = nil)
+      @name = name
+      @value = value
+    end
+
+    # Compares two options
+    #
+    # @param [Option]
+    # @return [Boolean]
+    def ==(another_option)
+      name == another_option.name
+    end
+    alias :eql? :==
+
+    # Returns the option's hash
+    #
+    # @return [Fixnum]
+    def hash
+      name.hash
+    end
+
+    # Returns the option as string following the "--<name>=<value>" format
+    #
+    # @return [String]
+    def to_s
+      "--#{name}#{value_as_string}"
+    end
+
+    private
+
+    # Returns the value fragment of the option string if any value is specified
+    #
+    # @return [String]
+    def value_as_string
+      if value.nil?
+        ''
+      else
+        "=#{value}"
+      end
+    end
+  end
+end

data/lib/percona_migrator/runner.rb

@@ -5,7 +5,6 @@ module PerconaMigrator
   # It executes pt-online-schema-change commands in a new process and gets its
   # output and status
   class Runner
-    COMMAND_NOT_FOUND = 127
 
     # Constructor
     #
@@ -17,8 +16,7 @@ module PerconaMigrator
       @logger = logger
       @cli_generator = cli_generator
       @mysql_adapter = mysql_adapter
-      @status = nil
-      @config = config
+      @error_log_path = config.error_log_path
     end
 
     # Executes the passed sql statement using pt-online-schema-change for ALTER
@@ -27,8 +25,8 @@ module PerconaMigrator
     # @param sql [String]
     def query(sql)
       if alter_statement?(sql)
-        command = cli_generator.parse_statement(sql)
-        execute(command)
+        command_line = cli_generator.parse_statement(sql)
+        execute(command_line)
       else
         mysql_adapter.execute(sql)
       end
@@ -45,18 +43,15 @@ module PerconaMigrator
     # TODO: rename it so we don't confuse it with AR's #execute
     # Runs and logs the given command
     #
-    # @param command [String]
+    # @param command_line [String]
     # @return [Boolean]
-    def execute(command)
-      @command = command
-      logging { run_command }
-      validate_status
-      status
+    def execute(command_line)
+      Command.new(command_line, error_log_path, logger).run
     end
 
     private
 
-    attr_reader :command, :logger, :status, :cli_generator, :mysql_adapter, :config
+    attr_reader :logger, :cli_generator, :mysql_adapter, :error_log_path
 
     # Checks whether the sql statement is an ALTER TABLE
     #
@@ -65,66 +60,5 @@ module PerconaMigrator
     def alter_statement?(sql)
       sql =~ /\Aalter table/i
     end
-
-    # Logs the start and end of the execution
-    #
-    # @yield
-    def logging
-      log_started
-      yield
-      log_finished
-    end
-
-    # Logs when the execution started
-    def log_started
-      logger.write("\n")
-      logger.say("Running #{command}\n\n", true)
-    end
-
-    # Executes the command and prints its output to the stdout
-    def run_command
-      Open3.popen3("#{command} 2> #{error_log_path}") do |_stdin, stdout, _stderr, waith_thr|
-        begin
-          loop do
-            IO.select([stdout])
-            data = stdout.read_nonblock(8)
-            logger.write_no_newline(data)
-          end
-        rescue EOFError
-          # noop
-        ensure
-          @status = waith_thr.value
-        end
-      end
-    end
-
-    # Validates the status of the execution
-    #
-    # @raise [NoStatusError] if the spawned process' status can't be retrieved
-    # @raise [SignalError] if the spawned process received a signal
-    # @raise [CommandNotFoundError] if pt-online-schema-change can't be found
-    def validate_status
-      raise SignalError.new(status) if status.signaled?
-      raise CommandNotFoundError if status.exitstatus == COMMAND_NOT_FOUND
-      raise Error, error_message unless status.success?
-    end
-
-    # Prints a line break to keep the logs separate from the execution time
-    # print by the migration
-    def log_finished
-      logger.write("\n")
-    end
-
-    # The path where the percona toolkit stderr will be written
-    #
-    # @return [String]
-    def error_log_path
-      config.error_log_path
-    end
-
-    # @return [String]
-    def error_message
-      File.read(error_log_path)
-    end
   end
 end

data/lib/percona_migrator/user_options.rb

@@ -0,0 +1,44 @@
+module PerconaMigrator
+  # Encapsulates the pt-online-schema-change options defined by the user
+  class UserOptions
+    delegate :each, :merge, to: :to_set
+
+    # Constructor
+    #
+    # @param arguments [String]
+    def initialize(arguments = ENV['PERCONA_ARGS'])
+      @arguments = arguments
+    end
+
+    private
+
+    attr_reader :arguments
+
+    # Returns the arguments the user defined but without duplicates
+    #
+    # @return [Set]
+    def to_set
+      Set.new(user_options)
+    end
+
+    # Returns Option instances from the arguments the user specified, if any
+    #
+    # @return [Array]
+    def user_options
+      if arguments
+        build_options
+      else
+        []
+      end
+    end
+
+    # Builds Option instances from the user arguments
+    #
+    # @return [Array<Option>]
+    def build_options
+      arguments.split(' ').map do |argument|
+        Option.from_string(argument)
+      end
+    end
+  end
+end

data/lib/percona_migrator/version.rb

@@ -1,3 +1,3 @@
 module PerconaMigrator
-  VERSION = '1.0.0'.freeze
+  VERSION = '1.1.0'.freeze
 end

data/lib/percona_migrator.rb

@@ -2,6 +2,7 @@ require 'active_record'
 require 'active_support/all'
 
 require 'percona_migrator/version'
+require 'percona_migrator/log_sanitizers/password_sanitizer'
 require 'percona_migrator/runner'
 require 'percona_migrator/cli_generator'
 require 'percona_migrator/logger'
@@ -9,6 +10,7 @@ require 'percona_migrator/null_logger'
 require 'percona_migrator/logger_factory'
 require 'percona_migrator/configuration'
 require 'percona_migrator/errors'
+require 'percona_migrator/command'
 
 require 'percona_migrator/railtie' if defined?(Rails)
 
@@ -28,6 +30,21 @@ module PerconaMigrator
   # Hooks Percona Migrator into Rails migrations by replacing the configured
   # database adapter
   def self.load
+    ActiveRecord::Migrator.instance_eval do
+      class << self
+        alias_method(:original_migrate, :migrate)
+      end
+
+      # Checks whether arguments are being passed through PERCONA_ARGS when running
+      # the db:migrate rake task
+      #
+      # @raise [ArgumentsNotSupported] if PERCONA_ARGS has any value
+      def migrate(migrations_paths, target_version = nil, &block)
+        raise ArgumentsNotSupported if ENV['PERCONA_ARGS'].present?
+        original_migrate(migrations_paths, target_version, &block)
+      end
+    end
+
     ActiveRecord::Migration.class_eval do
       alias_method :original_migrate, :migrate
 
@@ -55,10 +72,9 @@ module PerconaMigrator
       # Make all connections in the connection pool to use PerconaAdapter
       # instead of the current adapter.
       def reconnect_with_percona
-        connection_config = ActiveRecord::Base.connection_config
-        ActiveRecord::Base.establish_connection(
-          connection_config.merge(adapter: 'percona')
-        )
+        connection_config = ActiveRecord::Base
+          .connection_config.merge(adapter: 'percona')
+        ActiveRecord::Base.establish_connection(connection_config)
       end
     end
   end

data/percona_migrator.gemspec

@@ -7,14 +7,20 @@ require 'percona_migrator/version'
 Gem::Specification.new do |spec|
   spec.name          = 'percona_migrator'
   spec.version       = PerconaMigrator::VERSION
-  spec.authors       = ['Ilya Zayats', 'Pau Pérez', 'Fran Casas', 'Jorge Morante']
-  spec.email         = ['ilya.zayats@redbooth.com', 'pau.perez@redbooth.com', 'fran.casas@redbooth.com', 'jorge.morante@redbooth.com']
+  spec.authors       = ['Ilya Zayats', 'Pau Pérez', 'Fran Casas', 'Jorge Morante', 'Adrian Serafin']
+  spec.email         = ['ilya.zayats@redbooth.com', 'pau.perez@redbooth.com', 'fran.casas@redbooth.com', 'jorge.morante@redbooth.com', 'adrian@softmad.pl']
 
   spec.summary       = %q{pt-online-schema-change runner for ActiveRecord migrations}
   spec.description   = %q{Execute your ActiveRecord migrations with Percona's pt-online-schema-change}
   spec.homepage      = 'http://github.com/redbooth/percona_migrator'
   spec.license       = 'MIT'
 
+  spec.post_install_message = <<-MESSAGE
+  !    The Percona_migrator gem has been deprecated and has been replaced by Departure.
+  !    See: https://rubygems.org/gems/departure
+  !    And: https://github.com/redbooth/departure
+  MESSAGE
+
   spec.files         = `git ls-files -z`.split("\x0").reject { |f| f.match(%r{^(test|spec|features)/}) }
   spec.require_paths = ['lib']
 
@@ -26,4 +32,5 @@ Gem::Specification.new do |spec|
   spec.add_development_dependency 'rspec', '~> 3.4', '>= 3.4.0'
   spec.add_development_dependency 'rspec-its', '~> 1.2'
   spec.add_development_dependency 'byebug', '~> 8.2', '>= 8.2.1'
+  spec.add_development_dependency 'climate_control', '~> 0.0.3'
 end

metadata

@@ -1,17 +1,18 @@
 --- !ruby/object:Gem::Specification
 name: percona_migrator
 version: !ruby/object:Gem::Version
-  version: 1.0.0
+  version: 1.1.0
 platform: ruby
 authors:
 - Ilya Zayats
 - Pau Pérez
 - Fran Casas
 - Jorge Morante
+- Adrian Serafin
 autorequire: 
 bindir: bin
 cert_chain: []
-date: 2016-11-30 00:00:00.000000000 Z
+date: 2017-04-07 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: rails
@@ -129,12 +130,27 @@ dependencies:
     - - ">="
       - !ruby/object:Gem::Version
         version: 8.2.1
+- !ruby/object:Gem::Dependency
+  name: climate_control
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 0.0.3
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 0.0.3
 description: Execute your ActiveRecord migrations with Percona's pt-online-schema-change
 email:
 - ilya.zayats@redbooth.com
 - pau.perez@redbooth.com
 - fran.casas@redbooth.com
 - jorge.morante@redbooth.com
+- adrian@softmad.pl
 executables: []
 extensions: []
 extra_rdoc_files: []
@@ -150,6 +166,7 @@ files:
 - RELEASING.md
 - Rakefile
 - bin/console
+- bin/rspec
 - bin/setup
 - config.yml
 - configuration.rb
@@ -161,13 +178,19 @@ files:
 - lib/percona_migrator.rb
 - lib/percona_migrator/alter_argument.rb
 - lib/percona_migrator/cli_generator.rb
+- lib/percona_migrator/command.rb
 - lib/percona_migrator/configuration.rb
+- lib/percona_migrator/connection_details.rb
+- lib/percona_migrator/dsn.rb
 - lib/percona_migrator/errors.rb
+- lib/percona_migrator/log_sanitizers/password_sanitizer.rb
 - lib/percona_migrator/logger.rb
 - lib/percona_migrator/logger_factory.rb
 - lib/percona_migrator/null_logger.rb
+- lib/percona_migrator/option.rb
 - lib/percona_migrator/railtie.rb
 - lib/percona_migrator/runner.rb
+- lib/percona_migrator/user_options.rb
 - lib/percona_migrator/version.rb
 - percona_migrator.gemspec
 - test_database.rb
@@ -175,7 +198,10 @@ homepage: http://github.com/redbooth/percona_migrator
 licenses:
 - MIT
 metadata: {}
-post_install_message: 
+post_install_message: |2
+    !    The Percona_migrator gem has been deprecated and has been replaced by Departure.
+    !    See: https://rubygems.org/gems/departure
+    !    And: https://github.com/redbooth/departure
 rdoc_options: []
 require_paths:
 - lib
@@ -191,7 +217,7 @@ required_rubygems_version: !ruby/object:Gem::Requirement
       version: '0'
 requirements: []
 rubyforge_project: 
-rubygems_version: 2.4.5.1
+rubygems_version: 2.6.10
 signing_key: 
 specification_version: 4
 summary: pt-online-schema-change runner for ActiveRecord migrations