replica_pools 2.2.0.beta1 → 2.3.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: aba6d5a57bda0c33f6531172ff1f8a9e735168a94688318c09388032063ca637
-  data.tar.gz: 10677ab3c419b42fa1a8ebe8367204a42ff87bbdc01a1a986575a70f12cb3925
+  metadata.gz: 9d9219fb04b0b4118f99202ad78486d565bb88fe57079f743336b381b50d5864
+  data.tar.gz: e3fefd1456ce775cf127e0561d5827b39d4a45fab0ef4359178bf58d841887bc
 SHA512:
-  metadata.gz: 3c0bd1e057eb02a547d33792d8d3bbc7b378c7cc49574a8635a885c0ce9668fe90c1dc880435a0a3eabd8d3322d5f89970c1809b0d8c98ddbe538289232c7b61
-  data.tar.gz: 42b3bc14c121185c8df5c7de20c556d3604576878ea6f3deaddf9e8ad1a0b726e99c12f23bbb1ca9d104e757dc18d04f3848c3bf86304a49efa54b3ae259dc63
+  metadata.gz: a1777856dd70f4fd661ef3a7ca6d149f57772e72e9636cd0ef674476c858fa8ce1e086a846a79e624924c1838765e39a88273fb0d3d6b01812c01be7668fe69c
+  data.tar.gz: 0f6f739901cfcf978c9d6b0b1a4e9efbd46c66c33954ab577186343c74eb5a9e499c15ed2d8fa6d8c97afc1f85854e81ef72cbeced472cc5cd0d7f0db59e3e15

data/README.md

@@ -2,8 +2,7 @@
 
 Easy Single Leader / Multiple Replica Setup for use in Ruby/Rails projects
 
-[![Build
-Status](https://travis-ci.org/kickstarter/replica_pools.png?branch=owningit)](https://travis-ci.org/kickstarter/replica_pools)
+[![Spec](https://github.com/kickstarter/replica_pools/actions/workflows/spec.yml/badge.svg)](https://github.com/kickstarter/replica_pools/actions/workflows/spec.yml)
 
 ## Overview
 
@@ -11,22 +10,22 @@ ReplicaPools replaces ActiveRecord's connection with a proxy that routes databas
 
 ReplicaPools also provides helpers so you can customize your replica strategy. You can organize replicas into pools and cycle through them (e.g. in a before_filter). You can make the connection default to the leader, or the default replica pool, and then use block helpers to temporarily change the behavior (e.g. in an around_filter).
 
-* Uses a naming convention in database.yml to designate replica pools.
-* Defaults to a given replica pool, but may also be configured to default to leader.
-* Routes database interactions (queries) to the right connection
-  * Whitelisted queries go to the current connection (might be a replica).
-  * All queries inside a transaction run on leader.
-  * All other queries are also sent to the leader connection.
-* Supports ActiveRecord's in-memory query caching.
-* Helper methods can be used to easily load balance replicas, route traffic to different replica pools, or run directly against leader. (examples below)
+- Uses a naming convention in database.yml to designate replica pools.
+- Defaults to a given replica pool, but may also be configured to default to leader.
+- Routes database interactions (queries) to the right connection
+  - Whitelisted queries go to the current connection (might be a replica).
+  - All queries inside a transaction run on leader.
+  - All other queries are also sent to the leader connection.
+- Supports ActiveRecord's in-memory query caching.
+- Helper methods can be used to easily load balance replicas, route traffic to different replica pools, or run directly against leader. (examples below)
 
 ## Not Supported
 
-* Sharding.
-* Automatic load balancing strategies.
-* Replica weights. You can accomplish this in your own load balancing strategy.
-* Whitelisting models that always use leader.
-* Blacklisting poorly performing replicas. This could cause load spikes on your leader. Whatever provisions your database.yml should make this choice.
+- Sharding.
+- Automatic load balancing strategies.
+- Replica weights. You can accomplish this in your own load balancing strategy.
+- Whitelisting models that always use leader.
+- Blacklisting poorly performing replicas. This could cause load spikes on your leader. Whatever provisions your database.yml should make this choice.
 
 ## Installation and Setup
 
@@ -166,7 +165,7 @@ To disable queries to the leader database -- for instance, in a production
 console -- set the disable_leader configuration to false. This will raise
 a ReplicaPools::LeaderDisabled error:
 
-  ReplicaPools.config.disable_leader = false
+ReplicaPools.config.disable_leader = false
 
 ## Running specs
 
@@ -186,11 +185,15 @@ Then you can run tests with:
 $ bundle exec rake spec
 ```
 
+## Releasing a New Version
+
+First bump the version as appropriate in `lib/replica_pools/version.rb` and then run `bundle exec rake release`. This will push git tags to github and package and push the gem to rubygems.org.
+
 ## Authors
 
 Author: Dan Drabik, Lance Ivy
 
-Copyright (c) 2012-2019, Kickstarter
+Copyright (c) 2012-2021, Kickstarter
 
 Released under the MIT license
 
@@ -200,10 +203,10 @@ Released under the MIT license
 
 The project is based on:
 
-* https://github.com/schoefmax/multi_db
+- https://github.com/schoefmax/multi_db
 
 ### Masochism
 
 The original leader/replica plugin:
 
-* http://github.com/technoweenie/masochism
+- http://github.com/technoweenie/masochism

data/lib/replica_pools/connection_proxy.rb

@@ -11,26 +11,18 @@ module ReplicaPools
     class << self
       def generate_safe_delegations
         ReplicaPools.config.safe_methods.each do |method|
-          generate_safe_delegation(method) unless instance_methods.include?(method)
+          self.define_method(method) do |*args, &block|
+            route_to(current, method, *args, &block)
+          end unless instance_methods.include?(method)
         end
       end
-
-      protected
-
-      def generate_safe_delegation(method)
-        class_eval <<-END, __FILE__, __LINE__ + 1
-          def #{method}(*args, &block)
-            route_to(current, :#{method}, *args, &block)
-          end
-        END
-      end
     end
 
     def initialize(leader, pools)
-      @leader       = leader
-      @replica_pools  = pools
-      @leader_depth = 0
-      @current_pool = default_pool
+      @leader        = leader
+      @replica_pools = pools
+      @leader_depth  = 0
+      @current_pool  = default_pool
 
       if ReplicaPools.config.defaults_to_leader
         @current = leader
@@ -91,7 +83,13 @@ module ReplicaPools
     # Safe methods have been generated during `setup!`.
     # Creates a method to speed up subsequent calls.
     def method_missing(method, *args, &block)
-      generate_unsafe_delegation(method)
+      self.class.define_method(method) do |*args, &block|
+        route_to(leader, method, *args, &block).tap do
+          if %i[insert delete update].include?(method)
+            leader.retrieve_connection.clear_query_cache
+          end
+        end
+      end
       send(method, *args, &block)
     end
 
@@ -99,14 +97,6 @@ module ReplicaPools
       leader_depth > 0
     end
 
-    def generate_unsafe_delegation(method)
-      self.class_eval <<-END, __FILE__, __LINE__ + 1
-        def #{method}(*args, &block)
-          route_to(leader, :#{method}, *args, &block)
-        end
-      END
-    end
-
     def route_to(conn, method, *args, &block)
       raise ReplicaPools::LeaderDisabled.new if ReplicaPools.config.disable_leader && conn == leader
       conn.retrieve_connection.send(method, *args, &block)

data/lib/replica_pools/engine.rb

@@ -10,26 +10,70 @@ module ReplicaPools
 
       ReplicaPools.config.safe_methods =
         if ActiveRecord::VERSION::MAJOR == 3
-          [
-            :select_all, :select_one, :select_value, :select_values,
-            :select_rows, :select, :verify!, :raw_connection, :active?, :reconnect!,
-            :disconnect!, :reset_runtime, :log, :log_info
+          %i[
+            active?
+            disconnect!
+            log
+            log_info
+            raw_connection
+            reconnect!
+            reset_runtime
+            select
+            select_all
+            select_one
+            select_rows
+            select_value
+            select_values
+            verify!
           ]
         elsif ActiveRecord::VERSION::MAJOR == 4
-          [
-            :select_all, :select_one, :select_value, :select_values,
-            :select_rows, :select, :verify!, :raw_connection, :active?, :reconnect!,
-            :disconnect!, :reset_runtime, :log
+          %i[
+            active?
+            disconnect!
+            log
+            raw_connection
+            reconnect!
+            reset_runtime
+            select
+            select_all
+            select_one
+            select_rows
+            select_value
+            select_values
+            verify!
           ]
         elsif [5, 6].include?(ActiveRecord::VERSION::MAJOR)
-          [
-           :select_all, :select_one, :select_value, :select_values,
-           :select_rows, :select, :select_prepared, :verify!, :raw_connection,
-           :active?, :reconnect!, :disconnect!, :reset_runtime, :log,
-           :lookup_cast_type_from_column, :sanitize_limit,
-           :combine_bind_parameters, :quote_table_name, :quote, :quote_column_names, :quote_table_names, :table_alias_for,
-           :case_sensitive_comparison, :case_insensitive_comparison,
-           :schema_cache, :cacheable_query, :prepared_statements, :clear_cache!, :column_name_for_operation
+          %i[
+           active?
+           cacheable_query
+           case_insensitive_comparison
+           case_sensitive_comparison
+           clear_cache!
+           column_name_for_operation
+           column_name_with_order_matcher
+           combine_bind_parameters
+           disconnect!
+           log
+           lookup_cast_type_from_column
+           prepared_statements
+           quote
+           quote_column_names
+           quote_table_name
+           quote_table_names
+           raw_connection
+           reconnect!
+           reset_runtime
+           sanitize_limit
+           schema_cache
+           select
+           select_all
+           select_one
+           select_prepared
+           select_rows
+           select_value
+           select_values
+           table_alias_for
+           verify!
           ]
         else
           warn "Unsupported ActiveRecord version #{ActiveRecord.version}. Please whitelist the safe methods."

data/lib/replica_pools/pools.rb

@@ -6,12 +6,12 @@ module ReplicaPools
 
     def initialize
       pools = {}
-      pool_configurations.group_by{|_, name, _| name }.each do |name, set|
+      pool_configurations.group_by{ |_, name, _| name }.each do |name, set|
         pools[name.to_sym] = ReplicaPools::Pool.new(
           name,
-          set.map{ |conn_name, _, replica_name|
+          set.map do |conn_name, _, replica_name|
             connection_class(name, replica_name, conn_name)
-          }
+          end
         )
       end
 
@@ -47,16 +47,16 @@ module ReplicaPools
     def connection_class(pool_name, replica_name, connection_name)
       class_name = "#{pool_name.camelize}#{replica_name.camelize}"
 
-      ReplicaPools.module_eval %Q{
-        class #{class_name} < ActiveRecord::Base
-          self.abstract_class = true
-          establish_connection :#{connection_name}
-          def self.connection_config
-            configurations[#{connection_name.to_s.inspect}]
-          end
+      ReplicaPools.const_set(class_name, Class.new(ActiveRecord::Base) do |c|
+        c.abstract_class = true
+        c.define_singleton_method(:connection_config) do
+          configurations[connection_name.to_s]
         end
-      }, __FILE__, __LINE__
-      ReplicaPools.const_get(class_name)
+      end)
+
+      ReplicaPools.const_get(class_name).tap do |c|
+        c.establish_connection(connection_name.to_sym)
+      end
     end
   end
 end

data/lib/replica_pools/query_cache.rb

@@ -10,11 +10,9 @@ module ReplicaPools
 
     # these methods can all use the leader connection
     (query_cache_methods - [:select_all]).each do |method_name|
-      module_eval <<-END, __FILE__, __LINE__ + 1
-        def #{method_name}(*a, &b)
-          ActiveRecord::Base.connection.#{method_name}(*a, &b)
-        end
-      END
+      define_method(method_name) do |*args, &block|
+        ActiveRecord::Base.connection.send(method_name, *args, &block)
+      end
     end
 
     # select_all is trickier. it needs to use the leader
@@ -24,6 +22,8 @@ module ReplicaPools
       # there may be more args for Rails 5.0+, but we only care about arel, name, and binds for caching.
       relation, name, raw_binds = args
 
+      # Rails 6.2 breaks this method as locked? is no longer available
+      # https://github.com/kickstarter/replica_pools/issues/26
       if !query_cache_enabled || locked?(relation)
         return route_to(current, :select_all, *args)
       end
@@ -32,7 +32,7 @@ module ReplicaPools
       if raw_binds.blank? && relation.is_a?(ActiveRecord::Relation)
         arel, binds = relation.arel, relation.bind_values
       else
-        arel, binds = relation, raw_binds
+        arel, binds = relation, Array(raw_binds)
       end
 
       sql = to_sql(arel, binds)

data/lib/replica_pools/version.rb

@@ -1,3 +1,3 @@
 module ReplicaPools
-  VERSION = "2.2.0.beta1"
+  VERSION = "2.3.0"
 end

data/lib/replica_pools.rb

@@ -1,3 +1,5 @@
+require 'logger'
+
 require 'active_record'
 require 'replica_pools/config'
 require 'replica_pools/pool'
@@ -64,7 +66,7 @@ module ReplicaPools
     end
 
     def logger
-      ActiveRecord::Base.logger
+      ActiveRecord::Base.logger || Logger.new(STDOUT)
     end
   end
 end

data/spec/query_cache_spec.rb

@@ -1,5 +1,6 @@
 require 'rack'
 require_relative 'spec_helper'
+require_relative 'config/test_model'
 
 describe ReplicaPools::QueryCache do
   before(:each) do
@@ -103,4 +104,16 @@ describe ReplicaPools::QueryCache do
       end
     end
   end
+
+  describe '.pluck regression test' do
+    it 'should work with query caching' do
+      TestModel.connection.enable_query_cache!
+      expect(TestModel.pluck(:id).count).to eql TestModel.all.count
+    end
+
+    it 'should work if query cache is not enabled' do
+      TestModel.connection.disable_query_cache!
+      expect(TestModel.pluck(:id).count).to eql TestModel.all.count
+    end
+  end
 end

metadata

@@ -1,44 +1,44 @@
 --- !ruby/object:Gem::Specification
 name: replica_pools
 version: !ruby/object:Gem::Version
-  version: 2.2.0.beta1
+  version: 2.3.0
 platform: ruby
 authors:
 - Dan Drabik
 - Lance Ivy
-autorequire: 
+autorequire:
 bindir: bin
 cert_chain: []
-date: 2019-08-05 00:00:00.000000000 Z
+date: 2022-04-28 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: activerecord
   requirement: !ruby/object:Gem::Requirement
     requirements:
-    - - ">="
+    - - "~>"
       - !ruby/object:Gem::Version
-        version: 3.2.12
+        version: '6.0'
   type: :runtime
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
-    - - ">="
+    - - "~>"
       - !ruby/object:Gem::Version
-        version: 3.2.12
+        version: '6.0'
 - !ruby/object:Gem::Dependency
   name: mysql2
   requirement: !ruby/object:Gem::Requirement
     requirements:
     - - "~>"
       - !ruby/object:Gem::Version
-        version: 0.4.4
+        version: '0.5'
   type: :development
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
     - - "~>"
       - !ruby/object:Gem::Version
-        version: 0.4.4
+        version: '0.5'
 - !ruby/object:Gem::Dependency
   name: rack
   requirement: !ruby/object:Gem::Requirement
@@ -95,6 +95,20 @@ dependencies:
     - - ">="
       - !ruby/object:Gem::Version
         version: '0'
+- !ruby/object:Gem::Dependency
+  name: pry
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
 description: Connection proxy for ActiveRecord for leader / replica setups.
 email: dan@kickstarter.com
 executables: []
@@ -123,7 +137,7 @@ homepage: https://github.com/kickstarter/replica_pools
 licenses:
 - MIT
 metadata: {}
-post_install_message: 
+post_install_message:
 rdoc_options: []
 require_paths:
 - lib
@@ -138,8 +152,8 @@ required_rubygems_version: !ruby/object:Gem::Requirement
     - !ruby/object:Gem::Version
       version: '1.2'
 requirements: []
-rubygems_version: 3.0.3
-signing_key: 
+rubygems_version: 3.1.6
+signing_key:
 specification_version: 4
 summary: Connection proxy for ActiveRecord for leader / replica setups.
 test_files: