slavery 1.0.0

Sign up to get free protection for your applications and to get access to all the features.
@@ -0,0 +1,20 @@
1
+ *.gem
2
+ *.rbc
3
+ .bundle
4
+ .config
5
+ .yardoc
6
+ Gemfile.lock
7
+ InstalledFiles
8
+ _yardoc
9
+ coverage
10
+ doc/
11
+ lib/bundler/man
12
+ pkg
13
+ rdoc
14
+ spec/reports
15
+ test/tmp
16
+ test/version_tmp
17
+ tmp
18
+
19
+ test_db
20
+ test_slave_db
data/.rspec ADDED
@@ -0,0 +1 @@
1
+ --color
data/Gemfile ADDED
@@ -0,0 +1,3 @@
1
+ source 'https://rubygems.org'
2
+
3
+ gemspec
@@ -0,0 +1,22 @@
1
+ Copyright (c) 2012 Kenn Ejima
2
+
3
+ MIT License
4
+
5
+ Permission is hereby granted, free of charge, to any person obtaining
6
+ a copy of this software and associated documentation files (the
7
+ "Software"), to deal in the Software without restriction, including
8
+ without limitation the rights to use, copy, modify, merge, publish,
9
+ distribute, sublicense, and/or sell copies of the Software, and to
10
+ permit persons to whom the Software is furnished to do so, subject to
11
+ the following conditions:
12
+
13
+ The above copyright notice and this permission notice shall be
14
+ included in all copies or substantial portions of the Software.
15
+
16
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
17
+ EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
18
+ MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
19
+ NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
20
+ LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
21
+ OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
22
+ WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
@@ -0,0 +1,108 @@
1
+ # Slavery - Simple, conservative slave read for ActiveRecord
2
+
3
+ Slavery is a simple, easy to use plugin for ActiveRecord that enables conservative slave reads, which means it doesn't automatically redirect all SELECTs to slaves. Instead, it lets you specify `Slavery.on_slave { User.count }` to send a particular query to a slave.
4
+
5
+ Probably you just start off with one single database. As your app grows, you would move to master-slave replication for redundancy. At this point, all queries still go to the master and slaves are just backups. With that configuration, it's tempting to run some long-running queries on the slave. And that's exactly what Slavery does.
6
+
7
+ * Conservative - Safe by default. Installing Slavery won't change your app's current behavior.
8
+ * Future proof - No dirty hacks, simply works as a proxy for `ActiveRecord::Base.connection`.
9
+ * Simple - Less than 100 LOC, you can read the entire source and completely stay in control.
10
+
11
+ Slavery works with ActiveRecord 3 or later.
12
+
13
+ ## Install
14
+
15
+ Add this line to your application's Gemfile:
16
+
17
+ ```ruby
18
+ gem 'slavery'
19
+ ```
20
+
21
+ And create slave configs for each environment.
22
+
23
+ ```yaml
24
+ development:
25
+ adapter: mysql2
26
+ username: root
27
+ database: myapp_development
28
+
29
+ development_slave:
30
+ adapter: mysql2
31
+ username: root
32
+ database: myapp_development
33
+ ```
34
+
35
+ By convention, config keys with `[env]_slave` are automatically used for slave reads.
36
+
37
+ Notice that you just copied the settings for `development` to `development_slave`. For `development` and `test`, it's actually recommended as probably you don't want to have replicating multiple databases on your machine. Two connections to the same identical database should be fine for testing purpose.
38
+
39
+ At this point, Slavery does nothing. Run tests and confirm that anything isn't broken.
40
+
41
+ ## Usage
42
+
43
+ To start using Slavery, you need to add `Slavery.on_slave` in your code. Queries in the `Slavery.on_slave` block run on the slave.
44
+
45
+ ```ruby
46
+ Slavery.on_slave { User.count } # => runs on slave
47
+ ```
48
+
49
+ You can nest `on_slave` and `on_master` interchangeably. The following code works as expected.
50
+
51
+ ```ruby
52
+ Slavery.on_slave do
53
+ ...
54
+ Slavery.on_master do
55
+ ...
56
+ end
57
+ ...
58
+ end
59
+ ```
60
+
61
+ ## Read-only user
62
+
63
+ For an extra safeguard, it is recommended to use a read-only user for slave access.
64
+
65
+ ```ruby
66
+ development_slave:
67
+ adapter: mysql2
68
+ username: readonly
69
+ database: myapp_development
70
+ ```
71
+
72
+ With MySQL, `GRANT SELECT` creates the user.
73
+
74
+ ```SQL
75
+ GRANT SELECT ON *.* TO 'readonly'@'localhost';
76
+ ```
77
+
78
+ With this setting, writes on slave should raises an exception.
79
+
80
+ ```ruby
81
+ Slavery.on_slave { User.create } # => ActiveRecord::StatementInvalid: Mysql2::Error: INSERT command denied...
82
+ ```
83
+
84
+ ## Database failure
85
+
86
+ When one of the master or the slave goes down, you would rewrite `database.yml` to make all queries go to the surviving database, until you recover or rebuild the failed one.
87
+
88
+ In such an event, you don't want to manually remove `Slavery.on_slave` from your code. Instead, just put the following line in `config/initializers/slavery.rb`.
89
+
90
+ ```ruby
91
+ Slavely.disabled = true
92
+ ```
93
+
94
+ With this line, Slavery stops connection switching and all queries go to the master database.
95
+
96
+ ## Support for non-Rails apps
97
+
98
+ If you're using ActiveRecord in a non-Rails app (e.g. Sinatra), be sure to set `Slavery.env` in the boot sequence.
99
+
100
+ ```ruby
101
+ Slavery.env = 'development'
102
+
103
+ ActiveRecord::Base.configurations = {
104
+ 'development' => { adapter: 'mysql2', ... },
105
+ 'development_slave' => { adapter: 'mysql2', ... }
106
+ }
107
+ ActiveRecord::Base.establish_connection(:development)
108
+ ```
@@ -0,0 +1,6 @@
1
+ require 'bundler/gem_tasks'
2
+
3
+ # RSpec
4
+ require 'rspec/core/rake_task'
5
+ RSpec::Core::RakeTask.new(:spec)
6
+ task :default => :spec
@@ -0,0 +1,89 @@
1
+ require 'slavery/version'
2
+ require 'slavery/railtie'
3
+ require 'active_record'
4
+ require 'active_support/core_ext/module/attribute_accessors'
5
+
6
+ module Slavery
7
+ extend ActiveSupport::Concern
8
+
9
+ included do
10
+ class << self
11
+ alias_method_chain :connection, :slavery
12
+ end
13
+ end
14
+
15
+ class Error < StandardError; end
16
+
17
+ mattr_accessor :disabled
18
+
19
+ module ModuleFunctions
20
+ def on_slave(&block)
21
+ ActiveRecord::Base.on_slave(&block)
22
+ end
23
+
24
+ def on_master(&block)
25
+ ActiveRecord::Base.on_master(&block)
26
+ end
27
+
28
+ def env
29
+ self.env = defined?(Rails) ? Rails.env.to_s : 'development' unless @env
30
+ @env
31
+ end
32
+
33
+ def env=(string)
34
+ @env = ActiveSupport::StringInquirer.new(string)
35
+ end
36
+ end
37
+ extend ModuleFunctions
38
+
39
+ module ClassMethods
40
+ def on_slave(&block)
41
+ with_slavery true, &block
42
+ end
43
+
44
+ def on_master(&block)
45
+ with_slavery false, &block
46
+ end
47
+
48
+ def with_slavery(new_value)
49
+ old_value = Thread.current[:on_slave] # Save for recursive nested calls
50
+ Thread.current[:on_slave] = new_value
51
+ yield
52
+ ensure
53
+ Thread.current[:on_slave] = old_value
54
+ end
55
+
56
+ def connection_with_slavery
57
+ if Thread.current[:on_slave] and slaveryable?
58
+ slave_connection
59
+ else
60
+ master_connection
61
+ end
62
+ end
63
+
64
+ def slaveryable?
65
+ inside_transaction = master_connection.open_transactions > 0
66
+ raise Error.new('on_slave cannot be used inside transaction block!') if inside_transaction
67
+
68
+ !Slavery.disabled
69
+ end
70
+
71
+ def master_connection
72
+ connection_without_slavery
73
+ end
74
+
75
+ def slave_connection
76
+ slave_connection_holder.connection_without_slavery
77
+ end
78
+
79
+ # Create an anonymous AR class to hold slave connection
80
+ def slave_connection_holder
81
+ @slave_connection_holder ||= Class.new(ActiveRecord::Base) {
82
+ self.abstract_class = true
83
+ establish_connection("#{Slavery.env}_slave")
84
+ }
85
+ rescue ActiveRecord::AdapterNotSpecified
86
+ raise Error.new("#{Slavery.env}_slave does not exist!")
87
+ end
88
+ end
89
+ end
@@ -0,0 +1,11 @@
1
+ module Slavery
2
+ if defined? Rails::Railtie
3
+ class Railtie < Rails::Railtie
4
+ initializer 'slavery.insert_into_active_record' do |app|
5
+ ActiveSupport.on_load :active_record do
6
+ include Slavery
7
+ end
8
+ end
9
+ end
10
+ end
11
+ end
@@ -0,0 +1,3 @@
1
+ module Slavery
2
+ VERSION = '1.0.0'
3
+ end
@@ -0,0 +1,25 @@
1
+ # -*- encoding: utf-8 -*-
2
+ lib = File.expand_path('../lib', __FILE__)
3
+ $LOAD_PATH.unshift(lib) unless $LOAD_PATH.include?(lib)
4
+ require 'slavery/version'
5
+
6
+ Gem::Specification.new do |gem|
7
+ gem.name = 'slavery'
8
+ gem.version = Slavery::VERSION
9
+ gem.authors = ['Kenn Ejima']
10
+ gem.email = ['kenn.ejima@gmail.com']
11
+ gem.description = %q{Selective slave read for ActiveRecord}
12
+ gem.summary = %q{Selective slave read for ActiveRecord}
13
+ gem.homepage = 'https://github.com/kenn/slavery'
14
+
15
+ gem.files = `git ls-files`.split($/)
16
+ gem.executables = gem.files.grep(%r{^bin/}).map{ |f| File.basename(f) }
17
+ gem.test_files = gem.files.grep(%r{^(test|spec|features)/})
18
+ gem.require_paths = ['lib']
19
+
20
+ gem.add_runtime_dependency 'activerecord', '>= 3.0.0'
21
+
22
+ gem.add_development_dependency 'mysql2'
23
+ gem.add_development_dependency 'rspec'
24
+ gem.add_development_dependency 'sqlite3'
25
+ end
@@ -0,0 +1,55 @@
1
+ require 'spec_helper'
2
+
3
+ describe Slavery do
4
+ def on_slave?
5
+ Thread.current[:on_slave]
6
+ end
7
+
8
+ it 'sets thread local' do
9
+ Slavery.on_master { on_slave?.should == false }
10
+ Slavery.on_slave { on_slave?.should == true }
11
+ end
12
+
13
+ it 'returns value from block' do
14
+ Slavery.on_master { User.count }.should == 2
15
+ Slavery.on_slave { User.count }.should == 1
16
+ end
17
+
18
+ it 'handles nested calls' do
19
+ # Slave -> Slave
20
+ Slavery.on_slave do
21
+ on_slave?.should == true
22
+
23
+ Slavery.on_slave do
24
+ on_slave?.should == true
25
+ end
26
+
27
+ on_slave?.should == true
28
+ end
29
+
30
+ # Slave -> Master
31
+ Slavery.on_slave do
32
+ on_slave?.should == true
33
+
34
+ Slavery.on_master do
35
+ on_slave?.should == false
36
+ end
37
+
38
+ on_slave?.should == true
39
+ end
40
+ end
41
+
42
+ it 'disables in transaction' do
43
+ User.transaction do
44
+ expect { User.slaveryable? }.to raise_error(Slavery::Error)
45
+ end
46
+ end
47
+
48
+ it 'disables by configuration' do
49
+ Slavery.stub(:disabled).and_return(false)
50
+ Slavery.on_slave { User.slaveryable?.should == true }
51
+
52
+ Slavery.stub(:disabled).and_return(true)
53
+ Slavery.on_slave { User.slaveryable?.should == false }
54
+ end
55
+ end
@@ -0,0 +1,33 @@
1
+ require 'rubygems'
2
+ require 'bundler/setup'
3
+
4
+ require 'slavery'
5
+
6
+ # Activate Slavery
7
+ ActiveRecord::Base.send(:include, Slavery)
8
+
9
+ # Prepare databases
10
+ class User < ActiveRecord::Base
11
+ end
12
+
13
+ # Should be equal to Rails.env
14
+ Slavery.env = 'test'
15
+
16
+ ActiveRecord::Base.configurations = {
17
+ 'test' => { adapter: 'sqlite3', database: 'test_db' },
18
+ 'test_slave' => { adapter: 'sqlite3', database: 'test_slave_db' }
19
+ }
20
+
21
+ # Create two records on master
22
+ ActiveRecord::Base.establish_connection(:test)
23
+ ActiveRecord::Base.connection.create_table :users, force: true
24
+ User.create
25
+ User.create
26
+
27
+ # Create one record on slave, emulating replication lag
28
+ ActiveRecord::Base.establish_connection(:test_slave)
29
+ ActiveRecord::Base.connection.create_table :users, force: true
30
+ User.create
31
+
32
+ # Reconnect to master
33
+ ActiveRecord::Base.establish_connection(:test)
metadata ADDED
@@ -0,0 +1,124 @@
1
+ --- !ruby/object:Gem::Specification
2
+ name: slavery
3
+ version: !ruby/object:Gem::Version
4
+ version: 1.0.0
5
+ prerelease:
6
+ platform: ruby
7
+ authors:
8
+ - Kenn Ejima
9
+ autorequire:
10
+ bindir: bin
11
+ cert_chain: []
12
+ date: 2012-09-20 00:00:00.000000000 Z
13
+ dependencies:
14
+ - !ruby/object:Gem::Dependency
15
+ name: activerecord
16
+ requirement: !ruby/object:Gem::Requirement
17
+ none: false
18
+ requirements:
19
+ - - ! '>='
20
+ - !ruby/object:Gem::Version
21
+ version: 3.0.0
22
+ type: :runtime
23
+ prerelease: false
24
+ version_requirements: !ruby/object:Gem::Requirement
25
+ none: false
26
+ requirements:
27
+ - - ! '>='
28
+ - !ruby/object:Gem::Version
29
+ version: 3.0.0
30
+ - !ruby/object:Gem::Dependency
31
+ name: mysql2
32
+ requirement: !ruby/object:Gem::Requirement
33
+ none: false
34
+ requirements:
35
+ - - ! '>='
36
+ - !ruby/object:Gem::Version
37
+ version: '0'
38
+ type: :development
39
+ prerelease: false
40
+ version_requirements: !ruby/object:Gem::Requirement
41
+ none: false
42
+ requirements:
43
+ - - ! '>='
44
+ - !ruby/object:Gem::Version
45
+ version: '0'
46
+ - !ruby/object:Gem::Dependency
47
+ name: rspec
48
+ requirement: !ruby/object:Gem::Requirement
49
+ none: false
50
+ requirements:
51
+ - - ! '>='
52
+ - !ruby/object:Gem::Version
53
+ version: '0'
54
+ type: :development
55
+ prerelease: false
56
+ version_requirements: !ruby/object:Gem::Requirement
57
+ none: false
58
+ requirements:
59
+ - - ! '>='
60
+ - !ruby/object:Gem::Version
61
+ version: '0'
62
+ - !ruby/object:Gem::Dependency
63
+ name: sqlite3
64
+ requirement: !ruby/object:Gem::Requirement
65
+ none: false
66
+ requirements:
67
+ - - ! '>='
68
+ - !ruby/object:Gem::Version
69
+ version: '0'
70
+ type: :development
71
+ prerelease: false
72
+ version_requirements: !ruby/object:Gem::Requirement
73
+ none: false
74
+ requirements:
75
+ - - ! '>='
76
+ - !ruby/object:Gem::Version
77
+ version: '0'
78
+ description: Selective slave read for ActiveRecord
79
+ email:
80
+ - kenn.ejima@gmail.com
81
+ executables: []
82
+ extensions: []
83
+ extra_rdoc_files: []
84
+ files:
85
+ - .gitignore
86
+ - .rspec
87
+ - Gemfile
88
+ - LICENSE.txt
89
+ - README.md
90
+ - Rakefile
91
+ - lib/slavery.rb
92
+ - lib/slavery/railtie.rb
93
+ - lib/slavery/version.rb
94
+ - slavery.gemspec
95
+ - spec/slavery_spec.rb
96
+ - spec/spec_helper.rb
97
+ homepage: https://github.com/kenn/slavery
98
+ licenses: []
99
+ post_install_message:
100
+ rdoc_options: []
101
+ require_paths:
102
+ - lib
103
+ required_ruby_version: !ruby/object:Gem::Requirement
104
+ none: false
105
+ requirements:
106
+ - - ! '>='
107
+ - !ruby/object:Gem::Version
108
+ version: '0'
109
+ required_rubygems_version: !ruby/object:Gem::Requirement
110
+ none: false
111
+ requirements:
112
+ - - ! '>='
113
+ - !ruby/object:Gem::Version
114
+ version: '0'
115
+ requirements: []
116
+ rubyforge_project:
117
+ rubygems_version: 1.8.19
118
+ signing_key:
119
+ specification_version: 3
120
+ summary: Selective slave read for ActiveRecord
121
+ test_files:
122
+ - spec/slavery_spec.rb
123
+ - spec/spec_helper.rb
124
+ has_rdoc: