ar-octopus 0.6.0 → 0.6.1
Sign up to get free protection for your applications and to get access to all the features.
- data/.gitignore +1 -1
- data/.travis.yml +7 -6
- data/README.mkdn +1 -1
- data/Rakefile +21 -1
- data/gemfiles/rails30.gemfile +8 -0
- data/gemfiles/rails31.gemfile +7 -0
- data/gemfiles/rails32.gemfile +7 -0
- data/lib/octopus.rb +4 -1
- data/lib/octopus/model.rb +15 -0
- data/lib/octopus/version.rb +1 -1
- data/sample_app/Gemfile +9 -10
- data/sample_app/README.rdoc +261 -0
- data/sample_app/Rakefile +2 -2
- data/sample_app/app/assets/images/rails.png +0 -0
- data/sample_app/app/assets/javascripts/application.js +15 -0
- data/sample_app/app/assets/stylesheets/application.css +13 -0
- data/sample_app/app/mailers/.gitkeep +0 -0
- data/sample_app/app/models/.gitkeep +0 -0
- data/sample_app/config/application.rb +30 -14
- data/sample_app/config/boot.rb +3 -10
- data/sample_app/config/database.yml +18 -15
- data/sample_app/config/environments/development.rb +22 -4
- data/sample_app/config/environments/production.rb +35 -14
- data/sample_app/config/environments/test.rb +13 -8
- data/sample_app/config/initializers/inflections.rb +5 -0
- data/sample_app/config/initializers/secret_token.rb +1 -1
- data/sample_app/config/initializers/session_store.rb +3 -3
- data/sample_app/config/initializers/wrap_parameters.rb +14 -0
- data/sample_app/config/locales/en.yml +1 -1
- data/sample_app/config/routes.rb +1 -1
- data/sample_app/db/schema.rb +7 -8
- data/sample_app/features/support/database.rb +13 -0
- data/sample_app/features/support/env.rb +43 -58
- data/sample_app/lib/assets/.gitkeep +0 -0
- data/sample_app/lib/tasks/cucumber.rake +15 -3
- data/sample_app/log/.gitkeep +0 -0
- data/sample_app/vendor/assets/javascripts/.gitkeep +0 -0
- data/sample_app/vendor/assets/stylesheets/.gitkeep +0 -0
- data/spec/octopus/association_spec.rb +1 -1
- data/spec/octopus/octopus_spec.rb +4 -4
- data/spec/octopus/proxy_spec.rb +40 -7
- data/spec/octopus/replication_spec.rb +1 -1
- data/spec/octopus/sharded_spec.rb +1 -1
- data/spec/spec_helper.rb +0 -2
- data/spec/support/database_models.rb +21 -0
- data/spec/support/octopus_helper.rb +7 -1
- metadata +175 -156
- data/sample_app/test/performance/browsing_test.rb +0 -9
- data/sample_app/test/test_helper.rb +0 -13
data/.gitignore
CHANGED
data/.travis.yml
CHANGED
@@ -2,17 +2,13 @@ language: ruby
|
|
2
2
|
env:
|
3
3
|
- CI=true
|
4
4
|
before_script:
|
5
|
-
|
6
|
-
- "bundle exec rake db:prepare"
|
7
|
-
bundler_args: --without development
|
8
|
-
|
5
|
+
- "bundle exec rake db:prepare"
|
9
6
|
rvm:
|
10
7
|
- 1.8.7
|
11
8
|
- 1.9.3
|
12
9
|
|
13
10
|
gemfile:
|
14
|
-
- gemfiles/
|
15
|
-
- gemfiles/rails3.gemfile
|
11
|
+
- gemfiles/rails30.gemfile
|
16
12
|
- gemfiles/rails31.gemfile
|
17
13
|
- gemfiles/rails32.gemfile
|
18
14
|
|
@@ -20,3 +16,8 @@ notifications:
|
|
20
16
|
recipients:
|
21
17
|
- gabriel.sobrinho@gmail.com
|
22
18
|
- thiago.pradi@gmail.com
|
19
|
+
|
20
|
+
matrix:
|
21
|
+
include:
|
22
|
+
- rvm: 2.0.0
|
23
|
+
gemfile: gemfiles/rails32.gemfile
|
data/README.mkdn
CHANGED
@@ -1,6 +1,6 @@
|
|
1
1
|
# Octopus - Easy Database Sharding for ActiveRecord
|
2
2
|
|
3
|
-
[![Build Status](https://travis-ci.org/tchandy/octopus.png)](https://travis-ci.org/tchandy/octopus) [![Code Climate](https://codeclimate.com/badge.png)](https://codeclimate.com/github/tchandy/octopus)
|
3
|
+
<a href='http://www.pledgie.com/campaigns/20950'><img alt='Click here to lend your support to: Octopus and make a donation at www.pledgie.com !' src='http://www.pledgie.com/campaigns/20950.png?skin_name=chrome' border='0' /></a> [![Build Status](https://travis-ci.org/tchandy/octopus.png)](https://travis-ci.org/tchandy/octopus) [![Code Climate](https://codeclimate.com/badge.png)](https://codeclimate.com/github/tchandy/octopus)
|
4
4
|
|
5
5
|
Octopus is a better way to do Database Sharding in ActiveRecord. Sharding allows multiple databases in the same rails application. While there are several projects that implement Sharding (e.g. DbCharmer, DataFabric, MultiDb), each project has its own limitations. The main goal of octopus project is to provide a better way of doing Database Sharding.
|
6
6
|
|
data/Rakefile
CHANGED
@@ -56,7 +56,9 @@ namespace :db do
|
|
56
56
|
# Require the database connection
|
57
57
|
require "#{File.dirname(__FILE__)}/spec/support/database_connection"
|
58
58
|
|
59
|
-
[:master, :brazil, :canada, :russia, :alone_shard, :postgresql_shard, :sqlite_shard
|
59
|
+
shard_symbols = [:master, :brazil, :canada, :russia, :alone_shard, :postgresql_shard, :sqlite_shard]
|
60
|
+
shard_symbols << :protocol_shard if Octopus.rails32?
|
61
|
+
shard_symbols.each do |shard_symbol|
|
60
62
|
# Rails 3.1 needs to do some introspection around the base class, which requires
|
61
63
|
# the model be a descendent of ActiveRecord::Base.
|
62
64
|
class BlankModel < ActiveRecord::Base; end;
|
@@ -138,6 +140,24 @@ namespace :db do
|
|
138
140
|
BlankModel.using(shard_symbol).connection.create_table(:adverts) do |u|
|
139
141
|
u.string :name
|
140
142
|
end
|
143
|
+
|
144
|
+
if shard_symbol == :alone_shard
|
145
|
+
BlankModel.using(shard_symbol).connection.create_table(:mmorpg_players) do |u|
|
146
|
+
u.string :player_name
|
147
|
+
end
|
148
|
+
|
149
|
+
BlankModel.using(shard_symbol).connection.create_table(:weapons) do |u|
|
150
|
+
u.integer :mmorpg_player_id
|
151
|
+
u.string :name
|
152
|
+
u.string :hand
|
153
|
+
end
|
154
|
+
|
155
|
+
BlankModel.using(shard_symbol).connection.create_table(:skills) do |u|
|
156
|
+
u.integer :mmorpg_player_id
|
157
|
+
u.integer :weapon_id
|
158
|
+
u.string :name
|
159
|
+
end
|
160
|
+
end
|
141
161
|
end
|
142
162
|
end
|
143
163
|
|
data/lib/octopus.rb
CHANGED
@@ -105,7 +105,10 @@ require "octopus/association"
|
|
105
105
|
require "octopus/rails3/persistence"
|
106
106
|
require "octopus/rails3/log_subscriber"
|
107
107
|
require "octopus/rails3/abstract_adapter"
|
108
|
-
|
108
|
+
|
109
|
+
if defined?(::Rails)
|
110
|
+
require "octopus/railtie"
|
111
|
+
end
|
109
112
|
|
110
113
|
if Octopus.rails30?
|
111
114
|
require "octopus/rails3.0/arel"
|
data/lib/octopus/model.rb
CHANGED
@@ -86,6 +86,9 @@ module Octopus::Model
|
|
86
86
|
base.send(:alias_method, :equality_without_octopus, :==)
|
87
87
|
base.send(:alias_method, :==, :equality_with_octopus)
|
88
88
|
base.send(:alias_method, :eql?, :==)
|
89
|
+
if !Octopus.rails30? and !Octopus.rails31?
|
90
|
+
base.send(:alias_method_chain, :perform_validations, :octopus)
|
91
|
+
end
|
89
92
|
end
|
90
93
|
|
91
94
|
def should_set_current_shard?
|
@@ -109,6 +112,18 @@ module Octopus::Model
|
|
109
112
|
def equality_with_octopus(comparison_object)
|
110
113
|
equality_without_octopus(comparison_object) && comparison_object.current_shard == current_shard
|
111
114
|
end
|
115
|
+
|
116
|
+
if !Octopus.rails30? and !Octopus.rails31?
|
117
|
+
def perform_validations_with_octopus(*args)
|
118
|
+
if Octopus.enabled? and should_set_current_shard?
|
119
|
+
Octopus.using(self.current_shard) do
|
120
|
+
perform_validations_without_octopus(*args)
|
121
|
+
end
|
122
|
+
else
|
123
|
+
perform_validations_without_octopus(*args)
|
124
|
+
end
|
125
|
+
end
|
126
|
+
end
|
112
127
|
end
|
113
128
|
|
114
129
|
module ClassMethods
|
data/lib/octopus/version.rb
CHANGED
data/sample_app/Gemfile
CHANGED
@@ -1,21 +1,20 @@
|
|
1
|
-
source
|
1
|
+
source 'https://rubygems.org'
|
2
2
|
|
3
|
-
gem 'rails', '3.
|
3
|
+
gem 'rails', '3.2.13'
|
4
4
|
|
5
5
|
# Bundle edge Rails instead:
|
6
6
|
# gem 'rails', :git => 'git://github.com/rails/rails.git'
|
7
7
|
|
8
|
-
gem '
|
9
|
-
gem '
|
8
|
+
gem 'pg'
|
9
|
+
gem 'sqlite3'
|
10
|
+
gem 'ar-octopus', '0.6.0'
|
11
|
+
gem 'pry'
|
10
12
|
|
11
13
|
group :test do
|
12
14
|
gem 'capybara'
|
13
|
-
gem '
|
14
|
-
gem 'cucumber-rails'
|
15
|
-
gem 'cucumber'
|
16
|
-
gem 'spork'
|
15
|
+
gem 'cucumber-rails', :require => false
|
17
16
|
gem 'launchy'
|
18
|
-
gem "rspec-rails"
|
19
|
-
gem 'ruby-debug' if RUBY_VERSION < "1.9"
|
17
|
+
gem "rspec-rails"
|
20
18
|
gem "aruba"
|
19
|
+
gem "database_cleaner"
|
21
20
|
end
|
@@ -0,0 +1,261 @@
|
|
1
|
+
== Welcome to Rails
|
2
|
+
|
3
|
+
Rails is a web-application framework that includes everything needed to create
|
4
|
+
database-backed web applications according to the Model-View-Control pattern.
|
5
|
+
|
6
|
+
This pattern splits the view (also called the presentation) into "dumb"
|
7
|
+
templates that are primarily responsible for inserting pre-built data in between
|
8
|
+
HTML tags. The model contains the "smart" domain objects (such as Account,
|
9
|
+
Product, Person, Post) that holds all the business logic and knows how to
|
10
|
+
persist themselves to a database. The controller handles the incoming requests
|
11
|
+
(such as Save New Account, Update Product, Show Post) by manipulating the model
|
12
|
+
and directing data to the view.
|
13
|
+
|
14
|
+
In Rails, the model is handled by what's called an object-relational mapping
|
15
|
+
layer entitled Active Record. This layer allows you to present the data from
|
16
|
+
database rows as objects and embellish these data objects with business logic
|
17
|
+
methods. You can read more about Active Record in
|
18
|
+
link:files/vendor/rails/activerecord/README.html.
|
19
|
+
|
20
|
+
The controller and view are handled by the Action Pack, which handles both
|
21
|
+
layers by its two parts: Action View and Action Controller. These two layers
|
22
|
+
are bundled in a single package due to their heavy interdependence. This is
|
23
|
+
unlike the relationship between the Active Record and Action Pack that is much
|
24
|
+
more separate. Each of these packages can be used independently outside of
|
25
|
+
Rails. You can read more about Action Pack in
|
26
|
+
link:files/vendor/rails/actionpack/README.html.
|
27
|
+
|
28
|
+
|
29
|
+
== Getting Started
|
30
|
+
|
31
|
+
1. At the command prompt, create a new Rails application:
|
32
|
+
<tt>rails new myapp</tt> (where <tt>myapp</tt> is the application name)
|
33
|
+
|
34
|
+
2. Change directory to <tt>myapp</tt> and start the web server:
|
35
|
+
<tt>cd myapp; rails server</tt> (run with --help for options)
|
36
|
+
|
37
|
+
3. Go to http://localhost:3000/ and you'll see:
|
38
|
+
"Welcome aboard: You're riding Ruby on Rails!"
|
39
|
+
|
40
|
+
4. Follow the guidelines to start developing your application. You can find
|
41
|
+
the following resources handy:
|
42
|
+
|
43
|
+
* The Getting Started Guide: http://guides.rubyonrails.org/getting_started.html
|
44
|
+
* Ruby on Rails Tutorial Book: http://www.railstutorial.org/
|
45
|
+
|
46
|
+
|
47
|
+
== Debugging Rails
|
48
|
+
|
49
|
+
Sometimes your application goes wrong. Fortunately there are a lot of tools that
|
50
|
+
will help you debug it and get it back on the rails.
|
51
|
+
|
52
|
+
First area to check is the application log files. Have "tail -f" commands
|
53
|
+
running on the server.log and development.log. Rails will automatically display
|
54
|
+
debugging and runtime information to these files. Debugging info will also be
|
55
|
+
shown in the browser on requests from 127.0.0.1.
|
56
|
+
|
57
|
+
You can also log your own messages directly into the log file from your code
|
58
|
+
using the Ruby logger class from inside your controllers. Example:
|
59
|
+
|
60
|
+
class WeblogController < ActionController::Base
|
61
|
+
def destroy
|
62
|
+
@weblog = Weblog.find(params[:id])
|
63
|
+
@weblog.destroy
|
64
|
+
logger.info("#{Time.now} Destroyed Weblog ID ##{@weblog.id}!")
|
65
|
+
end
|
66
|
+
end
|
67
|
+
|
68
|
+
The result will be a message in your log file along the lines of:
|
69
|
+
|
70
|
+
Mon Oct 08 14:22:29 +1000 2007 Destroyed Weblog ID #1!
|
71
|
+
|
72
|
+
More information on how to use the logger is at http://www.ruby-doc.org/core/
|
73
|
+
|
74
|
+
Also, Ruby documentation can be found at http://www.ruby-lang.org/. There are
|
75
|
+
several books available online as well:
|
76
|
+
|
77
|
+
* Programming Ruby: http://www.ruby-doc.org/docs/ProgrammingRuby/ (Pickaxe)
|
78
|
+
* Learn to Program: http://pine.fm/LearnToProgram/ (a beginners guide)
|
79
|
+
|
80
|
+
These two books will bring you up to speed on the Ruby language and also on
|
81
|
+
programming in general.
|
82
|
+
|
83
|
+
|
84
|
+
== Debugger
|
85
|
+
|
86
|
+
Debugger support is available through the debugger command when you start your
|
87
|
+
Mongrel or WEBrick server with --debugger. This means that you can break out of
|
88
|
+
execution at any point in the code, investigate and change the model, and then,
|
89
|
+
resume execution! You need to install ruby-debug to run the server in debugging
|
90
|
+
mode. With gems, use <tt>sudo gem install ruby-debug</tt>. Example:
|
91
|
+
|
92
|
+
class WeblogController < ActionController::Base
|
93
|
+
def index
|
94
|
+
@posts = Post.all
|
95
|
+
debugger
|
96
|
+
end
|
97
|
+
end
|
98
|
+
|
99
|
+
So the controller will accept the action, run the first line, then present you
|
100
|
+
with a IRB prompt in the server window. Here you can do things like:
|
101
|
+
|
102
|
+
>> @posts.inspect
|
103
|
+
=> "[#<Post:0x14a6be8
|
104
|
+
@attributes={"title"=>nil, "body"=>nil, "id"=>"1"}>,
|
105
|
+
#<Post:0x14a6620
|
106
|
+
@attributes={"title"=>"Rails", "body"=>"Only ten..", "id"=>"2"}>]"
|
107
|
+
>> @posts.first.title = "hello from a debugger"
|
108
|
+
=> "hello from a debugger"
|
109
|
+
|
110
|
+
...and even better, you can examine how your runtime objects actually work:
|
111
|
+
|
112
|
+
>> f = @posts.first
|
113
|
+
=> #<Post:0x13630c4 @attributes={"title"=>nil, "body"=>nil, "id"=>"1"}>
|
114
|
+
>> f.
|
115
|
+
Display all 152 possibilities? (y or n)
|
116
|
+
|
117
|
+
Finally, when you're ready to resume execution, you can enter "cont".
|
118
|
+
|
119
|
+
|
120
|
+
== Console
|
121
|
+
|
122
|
+
The console is a Ruby shell, which allows you to interact with your
|
123
|
+
application's domain model. Here you'll have all parts of the application
|
124
|
+
configured, just like it is when the application is running. You can inspect
|
125
|
+
domain models, change values, and save to the database. Starting the script
|
126
|
+
without arguments will launch it in the development environment.
|
127
|
+
|
128
|
+
To start the console, run <tt>rails console</tt> from the application
|
129
|
+
directory.
|
130
|
+
|
131
|
+
Options:
|
132
|
+
|
133
|
+
* Passing the <tt>-s, --sandbox</tt> argument will rollback any modifications
|
134
|
+
made to the database.
|
135
|
+
* Passing an environment name as an argument will load the corresponding
|
136
|
+
environment. Example: <tt>rails console production</tt>.
|
137
|
+
|
138
|
+
To reload your controllers and models after launching the console run
|
139
|
+
<tt>reload!</tt>
|
140
|
+
|
141
|
+
More information about irb can be found at:
|
142
|
+
link:http://www.rubycentral.org/pickaxe/irb.html
|
143
|
+
|
144
|
+
|
145
|
+
== dbconsole
|
146
|
+
|
147
|
+
You can go to the command line of your database directly through <tt>rails
|
148
|
+
dbconsole</tt>. You would be connected to the database with the credentials
|
149
|
+
defined in database.yml. Starting the script without arguments will connect you
|
150
|
+
to the development database. Passing an argument will connect you to a different
|
151
|
+
database, like <tt>rails dbconsole production</tt>. Currently works for MySQL,
|
152
|
+
PostgreSQL and SQLite 3.
|
153
|
+
|
154
|
+
== Description of Contents
|
155
|
+
|
156
|
+
The default directory structure of a generated Ruby on Rails application:
|
157
|
+
|
158
|
+
|-- app
|
159
|
+
| |-- assets
|
160
|
+
| | |-- images
|
161
|
+
| | |-- javascripts
|
162
|
+
| | `-- stylesheets
|
163
|
+
| |-- controllers
|
164
|
+
| |-- helpers
|
165
|
+
| |-- mailers
|
166
|
+
| |-- models
|
167
|
+
| `-- views
|
168
|
+
| `-- layouts
|
169
|
+
|-- config
|
170
|
+
| |-- environments
|
171
|
+
| |-- initializers
|
172
|
+
| `-- locales
|
173
|
+
|-- db
|
174
|
+
|-- doc
|
175
|
+
|-- lib
|
176
|
+
| |-- assets
|
177
|
+
| `-- tasks
|
178
|
+
|-- log
|
179
|
+
|-- public
|
180
|
+
|-- script
|
181
|
+
|-- test
|
182
|
+
| |-- fixtures
|
183
|
+
| |-- functional
|
184
|
+
| |-- integration
|
185
|
+
| |-- performance
|
186
|
+
| `-- unit
|
187
|
+
|-- tmp
|
188
|
+
| `-- cache
|
189
|
+
| `-- assets
|
190
|
+
`-- vendor
|
191
|
+
|-- assets
|
192
|
+
| |-- javascripts
|
193
|
+
| `-- stylesheets
|
194
|
+
`-- plugins
|
195
|
+
|
196
|
+
app
|
197
|
+
Holds all the code that's specific to this particular application.
|
198
|
+
|
199
|
+
app/assets
|
200
|
+
Contains subdirectories for images, stylesheets, and JavaScript files.
|
201
|
+
|
202
|
+
app/controllers
|
203
|
+
Holds controllers that should be named like weblogs_controller.rb for
|
204
|
+
automated URL mapping. All controllers should descend from
|
205
|
+
ApplicationController which itself descends from ActionController::Base.
|
206
|
+
|
207
|
+
app/models
|
208
|
+
Holds models that should be named like post.rb. Models descend from
|
209
|
+
ActiveRecord::Base by default.
|
210
|
+
|
211
|
+
app/views
|
212
|
+
Holds the template files for the view that should be named like
|
213
|
+
weblogs/index.html.erb for the WeblogsController#index action. All views use
|
214
|
+
eRuby syntax by default.
|
215
|
+
|
216
|
+
app/views/layouts
|
217
|
+
Holds the template files for layouts to be used with views. This models the
|
218
|
+
common header/footer method of wrapping views. In your views, define a layout
|
219
|
+
using the <tt>layout :default</tt> and create a file named default.html.erb.
|
220
|
+
Inside default.html.erb, call <% yield %> to render the view using this
|
221
|
+
layout.
|
222
|
+
|
223
|
+
app/helpers
|
224
|
+
Holds view helpers that should be named like weblogs_helper.rb. These are
|
225
|
+
generated for you automatically when using generators for controllers.
|
226
|
+
Helpers can be used to wrap functionality for your views into methods.
|
227
|
+
|
228
|
+
config
|
229
|
+
Configuration files for the Rails environment, the routing map, the database,
|
230
|
+
and other dependencies.
|
231
|
+
|
232
|
+
db
|
233
|
+
Contains the database schema in schema.rb. db/migrate contains all the
|
234
|
+
sequence of Migrations for your schema.
|
235
|
+
|
236
|
+
doc
|
237
|
+
This directory is where your application documentation will be stored when
|
238
|
+
generated using <tt>rake doc:app</tt>
|
239
|
+
|
240
|
+
lib
|
241
|
+
Application specific libraries. Basically, any kind of custom code that
|
242
|
+
doesn't belong under controllers, models, or helpers. This directory is in
|
243
|
+
the load path.
|
244
|
+
|
245
|
+
public
|
246
|
+
The directory available for the web server. Also contains the dispatchers and the
|
247
|
+
default HTML files. This should be set as the DOCUMENT_ROOT of your web
|
248
|
+
server.
|
249
|
+
|
250
|
+
script
|
251
|
+
Helper scripts for automation and generation.
|
252
|
+
|
253
|
+
test
|
254
|
+
Unit and functional tests along with fixtures. When using the rails generate
|
255
|
+
command, template test files will be generated for you and placed in this
|
256
|
+
directory.
|
257
|
+
|
258
|
+
vendor
|
259
|
+
External libraries that the application depends on. Also includes the plugins
|
260
|
+
subdirectory. If the app has frozen rails, those gems also go here, under
|
261
|
+
vendor/rails/. This directory is in the load path.
|