ar-octopus 0.6.0 → 0.6.1

Sign up to get free protection for your applications and to get access to all the features.
Files changed (49) hide show
  1. data/.gitignore +1 -1
  2. data/.travis.yml +7 -6
  3. data/README.mkdn +1 -1
  4. data/Rakefile +21 -1
  5. data/gemfiles/rails30.gemfile +8 -0
  6. data/gemfiles/rails31.gemfile +7 -0
  7. data/gemfiles/rails32.gemfile +7 -0
  8. data/lib/octopus.rb +4 -1
  9. data/lib/octopus/model.rb +15 -0
  10. data/lib/octopus/version.rb +1 -1
  11. data/sample_app/Gemfile +9 -10
  12. data/sample_app/README.rdoc +261 -0
  13. data/sample_app/Rakefile +2 -2
  14. data/sample_app/app/assets/images/rails.png +0 -0
  15. data/sample_app/app/assets/javascripts/application.js +15 -0
  16. data/sample_app/app/assets/stylesheets/application.css +13 -0
  17. data/sample_app/app/mailers/.gitkeep +0 -0
  18. data/sample_app/app/models/.gitkeep +0 -0
  19. data/sample_app/config/application.rb +30 -14
  20. data/sample_app/config/boot.rb +3 -10
  21. data/sample_app/config/database.yml +18 -15
  22. data/sample_app/config/environments/development.rb +22 -4
  23. data/sample_app/config/environments/production.rb +35 -14
  24. data/sample_app/config/environments/test.rb +13 -8
  25. data/sample_app/config/initializers/inflections.rb +5 -0
  26. data/sample_app/config/initializers/secret_token.rb +1 -1
  27. data/sample_app/config/initializers/session_store.rb +3 -3
  28. data/sample_app/config/initializers/wrap_parameters.rb +14 -0
  29. data/sample_app/config/locales/en.yml +1 -1
  30. data/sample_app/config/routes.rb +1 -1
  31. data/sample_app/db/schema.rb +7 -8
  32. data/sample_app/features/support/database.rb +13 -0
  33. data/sample_app/features/support/env.rb +43 -58
  34. data/sample_app/lib/assets/.gitkeep +0 -0
  35. data/sample_app/lib/tasks/cucumber.rake +15 -3
  36. data/sample_app/log/.gitkeep +0 -0
  37. data/sample_app/vendor/assets/javascripts/.gitkeep +0 -0
  38. data/sample_app/vendor/assets/stylesheets/.gitkeep +0 -0
  39. data/spec/octopus/association_spec.rb +1 -1
  40. data/spec/octopus/octopus_spec.rb +4 -4
  41. data/spec/octopus/proxy_spec.rb +40 -7
  42. data/spec/octopus/replication_spec.rb +1 -1
  43. data/spec/octopus/sharded_spec.rb +1 -1
  44. data/spec/spec_helper.rb +0 -2
  45. data/spec/support/database_models.rb +21 -0
  46. data/spec/support/octopus_helper.rb +7 -1
  47. metadata +175 -156
  48. data/sample_app/test/performance/browsing_test.rb +0 -9
  49. data/sample_app/test/test_helper.rb +0 -13
data/.gitignore CHANGED
@@ -3,7 +3,7 @@
3
3
  .bundle
4
4
  .rvmrc
5
5
  Gemfile.lock
6
- gemfiles/*
6
+ gemfiles/*.lock
7
7
  pkg/*
8
8
  *.rbc
9
9
  tmp/*
@@ -2,17 +2,13 @@ language: ruby
2
2
  env:
3
3
  - CI=true
4
4
  before_script:
5
- - "bundle install"
6
- - "bundle exec rake db:prepare"
7
- bundler_args: --without development
8
-
5
+ - "bundle exec rake db:prepare"
9
6
  rvm:
10
7
  - 1.8.7
11
8
  - 1.9.3
12
9
 
13
10
  gemfile:
14
- - gemfiles/rails2.gemfile
15
- - gemfiles/rails3.gemfile
11
+ - gemfiles/rails30.gemfile
16
12
  - gemfiles/rails31.gemfile
17
13
  - gemfiles/rails32.gemfile
18
14
 
@@ -20,3 +16,8 @@ notifications:
20
16
  recipients:
21
17
  - gabriel.sobrinho@gmail.com
22
18
  - thiago.pradi@gmail.com
19
+
20
+ matrix:
21
+ include:
22
+ - rvm: 2.0.0
23
+ gemfile: gemfiles/rails32.gemfile
@@ -1,6 +1,6 @@
1
1
  # Octopus - Easy Database Sharding for ActiveRecord
2
2
 
3
- [![Build Status](https://travis-ci.org/tchandy/octopus.png)](https://travis-ci.org/tchandy/octopus) [![Code Climate](https://codeclimate.com/badge.png)](https://codeclimate.com/github/tchandy/octopus)
3
+ <a href='http://www.pledgie.com/campaigns/20950'><img alt='Click here to lend your support to: Octopus and make a donation at www.pledgie.com !' src='http://www.pledgie.com/campaigns/20950.png?skin_name=chrome' border='0' /></a> [![Build Status](https://travis-ci.org/tchandy/octopus.png)](https://travis-ci.org/tchandy/octopus) [![Code Climate](https://codeclimate.com/badge.png)](https://codeclimate.com/github/tchandy/octopus)
4
4
 
5
5
  Octopus is a better way to do Database Sharding in ActiveRecord. Sharding allows multiple databases in the same rails application. While there are several projects that implement Sharding (e.g. DbCharmer, DataFabric, MultiDb), each project has its own limitations. The main goal of octopus project is to provide a better way of doing Database Sharding.
6
6
 
data/Rakefile CHANGED
@@ -56,7 +56,9 @@ namespace :db do
56
56
  # Require the database connection
57
57
  require "#{File.dirname(__FILE__)}/spec/support/database_connection"
58
58
 
59
- [:master, :brazil, :canada, :russia, :alone_shard, :postgresql_shard, :sqlite_shard, :protocol_shard].each do |shard_symbol|
59
+ shard_symbols = [:master, :brazil, :canada, :russia, :alone_shard, :postgresql_shard, :sqlite_shard]
60
+ shard_symbols << :protocol_shard if Octopus.rails32?
61
+ shard_symbols.each do |shard_symbol|
60
62
  # Rails 3.1 needs to do some introspection around the base class, which requires
61
63
  # the model be a descendent of ActiveRecord::Base.
62
64
  class BlankModel < ActiveRecord::Base; end;
@@ -138,6 +140,24 @@ namespace :db do
138
140
  BlankModel.using(shard_symbol).connection.create_table(:adverts) do |u|
139
141
  u.string :name
140
142
  end
143
+
144
+ if shard_symbol == :alone_shard
145
+ BlankModel.using(shard_symbol).connection.create_table(:mmorpg_players) do |u|
146
+ u.string :player_name
147
+ end
148
+
149
+ BlankModel.using(shard_symbol).connection.create_table(:weapons) do |u|
150
+ u.integer :mmorpg_player_id
151
+ u.string :name
152
+ u.string :hand
153
+ end
154
+
155
+ BlankModel.using(shard_symbol).connection.create_table(:skills) do |u|
156
+ u.integer :mmorpg_player_id
157
+ u.integer :weapon_id
158
+ u.string :name
159
+ end
160
+ end
141
161
  end
142
162
  end
143
163
 
@@ -0,0 +1,8 @@
1
+ # This file was generated by Appraisal
2
+
3
+ source "https://rubygems.org"
4
+
5
+ gem "activerecord", "~> 3.0.11"
6
+ gem "mysql2", "< 0.3"
7
+
8
+ gemspec :path=>"../"
@@ -0,0 +1,7 @@
1
+ # This file was generated by Appraisal
2
+
3
+ source "https://rubygems.org"
4
+
5
+ gem "activerecord", "~> 3.1.3"
6
+
7
+ gemspec :path=>"../"
@@ -0,0 +1,7 @@
1
+ # This file was generated by Appraisal
2
+
3
+ source "https://rubygems.org"
4
+
5
+ gem "activerecord", "~> 3.2.0"
6
+
7
+ gemspec :path=>"../"
@@ -105,7 +105,10 @@ require "octopus/association"
105
105
  require "octopus/rails3/persistence"
106
106
  require "octopus/rails3/log_subscriber"
107
107
  require "octopus/rails3/abstract_adapter"
108
- require "octopus/railtie"
108
+
109
+ if defined?(::Rails)
110
+ require "octopus/railtie"
111
+ end
109
112
 
110
113
  if Octopus.rails30?
111
114
  require "octopus/rails3.0/arel"
@@ -86,6 +86,9 @@ module Octopus::Model
86
86
  base.send(:alias_method, :equality_without_octopus, :==)
87
87
  base.send(:alias_method, :==, :equality_with_octopus)
88
88
  base.send(:alias_method, :eql?, :==)
89
+ if !Octopus.rails30? and !Octopus.rails31?
90
+ base.send(:alias_method_chain, :perform_validations, :octopus)
91
+ end
89
92
  end
90
93
 
91
94
  def should_set_current_shard?
@@ -109,6 +112,18 @@ module Octopus::Model
109
112
  def equality_with_octopus(comparison_object)
110
113
  equality_without_octopus(comparison_object) && comparison_object.current_shard == current_shard
111
114
  end
115
+
116
+ if !Octopus.rails30? and !Octopus.rails31?
117
+ def perform_validations_with_octopus(*args)
118
+ if Octopus.enabled? and should_set_current_shard?
119
+ Octopus.using(self.current_shard) do
120
+ perform_validations_without_octopus(*args)
121
+ end
122
+ else
123
+ perform_validations_without_octopus(*args)
124
+ end
125
+ end
126
+ end
112
127
  end
113
128
 
114
129
  module ClassMethods
@@ -1,3 +1,3 @@
1
1
  module Octopus
2
- VERSION = '0.6.0'
2
+ VERSION = '0.6.1'
3
3
  end
@@ -1,21 +1,20 @@
1
- source :rubygems
1
+ source 'https://rubygems.org'
2
2
 
3
- gem 'rails', '3.0.5'
3
+ gem 'rails', '3.2.13'
4
4
 
5
5
  # Bundle edge Rails instead:
6
6
  # gem 'rails', :git => 'git://github.com/rails/rails.git'
7
7
 
8
- gem 'sqlite3-ruby', :require => 'sqlite3'
9
- gem 'ar-octopus', :git => 'git://github.com/tchandy/octopus.git', :require => "octopus"
8
+ gem 'pg'
9
+ gem 'sqlite3'
10
+ gem 'ar-octopus', '0.6.0'
11
+ gem 'pry'
10
12
 
11
13
  group :test do
12
14
  gem 'capybara'
13
- gem 'database_cleaner'
14
- gem 'cucumber-rails'
15
- gem 'cucumber'
16
- gem 'spork'
15
+ gem 'cucumber-rails', :require => false
17
16
  gem 'launchy'
18
- gem "rspec-rails", ">= 2.0.0.beta.16"
19
- gem 'ruby-debug' if RUBY_VERSION < "1.9"
17
+ gem "rspec-rails"
20
18
  gem "aruba"
19
+ gem "database_cleaner"
21
20
  end
@@ -0,0 +1,261 @@
1
+ == Welcome to Rails
2
+
3
+ Rails is a web-application framework that includes everything needed to create
4
+ database-backed web applications according to the Model-View-Control pattern.
5
+
6
+ This pattern splits the view (also called the presentation) into "dumb"
7
+ templates that are primarily responsible for inserting pre-built data in between
8
+ HTML tags. The model contains the "smart" domain objects (such as Account,
9
+ Product, Person, Post) that holds all the business logic and knows how to
10
+ persist themselves to a database. The controller handles the incoming requests
11
+ (such as Save New Account, Update Product, Show Post) by manipulating the model
12
+ and directing data to the view.
13
+
14
+ In Rails, the model is handled by what's called an object-relational mapping
15
+ layer entitled Active Record. This layer allows you to present the data from
16
+ database rows as objects and embellish these data objects with business logic
17
+ methods. You can read more about Active Record in
18
+ link:files/vendor/rails/activerecord/README.html.
19
+
20
+ The controller and view are handled by the Action Pack, which handles both
21
+ layers by its two parts: Action View and Action Controller. These two layers
22
+ are bundled in a single package due to their heavy interdependence. This is
23
+ unlike the relationship between the Active Record and Action Pack that is much
24
+ more separate. Each of these packages can be used independently outside of
25
+ Rails. You can read more about Action Pack in
26
+ link:files/vendor/rails/actionpack/README.html.
27
+
28
+
29
+ == Getting Started
30
+
31
+ 1. At the command prompt, create a new Rails application:
32
+ <tt>rails new myapp</tt> (where <tt>myapp</tt> is the application name)
33
+
34
+ 2. Change directory to <tt>myapp</tt> and start the web server:
35
+ <tt>cd myapp; rails server</tt> (run with --help for options)
36
+
37
+ 3. Go to http://localhost:3000/ and you'll see:
38
+ "Welcome aboard: You're riding Ruby on Rails!"
39
+
40
+ 4. Follow the guidelines to start developing your application. You can find
41
+ the following resources handy:
42
+
43
+ * The Getting Started Guide: http://guides.rubyonrails.org/getting_started.html
44
+ * Ruby on Rails Tutorial Book: http://www.railstutorial.org/
45
+
46
+
47
+ == Debugging Rails
48
+
49
+ Sometimes your application goes wrong. Fortunately there are a lot of tools that
50
+ will help you debug it and get it back on the rails.
51
+
52
+ First area to check is the application log files. Have "tail -f" commands
53
+ running on the server.log and development.log. Rails will automatically display
54
+ debugging and runtime information to these files. Debugging info will also be
55
+ shown in the browser on requests from 127.0.0.1.
56
+
57
+ You can also log your own messages directly into the log file from your code
58
+ using the Ruby logger class from inside your controllers. Example:
59
+
60
+ class WeblogController < ActionController::Base
61
+ def destroy
62
+ @weblog = Weblog.find(params[:id])
63
+ @weblog.destroy
64
+ logger.info("#{Time.now} Destroyed Weblog ID ##{@weblog.id}!")
65
+ end
66
+ end
67
+
68
+ The result will be a message in your log file along the lines of:
69
+
70
+ Mon Oct 08 14:22:29 +1000 2007 Destroyed Weblog ID #1!
71
+
72
+ More information on how to use the logger is at http://www.ruby-doc.org/core/
73
+
74
+ Also, Ruby documentation can be found at http://www.ruby-lang.org/. There are
75
+ several books available online as well:
76
+
77
+ * Programming Ruby: http://www.ruby-doc.org/docs/ProgrammingRuby/ (Pickaxe)
78
+ * Learn to Program: http://pine.fm/LearnToProgram/ (a beginners guide)
79
+
80
+ These two books will bring you up to speed on the Ruby language and also on
81
+ programming in general.
82
+
83
+
84
+ == Debugger
85
+
86
+ Debugger support is available through the debugger command when you start your
87
+ Mongrel or WEBrick server with --debugger. This means that you can break out of
88
+ execution at any point in the code, investigate and change the model, and then,
89
+ resume execution! You need to install ruby-debug to run the server in debugging
90
+ mode. With gems, use <tt>sudo gem install ruby-debug</tt>. Example:
91
+
92
+ class WeblogController < ActionController::Base
93
+ def index
94
+ @posts = Post.all
95
+ debugger
96
+ end
97
+ end
98
+
99
+ So the controller will accept the action, run the first line, then present you
100
+ with a IRB prompt in the server window. Here you can do things like:
101
+
102
+ >> @posts.inspect
103
+ => "[#<Post:0x14a6be8
104
+ @attributes={"title"=>nil, "body"=>nil, "id"=>"1"}>,
105
+ #<Post:0x14a6620
106
+ @attributes={"title"=>"Rails", "body"=>"Only ten..", "id"=>"2"}>]"
107
+ >> @posts.first.title = "hello from a debugger"
108
+ => "hello from a debugger"
109
+
110
+ ...and even better, you can examine how your runtime objects actually work:
111
+
112
+ >> f = @posts.first
113
+ => #<Post:0x13630c4 @attributes={"title"=>nil, "body"=>nil, "id"=>"1"}>
114
+ >> f.
115
+ Display all 152 possibilities? (y or n)
116
+
117
+ Finally, when you're ready to resume execution, you can enter "cont".
118
+
119
+
120
+ == Console
121
+
122
+ The console is a Ruby shell, which allows you to interact with your
123
+ application's domain model. Here you'll have all parts of the application
124
+ configured, just like it is when the application is running. You can inspect
125
+ domain models, change values, and save to the database. Starting the script
126
+ without arguments will launch it in the development environment.
127
+
128
+ To start the console, run <tt>rails console</tt> from the application
129
+ directory.
130
+
131
+ Options:
132
+
133
+ * Passing the <tt>-s, --sandbox</tt> argument will rollback any modifications
134
+ made to the database.
135
+ * Passing an environment name as an argument will load the corresponding
136
+ environment. Example: <tt>rails console production</tt>.
137
+
138
+ To reload your controllers and models after launching the console run
139
+ <tt>reload!</tt>
140
+
141
+ More information about irb can be found at:
142
+ link:http://www.rubycentral.org/pickaxe/irb.html
143
+
144
+
145
+ == dbconsole
146
+
147
+ You can go to the command line of your database directly through <tt>rails
148
+ dbconsole</tt>. You would be connected to the database with the credentials
149
+ defined in database.yml. Starting the script without arguments will connect you
150
+ to the development database. Passing an argument will connect you to a different
151
+ database, like <tt>rails dbconsole production</tt>. Currently works for MySQL,
152
+ PostgreSQL and SQLite 3.
153
+
154
+ == Description of Contents
155
+
156
+ The default directory structure of a generated Ruby on Rails application:
157
+
158
+ |-- app
159
+ | |-- assets
160
+ | | |-- images
161
+ | | |-- javascripts
162
+ | | `-- stylesheets
163
+ | |-- controllers
164
+ | |-- helpers
165
+ | |-- mailers
166
+ | |-- models
167
+ | `-- views
168
+ | `-- layouts
169
+ |-- config
170
+ | |-- environments
171
+ | |-- initializers
172
+ | `-- locales
173
+ |-- db
174
+ |-- doc
175
+ |-- lib
176
+ | |-- assets
177
+ | `-- tasks
178
+ |-- log
179
+ |-- public
180
+ |-- script
181
+ |-- test
182
+ | |-- fixtures
183
+ | |-- functional
184
+ | |-- integration
185
+ | |-- performance
186
+ | `-- unit
187
+ |-- tmp
188
+ | `-- cache
189
+ | `-- assets
190
+ `-- vendor
191
+ |-- assets
192
+ | |-- javascripts
193
+ | `-- stylesheets
194
+ `-- plugins
195
+
196
+ app
197
+ Holds all the code that's specific to this particular application.
198
+
199
+ app/assets
200
+ Contains subdirectories for images, stylesheets, and JavaScript files.
201
+
202
+ app/controllers
203
+ Holds controllers that should be named like weblogs_controller.rb for
204
+ automated URL mapping. All controllers should descend from
205
+ ApplicationController which itself descends from ActionController::Base.
206
+
207
+ app/models
208
+ Holds models that should be named like post.rb. Models descend from
209
+ ActiveRecord::Base by default.
210
+
211
+ app/views
212
+ Holds the template files for the view that should be named like
213
+ weblogs/index.html.erb for the WeblogsController#index action. All views use
214
+ eRuby syntax by default.
215
+
216
+ app/views/layouts
217
+ Holds the template files for layouts to be used with views. This models the
218
+ common header/footer method of wrapping views. In your views, define a layout
219
+ using the <tt>layout :default</tt> and create a file named default.html.erb.
220
+ Inside default.html.erb, call <% yield %> to render the view using this
221
+ layout.
222
+
223
+ app/helpers
224
+ Holds view helpers that should be named like weblogs_helper.rb. These are
225
+ generated for you automatically when using generators for controllers.
226
+ Helpers can be used to wrap functionality for your views into methods.
227
+
228
+ config
229
+ Configuration files for the Rails environment, the routing map, the database,
230
+ and other dependencies.
231
+
232
+ db
233
+ Contains the database schema in schema.rb. db/migrate contains all the
234
+ sequence of Migrations for your schema.
235
+
236
+ doc
237
+ This directory is where your application documentation will be stored when
238
+ generated using <tt>rake doc:app</tt>
239
+
240
+ lib
241
+ Application specific libraries. Basically, any kind of custom code that
242
+ doesn't belong under controllers, models, or helpers. This directory is in
243
+ the load path.
244
+
245
+ public
246
+ The directory available for the web server. Also contains the dispatchers and the
247
+ default HTML files. This should be set as the DOCUMENT_ROOT of your web
248
+ server.
249
+
250
+ script
251
+ Helper scripts for automation and generation.
252
+
253
+ test
254
+ Unit and functional tests along with fixtures. When using the rails generate
255
+ command, template test files will be generated for you and placed in this
256
+ directory.
257
+
258
+ vendor
259
+ External libraries that the application depends on. Also includes the plugins
260
+ subdirectory. If the app has frozen rails, those gems also go here, under
261
+ vendor/rails/. This directory is in the load path.