tech-angels-resque-throttle 0.2.20

Sign up to get free protection for your applications and to get access to all the features.
@@ -0,0 +1,5 @@
1
+ README.rdoc
2
+ lib/**/*.rb
3
+ bin/*
4
+ features/**/*.feature
5
+ LICENSE
@@ -0,0 +1,22 @@
1
+ ## MAC OS
2
+ .DS_Store
3
+
4
+ ## TEXTMATE
5
+ *.tmproj
6
+ tmtags
7
+
8
+ ## EMACS
9
+ *~
10
+ \#*
11
+ .\#*
12
+
13
+ ## VIM
14
+ *.swp
15
+
16
+ ## PROJECT::GENERAL
17
+ coverage
18
+ rdoc
19
+ pkg
20
+
21
+ ## PROJECT::SPECIFIC
22
+ .idea
data/LICENSE ADDED
@@ -0,0 +1,20 @@
1
+ Copyright (c) 2010 Zendesk
2
+
3
+ Permission is hereby granted, free of charge, to any person obtaining
4
+ a copy of this software and associated documentation files (the
5
+ "Software"), to deal in the Software without restriction, including
6
+ without limitation the rights to use, copy, modify, merge, publish,
7
+ distribute, sublicense, and/or sell copies of the Software, and to
8
+ permit persons to whom the Software is furnished to do so, subject to
9
+ the following conditions:
10
+
11
+ The above copyright notice and this permission notice shall be
12
+ included in all copies or substantial portions of the Software.
13
+
14
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
15
+ EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
16
+ MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
17
+ NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
18
+ LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
19
+ OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
20
+ WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
@@ -0,0 +1,66 @@
1
+ resque-throttle
2
+ ===============
3
+
4
+ Resque Throttle is a plugin for the [Resque][0] queueing system
5
+ (http://github.com/defunkt/resque). It adds a ThrottledJob class that will
6
+ limit the amount of times it can be enqueued per class.
7
+
8
+ To use
9
+ ------
10
+ The job you wish to throttle should inherit from the Resque::ThrottledJob class.
11
+
12
+ In your class, add the can_run_every in which the job should be throttled. Example:
13
+
14
+ class MyThrottledJob < Resque::ThrottledJob
15
+ throttle :can_run_every => 24.hours
16
+
17
+ #rest of your class here
18
+ end
19
+
20
+ By default, the key which identifies the job is simply the class name. This "identifier"
21
+ is stored in a redis key with a TTL equal to that of the can_run_every. Thus the
22
+ default behavior is a single Job class inheriting from Resque::ThrottledJob can only
23
+ run every 30 minutes.
24
+
25
+ If you'd like to override that to be more granular, you can do that in the identifier class method
26
+ by returning a string. For example, if you want the job to be limited to once a day per
27
+ account, do something like the following:
28
+
29
+ class MyThrottledJob < Resque::ThrottledJob
30
+ throttle :can_run_every => 24.hours
31
+
32
+ def self.identifier(*args)
33
+ account_id = *args
34
+ "account_id:#{account_id}"
35
+ end
36
+
37
+ #rest of your class here
38
+ end
39
+
40
+ The *args passed to identifier are the same arguments that are passed to perform.
41
+
42
+ When a job is throttled, it will raise a ThrottledError and the job will not be enqueued.
43
+
44
+ Contributing
45
+ ------------
46
+
47
+ Once you've made your commits:
48
+
49
+ 1. [Fork][1] Resque Throttle
50
+ 2. Create a topic branch - `git checkout -b my_branch`
51
+ 3. Push to your branch - `git push origin my_branch`
52
+ 4. Create an [Issue][2] with a link to your branch
53
+ 5. That's it!
54
+
55
+ Author
56
+ ------
57
+ Scott J. Tamosunas :: tamosunas@gmail.com :: @scotttam
58
+
59
+ Copyright
60
+ ---------
61
+ Copyright (c) 2010 Zendesk. See LICENSE for details.
62
+
63
+ [0]: http://github.com/defunkt/resque
64
+ [1]: http://help.github.com/forking/
65
+ [2]: http://github.com/scotttam/resque-throttle/issues
66
+
@@ -0,0 +1,55 @@
1
+ require 'rubygems'
2
+ require 'rake'
3
+
4
+ begin
5
+ require 'jeweler'
6
+ Jeweler::Tasks.new do |gem|
7
+ gem.name = "resque-throttle"
8
+ gem.summary = %Q{resque-throttle is an extension to the resque queue system that restricts the frequency in which certain jobs are run.}
9
+ gem.description = %Q{resque-throttle is an extension to the resque queue system that restricts the frequency in which certain jobs are run. Add more description here.}
10
+ gem.email = "tamosunas@gmail.com"
11
+ gem.homepage = "http://github.com/scotttam/resque-throttle"
12
+ gem.authors = ["Scott J. Tamosunas"]
13
+ gem.add_dependency "resque", ">=1.6.0"
14
+ gem.add_development_dependency "shoulda", ">= 0"
15
+ gem.add_development_dependency "mocha", ">=0.9.8"
16
+ # gem is a Gem::Specification... see http://www.rubygems.org/read/chapter/20 for additional settings
17
+ end
18
+ Jeweler::GemcutterTasks.new
19
+ rescue LoadError
20
+ puts "Jeweler (or a dependency) not available. Install it with: gem install jeweler"
21
+ end
22
+
23
+ require 'rake/testtask'
24
+ Rake::TestTask.new(:test) do |test|
25
+ test.libs << 'lib' << 'test'
26
+ test.pattern = 'test/**/*_test.rb'
27
+ test.verbose = true
28
+ end
29
+
30
+ begin
31
+ require 'rcov/rcovtask'
32
+ Rcov::RcovTask.new do |test|
33
+ test.libs << 'test'
34
+ test.pattern = 'test/**/*_test.rb'
35
+ test.verbose = true
36
+ end
37
+ rescue LoadError
38
+ task :rcov do
39
+ abort "RCov is not available. In order to run rcov, you must: sudo gem install spicycode-rcov"
40
+ end
41
+ end
42
+
43
+ task :test => :check_dependencies
44
+
45
+ task :default => :test
46
+
47
+ require 'rake/rdoctask'
48
+ Rake::RDocTask.new do |rdoc|
49
+ version = File.exist?('VERSION') ? File.read('VERSION') : ""
50
+
51
+ rdoc.rdoc_dir = 'rdoc'
52
+ rdoc.title = "resque-throttle #{version}"
53
+ rdoc.rdoc_files.include('README*')
54
+ rdoc.rdoc_files.include('lib/**/*.rb')
55
+ end
data/VERSION ADDED
@@ -0,0 +1 @@
1
+ 0.2.19
@@ -0,0 +1,3 @@
1
+ require "resque/resque"
2
+ require "resque/throttle"
3
+ require "resque/throttled_job"
@@ -0,0 +1,35 @@
1
+ require "resque/throttle"
2
+
3
+ module Resque
4
+ extend self
5
+
6
+ # Raised when trying to create a job that is throttled
7
+ class ThrottledError < RuntimeError; end
8
+
9
+ def enqueue_with_throttle(klass, *args)
10
+ if should_throttle?(klass, *args)
11
+ raise ThrottledError.new("#{klass} with key #{klass.key(*args)} has exceeded it's throttle limit")
12
+ end
13
+ enqueue_without_throttle(klass, *args)
14
+ end
15
+ alias_method :enqueue_without_throttle, :enqueue
16
+ alias_method :enqueue, :enqueue_with_throttle
17
+
18
+ private
19
+
20
+ def should_throttle?(klass, *args)
21
+ return false if !throttle_job?(klass) || klass.disabled
22
+ return true if key_found?(klass, *args)
23
+ redis.set(klass.key(*args), true)
24
+ redis.expire(klass.key(*args), klass.can_run_every)
25
+ return false
26
+ end
27
+
28
+ def key_found?(klass, *args)
29
+ redis.get(klass.key(*args))
30
+ end
31
+
32
+ def throttle_job?(klass)
33
+ klass.ancestors.include?(Resque::ThrottledJob)
34
+ end
35
+ end
@@ -0,0 +1,5 @@
1
+ require 'resque'
2
+
3
+ module Resque
4
+ end
5
+
@@ -0,0 +1,34 @@
1
+ module Resque
2
+ class SettingNotFound < RuntimeError; end
3
+
4
+ class ThrottledJob
5
+
6
+ THROTTLE_DEFAULTS = {
7
+ :can_run_every => 1800,
8
+ :disabled => false,
9
+ }
10
+
11
+ def self.settings
12
+ @settings ||= THROTTLE_DEFAULTS.dup
13
+ end
14
+
15
+ def self.throttle(args = {})
16
+ settings.merge!(args)
17
+ end
18
+
19
+ def self.identifier(*args)
20
+ end
21
+
22
+ def self.key(*args)
23
+ [self.to_s, identifier(*args)].compact.join(":")
24
+ end
25
+
26
+ def self.can_run_every
27
+ settings[:can_run_every]
28
+ end
29
+
30
+ def self.disabled
31
+ settings[:disabled]
32
+ end
33
+ end
34
+ end
@@ -0,0 +1,65 @@
1
+ # Generated by jeweler
2
+ # DO NOT EDIT THIS FILE DIRECTLY
3
+ # Instead, edit Jeweler::Tasks in Rakefile, and run the gemspec command
4
+ # -*- encoding: utf-8 -*-
5
+
6
+ Gem::Specification.new do |s|
7
+ s.name = %q{tech-angels-resque-throttle}
8
+ s.version = "0.2.20"
9
+
10
+ s.required_rubygems_version = Gem::Requirement.new(">= 0") if s.respond_to? :required_rubygems_version=
11
+ s.authors = ["Scott J. Tamosunas"]
12
+ s.date = %q{2010-10-06}
13
+ s.description = %q{resque-throttle is an extension to the resque queue system that restricts the frequency in which certain jobs are run. Add more description here.}
14
+ s.email = %q{tamosunas@gmail.com}
15
+ s.extra_rdoc_files = [
16
+ "LICENSE",
17
+ "README.markdown"
18
+ ]
19
+ s.files = [
20
+ ".document",
21
+ ".gitignore",
22
+ "LICENSE",
23
+ "README.markdown",
24
+ "Rakefile",
25
+ "VERSION",
26
+ "lib/resque-throttle.rb",
27
+ "lib/resque/resque.rb",
28
+ "lib/resque/throttle.rb",
29
+ "lib/resque/throttled_job.rb",
30
+ "resque-throttle.gemspec",
31
+ "test/resque/resque_test.rb",
32
+ "test/resque/throttled_job_test.rb",
33
+ "test/test_helper.rb"
34
+ ]
35
+ s.homepage = %q{http://github.com/scotttam/resque-throttle}
36
+ s.rdoc_options = ["--charset=UTF-8"]
37
+ s.require_paths = ["lib"]
38
+ s.rubygems_version = %q{1.3.7}
39
+ s.summary = %q{resque-throttle is an extension to the resque queue system that restricts the frequency in which certain jobs are run.}
40
+ s.test_files = [
41
+ "test/resque/resque_test.rb",
42
+ "test/resque/throttled_job_test.rb",
43
+ "test/test_helper.rb"
44
+ ]
45
+
46
+ if s.respond_to? :specification_version then
47
+ current_version = Gem::Specification::CURRENT_SPECIFICATION_VERSION
48
+ s.specification_version = 3
49
+
50
+ if Gem::Version.new(Gem::VERSION) >= Gem::Version.new('1.2.0') then
51
+ s.add_runtime_dependency(%q<resque>, [">= 1.6.0"])
52
+ s.add_development_dependency(%q<shoulda>, [">= 0"])
53
+ s.add_development_dependency(%q<mocha>, [">= 0.9.8"])
54
+ else
55
+ s.add_dependency(%q<resque>, [">= 1.6.0"])
56
+ s.add_dependency(%q<shoulda>, [">= 0"])
57
+ s.add_dependency(%q<mocha>, [">= 0.9.8"])
58
+ end
59
+ else
60
+ s.add_dependency(%q<resque>, [">= 1.6.0"])
61
+ s.add_dependency(%q<shoulda>, [">= 0"])
62
+ s.add_dependency(%q<mocha>, [">= 0.9.8"])
63
+ end
64
+ end
65
+
@@ -0,0 +1,33 @@
1
+ require File.dirname(__FILE__) + '/../test_helper'
2
+
3
+ class ResqueTest < Test::Unit::TestCase
4
+
5
+ context "Resque" do
6
+ setup do
7
+ Resque.redis.flush_all
8
+ assert_nil Resque.redis.get(OneHourThrottledJob.key)
9
+ @bogus_args = "bogus_arg"
10
+ end
11
+
12
+ context "#enqueue" do
13
+ should "add a throttled job key to the set with the proper TTL (Expire)" do
14
+ Resque.expects(:enqueue_without_throttle).returns(true)
15
+ assert Resque.enqueue(IdentifierThrottledJob, @bogus_args)
16
+ assert Resque.redis.keys('*').include?("resque:IdentifierThrottledJob:my_bogus_arg")
17
+ assert_equal 3600, Resque.redis.ttl(IdentifierThrottledJob.key(@bogus_args))
18
+ end
19
+
20
+ context "job has not reached throttle limit" do
21
+ should "not add another job to the queue and raise a throttled exception" do
22
+ Resque.expects(:enqueue_without_throttle).once
23
+ assert_raises(Resque::ThrottledError) { 2.times { Resque.enqueue(OneHourThrottledJob, @bogus_args) } }
24
+ end
25
+ end
26
+
27
+ should "enqueue a job without throttling if the job is disabled" do
28
+ Resque.expects(:enqueue_without_throttle).twice
29
+ 2.times { Resque.enqueue(DisabledThrottledJob, @bogus_args) }
30
+ end
31
+ end
32
+ end
33
+ end
@@ -0,0 +1,52 @@
1
+ require File.dirname(__FILE__) + '/../test_helper'
2
+
3
+ class ThrottledJobTest < Test::Unit::TestCase
4
+
5
+ context "Resque::ThrottledJob" do
6
+ should "instantiate a new Resque::ThrottledJob" do
7
+ assert Resque::ThrottledJob.new
8
+ end
9
+
10
+ context "settings" do
11
+ context "#can_run_every" do
12
+ should "return the number of seconds in which to throttle these jobs" do
13
+ assert_equal 3600, OneHourThrottledJob.can_run_every
14
+ end
15
+
16
+ should "default to 30 minutes (1800 seconds) if not provided" do
17
+ assert_equal 1800, DefaultThrottledJob.can_run_every
18
+ end
19
+ end
20
+
21
+ context "#identifier" do
22
+ should "return an additional key identifier used in storing the key in the redis SET" do
23
+ assert_equal "my_identifier", IdentifierThrottledJob.identifier("identifier")
24
+ end
25
+
26
+ should "return nil if not defined" do
27
+ assert_nil DefaultThrottledJob.identifier
28
+ end
29
+ end
30
+
31
+ context "#disabled" do
32
+ should "not be disabled by default" do
33
+ assert !DefaultThrottledJob.disabled
34
+ end
35
+
36
+ should "be able to be overriden" do
37
+ assert DisabledThrottledJob.disabled
38
+ end
39
+ end
40
+ end
41
+
42
+ context "#key" do
43
+ should "consist of the class name and the identifier" do
44
+ assert_equal "IdentifierThrottledJob:my_identifier", IdentifierThrottledJob.key("identifier")
45
+ end
46
+
47
+ should "consist of just the class name if the identifier is not provided" do
48
+ assert_equal "DefaultThrottledJob", DefaultThrottledJob.key
49
+ end
50
+ end
51
+ end
52
+ end
@@ -0,0 +1,51 @@
1
+ require 'rubygems'
2
+ require 'test/unit'
3
+ require 'shoulda'
4
+ require 'mocha'
5
+
6
+ $LOAD_PATH.unshift(File.join(File.dirname(__FILE__), '..', 'lib'))
7
+ $LOAD_PATH.unshift(File.dirname(__FILE__))
8
+ require 'resque/resque'
9
+ require 'resque/throttle'
10
+ require 'resque/throttled_job'
11
+
12
+ class Test::Unit::TestCase
13
+ end
14
+
15
+ #fixture classes
16
+ class DefaultThrottledJob < Resque::ThrottledJob
17
+ @queue = :some_queue
18
+
19
+ def self.perform(some_id, some_other_thing)
20
+ end
21
+ end
22
+
23
+ class OneHourThrottledJob < Resque::ThrottledJob
24
+ @queue = :some_queue
25
+ throttle :can_run_every => 3600
26
+
27
+ def self.perform(some_id, some_other_thing)
28
+ end
29
+ end
30
+
31
+ class IdentifierThrottledJob < Resque::ThrottledJob
32
+ @queue = :some_queue
33
+
34
+ throttle :can_run_every => 3600
35
+
36
+ def self.perform(some_id, some_other_thing)
37
+ end
38
+
39
+ def self.identifier(*args)
40
+ first, second = *args
41
+ "my_#{first}"
42
+ end
43
+ end
44
+
45
+ class DisabledThrottledJob < Resque::ThrottledJob
46
+ @queue = :some_queue
47
+ throttle :disabled => true
48
+
49
+ def self.perform(some_id, some_other_thing)
50
+ end
51
+ end
metadata ADDED
@@ -0,0 +1,128 @@
1
+ --- !ruby/object:Gem::Specification
2
+ name: tech-angels-resque-throttle
3
+ version: !ruby/object:Gem::Version
4
+ hash: 63
5
+ prerelease: false
6
+ segments:
7
+ - 0
8
+ - 2
9
+ - 20
10
+ version: 0.2.20
11
+ platform: ruby
12
+ authors:
13
+ - Scott J. Tamosunas
14
+ autorequire:
15
+ bindir: bin
16
+ cert_chain: []
17
+
18
+ date: 2010-10-06 00:00:00 +02:00
19
+ default_executable:
20
+ dependencies:
21
+ - !ruby/object:Gem::Dependency
22
+ name: resque
23
+ prerelease: false
24
+ requirement: &id001 !ruby/object:Gem::Requirement
25
+ none: false
26
+ requirements:
27
+ - - ">="
28
+ - !ruby/object:Gem::Version
29
+ hash: 15
30
+ segments:
31
+ - 1
32
+ - 6
33
+ - 0
34
+ version: 1.6.0
35
+ type: :runtime
36
+ version_requirements: *id001
37
+ - !ruby/object:Gem::Dependency
38
+ name: shoulda
39
+ prerelease: false
40
+ requirement: &id002 !ruby/object:Gem::Requirement
41
+ none: false
42
+ requirements:
43
+ - - ">="
44
+ - !ruby/object:Gem::Version
45
+ hash: 3
46
+ segments:
47
+ - 0
48
+ version: "0"
49
+ type: :development
50
+ version_requirements: *id002
51
+ - !ruby/object:Gem::Dependency
52
+ name: mocha
53
+ prerelease: false
54
+ requirement: &id003 !ruby/object:Gem::Requirement
55
+ none: false
56
+ requirements:
57
+ - - ">="
58
+ - !ruby/object:Gem::Version
59
+ hash: 43
60
+ segments:
61
+ - 0
62
+ - 9
63
+ - 8
64
+ version: 0.9.8
65
+ type: :development
66
+ version_requirements: *id003
67
+ description: resque-throttle is an extension to the resque queue system that restricts the frequency in which certain jobs are run. Add more description here.
68
+ email: tamosunas@gmail.com
69
+ executables: []
70
+
71
+ extensions: []
72
+
73
+ extra_rdoc_files:
74
+ - LICENSE
75
+ - README.markdown
76
+ files:
77
+ - .document
78
+ - .gitignore
79
+ - LICENSE
80
+ - README.markdown
81
+ - Rakefile
82
+ - VERSION
83
+ - lib/resque-throttle.rb
84
+ - lib/resque/resque.rb
85
+ - lib/resque/throttle.rb
86
+ - lib/resque/throttled_job.rb
87
+ - resque-throttle.gemspec
88
+ - test/resque/resque_test.rb
89
+ - test/resque/throttled_job_test.rb
90
+ - test/test_helper.rb
91
+ has_rdoc: true
92
+ homepage: http://github.com/scotttam/resque-throttle
93
+ licenses: []
94
+
95
+ post_install_message:
96
+ rdoc_options:
97
+ - --charset=UTF-8
98
+ require_paths:
99
+ - lib
100
+ required_ruby_version: !ruby/object:Gem::Requirement
101
+ none: false
102
+ requirements:
103
+ - - ">="
104
+ - !ruby/object:Gem::Version
105
+ hash: 3
106
+ segments:
107
+ - 0
108
+ version: "0"
109
+ required_rubygems_version: !ruby/object:Gem::Requirement
110
+ none: false
111
+ requirements:
112
+ - - ">="
113
+ - !ruby/object:Gem::Version
114
+ hash: 3
115
+ segments:
116
+ - 0
117
+ version: "0"
118
+ requirements: []
119
+
120
+ rubyforge_project:
121
+ rubygems_version: 1.3.7
122
+ signing_key:
123
+ specification_version: 3
124
+ summary: resque-throttle is an extension to the resque queue system that restricts the frequency in which certain jobs are run.
125
+ test_files:
126
+ - test/resque/resque_test.rb
127
+ - test/resque/throttled_job_test.rb
128
+ - test/test_helper.rb