tech-angels-resque-throttle 0.2.20

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
@@ -0,0 +1,5 @@
1
+ README.rdoc
2
+ lib/**/*.rb
3
+ bin/*
4
+ features/**/*.feature
5
+ LICENSE
@@ -0,0 +1,22 @@
1
+ ## MAC OS
2
+ .DS_Store
3
+
4
+ ## TEXTMATE
5
+ *.tmproj
6
+ tmtags
7
+
8
+ ## EMACS
9
+ *~
10
+ \#*
11
+ .\#*
12
+
13
+ ## VIM
14
+ *.swp
15
+
16
+ ## PROJECT::GENERAL
17
+ coverage
18
+ rdoc
19
+ pkg
20
+
21
+ ## PROJECT::SPECIFIC
22
+ .idea
data/LICENSE ADDED
@@ -0,0 +1,20 @@
1
+ Copyright (c) 2010 Zendesk
2
+
3
+ Permission is hereby granted, free of charge, to any person obtaining
4
+ a copy of this software and associated documentation files (the
5
+ "Software"), to deal in the Software without restriction, including
6
+ without limitation the rights to use, copy, modify, merge, publish,
7
+ distribute, sublicense, and/or sell copies of the Software, and to
8
+ permit persons to whom the Software is furnished to do so, subject to
9
+ the following conditions:
10
+
11
+ The above copyright notice and this permission notice shall be
12
+ included in all copies or substantial portions of the Software.
13
+
14
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
15
+ EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
16
+ MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
17
+ NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
18
+ LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
19
+ OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
20
+ WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
@@ -0,0 +1,66 @@
1
+ resque-throttle
2
+ ===============
3
+
4
+ Resque Throttle is a plugin for the [Resque][0] queueing system
5
+ (http://github.com/defunkt/resque). It adds a ThrottledJob class that will
6
+ limit the amount of times it can be enqueued per class.
7
+
8
+ To use
9
+ ------
10
+ The job you wish to throttle should inherit from the Resque::ThrottledJob class.
11
+
12
+ In your class, add the can_run_every in which the job should be throttled. Example:
13
+
14
+ class MyThrottledJob < Resque::ThrottledJob
15
+ throttle :can_run_every => 24.hours
16
+
17
+ #rest of your class here
18
+ end
19
+
20
+ By default, the key which identifies the job is simply the class name. This "identifier"
21
+ is stored in a redis key with a TTL equal to that of the can_run_every. Thus the
22
+ default behavior is a single Job class inheriting from Resque::ThrottledJob can only
23
+ run every 30 minutes.
24
+
25
+ If you'd like to override that to be more granular, you can do that in the identifier class method
26
+ by returning a string. For example, if you want the job to be limited to once a day per
27
+ account, do something like the following:
28
+
29
+ class MyThrottledJob < Resque::ThrottledJob
30
+ throttle :can_run_every => 24.hours
31
+
32
+ def self.identifier(*args)
33
+ account_id = *args
34
+ "account_id:#{account_id}"
35
+ end
36
+
37
+ #rest of your class here
38
+ end
39
+
40
+ The *args passed to identifier are the same arguments that are passed to perform.
41
+
42
+ When a job is throttled, it will raise a ThrottledError and the job will not be enqueued.
43
+
44
+ Contributing
45
+ ------------
46
+
47
+ Once you've made your commits:
48
+
49
+ 1. [Fork][1] Resque Throttle
50
+ 2. Create a topic branch - `git checkout -b my_branch`
51
+ 3. Push to your branch - `git push origin my_branch`
52
+ 4. Create an [Issue][2] with a link to your branch
53
+ 5. That's it!
54
+
55
+ Author
56
+ ------
57
+ Scott J. Tamosunas :: tamosunas@gmail.com :: @scotttam
58
+
59
+ Copyright
60
+ ---------
61
+ Copyright (c) 2010 Zendesk. See LICENSE for details.
62
+
63
+ [0]: http://github.com/defunkt/resque
64
+ [1]: http://help.github.com/forking/
65
+ [2]: http://github.com/scotttam/resque-throttle/issues
66
+
@@ -0,0 +1,55 @@
1
+ require 'rubygems'
2
+ require 'rake'
3
+
4
+ begin
5
+ require 'jeweler'
6
+ Jeweler::Tasks.new do |gem|
7
+ gem.name = "resque-throttle"
8
+ gem.summary = %Q{resque-throttle is an extension to the resque queue system that restricts the frequency in which certain jobs are run.}
9
+ gem.description = %Q{resque-throttle is an extension to the resque queue system that restricts the frequency in which certain jobs are run. Add more description here.}
10
+ gem.email = "tamosunas@gmail.com"
11
+ gem.homepage = "http://github.com/scotttam/resque-throttle"
12
+ gem.authors = ["Scott J. Tamosunas"]
13
+ gem.add_dependency "resque", ">=1.6.0"
14
+ gem.add_development_dependency "shoulda", ">= 0"
15
+ gem.add_development_dependency "mocha", ">=0.9.8"
16
+ # gem is a Gem::Specification... see http://www.rubygems.org/read/chapter/20 for additional settings
17
+ end
18
+ Jeweler::GemcutterTasks.new
19
+ rescue LoadError
20
+ puts "Jeweler (or a dependency) not available. Install it with: gem install jeweler"
21
+ end
22
+
23
+ require 'rake/testtask'
24
+ Rake::TestTask.new(:test) do |test|
25
+ test.libs << 'lib' << 'test'
26
+ test.pattern = 'test/**/*_test.rb'
27
+ test.verbose = true
28
+ end
29
+
30
+ begin
31
+ require 'rcov/rcovtask'
32
+ Rcov::RcovTask.new do |test|
33
+ test.libs << 'test'
34
+ test.pattern = 'test/**/*_test.rb'
35
+ test.verbose = true
36
+ end
37
+ rescue LoadError
38
+ task :rcov do
39
+ abort "RCov is not available. In order to run rcov, you must: sudo gem install spicycode-rcov"
40
+ end
41
+ end
42
+
43
+ task :test => :check_dependencies
44
+
45
+ task :default => :test
46
+
47
+ require 'rake/rdoctask'
48
+ Rake::RDocTask.new do |rdoc|
49
+ version = File.exist?('VERSION') ? File.read('VERSION') : ""
50
+
51
+ rdoc.rdoc_dir = 'rdoc'
52
+ rdoc.title = "resque-throttle #{version}"
53
+ rdoc.rdoc_files.include('README*')
54
+ rdoc.rdoc_files.include('lib/**/*.rb')
55
+ end
data/VERSION ADDED
@@ -0,0 +1 @@
1
+ 0.2.19
@@ -0,0 +1,3 @@
1
+ require "resque/resque"
2
+ require "resque/throttle"
3
+ require "resque/throttled_job"
@@ -0,0 +1,35 @@
1
+ require "resque/throttle"
2
+
3
+ module Resque
4
+ extend self
5
+
6
+ # Raised when trying to create a job that is throttled
7
+ class ThrottledError < RuntimeError; end
8
+
9
+ def enqueue_with_throttle(klass, *args)
10
+ if should_throttle?(klass, *args)
11
+ raise ThrottledError.new("#{klass} with key #{klass.key(*args)} has exceeded it's throttle limit")
12
+ end
13
+ enqueue_without_throttle(klass, *args)
14
+ end
15
+ alias_method :enqueue_without_throttle, :enqueue
16
+ alias_method :enqueue, :enqueue_with_throttle
17
+
18
+ private
19
+
20
+ def should_throttle?(klass, *args)
21
+ return false if !throttle_job?(klass) || klass.disabled
22
+ return true if key_found?(klass, *args)
23
+ redis.set(klass.key(*args), true)
24
+ redis.expire(klass.key(*args), klass.can_run_every)
25
+ return false
26
+ end
27
+
28
+ def key_found?(klass, *args)
29
+ redis.get(klass.key(*args))
30
+ end
31
+
32
+ def throttle_job?(klass)
33
+ klass.ancestors.include?(Resque::ThrottledJob)
34
+ end
35
+ end
@@ -0,0 +1,5 @@
1
+ require 'resque'
2
+
3
+ module Resque
4
+ end
5
+
@@ -0,0 +1,34 @@
1
+ module Resque
2
+ class SettingNotFound < RuntimeError; end
3
+
4
+ class ThrottledJob
5
+
6
+ THROTTLE_DEFAULTS = {
7
+ :can_run_every => 1800,
8
+ :disabled => false,
9
+ }
10
+
11
+ def self.settings
12
+ @settings ||= THROTTLE_DEFAULTS.dup
13
+ end
14
+
15
+ def self.throttle(args = {})
16
+ settings.merge!(args)
17
+ end
18
+
19
+ def self.identifier(*args)
20
+ end
21
+
22
+ def self.key(*args)
23
+ [self.to_s, identifier(*args)].compact.join(":")
24
+ end
25
+
26
+ def self.can_run_every
27
+ settings[:can_run_every]
28
+ end
29
+
30
+ def self.disabled
31
+ settings[:disabled]
32
+ end
33
+ end
34
+ end
@@ -0,0 +1,65 @@
1
+ # Generated by jeweler
2
+ # DO NOT EDIT THIS FILE DIRECTLY
3
+ # Instead, edit Jeweler::Tasks in Rakefile, and run the gemspec command
4
+ # -*- encoding: utf-8 -*-
5
+
6
+ Gem::Specification.new do |s|
7
+ s.name = %q{tech-angels-resque-throttle}
8
+ s.version = "0.2.20"
9
+
10
+ s.required_rubygems_version = Gem::Requirement.new(">= 0") if s.respond_to? :required_rubygems_version=
11
+ s.authors = ["Scott J. Tamosunas"]
12
+ s.date = %q{2010-10-06}
13
+ s.description = %q{resque-throttle is an extension to the resque queue system that restricts the frequency in which certain jobs are run. Add more description here.}
14
+ s.email = %q{tamosunas@gmail.com}
15
+ s.extra_rdoc_files = [
16
+ "LICENSE",
17
+ "README.markdown"
18
+ ]
19
+ s.files = [
20
+ ".document",
21
+ ".gitignore",
22
+ "LICENSE",
23
+ "README.markdown",
24
+ "Rakefile",
25
+ "VERSION",
26
+ "lib/resque-throttle.rb",
27
+ "lib/resque/resque.rb",
28
+ "lib/resque/throttle.rb",
29
+ "lib/resque/throttled_job.rb",
30
+ "resque-throttle.gemspec",
31
+ "test/resque/resque_test.rb",
32
+ "test/resque/throttled_job_test.rb",
33
+ "test/test_helper.rb"
34
+ ]
35
+ s.homepage = %q{http://github.com/scotttam/resque-throttle}
36
+ s.rdoc_options = ["--charset=UTF-8"]
37
+ s.require_paths = ["lib"]
38
+ s.rubygems_version = %q{1.3.7}
39
+ s.summary = %q{resque-throttle is an extension to the resque queue system that restricts the frequency in which certain jobs are run.}
40
+ s.test_files = [
41
+ "test/resque/resque_test.rb",
42
+ "test/resque/throttled_job_test.rb",
43
+ "test/test_helper.rb"
44
+ ]
45
+
46
+ if s.respond_to? :specification_version then
47
+ current_version = Gem::Specification::CURRENT_SPECIFICATION_VERSION
48
+ s.specification_version = 3
49
+
50
+ if Gem::Version.new(Gem::VERSION) >= Gem::Version.new('1.2.0') then
51
+ s.add_runtime_dependency(%q<resque>, [">= 1.6.0"])
52
+ s.add_development_dependency(%q<shoulda>, [">= 0"])
53
+ s.add_development_dependency(%q<mocha>, [">= 0.9.8"])
54
+ else
55
+ s.add_dependency(%q<resque>, [">= 1.6.0"])
56
+ s.add_dependency(%q<shoulda>, [">= 0"])
57
+ s.add_dependency(%q<mocha>, [">= 0.9.8"])
58
+ end
59
+ else
60
+ s.add_dependency(%q<resque>, [">= 1.6.0"])
61
+ s.add_dependency(%q<shoulda>, [">= 0"])
62
+ s.add_dependency(%q<mocha>, [">= 0.9.8"])
63
+ end
64
+ end
65
+
@@ -0,0 +1,33 @@
1
+ require File.dirname(__FILE__) + '/../test_helper'
2
+
3
+ class ResqueTest < Test::Unit::TestCase
4
+
5
+ context "Resque" do
6
+ setup do
7
+ Resque.redis.flush_all
8
+ assert_nil Resque.redis.get(OneHourThrottledJob.key)
9
+ @bogus_args = "bogus_arg"
10
+ end
11
+
12
+ context "#enqueue" do
13
+ should "add a throttled job key to the set with the proper TTL (Expire)" do
14
+ Resque.expects(:enqueue_without_throttle).returns(true)
15
+ assert Resque.enqueue(IdentifierThrottledJob, @bogus_args)
16
+ assert Resque.redis.keys('*').include?("resque:IdentifierThrottledJob:my_bogus_arg")
17
+ assert_equal 3600, Resque.redis.ttl(IdentifierThrottledJob.key(@bogus_args))
18
+ end
19
+
20
+ context "job has not reached throttle limit" do
21
+ should "not add another job to the queue and raise a throttled exception" do
22
+ Resque.expects(:enqueue_without_throttle).once
23
+ assert_raises(Resque::ThrottledError) { 2.times { Resque.enqueue(OneHourThrottledJob, @bogus_args) } }
24
+ end
25
+ end
26
+
27
+ should "enqueue a job without throttling if the job is disabled" do
28
+ Resque.expects(:enqueue_without_throttle).twice
29
+ 2.times { Resque.enqueue(DisabledThrottledJob, @bogus_args) }
30
+ end
31
+ end
32
+ end
33
+ end
@@ -0,0 +1,52 @@
1
+ require File.dirname(__FILE__) + '/../test_helper'
2
+
3
+ class ThrottledJobTest < Test::Unit::TestCase
4
+
5
+ context "Resque::ThrottledJob" do
6
+ should "instantiate a new Resque::ThrottledJob" do
7
+ assert Resque::ThrottledJob.new
8
+ end
9
+
10
+ context "settings" do
11
+ context "#can_run_every" do
12
+ should "return the number of seconds in which to throttle these jobs" do
13
+ assert_equal 3600, OneHourThrottledJob.can_run_every
14
+ end
15
+
16
+ should "default to 30 minutes (1800 seconds) if not provided" do
17
+ assert_equal 1800, DefaultThrottledJob.can_run_every
18
+ end
19
+ end
20
+
21
+ context "#identifier" do
22
+ should "return an additional key identifier used in storing the key in the redis SET" do
23
+ assert_equal "my_identifier", IdentifierThrottledJob.identifier("identifier")
24
+ end
25
+
26
+ should "return nil if not defined" do
27
+ assert_nil DefaultThrottledJob.identifier
28
+ end
29
+ end
30
+
31
+ context "#disabled" do
32
+ should "not be disabled by default" do
33
+ assert !DefaultThrottledJob.disabled
34
+ end
35
+
36
+ should "be able to be overriden" do
37
+ assert DisabledThrottledJob.disabled
38
+ end
39
+ end
40
+ end
41
+
42
+ context "#key" do
43
+ should "consist of the class name and the identifier" do
44
+ assert_equal "IdentifierThrottledJob:my_identifier", IdentifierThrottledJob.key("identifier")
45
+ end
46
+
47
+ should "consist of just the class name if the identifier is not provided" do
48
+ assert_equal "DefaultThrottledJob", DefaultThrottledJob.key
49
+ end
50
+ end
51
+ end
52
+ end
@@ -0,0 +1,51 @@
1
+ require 'rubygems'
2
+ require 'test/unit'
3
+ require 'shoulda'
4
+ require 'mocha'
5
+
6
+ $LOAD_PATH.unshift(File.join(File.dirname(__FILE__), '..', 'lib'))
7
+ $LOAD_PATH.unshift(File.dirname(__FILE__))
8
+ require 'resque/resque'
9
+ require 'resque/throttle'
10
+ require 'resque/throttled_job'
11
+
12
+ class Test::Unit::TestCase
13
+ end
14
+
15
+ #fixture classes
16
+ class DefaultThrottledJob < Resque::ThrottledJob
17
+ @queue = :some_queue
18
+
19
+ def self.perform(some_id, some_other_thing)
20
+ end
21
+ end
22
+
23
+ class OneHourThrottledJob < Resque::ThrottledJob
24
+ @queue = :some_queue
25
+ throttle :can_run_every => 3600
26
+
27
+ def self.perform(some_id, some_other_thing)
28
+ end
29
+ end
30
+
31
+ class IdentifierThrottledJob < Resque::ThrottledJob
32
+ @queue = :some_queue
33
+
34
+ throttle :can_run_every => 3600
35
+
36
+ def self.perform(some_id, some_other_thing)
37
+ end
38
+
39
+ def self.identifier(*args)
40
+ first, second = *args
41
+ "my_#{first}"
42
+ end
43
+ end
44
+
45
+ class DisabledThrottledJob < Resque::ThrottledJob
46
+ @queue = :some_queue
47
+ throttle :disabled => true
48
+
49
+ def self.perform(some_id, some_other_thing)
50
+ end
51
+ end
metadata ADDED
@@ -0,0 +1,128 @@
1
+ --- !ruby/object:Gem::Specification
2
+ name: tech-angels-resque-throttle
3
+ version: !ruby/object:Gem::Version
4
+ hash: 63
5
+ prerelease: false
6
+ segments:
7
+ - 0
8
+ - 2
9
+ - 20
10
+ version: 0.2.20
11
+ platform: ruby
12
+ authors:
13
+ - Scott J. Tamosunas
14
+ autorequire:
15
+ bindir: bin
16
+ cert_chain: []
17
+
18
+ date: 2010-10-06 00:00:00 +02:00
19
+ default_executable:
20
+ dependencies:
21
+ - !ruby/object:Gem::Dependency
22
+ name: resque
23
+ prerelease: false
24
+ requirement: &id001 !ruby/object:Gem::Requirement
25
+ none: false
26
+ requirements:
27
+ - - ">="
28
+ - !ruby/object:Gem::Version
29
+ hash: 15
30
+ segments:
31
+ - 1
32
+ - 6
33
+ - 0
34
+ version: 1.6.0
35
+ type: :runtime
36
+ version_requirements: *id001
37
+ - !ruby/object:Gem::Dependency
38
+ name: shoulda
39
+ prerelease: false
40
+ requirement: &id002 !ruby/object:Gem::Requirement
41
+ none: false
42
+ requirements:
43
+ - - ">="
44
+ - !ruby/object:Gem::Version
45
+ hash: 3
46
+ segments:
47
+ - 0
48
+ version: "0"
49
+ type: :development
50
+ version_requirements: *id002
51
+ - !ruby/object:Gem::Dependency
52
+ name: mocha
53
+ prerelease: false
54
+ requirement: &id003 !ruby/object:Gem::Requirement
55
+ none: false
56
+ requirements:
57
+ - - ">="
58
+ - !ruby/object:Gem::Version
59
+ hash: 43
60
+ segments:
61
+ - 0
62
+ - 9
63
+ - 8
64
+ version: 0.9.8
65
+ type: :development
66
+ version_requirements: *id003
67
+ description: resque-throttle is an extension to the resque queue system that restricts the frequency in which certain jobs are run. Add more description here.
68
+ email: tamosunas@gmail.com
69
+ executables: []
70
+
71
+ extensions: []
72
+
73
+ extra_rdoc_files:
74
+ - LICENSE
75
+ - README.markdown
76
+ files:
77
+ - .document
78
+ - .gitignore
79
+ - LICENSE
80
+ - README.markdown
81
+ - Rakefile
82
+ - VERSION
83
+ - lib/resque-throttle.rb
84
+ - lib/resque/resque.rb
85
+ - lib/resque/throttle.rb
86
+ - lib/resque/throttled_job.rb
87
+ - resque-throttle.gemspec
88
+ - test/resque/resque_test.rb
89
+ - test/resque/throttled_job_test.rb
90
+ - test/test_helper.rb
91
+ has_rdoc: true
92
+ homepage: http://github.com/scotttam/resque-throttle
93
+ licenses: []
94
+
95
+ post_install_message:
96
+ rdoc_options:
97
+ - --charset=UTF-8
98
+ require_paths:
99
+ - lib
100
+ required_ruby_version: !ruby/object:Gem::Requirement
101
+ none: false
102
+ requirements:
103
+ - - ">="
104
+ - !ruby/object:Gem::Version
105
+ hash: 3
106
+ segments:
107
+ - 0
108
+ version: "0"
109
+ required_rubygems_version: !ruby/object:Gem::Requirement
110
+ none: false
111
+ requirements:
112
+ - - ">="
113
+ - !ruby/object:Gem::Version
114
+ hash: 3
115
+ segments:
116
+ - 0
117
+ version: "0"
118
+ requirements: []
119
+
120
+ rubyforge_project:
121
+ rubygems_version: 1.3.7
122
+ signing_key:
123
+ specification_version: 3
124
+ summary: resque-throttle is an extension to the resque queue system that restricts the frequency in which certain jobs are run.
125
+ test_files:
126
+ - test/resque/resque_test.rb
127
+ - test/resque/throttled_job_test.rb
128
+ - test/test_helper.rb