resque-pool-lifeguard 0.2.0

Sign up to get free protection for your applications and to get access to all the features.
checksums.yaml ADDED
@@ -0,0 +1,7 @@
1
+ ---
2
+ SHA1:
3
+ metadata.gz: 996db8e16912d190a81d140e345c55a46420f14d
4
+ data.tar.gz: 3897ef6ce90ae2481a6e91d2dd6dec4ed4950151
5
+ SHA512:
6
+ metadata.gz: 92616a7e384cfff1f1d2b94291028a9dc55e6c74f278773c05f6d94e41d020f342794eb0d38abd0fa04d7521345c09d10b24173b8f47f712bf5592da616484b5
7
+ data.tar.gz: 133f8c55a32529771afb0eb2bb814af8710b4b3271190cb188c4de9a30421ffde51dfc010784865f11456ce7e7b3de2003b54d555ec5a7c364eb829396e14ea2
data/.gitignore ADDED
@@ -0,0 +1,9 @@
1
+ /.bundle/
2
+ /.yardoc
3
+ /Gemfile.lock
4
+ /_yardoc/
5
+ /coverage/
6
+ /doc/
7
+ /pkg/
8
+ /spec/reports/
9
+ /tmp/
data/.rspec ADDED
@@ -0,0 +1,2 @@
1
+ --format documentation
2
+ --color
data/.travis.yml ADDED
@@ -0,0 +1,6 @@
1
+ language: ruby
2
+ rvm:
3
+ - 2.1
4
+ - 2.2
5
+ - 2.3.0
6
+ before_install: gem install bundler -v 1.11.2
@@ -0,0 +1,49 @@
1
+ # Contributor Code of Conduct
2
+
3
+ As contributors and maintainers of this project, and in the interest of
4
+ fostering an open and welcoming community, we pledge to respect all people who
5
+ contribute through reporting issues, posting feature requests, updating
6
+ documentation, submitting pull requests or patches, and other activities.
7
+
8
+ We are committed to making participation in this project a harassment-free
9
+ experience for everyone, regardless of level of experience, gender, gender
10
+ identity and expression, sexual orientation, disability, personal appearance,
11
+ body size, race, ethnicity, age, religion, or nationality.
12
+
13
+ Examples of unacceptable behavior by participants include:
14
+
15
+ * The use of sexualized language or imagery
16
+ * Personal attacks
17
+ * Trolling or insulting/derogatory comments
18
+ * Public or private harassment
19
+ * Publishing other's private information, such as physical or electronic
20
+ addresses, without explicit permission
21
+ * Other unethical or unprofessional conduct
22
+
23
+ Project maintainers have the right and responsibility to remove, edit, or
24
+ reject comments, commits, code, wiki edits, issues, and other contributions
25
+ that are not aligned to this Code of Conduct, or to ban temporarily or
26
+ permanently any contributor for other behaviors that they deem inappropriate,
27
+ threatening, offensive, or harmful.
28
+
29
+ By adopting this Code of Conduct, project maintainers commit themselves to
30
+ fairly and consistently applying these principles to every aspect of managing
31
+ this project. Project maintainers who do not follow or enforce the Code of
32
+ Conduct may be permanently removed from the project team.
33
+
34
+ This code of conduct applies both within project spaces and in public spaces
35
+ when an individual is representing the project or its community.
36
+
37
+ Instances of abusive, harassing, or otherwise unacceptable behavior may be
38
+ reported by contacting a project maintainer at crazymykl@gmail.com. All
39
+ complaints will be reviewed and investigated and will result in a response that
40
+ is deemed necessary and appropriate to the circumstances. Maintainers are
41
+ obligated to maintain confidentiality with regard to the reporter of an
42
+ incident.
43
+
44
+ This Code of Conduct is adapted from the [Contributor Covenant][homepage],
45
+ version 1.3.0, available at
46
+ [http://contributor-covenant.org/version/1/3/0/][version]
47
+
48
+ [homepage]: http://contributor-covenant.org
49
+ [version]: http://contributor-covenant.org/version/1/3/0/
data/Gemfile ADDED
@@ -0,0 +1,4 @@
1
+ source 'https://rubygems.org'
2
+
3
+ # Specify your gem's dependencies in resque-pool-lifeguard.gemspec
4
+ gemspec
data/LICENSE.txt ADDED
@@ -0,0 +1,21 @@
1
+ The MIT License (MIT)
2
+
3
+ Copyright (c) 2016 Mike MacDonald
4
+
5
+ Permission is hereby granted, free of charge, to any person obtaining a copy
6
+ of this software and associated documentation files (the "Software"), to deal
7
+ in the Software without restriction, including without limitation the rights
8
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9
+ copies of the Software, and to permit persons to whom the Software is
10
+ furnished to do so, subject to the following conditions:
11
+
12
+ The above copyright notice and this permission notice shall be included in
13
+ all copies or substantial portions of the Software.
14
+
15
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
21
+ THE SOFTWARE.
data/README.md ADDED
@@ -0,0 +1,40 @@
1
+ # Resque::Pool::Lifeguard [![Build Status](https://travis-ci.org/crazymykl/resque-pool-lifeguard.svg?branch=master)](https://travis-ci.org/crazymykl/resque-pool-lifeguard)
2
+
3
+ Resque pool is a great way to manage a set of resque workers. However, sometimes one wants to spin up a bunch of workers temporarily, or to conserve resources during times of heavy load.
4
+
5
+ ## Installation
6
+
7
+ Add this line to your application's Gemfile:
8
+
9
+ ```ruby
10
+ gem 'resque-pool-lifeguard'
11
+ ```
12
+
13
+ And then execute:
14
+
15
+ $ bundle
16
+
17
+ Or install it yourself as:
18
+
19
+ $ gem install resque-pool-lifeguard
20
+
21
+ ## Usage
22
+
23
+ Add `require 'resque/pool/lifeguard/tasks'` to your Rakefile (as well as the existing `resque-pool` config).
24
+
25
+ Add `require 'resque/pool/lifeguard/server'` to where you mount your resque-web GUI.
26
+
27
+ ## Development
28
+
29
+ After checking out the repo, run `bin/setup` to install dependencies. Then, run `rake spec` to run the tests. You can also run `bin/console` for an interactive prompt that will allow you to experiment.
30
+
31
+ To install this gem onto your local machine, run `bundle exec rake install`. To release a new version, update the version number in `version.rb`, and then run `bundle exec rake release`, which will create a git tag for the version, push git commits and tags, and push the `.gem` file to [rubygems.org](https://rubygems.org).
32
+
33
+ ## Contributing
34
+
35
+ Bug reports and pull requests are welcome on GitHub at https://github.com/crazymykl/resque-pool-lifeguard. This project is intended to be a safe, welcoming space for collaboration, and contributors are expected to adhere to the [Contributor Covenant](http://contributor-covenant.org) code of conduct.
36
+
37
+
38
+ ## License
39
+
40
+ The gem is available as open source under the terms of the [MIT License](http://opensource.org/licenses/MIT).
data/Rakefile ADDED
@@ -0,0 +1,7 @@
1
+ require "bundler/gem_tasks"
2
+ require "rspec/core/rake_task"
3
+ require 'resque/pool/lifeguard/tasks'
4
+
5
+ RSpec::Core::RakeTask.new(:spec)
6
+
7
+ task :default => :spec
data/bin/console ADDED
@@ -0,0 +1,14 @@
1
+ #!/usr/bin/env ruby
2
+
3
+ require "bundler/setup"
4
+ require "resque/pool/lifeguard"
5
+
6
+ # You can add fixtures and/or initialization code here to make experimenting
7
+ # with your gem easier. You can also use a different console, if you like.
8
+
9
+ # (If you use this, don't forget to add pry to your Gemfile!)
10
+ # require "pry"
11
+ # Pry.start
12
+
13
+ require "irb"
14
+ IRB.start
data/bin/setup ADDED
@@ -0,0 +1,8 @@
1
+ #!/usr/bin/env bash
2
+ set -euo pipefail
3
+ IFS=$'\n\t'
4
+ set -vx
5
+
6
+ bundle install
7
+
8
+ # Do any other automated setup that you need to do here
@@ -0,0 +1,76 @@
1
+ require 'resque/pool'
2
+ require "resque/pool/lifeguard/version"
3
+
4
+ module Resque
5
+ class Pool
6
+ class Lifeguard
7
+
8
+ def initialize hostname: Socket.gethostname, defaults: -> (env) { {} }
9
+ @defaults = defaults
10
+ @hostname = hostname
11
+ end
12
+
13
+ def self.pool_key
14
+ 'resque-pool-lifeguard'
15
+ end
16
+
17
+ def self.all_pools
18
+ all = Resque.redis.hgetall pool_key
19
+ all.map { |k, v|
20
+ [k, Resque.decode(v)]
21
+ }.to_h
22
+ rescue Resque::Helpers::DecodeException
23
+ reset!
24
+ {}
25
+ end
26
+
27
+ def self.reset!
28
+ Resque.redis.del pool_key
29
+ end
30
+
31
+ def call env
32
+ values || set_defaults(env)
33
+ end
34
+
35
+ def reset!
36
+ Resque.redis.hdel pool_key, hostname
37
+ end
38
+
39
+ def values
40
+ Resque.decode Resque.redis.hget pool_key, hostname
41
+ rescue Resque::Helpers::DecodeException
42
+ reset!
43
+ nil
44
+ end
45
+
46
+ def values= values
47
+ Resque.redis.hset pool_key, hostname, (Resque.encode values)
48
+ end
49
+
50
+ def [] queues
51
+ values.to_h[queues]
52
+ end
53
+
54
+ def []= queues, count
55
+ self.values = if count.zero?
56
+ values.to_h.tap do |vals| vals.delete queues end
57
+ else
58
+ values.to_h.merge queues => count
59
+ end
60
+ end
61
+
62
+ private
63
+ attr_reader :defaults
64
+ attr_reader :hostname
65
+
66
+ def pool_key
67
+ self.class.pool_key
68
+ end
69
+
70
+ def set_defaults env
71
+ self.values = defaults.(env)
72
+ end
73
+
74
+ end
75
+ end
76
+ end
@@ -0,0 +1,43 @@
1
+ require 'resque/server'
2
+ require 'resque/pool/lifeguard'
3
+
4
+ module Resque
5
+ class Pool
6
+ class Lifeguard
7
+ module Server
8
+ VIEW_PATH = File.join(__dir__, 'server', 'views')
9
+
10
+ def self.registered app
11
+ app.get '/pools' do
12
+ pools_view
13
+ end
14
+
15
+ app.post '/pools/:host' do
16
+ host, queues, count = params.values_at(*%i[host queues count])
17
+
18
+ Lifeguard.new(hostname: host)[queues] = Integer(count)
19
+ redirect u :pools
20
+ end
21
+
22
+ app.get "/pools.poll" do
23
+ content_type "text/plain"
24
+ @polling = true
25
+
26
+ pools_view layout: false
27
+ end
28
+
29
+ app.helpers do
30
+ def pools_view(options = {}, locals = {})
31
+ erb File.read(File.join VIEW_PATH, "pool.erb"), options, locals
32
+ end
33
+ end
34
+
35
+ app.tabs << 'Pools'
36
+ end
37
+
38
+ end
39
+
40
+ Resque::Server.register Server
41
+ end
42
+ end
43
+ end
@@ -0,0 +1,67 @@
1
+ <% pools = Resque::Pool::Lifeguard.all_pools %>
2
+ <% workers = Resque.workers.group_by { |w| [w.hostname, w.queues] } %>
3
+
4
+ <style>
5
+ #main form.queues {
6
+ float: none;
7
+ margin: 0;
8
+ }
9
+
10
+ form.queues input[type="number"] {
11
+ width: 35px;
12
+ }
13
+ </style>
14
+
15
+ <h1 class='wi'>Worker Pools</h1>
16
+ <p class='intro'>The worker pools listed below are all registered as active on your system.</p>
17
+
18
+ <% pools.each do |host, pool| %>
19
+ <% if pools.length > 1 %>
20
+ <h2 class='hostname'><%= host %></h2>
21
+ <% end %>
22
+ <table class='pool'>
23
+ <tr>
24
+ <th>Queues</th>
25
+ <th>Provisioned</th>
26
+ <th>Running</th>
27
+ <th>Working</th>
28
+ <th>Idle</th>
29
+ </tr>
30
+ <% pool.each do |queues, count| %>
31
+ <% split_queues = queues.split ',' %>
32
+ <% my_workers = workers.fetch [host, split_queues], [] %>
33
+ <tr>
34
+ <td class='queues'>
35
+ <% split_queues.each do |q| %>
36
+ <a class="queue-tag" href="<%= u "/queues/#{q}" %>"><%= q %></a>
37
+ <% end %>
38
+ </td>
39
+ <td>
40
+ <form class='update queues' action="<%= u "/pools/#{host}" %>" method="POST">
41
+ <input name="queues" type="hidden" value="<%= queues %>">
42
+ <input name="count" type="number" min="0" value="<%= count %>">
43
+ <input type="submit" value="Update">
44
+ </form>
45
+ </td>
46
+ <td><%= my_workers.count %></td>
47
+ <td><%= my_workers.count &:working? %></td>
48
+ <td><%= my_workers.count &:idle? %></td>
49
+ </tr>
50
+ <% end %>
51
+ <tr>
52
+ <th>Add new...</th>
53
+ <td colspan="4">
54
+ <form class='new queues' action="<%= u "/pools/#{host}" %>" method="POST">
55
+ <input name="queues" placeholder="Enter queue name(s)">
56
+ <input name="count" type="number" min="0" value="1">
57
+ <input type="submit" value="Create">
58
+ </form>
59
+ </td>
60
+ </tr>
61
+ </table>
62
+
63
+ <% end %>
64
+
65
+
66
+
67
+ <%= poll %>
@@ -0,0 +1,19 @@
1
+ require 'resque/tasks'
2
+ require 'resque/pool/tasks'
3
+ require 'resque/pool/lifeguard'
4
+
5
+ namespace :resque do
6
+
7
+ namespace :pool do
8
+ # resque pool config. e.g. after_prefork connection handling
9
+ task :lifeguard do
10
+ defaults = FileOrHashLoader.new
11
+ Resque::Pool.config_loader = Resque::Pool::Lifeguard.new defaults: defaults
12
+ Resque::Pool.log "Resque Pool Lifeguard on Duty"
13
+ end
14
+
15
+ task setup: :lifeguard
16
+
17
+ end
18
+
19
+ end
@@ -0,0 +1,7 @@
1
+ module Resque
2
+ class Pool
3
+ class Lifeguard
4
+ VERSION = "0.2.0"
5
+ end
6
+ end
7
+ end
@@ -0,0 +1,30 @@
1
+ # coding: utf-8
2
+ lib = File.expand_path('../lib', __FILE__)
3
+ $LOAD_PATH.unshift(lib) unless $LOAD_PATH.include?(lib)
4
+ require 'resque/pool/lifeguard/version'
5
+
6
+ Gem::Specification.new do |spec|
7
+ spec.name = "resque-pool-lifeguard"
8
+ spec.version = Resque::Pool::Lifeguard::VERSION
9
+ spec.authors = ["Mike MacDonald"]
10
+ spec.email = ["crazymykl@gmail.com"]
11
+
12
+ spec.summary = %q{Adds live GUI queue/worker management to resque-pool}
13
+ spec.homepage = "https://github.com/crazymykl/resque-pool-lifeguard"
14
+ spec.license = "MIT"
15
+
16
+ spec.required_ruby_version = '>= 2.0'
17
+
18
+ spec.files = `git ls-files -z`.split("\x0").reject { |f| f.match(%r{^(test|spec|features)/}) }
19
+ spec.bindir = "exe"
20
+ spec.executables = spec.files.grep(%r{^exe/}) { |f| File.basename(f) }
21
+ spec.require_paths = ["lib"]
22
+
23
+ spec.add_dependency "resque", "~> 1.22"
24
+ spec.add_dependency "resque-pool", "~> 0.6.0"
25
+ spec.add_dependency "rake"
26
+ spec.add_development_dependency "bundler", "~> 1.11"
27
+ spec.add_development_dependency "rspec", "~> 3.0"
28
+ spec.add_development_dependency "simplecov", "~> 0.11.2"
29
+ spec.add_development_dependency "fakeredis", "~> 0.5.0"
30
+ end
metadata ADDED
@@ -0,0 +1,158 @@
1
+ --- !ruby/object:Gem::Specification
2
+ name: resque-pool-lifeguard
3
+ version: !ruby/object:Gem::Version
4
+ version: 0.2.0
5
+ platform: ruby
6
+ authors:
7
+ - Mike MacDonald
8
+ autorequire:
9
+ bindir: exe
10
+ cert_chain: []
11
+ date: 2016-03-24 00:00:00.000000000 Z
12
+ dependencies:
13
+ - !ruby/object:Gem::Dependency
14
+ name: resque
15
+ requirement: !ruby/object:Gem::Requirement
16
+ requirements:
17
+ - - "~>"
18
+ - !ruby/object:Gem::Version
19
+ version: '1.22'
20
+ type: :runtime
21
+ prerelease: false
22
+ version_requirements: !ruby/object:Gem::Requirement
23
+ requirements:
24
+ - - "~>"
25
+ - !ruby/object:Gem::Version
26
+ version: '1.22'
27
+ - !ruby/object:Gem::Dependency
28
+ name: resque-pool
29
+ requirement: !ruby/object:Gem::Requirement
30
+ requirements:
31
+ - - "~>"
32
+ - !ruby/object:Gem::Version
33
+ version: 0.6.0
34
+ type: :runtime
35
+ prerelease: false
36
+ version_requirements: !ruby/object:Gem::Requirement
37
+ requirements:
38
+ - - "~>"
39
+ - !ruby/object:Gem::Version
40
+ version: 0.6.0
41
+ - !ruby/object:Gem::Dependency
42
+ name: rake
43
+ requirement: !ruby/object:Gem::Requirement
44
+ requirements:
45
+ - - ">="
46
+ - !ruby/object:Gem::Version
47
+ version: '0'
48
+ type: :runtime
49
+ prerelease: false
50
+ version_requirements: !ruby/object:Gem::Requirement
51
+ requirements:
52
+ - - ">="
53
+ - !ruby/object:Gem::Version
54
+ version: '0'
55
+ - !ruby/object:Gem::Dependency
56
+ name: bundler
57
+ requirement: !ruby/object:Gem::Requirement
58
+ requirements:
59
+ - - "~>"
60
+ - !ruby/object:Gem::Version
61
+ version: '1.11'
62
+ type: :development
63
+ prerelease: false
64
+ version_requirements: !ruby/object:Gem::Requirement
65
+ requirements:
66
+ - - "~>"
67
+ - !ruby/object:Gem::Version
68
+ version: '1.11'
69
+ - !ruby/object:Gem::Dependency
70
+ name: rspec
71
+ requirement: !ruby/object:Gem::Requirement
72
+ requirements:
73
+ - - "~>"
74
+ - !ruby/object:Gem::Version
75
+ version: '3.0'
76
+ type: :development
77
+ prerelease: false
78
+ version_requirements: !ruby/object:Gem::Requirement
79
+ requirements:
80
+ - - "~>"
81
+ - !ruby/object:Gem::Version
82
+ version: '3.0'
83
+ - !ruby/object:Gem::Dependency
84
+ name: simplecov
85
+ requirement: !ruby/object:Gem::Requirement
86
+ requirements:
87
+ - - "~>"
88
+ - !ruby/object:Gem::Version
89
+ version: 0.11.2
90
+ type: :development
91
+ prerelease: false
92
+ version_requirements: !ruby/object:Gem::Requirement
93
+ requirements:
94
+ - - "~>"
95
+ - !ruby/object:Gem::Version
96
+ version: 0.11.2
97
+ - !ruby/object:Gem::Dependency
98
+ name: fakeredis
99
+ requirement: !ruby/object:Gem::Requirement
100
+ requirements:
101
+ - - "~>"
102
+ - !ruby/object:Gem::Version
103
+ version: 0.5.0
104
+ type: :development
105
+ prerelease: false
106
+ version_requirements: !ruby/object:Gem::Requirement
107
+ requirements:
108
+ - - "~>"
109
+ - !ruby/object:Gem::Version
110
+ version: 0.5.0
111
+ description:
112
+ email:
113
+ - crazymykl@gmail.com
114
+ executables: []
115
+ extensions: []
116
+ extra_rdoc_files: []
117
+ files:
118
+ - ".gitignore"
119
+ - ".rspec"
120
+ - ".travis.yml"
121
+ - CODE_OF_CONDUCT.md
122
+ - Gemfile
123
+ - LICENSE.txt
124
+ - README.md
125
+ - Rakefile
126
+ - bin/console
127
+ - bin/setup
128
+ - lib/resque/pool/lifeguard.rb
129
+ - lib/resque/pool/lifeguard/server.rb
130
+ - lib/resque/pool/lifeguard/server/views/pool.erb
131
+ - lib/resque/pool/lifeguard/tasks.rb
132
+ - lib/resque/pool/lifeguard/version.rb
133
+ - resque-pool-lifeguard.gemspec
134
+ homepage: https://github.com/crazymykl/resque-pool-lifeguard
135
+ licenses:
136
+ - MIT
137
+ metadata: {}
138
+ post_install_message:
139
+ rdoc_options: []
140
+ require_paths:
141
+ - lib
142
+ required_ruby_version: !ruby/object:Gem::Requirement
143
+ requirements:
144
+ - - ">="
145
+ - !ruby/object:Gem::Version
146
+ version: '2.0'
147
+ required_rubygems_version: !ruby/object:Gem::Requirement
148
+ requirements:
149
+ - - ">="
150
+ - !ruby/object:Gem::Version
151
+ version: '0'
152
+ requirements: []
153
+ rubyforge_project:
154
+ rubygems_version: 2.4.3
155
+ signing_key:
156
+ specification_version: 4
157
+ summary: Adds live GUI queue/worker management to resque-pool
158
+ test_files: []