einhorn 0.8.2 → 1.0.1

data/.travis.yml

@@ -1,10 +0,0 @@
-language: ruby
-rvm:
-  - 2.0.0
-  - 2.1
-  - 2.2
-
-# This is to work around the version of bundler installed in Travis and
-# https://github.com/bundler/bundler/issues/3558
-before_install:
-  - gem update bundler

data/CONTRIBUTORS

@@ -1,6 +0,0 @@
-Greg Brockman <gdb@stripe.com>
-Evan Broder <evan@stripe.com>
-Nelson Elhage <nelhage@stripe.com>
-Paul Hammond <paul@paulhammond.org>
-Conrad Irwin <conrad.irwin@gmail.com>
-Max Wang <max@stripe.com>

data/Gemfile

@@ -1,11 +0,0 @@
-# Execute bundler hook if present
-['~/.', '/etc/'].any? do |file|
- File.lstat(path = File.expand_path(file + 'bundle-gemfile-hook')) rescue next
- eval(File.read(path), binding, path); break true
-end || source('https://rubygems.org/')
-
-# Only needed for examples
-gem 'thin-attach_socket'
-
-# Specify your gem's dependencies in einhorn.gemspec
-gemspec

data/History.txt

@@ -1,4 +0,0 @@
-=== 0.5.0 2013-07-11
-
-* 1 major enhancement:
-  * Improve Einhorn protocol to allow multiplexing of commands on a single socket

data/README.md.in

@@ -1,94 +0,0 @@
-# Einhorn: the language-independent shared socket manager
-
-![Einhorn](https://stripe.com/img/blog/posts/meet-einhorn/einhorn.png)
-
-Let's say you have a server process which processes one request at a
-time. Your site is becoming increasingly popular, and this one process
-is no longer able to handle all of your inbound connections. However,
-you notice that your box's load number is low.
-
-So you start thinking about how to handle more requests. You could
-rewrite your server to use threads, but threads are a pain to program
-against (and maybe you're writing in Python or Ruby where you don't
-have true threads anyway). You could rewrite your server to be
-event-driven, but that'd require a ton of effort, and it wouldn't help
-you go beyond one core. So instead, you decide to just run multiple
-copies of your server process.
-
-Enter Einhorn. Einhorn makes it easy to run (and keep alive) multiple
-copies of a single long-lived process. If that process is a server
-listening on some socket, Einhorn will open the socket in the master
-process so that it's shared among the workers.
-
-Einhorn is designed to be compatible with arbitrary languages and
-frameworks, requiring minimal modification of your
-application. Einhorn is simple to configure and run.
-
-## Installation
-
-Install from Rubygems as:
-
-    $ gem install einhorn
-
-Or build from source by:
-
-    $ gem build einhorn.gemspec
-
-And then install the built gem.
-
-[[usage]]
-
-## Contributing
-
-Contributions are definitely welcome. To contribute, just follow the
-usual workflow:
-
-1. Fork Einhorn
-2. Create your feature branch (`git checkout -b my-new-feature`)
-3. Commit your changes (`git commit -am 'Added some feature'`)
-4. Push to the branch (`git push origin my-new-feature`)
-5. Create new Github pull request
-
-## History
-
-Einhorn came about when Stripe was investigating seamless code
-upgrading solutions for our API worker processes. We really liked the
-process model of [Unicorn](http://unicorn.bogomips.org/), but didn't
-want to use its HTTP functionality. So Einhorn was born, providing the
-master process functionality of Unicorn (and similar preforking
-servers) to a wider array of applications.
-
-See https://stripe.com/blog/meet-einhorn for more background.
-
-Stripe currently uses Einhorn in production for a number of
-services. You can use Conrad Irwin's thin-attach_socket gem along with
-EventMachine-LE to support file-descriptor passing. Check out
-`example/thin_example` for an example of running Thin under Einhorn.
-
-## Compatibility
-
-Einhorn runs in Ruby 2.0, 2.1, and 2.2
-
-The following libraries ease integration with Einhorn with languages other than
-Ruby:
-
-- **[go-einhorn](https://github.com/stripe/go-einhorn)**: Stripe's own library
-  for *talking* to an einhorn master (doesn't wrap socket code).
-- **[goji](https://github.com/zenazn/goji/)**: Go (golang) server framework. The
-  [`bind`](https://godoc.org/github.com/zenazn/goji/bind) and
-  [`graceful`](https://godoc.org/github.com/zenazn/goji/graceful)
-  packages provide helpers and HTTP/TCP connection wrappers for Einhorn
-  integration.
-- **[github.com/CHH/einhorn](https://github.com/CHH/einhorn)**: PHP library
-- **[thin-attach\_socket](https://github.com/ConradIrwin/thin-attach_socket)**:
-  run `thin` behind Einhorn
-- **[baseplate](https://reddit.github.io/baseplate/cli/serve.html)**: a
-  collection of Python helpers and libraries, with support for running behind
-  Einhorn
-
-*NB: this list should not imply any official endorsement or vetting!*
-
-## About
-
-Einhorn is a project of [Stripe](https://stripe.com), led by [Carl Jackson](https://github.com/zenazn). Feel free to get in touch at
-info@stripe.com.

data/Rakefile

@@ -1,27 +0,0 @@
-#!/usr/bin/env rake
-require 'bundler/gem_tasks'
-require 'rake/testtask'
-
-desc 'Rebuild the README with the latest usage from einhorn'
-task :readme do
-  Dir.chdir(File.dirname(__FILE__))
-  readme = File.read('README.md.in')
-  usage = `bin/einhorn -h`
-  readme.gsub!('[[usage]]', usage)
-  File.open('README.md', 'w') {|f| f.write(readme)}
-end
-
-task :default => :test do
-end
-require 'bundler/setup'
-require 'chalk-rake/gem_tasks'
-require 'rake/testtask'
-
-Rake::TestTask.new do |t|
-  t.libs = ['lib']
-  # t.warning = true
-  t.verbose = true
-  t.test_files = FileList['test/**/*.rb'].reject do |file|
-    file.end_with?('_lib.rb') || file.include?('/_lib/')
-  end
-end

data/test/_lib.rb

@@ -1,12 +0,0 @@
-require 'rubygems'
-require 'bundler/setup'
-
-require 'minitest/autorun'
-require 'minitest/spec'
-require 'mocha/setup'
-
-class EinhornTestCase < ::MiniTest::Spec
-  def setup
-    # Put global stubs here
-  end
-end

data/test/integration/_lib/fixtures/env_printer/env_printer.rb

@@ -1,26 +0,0 @@
-require 'bundler/setup'
-require 'socket'
-require 'einhorn/worker'
-
-def einhorn_main
-  $stderr.puts "Worker starting up!"
-  serv = Socket.for_fd(ENV['EINHORN_FD_0'].to_i)
-  $stderr.puts "Worker has a socket"
-  Einhorn::Worker.ack!
-  $stderr.puts "Worker sent ack to einhorn"
-  $stdout.puts "Environment from #{Process.pid} is: #{ENV.inspect}"
-  while true
-    s, addrinfo = serv.accept
-    $stderr.puts "Worker got a socket!"
-    output = ""
-    ARGV.each do |variable_to_write|
-      output += ENV[variable_to_write].to_s
-    end
-    s.write(output)
-    s.flush
-    s.close
-    $stderr.puts "Worker closed its socket"
-  end
-end
-
-einhorn_main if $0 == __FILE__

data/test/integration/_lib/fixtures/exit_during_upgrade/exiting_server.rb

@@ -1,23 +0,0 @@
-require 'bundler/setup'
-require 'socket'
-require 'einhorn/worker'
-
-def einhorn_main
-  serv = Socket.for_fd(Einhorn::Worker.socket!)
-  Einhorn::Worker.ack!
-  Einhorn::Worker.ping!("id-1")
-
-  Signal.trap('USR2') do
-    sleep 3
-    exit!
-  end
-
-  while true
-    s, _ = serv.accept
-    s.write($$)
-    s.flush
-    s.close
-  end
-end
-
-einhorn_main if $0 == __FILE__

data/test/integration/_lib/fixtures/exit_during_upgrade/upgrade_reexec.rb

@@ -1,6 +0,0 @@
-#!/bin/sh
-
-if [ "$1" = "--with-state-fd" ]; then
-  sleep 6
-fi
-exec bundle exec --keep-file-descriptors einhorn "$@"

data/test/integration/_lib/fixtures/pdeathsig_printer/pdeathsig_printer.rb

@@ -1,29 +0,0 @@
-require 'bundler/setup'
-require 'socket'
-require 'einhorn/worker'
-require 'einhorn/prctl'
-
-def einhorn_main
-  serv = Socket.for_fd(Einhorn::Worker.socket!)
-
-  Signal.trap("USR2") { exit }
-
-  begin
-    output = Einhorn::Prctl.get_pdeathsig
-    if output == nil then
-      output = "nil"
-    end
-  rescue NotImplementedError
-    output = "not implemented"
-  end
-
-  Einhorn::Worker.ack!
-  while true
-    s, _ = serv.accept
-    s.write(output)
-    s.flush
-    s.close
-  end
-end
-
-einhorn_main if $0 == __FILE__

data/test/integration/_lib/fixtures/signal_timeout/sleepy_server.rb

@@ -1,23 +0,0 @@
-require 'bundler/setup'
-require 'socket'
-require 'einhorn/worker'
-
-def einhorn_main
-  serv = Socket.for_fd(Einhorn::Worker.socket!)
-  Einhorn::Worker.ack!
-  Einhorn::Worker.ping!("id-1")
-
-  Signal.trap('USR2') do
-    sleep ENV.fetch("TRAP_SLEEP").to_i
-    exit
-  end
-
-  while true
-    s, _ = serv.accept
-    s.write($$)
-    s.flush
-    s.close
-  end
-end
-
-einhorn_main if $0 == __FILE__

data/test/integration/_lib/fixtures/upgrade_project/upgrading_server.rb

@@ -1,24 +0,0 @@
-require 'bundler/setup'
-require 'socket'
-require 'einhorn/worker'
-
-def einhorn_main
-  version = File.read(File.join(File.dirname(__FILE__), "version"))
-  $stderr.puts "Worker starting up!"
-  serv = Socket.for_fd(ENV['EINHORN_FD_0'].to_i)
-  $stderr.puts "Worker has a socket"
-  Einhorn::Worker.ack!
-  $stderr.puts "Worker sent ack to einhorn"
-  Einhorn::Worker.ping!("id-1")
-  $stderr.puts "Worker has sent a ping to einhorn"
-  while true
-    s, addrinfo = serv.accept
-    $stderr.puts "Worker got a socket!"
-    s.write(version)
-    s.flush
-    s.close
-    $stderr.puts "Worker closed its socket"
-  end
-end
-
-einhorn_main if $0 == __FILE__

data/test/integration/_lib/helpers/einhorn_helpers.rb

@@ -1,148 +0,0 @@
-require 'subprocess'
-require 'timeout'
-require 'tmpdir'
-
-module Helpers
-  module EinhornHelpers
-    def einhorn_code_dir
-      File.expand_path('../../../../', File.dirname(__FILE__))
-    end
-
-    def default_einhorn_command
-      cmd = ['bundle', 'exec']
-      cmd << '--keep-file-descriptors' if RUBY_VERSION >= '2.0'
-      cmd << File.expand_path('bin/einhorn', einhorn_code_dir)
-
-      cmd
-    end
-
-    def with_running_einhorn(cmdline, options = {})
-      options = options.dup
-      einhorn_command = options.delete(:einhorn_command) { default_einhorn_command }
-      expected_exit_code = options.delete(:expected_exit_code) { nil }
-      output_callback = options.delete(:output_callback) { nil }
-
-      stdout, stderr = "", ""
-      communicator = nil
-      process = Bundler.with_clean_env do
-        default_options = {
-          :stdout => Subprocess::PIPE,
-          :stderr => Subprocess::PIPE,
-          :stdin => '/dev/null',
-          :cwd => einhorn_code_dir
-        }
-        Subprocess::Process.new(Array(einhorn_command) + cmdline, default_options.merge(options))
-      end
-
-      status = nil
-      begin
-        communicator = Thread.new do
-          begin
-            stdout, stderr = process.communicate
-          rescue Errno::ECHILD
-            # It's dead, and we're not getting anything. This is peaceful.
-          end
-        end
-        yield(process) if block_given?
-      rescue
-        unless (status = process.poll) && status.exited?
-          process.terminate
-        end
-        raise
-      ensure
-        unless (status = process.poll) && status.exited?
-          for i in 1..10 do
-            status = process.poll
-            if status && status.exited?
-              break
-            end
-            sleep(1)
-          end
-          unless status && status.exited?
-            $stderr.puts "Could not get Einhorn to quit within 10 seconds, killing it forcefully..."
-            process.send_signal("KILL")
-            status = process.wait
-          end
-        end
-        communicator.join
-        output_callback.call(stdout, stderr) if output_callback
-      end
-    end
-
-    def einhornsh(commandline, options = {})
-      Subprocess.check_call(%W{bundle exec #{File.expand_path('bin/einhornsh')}} + commandline,
-                            {
-                              :stdin => '/dev/null',
-                              :stdout => '/dev/null',
-                              :stderr => '/dev/null'
-                            }.merge(options))
-    end
-
-    def fixture_path(name)
-      File.expand_path(File.join('../fixtures', name), File.dirname(__FILE__))
-    end
-
-    # Creates a new temporary directory with the initial contents from
-    # test/integration/_lib/fixtures/{name} and returns the path to
-    # it.  The contents of this directory are temporary and can be
-    # safely overwritten.
-    def prepare_fixture_directory(name)
-      @fixtured_dirs ||= Set.new
-      new_dir = Dir.mktmpdir(name)
-      @fixtured_dirs << new_dir
-      FileUtils.cp_r(File.join(fixture_path(name), '.'), new_dir, :preserve => true)
-
-      new_dir
-    end
-
-    def cleanup_fixtured_directories
-      (@fixtured_dirs || []).each { |dir| FileUtils.rm_rf(dir) }
-    end
-
-    def find_free_port(host='127.0.0.1')
-      open_port = TCPServer.new(host, 0)
-      open_port.addr[1]
-    ensure
-      open_port.close
-    end
-
-    def get_state(client)
-      client.send_command('command' => 'state')
-      YAML.load(client.receive_message['message'])[:state]
-    end
-
-    def wait_for_open_port
-      max_retries = 50
-      begin
-        read_from_port
-      rescue Errno::ECONNREFUSED
-        max_retries -= 1
-        if max_retries <= 0
-          raise
-        else
-          sleep 0.1
-          retry
-        end
-      end
-    end
-
-
-    def read_from_port
-      ewouldblock = RUBY_VERSION >= '1.9.0' ? IO::WaitWritable : Errno::EINPROGRESS
-      socket = Socket.new(Socket::PF_INET, Socket::SOCK_STREAM, 0)
-      sockaddr = Socket.pack_sockaddr_in(@port, '127.0.0.1')
-      begin
-        socket.connect_nonblock(sockaddr)
-      rescue ewouldblock
-        IO.select(nil, [socket], [], 5)
-        begin
-          socket.connect_nonblock(sockaddr)
-        rescue Errno::EISCONN
-        end
-      end
-      socket.read.chomp
-    ensure
-      socket.close if socket
-    end
-  end
-end

data/test/integration/_lib/helpers.rb

@@ -1,4 +0,0 @@
-module Helpers
-end
-
-require(File.expand_path('helpers/einhorn_helpers', File.dirname(__FILE__)))

data/test/integration/_lib.rb

@@ -1,6 +0,0 @@
-require(File.expand_path('../_lib', File.dirname(__FILE__)))
-require(File.expand_path('_lib/helpers', File.dirname(__FILE__)))
-
-class EinhornIntegrationTestCase < EinhornTestCase
-
-end

data/test/integration/pdeathsig.rb

@@ -1,26 +0,0 @@
-require(File.expand_path('_lib', File.dirname(__FILE__)))
-
-class PdeathsigTest < EinhornIntegrationTestCase
-  include Helpers::EinhornHelpers
-
-  describe 'when run with -k' do
-    before do
-      @dir = prepare_fixture_directory('pdeathsig_printer')
-      @port = find_free_port
-      @server_program = File.join(@dir, 'pdeathsig_printer.rb')
-      @socket_path = File.join(@dir, 'einhorn.sock')
-    end
-    after { cleanup_fixtured_directories }
-
-    it 'sets pdeathsig to USR2 in the child process' do
-      with_running_einhorn(%W{einhorn -m manual -b 127.0.0.1:#{@port} -d #{@socket_path} -k -- ruby #{@server_program}}) do |process|
-        wait_for_open_port
-        output = read_from_port
-        if output != "not implemented" then
-          assert_equal("USR2", output)
-        end
-        process.terminate
-      end
-    end
-  end
-end

data/test/integration/startup.rb

@@ -1,31 +0,0 @@
-require(File.expand_path('_lib', File.dirname(__FILE__)))
-
-class StartupTest < EinhornIntegrationTestCase
-  include Helpers::EinhornHelpers
-
-  describe 'when invoked without args' do
-    it 'prints usage and exits with 1' do
-      assert_raises(Subprocess::NonZeroExit) do
-        Subprocess.check_call(default_einhorn_command,
-                              :stdout => Subprocess::PIPE,
-                              :stderr => Subprocess::PIPE) do |einhorn|
-          stdout, stderr = einhorn.communicate
-          assert_match(/\A## Usage/, stdout)
-          assert_equal(1, einhorn.wait.exitstatus)
-        end
-      end
-    end
-  end
-
-  describe 'when invoked with --upgrade-check' do
-    it 'successfully exits' do
-      Subprocess.check_call(default_einhorn_command + %w[--upgrade-check],
-                            :stdout => Subprocess::PIPE,
-                            :stderr => Subprocess::PIPE) do |einhorn|
-        stdout, stderr = einhorn.communicate
-        status = einhorn.wait
-        assert_equal(0, status.exitstatus)
-      end
-    end
-  end
-end