em-http-request-samesite 0.1.1

checksums.yaml

@@ -0,0 +1,7 @@
+---
+SHA256:
+  metadata.gz: 8ea216d5238086682cc941478c2bf05e70cdb7ea16b59e09950c885b1e512394
+  data.tar.gz: 4376ef9d9761cf806488d4fed8494c2d51838902d7abcd63b5927036f3869aab
+SHA512:
+  metadata.gz: 5d2ec4884affa48bab23cdd3dba528858123c27549c7ccbad3829007d810aee7afd0f8d8a8169ef35c4e73113647f95bacaaa85d31549d6cdc60255874bf3a8c
+  data.tar.gz: 0a9696c7951bbcd4a6065ed3de205a01fa991ab9c981d7bfc2819b80f80c0060e10479e7ae5f7a5a7240a34342d2c85158f39c088ee4da608daa658ac8ab05cd

data/.gitignore

@@ -0,0 +1,9 @@
+*.bundle
+*.o
+Makefile
+mkmf.log
+Gemfile.lock
+misc
+gems/
+vendor/
+.idea

data/.travis.yml

@@ -0,0 +1,7 @@
+language: ruby
+rvm:
+  - 2.2.4
+script: bundle exec rake spec
+notifications:
+  email:
+    - ilya@igvita.com

data/Changelog.md

@@ -0,0 +1,68 @@
+# Changelog
+
+## master
+
+- User-Agent header is now removed if set to nil.
+
+## 1.0.0.beta.1 / 2011-02-20 - The big rewrite
+
+- Switched parser from Ragel to http_parser.rb
+- Removed em_buffer C extension
+- Added support for HTTP keepalive
+- Added support for HTTP pipelining
+- ~60% performance improvement across the board: less GC time!
+- Refactored & split all tests
+- Basic 100-Continue handling on POST/PUT
+
+## 0.3.0 / 2011-01-15
+
+- IMPORTANT: default to non-persistent connections (timeout => 0 now requires :keepalive => true)
+- see: https://github.com/igrigorik/em-http-request/commit/1ca5b608e876c18fa6cfa318d0685dcf5b974e09
+
+- added escape_utils dependency to fix slow encode on long string escapes
+
+- bugfix: proxy authorization headers
+- bugfix: default to Encoding.default_external on invalid encoding in response
+- bugfix: do not normalize URI's internally
+- bugfix: more robust Encoding detection
+
+
+## 0.2.15 / 2010-11-18
+
+- bugfix: follow redirects on missing content-length
+- bugfix: fixed undefined warnings when running in strict mode
+
+## 0.2.14 / 2010-10-06
+
+- bugfix: form-encode keys/values of ruby objects passed in as body
+
+## 0.2.13 / 2010-09-25
+
+- added SOCKS5 proxy support
+- bugfix: follow redirects on HEAD requests
+
+## 0.2.12 / 2010-09-12
+
+- added headers callback (http.headers {|h| p h})
+- added .close method on client obj to terminate session (accepts message)
+
+- bugfix: report 0 for response status on 1.9 on timeouts
+- bugfix: handle bad Location host redirects
+- bugfix: reset host override on connect
+
+## 0.2.11 / 2010-08-16
+
+- all URIs are now normalized prior to dispatch (and on redirect)
+- default to direct proxy (instead of CONNECT handshake) - better performance
+  - specify :proxy => {:tunnel => true} if you need to force CONNECT route
+- MultiRequest accepts block syntax for dispatching parallel requests (see specs)
+- MockHttpRequest accepts block syntax (see Mock wiki page)
+
+
+- bugfix: nullbyte frame for websockets
+- bugfix: set @uri on DNS resolve failure
+- bugfix: handle bad hosts in absolute redirects
+- bugfix: reset seen content on redirects (doh!)
+- bugfix: invalid multibyte escape in websocket regex (1.9.2+)
+- bugfix: report etag and last_modified headers correctly
+

data/Gemfile

@@ -0,0 +1,14 @@
+source 'http://rubygems.org'
+
+gemspec
+
+group :benchmark do
+  gem 'curb'
+  gem 'excon'
+  gem 'httparty'
+  gem 'rest-client'
+  gem 'sinatra'
+  gem 'streamly_ffi'
+  gem 'tach', '>= 0.0.8'
+  gem 'typhoeus'
+end

data/README.md

@@ -0,0 +1,63 @@
+# EM-HTTP-Request 
+
+[![Gem Version](https://badge.fury.io/rb/em-http-request.svg)](http://rubygems.org/gems/em-http-request) [![Build Status](https://travis-ci.org/igrigorik/em-http-request.svg)](https://travis-ci.org/igrigorik/em-http-request)
+
+Async (EventMachine) HTTP client, with support for:
+
+- Asynchronous HTTP API for single & parallel request execution
+- Keep-Alive and HTTP pipelining support
+- Auto-follow 3xx redirects with max depth
+- Automatic gzip & deflate decoding
+- Streaming response processing
+- Streaming file uploads
+- HTTP proxy and SOCKS5 support
+- Basic Auth & OAuth
+- Connection-level & global middleware support
+- HTTP parser via [http_parser.rb](https://github.com/tmm1/http_parser.rb)
+- Works wherever EventMachine runs: Rubinius, JRuby, MRI
+
+## Getting started
+
+    gem install em-http-request
+
+- Introductory [screencast](http://everburning.com/news/eventmachine-screencast-em-http-request)
+- [Issuing GET/POST/etc requests](https://github.com/igrigorik/em-http-request/wiki/Issuing-Requests)
+- [Issuing parallel requests with Multi interface](https://github.com/igrigorik/em-http-request/wiki/Parallel-Requests)
+- [Handling Redirects & Timeouts](https://github.com/igrigorik/em-http-request/wiki/Redirects-and-Timeouts)
+- [Keep-Alive and HTTP Pipelining](https://github.com/igrigorik/em-http-request/wiki/Keep-Alive-and-HTTP-Pipelining)
+- [Stream processing responses & uploads](https://github.com/igrigorik/em-http-request/wiki/Streaming)
+- [Issuing requests through HTTP & SOCKS5 proxies](https://github.com/igrigorik/em-http-request/wiki/Proxy)
+- [Basic Auth & OAuth](https://github.com/igrigorik/em-http-request/wiki/Basic-Auth-and-OAuth)
+- [GZIP & Deflate decoding](https://github.com/igrigorik/em-http-request/wiki/Compression)
+- [EM-HTTP Middleware](https://github.com/igrigorik/em-http-request/wiki/Middleware)
+
+## Extensions
+
+Several higher-order Ruby projects have incorporated em-http and other Ruby HTTP clients:
+
+- [EM-Synchrony](https://github.com/igrigorik/em-synchrony) - Collection of convenience classes and primitives to help untangle evented code (Ruby 1.9 + Fibers).
+- [Rack-Client](https://github.com/halorgium/rack-client) - Use Rack API for server, test, and client side. Supports Rack middleware!
+    - [Example in action](https://gist.github.com/802391)
+- [Faraday](https://github.com/lostisland/faraday) - Modular HTTP client library using middleware heavily inspired by Rack.
+    - [Example in action](https://gist.github.com/802395)
+
+## Testing
+
+- [WebMock](https://github.com/bblimke/webmock) - Library for stubbing and setting expectations on HTTP requests in Ruby.
+    - Example of [using WebMock, VCR & EM-HTTP](https://gist.github.com/802553)
+
+## Other libraries & applications using EM-HTTP
+
+- [VMWare CloudFoundry](https://github.com/cloudfoundry) - The open platform-as-a-service project
+- [PubSubHubbub](https://github.com/igrigorik/PubSubHubbub) - Asynchronous PubSubHubbub ruby client
+- [em-net-http](https://github.com/jfairbairn/em-net-http) - Monkeypatching Net::HTTP to play ball with EventMachine
+- [chirpstream](https://github.com/joshbuddy/chirpstream) - EM client for Twitters Chirpstream API
+- [rsolr-async](https://github.com/mwmitchell/rsolr-async) - An asynchronus connection adapter for RSolr
+- [Firering](https://github.com/EmmanuelOga/firering) - Eventmachine powered Campfire API
+- [RDaneel](https://github.com/hasmanydevelopers/RDaneel) - Ruby crawler which respects robots.txt
+- [em-eventsource](https://github.com/AF83/em-eventsource) - EventSource client for EventMachine
+- and many others.. drop me a link if you want yours included!
+
+### License
+
+(MIT License) - Copyright (c) 2011 Ilya Grigorik

data/Rakefile

@@ -0,0 +1,10 @@
+require 'bundler'
+Bundler::GemHelper.install_tasks
+
+require 'rspec/core/rake_task'
+
+desc "Run all RSpec tests"
+RSpec::Core::RakeTask.new(:spec)
+
+task :default => :spec
+task :test => [:spec]

data/benchmarks/clients.rb

@@ -0,0 +1,170 @@
+$: << './benchmarks'
+require 'server'
+
+require 'excon'
+require 'httparty'
+require 'net/http'
+require 'open-uri'
+require 'rest_client'
+require 'tach'
+require 'typhoeus'
+
+url = 'http://127.0.0.1:9292/data/10000'
+
+with_server do
+  Tach.meter(100) do
+
+    tach('curb (persistent)') do |n|
+      curb = Curl::Easy.new
+
+      n.times do
+        curb.url = url
+        curb.http_get
+        curb.body_str
+      end
+    end
+
+    tach('em-http-request') do |n|
+      EventMachine.run {
+        count = 0
+        error = 0
+
+        n.times do
+          http = EventMachine::HttpRequest.new(url).get
+
+          http.callback {
+            count += 1
+            if count == n
+              p [count, error]
+              EM.stop
+            end
+          }
+
+          http.errback {
+            count += 1
+            error += 1
+            if count == n
+              p [count, error]
+              EM.stop
+            end
+          }
+        end
+      }
+    end
+
+    tach('em-http-request (persistent)') do |n|
+      EventMachine.run {
+        count = 0
+        error = 0
+
+        conn = EventMachine::HttpRequest.new(url)
+
+        n.times do
+          http = conn.get :keepalive => true
+          http.callback {
+            count += 1
+            if count == n
+              p [count, error]
+              EM.stop
+            end
+          }
+
+          http.errback {
+            count += 1
+            error += 1
+            if count == n
+              p [count, error]
+              EM.stop
+            end
+          }
+        end
+      }
+    end
+
+    tach('Excon') do
+      Excon.get(url).body
+    end
+
+    excon = Excon.new(url)
+    tach('Excon (persistent)') do
+      excon.request(:method => 'get').body
+    end
+
+    tach('HTTParty') do
+      HTTParty.get(url).body
+    end
+
+    uri = Addressable::URI.parse(url)
+    tach('Net::HTTP') do
+      Net::HTTP.start(uri.host, uri.port) {|http| http.get(uri.path).body }
+    end
+
+    uri = Addressable::URI.parse(url)
+    Net::HTTP.start(uri.host, uri.port) do |http|
+      tach('Net::HTTP (persistent)') do
+        http.get(uri.path).body
+      end
+    end
+
+    tach('open-uri') do
+      open(url).read
+    end
+
+    tach('RestClient') do
+      RestClient.get(url)
+    end
+
+    streamly = StreamlyFFI::Connection.new
+    tach('StreamlyFFI (persistent)') do
+      streamly.get(url)
+    end
+
+    tach('Typhoeus') do |n|
+        hydra = Typhoeus::Hydra.new( max_concurrency: 8 )
+        hydra.disable_memoization
+        count = 0
+        error = 0
+        n.times {
+            req = Typhoeus::Request.new( url )
+            req.on_complete do |res|
+                count += 1
+                error += 1 if !res.success?
+                p [count, error] if count == n
+
+            end
+            hydra.queue( req )
+        }
+        hydra.run
+    end
+
+  end
+end
+
+
+#+------------------------------+-----------+
+#| tach                         | total     |
+#+------------------------------+-----------+
+#| em-http-request (persistent) | 0.145512  |
+#+------------------------------+-----------+
+#| Excon                        | 0.181564  |
+#+------------------------------+-----------+
+#| RestClient                   | 0.253127  |
+#+------------------------------+-----------+
+#| Net::HTTP                    | 0.294412  |
+#+------------------------------+-----------+
+#| HTTParty                     | 0.305397  |
+#+------------------------------+-----------+
+#| open-uri                     | 0.307007  |
+#+------------------------------+-----------+
+#| Net::HTTP (persistent)       | 0.313716  |
+#+------------------------------+-----------+
+#| Typhoeus                     | 0.514725  |
+#+------------------------------+-----------+
+#| curb (persistent)            | 3.981700  |
+#+------------------------------+-----------+
+#| StreamlyFFI (persistent)     | 3.989063  |
+#+------------------------------+-----------+
+#| Excon (persistent)           | 4.018761  |
+#+------------------------------+-----------+
+#| em-http-request              | 15.025291 |
+#+------------------------------+-----------+

data/benchmarks/em-excon.rb

@@ -0,0 +1,87 @@
+$: << './benchmarks'
+require 'server'
+
+url = 'http://127.0.0.1/10k.html'
+
+with_server do
+  Tach.meter(100) do
+
+    excon = Excon.new(url)
+    tach('Excon (persistent)') do
+      excon.request(:method => 'get').body
+    end
+
+    tach('Excon') do
+      Excon.get(url).body
+    end
+
+    tach('em-http-request') do |n|
+      EventMachine.run {
+        count = 0
+        error = 0
+        n.times do
+          EM.next_tick do
+            http = EventMachine::HttpRequest.new(url, :connect_timeout => 1).get
+
+            http.callback {
+              count += 1
+              if count == n
+                p [count, error]
+                EM.stop
+              end
+            }
+
+            http.errback {
+              count += 1
+              error += 1
+              if count == n
+                p [count, error]
+                EM.stop
+              end
+            }
+          end
+        end
+      }
+    end
+
+    tach('em-http-request (persistent)') do |n|
+      EventMachine.run {
+        count = 0
+        error = 0
+        conn = EventMachine::HttpRequest.new(url)
+
+        n.times do
+          http = conn.get :keepalive => true
+          http.callback {
+            count += 1
+            if count == n
+              p [count, error]
+              EM.stop
+            end
+          }
+
+          http.errback {
+            count += 1
+            error += 1
+            if count == n
+              p [count, error]
+              EM.stop
+            end
+          }
+        end
+      }
+    end
+  end
+end
+
+# +------------------------------+----------+
+# | tach                         | total    |
+# +------------------------------+----------+
+# | em-http-request (persistent) | 0.018133 |
+# +------------------------------+----------+
+# | Excon (persistent)           | 0.023975 |
+# +------------------------------+----------+
+# | Excon                        | 0.032877 |
+# +------------------------------+----------+
+# | em-http-request              | 0.042891 |
+# +------------------------------+----------+