stella 0.8.8.001 → 2.0.1.001

data/CHANGES.txt

@@ -1,7 +1,15 @@
 STELLA, CHANGES
 
+#### 2.0.1 (2011-06-08) ###############################
+
+NOTE: First release of 2.x.
+
+
 #### 0.8.X (XXXX-XX-XX) ###############################
 
+NOTE: We're now focusing our effort on 2.0, so these features are still 
+      outstanding for a 1.x release (they probably won't be worked on).
+
 * TODO: Force response block content type. 
 * TODO: Add option to dump full request/response output to a file by client
 * TODO: review cookie handling. Not always sent automatically. 
@@ -60,7 +68,7 @@ STELLA, CHANGES
 * FIXED: There was no response body in Stella::Engine::Log objects
 * CHANGE: Store URIs as strings in Stella::Engine::Log objects
 * CHANGE: Stella::Data::HTTP now uses @header instead of @headers
-* ADDED: Testrun#end_time, Testrun#running?
+* ADDED: Testrun#etime, Testrun#running?
 * ADDED: Testrun.elapsed_seconds
 * ADDED: Testrun.granularity which replaces Load::ROTATE_TIMELINE
 

data/Gemfile

@@ -0,0 +1,19 @@
+source "http://production.s3.rubygems.org.s3.amazonaws.com"
+
+gem 'SystemTimer', :platforms => :mri_18
+
+gem 'familia', '0.7.1'
+gem 'gibbler', '0.8.9'
+gem 'drydock', '0.6.9'
+gem 'benelux', '0.6.1'
+gem 'sysinfo'
+gem 'storable', '>= 0.8.8'
+gem 'nokogiri', '1.4.4'
+gem 'yajl-ruby'
+gem 'multi_json'
+gem 'public_suffix_service', '0.8.1'
+gem 'whois', '1.6.6'
+gem 'ipaddress', '0.7.0'
+gem 'addressable', '2.2.2'
+gem 'redis', '2.2.0'
+

data/Gemfile.lock

@@ -0,0 +1,50 @@
+GEM
+  remote: http://production.s3.rubygems.org.s3.amazonaws.com/
+  specs:
+    SystemTimer (1.2.3)
+    addressable (2.2.2)
+    attic (0.5.3)
+    benelux (0.6.1)
+      attic (>= 0.5.3)
+      storable (>= 0.8.6)
+    drydock (0.6.9)
+    familia (0.7.1)
+      gibbler (>= 0.8.6)
+      multi_json (>= 0.0.5)
+      redis (>= 2.1.0)
+      storable (>= 0.8.6)
+      uri-redis (>= 0.4.2)
+    gibbler (0.8.9)
+      attic (>= 0.4.0)
+    ipaddress (0.7.0)
+    multi_json (0.0.5)
+    nokogiri (1.4.4)
+    public_suffix_service (0.8.1)
+    redis (2.2.0)
+    storable (0.8.8)
+    sysinfo (0.7.3)
+      drydock
+      storable
+    uri-redis (0.4.2)
+    whois (1.6.6)
+    yajl-ruby (0.7.9)
+
+PLATFORMS
+  ruby
+
+DEPENDENCIES
+  SystemTimer
+  addressable (= 2.2.2)
+  benelux (= 0.6.1)
+  drydock (= 0.6.9)
+  familia (= 0.7.1)
+  gibbler (= 0.8.9)
+  ipaddress (= 0.7.0)
+  multi_json
+  nokogiri (= 1.4.4)
+  public_suffix_service (= 0.8.1)
+  redis (= 2.2.0)
+  storable (>= 0.8.8)
+  sysinfo
+  whois (= 1.6.6)
+  yajl-ruby

data/README.md

@@ -1,96 +1,21 @@
-# Stella - 0.8 BETA
+# Stella - 2.0-RC1
 
-**Blame Stella for breaking your web application!**
-
-Stella is an integration and load testing tool. It fits well into an agile development process because the configuration syntax is simple yet powerful and a single config can be used for both kinds of tests (integration and load). Stella runs at the protocol-level which means it generates HTTP requests and parses the responses but does not perform any browser simulation (see Caveats).
-
-### Important Information Regarding Your Testplans
-
-*The testplan configuration syntax changed a little in 0.8. Most configs will not be affected. See "News" below for more info.*
+**Define realistic testplans and run them against your webapps**
 
 ## Features
 
-* Support for simulating multiple usecases at the same time
-* Sophisticated response handling 
-* Automatic parsing of HTML, XML, XHTML, YAML, and JSON response bodies
-* Dynamic variable replacement 
-* Support for testing multiple sites simultaneously
-
-
-## Caveats
-
-There are a few known limitations:
-
-* *POSSIBLE SHOW-STOPPER*: An upper limit of around 200-300 concurrent virtual HTTP clients. There is a threading issue in the HTTPClient library which appears under high load. 
-* *POSSIBLE SHOW-STOPPER*: No support for browser or UI based tests (a la Watir or Selenium). If this is a show stopper for you, check out [WatirGrid](http://github.com/90kts/watirgrid)
-* *ANNOYING*: File uploads do not work with some HTTP servers (WEBrick)
-* *ANNOYING*: Lack of documentation (see examples/ directory)
-* *ANNOYING*: Reporting is limited to log files and command-line output. You need to make your own graphs. 
-
-
 ## Examples
 
-
 ### Testplan Configuration
 
-Every load testing tool worth its salt allows you to control the logical flow with some form of programming language. One of the advantages that open source tools have over commercial ones is that the languages used are generally well known whereas most commercial tools use proprietary languages. This makes it possible to define sophisticated and realistic tests.
-
-Stella test plans are defined in subset of the Ruby programming language. They also typically contain more than one usecase which is important when simulating realistic load. 
-
-    usecase "An Example Usecase" do
-      get '/some/path' do
-        param :what  => 'food'
-        param :where => 'iowa'
-        response 200 do
-          # code executed when the server returns a 200 response. 
-        end
-      end
-      
-      get '/a/dynamic/:path' do    
-        param :path => random(4)   # => http://host/a/dynamic/jrr1
-      end
-    end
-    
-    
-See the [examples/](http://github.com/solutious/stella/tree/0.8/examples/) directory and [Getting Started](http://solutious.com/projects/stella/getting-started/) for more information. 
-
-
 ### Running Tests
 
-Stella is a command-line tool with two main commands: "verify" for integration tests and "generate" for load tests. 
-
-    # Verify a test plan is defined correctly
-    # by running a single user functional test.
-    $ stella verify -p examples/essentials/plan.rb http://stellaaahhhh.com/
-    
-    # Generate load using the same test plan. 
-    $ stella generate -p examples/essentials/plan.rb -c 50 -d 10m http://stellaaahhhh.com/
-    
-
-See <tt>$ stella -h</tt> and <tt>$ stella example</tt> for more info. 
-
-## News
-
-### 2010-01-16: sequential, random, rsequential etc... methods now return ERB-style templates instead of Procs
-
-Pre-0.8 would return a Proc that would be evaluated at request time:
-
-    get "/" do
-      param :salt => random(8)    # => "#<Proc0x13423c0 ...>"
-    end
-    
-In 0.8 and beyond, the same configuration will return a String:
-
-    get "/" do
-      param :salt => random(8)    # => "<%= random(8) %>"
-    end
-
 ## Installation
 
 Get it in one of the following ways:
      
-    $ gem install stella --source=http://gemcutter.org/
-    $ sudo gem install stella --source=http://gemcutter.org/
+    $ gem install stella
+    $ sudo gem install stella
     $ git clone git://github.com/solutious/stella.git
 
 You can also download via [tarball](http://github.com/solutious/stella/tarball/latest) or [zip](http://github.com/solutious/stella/zipball/latest). 
@@ -113,6 +38,7 @@ NOTE: If you get errors about libxml2 or libxslt on Ubuntu, you need to install
 ## Credits
 
 * [Delano Mandelbaum](http://solutious.com)
+* [Daniel J. Berger] for file logic borrowed from ptools[http://raa.ruby-lang.org/project/ptools/]
 
 
 ## Thanks 

data/Rakefile

@@ -20,17 +20,20 @@ begin
     gem.version = "#{config[:MAJOR]}.#{config[:MINOR]}.#{config[:PATCH]}.#{config[:BUILD]}"
     gem.name = "stella"
     gem.rubyforge_project = gem.name
-    gem.summary = "Blame Stella for breaking your web application!"
-    gem.description = "Blame Stella for breaking your web application!"
+    gem.summary = "Define realistic testplans and run them against your webapps"
+    gem.description = "Define realistic testplans and run them against your webapps"
     gem.email = "delano@solutious.com"
-    gem.homepage = "http://blamestella.com/"
+    gem.homepage = "http://github.com/solutious/stella"
     gem.authors = ["Delano Mandelbaum"]
-    gem.add_dependency("gibbler",    ">= 0.8.1")
+    gem.add_dependency('familia',    '>= 0.7.1')
+    gem.add_dependency("gibbler",    ">= 0.8.9")
     gem.add_dependency("drydock",    ">= 0.6.9")
-    gem.add_dependency("benelux",    "= 0.5.17")
+    gem.add_dependency("benelux",    ">= 0.6.1")
     gem.add_dependency('sysinfo',    '>= 0.7.3')
-    gem.add_dependency('storable',   '>= 0.7.3')
-    gem.add_dependency("nokogiri")
+    gem.add_dependency('storable',   '>= 0.8.8')
+    gem.add_dependency("nokogiri",      ">= 1.4.4")
+    gem.add_dependency("public_suffix_service",      ">= 0.8.1")
+    gem.add_dependency("whois",      ">= 1.6.6")
 
     #gem.add_development_dependency("rspec", ">= 1.2.9")
     #gem.add_development_dependency("mocha", ">= 0.9.8")

data/Rudyfile

@@ -1,4 +1,4 @@
-  require 'stella'
+require 'stella'
 
 machines do
   

data/TODO

@@ -0,0 +1,31 @@
+  getaddrinfo: Temporary failure in name resolution (http://bccurrencyexchange.com:80)
+  /home/stella/stella/vendor/httpclient-2.1.5.2/httpclient/session.rb:680:in `initialize'
+  /home/stella/stella/vendor/httpclient-2.1.5.2/httpclient/session.rb:680:in `new'
+  /home/stella/stella/vendor/httpclient-2.1.5.2/httpclient/session.rb:680:in `create_socket'
+  /home/stella/stella/vendor/httpclient-2.1.5.2/httpclient/session.rb:637:in `block in connect'
+  /home/stella/stella/vendor/httpclient-2.1.5.2/httpclient/timeout.rb:128:in `timeout'
+  /home/stella/stella/vendor/httpclient-2.1.5.2/httpclient/session.rb:636:in `connect'
+  /usr/local/lib/ruby/gems/1.9.1/gems/benelux-0.5.16/lib/benelux/packer.rb:101:in `connect'
+  /home/stella/stella/vendor/httpclient-2.1.5.2/httpclient/session.rb:526:in `query'
+  /usr/local/lib/ruby/gems/1.9.1/gems/benelux-0.5.16/lib/benelux/packer.rb:101:in `query'
+  /home/stella/stella/vendor/httpclient-2.1.5.2/httpclient/session.rb:147:in `query'
+  /home/stella/stella/vendor/httpclient-2.1.5.2/httpclient.rb:956:in `do_get_block'
+  /home/stella/stella/vendor/httpclient-2.1.5.2/httpclient.rb:766:in `block in do_request'
+  /home/stella/stella/vendor/httpclient-2.1.5.2/httpclient.rb:851:in `protect_keep_alive_disconnected'
+  /home/stella/stella/vendor/httpclient-2.1.5.2/httpclient.rb:765:in `do_request'
+  /usr/local/lib/ruby/gems/1.9.1/gems/benelux-0.5.16/lib/benelux/packer.rb:101:in `do_request'
+  /home/stella/stella/vendor/httpclient-2.1.5.2/httpclient.rb:667:in `request'
+  /home/stella/stella/vendor/httpclient-2.1.5.2/httpclient.rb:592:in `get'
+  /home/stella/stella/lib/stella/client.rb:54:in `block in execute'
+  /home/stella/stella/lib/stella/client.rb:44:in `each'
+  /home/stella/stella/lib/stella/client.rb:44:in `each_with_index'
+  /home/stella/stella/lib/stella/client.rb:44:in `execute'
+  /home/stella/stella/lib/stella/engine.rb:46:in `block (4 levels) in run'
+  /home/stella/stella/lib/stella.rb:123:in `call'
+  /home/stella/stella/lib/stella.rb:123:in `rescue'
+  /home/stella/stella/lib/stella/engine.rb:46:in `block (3 levels) in run'
+  /home/stella/stella/lib/stella/engine.rb:44:in `each'
+  /home/stella/stella/lib/stella/engine.rb:44:in `each_with_index'
+  /home/stella/stella/lib/stella/engine.rb:44:in `block (2 levels) in run'
+  /home/stella/stella/lib/stella/engine.rb:43:in `times'
+  /home/stella/stella/lib/stella/engine.rb:43:in `block in run'

data/VERSION.yml

@@ -1,5 +1,4 @@
---- 
-:MAJOR: 0
-:MINOR: 8
-:PATCH: 8
+:MAJOR: 2
+:MINOR: 0
+:PATCH: 1
 :BUILD: '001'

data/bin/stella

@@ -12,9 +12,7 @@
 # Usage:
 # 
 #     $ stella -h
-#     $ stella verify -p plans/basic.rb http://test.example.com/
-#     $ stella generate -u 10 -t 60 http://test.example.com/
-#     $ stella generate -u 10 -r 40 -p plans/basic.rb http://test.example.com/
+#     $ stella checkup -p plans/basic.rb http://stellaaahhhh.com/
 #
 #--
 
@@ -23,8 +21,8 @@ BASE_PATH = File.expand_path File.join(File.dirname(__FILE__), '..')
 lib_dir = File.join(BASE_PATH, 'lib')
 $:.unshift lib_dir  
 
-require 'drydock'
 require 'stella'
+require 'drydock'
 require 'stella/cli'
 
 # Command-line interface for bin/stella
@@ -40,32 +38,23 @@ class Stella::CLI::Definition
   #global :S, :secret, String, "Secret Key"
   global :D, :debug, "Enable debug mode" do
     Drydock.debug true
-    Stella.enable_debug
+    Stella.debug = true
   end
-  global :W, :wait, Integer, "Seconds to wait before starting test"
-  global :H, :withheader, "Include X-Stella-ID request header" 
-  global :P, :withparam, "Include __stella query parameter header"
+  global :P, :pause, Integer, "Seconds to wait before starting test"
+  #global :H, :withheader, "Include X-Stella-ID request header" 
+  #global :P, :withparam, "Include __stella query parameter header"
   global :T, :timeout, Float, "HTTP request timeout (default: unlimited)"
-  global :o, :output, String, "Write output to the given file" do |v|
-    String.disable_color
-    Stella.log.output = v
-  end
-  global :var, Array, 'Set an arbitrary variable (--var "name=v")'
-  global :f, :format, String, "Output format (partial support)"
+  global :F, :format, String, "Output format (partial support)"
+  global :f, :filter, String, "Only run usecases that match this filter"
+  global :p, :testplan, String, "Path to testplan"
   global :n, :nocolor, "Disable output colors" do
     String.disable_color
   end
   global :q, :quiet, "Be quiet!" do
-    Stella.enable_quiet
+    Stella.quiet = true
   end
   global :v, :verbose, "Increase verbosity of output (e.g. -v or -vv or -vvv)" do
-    Stella.stdout.lev += 1
-  end
-  global :nostats, "Disable stat collection" do
-    true
-  end
-  global :notemplates, "Disable template parsing" do
-    true
+    Stella.noise += 1
   end
   global :V, :version, "Display version number" do
     puts "Stella version: #{Stella::VERSION.inspect}"
@@ -79,64 +68,17 @@ class Stella::CLI::Definition
   usage "stella example"
   command :example => Stella::CLI
   
-  about "View Stella configuration"
-  usage "stella config"
-  command :config => Stella::CLI
-  
-  about "Preview a test plan"
-  usage "stella preview [-p path/2/testplan.rb] "
-  option :c, :clients, Integer, "Maximum number of virtual clients (ignored)"
-  option :a, :arrival, Float, "Arrival rate (ignored)"
-  option :r, :repetitions, Integer, "Number of times to repeat the testplan (ignored)"
-  option :d, :duration, String, "Max duration to run test (ignored)"
-  option :W, :nowait, "Ignore wait times (ignored)"
-  option :w, :wait, Float, "Wait time (in seconds) between client requests (ignored if testplan supplied)"
-  option :p, :testplan, String, "Path to testplan" 
-  option :g, :granularity, Integer, "Amount of time (in seconds) between timeline rotations"
-  command :preview => Stella::CLI
-  
-  about "Verify a test plan"
-  usage "stella verify [-p path/2/testplan.rb] URI"
-  usage "e.g."
-  usage "   $ stella verify -p path/2/testplan.rb http://stellaaahhhh.com/"
-  option :c, :clients, Integer, "Maximum number of virtual clients (ignored)"
-  option :a, :arrival, Float, "Arrival rate (ignored)"
-  option :r, :repetitions, Integer, "Number of times to repeat the testplan (ignored)"
-  option :d, :duration, String, "Max duration to run test (ignored)"
-  option :W, :nowait, "Ignore wait times"
-  option :w, :wait, Float, "Wait time (in seconds) between client requests (ignored if testplan supplied)"
-  option :p, :testplan, String, "Path to testplan" 
-  option :g, :granularity, Integer, "Amount of time (in seconds) between timeline rotations"
-  command :verify => Stella::CLI
-  
-  about "Generate requests"
-  usage "stella generate [options] URI"
-  #usage "stella load [options] URI"
-  #usage "stella stress [options] URI"
+  about "Run a checkup"
+  usage "stella checkup [options] URI"
   usage "e.g. "
-  usage "   $ stella generate -p path/2/testplan.rb -u 100 -r 50 http://stellaaahhhh.com:3114/"
-  #usage "   $ stella stress --clients=50 --repetitions=20 http://stellaaahhhh.com/"
-  option :c, :clients, Integer, "Maximum number of virtual clients"
-  option :a, :arrival, Float, "Arrival rate (new clients per second)"
+  usage "   $ stella checkup -p path/2/testplan.rb http://stellaaahhhh.com/"
+  option :c, :concurrency, Integer, "Maximum number of virtual clients"
+  #option :a, :arrival, Float, "Arrival rate (new clients per second)"
   option :r, :repetitions, Integer, "Number of times to repeat the testplan (per vclient)"
-  option :d, :duration, String, "Max duration to run test"
   option :W, :nowait, "Ignore wait times"
-  option :w, :wait, Float, "Wait time (in seconds) between client requests (ignored if testplan supplied)"
-  option :p, :testplan, String, "Path to testplan" 
-  option :g, :granularity, Integer, "Amount of time (in seconds) between timeline rotations"
-  command :generate => Stella::CLI
+  #option :w, :wait, Float, "Wait time (in seconds) between client requests (ignored if testplan supplied)
+  command :checkup => Stella::CLI
   
-  about "Initialize Stella configuration"
-  command :init do
-    Stella::Config.init
-  end
-  
-  if Drydock.debug?
-    about "Blast away all Stella config assets"
-    command :blast do
-      Stella::Config.blast
-    end
-  end
   
   
   # ----------------------------------  STELLA MISCELLANEOUS  --------
@@ -155,8 +97,8 @@ class Stella::CLI::Definition
 
   after do |obj|  
     @elapsed = Time.now - @start
-    if @elapsed > 0.1
-      Stella.stdout.puts 2, "#{$/}Elapsed: %.2f seconds" % @elapsed.to_f
+    if @elapsed > 0.1 && Stella.noise > 1
+      Stella.li "#{$/}Elapsed: %.2f seconds" % @elapsed.to_f
     end
     code = obj.exit_code if obj.respond_to? :exit_code
     exit code ||= 0
@@ -173,13 +115,13 @@ rescue Drydock::InvalidArgument => ex
   STDERR.puts ex.message
 rescue Drydock::UnknownCommand => ex
   STDERR.puts "Unknown command: %s" % ex.name
-rescue Stella::Error => ex
+rescue StellaError => ex
   STDERR.puts ex.message
-  STDERR.puts ex.backtrace if Stella.stdout.lev > 2 || Stella.debug?
+  STDERR.puts ex.backtrace if Stella.debug?
 rescue Interrupt
   puts $/, "Exiting... "
   exit 1
 rescue => ex
   STDERR.puts "ERROR (#{ex.class.to_s}): #{ex.message}"
-  STDERR.puts ex.backtrace if Stella.stdout.lev > 2 || Stella.debug?
+  STDERR.puts ex.backtrace if Stella.debug?
 end

data/certs/README.txt

@@ -0,0 +1,17 @@
+2011-04-08
+
+cert/stella-master.crt is a combination of the following:
+
+## CERTIFICATE ORIGINS ##
+
+- cacerts.pem:
+https://github.com/nahi/httpclient/blob/78519746cc417/dist_key/cacerts.pem
+
+- gd*.crt:
+https://certs.godaddy.com/anonymous/repository.seam
+
+- startssl-sub.class1.server.ca.pem
+https://www.startssl.com/certs/sub.class1.server.ca.pem
+
+- startssl-ca.pem
+https://www.startssl.com/certs/ca.pem