rubberband_flamethrower 0.4.2 → 0.4.3

data/README.md

@@ -77,7 +77,7 @@ The "auto" argument can be used to repeatedly run the "flamethrower fire" comman
 
 	flamethrower auto
 
-This can be configured much like the above example, though there is one additional parameter, which is supplied first and represents the number of times to run the "flamethrower fire" command. Here are the parameters in order with their default values: (how_many_batches=3, per_batch=500, starting_id=1, server_url="http://localhost:9200", index="twitter", type="tweet", id_overwrite="n")
+This can be configured much like the above example with two additional parameters, which is supplied first and represents the number of times to run the "flamethrower fire" command. Here are the parameters in order with their default values: (how_many_batches=3, per_batch=500, starting_id=1, server_url="http://localhost:9200", index="twitter", type="tweet", id_overwrite="n")
 
 To run the "flamethrower fire" command 5 times in a row instead of the default 3:
 
@@ -87,7 +87,7 @@ To run the "flamethrower  fire" command 5 times, inserting 5,000 objects each ti
 
 	flamethrower auto 5 5000
 	
-The id_overwrite parameter determines the ID strategy used for subsequent batches in the auto command. When set to \"n\" (which it is by default) each batch will be writing new data with fresh IDs to the Elastic Search server, simulating a system where data is constantly being inserted and not updated. 5 batches of 500 with an \"n\" would use the IDs 1-2,500. When it is set to \"y\" each batch will simulate overwriting existing data in the Elastic Search server, simulating a system where data is constantly being updated (after the initial batch). 5 batches of 500 with a setting of \"y\" would use the IDs 1-500 on each batch.
+The id_overwrite parameter determines the ID strategy used for subsequent batches in the auto command. 	When set to "n" ("n" is the default) each batch will be writing new data with unused IDs to the Elastic Search server, simulating a system where new data is constantly being inserted and not updated. 5 batches of 500 with an "n" would use the IDs 1-2500. When it is set to "y" each batch (after the first) will be overwriting existing data on the Elastic Search server, simulating a system where data is constantly being updated (after the initial batch). 5 batches of 500 with a setting of "y" would use the IDs 1-500 on each batch.
 	
 #### Help
 

data/VERSION

@@ -1 +1 @@
-0.4.2
+0.4.3

data/lib/rubberband_flamethrower.rb

@@ -46,25 +46,25 @@ module RubberbandFlamethrower
   # this is adapted from the file README.md
   # things updated here should be updated there
   def self.help
-    puts "Rubberband Flamethrower is a gem for inserting faked data into an Elastic Search server"
+    puts "\nRubberband Flamethrower is a gem for inserting faked data into an Elastic Search server"
     puts "and providing basic benchmarks. It creates and inserts fake data objects with three"
     puts "fields (message, username, and post_date) and reports timing information."
     
-    puts "\n\nFlamethrower Commands Available:\n\n"
+    puts "\nFlamethrower Commands Available:\n\n"
     puts "flamethrower fire #benchmark a batch insert of data to an elastic search server"
     puts "flamethrower auto #benchmark a series of batch inserts to an elastic search server"
     puts "flamethrower help #display this help message"
     
-    puts "\n\nThe fire and auto commands can be configured by passing arguments."
+    puts "\nThe fire and auto commands can be configured by passing arguments."
     puts "The parameters accepted by fire and auto all have a default value if left blank."
     
-    puts "\n\n\"fire\" parameters in order with their default values:"
+    puts "\n\"fire\" parameters in order with their default values:"
     puts "(how_many=500, starting_id=1, server_url=http://localhost:9200, index=twitter, type=tweet)"
 
-    puts "\n\n\"auto\" parameters in order with their default values:"
+    puts "\n\"auto\" parameters in order with their default values:"
     puts "(how_many_batches=3, per_batch=500, starting_id=1, server_url=http://localhost:9200, index=twitter, type=tweet, id_overwrite=n)"
     
-    puts "\n\nUsage Examples With Parameters:"
+    puts "\nUsage Examples With Parameters:"
     puts "flamethrower fire 10000 #To Insert 10,000 instead of 500"
     puts "flamethrower fire 5000 5001 #To Insert 5,000 starting with the ID 5001"
     puts "flamethrower fire 2000 1 \"http://es.com:9200\" #Elastic Search Node located at http://es.com:9200"
@@ -72,11 +72,11 @@ module RubberbandFlamethrower
     puts "\t#Insert into an index named \"facebook\" instead of \"twitter\""
     puts "\t#with a type of \"message\" instead of \"tweet\""
     
-    puts "\n\nThe id_overwrite parameter determines the ID strategy used for subsequent batches in the auto command."
-    puts "When set to \"n\" (which it is by default)each batch will be writing new data with fresh IDs to the Elastic"
-    puts "Search server, simulating a system where data is constantly being inserted and not updated. When it is set"
-    puts "to \"y\" each batch will simulate overwriting existing data in the Elastic Search server, simulating a"
-    puts "system where data is constantly being updated (after the initial batch)."
+    puts "\nThe id_overwrite parameter determines the ID strategy used for subsequent batches in the auto command."
+    puts "When set to \"n\" (\"n\" is the default) each batch will be writing new data with unused IDs to the Elastic"
+    puts "Search server, simulating a system where new data is constantly being inserted and not updated. When it is"
+    puts "set to \"y\" each batch (after the first) will be overwriting existing data on the Elastic Search server,"
+    puts "simulating a system where data is constantly being updated (after the initial batch)."
   end
 
 end

data/rubberband_flamethrower.gemspec

@@ -5,7 +5,7 @@
 
 Gem::Specification.new do |s|
   s.name = "rubberband_flamethrower"
-  s.version = "0.4.2"
+  s.version = "0.4.3"
 
   s.required_rubygems_version = Gem::Requirement.new(">= 0") if s.respond_to? :required_rubygems_version=
   s.authors = ["Michael Orr"]
@@ -30,8 +30,6 @@ Gem::Specification.new do |s|
     "lib/rubberband_flamethrower/.DS_Store",
     "lib/rubberband_flamethrower/data_generator.rb",
     "lib/rubberband_flamethrower/flamethrower.rb",
-    "lib/rubberband_flamethrower/inserter.rb",
-    "lib/rubberband_flamethrower/retriever.rb",
     "lib/rubberband_flamethrower/words/README",
     "lib/rubberband_flamethrower/words/american-words.10",
     "lib/rubberband_flamethrower/words/american-words.20",

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: rubberband_flamethrower
 version: !ruby/object:Gem::Version
-  version: 0.4.2
+  version: 0.4.3
   prerelease: 
 platform: ruby
 authors:
@@ -13,7 +13,7 @@ date: 2013-04-09 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: httparty
-  requirement: &7516720 !ruby/object:Gem::Requirement
+  requirement: &11304560 !ruby/object:Gem::Requirement
     none: false
     requirements:
     - - ~>
@@ -21,10 +21,10 @@ dependencies:
         version: 0.10.2
   type: :runtime
   prerelease: false
-  version_requirements: *7516720
+  version_requirements: *11304560
 - !ruby/object:Gem::Dependency
   name: activesupport
-  requirement: &7515460 !ruby/object:Gem::Requirement
+  requirement: &11320540 !ruby/object:Gem::Requirement
     none: false
     requirements:
     - - ~>
@@ -32,10 +32,10 @@ dependencies:
         version: 3.2.13
   type: :runtime
   prerelease: false
-  version_requirements: *7515460
+  version_requirements: *11320540
 - !ruby/object:Gem::Dependency
   name: rdoc
-  requirement: &7512800 !ruby/object:Gem::Requirement
+  requirement: &11314600 !ruby/object:Gem::Requirement
     none: false
     requirements:
     - - ~>
@@ -43,10 +43,10 @@ dependencies:
         version: '3.12'
   type: :development
   prerelease: false
-  version_requirements: *7512800
+  version_requirements: *11314600
 - !ruby/object:Gem::Dependency
   name: bundler
-  requirement: &7520600 !ruby/object:Gem::Requirement
+  requirement: &11330760 !ruby/object:Gem::Requirement
     none: false
     requirements:
     - - ~>
@@ -54,10 +54,10 @@ dependencies:
         version: 1.3.0
   type: :development
   prerelease: false
-  version_requirements: *7520600
+  version_requirements: *11330760
 - !ruby/object:Gem::Dependency
   name: jeweler
-  requirement: &7534940 !ruby/object:Gem::Requirement
+  requirement: &11324960 !ruby/object:Gem::Requirement
     none: false
     requirements:
     - - ~>
@@ -65,7 +65,7 @@ dependencies:
         version: 1.8.4
   type: :development
   prerelease: false
-  version_requirements: *7534940
+  version_requirements: *11324960
 description: Use to quickly fill up some indicies in Elastic Search and to retrieve
   statistics about insertion rates
 email: michael@cloudspace.com
@@ -88,8 +88,6 @@ files:
 - lib/rubberband_flamethrower/.DS_Store
 - lib/rubberband_flamethrower/data_generator.rb
 - lib/rubberband_flamethrower/flamethrower.rb
-- lib/rubberband_flamethrower/inserter.rb
-- lib/rubberband_flamethrower/retriever.rb
 - lib/rubberband_flamethrower/words/README
 - lib/rubberband_flamethrower/words/american-words.10
 - lib/rubberband_flamethrower/words/american-words.20
@@ -117,7 +115,7 @@ required_ruby_version: !ruby/object:Gem::Requirement
       version: '0'
       segments:
       - 0
-      hash: 4490731657704631549
+      hash: 2071983575362906945
 required_rubygems_version: !ruby/object:Gem::Requirement
   none: false
   requirements:

data/lib/rubberband_flamethrower/inserter.rb

@@ -1,37 +0,0 @@
-# Rubberband Flamethrower is a collection of scripts for dealing with faked Elastic Search data. 
-# This file is the main script for inserting fake data 
-# It inserts fake "tweet" type objects into a "twitter" index 
-# on a local Elastic Search server at localhost:9200.  
-# It runs in an infinite loop until you stop it.
-#
-#
-# Author::    Michael Orr 
-#             email - michael@cloudspace.com 
-#             twitter - @imbiat
-# Copyright:: Copyright (c) 2013
-# License::   MIT License
-
-
-require_relative "data_generator.rb"
-
-# a unique ID must be provided for each document stored in Elastic Search
-# since we are looping, we set a starting id and it will be incremented in the loop
-id = 2
-
-# initialize the random data generator object
-data = DataGenerator.new
-
-# start infinite loop
-while true do  
-  
-  # generate a piece of random data to insert that approxiamates a tweet
-  insert_data = data.generate_random_insert_data
-  puts insert_data
-  
-  # insert the random data into local elastic search index "twitter" as type "tweet" with set id
-  response = HTTParty.put("http://localhost:9200/twitter/tweet/#{id}", body: insert_data) 
-  puts response.body
-  
-  #increment the insert id
-  id = id + 1
-end

data/lib/rubberband_flamethrower/retriever.rb

@@ -1,37 +0,0 @@
-# Rubberband Flamethrower is a collection of scripts for dealing with faked Elastic Search data. 
-# This file is the main script for retrieving fake data 
-# When running it will loop continuously
-# doing a search on the tweets type in the twitter index
-# for all objects within the date range between 2 and 3 minutes ago
-# and reports the number of objects found.
-#
-# This can be used to easily approximate the maximum speed obtainable 
-# for inserting to a local Elastic Search index for a given AWS box size.
-#
-#
-# Author::    Michael Orr 
-#             email - michael@cloudspace.com 
-#             twitter - @imbiat
-# Copyright:: Copyright (c) 2013
-# License::   MIT License
-
-
-require 'httparty'
-require "active_support/core_ext"
-
-# start infinite loop
-while true do
-
-  # set up start and end range values for query
-  range_start = (Time.now - 3.minutes).strftime "%Y%m%dT%H:%M:%S"
-  range_end = (Time.now - 2.minutes).strftime "%Y%m%dT%H:%M:%S"
-
-  # set up json for elastic search range query
-  query = {query: {range: { postDate: {from: "#{range_start}", to: "#{range_end}"}}}}.to_json
-  puts query
-
-  # perform elastic search query and report results
-  response = HTTParty.get("http://localhost:9200/twitter/tweet/_search", body: query)
-  parsed = JSON.parse(response.body)
-  puts "hits found: #{parsed["hits"]["total"]}"
-end