logfile_interval 1.1.0 → 1.1.1

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA1:
-  metadata.gz: e0f1a02f57605b2eb8eacf703a456dbe9038abcd
-  data.tar.gz: f1d68cd7e72dc15023f6c3f8ae72d7e2eb104102
+  metadata.gz: 37c52b3b1355cf1589c84a6f2f8e76233222eb80
+  data.tar.gz: 5ec64eb915a57de6c94974756d4a3d8a58042dc6
 SHA512:
-  metadata.gz: 3bc11945565915aaa028f61f01b670340a2765640abf44aca2d8b1d36cb6a6b09c8626b7e3d964e3e3a7f0479893240defa0b600feec3f98e1f6c5176c5cda8a
-  data.tar.gz: cb91a1b9aad9bd67aa5fa1ccfa9a9f0d69cab5bbc177ecdfc4ac4f80d08c1edcf39cbf5df250c8251913ca50a2d4e9abf17e92335c41b9b10b17dc32bddf5cc5
+  metadata.gz: 2b6eb7f3ecbfc8b12fa5900c02ca45e6f58ec1730018500c860c3be7e63ee0a83f402ee000e9141720ec13f6d89c7585dc6befbde89ec86929f51707e8fc47f1
+  data.tar.gz: 865b1ae02eb35830c8723f3b9ad5b013a3f0a335eaecc05cc95f077f468db34855af91510a00d77d4a0caf45183f708263daa78c99cb6da9f7b12c574e2bc5be

data/Gemfile.lock

@@ -1,7 +1,7 @@
 PATH
   remote: .
   specs:
-    logfile_interval (1.1.0)
+    logfile_interval (1.1.1)
 
 GEM
   remote: https://rubygems.org/

data/README.md

@@ -2,27 +2,92 @@
 
 Logfile parser and aggregator.
 
-It iterates over each line of logfiles, parses each line and aggregates all lines in a time interval into a single
-record made up of the sum, the average, the number of occurences per value or average of the deltas between lines.
+It iterates over 1 or more logfiles, parses each line and aggregates them into time intervals. Each interval object
+includes aggregated data for each field of the logfile.
 
-## Installation
+Aggregated data can be for example the sum, the average value or the number of occurences of each value.
 
-Add this line to your application's Gemfile:
+## Example
+This example will parse an access.log file and aggregate the data into 5 minute intervals.
 
-    gem 'logfile_interval'
+In each interval, it counts
+* the number of requests per IP address
+* the number of requests for each HTTP status code
+* the number of requests for each HTTP status code and IP address.
 
-And then execute:
+Full script is in [readme.rb](bin/readme.rb).
+### Code
+```ruby
+require 'pp'
+require 'date'
+require 'logfile_interval'
 
-    $ bundle
+class AccessLog < LogfileInterval::LineParser::Base
+  # Example line:
+  # 74.75.19.145 - - [31/Mar/2013:06:54:12 -0700] "GET /ppa/google_chrome HTTP/1.1" 200 7855 "https://www.google.com/" "Mozilla/5.0 Chrome/25.0.1364.160"
 
-Or install it yourself as:
+  set_regex /^([\d\.]+)\s+.*\s+\[(\d\d.*\d\d)\]\s+"(?:GET|POST|PUT|HEAD|DELETE)\s+(\S+)\s+HTTP\S+"\s+(\d+)\s+/
 
-    $ gem install logfile_interval
+  add_column :name => 'ip',           :pos => 1, :aggregator => :count,     :group_by => 'ip'
+  add_column :name => 'timestamp',    :pos => 2, :aggregator => :timestamp
+  add_column :name => 'code',         :pos => 4, :aggregator => :count,     :group_by => 'code'
+  add_column :name => 'code_by_ip',   :pos => 4, :aggregator => :count,     :group_by => 'ip'
 
-## Usage
+  def time
+    DateTime.strptime(self.timestamp, '%d/%b/%Y:%H:%M:%S %z').to_time
+  end
+end
+
+path = ENV['ACCESS_LOG_PATH']
+file = LogfileInterval::Logfile.new(path, AccessLog)
+unless file.exist?
+  puts "#{path} is not found"
+  exit 1
+end
 
+builder = LogfileInterval::IntervalBuilder.new(file, 300)
+builder.each_interval do |interval|
+  next unless interval.size > 0
+
+  puts
+  puts "start time of interval:               #{interval.start_time}"
+  puts "number of seconds in interval:        #{interval.length}"
+  puts "number of requests found in interval: #{interval.size}"
+  puts "number of requests per ip address in interval:"
+  pp interval[:ip]
+  puts "number of requests per http code in interval:"
+  pp interval[:code]
+  puts "for each http code, number of requests grouped by ip:"
+  pp interval[:code_by_ip]
+end
+```
+### Output
+Logfile used for example: [access.log](spec/support/logfiles/access.log.3).
+```
+start time of interval:            2012-01-01 16:30:00 -0800
+number of seconds in interval:     300
+number of requests found in interval: 4
+number of requests per ip address in interval:
+{"78.54.172.146"=>3, "66.249.68.148"=>1}
+number of requests per http code in interval:
+{"200"=>3, "302"=>1}
+for each ip, number of requests grouped by http code:
+{"200"=>{"78.54.172.146"=>2, "66.249.68.148"=>1}, "302"=>{"78.54.172.146"=>1}}
+
+start time of interval:            2012-01-01 16:25:00 -0800
+number of seconds in interval:     300
+number of requests found in interval: 3
+number of requests per ip address in interval:
+{"78.54.172.146"=>1, "173.192.238.51"=>1, "66.249.67.176"=>1}
+number of requests per http code in interval:
+{"200"=>1, "301"=>2}
+for each ip, number of requests grouped by http code:
+{"200"=>{"78.54.172.146"=>1}, "301"=>{"173.192.238.51"=>1, "66.249.67.176"=>1}}
+```
+
+## Usage
 ### Write a LineParser class
-#### Example
+The first step is to define a LineParser class as in the example above. The parser lists the fields that must be parsed, how a timestamp can be extracted from each line and how to aggregate values into intervals.
 ```ruby
 module LogfileInterval
   module LineParser
@@ -46,8 +111,7 @@ module LogfileInterval
   end
 end
 ```
-#### Writing a parser class
-The parser must define:
+#### The parser must define:
 * A regex that extracts the fields out of each line.
 * A set of columns that will to be parsed and aggregated in time intervals.
 * A 'time' method that converts the mandatory timestamp field of a line into a Time object.
@@ -57,7 +121,7 @@ The parser must define:
 * pos:  the position of the captured field in the regex matched data
 * aggregator : the aggregation mode for this field
 * conversion: the parser will convert the field to an integer or a float when building the parsed record
-* group_by: group_by value is the name of another field. The aggregator will apply the aggregator to this field for each distinct value found in the other field.
+* group_by: group_by value is the name of another field. Values will be aggregated for each 'name', 'group_by' pair.
 
 #### Aggregator types and options
 * timestamp: the timestamp field will be used to determine to which interval the line belongs, each line MUST have a timestamp
@@ -121,8 +185,20 @@ interval_builder.each_interval do |interval|
 end
 ```
 
-## Contributing
+## Installation
+Add this line to your application's Gemfile:
+
+    gem 'logfile_interval'
 
+And then execute:
+
+    $ bundle install
+
+Or install it yourself as:
+
+    $ gem install logfile_interval
+
+## Contributing
 1. Fork it
 2. Create your feature branch (`git checkout -b my-new-feature`)
 3. Commit your changes (`git commit -am 'Add some feature'`)

data/bin/aggregate_access_log.rb

@@ -0,0 +1,43 @@
+#!/usr/bin/env ruby
+
+require 'pp'
+require 'date'
+require File.join(File.expand_path('../../lib', __FILE__), 'logfile_interval')
+
+logfile = ARGV[0]
+unless File.exist?(String(logfile))
+  puts "#{logfile} does not exist."
+  exit 1
+end
+
+class AccessLogParser < LogfileInterval::LineParser::Base
+  # Example line:
+  # 74.75.19.145 - - [31/Mar/2013:06:54:12 -0700] "GET /ppa/google_chrome HTTP/1.1" 200 7855 "https://www.google.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.22 (KHTML, like Gecko) Ubuntu Chromium/25.0.1364.160 Chrome/25.0.1364.160 Safari/537.22"
+
+  set_regex /^([\d\.]+)\s+\S+\s+\S+\s+\[(\d\d.*\d\d)\]\s+"(?:GET|POST|PUT|HEAD|DELETE)\s+(\S+)\s+HTTP\S+"\s+(\d+)\s+(\d+)\s+"([^"]*)"\s+"([^"]+)"$/
+
+  add_column :name => 'ip',           :pos => 1, :aggregator => :count,                              :group_by => 'ip'
+  add_column :name => 'timestamp',    :pos => 2, :aggregator => :timestamp
+  add_column :name => 'code_by_ip',   :pos => 4, :aggregator => :count,                              :group_by => 'ip'
+  add_column :name => 'length',       :pos => 5, :aggregator => :average,   :conversion => :integer
+  add_column :name => 'length_by_ip', :pos => 5, :aggregator => :average,   :conversion => :integer, :group_by => 'ip'
+  add_column :name => 'referer',      :pos => 6, :aggregator => :count,                              :group_by => :referer
+  add_column :name => 'referer_by_ip', :pos => 6, :aggregator => :count,                             :group_by => :ip
+
+  def time
+    DateTime.strptime(self.timestamp, '%d/%b/%Y:%H:%M:%S %z').to_time
+  end
+end
+
+file = LogfileInterval::Logfile.new(logfile, AccessLogParser)
+builder = LogfileInterval::IntervalBuilder.new(file, 300)
+builder.each_interval do |interval|
+  next unless interval.size > 0
+
+  puts
+  puts "start_time=#{interval.start_time} size=#{interval.size}"
+  pp interval[:ip]
+  pp interval[:referer_by_ip]
+  STDIN.gets
+end
+

data/bin/readme.rb

@@ -0,0 +1,44 @@
+#!/usr/bin/env ruby
+
+require 'pp'
+require 'date'
+require File.join(File.expand_path('../../lib', __FILE__), 'logfile_interval')
+
+class AccessLog < LogfileInterval::LineParser::Base
+  # Example line:
+  # 74.75.19.145 - - [31/Mar/2013:06:54:12 -0700] "GET /ppa/google_chrome HTTP/1.1" 200 7855 "https://www.google.com/" "Mozilla/5.0 Chrome/25.0.1364.160"
+
+  set_regex /^([\d\.]+)\s+.*\s+\[(\d\d.*\d\d)\]\s+"(?:GET|POST|PUT|HEAD|DELETE)\s+(\S+)\s+HTTP\S+"\s+(\d+)\s+/
+
+  add_column :name => 'ip',           :pos => 1, :aggregator => :count,     :group_by => 'ip'
+  add_column :name => 'timestamp',    :pos => 2, :aggregator => :timestamp
+  add_column :name => 'code',         :pos => 4, :aggregator => :count,     :group_by => 'code'
+  add_column :name => 'code_by_ip',   :pos => 4, :aggregator => :count,     :group_by => 'ip'
+
+  def time
+    DateTime.strptime(self.timestamp, '%d/%b/%Y:%H:%M:%S %z').to_time
+  end
+end
+
+path = ENV['ACCESS_LOG_PATH']
+file = LogfileInterval::Logfile.new(path, AccessLog)
+unless file.exist?
+  puts "#{path} is not found"
+  exit 1
+end
+
+builder = LogfileInterval::IntervalBuilder.new(file, 300)
+builder.each_interval do |interval|
+  next unless interval.size > 0
+
+  puts
+  puts "start time of interval:            #{interval.start_time}"
+  puts "number of seconds in interval:     #{interval.length}"
+  puts "number of requests found in interval: #{interval.size}"
+  puts "number of requests per ip address in interval:"
+  pp interval[:ip]
+  puts "number of requests per http code in interval:"
+  pp interval[:code]
+  puts "for each ip, number of requests grouped by http code:"
+  pp interval[:code_by_ip]
+end

data/lib/logfile_interval.rb

@@ -1,12 +1,14 @@
-require "logfile_interval/version"
-require "logfile_interval/file_backward"
-require "logfile_interval/interval"
-require "logfile_interval/interval_builder"
-require "logfile_interval/logfile"
-require "logfile_interval/logfile_set"
-require "logfile_interval/line_parser/base"
-require "logfile_interval/line_parser/aggregator"
-require "logfile_interval/line_parser/counter"
+lib_dir = File.expand_path('..', __FILE__)
+
+require "#{lib_dir}/logfile_interval/version"
+require "#{lib_dir}/logfile_interval/file_backward"
+require "#{lib_dir}/logfile_interval/interval"
+require "#{lib_dir}/logfile_interval/interval_builder"
+require "#{lib_dir}/logfile_interval/logfile"
+require "#{lib_dir}/logfile_interval/logfile_set"
+require "#{lib_dir}/logfile_interval/line_parser/base"
+require "#{lib_dir}/logfile_interval/line_parser/aggregator"
+require "#{lib_dir}/logfile_interval/line_parser/counter"
 
 module LogfileInterval
 end

data/lib/logfile_interval/interval.rb

@@ -22,7 +22,11 @@ module LogfileInterval
     end
 
     def [](name)
-      @data[name].values
+      @data[name.to_sym].values
+    end
+
+    def each(&block)
+      @data.each(&block)
     end
 
     def add_record(record)

data/lib/logfile_interval/line_parser/aggregator.rb

@@ -20,7 +20,7 @@ module LogfileInterval
         end
 
         def value(group = nil)
-          average(key(group))
+          val(key(group))
         end
 
         def values
@@ -47,10 +47,14 @@ module LogfileInterval
 
         def each
           @val.each_key do |k|
-            yield k, average(k)
+            yield k, val(k)
           end
         end
 
+        def val(k)
+          @val[k]
+        end
+
         def average(k)
           @size[k] > 0 ? @val[k].to_f / @size[k].to_f : 0
         end
@@ -59,7 +63,6 @@ module LogfileInterval
       class Sum < Base
         def add(value, group_by = nil)
           @val.add(key(group_by), value)
-          @size.set(key(group_by), 1)
         end
       end
 
@@ -68,12 +71,15 @@ module LogfileInterval
           @val.add(key(group_by), value)
           @size.increment(key(group_by))
         end
+
+        def val(k)
+          average(k)
+        end
       end
 
       class Count < Base
         def add(value, group_by = nil)
           @val.add(key(group_by), 1)
-          @size.set(key(group_by), 1)
         end
       end
 
@@ -85,7 +91,6 @@ module LogfileInterval
         def add(value, group_by)
           raise ArgumentError, 'group_by argument is mandatory for GroupAndCount#add' unless group_by
           @val.increment_subkey(value, key(group_by))
-          @size.set(key(group_by), 1)
         end
       end
 
@@ -102,6 +107,10 @@ module LogfileInterval
           end
           @previous.set(key(group_by), value)
         end
+
+        def val(k)
+          average(k)
+        end
       end
     end
   end

data/lib/logfile_interval/line_parser/base.rb

@@ -22,19 +22,23 @@ module LogfileInterval
         def add_column(options)
           name          = options.fetch(:name)
           pos           = options.fetch(:pos)
-          aggregator  = options.fetch(:aggregator)
           conversion    = options.fetch(:conversion, :string)
+          group_by      = options.fetch(:group_by, nil)
+          aggregator    = options.fetch(:aggregator)
           unless AGGREGATION_FUNCTIONS.include?(aggregator)
             raise ArgumentError, "aggregator must be one of #{AGGREGATION_FUNCTIONS.join(', ')}"
           end
 
-          if aggregator == :count && options[:group_by] && options[:group_by] != name
+          name      = name.to_sym
+          group_by  = group_by.to_sym unless group_by.nil?
+
+          if aggregator == :count && group_by && group_by != name
             aggregator = :group_and_count
           end
 
           aggregator = Aggregator.klass(aggregator)
           columns[name] = { :pos => pos, :aggregator => aggregator, :conversion => conversion }
-          columns[name][:group_by] = options[:group_by]
+          columns[name][:group_by] = group_by
 
           define_method(name) do
             @data[name]

data/lib/logfile_interval/line_parser/counter.rb

@@ -1,8 +1,6 @@
 module LogfileInterval
   module LineParser
     class Counter < Hash
-      class ValueTypeError < StandardError; end
-
       def increment(key)
         if self.has_key?(key)
           self[key] += 1

data/lib/logfile_interval/logfile.rb

@@ -7,8 +7,12 @@ module LogfileInterval
       @parser   = parser
     end
 
+    def exist?
+      filename && File.exist?(@filename)
+    end
+
     def first_timestamp
-      return nil unless File.exist?(@filename)
+      return unless exist?
       File.open(@filename) do |f|
         while line = f.gets
           if record = parser.create_record(line)
@@ -19,6 +23,7 @@ module LogfileInterval
     end
 
     def each_line
+      return unless exist?
       f = FileBackward.new(@filename)
       while(line = f.gets)
         yield line.chomp

data/lib/logfile_interval/version.rb

@@ -1,3 +1,3 @@
 module LogfileInterval
-  VERSION = "1.1.0"
+  VERSION = "1.1.1"
 end

data/spec/lib/interval_builder_spec.rb

@@ -13,7 +13,7 @@ module LogfileInterval
 
     context :each_interval do
       before :each do
-        Time.stub(:now).and_return(Time.new(2013,12,01,16,0,0,'-08:00'))
+        Time.stub(:now).and_return(Time.new(2013,12,01,16,0,1,'-08:00'))
         @intervals = []
         @builder.each_interval do |interval|
           @intervals << interval
@@ -27,6 +27,7 @@ module LogfileInterval
       context 'first interval' do
         it 'got records from both logfiles' do
           @intervals.first.size.should == 4
+          @intervals.first.end_time.should == Time.new(2013,12,01,16,0,0,'-08:00')
           @intervals.first[:total_time].should == 700.0/4
           @intervals.first[:num_bytes].should == 52000
           @intervals.first[:rss].round(5).should == 0.60
@@ -38,6 +39,7 @@ module LogfileInterval
       context 'second interval' do
         it 'got records from second logfile only' do
           @intervals.last.size.should == 2
+          @intervals.last.end_time.should == Time.new(2013,12,01,15,55,0,'-08:00')
           @intervals.last[:total_time].should == 300
           @intervals.last[:num_bytes].should == 41000
           @intervals.last[:rss].round(5).should == 0.20
@@ -46,5 +48,15 @@ module LogfileInterval
         end
       end
     end
+
+    context :last_interval do
+      it 'returns the most recent interval' do
+        Time.stub(:now).and_return(Time.new(2013,12,01,16,0,1,'-08:00'))
+        interval = @builder.last_interval
+        interval.end_time.should == Time.new(2013,12,01,16,0,0,'-08:00')
+        interval.size.should == 4
+        interval[:num_bytes].should == 52000
+      end
+    end
   end
 end

data/spec/lib/line_parser/counter_spec.rb

@@ -0,0 +1,70 @@
+require 'spec_helper'
+
+module LogfileInterval
+  module LineParser
+    describe Counter do
+      it 'behaves like a hash' do
+        c = Counter.new
+        c[:a] = 1
+        c.keys.should == [:a]
+        c.values.should == [1]
+        c.delete(:a)
+        c.keys.should be_empty
+
+        c[:a] = 1
+        c[:b] = 2
+        c.keys.sort.should == [:a, :b]
+      end
+
+      it 'returns 0 when key does not exist' do
+        c = Counter.new
+        c[:a].should == 0
+      end
+
+      describe :increment do
+        it 'adds 1 to value for key argument' do
+          c = Counter.new
+          c[:a] = 1
+          c.increment(:a)
+          c[:a].should == 2
+        end
+
+        it 'creates new key when missing' do
+          c = Counter.new
+          c.increment(:a)
+          c[:a].should == 1
+        end
+      end
+
+      describe :add do
+        it 'adds number to hash value' do
+          c = Counter.new
+          c[:a] = 1
+          c.add(:a, 5)
+          c[:a].should == 6
+        end
+
+        it 'creates a new key when missing' do
+          c = Counter.new
+          c.add(:a, 4)
+          c[:a].should == 4
+        end
+      end
+
+      describe :increment_subkey do
+        it 'saves values of type Counter' do
+          c = Counter.new
+          c.increment_subkey(:a, :sub)
+          c[:a].should be_a(Counter)
+          c[:a][:sub].should == 1
+        end
+
+        it 'raises an error when trying to increment an existing integer key' do
+          c = Counter.new
+          c[:a] = 1
+          lambda { c.increment_subkey(:a, :sub) }.should raise_error(RuntimeError)
+        end
+      end
+    end
+  end
+end

data/spec/support/lib/access_log.rb

@@ -9,9 +9,9 @@ module LogfileInterval
 
       set_regex /^([\d\.]+)\s+\S+\s+\S+\s+\[(\d\d.*\d\d)\]\s+"(?:GET|POST|PUT|HEAD|DELETE)\s+(\S+)\s+HTTP\S+"\s+(\d+)\s+(\d+)\s+"([^"]*)"\s+"([^"]+)"$/
 
-      add_column :name => 'ip',           :pos => 1, :aggregator => :count,                              :group_by => 'id'
+      add_column :name => 'ip',           :pos => 1, :aggregator => :count,                              :group_by => 'ip'
       add_column :name => 'timestamp',    :pos => 2, :aggregator => :timestamp
-      add_column :name => 'code',         :pos => 4, :aggregator => :count,                              :group_by => 'id'
+      add_column :name => 'code',         :pos => 4, :aggregator => :count,                              :group_by => 'ip'
       add_column :name => 'length',       :pos => 5, :aggregator => :average,   :conversion => :integer
       add_column :name => 'length_by_ip', :pos => 5, :aggregator => :average,   :conversion => :integer, :group_by => 'ip'
 

data/spec/support/logfiles/access.log.3

@@ -0,0 +1,7 @@
+66.249.67.176 - - [01/Jan/2012:16:25:47 -0800] "GET /packages/show/1 HTTP/1.1" 301 185 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
+173.192.238.51 - - [01/Jan/2012:16:26:31 -0800] "GET / HTTP/1.1" 301 185 "-" "Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.19; aggregator:Spinn3r (Spinn3r 3.1);"
+78.54.172.146 - - [01/Jan/2012:16:26:51 -0800] "GET /package/core/oneiric/main/base/abrowser HTTP/1.1" 200 6801 "http://www.google.com/url?sa=t&rct=j&q=abrowser" "Mozilla/5.0 (Ubuntu; X11; Linux x86_64; rv:9.0.1) Gecko/20100101 Firefox/9.0.1"
+78.54.172.146 - - [01/Jan/2012:16:30:51 -0800] "GET /package/core/oneiric/main/base/firefox  HTTP/1.1" 200 6801 "http://www.google.com/url?sa=t&rct=j&q=firefox" "Mozilla/5.0 (Ubuntu; X11; Linux x86_64; rv:9.0.1) Gecko/20100101 Firefox/9.0.1"
+66.249.68.148 - - [01/Jan/2012:16:30:51 -0800] "GET /package/core/hardy/main/updates/libldap2-dev HTTP/1.1" 200 7058 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
+78.54.172.146 - - [01/Jan/2012:16:30:51 -0800] "GET /package/show/2  HTTP/1.1" 302 6801 "http://www.google.com/url?sa=t&rct=j&q=abrowser" "Mozilla/5.0 (Ubuntu; X11; Linux x86_64; rv:9.0.1) Gecko/20100101 Firefox/9.0.1"
+78.54.172.146 - - [01/Jan/2012:16:31:51 -0800] "GET /package/core/oneiric/main/base/abrowser-6.0  HTTP/1.1" 200 6801 "http://www.google.com/url?sa=t&rct=j&q=abrowser" "Mozilla/5.0 (Ubuntu; X11; Linux x86_64; rv:9.0.1) Gecko/20100101 Firefox/9.0.1"

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: logfile_interval
 version: !ruby/object:Gem::Version
-  version: 1.1.0
+  version: 1.1.1
 platform: ruby
 authors:
 - Philippe Le Rohellec
 autorequire: 
 bindir: bin
 cert_chain: []
-date: 2013-12-08 00:00:00.000000000 Z
+date: 2014-01-03 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: bundler
@@ -83,7 +83,9 @@ dependencies:
 description: Logfile parser and aggregator
 email:
 - philippe@lerohellec.com
-executables: []
+executables:
+- aggregate_access_log.rb
+- readme.rb
 extensions: []
 extra_rdoc_files: []
 files:
@@ -94,6 +96,8 @@ files:
 - LICENSE.txt
 - README.md
 - Rakefile
+- bin/aggregate_access_log.rb
+- bin/readme.rb
 - docs/design.rb
 - docs/design2.rb
 - docs/design3.rb
@@ -113,6 +117,7 @@ files:
 - spec/lib/interval_spec.rb
 - spec/lib/line_parser/aggregator_spec.rb
 - spec/lib/line_parser/base_spec.rb
+- spec/lib/line_parser/counter_spec.rb
 - spec/lib/logfile_set_spec.rb
 - spec/lib/logfile_spec.rb
 - spec/spec_helper.rb
@@ -121,6 +126,7 @@ files:
 - spec/support/logfiles/access.log
 - spec/support/logfiles/access.log.1
 - spec/support/logfiles/access.log.2
+- spec/support/logfiles/access.log.3
 - spec/support/logfiles/timing.log
 - spec/support/logfiles/timing.log.1
 homepage: https://github.com/plerohellec/logfile_interval
@@ -152,6 +158,7 @@ test_files:
 - spec/lib/interval_spec.rb
 - spec/lib/line_parser/aggregator_spec.rb
 - spec/lib/line_parser/base_spec.rb
+- spec/lib/line_parser/counter_spec.rb
 - spec/lib/logfile_set_spec.rb
 - spec/lib/logfile_spec.rb
 - spec/spec_helper.rb
@@ -160,5 +167,6 @@ test_files:
 - spec/support/logfiles/access.log
 - spec/support/logfiles/access.log.1
 - spec/support/logfiles/access.log.2
+- spec/support/logfiles/access.log.3
 - spec/support/logfiles/timing.log
 - spec/support/logfiles/timing.log.1