plog 0.5.0 → 0.6.0

data/README.rdoc

@@ -1,148 +1,9 @@
 = Plog
 
-Ruby on Rails production log statistics generator.
+Production log parser.
 
-by Kazuyoshi Tlacaelel.
 
-    $ plog my_directory_with_production_logs/
-    $ ls plog/
-    objects     statistics.txt
-
-
-== Copyright
-
-Copyright (c) 2009 Kazuyoshi Tlacaelel. See LICENSE for details.
-
-== Comming soon!
-
-comming soon to a terminal near you!
-
-  * sorting:
-  * more statistics
-    (hits, number of hits per response type like 200, 302 etc)
-
-May be... but don't expect any of these to become a reality
-I love programming and tons of ideas flow in my head with posibilities
-but I do not have the time! :(
-
-  * Different export drivers?
-    (should be another plugin)
-
-  * cli options abstracted into classes so they can be aggregated with ease
-    (this might be cool)
-
-  * google charts integration
-    (is too much for this api)
-    (may be as a different plugin)
-
-== Dependancies:
-
-  * FileUtils
-  * MD5
-  * File
-  * Dir
-  * URI
-  * rubygems 1.3.3
-
-== Features:
-
-Compiles statistics in a easy to read manner
-
-
-    Hits      Time      Avg-Time  DbTime    Avg-DB    View      Avg-View  Url
-    93        18057     0.194     5775      0.062     10437     0.112     /users/[0-9]
-    12        277       0.023     193       0.016     0         0         /user_themes/update
-    1         290       0.29      107       0.107     175       0.175     /posts
-    3         99        0.033     57        0.019     0         0         /comments
-    82        11922     0.145     5969      0.072     4979      0.06      /user/[0-9]/comments
-    1868      1301006   0.696     623246    0.333     491474    0.263     /user/[0-9]/posts?
-    1         72        0.072     39        0.039     0         0         /confirm_destroy_account/[0-9]?
-    797       971882    1.219     414829    0.52      423130    0.53      /user/[0-9]/articles/friends?
-    122       20830     0.17      7081      0.058     10291     0.084     /user/[0-9]/topics?
-
-== Improvized twicks:
-
-You can improvize some quick sorting using the command line like:
-
-    cat plog/statistics.txt | head -n1 > some_file.txt
-    cat plog/statistics.txt | sort -nr >> some_file.txt
-
-This will create a new file with sorted results by hits for you!
-
-    Hits      Time      Avg-Time  DbTime    Avg-DB    View      Avg-View  Url
-    1868      1301006   0.696     623246    0.333     491474    0.263     /user/[0-9]/posts?
-    797       971882    1.219     414829    0.52      423130    0.53      /user/[0-9]/articles/friends?
-    122       20830     0.17      7081      0.058     10291     0.084     /user/[0-9]/topics?
-    93        18057     0.194     5775      0.062     10437     0.112     /users/[0-9]
-    82        11922     0.145     5969      0.072     4979      0.06      /user/[0-9]/comments
-    12        277       0.023     193       0.016     0         0         /user_themes/update
-    3         99        0.033     57        0.019     0         0         /comments
-    1         72        0.072     39        0.039     0         0         /confirm_destroy_account/[0-9]?
-    1         290       0.29      107       0.107     175       0.175     /posts
-
-== Installation
-
-    $ gem sources -a http://gems.github.com
-    $ gem install ktlacaelel-plog
-
-== Known bugs:
-  none, so far..
-
-== License:
-  MIT. See the "LICENSE" file for details.
-
-== Participate
-
-* Send me a brief message
-* Fork the project.
-* Add tests for it. This is important so I don't break it in a
-  future version unintentionally.
-* Make your feature addition or bug fix.
-* Commit, do not mess with rakefile, version, or history.
-  (if you want to have your own version, that is fine but
-   bump version in a commit by itself I can ignore when I pull)
-* Send me a pull request. Bonus points for topic branches.
-
-== Output:
-
-All output is packed in a plog directory, from wherever you run
-the "plog" executable.
-
-Inside this directory you'll find a directory called objects.
-wich contains many small files called "object-files"
-this files contain all the parsed statistics of you log files.
-
-The information is scattered and can be reused for future compilations
-meaning that new compilations data will merge with the existing one.
-
-all data in these "object-files" is read and summarized into a
-statistics.txt file found inside of the plog directory.
-
-== Tests:
-
-  * 70% tested, with shoulda
-  * all core areas of the api are tested, and tests pass!
-  * only the cli part of the api has no tests, but will be implemented soon
-
-== Usage:
-
-The "plog" ( production log ) executable receives one option.
-This must be a directory containing one or more production logs.
-Only logs in the first level will be parsed.
-Recursive reading is not allowed
-
-    $ plog directory_with_logs/
-
-== Works on:
-
-  * OSX Darwin utopia.local 9.8.0 Darwin Kernel Version 9.8.0: Wed Jul 15 16:55:01 PDT 2009; root:xnu-1228.15.4~1/RELEASE_I386 i386
-  * UBUNTU Linux utopia.local 2.6.28-11-server #42-Ubuntu SMP Fri Apr 17 02:45:36 UTC 2009 x86_64 GNU/Linux
-
-  * OSX ruby 1.8.6 (2008-08-11 patchlevel 287) [universal-darwin9.0]
-  * UBUNTU ruby 1.8.7 (2009-06-12 patchlevel 174) [x86_64-linux]
-
-  * rubygems 1.3.4
-  * rubygems 1.3.3
+    update coming soon!
 
 == The end.
 

data/Rakefile

@@ -54,3 +54,9 @@ Rake::RDocTask.new do |rdoc|
   rdoc.rdoc_files.include('README*')
   rdoc.rdoc_files.include('lib/**/*.rb')
 end
+
+desc 'Generate code statistics'
+task :stats do
+  require 'code_statistics'
+  CodeStatistics.new(['Plog', 'lib'], ['Tests', 'test']).to_s
+end

data/VERSION

@@ -1 +1 @@
-0.5.0
+0.6.0

data/lib/plog.rb

@@ -1,13 +1,8 @@
-
-# required external libraries
-require 'fileutils'
-require 'md5'
-require 'uri'
-
-# required internal libraries
-require 'cli'
-require 'completed_line'
-require 'log_file'
-require 'object_file'
-require 'url'
+require 'yaml'
+require 'rubygems'
+require 'active_record'
+require 'active_support'
+require 'plog/record_abstraction'
+require 'plog/scanner'
+require 'plog/parser'
 

data/lib/plog/parser.rb

@@ -0,0 +1,31 @@
+module Plog
+
+  class Parser
+
+    class << Parser
+
+      attr_reader :data
+
+      def reset
+      end
+
+      def crunch data
+        load_data data
+      end
+
+      def load_data(value)
+        reset
+        @data = value
+        self
+      end
+
+      def is_candidate?
+        raise 'You must implement a is_candidate? method in your tokenizer class'
+      end
+
+    end
+
+  end
+
+end
+

data/lib/plog/record_abstraction.rb

@@ -0,0 +1,62 @@
+module Plog
+
+  class RecordAbstraction
+
+    class << RecordAbstraction
+
+      def setup(table)
+        @table = table
+      end
+
+      def migration_name
+        "#{record_name}Migration"
+      end
+
+      def record_name
+        "#{@table[:table_name].to_s.camelize}"
+      end
+
+      def record_class
+        "
+        class ::#{record_name} < ActiveRecord::Base
+          set_table_name :#{record_name.underscore}
+        end
+        "
+      end
+
+      def migration_class
+        "
+        class ::#{migration_name} < ActiveRecord::Migration
+          def self.up
+            create_table :#{@table[:table_name]} do |t|
+              #{@table[:fields].map { |field, type| 't.' + type.to_s + ' :' + field.to_s } * "\n            " }
+              t.timestamps
+            end
+          end
+        end
+        "
+      end
+
+      def record_constant
+        eval(record_class)
+        eval('::' + record_name)
+      end
+
+      def migration_constant
+        eval(migration_class)
+        eval('::' + migration_name)
+      end
+
+      def record_exists?
+        ActiveRecord::Base.connection.execute('show tables').each do |record|
+          return true if record.first == @table[:table_name].to_s
+        end
+        false
+      end
+
+    end
+
+  end
+
+end
+

data/lib/plog/scanner.rb

@@ -0,0 +1,33 @@
+module Plog
+
+  class Scanner
+
+    class << Scanner
+
+      def load(io, config, &block)
+        @config = config
+        @config.each do |table|
+          RecordAbstraction.setup(table)
+          unless RecordAbstraction.record_exists?
+            RecordAbstraction.migration_constant.up
+          end
+        end
+        io.each_line { |line| yield(line, self) }
+      end
+
+      def record table_name
+        constant(table_name).new
+      end
+
+      # TODO: optimize
+      def constant table_name
+        config = @config.find { |hash| hash[:table_name] == table_name }
+        RecordAbstraction.setup(config)
+        RecordAbstraction.record_constant
+      end
+
+    end
+
+  end
+
+end

data/plog.gemspec

@@ -1,65 +1,53 @@
 # Generated by jeweler
-# DO NOT EDIT THIS FILE
-# Instead, edit Jeweler::Tasks in Rakefile, and run `rake gemspec`
+# DO NOT EDIT THIS FILE DIRECTLY
+# Instead, edit Jeweler::Tasks in Rakefile, and run 'rake gemspec'
 # -*- encoding: utf-8 -*-
 
 Gem::Specification.new do |s|
   s.name = %q{plog}
-  s.version = "0.2.4"
+  s.version = "0.6.0"
 
   s.required_rubygems_version = Gem::Requirement.new(">= 0") if s.respond_to? :required_rubygems_version=
   s.authors = ["Kazuyoshi Tlacaelel"]
-  s.date = %q{2009-09-09}
+  s.date = %q{2012-05-09}
   s.default_executable = %q{plog}
   s.description = %q{Plog - Ruby on Rails production log statistic generator. by Kazuyoshi Tlacaelel}
   s.email = %q{kazu.dev@gmail.com}
   s.executables = ["plog"]
   s.extra_rdoc_files = [
     "LICENSE",
-     "README.rdoc"
+    "README.rdoc"
   ]
   s.files = [
     ".document",
-     ".gitignore",
-     "LICENSE",
-     "README.rdoc",
-     "Rakefile",
-     "VERSION",
-     "bin/plog",
-     "lib/cli.rb",
-     "lib/completed_line.rb",
-     "lib/log_file.rb",
-     "lib/object_file.rb",
-     "lib/plog.rb",
-     "lib/url.rb",
-     "plog.gemspec",
-     "test/completed_line_test.rb",
-     "test/data/example.log",
-     "test/log_file_test.rb",
-     "test/object_file_test.rb",
-     "test/plog_test.rb",
-     "test/test_helper.rb",
-     "test/url_test.rb"
+    "LICENSE",
+    "README.rdoc",
+    "Rakefile",
+    "VERSION",
+    "bin/plog",
+    "lib/plog.rb",
+    "lib/plog/parser.rb",
+    "lib/plog/record_abstraction.rb",
+    "lib/plog/scanner.rb",
+    "plog.gemspec",
+    "test/completed_line_test.rb",
+    "test/data/example.log",
+    "test/log_file_test.rb",
+    "test/object_file_test.rb",
+    "test/plog_test.rb",
+    "test/test_helper.rb",
+    "test/url_test.rb"
   ]
   s.homepage = %q{http://github.com/ktlacaelel/plog}
-  s.rdoc_options = ["--charset=UTF-8"]
   s.require_paths = ["lib"]
-  s.rubygems_version = %q{1.3.3}
+  s.rubygems_version = %q{1.3.7}
   s.summary = %q{Plog - Ruby on Rails production log statistic generator. by Kazuyoshi Tlacaelel}
-  s.test_files = [
-    "test/completed_line_test.rb",
-     "test/log_file_test.rb",
-     "test/object_file_test.rb",
-     "test/plog_test.rb",
-     "test/test_helper.rb",
-     "test/url_test.rb"
-  ]
 
   if s.respond_to? :specification_version then
     current_version = Gem::Specification::CURRENT_SPECIFICATION_VERSION
     s.specification_version = 3
 
-    if Gem::Version.new(Gem::RubyGemsVersion) >= Gem::Version.new('1.2.0') then
+    if Gem::Version.new(Gem::VERSION) >= Gem::Version.new('1.2.0') then
       s.add_development_dependency(%q<thoughtbot-shoulda>, [">= 0"])
     else
       s.add_dependency(%q<thoughtbot-shoulda>, [">= 0"])
@@ -68,3 +56,4 @@ Gem::Specification.new do |s|
     s.add_dependency(%q<thoughtbot-shoulda>, [">= 0"])
   end
 end
+

metadata

@@ -1,7 +1,13 @@
 --- !ruby/object:Gem::Specification 
 name: plog
 version: !ruby/object:Gem::Version 
-  version: 0.5.0
+  hash: 7
+  prerelease: false
+  segments: 
+  - 0
+  - 6
+  - 0
+  version: 0.6.0
 platform: ruby
 authors: 
 - Kazuyoshi Tlacaelel
@@ -9,19 +15,23 @@ autorequire:
 bindir: bin
 cert_chain: []
 
-date: 2009-11-09 00:00:00 +09:00
+date: 2012-05-09 00:00:00 -05:00
 default_executable: plog
 dependencies: 
 - !ruby/object:Gem::Dependency 
   name: thoughtbot-shoulda
-  type: :development
-  version_requirement: 
-  version_requirements: !ruby/object:Gem::Requirement 
+  prerelease: false
+  requirement: &id001 !ruby/object:Gem::Requirement 
+    none: false
     requirements: 
     - - ">="
       - !ruby/object:Gem::Version 
+        hash: 3
+        segments: 
+        - 0
         version: "0"
-    version: 
+  type: :development
+  version_requirements: *id001
 description: Plog - Ruby on Rails production log statistic generator. by Kazuyoshi Tlacaelel
 email: kazu.dev@gmail.com
 executables: 
@@ -33,18 +43,15 @@ extra_rdoc_files:
 - README.rdoc
 files: 
 - .document
-- .gitignore
 - LICENSE
 - README.rdoc
 - Rakefile
 - VERSION
 - bin/plog
-- lib/cli.rb
-- lib/completed_line.rb
-- lib/log_file.rb
-- lib/object_file.rb
 - lib/plog.rb
-- lib/url.rb
+- lib/plog/parser.rb
+- lib/plog/record_abstraction.rb
+- lib/plog/scanner.rb
 - plog.gemspec
 - test/completed_line_test.rb
 - test/data/example.log
@@ -58,33 +65,34 @@ homepage: http://github.com/ktlacaelel/plog
 licenses: []
 
 post_install_message: 
-rdoc_options: 
-- --charset=UTF-8
+rdoc_options: []
+
 require_paths: 
 - lib
 required_ruby_version: !ruby/object:Gem::Requirement 
+  none: false
   requirements: 
   - - ">="
     - !ruby/object:Gem::Version 
+      hash: 3
+      segments: 
+      - 0
       version: "0"
-  version: 
 required_rubygems_version: !ruby/object:Gem::Requirement 
+  none: false
   requirements: 
   - - ">="
     - !ruby/object:Gem::Version 
+      hash: 3
+      segments: 
+      - 0
       version: "0"
-  version: 
 requirements: []
 
 rubyforge_project: 
-rubygems_version: 1.3.5
+rubygems_version: 1.3.7
 signing_key: 
 specification_version: 3
 summary: Plog - Ruby on Rails production log statistic generator. by Kazuyoshi Tlacaelel
-test_files: 
-- test/completed_line_test.rb
-- test/log_file_test.rb
-- test/object_file_test.rb
-- test/plog_test.rb
-- test/test_helper.rb
-- test/url_test.rb
+test_files: []
+

data/.gitignore

@@ -1,7 +0,0 @@
-*.sw?
-.DS_Store
-coverage
-rdoc
-pkg
-kazu.test
-objects

data/lib/cli.rb

@@ -1,119 +0,0 @@
-module Plog
-
-  class Cli
-
-    attr_reader :source_directory, :log_files
-
-    STATS_FILE = 'statistics.txt'
-
-    # ==========================================================================
-    # CLIENT INTERFACE
-    # ==========================================================================
-
-    def initialize(source_directory, target_directory)
-      @log_files = []
-      @source_directory = source_directory
-      @target_directory = target_directory
-      check_directory_consistency!
-      preload_log_files!
-    end
-
-    def run!
-      stdout count_of_logs_banner(@log_files.size)
-      stdout notice_banner
-      create_object_files
-      destroy_old_log_file
-      append_headers_to_log_file
-      parse_object_files
-    end
-
-    # ==========================================================================
-    # INTERNAL INTERFACE
-    # ==========================================================================
-
-    protected
-
-    def trim(string)
-      return '' unless string.is_a? String
-      string.gsub(/^\s+/, '').gsub(/\s+$/, '')
-    end
-
-    def create_object_files
-      @log_files.each do |log_file|
-        stdout parsing_log_file_banner(log_file.name)
-        log_file.parse_completed_lines!
-      end
-    end
-
-    def parse_object_files
-      Dir.glob(object_file_pattern).each do |object_file|
-        file = File.new(statistic_file_path, 'a+')
-        file.puts trim(ObjectFile.new(object_file).export)
-        file.close
-      end
-    end
-
-    def object_file_pattern
-      File.join(@target_directory, 'objects') + '/*'
-    end
-
-    def statistic_file_path
-      File.join(@target_directory, STATS_FILE)
-    end
-
-    def destroy_old_log_file
-      FileUtils.touch statistic_file_path
-      FileUtils.rm statistic_file_path
-    end
-
-    def append_headers_to_log_file
-      file = File.new(statistic_file_path, 'a+')
-      file.puts trim(ObjectFile.formated_headers)
-      file.close
-    end
-
-    def check_directory_consistency!
-      abort directory_not_found_banner unless File.exist? @source_directory
-    end
-
-    def preload_log_files!
-      Dir.glob(File.join(@source_directory, '*.log')).each do |log_file|
-        @log_files << LogFile.new(log_file, @target_directory)
-        stdout loading_log_file_banner(log_file)
-      end
-    end
-
-    def stdout(string)
-      puts ' ---> ' + string
-    end
-
-    # ==========================================================================
-    # BANNERS
-    # ==========================================================================
-
-    def notice_banner
-      'Parsing logs...
-      This may take a long-while, go get yourself a coffee!
-      While I hanlde this stuff for you.
-      '
-    end
-
-    def count_of_logs_banner(size)
-      'Count of loaded logs : %s ' % size
-    end
-
-    def parsing_log_file_banner(file)
-      'Parsing log located at : %s ' % file
-    end
-
-    def loading_log_file_banner(file)
-      'Initializing log file: %s' % file
-    end
-
-    def directory_not_found_banner
-      'No such dir: %s' % @source_directory
-    end
-
-  end
-
-end

data/lib/completed_line.rb

@@ -1,109 +0,0 @@
-module Plog
-
-  class CompletedLine
-
-    TOTAL_TIME_REGEX = /^(Completed in )(\d+)ms/         # \2
-    VIEW_TIME_REGEX = /([^\(]+)([^V]+)(View: )(\d+)(.*)/ # \4
-    DB_TIME_REGEX = /([^\(]+)([^D]+)(DB: )(\d+)(.*)/     # \4
-    URL_REGEX = /([^\[]+)(\[)([^\]]+)(.*)/
-    STATUS_REGEX = /(\s)(\d+)(\s)(\w+)(\s)(\[)(.*)/      # \2, \4
-    COMPLETED_TIME_REGEX = /^Completed/
-
-    def self.url
-      URL.new(@url)
-    end
-
-    def self.valid?
-      completed_line?
-    end
-
-    def self.completed_line?
-      return false unless @line.is_a? String
-      return false unless COMPLETED_TIME_REGEX =~ @line
-      return false unless DB_TIME_REGEX =~ @line
-      return false if @line.size < 10
-      true
-    end
-
-    def self.read!(string_line)
-      @line = string_line
-      validate
-    end
-
-    def self.db_time
-      @db_time
-    end
-
-    def self.view_time
-      @view_time
-    end
-
-    def self.total_time
-      @total_time
-    end
-
-    def self.status_string
-      @status_string
-    end
-
-    def self.status_number
-      @status_number
-    end
-
-    def self.to_csv
-      [total_time, view_time, db_time, url.simplify].join(',')
-    end
-
-    def self.merge(view, db)
-      @view_time += view.to_i
-      @db_time += db.to_i
-      @total_time = (@view_time + @db_time)
-    end
-
-    protected
-
-    def self.validate
-      return unless completed_line?
-      fragmentize!
-      extract_time!
-      extract_url!
-    end
-
-    def self.fragmentize!
-      @first_fragment, @second_fragment = @line.split('|')
-    end
-
-    def self.extract_time!
-      @total_time = extract_total_time
-      @view_time = extract_view_time
-      @db_time = extract_db_time
-      @status_number, @status_string = extract_status_number_and_string
-      nil
-    end
-
-    def self.extract_total_time
-      return 0 unless TOTAL_TIME_REGEX =~ @first_fragment
-      @first_fragment.gsub(TOTAL_TIME_REGEX, '\2').to_i
-    end
-
-    def self.extract_db_time
-      return 0 unless DB_TIME_REGEX =~ @first_fragment
-      @first_fragment.gsub(DB_TIME_REGEX, '\4').to_i
-    end
-
-    def self.extract_view_time
-      return 0 unless VIEW_TIME_REGEX =~ @first_fragment
-      @first_fragment.gsub(VIEW_TIME_REGEX, '\4').to_i
-    end
-
-    def self.extract_status_number_and_string
-      @second_fragment.gsub(STATUS_REGEX, '\2,\4').split(',')
-    end
-
-    def self.extract_url!
-      @url = @second_fragment.gsub(URL_REGEX, '\3')
-    end
-
-  end
-
-end

data/lib/log_file.rb

@@ -1,52 +0,0 @@
-module Plog
-
-  class LogFile < File
-
-    attr_accessor :name
-
-    def initialize(file, dump_dir)
-      @dump_dir = dump_dir
-      check_dump_dir_consistency!
-      super(file, 'r')
-      @name = file
-    end
-
-    def check_dump_dir_consistency!
-      unless File.exist? objects_recipient_path
-        FileUtils.mkdir_p objects_recipient_path
-      end
-    end
-
-    def validate(file)
-      abort 'File not found: ' + file.inspect unless File.exist? file
-    end
-
-    def parse_completed_lines!
-      each_line do |line|
-        CompletedLine.read! line
-        parse_completed_line if CompletedLine.valid?
-      end
-    end
-
-    def parse_completed_line
-      of = ObjectFile.new(object_path, 'w+')
-      of.simplified_url = CompletedLine.url.simplify
-      of.append_total_time CompletedLine.total_time
-      of.append_db_time CompletedLine.db_time
-      of.append_view_time CompletedLine.view_time
-      of.append_hits 1
-      of.save_changes!
-      of.close
-    end
-
-    def object_path
-      File.join(objects_recipient_path, CompletedLine.url.hashify)
-    end
-
-    def objects_recipient_path
-      @objects_recipient_path ||= File.join(@dump_dir, 'objects')
-    end
-
-  end
-
-end

data/lib/object_file.rb

@@ -1,165 +0,0 @@
-module Plog
-
-  class ObjectFile < File
-
-    DEFAULT_VALUES = {
-      :@total_hits => 0,
-      :@total_time => 0,
-      :@view_time => 0,
-      :@db_time => 0,
-      :@simplified_url => 'default'
-    }
-
-    KEY_ORDER = [
-      :@total_hits,
-      :@total_time,
-      :@view_time,
-      :@db_time,
-      :@simplified_url
-    ]
-
-    attr_accessor :simplified_url
-    attr_reader :view_time, :total_time, :db_time, :total_hits
-
-    def initialize(*args)
-      raw_data(args.first)
-      super(*args)
-      setup!
-    end
-
-    def setup!
-      unpack_default_values if ObjectFile.zero? path
-      load_changes!
-    end
-
-    def unpack_default_values
-      DEFAULT_VALUES.each do |k, v|
-        instance_variable_set k, v
-      end
-    end
-
-    def append_view_time(value)
-      @view_time += value.to_i
-    end
-
-    def append_db_time(value)
-      @db_time += value.to_i
-    end
-
-    def append_total_time(value)
-      @total_time += value
-    end
-
-    def append_hits(value)
-      @total_hits += value
-    end
-
-    def save_changes!
-      puts serialize_changes
-    end
-
-    def serialize_changes
-      KEY_ORDER.collect { |key| instance_variable_get key }.join(',')
-    end
-
-    def load_changes!
-      return if @raw_data == ''
-      @total_hits, @total_time, @view_time, @db_time, @simplified_url = @raw_data.split(',')
-      intify!
-    end
-
-    def intify!
-      @total_hits = @total_hits.to_i
-      @total_time = @total_time.to_i
-      @db_time = @db_time.to_i
-      @view_time = @view_time.to_i
-    end
-
-    def raw_data(some_string)
-      if File.exist? some_string
-        @raw_data = File.new(some_string).read
-      else
-        @raw_data = ''
-      end
-    end
-
-    def export_settings
-      [
-        [@total_hits, [:left, 15]],
-        [total_time_in_secs, [:left, 15]],
-        [avg_total_time, [:left, 15]],
-        [db_time_in_secs, [:left, 15]],
-        [avg_db_time, [:left, 15]],
-        [view_time_in_secs, [:left, 15]],
-        [avg_view_time, [:left, 15]],
-        [simplified_url, [:left, 40]],
-      ]
-    end
-
-    def self.export_header_settings
-      [
-        ['Hits', [:left, 15]],
-        ['Time', [:left, 15]],
-        ['Avg-Time', [:left, 15]],
-        ['DbTime', [:left, 15]],
-        ['Avg-DB', [:left, 15]],
-        ['View', [:left, 15]],
-        ['Avg-View', [:left, 15]],
-        ['Url', [:left, 40]],
-      ]
-    end
-
-    def self.formated_headers
-      export_header_settings.collect do |value, setting|
-        if setting.first == :left
-          value.to_s.ljust(setting[1])
-        else
-          value.to_s.rjust(setting[1])
-        end
-      end.join('') + "\n"
-    end
-
-    def export_headers
-      export_header_settings.collect { |header| header.ljust(20) }.join('')
-    end
-
-    def export
-      export_settings.collect do |value, setting|
-        if setting.first == :left
-          value.to_s.ljust(setting[1])
-        else
-          value.to_s.rjust(setting[1])
-        end
-      end.join('')
-    end
-
-    def avg_total_time
-      return 0 if @total_time == 0
-      (@total_time / @total_hits / 1000.0)
-    end
-
-    def avg_view_time
-      return 0 if @view_time == 0
-      (@view_time / @total_hits / 1000.0)
-    end
-
-    def avg_db_time
-      return 0 if @db_time == 0
-      (@db_time / @total_hits / 1000.0)
-    end
-
-    def total_time_in_secs
-      @total_time / 1000.0
-    end
-
-    def db_time_in_secs
-      @db_time / 1000.0
-    end
-
-    def view_time_in_secs
-      @view_time / 1000.0
-    end
-
-  end
-
-end

data/lib/url.rb

@@ -1,37 +0,0 @@
-module Plog
-
-  class URL
-
-    def initialize(url)
-      @url = url
-      @obj = URI.parse URI.escape(url)
-    end
-
-    def to_s
-      @url
-    end
-
-    def simplify
-      simplify_url = @url.dup
-      simplifiers.each { |k, v| simplify_url.gsub!(k, v) if k =~ simplify_url }
-      simplify_url
-    end
-
-    def hashify
-      ::MD5.hexdigest simplify
-    end
-
-    protected
-
-    def simplifiers
-      {
-        /\?.*/ => '?',
-        /\d+/ => '[0-9]',
-        /http:..[^\/]+/ => '',
-        /%.*/ => '%~'
-      }
-    end
-
-  end
-
-end