weblog-parser 0.1.0 → 0.1.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- checksums.yaml +4 -4
 - data/README.md +28 -12
 - data/lib/log_parser/version.rb +1 -1
 - data/weblog_parser.gemspec +2 -2
 - metadata +3 -3
 
    
        checksums.yaml
    CHANGED
    
    | 
         @@ -1,7 +1,7 @@ 
     | 
|
| 
       1 
1 
     | 
    
         
             
            ---
         
     | 
| 
       2 
2 
     | 
    
         
             
            SHA256:
         
     | 
| 
       3 
     | 
    
         
            -
              metadata.gz:  
     | 
| 
       4 
     | 
    
         
            -
              data.tar.gz:  
     | 
| 
      
 3 
     | 
    
         
            +
              metadata.gz: a39ee84c80475a33bf073af960a42f30517bb881d273367779d31fb124d16d9a
         
     | 
| 
      
 4 
     | 
    
         
            +
              data.tar.gz: 2bcb4ff7114711eb946b6843a510a525545045111689ad00a77100f66fd8eaa6
         
     | 
| 
       5 
5 
     | 
    
         
             
            SHA512:
         
     | 
| 
       6 
     | 
    
         
            -
              metadata.gz:  
     | 
| 
       7 
     | 
    
         
            -
              data.tar.gz:  
     | 
| 
      
 6 
     | 
    
         
            +
              metadata.gz: 342d756d1a9e37afdaedd26cdeda7dae52301e18989172500bb612cb1c9e1fe72add609ff4ccbe73713328fb2ca34e59f754ee49fb106aa0c4aaae7d7e97be3f
         
     | 
| 
      
 7 
     | 
    
         
            +
              data.tar.gz: 210d60841f0fdf4957f06998f5a4ccb52ceda56d02c15e2477bf246f49f4baf534f7dfa16b59df4accb5aef51b8e407f34a0bfdba40434bc2cb40daa66fad6fd
         
     | 
    
        data/README.md
    CHANGED
    
    | 
         @@ -1,4 +1,4 @@ 
     | 
|
| 
       1 
     | 
    
         
            -
            #  
     | 
| 
      
 1 
     | 
    
         
            +
            # WebLog Parser - Readme
         
     | 
| 
       2 
2 
     | 
    
         | 
| 
       3 
3 
     | 
    
         
             
            ## Installing
         
     | 
| 
       4 
4 
     | 
    
         | 
| 
         @@ -6,20 +6,34 @@ 
     | 
|
| 
       6 
6 
     | 
    
         | 
| 
       7 
7 
     | 
    
         
             
            ## Usage
         
     | 
| 
       8 
8 
     | 
    
         | 
| 
       9 
     | 
    
         
            -
             
     | 
| 
       10 
     | 
    
         
            -
            It uses a command-line interface.
         
     | 
| 
      
 9 
     | 
    
         
            +
            WebLog Parser reads a webserver logfile and counts page visits and unique page
         
     | 
| 
      
 10 
     | 
    
         
            +
            views.  It uses a command-line interface.
         
     | 
| 
      
 11 
     | 
    
         
            +
             
     | 
| 
      
 12 
     | 
    
         
            +
            ### Getting Started
         
     | 
| 
      
 13 
     | 
    
         
            +
             
     | 
| 
      
 14 
     | 
    
         
            +
            An example log file can be found at https://tinyurl.com/ve8x3qs
         
     | 
| 
      
 15 
     | 
    
         
            +
            You can download this file and name it 'weblog.log'.
         
     | 
| 
      
 16 
     | 
    
         
            +
            Then run the command:
         
     | 
| 
      
 17 
     | 
    
         
            +
             
     | 
| 
      
 18 
     | 
    
         
            +
              `wlparser -i -f weblog.log`
         
     | 
| 
      
 19 
     | 
    
         
            +
             
     | 
| 
      
 20 
     | 
    
         
            +
            This will read the log file and validates either ip4 or ip6 addresses.  The file
         
     | 
| 
      
 21 
     | 
    
         
            +
            contains both, so if you don't use the -i option, it will show some errors as
         
     | 
| 
      
 22 
     | 
    
         
            +
            the default is ip4.
         
     | 
| 
      
 23 
     | 
    
         
            +
             
     | 
| 
      
 24 
     | 
    
         
            +
            ### Options
         
     | 
| 
       11 
25 
     | 
    
         | 
| 
       12 
26 
     | 
    
         
             
              `wlparser -h`
         
     | 
| 
       13 
27 
     | 
    
         
             
              `wlparser --help`
         
     | 
| 
       14 
28 
     | 
    
         | 
| 
       15 
29 
     | 
    
         
             
            Shows a list of options
         
     | 
| 
       16 
30 
     | 
    
         | 
| 
       17 
     | 
    
         
            -
              `wlparser -f logfile.log`
         
     | 
| 
      
 31 
     | 
    
         
            +
              `wlparser -f logfile.log`  
         
     | 
| 
       18 
32 
     | 
    
         
             
              `wlparser --file logfile.log`
         
     | 
| 
       19 
33 
     | 
    
         | 
| 
       20 
34 
     | 
    
         
             
            Reads a log file and display results:
         
     | 
| 
       21 
35 
     | 
    
         | 
| 
       22 
     | 
    
         
            -
              `wlparser -m 'logfile1.log logfile2.log'`
         
     | 
| 
      
 36 
     | 
    
         
            +
              `wlparser -m 'logfile1.log logfile2.log'`  
         
     | 
| 
       23 
37 
     | 
    
         
             
              `wlparser --multiple_files 'logfile1.log logfile2.log'`
         
     | 
| 
       24 
38 
     | 
    
         | 
| 
       25 
39 
     | 
    
         
             
            Reads a list of log files in quotes and displays results.  All files give
         
     | 
| 
         @@ -83,7 +97,7 @@ Validates ip addresses using ip6 format. 
     | 
|
| 
       83 
97 
     | 
    
         
             
             `wlparser -6`
         
     | 
| 
       84 
98 
     | 
    
         
             
             `wlparser --ip4ip6_validation`
         
     | 
| 
       85 
99 
     | 
    
         | 
| 
       86 
     | 
    
         
            -
            Validates ip addresses if  
     | 
| 
      
 100 
     | 
    
         
            +
            Validates ip addresses if they matches either ip4 or ip6 format.
         
     | 
| 
       87 
101 
     | 
    
         | 
| 
       88 
102 
     | 
    
         
             
             `wlparser -I`
         
     | 
| 
       89 
103 
     | 
    
         
             
             `wlparser --no_ip_validation`
         
     | 
| 
         @@ -103,7 +117,7 @@ Does not validate webpage path, assumes they are all valid. 
     | 
|
| 
       103 
117 
     | 
    
         
             
             `wlparser -r`
         
     | 
| 
       104 
118 
     | 
    
         
             
             `wlparser --remove_invalid`
         
     | 
| 
       105 
119 
     | 
    
         | 
| 
       106 
     | 
    
         
            -
            Ignore logs  
     | 
| 
      
 120 
     | 
    
         
            +
            Ignore logs if either ip address or path is invalid.
         
     | 
| 
       107 
121 
     | 
    
         | 
| 
       108 
122 
     | 
    
         
             
             `wlparser -R`
         
     | 
| 
       109 
123 
     | 
    
         
             
             `wlparser --warn_invalid`
         
     | 
| 
         @@ -129,7 +143,7 @@ Displays unique page views in results and in text file output (default). 
     | 
|
| 
       129 
143 
     | 
    
         
             
              `wlparser -U`
         
     | 
| 
       130 
144 
     | 
    
         
             
              `wlparser --no_unique_page_views`
         
     | 
| 
       131 
145 
     | 
    
         | 
| 
       132 
     | 
    
         
            -
             
     | 
| 
      
 146 
     | 
    
         
            +
            Does not display unique page views in results or text file output (default).
         
     | 
| 
       133 
147 
     | 
    
         | 
| 
       134 
148 
     | 
    
         
             
            ##Log Format
         
     | 
| 
       135 
149 
     | 
    
         | 
| 
         @@ -141,8 +155,7 @@ Example log with ip4 address: 
     | 
|
| 
       141 
155 
     | 
    
         | 
| 
       142 
156 
     | 
    
         
             
            Logs can use either using ip4 addresses or ip6 addresses.  
         
     | 
| 
       143 
157 
     | 
    
         | 
| 
       144 
     | 
    
         
            -
            ip4 addresses should be valid i.e. between 0.0.0.0 and 255.255.255.255, although
         
     | 
| 
       145 
     | 
    
         
            -
            you can skip this check.
         
     | 
| 
      
 158 
     | 
    
         
            +
            ip4 addresses should be valid i.e. between 0.0.0.0 and 255.255.255.255, although you can skip this check.
         
     | 
| 
       146 
159 
     | 
    
         | 
| 
       147 
160 
     | 
    
         
             
            Example log with ip6 address:
         
     | 
| 
       148 
161 
     | 
    
         
             
              `\webpage\index 1234:1234:1234:1234:1234:1234:1234:1234`
         
     | 
| 
         @@ -153,10 +166,12 @@ ip6 addresses can be compressed e.g. 
     | 
|
| 
       153 
166 
     | 
    
         | 
| 
       154 
167 
     | 
    
         
             
            ## Testing
         
     | 
| 
       155 
168 
     | 
    
         | 
| 
       156 
     | 
    
         
            -
            Tests can be run using:
         
     | 
| 
      
 169 
     | 
    
         
            +
            Tests can be run from the cloned repository using:
         
     | 
| 
       157 
170 
     | 
    
         | 
| 
       158 
171 
     | 
    
         
             
              `rake test`
         
     | 
| 
       159 
172 
     | 
    
         | 
| 
      
 173 
     | 
    
         
            +
            The git repository is: https://github.com/davidmorton0/WebLogParser
         
     | 
| 
      
 174 
     | 
    
         
            +
             
     | 
| 
       160 
175 
     | 
    
         
             
            Tests have been separated into
         
     | 
| 
       161 
176 
     | 
    
         
             
            * unit tests - test methods in each class
         
     | 
| 
       162 
177 
     | 
    
         
             
            * integration tests - test the whole app
         
     | 
| 
         @@ -176,7 +191,8 @@ Note that the dependencies to Constants are not shown. 
     | 
|
| 
       176 
191 
     | 
    
         
             
            ### Classes
         
     | 
| 
       177 
192 
     | 
    
         | 
| 
       178 
193 
     | 
    
         
             
            * Parser - Holds the log information and changes the format
         
     | 
| 
       179 
     | 
    
         
            -
            * LogReader - Loads files then reads logs.  Validates logs, ip addresses and 
     | 
| 
      
 194 
     | 
    
         
            +
            * LogReader - Loads files then reads logs.  Validates logs, ip addresses and
         
     | 
| 
      
 195 
     | 
    
         
            +
            paths
         
     | 
| 
       180 
196 
     | 
    
         
             
            * ipValidator - Validates ip addresses
         
     | 
| 
       181 
197 
     | 
    
         
             
            * PathValidator - Validates the path for the webpage
         
     | 
| 
       182 
198 
     | 
    
         
             
            * OptionHandler - Sets the options from the command line arguments given
         
     | 
    
        data/lib/log_parser/version.rb
    CHANGED
    
    
    
        data/weblog_parser.gemspec
    CHANGED
    
    | 
         @@ -9,7 +9,7 @@ Gem::Specification.new do |spec| 
     | 
|
| 
       9 
9 
     | 
    
         
             
              spec.email         = ["davidmorton0@gmail.com"]
         
     | 
| 
       10 
10 
     | 
    
         | 
| 
       11 
11 
     | 
    
         
             
              spec.summary       = %q{A command line parser for web server logs}
         
     | 
| 
       12 
     | 
    
         
            -
              spec.homepage      = "https://github.com/davidmorton0/ 
     | 
| 
      
 12 
     | 
    
         
            +
              spec.homepage      = "https://github.com/davidmorton0/WebLogParser"
         
     | 
| 
       13 
13 
     | 
    
         
             
              spec.license       = "MIT"
         
     | 
| 
       14 
14 
     | 
    
         | 
| 
       15 
15 
     | 
    
         
             
              # Prevent pushing this gem to RubyGems.org. To allow pushes either set the 'allowed_push_host'
         
     | 
| 
         @@ -18,7 +18,7 @@ Gem::Specification.new do |spec| 
     | 
|
| 
       18 
18 
     | 
    
         
             
                #spec.metadata["allowed_push_host"] = "TODO: Set to 'http://mygemserver.com'"
         
     | 
| 
       19 
19 
     | 
    
         | 
| 
       20 
20 
     | 
    
         
             
                #spec.metadata["homepage_uri"] = spec.homepage
         
     | 
| 
       21 
     | 
    
         
            -
                spec.metadata["source_code_uri"] = "https://github.com/davidmorton0/ 
     | 
| 
      
 21 
     | 
    
         
            +
                spec.metadata["source_code_uri"] = "https://github.com/davidmorton0/WebLogParser"
         
     | 
| 
       22 
22 
     | 
    
         
             
                #spec.metadata["changelog_uri"] = "TODO: Put your gem's CHANGELOG.md URL here."
         
     | 
| 
       23 
23 
     | 
    
         
             
              else
         
     | 
| 
       24 
24 
     | 
    
         
             
                raise "RubyGems 2.0 or newer is required to protect against " \
         
     | 
    
        metadata
    CHANGED
    
    | 
         @@ -1,7 +1,7 @@ 
     | 
|
| 
       1 
1 
     | 
    
         
             
            --- !ruby/object:Gem::Specification
         
     | 
| 
       2 
2 
     | 
    
         
             
            name: weblog-parser
         
     | 
| 
       3 
3 
     | 
    
         
             
            version: !ruby/object:Gem::Version
         
     | 
| 
       4 
     | 
    
         
            -
              version: 0.1. 
     | 
| 
      
 4 
     | 
    
         
            +
              version: 0.1.1
         
     | 
| 
       5 
5 
     | 
    
         
             
            platform: ruby
         
     | 
| 
       6 
6 
     | 
    
         
             
            authors:
         
     | 
| 
       7 
7 
     | 
    
         
             
            - David Morton
         
     | 
| 
         @@ -84,11 +84,11 @@ files: 
     | 
|
| 
       84 
84 
     | 
    
         
             
            - lib/log_parser/version.rb
         
     | 
| 
       85 
85 
     | 
    
         
             
            - lib/log_parser/warning_handler.rb
         
     | 
| 
       86 
86 
     | 
    
         
             
            - weblog_parser.gemspec
         
     | 
| 
       87 
     | 
    
         
            -
            homepage: https://github.com/davidmorton0/ 
     | 
| 
      
 87 
     | 
    
         
            +
            homepage: https://github.com/davidmorton0/WebLogParser
         
     | 
| 
       88 
88 
     | 
    
         
             
            licenses:
         
     | 
| 
       89 
89 
     | 
    
         
             
            - MIT
         
     | 
| 
       90 
90 
     | 
    
         
             
            metadata:
         
     | 
| 
       91 
     | 
    
         
            -
              source_code_uri: https://github.com/davidmorton0/ 
     | 
| 
      
 91 
     | 
    
         
            +
              source_code_uri: https://github.com/davidmorton0/WebLogParser
         
     | 
| 
       92 
92 
     | 
    
         
             
            post_install_message: 
         
     | 
| 
       93 
93 
     | 
    
         
             
            rdoc_options: []
         
     | 
| 
       94 
94 
     | 
    
         
             
            require_paths:
         
     |