log-analyser 0.1.2.pre.v012b.20201107192223 → 0.1.3.pre.documentation.20201108192110

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
checksums.yaml CHANGED
@@ -1,7 +1,7 @@
1
1
  ---
2
2
  SHA256:
3
- metadata.gz: bfd181eae4b61db55638dc2a69e4a2bd4a22754fb47b0c9e6a057bd4c216d4c0
4
- data.tar.gz: fd5f803b14fc3af9db56d9d7178f4bd67aafb28bd3f68c75bf456075307adb88
3
+ metadata.gz: c2b9b98f46b7ffd52716e53e4b069bfa6d1a01186bfe24bd5e6d9136fc9b79af
4
+ data.tar.gz: 67c01dedd6e66dc077d6e852f64c5270573cdd6c579aeda09326f881845dc61f
5
5
  SHA512:
6
- metadata.gz: a67fb1a45d8349d98b24b63fe81638f0bee06f607117541d31e7bb8df27c0930388d6515c2e7e8802b80da83a8271a159aa64394f5e3e28aa2bccf671070e4bb
7
- data.tar.gz: d6c9e73b663d88b9a2675ae64b9fbdb2f9e84642bf155559ae8674f278df72db268cc9199df020cbdfd275487100e2c760d7cb85e81ee0932447fcbe93a2c3d3
6
+ metadata.gz: a60d02c6be8493405b7bcd36c7b1bdcffb8a3f24f5432411fbacb707ccc4d0c59f44797d64fa1f553ab48b13ee9c3f750d8ec4c1a06b3a910db65c7ad71638ee
7
+ data.tar.gz: b56ec12bf9e52a256498c9573bfceb0eefe40404131536a5ce37514f92ef2840a269df5aad120230aa9a9539c14239419d07a8cba6b35dcdf26621a319bf4f5f
data/CHANGELOG CHANGED
@@ -1 +1,7 @@
1
- v0.1.1. adding gemspec/echoe/
1
+ v0.1.3. completing documentation
2
+
3
+ v0.1.2b.
4
+
5
+ v0.1.2.
6
+
7
+ v0.1.1. adding gemspec/echoe/
data/README.md CHANGED
@@ -26,6 +26,8 @@ After instantiating *log-analyser's* `PageviewsLogAggregator` class with the pat
26
26
  <summary>click to expand the index</summary>
27
27
 
28
28
  - [Installation](#installation)
29
+ * [Gem](#gem)
30
+ * [Project](#project)
29
31
  - [Usage](#usage)
30
32
  - [Logs and Pageviews](#logs-and-pageviews)
31
33
  * [Definitions](#definitions)
@@ -40,6 +42,8 @@ After instantiating *log-analyser's* `PageviewsLogAggregator` class with the pat
40
42
 
41
43
  ## Installation
42
44
 
45
+ ### Gem
46
+
43
47
  To use *log-analyser* in your application, add this line to your Gemfile:
44
48
 
45
49
  ```ruby
@@ -50,7 +54,7 @@ Or install it yourself as:
50
54
 
51
55
  $ gem install log-analyser
52
56
 
53
- ## Usage
57
+ #### Gem Usage
54
58
 
55
59
  ```
56
60
  ...
@@ -60,18 +64,72 @@ Or install it yourself as:
60
64
  ...
61
65
  ```
62
66
 
67
+ ### Project
68
+
69
+ Install the Ruby version specified in `.ruby-version` </br>
70
+ Clone the project and install Bundler
71
+
72
+ ```
73
+ git clone git@github.com:DMazzei/log-analyser.git
74
+ cd log-analyser
75
+ gem install bundler
76
+ ```
77
+
78
+ #### Setup:
79
+
80
+ Run the initial setup
81
+
82
+ $ bin/setup
83
+
84
+ > If you need to reinstall dependencies or something alike:
85
+ > ```
86
+ > $ bundle install
87
+ > ```
88
+
89
+ #### Usage
90
+
91
+ Call `./bin/parse_pageview_file.rb` passing a logfile path as argument, will return the pageview count ordered from most to less viewed.</br>
92
+ Check the script with `--help` argument for more options
93
+
94
+ ![image](https://user-images.githubusercontent.com/3502642/98471556-0c265c00-21e5-11eb-8fc3-c029e09e41fa.png)
95
+
96
+ An example log can be found in `resources` folder:
97
+
98
+ $ ./bin/parse_pageview_file.rb --file 'resources/webserver.log'
99
+ |--------------------------------------------------|
100
+ | All pageviews |
101
+ |--------------------------------------------------|
102
+ | /about/2.................... | 90 |
103
+ | /contact.................... | 89 |
104
+ | /index...................... | 82 |
105
+ | /about...................... | 81 |
106
+ | /help_page/1................ | 80 |
107
+ | /home....................... | 78 |
108
+ |--------------------------------------------------|
109
+
110
+ The `-u` or `--unique` option will also display the unique pageview count:
111
+
112
+ $ ./bin/parse_pageview_file.rb --file 'resources/webserver.log' -u
113
+
114
+ And any specific page can be filtered with `-p` or `--page`:
115
+
116
+ $ ./bin/parse_pageview_file.rb --file 'resources/webserver.log' -p '/index'
117
+ |--------------------------------------------------|
118
+ | View count for page: /index |
119
+ |--------------------------------------------------|
120
+ | All pageviews |
121
+ |--------------------------------------------------|
122
+ | /index...................... | 82 |
123
+ |--------------------------------------------------|
124
+
63
125
  ## Logs and Pageviews
64
126
 
65
127
  ### Definitions
66
- ```
67
- A pageview is defined as a view of a page on your site that is being tracked by the Analytics tracking code.
68
- If a user clicks reload after reaching the page, this is counted as an additional pageview.
69
- If a user navigates to a different page and then returns to the original page, a second pageview is recorded as well.
70
128
 
71
- A unique pageview, as seen in the Content Overview report, aggregates pageviews that are generated by the same
72
- user during the same session. A unique pageview represents the number of sessions during which that page was
73
- viewed one or more times.
74
- ```
129
+ > :page_facing_up: A pageview is defined as a view of a page on your site that is being tracked by the Analytics tracking code. If a user clicks reload after reaching the page, this is counted as an additional pageview. If a user navigates to a different page and then returns to the original page, a second pageview is recorded as well.
130
+
131
+ > :page_with_curl: A unique pageview, as seen in the Content Overview report, aggregates pageviews that are generated by the same user during the same session. A unique pageview represents the number of sessions during which that page was viewed one or more times.
132
+
75
133
 
76
134
  ### Log Formatting
77
135
 
@@ -89,25 +147,6 @@ A space must separate the page name (first column) from the user identifier (e.g
89
147
 
90
148
  #### Start with the project:
91
149
 
92
- Install the Ruby version specified in `.ruby-version` </br>
93
- Clone the project and install Bundler
94
-
95
- ```
96
- git clone git@github.com:DMazzei/log-analyser.git
97
- cd log-analyser
98
- gem install bundler
99
- ```
100
-
101
- #### Setup:
102
-
103
- Run the initial setup
104
-
105
- $ bin/setup
106
-
107
- > If you need to reinstall dependencies or something alike:
108
- > ```
109
- > $ bundle install
110
- > ```
111
150
 
112
151
 
113
152
  You can also run `Bundle exec console` for an interactive prompt that will allow you to experiment.
@@ -130,11 +169,16 @@ Status and coverage history can be checked [here](https://coveralls.io/github/DM
130
169
 
131
170
  #### Deployment
132
171
 
133
- After passing all checks and requirements on github, a *PR* can be merged after review and approval.
134
- The _*master branch*_ merge process will trigger the deployment process on CircleCI.
172
+ Following the creation of a _*Pull Request*_ a CI workflow is triggered in CircleCI, that can be checked [here](https://app.circleci.com/pipelines/github/DMazzei/log-analyser).</br>
173
+ This workflow consist in _building_ the library; Running _rubocop_ and _rspec_ to validate integrity and code quality; And lastly generating and pushing a _feature-gem_ that can be used for development and tests.
174
+
175
+ After passing all checks and requirements on github, a *PR* can be merged as soon as it is reviewed and approved.
176
+ The _*master branch*_ merge process will trigger the deployment process on CircleCI, and this workflow ends with the generation of a _*tagged-gem*_.
135
177
 
136
- The deployment process will build and tag a new gem version and push it to [rubygems.org](https://rubygems.org/gems/log-analyser).
178
+ The whole deployment process will finish by building and tagging a new gem version and pushing it to [rubygems.org](https://rubygems.org/gems/log-analyser).
137
179
 
180
+ > :warning: In order to merge changes into _*master branch*_, the version must be bumped up, otherwise the deployment will fail.</br>
181
+ > The version must be updated in `version.rb`.
138
182
 
139
183
  ## Contributing
140
184
 
@@ -1,19 +1,21 @@
1
1
  # frozen_string_literal: true
2
2
 
3
- class Pageviews
4
- InvalidLogEntriesError = Class.new(StandardError)
3
+ module LogAnalyser
4
+ class Pageviews
5
+ InvalidLogEntriesError = Class.new(StandardError)
5
6
 
6
- def self.for(entries = {})
7
- new.generate_view_count(entries)
8
- rescue StandardError
9
- raise InvalidLogEntriesError
10
- end
7
+ def self.for(entries = {})
8
+ new.generate_view_count(entries)
9
+ rescue StandardError
10
+ raise InvalidLogEntriesError
11
+ end
11
12
 
12
- def generate_view_count(entries)
13
- entries
14
- .transform_values(&:size)
15
- .sort_by(&:last)
16
- .reverse
17
- .to_h
13
+ def generate_view_count(entries)
14
+ entries
15
+ .transform_values(&:size)
16
+ .sort_by(&:last)
17
+ .reverse
18
+ .to_h
19
+ end
18
20
  end
19
21
  end
@@ -4,24 +4,26 @@ require_relative 'parser'
4
4
  require_relative 'pageviews'
5
5
  require_relative 'unique_pageviews'
6
6
 
7
- class PageviewsLogAggregator
8
- def initialize(file_path)
9
- @file_path = file_path
10
- end
7
+ module LogAnalyser
8
+ class PageviewsLogAggregator
9
+ def initialize(file_path)
10
+ @file_path = file_path
11
+ end
11
12
 
12
- def all
13
- Pageviews.for(entries)
14
- end
13
+ def all
14
+ Pageviews.for(entries)
15
+ end
15
16
 
16
- def unique
17
- UniquePageviews.for(entries)
18
- end
17
+ def unique
18
+ UniquePageviews.for(entries)
19
+ end
19
20
 
20
- private
21
+ private
21
22
 
22
- attr_accessor :file_path
23
+ attr_accessor :file_path
23
24
 
24
- def entries
25
- @entries ||= Parser.call(file_path)
25
+ def entries
26
+ @entries ||= Parser.call(file_path)
27
+ end
26
28
  end
27
29
  end
@@ -1,33 +1,35 @@
1
1
  # frozen_string_literal: true
2
2
 
3
- class Parser
4
- class FileNotFoundError < StandardError
5
- def initialize(path)
6
- super("File not found for path: [#{path}]")
3
+ module LogAnalyser
4
+ class Parser
5
+ class FileNotFoundError < StandardError
6
+ def initialize(path)
7
+ super("File not found for path: [#{path}]")
8
+ end
7
9
  end
8
- end
9
10
 
10
- def self.call(file_path)
11
- new.call(file_path)
12
- end
11
+ def self.call(file_path)
12
+ new.call(file_path)
13
+ end
13
14
 
14
- def call(file_path)
15
- raise FileNotFoundError, file_path unless File.exist?(file_path)
15
+ def call(file_path)
16
+ raise FileNotFoundError, file_path unless File.exist?(file_path)
16
17
 
17
- data = File.open(file_path).map(&:strip)
18
- data.reject!(&:empty?)
19
- parse(data)
20
- end
18
+ data = File.open(file_path).map(&:strip)
19
+ data.reject!(&:empty?)
20
+ parse(data)
21
+ end
21
22
 
22
- private
23
+ private
23
24
 
24
- def parse(data)
25
- entries = Hash.new { |h, k| h[k] = [] }
26
- data.each do |entry|
27
- key, value = *entry.split(/\s+/)
28
- entries[key] << value
29
- end
25
+ def parse(data)
26
+ entries = Hash.new { |h, k| h[k] = [] }
27
+ data.each do |entry|
28
+ key, value = *entry.split(/\s+/)
29
+ entries[key] << value
30
+ end
30
31
 
31
- entries
32
+ entries
33
+ end
32
34
  end
33
35
  end
@@ -1,10 +1,12 @@
1
1
  # frozen_string_literal: true
2
2
 
3
- class UniquePageviews < Pageviews
4
- def generate_view_count(entries)
5
- entries.transform_values { |value| value.uniq.size }
6
- .sort_by(&:last)
7
- .reverse
8
- .to_h
3
+ module LogAnalyser
4
+ class UniquePageviews < Pageviews
5
+ def generate_view_count(entries)
6
+ entries.transform_values { |value| value.uniq.size }
7
+ .sort_by(&:last)
8
+ .reverse
9
+ .to_h
10
+ end
9
11
  end
10
12
  end
metadata CHANGED
@@ -1,44 +1,50 @@
1
1
  --- !ruby/object:Gem::Specification
2
2
  name: log-analyser
3
3
  version: !ruby/object:Gem::Version
4
- version: 0.1.2.pre.v012b.20201107192223
4
+ version: 0.1.3.pre.documentation.20201108192110
5
5
  platform: ruby
6
6
  authors:
7
7
  - Dan Mazzei
8
8
  autorequire:
9
- bindir: exe
9
+ bindir: bin
10
10
  cert_chain: []
11
- date: 2020-11-07 00:00:00.000000000 Z
11
+ date: 2020-11-08 00:00:00.000000000 Z
12
12
  dependencies: []
13
13
  description: Log reader and data aggregator for pageviews information.
14
14
  email:
15
15
  - danielmazzei@gmail.com
16
16
  executables: []
17
17
  extensions: []
18
- extra_rdoc_files: []
18
+ extra_rdoc_files:
19
+ - CHANGELOG
20
+ - LICENSE.txt
21
+ - README.md
19
22
  files:
20
- - ".ruby-version"
21
23
  - CHANGELOG
22
- - Gemfile
23
- - Guardfile
24
24
  - LICENSE.txt
25
25
  - README.md
26
- - Rakefile
27
- - bin/setup
28
- - config/environment.rb
29
26
  - lib/pageviews.rb
30
27
  - lib/pageviews_log_aggregator.rb
31
28
  - lib/parser.rb
32
29
  - lib/unique_pageviews.rb
33
- - log-analyser.gemspec
34
- - version.rb
35
30
  homepage: https://github.com/DMazzei/log-analyser
36
31
  licenses:
37
32
  - MIT
38
33
  metadata:
39
34
  homepage_uri: https://github.com/DMazzei/log-analyser
35
+ source_code_uri: https://github.com/DMazzei/log-analyser
36
+ changelog_uri: https://github.com/DMazzei/log-analyser/blob/master/CHANGELOG
37
+ bug_tracker_uri: https://github.com/DMazzei/log-analyser/issues
38
+ documentation_uri: https://www.rubydoc.info/gems/log-analyser
40
39
  post_install_message:
41
- rdoc_options: []
40
+ rdoc_options:
41
+ - "--title"
42
+ - Emoticon - emotions in terminal
43
+ - "--main"
44
+ - README.md
45
+ - "--line-numbers"
46
+ - "--inline-source"
47
+ - "--quiet"
42
48
  require_paths:
43
49
  - lib
44
50
  required_ruby_version: !ruby/object:Gem::Requirement
@@ -1 +0,0 @@
1
- 2.7.1
data/Gemfile DELETED
@@ -1,24 +0,0 @@
1
- # frozen_string_literal: true
2
-
3
- source 'https://rubygems.org'
4
-
5
- gem 'bundler'
6
- gem 'rake', '~> 12.0'
7
- gem 'require_all'
8
-
9
- group :development, :test do
10
- gem 'coveralls_reborn', '~> 0.18.0', require: false
11
- gem 'rspec', '~> 3.8'
12
- gem 'rspec_junit_formatter'
13
- gem 'rubocop', require: false
14
- gem 'simplecov', require: false
15
- gem 'simplecov-lcov'
16
- end
17
-
18
- group :development do
19
- gem 'guard'
20
- gem 'guard-rspec'
21
- gem 'pry'
22
- end
23
-
24
- gemspec name: 'log-analyser'
data/Guardfile DELETED
@@ -1,45 +0,0 @@
1
- # frozen_string_literal: true
2
-
3
- # A sample Guardfile
4
- # More info at https://github.com/guard/guard#readme
5
-
6
- ## Uncomment and set this to only include directories you want to watch
7
- # directories %w(app lib config test spec features) \
8
- # .select{|d| Dir.exist?(d) ? d : UI.warning("Directory #{d} does not exist")}
9
-
10
- ## Note: if you are using the `directories` clause above and you are not
11
- ## watching the project directory ('.'), then you will want to move
12
- ## the Guardfile to a watched dir and symlink it back, e.g.
13
- #
14
- # $ mkdir config
15
- # $ mv Guardfile config/
16
- # $ ln -s config/Guardfile .
17
- #
18
- # and, you'll have to watch "config/Guardfile" instead of "Guardfile"
19
-
20
- # Note: The cmd option is now required due to the increasing number of ways
21
- # rspec may be run, below are examples of the most common uses.
22
- # * bundler: 'bundle exec rspec'
23
- # * bundler binstubs: 'bin/rspec'
24
- # * spring: 'bin/rspec' (This will use spring if running and you have
25
- # installed the spring binstubs per the docs)
26
- # * zeus: 'zeus rspec' (requires the server to be started separately)
27
- # * 'just' rspec: 'rspec'
28
-
29
- guard :rspec, cmd: 'bundle exec rspec' do
30
- require 'guard/rspec/dsl'
31
- dsl = Guard::RSpec::Dsl.new(self)
32
-
33
- # Feel free to open issues for suggestions and improvements
34
-
35
- # RSpec files
36
- rspec = dsl.rspec
37
- watch(rspec.spec_helper) { rspec.spec_dir }
38
- watch(rspec.spec_support) { rspec.spec_dir }
39
- watch(rspec.spec_files)
40
- watch(/^lib\/documents_analyser\/(.+)\.rb$/) { |m| "spec/#{m[1]}_spec.rb" }
41
-
42
- # Ruby files
43
- ruby = dsl.ruby
44
- dsl.watch_spec_files_for(ruby.lib_files)
45
- end
data/Rakefile DELETED
@@ -1,16 +0,0 @@
1
- # frozen_string_literal: true
2
-
3
- begin
4
- require 'bundler/setup'
5
- rescue LoadError
6
- puts 'You must `gem install bundler` and `bundle install` to run rake tasks'
7
- end
8
-
9
- Bundler::GemHelper.install_tasks
10
-
11
- require 'rubygems'
12
- require 'rspec/core/rake_task'
13
-
14
- RSpec::Core::RakeTask.new(:spec)
15
-
16
- task default: :spec
data/bin/setup DELETED
@@ -1,19 +0,0 @@
1
- #!/usr/bin/env ruby
2
- require 'fileutils'
3
-
4
- # path to your application root.
5
- APP_ROOT = File.expand_path('..', __dir__)
6
-
7
- def system!(*args)
8
- system(*args) || abort("\n== Command #{args} failed ==")
9
- end
10
-
11
- FileUtils.chdir APP_ROOT do
12
- # This script is a way to setup or update your development environment automatically.
13
- # This script is idempotent, so that you can run it at anytime and get an expectable outcome.
14
- # Add necessary setup steps to this file.
15
-
16
- puts '== Installing dependencies =='
17
- system! 'gem install bundler --conservative'
18
- system('bundle check') || system!('bundle install')
19
- end
@@ -1,11 +0,0 @@
1
- # frozen_string_literal: true
2
-
3
- require 'bundler/setup'
4
- require 'pathname'
5
- require 'require_all'
6
-
7
- APP_ROOT = Pathname.new(__dir__).parent
8
- $LOAD_PATH.unshift(File.join(APP_ROOT, '/lib')) unless $LOAD_PATH.include?(File.join(APP_ROOT, '/lib'))
9
-
10
- require './version'
11
- require_all './lib'
@@ -1,29 +0,0 @@
1
- # frozen_string_literal: true
2
-
3
- require_relative 'version'
4
-
5
- Gem::Specification.new do |spec|
6
- spec.name = 'log-analyser'
7
- spec.version = VERSION
8
- spec.authors = ['Dan Mazzei']
9
- spec.email = ['danielmazzei@gmail.com']
10
-
11
- spec.summary = 'Log reader and data aggregator for pageviews information.'
12
- spec.description = 'Log reader and data aggregator for pageviews information.'
13
- spec.homepage = 'https://github.com/DMazzei/log-analyser'
14
- spec.license = 'MIT'
15
- spec.required_ruby_version = Gem::Requirement.new('>= 2.7')
16
-
17
- # spec.metadata['allowed_push_host'] = "'TODO: Set to 'http://mygemserver.com''"
18
-
19
- spec.metadata['homepage_uri'] = spec.homepage
20
- # spec.metadata['source_code_uri'] = "'TODO: Put your gem's public repo URL here.'"
21
- # spec.metadata['changelog_uri'] = "'TODO: Put your gem's CHANGELOG.md URL here.'"
22
-
23
- # Specify which files should be added to the gem when it is released.
24
- # The `git ls-files -z` loads the files in the RubyGem that have been added into git.
25
- spec.files = %w(.ruby-version CHANGELOG Gemfile Guardfile LICENSE.txt README.md Rakefile bin/setup config/environment.rb lib/pageviews.rb lib/pageviews_log_aggregator.rb lib/parser.rb lib/unique_pageviews.rb log-analyser.gemspec version.rb)
26
- spec.bindir = 'exe'
27
- spec.executables = spec.files.grep(/^exe\//) { |f| File.basename(f) }
28
- spec.require_paths = ['lib']
29
- end
data/version.rb DELETED
@@ -1,3 +0,0 @@
1
- # frozen_string_literal: true
2
-
3
- VERSION = '0.1.2'