rsssf 0.0.1 → 0.2.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
-SHA1:
-  metadata.gz: 0e916c424ef3d9ebd62d5c2fb1e09122806c5765
-  data.tar.gz: 232f06dea9fd3f878e554b1d4a2029531468f842
+SHA256:
+  metadata.gz: 92c74803ad71cb9cac8376ef3e0e01890352fc0a0edb01208eab3a9c41f60767
+  data.tar.gz: 874bdc292143352c88e23b44ed23abb98312d4afd2fd2cc797d078bce1eef0ed
 SHA512:
-  metadata.gz: 898399cdcedd7890145278b17d6d7ab5d8f305160513def86152b69a345de5c19ddb4e2e770753c091216c203bf31a3bd2bd70ca33b0087a8d003292cdd97acf
-  data.tar.gz: 0b76813d36aee3c59a83c2dfce1d916ee4677da585d52464a531dc2563e5bf96d33b345afe766bb4af962c03f4abcfed0a5b8523e485c85c7e85e406fd9ab8c6
+  metadata.gz: 0cc04f3a78663d870ed8a4d5b77813a1601e49a67fe3ea9265972f8da5b43b88adde78d184bedc320edb29439d7abb6439e6b045181bedea48c6d6be037d1a86
+  data.tar.gz: e92c7acc956eacd756665e83baee9373cf2af422da5deddd51e91e1266d7498e005a8d0b2e88868a23b3929c7b1900ef5bf20c7bd02e260bd07152e3e53d850a

data/{HISTORY.md → CHANGELOG.md}

@@ -1,3 +1,5 @@
+### 0.2.0
+
 ### 0.0.1 / 2015-09-15
 
 * Everything is new. First release

data/Manifest.txt

@@ -1,6 +1,14 @@
-HISTORY.md
+CHANGELOG.md
 Manifest.txt
 README.md
 Rakefile
 lib/rsssf.rb
+lib/rsssf/convert.rb
+lib/rsssf/download.rb
+lib/rsssf/page.rb
+lib/rsssf/repo.rb
+lib/rsssf/reports/page.rb
+lib/rsssf/reports/schedule.rb
+lib/rsssf/schedule.rb
+lib/rsssf/utils.rb
 lib/rsssf/version.rb

data/README.md

@@ -1,24 +1,210 @@
 # rsssf - tools 'n' scripts for RSSSF (Rec.Sport.Soccer Statistics Foundation) archive data
 
 
-* home  :: [github.com/sportdb/rsssf](https://github.com/sportdb/mrhyde)
-* bugs  :: [github.com/sportdb/rsssf/issues](https://github.com/sportdb/rsssf/issues)
+* home  :: [github.com/sportdb/sport.db.sources](https://github.com/sportdb/sport.db.sources)
+* bugs  :: [github.com/sportdb/sport.db.sources/issues](https://github.com/sportdb/sport.db.sources/issues)
 * gem   :: [rubygems.org/gems/rsssf](https://rubygems.org/gems/rsssf)
 * rdoc  :: [rubydoc.info/gems/rsssf](http://rubydoc.info/gems/rsssf)
-* forum :: [opensport](http://groups.google.com/group/opensport)
+
+
+
+
+## What's the Rec.Sport.Soccer Statistics Foundation (RSSSF)?
+
+The RSSSF collects and offers football (soccer) league tables, match results and more
+from all over the world online in plain text. Example:
+
+```
+Round 1
+[May 25]
+Vasco da Gama   1-0 Portuguesa
+ [Carlos Tenório 47']
+Vitória         2-2 Internacional
+ [Maxi Biancucchi 2', Gabriel Paulista 11'; Diego Forlán 29', Fred 63']
+Corinthians     1-1 Botafogo
+ [Paulinho 73'; Rafael Marques 24']
+[May 26]
+Grêmio          2-0 Náutico         [played in Caxias do Sul-RS]
+ [Zé Roberto 15', Elano 70']
+Ponte Preta     0-2 São Paulo
+ [Lúcio 9', Jádson 44'p]
+Criciúma        3-1 Bahia
+ [Matheus Ferraz 45'+1', Lins 46', João Vítor 82'; Diones 72']
+Santos          0-0 Flamengo        [played in Brasília-DF]
+Fluminense      2-1 Atlético/PR     [played in Macaé-RJ]
+ [Rafael Sóbis 15'p, Samuel 53'; Manoel 28']
+Cruzeiro        5-0 Goiás
+ [Diego Souza 5', Bruno Rodrigo 30', Nílton 40',79', Borges 42']
+Coritiba        2-1 Atlético/MG
+ [Deivid 53', Arthur 90'+1'; Diego Tardelli 51']
+```
+
+[Find out more about the Rec.Sport.Soccer Statistics Foundation (RSSSF) »](http://www.rsssf.com)
+
 
 
 ## Usage
 
-To be done
+
+### Download (and Cache ) Pages
+
+To download (and cache) pages from the world wide web use:
+
+``` ruby
+Rsssf.download_page( 'https://rsssf.org/tablese/eng2024.html',
+                      encoding: 'Windows-1252' )
+
+Rsssf.download_page( 'https://rsssf.org/tablesb/braz2024.html',
+                      encoding: 'Windows-1252' )
+```
+
+Note:  Most pages on rsssf.org use the Windows-1252 (character) encoding.
+To "auto-magically" convert to unicode (utf-8) 
+add the encoding option (default is `UTF-8`). 
+
+Or as a convenience shortcut download (pre-configured table) pages by country code (e.g `eng` - England, `es` - Spain (España), `de` - Germany (Deutschland), `br` - Brazil (Brasil) etc.)
+and season (e.g. `2023/24` or `2024` etc.)
+
+``` ruby
+Rsssf.download_table( 'eng', season: '2023/24' )
+
+Rsssf.download_table( 'br', season: '2024' )
+```
+
+
+Note: The rsssf machinery uses a built-in web cache.  All downloads get "auto-magically" cached (in `./cache/rsssf.org`).
+
+
+
+### Working with Pages
+
+
+Note: The `RsssfPage` machinery will convert the rsssf archive page
+from hypertext (HTML) to plain text e.g.
+
+```
+<hr>
+<a href="#premier">Premier League</A><br>
+<a href="#cups">Cup Tournaments</A><br>
+<a href="#champ">Championship</A><br>
+<a href="#first">Division 1</A><br>
+<a href="#second">Division 2</A><br>
+<a href="#conf">Conference</A>
+<hr>
+<h4><a name="premier">Premier League</A></h4>
+<pre>
+Final Table:
+
+ 1.Chelsea                 38  26  9  3  73-32  87  Champions
+ 2.Manchester City         38  24  7  7  83-38  79
+ 3.Arsenal                 38  22  9  7  71-36  75
+...
+```
+
+will become
+
+```
+=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
+‹Premier League›
+‹Cup Tournaments›
+‹Championship›
+‹Division 1›
+‹Division 2›
+‹Conference›
+=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
+
+#### Premier League
+
+
+Final Table:
+
+ 1.Chelsea                 38  26  9  3  73-32  87  Champions
+ 2.Manchester City         38  24  7  7  83-38  79
+ 3.Arsenal                 38  22  9  7  71-36  75
+...
+```
+
+
+### Working with Repos
+
+To fetch pages from the world wide web for many seasons in batch setup and use a repo.
+
+Step 1: List all archive pages
+
+In the `tables/config.yml` list all archive pages to fetch. Example:
+
+``` yaml
+2010-11: tablese/eng2011.html
+2011-12: tablese/eng2012.html
+2012-13: tablese/eng2013.html
+2013-14: tablese/eng2014.html
+2014-15: tablese/eng2015.html
+```
+
+Step 2: Fetch all archive pages
+
+Use:
+
+``` ruby
+repo = RsssfRepo.new( './england', title: 'England (and Wales)' )
+repo.fetch_pages
+```
+
+Bonus: To create a summary of all pages fetched (e.g. authors, last_updated, sections, etc.).
+Use:
+
+``` ruby
+repo.make_pages_report
+```
+
+Example - `tables/README.md`:
+
+
+football.db RSSSF Archive Data Summary for England (and Wales)
+
+_Last Update: 2015-11-26 18:22:22 +0200_
+
+| Season  | File   | Authors  | Last Updated | Lines (Chars) | Sections |
+| :------ | :------ | :------- | :----------- | ------------: | :------- |
+| 2014-15 | [eng2015.txt](https://github.com/rsssf/eng-england/blob/master/tables/eng2015.txt) | Ian King and Karel Stokkermans | 4 Jun 2015 | 1249 (34138) | Premier League, Cup Tournaments, Championship, Division 1, Division 2, Conference |
+| 2013-14 | [eng2014.txt](https://github.com/rsssf/eng-england/blob/master/tables/eng2014.txt) | Ian King and Karel Stokkermans | 5 Feb 2015 | 1254 (34294) | Premier League, Cup Tournaments, Championship, Division 1, Division 2, Conference |
+| 2012-13 | [eng2013.txt](https://github.com/rsssf/eng-england/blob/master/tables/eng2013.txt) | Karel Stokkermans | 5 Feb 2015 | 1269 (34531) | Premiership, Cup Tournaments, Championship, Division 1, Division 2, Conference |
+| 2011-12 | [eng2012.txt](https://github.com/rsssf/eng-england/blob/master/tables/eng2012.txt) | Karel Stokkermans | 5 Feb 2015 | 691 (21925) | Premiership, Cup Tournaments, Championship, Division 1, Division 2, Conference |
+| 2010-11 | [eng2011.txt](https://github.com/rsssf/eng-england/blob/master/tables/eng2011.txt) | Ian King, Karel Stokkermans and Jan Schoenmakers | 5 Feb 2015 | 959 (37393) | Premiership, Cup Tournaments, Championship, Division 1, Division 2, Conference |
+
+
+That's it.
+
+
+### Preparing Archive Pages for SQL Database Imports (e.g. football.db)
+
+To import match schedules (fixtures and results) and more using the football.db machinery
+prepare "simple" single league (or cup) pages with standings tables etc. stripped out.
+For example, to break-out the Premier League and FA Cup from the `eng2015.txt`
+archive page use:
+
+``` ruby
+page = RsssfPage.from_url( 'http://www.rsssf.com/tablese/eng2015.html')
+
+schedule = page.find_schedule( header: 'Premier League')   ## returns RsssfSchedule obj
+schedule.save( './1-premierleague.txt' )
+
+schedule = page.find_schedule( header: 'FA Cup', cup: true )
+schedule.save( './facup.txt' )
+```
 
 
 
-## Install
+## RSSSF Datasets
 
-Just install the gem:
+See the rsssf github org for pre-processed ready-to-import datasets. Prepared repos include:
 
-    $ gem install rsssf
+- [`england`](https://github.com/rsssf/england)    - rsssf archive data for England - Premier League, Championship, FA Cup etc.
+- [`deutschland`](https://github.com/rsssf/deutschland) - rsssf archive data for Germany (Deutschland) - Deutsche Bundesliga, 2. Bundesliga, 3. Liga, DFB Pokal etc.
+- [`espana`](https://github.com/rsssf/espana)      - rsssf archive data for España (Spain) - Primera División / La Liga, Copa de Rey, etc.
+- [`austria`](https://github.com/rsssf/austria)     - rsssf archive data for Austria (Österreich) - Österr. Bundesliga, Erste Liga, ÖFB Pokal etc.
+- [`brazil`](https://github.com/rsssf/brazil)      - rsssf archive data for Brazil (Brasil) - Campeonato Brasileiro Série A / Brasileirão etc.
+- and more
 
 
 ## License

data/Rakefile

@@ -8,25 +8,26 @@ Hoe.spec 'rsssf' do
   self.summary = "rsssf - tools 'n' scripts for RSSSF (Rec.Sport.Soccer Statistics Foundation) archive data"
   self.description = summary
 
-  self.urls    = ['https://github.com/sportdb/rsssf']
+  self.urls    = { home: 'https://github.com/sportdb/sport.db.sources' }
 
   self.author  = 'Gerald Bauer'
-  self.email   = 'opensport@googlegroups.com'
+  self.email   = 'gerald.bauer@gmail.com'
 
   # switch extension to .markdown for gihub formatting
   self.readme_file  = 'README.md'
-  self.history_file = 'HISTORY.md'
+  self.history_file = 'CHANGELOG.md'
 
   self.extra_deps = [
-    ['logutils'],
-    ['textutils'],
-    ['fetcher'],
+    ['cocos'],
+    ['season-formats'],
+    ['rsssf-parser'],   ## add rsssf parser machinery & tool
   ]
 
+
   self.licenses = ['Public Domain']
 
   self.spec_extras = {
-    required_ruby_version: '>= 1.9.2'
+    required_ruby_version: '>= 2.2.2'
   }
 
 end