csvutils 0.2.2 → 0.3.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (36) hide show
  1. checksums.yaml +4 -4
  2. data/HISTORY.md +3 -3
  3. data/LICENSE.md +116 -0
  4. data/Manifest.txt +8 -4
  5. data/README.md +302 -286
  6. data/Rakefile +30 -26
  7. data/bin/csvcut +17 -17
  8. data/bin/csvhead +17 -17
  9. data/bin/csvheader +17 -17
  10. data/bin/csvsplit +17 -17
  11. data/bin/csvstat +17 -17
  12. data/{test/data → datasets}/at-austria/AUT.csv +363 -363
  13. data/{test/data → datasets}/de-deutschland/bundesliga.csv +481 -481
  14. data/{test/data → datasets}/eng-england/2017-18/E0.csv +381 -381
  15. data/lib/csvutils.rb +32 -31
  16. data/lib/csvutils/commands/cut.rb +43 -43
  17. data/lib/csvutils/commands/head.rb +40 -40
  18. data/lib/csvutils/commands/header.rb +35 -35
  19. data/lib/csvutils/commands/split.rb +41 -41
  20. data/lib/csvutils/commands/stat.rb +41 -41
  21. data/lib/csvutils/cut.rb +43 -50
  22. data/lib/csvutils/head.rb +22 -25
  23. data/lib/csvutils/header.rb +16 -28
  24. data/lib/csvutils/split.rb +106 -107
  25. data/lib/csvutils/stat.rb +81 -86
  26. data/lib/csvutils/test.rb +19 -22
  27. data/lib/csvutils/utils.rb +29 -13
  28. data/lib/csvutils/version.rb +24 -24
  29. data/test/helper.rb +16 -16
  30. data/test/test_cut.rb +31 -0
  31. data/test/test_head.rb +30 -0
  32. data/test/{test_headers.rb → test_header.rb} +50 -50
  33. data/test/test_misc.rb +44 -44
  34. data/test/test_split.rb +31 -0
  35. data/test/test_version.rb +20 -20
  36. metadata +28 -9
checksums.yaml CHANGED
@@ -1,7 +1,7 @@
1
1
  ---
2
2
  SHA1:
3
- metadata.gz: c639c6a13e149e81b5255262884abd02fae3c22e
4
- data.tar.gz: 73bec69652d262ebf616c00e8351f8788b0d022a
3
+ metadata.gz: 0be624b7103c77a6542c61522d097a807e207204
4
+ data.tar.gz: 4d6dffcadc2d6906e59eb009085a4b0cf822b81d
5
5
  SHA512:
6
- metadata.gz: 45d8ba36d58577f3362cea9ead2ff9b952992f5038cb453dad6d666948a498269b60ef2c7d15b1c260b291a69c047ab3616ba62d93c92ac6af61cd5e8ae703fc
7
- data.tar.gz: 56ebd4f88a54411e97312a832de6d2d830e1af15e287923535dd51edd4ac11c09ff525a7a27363d9c4255defbae7dc6040f6bb2202439fc06d4bf15adfe01b54
6
+ metadata.gz: 839586401ebf58210d448cfe42f1d3959abbc640f93540e7127dad6fd04666c6cd3f31f07b4cf659000c2e5deda0db32fdbdf2d59d55beb87533ad24f275e193
7
+ data.tar.gz: 69219118ab9871d44797078da35ef5c060b50399334ea00c219471658ce07045f55ab76213ab6743e358e04e1f0be2c4fcf3036274665bc870ee4067530c9cb5
data/HISTORY.md CHANGED
@@ -1,3 +1,3 @@
1
- ### 0.0.1 / 2018-08-04
2
-
3
- * Everything is new. First release.
1
+ ### 0.0.1 / 2018-08-04
2
+
3
+ * Everything is new. First release.
data/LICENSE.md ADDED
@@ -0,0 +1,116 @@
1
+ CC0 1.0 Universal
2
+
3
+ Statement of Purpose
4
+
5
+ The laws of most jurisdictions throughout the world automatically confer
6
+ exclusive Copyright and Related Rights (defined below) upon the creator and
7
+ subsequent owner(s) (each and all, an "owner") of an original work of
8
+ authorship and/or a database (each, a "Work").
9
+
10
+ Certain owners wish to permanently relinquish those rights to a Work for the
11
+ purpose of contributing to a commons of creative, cultural and scientific
12
+ works ("Commons") that the public can reliably and without fear of later
13
+ claims of infringement build upon, modify, incorporate in other works, reuse
14
+ and redistribute as freely as possible in any form whatsoever and for any
15
+ purposes, including without limitation commercial purposes. These owners may
16
+ contribute to the Commons to promote the ideal of a free culture and the
17
+ further production of creative, cultural and scientific works, or to gain
18
+ reputation or greater distribution for their Work in part through the use and
19
+ efforts of others.
20
+
21
+ For these and/or other purposes and motivations, and without any expectation
22
+ of additional consideration or compensation, the person associating CC0 with a
23
+ Work (the "Affirmer"), to the extent that he or she is an owner of Copyright
24
+ and Related Rights in the Work, voluntarily elects to apply CC0 to the Work
25
+ and publicly distribute the Work under its terms, with knowledge of his or her
26
+ Copyright and Related Rights in the Work and the meaning and intended legal
27
+ effect of CC0 on those rights.
28
+
29
+ 1. Copyright and Related Rights. A Work made available under CC0 may be
30
+ protected by copyright and related or neighboring rights ("Copyright and
31
+ Related Rights"). Copyright and Related Rights include, but are not limited
32
+ to, the following:
33
+
34
+ i. the right to reproduce, adapt, distribute, perform, display, communicate,
35
+ and translate a Work;
36
+
37
+ ii. moral rights retained by the original author(s) and/or performer(s);
38
+
39
+ iii. publicity and privacy rights pertaining to a person's image or likeness
40
+ depicted in a Work;
41
+
42
+ iv. rights protecting against unfair competition in regards to a Work,
43
+ subject to the limitations in paragraph 4(a), below;
44
+
45
+ v. rights protecting the extraction, dissemination, use and reuse of data in
46
+ a Work;
47
+
48
+ vi. database rights (such as those arising under Directive 96/9/EC of the
49
+ European Parliament and of the Council of 11 March 1996 on the legal
50
+ protection of databases, and under any national implementation thereof,
51
+ including any amended or successor version of such directive); and
52
+
53
+ vii. other similar, equivalent or corresponding rights throughout the world
54
+ based on applicable law or treaty, and any national implementations thereof.
55
+
56
+ 2. Waiver. To the greatest extent permitted by, but not in contravention of,
57
+ applicable law, Affirmer hereby overtly, fully, permanently, irrevocably and
58
+ unconditionally waives, abandons, and surrenders all of Affirmer's Copyright
59
+ and Related Rights and associated claims and causes of action, whether now
60
+ known or unknown (including existing as well as future claims and causes of
61
+ action), in the Work (i) in all territories worldwide, (ii) for the maximum
62
+ duration provided by applicable law or treaty (including future time
63
+ extensions), (iii) in any current or future medium and for any number of
64
+ copies, and (iv) for any purpose whatsoever, including without limitation
65
+ commercial, advertising or promotional purposes (the "Waiver"). Affirmer makes
66
+ the Waiver for the benefit of each member of the public at large and to the
67
+ detriment of Affirmer's heirs and successors, fully intending that such Waiver
68
+ shall not be subject to revocation, rescission, cancellation, termination, or
69
+ any other legal or equitable action to disrupt the quiet enjoyment of the Work
70
+ by the public as contemplated by Affirmer's express Statement of Purpose.
71
+
72
+ 3. Public License Fallback. Should any part of the Waiver for any reason be
73
+ judged legally invalid or ineffective under applicable law, then the Waiver
74
+ shall be preserved to the maximum extent permitted taking into account
75
+ Affirmer's express Statement of Purpose. In addition, to the extent the Waiver
76
+ is so judged Affirmer hereby grants to each affected person a royalty-free,
77
+ non transferable, non sublicensable, non exclusive, irrevocable and
78
+ unconditional license to exercise Affirmer's Copyright and Related Rights in
79
+ the Work (i) in all territories worldwide, (ii) for the maximum duration
80
+ provided by applicable law or treaty (including future time extensions), (iii)
81
+ in any current or future medium and for any number of copies, and (iv) for any
82
+ purpose whatsoever, including without limitation commercial, advertising or
83
+ promotional purposes (the "License"). The License shall be deemed effective as
84
+ of the date CC0 was applied by Affirmer to the Work. Should any part of the
85
+ License for any reason be judged legally invalid or ineffective under
86
+ applicable law, such partial invalidity or ineffectiveness shall not
87
+ invalidate the remainder of the License, and in such case Affirmer hereby
88
+ affirms that he or she will not (i) exercise any of his or her remaining
89
+ Copyright and Related Rights in the Work or (ii) assert any associated claims
90
+ and causes of action with respect to the Work, in either case contrary to
91
+ Affirmer's express Statement of Purpose.
92
+
93
+ 4. Limitations and Disclaimers.
94
+
95
+ a. No trademark or patent rights held by Affirmer are waived, abandoned,
96
+ surrendered, licensed or otherwise affected by this document.
97
+
98
+ b. Affirmer offers the Work as-is and makes no representations or warranties
99
+ of any kind concerning the Work, express, implied, statutory or otherwise,
100
+ including without limitation warranties of title, merchantability, fitness
101
+ for a particular purpose, non infringement, or the absence of latent or
102
+ other defects, accuracy, or the present or absence of errors, whether or not
103
+ discoverable, all to the greatest extent permissible under applicable law.
104
+
105
+ c. Affirmer disclaims responsibility for clearing rights of other persons
106
+ that may apply to the Work or any use thereof, including without limitation
107
+ any person's Copyright and Related Rights in the Work. Further, Affirmer
108
+ disclaims responsibility for obtaining any necessary consents, permissions
109
+ or other rights required for any use of the Work.
110
+
111
+ d. Affirmer understands and acknowledges that Creative Commons is not a
112
+ party to this document and has no duty or obligation with respect to this
113
+ CC0 or use of the Work.
114
+
115
+ For more information, please see
116
+ <http://creativecommons.org/publicdomain/zero/1.0/>
data/Manifest.txt CHANGED
@@ -1,4 +1,5 @@
1
1
  HISTORY.md
2
+ LICENSE.md
2
3
  Manifest.txt
3
4
  README.md
4
5
  Rakefile
@@ -7,6 +8,9 @@ bin/csvhead
7
8
  bin/csvheader
8
9
  bin/csvsplit
9
10
  bin/csvstat
11
+ datasets/at-austria/AUT.csv
12
+ datasets/de-deutschland/bundesliga.csv
13
+ datasets/eng-england/2017-18/E0.csv
10
14
  lib/csvutils.rb
11
15
  lib/csvutils/commands/cut.rb
12
16
  lib/csvutils/commands/head.rb
@@ -21,10 +25,10 @@ lib/csvutils/stat.rb
21
25
  lib/csvutils/test.rb
22
26
  lib/csvutils/utils.rb
23
27
  lib/csvutils/version.rb
24
- test/data/at-austria/AUT.csv
25
- test/data/de-deutschland/bundesliga.csv
26
- test/data/eng-england/2017-18/E0.csv
27
28
  test/helper.rb
28
- test/test_headers.rb
29
+ test/test_cut.rb
30
+ test/test_head.rb
31
+ test/test_header.rb
29
32
  test/test_misc.rb
33
+ test/test_split.rb
30
34
  test/test_version.rb
data/README.md CHANGED
@@ -1,286 +1,302 @@
1
- # csvutils - tools 'n' scripts for working with comma-separated values (csv) datafiles - the world's most popular tabular date interchange format in text
2
-
3
-
4
- * home :: [github.com/csv11/csvutils](https://github.com/csv11/csvutils)
5
- * bugs :: [github.com/csv11/csvutils/issues](https://github.com/csv11/csvutils/issues)
6
- * gem :: [rubygems.org/gems/csvutils](https://rubygems.org/gems/csvutils)
7
- * rdoc :: [rubydoc.info/gems/csvutils](http://rubydoc.info/gems/csvutils)
8
- * forum :: [wwwmake](http://groups.google.com/group/wwwmake)
9
-
10
-
11
-
12
- ## Usage
13
-
14
- ### Command Line Tools
15
-
16
- `csvhead` • `csvheader` • `csvstat` • `csvsplit` • `csvcut`
17
-
18
-
19
- Try:
20
-
21
- ```
22
- $ csvhead -h # or
23
- $ csvhead --help
24
- ```
25
-
26
- resulting in:
27
-
28
- ```
29
- Usage: csvhead [OPTS] datafile ...
30
- -n, --num=NUM Number of rows
31
- -h, --help Prints this help
32
- ```
33
-
34
- and so on. Now try with `csvheader -h`, `csvstat -h`, `csvsplit -h`,
35
- `csvcut -h` and so on.
36
-
37
-
38
-
39
- #### Working with Comma-Separated Values (CSV) Datafile Examples
40
-
41
- Let's use a sample datafile e.g. `E0.csv` from the [football.csv project]() with
42
- matches from the English Premier League. Try
43
-
44
- ```
45
- $ csvhead E0.csv
46
- ```
47
- to pretty print (pp) the first four row (use the `-n` option for more or less rows).
48
- Resulting in:
49
-
50
- ```
51
- == E0.csv (.) ==
52
-
53
- #<CSV::Row "Date":nil "HomeTeam":"Arsenal" "AwayTeam":"Leicester" "FTHG":"4" "FTAG":"3" "HTHG":"2" "HTAG":"2">
54
- #<CSV::Row "Date":nil "HomeTeam":"Brighton" "AwayTeam":"Man City" "FTHG":"0" "FTAG":"2" "HTHG":"?" "HTAG":"?">
55
- #<CSV::Row "Date":"12/08/17" "HomeTeam":"Chelsea" "AwayTeam":"Burnley" "FTHG":"2" "FTAG":"3" "HTHG":"?" "HTAG":"?">
56
- #<CSV::Row "Date":"-" "HomeTeam":"Crystal Palace" "AwayTeam":"Huddersfield" "FTHG":"0" "FTAG":"3" "HTHG":"0" "HTAG":"2">
57
-
58
- 4 rows
59
- ```
60
-
61
- Next try
62
-
63
- ```
64
- $ csvheader E0.csv
65
- ```
66
-
67
- to print all header columns (the first row). Resulting in:
68
-
69
- ```
70
- == E0.csv (.) ==
71
-
72
- 7 columns:
73
- 1: Date
74
- 2: HomeTeam
75
- 3: AwayTeam
76
- 4: FTHG
77
- 5: FTAG
78
- 6: HTHG
79
- 7: HTAG
80
- ```
81
-
82
- Next try:
83
-
84
- ```
85
- $ csvstat -c HomeTeam,AwayTeam E0.csv
86
- ```
87
-
88
- to show all unique values for the columns `HomeTeam` and `AwayTeam`.
89
- Resulting in:
90
-
91
- ```
92
- == E0.csv (.) ==
93
-
94
- ... 380 rows
95
-
96
- 7 columns:
97
- 1: Date
98
- 2: HomeTeam
99
- 3: AwayTeam
100
- 4: FTHG
101
- 5: FTAG
102
- 6: HTHG
103
- 7: HTAG
104
-
105
- column >HomeTeam< 21 unique values:
106
- 1 x <nil>
107
- 19 x Arsenal
108
- 18 x Bournemouth
109
- 19 x Brighton
110
- 19 x Burnley
111
- 19 x Chelsea
112
- 19 x Crystal Palace
113
- 19 x Everton
114
- 19 x Huddersfield
115
- 19 x Leicester
116
- 19 x Liverpool
117
- 19 x Man City
118
- 19 x Man United
119
- 19 x Newcastle
120
- 19 x Southampton
121
- 19 x Stoke
122
- 19 x Swansea
123
- 19 x Tottenham
124
- 19 x Watford
125
- 19 x West Brom
126
- 19 x West Ham
127
- column >AwayTeam< 21 unique values:
128
- 1 x ?
129
- 19 x Arsenal
130
- 19 x Bournemouth
131
- 19 x Brighton
132
- 19 x Burnley
133
- 19 x Chelsea
134
- 19 x Crystal Palace
135
- 19 x Everton
136
- 19 x Huddersfield
137
- 19 x Leicester
138
- 19 x Liverpool
139
- 19 x Man City
140
- 19 x Man United
141
- 19 x Newcastle
142
- 19 x Southampton
143
- 19 x Stoke
144
- 19 x Swansea
145
- 19 x Tottenham
146
- 18 x Watford
147
- 19 x West Brom
148
- 19 x West Ham
149
- ```
150
-
151
-
152
- #### Split & Cut - Split One Datafile into Many or Cut / Reorder Columns
153
-
154
- Let's use another sample datafile e.g. `AUT.csv` that holds many seasons
155
- from the Austrian (AUT) Bundesliga. First lets see how many seasons:
156
-
157
- ```
158
- $ csvstat -c Season AUT.csv
159
- ```
160
-
161
- Resulting in:
162
-
163
- ```
164
- == AUT.csv (.) ==
165
-
166
- ... 362 rows
167
-
168
- 7 columns:
169
- 1: Season
170
- 2: Date
171
- 3: Time
172
- 4: Home
173
- 5: Away
174
- 6: HG
175
- 7: AG
176
-
177
- column >Season< 2 unique values:
178
- 180 x 2016/2017
179
- 182 x 2017/2018
180
- ```
181
-
182
- Now let's split the `AUT.csv` datafile by the `Season` column
183
- resulting in two new datafiles named `AUT_2016-2017.csv`
184
- and `ÀUT_2017-2018.csv`. Try:
185
-
186
- ```
187
- $ csvsplit -c Season AUT.csv
188
- ```
189
-
190
- Resulting in:
191
-
192
- ```
193
- new chunk: ["2016/2017"]
194
- saving >AUT_2016-2017.csv<...
195
- new chunk: ["2017/2018"]
196
- saving >AUT_2017-2018.csv<...
197
- ```
198
-
199
- Let's cut out (remove) the `Season` and `Time` column from the new `AUT_2016-2017.csv`
200
- datafile. Try:
201
-
202
- ```
203
- $ csvcut -c Date,Home,Away,HG,AG AUT_2016-2017.csv
204
- ```
205
-
206
- Double check the overwritten cleaned-up datafile:
207
-
208
- ```
209
- $ csvhead AUT_2016-2017.csv
210
- ```
211
-
212
- resulting in:
213
-
214
- ```
215
-
216
- ```
217
-
218
- And so on and so forth.
219
-
220
-
221
-
222
-
223
- ### Code, Code, Code - Script Your Data Work Flow with Ruby
224
-
225
- You can use all tools in your script using the `CsvUtils`
226
- class methods:
227
-
228
- | Shell | Ruby |
229
- |-------------|-----------------------------------|
230
- | `csvhead` | `CsvUtils.head( path, n: 4 )` |
231
- | `csvheader` | `CsvUtils.header( path )` |
232
- | `csvstat` | `CsvUtils.stat( path, *columns )` |
233
- | `csvsplit` | `CsvUtils.split( path, *columns )` |
234
- | `csvcut` | `CsvUtils.cut( path, *columns, output: path)` |
235
-
236
-
237
-
238
- Let's retry the sample above in a script:
239
-
240
-
241
- ``` ruby
242
- require 'csvutils'
243
-
244
-
245
- CsvUtils.head( 'E0.csv' )
246
- # same as
247
- # $ csvhead E0.csv
248
-
249
- CsvUtils.header( 'E0.csv' )
250
- # => see above :-)
251
-
252
- CsvUtils.stat( 'E0.csv', 'HomeTeam', 'AwayTeam' )
253
- # same as:
254
- # $ csvstat -c HomeTeam,AwayTeam E0.csv
255
-
256
-
257
- CsvUtils.stat( 'AUT.csv', 'Season' )
258
- # => same as
259
- # $ csvstat -c Season AUT.csv
260
-
261
-
262
- CsvUtils.split( 'AUT.csv', 'Season' )
263
- # => see above :-)
264
-
265
- CsvUtils.cut( 'AUT_2016-2017.csv', 'AUT_2016-2017.csv', 'Date', 'Home', 'Away', 'HG', 'AG' )
266
- # => see above :-)
267
-
268
-
269
- ```
270
-
271
-
272
- That's it.
273
-
274
-
275
- ## License
276
-
277
-
278
- ![](https://publicdomainworks.github.io/buttons/zero88x31.png)
279
-
280
- The `csvutils` scripts are dedicated to the public domain.
281
- Use it as you please with no restrictions whatsoever.
282
-
283
- ## Questions? Comments?
284
-
285
- Send them along to the [wwwmake forum](http://groups.google.com/group/wwwmake).
286
- Thanks!
1
+ # csvutils - tools 'n' scripts for working with comma-separated values (csv) datafiles - the world's most popular tabular data interchange format in text
2
+
3
+
4
+ * home :: [github.com/csvreader/csvutils](https://github.com/csvreader/csvutils)
5
+ * bugs :: [github.com/csvreader/csvutils/issues](https://github.com/csvreader/csvutils/issues)
6
+ * gem :: [rubygems.org/gems/csvutils](https://rubygems.org/gems/csvutils)
7
+ * rdoc :: [rubydoc.info/gems/csvutils](http://rubydoc.info/gems/csvutils)
8
+ * forum :: [wwwmake](http://groups.google.com/group/wwwmake)
9
+
10
+
11
+
12
+ ## Usage
13
+
14
+ ### Command Line Tools
15
+
16
+ `csvhead` • `csvheader` • `csvstat` • `csvsplit` • `csvcut`
17
+
18
+
19
+ Try the help option `-h/--help` with the command line tools. Example:
20
+
21
+ ```
22
+ $ csvhead -h # or
23
+ $ csvhead --help
24
+ ```
25
+
26
+ resulting in:
27
+
28
+ ```
29
+ Usage: csvhead [OPTS] datafile ...
30
+ -n, --num=NUM Number of rows
31
+ -h, --help Prints this help
32
+ ```
33
+
34
+ Now try it with `csvheader -h`, `csvstat -h`, `csvsplit -h`,
35
+ `csvcut -h` and so on.
36
+
37
+
38
+
39
+ #### Working with Comma-Separated Values (CSV) Datafile Examples
40
+
41
+ Let's use a sample datafile e.g. [`ENG.csv`](getting-started-samples/ENG.csv) from the
42
+ [football.csv project](https://github.com/footballcsv) with
43
+ matches from the English Premier League. Try
44
+
45
+
46
+ ```
47
+ $ csvhead ENG.csv
48
+ ```
49
+ to pretty print (pp) the first four rows (use the `-n/--num` option for more or less rows).
50
+ Resulting in:
51
+
52
+ ```
53
+ == ENG.csv ==
54
+
55
+ <Date:11/08/17, Team1:Arsenal, Team2:Leicester, FT1:4, FT2:3>
56
+ <Date:12/08/17, Team1:Brighton, Team2:Man City, FT1:0, FT2:2>
57
+ <Date:12/08/17, Team1:Chelsea, Team2:Burnley, FT1:2, FT2:3>
58
+ <Date:12/08/17, Team1:Crystal Palace, Team2:Huddersfield, FT1:0, FT2:3>
59
+ 4 rows
60
+ ```
61
+
62
+ Next try
63
+
64
+ ```
65
+ $ csvheader ENG.csv
66
+ ```
67
+
68
+ to print all header columns (the first row). Resulting in:
69
+
70
+ ```
71
+ == ENG.csv ==
72
+
73
+ 5 columns:
74
+ 1: Date
75
+ 2: Team1
76
+ 3: Team2
77
+ 4: FT1
78
+ 5: FT2
79
+ ```
80
+
81
+ Next try:
82
+
83
+ ```
84
+ $ csvstat -c Team1,Team2 ENG.csv
85
+ ```
86
+
87
+ to show all unique values for the columns `Team1` and `Team2`.
88
+ Resulting in:
89
+
90
+ ```
91
+ == ENG.csv ==
92
+
93
+ ... 380 rows
94
+
95
+ 5 columns:
96
+ 1: Date
97
+ 2: Team1
98
+ 3: Team2
99
+ 4: FT1
100
+ 5: FT2
101
+
102
+ column "Team1" - 20 unique values:
103
+ 19 x Arsenal
104
+ 19 x Bournemouth
105
+ 19 x Brighton
106
+ 19 x Burnley
107
+ 19 x Chelsea
108
+ 19 x Crystal Palace
109
+ 19 x Everton
110
+ 19 x Huddersfield
111
+ 19 x Leicester
112
+ 19 x Liverpool
113
+ 19 x Man City
114
+ 19 x Man United
115
+ 19 x Newcastle
116
+ 19 x Southampton
117
+ 19 x Stoke
118
+ 19 x Swansea
119
+ 19 x Tottenham
120
+ 19 x Watford
121
+ 19 x West Brom
122
+ 19 x West Ham
123
+ column "Team2" - 20 unique values:
124
+ 19 x Arsenal
125
+ 19 x Bournemouth
126
+ 19 x Brighton
127
+ 19 x Burnley
128
+ 19 x Chelsea
129
+ 19 x Crystal Palace
130
+ 19 x Everton
131
+ 19 x Huddersfield
132
+ 19 x Leicester
133
+ 19 x Liverpool
134
+ 19 x Man City
135
+ 19 x Man United
136
+ 19 x Newcastle
137
+ 19 x Southampton
138
+ 19 x Stoke
139
+ 19 x Swansea
140
+ 19 x Tottenham
141
+ 19 x Watford
142
+ 19 x West Brom
143
+ 19 x West Ham
144
+ ```
145
+
146
+
147
+ #### Split & Cut - Split One Datafile into Many or Cut / Reorder Columns
148
+
149
+ Let's use another sample datafile e.g. [`AUT.csv`](getting-started-samples/AUT.csv) that holds many seasons
150
+ from the Austrian (AUT) Bundesliga. First lets see how many seasons:
151
+
152
+ ```
153
+ $ csvstat -c Season AUT.csv
154
+ ```
155
+
156
+ Resulting in:
157
+
158
+ ```
159
+ == AUT.csv ==
160
+
161
+ ... 360 rows
162
+
163
+ 6 columns:
164
+ 1: Season
165
+ 2: Date
166
+ 3: Team1
167
+ 4: Team2
168
+ 5: FT1
169
+ 6: FT2
170
+
171
+ column "Season" - 2 unique values:
172
+ 180 x 2016/2017
173
+ 180 x 2017/2018
174
+ ```
175
+
176
+ Now let's split the `AUT.csv` datafile by the `Season` column
177
+ resulting in two new datafiles named `AUT_2016-2017.csv`
178
+ and `ÀUT_2017-2018.csv`. Try:
179
+
180
+ ```
181
+ $ csvsplit -c Season AUT.csv
182
+ ```
183
+
184
+ Resulting in:
185
+
186
+ ```
187
+ new chunk: ["2016/2017"] - saving "AUT_2016-2017.csv"...
188
+ new chunk: ["2017/2018"] - saving "AUT_2017-2018.csv"...
189
+ ```
190
+
191
+ Let's cut out (remove) the `Season` column from the new `AUT_2016-2017.csv`
192
+ datafile. Try:
193
+
194
+ ```
195
+ $ csvcut -c Date,Team1,Team2,FT1,FT2 AUT_2016-2017.csv
196
+ ```
197
+
198
+ Double check the overwritten in-place cleaned-up datafile:
199
+
200
+ ```
201
+ $ csvhead AUT_2016-2017.csv
202
+ ```
203
+
204
+ resulting in:
205
+
206
+ ```
207
+ == AUT_2016-2017.csv ==
208
+
209
+ <Date:23/07/16, Team1:Rapid Vienna, Team2:Ried, FT1:5, FT2:0>
210
+ <Date:23/07/16, Team1:Altach, Team2:AC Wolfsberger, FT1:1, FT2:0>
211
+ <Date:23/07/16, Team1:Sturm Graz, Team2:Salzburg, FT1:3, FT2:1>
212
+ <Date:24/07/16, Team1:St. Pölten, Team2:Austria Vienna, FT1:1, FT2:2>
213
+ 4 rows
214
+ ```
215
+
216
+ And so on and so forth.
217
+
218
+
219
+
220
+
221
+ ### Code, Code, Code - Script Your Data Work Flow with Ruby
222
+
223
+ You can use all tools in your script using the `CsvUtils`
224
+ class methods:
225
+
226
+ | Shell | Ruby |
227
+ |-------------|-----------------------------------|
228
+ | `csvhead` | [`CsvUtils.head( path, n: 4 )`](lib/csvutils/head.rb) |
229
+ | `csvheader` | [`CsvUtils.header( path )`](lib/csvutils/header.rb) |
230
+ | `csvstat` | [`CsvUtils.stat( path, *columns )`](lib/csvutils/stat.rb) |
231
+ | `csvsplit` | [`CsvUtils.split( path, *columns )`](lib/csvutils/split.rb) |
232
+ | `csvcut` | [`CsvUtils.cut( path, *columns, output: path)`](lib/csvutils/cut.rb) |
233
+
234
+
235
+
236
+ Let's retry the sample above in a script:
237
+
238
+
239
+ ``` ruby
240
+ require 'csvutils'
241
+
242
+
243
+ CsvUtils.head( 'ENG.csv' )
244
+ # same as:
245
+ # $ csvhead ENG.csv
246
+
247
+ CsvUtils.header( 'ENG.csv' )
248
+ # same as:
249
+ # $ csvheader ENG.csv
250
+
251
+ CsvUtils.stat( 'ENG.csv', 'Team1', 'Team2' )
252
+ # same as:
253
+ # $ csvstat -c Team1,Team2 ENG.csv
254
+
255
+
256
+ CsvUtils.stat( 'AUT.csv', 'Season' )
257
+ # same as:
258
+ # $ csvstat -c Season AUT.csv
259
+
260
+ CsvUtils.split( 'AUT.csv', 'Season' )
261
+ # same as:
262
+ # $ csvsplit -c Season AUT.csv
263
+
264
+ CsvUtils.cut( 'AUT_2016-2017.csv', 'Date', 'Team1', 'Team2', 'FT1', 'FT2' )
265
+ # same as:
266
+ # $ csvcut -c Date,Team1,Team2,FT1,FT2 AUT_2016-2017.csv
267
+ ```
268
+
269
+
270
+
271
+ That's it. See the [`/getting-started-samples`](/getting-started-samples)
272
+ folder to
273
+ run the samples on your own computer.
274
+
275
+
276
+
277
+ ## Install
278
+
279
+ Just install the gem:
280
+
281
+ ```
282
+ $ gem install csvutils
283
+ ```
284
+
285
+
286
+
287
+ ## Alternatives
288
+
289
+ See the Libraries & Tools section in the [Awesome CSV](https://github.com/csvspecs/awesome-csv#libraries--tools) page.
290
+
291
+
292
+ ## License
293
+
294
+ ![](https://publicdomainworks.github.io/buttons/zero88x31.png)
295
+
296
+ The `csvutils` scripts are dedicated to the public domain.
297
+ Use it as you please with no restrictions whatsoever.
298
+
299
+ ## Questions? Comments?
300
+
301
+ Send them along to the [wwwmake forum](http://groups.google.com/group/wwwmake).
302
+ Thanks!