smarter_csv 1.3.0 → 1.5.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 79279f7e51fa65451092db03404d4c2b32e6fdf15107c931d35b6c8db094f68a
-  data.tar.gz: 6f930523b5c6e1bdc3e7d8a78d49bcbcc244437bd4e51d44d104768a4b3bb1c8
+  metadata.gz: 23032eface2d1d918bcd6daabb4ca79e03096612bda1017d06f1b0542d0c4619
+  data.tar.gz: 12b68eeafc4f83c06b66da45b27da5e716675bff1e77be2362c2c10006821d9c
 SHA512:
-  metadata.gz: 93630aba89f0d6cbf7e311e3abbca51c5677edd3f653d978e98b54c2d251483dbf7951a5892dcaca7ca0d4d449eb5071fca35fac3f361bdf9bebfddbf7682673
-  data.tar.gz: 27164e53008600af9873c255bcde5f471ee41c3e6c808a1ed8087ab24a9008a5850dde3f57edac901a562cbb505c634132470827c55662ed7440612ce766f22b
+  metadata.gz: 5b84337de25ed7a8492088b82342e6d3b16d1fdc95120f9699986aee7d9416a51cfec981eb125e0d4b17600bc1c06c52eb3b2251857668210d9402e95bb75860
+  data.tar.gz: b26b40b49bf6d739df9cd5deb477c33fdc22c54ed88c96f87e401fef789aedf3f9c55d25df60e4900a1e2a3c8bc0fc6e78018b128ab6ac14062fd97f694f3568

data/.gitignore

@@ -6,3 +6,5 @@
 .bundle
 Gemfile.lock
 pkg/*
+coverage/*
+.DS_Store

data/CHANGELOG.md

@@ -0,0 +1,181 @@
+
+# SmarterCSV 1.x Change Log
+
+## 1.5.0 (2022-04-25)
+  * fixed bug with trailing col_sep characters, introduced in 1.4.0
+  * Fix deprecation warning in Ruby 3.0.3 / $INPUT_RECORD_SEPARATOR (thanks to Joel Fouse )
+
+  * changed default for `comment_regexp` to be `nil` for a safer default behavior (thanks to David Lazar)
+  **Note**
+    This no longer assumes that lines starting with `#` are comments.
+    If you want to treat lines starting with '#' as comments, use `comment_regexp: /\A#/`
+
+## 1.4.2 (2022-02-12)
+  * fixed issue with simplecov
+
+## 1.4.1 (2022-02-12) (PULLED)
+  * minor fix: also support `col_sep: :auto`
+  * added simplecov
+
+## 1.4.0 (2022-02-11)
+  * dropped GPL license, smarter_csv is now only using the MIT License
+  * added experimental option `col_sep: 'auto` to auto-detect the column separator (issue #183)
+    The default behavior is still to assume `,` is the column separator. 
+  * fixed buggy behavior when using `remove_empty_values: false` (issue #168)
+  * fixed Ruby 3.0 deprecation
+
+## 1.3.0 (2022-02-06) Breaking code change if you used `--key_mappings`
+ * fix bug for key_mappings (issue #181)   
+   The values of the `key_mappings` hash will now be used "as is", and no longer forced to be symbols
+
+   **Users with existing code with `--key_mappings` need to change their code** to 
+     * either use symbols in the `key_mapping` hash
+     * or change the expected keys from symbols to strings
+
+## 1.2.9 (2021-11-22) (PULLED)
+ * fix bug for key_mappings (issue #181)
+   The values of the `key_mappings` hash will now be used "as is", and no longer forced to be symbols
+
+## 1.2.8 (2020-02-04)
+ * fix deprecation warnings on Ruby 2.7 (thank to Diego Salido)
+
+## 1.2.7 (2020-02-03)
+
+## 1.2.6 (2018-11-13)
+ * fixing error caused by calling f.close when we do not hand in a file
+
+## 1.2.5 (2018-09-16)
+ * fixing issue #136 with comments in CSV files
+ * fixing error class hierarchy
+
+## 1.2.4 (2018-08-06)
+ * using Rails blank? if it's available
+
+## 1.2.3 (2018-01-27)
+ * fixed regression / test
+ * fuxed quote_char interpolation for headers, but not data (thanks to Colin Petruno)
+ * bugfix (thanks to Joshua Smith for reporting)
+
+## 1.2.0 (2018-01-20)
+ * add default validation that a header can only appear once
+ * add option `required_headers`
+
+## 1.1.5 (2017-11-05)
+ * fix issue with invalid byte sequences in header (issue #103, thanks to Dave Myron)
+ * fix issue with invalid byte sequences in multi-line data (thanks to Ivan Ushakov)
+ * analyze only 500 characters by default when `:row_sep => :auto` is used.
+   added option `row_sep_auto_chars` to change the default if necessary. (thanks to Matthieu Paret)
+
+## 1.1.4 (2017-01-16)
+ * fixing UTF-8 related bug which was introduced in 1.1.2 (thanks to Tirdad C.)
+
+## 1.1.3 (2016-12-30)
+ * added warning when options indicate UTF-8 processing, but input filehandle is not opened with r:UTF-8 option
+
+## 1.1.2 (2016-12-29)
+ * added option `invalid_byte_sequence` (thanks to polycarpou)
+ * added comments on handling of UTF-8 encoding when opening from File vs. OpenURI (thanks to KevinColemanInc)
+
+## 1.1.1 (2016-11-26)
+ * added option to `skip_lines` (thanks to wal)
+ * added option to `force_utf8` encoding (thanks to jordangraft)
+ * bugfix if no headers in input data (thanks to esBeee)
+ * ensure input file is closed (thanks to waldyr)
+ * improved verbose output (thankd to benmaher)
+ * improved documentation
+
+## 1.1.0 (2015-07-26)
+ * added feature :value_converters, which allows parsing of dates, money, and other things (thanks to Raphaël Bleuse, Lucas Camargo de Almeida, Alejandro)
+ * added error if :headers_in_file is set to false, and no :user_provided_headers are given (thanks to innhyu)
+ * added support to convert dashes to underscore characters in headers (thanks to César Camacho)
+ * fixing automatic detection of \r\n line-endings (thanks to feens)
+
+## 1.0.19 (2014-10-29)
+ * added option :keep_original_headers to keep CSV-headers as-is (thanks to Benjamin Thouret)
+
+## 1.0.18 (2014-10-27)
+ * added support for multi-line fields / csv fields containing CR (thanks to Chris Hilton) (issue #31)
+
+## 1.0.17 (2014-01-13)
+ * added option to set :row_sep to :auto , for automatic detection of the row-separator (issue #22)
+
+## 1.0.16 (2014-01-13)
+ * :convert_values_to_numeric option can now be qualified with :except or :only (thanks to Hugo Lepetit)
+ * removed deprecated `process_csv` method
+
+## 1.0.15 (2013-12-07)
+ * new option:
+   * :remove_unmapped_keys  to completely ignore columns which were not mapped with :key_mapping (thanks to Dave Sanders)
+
+## 1.0.14 (2013-11-01)
+ * added GPL-2 and MIT license to GEM spec file; if you need another license contact me
+
+## 1.0.12 (2013-10-15)
+ * added RSpec tests
+
+## 1.0.11 (2013-09-28)
+ * bugfix : fixed issue #18 - fixing issue with last chunk not being properly returned (thanks to Jordan Running)
+ * added RSpec tests
+
+## 1.0.10 (2013-06-26)
+ * bugfix : fixed issue #14 - passing options along to CSV.parse (thanks to Marcos Zimmermann)
+
+## 1.0.9 (2013-06-19)
+ * bugfix : fixed issue #13 with negative integers and floats not being correctly converted (thanks to Graham Wetzler)
+
+## 1.0.8 (2013-06-01)
+
+ * bugfix : fixed issue with nil values in inputs with quote-char (thanks to Félix Bellanger)
+ * new options:
+    * :force_simple_split : to force simiple splitting on :col_sep character for non-standard CSV-files. e.g. without properly escaped :quote_char
+    * :verbose : print out line number while processing (to track down problems in input files)
+
+## 1.0.7 (2013-05-20)
+
+ * allowing process to work with objects with a 'readline' method (thanks to taq)
+ * added options:
+    * :file_encoding : defaults to utf8  (thanks to MrTin, Paxa)
+
+## 1.0.6 (2013-05-19)
+
+ * bugfix : quoted fields are now correctly parsed
+
+## 1.0.5 (2013-05-08)
+
+ * bugfix : for :headers_in_file option
+
+## 1.0.4 (2012-08-17)
+
+ * renamed the following options:
+    * :strip_whitepace_from_values => :strip_whitespace   - removes leading/trailing whitespace from headers and values
+
+## 1.0.3 (2012-08-16)
+
+ * added the following options:
+    * :strip_whitepace_from_values   - removes leading/trailing whitespace from values
+
+## 1.0.2 (2012-08-02)
+
+ * added more options for dealing with headers:
+    * :user_provided_headers ,user provided Array with header strings or symbols, to precisely define what the headers should be, overriding any in-file headers (default: nil)
+    * :headers_in_file , if the file contains headers as the first line (default: true)
+
+## 1.0.1 (2012-07-30)
+
+ * added the following options:
+    * :downcase_header
+    * :strings_as_keys
+    * :remove_zero_values
+    * :remove_values_matching
+    * :remove_empty_hashes
+    * :convert_values_to_numeric
+
+ * renamed the following options:
+    * :remove_empty_fields => :remove_empty_values
+
+
+## 1.0.0 (2012-07-29)
+
+ * renamed `SmarterCSV.process_csv` to `SmarterCSV.process`.
+
+## 1.0.0.pre1 (2012-07-29)

data/CONTRIBUTORS.md

@@ -0,0 +1,46 @@
+# A Big Thank You to all the Contributors!!
+
+
+A Big Thank you to everyone who filed issues, sent comments, and who contributed with pull requests:
+
+ * [Jack 0](https://github.com/xjlin0)
+ * [Alejandro](https://github.com/agaviria)
+ * [Lucas Camargo de Almeida](https://github.com/lcalmeida)
+ * [Raphaël Bleuse](https://github.com/bleuse)
+ * [feens](https://github.com/feens)
+ * [César Camacho](https://github.com/chanko)
+ * [innhyu](https://github.com/innhyu)
+ * [Benjamin Thouret](https://github.com/benichu)
+ * [Chris Hilton](https://github.com/chrismhilton)
+ * [Sean Duckett](http://github.com/sduckett)
+ * [Alex Ong](http://github.com/khaong)
+ * [Martin Nilsson](http://github.com/MrTin)
+ * [Eustáquio Rangel](http://github.com/taq)
+ * [Pavel](http://github.com/paxa)
+ * [Félix Bellanger](https://github.com/Keeguon)
+ * [Graham Wetzler](https://github.com/grahamwetzler)
+ * [Marcos G. Zimmermann](https://github.com/marcosgz)
+ * [Jordan Running](https://github.com/jrunning)
+ * [Dave Sanders](https://github.com/DaveSanders)
+ * [Hugo Lepetit](https://github.com/giglemad)
+ * [esBeee](https://github.com/esBeee)
+ * [Waldyr de Souza](https://github.com/waldyr)
+ * [Ben Maher](https://github.com/benmaher)
+ * [Wal McConnell](https://github.com/wal)
+ * [Jordan Graft](https://github.com/jordangraft)
+ * [Michael](https://github.com/polycarpou)
+ * [Kevin Coleman](https://github.com/KevinColemanInc)
+ * [Tirdad C.](https://github.com/tridadc)
+ * [Dave Myron](https://github.com/contentfree)
+ * [Ivan Ushakov](https://github.com/IvanUshakov)
+ * [Matthieu Paret](https://github.com/mtparet)
+ * [Rohit Amarnath](https://github.com/ramarnat)
+ * [Joshua Smith](https://github.com/enviable)
+ * [Colin Petruno](https://github.com/colinpetruno)
+ * [Diego Salido](https://github.com/salidux)
+ * [Elie](https://github.com/elieteyssedou)
+ * [Chris Wong](https://github.com/lightwave)
+ * [Olle Jonsson](https://github.com/olleolleolle)
+ * [Nicolas Guillemain](https://github.com/Viiruus)
+ * [Sp6](https://github.com/sp6)
+ * [Joel Fouse](https://github.com/jfouse)

data/LICENSE.txt

@@ -0,0 +1,21 @@
+The MIT License (MIT)
+
+Copyright (c) 2012..2022 Tilo Sloboda
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in
+all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
+THE SOFTWARE.