dsv 0.12.11 → 0.12.12

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 12c41912ef12924ca7177b91aa6d532d4acff23b68073fea18172990fc41cd54
-  data.tar.gz: 553305fef6d5b78bea65c39b99f8e72e6dbab070352978c333ce9c277d63dfdc
+  metadata.gz: d83c84d7b20fd4f67811f8259313a7c9f7c52cb48430feab0316c96137c3bbd0
+  data.tar.gz: 26bf580f0b29c4886796f267a415548bec6354009bede7a12b45b8fbbe3668a5
 SHA512:
-  metadata.gz: d89e956eebebc2e15f6e3374bd39e344de12b9999a551db07e15201aefe0921ec4aa62fde5f8f259f5b3b79a6e3a60b9833c9641380913bc1c202036a832ff2a
-  data.tar.gz: 2e2f17f71e7651025b05378e90436567ff402870ff815e286c9dd777c11c773d84f249383ff8e4a1b0f817b6d70281c1d90de169970bba2a28b10c5493227af6
+  metadata.gz: 9ee707193d1e740d503ec877f0c079a2868ab3ba848459771760cf96992b002763d6e337e3a9b9ac6f97428c98cf4700b5b32866e00a5729ab3fa50c5ba24094
+  data.tar.gz: 007524b8e1cffeb88f7d12b6ebe195b07aaafe85cc060bb1b74c6b372869e944505983ac3629ecabbce84f7f28fecc7e72537133e14ac19e5040dde8020f6344

data/CHANGELOG

@@ -2,6 +2,15 @@
 
 ## 20261103
 
+0.12.12: as_array: with a column selection gives the columns selected.
+
+1. ~ parse_fields(): under as_array:, a selection gives the selected fields; + positions(). Each column not selected had come back as nil, and a selection by position had lost its values.
+2. ~ DSV#each: under as_array:, selects by position. A selection by name had raised TypeError.
+3. ~ test/dsv_test.rb: + selections under as_array:, by name, by position, by a repeated name, and from rows already read.
+4. ~ README.md: + as_array:, and a selection under it.
+5. ~ TODO: - 1.
+6. ~ lib/DSV/VERSION.rb: /0.12.11/0.12.12/.
+
 0.12.11: the class methods close the files they open, and return an Enumerator without a block.
 
 1. ~ DSV.each, .read, .write, .header_row, .first_row, .attributes, .columns: + opened(), so that a path or text given is closed after the call, an early exit included; an IO given is left open. Each had left its file open.

data/README.md

@@ -40,6 +40,13 @@ DSV.read("1,2,3\n4,5,6\n")
 # => [{0 => "1", 1 => "2", 2 => "3"}, {0 => "4", 1 => "5", 2 => "6"}]
 ```
 
+With `as_array: true` each row is an Array of its values in column order, the form stdlib CSV gives:
+
+```ruby
+DSV.read("1,2,3\n4,5,6\n", as_array: true)
+# => [["1", "2", "3"], ["4", "5", "6"]]
+```
+
 A String that names an existing file is read as a file; any other String is read as text.
 
 ### Selecting columns
@@ -53,6 +60,8 @@ DSV.read('people.csv', 'name', headers: true)
 DSV.read('people.csv', headers: true, selected_columns: ['name'])
 ```
 
+Under `as_array:` the Arrays hold the columns selected, in column order.
+
 ### Enumerating from the class
 
 The Enumerable calls are available on a source directly, each taking the same options:

data/TODO

@@ -2,44 +2,43 @@
 
 ## 0.12.x, fixes
 
-1. as_array: with a column selection: each('name') no longer raises TypeError, and read('name', as_array: true) gives only the columns selected. as_array: in the README, as the way to get Arrays as CSV gives them.
-2. Reading honours quote: given as a String, as writing does; DSV.parse_line honours quote:.
-3. A space as the column separator splits on each space, not as String#split(' ') does.
-4. :double back to 0.12.4's reading, undoing 0.12.5 item 2: a row not starting with a quote split plainly, one starting with a quote split on quote-separator-quote, and one which leaves a lone quote in a field read in full as wholly quoted. The README back to 0.12.3's wording.
-5. :single read, as :double is with a single quote.
-6. filter, a class-level alias of select.
-7. A String under a write mode taken as a path, so that a file not yet there can be written by name.
-8. The internals private.
+1. Reading honours quote: given as a String, as writing does; DSV.parse_line honours quote:.
+2. A space as the column separator splits on each space, not as String#split(' ') does.
+3. :double back to 0.12.4's reading, undoing 0.12.5 item 2: a row not starting with a quote split plainly, one starting with a quote split on quote-separator-quote, and one which leaves a lone quote in a field read in full as wholly quoted. The README back to 0.12.3's wording.
+4. :single read, as :double is with a single quote.
+5. filter, a class-level alias of select.
+6. A String under a write mode taken as a path, so that a file not yet there can be written by name.
+7. The internals private.
 
 ## 0.13.0, modes as declarations
 
-9. An unknown quote mode, file mode or option raises ArgumentError, where each is ignored today.
-10. :mixed, the name of the default.
-11. A mode raises on a contradiction which costs nothing to see, every row alike, header included: under :double, a row not starting with a quote, and a bare field in a row read in full. Declaring :mixed reads such a row.
+8. An unknown quote mode, file mode or option raises ArgumentError, where each is ignored today.
+9. :mixed, the name of the default.
+10. A mode raises on a contradiction which costs nothing to see, every row alike, header included: under :double, a row not starting with a quote, and a bare field in a row read in full. Declaring :mixed reads such a row.
 
 ## 0.14.0, streaming
 
-12. each yields each row as it is read and returns its receiver, so that detect and break stop reading and memory does not grow with the file; rows is no longer filled by each. Chunks come from each_slice. A source read once, start to end, with no rewind, so that a pipe or $stdin can be read: the header from the first row read, and the line of an error found by seeking only where the source can; a rewind left to r+ rewriting and first_row called alone.
+11. each yields each row as it is read and returns its receiver, so that detect and break stop reading and memory does not grow with the file; rows is no longer filled by each. Chunks come from each_slice. A source read once, start to end, with no rewind, so that a pipe or $stdin can be read: the header from the first row read, and the line of an error found by seeking only where the source can; a rewind left to r+ rewriting and first_row called alone.
 
 ## 1.0
 
-13. A corpus in the tests, a day of NEMWEB's dispatch files trimmed and the RFC 4180 cases, each checked against stdlib CSV's rows.
-14. A benchmark script against stdlib CSV, and the README's speed sentence written from its output.
-15. README: every mode by example, and a table matching each to stdlib CSV's and Python's settings.
+12. A corpus in the tests, a day of NEMWEB's dispatch files trimmed and the RFC 4180 cases, each checked against stdlib CSV's rows.
+13. A benchmark script against stdlib CSV, and the README's speed sentence written from its output.
+14. README: every mode by example, and a table matching each to stdlib CSV's and Python's settings.
 
 ## 1.x, speed, results unchanged
 
-16. A per-row fast path for the default: split, the fields bare or wrapped in two quotes unwrapped, any other row read in full.
-17. as_array: returning the split fields, rather than building a Hash and then an Array from it.
-18. The splitter chosen once, at construction, as row_renderer is for writing.
-19. Two string predicates in place of four regex matches per piece; rows built by zip.to_h; the scanner-based parser, at the tag scanner-parser-20261006, judged against the rest.
+15. A per-row fast path for the default: split, the fields bare or wrapped in two quotes unwrapped, any other row read in full.
+16. as_array: returning the split fields, rather than building a Hash and then an Array from it.
+17. The splitter chosen once, at construction, as row_renderer is for writing.
+18. Two string predicates in place of four regex matches per piece; rows built by zip.to_h; the scanner-based parser, at the tag scanner-parser-20261006, judged against the rest.
 
 ## 1.x, features
 
-20. :rfc_4180, a quote mode reading what RFC 4180 allows as :mixed does and raising on what it forbids.
-21. field_count:, :header or an Integer, off by default: a row of another width raises.
-22. Writing: minimal quoting, a field quoted only where it holds a separator, a quote or a row terminator; a row terminator inside a field kept, quoted, or folded to a space; the encoding declared and a transcode offered with any loss marked.
-23. A line number in each parse error, found only when the error is raised, as UnterminatedQuote finds its, where the source can seek. line_numbers:, off by default, counts lines as it reads instead, for any source a pipe included: the read loop chosen once, at construction, as row_renderer is for writing, so that without it no row pays for the count.
-24. The instance-level header_row renamed headers?, kept as an alias; << to append a row and generate to build a string.
-25. Symbols and Strings interchangeable for column names, in a selection, a columns: list and a row's keys.
-26. The duplicate-header modes as an option: keep all as an Array, the default; index, a, a.1; first; last; error.
+19. :rfc_4180, a quote mode reading what RFC 4180 allows as :mixed does and raising on what it forbids.
+20. field_count:, :header or an Integer, off by default: a row of another width raises.
+21. Writing: minimal quoting, a field quoted only where it holds a separator, a quote or a row terminator; a row terminator inside a field kept, quoted, or folded to a space; the encoding declared and a transcode offered with any loss marked.
+22. A line number in each parse error, found only when the error is raised, as UnterminatedQuote finds its, where the source can seek. line_numbers:, off by default, counts lines as it reads instead, for any source a pipe included: the read loop chosen once, at construction, as row_renderer is for writing, so that without it no row pays for the count.
+23. The instance-level header_row renamed headers?, kept as an alias; << to append a row and generate to build a string.
+24. Symbols and Strings interchangeable for column names, in a selection, a columns: list and a row's keys.
+25. The duplicate-header modes as an option: keep all as an Array, the default; index, a, a.1; first; last; error.

data/lib/DSV/VERSION.rb

@@ -2,5 +2,5 @@
 # DSV::VERSION
 
 class DSV
-  VERSION = '0.12.11'
+  VERSION = '0.12.12'
 end

data/lib/dsv.rb

@@ -388,6 +388,8 @@ class DSV
   end
 
   def parse_fields(fields, *selected_columns)
+    selected_columns.flatten!
+    return fields.values_at(*positions(selected_columns)) if @as_array && !selected_columns.empty?
     parsed_row = {}
     i = -1
     if selected_columns.empty?
@@ -399,7 +401,6 @@ class DSV
         fields.each{|column_value| store_field(parsed_row, attributes[i += 1], column_value)}
       end
     else
-      selected_columns.flatten!
       case selected_columns[0]
       when Integer
         fields.each{|column_value| parsed_row[i] = column_value unless !selected_columns.include?(i += 1)}
@@ -418,6 +419,11 @@ class DSV
     end
   end
 
+# The positions of the columns selected, in column order, a repeated name giving each of its own.
+def positions(selected_columns)
+  selected_columns.flat_map{|column| column.is_a?(::Integer) ? column : Array((columns || {})[column])}.sort
+end
+
   # With no columns defined, rows keyed by name supply them, and the header, from the first row's keys; rows keyed by position write positionally and have no header to write.
   def write(*selected_columns)
     prepare_to_rewrite if @mode == 'r+'
@@ -492,14 +498,16 @@ class DSV
     if @rows[0]
       if selected_columns.empty?
         @rows.each{|row| yield row}
+      elsif @as_array
+        @rows.each{|row| yield row.values_at(*positions(selected_columns))}
       else
         @rows.each do |row|
           yield selected_columns.inject({}){|hash, column_name| hash[column_name] = row[column_name]; hash}
         end
       end
     else
-      if selected_columns.empty?
-        read_csv.each{|row| yield row}
+      if selected_columns.empty? || @as_array
+        read_csv(selected_columns).each{|row| yield row}
       else
         read_csv(selected_columns).each do |row|
           yield selected_columns.inject({}){|hash, column_name| hash[column_name] = row[column_name]; hash}

data/test/dsv_test.rb

@@ -118,6 +118,15 @@ describe DSV do
       _(yielded(:each, DATA, 'a', headers: true)).must_equal [{'a' => '1'}, {'a' => '4'}]
       _(yielded(:parse, DATA, 'b', headers: true)).must_equal [{'b' => '2'}, {'b' => '5'}]
     end
+
+    it "gives only the columns selected under as_array:, in column order" do
+      _(DSV.read(DATA, 'a', headers: true, as_array: true)).must_equal [['1'], ['4']]
+      _(DSV.read(DATA, ['c', 'a'], headers: true, as_array: true)).must_equal [['1', '3'], ['4', '6']]
+      _(DSV.read(DATA, headers: true, as_array: true, selected_columns: ['b'])).must_equal [['2'], ['5']]
+      _(DSV.read("1,2,3\n4,5,6\n", 1, as_array: true)).must_equal [['2'], ['5']]
+      _(DSV.read("a,a,b\n1,2,3\n", 'a', headers: true, as_array: true)).must_equal [['1', '2']]
+      _(yielded(:each, DATA, 'a', headers: true, as_array: true)).must_equal [['1'], ['4']]
+    end
   end
 
   describe ".parse" do
@@ -415,6 +424,12 @@ describe DSV do
   end
 
   describe "#each" do
+    it "selects from rows already read under as_array:, in column order" do
+      csv = DSV.new(DATA, headers: true, as_array: true)
+      csv.read
+      _(csv.each(['c', 'a']).to_a).must_equal [['1', '3'], ['4', '6']]
+    end
+
     it "yields each row, reading the source first if it has not been read" do
       rows = []
       DSV.new(DATA, headers: true).each{|row| rows << row}

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: dsv
 version: !ruby/object:Gem::Version
-  version: 0.12.11
+  version: 0.12.12
 platform: ruby
 authors:
 - thoran