csvreader 1.0.3 → 1.1.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA1:
-  metadata.gz: 46909e44ebe97a9bbc19c95f1979821d001aac93
-  data.tar.gz: 4820888344741534cfc391d1b610a71a4c73f922
+  metadata.gz: b7c45afa79ca462aef1a8a9f1f6da26b7b08e125
+  data.tar.gz: b1a20a1acf5e88331900169f5d3542fb4f866f58
 SHA512:
-  metadata.gz: 5cb35f119810de48868c758bd60d53e621d093e7dbc0c7b1459818f187b4ce5785e04d232432f32e54bb683c0585c97df56eb0a3352ae07aa8bfe990bdf2f6f8
-  data.tar.gz: 507245efca585926a7e21675ebf0fa997c5be792cb00d47647ee082a68482b1d96d3b9aec6b8ddf4b1278145604931b399a0dc82b956e939c52911680c9ac10c
+  metadata.gz: 7cf456f8e886e687ade020c70830332c1b2c3bdb1d14a148ed9a01ce2d7d1e9acffab2a3435907641fad220830f3eee39c20d8ca645e096bae5fe0bb2184a075
+  data.tar.gz: a887567bd67a3080d99adb2a609d8e79a5385b83abe1109f1f4d24a1ebd5fb9536e38701e8fefe5020c16753f674d45b673d00b6300b3422d713a630c3dbf0d6

data/Manifest.txt

@@ -9,6 +9,7 @@ lib/csvreader/buffer.rb
 lib/csvreader/builder.rb
 lib/csvreader/converter.rb
 lib/csvreader/parser.rb
+lib/csvreader/parser_fixed.rb
 lib/csvreader/parser_json.rb
 lib/csvreader/parser_std.rb
 lib/csvreader/parser_strict.rb
@@ -26,6 +27,7 @@ test/helper.rb
 test/test_buffer.rb
 test/test_converter.rb
 test/test_parser.rb
+test/test_parser_fixed.rb
 test/test_parser_formats.rb
 test/test_parser_java.rb
 test/test_parser_meta.rb

data/README.md

@@ -1,8 +1,8 @@
 # csvreader - read tabular data in the comma-separated values (csv) format the right way (uses best practices out-of-the-box with zero-configuration)
 
 
-* home  :: [github.com/csv11/csvreader](https://github.com/csv11/csvreader)
-* bugs  :: [github.com/csv11/csvreader/issues](https://github.com/csv11/csvreader/issues)
+* home  :: [github.com/csvreader/csvreader](https://github.com/csvreader/csvreader)
+* bugs  :: [github.com/csvreader/csvreader/issues](https://github.com/csvreader/csvreader/issues)
 * gem   :: [rubygems.org/gems/csvreader](https://rubygems.org/gems/csvreader)
 * rdoc  :: [rubydoc.info/gems/csvreader](http://rubydoc.info/gems/csvreader)
 * forum :: [wwwmake](http://groups.google.com/group/wwwmake)
@@ -13,7 +13,7 @@
 
 
 ``` ruby
-txt <<=TXT
+txt = <<TXT
 1,2,3
 4,5,6
 TXT
@@ -46,7 +46,7 @@ Use the converters keyword option to (auto-)convert strings to nulls, booleans,
 Example:
 
 ``` ruby
-txt <<=TXT
+txt = <<TXT
 1,2,3
 true,false,null
 TXT
@@ -79,7 +79,7 @@ Csv.parse( 'Ruby, 2020-03-01, 100', converters: [->(v) { Time.parse(v) rescue v
 #=> [["Ruby", 2020-03-01 00:00:00 +0200, "100"]]
 ```
 
-A custom converter is a method that gets the value passed in 
+A custom converter is a method that gets the value passed in
 and if successful returns a non-string type (e.g. integer, float, date, etc.)
 or a string (for further processing with all other converters in the "pipeline" configuration).
 
@@ -121,7 +121,7 @@ as an array) and you want your records as hashes instead of arrays of strings.
 Example:
 
 ``` ruby
-txt <<=TXT
+txt = <<TXT
 A,B,C
 1,2,3
 4,5,6
@@ -132,7 +132,7 @@ pp records
 
 # -or-
 
-txt2 <<=TXT
+txt2 = <<TXT
 1,2,3
 4,5,6
 TXT
@@ -171,7 +171,7 @@ and replace spaces with underscores.
 Example:
 
 ``` ruby
-txt <<=TXT
+txt = <<TXT
 a,b,c
 1,2,3
 true,false,null
@@ -183,7 +183,7 @@ pp records
 #     {a: true, b: false, c: nil}]
 
 # -or-
-options = { :converters        => :all, 
+options = { :converters        => :all,
             :header_converters => :symbol }
 
 records = CsvHash.parse( txt, options )  
@@ -203,7 +203,7 @@ Built-in header converters include:
 
 ### What about (typed) structs?
 
-See the [csvrecord library »](https://github.com/csv11/csvrecord)
+See the [csvrecord library »](https://github.com/csvreader/csvrecord)
 
 Example from the csvrecord docu:
 
@@ -284,7 +284,7 @@ Hofbräu Oktoberfestbier (6.3%) by Staatliches Hofbräuhaus München, München
 
 ### What about tabular data packages with pre-defined types / schemas?
 
-See the [csvpack library »](https://github.com/csv11/csvpack)
+See the [csvpack library »](https://github.com/csvreader/csvpack)
 
 
 
@@ -339,7 +339,7 @@ Use strict if you do NOT want to trim leading and trailing spaces
 and if you do NOT want to skip blank lines. Example:
 
 ``` ruby
-txt <<=TXT
+txt = <<TXT
 1, 2,3
 4,5 ,6
 
@@ -402,7 +402,7 @@ Note: If you use tab (`\t`) use the `TabReader`
 Why? Tab =! CSV. Yes, tab is
 its own (even) simpler format
 (e.g. no escape rules, no newlines in values, etc.),
-see [`TabReader` »](https://github.com/csv11/tabreader).
+see [`TabReader` »](https://github.com/csvreader/tabreader).
 
 ``` ruby
 Csv.tab.parse( ... )  # note: "classic" strict tab format
@@ -421,6 +421,39 @@ Csv.strict.read( ..., sep: "\t" )
 
 
 
+
+### Q: How can I read records with fixed width (and no separator)?
+
+Pass in the `width` keyword option with the field widths / lengths
+to the "fixed" parser. Example:
+
+``` ruby
+txt = <<TXT
+12345678123456781234567890123456789012345678901212345678901234
+TXT
+
+Csv.fixed.parse( txt, width: [8,8,32,14] )
+# => [["12345678","12345678", "12345678901234567890123456789012", "12345678901234"]]
+
+
+txt = <<TXT
+John    Smith   john@example.com                1-888-555-6666
+Michele O'Reileymichele@example.com             1-333-321-8765
+TXT
+
+Csv.fixed.parse( txt, width: [8,8,32,14] )
+# => [["John",    "Smith",    "john@example.com",    "1-888-555-6666"],
+#     ["Michele", "O'Reiley", "michele@example.com", "1-333-321-8765"]]
+
+# and so on
+```
+
+Note: You can use for your convenience the built-in
+`Csv.fix` or `Csv.f` aliases / shortcuts.
+
+
+
+
 ### Q: What's broken in the standard library CSV reader?
 
 Two major design bugs and many many minor.
@@ -476,7 +509,7 @@ and some more.
 
 ## Alternatives
 
-See the Libraries & Tools section in the [Awesome CSV](https://github.com/csv11/awesome-csv#libraries--tools) page.
+See the Libraries & Tools section in the [Awesome CSV](https://github.com/csvspecs/awesome-csv#libraries--tools) page.
 
 
 ## License

data/Rakefile

@@ -8,19 +8,19 @@ Hoe.spec 'csvreader' do
   self.summary = "csvreader - read tabular data in the comma-separated values (csv) format the right way (uses best practices out-of-the-box with zero-configuration)"
   self.description = summary
 
-  self.urls = ['https://github.com/csv11/csvreader']
+  self.urls = ['https://github.com/csvreader/csvreader']
 
   self.author = 'Gerald Bauer'
   self.email = 'wwwmake@googlegroups.com'
 
   # switch extension to .markdown for gihub formatting
-  self.readme_file = 'README.md'
+  self.readme_file  = 'README.md'
   self.history_file = 'HISTORY.md'
 
   self.licenses = ['Public Domain']
 
   self.spec_extras = {
-   :required_ruby_version => '>= 2.2.2'
+    required_ruby_version: '>= 2.2.2'
   }
 
 end

data/lib/csvreader/base.rb

@@ -17,6 +17,8 @@ require 'csvreader/buffer'
 require 'csvreader/parser_std'      # best practices pre-configured out-of-the-box
 require 'csvreader/parser_strict'   # flexible (strict - no leading/trailing space triming, blanks, etc.), configure for different formats/dialects
 require 'csvreader/parser_tab'
+require 'csvreader/parser_fixed'
+require 'csvreader/parser_json'
 require 'csvreader/parser'
 require 'csvreader/converter'
 require 'csvreader/reader'
@@ -62,6 +64,8 @@ class Parser
 
   TAB     = ParserTab.new
 
+  FIXED   = ParserFixed.new
+
 
   def self.default()         DEFAULT;         end ## alternative alias for DEFAULT
   def self.numeric()         NUMERIC;         end
@@ -76,6 +80,9 @@ class Parser
   def self.postgresql_text() POSTGRESQL_TEXT; end
   def self.postgres_text()   postgresql_text; end
   def self.tab()             TAB;             end
+  def self.fixed()           FIXED;           end
+  def self.fix()             fixed;           end
+  def self.f()               fixed;           end
 end # class Parser
 end # class CsvReader
 
@@ -95,7 +102,8 @@ class CsvReader
   POSTGRES_TEXT = POSTGRESQL_TEXT = Builder.new( Parser::POSTGRESQL_TEXT )
 
 
-  TAB = Builder.new( Parser::TAB )
+  TAB   = Builder.new( Parser::TAB )
+  FIXED = Builder.new( Parser::FIXED )
 
 
   def self.default()         DEFAULT;         end ## alternative alias for DEFAULT
@@ -111,6 +119,9 @@ class CsvReader
   def self.postgresql_text() POSTGRESQL_TEXT; end
   def self.postgres_text()   postgresql_text; end
   def self.tab()             TAB;             end
+  def self.fixed()           FIXED;           end
+  def self.fix()             fixed;           end
+  def self.f()               fixed;           end
 end # class CsvReader
 
 
@@ -129,7 +140,8 @@ class CsvHashReader
   POSTGRES_TEXT = POSTGRESQL_TEXT = Builder.new( Parser::POSTGRESQL_TEXT )
 
 
-  TAB = Builder.new( Parser::TAB )
+  TAB   = Builder.new( Parser::TAB )
+  FIXED = Builder.new( Parser::FIXED )
 
 
   def self.default()         DEFAULT;         end ## alternative alias for DEFAULT
@@ -145,6 +157,9 @@ class CsvHashReader
   def self.postgresql_text() POSTGRESQL_TEXT; end
   def self.postgres_text()   postgresql_text; end
   def self.tab()             TAB;             end
+  def self.fixed()           FIXED;           end
+  def self.fix()             fixed;           end
+  def self.f()               fixed;           end
 end # class CsvHashReader
 
 

data/lib/csvreader/builder.rb

@@ -8,7 +8,11 @@ class Builder  ## rename to CsvReaderBuilder - why? why not?
     @parser = parser
   end
 
-  def config() @parser.config; end   ## (auto-)forward to wrapped parser
+
+  ## (auto-)forward to wrapped parser
+  ##   note/fix: not all parser use/have config e.g. ParserTab, ParserFixed, etc.
+  def config() @parser.config; end
+
 
   ## todo/fix:
   ##   add parser config (attribute) setter e.g.
@@ -19,38 +23,40 @@ class Builder  ## rename to CsvReaderBuilder - why? why not?
   def open( path, mode=nil,
                  sep: nil,
                  converters: nil,
+                 width: nil,
                  parser: @parser, &block )
       CsvReader.open( path, mode,
-                      sep: sep, converters: converters,
+                      sep: sep, converters: converters, width: width,
                       parser: @parser, &block )
   end
 
   def read( path, sep: nil,
-                  converters: nil )
+                  converters: nil,
+                  width: nil )
     CsvReader.read( path,
-                  sep: sep, converters: converters,
+                  sep: sep, converters: converters, width: width,
                   parser: @parser )
   end
 
-  def header( path, sep: nil )
+  def header( path, sep: nil, width: nil )
     CsvReader.header( path,
-                    sep: sep,
+                    sep: sep, width: width,
                     parser: @parser )
   end
 
   def foreach( path, sep: nil,
-                     converters: nil, &block )
+                     converters: nil, width: nil, &block )
     CsvReader.foreach( path,
-                     sep: sep, converters: converters,
+                     sep: sep, converters: converters, width: width,
                      parser: @parser, &block )
   end
 
 
 
   def parse( data, sep: nil,
-                   converters: nil, &block )
+                   converters: nil, width: nil, &block )
     CsvReader.parse( data,
-                   sep: sep, converters: converters,
+                   sep: sep, converters: converters, width: width,
                    parser: @parser, &block )
   end
 end # class Builder
@@ -64,7 +70,9 @@ class Builder  ## rename to CsvHashReaderBuilder - why? why not?
     @parser = parser
   end
 
-  def config() @parser.config; end   ## (auto-)forward to wrapped parser
+  ## (auto-)forward to wrapped parser
+  ##   note/fix: not all parser use/have config e.g. ParserTab, ParserFixed, etc.
+  def config() @parser.config; end
 
   ## todo/fix:
   ##   add parser config (attribute) setter e.g.
@@ -78,32 +86,37 @@ class Builder  ## rename to CsvHashReaderBuilder - why? why not?
                  sep: nil,
                  converters: nil,
                  header_converters: nil,
+                 width: nil,
                  parser: @parser, &block )
       CsvHashReader.open( path, mode,
                       headers: headers, sep: sep, converters: converters,
                       header_converters: header_converters,
+                      width: width,
                       parser: @parser, &block )
   end
 
   def read( path, headers: nil,
                   sep: nil,
                   converters: nil,
-                  header_converters: nil )
+                  header_converters: nil,
+                  width: nil )
     CsvHashReader.read( path,
                   headers: headers,
                   sep: sep, converters: converters,
                   header_converters: header_converters,
+                  width: width,
                   parser: @parser )
   end
 
   def foreach( path, headers: nil,
                      sep: nil,
                      converters: nil,
-                     header_converters: nil, &block )
+                     header_converters: nil, width: nil, &block )
     CsvHashReader.foreach( path,
                      headers: headers,
                      sep: sep, converters: converters,
                      header_converters: header_converters,
+                     width: width,
                      parser: @parser, &block )
   end
 
@@ -111,11 +124,12 @@ class Builder  ## rename to CsvHashReaderBuilder - why? why not?
   def parse( data, headers: nil,
                    sep: nil,
                    converters: nil,
-                   header_converters: nil, &block )
+                   header_converters: nil, width: nil, &block )
     CsvHashReader.parse( data,
                    headers: headers,
                    sep: sep, converters: converters,
                    header_converters: header_converters,
+                   width: width,
                    parser: @parser, &block )
   end
 end # class Builder

data/lib/csvreader/parser_fixed.rb

@@ -0,0 +1,90 @@
+# encoding: utf-8
+
+class CsvReader
+
+class ParserFixed
+
+###################################
+## add simple logger with debug flag/switch
+#
+#  use Parser.debug = true   # to turn on
+#
+#  todo/fix: use logutils instead of std logger - why? why not?
+
+def self.build_logger()
+  l = Logger.new( STDOUT )
+  l.level = :info    ## set to :info on start; note: is 0 (debug) by default
+  l
+end
+def self.logger() @@logger ||= build_logger; end
+def logger()  self.class.logger; end
+
+
+def parse( data, width:, &block )
+
+  ## note: input: required each_line (string or io/file for example)
+
+  input = data   ## assume it's a string or io/file handle
+
+  if block_given?
+    parse_lines( input, width: width, &block )
+  else
+    records = []
+
+    parse_lines( input, width: width ) do |record|
+      records << record
+    end
+
+    records
+  end
+end ## method parse
+
+
+
+private
+
+def parse_lines( input, width:, &block )
+
+  ## note: each line only works with \n (windows) or \r\n (unix)
+  ##   will NOT work with \r (old mac, any others?) only!!!!
+  input.each_line do |line|
+
+    ##  note: chomp('') if is an empty string,
+    ##    it will remove all trailing newlines from the string.
+    ##    use line.sub(/[\n\r]*$/, '') or similar instead - why? why not?
+    line = line.chomp( '' )
+    logger.debug "line:"                if logger.debug?
+    logger.debug line.pretty_inspect    if logger.debug?
+
+
+    ## skip empty lines and comments
+    if line =~ /^[ \t]*$/   ## skip blank lines (with whitespace only)
+       logger.debug "skip blank line"    if logger.debug?
+       next
+    end
+
+    if line =~ /^[ \t]*#/   # start_with?( "#" ) -- skip comment lines (note: allow leading whitespaces)
+       logger.debug "skip comment line"   if logger.debug?
+       next
+    end
+
+
+    values = []
+    offset = 0  # start position / offset
+    width.each_with_index do |w,i|
+       logger.debug "[#{i}] start: #{offset}, width: #{w}"   if logger.debug?
+
+       value = line[offset, w]
+       value = value.strip   if value    ## note: if not nil strip; only use rstrip (for trailing only) - why? why not?
+       values << value
+       offset += w
+    end
+
+    ## note: requires block - enforce? how? why? why not?
+    block.call( values )
+  end
+end # method parse_lines
+
+
+end # class ParserFixed
+end # class CsvReader

data/lib/csvreader/parser_json.rb

@@ -1,2 +1,5 @@
-##
+# encoding: utf-8
+
+
+#######
 ## todo: add parser for new CSV <3 JSON format

data/lib/csvreader/reader.rb

@@ -5,12 +5,14 @@ class CsvReader
     def self.open( path, mode=nil,
                    sep: nil,
                    converters: nil,
+                   width: nil,
                    parser: nil, &block )   ## rename path to filename or name - why? why not?
 
         ## note: default mode (if nil/not passed in) to 'r:bom|utf-8'
         f = File.open( path, mode ? mode : 'r:bom|utf-8' )
         csv = new(f, sep: sep,
                      converters: converters,
+                     width: width,
                      parser: parser )
 
         # handle blocks like Ruby's open(), not like the (old old) CSV library
@@ -28,20 +30,22 @@ class CsvReader
 
     def self.read( path, sep: nil,
                          converters: nil,
+                         width: nil,
                          parser: nil )
         open( path,
               sep: sep,
               converters: converters,
+              width: width,
               parser: parser ) { |csv| csv.read }
     end
 
 
-    def self.header( path, sep: nil, parser: nil )   ## use header or headers - or use both (with alias)?
+    def self.header( path, sep: nil, width: nil, parser: nil )   ## use header or headers - or use both (with alias)?
        # read first lines (only)
        #  and parse with csv to get header from csv library itself
 
        records = []
-       open( path, sep: sep, parser: parser ) do |csv|
+       open( path, sep: sep, width: width, parser: parser ) do |csv|
           csv.each do |record|
             records << record
             break   ## only parse/read first record
@@ -56,8 +60,8 @@ class CsvReader
 
 
     def self.foreach( path, sep: nil,
-                            converters: nil, parser: nil, &block )
-      csv = open( path, sep: sep, converters: converters, parser: parser )
+                            converters: nil, width: nil, parser: nil, &block )
+      csv = open( path, sep: sep, converters: converters, width: width, parser: parser )
 
       if block_given?
         begin
@@ -76,8 +80,9 @@ class CsvReader
 
     def self.parse( data, sep: nil,
                           converters: nil,
+                          width: nil,
                           parser: nil, &block )
-      csv = new( data, sep: sep, converters: converters, parser: parser )
+      csv = new( data, sep: sep, converters: converters, width: width, parser: parser )
 
       if block_given?
         csv.each( &block )  ## note: caller (responsible) must close file!!! - add autoclose - why? why not?
@@ -93,9 +98,9 @@ class CsvReader
     ##   always use parse (do NOT/NOT/NOT use parse_line)  - why? why not?
     ##   todo/fix: remove parse_line!!!
     def self.parse_line( data, sep: nil,
-                               converters: nil )
+                               converters: nil, width: nil )
        records = []
-       parse( data, sep: sep, converters: converters ) do |record|
+       parse( data, sep: sep, converters: converters, width: width ) do |record|
          records << record
          break   # only parse first record
        end
@@ -105,14 +110,15 @@ class CsvReader
 
 
 
-    def initialize( data, sep: nil, converters: nil, parser: nil )
+    def initialize( data, sep: nil, converters: nil, width: nil, parser: nil )
           raise ArgumentError.new( "Cannot parse nil as CSV" )  if data.nil?
           ## todo: use (why? why not) - raise ArgumentError, "Cannot parse nil as CSV"     if data.nil?
 
           # create the IO object we will read from
           @io = data.is_a?(String) ? StringIO.new(data) : data
 
-          @sep = sep
+          @sep   = sep     # (optional) for ParserStd, ParserStrict
+          @width = width   # (optional) for ParserFixed
 
           @converters  = Converter.create_converters( converters )
 
@@ -141,7 +147,10 @@ class CsvReader
        if block_given?
          kwargs = {}
          ## note: only add separator if present/defined (not nil)
-         kwargs[:sep] = @sep    if @sep && @parser.respond_to?( :'sep=' )
+         ##  todo/fix: change sep keyword to "known" classes!!!!
+         kwargs[:sep]   = @sep    if @sep && @parser.respond_to?( :'sep=' )
+
+         kwargs[:width] = @width  if @parser.is_a?( ParserFixed )
 
          ## check array / pipeline of converters is empty (size=0 e.g. is [])
          if @converters.empty?

data/lib/csvreader/reader_hash.rb

@@ -4,8 +4,9 @@ class CsvHashReader
 
 
 ## add convenience shortcuts / aliases for CsvReader support classes
-Parser    = CsvReader::Parser
-Converter = CsvReader::Converter
+Parser      = CsvReader::Parser
+ParserFixed = CsvReader::ParserFixed
+Converter   = CsvReader::Converter
 
 
 
@@ -14,6 +15,7 @@ def self.open( path, mode=nil,
                sep: nil,
                converters: nil,
                header_converters: nil,
+               width: nil,
                parser: nil, &block )   ## rename path to filename or name - why? why not?
 
     ## note: default mode (if nil/not passed in) to 'r:bom|utf-8'
@@ -22,6 +24,7 @@ def self.open( path, mode=nil,
                  sep: sep,
                  converters: converters,
                  header_converters: header_converters,
+                 width: width,
                  parser: parser )
 
     # handle blocks like Ruby's open(), not like the (old old) CSV library
@@ -41,12 +44,14 @@ def self.read( path, headers: nil,
                      sep: nil,
                      converters: nil,
                      header_converters: nil,
+                     width: nil,
                      parser: nil )
     open( path,
           headers: headers,
           sep: sep,
           converters: converters,
           header_converters: header_converters,
+          width: width,
           parser: parser ) { |csv| csv.read }
 end
 
@@ -56,12 +61,14 @@ def self.foreach( path, headers: nil,
                         sep: nil,
                         converters: nil,
                         header_converters: nil,
+                        width: nil,
                         parser: nil, &block )
   csv = open( path,
               headers: headers,
               sep: sep,
               converters: converters,
               header_converters: header_converters,
+              width: width,
               parser: parser )
 
   if block_given?
@@ -83,12 +90,14 @@ def self.parse( data, headers: nil,
                       sep: nil,
                       converters: nil,
                       header_converters: nil,
+                      width: nil,
                       parser: nil, &block )
   csv = new( data,
              headers: headers,
              sep: sep,
              converters: converters,
              header_converters: header_converters,
+             width: width,
              parser: parser )
 
   if block_given?
@@ -105,6 +114,7 @@ end # method self.parse
 def initialize( data, headers: nil, sep: nil,
                       converters: nil,
                       header_converters: nil,
+                      width: nil,
                       parser: nil )
       raise ArgumentError.new( "Cannot parse nil as CSV" )  if data.nil?
       ## todo: use (why? why not) - raise ArgumentError, "Cannot parse nil as CSV"     if data.nil?
@@ -117,7 +127,8 @@ def initialize( data, headers: nil, sep: nil,
       ##    for now - do NOT auto-convert passed in headers - keep them as-is (1:1)
       @names = headers ? headers : nil
 
-      @sep = sep
+      @sep   = sep
+      @width = width
 
       @converters        = Converter.create_converters( converters )
       @header_converters = Converter.create_header_converters( header_converters )
@@ -156,8 +167,12 @@ def_delegators :@io,
    if block_given?
      kwargs = {}
      ## note: only add separator if present/defined (not nil)
+     ##  todo/fix: change sep keyword to "known" classes!!!!
      kwargs[:sep] = @sep    if @sep && @parser.respond_to?( :'sep=' )
 
+     kwargs[:width] = @width  if @parser.is_a?( ParserFixed )
+
+
      @parser.parse( @io, kwargs ) do |raw_values|     # sep: sep
         if @names.nil?    ## check for (first) headers row
           if @header_converters.empty?

data/lib/csvreader/version.rb

@@ -4,8 +4,8 @@
 class CsvReader   ## note: uses a class for now - change to module - why? why not?
 
   MAJOR = 1    ## todo: namespace inside version or something - why? why not??
-  MINOR = 0
-  PATCH = 3
+  MINOR = 1
+  PATCH = 0
   VERSION = [MAJOR,MINOR,PATCH].join('.')
 
 

data/test/helper.rb

@@ -20,3 +20,4 @@ end
 
 ## CsvReader::ParserStd.logger.level    = :debug   ## turn on "global" logging
 ## CsvReader::ParserStrict.logger.level = :debug   ## turn on "global" logging
+## CsvReader::ParserFixed.logger.level = :debug   ## turn on "global" logging

data/test/test_parser_fixed.rb

@@ -0,0 +1,85 @@
+# encoding: utf-8
+
+###
+#  to run use
+#     ruby -I ./lib -I ./test test/test_parser_fixed.rb
+
+
+require 'helper'
+
+class TestParserFixed < MiniTest::Test
+
+
+def parser() CsvReader::Parser::FIXED;  end
+def reader() CsvReader.fixed;           end
+
+
+def test_width
+   width( parser )
+   width( reader )
+end
+
+def test_contacts
+   contacts( parser )
+   contacts( reader )
+end
+
+
+def width( parser )
+  records = [["12345678","12345678", "12345678901234567890123456789012", "12345678901234"]]
+
+  assert_equal records, parser.parse( <<TXT, width: [8,8,32,14] )
+# fixed width with comments and blank lines
+
+12345678123456781234567890123456789012345678901212345678901234
+
+TXT
+
+  assert_equal records, parser.parse( <<TXT, width: [8,8,32,14] )
+12345678123456781234567890123456789012345678901212345678901234
+TXT
+end
+
+
+def contacts( parser )
+  records = [["John",    "Smith",    "john@example.com",    "1-888-555-6666"],
+             ["Michele", "O'Reiley", "michele@example.com", "1-333-321-8765"]]
+
+  assert_equal records, parser.parse( <<TXT, width: [8,8,32,14] )
+# fixed width with comments and blank lines
+
+John    Smith   john@example.com                1-888-555-6666
+Michele O'Reileymichele@example.com             1-333-321-8765
+
+TXT
+
+
+   assert_equal records, parser.parse( <<TXT, width: [8,8,32,14] )
+John    Smith   john@example.com                1-888-555-6666
+Michele O'Reileymichele@example.com             1-333-321-8765
+TXT
+end
+
+
+def test_contacts
+  records = [["John",    "Smith",    "john@example.com",    "1-888-555-6666"],
+             ["Michele", "O'Reiley", "michele@example.com", "1-333-321-8765"]]
+
+  assert_equal records, parser.parse( <<TXT, width: [8,8,32,14] )
+# fixed width with comments and blank lines
+
+John    Smith   john@example.com                1-888-555-6666
+Michele O'Reileymichele@example.com             1-333-321-8765
+
+TXT
+
+
+   assert_equal records, parser.parse( <<TXT, width: [8,8,32,14] )
+John    Smith   john@example.com                1-888-555-6666
+Michele O'Reileymichele@example.com             1-333-321-8765
+TXT
+end
+
+
+
+end # class TestParserFixed

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: csvreader
 version: !ruby/object:Gem::Version
-  version: 1.0.3
+  version: 1.1.0
 platform: ruby
 authors:
 - Gerald Bauer
 autorequire: 
 bindir: bin
 cert_chain: []
-date: 2018-10-22 00:00:00.000000000 Z
+date: 2018-10-23 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: rdoc
@@ -60,6 +60,7 @@ files:
 - lib/csvreader/builder.rb
 - lib/csvreader/converter.rb
 - lib/csvreader/parser.rb
+- lib/csvreader/parser_fixed.rb
 - lib/csvreader/parser_json.rb
 - lib/csvreader/parser_std.rb
 - lib/csvreader/parser_strict.rb
@@ -77,6 +78,7 @@ files:
 - test/test_buffer.rb
 - test/test_converter.rb
 - test/test_parser.rb
+- test/test_parser_fixed.rb
 - test/test_parser_formats.rb
 - test/test_parser_java.rb
 - test/test_parser_meta.rb
@@ -89,7 +91,7 @@ files:
 - test/test_reader_hash.rb
 - test/test_reader_hash_converters.rb
 - test/test_samples.rb
-homepage: https://github.com/csv11/csvreader
+homepage: https://github.com/csvreader/csvreader
 licenses:
 - Public Domain
 metadata: {}