simple_xlsx_reader 4.0.1 → 5.1.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: f5e0de15ab326f027127322eac9d88d752ffd2d55797df23ed525a7eea1d9833
-  data.tar.gz: 415972aaf4f77e4bdb5e60b0095cf01f6d7e24a0cd28d493c8ad8d01fa50d66b
+  metadata.gz: f779f6e272fd4b79b2da180f31eb71b40e51b25d96f50fa72180908472c56750
+  data.tar.gz: 6bd6d85c61aaede6aebbe24f88b8fcc8a4018345581a3793e6e3a89a7bc285ab
 SHA512:
-  metadata.gz: cfea3adb62767bedfe6470377b54078066b1bf07e13c065160a31c260261f65a658c34c37dc850c01dd27ba7038a4261f1a6ea9c6ff42771e8113dbabc51897b
-  data.tar.gz: a4b996c3d15b2f54a61d8fc90366ba502d6bc108b1bfe5ed34b9d46f63fe7c52381f181421cc31eea46b7c73e6925d3aa3cfeb8e1b737021be93e4863ea9e703
+  metadata.gz: 63b52b5835fe344b7a8116c6217c6df2f1ec9e68b2876212dec1b08a22dc33549f81905079d7ccea8f2612455e70ab1719aad82229d4fbc00d6da92e4c1ca7a1
+  data.tar.gz: e9e615a600b5bd19c7510fc1b0cbd42e2a2a5494ca9da63be9de813b1bedff73045faa3d0b2f2c8c7b6a7eefecc1219fbbcf6a9f79971b30ba2f8e8c7417cdd8

data/.github/dependabot.yml

@@ -0,0 +1,6 @@
+version: 2
+updates:
+  - package-ecosystem: "github-actions"
+    directory: "/"
+    schedule:
+      interval: "weekly"

data/.github/workflows/ruby.yml

@@ -22,10 +22,10 @@ jobs:
     runs-on: ubuntu-latest
     strategy:
       matrix:
-        ruby-version: ['2.6', '2.7', '3.0', '3.1', '3.2']
+        ruby-version: ['2.6', '2.7', '3.0', '3.1', '3.2', '3.3']
 
     steps:
-    - uses: actions/checkout@v3
+    - uses: actions/checkout@v4
     - name: Set up Ruby
       uses: ruby/setup-ruby@v1
       with:

data/CHANGELOG.md

@@ -1,3 +1,19 @@
+### 5.1.0
+
+* Parse sheets containing namespaces and no 'r' att (@skipchris)
+* Fix Zlib error when loading from string (@myabc)
+* Prevent a SimpleXlsxReader::CellLoadError (no implicit conversion of Integer
+  into String) when the casted value (friendly name) is not a string (@tsdbrown)
+* Accidental 25% perfarmance improvement while experimenting with namespace
+  support (see #53f5a9).
+
+### 5.0.0
+
+* Change SimpleXlsxReader::Hyperlink to default to the visible cell value
+  instead of the hyperlink URL, which in the case of mailto hyperlinks is
+  surprising.
+* Fix blank content when parsing docs from string (@codemole)
+
 ### 4.0.1
 
 * Fix nil error when handling some inline strings

data/README.md

@@ -9,15 +9,17 @@ then forgotten. We just want to get the data, and get out!
 
 ## Summary (now with stream parsing):
 
-    doc = SimpleXlsxReader.open('/path/to/workbook.xlsx')
-    doc.sheets # => [<#SXR::Sheet>, ...]
-    doc.sheets.first.name # 'Sheet1'
-    doc.sheets.first.rows # <SXR::Document::RowsProxy>
-    doc.sheets.first.rows.each # an <Enumerator> ready to chain or stream
-    doc.sheets.first.rows.each {} # Streams the rows to your block
-    doc.sheets.first.rows.each(headers: true) {} # Streams row-hashes
-    doc.sheets.first.rows.each(headers: {id: /ID/}) {} # finds & maps headers, streams
-    doc.sheets.first.rows.slurp # Slurps rows into memory as a 2D array
+```ruby
+doc = SimpleXlsxReader.open('/path/to/workbook.xlsx')
+doc.sheets # => [<#SXR::Sheet>, ...]
+doc.sheets.first.name # 'Sheet1'
+rows = doc.sheets.first.rows # <SXR::Document::RowsProxy>
+rows.each # an <Enumerator> ready to chain or stream
+rows.each {} # Streams the rows to your block
+rows.each(headers: true) {} # Streams row-hashes
+rows.each(headers: {id: /ID/}) {} # finds & maps headers, streams
+rows.slurp # Slurps rows into memory as a 2D array
+```
 
 That's the gist of it!
 
@@ -29,7 +31,8 @@ See also the [Document](https://github.com/woahdae/simple_xlsx_reader/blob/2.0.0
 
 This project was started years ago, primarily because other Ruby xlsx parsers
 didn't import data with the correct types. Numbers as strings, dates as numbers,
-hyperlinks with inaccessible URLs, or - subtly buggy - simple dates as DateTime
+[hyperlinks](https://github.com/woahdae/simple_xlsx_reader/blob/master/lib/simple_xlsx_reader/hyperlink.rb)
+with inaccessible URLs, or - subtly buggy - simple dates as DateTime
 objects. If your app uses a timezone offset, depending on what timezone and
 what time of day you load the xlsx file, your dates might end up a day off!
 SimpleXlsxReader understands all these correctly.
@@ -39,12 +42,14 @@ SimpleXlsxReader understands all these correctly.
 Many Ruby xlsx parsers seem to be inspired more by Excel than Ruby, frankly.
 SimpleXlsxReader strives to be fairly idiomatic Ruby:
 
-    # quick example having fun w/ ruby
-    doc = SimpleXlsxReader.open(path_or_io)
-    doc.sheets.first.rows.each(headers: {id: /ID/})
-      .with_index.with_object({}) do |(row, index), acc|
-        acc[row[:id]] = index
-      end
+```ruby
+# quick example having fun w/ ruby
+doc = SimpleXlsxReader.open(file_path) # or SimpleXlsxReader.parse(string_or_io)
+doc.sheets.first.rows.each(headers: {id: /ID/})
+  .with_index.with_object({}) do |(row, index), acc|
+    acc[row[:id]] = index
+end
+```
 
 ### Now faster
 
@@ -77,15 +82,19 @@ If you had an excel sheet representing this data:
 
 Get a handle on the rows proxy:
 
-`rows = SimpleXlsxReader.open('suited_heroes.xlsx').sheets.first.rows`
+```ruby
+rows = SimpleXlsxReader.open('suited_heroes.xlsx').sheets.first.rows
+```
 
 Simple streaming (kinda boring):
 
-`rows.each { |row| ... }`
+```ruby
+rows.each { |row| ... }
+````
 
 Streaming with headers, and how about a little enumerable chaining:
 
-```
+```ruby
 # Map of hero names by ID: { 117 => 'John Halo', ... }
 
 rows.each(headers: true).with_object({}) do |row, acc|
@@ -108,7 +117,7 @@ Sometimes though you have some junk at the top of your spreadsheet:
 For this, `headers` can be a hash whose keys replace headers and whose values
 help find the correct header row:
 
-```
+```ruby
 # Same map of hero names by ID: { 117 => 'John Halo', ... }
 
 rows.each(headers: {id: /ID/, name: /Name/}).with_object({}) do |row, acc|
@@ -119,7 +128,7 @@ end
 If your header-to-attribute mapping is more complicated than key/value, you
 can do the mapping elsewhere, but use a block to find the header row:
 
-```
+```ruby
 # Example roughly analogous to some production code mapping a single spreadsheet
 # across many objects. Might be a simpler way now that we have the headers-hash
 # feature.
@@ -168,9 +177,11 @@ can set `SimpleXlsxReader.configuration.catch_cell_load_errors =
 true`, and load errors will instead be inserted into Sheet#load_errors keyed
 by [rownum, colnum]:
 
-    {
-      [rownum, colnum] => '[error]'
-    }
+```ruby
+{
+  [rownum, colnum] => '[error]'
+}
+```
 
 ### Performance
 
@@ -233,11 +244,9 @@ This project follows [semantic versioning 1.0](http://semver.org/spec/v1.0.0.htm
 Remember to write tests, think about edge cases, and run the existing
 suite.
 
-Note that as of commit 665cbafdde, the most extreme end of the
-linear-time performance test, which is 10,000 rows (12 columns), runs in
-~4 seconds on Ruby 2.1 on a 2012 MBP. If the linear time assertion fails
-or you're way off that, there is probably a performance regression in
-your code.
+The full suite contains a performance test that on an M1 MBP runs the final
+large file in about five seconds. Check out that test before & after your
+change to check for performance changes.
 
 Then, the standard stuff:
 

data/lib/simple_xlsx_reader/hyperlink.rb

@@ -4,27 +4,26 @@ module SimpleXlsxReader
   # We support hyperlinks as a "type" even though they're technically
   # represented either as a function or an external reference in the xlsx spec.
   #
-  # Since having hyperlink data in our sheet usually means we might want to do
-  # something primarily with the URL (store it in the database, download it, etc),
-  # we go through extra effort to parse the function or follow the reference
-  # to represent the hyperlink primarily as a URL. However, maybe we do want
-  # the hyperlink "friendly name" part (as MS calls it), so here we've subclassed
-  # string to tack on the friendly name. This means 80% of us that just want
-  # the URL value will have to do nothing extra, but the 20% that might want the
-  # friendly name can access it.
+  # In practice, hyperlinks are usually a link or a mailto. In the case of a
+  # link, we probably want to follow it to download something, but in the case
+  # of an email, we probably just want the email and not the mailto. So we
+  # represent a hyperlink primarily as it is seen by the user, following the
+  # principle of least surprise, but the url is accessible via #url.
   #
-  # Note, by default, the value we would get by just asking the cell would
-  # be the "friendly name" and *not* the URL, which is tucked away in the
-  # function definition or a separate "relationships" meta-document.
+  # Microsoft calls the visible part of a hyperlink cell the "friendly name,"
+  # so we expose that as a method too, in case you want to be explicit about
+  # how you're accessing it.
   #
   # See MS documentation on the HYPERLINK function for some background:
   # https://support.office.com/en-us/article/HYPERLINK-function-333c7ce6-c5ae-4164-9c47-7de9b76f577f
   class Hyperlink < String
     attr_reader :friendly_name
+    attr_reader :url
 
     def initialize(url, friendly_name = nil)
-      @friendly_name = friendly_name
-      super(url)
+      @url = url
+      @friendly_name = friendly_name&.to_s
+      super(@friendly_name || @url)
     end
   end
 end

data/lib/simple_xlsx_reader/loader/sheet_parser.rb

@@ -31,9 +31,11 @@ module SimpleXlsxReader
         @url = nil # silence warnings
         @function = nil # silence warnings
         @capture = nil # silence warnings
+        @captured = nil # silence warnings
         @dimension = nil # silence warnings
+        @column_index = 0
 
-        @file_io.rewind # in case we've already parsed this once
+        @file_io.rewind # if it's IO from IO.read, we need to rewind it
 
         # In this project this is only used for GUI-made hyperlinks (as opposed
         # to FUNCTION-based hyperlinks). Unfortunately the're needed to parse
@@ -41,10 +43,12 @@ module SimpleXlsxReader
         # to just stream-parse the file twice, first for the hyperlinks at the
         # bottom of the file, then for the file itself. In the future it would
         # be clever to use grep to extract the xml into its own smaller file.
-        if xrels_file&.grep(/hyperlink/)&.any?
-          xrels_file.rewind
-          load_gui_hyperlinks # represented as hyperlinks_by_cell
-          @file_io.rewind
+        if xrels_file
+          if xrels_file.grep(/hyperlink/).any?
+            xrels_file.rewind
+            load_gui_hyperlinks # represented as hyperlinks_by_cell
+          end
+          @file_io.rewind # we've already parsed this once
         end
 
         Nokogiri::XML::SAX::Parser.new(self).parse(@file_io)
@@ -53,17 +57,20 @@ module SimpleXlsxReader
       ###
       # SAX document hooks
 
-      def start_element(name, attrs = [])
+      def start_element_namespace(name, attrs = [], _prefix, _uri, _ns)
         case name
-        when 'dimension' then @dimension = attrs.last.last
+        when 'dimension'
+          @dimension = attrs.last.value
         when 'row'
-          @current_row_num = attrs.find {|(k, v)| k == 'r'}&.last&.to_i
+          @current_row_num = attrs.find {|attr| attr.localname == 'r'}&.value&.to_i
           @current_row = Array.new(column_length)
+          @column_index = 0
         when 'c'
-          attrs = attrs.inject({}) {|acc, (k, v)| acc[k] = v; acc}
-          @cell_name = attrs['r']
+          attrs = attrs.inject({}) {|acc, attr| acc[attr.localname] = attr.value; acc}
+          @cell_name = attrs['r'] || column_number_to_letter(@column_index)
           @type = attrs['t']
           @style = attrs['s'] && style_types[attrs['s'].to_i]
+          @column_index += 1
         when 'f' then @function = true
         when 'v', 't' then @capture = true
         end
@@ -114,7 +121,7 @@ module SimpleXlsxReader
         @captured = @captured ? @captured + (captured || '') : captured
       end
 
-      def end_element(name)
+      def end_element_namespace(name, _prefix, _uri)
         case name
         when 'row'
           if @headers == true # ya a little funky
@@ -208,10 +215,10 @@ module SimpleXlsxReader
           @hyperlinks_by_cell
         end
 
-        def start_element(name, attrs)
+        def start_element_namespace(name, attrs, _prefix, _uri, _ns)
           case name
           when 'hyperlink'
-            attrs = attrs.inject({}) {|acc, (k, v)| acc[k] = v; acc}
+            attrs = attrs.inject({}) {|acc, attr| acc[attr.localname] = attr.value; acc}
             id = attrs['id'] || attrs['r:id']
 
             @hyperlinks_by_cell[attrs['ref']] =
@@ -264,6 +271,16 @@ module SimpleXlsxReader
         end
         result
       end
+
+      def column_number_to_letter(n)
+        result = []
+        loop do
+          result.unshift((n % 26 + 65).chr)
+          n = (n / 26) - 1
+          break if n < 0
+        end
+        result.join
+      end
     end
   end
 end

data/lib/simple_xlsx_reader/version.rb

@@ -1,5 +1,5 @@
 # frozen_string_literal: true
 
 module SimpleXlsxReader
-  VERSION = '4.0.1'
+  VERSION = '5.1.0'
 end

data/test/namespaces_and_missing_atts_test.rb

@@ -0,0 +1,63 @@
+# frozen_string_literal: true
+
+require_relative 'test_helper'
+
+describe SimpleXlsxReader do
+  # Based on a real-world sheet possibly generated by PowerBI, where the xml
+  # has namespacing and rows are missing the 'r' attribute.
+  let(:sheet) do
+    <<~XML
+      <?xml version="1.0" encoding="utf-8"?>
+      <x:worksheet xmlns:x="http://schemas.openxmlformats.org/spreadsheetml/2006/main">
+        <x:sheetData>
+          <x:row>
+            <x:c s="2" t="inlineStr">
+              <x:is>
+                <x:t>Salmon</x:t>
+              </x:is>
+            </x:c>
+            <x:c s="2" t="inlineStr">
+              <x:is>
+                <x:t>Trout</x:t>
+              </x:is>
+            </x:c>
+          </x:row>
+          <x:row>
+            <x:c s="2" t="inlineStr">
+              <x:is>
+                <x:t>Cat</x:t>
+              </x:is>
+            </x:c>
+            <x:c s="2" t="inlineStr">
+              <x:is>
+                <x:t>Dog</x:t>
+              </x:is>
+            </x:c>
+          </x:row>
+        </x:sheetData>
+      </x:worksheet>
+    XML
+  end
+
+  let(:styles) do
+    <<~XML
+      <?xml version="1.0" encoding="utf-8"?><x:styleSheet xmlns:x="http://schemas.openxmlformats.org/spreadsheetml/2006/main"><x:numFmts><x:numFmt numFmtId="181" formatCode="0" /><x:numFmt numFmtId="182" formatCode="m/d/yyyy h:mm:ss AM/PM" /><x:numFmt numFmtId="183" formatCode="dd MMMM yyyy" /></x:numFmts><x:fonts><x:font /><x:font><x:b /></x:font></x:fonts><x:fills><x:fill><x:patternFill patternType="none" /></x:fill><x:fill><x:patternFill patternType="gray125" /></x:fill></x:fills><x:borders><x:border /><x:border><x:bottom style="thin" /></x:border><x:border><x:right style="thin" /></x:border></x:borders><x:cellXfs><x:xf /><x:xf fontId="1" /><x:xf borderId="1" /><x:xf fontId="1" borderId="1" /><x:xf borderId="2" /><x:xf fontId="1" borderId="2" /><x:xf><x:alignment vertical="top" /></x:xf><x:xf fontId="1"><x:alignment vertical="top" /></x:xf><x:xf numFmtId="181" /><x:xf numFmtId="182" /><x:xf numFmtId="183" /><x:xf numFmtId="182" fontId="1" /><x:xf numFmtId="181" fontId="1" /><x:xf numFmtId="183" fontId="1" /></x:cellXfs></x:styleSheet>
+    XML
+  end
+
+  let(:wonky_file) do
+    TestXlsxBuilder.new(
+      sheets: [sheet],
+      styles: styles
+    )
+  end
+
+  let(:subject) { SimpleXlsxReader::Document.new(wonky_file.archive.path) }
+
+  describe '#to_hash' do
+    it 'should extract values from namespaced cells missing "r" attributes' do
+      _(subject.sheets.first.rows.to_a[0]).must_include('Salmon')
+      _(subject.sheets.first.rows.to_a[1]).must_include('Dog')
+    end
+  end
+end

data/test/performance_test.rb

@@ -70,7 +70,7 @@ describe 'SimpleXlsxReader Benchmark' do
   let(:styles) do
     # s='0' above refers to the value of numFmtId at cellXfs index 0,
     # which is in this case 'General' type
-    styles =
+    _styles =
       <<-XML
         <styleSheet xmlns="http://schemas.openxmlformats.org/spreadsheetml/2006/main">
           <cellXfs count="1">

data/test/simple_xlsx_reader_test.rb

@@ -56,7 +56,7 @@ describe SimpleXlsxReader do
     end
 
     describe 'load from string' do
-      let(:subject) { SimpleXlsxReader.parse(sesame_street_blog_io) }
+      let(:subject) { SimpleXlsxReader.parse(sesame_street_blog_string) }
 
       it 'reads an xlsx string into a hash of {[sheet name] => [data]}' do
         _(subject.to_hash).must_equal(expected_result)
@@ -92,7 +92,7 @@ describe SimpleXlsxReader do
         body: 'The Greatest',
         created_at: Time.parse('2002-01-01 11:00:00 UTC'),
         count: 1,
-        "URL" => 'http://www.example.com/hyperlink-function'
+        "URL" => 'This uses the HYPERLINK() function'
       )
 
       _(rows.slurped?).must_equal false
@@ -611,6 +611,11 @@ describe SimpleXlsxReader do
           _(described_class.cast('2', 's', nil, shared_strings: %w[a b c], url: url))
             .must_equal SXR::Hyperlink.new(url, 'c')
         end
+
+        it 'creates a hyperlink with a fixnum friendly_name' do
+          _(described_class.cast('123', nil, :fixnum, url: url))
+            .must_equal SXR::Hyperlink.new(url, '123')
+        end
       end
     end
 
@@ -1031,6 +1036,52 @@ describe SimpleXlsxReader do
     end
   end
 
+  describe 'parsing documents with non-hyperlinked rels' do
+    let(:rels) do
+      [
+        Nokogiri::XML(
+          <<-XML
+          <?xml version="1.0" encoding="UTF-8"?>
+          <Relationships xmlns="http://schemas.openxmlformats.org/package/2006/relationships"></Relationships>
+          XML
+        ).remove_namespaces!
+      ]
+    end
+
+    describe 'when document is opened as path' do
+      before do
+        @row = SimpleXlsxReader.open(xlsx.archive.path).sheets[0].rows.to_a[0]
+      end
+
+      it 'reads cell content' do
+        _(@row[0]).must_equal 'Cell A'
+      end
+    end
+
+    describe 'when document is parsed as a String' do
+      before do
+        output = File.binread(xlsx.archive.path)
+        @row = SimpleXlsxReader.parse(output).sheets[0].rows.to_a[0]
+      end
+
+      it 'reads cell content' do
+        _(@row[0]).must_equal 'Cell A'
+      end
+    end
+
+    describe 'when document is parsed as StringIO' do
+      before do
+        stream = StringIO.new(File.binread(xlsx.archive.path), 'rb')
+        @row = SimpleXlsxReader.parse(stream).sheets[0].rows.to_a[0]
+        stream.close
+      end
+
+      it 'reads cell content' do
+        _(@row[0]).must_equal 'Cell A'
+      end
+    end
+  end
+
   # https://support.microsoft.com/en-us/office/available-number-formats-in-excel-0afe8f52-97db-41f1-b972-4b46e9f1e8d2
   describe 'numeric fields styled as "General"' do
     let(:misc_numbers_path) do

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: simple_xlsx_reader
 version: !ruby/object:Gem::Version
-  version: 4.0.1
+  version: 5.1.0
 platform: ruby
 authors:
 - Woody Peterson
 autorequire:
 bindir: bin
 cert_chain: []
-date: 2023-03-06 00:00:00.000000000 Z
+date: 2025-04-10 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: nokogiri
@@ -87,6 +87,7 @@ executables: []
 extensions: []
 extra_rdoc_files: []
 files:
+- ".github/dependabot.yml"
 - ".github/workflows/ruby.yml"
 - ".gitignore"
 - ".travis.yml"
@@ -115,6 +116,7 @@ files:
 - test/lower_case_sharedstrings.xlsx
 - test/lower_case_sharedstrings_test.rb
 - test/misc_numbers.xlsx
+- test/namespaces_and_missing_atts_test.rb
 - test/percentages_n_currencies.xlsx
 - test/performance_test.rb
 - test/sesame_street_blog.xlsx
@@ -142,7 +144,7 @@ required_rubygems_version: !ruby/object:Gem::Requirement
     - !ruby/object:Gem::Version
       version: '0'
 requirements: []
-rubygems_version: 3.3.7
+rubygems_version: 3.5.22
 signing_key:
 specification_version: 4
 summary: Read xlsx data the Ruby way
@@ -157,6 +159,7 @@ test_files:
 - test/lower_case_sharedstrings.xlsx
 - test/lower_case_sharedstrings_test.rb
 - test/misc_numbers.xlsx
+- test/namespaces_and_missing_atts_test.rb
 - test/percentages_n_currencies.xlsx
 - test/performance_test.rb
 - test/sesame_street_blog.xlsx