rubyzip 2.4.1 → 3.2.2

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (63) hide show
  1. checksums.yaml +4 -4
  2. data/Changelog.md +485 -0
  3. data/LICENSE.md +24 -0
  4. data/README.md +180 -40
  5. data/Rakefile +15 -13
  6. data/lib/zip/central_directory.rb +179 -125
  7. data/lib/zip/compressor.rb +3 -1
  8. data/lib/zip/constants.rb +29 -21
  9. data/lib/zip/crypto/aes_encryption.rb +120 -0
  10. data/lib/zip/crypto/decrypted_io.rb +20 -14
  11. data/lib/zip/crypto/encryption.rb +4 -2
  12. data/lib/zip/crypto/null_encryption.rb +5 -13
  13. data/lib/zip/crypto/traditional_encryption.rb +10 -6
  14. data/lib/zip/decompressor.rb +4 -3
  15. data/lib/zip/deflater.rb +12 -8
  16. data/lib/zip/dirtyable.rb +32 -0
  17. data/lib/zip/dos_time.rb +45 -5
  18. data/lib/zip/entry.rb +391 -264
  19. data/lib/zip/entry_set.rb +11 -9
  20. data/lib/zip/errors.rb +136 -16
  21. data/lib/zip/extra_field/aes.rb +50 -0
  22. data/lib/zip/extra_field/generic.rb +10 -11
  23. data/lib/zip/extra_field/ntfs.rb +6 -4
  24. data/lib/zip/extra_field/old_unix.rb +3 -1
  25. data/lib/zip/extra_field/universal_time.rb +3 -1
  26. data/lib/zip/extra_field/unix.rb +5 -3
  27. data/lib/zip/extra_field/unknown.rb +35 -0
  28. data/lib/zip/extra_field/zip64.rb +19 -5
  29. data/lib/zip/extra_field.rb +25 -23
  30. data/lib/zip/file.rb +174 -267
  31. data/lib/zip/file_split.rb +91 -0
  32. data/lib/zip/filesystem/dir.rb +86 -0
  33. data/lib/zip/filesystem/directory_iterator.rb +48 -0
  34. data/lib/zip/filesystem/file.rb +263 -0
  35. data/lib/zip/filesystem/file_stat.rb +110 -0
  36. data/lib/zip/filesystem/zip_file_name_mapper.rb +81 -0
  37. data/lib/zip/filesystem.rb +27 -596
  38. data/lib/zip/inflater.rb +11 -8
  39. data/lib/zip/input_stream.rb +76 -57
  40. data/lib/zip/ioextras/abstract_input_stream.rb +19 -13
  41. data/lib/zip/ioextras/abstract_output_stream.rb +13 -3
  42. data/lib/zip/ioextras.rb +7 -7
  43. data/lib/zip/null_compressor.rb +3 -1
  44. data/lib/zip/null_decompressor.rb +6 -3
  45. data/lib/zip/null_input_stream.rb +3 -1
  46. data/lib/zip/output_stream.rb +60 -57
  47. data/lib/zip/pass_thru_compressor.rb +3 -1
  48. data/lib/zip/pass_thru_decompressor.rb +8 -5
  49. data/lib/zip/streamable_directory.rb +3 -1
  50. data/lib/zip/streamable_stream.rb +4 -1
  51. data/lib/zip/version.rb +4 -1
  52. data/lib/zip.rb +25 -22
  53. data/rubyzip.gemspec +39 -0
  54. data/samples/example.rb +8 -3
  55. data/samples/example_filesystem.rb +3 -2
  56. data/samples/example_recursive.rb +3 -1
  57. data/samples/gtk_ruby_zip.rb +5 -3
  58. data/samples/qtzip.rb +7 -6
  59. data/samples/write_simple.rb +2 -1
  60. data/samples/zipfind.rb +1 -0
  61. metadata +86 -52
  62. data/TODO +0 -15
  63. data/lib/zip/extra_field/zip64_placeholder.rb +0 -15
data/README.md CHANGED
@@ -2,23 +2,22 @@
2
2
 
3
3
  [![Gem Version](https://badge.fury.io/rb/rubyzip.svg)](http://badge.fury.io/rb/rubyzip)
4
4
  [![Tests](https://github.com/rubyzip/rubyzip/actions/workflows/tests.yml/badge.svg)](https://github.com/rubyzip/rubyzip/actions/workflows/tests.yml)
5
- [![Code Climate](https://codeclimate.com/github/rubyzip/rubyzip.svg)](https://codeclimate.com/github/rubyzip/rubyzip)
5
+ [![Linter](https://github.com/rubyzip/rubyzip/actions/workflows/lint.yml/badge.svg)](https://github.com/rubyzip/rubyzip/actions/workflows/lint.yml)
6
+ [![Ruby Style Guide](https://img.shields.io/badge/code_style-rubocop-brightgreen.svg)](https://github.com/rubocop/rubocop)
7
+ [![Maintainability](https://qlty.sh/gh/rubyzip/projects/rubyzip/maintainability.svg)](https://qlty.sh/gh/rubyzip/projects/rubyzip)
6
8
  [![Coverage Status](https://img.shields.io/coveralls/rubyzip/rubyzip.svg)](https://coveralls.io/r/rubyzip/rubyzip?branch=master)
7
9
 
8
10
  Rubyzip is a ruby library for reading and writing zip files.
9
11
 
10
- ## Important note
11
-
12
- Rubyzip 2.4 is intended to be the last release in the 2.x series. Please get ready for version 3.0.
12
+ ## Important notes
13
13
 
14
14
  ### Updating to version 3.0
15
15
 
16
- The public API of some classes has been modernized to use named parameters for optional arguments. Also some methods have been changed or removed. Please check your usage of the following Rubyzip classes:
16
+ The public API of some classes has been modernized to use named parameters for optional arguments. Please check your usage of the following Rubyzip classes:
17
17
  * `File`
18
18
  * `Entry`
19
19
  * `InputStream`
20
20
  * `OutputStream`
21
- * `DOSTime`
22
21
 
23
22
  **Please see [Updating to version 3.x](https://github.com/rubyzip/rubyzip/wiki/Updating-to-version-3.x) in the wiki for details.**
24
23
 
@@ -57,7 +56,7 @@ input_filenames = ['image.jpg', 'description.txt', 'stats.csv']
57
56
 
58
57
  zipfile_name = "/Users/me/Desktop/archive.zip"
59
58
 
60
- Zip::File.open(zipfile_name, Zip::File::CREATE) do |zipfile|
59
+ Zip::File.open(zipfile_name, create: true) do |zipfile|
61
60
  input_filenames.each do |filename|
62
61
  # Two arguments:
63
62
  # - The name of the file as it will appear in the archive
@@ -68,6 +67,48 @@ Zip::File.open(zipfile_name, Zip::File::CREATE) do |zipfile|
68
67
  end
69
68
  ```
70
69
 
70
+ ### Creating a Zip file with `Zip::OutputStream`
71
+
72
+ ```ruby
73
+ require 'rubygems'
74
+ require 'zip'
75
+
76
+ Zip::OutputStream.open('archive.zip') do |zos|
77
+ # Quick.
78
+ zos.put_next_entry('greeting.txt')
79
+ zos << 'Hello, World!'
80
+
81
+ # More control.
82
+ # You MUST NOT make any calls on your `Entry` after calling `put_next_entry`.
83
+ entry = Zip::Entry.new(nil, 'parting.txt')
84
+ entry.atime = Time.now
85
+ zos.put_next_entry(entry)
86
+ zos.write('TTFN')
87
+ end
88
+ ```
89
+
90
+ You can generate a Zip archive in memory using `Zip::OutputStream.write_buffer`.
91
+
92
+ ### Suppressing extra fields
93
+
94
+ If you wish to suppress extra fields from being added to your entries, you can do so by passing the `suppress_extra_fields` parameter to any of the archive opening calls within `Zip::File` or `Zip::OutputStream`, e.g.:
95
+
96
+ ```ruby
97
+ # Suppress all extra fields.
98
+ Zip::File.open('archive.zip', create: true, suppress_extra_fields: true)
99
+ Zip::OutputStream.open('archive.zip', suppress_extra_fields: true)
100
+
101
+ # Suppress an individual extra field.
102
+ Zip::File.open('archive.zip', create: true, suppress_extra_fields: :zip64)
103
+ Zip::OutputStream.open('archive.zip', suppress_extra_fields: :zip64)
104
+
105
+ # Suppress multiple extra fields.
106
+ Zip::File.open('archive.zip', create: true, suppress_extra_fields: [:ntfs, :zip64])
107
+ Zip::OutputStream.open('archive.zip', suppress_extra_fields: [:ntfs, :zip64])
108
+ ```
109
+
110
+ Note that there are some extra fields that cannot be suppressed at all (e.g. `:aes`), and some which will only be suppressed if it is safe to do so (e.g. `:zip64`).
111
+
71
112
  ### Zipping a directory recursively
72
113
 
73
114
  Copy from [here](https://github.com/rubyzip/rubyzip/blob/9d891f7353e66052283562d3e252fe380bb4b199/samples/example_recursive.rb)
@@ -96,7 +137,7 @@ class ZipFileGenerator
96
137
  def write
97
138
  entries = Dir.entries(@input_dir) - %w[. ..]
98
139
 
99
- ::Zip::File.open(@output_file, ::Zip::File::CREATE) do |zipfile|
140
+ ::Zip::File.open(@output_file, create: true) do |zipfile|
100
141
  write_entries entries, '', zipfile
101
142
  end
102
143
  end
@@ -129,9 +170,9 @@ class ZipFileGenerator
129
170
  end
130
171
  ```
131
172
 
132
- ### Save zip archive entries in sorted by name state
173
+ ### Save zip archive entries sorted by name
133
174
 
134
- To save zip archives in sorted order like below, you need to set `::Zip.sort_entries` to `true`
175
+ To save zip archives with their entries sorted by name (see below), set `::Zip.sort_entries` to `true`
135
176
 
136
177
  ```
137
178
  Vegetable/
@@ -145,7 +186,7 @@ fruit/mango
145
186
  fruit/orange
146
187
  ```
147
188
 
148
- After this, entries in the zip archive will be saved in ordered state.
189
+ Opening an existing zip file with this option set will not change the order of the entries automatically. Altering the zip file - adding an entry, renaming an entry, adding or changing the archive comment, etc - will cause the ordering to be applied when closing the file.
149
190
 
150
191
  ### Default permissions of zip archives
151
192
 
@@ -181,28 +222,79 @@ Zip::File.open('foo.zip') do |zip_file|
181
222
  end
182
223
  ```
183
224
 
184
- #### Notice about ::Zip::InputStream
225
+ ### Reading a Zip file with `Zip::InputStream`
226
+
227
+ `Zip::InputStream` can be used for faster reading of zip file content because it does not read the Central directory up front.
228
+
229
+ There is one exception where it can not work however, and this is if the file does not contain enough information in the local entry headers to extract an entry. This is indicated in an entry by the General Purpose Flag bit 3 being set.
185
230
 
186
- `::Zip::InputStream` usable for fast reading zip file content because it not read Central directory.
231
+ > If bit 3 (0x08) of the general-purpose flags field is set, then the CRC-32 and file sizes are not known when the header is written. The fields in the local header are filled with zero, and the CRC-32 and size are appended in a 12-byte structure (optionally preceded by a 4-byte signature) immediately after the compressed data.
187
232
 
188
- But there is one exception when it is not working - General Purpose Flag Bit 3.
233
+ If `Zip::InputStream` finds such an entry in the zip archive it will raise an exception (`Zip::StreamingError`).
189
234
 
190
- > If bit 3 (0x08) of the general-purpose flags field is set, then the CRC-32 and file sizes are not known when the header is written. The fields in the local header are filled with zero, and the CRC-32 and size are appended in a 12-byte structure (optionally preceded by a 4-byte signature) immediately after the compressed data
235
+ `Zip::InputStream` is not designed to be used for random access in a zip file. When performing any operations on an entry that you are accessing via `Zip::InputStream#get_next_entry` then you should complete any such operations before the next call to `get_next_entry`.
236
+
237
+ ```ruby
238
+ Zip::InputStream.open('file.zip') do |zip_stream|
239
+ while entry = zip_stream.get_next_entry
240
+ # All required operations on `entry` go here.
241
+ end
242
+ end # The `InputStream` is closed at the end of the block.
243
+ ```
191
244
 
192
- If `::Zip::InputStream` finds such entry in the zip archive it will raise an exception.
245
+ Any attempt to move about in a zip file opened with `Zip::InputStream` could result in the incorrect entry being accessed and/or Zlib buffer errors. If you need random access in a zip file, use `Zip::File`.
193
246
 
194
- ### Password Protection (Experimental)
247
+ ### Password Protection (experimental)
248
+
249
+ Rubyzip supports reading zip files with AES encryption (version 3.1 and later), and reading and writing zip files with traditional zip encryption (a.k.a. "ZipCrypto"). Encryption is currently only available with the stream API, with either files or buffers, e.g.:
250
+
251
+ #### Version 2.x (ZipCrypto only)
252
+
253
+ ```ruby
254
+ # Writing.
255
+ enc = Zip::TraditionalEncrypter.new('password')
256
+ buffer = Zip::OutputStream.write_buffer(::StringIO.new(''), enc) do |output|
257
+ output.put_next_entry("my_file.txt")
258
+ output.write my_data
259
+ end
260
+
261
+ # Reading.
262
+ dec = Zip::TraditionalDecrypter.new('password')
263
+ Zip::InputStream.open(buffer, 0, dec) do |input|
264
+ entry = input.get_next_entry
265
+ puts "Contents of '#{entry.name}':"
266
+ puts input.read
267
+ end
268
+ ```
195
269
 
196
- Rubyzip supports reading/writing zip files with traditional zip encryption (a.k.a. "ZipCrypto"). AES encryption is not yet supported. It can be used with buffer streams, e.g.:
270
+ #### Version 3.x (AES reading and ZipCrypto read/write)
197
271
 
198
272
  ```ruby
199
- Zip::OutputStream.write_buffer(::StringIO.new, Zip::TraditionalEncrypter.new('password')) do |out|
200
- out.put_next_entry("my_file.txt")
201
- out.write my_data
202
- end.string
273
+ # Reading AES, version 3.1 and later.
274
+ dec = Zip::AESDecrypter.new('password', Zip::AESEncryption::STRENGTH_256_BIT)
275
+ Zip::InputStream.open('aes-encrypted-file.zip', decrypter: dec) do |input|
276
+ entry = input.get_next_entry
277
+ puts "Contents of '#{entry.name}':"
278
+ puts input.read
279
+ end
280
+
281
+ # Writing.
282
+ enc = Zip::TraditionalEncrypter.new('password')
283
+ buffer = Zip::OutputStream.write_buffer(encrypter: enc) do |output|
284
+ output.put_next_entry("my_file.txt")
285
+ output.write my_data
286
+ end
287
+
288
+ # Reading.
289
+ dec = Zip::TraditionalDecrypter.new('password')
290
+ Zip::InputStream.open(buffer, decrypter: dec) do |input|
291
+ entry = input.get_next_entry
292
+ puts "Contents of '#{entry.name}':"
293
+ puts input.read
294
+ end
203
295
  ```
204
296
 
205
- This is an experimental feature and the interface for encryption may change in future versions.
297
+ _This is an evolving feature and the interface for encryption may change in future versions._
206
298
 
207
299
  ## Known issues
208
300
 
@@ -216,7 +308,7 @@ buffer = Zip::OutputStream.write_buffer do |out|
216
308
  unless [DOCUMENT_FILE_PATH, RELS_FILE_PATH].include?(e.name)
217
309
  out.put_next_entry(e.name)
218
310
  out.write e.get_input_stream.read
219
- end
311
+ end
220
312
  end
221
313
 
222
314
  out.put_next_entry(DOCUMENT_FILE_PATH)
@@ -296,25 +388,37 @@ Zip.validate_entry_sizes = false
296
388
 
297
389
  Note that if you use the lower level `Zip::InputStream` interface, `rubyzip` does *not* check the entry `size`s. In this case, the caller is responsible for making sure it does not read more data than expected from the input stream.
298
390
 
299
- ### Default Compression
391
+ ### Compression level
392
+
393
+ When adding entries to a zip archive you can set the compression level to trade-off compressed size against compression speed. By default this is set to the same as the underlying Zlib library's default (`Zlib::DEFAULT_COMPRESSION`), which is somewhere in the middle.
300
394
 
301
- You can set the default compression level like so:
395
+ You can configure the default compression level with:
302
396
 
303
397
  ```ruby
304
- Zip.default_compression = Zlib::DEFAULT_COMPRESSION
398
+ Zip.default_compression = X
305
399
  ```
306
400
 
307
- It defaults to `Zlib::DEFAULT_COMPRESSION`. Possible values are `Zlib::BEST_COMPRESSION`, `Zlib::DEFAULT_COMPRESSION` and `Zlib::NO_COMPRESSION`
401
+ Where X is an integer between 0 and 9, inclusive. If this option is set to 0 (`Zlib::NO_COMPRESSION`) then entries will be stored in the zip archive uncompressed. A value of 1 (`Zlib::BEST_SPEED`) gives the fastest compression and 9 (`Zlib::BEST_COMPRESSION`) gives the smallest compressed file size.
402
+
403
+ This can also be set for each archive as an option to `Zip::File`:
404
+
405
+ ```ruby
406
+ Zip::File.open('foo.zip', create:true, compression_level: 9) do |zip|
407
+ zip.add ...
408
+ end
409
+ ```
308
410
 
309
411
  ### Zip64 Support
310
412
 
311
- By default, Zip64 support is disabled for writing. To enable it do this:
413
+ Since version 3.0, Zip64 support is enabled for writing by default. To disable it do this:
312
414
 
313
415
  ```ruby
314
- Zip.write_zip64_support = true
416
+ Zip.write_zip64_support = false
315
417
  ```
316
418
 
317
- _NOTE_: If you will enable Zip64 writing then you will need zip extractor with Zip64 support to extract archive.
419
+ Prior to version 3.0, Zip64 support is disabled for writing by default.
420
+
421
+ _NOTE_: If Zip64 write support is enabled then any extractor subsequently used may also require Zip64 support to read from the resultant archive.
318
422
 
319
423
  ### Block Form
320
424
 
@@ -329,15 +433,50 @@ You can set multiple settings at the same time by using a block:
329
433
  end
330
434
  ```
331
435
 
436
+ ## Compatibility
437
+
438
+ Rubyzip is known to run on a number of platforms and under a number of different Ruby versions.
439
+
440
+ ### Version 2.4.x
441
+
442
+ Rubyzip 2.4 is known to work on MRI 2.4 to 3.4 on Linux and Mac, and JRuby and Truffleruby on Linux. There are known issues with Windows which have been fixed on the development branch. Please [let us know](https://github.com/rubyzip/rubyzip/pulls) if you know Rubyzip 2.4 works on a platform/Ruby combination not listed here, or [raise an issue](https://github.com/rubyzip/rubyzip/issues) if you see a failure where we think it should work.
443
+
444
+ ### Version 3.x
445
+
446
+ Please see the table below for what we think the current situation is. Note: an empty cell means "unknown", not "does not work".
447
+
448
+ | OS/Ruby | 3.0 | 3.1 | 3.2 | 3.3 | 3.4 | Head | JRuby 10.0.1.0 | JRuby Head | Truffleruby 24.2.1 | Truffleruby Head |
449
+ |---------|-----|-----|-----|-----|-----|------|---------------|------------|--------------------|------------------|
450
+ |Ubuntu 24.04| CI | CI | CI | CI | CI | ci | CI | ci | CI | ci |
451
+ |Mac OS 14.7.6| CI | CI | CI | CI | CI | ci | x | | x | |
452
+ |Windows Server 2022| CI | | | | CI&nbsp;mswin</br>CI&nbsp;ucrt | | | | | |
453
+
454
+ Key: `CI` - tested in CI, should work; `ci` - tested in CI, might fail; `x` - known working; `o` - known failing.
455
+
456
+ Rubies 3.1+ are also tested separately with YJIT turned on (Ubuntu and Mac OS).
457
+
458
+ See [the Actions tab](https://github.com/rubyzip/rubyzip/actions) in GitHub for full details.
459
+
460
+ Please [raise a PR](https://github.com/rubyzip/rubyzip/pulls) if you know Rubyzip works on a platform/Ruby combination not listed here, or [raise an issue](https://github.com/rubyzip/rubyzip/issues) if you see a failure where we think it should work.
461
+
332
462
  ## Developing
333
463
 
334
- To run the test you need to do this:
464
+ Install the dependencies:
335
465
 
336
- ```
466
+ ```shell
337
467
  bundle install
468
+ ```
469
+
470
+ Run the tests with `rake`:
471
+
472
+ ```shell
338
473
  rake
339
474
  ```
340
475
 
476
+ Please also run `rubocop` over your changes.
477
+
478
+ Our CI runs on [GitHub Actions](https://github.com/rubyzip/rubyzip/actions). Please note that `rubocop` is run as part of the CI configuration and will fail a build if errors are found.
479
+
341
480
  ## Website and Project Home
342
481
 
343
482
  http://github.com/rubyzip/rubyzip
@@ -346,17 +485,18 @@ http://rdoc.info/github/rubyzip/rubyzip/master/frames
346
485
 
347
486
  ## Authors
348
487
 
349
- Alexander Simonov ( alex at simonov.me)
488
+ See https://github.com/rubyzip/rubyzip/graphs/contributors for a comprehensive list.
350
489
 
351
- Alan Harper ( alan at aussiegeek.net)
490
+ ### Current maintainers
352
491
 
353
- Thomas Sondergaard (thomas at sondergaard.cc)
492
+ * Robert Haines (@hainesr)
493
+ * John Lees-Miller (@jdleesmiller)
494
+ * Oleksandr Simonov (@simonoff)
354
495
 
355
- Technorama Ltd. (oss-ruby-zip at technorama.net)
496
+ ### Original author
356
497
 
357
- extra-field support contributed by Tatsuki Sugiura (sugi at nemui.org)
498
+ * Thomas Sondergaard
358
499
 
359
500
  ## License
360
501
 
361
- Rubyzip is distributed under the same license as ruby. See
362
- http://www.ruby-lang.org/en/LICENSE.txt
502
+ Rubyzip is distributed under the same license as Ruby. In practice this means you can use it under the terms of the Ruby License or the 2-Clause BSD License. See https://www.ruby-lang.org/en/about/license.txt and LICENSE.md for details.
data/Rakefile CHANGED
@@ -1,21 +1,23 @@
1
+ # frozen_string_literal: true
2
+
1
3
  require 'bundler/gem_tasks'
2
- require 'rake/testtask'
4
+ require 'minitest/test_task'
5
+ require 'rdoc/task'
3
6
  require 'rubocop/rake_task'
4
7
 
5
8
  task default: :test
6
9
 
7
- Rake::TestTask.new(:test) do |test|
8
- test.libs << 'lib'
9
- test.libs << 'test'
10
- test.pattern = 'test/**/*_test.rb'
11
- test.verbose = true
10
+ Minitest::TestTask.create do |test|
11
+ test.framework = 'require "simplecov"'
12
+ test.test_globs = 'test/**/*_test.rb'
12
13
  end
13
14
 
14
- RuboCop::RakeTask.new
15
+ RDoc::Task.new do |rdoc|
16
+ rdoc.main = 'README.md'
17
+ rdoc.rdoc_files.include('README.md', 'lib/**/*.rb')
18
+ rdoc.options << '--markup=markdown'
19
+ rdoc.options << '--tab-width=2'
20
+ rdoc.options << "-t Rubyzip version #{Zip::VERSION}"
21
+ end
15
22
 
16
- # Rake::TestTask.new(:zip64_full_test) do |test|
17
- # test.libs << File.join(File.dirname(__FILE__), 'lib')
18
- # test.libs << File.join(File.dirname(__FILE__), 'test')
19
- # test.pattern = File.join(File.dirname(__FILE__), 'test/zip64_full_test.rb')
20
- # test.verbose = true
21
- # end
23
+ RuboCop::RakeTask.new