omnizip 0.3.19 → 0.3.20

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: affda0906d52a418254670adb02e96312d6e268d1df4aafbba575ade503edfbe
-  data.tar.gz: ae4e84af21221350bf4d67a1b295546674527e091b500a715cb96f8547870990
+  metadata.gz: dcad8b150c8f11ed823e029a054b9c7fb8efcd169482dacad067d6a9ea703d3b
+  data.tar.gz: af2b5cec7a79078f1068a148c2c7dc128bb1ec4241aef5a6f7c37058eee10adb
 SHA512:
-  metadata.gz: 91044c5b1067662c5177e2b8ca262ad0434e4a4cf94e9ea321251723499188fc4b57b3793e2ed88ce51ea406cdb1bfb6d31921ef3b08a7baaf4fd6e62102dc5b
-  data.tar.gz: b6614848a2eb450b748bca1d3d297b7bcd5751607124687237c75ebdeeb43b033ffe6d9af49af457e94aa1cace5ab615c3fe6d04f6a5bb3206a863249225ead6
+  metadata.gz: 3db9493020536b160e63d7519610761f18fb1e77624cb8ebc1ca941bd58be86872e05eafc3985ee53f5767ad84cc095b6013d8a2e25ed3fe22024ba85321b3f0
+  data.tar.gz: 83196c0c7630c1cbe05859ca027c7ea5245fcfee56eae2de85e2f7a484c1513d4cc3017885536d22d5fe38fcdcfd84727ed19f313201e7aa3d5190ccc9fe6667

data/CHANGELOG.md

@@ -5,6 +5,100 @@ All notable changes to this project will be documented in this file.
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+## [Unreleased]
+
+## [0.3.19] - 2026-08-25
+
+### Fixed
+- 7-Zip LZMA2 encoder corrupted every chunk after the first: pos_state was
+  computed from the chunk-relative position while decoders count positions
+  continuously across chunk boundaries. The stale duplicated encoder is now a
+  thin subclass of the fixed XZ Utils encoder (also picking up its state-reset,
+  64 KiB chunk-cap and symbol-queue fixes).
+
+## [0.3.18] - 2026-08-25
+
+### Added
+- Zstandard long-distance matching (LDM): a sparse hash table over the whole
+  frame finds matches beyond the 128 KiB block window at levels >= 19 for
+  multi-block inputs, bringing zstd-22 output to reference parity
+  (0.146 vs omnizip-rs 0.1456 on the benchmark corpus).
+
+## [0.3.17] - 2026-08-25
+
+### Changed
+- Zstandard greedy parser: rep0 fast-path and backward match extension into
+  the pending literals (default-level text ratio 0.177 -> 0.167).
+
+## [0.3.16] - 2026-08-24
+
+### Added
+- Zstandard Compressed_Blocks now carry a sequences section: LZ77 match
+  finder (greedy/lazy/lazy2) and LL/OF/ML FSE sequence encoding with
+  Predefined/FSE_Compressed table selection. Text ratio 0.49 -> ~0.17.
+
+### Changed
+- Migrated ConversionOptions, ParallelOptions, ProgressOptions and EtaResult
+  models to lutaml-model (breaking change for hand-rolled hash access).
+
+## [0.3.15] - 2026-08-24
+
+### Fixed
+- Zstandard codec rebuilt per RFC 8878: FSE tables from stream, FSE Huffman
+  weights, treeless literals, repeat mode, XXH64 frame checksums, window
+  descriptor; `compress` with default options now really compresses instead
+  of emitting stored frames (issues #27, BUGREPORT 01-10).
+- XZ LZMA2 encoder: chunking, repeat-offset state and wire format repaired
+  (issue #26; missing `tempfile` require, symbol-buffer overflow at ~10 MB).
+
+## [0.3.14] - 2026-07-25
+
+### Changed
+- Documented the Algorithms vs Implementations boundary; deepened the
+  Algorithm base class with a class-level facade and IO::Source/Sink.
+- Extracted `Omnizip::Parallel::Engine`.
+
+## [0.3.13] - 2026-07-24
+
+### Changed
+- Reverted the v0.3.12 require-omnizip-everywhere band-aid in favor of
+  per-file entry-point requires.
+
+## [0.3.12] - 2026-07-24
+
+### Fixed
+- Circular dependency at gemspec load (`version.rb` no longer requires
+  omnizip); missing entry-point requires at the top of internal files.
+
+## [0.3.11] - 2026-07-22
+
+### Fixed
+- Format files broke when required directly by external code; LinkHandler
+  symlink gating; BCJ filter autoload.
+
+## [0.3.10] - 2026-07-21
+
+### Changed
+- Migrated CompressionOptions and AlgorithmMetadata to lutaml-model;
+  decoupled Convenience from ZIP via ArchiveHandler; replaced `respond_to?`
+  type checks with `is_a?`.
+
+## [0.3.9] - 2026-03-24
+
+### Fixed
+- Windows unrar detection; 7-Zip SDK version validation (major version only).
+
+## [0.3.8] - 2026-02-24
+
+### Fixed
+- Formats now auto-register when their files are loaded directly.
+
+## [0.3.7] - 2026-02-23
+
+### Fixed
+- XZ dictionary-size bounds checking (OOM prevention); block header parser
+  autoload.
+
 ## [0.3.6] - 2026-02-23
 
 ### Changed
@@ -18,8 +112,6 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 - Fixed RAR format `verify` and `repair` convenience methods
 - Fixed library loading to ensure convenience methods are available at startup
 
-## [Unreleased]
-
 ### Added
 - **XAR Format Support**: Full read/write support for XAR (eXtensible ARchive) format
   - XAR is primarily used on macOS for software packages (.pkg files) and installers
@@ -594,4 +686,4 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
   - Native compression support documented
   - All 6 compression methods explained
   - Performance characteristics detailed
-  - Real-world usage examples
+  - Real-world usage examples

data/lib/omnizip/version.rb

@@ -1,5 +1,5 @@
 # frozen_string_literal: true
 
 module Omnizip
-  VERSION = "0.3.19"
+  VERSION = "0.3.20"
 end

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: omnizip
 version: !ruby/object:Gem::Version
-  version: 0.3.19
+  version: 0.3.20
 platform: ruby
 authors:
 - Ribose Inc.
@@ -298,8 +298,6 @@ files:
 - lib/omnizip/algorithms/ppmd8/restoration_method.rb
 - lib/omnizip/algorithms/ppmd_base.rb
 - lib/omnizip/algorithms/registration.rb
-- lib/omnizip/algorithms/sevenzip_lzma2.rb
-- lib/omnizip/algorithms/xz_lzma2.rb
 - lib/omnizip/algorithms/zstandard.rb
 - lib/omnizip/algorithms/zstandard/constants.rb
 - lib/omnizip/algorithms/zstandard/decoder.rb

data/lib/omnizip/algorithms/sevenzip_lzma2.rb

@@ -1,119 +0,0 @@
-# frozen_string_literal: true
-
-# Copyright (C) 2025 Ribose Inc.
-#
-# Permission is hereby granted, free of charge, to any person obtaining a
-# copy of this software and associated documentation files (the "Software"),
-# to deal in the Software without restriction, including without limitation
-# the rights to use, copy, modify, merge, publish, distribute, sublicense,
-# and/or sell copies of the Software, and to permit persons to whom the
-# Software is furnished to do so, subject to the following conditions:
-#
-# The above copyright notice and this permission notice shall be included in
-# all copies or substantial portions of the Software.
-#
-# THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
-# IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
-# FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
-# AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
-# LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
-# FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER
-# DEALINGS IN THE SOFTWARE.
-
-module Omnizip
-  module Algorithms
-    # 7-Zip LZMA2 compression algorithm.
-    #
-    # This algorithm uses the 7-Zip SDK-compatible implementation of LZMA2,
-    # which provides compatibility with 7-Zip command-line tools.
-    #
-    # @example Compress data
-    #   algorithm = Omnizip::AlgorithmRegistry.get(:sevenzip_lzma2).new(
-    #     dict_size: 8 * 1024 * 1024
-    #   )
-    #   algorithm.compress(input_io, output_io)
-    #
-    # @example Decompress data
-    #   algorithm = Omnizip::AlgorithmRegistry.get(:sevenzip_lzma2).new
-    #   algorithm.decompress(input_io, output_io)
-    class SevenZipLZMA2 < Algorithm
-      # Get algorithm metadata.
-      #
-      # @return [Models::AlgorithmMetadata] Algorithm information
-      def self.metadata
-        Models::AlgorithmMetadata.new.tap do |meta|
-          meta.name = "sevenzip_lzma2"
-          meta.description = "LZMA2 compression (7-Zip SDK implementation)"
-          meta.version = "1.0.0"
-        end
-      end
-
-      # Compress data using 7-Zip LZMA2.
-      #
-      # @param input [IO, String] Input data
-      # @param output [IO] Output stream
-      # @return [void]
-      def compress(input, output)
-        # Apply filter if set
-        input_data = if input.is_a?(String)
-                       if @filter
-                         @filter.encode(input)
-                       else
-                         input
-                       end
-                     elsif input.respond_to?(:read)
-                       data = input.read
-                       if @filter
-                         @filter.encode(data)
-                       else
-                         data
-                       end
-                     else
-                       raise ArgumentError, "Input must be a String or IO"
-                     end
-
-        # Get encoding options
-        dict_size = @options.fetch(:dict_size, 8 * 1024 * 1024)
-        lc = @options.fetch(:lc, 3)
-        lp = @options.fetch(:lp, 0)
-        pb = @options.fetch(:pb, 2)
-
-        # Use existing LZMA2Encoder which wraps SimpleLZMA2Encoder
-        encoder = LZMA2::LZMA2Encoder.new(
-          dict_size: dict_size,
-          lc: lc,
-          lp: lp,
-          pb: pb,
-          standalone: false,
-        )
-
-        compressed = encoder.encode(input_data)
-        output.write(compressed)
-      end
-
-      # Decompress data using 7-Zip LZMA2.
-      #
-      # @param input [IO] Input stream
-      # @param output [IO] Output stream
-      # @return [void]
-      def decompress(input, output)
-        dict_size = @options.fetch(:dict_size, 8 * 1024 * 1024)
-
-        # Use existing LZMA2::Decoder
-        decoder = LZMA2::Decoder.new(input, raw_mode: true,
-                                            dict_size: dict_size)
-        decompressed = decoder.decode_stream
-
-        # Reverse filter if set
-        if @filter
-          decompressed = @filter.decode(decompressed)
-        end
-
-        output.write(decompressed)
-      end
-    end
-  end
-end
-
-# Register the algorithm
-Omnizip::Algorithms::SevenZipLZMA2.register_algorithm

data/lib/omnizip/algorithms/xz_lzma2.rb

@@ -1,114 +0,0 @@
-# frozen_string_literal: true
-
-# Copyright (C) 2025 Ribose Inc.
-#
-# Permission is hereby granted, free of charge, to any person obtaining a
-# copy of this software and associated documentation files (the "Software"),
-# to deal in the Software without restriction, including without limitation
-# the rights to use, copy, modify, merge, publish, distribute, sublicense,
-# and/or sell copies of the Software, and to permit persons to whom the
-# Software is furnished to do so, subject to the following conditions:
-#
-# The above copyright notice and this permission notice shall be included in
-# all copies or substantial portions of the Software.
-#
-# THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
-# IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
-# FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
-# AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
-# LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
-# FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER
-# DEALINGS IN THE SOFTWARE.
-
-module Omnizip
-  module Algorithms
-    # XZ Utils LZMA2 compression algorithm.
-    #
-    # This algorithm uses the XZ Utils implementation of LZMA2,
-    # which provides full compatibility with xz command-line tools.
-    #
-    # @example Compress data
-    #   algorithm = Omnizip::AlgorithmRegistry.get(:xz_lzma2).new(
-    #     dict_size: 8 * 1024 * 1024
-    #   )
-    #   algorithm.compress(input_io, output_io)
-    #
-    # @example Decompress data
-    #   algorithm = Omnizip::AlgorithmRegistry.get(:xz_lzma2).new
-    #   algorithm.decompress(input_io, output_io)
-    class XZLZMA2 < Algorithm
-      # Get algorithm metadata.
-      #
-      # @return [Models::AlgorithmMetadata] Algorithm information
-      def self.metadata
-        Models::AlgorithmMetadata.new.tap do |meta|
-          meta.name = "xz_lzma2"
-          meta.description = "LZMA2 compression (XZ Utils implementation)"
-          meta.version = "1.0.0"
-        end
-      end
-
-      # Compress data using XZ Utils LZMA2.
-      #
-      # @param input [IO, String] Input data
-      # @param output [IO] Output stream
-      # @return [void]
-      def compress(input, output)
-        input_data = if input.is_a?(String)
-                       input
-                     elsif input.respond_to?(:read)
-                       input.read
-                     else
-                       raise ArgumentError, "Input must be a String or IO"
-                     end
-
-        # Apply filter if set
-        if @filter
-          input_data = @filter.encode(input_data)
-        end
-
-        # Get encoding options
-        dict_size = @options.fetch(:dict_size, 8 * 1024 * 1024)
-        lc = @options.fetch(:lc, 3)
-        lp = @options.fetch(:lp, 0)
-        pb = @options.fetch(:pb, 2)
-        standalone = @options.fetch(:standalone, false)
-
-        # Create encoder and compress
-        encoder = Implementations::XZUtils::LZMA2::Encoder.new(
-          dict_size: dict_size,
-          lc: lc,
-          lp: lp,
-          pb: pb,
-          standalone: standalone,
-        )
-
-        compressed = encoder.encode(input_data)
-        output.write(compressed)
-      end
-
-      # Decompress data using XZ Utils LZMA2.
-      #
-      # @param input [IO] Input stream
-      # @param output [IO] Output stream
-      # @return [void]
-      def decompress(input, output)
-        dict_size = @options.fetch(:dict_size, 8 * 1024 * 1024)
-
-        decoder = Implementations::XZUtils::LZMA2::Decoder.new(input,
-                                                               raw_mode: true, dict_size: dict_size)
-        decompressed = decoder.decode_stream
-
-        # Reverse filter if set
-        if @filter
-          decompressed = @filter.decode(decompressed)
-        end
-
-        output.write(decompressed)
-      end
-    end
-  end
-end
-
-# Register the algorithm
-Omnizip::Algorithms::XZLZMA2.register_algorithm