pure_jpeg 0.3.3 → 0.4.1

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
checksums.yaml CHANGED
@@ -1,7 +1,7 @@
1
1
  ---
2
2
  SHA256:
3
- metadata.gz: 7c252d678f3b8c916a2430b802569dc5099a19636359e9864637ed9fe01c90a3
4
- data.tar.gz: 8feec524d8c41ca74be1e9bc47cf41b762cb14dc3500dc03c9240680d5877933
3
+ metadata.gz: 41b11ef04efbfb35b257ce2e93e40ae4b4fd07fec3fd05918b87eacba9a517eb
4
+ data.tar.gz: 460755287366135f012fca8975822c9c50b52fa9e55144c3d1afc3c00538af37
5
5
  SHA512:
6
- metadata.gz: c8d26b4d4bed6da87f048036b06bc80eddd6c7ff8318032fb9cfccc15f5aea961e62fefe9965dde33c3d33cea5b611b4c2f6cb2397efa2f43effd8eb456fcf93
7
- data.tar.gz: 63a9fe6bdf1136c8ea6c8e38a6b6641e6be2975fef4fea9394f0b48de22b01862996a87557b5c0bf7d7915020630f08c9285ebf8b8e8482f38f228c31b2d08e7
6
+ metadata.gz: 2d9c6cb32fb7197cd2fb78bf391e970729036aab6c37b4215c8fca9aef687ca2079d209367956618e6951aaf9f6e809030a64e724b8bc34c070f0de1ad373680
7
+ data.tar.gz: 9d88a0c1e1d15068afe4827f838fa6736c1fde4403720edb32ac4c6e840619ccacf9ac7788e6b1ebe9df6dd8b61cc096bcac07424cd03b8ce9e89f9770ad1977
data/CHANGELOG.md CHANGED
@@ -1,5 +1,52 @@
1
1
  # Changelog
2
2
 
3
+ ## 0.4.1
4
+
5
+ This is a robustness and compatibility release. It makes decoding more reliable
6
+ across valid JPEG variants, improves handling of malformed input, and strengthens
7
+ Spinel support while preserving the existing public API and encoder output.
8
+
9
+ Fixes:
10
+
11
+ - Decode progressive images correctly when component edges require padded blocks
12
+ - Preserve each scan's restart interval and each component's original quantization table
13
+ - Decode baseline images with separate component scans and handle subsampled luminance
14
+ - Handle JPEG marker fill bytes correctly between scans and at restart boundaries
15
+ - Validate restart markers without recursion; reject malformed frame/scan parameters,
16
+ invalid Huffman tables, excessive coefficient runs, and incomplete scan data with `DecodeError`
17
+ - Reject unsupported precision and RGB/Adobe color transforms explicitly
18
+ - Read ICC headers after the frame header in `PureJPEG.info`; ignore incomplete or
19
+ inconsistent multipart profiles instead of returning partial profile bytes
20
+ - Treat binary garbage containing null bytes as data rather than a filesystem path
21
+ - Avoid a Spinel compiler bug in conditional hash assignment during decoding
22
+
23
+ Testing and packaging:
24
+
25
+ - Add small libjpeg-turbo fixtures with trusted decoded-pixel hashes and malformed-input regressions
26
+ - Add Spinel pixel-parity checks for the decoder fixes; all four package checks and
27
+ all eight selected RawSource tests pass on Spinel revision `2406a5649`
28
+ - Keep all existing tests, public API signatures, source-adapter behavior, and encoder output unchanged
29
+ - Run CI on pushes to `main` and smoke-test the built, installed gem without development dependencies
30
+ - Include creative-options documentation and IJG notices in the gem; correct the DCT algorithm attribution
31
+
32
+ ## 0.4.0
33
+
34
+ Performance:
35
+
36
+ - Faster Huffman coding and decoding, with scan references resolved once per scan
37
+ - Combined quantization and zigzag passes, including direct reconstruction from progressive coefficient buffers
38
+ - Color encoding downsamples chroma two rows at a time instead of allocating full-resolution chroma images
39
+ - Block-based `RawSource` construction avoids allocating pixels that would immediately be replaced
40
+ - Measured encode/decode times reduced by roughly 12–28% on Ruby 4.0.2 with YJIT; baseline decode allocations fell from 76,994 to 114 on the bundled 1024x1024 benchmark
41
+ - Encoding array storage allocated for that image fell from 29.4 MB to 12.6 MB, with encoded bytes and decoded pixels preserved in equivalence checks
42
+
43
+ Compatibility and testing:
44
+
45
+ - Experimental Spinel compatibility, tested at revision `7f08abd9`, with benchmarks and a `rake test:spinel` proof-of-concept runner
46
+ - Spinel currently passes seven of the eight selected RawSource tests; the remaining test fails because `respond_to?` is unavailable on its pixel struct. See `test/SPINEL.md` for details
47
+ - Added regression tests for quantization rounding, progressive coefficient offsets, and chroma downsampling edges
48
+ - Updated performance comparisons for CRuby, TruffleRuby, JRuby, and Spinel
49
+
3
50
  ## 0.3.3
4
51
 
5
52
  New features:
data/CREATIVE.md ADDED
@@ -0,0 +1,100 @@
1
+ # Creative encoding with PureJPEG
2
+
3
+ PureJPEG exposes access to several 'knobs' to manipulate the JPEG encoding pipeline. These produce a range of aesthetic effects by controlling how the DCT frequency coefficients are quantized.
4
+
5
+ All examples assume:
6
+
7
+ ```ruby
8
+ require "chunky_png"
9
+ require_relative "lib/pure_jpeg"
10
+
11
+ image = ChunkyPNG::Image.from_file("input.png")
12
+ source = PureJPEG::Source::ChunkyPNGSource.new(image)
13
+ ```
14
+
15
+ ## Scrambled quantization ("early digicam" look)
16
+
17
+ The JPEG spec stores quantization tables in zigzag order. Enabling `scramble_quantization` writes them in raster order instead, which means any standard viewer applies the wrong quantization values to the wrong frequency coefficients. The result is a chaotic, crunchy artifact pattern reminiscent of early 2000s digital cameras (what I really wanted in the first place).
18
+
19
+ ```ruby
20
+ PureJPEG.encode(source, quality: 20, scramble_quantization: true).write("scrambled.jpg")
21
+ ```
22
+
23
+ Lower quality values amplify the effect.
24
+
25
+ ## Chroma crush (sharp detail, broken color)
26
+
27
+ Set high luminance quality but aggressively compress the chrominance channels. Detail and edges stay sharp but the color information collapses into large blocky patches with hue shifts.
28
+
29
+ ```ruby
30
+ PureJPEG.encode(source, quality: 90, chroma_quality: 5).write("chromacrush.jpg")
31
+ ```
32
+
33
+ ## Luma crush (soft image, faithful color)
34
+
35
+ The opposite: crush the luminance channel while preserving chrominance. Produces a soft, almost oil-painting quality where the image is blocky and low-detail but the colors remain surprisingly accurate.
36
+
37
+ ```ruby
38
+ PureJPEG.encode(source, quality: 10, chroma_quality: 95).write("lumacrush.jpg")
39
+ ```
40
+
41
+ ## DC-only (8x8 mosaic)
42
+
43
+ A custom quantization table that preserves only the DC coefficient (the average brightness of each 8x8 block) and kills all 63 AC coefficients. Every block becomes a single flat color, producing a hard mosaic effect.
44
+
45
+ ```ruby
46
+ dc_only = [1] + [255] * 63
47
+ PureJPEG.encode(source, luminance_table: dc_only, chrominance_table: dc_only).write("dconly.jpg")
48
+ ```
49
+
50
+ You can soften the mosaic by letting a few low-frequency AC coefficients through:
51
+
52
+ ```ruby
53
+ # Keep DC and the first few AC coefficients
54
+ gentle_mosaic = [1, 1, 1, 2, 4, 8] + [255] * 58
55
+ PureJPEG.encode(source, luminance_table: gentle_mosaic, chrominance_table: gentle_mosaic).write("gentle_mosaic.jpg")
56
+ ```
57
+
58
+ ## Inverted frequency emphasis
59
+
60
+ Normally JPEG preserves low frequencies (smooth gradients) and discards high frequencies (fine detail). This modifier inverts that, preserving edges and texture while crushing smooth areas. The result is an embossed or etched look.
61
+
62
+ ```ruby
63
+ inverter = ->(table, _channel) {
64
+ max = table.max
65
+ table.map { |v| [max + 1 - v, 1].max }
66
+ }
67
+ PureJPEG.encode(source, quality: 30, quantization_modifier: inverter).write("inverted.jpg")
68
+ ```
69
+
70
+ ## Combining effects
71
+
72
+ The `quantization_modifier` proc receives the table and a channel identifier (`:luminance` or `:chrominance`), so you can apply different transformations per channel:
73
+
74
+ ```ruby
75
+ modifier = ->(table, channel) {
76
+ case channel
77
+ when :luminance
78
+ # Sharpen luma by halving quantization values
79
+ table.map { |v| [v / 2, 1].max }
80
+ when :chrominance
81
+ # Posterize color by doubling quantization values
82
+ table.map { |v| [v * 2, 255].min }
83
+ end
84
+ }
85
+ PureJPEG.encode(source, quality: 50, quantization_modifier: modifier).write("combined.jpg")
86
+ ```
87
+
88
+ ## Full option reference
89
+
90
+ ```ruby
91
+ PureJPEG.encode(source,
92
+ quality: 85, # 1-100, overall compression level
93
+ grayscale: false, # encode as single-channel grayscale
94
+ chroma_quality: nil, # 1-100, independent Cb/Cr quality (defaults to quality)
95
+ luminance_table: nil, # custom 64-element quantization table for Y (raster order)
96
+ chrominance_table: nil, # custom 64-element quantization table for Cb/Cr (raster order)
97
+ quantization_modifier: nil, # proc(table, :luminance/:chrominance) -> modified table
98
+ scramble_quantization: false # write quant tables in wrong order (digicam effect)
99
+ )
100
+ ```
data/LICENSE CHANGED
@@ -19,3 +19,10 @@ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
19
  LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
20
  OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
21
21
  SOFTWARE.
22
+
23
+ The integer DCT implementation in lib/pure_jpeg/dct.rb is adapted from the
24
+ Independent JPEG Group's jfdctint.c and jidctint.c. Its upstream copyright,
25
+ disclaimer, and distribution terms are included in LICENSE-IJG. PureJPEG's
26
+ adaptation ports the transforms to Ruby arrays, removes the C integration
27
+ and scaled-output variants, and normalizes forward coefficients before
28
+ quantization. The IJG-derived portions remain subject to those terms.
data/LICENSE-IJG ADDED
@@ -0,0 +1,260 @@
1
+ libjpeg-turbo note: This file has been modified by The libjpeg-turbo Project
2
+ to include only information relevant to libjpeg-turbo, to wordsmith certain
3
+ sections, and to remove impolitic language that existed in the libjpeg v8
4
+ README. It is included only for reference. Please see README.md for
5
+ information specific to libjpeg-turbo.
6
+
7
+
8
+ The Independent JPEG Group's JPEG software
9
+ ==========================================
10
+
11
+ This distribution contains a release of the Independent JPEG Group's free JPEG
12
+ software. You are welcome to redistribute this software and to use it for any
13
+ purpose, subject to the conditions under LEGAL ISSUES, below.
14
+
15
+ This software is the work of Tom Lane, Guido Vollbeding, Philip Gladstone,
16
+ Bill Allombert, Jim Boucher, Lee Crocker, Bob Friesenhahn, Ben Jackson,
17
+ Julian Minguillon, Luis Ortiz, George Phillips, Davide Rossi, Ge' Weijers,
18
+ and other members of the Independent JPEG Group.
19
+
20
+ IJG is not affiliated with the ISO/IEC JTC1/SC29/WG1 standards committee
21
+ (also known as JPEG, together with ITU-T SG16).
22
+
23
+
24
+ DOCUMENTATION ROADMAP
25
+ =====================
26
+
27
+ This file contains the following sections:
28
+
29
+ OVERVIEW General description of JPEG and the IJG software.
30
+ LEGAL ISSUES Copyright, lack of warranty, terms of distribution.
31
+ REFERENCES Where to learn more about JPEG.
32
+ ARCHIVE LOCATIONS Where to find newer versions of this software.
33
+ FILE FORMAT WARS Software *not* to get.
34
+ TO DO Plans for future IJG releases.
35
+
36
+ Other documentation files in the distribution are:
37
+
38
+ User documentation:
39
+ doc/usage.txt Usage instructions for cjpeg, djpeg, jpegtran,
40
+ rdjpgcom, and wrjpgcom.
41
+ doc/*.1 Unix-style man pages for programs (same info as
42
+ usage.txt).
43
+ doc/wizard.txt Advanced usage instructions for JPEG wizards only.
44
+ doc/change.log Version-to-version change highlights.
45
+ Programmer and internal documentation:
46
+ doc/libjpeg.txt How to use the JPEG library in your own programs.
47
+ src/example.c Sample code for calling the JPEG library.
48
+ doc/structure.txt Overview of the JPEG library's internal structure.
49
+ doc/coderules.txt Coding style rules --- please read if you contribute
50
+ code.
51
+
52
+ Please read at least usage.txt. Some information can also be found in the JPEG
53
+ FAQ (Frequently Asked Questions) article. See ARCHIVE LOCATIONS below to find
54
+ out where to obtain the FAQ article.
55
+
56
+ If you want to understand how the JPEG code works, we suggest reading one or
57
+ more of the REFERENCES, then looking at the documentation files (in roughly
58
+ the order listed) before diving into the code.
59
+
60
+
61
+ OVERVIEW
62
+ ========
63
+
64
+ This package contains C software to implement JPEG image encoding, decoding,
65
+ and transcoding. JPEG (pronounced "jay-peg") is a standardized compression
66
+ method for full-color and grayscale images. JPEG's strong suit is compressing
67
+ photographic images or other types of images that have smooth color and
68
+ brightness transitions between neighboring pixels. Images with sharp lines or
69
+ other abrupt features may not compress well with JPEG, and a higher JPEG
70
+ quality may have to be used to avoid visible compression artifacts with such
71
+ images.
72
+
73
+ JPEG is normally lossy, meaning that the output pixels are not necessarily
74
+ identical to the input pixels. However, on photographic content and other
75
+ "smooth" images, very good compression ratios can be obtained with no visible
76
+ compression artifacts, and extremely high compression ratios are possible if
77
+ you are willing to sacrifice image quality (by reducing the "quality" setting
78
+ in the compressor.)
79
+
80
+ This software implements JPEG baseline, extended-sequential, progressive, and
81
+ lossless compression processes. Provision is made for supporting all variants
82
+ of these processes, although some uncommon parameter settings aren't
83
+ implemented yet. We have made no provision for supporting the hierarchical
84
+ processes defined in the standard.
85
+
86
+ We provide a set of library routines for reading and writing JPEG image files,
87
+ plus two sample applications "cjpeg" and "djpeg", which use the library to
88
+ perform conversion between JPEG and some other popular image file formats.
89
+ The library is intended to be reused in other applications.
90
+
91
+ In order to support file conversion and viewing software, we have included
92
+ considerable functionality beyond the bare JPEG coding/decoding capability;
93
+ for example, the color quantization modules are not strictly part of JPEG
94
+ decoding, but they are essential for output to colormapped file formats. These
95
+ extra functions can be compiled out of the library if not required for a
96
+ particular application.
97
+
98
+ We have also included "jpegtran", a utility for lossless transcoding between
99
+ different JPEG processes, and "rdjpgcom" and "wrjpgcom", two simple
100
+ applications for inserting and extracting textual comments in JFIF files.
101
+
102
+ The emphasis in designing this software has been on achieving portability and
103
+ flexibility, while also making it fast enough to be useful. In particular,
104
+ the software is not intended to be read as a tutorial on JPEG. (See the
105
+ REFERENCES section for introductory material.) Rather, it is intended to
106
+ be reliable, portable, industrial-strength code. We do not claim to have
107
+ achieved that goal in every aspect of the software, but we strive for it.
108
+
109
+ We welcome the use of this software as a component of commercial products.
110
+ No royalty is required, but we do ask for an acknowledgement in product
111
+ documentation, as described under LEGAL ISSUES.
112
+
113
+
114
+ LEGAL ISSUES
115
+ ============
116
+
117
+ In plain English:
118
+
119
+ 1. We don't promise that this software works. (But if you find any bugs,
120
+ please let us know!)
121
+ 2. You can use this software for whatever you want. You don't have to pay us.
122
+ 3. You may not pretend that you wrote this software. If you use it in a
123
+ program, you must acknowledge somewhere in your documentation that
124
+ you've used the IJG code.
125
+
126
+ In legalese:
127
+
128
+ The authors make NO WARRANTY or representation, either express or implied,
129
+ with respect to this software, its quality, accuracy, merchantability, or
130
+ fitness for a particular purpose. This software is provided "AS IS", and you,
131
+ its user, assume the entire risk as to its quality and accuracy.
132
+
133
+ This software is copyright (C) 1991-2020, Thomas G. Lane, Guido Vollbeding.
134
+ All Rights Reserved except as specified below.
135
+
136
+ Permission is hereby granted to use, copy, modify, and distribute this
137
+ software (or portions thereof) for any purpose, without fee, subject to these
138
+ conditions:
139
+ (1) If any part of the source code for this software is distributed, then this
140
+ README file must be included, with this copyright and no-warranty notice
141
+ unaltered; and any additions, deletions, or changes to the original files
142
+ must be clearly indicated in accompanying documentation.
143
+ (2) If only executable code is distributed, then the accompanying
144
+ documentation must state that "this software is based in part on the work of
145
+ the Independent JPEG Group".
146
+ (3) Permission for use of this software is granted only if the user accepts
147
+ full responsibility for any undesirable consequences; the authors accept
148
+ NO LIABILITY for damages of any kind.
149
+
150
+ These conditions apply to any software derived from or based on the IJG code,
151
+ not just to the unmodified library. If you use our work, you ought to
152
+ acknowledge us.
153
+
154
+ Permission is NOT granted for the use of any IJG author's name or company name
155
+ in advertising or publicity relating to this software or products derived from
156
+ it. This software may be referred to only as "the Independent JPEG Group's
157
+ software".
158
+
159
+ We specifically permit and encourage the use of this software as the basis of
160
+ commercial products, provided that all warranty or liability claims are
161
+ assumed by the product vendor.
162
+
163
+
164
+ REFERENCES
165
+ ==========
166
+
167
+ We recommend reading one or more of these references before trying to
168
+ understand the innards of the JPEG software.
169
+
170
+ The best short technical introduction to the JPEG compression algorithm is
171
+ Wallace, Gregory K. "The JPEG Still Picture Compression Standard",
172
+ Communications of the ACM, April 1991 (vol. 34 no. 4), pp. 30-44.
173
+ (Adjacent articles in that issue discuss MPEG motion picture compression,
174
+ applications of JPEG, and related topics.) If you don't have the CACM issue
175
+ handy, a PDF file containing a revised version of Wallace's article is
176
+ available at http://www.ijg.org/files/Wallace.JPEG.pdf. The file (actually
177
+ a preprint for an article that appeared in IEEE Trans. Consumer Electronics)
178
+ omits the sample images that appeared in CACM, but it includes corrections
179
+ and some added material. Note: the Wallace article is copyright ACM and IEEE,
180
+ and it may not be used for commercial purposes.
181
+
182
+ A somewhat less technical, more leisurely introduction to JPEG can be found in
183
+ "The Data Compression Book" by Mark Nelson and Jean-loup Gailly, published by
184
+ M&T Books (New York), 2nd ed. 1996, ISBN 1-55851-434-1. This book provides
185
+ good explanations and example C code for a multitude of compression methods
186
+ including JPEG. It is an excellent source if you are comfortable reading C
187
+ code but don't know much about data compression in general. The book's JPEG
188
+ sample code is far from industrial-strength, but when you are ready to look
189
+ at a full implementation, you've got one here...
190
+
191
+ The best currently available description of JPEG is the textbook "JPEG Still
192
+ Image Data Compression Standard" by William B. Pennebaker and Joan L.
193
+ Mitchell, published by Van Nostrand Reinhold, 1993, ISBN 0-442-01272-1.
194
+ Price US$59.95, 638 pp. The book includes the complete text of the ISO JPEG
195
+ standards (DIS 10918-1 and draft DIS 10918-2).
196
+
197
+ The original JPEG standard is divided into two parts, Part 1 being the actual
198
+ specification, while Part 2 covers compliance testing methods. Part 1 is
199
+ titled "Digital Compression and Coding of Continuous-tone Still Images,
200
+ Part 1: Requirements and guidelines" and has document numbers ISO/IEC IS
201
+ 10918-1, ITU-T T.81. Part 2 is titled "Digital Compression and Coding of
202
+ Continuous-tone Still Images, Part 2: Compliance testing" and has document
203
+ numbers ISO/IEC IS 10918-2, ITU-T T.83.
204
+
205
+ The JPEG standard does not specify all details of an interchangeable file
206
+ format. For the omitted details, we follow the "JFIF" conventions, revision
207
+ 1.02. JFIF version 1 has been adopted as ISO/IEC 10918-5 (05/2013) and
208
+ Recommendation ITU-T T.871 (05/2011): Information technology - Digital
209
+ compression and coding of continuous-tone still images: JPEG File Interchange
210
+ Format (JFIF). It is available as a free download in PDF file format from
211
+ https://www.iso.org/standard/54989.html and http://www.itu.int/rec/T-REC-T.871.
212
+ A PDF file of the older JFIF 1.02 specification is available at
213
+ http://www.w3.org/Graphics/JPEG/jfif3.pdf.
214
+
215
+ The TIFF 6.0 file format specification can be obtained from
216
+ http://mirrors.ctan.org/graphics/tiff/TIFF6.ps.gz. The JPEG incorporation
217
+ scheme found in the TIFF 6.0 spec of 3-June-92 has a number of serious
218
+ problems. IJG does not recommend use of the TIFF 6.0 design (TIFF Compression
219
+ tag 6). Instead, we recommend the JPEG design proposed by TIFF Technical Note
220
+ #2 (Compression tag 7). Copies of this Note can be obtained from
221
+ http://www.ijg.org/files/. It is expected that the next revision
222
+ of the TIFF spec will replace the 6.0 JPEG design with the Note's design.
223
+ Although IJG's own code does not support TIFF/JPEG, the free libtiff library
224
+ uses our library to implement TIFF/JPEG per the Note.
225
+
226
+
227
+ ARCHIVE LOCATIONS
228
+ =================
229
+
230
+ The "official" archive site for this software is www.ijg.org.
231
+ The most recent released version can always be found there in
232
+ directory "files".
233
+
234
+ The JPEG FAQ (Frequently Asked Questions) article is a source of some
235
+ general information about JPEG. It is available at
236
+ http://www.faqs.org/faqs/jpeg-faq.
237
+
238
+
239
+ FILE FORMAT COMPATIBILITY
240
+ =========================
241
+
242
+ This software implements ITU T.81 | ISO/IEC 10918 with some extensions from
243
+ ITU T.871 | ISO/IEC 10918-5 (JPEG File Interchange Format-- see REFERENCES).
244
+ Informally, the term "JPEG image" or "JPEG file" most often refers to JFIF or
245
+ a subset thereof, but there are other formats containing the name "JPEG" that
246
+ are incompatible with the original JPEG standard or with JFIF (for instance,
247
+ JPEG 2000 and JPEG XR). This software therefore does not support these
248
+ formats. Indeed, one of the original reasons for developing this free software
249
+ was to help force convergence on a common, interoperable format standard for
250
+ JPEG files.
251
+
252
+ JFIF is a minimal or "low end" representation. TIFF/JPEG (TIFF revision 6.0 as
253
+ modified by TIFF Technical Note #2) can be used for "high end" applications
254
+ that need to record a lot of additional data about an image.
255
+
256
+
257
+ TO DO
258
+ =====
259
+
260
+ Please send bug reports, offers of help, etc. to jpeg-info@jpegclub.org.
data/README.md CHANGED
@@ -6,7 +6,7 @@
6
6
 
7
7
  Convert PNG or other pixel data to JPEG. Or the other way! Implements baseline JPEG encoding (DCT, Huffman, 4:2:0 chroma subsampling) and decodes both baseline and progressive JPEGs. Exposes a variety of encoding options to adjust parts of the JPEG pipeline not normally available (I needed this to recreate the JPEG compression styles of older digital cameras - don't ask..)
8
8
 
9
- It works on CRuby 3.0+, TruffleRuby 33.0, and JRuby 10.0. There's *almost* 100% test coverage - I need to find some "broken" JPEGs to do the rest (hit me up if you have any sources..)
9
+ It works on CRuby 3.0+, TruffleRuby 33.0, JRuby 10.0, and [Spinel](https://github.com/matz/spinel) (tested at `7f08abd9`). Tests include external JPEG fixtures with pixel expectations generated by libjpeg-turbo, alongside round-trip and malformed-input checks.
10
10
 
11
11
  > [!NOTE]
12
12
  > Rubyists might find the [AI Disclosure](#ai-disclosure) section below of interest.
@@ -23,6 +23,15 @@ gem "pure_jpeg"
23
23
  gem install pure_jpeg
24
24
  ```
25
25
 
26
+ > [!NOTE]
27
+ > Using [Spinel](https://github.com/matz/spinel)? Add PureJPEG from your Spin project directory:
28
+ >
29
+ > ```sh
30
+ > spin add pure_jpeg --git https://github.com/peterc/pure_jpeg
31
+ > ```
32
+ >
33
+ > Then use `require "pure_jpeg"` in your code as usual.
34
+
26
35
  There are no runtime dependencies. [ChunkyPNG](https://github.com/wvanbergen/chunky_png) is optional (though quite useful) if you want to use `from_chunky_png`.
27
36
 
28
37
  `examples/` contains some useful example scripts for basic JPEG to PNG and PNG to JPEG conversion if you want to do some quick tests without writing code.
@@ -151,8 +160,13 @@ info.width # => 1024
151
160
  info.height # => 768
152
161
  info.component_count # => 3
153
162
  info.progressive # => false
163
+ info.icc_profile # => binary profile bytes, or nil
154
164
  ```
155
165
 
166
+ Metadata queries read headers through the first scan marker, without decoding
167
+ pixels. Incomplete or inconsistent multipart ICC profiles are ignored and
168
+ reported as `nil`. ICC extraction does not perform color-profile conversion.
169
+
156
170
  ### Iterating pixels
157
171
 
158
172
  ```ruby
@@ -198,22 +212,33 @@ Decoding:
198
212
  - 1-component (grayscale) and 3-component (YCbCr) images
199
213
  - Any chroma subsampling factor (4:4:4, 4:2:2, 4:2:0, etc.)
200
214
  - Restart markers (DRI/RST)
215
+ - Separate component scans in baseline JPEGs
201
216
 
202
- Not supported: arithmetic coding, 12-bit precision, EXIF/ICC profile preservation, adding a default background for transparent sources (see what happens above!). Largely because I don't need these, but they are all do-able, especially with how loosely coupled this library is internally. Raise an issue if you really care about them!
217
+ Encoding and decoding allow dimensions up to 8192 pixels on each axis. The
218
+ decoder allocates whole-image buffers; this dimension limit is not a memory
219
+ budget. `PureJPEG.info` can inspect dimensions without allocating pixel buffers.
220
+ Invalid or unsupported JPEG data raises `PureJPEG::DecodeError`.
221
+
222
+ Not supported: arithmetic coding, 12-bit precision, RGB/CMYK JPEG color spaces,
223
+ or EXIF/ICC profile preservation when re-encoding. Transparent PNG sources can
224
+ be composited with the explicit `background:` option above. Raise an issue if
225
+ you need one of the unsupported formats!
203
226
 
204
227
  Possible future improvements: ICC profile rendering/conversion.
205
228
 
206
229
  ## Performance
207
230
 
208
- On a 1024x1024 image (Apple M5, 5 runs after warmup):
231
+ On the bundled 1024x1024 images (Apple M5, median of 15 runs after 20 seconds of warmup per operation):
232
+
233
+ | Operation | CRuby 4.0.2 (YJIT) | TruffleRuby 34.0.1 | JRuby 9.4.14.0 | Spinel (`7f08abd9`) |
234
+ |-----------|-------------------|-------------------|---------------|--------------------|
235
+ | Encode (color, q85) | ~0.131s | ~0.088s | ~0.577s | ~0.104s |
236
+ | Decode (baseline) | ~0.112s | ~0.027s | ~0.554s | ~0.078s |
237
+ | Decode (progressive) | ~0.140s | ~0.037s | ~0.617s | ~0.092s |
209
238
 
210
- | Operation | CRuby 4.0.2 (YJIT) | TruffleRuby 33.0.1 |
211
- |-----------|---------------------|---------------------|
212
- | Encode (color, q85) | ~0.16s | ~0.08s |
213
- | Decode (baseline) | ~0.14s | ~0.05s |
214
- | Decode (progressive) | ~0.18s | ~0.09s |
239
+ Inputs were loaded before timing, and encoded output was returned in memory; file I/O and PNG loading are excluded. Runtimes were benchmarked sequentially. JRuby used its default JIT on OpenJDK 21.0.10. Spinel was measured separately with the same inputs and timing protocol, using a portable harness with PNG pixels preloaded; its encoded JPEG and decoded pixels matched CRuby byte-for-byte. Results vary with image content, garbage collection, and JIT warmup.
215
240
 
216
- The encoder and decoder use an integer-scaled AAN (Arai-Agui-Nakajima) DCT with fixed-point arithmetic throughout — no Float operations in the hot path. Color space conversion uses fixed-point integer math, and pixel data is stored as packed integers to avoid per-pixel object allocation. TruffleRuby's Graal JIT compiler can optimize these tight integer loops particularly well, resulting in 2-3x faster performance once warmed up.
241
+ The encoder and decoder use the IJG accurate integer DCT, based on the Loeffler factorization, with fixed-point arithmetic throughout — no Float operations in the hot path. Color space conversion uses fixed-point integer math, and pixel data is stored as packed integers to avoid per-pixel object allocation. TruffleRuby's Graal JIT compiler can optimize these tight integer loops particularly well once warmed up.
217
242
 
218
243
  ## Example scripts
219
244
 
@@ -264,6 +289,19 @@ rake benchmark # basic benchmark of encoding and decoding (5 runs after warmup
264
289
  rake profile # CPU profile with StackProf (requires the stackprof gem)
265
290
  ```
266
291
 
292
+ The Minitest suite lives in `test/minitest/`; `rake` and `rake test` run it
293
+ with SimpleCov as before. To run one file:
294
+
295
+ ```sh
296
+ bundle exec rake test TEST=test/minitest/test_raw_source.rb
297
+ ```
298
+
299
+ With Spinel and Spin installed, `spin test` runs the standalone package checks
300
+ in `test/*.rb`, comparing their output with CRuby. These cover color/grayscale
301
+ round trips, metadata, and invalid input; they supplement the full Minitest
302
+ suite. See [test/SPINEL.md](test/SPINEL.md) for details and the existing
303
+ `rake test:spinel` runner.
304
+
267
305
  ## Full benchmark script
268
306
 
269
307
  `benchmark/run.rb` is a more thorough benchmark that exercises the encode and decode paths in several ways. It auto-enables YJIT, warms up before measuring, and reports object allocations, throughput (iterations/second via `benchmark-ips`), best-of-N wall-clock times, and a sustained mixed workload across encode (q85, q95 optimized, grayscale) and decode (baseline and progressive).
@@ -299,4 +337,6 @@ ruby benchmark/run.rb --profile-alloc # retained-object profile with Vernier
299
337
 
300
338
  ## License
301
339
 
302
- MIT
340
+ MIT, with IJG terms for the adapted integer DCT implementation. This software
341
+ is based in part on the work of the Independent JPEG Group. See [LICENSE](LICENSE)
342
+ and [LICENSE-IJG](LICENSE-IJG) for the notices and adaptation details.
@@ -35,6 +35,26 @@ module PureJPEG
35
35
  @buffer = 0
36
36
  end
37
37
 
38
+ # Consume exactly the restart expected at an MCU boundary. Marker fill
39
+ # bytes are allowed; entropy bytes and out-of-sequence restarts are not.
40
+ def read_restart(expected)
41
+ reset
42
+ unless @data.getbyte(@pos) == 0xFF
43
+ raise DecodeError, "Missing JPEG restart marker"
44
+ end
45
+ @pos += 1 while @pos < @length && @data.getbyte(@pos) == 0xFF
46
+ unless @data.getbyte(@pos) == 0xD0 + expected
47
+ raise DecodeError, "Unexpected JPEG restart marker (expected RST#{expected})"
48
+ end
49
+ @pos += 1
50
+ end
51
+
52
+ def finish_scan!
53
+ # Remaining bits in the last byte are padding, but whole unread bytes
54
+ # indicate extra entropy data or an unexpected trailing restart marker.
55
+ raise DecodeError, "Extra data after JPEG scan" unless @pos == @length
56
+ end
57
+
38
58
  # Read additional bits and sign-extend per JPEG spec (receive/extend).
39
59
  def receive_extend(size)
40
60
  return 0 if size == 0
@@ -56,10 +76,7 @@ module PureJPEG
56
76
  raise PureJPEG::DecodeError, "Unexpected end of scan data" if @pos >= @length
57
77
  next_byte = @data.getbyte(@pos)
58
78
  @pos += 1
59
- # 0xFF 0x00 is a stuffed 0xFF byte
60
- # Skip restart markers (0xD0-0xD7)
61
- return fill_buffer if next_byte != 0x00 && next_byte >= 0xD0 && next_byte <= 0xD7
62
- # For 0x00, the byte is 0xFF (stuffing removed)
79
+ raise DecodeError, "Unexpected marker in JPEG entropy data" unless next_byte == 0x00
63
80
  end
64
81
  @buffer = byte
65
82
  @bits_in_buffer = 8
data/lib/pure_jpeg/dct.rb CHANGED
@@ -2,8 +2,10 @@
2
2
 
3
3
  module PureJPEG
4
4
  # Integer-scaled DCT based on the IJG (Independent JPEG Group) reference
5
- # implementation (jfdctint.c / jidctint.c). Uses the Arai-Agui-Nakajima
6
- # factorization with 13-bit fixed-point constants.
5
+ # implementation (jfdctint.c / jidctint.c). Uses the Loeffler-based accurate
6
+ # integer factorization with 13-bit fixed-point constants. The upstream
7
+ # copyright and distribution terms are included in LICENSE-IJG; adaptation
8
+ # details are recorded in LICENSE.
7
9
  #
8
10
  # All arithmetic is pure Integer (additions, shifts, multiplies) — no Float
9
11
  # operations. This is ~3x faster than the matrix-multiply float DCT under