zstd-native-ruby 1.0.1 → 1.0.2

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 8aae4c9cef055ab4fc7335c28e74f20fdcfbe86148af3c00a9b196901a890c4b
-  data.tar.gz: 7d6e1cb5a67f76c23a1a3a27db3e184a8ed796bf1a335c1368b3be18cfec3954
+  metadata.gz: 0e850fb481d9a4e9aed7d84232598eff637e27a00917a07a166d2a0268a8fa4b
+  data.tar.gz: a8732beab4d74e6909f5bd5124b62af090ec36aec933d43efdea55f67a14d400
 SHA512:
-  metadata.gz: 5aee75750d0010c0ad0270733409ce3f49afe6b136392fbe0fe46ada760518e3858cafbe8e8aa22701c3723fe5aba75575b1c97aac44304f168f65877f474256
-  data.tar.gz: b6836ac46336279547296430acb25e462c5a1f69655909e0e5dab6800ae6b170af298bcb85042e2898f842b380f6bfb6aa1ce1287aec89f6dd121a04a8aa5aed
+  metadata.gz: d6a26fc638e806850690b2043c04e56c531425bdcb98ec805091b7f05e0967d52087c7b813feb2f2e6fdb654425168668dc86cdcb7e7b991b1aba808002003b0
+  data.tar.gz: 9e44a687a8e67c633b85c470d879977de35fcb6c554b5d5191d59fe4b63d8f1e7c1b80879862fa8635be2d1b0c074e56856a98184018e31e1abfca3d4c8af48b

data/LICENSE

@@ -1,6 +1,6 @@
 MIT License
 
-Copyright (c) 2025
+Copyright (c) 2025 John Greninger
 
 Permission is hereby granted, free of charge, to any person obtaining a copy
 of this software and associated documentation files (the "Software"), to deal
@@ -12,7 +12,9 @@ furnished to do so, subject to the following conditions:
 The above copyright notice and this permission notice shall be included in all
 copies or substantial portions of the Software.
 
-THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF NOTICE SHALL THE
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
 AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
 LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
 OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE

data/README.md

@@ -1,47 +1,74 @@
 # zstd-native-ruby
 
-Ruby bindings for Facebook's Zstandard (zstd) compression library with bundled native library.
-
-This gem bundles the zstd C library, so you don't need to install zstd separately on your system. It provides native performance with simple Ruby API for file compression and decompression.
+Native Ruby bindings for the Facebook Zstandard (zstd) compression library.
 
 ## Installation
 
-Install from RubyGems:
-
-```bash
-gem install zstd-native-ruby
-```
-
-Or add to your Gemfile:
+Add this line to your application's Gemfile:
 
 ```ruby
 gem 'zstd-native-ruby'
 ```
 
+And then execute:
+
+    $ bundle install
+
+Or install it yourself as:
+
+    $ gem install zstd-native-ruby
+
 ## Usage
 
 ```ruby
-require 'zstd_ruby'
+require 'zstd_native'
 
-# Compress a file
-ZstdRuby.compress_file('input.txt', 'output.txt.zst', level: 3)
+# Simple compression
+data = "Hello, World!" * 100
+compressed = ZstdNative.compress(data)
+decompressed = ZstdNative.decompress(compressed)
 
-# Decompress a file
-ZstdRuby.decompress_file('output.txt.zst', 'decompressed.txt')
+# With compression level (1-22, default is 3)
+compressed = ZstdNative.compress(data, 10)
+
+# Streaming compression
+stream = ZstdNative::CStream.new(level: 5)
+stream.compress("chunk1")
+stream.compress("chunk2")
+compressed_data = stream.finish
+
+# Streaming decompression
+dstream = ZstdNative::DStream.new
+dstream.decompress(compressed_data)
+
+# Dictionary compression
+dict = ZstdNative::CDict.new(dictionary_data)
+compressed = ZstdNative.compress_using_dict(data, dict)
+
+ddict = ZstdNative::DDict.new(dictionary_data)
+decompressed = ZstdNative.decompress_using_dict(compressed, ddict)
 ```
 
-## Compression Levels
+## Features
 
-Zstd supports compression levels from 1 (fastest) to 22 (best compression). The default level is 3.
+- Simple compression and decompression
+- Streaming compression and decompression
+- Dictionary support
+- Full access to all zstd.h API functions
+- Native performance
 
 ## Development
 
-```bash
-bundle install
-rake compile
-rake test
-```
+After checking out the repo, run:
+
+    $ bundle install
+    $ rake compile
+    $ rake test
 
 ## License
 
-MIT License
+The gem is available as open source under the terms of the MIT License.
+
+## Credits
+
+This gem wraps the Facebook Zstandard library: https://github.com/facebook/zstd

data/ext/zstd_native/Makefile

@@ -0,0 +1,269 @@
+
+SHELL = /bin/sh
+
+# V=0 quiet, V=1 verbose.  other values don't work.
+V = 0
+V0 = $(V:0=)
+Q1 = $(V:1=)
+Q = $(Q1:0=@)
+ECHO1 = $(V:1=@ :)
+ECHO = $(ECHO1:0=@ echo)
+NULLCMD = :
+
+#### Start of system configuration section. ####
+
+srcdir = /home/jgreninger/Work/zstd-ruby/ext/zstd_native
+topdir = /usr/include/ruby-3.2.0
+hdrdir = $(topdir)
+arch_hdrdir = /usr/include/x86_64-linux-gnu/ruby-3.2.0
+PATH_SEPARATOR = :
+VPATH = $(srcdir):$(arch_hdrdir)/ruby:$(hdrdir)/ruby
+prefix = $(DESTDIR)/usr
+rubysitearchprefix = $(sitearchlibdir)/$(RUBY_BASE_NAME)
+rubyarchprefix = $(archlibdir)/$(RUBY_BASE_NAME)
+rubylibprefix = $(libdir)/$(RUBY_BASE_NAME)
+exec_prefix = $(prefix)
+vendorarchhdrdir = $(sitearchincludedir)/$(RUBY_VERSION_NAME)/vendor_ruby
+sitearchhdrdir = $(sitearchincludedir)/$(RUBY_VERSION_NAME)/site_ruby
+rubyarchhdrdir = $(archincludedir)/$(RUBY_VERSION_NAME)
+vendorhdrdir = $(rubyhdrdir)/vendor_ruby
+sitehdrdir = $(rubyhdrdir)/site_ruby
+rubyhdrdir = $(includedir)/$(RUBY_VERSION_NAME)
+vendorarchdir = $(rubysitearchprefix)/vendor_ruby/$(ruby_version)
+vendorlibdir = $(vendordir)/$(ruby_version)
+vendordir = $(rubylibprefix)/vendor_ruby
+sitearchdir = $(DESTDIR)/usr/local/lib/x86_64-linux-gnu/site_ruby
+sitelibdir = $(sitedir)/$(ruby_version)
+sitedir = $(DESTDIR)/usr/local/lib/site_ruby
+rubyarchdir = $(rubyarchprefix)/$(ruby_version)
+rubylibdir = $(rubylibprefix)/$(ruby_version)
+sitearchincludedir = $(includedir)/$(sitearch)
+archincludedir = $(includedir)/$(arch)
+sitearchlibdir = $(libdir)/$(sitearch)
+archlibdir = $(libdir)/$(arch)
+ridir = $(datarootdir)/$(RI_BASE_NAME)
+mandir = $(datarootdir)/man
+localedir = $(datarootdir)/locale
+libdir = $(exec_prefix)/lib
+psdir = $(docdir)
+pdfdir = $(docdir)
+dvidir = $(docdir)
+htmldir = $(docdir)
+infodir = $(datarootdir)/info
+docdir = $(datarootdir)/doc/$(PACKAGE)
+oldincludedir = $(DESTDIR)/usr/include
+includedir = $(prefix)/include
+runstatedir = $(DESTDIR)/var/run
+localstatedir = $(DESTDIR)/var
+sharedstatedir = $(prefix)/com
+sysconfdir = $(DESTDIR)/etc
+datadir = $(datarootdir)
+datarootdir = $(prefix)/share
+libexecdir = $(exec_prefix)/libexec
+sbindir = $(exec_prefix)/sbin
+bindir = $(exec_prefix)/bin
+archdir = $(rubyarchdir)
+
+
+CC_WRAPPER = 
+CC = x86_64-linux-gnu-gcc
+CXX = x86_64-linux-gnu-g++
+LIBRUBY = $(LIBRUBY_SO)
+LIBRUBY_A = lib$(RUBY_SO_NAME)-static.a
+LIBRUBYARG_SHARED = -l$(RUBY_SO_NAME)
+LIBRUBYARG_STATIC = -l$(RUBY_SO_NAME)-static $(MAINLIBS)
+empty =
+OUTFLAG = -o $(empty)
+COUTFLAG = -o $(empty)
+CSRCFLAG = $(empty)
+
+RUBY_EXTCONF_H = 
+cflags   = $(optflags) $(debugflags) $(warnflags)
+cxxflags = 
+optflags = -O3 -fno-fast-math
+debugflags = -ggdb3
+warnflags = -Wall -Wextra -Wdeprecated-declarations -Wdiv-by-zero -Wduplicated-cond -Wimplicit-function-declaration -Wimplicit-int -Wmisleading-indentation -Wpointer-arith -Wwrite-strings -Wold-style-definition -Wimplicit-fallthrough=0 -Wmissing-noreturn -Wno-cast-function-type -Wno-constant-logical-operand -Wno-long-long -Wno-missing-field-initializers -Wno-overlength-strings -Wno-packed-bitfield-compat -Wno-parentheses-equality -Wno-self-assign -Wno-tautological-compare -Wno-unused-parameter -Wno-unused-value -Wsuggest-attribute=format -Wsuggest-attribute=noreturn -Wunused-variable -Wundef
+cppflags = 
+CCDLFLAGS = -fPIC
+CFLAGS   = $(CCDLFLAGS) -g -O2 -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -ffile-prefix-map=BUILDDIR=. -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -fdebug-prefix-map=BUILDDIR=/usr/src/ruby3.2-3.2.3-1ubuntu0.24.04.6 -fPIC -O3 -std=c99 -DZSTD_DISABLE_ASM $(ARCH_FLAG)
+INCFLAGS = -I. -I$(arch_hdrdir) -I$(hdrdir)/ruby/backward -I$(hdrdir) -I$(srcdir) -I/home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib -I/home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/common
+DEFS     = 
+CPPFLAGS =  -Wdate-time -D_FORTIFY_SOURCE=3 $(DEFS) $(cppflags)
+CXXFLAGS = $(CCDLFLAGS) -g -O2 -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -ffile-prefix-map=BUILDDIR=. -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -fdebug-prefix-map=BUILDDIR=/usr/src/ruby3.2-3.2.3-1ubuntu0.24.04.6 $(ARCH_FLAG)
+ldflags  = -L. -Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,-z,now -fstack-protector-strong -rdynamic -Wl,-export-dynamic -Wl,--no-as-needed
+dldflags = -Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,-z,now 
+ARCH_FLAG = 
+DLDFLAGS = $(ldflags) $(dldflags) $(ARCH_FLAG)
+LDSHARED = $(CC) -shared
+LDSHAREDXX = $(CXX) -shared
+AR = x86_64-linux-gnu-gcc-ar
+EXEEXT = 
+
+RUBY_INSTALL_NAME = $(RUBY_BASE_NAME)3.2
+RUBY_SO_NAME = ruby-3.2
+RUBYW_INSTALL_NAME = 
+RUBY_VERSION_NAME = $(RUBY_BASE_NAME)-$(ruby_version)
+RUBYW_BASE_NAME = rubyw
+RUBY_BASE_NAME = ruby
+
+arch = x86_64-linux-gnu
+sitearch = $(arch)
+ruby_version = 3.2.0
+ruby = $(bindir)/$(RUBY_BASE_NAME)3.2
+RUBY = $(ruby)
+BUILTRUBY = $(bindir)/$(RUBY_BASE_NAME)3.2
+ruby_headers = $(hdrdir)/ruby.h $(hdrdir)/ruby/backward.h $(hdrdir)/ruby/ruby.h $(hdrdir)/ruby/defines.h $(hdrdir)/ruby/missing.h $(hdrdir)/ruby/intern.h $(hdrdir)/ruby/st.h $(hdrdir)/ruby/subst.h $(arch_hdrdir)/ruby/config.h
+
+RM = rm -f
+RM_RF = rm -fr
+RMDIRS = rmdir --ignore-fail-on-non-empty -p
+MAKEDIRS = /bin/mkdir -p
+INSTALL = /usr/bin/install -c
+INSTALL_PROG = $(INSTALL) -m 0755
+INSTALL_DATA = $(INSTALL) -m 644
+COPY = cp
+TOUCH = exit >
+
+#### End of system configuration section. ####
+
+preload = 
+libpath = . $(archlibdir)
+LIBPATH =  -L. -L$(archlibdir)
+DEFFILE = 
+
+CLEANFILES = mkmf.log
+DISTCLEANFILES = 
+DISTCLEANDIRS = 
+
+extout = 
+extout_prefix = 
+target_prefix = 
+LOCAL_LIBS = 
+LIBS = $(LIBRUBYARG_SHARED)  -lm -lpthread  -lc
+ORIG_SRCS = zstd_native.c
+SRCS = $(ORIG_SRCS) debug.c entropy_common.c error_private.c fse_decompress.c pool.c threading.c xxhash.c zstd_common.c fse_compress.c hist.c huf_compress.c zstd_compress.c zstd_compress_literals.c zstd_compress_sequences.c zstd_compress_superblock.c zstd_double_fast.c zstd_fast.c zstd_lazy.c zstd_ldm.c zstd_opt.c zstd_preSplit.c zstdmt_compress.c huf_decompress.c zstd_ddict.c zstd_decompress.c zstd_decompress_block.c cover.c divsufsort.c fastcover.c zdict.c zstd_native.c
+OBJS = /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/common/debug.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/common/entropy_common.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/common/error_private.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/common/fse_decompress.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/common/pool.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/common/threading.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/common/xxhash.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/common/zstd_common.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/compress/fse_compress.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/compress/hist.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/compress/huf_compress.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/compress/zstd_compress.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/compress/zstd_compress_literals.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/compress/zstd_compress_sequences.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/compress/zstd_compress_superblock.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/compress/zstd_double_fast.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/compress/zstd_fast.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/compress/zstd_lazy.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/compress/zstd_ldm.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/compress/zstd_opt.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/compress/zstd_preSplit.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/compress/zstdmt_compress.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/decompress/huf_decompress.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/decompress/zstd_ddict.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/decompress/zstd_decompress.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/decompress/zstd_decompress_block.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/dictBuilder/cover.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/dictBuilder/divsufsort.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/dictBuilder/fastcover.o /home/jgreninger/Work/zstd-ruby/ext/zstd_native/zstd/lib/dictBuilder/zdict.o zstd_native.o
+HDRS = 
+LOCAL_HDRS = 
+TARGET = zstd_native
+TARGET_NAME = zstd_native
+TARGET_ENTRY = Init_$(TARGET_NAME)
+DLLIB = $(TARGET).so
+EXTSTATIC = 
+STATIC_LIB = 
+
+TIMESTAMP_DIR = .
+BINDIR        = $(bindir)
+RUBYCOMMONDIR = $(sitedir)$(target_prefix)
+RUBYLIBDIR    = $(sitelibdir)$(target_prefix)
+RUBYARCHDIR   = $(sitearchdir)$(target_prefix)
+HDRDIR        = $(sitehdrdir)$(target_prefix)
+ARCHHDRDIR    = $(sitearchhdrdir)$(target_prefix)
+TARGET_SO_DIR =
+TARGET_SO     = $(TARGET_SO_DIR)$(DLLIB)
+CLEANLIBS     = $(TARGET_SO) false
+CLEANOBJS     = $(OBJS) *.bak
+TARGET_SO_DIR_TIMESTAMP = $(TIMESTAMP_DIR)/.sitearchdir.time
+
+all:    $(DLLIB)
+static: $(STATIC_LIB)
+.PHONY: all install static install-so install-rb
+.PHONY: clean clean-so clean-static clean-rb
+
+clean-static::
+clean-rb-default::
+clean-rb::
+clean-so::
+clean: clean-so clean-static clean-rb-default clean-rb
+		-$(Q)$(RM_RF) $(CLEANLIBS) $(CLEANOBJS) $(CLEANFILES) .*.time
+
+distclean-rb-default::
+distclean-rb::
+distclean-so::
+distclean-static::
+distclean: clean distclean-so distclean-static distclean-rb-default distclean-rb
+		-$(Q)$(RM) Makefile $(RUBY_EXTCONF_H) conftest.* mkmf.log
+		-$(Q)$(RM) core ruby$(EXEEXT) *~ $(DISTCLEANFILES)
+		-$(Q)$(RMDIRS) $(DISTCLEANDIRS) 2> /dev/null || true
+
+realclean: distclean
+install: install-so install-rb
+
+install-so: $(DLLIB) $(TARGET_SO_DIR_TIMESTAMP)
+	$(INSTALL_PROG) $(DLLIB) $(RUBYARCHDIR)
+clean-static::
+	-$(Q)$(RM) $(STATIC_LIB)
+install-rb: pre-install-rb do-install-rb install-rb-default
+install-rb-default: pre-install-rb-default do-install-rb-default
+pre-install-rb: Makefile
+pre-install-rb-default: Makefile
+do-install-rb:
+do-install-rb-default:
+pre-install-rb-default:
+	@$(NULLCMD)
+$(TARGET_SO_DIR_TIMESTAMP):
+	$(Q) $(MAKEDIRS) $(@D) $(RUBYARCHDIR)
+	$(Q) $(TOUCH) $@
+
+site-install: site-install-so site-install-rb
+site-install-so: install-so
+site-install-rb: install-rb
+
+.SUFFIXES: .c .m .cc .mm .cxx .cpp .o .S
+
+.cc.o:
+	$(ECHO) compiling $(<)
+	$(Q) $(CXX) $(INCFLAGS) $(CPPFLAGS) $(CXXFLAGS) $(COUTFLAG)$@ -c $(CSRCFLAG)$<
+
+.cc.S:
+	$(ECHO) translating $(<)
+	$(Q) $(CXX) $(INCFLAGS) $(CPPFLAGS) $(CXXFLAGS) $(COUTFLAG)$@ -S $(CSRCFLAG)$<
+
+.mm.o:
+	$(ECHO) compiling $(<)
+	$(Q) $(CXX) $(INCFLAGS) $(CPPFLAGS) $(CXXFLAGS) $(COUTFLAG)$@ -c $(CSRCFLAG)$<
+
+.mm.S:
+	$(ECHO) translating $(<)
+	$(Q) $(CXX) $(INCFLAGS) $(CPPFLAGS) $(CXXFLAGS) $(COUTFLAG)$@ -S $(CSRCFLAG)$<
+
+.cxx.o:
+	$(ECHO) compiling $(<)
+	$(Q) $(CXX) $(INCFLAGS) $(CPPFLAGS) $(CXXFLAGS) $(COUTFLAG)$@ -c $(CSRCFLAG)$<
+
+.cxx.S:
+	$(ECHO) translating $(<)
+	$(Q) $(CXX) $(INCFLAGS) $(CPPFLAGS) $(CXXFLAGS) $(COUTFLAG)$@ -S $(CSRCFLAG)$<
+
+.cpp.o:
+	$(ECHO) compiling $(<)
+	$(Q) $(CXX) $(INCFLAGS) $(CPPFLAGS) $(CXXFLAGS) $(COUTFLAG)$@ -c $(CSRCFLAG)$<
+
+.cpp.S:
+	$(ECHO) translating $(<)
+	$(Q) $(CXX) $(INCFLAGS) $(CPPFLAGS) $(CXXFLAGS) $(COUTFLAG)$@ -S $(CSRCFLAG)$<
+
+.c.o:
+	$(ECHO) compiling $(<)
+	$(Q) $(CC) $(INCFLAGS) $(CPPFLAGS) $(CFLAGS) $(COUTFLAG)$@ -c $(CSRCFLAG)$<
+
+.c.S:
+	$(ECHO) translating $(<)
+	$(Q) $(CC) $(INCFLAGS) $(CPPFLAGS) $(CFLAGS) $(COUTFLAG)$@ -S $(CSRCFLAG)$<
+
+.m.o:
+	$(ECHO) compiling $(<)
+	$(Q) $(CC) $(INCFLAGS) $(CPPFLAGS) $(CFLAGS) $(COUTFLAG)$@ -c $(CSRCFLAG)$<
+
+.m.S:
+	$(ECHO) translating $(<)
+	$(Q) $(CC) $(INCFLAGS) $(CPPFLAGS) $(CFLAGS) $(COUTFLAG)$@ -S $(CSRCFLAG)$<
+
+$(TARGET_SO): $(OBJS) Makefile
+	$(ECHO) linking shared-object $(DLLIB)
+	-$(Q)$(RM) $(@)
+	$(Q) $(LDSHARED) -o $@ $(OBJS) $(LIBPATH) $(DLDFLAGS) $(LOCAL_LIBS) $(LIBS)
+
+
+
+$(OBJS): $(HDRS) $(ruby_headers)

data/ext/zstd_native/extconf.rb

@@ -0,0 +1,37 @@
+require "mkmf"
+
+# Set the extension name
+extension_name = "zstd_native"
+
+# Find zstd library sources
+zstd_lib_dir = File.join(__dir__, "zstd/lib")
+
+unless File.directory?(zstd_lib_dir)
+  abort "ERROR: zstd library not found. Expected at #{zstd_lib_dir}"
+end
+
+# Add include directories
+$INCFLAGS << " -I#{zstd_lib_dir}"
+$INCFLAGS << " -I#{zstd_lib_dir}/common"
+
+# Find all zstd source files we need
+zstd_sources = Dir.glob(File.join(zstd_lib_dir, "common/*.c"))
+zstd_sources += Dir.glob(File.join(zstd_lib_dir, "compress/*.c"))
+zstd_sources += Dir.glob(File.join(zstd_lib_dir, "decompress/*.c"))
+zstd_sources += Dir.glob(File.join(zstd_lib_dir, "dictBuilder/*.c"))
+
+# Add zstd sources to the compilation
+$objs = []
+zstd_sources.each do |src|
+  obj = src.sub(/\.c$/, '.o')
+  $objs << obj
+end
+
+# Add our extension source
+$objs << "zstd_native.o"
+
+# Set optimization flags and disable assembly
+$CFLAGS << " -O3 -std=c99 -DZSTD_DISABLE_ASM"
+
+# Create the makefile
+create_makefile(extension_name, __dir__)

data/{vendor → ext/zstd_native}/zstd/CONTRIBUTING.md

@@ -373,12 +373,7 @@ counter `L1-dcache-load-misses`
 
 #### Visual Studio
 
-Build Zstd with symbols first (for example `cmake -B build -S build/cmake -DCMAKE_BUILD_TYPE=RelWithDebInfo && ninja -C build zstd`) so the profiler resolves call stacks.
-
-* Launch Visual Studio’s Performance Profiler (`Alt+F2`), enable CPU Usage (optionally Instrumentation), and point it at the `programs/zstd` benchmark you want to run.
-* If you prefer to start the benchmark from a terminal, use “Attach to running process” to latch onto it mid-run; keep frame pointers (`-fno-omit-frame-pointer`) for clean stacks.
-* When you stop the capture, review the call tree, hot path, and annotated source panes
-* Microsoft’s [Performance Profiling docs](https://learn.microsoft.com/en-us/visualstudio/profiling/?view=vs-2022) cover deeper sampling, ETW, and collection options if required.
+TODO
 
 ## Issues
 We use GitHub issues to track public bugs. Please ensure your description is

data/{vendor → ext/zstd_native}/zstd/Makefile

@@ -144,13 +144,10 @@ clean:
 	$(Q)$(RM) -r lz4 cmakebuild mesonbuild install
 	@echo Cleaning completed
 
-LIBZSTD_MK_DIR = $(ZSTDDIR)
-include $(LIBZSTD_MK_DIR)/install_oses.mk # UNAME, INSTALL_OS_LIST
-
 #------------------------------------------------------------------------------
 # make install is validated only for Linux, macOS, Hurd and some BSD targets
 #------------------------------------------------------------------------------
-ifneq (,$(filter $(INSTALL_OS_LIST),$(UNAME)))
+ifneq (,$(filter Linux Darwin GNU/kFreeBSD GNU OpenBSD FreeBSD DragonFly NetBSD MSYS_NT% CYGWIN_NT% Haiku AIX,$(shell sh -c 'MSYSTEM="MSYS" uname') ))
 
 HOST_OS = POSIX
 
@@ -354,7 +351,7 @@ apt-add-repo:
 	sudo add-apt-repository -y ppa:ubuntu-toolchain-r/test
 	sudo apt-get update -y -qq
 
-.PHONY: ppcinstall arminstall valgrindinstall libc6install gcc6install gcc7install gcc8install gpp6install clang38install
+.PHONY: ppcinstall arminstall valgrindinstall libc6install gcc6install gcc7install gcc8install gpp6install clang38install lz4install
 ppcinstall:
 	APT_PACKAGES="qemu-system-ppc qemu-user-static gcc-powerpc-linux-gnu" $(MAKE) apt-install
 
@@ -382,6 +379,10 @@ gpp6install: apt-add-repo
 clang38install:
 	APT_PACKAGES="clang-3.8" $(MAKE) apt-install
 
+# Ubuntu 14.04 ships a too-old lz4
+lz4install:
+	[ -e lz4 ] || git clone https://github.com/lz4/lz4 && sudo $(MAKE) -C lz4 install
+
 endif
 
 

data/{vendor → ext/zstd_native}/zstd/README.md

@@ -30,9 +30,9 @@ a list of known ports and bindings is provided on [Zstandard homepage](https://f
 
 For reference, several fast compression algorithms were tested and compared
 on a desktop featuring a Core i7-9700K CPU @ 4.9GHz
-and running Ubuntu 24.04 (`Linux 6.8.0-53-generic`),
+and running Ubuntu 20.04 (`Linux ubu20 5.15.0-101-generic`),
 using [lzbench], an open-source in-memory benchmark by @inikep
-compiled with [gcc] 14.2.0,
+compiled with [gcc] 9.4.0,
 on the [Silesia compression corpus].
 
 [lzbench]: https://github.com/inikep/lzbench
@@ -41,16 +41,16 @@ on the [Silesia compression corpus].
 
 | Compressor name         | Ratio | Compression| Decompress.|
 | ---------------         | ------| -----------| ---------- |
-| **zstd 1.5.7 -1**       | 2.896 |   510 MB/s |  1550 MB/s |
-| brotli 1.1.0 -1         | 2.883 |   290 MB/s |   425 MB/s |
-| [zlib] 1.3.1 -1         | 2.743 |   105 MB/s |   390 MB/s |
-| **zstd 1.5.7 --fast=1** | 2.439 |   545 MB/s |  1850 MB/s |
-| quicklz 1.5.0 -1        | 2.238 |   520 MB/s |   750 MB/s |
-| **zstd 1.5.7 --fast=4** | 2.146 |   665 MB/s |  2050 MB/s |
-| lzo1x 2.10 -1           | 2.106 |   650 MB/s |   780 MB/s |
-| [lz4] 1.10.0            | 2.101 |   675 MB/s |  3850 MB/s |
-| snappy 1.2.1            | 2.089 |   520 MB/s |  1500 MB/s |
-| lzf 3.6 -1              | 2.077 |   410 MB/s |   820 MB/s |
+| **zstd 1.5.6 -1**       | 2.887 |   510 MB/s |  1580 MB/s |
+| [zlib] 1.2.11 -1        | 2.743 |    95 MB/s |   400 MB/s |
+| brotli 1.0.9 -0         | 2.702 |   395 MB/s |   430 MB/s |
+| **zstd 1.5.6 --fast=1** | 2.437 |   545 MB/s |  1890 MB/s |
+| **zstd 1.5.6 --fast=3** | 2.239 |   650 MB/s |  2000 MB/s |
+| quicklz 1.5.0 -1        | 2.238 |   525 MB/s |   750 MB/s |
+| lzo1x 2.10 -1           | 2.106 |   650 MB/s |   825 MB/s |
+| [lz4] 1.9.4             | 2.101 |   700 MB/s |  4000 MB/s |
+| lzf 3.6 -1              | 2.077 |   420 MB/s |   830 MB/s |
+| snappy 1.1.9            | 2.073 |   530 MB/s |  1660 MB/s |
 
 [zlib]: https://www.zlib.net/
 [lz4]: https://lz4.github.io/lz4/
@@ -120,40 +120,33 @@ Dictionary gains are mostly effective in the first few KB. Then, the compression
 
 ## Build instructions
 
-`make` is the main build system of this project.
-It is the reference, and other build systems are periodically updated to stay compatible.
-However, small drifts and feature differences can be present, since perfect synchronization is difficult.
-For this reason, when your build system allows it, prefer employing `make`.
+`make` is the officially maintained build system of this project.
+All other build systems are "compatible" and 3rd-party maintained,
+they may feature small differences in advanced options.
+When your system allows it, prefer using `make` to build `zstd` and `libzstd`.
 
 ### Makefile
 
-Assuming your system supports standard `make` (or `gmake`),
-just invoking `make` in root directory generates `zstd` cli at root,
-and also generates `libzstd` into `lib/`.
+If your system is compatible with standard `make` (or `gmake`),
+invoking `make` in root directory will generate `zstd` cli in root directory.
+It will also create `libzstd` into `lib/`.
 
-Other standard targets include:
-- `make install` : install zstd cli, library and man pages
-- `make check` : run `zstd`, test its essential behavior on local platform
+Other available options include:
+- `make install` : create and install zstd cli, library and man pages
+- `make check` : create and run `zstd`, test its behavior on local platform
 
 The `Makefile` follows the [GNU Standard Makefile conventions](https://www.gnu.org/prep/standards/html_node/Makefile-Conventions.html),
-allowing staged install, standard compilation flags, directory variables and command variables.
+allowing staged install, standard flags, directory variables and command variables.
 
-For advanced use cases, specialized flags which control binary generation and installation paths are documented
-in [`lib/README.md`](lib/README.md#modular-build) for the `libzstd` library
+For advanced use cases, specialized compilation flags which control binary generation
+are documented in [`lib/README.md`](lib/README.md#modular-build) for the `libzstd` library
 and in [`programs/README.md`](programs/README.md#compilation-variables) for the `zstd` CLI.
 
 ### cmake
 
-A `cmake` project generator is available for generating Makefiles or other build scripts
-to create the `zstd` binary as well as `libzstd` dynamic and static libraries.
-The repository root now contains a minimal `CMakeLists.txt` that forwards to `build/cmake`,
-so you can configure the project with a standard `cmake -S .` invocation,
-while the historical `cmake -S build/cmake` entry point remains fully supported.
-
-```bash
-cmake -S . -B build-cmake
-cmake --build build-cmake
-```
+A `cmake` project generator is provided within `build/cmake`.
+It can generate Makefiles or other build scripts
+to create `zstd` binary, and `libzstd` dynamic and static libraries.
 
 By default, `CMAKE_BUILD_TYPE` is set to `Release`.
 
@@ -163,7 +156,7 @@ By default, `CMAKE_BUILD_TYPE` is set to `Release`.
 To perform a Fat/Universal2 build and install use the following commands:
 
 ```bash
-cmake -S . -B build-cmake-debug -G Ninja -DCMAKE_OSX_ARCHITECTURES="x86_64;x86_64h;arm64"
+cmake -B build-cmake-debug -S build/cmake -G Ninja -DCMAKE_OSX_ARCHITECTURES="x86_64;x86_64h;arm64"
 cd build-cmake-debug
 ninja
 sudo ninja install
@@ -205,11 +198,10 @@ If the version is out of date, please [create an issue or pull request](https://
 ### Visual Studio (Windows)
 
 Going into `build` directory, you will find additional possibilities:
-- Projects for Visual Studio 2008 and 2010.
+- Projects for Visual Studio 2005, 2008 and 2010.
   + VS2010 project is compatible with VS2012, VS2013, VS2015 and VS2017.
 - Automated build scripts for Visual compiler by [@KrzysFR](https://github.com/KrzysFR), in `build/VS_scripts`,
   which will build `zstd` cli and `libzstd` library without any need to open Visual Studio solution.
-- It is now recommended to generate Visual Studio solutions from `cmake`
 
 ### Buck
 
@@ -218,7 +210,7 @@ The output binary will be in `buck-out/gen/programs/`.
 
 ### Bazel
 
-You can integrate zstd into your Bazel project by using the module hosted on the [Bazel Central Repository](https://registry.bazel.build/modules/zstd).
+You easily can integrate zstd into your Bazel project by using the module hosted on the [Bazel Central Repository](https://registry.bazel.build/modules/zstd).
 
 ## Testing
 
@@ -229,9 +221,9 @@ For information on CI testing, please refer to `TESTING.md`.
 
 ## Status
 
-Zstandard is deployed within Meta and many other large cloud infrastructures,
-to compress humongous amounts of data in various formats and use cases.
-It is also continuously fuzzed for security issues by Google's [oss-fuzz](https://github.com/google/oss-fuzz/tree/master/projects/zstd) program.
+Zstandard is currently deployed within Facebook and many other large cloud infrastructures.
+It is run continuously to compress large amounts of data in multiple formats and use cases.
+Zstandard is considered safe for production environments.
 
 ## License
 
@@ -240,5 +232,6 @@ Zstandard is dual-licensed under [BSD](LICENSE) OR [GPLv2](COPYING).
 ## Contributing
 
 The `dev` branch is the one where all contributions are merged before reaching `release`.
+If you plan to propose a patch, please commit into the `dev` branch, or its own feature branch.
 Direct commit to `release` are not permitted.
 For more information, please read [CONTRIBUTING](CONTRIBUTING.md).