palletjack 2.1.2__tar.gz → 2.2.0__tar.gz
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- {palletjack-2.1.2 → palletjack-2.2.0}/PKG-INFO +3 -3
- {palletjack-2.1.2 → palletjack-2.2.0}/README.md +1 -1
- {palletjack-2.1.2 → palletjack-2.2.0}/palletjack/palletjack_cython.cpp +1447 -1115
- {palletjack-2.1.2 → palletjack-2.2.0}/palletjack.egg-info/PKG-INFO +3 -3
- palletjack-2.2.0/palletjack.egg-info/requires.txt +1 -0
- {palletjack-2.1.2 → palletjack-2.2.0}/pyproject.toml +3 -3
- palletjack-2.1.2/palletjack.egg-info/requires.txt +0 -1
- {palletjack-2.1.2 → palletjack-2.2.0}/LICENSE +0 -0
- {palletjack-2.1.2 → palletjack-2.2.0}/palletjack/__init__.py +0 -0
- {palletjack-2.1.2 → palletjack-2.2.0}/palletjack/cpalletjack.pxd +0 -0
- {palletjack-2.1.2 → palletjack-2.2.0}/palletjack/palletjack.cc +0 -0
- {palletjack-2.1.2 → palletjack-2.2.0}/palletjack/palletjack.h +0 -0
- {palletjack-2.1.2 → palletjack-2.2.0}/palletjack/palletjack_cython.pyx +0 -0
- {palletjack-2.1.2 → palletjack-2.2.0}/palletjack/parquet_types_palletjack.cpp +0 -0
- {palletjack-2.1.2 → palletjack-2.2.0}/palletjack/parquet_types_palletjack.h +0 -0
- {palletjack-2.1.2 → palletjack-2.2.0}/palletjack/windows_fixup.h +0 -0
- {palletjack-2.1.2 → palletjack-2.2.0}/palletjack.egg-info/SOURCES.txt +0 -0
- {palletjack-2.1.2 → palletjack-2.2.0}/palletjack.egg-info/dependency_links.txt +0 -0
- {palletjack-2.1.2 → palletjack-2.2.0}/palletjack.egg-info/not-zip-safe +0 -0
- {palletjack-2.1.2 → palletjack-2.2.0}/palletjack.egg-info/top_level.txt +0 -0
- {palletjack-2.1.2 → palletjack-2.2.0}/setup.cfg +0 -0
- {palletjack-2.1.2 → palletjack-2.2.0}/setup.py +0 -0
- {palletjack-2.1.2 → palletjack-2.2.0}/test/test_palletjack.py +0 -0
- {palletjack-2.1.2 → palletjack-2.2.0}/test/test_readme.py +0 -0
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
Metadata-Version: 2.1
|
|
2
2
|
Name: palletjack
|
|
3
|
-
Version: 2.
|
|
3
|
+
Version: 2.2.0
|
|
4
4
|
Summary: Faster parquet metadata reading
|
|
5
5
|
Author-email: Marcin Krystianc <marcin.krystianc@gmail.com>
|
|
6
6
|
Project-URL: Homepage, https://github.com/marcin-krystianc/PalletJack
|
|
@@ -11,7 +11,7 @@ Classifier: Operating System :: OS Independent
|
|
|
11
11
|
Requires-Python: >=3.9
|
|
12
12
|
Description-Content-Type: text/markdown
|
|
13
13
|
License-File: LICENSE
|
|
14
|
-
Requires-Dist: pyarrow~=
|
|
14
|
+
Requires-Dist: pyarrow~=16.0
|
|
15
15
|
|
|
16
16
|
# PalletJack
|
|
17
17
|
PalletJack was created as a workaround for apache/arrow#38149. The standard parquet reader is not efficient for files with numerous columns and row groups, as it requires parsing the entire metadata section each time the file is opened. The size of this metadata section is proportional to the number of columns and row groups in the file.
|
|
@@ -25,7 +25,7 @@ PalletJack reduces the amount of metadata bytes that need to be read and decoded
|
|
|
25
25
|
|
|
26
26
|
## Required:
|
|
27
27
|
|
|
28
|
-
- pyarrow ~=
|
|
28
|
+
- pyarrow ~= 16.0
|
|
29
29
|
|
|
30
30
|
PalletJack operates on top of pyarrow, making it an essential requirement for both building and using PalletJack. While our source package is compatible with recent versions of pyarrow, the binary distribution package specifically requires the latest major version of pyarrow.
|
|
31
31
|
|
|
@@ -10,7 +10,7 @@ PalletJack reduces the amount of metadata bytes that need to be read and decoded
|
|
|
10
10
|
|
|
11
11
|
## Required:
|
|
12
12
|
|
|
13
|
-
- pyarrow ~=
|
|
13
|
+
- pyarrow ~= 16.0
|
|
14
14
|
|
|
15
15
|
PalletJack operates on top of pyarrow, making it an essential requirement for both building and using PalletJack. While our source package is compatible with recent versions of pyarrow, the binary distribution package specifically requires the latest major version of pyarrow.
|
|
16
16
|
|