gruppera 0.4.0__py3-none-win_amd64.whl
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
|
Binary file
|
|
@@ -0,0 +1,97 @@
|
|
|
1
|
+
Metadata-Version: 2.1
|
|
2
|
+
Name: gruppera
|
|
3
|
+
Version: 0.4.0
|
|
4
|
+
Summary: Fast station-temperature aggregation (One Billion Row Challenge format): mmap, SWAR parsing, byte-identical output to the Java reference.
|
|
5
|
+
Home-page: https://github.com/andrey-usa/gruppera
|
|
6
|
+
Project-URL: Source, https://github.com/andrey-usa/gruppera
|
|
7
|
+
Project-URL: Changelog, https://github.com/andrey-usa/gruppera/blob/HEAD/CHANGELOG.md
|
|
8
|
+
License: MIT
|
|
9
|
+
Keywords: 1brc,aggregation,performance,simd,cli
|
|
10
|
+
Classifier: Programming Language :: Rust
|
|
11
|
+
Classifier: Environment :: Console
|
|
12
|
+
Classifier: License :: OSI Approved :: MIT License
|
|
13
|
+
Requires-Python: >=3.8
|
|
14
|
+
Description-Content-Type: text/markdown
|
|
15
|
+
|
|
16
|
+
# gruppera
|
|
17
|
+
|
|
18
|
+
High-performance station-temperature aggregation engine, written in Rust.
|
|
19
|
+
|
|
20
|
+
## Status
|
|
21
|
+
|
|
22
|
+
On 200M rows (2.6 GB, official 1BRC generator, warm cache,
|
|
23
|
+
4 vCPU GitHub runner) gruppera is within 5% of the 1BRC winner (thomaswue)
|
|
24
|
+
built the way it ships, as a GraalVM native image, ties it on CPU time, and
|
|
25
|
+
runs 1.76× faster than the winner on the JVM — with byte-identical output
|
|
26
|
+
([bench-200m run 37402714819](https://github.com/andrey-usa/gruppera/actions/runs/37402714819)):
|
|
27
|
+
|
|
28
|
+
| contender | wall (best of 3) | CPU time |
|
|
29
|
+
|---|---|---|
|
|
30
|
+
| gruppera | 0.915 s | 3.35 s |
|
|
31
|
+
| gruppera + PGO | 0.913 s | 3.34 s |
|
|
32
|
+
| winner, native image (tuned flags) | 0.875 s | 3.36 s |
|
|
33
|
+
| winner, native image (default) | 0.885 s | 3.37 s |
|
|
34
|
+
| winner, OpenJDK 21 (JIT) | 1.609 s | 5.59 s |
|
|
35
|
+
|
|
36
|
+
The native image's remaining wall-time edge includes its fork trick: the parent prints and exits while a worker process
|
|
37
|
+
still unmaps the file, so the measured wall stops before teardown; gruppera's
|
|
38
|
+
wall includes its own munmap.
|
|
39
|
+
|
|
40
|
+
## Design
|
|
41
|
+
|
|
42
|
+
- Memory-mapped input, 2MB work-stealing chunks claimed via an atomic cursor
|
|
43
|
+
- Three interleaved row parsers per thread to hide hash-table latency
|
|
44
|
+
- SWAR branchless temperature parsing into integer tenths
|
|
45
|
+
- Per-thread open-addressing hash tables (64-byte slots, linear probing)
|
|
46
|
+
- Integer-only accumulation; floating point only at output formatting
|
|
47
|
+
|
|
48
|
+
The techniques follow standard practice in high-performance text aggregation.
|
|
49
|
+
We are grateful to the 1BRC (One Billion Row Challenge) community, whose
|
|
50
|
+
public write-ups informed this design. This is an original implementation.
|
|
51
|
+
|
|
52
|
+
## Correctness
|
|
53
|
+
|
|
54
|
+
Every push runs `tests/fuzz.py`: the release binary (real mmap) is diffed
|
|
55
|
+
against a naive reference on randomized inputs — name lengths around every
|
|
56
|
+
SWAR path boundary, multibyte UTF-8, 100-byte names, 10k-station multi-chunk
|
|
57
|
+
files, tiny files — with half the inputs ending exactly on a 4 KiB page so
|
|
58
|
+
any read past EOF faults. Output order matches Java's `TreeMap<String>`
|
|
59
|
+
(UTF-16 code units).
|
|
60
|
+
|
|
61
|
+
## Install
|
|
62
|
+
|
|
63
|
+
Prebuilt binaries for Linux (x86_64, aarch64), macOS (arm64, x86_64) and
|
|
64
|
+
Windows (x64) are on the [releases page](https://github.com/andrey-usa/gruppera/releases),
|
|
65
|
+
and the same binaries through package managers:
|
|
66
|
+
|
|
67
|
+
| | |
|
|
68
|
+
|---|---|
|
|
69
|
+
| Cargo | `cargo install --locked gruppera` |
|
|
70
|
+
| npm | `npm install -g gruppera` |
|
|
71
|
+
| pip / uv | `pip install gruppera` · `uv tool install gruppera` |
|
|
72
|
+
| Homebrew | `brew install andrey-usa/tap/gruppera` |
|
|
73
|
+
| Scoop | `scoop bucket add andrey-usa https://github.com/andrey-usa/scoop-bucket` then `scoop install gruppera` |
|
|
74
|
+
|
|
75
|
+
The prebuilt x86_64 binaries target `x86-64-v2` so they run on any CPU from
|
|
76
|
+
the last fifteen years. For the numbers above, build for your own machine:
|
|
77
|
+
|
|
78
|
+
```sh
|
|
79
|
+
cargo build --release # .cargo/config.toml sets -C target-cpu=native
|
|
80
|
+
```
|
|
81
|
+
|
|
82
|
+
## Run
|
|
83
|
+
|
|
84
|
+
```sh
|
|
85
|
+
gruppera measurements.txt
|
|
86
|
+
```
|
|
87
|
+
|
|
88
|
+
Input is the 1BRC format, one `<station>;<temperature>` row per line;
|
|
89
|
+
output is `{station=min/mean/max, ...}` sorted by station name.
|
|
90
|
+
|
|
91
|
+
## Contributing
|
|
92
|
+
|
|
93
|
+
See [CONTRIBUTING.md](CONTRIBUTING.md).
|
|
94
|
+
|
|
95
|
+
## License
|
|
96
|
+
|
|
97
|
+
[MIT](LICENSE)
|
|
@@ -0,0 +1,5 @@
|
|
|
1
|
+
gruppera-0.4.0.data/scripts/gruppera.exe,sha256=nZTAw4N0qRgrI0qJOgfBr2s0wF6n-crBAapWzFYb2gA,301568
|
|
2
|
+
gruppera-0.4.0.dist-info/METADATA,sha256=pXKRChXOaS0Q0GaCndu--saBGuCT3m8APFYgoJF0_Tg,3713
|
|
3
|
+
gruppera-0.4.0.dist-info/WHEEL,sha256=g1aQ65onkFiWyh7QjiXnWXLnCV9xiZTddNDcljDxYOM,88
|
|
4
|
+
gruppera-0.4.0.dist-info/licenses/LICENSE,sha256=RSeVx-hjXtE643Nsk8gnOcomD9Wdf4PAXy7J7fSi4pQ,1067
|
|
5
|
+
gruppera-0.4.0.dist-info/RECORD,,
|
|
@@ -0,0 +1,21 @@
|
|
|
1
|
+
MIT License
|
|
2
|
+
|
|
3
|
+
Copyright (c) 2026 andrey-usa
|
|
4
|
+
|
|
5
|
+
Permission is hereby granted, free of charge, to any person obtaining a copy
|
|
6
|
+
of this software and associated documentation files (the "Software"), to deal
|
|
7
|
+
in the Software without restriction, including without limitation the rights
|
|
8
|
+
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
|
9
|
+
copies of the Software, and to permit persons to whom the Software is
|
|
10
|
+
furnished to do so, subject to the following conditions:
|
|
11
|
+
|
|
12
|
+
The above copyright notice and this permission notice shall be included in all
|
|
13
|
+
copies or substantial portions of the Software.
|
|
14
|
+
|
|
15
|
+
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
|
16
|
+
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
|
17
|
+
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
|
18
|
+
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
|
19
|
+
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
|
20
|
+
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
|
|
21
|
+
SOFTWARE.
|