evalsuite-python 0.1.0b2__py3-none-any.whl → 0.1.2__py3-none-any.whl
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- evalsuite/version.py +1 -1
- {evalsuite_python-0.1.0b2.dist-info → evalsuite_python-0.1.2.dist-info}/METADATA +28 -7
- {evalsuite_python-0.1.0b2.dist-info → evalsuite_python-0.1.2.dist-info}/RECORD +6 -6
- {evalsuite_python-0.1.0b2.dist-info → evalsuite_python-0.1.2.dist-info}/licenses/LICENSE +1 -1
- {evalsuite_python-0.1.0b2.dist-info → evalsuite_python-0.1.2.dist-info}/WHEEL +0 -0
- {evalsuite_python-0.1.0b2.dist-info → evalsuite_python-0.1.2.dist-info}/entry_points.txt +0 -0
evalsuite/version.py
CHANGED
|
@@ -1,18 +1,18 @@
|
|
|
1
1
|
Metadata-Version: 2.5
|
|
2
2
|
Name: evalsuite-python
|
|
3
|
-
Version: 0.1.
|
|
3
|
+
Version: 0.1.2
|
|
4
4
|
Summary: A unified Python framework for machine-learning, clinical, statistical, segmentation, object-detection, uncertainty, and model evaluation.
|
|
5
5
|
Project-URL: Homepage, https://evalsuite-nine.vercel.app
|
|
6
6
|
Project-URL: Documentation, https://evalsuite-nine.vercel.app/docs
|
|
7
7
|
Project-URL: Source, https://github.com/mkcs28/evalsuite-python
|
|
8
8
|
Project-URL: Issues, https://github.com/mkcs28/evalsuite-python/issues
|
|
9
9
|
Project-URL: Changelog, https://github.com/mkcs28/evalsuite-python/blob/main/CHANGELOG.md
|
|
10
|
-
Author: Manoj Kumar C S
|
|
11
|
-
Maintainer: Manoj Kumar C S
|
|
10
|
+
Author: Manoj Kumar C S, Nikhil D Bharadwaj
|
|
11
|
+
Maintainer: Manoj Kumar C S, Nikhil D Bharadwaj
|
|
12
12
|
License-Expression: MIT
|
|
13
13
|
License-File: LICENSE
|
|
14
14
|
Keywords: classification,evaluation,machine learning,metrics,regression,reproducibility,statistics
|
|
15
|
-
Classifier: Development Status ::
|
|
15
|
+
Classifier: Development Status :: 5 - Production/Stable
|
|
16
16
|
Classifier: Intended Audience :: Developers
|
|
17
17
|
Classifier: Intended Audience :: Science/Research
|
|
18
18
|
Classifier: Operating System :: OS Independent
|
|
@@ -62,7 +62,7 @@ Description-Content-Type: text/markdown
|
|
|
62
62
|
EvalSuite brings classification and regression metrics (with clinical, statistical, segmentation and
|
|
63
63
|
object-detection evaluation on the roadmap) into one consistent, validated, documented framework.
|
|
64
64
|
|
|
65
|
-
> **Status:
|
|
65
|
+
> **Status: stable (0.1.2).** Every item on the 0.1.0 roadmap is implemented and verified.
|
|
66
66
|
|
|
67
67
|
## Installation
|
|
68
68
|
|
|
@@ -185,8 +185,25 @@ Input files can be CSV, TSV, Parquet or JSON. Output format follows `--format` o
|
|
|
185
185
|
|
|
186
186
|
## Performance
|
|
187
187
|
|
|
188
|
-
|
|
189
|
-
|
|
188
|
+
Benchmarked against scikit-learn on the same data (fastest of 5 runs; Python 3.12, NumPy 2.5,
|
|
189
|
+
scikit-learn 1.9, Linux x86_64). Every result agrees with scikit-learn to floating-point rounding
|
|
190
|
+
(largest difference 1.1e-16).
|
|
191
|
+
|
|
192
|
+
| Case | n | EvalSuite (ms) | scikit-learn (ms) | Speed-up | Peak memory EvalSuite / sklearn (MiB) |
|
|
193
|
+
| --- | ---: | ---: | ---: | ---: | ---: |
|
|
194
|
+
| 8 binary label metrics via `evaluate()` | 1,000 | 0.38 | 11.70 | **31.2×** | 0.04 / 0.05 |
|
|
195
|
+
| 8 binary label metrics via `evaluate()` | 100,000 | 10.9 | 116.9 | **10.7×** | 3.2 / 3.1 |
|
|
196
|
+
| 8 binary label metrics via `evaluate()` | 1,000,000 | 108.8 | 1043.6 | **9.6×** | 31.5 / 30.5 |
|
|
197
|
+
| macro F1, 10 classes | 1,000,000 | 88.4 | 139.3 | **1.58×** | 30.5 / 21.8 |
|
|
198
|
+
| ROC AUC, binary | 1,000,000 | 247.4 | 352.5 | **1.42×** | 91.6 / 76.3 |
|
|
199
|
+
| MAE, MSE, RMSE, R² via `evaluate()` | 1,000 | 0.12 | 0.90 | **7.2×** | 0.03 / 0.02 |
|
|
200
|
+
| MAE, MSE, RMSE, R² via `evaluate()` | 1,000,000 | 29.3 | 20.1 | 0.69× | 22.9 / 15.3 |
|
|
201
|
+
|
|
202
|
+
`evaluate()` validates inputs once and builds the confusion matrix once for all metrics, which is where the
|
|
203
|
+
speed-up comes from. Large regression arrays are slower because EvalSuite checks every value for NaN,
|
|
204
|
+
infinity, shape and dtype before computing. Reproduce on your machine with `evalsuite benchmark`; full
|
|
205
|
+
table and notes in
|
|
206
|
+
[BENCHMARKS.md](https://github.com/mkcs28/evalsuite-python/blob/main/BENCHMARKS.md).
|
|
190
207
|
|
|
191
208
|
## Metrics in this release
|
|
192
209
|
|
|
@@ -225,6 +242,10 @@ ruff check . && ruff format --check . && mypy
|
|
|
225
242
|
- Website and documentation: https://evalsuite-nine.vercel.app
|
|
226
243
|
- Website source: https://github.com/mkcs28/evalsuite
|
|
227
244
|
|
|
245
|
+
## Credits
|
|
246
|
+
|
|
247
|
+
Authors and maintainers: **Manoj Kumar C S** and **Nikhil D Bharadwaj**.
|
|
248
|
+
|
|
228
249
|
## License
|
|
229
250
|
|
|
230
251
|
MIT. See [LICENSE](LICENSE).
|
|
@@ -5,7 +5,7 @@ evalsuite/benchmarks.py,sha256=6y0K6-5vwIc7D3ACItQXLSqVCRX6EvqWdVPttVlBkNU,10018
|
|
|
5
5
|
evalsuite/plot.py,sha256=QqQgcEOjIGkpMSwfgXjO2PzOaLBmj8-dTZrzlqzOHFw,11416
|
|
6
6
|
evalsuite/py.typed,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
|
|
7
7
|
evalsuite/reporting.py,sha256=-LISv9vvEnltT26GtzLjVlxOCcAwmjv4-HyB8_1UF5o,9615
|
|
8
|
-
evalsuite/version.py,sha256=
|
|
8
|
+
evalsuite/version.py,sha256=OSDjvHcdlFxo12lQp5sthgm-qvsSE4tKP7svhOkVaXc,98
|
|
9
9
|
evalsuite/classification/__init__.py,sha256=ErBIXbBGnhfW6v-1Cn5SegiERoyxNlmO1tEKcLM15mA,833
|
|
10
10
|
evalsuite/classification/_common.py,sha256=3ANV33ix_mnOzvOAG8glyJO-iYVhhTGO0S3YG0ZddB8,4543
|
|
11
11
|
evalsuite/classification/metrics.py,sha256=8-RPjzuFUKJYlXndrDv6kXlzRdx6aR2lHp7mzKsas2g,36969
|
|
@@ -28,8 +28,8 @@ evalsuite/stats/effect.py,sha256=O0-pxY_6o25G3w7ymDar3xb_dtCOO0kG0sLv-A_Yb0Q,488
|
|
|
28
28
|
evalsuite/stats/intervals.py,sha256=w2bLuFt3p-TTN_ALH1uKPmDMLcTzBBoV2YvcP-ENAOk,13709
|
|
29
29
|
evalsuite/stats/paired.py,sha256=YK3AFndChKeCEpK512u56VtRlKvhlGdkFLHHYe77zmc,8244
|
|
30
30
|
evalsuite/stats/results.py,sha256=nqXHUiW8l0fQJkbMiunU6Gz-2be1NApZ6Fif2B1K_Yw,4407
|
|
31
|
-
evalsuite_python-0.1.
|
|
32
|
-
evalsuite_python-0.1.
|
|
33
|
-
evalsuite_python-0.1.
|
|
34
|
-
evalsuite_python-0.1.
|
|
35
|
-
evalsuite_python-0.1.
|
|
31
|
+
evalsuite_python-0.1.2.dist-info/METADATA,sha256=t22WnU6D0zh7287IRmNjaBVrr_4svjekppzHTzHYr5I,10869
|
|
32
|
+
evalsuite_python-0.1.2.dist-info/WHEEL,sha256=W3fkpkm7-wf9vBI5Z-7s0eWkeM-spu78I8Neb98DeEg,87
|
|
33
|
+
evalsuite_python-0.1.2.dist-info/entry_points.txt,sha256=YYIwisn4L4sQt3ntzbM0_Z4yZE2KCu3GJ6KfWL1kIwc,54
|
|
34
|
+
evalsuite_python-0.1.2.dist-info/licenses/LICENSE,sha256=cRRQ6Kk8w2qCqtDSSUJQGy-0rqjmjJG09cZ6iIiMvdc,1095
|
|
35
|
+
evalsuite_python-0.1.2.dist-info/RECORD,,
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
MIT License
|
|
2
2
|
|
|
3
|
-
Copyright (c) 2026 Manoj Kumar C S
|
|
3
|
+
Copyright (c) 2026 Manoj Kumar C S and Nikhil D Bharadwaj
|
|
4
4
|
|
|
5
5
|
Permission is hereby granted, free of charge, to any person obtaining a copy
|
|
6
6
|
of this software and associated documentation files (the "Software"), to deal
|
|
File without changes
|
|
File without changes
|