datapruning 1.0.2__tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (15) hide show
  1. datapruning-1.0.2/LICENSE +21 -0
  2. datapruning-1.0.2/MANIFEST.in +1 -0
  3. datapruning-1.0.2/PKG-INFO +79 -0
  4. datapruning-1.0.2/README.md +55 -0
  5. datapruning-1.0.2/build_src/_core.c +38400 -0
  6. datapruning-1.0.2/datapruning/__init__.py +23 -0
  7. datapruning-1.0.2/datapruning.egg-info/PKG-INFO +79 -0
  8. datapruning-1.0.2/datapruning.egg-info/SOURCES.txt +13 -0
  9. datapruning-1.0.2/datapruning.egg-info/dependency_links.txt +1 -0
  10. datapruning-1.0.2/datapruning.egg-info/requires.txt +3 -0
  11. datapruning-1.0.2/datapruning.egg-info/top_level.txt +1 -0
  12. datapruning-1.0.2/pyproject.toml +34 -0
  13. datapruning-1.0.2/setup.cfg +4 -0
  14. datapruning-1.0.2/setup.py +45 -0
  15. datapruning-1.0.2/tests/test_simple.py +48 -0
datapruning-1.0.2/LICENSE ADDED
@@ -0,0 +1,21 @@
1
+ DataPruning Proprietary License
2
+
3
+ Copyright (c) 2026 DataPruning.
4
+ All rights reserved.
5
+
6
+ This software and associated files are proprietary and confidential.
7
+
8
+ Permission is granted to use the software for evaluation and
9
+ non-commercial purposes. Unauthorized copying, modification,
10
+ redistribution, reverse engineering, or commercial resale of this
11
+ software is prohibited.
12
+
13
+ The software is provided "as is", without warranty of any kind,
14
+ express or implied, including but not limited to the warranties of
15
+ merchantability, fitness for a particular purpose, and noninfringement.
16
+
17
+ In no event shall the authors or copyright holders be liable for any
18
+ claim, damages, or other liability arising from the use of the software.
19
+
20
+ For licensing inquiries:
21
+ https://www.datapruning.com
datapruning-1.0.2/MANIFEST.in ADDED
@@ -0,0 +1 @@
1
+ include build_src/_core.c
datapruning-1.0.2/PKG-INFO ADDED
@@ -0,0 +1,79 @@
1
+ Metadata-Version: 2.4
2
+ Name: datapruning
3
+ Version: 1.0.2
4
+ Summary: Intelligent data pruning for ML datasets
5
+ License: Proprietary
6
+ Project-URL: Homepage, https://www.datapruning.com
7
+ Classifier: Development Status :: 4 - Beta
8
+ Classifier: Intended Audience :: Developers
9
+ Classifier: Intended Audience :: Science/Research
10
+ Classifier: Programming Language :: Python :: 3
11
+ Classifier: Programming Language :: Python :: 3.10
12
+ Classifier: Programming Language :: Python :: 3.11
13
+ Classifier: Programming Language :: Python :: 3.12
14
+ Classifier: Programming Language :: Python :: 3.13
15
+ Classifier: Programming Language :: Python :: 3.14
16
+ Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
17
+ Requires-Python: >=3.10
18
+ Description-Content-Type: text/markdown
19
+ License-File: LICENSE
20
+ Requires-Dist: numpy>=1.24.0
21
+ Requires-Dist: pandas>=2.0.0
22
+ Requires-Dist: torch>=2.0.0
23
+ Dynamic: license-file
24
+
25
+ # DataPruning Lite
26
+
27
+ Local-first dataset pruning. Free for datasets up to 100K rows.
28
+
29
+ ## Overview
30
+
31
+ DataPruning reduces dataset size before training by selecting a smaller,
32
+ more informative subset of data. Runs entirely on your machine through a
33
+ compiled SDK — no data upload, no external processing.
34
+
35
+ ## Installation
36
+
37
+ ```bash
38
+ pip install datapruning
39
+ ```
40
+
41
+ **Note:** PyTorch (~2 GB) is a required dependency and will be installed
42
+ automatically. See [pytorch.org](https://pytorch.org) for GPU/CPU options.
43
+
44
+ ## Requirements
45
+
46
+ - Python 3.9–3.13
47
+ - PyTorch 2.0+
48
+ - Pandas 2.0+
49
+ - NumPy 1.24+
50
+
51
+ ## Usage
52
+
53
+ ```python
54
+ import pandas as pd
55
+ from datapruning import Pruner
56
+
57
+ df = pd.read_csv("dataset.csv")
58
+ p = Pruner(df)
59
+ filtered = p.prune(target_col="label", keep_ratio=0.5)
60
+
61
+ print(f"Kept {len(filtered)} / {len(df)} rows")
62
+ ```
63
+
64
+ ## Features
65
+
66
+ - Local execution, no data upload
67
+ - Pre-training dataset optimization
68
+ - Pandas DataFrame input
69
+ - Compiled processing module
70
+ - Free tier: up to 100K rows per dataset
71
+
72
+ ## Limits
73
+
74
+ Datasets exceeding 100,000 rows require an enterprise license.
75
+ Visit https://www.datapruning.com for details.
76
+
77
+ ## License
78
+
79
+ Proprietary software. See LICENSE file.
datapruning-1.0.2/README.md ADDED
@@ -0,0 +1,55 @@
1
+ # DataPruning Lite
2
+
3
+ Local-first dataset pruning. Free for datasets up to 100K rows.
4
+
5
+ ## Overview
6
+
7
+ DataPruning reduces dataset size before training by selecting a smaller,
8
+ more informative subset of data. Runs entirely on your machine through a
9
+ compiled SDK — no data upload, no external processing.
10
+
11
+ ## Installation
12
+
13
+ ```bash
14
+ pip install datapruning
15
+ ```
16
+
17
+ **Note:** PyTorch (~2 GB) is a required dependency and will be installed
18
+ automatically. See [pytorch.org](https://pytorch.org) for GPU/CPU options.
19
+
20
+ ## Requirements
21
+
22
+ - Python 3.9–3.13
23
+ - PyTorch 2.0+
24
+ - Pandas 2.0+
25
+ - NumPy 1.24+
26
+
27
+ ## Usage
28
+
29
+ ```python
30
+ import pandas as pd
31
+ from datapruning import Pruner
32
+
33
+ df = pd.read_csv("dataset.csv")
34
+ p = Pruner(df)
35
+ filtered = p.prune(target_col="label", keep_ratio=0.5)
36
+
37
+ print(f"Kept {len(filtered)} / {len(df)} rows")
38
+ ```
39
+
40
+ ## Features
41
+
42
+ - Local execution, no data upload
43
+ - Pre-training dataset optimization
44
+ - Pandas DataFrame input
45
+ - Compiled processing module
46
+ - Free tier: up to 100K rows per dataset
47
+
48
+ ## Limits
49
+
50
+ Datasets exceeding 100,000 rows require an enterprise license.
51
+ Visit https://www.datapruning.com for details.
52
+
53
+ ## License
54
+
55
+ Proprietary software. See LICENSE file.