graft-pytorch 0.1.7__tar.gz

graft_pytorch-0.1.7/CITATION.cff

@@ -0,0 +1,11 @@
+cff-version: 1.2.0
+message: "If you use this software, please cite it as below."
+authors:
+  - family-names: "Jha"
+    given-names: "A"
+    affiliation: "Skolkovo Institute of Science & Technology"
+title: "GRAFT: Gradient-Aware Fast MaxVol Technique for Dynamic Data Sampling"
+version: 1.0.0
+doi: 10.5281/zenodo.16947530
+date-released: 2025-01-01
+url: "https://github.com/ashishjv1/GRAFT"

graft_pytorch-0.1.7/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2024 Ashish Jha
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

graft_pytorch-0.1.7/MANIFEST.in

@@ -0,0 +1,36 @@
+# Include the README and other documentation files
+include README.md
+include LICENSE
+include CITATION.cff
+include requirements.txt
+include pyproject.toml
+
+# Include supplementary materials
+recursive-include supplementary *
+
+# Include example notebooks and scripts
+recursive-include examples *.py *.ipynb
+
+# Include test files
+recursive-include tests *.py
+
+# Exclude unnecessary files
+global-exclude __pycache__
+global-exclude *.py[co]
+global-exclude *.so
+global-exclude .DS_Store
+global-exclude *.egg-info
+
+# Exclude legacy files
+exclude trainer.py
+exclude GRAFT.py
+exclude GRAFT_swinft.py
+
+# Exclude build directories
+prune build
+prune dist
+prune .git
+prune .pytest_cache
+
+# Include package data
+recursive-include graft *.py

graft_pytorch-0.1.7/PKG-INFO

@@ -0,0 +1,302 @@
+Metadata-Version: 2.4
+Name: graft-pytorch
+Version: 0.1.7
+Summary: Gradient-Aware Fast MaxVol Technique for Dynamic Data Sampling
+Home-page: https://github.com/ashishjv1/GRAFT
+Author: Ashish Jha
+Author-email: Ashish Jha <Ashish.Jha@skoltech.ru>
+Maintainer-email: Ashish Jha <Ashish.Jha@skoltech.ru>
+License: MIT
+Project-URL: Homepage, https://github.com/ashishjv1/GRAFT
+Project-URL: Repository, https://github.com/ashishjv1/GRAFT
+Project-URL: Bug Reports, https://github.com/ashishjv1/GRAFT/issues
+Project-URL: Documentation, https://github.com/ashishjv1/GRAFT/blob/main/README.md
+Keywords: machine-learning,deep-learning,pytorch,data-sampling,gradient-based-sampling
+Classifier: Development Status :: 3 - Alpha
+Classifier: Intended Audience :: Developers
+Classifier: Intended Audience :: Science/Research
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.8
+Classifier: Programming Language :: Python :: 3.9
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Classifier: Topic :: Software Development :: Libraries :: Python Modules
+Requires-Python: >=3.8
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: torch>=1.9.0
+Requires-Dist: torchvision>=0.10.0
+Requires-Dist: numpy>=1.19.2
+Requires-Dist: tqdm>=4.62.3
+Requires-Dist: scikit-learn>=0.24.2
+Requires-Dist: pillow>=8.3.1
+Requires-Dist: matplotlib>=3.4.3
+Requires-Dist: transformers>=4.0.0
+Requires-Dist: medmnist>=2.0.0
+Provides-Extra: dev
+Requires-Dist: pytest>=6.2.5; extra == "dev"
+Requires-Dist: pytest-cov; extra == "dev"
+Requires-Dist: black; extra == "dev"
+Requires-Dist: isort; extra == "dev"
+Requires-Dist: flake8; extra == "dev"
+Provides-Extra: tracking
+Requires-Dist: wandb>=0.12.0; extra == "tracking"
+Requires-Dist: eco2ai>=1.0.0; extra == "tracking"
+Provides-Extra: all
+Requires-Dist: pytest>=6.2.5; extra == "all"
+Requires-Dist: pytest-cov; extra == "all"
+Requires-Dist: black; extra == "all"
+Requires-Dist: isort; extra == "all"
+Requires-Dist: flake8; extra == "all"
+Requires-Dist: wandb>=0.12.0; extra == "all"
+Requires-Dist: eco2ai>=1.0.0; extra == "all"
+Dynamic: author
+Dynamic: home-page
+Dynamic: license-file
+Dynamic: requires-python
+
+# GRAFT: Gradient-Aware Fast MaxVol Technique for Dynamic Data Sampling
+
+[![PyPI version](https://badge.fury.io/py/graft-pytorch.svg)](https://badge.fury.io/py/graft-pytorch)
+[![Python 3.8+](https://img.shields.io/badge/python-3.8+-blue.svg)](https://www.python.org/downloads/)
+[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
+
+A PyTorch implementation of smart sampling for efficient deep learning training.
+
+## Overview
+GRAFT uses gradient information and feature decomposition to select the most informative samples during training, reducing computation time while maintaining model performance.
+
+## Features
+- **Smart sample selection** using gradient-based importance scoring
+- **Multi-architecture support** (ResNet, ResNeXT, EfficientNet, BERT)
+- **Dataset compatibility** (CIFAR10/100, TinyImageNet, Caltech256, Medical datasets)
+- **Experiment tracking** with Weights & Biases integration
+- **Carbon footprint tracking** with eco2AI
+- **Efficient training** with reduced computational overhead
+
+## Installation
+
+### From PyPI (Recommended)
+```bash
+pip install graft-pytorch
+```
+
+### With optional dependencies
+```bash
+# For experiment tracking
+pip install graft-pytorch[tracking]
+
+# For development
+pip install graft-pytorch[dev]
+
+# Everything
+pip install graft-pytorch[all]
+```
+
+### From Source
+```bash
+git clone https://github.com/ashishjv1/GRAFT.git
+cd GRAFT
+pip install -e .
+```
+
+## Quick Start
+
+### Command Line Interface
+```bash
+# Install and train with smart sampling
+pip install graft-pytorch
+
+# Basic training with GRAFT sampling on CIFAR-10
+graft-train \
+    --numEpochs=200 \
+    --batch_size=128 \
+    --device="cuda" \
+    --optimizer="sgd" \
+    --lr=0.1 \
+    --numClasses=10 \
+    --dataset="cifar10" \
+    --model="resnet18" \
+    --fraction=0.5 \
+    --select_iter=25 \
+    --warm_start
+```
+
+### Python API
+```python
+import torch
+from graft import ModelTrainer, TrainingConfig
+from graft.utils.loader import loader
+
+# Load your dataset
+trainloader, valloader, trainset, valset = loader(
+    dataset="cifar10",
+    trn_batch_size=128,
+    val_batch_size=128
+)
+
+# Configure training with GRAFT
+config = TrainingConfig(
+    numEpochs=100,
+    batch_size=128,
+    device="cuda" if torch.cuda.is_available() else "cpu",
+    model_name="resnet18",
+    dataset_name="cifar10",
+    trainloader=trainloader,
+    valloader=valloader,
+    trainset=trainset,
+    optimizer_name="sgd",
+    lr=0.1,
+    fraction=0.5,         # Use 50% of data per epoch
+    selection_iter=25,    # Reselect samples every 25 epochs
+    warm_start=True       # Train on full data initially
+)
+
+# Train with smart sampling
+trainer = ModelTrainer(config, trainloader, valloader, trainset)
+train_stats, val_stats = trainer.train()
+
+print(f"Best validation accuracy: {val_stats['best_acc']:.2%}")
+```
+
+### Advanced Usage
+```python
+from graft import feature_sel, sample_selection
+import torch.nn as nn
+
+# Custom model and data selection
+model = MyCustomModel()
+data3 = feature_sel(dataloader, batch_size=128, device="cuda")
+
+# Manual sample selection
+selected_indices = sample_selection(
+    dataloader, data3, model, model.state_dict(),
+    batch_size=128, fraction=0.3, select_iter=10,
+    numEpochs=200, device="cuda", dataset="custom"
+)
+```
+
+## Functionality Overview
+
+### Core Components
+
+#### 1. Smart Sample Selection
+- **`sample_selection()`**: Selects most informative samples using gradient-based importance
+- **`feature_sel()`**: Performs feature decomposition for efficient sampling
+- Reduces training time by 30-50% while maintaining model performance
+
+#### 2. Supported Models
+- **Vision Models**: ResNet, ResNeXt, EfficientNet, MobileNet, FashionCNN
+- **Language Models**: BERT for sequence classification
+- **Custom Models**: Easy integration with any PyTorch model
+
+#### 3. Dataset Support
+- **Computer Vision**: CIFAR-10/100, TinyImageNet, Caltech256
+- **Medical Imaging**: Integration with MedMNIST datasets  
+- **Custom Datasets**: Support for any PyTorch DataLoader
+
+#### 4. Training Features
+- **Dynamic Sampling**: Adaptive sample selection during training
+- **Warm Starting**: Begin with full dataset, then switch to sampling
+- **Experiment Tracking**: Built-in WandB integration
+- **Carbon Tracking**: Monitor environmental impact with eco2AI
+
+### Configuration Parameters
+
+| Parameter | Description | Default | Options |
+|-----------|-------------|---------|---------|
+| `numEpochs` | Training epochs | 200 | Any integer |
+| `batch_size` | Batch size | 128 | 32, 64, 128, 256+ |
+| `device` | Computing device | "cuda" | "cpu", "cuda" |
+| `model` | Model architecture | "resnet18" | "resnet18/50", "resnext", "efficientnet" |
+| `fraction` | Data sampling ratio | 0.5 | 0.1 - 1.0 |
+| `select_iter` | Reselection frequency | 25 | Any integer |
+| `optimizer` | Optimization algorithm | "sgd" | "sgd", "adam" |
+| `lr` | Learning rate | 0.1 | 0.001 - 0.1 |
+| `warm_start` | Use full data initially | False | True/False |
+| `decomp` | Decomposition backend | "numpy" | "numpy", "torch" |
+
+### Performance Benefits
+
+- **Speed**: 30-50% faster training time
+- **Memory**: Reduced memory usage through smart sampling
+- **Accuracy**: Maintains or improves model performance
+- **Efficiency**: Lower carbon footprint and energy consumption
+
+## Package Structure
+```
+graft-pytorch/
+├── graft/
+│   ├── __init__.py          # Main package exports
+│   ├── trainer.py           # Training orchestration
+│   ├── genindices.py        # Sample selection algorithms
+│   ├── decompositions.py    # Feature decomposition
+│   ├── models/              # Supported architectures
+│   │   ├── resnet.py        # ResNet implementations  
+│   │   ├── efficientnet.py  # EfficientNet models
+│   │   └── BERT_model.py    # BERT for classification
+│   └── utils/               # Utility functions
+│       ├── loader.py        # Dataset loaders
+│       └── model_mapper.py  # Model selection
+├── tests/                   # Comprehensive test suite
+├── examples/                # Usage examples
+└── OIDC_SETUP.md           # Deployment configuration
+```
+
+## Contributing
+
+We welcome contributions! Please see our [contribution guidelines](CONTRIBUTING.md) for details.
+
+### Development Setup
+```bash
+# Clone the repository
+git clone https://github.com/ashishjv1/GRAFT.git
+cd GRAFT
+
+# Install in development mode
+pip install -e .[dev]
+
+# Run tests
+pytest tests/ -v
+
+# Run linting
+flake8 graft/ tests/
+```
+
+## License
+
+This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.
+
+## Citation
+
+If you use GRAFT in your research, please cite our paper:
+
+```bibtex
+@misc{jha2025graftgradientawarefastmaxvol,
+  title         = {GRAFT: Gradient-Aware Fast MaxVol Technique for Dynamic Data Sampling},
+  author        = {Ashish Jha and Anh Huy Phan and Razan Dibo and Valentin Leplat},
+  year          = {2025},
+  eprint        = {2508.13653},
+  archivePrefix = {arXiv},
+  primaryClass  = {cs.LG},
+  url           = {https://arxiv.org/abs/2508.13653}
+}
+```
+
+## Acknowledgments
+
+- Built using PyTorch
+- Inspired by MaxVol techniques for data sampling
+- Special thanks to the open-source community
+
+---
+
+**PyPI Package**: [graft-pytorch](https://pypi.org/project/graft-pytorch/)  
+**Paper**: [arXiv:2508.13653](https://arxiv.org/abs/2508.13653)  
+**Issues**: [GitHub Issues](https://github.com/ashishjv1/GRAFT/issues)  
+**Contact**: [Ashish Jha](mailto:Ashish.Jha@skoltech.ru)
+
+

graft_pytorch-0.1.7/README.md

@@ -0,0 +1,242 @@
+# GRAFT: Gradient-Aware Fast MaxVol Technique for Dynamic Data Sampling
+
+[![PyPI version](https://badge.fury.io/py/graft-pytorch.svg)](https://badge.fury.io/py/graft-pytorch)
+[![Python 3.8+](https://img.shields.io/badge/python-3.8+-blue.svg)](https://www.python.org/downloads/)
+[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
+
+A PyTorch implementation of smart sampling for efficient deep learning training.
+
+## Overview
+GRAFT uses gradient information and feature decomposition to select the most informative samples during training, reducing computation time while maintaining model performance.
+
+## Features
+- **Smart sample selection** using gradient-based importance scoring
+- **Multi-architecture support** (ResNet, ResNeXT, EfficientNet, BERT)
+- **Dataset compatibility** (CIFAR10/100, TinyImageNet, Caltech256, Medical datasets)
+- **Experiment tracking** with Weights & Biases integration
+- **Carbon footprint tracking** with eco2AI
+- **Efficient training** with reduced computational overhead
+
+## Installation
+
+### From PyPI (Recommended)
+```bash
+pip install graft-pytorch
+```
+
+### With optional dependencies
+```bash
+# For experiment tracking
+pip install graft-pytorch[tracking]
+
+# For development
+pip install graft-pytorch[dev]
+
+# Everything
+pip install graft-pytorch[all]
+```
+
+### From Source
+```bash
+git clone https://github.com/ashishjv1/GRAFT.git
+cd GRAFT
+pip install -e .
+```
+
+## Quick Start
+
+### Command Line Interface
+```bash
+# Install and train with smart sampling
+pip install graft-pytorch
+
+# Basic training with GRAFT sampling on CIFAR-10
+graft-train \
+    --numEpochs=200 \
+    --batch_size=128 \
+    --device="cuda" \
+    --optimizer="sgd" \
+    --lr=0.1 \
+    --numClasses=10 \
+    --dataset="cifar10" \
+    --model="resnet18" \
+    --fraction=0.5 \
+    --select_iter=25 \
+    --warm_start
+```
+
+### Python API
+```python
+import torch
+from graft import ModelTrainer, TrainingConfig
+from graft.utils.loader import loader
+
+# Load your dataset
+trainloader, valloader, trainset, valset = loader(
+    dataset="cifar10",
+    trn_batch_size=128,
+    val_batch_size=128
+)
+
+# Configure training with GRAFT
+config = TrainingConfig(
+    numEpochs=100,
+    batch_size=128,
+    device="cuda" if torch.cuda.is_available() else "cpu",
+    model_name="resnet18",
+    dataset_name="cifar10",
+    trainloader=trainloader,
+    valloader=valloader,
+    trainset=trainset,
+    optimizer_name="sgd",
+    lr=0.1,
+    fraction=0.5,         # Use 50% of data per epoch
+    selection_iter=25,    # Reselect samples every 25 epochs
+    warm_start=True       # Train on full data initially
+)
+
+# Train with smart sampling
+trainer = ModelTrainer(config, trainloader, valloader, trainset)
+train_stats, val_stats = trainer.train()
+
+print(f"Best validation accuracy: {val_stats['best_acc']:.2%}")
+```
+
+### Advanced Usage
+```python
+from graft import feature_sel, sample_selection
+import torch.nn as nn
+
+# Custom model and data selection
+model = MyCustomModel()
+data3 = feature_sel(dataloader, batch_size=128, device="cuda")
+
+# Manual sample selection
+selected_indices = sample_selection(
+    dataloader, data3, model, model.state_dict(),
+    batch_size=128, fraction=0.3, select_iter=10,
+    numEpochs=200, device="cuda", dataset="custom"
+)
+```
+
+## Functionality Overview
+
+### Core Components
+
+#### 1. Smart Sample Selection
+- **`sample_selection()`**: Selects most informative samples using gradient-based importance
+- **`feature_sel()`**: Performs feature decomposition for efficient sampling
+- Reduces training time by 30-50% while maintaining model performance
+
+#### 2. Supported Models
+- **Vision Models**: ResNet, ResNeXt, EfficientNet, MobileNet, FashionCNN
+- **Language Models**: BERT for sequence classification
+- **Custom Models**: Easy integration with any PyTorch model
+
+#### 3. Dataset Support
+- **Computer Vision**: CIFAR-10/100, TinyImageNet, Caltech256
+- **Medical Imaging**: Integration with MedMNIST datasets  
+- **Custom Datasets**: Support for any PyTorch DataLoader
+
+#### 4. Training Features
+- **Dynamic Sampling**: Adaptive sample selection during training
+- **Warm Starting**: Begin with full dataset, then switch to sampling
+- **Experiment Tracking**: Built-in WandB integration
+- **Carbon Tracking**: Monitor environmental impact with eco2AI
+
+### Configuration Parameters
+
+| Parameter | Description | Default | Options |
+|-----------|-------------|---------|---------|
+| `numEpochs` | Training epochs | 200 | Any integer |
+| `batch_size` | Batch size | 128 | 32, 64, 128, 256+ |
+| `device` | Computing device | "cuda" | "cpu", "cuda" |
+| `model` | Model architecture | "resnet18" | "resnet18/50", "resnext", "efficientnet" |
+| `fraction` | Data sampling ratio | 0.5 | 0.1 - 1.0 |
+| `select_iter` | Reselection frequency | 25 | Any integer |
+| `optimizer` | Optimization algorithm | "sgd" | "sgd", "adam" |
+| `lr` | Learning rate | 0.1 | 0.001 - 0.1 |
+| `warm_start` | Use full data initially | False | True/False |
+| `decomp` | Decomposition backend | "numpy" | "numpy", "torch" |
+
+### Performance Benefits
+
+- **Speed**: 30-50% faster training time
+- **Memory**: Reduced memory usage through smart sampling
+- **Accuracy**: Maintains or improves model performance
+- **Efficiency**: Lower carbon footprint and energy consumption
+
+## Package Structure
+```
+graft-pytorch/
+├── graft/
+│   ├── __init__.py          # Main package exports
+│   ├── trainer.py           # Training orchestration
+│   ├── genindices.py        # Sample selection algorithms
+│   ├── decompositions.py    # Feature decomposition
+│   ├── models/              # Supported architectures
+│   │   ├── resnet.py        # ResNet implementations  
+│   │   ├── efficientnet.py  # EfficientNet models
+│   │   └── BERT_model.py    # BERT for classification
+│   └── utils/               # Utility functions
+│       ├── loader.py        # Dataset loaders
+│       └── model_mapper.py  # Model selection
+├── tests/                   # Comprehensive test suite
+├── examples/                # Usage examples
+└── OIDC_SETUP.md           # Deployment configuration
+```
+
+## Contributing
+
+We welcome contributions! Please see our [contribution guidelines](CONTRIBUTING.md) for details.
+
+### Development Setup
+```bash
+# Clone the repository
+git clone https://github.com/ashishjv1/GRAFT.git
+cd GRAFT
+
+# Install in development mode
+pip install -e .[dev]
+
+# Run tests
+pytest tests/ -v
+
+# Run linting
+flake8 graft/ tests/
+```
+
+## License
+
+This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.
+
+## Citation
+
+If you use GRAFT in your research, please cite our paper:
+
+```bibtex
+@misc{jha2025graftgradientawarefastmaxvol,
+  title         = {GRAFT: Gradient-Aware Fast MaxVol Technique for Dynamic Data Sampling},
+  author        = {Ashish Jha and Anh Huy Phan and Razan Dibo and Valentin Leplat},
+  year          = {2025},
+  eprint        = {2508.13653},
+  archivePrefix = {arXiv},
+  primaryClass  = {cs.LG},
+  url           = {https://arxiv.org/abs/2508.13653}
+}
+```
+
+## Acknowledgments
+
+- Built using PyTorch
+- Inspired by MaxVol techniques for data sampling
+- Special thanks to the open-source community
+
+---
+
+**PyPI Package**: [graft-pytorch](https://pypi.org/project/graft-pytorch/)  
+**Paper**: [arXiv:2508.13653](https://arxiv.org/abs/2508.13653)  
+**Issues**: [GitHub Issues](https://github.com/ashishjv1/GRAFT/issues)  
+**Contact**: [Ashish Jha](mailto:Ashish.Jha@skoltech.ru)
+
+