pyrobovision 0.5.0__py3-none-any.whl

pyrobovision-0.5.0.dist-info/METADATA

@@ -0,0 +1,229 @@
+Metadata-Version: 2.4
+Name: pyrobovision
+Version: 0.5.0
+Summary: Advanced autonomous driving perception and vision-language foundation models for robotics
+Author-email: Georgi Mammen Mullassery <mullassery@gmail.com>
+License: MIT
+Project-URL: Homepage, https://github.com/Mullassery/PyRoboVision
+Project-URL: Documentation, https://github.com/Mullassery/PyRoboVision/blob/main/README.md
+Project-URL: Repository, https://github.com/Mullassery/PyRoboVision
+Project-URL: Bug Tracker, https://github.com/Mullassery/PyRoboVision/issues
+Keywords: robotics,autonomous-driving,perception,computer-vision,foundation-models,sam3,clip,grounding-dino
+Classifier: Development Status :: 4 - Beta
+Classifier: Intended Audience :: Developers
+Classifier: Intended Audience :: Science/Research
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Classifier: Topic :: Scientific/Engineering :: Image Recognition
+Requires-Python: >=3.10
+Description-Content-Type: text/markdown
+Requires-Dist: pyroboframes>=1.0.0
+Requires-Dist: numpy>=1.24.0
+Requires-Dist: torch>=2.0.0
+Requires-Dist: torchvision>=0.15.0
+Requires-Dist: transformers>=4.30.0
+Requires-Dist: scipy>=1.10.0
+Requires-Dist: open3d>=0.17.0
+Provides-Extra: dev
+Requires-Dist: pytest>=7.4.0; extra == "dev"
+Requires-Dist: pytest-cov>=4.1.0; extra == "dev"
+Requires-Dist: black>=23.0.0; extra == "dev"
+Requires-Dist: isort>=5.12.0; extra == "dev"
+Requires-Dist: mypy>=1.4.0; extra == "dev"
+Requires-Dist: ruff>=0.0.285; extra == "dev"
+Provides-Extra: cuda
+Requires-Dist: cupy>=12.0.0; extra == "cuda"
+Requires-Dist: torch[cuda11x]>=2.0.0; extra == "cuda"
+Provides-Extra: mlx
+Requires-Dist: mlx>=0.0.13; extra == "mlx"
+
+# PyRoboVision
+
+Advanced autonomous driving perception and vision-language foundation models for robotics. Built on top of [PyRoboFrames](https://github.com/Mullassery/PyRoboFrames).
+
+**Focus:** Advanced perception pipelines and multimodal understanding that consume data loaded by PyRoboFrames.
+
+---
+
+## What's Inside
+
+### Autonomous Driving (v0.5)
+- **Cylindrical panoramic stitching** — 360° multi-camera fusion (Waymo, nuScenes)
+- **Advanced blending** — Laplacian pyramid + graph-cut seams
+- **Bird's-eye-view (BEV)** — 3D projection for autonomous perception
+- **GPU acceleration** — CuPy (NVIDIA), MLX (Apple Silicon), NumPy (CPU)
+- **Sensor fusion** — Lidar/Radar + occupancy grid mapping
+- **Dataset loaders** — Waymo TFRecord, nuScenes JSON, KITTI stereo
+
+### Foundation Models (Phase 7)
+- **SAM3 segmentation** — Instance segmentation + temporal tracking
+- **CLIP embeddings** — Scene understanding, text-image similarity
+- **Grounding DINO** — Open-vocabulary object detection
+- **Multi-modal fusion** — Unified detection + segmentation + classification
+
+---
+
+## Installation
+
+```bash
+# Requires PyRoboFrames v1.0+
+pip install pyroboframes pyroboframes-vision
+
+# From source
+git clone https://github.com/Mullassery/PyRoboVision.git
+cd PyRoboVision
+pip install -e .
+```
+
+---
+
+## Quick Start
+
+### Autonomous Driving: 360° Panoramic Perception
+
+```python
+from pyrobovision.automotive import (
+    CylindricalStitcher,
+    get_waymo_layout,
+)
+
+# Stitch 5 cameras into 360° panorama
+layout = get_waymo_layout()
+stitcher = CylindricalStitcher(layout, blend_method="laplacian")
+
+frames = {
+    "FRONT": ...,
+    "FRONT_LEFT": ...,
+    # ... other cameras
+}
+
+panorama = stitcher.stitch(frames)  # [1, H, W, 3] seamless 360°
+```
+
+### Foundation Models: Multi-Modal Scene Understanding
+
+```python
+from pyrobovision.foundation_models import MultiModalFusion
+
+fusion = MultiModalFusion(
+    detection_prompt="car . pedestrian . cyclist",
+    device="mlx",  # or "cuda"
+)
+
+scene = fusion.understand(frame)
+for obj in scene.objects:
+    print(f"{obj.object_class}: {obj.semantic_label}")
+```
+
+---
+
+## Architecture
+
+### Dependency Graph
+
+```
+PyRoboVision/
+├── automotive/          # v0.5 AV perception
+│   ├── stitching.py
+│   ├── blending.py
+│   ├── bev.py
+│   ├── perception_3d.py
+│   ├── tfrecord_utils.py
+│   ├── nuscenes_utils.py
+│   └── datasets.py
+│
+└── foundation_models/   # Phase 7
+    ├── sam3_segmentation.py
+    ├── clip_embeddings.py
+    ├── grounding_dino.py
+    └── multimodal_fusion.py
+
+↓ Depends on PyRoboFrames v1.0+ (dataloader)
+PyRoboFrames/
+├── RoboFrameDataset      # Load LeRobot
+├── ProprioceptiveLoader  # Load state/action
+├── DataLoader            # Device selection
+└── [video decode, sensor fusion, etc.]
+```
+
+**Key design:** PyRoboVision is a consumer library, not a foundation. It uses PyRoboFrames to load data, then applies perception algorithms.
+
+---
+
+## Features
+
+| Phase | Feature | Status | Tests |
+|-------|---------|--------|-------|
+| **1** | Cylindrical panoramic projection | ✅ | 10 |
+| **2** | Laplacian pyramid blending | ✅ | 5 |
+| **3** | Bird's-eye-view (BEV) projection | ✅ | 5 |
+| **4a** | GPU acceleration (CuPy/MLX/NumPy) | ✅ | 6 |
+| **4b** | Optical flow seam tracking | ✅ | 10 |
+| **5** | Waymo/nuScenes/KITTI loaders | ✅ | 9 |
+| **6** | Lidar/Radar fusion + Occupancy grids | ✅ | 18 |
+| **7a** | SAM3 temporal segmentation | ✅ | 18 |
+| **7b** | CLIP scene embeddings | ✅ | 25 |
+| **7c** | Grounding DINO detection | ✅ | 26 |
+| **7d** | Multi-modal fusion | ✅ | 17 |
+
+**Total: 149 tests, all passing**
+
+---
+
+## Use Cases
+
+### Autonomous Driving
+- Waymo perception pipeline (panoramic stitching + 3D fusion)
+- nuScenes multi-camera understanding
+- Real-time BEV mapping
+
+### Mobile Manipulation
+- Egocentric robot perception (360° view from mobile base)
+- Scene understanding for pick-and-place
+
+### Robotdog Navigation
+- Panoramic localization (where am I in the scene?)
+- Terrain classification from multi-camera fusion
+
+---
+
+## Related Projects
+
+- **[PyRoboFrames](https://github.com/Mullassery/PyRoboFrames)** — Fast ML dataloader for robot learning (core dependency)
+- **[LeRobot](https://github.com/huggingface/lerobot)** — HuggingFace robotics datasets
+- **[Segment Anything 3 (SAM3)](https://github.com/facebookresearch/segment-anything-3)** — Instance segmentation
+- **[CLIP](https://github.com/openai/CLIP)** — Vision-language models
+- **[Grounding DINO](https://github.com/IDEA-Research/GroundingDINO)** — Open-vocabulary detection
+
+---
+
+## License
+
+MIT (same as PyRoboFrames)
+
+---
+
+## Contributing
+
+Contributions welcome. Please open issues and PRs on GitHub.
+
+For architectural decisions, see [ARCHITECTURE.md](./ARCHITECTURE.md).
+
+---
+
+## Citation
+
+```bibtex
+@software{mullassery2025pyrobovision,
+  title={PyRoboVision: Advanced perception and vision-language models for robotics},
+  author={Mullassery, Georgi},
+  url={https://github.com/Mullassery/PyRoboVision},
+  year={2025}
+}
+```

pyrobovision-0.5.0.dist-info/RECORD

@@ -0,0 +1,5 @@
+pyrobovision/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+pyrobovision-0.5.0.dist-info/METADATA,sha256=1AzyEDw1T7Vvlu_HI9CXyUZaB5Dv8BNxMn4y4Dc35tA,7149
+pyrobovision-0.5.0.dist-info/WHEEL,sha256=aeYiig01lYGDzBgS8HxWXOg3uV61G9ijOsup-k9o1sk,91
+pyrobovision-0.5.0.dist-info/top_level.txt,sha256=Yz6xlF7fChNwMOxWth-7NMmRcWWzEHaqRF30R5I1w3s,13
+pyrobovision-0.5.0.dist-info/RECORD,,

pyrobovision-0.5.0.dist-info/WHEEL

@@ -0,0 +1,5 @@
+Wheel-Version: 1.0
+Generator: setuptools (82.0.1)
+Root-Is-Purelib: true
+Tag: py3-none-any
+

pyrobovision-0.5.0.dist-info/top_level.txt

@@ -0,0 +1 @@
+pyrobovision