media-engine 0.1.0__py3-none-any.whl

media_engine-0.1.0.dist-info/METADATA

@@ -0,0 +1,276 @@
+Metadata-Version: 2.4
+Name: media-engine
+Version: 0.1.0
+Summary: AI-powered video extraction API for metadata, transcripts, faces, scenes, objects, and more
+Project-URL: Repository, https://github.com/thetrainroom/media-engine
+Project-URL: Issues, https://github.com/thetrainroom/media-engine/issues
+License: MIT
+License-File: LICENSE
+Keywords: ai,extraction,faces,metadata,ml,ocr,scenes,transcription,video
+Classifier: Development Status :: 4 - Beta
+Classifier: Framework :: FastAPI
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: MacOS :: MacOS X
+Classifier: Operating System :: POSIX :: Linux
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Topic :: Multimedia :: Video
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Requires-Python: >=3.12
+Requires-Dist: deepface>=0.0.79
+Requires-Dist: fastapi>=0.109.0
+Requires-Dist: ffmpeg-python>=0.2.0
+Requires-Dist: httpx>=0.27.0
+Requires-Dist: langdetect>=1.0.9
+Requires-Dist: paddleocr>=2.7.0
+Requires-Dist: paddlepaddle>=2.5.0
+Requires-Dist: psutil>=5.9.0
+Requires-Dist: pydantic-settings>=2.0.0
+Requires-Dist: pydantic>=2.0.0
+Requires-Dist: scenedetect[opencv]>=0.6.0
+Requires-Dist: uvicorn>=0.27.0
+Requires-Dist: webrtcvad>=2.0.10
+Provides-Extra: cpu
+Requires-Dist: open-clip-torch>=2.24.0; extra == 'cpu'
+Requires-Dist: openai-whisper>=20231117; extra == 'cpu'
+Requires-Dist: torch>=2.0.0; extra == 'cpu'
+Requires-Dist: ultralytics>=8.0.0; extra == 'cpu'
+Provides-Extra: cuda
+Requires-Dist: faster-whisper>=0.10.0; extra == 'cuda'
+Requires-Dist: open-clip-torch>=2.24.0; extra == 'cuda'
+Requires-Dist: torch>=2.0.0; extra == 'cuda'
+Requires-Dist: ultralytics>=8.0.0; extra == 'cuda'
+Provides-Extra: dev
+Requires-Dist: black>=24.0.0; extra == 'dev'
+Requires-Dist: httpx>=0.27.0; extra == 'dev'
+Requires-Dist: pyright>=1.1.0; extra == 'dev'
+Requires-Dist: pytest-asyncio>=0.23.0; extra == 'dev'
+Requires-Dist: pytest-cov>=4.0.0; extra == 'dev'
+Requires-Dist: pytest>=8.0.0; extra == 'dev'
+Requires-Dist: ruff>=0.3.0; extra == 'dev'
+Provides-Extra: mlx
+Requires-Dist: mlx-whisper>=0.4.0; extra == 'mlx'
+Requires-Dist: mlx>=0.5.0; extra == 'mlx'
+Requires-Dist: open-clip-torch>=2.24.0; extra == 'mlx'
+Requires-Dist: torch>=2.0.0; extra == 'mlx'
+Requires-Dist: ultralytics>=8.0.0; extra == 'mlx'
+Provides-Extra: qwen
+Requires-Dist: accelerate>=0.30.0; extra == 'qwen'
+Requires-Dist: qwen-vl-utils>=0.0.8; extra == 'qwen'
+Requires-Dist: torch>=2.0.0; extra == 'qwen'
+Requires-Dist: transformers>=4.40.0; extra == 'qwen'
+Description-Content-Type: text/markdown
+
+# Media Engine
+
+AI-powered video metadata extraction API for small TV stations and content creators. Provides a "file in → JSON out" API that extracts metadata, transcripts, faces, scenes, objects, CLIP embeddings, OCR text, and camera motion from video files.
+
+## Installation
+
+```bash
+# Apple Silicon Mac
+pip install media-engine[mlx]
+
+# NVIDIA GPU
+pip install media-engine[cuda]
+
+# CPU only
+pip install media-engine[cpu]
+
+# Start the server
+meng-server
+```
+
+**Requirements**: Python 3.12+, ffmpeg
+
+## Features
+
+- **Metadata extraction** - Duration, resolution, codec, GPS, device info (modular per-manufacturer)
+- **Transcription** - Whisper with speaker diarization
+- **Face detection** - DeepFace with embedding clustering
+- **Scene detection** - PySceneDetect content-aware boundaries
+- **Object detection** - YOLO or Qwen VLM
+- **CLIP embeddings** - Per-scene similarity search
+- **OCR** - PaddleOCR text extraction
+- **Motion analysis** - Camera pan/tilt/zoom detection
+- **Shot type** - Aerial, interview, b-roll classification
+
+## Quick Start
+
+### Docker (Recommended)
+
+```bash
+# Clone and run
+git clone https://github.com/thetrainroom/media-engine.git
+cd media-engine
+
+# Start the server
+docker compose up -d
+
+# Test
+curl http://localhost:8001/health
+```
+
+Mount your media folder:
+```bash
+MEDIA_PATH=/path/to/videos docker compose up -d
+```
+
+For NVIDIA GPU support (uses `Dockerfile.cuda`):
+```bash
+docker compose --profile gpu up -d
+```
+
+Or build manually:
+```bash
+docker build -f Dockerfile.cuda -t media-engine-gpu .
+docker run -p 8001:8001 --gpus all -v /path/to/media:/media media-engine-gpu
+```
+
+### Apple Silicon (Recommended: Native)
+
+Docker on macOS runs in a Linux VM without Metal/MPS access. For GPU acceleration on Apple Silicon, run natively:
+
+```bash
+pip install media-engine[mlx]
+meng-server
+```
+
+A `Dockerfile.mlx` is provided for consistency, but will use CPU in Docker:
+```bash
+docker compose --profile mlx up -d
+```
+
+### Development Installation
+
+```bash
+# Mac Apple Silicon
+pip install -e ".[mlx]"
+
+# NVIDIA GPU
+pip install -e ".[cuda]"
+
+# CPU only
+pip install -e ".[cpu]"
+
+# Run server with hot reload
+uvicorn media_engine.main:app --reload --port 8001
+```
+
+## API Usage
+
+### Extract metadata from a video
+
+```bash
+curl -X POST http://localhost:8001/extract \
+  -H "Content-Type: application/json" \
+  -d '{
+    "file": "/media/video.mp4",
+    "enable_metadata": true,
+    "enable_transcript": true,
+    "enable_faces": false,
+    "enable_scenes": true,
+    "enable_objects": false,
+    "enable_clip": false,
+    "enable_ocr": false,
+    "enable_motion": false
+  }'
+```
+
+### Endpoints
+
+| Endpoint | Method | Description |
+|----------|--------|-------------|
+| `/health` | GET | Health check |
+| `/extract` | POST | Extract features from video |
+| `/extractors` | GET | List available extractors |
+
+## Supported Devices
+
+The metadata extractor automatically detects camera/device type:
+
+| Manufacturer | Models | Features |
+|--------------|--------|----------|
+| **DJI** | Mavic, Air, Mini, Pocket, Osmo, Action | GPS from SRT, color profiles |
+| **Sony** | PXW, FX, Alpha, ZV series | XML sidecar, S-Log, GPS |
+| **Canon** | Cinema EOS, EOS R | XML sidecar |
+| **Apple** | iPhone, iPad | QuickTime metadata, GPS |
+| **Blackmagic** | Pocket, URSA, BRAW | ProApps metadata, BRAW detection |
+| **RED** | DSMC2, V-RAPTOR, KOMODO | R3D native support |
+| **ARRI** | ALEXA, ALEXA Mini, AMIRA | ARRIRAW detection |
+| **Insta360** | X3, X4, ONE RS, GO 3 | 360 video detection |
+| **FFmpeg** | OBS, Handbrake, etc. | Encoder detection |
+
+Adding new manufacturers is easy - create a module in `media_engine/extractors/metadata/`.
+
+## Architecture
+
+```
+media_engine/
+├── main.py              # FastAPI app
+├── config.py            # Settings and platform detection
+├── schemas.py           # Pydantic models
+└── extractors/
+    ├── metadata/        # Modular per-manufacturer
+    │   ├── dji.py
+    │   ├── sony.py
+    │   ├── apple.py
+    │   └── ...
+    ├── transcribe.py    # Whisper (MLX/CUDA/CPU)
+    ├── faces.py         # DeepFace + embeddings
+    ├── scenes.py        # PySceneDetect
+    ├── objects.py       # YOLO
+    ├── objects_qwen.py  # Qwen VLM
+    ├── clip.py          # CLIP embeddings
+    ├── ocr.py           # PaddleOCR
+    └── motion.py        # Optical flow analysis
+```
+
+## Configuration
+
+Settings are stored in `~/.config/polybos/config.json`:
+
+```json
+{
+  "whisper_model": "large-v3",
+  "fallback_language": "en",
+  "hf_token": null,
+  "face_sample_fps": 1.0,
+  "object_sample_fps": 2.0,
+  "ocr_languages": ["en", "no", "de", "fr", "es"]
+}
+```
+
+Set `hf_token` to enable speaker diarization (requires accepting license at [pyannote](https://huggingface.co/pyannote/speaker-diarization-3.1)).
+
+## Development
+
+```bash
+# Install dev dependencies
+pip install -e ".[dev]"
+
+# Lint
+ruff check media_engine/
+
+# Type check
+pyright media_engine/
+
+# Test
+export TEST_VIDEO_PATH=/path/to/test.mp4
+pytest tests/
+```
+
+## Contributing
+
+Contributions welcome! To add support for a new camera manufacturer:
+
+1. Create `media_engine/extractors/metadata/yourmanufacturer.py`
+2. Implement `detect()` and `extract()` methods
+3. Register with `register_extractor("name", YourExtractor())`
+4. Import in `metadata/__init__.py`
+
+See existing modules for examples.
+
+## License
+
+MIT

media_engine-0.1.0.dist-info/RECORD

@@ -0,0 +1,70 @@
+cli/clip.py,sha256=1ZCqz0Oki4ylNeWEoKuufrGWvC0jqVTnNagdkUmpAsc,2437
+cli/faces.py,sha256=X58_92b3UsRJ9qNJauTO8kjVxT_yznpABTwi9i-wp2s,2758
+cli/metadata.py,sha256=t7m6uZMbudqNydIN-fqwSJJ3q-Am4vBf1KIasY2ALzk,2555
+cli/motion.py,sha256=Gg7lupsgCI0FX0CMArK_V9Nb-aVFfGoTKan-awtkL1s,2628
+cli/objects.py,sha256=zakIoX6LmevBoHfYPlEnn6AOCBS20V3X_OOp2rJy_C4,2854
+cli/ocr.py,sha256=HM0wKZ1AKIb0eAGnXVFmkNaBO4MSID2871No_gQnS40,2811
+cli/scenes.py,sha256=W3DE6VTVOUo4pjbPLfX3iQIQ1LSI9Jo7n5sIZGG9dZc,1741
+cli/telemetry.py,sha256=z7UqxoGMY2L0QEkA3hlNZsP3paXREXxKkWpVVzCboJY,2029
+cli/transcript.py,sha256=CFgaxP_jFDQf-J7U-_1NK7ADx5zoLvJ-8_F2zSaCc68,2280
+media_engine/__init__.py,sha256=T0S3Jxe8MktWwlldioaPxRLRYIlp3Nw8GaIiQ6kaGrw,216
+media_engine/_version.py,sha256=5jwwVncvCiTnhOedfkzzxmxsggwmTBORdFL_4wq0ZeY,704
+media_engine/app.py,sha256=pnSNIyqQrTXad39x5ZZ1iskkF8WE9SWwici7C7llTMM,1987
+media_engine/cli.py,sha256=V41KS4samQjsYAP0064RcQ1pHS4Zs6Q94yUBDTTNMKE,293
+media_engine/config.py,sha256=W7dUw4VioD9ZHkqX6E-iW8xxst_b_JKcCjPydfF9YIQ,20677
+media_engine/main.py,sha256=H354jbr_3teUXdXwfmODwAt_i7s9wgedWw3EJbIilFw,2146
+media_engine/py.typed,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+media_engine/schemas.py,sha256=cpCyrp6zX1hx80gKzWZHQL36ww92Q3zY5dfEl8J4cjo,15030
+media_engine/batch/__init__.py,sha256=wJIGdNif8thXQqowCNNWwCC6fjgJM0bei47oo2x3_kA,1248
+media_engine/batch/models.py,sha256=-8tT6q4-60O_7-PgAWckoxlghpp0jMPJp5oTPZVYig8,3803
+media_engine/batch/processor.py,sha256=wZ1H4UTMtBykiENQw5QmFwgpusqR46I9mMOUuCcMv9s,56690
+media_engine/batch/queue.py,sha256=yhUN0xkpbJ74Ti1XrY12pe4y7Jf8nb016Q6gpV9IzLw,7535
+media_engine/batch/state.py,sha256=uobVK7G_-p58iCTzxmkBk8KEkYnWkzUn7t2_iD65J2o,827
+media_engine/batch/timing.py,sha256=3lKLzVyt5-mpkutqRiiUeXIFKlusfVI5ltxBGRnxGyw,11660
+media_engine/extractors/__init__.py,sha256=m9jl2SyqeGpn0kIET2qAO_nXT6caAGKurBW3oTlao8o,2048
+media_engine/extractors/clip.py,sha256=sCuy4MS_4aqtuIMgpWBY7NuEnfOQSZqoMTNNlkk6yGk,12984
+media_engine/extractors/faces.py,sha256=HwXB8XTwthOxTWHz1k-zz7ByXk2hZFQNekyesHJT-nQ,15700
+media_engine/extractors/frame_buffer.py,sha256=aiV9PD5A0tWzzvOa_LQ6ZBVZxikMTN6udYadxRa9Dcs,10968
+media_engine/extractors/frames.py,sha256=QdjholtR_pjEO21Vm98UgagEouP_rJq9XrxlwWY_PKU,13593
+media_engine/extractors/motion.py,sha256=nhTg0feNbR-veqDHqhWEIgJYazXiX-BnEKT9bicDzKg,25975
+media_engine/extractors/objects.py,sha256=bu7pGPeZhlEC-FantfF1r4P01DSLGn3NlgKB4HgtfFk,7765
+media_engine/extractors/objects_qwen.py,sha256=U08ZKRaPk0mGCovoTEqVQljaWjCaU8tRKzHTedR9nvo,29534
+media_engine/extractors/ocr.py,sha256=uz6TdfuxB4_pC18qWYs6xcUbls4h1-f6C5hOlyPGmTI,8512
+media_engine/extractors/scenes.py,sha256=I-Do5NJnl7gbUVYskvbkWtAwHNotydhxGU83fwIlJSk,2680
+media_engine/extractors/shot_type.py,sha256=CJ-SII8X3toSihs4oA5a3dbYcljLxeA68e5DFO6RRHA,7143
+media_engine/extractors/telemetry.py,sha256=TSsQVEA8sP2hnCwNYY-2AmE_hTTrOhKES0DSyj0ZU24,8796
+media_engine/extractors/transcribe.py,sha256=u40SPmnCA8CHYZPr0q6_5wZVOY5BEJZSPd_CrPbixTw,18038
+media_engine/extractors/translate.py,sha256=E23Neu42m2fmkrqlDDt1hFKddkDxK_FLlnJh32LFpSw,3808
+media_engine/extractors/vad.py,sha256=VibrAtJzruyjafrExrgshCKDtZzTDW2AM8a-RtZ1gRk,9000
+media_engine/extractors/metadata/__init__.py,sha256=SQMGL-DAejcOZE0OxgWOkfCewDBPuW-lZKFRma-r-B8,4021
+media_engine/extractors/metadata/apple.py,sha256=HBdMijdBLMsOBSsnzTf8DJykJkGFREGExEveQlUnqwU,5146
+media_engine/extractors/metadata/arri.py,sha256=XUn_N20Y-FPIds21JJwLfx6nlQvMwRG-W9p532-aeLI,3379
+media_engine/extractors/metadata/avchd.py,sha256=R0Eae04pAbC_lNGtmkmFuS_2Ax-_ktyqahz3sm7s8NU,6117
+media_engine/extractors/metadata/avchd_gps.py,sha256=m7SSU-RP9jm5fODw0lm-OSjiQg_11ADUUopBGayHetw,8321
+media_engine/extractors/metadata/base.py,sha256=wCnIPIjDwyXMfeMPufLQ9xjDlTOxK3uN97aasSwQPaQ,21953
+media_engine/extractors/metadata/blackmagic.py,sha256=steFuMBqDU2KorPCjITDgKqhOyAA7KIsqZgMOOIuYyA,4531
+media_engine/extractors/metadata/camera_360.py,sha256=qbNfohSgVSGL3t_C92MuSgVwZ5wATIHo5vBzKqrDp4c,9222
+media_engine/extractors/metadata/canon.py,sha256=2MuFEZSNHBPeWcxO-liMeDqUb6Xa-KnjTbyDMFKlhB4,10122
+media_engine/extractors/metadata/dji.py,sha256=nI0l8dgA46ahseuhygo6_NZWOjZpOOz2_N04u9IEUCU,11898
+media_engine/extractors/metadata/dv.py,sha256=JS7ImT5cd1UJVOxT1TAOnnBWPLRm6VAABVWkd79Skzw,3522
+media_engine/extractors/metadata/ffmpeg.py,sha256=JH0mjmyD82tI9m880IPFae258Xd74WjEUwJ5hUPEXVc,2157
+media_engine/extractors/metadata/generic.py,sha256=sCQY8HA2G1DZ2OmJWJdjAqKKpAJp1uDLJyX276f0VPI,4165
+media_engine/extractors/metadata/gopro.py,sha256=MQHqEzRWrYoW5bca1jzfIhcVAM-3lcGrJem16DsvKSE,8080
+media_engine/extractors/metadata/red.py,sha256=I5SClyeGYc3WxQ0TSwYAcHuv19elXbRQRkqBT1CUfW4,9356
+media_engine/extractors/metadata/registry.py,sha256=Idd7ind3X_1ywJ0spbeqEK9hT3ykQYUqbGVp6WITAX8,3619
+media_engine/extractors/metadata/sony.py,sha256=_BiXrEQStlcgKRQdzsZCVF9RU0wcXQ-7UuyY1M2QOzY,16332
+media_engine/extractors/metadata/tesla.py,sha256=EihXp-abCw_MpR1e1FSFCnckEz_7n1htvjcQpflRvG8,4247
+media_engine/routers/__init__.py,sha256=8gf_Jo9TpSkuHg0nwQboqUxI9jioEyVCimhO-lWN-Zs,477
+media_engine/routers/batch.py,sha256=VGdAZFUeRz4X0LWu6OK-UuiW9OHNt1Pe51xPfd4j6EI,2767
+media_engine/routers/health.py,sha256=vNYSNG-B0MoM9dxzOYB5v-12-VKJkvBpXXCYCH1itZg,2748
+media_engine/routers/models.py,sha256=6-wxgoeJd4MLz-pHgqze_eOAdM-HNN1HXfKnnHsJ03E,6998
+media_engine/routers/settings.py,sha256=meeBmQVE_9PhRrDMFOF30v0k2u20k2b2fxlaQB9FQ9w,3033
+media_engine/routers/utils.py,sha256=Cx6uWQldV8AC79sotVMSlRtWXTMZbSc8DWXdSBog7ys,4552
+media_engine/utils/__init__.py,sha256=UXpqgpt1NU8NTsP_iRPfiP20_OpmGqEoZS6jVmRpjXo,162
+media_engine/utils/logging.py,sha256=yOnrYMAfwqtJLOGnhiIJbzVU8m8MYF39acuIpU4A_oA,1965
+media_engine/utils/memory.py,sha256=OZB0yl21u-lj-VwmO8RrRMd_CURxeBgKZrb6QA3OYWU,1186
+media_engine-0.1.0.dist-info/METADATA,sha256=rScqmPz7ESlorrxpONPIo43qT9N0pECPwqZnDscif7U,8044
+media_engine-0.1.0.dist-info/WHEEL,sha256=WLgqFyCfm_KASv4WHyYy0P3pM_m7J5L9k2skdKLirC8,87
+media_engine-0.1.0.dist-info/entry_points.txt,sha256=vdEMWxqs_gFTni4BGrX_iCP_f2HhC6XIz8ExQvyMpcE,338
+media_engine-0.1.0.dist-info/licenses/LICENSE,sha256=UOl7jpYGV9IlJlBilZxQ5IoOKhDkbwUqvLDwQk2tsFw,1069
+media_engine-0.1.0.dist-info/RECORD,,

media_engine-0.1.0.dist-info/WHEEL

@@ -0,0 +1,4 @@
+Wheel-Version: 1.0
+Generator: hatchling 1.28.0
+Root-Is-Purelib: true
+Tag: py3-none-any

media_engine-0.1.0.dist-info/entry_points.txt

@@ -0,0 +1,11 @@
+[console_scripts]
+meng-clip = cli.clip:main
+meng-faces = cli.faces:main
+meng-metadata = cli.metadata:main
+meng-motion = cli.motion:main
+meng-objects = cli.objects:main
+meng-ocr = cli.ocr:main
+meng-scenes = cli.scenes:main
+meng-server = media_engine.cli:run_server
+meng-telemetry = cli.telemetry:main
+meng-transcript = cli.transcript:main

media_engine-0.1.0.dist-info/licenses/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 thetrainroom
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.