mblt-npu-python 0.0.0__tar.gz

mblt_npu_python-0.0.0/LICENSE

@@ -0,0 +1,28 @@
+BSD 3-Clause License
+
+Copyright (c) 2026, Mobilint, Inc.
+
+Redistribution and use in source and binary forms, with or without
+modification, are permitted provided that the following conditions are met:
+
+1. Redistributions of source code must retain the above copyright notice, this
+   list of conditions and the following disclaimer.
+
+2. Redistributions in binary form must reproduce the above copyright notice,
+   this list of conditions and the following disclaimer in the documentation
+   and/or other materials provided with the distribution.
+
+3. Neither the name of the copyright holder nor the names of its
+   contributors may be used to endorse or promote products derived from
+   this software without specific prior written permission.
+
+THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
+AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
+IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE
+FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
+DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR
+SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER
+CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,
+OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
+OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

mblt_npu_python-0.0.0/PKG-INFO

@@ -0,0 +1,121 @@
+Metadata-Version: 2.4
+Name: mblt-npu-python
+Version: 0.0.0
+Summary: Shared NPU access for the Mobilint Python packages
+Author: Mobilint
+License: BSD-3-Clause
+Project-URL: Home, https://www.mobilint.com/
+Project-URL: Repository, https://github.com/mobilint/mblt-npu-python
+Classifier: Development Status :: 4 - Beta
+Classifier: Intended Audience :: Developers
+Classifier: License :: OSI Approved :: BSD License
+Classifier: Operating System :: POSIX :: Linux
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Requires-Python: <3.13,>=3.10
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: mobilint-qb-runtime>=1.0.0
+Requires-Dist: huggingface-hub
+Provides-Extra: test
+Requires-Dist: pytest; extra == "test"
+Provides-Extra: onnxruntime
+Requires-Dist: onnxruntime; extra == "onnxruntime"
+Dynamic: license-file
+
+# Mobilint NPU Python
+
+Shared runtime support for applications that run MXQ models on Mobilint NPUs or ONNX models through ONNX Runtime.
+`mblt-npu-python` provides the common backend, device-selection rules, Hugging Face
+artifact resolution, and model-detail logging used by Mobilint Python packages. It
+is a library dependency, rather than an end-user model catalog.
+
+Version `0.0.0` is the initial standalone release.
+
+`logging` ships here rather than with its only caller because the two are mutually
+dependent — `npu_backend` imports `log_model_details`, and `log_model_details` reads
+a `MobilintNPUBackend`'s fields.
+
+## Installation
+
+```bash
+pip install mblt-npu-python
+```
+
+This package requires a supported Linux environment with
+[`mobilint-qb-runtime`](https://pypi.org/project/mobilint-qb-runtime/) available
+and Python 3.10 through 3.12.
+
+## Public API
+
+Import the backend from `mblt_npu`:
+
+```python
+from mblt_npu import MobilintNPUBackend
+
+backend = MobilintNPUBackend(
+    mxq_path="model.mxq",
+    core_mode="single",
+)
+backend.create()
+try:
+    backend.launch()
+    outputs = backend.mxq_model.infer([input_tensor])
+finally:
+    backend.dispose()
+```
+
+`MobilintNPUBackend` selects the appropriate implementation from
+`target_device` (default: `"aries-rb"`). `"aries-rb"` selects
+`MobilintAriesBackend`; `"regulus-ra"` and `"regulus-rb"` select
+`MobilintRegulusBackend`. The former generic values `"aries"` and `"regulus"`
+remain accepted when loading older configurations.
+`backend_class_for()` and `BACKEND_CLASSES` are available for integrations that
+need to inspect the supported targets.
+
+For ONNX inference, install the optional runtime extra and use `ONNXBackend`:
+
+```bash
+pip install "mblt-npu-python[onnxruntime]"
+```
+
+```python
+from mblt_npu import ONNXBackend
+
+backend = ONNXBackend("model.onnx")
+backend.create()
+outputs = backend({"images": input_array})
+backend.dispose()
+```
+
+`ONNXBackend` imports `onnxruntime` only when it creates a session.
+
+Most users should access the backend through a model package such as
+[`mblt-vision-python`](https://github.com/mobilint/mblt-vision-python), which owns
+model configuration, preprocessing, and postprocessing.
+
+## Testing helpers
+
+The optional `test` extra provides a shared pytest plugin with NPU options and the
+`npu_params` fixture used by Mobilint package test suites:
+
+```bash
+pip install "mblt-npu-python[test]"
+```
+
+Import `mblt_npu.pytest_plugin` from a repository's root `tests/conftest.py` to
+register its options. The plugin is intentionally not auto-registered, so projects
+control when those command-line options are exposed.
+
+## Support and issues
+
+For installation, runtime, or integration support, visit the
+[Mobilint forum](https://discuss.mobilint.com/). Report reproducible package issues in the
+[mblt-npu-python issue tracker](https://github.com/mobilint/mblt-npu-python/issues).
+
+## License
+
+Distributed under the [BSD 3-Clause License](LICENSE).

mblt_npu_python-0.0.0/README.md

@@ -0,0 +1,93 @@
+# Mobilint NPU Python
+
+Shared runtime support for applications that run MXQ models on Mobilint NPUs or ONNX models through ONNX Runtime.
+`mblt-npu-python` provides the common backend, device-selection rules, Hugging Face
+artifact resolution, and model-detail logging used by Mobilint Python packages. It
+is a library dependency, rather than an end-user model catalog.
+
+Version `0.0.0` is the initial standalone release.
+
+`logging` ships here rather than with its only caller because the two are mutually
+dependent — `npu_backend` imports `log_model_details`, and `log_model_details` reads
+a `MobilintNPUBackend`'s fields.
+
+## Installation
+
+```bash
+pip install mblt-npu-python
+```
+
+This package requires a supported Linux environment with
+[`mobilint-qb-runtime`](https://pypi.org/project/mobilint-qb-runtime/) available
+and Python 3.10 through 3.12.
+
+## Public API
+
+Import the backend from `mblt_npu`:
+
+```python
+from mblt_npu import MobilintNPUBackend
+
+backend = MobilintNPUBackend(
+    mxq_path="model.mxq",
+    core_mode="single",
+)
+backend.create()
+try:
+    backend.launch()
+    outputs = backend.mxq_model.infer([input_tensor])
+finally:
+    backend.dispose()
+```
+
+`MobilintNPUBackend` selects the appropriate implementation from
+`target_device` (default: `"aries-rb"`). `"aries-rb"` selects
+`MobilintAriesBackend`; `"regulus-ra"` and `"regulus-rb"` select
+`MobilintRegulusBackend`. The former generic values `"aries"` and `"regulus"`
+remain accepted when loading older configurations.
+`backend_class_for()` and `BACKEND_CLASSES` are available for integrations that
+need to inspect the supported targets.
+
+For ONNX inference, install the optional runtime extra and use `ONNXBackend`:
+
+```bash
+pip install "mblt-npu-python[onnxruntime]"
+```
+
+```python
+from mblt_npu import ONNXBackend
+
+backend = ONNXBackend("model.onnx")
+backend.create()
+outputs = backend({"images": input_array})
+backend.dispose()
+```
+
+`ONNXBackend` imports `onnxruntime` only when it creates a session.
+
+Most users should access the backend through a model package such as
+[`mblt-vision-python`](https://github.com/mobilint/mblt-vision-python), which owns
+model configuration, preprocessing, and postprocessing.
+
+## Testing helpers
+
+The optional `test` extra provides a shared pytest plugin with NPU options and the
+`npu_params` fixture used by Mobilint package test suites:
+
+```bash
+pip install "mblt-npu-python[test]"
+```
+
+Import `mblt_npu.pytest_plugin` from a repository's root `tests/conftest.py` to
+register its options. The plugin is intentionally not auto-registered, so projects
+control when those command-line options are exposed.
+
+## Support and issues
+
+For installation, runtime, or integration support, visit the
+[Mobilint forum](https://discuss.mobilint.com/). Report reproducible package issues in the
+[mblt-npu-python issue tracker](https://github.com/mobilint/mblt-npu-python/issues).
+
+## License
+
+Distributed under the [BSD 3-Clause License](LICENSE).

mblt_npu_python-0.0.0/mblt_npu/__init__.py

@@ -0,0 +1,36 @@
+"""Shared NPU access for the mblt Python packages.
+
+`MobilintNPUBackend` is defined exactly once, here, because the alternative
+was a copy in each of mblt-vision-python, mblt-transformers-python and
+mblt-MeloTTS-python that nothing would keep in sync.
+
+`logging` lives here too rather than in vision, its only caller, because the
+two are mutually dependent: npu_backend imports log_model_details and
+log_model_details reads a MobilintNPUBackend's fields.
+"""
+
+from .npu_backend import (
+    BACKEND_CLASSES,
+    DEFAULT_TARGET_DEVICE,
+    MobilintAriesBackend,
+    MobilintNPUBackend,
+    MobilintRegulusBackend,
+    backend_class_for,
+    normalize_target_device,
+)
+from .logging import log_model_details
+from .onnx_backend import ONNXBackend
+
+__version__ = "0.0.0"
+
+__all__ = [
+    "BACKEND_CLASSES",
+    "DEFAULT_TARGET_DEVICE",
+    "MobilintAriesBackend",
+    "MobilintNPUBackend",
+    "MobilintRegulusBackend",
+    "ONNXBackend",
+    "backend_class_for",
+    "log_model_details",
+    "normalize_target_device",
+]

mblt_npu_python-0.0.0/mblt_npu/logging.py

@@ -0,0 +1,54 @@
+import hashlib
+import os
+from typing import TYPE_CHECKING, Optional
+
+if TYPE_CHECKING:
+    from .npu_backend import MobilintNPUBackend
+
+_VERBOSE_TRUE_VALUES = {"1", "true", "yes", "on"}
+
+
+def _is_verbose_enabled() -> bool:
+    return os.getenv("MBLT_MODEL_ZOO_VERBOSE", "").lower() in _VERBOSE_TRUE_VALUES
+
+
+def _md5_hash_from_file(file_path: str) -> str:
+    hash_md5 = hashlib.md5()
+    with open(file_path, "rb") as file_handle:
+        for chunk in iter(lambda: file_handle.read(8192), b""):
+            hash_md5.update(chunk)
+    return hash_md5.hexdigest()
+
+
+def log_model_details(
+    model_path: str, npu_backend: Optional["MobilintNPUBackend"] = None
+) -> None:
+    """Print model metadata when verbose logging is enabled."""
+    if not _is_verbose_enabled():
+        return
+
+    print("Model Initialized")
+    print(f"Model Size: {os.path.getsize(model_path) / 1024 / 1024:.2f} MB")
+    print(f"Model Hash: {_md5_hash_from_file(model_path)}")
+
+    if npu_backend is not None:
+        print(f"Device Number: {npu_backend.dev_no}")
+        print(f"Core Mode: {npu_backend.core_mode}")
+        if npu_backend.core_mode == "single":
+            print(f"Target Cores: {npu_backend.target_cores}")
+        else:
+            print(f"Target Clusters: {npu_backend.target_clusters}")
+        if npu_backend.mxq_model.get_num_model_variants() == 1:
+            print(f"Model Input Shape: {npu_backend.mxq_model.get_model_input_shape()}")
+            print(
+                f"Model Output Shape: {npu_backend.mxq_model.get_model_output_shape()}"
+            )
+        else:
+            for i in range(npu_backend.mxq_model.get_num_model_variants()):
+                print(f"Model Variant {i}")
+                print(
+                    f"\tInput Shape: {npu_backend.mxq_model.get_model_variant_handle(i).get_model_input_shape()}"
+                )
+                print(
+                    f"\tOutput Shape: {npu_backend.mxq_model.get_model_variant_handle(i).get_model_output_shape()}"
+                )