torchruntime 1.0.2__tar.gz

torchruntime-1.0.2/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2025 easydiffusion
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

torchruntime-1.0.2/MANIFEST.in

@@ -0,0 +1 @@
+include torchruntime/gpu_pci_ids.db

torchruntime-1.0.2/PKG-INFO

@@ -0,0 +1,145 @@
+Metadata-Version: 2.2
+Name: torchruntime
+Version: 1.0.2
+Summary: Meant for app developers. A convenient way to install and configure the appropriate version of PyTorch on the user's computer, based on the OS and GPU manufacturer and model number.
+Author-email: cmdr2 <secondary.cmdr2@gmail.com>
+Project-URL: Homepage, https://github.com/easydiffusion/torchruntime
+Project-URL: Bug Tracker, https://github.com/easydiffusion/torchruntime/issues
+Keywords: torch,ai,ml,llm,installer,runtime
+Classifier: Programming Language :: Python :: 3
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: Microsoft :: Windows :: Windows 10
+Classifier: Operating System :: Microsoft :: Windows :: Windows 11
+Classifier: Operating System :: POSIX :: Linux
+Classifier: Operating System :: MacOS
+Requires-Python: >=3.0
+Description-Content-Type: text/markdown
+License-File: LICENSE
+
+# torchruntime
+[![Discord Server](https://img.shields.io/discord/1014774730907209781?label=Discord)](https://discord.com/invite/u9yhsFmEkB)
+
+**torchruntime** is a lightweight package for automatically installing the appropriate variant of PyTorch on a user's computer, based on their OS, and GPU manufacturer and GPU model.
+
+This package is used by [Easy Diffusion](https://github.com/easydiffusion/easydiffusion), but you're welcome to use it as well. It's useful for developers who make PyTorch-based apps that target users with NVIDIA, AMD and Intel graphics cards (as well as CPU-only usage), on Windows, Mac and Linux.
+
+### Why?
+It lets you treat PyTorch as a single dependency (like it should be), and lets you assume that each user will get the most-performant variant of PyTorch suitable for their computer's OS and hardware.
+
+It deals with the complexity of the variety of torch builds and configurations required for CUDA, AMD (ROCm, DirectML), Intel (xpu/DirectML/ipex), and CPU-only.
+
+**Compatibility table**: [Click here](#compatibility-table) to see the supported graphics cards and operating systems.
+
+# Installation
+Supports Windows, Linux, and Mac.
+
+`pip install torchruntime`
+
+## Usage
+### Step 1. Install the appropriate variant of PyTorch
+*This command should be run on the user's computer, or while creating platform-specific builds:*
+
+`python -m torchruntime install`
+
+This will install `torch`, `torchvision`, and `torchaudio`, and will decide the variant based on the user's OS, GPU manufacturer and GPU model number. See [customizing packages](#customizing-packages) for more options.
+
+### Step 2. Initialize torch
+This should be run inside your program, to initialize the required environment variables (if any) for the variant of torch being used.
+
+```py
+import torchruntime
+
+torchruntime.init_torch()
+```
+
+## Customizing packages
+By default, `python -m torchruntime install` will install the latest available `torch`, `torchvision` and `torchaudio` suitable on the user's platform.
+
+You can customize the packages to install by including their names:
+* For e.g. to install only `torch` and `torchvision`, you can run `python -m torchruntime install torch torchvision`
+* To install specific versions (in pip format), you can run `python -m torchruntime install "torch>2.0" "torchvision==0.20"`
+
+**Note:** If you specify package versions, please keep in mind that the version may not be available to *all* the users on *all* the torch platforms. For e.g. a user with Python 3.8 would not be able to install torch 2.5 (or higher), because torch 2.5 dropped support for Python 3.8.
+
+So in general, it's better to avoid specifying a version unless it really matters to you (or you know what you're doing). Instead, please allow `torchruntime` to pick the latest-possible version for the user.
+
+# Compatibility table
+The list of platforms on which `torchruntime` can install a working variant of PyTorch.
+
+**Note:** *This list is based on user feedback (since I don't have all the cards). Please let me know if your card is supported (or not) by opening a pull request or issue or messaging on [Discord](https://discord.com/invite/u9yhsFmEkB) (with supporting logs).*
+
+**CPU-only:**
+
+| OS  | Supported?| Notes  |
+|---|---|---|
+| Windows  | ✅ Yes  | x86_64  |
+| Linux  | ✅ Yes  | x86_64 and aarch64  |
+| Mac (M1/M2/M3/M4)  | ✅ Yes  | arm64. `mps` backend  |
+| Mac (Intel)  | ✅ Yes  | x86_64. Stopped after `torch 2.2.2`  |
+
+**NVIDIA:**
+
+| Series  | Supported? | OS | Notes  |
+|---|---|---|---|
+| 40xx  | ✅ Yes  | Win/Linux  | Uses CUDA 124  |
+| 30xx  | ✅ Yes  | Win/Linux  | Uses CUDA 124  |
+| 20xx  | ✅ Yes  | Win/Linux  | Uses CUDA 124  |
+| 10xx/16xx  | ✅ Yes  | Win/Linux  | Uses CUDA 124. Full-precision required on 16xx series  |
+
+**AMD:**
+
+| Series  | Supported? | OS   | Notes  |
+|---|---|---|---|
+| 7xxx  | ✅ Yes  | Win/Linux    | Navi3/RDNA3 (gfx110x). ROCm 6.2 on Linux. DirectML on Windows  |
+| 6xxx  | ✅ Yes  | Win/Linux    | Navi2/RDNA2 (gfx103x). ROCm 6.2 on Linux. DirectML on Windows  |
+| 5xxx  | ✅ Yes  | Win/Linux    | Navi1/RDNA1 (gfx101x). Full-precision required. DirectML on Windows. Linux only supports upto ROCm 5.2. Waiting for [this](https://github.com/pytorch/pytorch/issues/132570#issuecomment-2313071756) for ROCm 6.2 support.  |
+| 5xxx on Intel Mac  | ❓ Untested (WIP)  | Intel Mac  | gfx101x. Implemented but need testers, please message on [Discord](https://discord.com/invite/u9yhsFmEkB) |
+| 4xxxG/Radeon VII  | ✅ Yes  | Win/Linux  | Vega 20 gfx906. Need testers for Windows, please message on [Discord](https://discord.com/invite/u9yhsFmEkB) |
+| 2xxxG/Radeon RX Vega 56  | ❓ Untested (WIP)  | N/A  | Vega 10 gfx900. Implemented but need testers, please message on [Discord](https://discord.com/invite/u9yhsFmEkB) |
+| 5xx/Polaris  | ❓ Untested (WIP)  | N/A  | gfx80x. Implemented but need testers, please message on [Discord](https://discord.com/invite/u9yhsFmEkB) |
+
+**Apple:**
+
+| Series  | Supported? |Notes  |
+|---|---|---|
+| M1/M2/M3/M4  | ✅ Yes  | 'mps' backend  |
+| AMD on Intel Mac  | ❓ Untested (WIP)  | Implemented but need testers, please message on [Discord](https://discord.com/invite/u9yhsFmEkB) |
+
+**Intel:**
+
+| Series  | Supported? | OS | Notes  |
+|---|---|---|---|
+| Arc  | ❓ Untested (WIP)  | Win/Linux  | Implemented but need testers, please message on [Discord](https://discord.com/invite/u9yhsFmEkB). Backends: 'xpu' or DirectML or [ipex](https://github.com/intel/intel-extension-for-pytorch) |
+
+
+# FAQ
+## Why can't I just run 'pip install torch'?
+`pip install torch` installs the CPU-only version of torch, so it won't utilize your GPU's capabilities.
+
+## Why can't I just install torch-for-ROCm directly to support AMD?
+Different models of AMD cards require different LLVM targets, and sometimes different ROCm versions. And ROCm currently doesn't work on Windows, so AMD on Windows is best served (currently) with DirectML.
+
+And plenty of AMD cards work with ROCm (even when they aren't in the official list of supported cards). Information about these cards (for e.g. the LLVM target to use) is pretty scattered.
+
+`torchruntime` deals with this complexity for your convenience.
+
+# Contributing
+📢 I'm looking for contributions in these specific areas:
+- More testing on consumer AMD GPUs.
+- More support for older AMD GPUs. Explore: Compile and host PyTorch wheels and rocm (on GitHub) for older AMD gpus (e.g. 580/590/Polaris) with the required patches.
+- Intel GPUs.
+- Testing on professional AMD GPUs (e.g. the Instinct series).
+- An easy-to-run benchmark script (that people can run to check the level of compatibility on their platform).
+
+Please message on the [Discord community](https://discord.com/invite/u9yhsFmEkB) if you have AMD or Intel GPUs, and would like to help with testing or adding support for them! Thanks!
+
+# Credits
+* Code contributors on [Easy Diffusion](https://github.com/easydiffusion/easydiffusion).
+* Users on [Easy Diffusion's Discord](https://discord.com/invite/u9yhsFmEkB) who've helped with testing on various GPUs.
+* [PCI Database](https://github.com/pciutils/pciids/) automatically generated from the PCI ID Database at http://pci-ids.ucw.cz
+
+# More resources
+* [AMD GPU LLVM Architectures](https://web.archive.org/web/20241228163540/https://llvm.org/docs/AMDGPUUsage.html#processors)
+* [Status of ROCm support for AMD Navi 1](https://github.com/ROCm/ROCm/issues/2527)
+* [Torch support for ROCm 6.2 on AMD Navi 1](https://github.com/pytorch/pytorch/issues/132570#issuecomment-2313071756)
+* [ROCmLibs-for-gfx1103-AMD780M-APU](https://github.com/likelovewant/ROCmLibs-for-gfx1103-AMD780M-APU)

torchruntime-1.0.2/README.md

@@ -0,0 +1,127 @@
+# torchruntime
+[![Discord Server](https://img.shields.io/discord/1014774730907209781?label=Discord)](https://discord.com/invite/u9yhsFmEkB)
+
+**torchruntime** is a lightweight package for automatically installing the appropriate variant of PyTorch on a user's computer, based on their OS, and GPU manufacturer and GPU model.
+
+This package is used by [Easy Diffusion](https://github.com/easydiffusion/easydiffusion), but you're welcome to use it as well. It's useful for developers who make PyTorch-based apps that target users with NVIDIA, AMD and Intel graphics cards (as well as CPU-only usage), on Windows, Mac and Linux.
+
+### Why?
+It lets you treat PyTorch as a single dependency (like it should be), and lets you assume that each user will get the most-performant variant of PyTorch suitable for their computer's OS and hardware.
+
+It deals with the complexity of the variety of torch builds and configurations required for CUDA, AMD (ROCm, DirectML), Intel (xpu/DirectML/ipex), and CPU-only.
+
+**Compatibility table**: [Click here](#compatibility-table) to see the supported graphics cards and operating systems.
+
+# Installation
+Supports Windows, Linux, and Mac.
+
+`pip install torchruntime`
+
+## Usage
+### Step 1. Install the appropriate variant of PyTorch
+*This command should be run on the user's computer, or while creating platform-specific builds:*
+
+`python -m torchruntime install`
+
+This will install `torch`, `torchvision`, and `torchaudio`, and will decide the variant based on the user's OS, GPU manufacturer and GPU model number. See [customizing packages](#customizing-packages) for more options.
+
+### Step 2. Initialize torch
+This should be run inside your program, to initialize the required environment variables (if any) for the variant of torch being used.
+
+```py
+import torchruntime
+
+torchruntime.init_torch()
+```
+
+## Customizing packages
+By default, `python -m torchruntime install` will install the latest available `torch`, `torchvision` and `torchaudio` suitable on the user's platform.
+
+You can customize the packages to install by including their names:
+* For e.g. to install only `torch` and `torchvision`, you can run `python -m torchruntime install torch torchvision`
+* To install specific versions (in pip format), you can run `python -m torchruntime install "torch>2.0" "torchvision==0.20"`
+
+**Note:** If you specify package versions, please keep in mind that the version may not be available to *all* the users on *all* the torch platforms. For e.g. a user with Python 3.8 would not be able to install torch 2.5 (or higher), because torch 2.5 dropped support for Python 3.8.
+
+So in general, it's better to avoid specifying a version unless it really matters to you (or you know what you're doing). Instead, please allow `torchruntime` to pick the latest-possible version for the user.
+
+# Compatibility table
+The list of platforms on which `torchruntime` can install a working variant of PyTorch.
+
+**Note:** *This list is based on user feedback (since I don't have all the cards). Please let me know if your card is supported (or not) by opening a pull request or issue or messaging on [Discord](https://discord.com/invite/u9yhsFmEkB) (with supporting logs).*
+
+**CPU-only:**
+
+| OS  | Supported?| Notes  |
+|---|---|---|
+| Windows  | ✅ Yes  | x86_64  |
+| Linux  | ✅ Yes  | x86_64 and aarch64  |
+| Mac (M1/M2/M3/M4)  | ✅ Yes  | arm64. `mps` backend  |
+| Mac (Intel)  | ✅ Yes  | x86_64. Stopped after `torch 2.2.2`  |
+
+**NVIDIA:**
+
+| Series  | Supported? | OS | Notes  |
+|---|---|---|---|
+| 40xx  | ✅ Yes  | Win/Linux  | Uses CUDA 124  |
+| 30xx  | ✅ Yes  | Win/Linux  | Uses CUDA 124  |
+| 20xx  | ✅ Yes  | Win/Linux  | Uses CUDA 124  |
+| 10xx/16xx  | ✅ Yes  | Win/Linux  | Uses CUDA 124. Full-precision required on 16xx series  |
+
+**AMD:**
+
+| Series  | Supported? | OS   | Notes  |
+|---|---|---|---|
+| 7xxx  | ✅ Yes  | Win/Linux    | Navi3/RDNA3 (gfx110x). ROCm 6.2 on Linux. DirectML on Windows  |
+| 6xxx  | ✅ Yes  | Win/Linux    | Navi2/RDNA2 (gfx103x). ROCm 6.2 on Linux. DirectML on Windows  |
+| 5xxx  | ✅ Yes  | Win/Linux    | Navi1/RDNA1 (gfx101x). Full-precision required. DirectML on Windows. Linux only supports upto ROCm 5.2. Waiting for [this](https://github.com/pytorch/pytorch/issues/132570#issuecomment-2313071756) for ROCm 6.2 support.  |
+| 5xxx on Intel Mac  | ❓ Untested (WIP)  | Intel Mac  | gfx101x. Implemented but need testers, please message on [Discord](https://discord.com/invite/u9yhsFmEkB) |
+| 4xxxG/Radeon VII  | ✅ Yes  | Win/Linux  | Vega 20 gfx906. Need testers for Windows, please message on [Discord](https://discord.com/invite/u9yhsFmEkB) |
+| 2xxxG/Radeon RX Vega 56  | ❓ Untested (WIP)  | N/A  | Vega 10 gfx900. Implemented but need testers, please message on [Discord](https://discord.com/invite/u9yhsFmEkB) |
+| 5xx/Polaris  | ❓ Untested (WIP)  | N/A  | gfx80x. Implemented but need testers, please message on [Discord](https://discord.com/invite/u9yhsFmEkB) |
+
+**Apple:**
+
+| Series  | Supported? |Notes  |
+|---|---|---|
+| M1/M2/M3/M4  | ✅ Yes  | 'mps' backend  |
+| AMD on Intel Mac  | ❓ Untested (WIP)  | Implemented but need testers, please message on [Discord](https://discord.com/invite/u9yhsFmEkB) |
+
+**Intel:**
+
+| Series  | Supported? | OS | Notes  |
+|---|---|---|---|
+| Arc  | ❓ Untested (WIP)  | Win/Linux  | Implemented but need testers, please message on [Discord](https://discord.com/invite/u9yhsFmEkB). Backends: 'xpu' or DirectML or [ipex](https://github.com/intel/intel-extension-for-pytorch) |
+
+
+# FAQ
+## Why can't I just run 'pip install torch'?
+`pip install torch` installs the CPU-only version of torch, so it won't utilize your GPU's capabilities.
+
+## Why can't I just install torch-for-ROCm directly to support AMD?
+Different models of AMD cards require different LLVM targets, and sometimes different ROCm versions. And ROCm currently doesn't work on Windows, so AMD on Windows is best served (currently) with DirectML.
+
+And plenty of AMD cards work with ROCm (even when they aren't in the official list of supported cards). Information about these cards (for e.g. the LLVM target to use) is pretty scattered.
+
+`torchruntime` deals with this complexity for your convenience.
+
+# Contributing
+📢 I'm looking for contributions in these specific areas:
+- More testing on consumer AMD GPUs.
+- More support for older AMD GPUs. Explore: Compile and host PyTorch wheels and rocm (on GitHub) for older AMD gpus (e.g. 580/590/Polaris) with the required patches.
+- Intel GPUs.
+- Testing on professional AMD GPUs (e.g. the Instinct series).
+- An easy-to-run benchmark script (that people can run to check the level of compatibility on their platform).
+
+Please message on the [Discord community](https://discord.com/invite/u9yhsFmEkB) if you have AMD or Intel GPUs, and would like to help with testing or adding support for them! Thanks!
+
+# Credits
+* Code contributors on [Easy Diffusion](https://github.com/easydiffusion/easydiffusion).
+* Users on [Easy Diffusion's Discord](https://discord.com/invite/u9yhsFmEkB) who've helped with testing on various GPUs.
+* [PCI Database](https://github.com/pciutils/pciids/) automatically generated from the PCI ID Database at http://pci-ids.ucw.cz
+
+# More resources
+* [AMD GPU LLVM Architectures](https://web.archive.org/web/20241228163540/https://llvm.org/docs/AMDGPUUsage.html#processors)
+* [Status of ROCm support for AMD Navi 1](https://github.com/ROCm/ROCm/issues/2527)
+* [Torch support for ROCm 6.2 on AMD Navi 1](https://github.com/pytorch/pytorch/issues/132570#issuecomment-2313071756)
+* [ROCmLibs-for-gfx1103-AMD780M-APU](https://github.com/likelovewant/ROCmLibs-for-gfx1103-AMD780M-APU)

torchruntime-1.0.2/pyproject.toml

@@ -0,0 +1,33 @@
+[build-system]
+requires = [ "setuptools",]
+build-backend = "setuptools.build_meta"
+
+[project]
+name = "torchruntime"
+version = "1.0.2"
+description = "Meant for app developers. A convenient way to install and configure the appropriate version of PyTorch on the user's computer, based on the OS and GPU manufacturer and model number."
+readme = "README.md"
+requires-python = ">=3.0"
+classifiers = [ "Programming Language :: Python :: 3", "License :: OSI Approved :: MIT License", "Operating System :: Microsoft :: Windows :: Windows 10", "Operating System :: Microsoft :: Windows :: Windows 11", "Operating System :: POSIX :: Linux", "Operating System :: MacOS",]
+keywords = [ "torch", "ai", "ml", "llm", "installer", "runtime",]
+dynamic = [ "dependencies",]
+[[project.authors]]
+name = "cmdr2"
+email = "secondary.cmdr2@gmail.com"
+
+[project.urls]
+Homepage = "https://github.com/easydiffusion/torchruntime"
+"Bug Tracker" = "https://github.com/easydiffusion/torchruntime/issues"
+
+[tool.isort]
+profile = "black"
+
+[tool.black]
+line-length = 120
+include = "\\.pyi?$"
+exclude = "/(\n    \\.git\n  | \\.hg\n  | \\.mypy_cache\n  | \\.tox\n  | \\.venv\n  | _build\n  | buck-out\n  | build\n  | dist\n)/\n"
+
+[tool.pytest.ini_options]
+minversion = "6.0"
+addopts = "-vs"
+testpaths = [ "tests", "integration",]

torchruntime-1.0.2/setup.cfg

@@ -0,0 +1,4 @@
+[egg_info]
+tag_build = 
+tag_date = 0
+

torchruntime-1.0.2/setup.py

@@ -0,0 +1,5 @@
+import setuptools
+
+setuptools.setup(
+    install_requires=[],
+)

torchruntime-1.0.2/tests/test_configure.py

@@ -0,0 +1,137 @@
+import os
+import pytest
+from torchruntime.configure import set_rocm_env_vars
+from torchruntime.consts import AMD
+
+
+def create_gpu_info(device_id, device_name):
+    return (AMD, "Advanced Micro Devices, Inc. [AMD/ATI]", device_id, device_name)
+
+
+@pytest.fixture(autouse=True)
+def clean_env():
+    # Remove relevant environment variables before each test
+    env_vars = [
+        "HSA_OVERRIDE_GFX_VERSION",
+        "HIP_VISIBLE_DEVICES",
+        "ROC_ENABLE_PRE_VEGA",
+        "HSA_ENABLE_SDMA",
+        "FORCE_FULL_PRECISION",
+    ]
+
+    # Store original values
+    original_values = {}
+    for var in env_vars:
+        if var in os.environ:
+            original_values[var] = os.environ[var]
+            del os.environ[var]
+
+    yield
+
+    # Restore original values and remove any new ones
+    for var in env_vars:
+        if var in os.environ and var not in original_values:
+            del os.environ[var]
+        elif var in original_values:
+            os.environ[var] = original_values[var]
+
+
+def test_navi_3_settings():
+    gpus = [create_gpu_info("123", "Navi 31 XTX")]
+    set_rocm_env_vars(gpus, "rocm6.2")
+
+    assert os.environ.get("HSA_OVERRIDE_GFX_VERSION") == "11.0.0"
+    assert os.environ.get("HIP_VISIBLE_DEVICES") == "0"
+    assert "ROC_ENABLE_PRE_VEGA" not in os.environ
+    assert "FORCE_FULL_PRECISION" not in os.environ
+
+
+def test_navi_2_settings():
+    gpus = [create_gpu_info("123", "Navi 21 XTX")]
+    set_rocm_env_vars(gpus, "rocm6.2")
+
+    assert os.environ.get("HSA_OVERRIDE_GFX_VERSION") == "10.3.0"
+    assert os.environ.get("HIP_VISIBLE_DEVICES") == "0"
+    assert "ROC_ENABLE_PRE_VEGA" not in os.environ
+    assert "FORCE_FULL_PRECISION" not in os.environ
+
+
+def test_navi_1_settings():
+    gpus = [create_gpu_info("123", "Navi 14")]
+    set_rocm_env_vars(gpus, "rocm6.2")
+
+    assert os.environ.get("HSA_OVERRIDE_GFX_VERSION") == "10.3.0"
+    assert os.environ.get("HIP_VISIBLE_DEVICES") == "0"
+    assert os.environ.get("FORCE_FULL_PRECISION") == "yes"
+    assert "ROC_ENABLE_PRE_VEGA" not in os.environ
+
+
+def test_vega_2_settings():
+    gpus = [create_gpu_info("123", "Vega 20 Radeon VII")]
+    set_rocm_env_vars(gpus, "rocm6.2")
+
+    assert os.environ.get("HSA_OVERRIDE_GFX_VERSION") == "9.0.6"
+    assert os.environ.get("HIP_VISIBLE_DEVICES") == "0"
+    assert "FORCE_FULL_PRECISION" not in os.environ
+    assert "ROC_ENABLE_PRE_VEGA" not in os.environ
+
+
+def test_vega_1_settings():
+    gpus = [create_gpu_info("123", "Vega 10")]
+    set_rocm_env_vars(gpus, "rocm6.2")
+
+    assert os.environ.get("HSA_OVERRIDE_GFX_VERSION") == "9.0.0"
+    assert os.environ.get("HIP_VISIBLE_DEVICES") == "0"
+    assert os.environ.get("FORCE_FULL_PRECISION") == "yes"
+    assert "ROC_ENABLE_PRE_VEGA" not in os.environ
+
+
+def test_ellesmere_settings():
+    gpus = [create_gpu_info("123", "Ellesmere RX 580")]
+    set_rocm_env_vars(gpus, "rocm6.2")
+
+    assert os.environ.get("HSA_OVERRIDE_GFX_VERSION") == "8.0.3"
+    assert os.environ.get("ROC_ENABLE_PRE_VEGA") == "1"
+    assert os.environ.get("HIP_VISIBLE_DEVICES") == "0"
+    assert "FORCE_FULL_PRECISION" not in os.environ
+
+
+def test_unknown_gpu_settings():
+    gpus = [create_gpu_info("123", "Unknown GPU")]
+    set_rocm_env_vars(gpus, "rocm6.2")
+
+    assert "ROC_ENABLE_PRE_VEGA" not in os.environ
+    assert "HIP_VISIBLE_DEVICES" not in os.environ
+    assert "HSA_OVERRIDE_GFX_VERSION" not in os.environ
+    assert "FORCE_FULL_PRECISION" not in os.environ
+
+
+def test_multiple_gpus_same_type():
+    gpus = [create_gpu_info("123", "Navi 31 XTX"), create_gpu_info("124", "Navi 31 XT")]
+    set_rocm_env_vars(gpus, "rocm6.2")
+
+    assert os.environ.get("HSA_OVERRIDE_GFX_VERSION") == "11.0.0"
+    assert os.environ.get("HIP_VISIBLE_DEVICES") == "0,1"
+    assert "ROC_ENABLE_PRE_VEGA" not in os.environ
+    assert "FORCE_FULL_PRECISION" not in os.environ
+
+
+def test_multiple_gpus_mixed_types():
+    gpus = [create_gpu_info("123", "Navi 31 XTX"), create_gpu_info("124", "Navi 21 XT")]
+    set_rocm_env_vars(gpus, "rocm6.2")
+
+    # Should use Navi 3 settings since at least one GPU is Navi 3
+    assert os.environ.get("HSA_OVERRIDE_GFX_VERSION") == "11.0.0"
+    assert os.environ.get("HIP_VISIBLE_DEVICES") == "0,1"
+    assert "ROC_ENABLE_PRE_VEGA" not in os.environ
+    assert "FORCE_FULL_PRECISION" not in os.environ
+
+
+def test_empty_gpu_list():
+    gpus = []
+    set_rocm_env_vars(gpus, "rocm6.2")
+
+    assert "ROC_ENABLE_PRE_VEGA" not in os.environ
+    assert "HIP_VISIBLE_DEVICES" not in os.environ
+    assert "HSA_OVERRIDE_GFX_VERSION" not in os.environ
+    assert "FORCE_FULL_PRECISION" not in os.environ

torchruntime-1.0.2/tests/test_device_db.py

@@ -0,0 +1,50 @@
+from torchruntime.device_db import parse_windows_output, parse_linux_output, parse_macos_output
+
+
+def test_parse_windows_output():
+    output = """
+    PCI\\VEN_8086&DEV_591B&SUBSYS_2212103C&REV_04
+    PCI\\VEN_10DE&DEV_1C82&SUBSYS_37131462&REV_A1
+    PCI\\VEN_10DE&DEV_2504&SUBSYS_881D1043&REV_A1\\4&22AF55FA&0&0008
+    """
+    expected = [("8086", "591b"), ("10de", "1c82"), ("10de", ("2504"))]
+    assert sorted(parse_windows_output(output)) == sorted(expected)
+
+
+def test_parse_linux_output():
+    output = """
+    00:02.0 VGA compatible controller: Intel Corporation HD Graphics 620 (rev 02) [8086:5916]
+    01:00.0 3D controller: NVIDIA Corporation GP108M [GeForce MX150] (rev a1) [10de:1d10]
+    """
+    expected = [("8086", "5916"), ("10de", "1d10")]
+    assert sorted(parse_linux_output(output)) == sorted(expected)
+
+
+def test_parse_macos_output():
+    output = """
+    {
+        "SPDisplaysDataType": [
+            {
+                "spdisplays_vendor": "Intel",
+                "spdisplays_device-id": "0x5916"
+            },
+            {
+                "spdisplays_vendor": "NVIDIA (0x10de)",
+                "spdisplays_device-id": "0x1c82"
+            }
+        ]
+    }
+    """
+    expected = [("8086", "5916"), ("10de", "1c82")]
+    assert sorted(parse_macos_output(output)) == sorted(expected)
+
+
+def test_parse_macos_output_invalid_json():
+    output = "{ invalid_json: true }"
+    assert parse_macos_output(output) == []
+
+
+def test_empty_outputs():
+    assert parse_windows_output("") == []
+    assert parse_linux_output("") == []
+    assert parse_macos_output("") == []

torchruntime-1.0.2/tests/test_device_db_integration.py

@@ -0,0 +1,50 @@
+# Integration test, which connects to the database and checks for some common devices
+
+from torchruntime.device_db import get_device_infos, DEVICE_DB_FILE
+
+
+def test_db_file_exists():
+    import os
+    from torchruntime import device_db
+
+    db_path = os.path.join(os.path.dirname(device_db.__file__), DEVICE_DB_FILE)
+    assert os.path.exists(db_path)
+
+
+def test_get_single_device():
+    """Test retrieving a single device."""
+    result = get_device_infos([("8086", "56a7")])
+    assert len(result) == 1
+    assert result[0] == ("8086", "Intel Corporation", "56a7", "DG2 [Arc Xe Graphics]")
+
+
+def test_get_multiple_devices():
+    """Test retrieving multiple devices."""
+    input_ids = [("10de", "2786"), ("10de", "2504")]
+    result = get_device_infos(input_ids)
+    assert len(result) == 2
+    assert ("10de", "NVIDIA Corporation", "2786", "AD104 [GeForce RTX 4070]") in result
+    assert ("10de", "NVIDIA Corporation", "2504", "GA106 [GeForce RTX 3060 Lite Hash Rate]") in result
+
+
+def test_get_amd_devices():
+    """Test retrieving AMD devices."""
+    input_ids = [("1002", "9495"), ("1002", "747e")]
+    result = get_device_infos(input_ids)
+    assert len(result) == 2
+    assert ("1002", "Advanced Micro Devices, Inc. [AMD/ATI]", "9495", "RV730 [Radeon HD 4600 AGP Series]") in result
+    assert ("1002", "Advanced Micro Devices, Inc. [AMD/ATI]", "747e", "Navi 32 [Radeon RX 7700 XT / 7800 XT]") in result
+
+
+def test_get_nonexistent_device():
+    """Test retrieving a device that doesn't exist in the database."""
+    result = get_device_infos([("ffff", "ffff")])
+    assert len(result) == 0
+
+
+def test_get_mixed_existing_and_nonexistent():
+    """Test retrieving a mix of existing and non-existing devices."""
+    input_ids = [("8086", "56a7"), ("ffff", "ffff")]  # exists  # doesn't exist
+    result = get_device_infos(input_ids)
+    assert len(result) == 1
+    assert result[0] == ("8086", "Intel Corporation", "56a7", "DG2 [Arc Xe Graphics]")