gpustack-runner 0.1.24.post1__tar.gz → 0.1.24.post2__tar.gz

{gpustack_runner-0.1.24.post1 → gpustack_runner-0.1.24.post2}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: gpustack-runner
-Version: 0.1.24.post1
+Version: 0.1.24.post2
 Summary: GPUStack Runner is library for registering runnable accelerated backends and services in GPUStack.
 Project-URL: Homepage, https://github.com/gpustack/runner
 Project-URL: Bug Tracker, https://github.com/gpustack/gpustack/issues
@@ -54,8 +54,11 @@ The following table lists the supported accelerated backends and their correspon
 
 | CANN Version <br/> (Variant) | MindIE    | vLLM                                                       | SGLang                 |
 |------------------------------|-----------|------------------------------------------------------------|------------------------|
-| 8.3 (A3/910C)                | `2.2.rc1` | `0.13.0`, `0.12.0`, `0.11.0`                               | `0.5.7`, `0.5.6.post2` |
-| 8.3 (910B)                   | `2.2.rc1` | `0.13.0`, `0.12.0`, `0.11.0`                               | `0.5.7`, `0.5.6.post2` |
+| 8.5 (A3/910C)                | `2.3.0`   | `0.14.1`, `0.13.0`                                         | `0.5.8`                |
+| 8.5 (910B)                   | `2.3.0`   | `0.14.1`, `0.13.0`                                         | `0.5.8`                |
+| 8.5 (310P)                   | `2.3.0`   | `0.14.1`                                                   |                        |
+| 8.3 (A3/910C)                | `2.2.rc1` | `0.12.0`, `0.11.0`                                         | `0.5.7`, `0.5.6.post2` |
+| 8.3 (910B)                   | `2.2.rc1` | `0.12.0`, `0.11.0`                                         | `0.5.7`, `0.5.6.post2` |
 | 8.3 (310P)                   | `2.2.rc1` |                                                            |                        |
 | 8.2 (A3/910C)                | `2.1.rc2` | `0.10.2`, `0.10.1.1`                                       | `0.5.2`, `0.5.1.post3` |
 | 8.2 (910B)                   | `2.1.rc2` | `0.10.2`, `0.10.1.1`, <br/>`0.10.0`, `0.9.2`, <br/>`0.9.1` | `0.5.2`, `0.5.1.post3` |
@@ -89,7 +92,7 @@ The following table lists the supported accelerated backends and their correspon
 |-----------------------------|----------------------------|
 | 25.04                       | `0.11.0`, `0.9.2`, `0.8.5` |
 
-### THead HGGC
+### T-Head HGGC
 
 | HGGC Version <br/> (Variant) | vLLM     | SGLang  |
 |------------------------------|----------|---------|
@@ -97,10 +100,11 @@ The following table lists the supported accelerated backends and their correspon
 
 ### MetaX MACA
 
-| MACA Version <br/> (Variant) | vLLM     |
-|------------------------------|----------|
-| 3.2                          | `0.10.2` |
-| 3.0                          | `0.9.1`  |
+| MACA Version <br/> (Variant) | vLLM     | SGLang  |
+|------------------------------|----------|---------|
+| 3.3                          | `0.11.2` | `0.5.6` |
+| 3.2                          | `0.10.2` |         |
+| 3.0                          | `0.9.1`  |         |
 
 ### MThreads MUSA
 
@@ -118,7 +122,7 @@ The following table lists the supported accelerated backends and their correspon
     `gfx908 gfx90a gfx942 gfx1030 gfx1100`.
 
 > [!WARNING]
-> - ROCm 7.0 vLLM `0.11.2/0.11.0` are reusing the official ROCm 6.4 PyTorch 2.9 wheel package rather than a ROCm
+> - ROCm 7.0 vLLM `0.11.2` are reusing the official ROCm 6.4 PyTorch 2.9 wheel package rather than a ROCm
     7.0 specific PyTorch build. Although supports ROCm 7.0 in vLLM `0.11.2`, `gfx1150/gfx1151` are not supported yet.
 > - ROCm 6.4 vLLM `0.13.0` supports `gfx903 gfx90a gfx942` only.
 > - ROCm 6.4 SGLang supports `gfx942` only.

{gpustack_runner-0.1.24.post1 → gpustack_runner-0.1.24.post2}/README.md

@@ -34,8 +34,11 @@ The following table lists the supported accelerated backends and their correspon
 
 | CANN Version <br/> (Variant) | MindIE    | vLLM                                                       | SGLang                 |
 |------------------------------|-----------|------------------------------------------------------------|------------------------|
-| 8.3 (A3/910C)                | `2.2.rc1` | `0.13.0`, `0.12.0`, `0.11.0`                               | `0.5.7`, `0.5.6.post2` |
-| 8.3 (910B)                   | `2.2.rc1` | `0.13.0`, `0.12.0`, `0.11.0`                               | `0.5.7`, `0.5.6.post2` |
+| 8.5 (A3/910C)                | `2.3.0`   | `0.14.1`, `0.13.0`                                         | `0.5.8`                |
+| 8.5 (910B)                   | `2.3.0`   | `0.14.1`, `0.13.0`                                         | `0.5.8`                |
+| 8.5 (310P)                   | `2.3.0`   | `0.14.1`                                                   |                        |
+| 8.3 (A3/910C)                | `2.2.rc1` | `0.12.0`, `0.11.0`                                         | `0.5.7`, `0.5.6.post2` |
+| 8.3 (910B)                   | `2.2.rc1` | `0.12.0`, `0.11.0`                                         | `0.5.7`, `0.5.6.post2` |
 | 8.3 (310P)                   | `2.2.rc1` |                                                            |                        |
 | 8.2 (A3/910C)                | `2.1.rc2` | `0.10.2`, `0.10.1.1`                                       | `0.5.2`, `0.5.1.post3` |
 | 8.2 (910B)                   | `2.1.rc2` | `0.10.2`, `0.10.1.1`, <br/>`0.10.0`, `0.9.2`, <br/>`0.9.1` | `0.5.2`, `0.5.1.post3` |
@@ -69,7 +72,7 @@ The following table lists the supported accelerated backends and their correspon
 |-----------------------------|----------------------------|
 | 25.04                       | `0.11.0`, `0.9.2`, `0.8.5` |
 
-### THead HGGC
+### T-Head HGGC
 
 | HGGC Version <br/> (Variant) | vLLM     | SGLang  |
 |------------------------------|----------|---------|
@@ -77,10 +80,11 @@ The following table lists the supported accelerated backends and their correspon
 
 ### MetaX MACA
 
-| MACA Version <br/> (Variant) | vLLM     |
-|------------------------------|----------|
-| 3.2                          | `0.10.2` |
-| 3.0                          | `0.9.1`  |
+| MACA Version <br/> (Variant) | vLLM     | SGLang  |
+|------------------------------|----------|---------|
+| 3.3                          | `0.11.2` | `0.5.6` |
+| 3.2                          | `0.10.2` |         |
+| 3.0                          | `0.9.1`  |         |
 
 ### MThreads MUSA
 
@@ -98,7 +102,7 @@ The following table lists the supported accelerated backends and their correspon
     `gfx908 gfx90a gfx942 gfx1030 gfx1100`.
 
 > [!WARNING]
-> - ROCm 7.0 vLLM `0.11.2/0.11.0` are reusing the official ROCm 6.4 PyTorch 2.9 wheel package rather than a ROCm
+> - ROCm 7.0 vLLM `0.11.2` are reusing the official ROCm 6.4 PyTorch 2.9 wheel package rather than a ROCm
     7.0 specific PyTorch build. Although supports ROCm 7.0 in vLLM `0.11.2`, `gfx1150/gfx1151` are not supported yet.
 > - ROCm 6.4 vLLM `0.13.0` supports `gfx903 gfx90a gfx942` only.
 > - ROCm 6.4 SGLang supports `gfx942` only.

{gpustack_runner-0.1.24.post1 → gpustack_runner-0.1.24.post2}/gpustack_runner/_version.py

@@ -27,8 +27,8 @@ version_tuple: VERSION_TUPLE
 __commit_id__: COMMIT_ID
 commit_id: COMMIT_ID
 
-__version__ = version = '0.1.24.post1'
-__version_tuple__ = version_tuple = (0, 1, 24, 'post1')
+__version__ = version = '0.1.24.post2'
+__version_tuple__ = version_tuple = (0, 1, 24, 'post2')
 try:
     from ._version_appendix import git_commit
     __commit_id__ = commit_id = git_commit

gpustack_runner-0.1.24.post2/gpustack_runner/_version_appendix.py

@@ -0,0 +1 @@
+git_commit = "62d75c6"

{gpustack_runner-0.1.24.post1 → gpustack_runner-0.1.24.post2}/gpustack_runner/cmds/images.py

@@ -464,7 +464,7 @@ class SaveImagesSubCommand(SubCommand):
             # Submit tasks
             for task_name, src_img, dst_file, dst_file_relative in saving_tasks:
                 if dst_file.exists():
-                    print(f"{dst_file.name} already exists, skipping save {src_img}.")
+                    print(f"✅ {dst_file} already exists, skipping save {src_img}.")
                     continue
                 dst_file.parent.mkdir(parents=True, exist_ok=True, mode=0o744)
 
@@ -976,7 +976,7 @@ class LoadImagesSubCommand(SubCommand):
         load_parser.add_argument(
             "input",
             nargs=OPTIONAL,
-            help="Input directory to load images (default: current working directory)",
+            help="Input directory to load images from (default: current working directory)",
         )
 
         load_parser.set_defaults(func=LoadImagesSubCommand)

{gpustack_runner-0.1.24.post1 → gpustack_runner-0.1.24.post2}/gpustack_runner/runner.py.json

@@ -1,35 +1,79 @@
 [
   {
     "backend": "cann",
-    "backend_version": "8.3",
-    "original_backend_version": "8.3.rc2",
+    "backend_version": "8.5",
+    "original_backend_version": "8.5.0",
     "backend_variant": "a3",
     "service": "mindie",
-    "service_version": "2.2.rc1",
+    "service_version": "2.3.0",
     "platform": "linux/amd64",
-    "docker_image": "gpustack/runner:cann8.3-a3-mindie2.2.rc1",
+    "docker_image": "gpustack/runner:cann8.5-a3-mindie2.3.0",
     "deprecated": false
   },
   {
     "backend": "cann",
-    "backend_version": "8.3",
-    "original_backend_version": "8.3.rc2",
+    "backend_version": "8.5",
+    "original_backend_version": "8.5.0",
     "backend_variant": "a3",
     "service": "mindie",
-    "service_version": "2.2.rc1",
+    "service_version": "2.3.0",
     "platform": "linux/arm64",
-    "docker_image": "gpustack/runner:cann8.3-a3-mindie2.2.rc1",
+    "docker_image": "gpustack/runner:cann8.5-a3-mindie2.3.0",
     "deprecated": false
   },
   {
     "backend": "cann",
-    "backend_version": "8.3",
-    "original_backend_version": "8.3.rc2",
+    "backend_version": "8.5",
+    "original_backend_version": "8.5.0",
     "backend_variant": "a3",
     "service": "sglang",
-    "service_version": "0.5.7",
+    "service_version": "0.5.8",
     "platform": "linux/arm64",
-    "docker_image": "gpustack/runner:cann8.3-a3-sglang0.5.7",
+    "docker_image": "gpustack/runner:cann8.5-a3-sglang0.5.8",
+    "deprecated": false
+  },
+  {
+    "backend": "cann",
+    "backend_version": "8.5",
+    "original_backend_version": "8.5.0",
+    "backend_variant": "a3",
+    "service": "vllm",
+    "service_version": "0.14.1",
+    "platform": "linux/amd64",
+    "docker_image": "gpustack/runner:cann8.5-a3-vllm0.14.1",
+    "deprecated": false
+  },
+  {
+    "backend": "cann",
+    "backend_version": "8.5",
+    "original_backend_version": "8.5.0",
+    "backend_variant": "a3",
+    "service": "vllm",
+    "service_version": "0.14.1",
+    "platform": "linux/arm64",
+    "docker_image": "gpustack/runner:cann8.5-a3-vllm0.14.1",
+    "deprecated": false
+  },
+  {
+    "backend": "cann",
+    "backend_version": "8.5",
+    "original_backend_version": "8.5.0",
+    "backend_variant": "a3",
+    "service": "vllm",
+    "service_version": "0.13.0",
+    "platform": "linux/amd64",
+    "docker_image": "gpustack/runner:cann8.5-a3-vllm0.13.0",
+    "deprecated": false
+  },
+  {
+    "backend": "cann",
+    "backend_version": "8.5",
+    "original_backend_version": "8.5.0",
+    "backend_variant": "a3",
+    "service": "vllm",
+    "service_version": "0.13.0",
+    "platform": "linux/arm64",
+    "docker_image": "gpustack/runner:cann8.5-a3-vllm0.13.0",
     "deprecated": false
   },
   {
@@ -37,10 +81,21 @@
     "backend_version": "8.3",
     "original_backend_version": "8.3.rc2",
     "backend_variant": "a3",
-    "service": "sglang",
-    "service_version": "0.5.6.post2",
+    "service": "mindie",
+    "service_version": "2.2.rc1",
+    "platform": "linux/amd64",
+    "docker_image": "gpustack/runner:cann8.3-a3-mindie2.2.rc1",
+    "deprecated": false
+  },
+  {
+    "backend": "cann",
+    "backend_version": "8.3",
+    "original_backend_version": "8.3.rc2",
+    "backend_variant": "a3",
+    "service": "mindie",
+    "service_version": "2.2.rc1",
     "platform": "linux/arm64",
-    "docker_image": "gpustack/runner:cann8.3-a3-sglang0.5.6.post2",
+    "docker_image": "gpustack/runner:cann8.3-a3-mindie2.2.rc1",
     "deprecated": false
   },
   {
@@ -48,10 +103,10 @@
     "backend_version": "8.3",
     "original_backend_version": "8.3.rc2",
     "backend_variant": "a3",
-    "service": "vllm",
-    "service_version": "0.13.0",
-    "platform": "linux/amd64",
-    "docker_image": "gpustack/runner:cann8.3-a3-vllm0.13.0",
+    "service": "sglang",
+    "service_version": "0.5.7",
+    "platform": "linux/arm64",
+    "docker_image": "gpustack/runner:cann8.3-a3-sglang0.5.7",
     "deprecated": false
   },
   {
@@ -59,10 +114,10 @@
     "backend_version": "8.3",
     "original_backend_version": "8.3.rc2",
     "backend_variant": "a3",
-    "service": "vllm",
-    "service_version": "0.13.0",
+    "service": "sglang",
+    "service_version": "0.5.6.post2",
     "platform": "linux/arm64",
-    "docker_image": "gpustack/runner:cann8.3-a3-vllm0.13.0",
+    "docker_image": "gpustack/runner:cann8.3-a3-sglang0.5.6.post2",
     "deprecated": false
   },
   {
@@ -221,35 +276,79 @@
   },
   {
     "backend": "cann",
-    "backend_version": "8.3",
-    "original_backend_version": "8.3.rc2",
+    "backend_version": "8.5",
+    "original_backend_version": "8.5.0",
     "backend_variant": "910b",
     "service": "mindie",
-    "service_version": "2.2.rc1",
+    "service_version": "2.3.0",
     "platform": "linux/amd64",
-    "docker_image": "gpustack/runner:cann8.3-910b-mindie2.2.rc1",
+    "docker_image": "gpustack/runner:cann8.5-910b-mindie2.3.0",
     "deprecated": false
   },
   {
     "backend": "cann",
-    "backend_version": "8.3",
-    "original_backend_version": "8.3.rc2",
+    "backend_version": "8.5",
+    "original_backend_version": "8.5.0",
     "backend_variant": "910b",
     "service": "mindie",
-    "service_version": "2.2.rc1",
+    "service_version": "2.3.0",
     "platform": "linux/arm64",
-    "docker_image": "gpustack/runner:cann8.3-910b-mindie2.2.rc1",
+    "docker_image": "gpustack/runner:cann8.5-910b-mindie2.3.0",
     "deprecated": false
   },
   {
     "backend": "cann",
-    "backend_version": "8.3",
-    "original_backend_version": "8.3.rc2",
+    "backend_version": "8.5",
+    "original_backend_version": "8.5.0",
     "backend_variant": "910b",
     "service": "sglang",
-    "service_version": "0.5.7",
+    "service_version": "0.5.8",
     "platform": "linux/arm64",
-    "docker_image": "gpustack/runner:cann8.3-910b-sglang0.5.7",
+    "docker_image": "gpustack/runner:cann8.5-910b-sglang0.5.8",
+    "deprecated": false
+  },
+  {
+    "backend": "cann",
+    "backend_version": "8.5",
+    "original_backend_version": "8.5.0",
+    "backend_variant": "910b",
+    "service": "vllm",
+    "service_version": "0.14.1",
+    "platform": "linux/amd64",
+    "docker_image": "gpustack/runner:cann8.5-910b-vllm0.14.1",
+    "deprecated": false
+  },
+  {
+    "backend": "cann",
+    "backend_version": "8.5",
+    "original_backend_version": "8.5.0",
+    "backend_variant": "910b",
+    "service": "vllm",
+    "service_version": "0.14.1",
+    "platform": "linux/arm64",
+    "docker_image": "gpustack/runner:cann8.5-910b-vllm0.14.1",
+    "deprecated": false
+  },
+  {
+    "backend": "cann",
+    "backend_version": "8.5",
+    "original_backend_version": "8.5.0",
+    "backend_variant": "910b",
+    "service": "vllm",
+    "service_version": "0.13.0",
+    "platform": "linux/amd64",
+    "docker_image": "gpustack/runner:cann8.5-910b-vllm0.13.0",
+    "deprecated": false
+  },
+  {
+    "backend": "cann",
+    "backend_version": "8.5",
+    "original_backend_version": "8.5.0",
+    "backend_variant": "910b",
+    "service": "vllm",
+    "service_version": "0.13.0",
+    "platform": "linux/arm64",
+    "docker_image": "gpustack/runner:cann8.5-910b-vllm0.13.0",
     "deprecated": false
   },
   {
@@ -257,10 +356,21 @@
     "backend_version": "8.3",
     "original_backend_version": "8.3.rc2",
     "backend_variant": "910b",
-    "service": "sglang",
-    "service_version": "0.5.6.post2",
+    "service": "mindie",
+    "service_version": "2.2.rc1",
+    "platform": "linux/amd64",
+    "docker_image": "gpustack/runner:cann8.3-910b-mindie2.2.rc1",
+    "deprecated": false
+  },
+  {
+    "backend": "cann",
+    "backend_version": "8.3",
+    "original_backend_version": "8.3.rc2",
+    "backend_variant": "910b",
+    "service": "mindie",
+    "service_version": "2.2.rc1",
     "platform": "linux/arm64",
-    "docker_image": "gpustack/runner:cann8.3-910b-sglang0.5.6.post2",
+    "docker_image": "gpustack/runner:cann8.3-910b-mindie2.2.rc1",
     "deprecated": false
   },
   {
@@ -268,10 +378,10 @@
     "backend_version": "8.3",
     "original_backend_version": "8.3.rc2",
     "backend_variant": "910b",
-    "service": "vllm",
-    "service_version": "0.13.0",
-    "platform": "linux/amd64",
-    "docker_image": "gpustack/runner:cann8.3-910b-vllm0.13.0",
+    "service": "sglang",
+    "service_version": "0.5.7",
+    "platform": "linux/arm64",
+    "docker_image": "gpustack/runner:cann8.3-910b-sglang0.5.7",
     "deprecated": false
   },
   {
@@ -279,10 +389,10 @@
     "backend_version": "8.3",
     "original_backend_version": "8.3.rc2",
     "backend_variant": "910b",
-    "service": "vllm",
-    "service_version": "0.13.0",
+    "service": "sglang",
+    "service_version": "0.5.6.post2",
     "platform": "linux/arm64",
-    "docker_image": "gpustack/runner:cann8.3-910b-vllm0.13.0",
+    "docker_image": "gpustack/runner:cann8.3-910b-sglang0.5.6.post2",
     "deprecated": false
   },
   {
@@ -527,6 +637,50 @@
     "docker_image": "gpustack/runner:cann8.2-910b-vllm0.9.1",
     "deprecated": false
   },
+  {
+    "backend": "cann",
+    "backend_version": "8.5",
+    "original_backend_version": "8.5.0",
+    "backend_variant": "310p",
+    "service": "mindie",
+    "service_version": "2.3.0",
+    "platform": "linux/amd64",
+    "docker_image": "gpustack/runner:cann8.5-310p-mindie2.3.0",
+    "deprecated": false
+  },
+  {
+    "backend": "cann",
+    "backend_version": "8.5",
+    "original_backend_version": "8.5.0",
+    "backend_variant": "310p",
+    "service": "mindie",
+    "service_version": "2.3.0",
+    "platform": "linux/arm64",
+    "docker_image": "gpustack/runner:cann8.5-310p-mindie2.3.0",
+    "deprecated": false
+  },
+  {
+    "backend": "cann",
+    "backend_version": "8.5",
+    "original_backend_version": "8.5.0",
+    "backend_variant": "310p",
+    "service": "vllm",
+    "service_version": "0.14.1",
+    "platform": "linux/amd64",
+    "docker_image": "gpustack/runner:cann8.5-310p-vllm0.14.1",
+    "deprecated": false
+  },
+  {
+    "backend": "cann",
+    "backend_version": "8.5",
+    "original_backend_version": "8.5.0",
+    "backend_variant": "310p",
+    "service": "vllm",
+    "service_version": "0.14.1",
+    "platform": "linux/arm64",
+    "docker_image": "gpustack/runner:cann8.5-310p-vllm0.14.1",
+    "deprecated": false
+  },
   {
     "backend": "cann",
     "backend_version": "8.3",
@@ -1418,6 +1572,28 @@
     "docker_image": "gpustack/runner:hggc12.3-vllm0.11.1",
     "deprecated": false
   },
+  {
+    "backend": "maca",
+    "backend_version": "3.3",
+    "original_backend_version": "3.3.0",
+    "backend_variant": "",
+    "service": "sglang",
+    "service_version": "0.5.6",
+    "platform": "linux/amd64",
+    "docker_image": "gpustack/runner:maca3.3-sglang0.5.6",
+    "deprecated": false
+  },
+  {
+    "backend": "maca",
+    "backend_version": "3.3",
+    "original_backend_version": "3.3.0",
+    "backend_variant": "",
+    "service": "vllm",
+    "service_version": "0.11.2",
+    "platform": "linux/amd64",
+    "docker_image": "gpustack/runner:maca3.3-vllm0.11.2",
+    "deprecated": false
+  },
   {
     "backend": "maca",
     "backend_version": "3.2",