gpustack-runner 0.1.24.post1__tar.gz → 0.1.24.post3__tar.gz

{gpustack_runner-0.1.24.post1 → gpustack_runner-0.1.24.post3}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: gpustack-runner
-Version: 0.1.24.post1
+Version: 0.1.24.post3
 Summary: GPUStack Runner is library for registering runnable accelerated backends and services in GPUStack.
 Project-URL: Homepage, https://github.com/gpustack/runner
 Project-URL: Bug Tracker, https://github.com/gpustack/gpustack/issues
@@ -52,14 +52,17 @@ The following table lists the supported accelerated backends and their correspon
     vllm-ascend [#3316](https://github.com/vllm-project/vllm-ascend/issues/3316)
     and [#2795](https://github.com/vllm-project/vllm-ascend/issues/2795).
 
-| CANN Version <br/> (Variant) | MindIE    | vLLM                                                       | SGLang                 |
-|------------------------------|-----------|------------------------------------------------------------|------------------------|
-| 8.3 (A3/910C)                | `2.2.rc1` | `0.13.0`, `0.12.0`, `0.11.0`                               | `0.5.7`, `0.5.6.post2` |
-| 8.3 (910B)                   | `2.2.rc1` | `0.13.0`, `0.12.0`, `0.11.0`                               | `0.5.7`, `0.5.6.post2` |
-| 8.3 (310P)                   | `2.2.rc1` |                                                            |                        |
-| 8.2 (A3/910C)                | `2.1.rc2` | `0.10.2`, `0.10.1.1`                                       | `0.5.2`, `0.5.1.post3` |
-| 8.2 (910B)                   | `2.1.rc2` | `0.10.2`, `0.10.1.1`, <br/>`0.10.0`, `0.9.2`, <br/>`0.9.1` | `0.5.2`, `0.5.1.post3` |
-| 8.2 (310P)                   | `2.1.rc2` | `0.10.0`, `0.9.2`                                          |                        |
+| CANN Version <br/> (Variant) | MindIE    | vLLM                                                               | SGLang                 |
+|------------------------------|-----------|--------------------------------------------------------------------|------------------------|
+| 8.5 (A3/910C)                | `2.3.0`   | `0.14.1`, `0.13.0`                                                 | `0.5.8`                |
+| 8.5 (910B)                   | `2.3.0`   | `0.14.1`, `0.13.0`                                                 | `0.5.8`                |
+| 8.5 (310P)                   | `2.3.0`   | `0.14.1`                                                           |                        |
+| 8.3 (A3/910C)                | `2.2.rc1` | `0.12.0`, `0.11.0`                                                 | `0.5.7`, `0.5.6.post2` |
+| 8.3 (910B)                   | `2.2.rc1` | `0.12.0`, `0.11.0`                                                 | `0.5.7`, `0.5.6.post2` |
+| 8.3 (310P)                   | `2.2.rc1` |                                                                    |                        |
+| 8.2 (A3/910C)                | `2.1.rc2` | `0.10.2`, ~~`0.10.1.1`~~                                           | `0.5.2`, `0.5.1.post3` |
+| 8.2 (910B)                   | `2.1.rc2` | `0.10.2`, ~~`0.10.1.1`~~, <br/>`0.10.0`, `0.9.2`, <br/>~~`0.9.1`~~ | `0.5.2`, `0.5.1.post3` |
+| 8.2 (310P)                   | `2.1.rc2` | `0.10.0`, `0.9.2`                                                  |                        |
 
 ### Iluvatar CoreX
 
@@ -77,11 +80,11 @@ The following table lists the supported accelerated backends and their correspon
 > - CUDA 12.6/12.4 supports Compute Capabilities:
     `7.5 8.0+PTX 8.9 9.0+PTX`.
 
-| CUDA Version <br/> (Variant) | vLLM                                        | SGLang                                                    | VoxBox   |
-|------------------------------|---------------------------------------------|-----------------------------------------------------------|----------|
-| 12.9                         | `0.13.0`, `0.12.0`, <br/>`0.11.2`           | `0.5.7`, `0.5.6.post2`                                    |          |
-| 12.8                         | `0.13.0`, `0.12.0`, <br/>`0.11.2`, `0.10.2` | `0.5.7`, `0.5.6.post2`, <br/>`0.5.5.post3`, `0.5.4.post3` | `0.0.21` |
-| 12.6                         | `0.13.0`, `0.12.0`, <br/>`0.11.2`,`0.10.2`  |                                                           | `0.0.21` |
+| CUDA Version <br/> (Variant) | vLLM                                                           | SGLang                                                                      | VoxBox   |
+|------------------------------|----------------------------------------------------------------|-----------------------------------------------------------------------------|----------|
+| 12.9                         | `0.14.1`, **`0.13.0`**, <br/>`0.12.0`, `0.11.2`                | `0.5.8`, `0.5.7`, <br/>`0.5.6.post2`                                        |          |
+| 12.8                         | `0.14.1`, **`0.13.0`**, <br/>`0.12.0`, `0.11.2`, <br/>`0.10.2` | `0.5.8`, `0.5.7`, <br/>`0.5.6.post2`, `0.5.5.post3`, <br/>~~`0.5.4.post3`~~ | `0.0.21` |
+| 12.6                         | `0.14.1`, **`0.13.0`**, <br/>`0.12.0`, `0.11.2`, <br/>`0.10.2` |                                                                             | `0.0.21` |
 
 ### Hygon DTK
 
@@ -89,7 +92,7 @@ The following table lists the supported accelerated backends and their correspon
 |-----------------------------|----------------------------|
 | 25.04                       | `0.11.0`, `0.9.2`, `0.8.5` |
 
-### THead HGGC
+### T-Head HGGC
 
 | HGGC Version <br/> (Variant) | vLLM     | SGLang  |
 |------------------------------|----------|---------|
@@ -97,10 +100,11 @@ The following table lists the supported accelerated backends and their correspon
 
 ### MetaX MACA
 
-| MACA Version <br/> (Variant) | vLLM     |
-|------------------------------|----------|
-| 3.2                          | `0.10.2` |
-| 3.0                          | `0.9.1`  |
+| MACA Version <br/> (Variant) | vLLM     | SGLang  |
+|------------------------------|----------|---------|
+| 3.3                          | `0.11.2` | `0.5.6` |
+| 3.2                          | `0.10.2` |         |
+| 3.0                          | `0.9.1`  |         |
 
 ### MThreads MUSA
 
@@ -118,16 +122,16 @@ The following table lists the supported accelerated backends and their correspon
     `gfx908 gfx90a gfx942 gfx1030 gfx1100`.
 
 > [!WARNING]
-> - ROCm 7.0 vLLM `0.11.2/0.11.0` are reusing the official ROCm 6.4 PyTorch 2.9 wheel package rather than a ROCm
+> - ROCm 7.0 vLLM `0.11.2` are reusing the official ROCm 6.4 PyTorch 2.9 wheel package rather than a ROCm
     7.0 specific PyTorch build. Although supports ROCm 7.0 in vLLM `0.11.2`, `gfx1150/gfx1151` are not supported yet.
 > - ROCm 6.4 vLLM `0.13.0` supports `gfx903 gfx90a gfx942` only.
 > - ROCm 6.4 SGLang supports `gfx942` only.
 > - ROCm 7.0 SGLang supports `gfx950` only.
 
-| ROCm Version <br/> (Variant) | vLLM                                        | SGLang                                     |
-|------------------------------|---------------------------------------------|--------------------------------------------|
-| 7.0                          | `0.13.0`, `0.12.0`, <br/>`0.11.2`           | `0.5.7`, `0.5.6.post2`                     |
-| 6.4                          | `0.13.0`, `0.12.0`, <br/>`0.11.2`, `0.10.2` | `0.5.7`, `0.5.6.post2`, <br/>`0.5.5.post3` |
+| ROCm Version <br/> (Variant) | vLLM                                            | SGLang                                     |
+|------------------------------|-------------------------------------------------|--------------------------------------------|
+| 7.0                          | **`0.13.0`**, `0.12.0`, <br/>`0.11.2`           | `0.5.7`, `0.5.6.post2`                     |
+| 6.4                          | **`0.13.0`**, `0.12.0`, <br/>`0.11.2`, `0.10.2` | `0.5.7`, `0.5.6.post2`, <br/>`0.5.5.post3` |
 
 ## Directory Structure
 

{gpustack_runner-0.1.24.post1 → gpustack_runner-0.1.24.post3}/README.md

@@ -32,14 +32,17 @@ The following table lists the supported accelerated backends and their correspon
     vllm-ascend [#3316](https://github.com/vllm-project/vllm-ascend/issues/3316)
     and [#2795](https://github.com/vllm-project/vllm-ascend/issues/2795).
 
-| CANN Version <br/> (Variant) | MindIE    | vLLM                                                       | SGLang                 |
-|------------------------------|-----------|------------------------------------------------------------|------------------------|
-| 8.3 (A3/910C)                | `2.2.rc1` | `0.13.0`, `0.12.0`, `0.11.0`                               | `0.5.7`, `0.5.6.post2` |
-| 8.3 (910B)                   | `2.2.rc1` | `0.13.0`, `0.12.0`, `0.11.0`                               | `0.5.7`, `0.5.6.post2` |
-| 8.3 (310P)                   | `2.2.rc1` |                                                            |                        |
-| 8.2 (A3/910C)                | `2.1.rc2` | `0.10.2`, `0.10.1.1`                                       | `0.5.2`, `0.5.1.post3` |
-| 8.2 (910B)                   | `2.1.rc2` | `0.10.2`, `0.10.1.1`, <br/>`0.10.0`, `0.9.2`, <br/>`0.9.1` | `0.5.2`, `0.5.1.post3` |
-| 8.2 (310P)                   | `2.1.rc2` | `0.10.0`, `0.9.2`                                          |                        |
+| CANN Version <br/> (Variant) | MindIE    | vLLM                                                               | SGLang                 |
+|------------------------------|-----------|--------------------------------------------------------------------|------------------------|
+| 8.5 (A3/910C)                | `2.3.0`   | `0.14.1`, `0.13.0`                                                 | `0.5.8`                |
+| 8.5 (910B)                   | `2.3.0`   | `0.14.1`, `0.13.0`                                                 | `0.5.8`                |
+| 8.5 (310P)                   | `2.3.0`   | `0.14.1`                                                           |                        |
+| 8.3 (A3/910C)                | `2.2.rc1` | `0.12.0`, `0.11.0`                                                 | `0.5.7`, `0.5.6.post2` |
+| 8.3 (910B)                   | `2.2.rc1` | `0.12.0`, `0.11.0`                                                 | `0.5.7`, `0.5.6.post2` |
+| 8.3 (310P)                   | `2.2.rc1` |                                                                    |                        |
+| 8.2 (A3/910C)                | `2.1.rc2` | `0.10.2`, ~~`0.10.1.1`~~                                           | `0.5.2`, `0.5.1.post3` |
+| 8.2 (910B)                   | `2.1.rc2` | `0.10.2`, ~~`0.10.1.1`~~, <br/>`0.10.0`, `0.9.2`, <br/>~~`0.9.1`~~ | `0.5.2`, `0.5.1.post3` |
+| 8.2 (310P)                   | `2.1.rc2` | `0.10.0`, `0.9.2`                                                  |                        |
 
 ### Iluvatar CoreX
 
@@ -57,11 +60,11 @@ The following table lists the supported accelerated backends and their correspon
 > - CUDA 12.6/12.4 supports Compute Capabilities:
     `7.5 8.0+PTX 8.9 9.0+PTX`.
 
-| CUDA Version <br/> (Variant) | vLLM                                        | SGLang                                                    | VoxBox   |
-|------------------------------|---------------------------------------------|-----------------------------------------------------------|----------|
-| 12.9                         | `0.13.0`, `0.12.0`, <br/>`0.11.2`           | `0.5.7`, `0.5.6.post2`                                    |          |
-| 12.8                         | `0.13.0`, `0.12.0`, <br/>`0.11.2`, `0.10.2` | `0.5.7`, `0.5.6.post2`, <br/>`0.5.5.post3`, `0.5.4.post3` | `0.0.21` |
-| 12.6                         | `0.13.0`, `0.12.0`, <br/>`0.11.2`,`0.10.2`  |                                                           | `0.0.21` |
+| CUDA Version <br/> (Variant) | vLLM                                                           | SGLang                                                                      | VoxBox   |
+|------------------------------|----------------------------------------------------------------|-----------------------------------------------------------------------------|----------|
+| 12.9                         | `0.14.1`, **`0.13.0`**, <br/>`0.12.0`, `0.11.2`                | `0.5.8`, `0.5.7`, <br/>`0.5.6.post2`                                        |          |
+| 12.8                         | `0.14.1`, **`0.13.0`**, <br/>`0.12.0`, `0.11.2`, <br/>`0.10.2` | `0.5.8`, `0.5.7`, <br/>`0.5.6.post2`, `0.5.5.post3`, <br/>~~`0.5.4.post3`~~ | `0.0.21` |
+| 12.6                         | `0.14.1`, **`0.13.0`**, <br/>`0.12.0`, `0.11.2`, <br/>`0.10.2` |                                                                             | `0.0.21` |
 
 ### Hygon DTK
 
@@ -69,7 +72,7 @@ The following table lists the supported accelerated backends and their correspon
 |-----------------------------|----------------------------|
 | 25.04                       | `0.11.0`, `0.9.2`, `0.8.5` |
 
-### THead HGGC
+### T-Head HGGC
 
 | HGGC Version <br/> (Variant) | vLLM     | SGLang  |
 |------------------------------|----------|---------|
@@ -77,10 +80,11 @@ The following table lists the supported accelerated backends and their correspon
 
 ### MetaX MACA
 
-| MACA Version <br/> (Variant) | vLLM     |
-|------------------------------|----------|
-| 3.2                          | `0.10.2` |
-| 3.0                          | `0.9.1`  |
+| MACA Version <br/> (Variant) | vLLM     | SGLang  |
+|------------------------------|----------|---------|
+| 3.3                          | `0.11.2` | `0.5.6` |
+| 3.2                          | `0.10.2` |         |
+| 3.0                          | `0.9.1`  |         |
 
 ### MThreads MUSA
 
@@ -98,16 +102,16 @@ The following table lists the supported accelerated backends and their correspon
     `gfx908 gfx90a gfx942 gfx1030 gfx1100`.
 
 > [!WARNING]
-> - ROCm 7.0 vLLM `0.11.2/0.11.0` are reusing the official ROCm 6.4 PyTorch 2.9 wheel package rather than a ROCm
+> - ROCm 7.0 vLLM `0.11.2` are reusing the official ROCm 6.4 PyTorch 2.9 wheel package rather than a ROCm
     7.0 specific PyTorch build. Although supports ROCm 7.0 in vLLM `0.11.2`, `gfx1150/gfx1151` are not supported yet.
 > - ROCm 6.4 vLLM `0.13.0` supports `gfx903 gfx90a gfx942` only.
 > - ROCm 6.4 SGLang supports `gfx942` only.
 > - ROCm 7.0 SGLang supports `gfx950` only.
 
-| ROCm Version <br/> (Variant) | vLLM                                        | SGLang                                     |
-|------------------------------|---------------------------------------------|--------------------------------------------|
-| 7.0                          | `0.13.0`, `0.12.0`, <br/>`0.11.2`           | `0.5.7`, `0.5.6.post2`                     |
-| 6.4                          | `0.13.0`, `0.12.0`, <br/>`0.11.2`, `0.10.2` | `0.5.7`, `0.5.6.post2`, <br/>`0.5.5.post3` |
+| ROCm Version <br/> (Variant) | vLLM                                            | SGLang                                     |
+|------------------------------|-------------------------------------------------|--------------------------------------------|
+| 7.0                          | **`0.13.0`**, `0.12.0`, <br/>`0.11.2`           | `0.5.7`, `0.5.6.post2`                     |
+| 6.4                          | **`0.13.0`**, `0.12.0`, <br/>`0.11.2`, `0.10.2` | `0.5.7`, `0.5.6.post2`, <br/>`0.5.5.post3` |
 
 ## Directory Structure
 

{gpustack_runner-0.1.24.post1 → gpustack_runner-0.1.24.post3}/gpustack_runner/_version.py

@@ -27,8 +27,8 @@ version_tuple: VERSION_TUPLE
 __commit_id__: COMMIT_ID
 commit_id: COMMIT_ID
 
-__version__ = version = '0.1.24.post1'
-__version_tuple__ = version_tuple = (0, 1, 24, 'post1')
+__version__ = version = '0.1.24.post3'
+__version_tuple__ = version_tuple = (0, 1, 24, 'post3')
 try:
     from ._version_appendix import git_commit
     __commit_id__ = commit_id = git_commit

gpustack_runner-0.1.24.post3/gpustack_runner/_version_appendix.py

@@ -0,0 +1 @@
+git_commit = "dc41ed2"

{gpustack_runner-0.1.24.post1 → gpustack_runner-0.1.24.post3}/gpustack_runner/cmds/images.py

@@ -464,7 +464,7 @@ class SaveImagesSubCommand(SubCommand):
             # Submit tasks
             for task_name, src_img, dst_file, dst_file_relative in saving_tasks:
                 if dst_file.exists():
-                    print(f"{dst_file.name} already exists, skipping save {src_img}.")
+                    print(f"✅ {dst_file} already exists, skipping save {src_img}.")
                     continue
                 dst_file.parent.mkdir(parents=True, exist_ok=True, mode=0o744)
 
@@ -976,7 +976,7 @@ class LoadImagesSubCommand(SubCommand):
         load_parser.add_argument(
             "input",
             nargs=OPTIONAL,
-            help="Input directory to load images (default: current working directory)",
+            help="Input directory to load images from (default: current working directory)",
         )
 
         load_parser.set_defaults(func=LoadImagesSubCommand)