@byteplus/ark-cli-darwin-x64 0.0.0-stage → 1.0.46-prerelease.dc921200a42d
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/LICENSE +201 -0
- package/bin/arkcli-darwin-amd64 +4 -0
- package/manifest.json +43 -0
- package/package.json +20 -4
- package/skills/arkcli-agent/SKILL.md +152 -0
- package/skills/arkcli-agent/references/agent.md +398 -0
- package/skills/arkcli-agent/references/byok.md +65 -0
- package/skills/arkcli-agent/references/context-management.md +42 -0
- package/skills/arkcli-agent/references/debug-export.md +26 -0
- package/skills/arkcli-agent/references/evals.md +178 -0
- package/skills/arkcli-agent/references/events-chat.md +148 -0
- package/skills/arkcli-agent/references/interfaces-gaps.md +52 -0
- package/skills/arkcli-agent/references/mcp-vault.md +111 -0
- package/skills/arkcli-agent/references/model-config.md +46 -0
- package/skills/arkcli-agent/references/self-hosted.md +47 -0
- package/skills/arkcli-agent/references/session-files.md +149 -0
- package/skills/arkcli-agent/references/session-upgrade.md +61 -0
- package/skills/arkcli-agent/references/skills.md +87 -0
- package/skills/arkcli-agent/references/todo-write.md +31 -0
- package/skills/arkcli-api-explorer/SKILL.md +188 -0
- package/skills/arkcli-api-explorer/references/arkcli-api.md +180 -0
- package/skills/arkcli-api-explorer/references/evals.md +176 -0
- package/skills/arkcli-auth/SKILL.md +184 -0
- package/skills/arkcli-auth/references/arkcli-auth-login.md +92 -0
- package/skills/arkcli-auth/references/arkcli-auth-status.md +109 -0
- package/skills/arkcli-auth/references/arkcli-auth-whoami.md +56 -0
- package/skills/arkcli-auth/references/auth-modes.md +78 -0
- package/skills/arkcli-auth/references/evals.md +82 -0
- package/skills/arkcli-auth/references/identity-resolution.md +33 -0
- package/skills/arkcli-auth/references/realname-gate.md +69 -0
- package/skills/arkcli-billing/SKILL.md +122 -0
- package/skills/arkcli-billing/references/arkcli-billing-list.md +259 -0
- package/skills/arkcli-billing/references/evals.md +107 -0
- package/skills/arkcli-chat/SKILL.md +114 -0
- package/skills/arkcli-chat/references/arkcli-chat.md +283 -0
- package/skills/arkcli-chat/references/caching-thinking.md +124 -0
- package/skills/arkcli-chat/references/chat-meta.md +77 -0
- package/skills/arkcli-chat/references/evals.md +34 -0
- package/skills/arkcli-chat/references/stream-events.md +124 -0
- package/skills/arkcli-chat/references/text-format.md +167 -0
- package/skills/arkcli-chat/references/tools.md +119 -0
- package/skills/arkcli-config/SKILL.md +197 -0
- package/skills/arkcli-config/references/arkcli-config-init.md +89 -0
- package/skills/arkcli-config/references/arkcli-config-profile.md +106 -0
- package/skills/arkcli-config/references/evals.md +154 -0
- package/skills/arkcli-connect/SKILL.md +196 -0
- package/skills/arkcli-connect/references/arkcli-connect.md +165 -0
- package/skills/arkcli-connect/references/evals.md +231 -0
- package/skills/arkcli-custommodel/SKILL.md +167 -0
- package/skills/arkcli-custommodel/references/arkcli-custommodel-available-quantizations.md +29 -0
- package/skills/arkcli-custommodel/references/arkcli-custommodel-delete.md +37 -0
- package/skills/arkcli-custommodel/references/arkcli-custommodel-get.md +45 -0
- package/skills/arkcli-custommodel/references/arkcli-custommodel-list.md +65 -0
- package/skills/arkcli-custommodel/references/arkcli-custommodel-quantize.md +59 -0
- package/skills/arkcli-custommodel/references/arkcli-custommodel-update.md +47 -0
- package/skills/arkcli-custommodel/references/arkcli-custommodel-upload.md +64 -0
- package/skills/arkcli-custommodel/references/evals.md +59 -0
- package/skills/arkcli-datasets/SKILL.md +39 -0
- package/skills/arkcli-datasets/references/commands.md +83 -0
- package/skills/arkcli-datasets/references/evals.md +31 -0
- package/skills/arkcli-deploy/SKILL.md +89 -0
- package/skills/arkcli-deploy/references/arkcli-deploy.md +141 -0
- package/skills/arkcli-deploy/references/evals.md +80 -0
- package/skills/arkcli-docs/SKILL.md +453 -0
- package/skills/arkcli-docs/references/commands.md +283 -0
- package/skills/arkcli-docs/references/evals.md +201 -0
- package/skills/arkcli-docs/references/failure-modes.md +85 -0
- package/skills/arkcli-doctor/CONTRIBUTING.md +54 -0
- package/skills/arkcli-doctor/SKILL.md +367 -0
- package/skills/arkcli-doctor/references/error-codes.md +162 -0
- package/skills/arkcli-doctor/references/evals.md +385 -0
- package/skills/arkcli-doctor/references/scope-account.md +94 -0
- package/skills/arkcli-doctor/references/scope-cli.md +88 -0
- package/skills/arkcli-doctor/references/scope-infer-endpoint.md +132 -0
- package/skills/arkcli-doctor/references/scope-metrics.md +157 -0
- package/skills/arkcli-doctor/references/scope-model.md +130 -0
- package/skills/arkcli-doctor/references/verify-origin.md +102 -0
- package/skills/arkcli-gen/SKILL.md +188 -0
- package/skills/arkcli-gen/references/arkcli-gen.md +230 -0
- package/skills/arkcli-gen/references/gen-meta.md +154 -0
- package/skills/arkcli-gen/references/image-stream.md +105 -0
- package/skills/arkcli-helper/SKILL.md +200 -0
- package/skills/arkcli-helper/references/arkcli-helper.md +298 -0
- package/skills/arkcli-helper/references/evals.md +334 -0
- package/skills/arkcli-iam/SKILL.md +46 -0
- package/skills/arkcli-iam/references/arkcli-iam-userid.md +54 -0
- package/skills/arkcli-iam/references/evals.md +24 -0
- package/skills/arkcli-infer-endpoint/SKILL.md +82 -0
- package/skills/arkcli-infer-endpoint/references/arkcli-infer-endpoint-capability-get.md +50 -0
- package/skills/arkcli-infer-endpoint/references/arkcli-infer-endpoint-create.md +121 -0
- package/skills/arkcli-infer-endpoint/references/arkcli-infer-endpoint-delete.md +71 -0
- package/skills/arkcli-infer-endpoint/references/arkcli-infer-endpoint-get.md +43 -0
- package/skills/arkcli-infer-endpoint/references/arkcli-infer-endpoint-list.md +82 -0
- package/skills/arkcli-infer-endpoint/references/arkcli-infer-endpoint-start.md +36 -0
- package/skills/arkcli-infer-endpoint/references/arkcli-infer-endpoint-stop.md +36 -0
- package/skills/arkcli-infer-endpoint/references/arkcli-infer-endpoint-update.md +78 -0
- package/skills/arkcli-infer-endpoint/references/evals.md +24 -0
- package/skills/arkcli-models/SKILL.md +305 -0
- package/skills/arkcli-models/references/arkcli-models-activate.md +103 -0
- package/skills/arkcli-models/references/arkcli-models-get.md +94 -0
- package/skills/arkcli-models/references/arkcli-models-list.md +71 -0
- package/skills/arkcli-models/references/arkcli-models-scenario-table.md +75 -0
- package/skills/arkcli-models/references/arkcli-models-search.md +170 -0
- package/skills/arkcli-models/references/evals.md +57 -0
- package/skills/arkcli-onboard/SKILL.md +169 -0
- package/skills/arkcli-onboard/references/evals.md +156 -0
- package/skills/arkcli-plans/SKILL.md +135 -0
- package/skills/arkcli-plans/references/arkcli-plans-buy.md +125 -0
- package/skills/arkcli-plans/references/arkcli-plans-get.md +84 -0
- package/skills/arkcli-plans/references/arkcli-plans-model-apply.md +58 -0
- package/skills/arkcli-plans/references/arkcli-plans-model-list.md +114 -0
- package/skills/arkcli-plans/references/arkcli-plans-renew.md +125 -0
- package/skills/arkcli-plans/references/arkcli-plans-team-rotate-apikey.md +61 -0
- package/skills/arkcli-plans/references/arkcli-plans-team-seat-assign.md +147 -0
- package/skills/arkcli-plans/references/arkcli-plans-team-seat-list.md +100 -0
- package/skills/arkcli-plans/references/evals.md +178 -0
- package/skills/arkcli-pricing/SKILL.md +120 -0
- package/skills/arkcli-pricing/references/arkcli-pricing-models.md +258 -0
- package/skills/arkcli-pricing/references/arkcli-pricing-plans.md +139 -0
- package/skills/arkcli-profile/SKILL.md +168 -0
- package/skills/arkcli-profile/references/arkcli-profile-create.md +92 -0
- package/skills/arkcli-profile/references/arkcli-profile-keys.md +135 -0
- package/skills/arkcli-profile/references/arkcli-profile-set-default.md +81 -0
- package/skills/arkcli-profile/references/evals.md +93 -0
- package/skills/arkcli-resources/SKILL.md +112 -0
- package/skills/arkcli-resources/references/arkcli-resources-list.md +105 -0
- package/skills/arkcli-shared/SKILL.md +209 -0
- package/skills/arkcli-shared/references/global-flags.md +77 -0
- package/skills/arkcli-shared/references/profile-defaults.md +35 -0
- package/skills/arkcli-shared/references/troubleshooting.md +49 -0
- package/skills/arkcli-shared/references/update.md +117 -0
- package/skills/arkcli-train-finetune/SKILL.md +109 -0
- package/skills/arkcli-train-finetune/references/create.md +274 -0
- package/skills/arkcli-train-finetune/references/download.md +50 -0
- package/skills/arkcli-train-finetune/references/evals.md +59 -0
- package/skills/arkcli-train-finetune/references/export-deploy.md +179 -0
- package/skills/arkcli-train-finetune/references/list.md +79 -0
- package/skills/arkcli-train-finetune/references/manage.md +140 -0
- package/skills/arkcli-understand/SKILL.md +105 -0
- package/skills/arkcli-understand/references/arkcli-understand.md +249 -0
- package/skills/arkcli-understand/references/evals.md +109 -0
- package/skills/arkcli-understand/references/sub-skills.md +137 -0
- package/skills/arkcli-usage/SKILL.md +123 -0
- package/skills/arkcli-usage/references/arkcli-usage-balance.md +196 -0
- package/skills/arkcli-usage/references/arkcli-usage-plan.md +153 -0
- package/skills/arkcli-usage/references/arkcli-usage-seats.md +199 -0
- package/skills/arkcli-usage/references/arkcli-usage-stats.md +160 -0
- package/README.md +0 -3
|
@@ -0,0 +1,121 @@
|
|
|
1
|
+
# arkcli infer endpoint create
|
|
2
|
+
|
|
3
|
+
Create an inference endpoint.
|
|
4
|
+
|
|
5
|
+
## Usage
|
|
6
|
+
|
|
7
|
+
```bash
|
|
8
|
+
arkcli infer endpoint create [flags]
|
|
9
|
+
```
|
|
10
|
+
|
|
11
|
+
## Flags
|
|
12
|
+
|
|
13
|
+
| Flag | Type | Description | Required |
|
|
14
|
+
|------|------|-------------|----------|
|
|
15
|
+
| `--model` | string | Model ID (foundation model or custom model) | Yes |
|
|
16
|
+
| `--name` | string | Endpoint name | Yes |
|
|
17
|
+
| `--billing-method` | string | Billing / inference method. Currently supports only `token`. If omitted, the default behavior is used. | No |
|
|
18
|
+
| `--rpm` | int | Rate limit RPM | No |
|
|
19
|
+
| `--tpm` | int | Rate limit TPM | No |
|
|
20
|
+
| `--dry-run` | bool | Emit the local create plan without model discovery, activation, or create API calls | No |
|
|
21
|
+
| `-h`, `--help` | | help for create | No |
|
|
22
|
+
|
|
23
|
+
Model resolution and activation checks require online state, so Client Preview
|
|
24
|
+
uses `fidelity=partial` and lists them under `unresolved`. It is not server
|
|
25
|
+
validation and does not prove that the model is activated or the request will
|
|
26
|
+
be accepted.
|
|
27
|
+
|
|
28
|
+
## Global Flags
|
|
29
|
+
|
|
30
|
+
| Flag | Type | Description |
|
|
31
|
+
|------|------|-------------|
|
|
32
|
+
| `--api-key` | string | ARK API key override |
|
|
33
|
+
| `--base-url` | string | Custom API base URL |
|
|
34
|
+
| `--debug` | | Print request and response debug details to stderr |
|
|
35
|
+
| `--format` | string | Output format: json (default "json") |
|
|
36
|
+
| `--page-all` | | Automatically fetch all pages when supported |
|
|
37
|
+
| `--page-delay` | int | Delay in milliseconds between pages (default 200) |
|
|
38
|
+
| `--page-limit` | int | Maximum pages to fetch with --page-all (default 10) |
|
|
39
|
+
| `--profile` | string | Active config profile |
|
|
40
|
+
| `--transform` | string | Transform output with a GJSON-style path expression |
|
|
41
|
+
|
|
42
|
+
## Examples
|
|
43
|
+
|
|
44
|
+
```bash
|
|
45
|
+
# Create an Endpoint
|
|
46
|
+
arkcli infer endpoint create \
|
|
47
|
+
--model dola-seed-2-1-turbo-260628 \
|
|
48
|
+
--name my-endpoint
|
|
49
|
+
|
|
50
|
+
# Explicitly request the token inference method (currently keeps the same create payload as when omitted, but first checks whether the model supports token)
|
|
51
|
+
arkcli infer endpoint create \
|
|
52
|
+
--model dola-seed-2-1-turbo-260628 \
|
|
53
|
+
--name my-token-endpoint \
|
|
54
|
+
--billing-method token
|
|
55
|
+
|
|
56
|
+
# Typical response
|
|
57
|
+
{
|
|
58
|
+
"Id": "ep-20260421180049-ngwkm"
|
|
59
|
+
}
|
|
60
|
+
|
|
61
|
+
# Extract only the Id for reuse by subsequent commands
|
|
62
|
+
endpoint_id=$(arkcli infer endpoint create \
|
|
63
|
+
--model dola-seed-2-1-turbo-260628 \
|
|
64
|
+
--name my-endpoint \
|
|
65
|
+
--transform Id)
|
|
66
|
+
```
|
|
67
|
+
|
|
68
|
+
## Return value
|
|
69
|
+
|
|
70
|
+
After creation succeeds, the command returns the `Id` of the new Endpoint. Example:
|
|
71
|
+
|
|
72
|
+
```json
|
|
73
|
+
{
|
|
74
|
+
"Id": "ep-20260421180049-ngwkm"
|
|
75
|
+
}
|
|
76
|
+
```
|
|
77
|
+
|
|
78
|
+
This `Id` is the primary entry point for subsequent operations.
|
|
79
|
+
|
|
80
|
+
## Next steps after creation
|
|
81
|
+
|
|
82
|
+
### 1. View details
|
|
83
|
+
|
|
84
|
+
```bash
|
|
85
|
+
arkcli infer endpoint get "$endpoint_id"
|
|
86
|
+
```
|
|
87
|
+
|
|
88
|
+
### 2. Manage the lifecycle
|
|
89
|
+
|
|
90
|
+
```bash
|
|
91
|
+
arkcli infer endpoint stop "$endpoint_id"
|
|
92
|
+
arkcli infer endpoint start "$endpoint_id"
|
|
93
|
+
```
|
|
94
|
+
|
|
95
|
+
### 3. Do not call `+deploy` again
|
|
96
|
+
|
|
97
|
+
If you already obtained an `Id` through `infer endpoint create`, the Endpoint has already been created.
|
|
98
|
+
|
|
99
|
+
At this point, do not run:
|
|
100
|
+
|
|
101
|
+
```bash
|
|
102
|
+
arkcli +deploy ...
|
|
103
|
+
```
|
|
104
|
+
|
|
105
|
+
Because `+deploy` is itself a "create Endpoint" workflow. It creates a new resource instead of reusing the `Id` that was just created.
|
|
106
|
+
|
|
107
|
+
## Notes
|
|
108
|
+
|
|
109
|
+
- `infer endpoint create` is oriented toward standard resource creation.
|
|
110
|
+
- `+deploy` is oriented toward the task workflow of "create Endpoint + model activation / reuse check / profile sync".
|
|
111
|
+
- Both commands create Endpoints and should not be executed sequentially as duplicate steps.
|
|
112
|
+
- Voice models (TTS / ASR / dubbing / podcast / voice / real-time voice interaction) cannot currently use this command to create Endpoints. Voice models are not supported.
|
|
113
|
+
- `--billing-method` currently has only one enum value: `token`. Passing `token` does not add extra fields to the CreateEndpoint request. It only checks before creation whether the corresponding model supports token-based inference.
|
|
114
|
+
- Foundation model support methods come from `ArkModels.data[].Features.ShareService`. For custom models, prefer the deployable version's `EndpointSupportedMethods.ShareService`, and fall back to `AvailableDeploymentTypes=Shared` when necessary.
|
|
115
|
+
|
|
116
|
+
## References
|
|
117
|
+
|
|
118
|
+
- [arkcli-infer-endpoint](../SKILL.md) -- infer endpoint capability overview
|
|
119
|
+
- [arkcli-infer-endpoint-get](arkcli-infer-endpoint-get.md) -- View Endpoint details
|
|
120
|
+
- [arkcli-infer-endpoint-start](arkcli-infer-endpoint-start.md) -- Start an Endpoint
|
|
121
|
+
- [arkcli-infer-endpoint-stop](arkcli-infer-endpoint-stop.md) -- Stop an Endpoint
|
|
@@ -0,0 +1,71 @@
|
|
|
1
|
+
# arkcli infer endpoint delete
|
|
2
|
+
|
|
3
|
+
Delete an inference endpoint (irreversible)
|
|
4
|
+
|
|
5
|
+
## Usage
|
|
6
|
+
|
|
7
|
+
```bash
|
|
8
|
+
arkcli infer endpoint delete <endpoint-id> [flags]
|
|
9
|
+
```
|
|
10
|
+
|
|
11
|
+
## Arguments
|
|
12
|
+
|
|
13
|
+
| Argument | Description | Required |
|
|
14
|
+
|----------|-------------|----------|
|
|
15
|
+
| `<endpoint-id>` | The ID of the endpoint to delete | Yes |
|
|
16
|
+
|
|
17
|
+
## Flags
|
|
18
|
+
|
|
19
|
+
| Flag | Type | Description | Required |
|
|
20
|
+
|------|------|-------------|----------|
|
|
21
|
+
| `--dry-run` | bool | Emit the local `DeleteEndpoint` Client Preview without reading or deleting the endpoint | No |
|
|
22
|
+
| `--yes` | bool | Skip the interactive Y/N prompt (TTY only). **Non-interactive mode: this flag does NOT authorize deletion** — set `ARKCLI_ALLOW_HEADLESS_DELETE=1` instead. | No |
|
|
23
|
+
| `-h`, `--help` | | help for delete | No |
|
|
24
|
+
|
|
25
|
+
## Confirmation mechanism (high risk, must read)
|
|
26
|
+
|
|
27
|
+
Deletion is irreversible. `infer endpoint delete` uses a **three-branch confirmation gate**:
|
|
28
|
+
|
|
29
|
+
| Environment | Behavior |
|
|
30
|
+
|------|------|
|
|
31
|
+
| Interactive terminal (TTY) | Shows a strong warning + `[y/N]`. The command executes only when the user enters `y`. `--yes` skips the prompt and counts as confirmation. |
|
|
32
|
+
| Non-interactive (agent / CI / pipeline) + `ARKCLI_ALLOW_HEADLESS_DELETE=1` | Allows the operation after printing an audit line (for true unattended automation). |
|
|
33
|
+
| Non-interactive + env not set | **hard-refuse** (`requires_headless_gate`). `--yes` is ignored here. |
|
|
34
|
+
|
|
35
|
+
Design intent: any agent can reflexively add `--yes`, but an agent's stdin is not a real TTY. Therefore, "real TTY or explicit env" is a hard gate that the agent cannot fabricate, preventing agents from silently approving deletion on behalf of the user with `--yes`. This aligns with the `ARKCLI_ALLOW_HEADLESS_ACTIVATION` pattern enabled for `infer endpoint create`.
|
|
36
|
+
|
|
37
|
+
### Notes for agent calls
|
|
38
|
+
|
|
39
|
+
When agents (Claude Code / OpenCode, and others) call `infer endpoint delete` through a skill, they run in a non-interactive environment:
|
|
40
|
+
|
|
41
|
+
- **hard-refuse by default**, even if `--yes` is provided.
|
|
42
|
+
- To delete in an agent / CI environment, the env must be set explicitly:
|
|
43
|
+
|
|
44
|
+
```bash
|
|
45
|
+
ARKCLI_ALLOW_HEADLESS_DELETE=1 arkcli infer endpoint delete <id> --yes
|
|
46
|
+
```
|
|
47
|
+
|
|
48
|
+
- In an interactive human terminal, run `arkcli infer endpoint delete <id>` directly and confirm as prompted.
|
|
49
|
+
|
|
50
|
+
`--dry-run` emits the local `DeleteEndpoint` request plan. It calls neither
|
|
51
|
+
`GetEndpoint` nor `DeleteEndpoint` and does not enter the confirmation gate.
|
|
52
|
+
The plan does not prove that the endpoint exists, is deletable, or will be
|
|
53
|
+
accepted by the server.
|
|
54
|
+
|
|
55
|
+
### Recommendation before deletion
|
|
56
|
+
|
|
57
|
+
If the endpoint is in the `Running` state, some scenarios require `stop` before `delete`. When the status does not allow deletion, the backend returns `OperationDenied.EndpointStatus`, and arkcli translates it into "endpoint status does not allow this operation" and suggests using `infer endpoint get <id>` to check the status.
|
|
58
|
+
|
|
59
|
+
## Global Flags
|
|
60
|
+
|
|
61
|
+
| Flag | Type | Description |
|
|
62
|
+
|------|------|-------------|
|
|
63
|
+
| `--api-key` | string | ARK API key override |
|
|
64
|
+
| `--base-url` | string | Custom API base URL |
|
|
65
|
+
| `--debug` | | Print request and response debug details to stderr |
|
|
66
|
+
| `--format` | string | Output format: json (default "json") |
|
|
67
|
+
| `--page-all` | | Automatically fetch all pages when supported |
|
|
68
|
+
| `--page-delay` | int | Delay in milliseconds between pages (default 200) |
|
|
69
|
+
| `--page-limit` | int | Maximum pages to fetch with --page-all (default 10) |
|
|
70
|
+
| `--profile` | string | Active config profile |
|
|
71
|
+
| `--transform` | string | Transform output with a GJSON-style path expression |
|
|
@@ -0,0 +1,43 @@
|
|
|
1
|
+
# arkcli infer endpoint get
|
|
2
|
+
|
|
3
|
+
Get inference endpoint details
|
|
4
|
+
|
|
5
|
+
## Diagnose from evidence
|
|
6
|
+
|
|
7
|
+
- With an exact Endpoint ID, call `get` directly. Preserve the entire ID, including `ep-m-`; never invent a suffix or rewrite its prefix. Record actual status, reason, model binding, scope and limits. Use `resources resolve` for ambiguous bindings; a custom model's base-model lineage is not its bound identity.
|
|
8
|
+
- Keep the original identity, region, base URL, request time, error code and RequestId. Redact credentials; do not rotate keys, change profiles or widen permissions as a diagnostic shortcut. A 401 requires checking credential shape/validity; a 403 requires checking actual resource access and scope; a 404 requires checking the exact ID and API route. None alone proves a specific cause.
|
|
9
|
+
- `Running` is control-plane state, not successful inference. Endpoint usage is aggregated usage, not a single-request error rate or trace. Use Doctor for supported metrics and state missing data or aggregation delay explicitly.
|
|
10
|
+
- Only run a minimal real inference when authorized, using the model's supported API and original input modality. For text, use `+chat --model <endpoint-id>`, not `--endpoint`. A text-only probe cannot prove image input works. Without a real call, report the data plane as unverified.
|
|
11
|
+
- For 500 errors, inspect API/modality compatibility, parameters and service evidence without assuming every vision model supports embeddings or blaming the network. For ClosedEndpoint, read the status first; starting or rebuilding is a separate authorized write.
|
|
12
|
+
|
|
13
|
+
## Usage
|
|
14
|
+
|
|
15
|
+
```bash
|
|
16
|
+
arkcli infer endpoint get <endpoint-id> [flags]
|
|
17
|
+
```
|
|
18
|
+
|
|
19
|
+
## Arguments
|
|
20
|
+
|
|
21
|
+
| Argument | Description | Required |
|
|
22
|
+
|----------|-------------|----------|
|
|
23
|
+
| `<endpoint-id>` | The ID of the endpoint to get | Yes |
|
|
24
|
+
|
|
25
|
+
## Flags
|
|
26
|
+
|
|
27
|
+
| Flag | Type | Description | Required |
|
|
28
|
+
|------|------|-------------|----------|
|
|
29
|
+
| `-h`, `--help` | | help for get | No |
|
|
30
|
+
|
|
31
|
+
## Global Flags
|
|
32
|
+
|
|
33
|
+
| Flag | Type | Description |
|
|
34
|
+
|------|------|-------------|
|
|
35
|
+
| `--api-key` | string | ARK API key override |
|
|
36
|
+
| `--base-url` | string | Custom API base URL |
|
|
37
|
+
| `--debug` | | Print request and response debug details to stderr |
|
|
38
|
+
| `--format` | string | Output format: json (default "json") |
|
|
39
|
+
| `--page-all` | | Automatically fetch all pages when supported |
|
|
40
|
+
| `--page-delay` | int | Delay in milliseconds between pages (default 200) |
|
|
41
|
+
| `--page-limit` | int | Maximum pages to fetch with --page-all (default 10) |
|
|
42
|
+
| `--profile` | string | Active config profile |
|
|
43
|
+
| `--transform` | string | Transform output with a GJSON-style path expression |
|
|
@@ -0,0 +1,82 @@
|
|
|
1
|
+
# arkcli infer endpoint list
|
|
2
|
+
|
|
3
|
+
List inference endpoints
|
|
4
|
+
|
|
5
|
+
## Inventory and export
|
|
6
|
+
|
|
7
|
+
- Preserve the requested identity and filters. An empty personal query does not authorize an account-wide query. For an explicitly account-wide running inventory, use `--status Running --page-all --page-size 100`.
|
|
8
|
+
- Parse complete stdout separately from stderr. The array is `Items`, not `items`; check pagination limits and warnings before calling the inventory complete. Never use `head` as a completeness check.
|
|
9
|
+
- Include the exact ID, name, actual bound model, status, creation time and description. Fetch per-Endpoint details only for requested fields absent from the list; distinguish missing values from zero.
|
|
10
|
+
- Fetch details serially by default and respect API QPS. Record partial failures individually; do not mix `2>&1` into JSON or claim full success after failures. Quote IDs as arguments rather than inserting returned values into shell source or file paths.
|
|
11
|
+
- Preserve raw timestamps, label the display timezone and convert offsets only once. Report query scope, filters, count, failures and completeness alongside the export.
|
|
12
|
+
|
|
13
|
+
## Usage
|
|
14
|
+
|
|
15
|
+
```bash
|
|
16
|
+
arkcli infer endpoint list [flags]
|
|
17
|
+
```
|
|
18
|
+
|
|
19
|
+
## Flags
|
|
20
|
+
|
|
21
|
+
| Flag | Type | Description | Required |
|
|
22
|
+
|------|------|-------------|----------|
|
|
23
|
+
| `--format` | string | Output format: table \| json | No |
|
|
24
|
+
| `--model` | string | Filter by model: a custom model ID (`cm-...`) or a foundation model name (`doubao-seedream-5-0-pro`, or the dotted DisplayName form `doubao-seedream-5.0-pro`) | No |
|
|
25
|
+
| `--status` | string | Filter by endpoint status | No |
|
|
26
|
+
| `--mine` | bool | List only endpoints created by the current SSO sub-user (server-side `sys:ark:createdBy` tag filtering) | No |
|
|
27
|
+
| `--page-number` | int | Page number (>=1) | No |
|
|
28
|
+
| `--page-size` | int | Page size | No |
|
|
29
|
+
| `-h`, `--help` | | help for list | No |
|
|
30
|
+
|
|
31
|
+
## `--model` semantics
|
|
32
|
+
|
|
33
|
+
`--model` accepts two kinds of value, dispatched by the CLI:
|
|
34
|
+
|
|
35
|
+
- `cm-` prefix → filtered as a **custom model ID** (`Filter.CustomModelIds`, case-sensitive).
|
|
36
|
+
- anything else → filtered as a **foundation model name**: the value is normalized to
|
|
37
|
+
the connector Name first, then sent as `Filter.FoundationModelNames` (exact match
|
|
38
|
+
server-side).
|
|
39
|
+
|
|
40
|
+
Normalization does exactly two things and **never rewrites characters**: an exact Name
|
|
41
|
+
match, then a case-insensitive exact DisplayName match. DisplayName is not always the
|
|
42
|
+
same shape as Name — for example the model `doubao-seedream-5-0` has DisplayName
|
|
43
|
+
`Doubao-Seedream-5.0-lite` (the display name carries `lite`, the connector Name does
|
|
44
|
+
not), so replacing dots with hyphens would produce a name that does not exist.
|
|
45
|
+
|
|
46
|
+
If the value is neither a `cm-` ID nor a match for any foundation model name, the
|
|
47
|
+
command **exits non-zero** with a hint instead of returning an empty list. Do not read
|
|
48
|
+
an empty result as "this account has no endpoint for that model".
|
|
49
|
+
|
|
50
|
+
```bash
|
|
51
|
+
arkcli infer endpoint list --model doubao-seedream-5-0-pro --page-all --page-size 100 --format json
|
|
52
|
+
```
|
|
53
|
+
|
|
54
|
+
## Semantics of "my endpoints" (overrides shared default)
|
|
55
|
+
|
|
56
|
+
This command **has built-in `--mine` support**. According to the "decision order" in [`../../arkcli-auth/references/identity-resolution.md`](../../arkcli-auth/references/identity-resolution.md), you MUST **prefer** this option and must not fall back to client-side filtering with `whoami + jq`.
|
|
57
|
+
|
|
58
|
+
```bash
|
|
59
|
+
arkcli infer endpoint list --mine --page-all --page-size 100 --page-delay 800 --format json
|
|
60
|
+
```
|
|
61
|
+
|
|
62
|
+
Behavior:
|
|
63
|
+
|
|
64
|
+
- At the shortcut layer, `--mine` combines the current `cfg.UserID` / `cfg.UserName` into `IAMUser/<UserID>/<UserName>` and sends it to `ListEndpoints` as `TagFilters.{Key: "sys:ark:createdBy", Values: [...]}`.
|
|
65
|
+
- It can be freely combined with `--status` / `--model` / `--page-*` (for example, `--mine --status Running`).
|
|
66
|
+
- It is available only for **SSO sub-user** login state. Other states **fail directly** and do not silently degrade:
|
|
67
|
+
- Non-SSO (AK/SK / APIKey): `--mine requires an SSO sub-user login`; run `arkcli auth login` to re-establish BytePlus identity.
|
|
68
|
+
- SSO root: `--mine is not supported for root logins`; guide the user to log in with a sub-user.
|
|
69
|
+
- SSO with missing UserID/UserName claims: guide the user to log in again to refresh identity.
|
|
70
|
+
|
|
71
|
+
## Global Flags
|
|
72
|
+
|
|
73
|
+
| Flag | Type | Description |
|
|
74
|
+
|------|------|-------------|
|
|
75
|
+
| `--api-key` | string | ARK API key override |
|
|
76
|
+
| `--base-url` | string | Custom API base URL |
|
|
77
|
+
| `--debug` | | Print request and response debug details to stderr |
|
|
78
|
+
| `--page-all` | | Automatically fetch all pages when supported |
|
|
79
|
+
| `--page-delay` | int | Delay in milliseconds between pages (default 200) |
|
|
80
|
+
| `--page-limit` | int | Maximum pages to fetch with --page-all (default 10) |
|
|
81
|
+
| `--profile` | string | Active config profile |
|
|
82
|
+
| `--transform` | string | Transform output with a GJSON-style path expression |
|
|
@@ -0,0 +1,36 @@
|
|
|
1
|
+
# arkcli infer endpoint start
|
|
2
|
+
|
|
3
|
+
Start an inference endpoint
|
|
4
|
+
|
|
5
|
+
## Usage
|
|
6
|
+
|
|
7
|
+
```bash
|
|
8
|
+
arkcli infer endpoint start <endpoint-id> [flags]
|
|
9
|
+
```
|
|
10
|
+
|
|
11
|
+
## Arguments
|
|
12
|
+
|
|
13
|
+
| Argument | Description | Required |
|
|
14
|
+
|----------|-------------|----------|
|
|
15
|
+
| `<endpoint-id>` | The ID of the endpoint to start | Yes |
|
|
16
|
+
|
|
17
|
+
## Flags
|
|
18
|
+
|
|
19
|
+
| Flag | Type | Description | Required |
|
|
20
|
+
|------|------|-------------|----------|
|
|
21
|
+
| `--dry-run` | bool | Emit a local `StartEndpoint` Client Preview without calling the API | No |
|
|
22
|
+
| `-h`, `--help` | | help for start | No |
|
|
23
|
+
|
|
24
|
+
## Global Flags
|
|
25
|
+
|
|
26
|
+
| Flag | Type | Description |
|
|
27
|
+
|------|------|-------------|
|
|
28
|
+
| `--api-key` | string | ARK API key override |
|
|
29
|
+
| `--base-url` | string | Custom API base URL |
|
|
30
|
+
| `--debug` | | Print request and response debug details to stderr |
|
|
31
|
+
| `--format` | string | Output format: json (default "json") |
|
|
32
|
+
| `--page-all` | | Automatically fetch all pages when supported |
|
|
33
|
+
| `--page-delay` | int | Delay in milliseconds between pages (default 200) |
|
|
34
|
+
| `--page-limit` | int | Maximum pages to fetch with --page-all (default 10) |
|
|
35
|
+
| `--profile` | string | Active config profile |
|
|
36
|
+
| `--transform` | string | Transform output with a GJSON-style path expression |
|
|
@@ -0,0 +1,36 @@
|
|
|
1
|
+
# arkcli infer endpoint stop
|
|
2
|
+
|
|
3
|
+
Stop an inference endpoint
|
|
4
|
+
|
|
5
|
+
## Usage
|
|
6
|
+
|
|
7
|
+
```bash
|
|
8
|
+
arkcli infer endpoint stop <endpoint-id> [flags]
|
|
9
|
+
```
|
|
10
|
+
|
|
11
|
+
## Arguments
|
|
12
|
+
|
|
13
|
+
| Argument | Description | Required |
|
|
14
|
+
|----------|-------------|----------|
|
|
15
|
+
| `<endpoint-id>` | The ID of the endpoint to stop | Yes |
|
|
16
|
+
|
|
17
|
+
## Flags
|
|
18
|
+
|
|
19
|
+
| Flag | Type | Description | Required |
|
|
20
|
+
|------|------|-------------|----------|
|
|
21
|
+
| `--dry-run` | bool | Emit a local `StopEndpoint` Client Preview without calling the API | No |
|
|
22
|
+
| `-h`, `--help` | | help for stop | No |
|
|
23
|
+
|
|
24
|
+
## Global Flags
|
|
25
|
+
|
|
26
|
+
| Flag | Type | Description |
|
|
27
|
+
|------|------|-------------|
|
|
28
|
+
| `--api-key` | string | ARK API key override |
|
|
29
|
+
| `--base-url` | string | Custom API base URL |
|
|
30
|
+
| `--debug` | | Print request and response debug details to stderr |
|
|
31
|
+
| `--format` | string | Output format: json (default "json") |
|
|
32
|
+
| `--page-all` | | Automatically fetch all pages when supported |
|
|
33
|
+
| `--page-delay` | int | Delay in milliseconds between pages (default 200) |
|
|
34
|
+
| `--page-limit` | int | Maximum pages to fetch with --page-all (default 10) |
|
|
35
|
+
| `--profile` | string | Active config profile |
|
|
36
|
+
| `--transform` | string | Transform output with a GJSON-style path expression |
|
|
@@ -0,0 +1,78 @@
|
|
|
1
|
+
# arkcli infer endpoint update
|
|
2
|
+
|
|
3
|
+
Update an inference endpoint (name / description / rate limits)
|
|
4
|
+
|
|
5
|
+
## Usage
|
|
6
|
+
|
|
7
|
+
```bash
|
|
8
|
+
arkcli infer endpoint update <endpoint-id> [flags]
|
|
9
|
+
```
|
|
10
|
+
|
|
11
|
+
At least one of `--name`, `--description`, `--rpm`+`--tpm`, or any `--cg-*` option must be provided. Otherwise, the command reports "nothing to update" and does not send a request.
|
|
12
|
+
|
|
13
|
+
## Arguments
|
|
14
|
+
|
|
15
|
+
| Argument | Description | Required |
|
|
16
|
+
|----------|-------------|----------|
|
|
17
|
+
| `<endpoint-id>` | The ID of the endpoint to update | Yes |
|
|
18
|
+
|
|
19
|
+
## Flags
|
|
20
|
+
|
|
21
|
+
| Flag | Type | Description | Required |
|
|
22
|
+
|------|------|-------------|----------|
|
|
23
|
+
| `--name` | string | New endpoint name | No |
|
|
24
|
+
| `--description` | string | New endpoint description (use empty string `""` to clear) | No |
|
|
25
|
+
| `--rpm` | int | Rate limit: requests per minute (must be paired with `--tpm`) | No |
|
|
26
|
+
| `--tpm` | int | Rate limit: tokens per minute (must be paired with `--rpm`) | No |
|
|
27
|
+
| `--cg-concurrent-requests` | int | ContentGeneration: max concurrent requests (image-generation endpoints) | No |
|
|
28
|
+
| `--cg-create-task-rpm` | int | ContentGeneration: CreateTask RPM (image-generation endpoints) | No |
|
|
29
|
+
| `--dry-run` | bool | Emit a local `UpdateEndpoint` Client Preview without calling the API | No |
|
|
30
|
+
| `-h`, `--help` | | help for update | No |
|
|
31
|
+
|
|
32
|
+
## Global Flags
|
|
33
|
+
|
|
34
|
+
| Flag | Type | Description |
|
|
35
|
+
|------|------|-------------|
|
|
36
|
+
| `--api-key` | string | ARK API key override |
|
|
37
|
+
| `--base-url` | string | Custom API base URL |
|
|
38
|
+
| `--debug` | | Print request and response debug details to stderr |
|
|
39
|
+
| `--format` | string | Output format: json (default "json") |
|
|
40
|
+
| `--page-all` | | Automatically fetch all pages when supported |
|
|
41
|
+
| `--page-delay` | int | Delay in milliseconds between pages (default 200) |
|
|
42
|
+
| `--page-limit` | int | Maximum pages to fetch with --page-all (default 10) |
|
|
43
|
+
| `--profile` | string | Active config profile |
|
|
44
|
+
| `--transform` | string | Transform output with a GJSON-style path expression |
|
|
45
|
+
|
|
46
|
+
## Examples
|
|
47
|
+
|
|
48
|
+
Rename only:
|
|
49
|
+
|
|
50
|
+
```bash
|
|
51
|
+
arkcli infer endpoint update ep-20260428194457-p8b47 --name seed-2-1-turbo-demo-123
|
|
52
|
+
```
|
|
53
|
+
|
|
54
|
+
Clear the description:
|
|
55
|
+
|
|
56
|
+
```bash
|
|
57
|
+
arkcli infer endpoint update ep-20260428194457-p8b47 --description ""
|
|
58
|
+
```
|
|
59
|
+
|
|
60
|
+
Adjust rate limits (`--rpm` and `--tpm` must be provided together):
|
|
61
|
+
|
|
62
|
+
```bash
|
|
63
|
+
arkcli infer endpoint update ep-20260428194457-p8b47 --rpm 60 --tpm 100000
|
|
64
|
+
```
|
|
65
|
+
|
|
66
|
+
Adjust content generation parameters for image-generation endpoints (valid only for image-generation scenarios):
|
|
67
|
+
|
|
68
|
+
```bash
|
|
69
|
+
arkcli infer endpoint update ep-20260507230659-skvgn \
|
|
70
|
+
--cg-concurrent-requests 10 \
|
|
71
|
+
--cg-create-task-rpm 60
|
|
72
|
+
```
|
|
73
|
+
|
|
74
|
+
Local preview (does not send a request):
|
|
75
|
+
|
|
76
|
+
```bash
|
|
77
|
+
arkcli infer endpoint update ep-20260428194457-p8b47 --name foo --dry-run
|
|
78
|
+
```
|
|
@@ -0,0 +1,24 @@
|
|
|
1
|
+
# arkcli-infer-endpoint evaluation cases
|
|
2
|
+
|
|
3
|
+
## Routing goals
|
|
4
|
+
|
|
5
|
+
- Deployment-form questions must route to `arkcli-infer-endpoint`, even when the prompt contains the generic word "capability".
|
|
6
|
+
- Foundation models use `--model` plus `--version`; custom models use `--custom-model-id`.
|
|
7
|
+
- Marketplace metadata commands must not substitute for the authoritative deployment-method query.
|
|
8
|
+
|
|
9
|
+
## Regression cases
|
|
10
|
+
|
|
11
|
+
| case | prompt | expected |
|
|
12
|
+
|---|---|---|
|
|
13
|
+
| `endpoint-capability-foundation` | Which deployment forms does `dola-seed-2-1-turbo` version `260628` support, such as shared service, batch, PTU, scale tier, or fallback? | Load `arkcli-infer-endpoint` and run `arkcli infer endpoint capability get --model dola-seed-2-1-turbo --version 260628 --format json`. |
|
|
14
|
+
| `endpoint-capability-custom` | Can custom model `cm-123` use PTU or shared service? | Run `arkcli infer endpoint capability get --custom-model-id cm-123 --format json`. |
|
|
15
|
+
| `endpoint-capability-read-only` | Check whether this model is deployable, but do not create anything. | Run only the capability query; do not run `+deploy` or `infer endpoint create`. |
|
|
16
|
+
| `endpoint-capability-no-models-fallback` | Tell me the supported inference deployment methods. | Do not use `models get`, `models search`, or Raw API Explorer as a replacement. |
|
|
17
|
+
|
|
18
|
+
## Key scoring points
|
|
19
|
+
|
|
20
|
+
- Must route to `arkcli-infer-endpoint`.
|
|
21
|
+
- Must execute `arkcli infer endpoint capability get`.
|
|
22
|
+
- Must read `supported_methods` and the full `capabilities` map.
|
|
23
|
+
- Must not infer deployment support from model name, modality, or another product.
|
|
24
|
+
- Must not mutate an Endpoint during a capability-only request.
|