@tuned-tensor/cli 0.11.0 → 0.12.0-beta.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +44 -29
- package/dist/{chunk-DAP2Z7EZ.js → chunk-HDGBDHOB.js} +474 -74
- package/dist/chunk-HDGBDHOB.js.map +1 -0
- package/dist/index.js +366 -199
- package/dist/index.js.map +1 -1
- package/dist/local-runtime.js +52 -19
- package/dist/local-runtime.js.map +1 -1
- package/docs/local-runtime/architecture.md +8 -2
- package/docs/local-runtime/spark.md +39 -2
- package/package.json +6 -2
- package/training/local-runner/pyproject.toml +2 -2
- package/training/local-runner/src/evaluate.py +44 -18
- package/training/local-runner/src/model_contract.py +134 -14
- package/training/local-runner/src/prefetch.py +25 -8
- package/training/local-runner/src/serve.py +14 -6
- package/training/local-runner/src/sft_data.py +7 -3
- package/training/local-runner/src/train.py +48 -14
- package/training/local-runner/uv.lock +54 -54
- package/dist/chunk-DAP2Z7EZ.js.map +0 -1
package/README.md
CHANGED
|
@@ -8,8 +8,9 @@
|
|
|
8
8
|
|
|
9
9
|
Existing commands such as `tt runs`, `tt models`, and `tt push` remain hosted
|
|
10
10
|
commands. The local workflow lives under `tt local`, so scripts keep their
|
|
11
|
-
current meaning
|
|
12
|
-
|
|
11
|
+
current meaning. In the interactive shell the local workflow is the default;
|
|
12
|
+
prefix a command with `cloud` (for example `cloud runs list`) to run one hosted
|
|
13
|
+
command without changing the default.
|
|
13
14
|
|
|
14
15
|
## Install
|
|
15
16
|
|
|
@@ -35,17 +36,17 @@ npm link
|
|
|
35
36
|
|
|
36
37
|
## Conversational terminal
|
|
37
38
|
|
|
38
|
-
The interactive agent harness and conversation state
|
|
39
|
-
|
|
39
|
+
The interactive agent harness and conversation state run on your laptop.
|
|
40
|
+
Inference runs through the provider/model you select, which may be a
|
|
40
41
|
local endpoint or a remote provider. Tuned Tensor remains an authenticated
|
|
41
42
|
typed tool provider: `tt auth login` is used only for Tuned Tensor REST calls
|
|
42
43
|
and is never sent to the selected model.
|
|
43
44
|
Tool results needed to answer a request are sent to the model you selected, so
|
|
44
45
|
choose a local or remote provider whose data policy fits your workload.
|
|
45
46
|
|
|
46
|
-
|
|
47
|
+
`tt` reuses provider authentication and custom model definitions from
|
|
47
48
|
`~/.pi/agent/auth.json` and `~/.pi/agent/models.json`. Authenticate a provider
|
|
48
|
-
|
|
49
|
+
through its normal login flow; `tt` deliberately has no provider-secret flags.
|
|
49
50
|
Then inspect and select a provider/model:
|
|
50
51
|
|
|
51
52
|
```bash
|
|
@@ -69,24 +70,24 @@ If a newer stable release is available it recommends
|
|
|
69
70
|
checks are ignored.
|
|
70
71
|
|
|
71
72
|
```text
|
|
72
|
-
tt
|
|
73
|
+
tt local support-agent › What happened in my latest training run?
|
|
73
74
|
TT Your latest run completed...
|
|
74
|
-
tt
|
|
75
|
-
tt
|
|
75
|
+
tt local support-agent › runs list
|
|
76
|
+
tt local support-agent › Ask whether my dataset is ready to train
|
|
76
77
|
```
|
|
77
78
|
|
|
78
|
-
Ordinary sentences go through the locally orchestrated
|
|
79
|
+
Ordinary sentences go through the locally orchestrated model session. The
|
|
79
80
|
model can call a
|
|
80
81
|
strict, bounded set of authenticated Tuned Tensor read tools and prepare-only
|
|
81
|
-
mutation tools; it has no shell or general filesystem tool.
|
|
82
|
-
can prepare one new folder directly beneath
|
|
83
|
-
directory with a validated `tunedtensor.json`. The
|
|
84
|
-
|
|
85
|
-
|
|
86
|
-
`runs list`, `doctor`, and `models list` still execute
|
|
87
|
-
command with `:` when you want to make that intent
|
|
88
|
-
|
|
89
|
-
override the
|
|
82
|
+
mutation tools; it has no shell or general filesystem tool. The shell runs the
|
|
83
|
+
local workflow by default, so it can prepare one new folder directly beneath
|
|
84
|
+
the shell's current working directory with a validated `tunedtensor.json`. The
|
|
85
|
+
tool refuses path traversal,
|
|
86
|
+
symlinked workspace roots, existing targets, and unsupported spec fields. Known
|
|
87
|
+
CLI commands such as `runs list`, `doctor`, and `models list` still execute
|
|
88
|
+
directly. Prefix a command with `:` when you want to make that intent
|
|
89
|
+
explicit. Commands run in the local workflow by default; prefix one with
|
|
90
|
+
`cloud` (or `local`) to override the target for that one command.
|
|
90
91
|
|
|
91
92
|
Agent conversations are durable and local under
|
|
92
93
|
`~/.config/tuned-tensor/agent/threads` (or the XDG config equivalent), with
|
|
@@ -119,12 +120,20 @@ ID. If a response or final state write is lost after dispatch, the action is
|
|
|
119
120
|
retained as `outcome_unknown`, cannot be retried automatically, and directs the
|
|
120
121
|
user to inspect the remote resource. `/reject` never calls a mutation endpoint.
|
|
121
122
|
|
|
122
|
-
Useful shell controls include `/help`, `/status`, `/context`, `/
|
|
123
|
-
`/
|
|
124
|
-
|
|
125
|
-
|
|
126
|
-
|
|
127
|
-
|
|
123
|
+
Useful shell controls include `/help`, `/status`, `/context`, `/model`, `/cd`,
|
|
124
|
+
`/clear`, and `/exit`. The shell runs the local workflow by default; prefix a
|
|
125
|
+
command with `cloud` (for example `cloud runs list`) to run one hosted command
|
|
126
|
+
without changing the default.
|
|
127
|
+
The shell banner and `/context` surface the assistant's configured provider and
|
|
128
|
+
model (`agent provider/model`) separately from the workflow model, so the
|
|
129
|
+
model answering your prompts is always visible. `/model` shows and changes the
|
|
130
|
+
laptop-local TT agent model: run it with no arguments for a short list of
|
|
131
|
+
suggestions, search with `/model <query>` (only the closest matches are
|
|
132
|
+
shown), or switch with `/model <provider>/<model>` (for example
|
|
133
|
+
`/model anthropic/claude-sonnet-4-5`). The equivalent non-interactive commands
|
|
134
|
+
are `tt agent models`, `tt agent configure`, and `tt agent status`.
|
|
135
|
+
The shell keeps normal terminal scrollback and command history only for the
|
|
136
|
+
current process.
|
|
128
137
|
|
|
129
138
|
Explicit commands remain non-interactive, including in CI. `tt --help` shows
|
|
130
139
|
the complete command surface, `tt status` inspects both targets without a
|
|
@@ -164,7 +173,7 @@ tt --json pipeline run --file pipeline.json \
|
|
|
164
173
|
to an omitted predecessor. Local plans execute directly and may omit, reorder,
|
|
165
174
|
or repeat supported components. Cloud and mixed-target plans remain preview-only
|
|
166
175
|
until the bounded hosted dispatcher and artifact handoff are deployed; execution
|
|
167
|
-
fails closed rather than silently running the fixed cloud workflow. The
|
|
176
|
+
fails closed rather than silently running the fixed cloud workflow. The TT agent
|
|
168
177
|
may describe, validate, and prepare a plan, but has no direct pipeline-execute
|
|
169
178
|
tool.
|
|
170
179
|
|
|
@@ -221,9 +230,15 @@ tt local models verify local-<run-id>
|
|
|
221
230
|
tt local models serve local-<run-id> --config local-runner.json
|
|
222
231
|
```
|
|
223
232
|
|
|
224
|
-
Local currently certifies text SFT with `Qwen/Qwen3.5-2B`,
|
|
225
|
-
|
|
226
|
-
|
|
233
|
+
Local currently certifies text SFT with `Qwen/Qwen3.5-2B`,
|
|
234
|
+
`nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16`, and
|
|
235
|
+
`meta-models/Muse-Glimmer-30B`, using LoRA/PEFT and CUDA. The 30B/3B-active
|
|
236
|
+
Nemotron path is intended for DGX Spark-class unified memory, uses activation
|
|
237
|
+
checkpointing, and adapts bounded shared attention/Mamba projections rather
|
|
238
|
+
than every routed expert matrix. Muse Glimmer is a vision-language checkpoint
|
|
239
|
+
whose text tower is fine-tuned through the image-text-to-text loader with the
|
|
240
|
+
vision tower frozen and unused. Evaluation and serving may use CPU. Training
|
|
241
|
+
artifacts, datasets, and model weights remain on the execution host.
|
|
227
242
|
|
|
228
243
|
Activation is optional and requires the run to pass a configured
|
|
229
244
|
`generalRegression` gate. Once activated, use
|