@tuned-tensor/cli 0.17.0 → 0.19.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +33 -28
- package/dist/{chunk-KRKISPHG.js → chunk-4Q54NHKR.js} +435 -40
- package/dist/chunk-4Q54NHKR.js.map +1 -0
- package/dist/index.js +355 -552
- package/dist/index.js.map +1 -1
- package/dist/local-runtime.js +26 -39
- package/dist/local-runtime.js.map +1 -1
- package/docs/local-runtime/aws-gpu.md +28 -27
- package/docs/local-runtime/foundation-long-runs.md +2 -2
- package/docs/local-runtime/serving.md +3 -3
- package/docs/local-runtime/spark.md +12 -17
- package/docs/spec-architecture.html +19 -19
- package/docs/spec-workflow.md +33 -8
- package/examples/single-spec/adapter/tunedtensor.json +49 -0
- package/examples/single-spec/foundation/tunedtensor.json +31 -0
- package/package.json +4 -3
- package/training/adapter/src/serve.py +6 -0
- package/dist/chunk-KRKISPHG.js.map +0 -1
package/README.md
CHANGED
|
@@ -288,29 +288,32 @@ expected output for every example. Treat those metrics as an end-to-end
|
|
|
288
288
|
execution and overfit check—not held-out capability or multi-GPU evidence when
|
|
289
289
|
no validation corpus is configured.
|
|
290
290
|
|
|
291
|
-
|
|
292
|
-
|
|
293
|
-
|
|
291
|
+
`tunedtensor.json` contains behavior, training settings, optional `evaluation`,
|
|
292
|
+
`runtime`, and advanced `pipeline` sections. Pipelines use the embedded recipe
|
|
293
|
+
or derive it from the saved spec. Only explicit `--file` loads a separate recipe;
|
|
294
|
+
it cannot override a conflicting embedded recipe. Foundation recipes must match
|
|
295
|
+
the spec's training settings.
|
|
294
296
|
|
|
295
297
|
```bash
|
|
296
|
-
tt pipeline
|
|
297
|
-
tt pipeline
|
|
298
|
-
tt pipeline
|
|
299
|
-
tt
|
|
300
|
-
|
|
301
|
-
tt
|
|
302
|
-
|
|
303
|
-
tt
|
|
304
|
-
tt --json pipeline run --spec tunedtensor.json --dry-run
|
|
305
|
-
tt pipeline run --spec tunedtensor.json --resume /absolute/path/to/foundation-run
|
|
298
|
+
tt pipeline validate --spec tunedtensor.json
|
|
299
|
+
tt --json pipeline plan --spec tunedtensor.json
|
|
300
|
+
tt pipeline run --spec tunedtensor.json --dry-run
|
|
301
|
+
tt pipeline run --spec tunedtensor.json
|
|
302
|
+
# Optional: embed the current derived recipe for customization
|
|
303
|
+
tt pipeline init --spec tunedtensor.json
|
|
304
|
+
# Existing projects: consolidate sidecars, retaining .bak copies
|
|
305
|
+
tt pipeline migrate --spec tunedtensor.json
|
|
306
306
|
```
|
|
307
307
|
|
|
308
|
-
|
|
309
|
-
|
|
308
|
+
Relative runtime paths resolve beside the spec. New project state uses
|
|
309
|
+
`.tuned-tensor/store` and `.tuned-tensor/artifacts`. Legacy `local-runner.json`
|
|
310
|
+
remains readable with a warning; migrate it before adding inline runtime or
|
|
311
|
+
evaluation settings. See [single-file examples](examples/single-spec) and the
|
|
312
|
+
[spec workflow](docs/spec-workflow.md).
|
|
310
313
|
|
|
311
314
|
`--only` and `--skip` preserve dependency safety: a selected step cannot refer
|
|
312
|
-
to an omitted predecessor. Keep step targets local and configure `gpu` in
|
|
313
|
-
`
|
|
315
|
+
to an omitted predecessor. Keep step targets local and configure `runtime.gpu` in
|
|
316
|
+
`tunedtensor.json` to execute GPU work on your AWS instance. Adapter and
|
|
314
317
|
foundation workflows use the same local pipeline. The TT agent may describe,
|
|
315
318
|
validate, and prepare a sealed pipeline action; only deterministic `/approve`
|
|
316
319
|
handling can execute it.
|
|
@@ -389,18 +392,20 @@ tt init \
|
|
|
389
392
|
|
|
390
393
|
Edit the generated `tunedtensor.json`, replacing the placeholder system prompt and both placeholder examples.
|
|
391
394
|
For a local GPU, `tt hardware` reports this machine's training and serving
|
|
392
|
-
capacity. For an AWS GPU,
|
|
393
|
-
|
|
395
|
+
capacity. For an AWS GPU, add the following `runtime` section to your
|
|
396
|
+
`tunedtensor.json`, replacing the instance, region, profile and SSH settings with your own:
|
|
394
397
|
|
|
395
398
|
```json
|
|
396
399
|
{
|
|
397
|
-
"
|
|
398
|
-
"
|
|
399
|
-
|
|
400
|
-
|
|
401
|
-
|
|
402
|
-
|
|
403
|
-
|
|
400
|
+
"runtime": {
|
|
401
|
+
"gpu": {
|
|
402
|
+
"provider": "aws",
|
|
403
|
+
"profile": "research",
|
|
404
|
+
"region": "eu-west-1",
|
|
405
|
+
"instanceId": "i-0123456789abcdef0",
|
|
406
|
+
"user": "ubuntu",
|
|
407
|
+
"identityFile": "~/.ssh/research-gpu.pem"
|
|
408
|
+
}
|
|
404
409
|
}
|
|
405
410
|
}
|
|
406
411
|
```
|
|
@@ -419,7 +424,7 @@ tt pipeline run --spec tunedtensor.json --dry-run
|
|
|
419
424
|
tt pipeline run --spec tunedtensor.json
|
|
420
425
|
```
|
|
421
426
|
|
|
422
|
-
These commands
|
|
427
|
+
These commands read runtime and evaluation settings from the core spec. The preview needs
|
|
423
428
|
no GPU or AWS connection. Results return to the local run and model stores:
|
|
424
429
|
|
|
425
430
|
```bash
|
|
@@ -451,7 +456,7 @@ Activation is optional and requires the run to pass a configured
|
|
|
451
456
|
`generalRegression` gate. Without that suite, `tt models activate` fails
|
|
452
457
|
closed. `tt serve active` also fails closed if nothing is activated — it does
|
|
453
458
|
not silently serve the protected base model. Once activated, use
|
|
454
|
-
`tt serve active
|
|
459
|
+
`tt serve active`.
|
|
455
460
|
|
|
456
461
|
`tt serve base` does not automatically inject the adjacent project spec.
|
|
457
462
|
Pass `--spec tunedtensor.json` when the server should enforce its instructions.
|