openpond-sdk 0.7.0 → 0.8.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/MODEL_STARTERS.md +25 -0
- package/TASKSETS.md +8 -0
- package/TRAINING_PROTOCOL.md +28 -0
- package/dist/{chunk-CGIMLZE5.js → chunk-5KA6NN6I.js} +277 -188
- package/dist/chunk-5KA6NN6I.js.map +7 -0
- package/dist/{chunk-ECTMEJ5N.js → chunk-IKTZ2CD4.js} +63 -42
- package/dist/chunk-IKTZ2CD4.js.map +7 -0
- package/dist/dataset-workspaces.js +5 -1
- package/dist/dataset-workspaces.js.map +2 -2
- package/dist/model-starter-attempts.js +5 -1
- package/dist/model-starter-catalog.js +1 -1
- package/dist/model-starters.js +1 -1
- package/dist/model-taskset-runs.js +10 -7
- package/dist/model-taskset-runs.js.map +2 -2
- package/dist/taskset-drafts.js +1 -1
- package/dist/taskset-packages.js +1 -1
- package/dist/training-bundle.js +1 -1
- package/dist/training.js +13 -1
- package/dist/types/packages/sdk/src/dataset-workspace-client.d.ts +4 -0
- package/dist/types/packages/sdk/src/dataset-workspace-client.d.ts.map +1 -1
- package/dist/types/packages/sdk/src/dataset-workspace-contracts.d.ts +3 -0
- package/dist/types/packages/sdk/src/dataset-workspace-contracts.d.ts.map +1 -1
- package/dist/types/packages/sdk/src/evaluation-project-context.d.ts +19 -0
- package/dist/types/packages/sdk/src/evaluation-project-context.d.ts.map +1 -0
- package/dist/types/packages/sdk/src/model-starter-attempts.d.ts +127 -12
- package/dist/types/packages/sdk/src/model-starter-attempts.d.ts.map +1 -1
- package/dist/types/packages/sdk/src/model-taskset-runs-contracts.d.ts +83 -8
- package/dist/types/packages/sdk/src/model-taskset-runs-contracts.d.ts.map +1 -1
- package/dist/types/packages/sdk/src/model-taskset-runs.d.ts +79 -9
- package/dist/types/packages/sdk/src/model-taskset-runs.d.ts.map +1 -1
- package/dist/types/packages/sdk/src/training-preparations.d.ts +639 -0
- package/dist/types/packages/sdk/src/training-preparations.d.ts.map +1 -0
- package/dist/types/packages/sdk/src/training-project-client.d.ts +4 -4
- package/dist/types/packages/sdk/src/training-project-contracts.d.ts +5 -5
- package/dist/types/packages/sdk/src/training.d.ts +309 -0
- package/dist/types/packages/sdk/src/training.d.ts.map +1 -1
- package/package.json +1 -1
- package/dist/chunk-CGIMLZE5.js.map +0 -7
- package/dist/chunk-ECTMEJ5N.js.map +0 -7
package/MODEL_STARTERS.md
CHANGED
|
@@ -147,3 +147,28 @@ retain a null metric value. The client verifies workspace, manifest,
|
|
|
147
147
|
population, grading role, metric references and result hashes on readback.
|
|
148
148
|
Hosts remain responsible for owner-authenticated evidence and durable
|
|
149
149
|
dispatch/cancellation; a content hash is not producer authentication.
|
|
150
|
+
|
|
151
|
+
### Dataset evaluations without a model configuration
|
|
152
|
+
|
|
153
|
+
SDK 0.8 allows an evaluation request to set `modelProjectId: null` and select an
|
|
154
|
+
exact published dataset release directly. The hosted executor still resolves the
|
|
155
|
+
complete package and checks its supported runtime before admitting the run.
|
|
156
|
+
Model-configuration-backed requests continue to require their attached release.
|
|
157
|
+
|
|
158
|
+
`policy.messages` optionally supplies system, user and assistant context before
|
|
159
|
+
each example. Those messages form part of the immutable execution policy hash;
|
|
160
|
+
changing them produces a different evaluation configuration. Dataset reference
|
|
161
|
+
answers are never included in these messages by the host.
|
|
162
|
+
|
|
163
|
+
The optional `project` field contains `{ id, revision, contentHash, targetId }`.
|
|
164
|
+
Its hash identifies the selected Project **content**, and `targetId` may be null
|
|
165
|
+
for an ad hoc evaluation inside that Project. Hosts authorize the Project and
|
|
166
|
+
resolve its retained revision before execution. Request, summary and manifest
|
|
167
|
+
must agree on this provenance. Project attribution is not inferred from shared
|
|
168
|
+
datasets or model configurations.
|
|
169
|
+
|
|
170
|
+
`runs.list({ projectId })` reads that Project's attributed evaluations;
|
|
171
|
+
`runs.list({})` reads authorized workspace history. Existing
|
|
172
|
+
`runs.list({ modelProjectId })` filtering remains available. Callers must handle
|
|
173
|
+
nullable `summary.modelProjectId` for independent evaluations. No trained model
|
|
174
|
+
or serving deployment is created by running an evaluation.
|
package/TASKSETS.md
CHANGED
|
@@ -304,3 +304,11 @@ Parquet collections through the dataset reader. Search never examines private
|
|
|
304
304
|
answers. Draft edits invalidate the index, and a published release remains
|
|
305
305
|
separate from its draft. No task listing, editing, or labeling operation starts
|
|
306
306
|
a training job.
|
|
307
|
+
|
|
308
|
+
Independent dataset writes may include `originProjectId` at creation. This is
|
|
309
|
+
immutable creation provenance, not exclusive ownership or a sharing grant. The
|
|
310
|
+
host verifies that the Project belongs to the same workspace and is active.
|
|
311
|
+
Receipts and list entries retain the origin so unpublished drafts remain visible
|
|
312
|
+
in their originating Project. A release can still be used across Projects through
|
|
313
|
+
explicit associations; changing or removing that association does not rewrite
|
|
314
|
+
where the draft was created.
|
package/TRAINING_PROTOCOL.md
CHANGED
|
@@ -78,6 +78,34 @@ checkpoint inventory or qualification metrics, when the portable client needs
|
|
|
78
78
|
that evidence to validate the artifact. This metadata is immutable output
|
|
79
79
|
evidence, not private worker-control, lease, or provider state.
|
|
80
80
|
|
|
81
|
+
## Manual run preparation
|
|
82
|
+
|
|
83
|
+
Hosts supporting reviewed-data training expose these authenticated, team-scoped
|
|
84
|
+
routes through `createTrainingClient`:
|
|
85
|
+
|
|
86
|
+
```text
|
|
87
|
+
POST /v1/training/preparations
|
|
88
|
+
GET /v1/training/preparations/{preparationId}?teamId=
|
|
89
|
+
POST /v1/training/preparations/{preparationId}/start
|
|
90
|
+
POST /v1/training/preparations/{preparationId}/cancel
|
|
91
|
+
```
|
|
92
|
+
|
|
93
|
+
`prepareRun` accepts a stable operation ID, the expected configuration revision
|
|
94
|
+
and ETag, an exact sealed batch reference, an optional organizing Project, a run
|
|
95
|
+
name and a maximum spend. Preparation freezes the executable inputs and stages
|
|
96
|
+
artifacts without starting compute or creating a recurring learning policy.
|
|
97
|
+
The returned plan binds its creator, request hash, source and submission hash.
|
|
98
|
+
The SDK verifies both plan and request identity before returning the receipt.
|
|
99
|
+
|
|
100
|
+
`startPreparation` and `cancelPreparation` require the retained plan hash and
|
|
101
|
+
observed receipt revision. Starting uses the stored submission; mutable
|
|
102
|
+
configuration changes do not silently recompile a prepared run. Providers must
|
|
103
|
+
serialize cancellation with job and dispatch creation, retain the submitted job
|
|
104
|
+
ID, and make identical retries return that same job. A cancelled preparation
|
|
105
|
+
cannot start. Once submitted, use the ordinary job cancellation controls.
|
|
106
|
+
Reading a preparation does not authorize starting it; the host rechecks scope,
|
|
107
|
+
creator permissions, resource access, runtime availability and spending limits.
|
|
108
|
+
|
|
81
109
|
## Deterministic grading identity
|
|
82
110
|
|
|
83
111
|
For portable training bundles, derive `job.rewardSource` with
|