dataiku-sdk 3.6.1 → 3.8.0

package/README.md

@@ -4,7 +4,7 @@ Agent-only TypeScript SDK and `dss` CLI for Dataiku DSS automation.
 
 ## API coverage
 
-The SDK and CLI include scenario run management; project, recipe, and dataset metadata; managed datasets, lineage, and table imports; external saved models and MLflow imports; LLM completions and embeddings; knowledge banks; project folders and data collections; users, groups, connections, macros, and plugin administration. Discover exact inputs with `dss commands run` and scoped command contracts rather than assuming flags from API field names. MLflow archive/folder imports and evaluations resolve the external container config explicitly: DSS 15 requires the `containerExecConfigName` parameter, so the SDK/CLI send `NONE` rather than omitting it (the plan surface matches the executed request).
+The SDK and CLI include scenario run management; project, recipe, and dataset metadata; managed datasets, lineage, and table imports; flow schema propagation and documentation; grouping and prepare recipes built from flags; Visual ML tasks, model diagnostics (subpopulation analyses, partial dependencies, time series residuals) and model documentation for lab models and saved-model versions; external saved models, MLflow imports, and the MLflow experiment-tracking extension; Project Deployer infrastructures, deployments, and published projects; LLM completions and embeddings; knowledge banks; project folders and data collections; users, groups, connections, macros, and plugin administration. Discover exact inputs with `dss commands run` and scoped command contracts rather than assuming flags from API field names. MLflow archive/folder imports and evaluations resolve the external container config explicitly: DSS 15 requires the `containerExecConfigName` parameter, so the SDK/CLI send `NONE` rather than omitting it (the plan surface matches the executed request).
 
 The [DSS 15 coverage matrix](docs/API-COVERAGE-DSS-15.md) maps documented operations to SDK methods and CLI actions, records documentation discrepancies, and identifies remaining gaps. A [machine-readable matrix](docs/API-COVERAGE-DSS-15.json) is also available. Coverage is not full DSS parity or live compatibility certification: availability depends on DSS version, permissions, licensing, and installed capabilities. One known documentation discrepancy: `plugin git-branches` is served by GET on DSS 15 (the same route rejects POST with 405 `rawMethodPOSTnotsupported`, contrary to the public docs).
 
@@ -16,7 +16,7 @@ Malformed user/group listings and scenario run histories fail explicitly instead
 
 ## Platform support
 
-The published `dss` CLI requires Bun >= 1.4.0 and supports Linux, macOS, and Windows. CI runs the minimum (Bun 1.4.0) and the latest release (1.4.2) on all three operating systems. The runtime dependency is pure JavaScript, so the same package also runs on every Bun-supported x64 and ARM64 system.
+The published `dss` CLI requires Bun >= 1.4.2 and supports Linux, macOS, and Windows. CI runs Bun 1.4.2 on all three operating systems. The runtime dependency is pure JavaScript, so the same package also runs on every Bun-supported x64 and ARM64 system.
 
 Run directly with Bun:
 
@@ -29,7 +29,7 @@ Or install the npm binary:
 ```text
 npm install --global dataiku-sdk
 ```
-The installed `dss` bin bootstraps Bun with automatic `.env` preloading disabled, so Bun >= 1.4.0 must be on `PATH`; the CLI's own `.env` handling stays authoritative. `bunx --bun` forces Bun's Node-compatibility mode, which provides the same no-preload guarantee across operating systems.
+The installed `dss` bin bootstraps Bun with automatic `.env` preloading disabled, so Bun >= 1.4.2 must be on `PATH`; the CLI's own `.env` handling stays authoritative. `bunx --bun` forces Bun's Node-compatibility mode, which provides the same no-preload guarantee across operating systems.
 
 Bun is the only supported runtime and the package manager. Examples below assume an installed `dss` binary. From a checkout, use `bun --no-env-file src/cli.ts ...` or the packaged launcher `bun --no-env-file ./bin/dss.js ...`. From another working directory, pass the checkout's absolute `bin/dss.js` path to Bun.
 `--no-env-file` disables Bun's automatic preloading only; the CLI still applies its documented `.env` handling unless `DATAIKU_DISABLE_ENV=1` is set.
@@ -201,21 +201,29 @@ essentials: exactly one compact JSON value on stdout per command (void success i
 failures as one structured JSON error object on stdout with a nonzero exit code, stderr reserved
 for JSONL diagnostics only, and exit codes `0` success / `1` usage error / `2` DSS or internal
 error / `3` transient DSS error / `4` failed long-running result or assertion. `--retries N`
-controls idempotent GET retries only; `dss sql query --start-retries N` retries transient failures
+controls idempotent GET retries only, and only transient failures (408/425/429, 5xx without a known
+non-transient cause, connection resets, timeouts) are retried: a refused connection, unknown host,
+bad URL, or untrusted certificate fails at once. `dss sql query --start-retries N` retries transient failures
 while starting a query. For portable multi-step mutations, prefer `dss batch`; shell chaining and
 pipeline exit semantics differ across platforms.
 
+`*.list` commands print compact items (identifiers, kind, next-step fields) by default; `--full`
+returns the DSS objects, `--contains TEXT` filters on identifiers, and `--limit N` caps the count
+with a `list_truncated` warning.
+
 Discover the command surface with scoped calls:
 
 ```text
 dss commands run
+dss commands run --contains "propagate schema"
 dss commands run --fields dataset.create.usage,dataset.create.description,dataset.create.flags,dataset.create.examples
 dss commands run --output commands.json
 dss agent contract --fields protocol,agentContractVersion,cli,stdio,planning,compatibility
 ```
 
-`dss commands run` prints the compact resource/action summary; registry entries never dump to stdout — they travel only via `--output PATH`. See the canonical skill for
-the full `--fields` projection rules and planning workflow.
+`dss commands run` prints the compact resource/action summary, and `--contains TEXT` finds the top 5
+actions for a concept; registry entries never dump to stdout — they travel only via `--output PATH`.
+See the canonical skill for the full `--fields` projection rules and planning workflow.
 
 ## Agent skill installation
 

package/bin/bun-version.js

@@ -0,0 +1,14 @@
+/**
+ * Whether a Bun version string is at least `minimum`, comparing only the
+ * release part (major.minor.patch). Canary builds print e.g.
+ * `1.4.3-canary.12+abc`; npm-style semver ranges (and Bun.semver) reject every
+ * prerelease, which would lock out anyone on a canary channel.
+ */
+export function versionAtLeast(actual, minimum,) {
+	const a = actual.split(/[-+]/,)[0].split(".",).map(Number,);
+	const m = minimum.split(".",).map(Number,);
+	for (let i = 0; i < m.length; i++) {
+		if ((a[i] ?? 0) !== m[i]) return (a[i] ?? 0) > m[i];
+	}
+	return true;
+}

package/bin/dss.js

@@ -7,6 +7,7 @@ import { spawnSync, } from "node:child_process";
 import { readFileSync, } from "node:fs";
 import * as path from "node:path";
 import { fileURLToPath, pathToFileURL, } from "node:url";
+import { versionAtLeast, } from "./bun-version.js";
 
 const runningUnderBun = typeof process.versions.bun === "string";
 const bunNodeCompatibilityMode = runningUnderBun
@@ -25,17 +26,6 @@ const MINIMUM_BUN = JSON.parse(
 	readFileSync(fileURLToPath(new URL("../package.json", import.meta.url,),), "utf-8",),
 ).engines.bun.replace(/^>=/, "",);
 
-/** Whether dotted version `actual` is >= `minimum` (numeric per part). */
-function versionAtLeast(actual, minimum,) {
-	// Compare the release part only: canary builds print e.g. 1.4.3-canary.12+abc.
-	const a = actual.split(/[-+]/,)[0].split(".",).map(Number,);
-	const m = minimum.split(".",).map(Number,);
-	for (let i = 0; i < m.length; i++) {
-		if ((a[i] ?? 0) !== m[i]) return (a[i] ?? 0) > m[i];
-	}
-	return true;
-}
-
 if (!runningUnderBun) {
 	// Check before spawning: an old Bun may reject --no-env-file during argument
 	// parsing, before any launcher code could report a JSON error.
@@ -47,7 +37,11 @@ if (!runningUnderBun) {
 			["--no-env-file", fileURLToPath(import.meta.url,), ...process.argv.slice(2,),],
 			{ stdio: "inherit", env: process.env, },
 		)
-		: { error: new Error(found ? `Bun ${found} is older than ${MINIMUM_BUN}.` : "bun not found",), };
+		: {
+			error: new Error(
+				found ? `Bun ${found} is older than the required ${MINIMUM_BUN}.` : "bun not found",
+			),
+		};
 	if (result.error) {
 		process.stdout.write(`${
 			JSON.stringify({
@@ -57,7 +51,9 @@ if (!runningUnderBun) {
 				code: "internal_error",
 				category: "internal",
 				exitCode: 2,
-				hint: `Install Bun >= ${MINIMUM_BUN} and ensure \`bun\` is on PATH.`,
+				hint: found
+					? `Update Bun to ${MINIMUM_BUN} or newer: run \`bun upgrade\`.`
+					: `Install Bun ${MINIMUM_BUN} or newer (https://bun.sh) and ensure \`bun\` is on PATH.`,
 			},)
 		}\n`,);
 		process.exitCode = 2;
@@ -66,7 +62,7 @@ if (!runningUnderBun) {
 	} else {
 		process.exitCode = result.status ?? 1;
 	}
-} else if (!Bun.semver.satisfies(Bun.version, `>=${MINIMUM_BUN}`,)) {
+} else if (!versionAtLeast(Bun.version, MINIMUM_BUN,)) {
 	process.stdout.write(`${
 		JSON.stringify({
 			type: "error",
@@ -75,7 +71,7 @@ if (!runningUnderBun) {
 			code: "internal_error",
 			category: "internal",
 			exitCode: 2,
-			hint: `Upgrade Bun to >= ${MINIMUM_BUN} (bun upgrade).`,
+			hint: `Update Bun to ${MINIMUM_BUN} or newer: run \`bun upgrade\`.`,
 		},)
 	}\n`,);
 	process.exitCode = 2;

package/dist/build-metadata.json

@@ -1 +1 @@
-{"format":1,"buildRevision":"dae7b426ec392ff4a62bcf07fab199e02080a0f6"}
+{"format":1,"buildRevision":"6814ed4e3da988eccd85f9f50d79e1da66253b0a"}

package/dist/packages/types/src/index.d.ts

@@ -124,6 +124,7 @@ export declare const DatasetCreateOptionsSchema: import("@sinclair/typebox").TOb
     table: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
     dbSchema: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
     catalog: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    query: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
     formatType: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
     formatParams: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TRecord<import("@sinclair/typebox").TString, import("@sinclair/typebox").TUnknown>>;
     managed: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
@@ -166,20 +167,101 @@ export declare const RecipeCreateOptionsSchema: import("@sinclair/typebox").TObj
     fuzzyNormalize: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
     projectKey: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
     outputFolder: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    /** Grouping: key columns. */
+    groupBy: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>>;
+    /** Grouping: `COL:FN[+FN]` specs (count, countDistinct, sum, avg, min, max, median, stddev, first, last, concat, ...). */
+    aggregate: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>>;
+    /** Grouping: ordering column for first/last aggregates. */
+    orderBy: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    /** Prepare: `OLD=NEW` column renames. */
+    rename: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>>;
+    /** Prepare: `COL=VALUE` fills for empty cells. */
+    fillEmpty: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>>;
+    /** Prepare: one `NAME=GREL_EXPRESSION` computed column. */
+    formula: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    /** Prepare: keep only rows where this GREL expression is true. */
+    filter: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    /** Prepare: columns to remove. */
+    dropColumns: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>>;
+    /** Prepare: the only columns to keep. */
+    keepColumns: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>>;
+    /**
+     * Prepare: order of the option groups (`rename`, `fillEmpty`, `formula`, `filter`,
+     * `dropColumns`, `keepColumns`); the CLI passes the order the flags were typed in.
+     * Groups left out follow in that default order.
+     */
+    stepOrder: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>>;
 }>;
 export type RecipeCreateOptions = Static<typeof RecipeCreateOptionsSchema>;
 export declare const RecipeCreateResultSchema: import("@sinclair/typebox").TObject<{
     recipeName: import("@sinclair/typebox").TString;
+    /** The `--name` that was asked for, present only when DSS created the recipe under a different name. */
+    requestedName: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
     type: import("@sinclair/typebox").TString;
     createdDatasets: import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>;
     joinConfigured: import("@sinclair/typebox").TBoolean;
+    /** Grouping keys/aggregates or prepare steps from flags were written to the payload. */
+    payloadConfigured: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
     outputProvisioningFallbackUsed: import("@sinclair/typebox").TBoolean;
     outputFolder: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
     temporaryOutputDataset: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
     temporaryOutputDatasetDeleted: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
-    syncOutputSchemaPropagated: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>>;
+    /** Output datasets whose schema DSS computed and the client applied after creation. */
+    outputSchemaUpdated: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>>;
+    /** Why DSS could not compute the output schema; the recipe itself was created. */
+    outputSchemaUpdateError: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
 }>;
 export type RecipeCreateResult = Static<typeof RecipeCreateResultSchema>;
+/** One output from GET /recipes/{name}/schema-update (dataikuapi compute_schema_updates). */
+export declare const RecipeSchemaUpdateComputableSchema: import("@sinclair/typebox").TObject<{
+    type: import("@sinclair/typebox").TString;
+    id: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    datasetName: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    previousSchemaWasEmpty: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
+    incompatibilities: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>>;
+    newSchema: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TObject<{
+        columns: import("@sinclair/typebox").TArray<import("@sinclair/typebox").TRecord<import("@sinclair/typebox").TString, import("@sinclair/typebox").TUnknown>>;
+    }>>;
+}>;
+export type RecipeSchemaUpdateComputable = Static<typeof RecipeSchemaUpdateComputableSchema>;
+export declare const RecipeSchemaUpdatesSchema: import("@sinclair/typebox").TObject<{
+    totalIncompatibilities: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TNumber>;
+    computables: import("@sinclair/typebox").TArray<import("@sinclair/typebox").TObject<{
+        type: import("@sinclair/typebox").TString;
+        id: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+        datasetName: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+        previousSchemaWasEmpty: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
+        incompatibilities: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>>;
+        newSchema: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TObject<{
+            columns: import("@sinclair/typebox").TArray<import("@sinclair/typebox").TRecord<import("@sinclair/typebox").TString, import("@sinclair/typebox").TUnknown>>;
+        }>>;
+    }>>;
+    recipeChanges: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TUnknown>>;
+}>;
+export type RecipeSchemaUpdates = Static<typeof RecipeSchemaUpdatesSchema>;
+export declare const RecipeUpdateSchemaResultSchema: import("@sinclair/typebox").TObject<{
+    recipeName: import("@sinclair/typebox").TString;
+    /** Output ids whose schema was replaced by the DSS-computed schema. */
+    updated: import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>;
+    /** Output ids whose schema differs from the computed one but was left as is (`derivedOutputs`, `dryRun`). */
+    pending: import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>;
+    /** Output ids whose current schema already matches. */
+    unchanged: import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>;
+    totalIncompatibilities: import("@sinclair/typebox").TNumber;
+    computables: import("@sinclair/typebox").TArray<import("@sinclair/typebox").TObject<{
+        type: import("@sinclair/typebox").TString;
+        id: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+        datasetName: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+        previousSchemaWasEmpty: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
+        incompatibilities: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>>;
+        newSchema: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TObject<{
+            columns: import("@sinclair/typebox").TArray<import("@sinclair/typebox").TRecord<import("@sinclair/typebox").TString, import("@sinclair/typebox").TUnknown>>;
+        }>>;
+    }>>;
+    /** `datasetsNeedingAction` entries from the DSS apply responses. */
+    datasetsNeedingAction: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TUnknown>>;
+}>;
+export type RecipeUpdateSchemaResult = Static<typeof RecipeUpdateSchemaResultSchema>;
 export declare const JobSummarySchema: import("@sinclair/typebox").TObject<{
     def: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TObject<{
         id: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
@@ -457,14 +539,15 @@ export declare const FlowZoneCreateOptionsSchema: import("@sinclair/typebox").TO
     }>>;
 }>;
 export type FlowZoneCreateOptions = Static<typeof FlowZoneCreateOptionsSchema>;
+/**
+ * DSS's public `PUT /flow/zones/{id}` persists name and color but silently
+ * ignores `position`; repositioning an existing zone goes through
+ * `flowZones.recreate`, which creates a replacement zone at the new position.
+ */
 export declare const FlowZoneUpdateOptionsSchema: import("@sinclair/typebox").TObject<{
     name: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
     color: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
     projectKey: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
-    position: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TObject<{
-        x: import("@sinclair/typebox").TNumber;
-        y: import("@sinclair/typebox").TNumber;
-    }>>;
 }>;
 export type FlowZoneUpdateOptions = Static<typeof FlowZoneUpdateOptionsSchema>;
 export declare const FolderCreateOptionsSchema: import("@sinclair/typebox").TObject<{
@@ -602,10 +685,24 @@ export declare const WikiSettingsSchema: import("@sinclair/typebox").TObject<{
     homeArticleId: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
 }>;
 export type WikiSettings = Static<typeof WikiSettingsSchema>;
+/** One entry of a wiki article's `attachments` (uploaded FILE or linked DSS object). */
+export declare const WikiArticleAttachmentSchema: import("@sinclair/typebox").TObject<{
+    attachmentType: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    smartId: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    taggableType: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    details: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TRecord<import("@sinclair/typebox").TString, import("@sinclair/typebox").TUnknown>>;
+}>;
+export type WikiArticleAttachment = Static<typeof WikiArticleAttachmentSchema>;
 export declare const WikiArticleMetadataSchema: import("@sinclair/typebox").TObject<{
     id: import("@sinclair/typebox").TString;
     name: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
     projectKey: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    attachments: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TObject<{
+        attachmentType: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+        smartId: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+        taggableType: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+        details: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TRecord<import("@sinclair/typebox").TString, import("@sinclair/typebox").TUnknown>>;
+    }>>>;
 }>;
 export type WikiArticleMetadata = Static<typeof WikiArticleMetadataSchema>;
 export declare const WikiArticleDataSchema: import("@sinclair/typebox").TObject<{
@@ -613,6 +710,12 @@ export declare const WikiArticleDataSchema: import("@sinclair/typebox").TObject<
         id: import("@sinclair/typebox").TString;
         name: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
         projectKey: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+        attachments: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TObject<{
+            attachmentType: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+            smartId: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+            taggableType: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+            details: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TRecord<import("@sinclair/typebox").TString, import("@sinclair/typebox").TUnknown>>;
+        }>>>;
     }>;
     payload: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
 }>;
@@ -998,6 +1101,12 @@ export declare const WikiArticleDataArraySchema: import("@sinclair/typebox").TAr
         id: import("@sinclair/typebox").TString;
         name: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
         projectKey: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+        attachments: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TObject<{
+            attachmentType: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+            smartId: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+            taggableType: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+            details: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TRecord<import("@sinclair/typebox").TString, import("@sinclair/typebox").TUnknown>>;
+        }>>>;
     }>;
     payload: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
 }>>;

package/dist/packages/types/src/index.js

@@ -169,6 +169,7 @@ export const DatasetCreateOptionsSchema = Type.Object({
     table: Type.Optional(Type.String()),
     dbSchema: Type.Optional(Type.String()),
     catalog: Type.Optional(Type.String()),
+    query: Type.Optional(Type.String()),
     formatType: Type.Optional(Type.String()),
     formatParams: Type.Optional(Type.Record(Type.String(), Type.Unknown())),
     managed: Type.Optional(Type.Boolean()),
@@ -211,17 +212,77 @@ export const RecipeCreateOptionsSchema = Type.Object({
     fuzzyNormalize: Type.Optional(Type.Boolean()),
     projectKey: Type.Optional(Type.String()),
     outputFolder: Type.Optional(Type.String()),
+    /** Grouping: key columns. */
+    groupBy: Type.Optional(Type.Array(Type.String())),
+    /** Grouping: `COL:FN[+FN]` specs (count, countDistinct, sum, avg, min, max, median, stddev, first, last, concat, ...). */
+    aggregate: Type.Optional(Type.Array(Type.String())),
+    /** Grouping: ordering column for first/last aggregates. */
+    orderBy: Type.Optional(Type.String()),
+    /** Prepare: `OLD=NEW` column renames. */
+    rename: Type.Optional(Type.Array(Type.String())),
+    /** Prepare: `COL=VALUE` fills for empty cells. */
+    fillEmpty: Type.Optional(Type.Array(Type.String())),
+    /** Prepare: one `NAME=GREL_EXPRESSION` computed column. */
+    formula: Type.Optional(Type.String()),
+    /** Prepare: keep only rows where this GREL expression is true. */
+    filter: Type.Optional(Type.String()),
+    /** Prepare: columns to remove. */
+    dropColumns: Type.Optional(Type.Array(Type.String())),
+    /** Prepare: the only columns to keep. */
+    keepColumns: Type.Optional(Type.Array(Type.String())),
+    /**
+     * Prepare: order of the option groups (`rename`, `fillEmpty`, `formula`, `filter`,
+     * `dropColumns`, `keepColumns`); the CLI passes the order the flags were typed in.
+     * Groups left out follow in that default order.
+     */
+    stepOrder: Type.Optional(Type.Array(Type.String())),
 });
 export const RecipeCreateResultSchema = Type.Object({
     recipeName: Type.String(),
+    /** The `--name` that was asked for, present only when DSS created the recipe under a different name. */
+    requestedName: Type.Optional(Type.String()),
     type: Type.String(),
     createdDatasets: Type.Array(Type.String()),
     joinConfigured: Type.Boolean(),
+    /** Grouping keys/aggregates or prepare steps from flags were written to the payload. */
+    payloadConfigured: Type.Optional(Type.Boolean()),
     outputProvisioningFallbackUsed: Type.Boolean(),
     outputFolder: Type.Optional(Type.String()),
     temporaryOutputDataset: Type.Optional(Type.String()),
     temporaryOutputDatasetDeleted: Type.Optional(Type.Boolean()),
-    syncOutputSchemaPropagated: Type.Optional(Type.Array(Type.String())),
+    /** Output datasets whose schema DSS computed and the client applied after creation. */
+    outputSchemaUpdated: Type.Optional(Type.Array(Type.String())),
+    /** Why DSS could not compute the output schema; the recipe itself was created. */
+    outputSchemaUpdateError: Type.Optional(Type.String()),
+});
+/** One output from GET /recipes/{name}/schema-update (dataikuapi compute_schema_updates). */
+export const RecipeSchemaUpdateComputableSchema = Type.Object({
+    type: Type.String(),
+    id: Type.Optional(Type.String()),
+    datasetName: Type.Optional(Type.String()),
+    previousSchemaWasEmpty: Type.Optional(Type.Boolean()),
+    incompatibilities: Type.Optional(Type.Array(Type.String())),
+    newSchema: Type.Optional(Type.Object({
+        columns: Type.Array(Type.Record(Type.String(), Type.Unknown())),
+    }, { additionalProperties: true, })),
+}, { additionalProperties: true, });
+export const RecipeSchemaUpdatesSchema = Type.Object({
+    totalIncompatibilities: Type.Optional(Type.Number()),
+    computables: Type.Array(RecipeSchemaUpdateComputableSchema),
+    recipeChanges: Type.Optional(Type.Array(Type.Unknown())),
+}, { additionalProperties: true, });
+export const RecipeUpdateSchemaResultSchema = Type.Object({
+    recipeName: Type.String(),
+    /** Output ids whose schema was replaced by the DSS-computed schema. */
+    updated: Type.Array(Type.String()),
+    /** Output ids whose schema differs from the computed one but was left as is (`derivedOutputs`, `dryRun`). */
+    pending: Type.Array(Type.String()),
+    /** Output ids whose current schema already matches. */
+    unchanged: Type.Array(Type.String()),
+    totalIncompatibilities: Type.Number(),
+    computables: Type.Array(RecipeSchemaUpdateComputableSchema),
+    /** `datasetsNeedingAction` entries from the DSS apply responses. */
+    datasetsNeedingAction: Type.Optional(Type.Array(Type.Unknown())),
 });
 // ---------------------------------------------------------------------------
 // Jobs
@@ -448,11 +509,15 @@ export const FlowZoneCreateOptionsSchema = Type.Object({
     projectKey: Type.Optional(Type.String()),
     position: Type.Optional(FlowZonePositionSchema),
 }, { additionalProperties: false, });
+/**
+ * DSS's public `PUT /flow/zones/{id}` persists name and color but silently
+ * ignores `position`; repositioning an existing zone goes through
+ * `flowZones.recreate`, which creates a replacement zone at the new position.
+ */
 export const FlowZoneUpdateOptionsSchema = Type.Object({
     name: Type.Optional(Type.String()),
     color: Type.Optional(Type.String()),
     projectKey: Type.Optional(Type.String()),
-    position: Type.Optional(FlowZonePositionSchema),
 }, { additionalProperties: false, });
 // ---------------------------------------------------------------------------
 // Folders
@@ -579,10 +644,18 @@ export const WikiSettingsSchema = Type.Object({
     taxonomy: Type.Optional(Type.Array(WikiTaxonomyNodeSchema)),
     homeArticleId: Type.Optional(Type.String()),
 }, { additionalProperties: true, });
+/** One entry of a wiki article's `attachments` (uploaded FILE or linked DSS object). */
+export const WikiArticleAttachmentSchema = Type.Object({
+    attachmentType: Type.Optional(Type.String()),
+    smartId: Type.Optional(Type.String()),
+    taggableType: Type.Optional(Type.String()),
+    details: Type.Optional(Type.Record(Type.String(), Type.Unknown())),
+}, { additionalProperties: true, });
 export const WikiArticleMetadataSchema = Type.Object({
     id: Type.String(),
     name: Type.Optional(Type.String()),
     projectKey: Type.Optional(Type.String()),
+    attachments: Type.Optional(Type.Array(WikiArticleAttachmentSchema)),
 }, { additionalProperties: true, });
 export const WikiArticleDataSchema = Type.Object({
     article: WikiArticleMetadataSchema,

package/dist/src/cli/coerce.d.ts

@@ -20,6 +20,8 @@ export declare function expectJsonObject(value: unknown, source: string): Record
 export declare function parseJsonObject(text: string, source: string): Record<string, unknown>;
 export declare function json(v: string | boolean | undefined, source?: string): Record<string, unknown> | undefined;
 export declare function readStdinText(): string;
+export declare function readInputText(path: string, flag: string): string;
+export declare function seenJsonInputCredentials(): readonly string[];
 export declare function jsonInput(flags: Record<string, string | boolean>): Record<string, unknown> | undefined;
 export declare function unknownJsonInput(flags: Record<string, string | boolean>): unknown;
 export declare function schemaColumnsInput(flags: Record<string, string | boolean>, usage: string): Array<{

package/dist/src/cli/coerce.js

@@ -1,4 +1,5 @@
 import { readFileSync, } from "node:fs";
+import { credentialValues, } from "../utils/secret-sanitize.js";
 import { UsageError, } from "./usage.js";
 function safeValuePreview(value) {
     return value.length <= 32 ? value : `${value.slice(0, 32)}…`;
@@ -164,7 +165,7 @@ function selectSingleSource(flags, sourceFlags) {
     }
     return provided[0];
 }
-function readInputText(path, flag) {
+export function readInputText(path, flag) {
     try {
         return readFileSync(path, "utf-8");
     }
@@ -173,31 +174,34 @@ function readInputText(path, flag) {
         throw new UsageError(`Could not read ${flag} file: ${path}`, "validation_failed", "Verify that the path names an existing, readable file.", { flag, path, ...(cause ? { cause, } : {}), });
     }
 }
+/**
+ * Credential values seen in this process's JSON inputs. DSS error text can
+ * echo the request payload, so error reports redact these.
+ */
+const jsonInputCredentials = [];
+export function seenJsonInputCredentials() {
+    return jsonInputCredentials;
+}
+function parseJsonSource(text, source, kind) {
+    const value = kind === "object" ? parseJsonObject(text, source) : parseJsonValue(text, source);
+    jsonInputCredentials.push(...credentialValues(value));
+    return value;
+}
 function resolveJsonSourceText(flags, kind) {
     const source = selectSingleSource(flags, JSON_SOURCE_FLAGS);
     if (source === undefined)
         return undefined;
-    if (source === "stdin") {
-        const jsonText = readStdinText();
-        return kind === "object"
-            ? parseJsonObject(jsonText, "stdin")
-            : parseJsonValue(jsonText, "stdin");
-    }
+    if (source === "stdin")
+        return parseJsonSource(readStdinText(), "stdin", kind);
     if (source === "data-file") {
         const fileValue = flags["data-file"];
         if (typeof fileValue === "string") {
-            const jsonText = readInputText(fileValue, "--data-file");
-            return kind === "object"
-                ? parseJsonObject(jsonText, fileValue)
-                : parseJsonValue(jsonText, fileValue);
+            return parseJsonSource(readInputText(fileValue, "--data-file"), fileValue, kind);
         }
     }
     const dataValue = flags["data"];
-    if (typeof dataValue === "string") {
-        return kind === "object"
-            ? parseJsonObject(dataValue, "--data")
-            : parseJsonValue(dataValue, "--data");
-    }
+    if (typeof dataValue === "string")
+        return parseJsonSource(dataValue, "--data", kind);
     throw new UsageError("JSON input source is present but has no value.", "invalid_flag_value");
 }
 export function jsonInput(flags) {