dataiku-sdk 0.12.7 → 1.1.0

package/README.md

@@ -20,32 +20,35 @@ npm install --global dataiku-sdk
 
 Bun is the primary development runtime and package manager. Examples below assume an installed `dss` binary. From a checkout, use `bun --no-env-file src/cli.ts ...` or the cross-runtime `bun --no-env-file ./bin/dss.js ...` launcher. Node users can invoke the same launcher as `node ./bin/dss.js ...`; if `dist/` is absent, it delegates to Bun. From another working directory, pass the checkout's absolute `bin/dss.js` path to Bun or Node.
 `--no-env-file` disables Bun's automatic preloading only; the CLI still applies its documented `.env` handling unless `DATAIKU_DISABLE_ENV=1` is set.
+`dss version` reports whether the running code came from `source` or `dist`, the Node/Bun runtime, the packaged build revision when available, and `staleBuild` when that revision differs from the checkout. Release builds generate `dist/build-metadata.json`; source snapshots without Git metadata still build but report no build revision.
 
 ## CLI contract
 
-- Command results write exactly one JSON value to stdout, including `doctor`, `batch`, and `cleanup` failure reports; use the exit code and result fields.
-- Dispatch/runtime failures write one JSONL error event to stderr with `type:"error"`, `ok:false`, `error`, `code`, and `exitCode`, while stdout stays empty.
-- Non-fatal diagnostics and `--verbose` traces are JSONL stderr events (`type:"warning"` / `type:"trace"`); no prose trace lines are part of the contract.
+- Command results write exactly one compact JSON value to stdout; void success is `{ok:true}`. `doctor`, `batch`, and `cleanup` failure reports are their direct result objects on stdout with a nonzero exit code — use the exit code and result fields.
+- Dispatch/runtime failures write one compact structured error object on stdout (`type:"error"`, `ok:false`, `error`, `code`, `category`, `exitCode`) with a nonzero exit code; stderr carries JSONL diagnostics only.
+- Non-fatal diagnostics and `--verbose` traces are JSONL stderr events (`type:"warning"` / `type:"trace"`), flushed before both success and failure output; no prose trace lines are part of the contract.
 - `--fields a,b,c` projects those fields from an object or array-of-objects result; dotted paths (`a.b.c`) drill into nested objects, and missing fields become `null`; string and scalar results pass through unchanged.
 - No prompts, help screens, tables, banners, or prose output are part of the contract.
 - Exit codes: `0` success, `1` usage/configuration error, `2` DSS/internal error, `3` transient DSS error, `4` a failed long-running result or synchronous assertion.
 - `--retries N` controls idempotent GET retries only. `dss sql query --start-retries N` explicitly retries transient failures while starting a query; use it only when executing the SQL more than once is safe.
 - The exit code is the success signal. For portable multi-step mutations, prefer `dss batch`; shell chaining and pipeline exit semantics differ across POSIX shells, Windows PowerShell, PowerShell 7, and Command Prompt.
-- `--raw` is only for recipe payload commands. Without `--output`, stdout is raw bytes; with `--output PATH`, stdout is the JSON string equal to `PATH` and the file contains the exact raw bytes.
+- Recipe payload commands write the payload as a JSON string on stdout; use `--output PATH` to write the exact bytes to a file instead, with stdout carrying the JSON string equal to `PATH`.
 
-Discover the agent contract and command surface with compact, scoped, `--json` calls:
+Discover the agent contract and command surface with scoped calls:
 
 ```text
-dss agent contract --fields protocol,agentContractVersion,cli,stdio,planning,compatibility --json
-dss commands run --fields dataset.create --json
-dss commands run --fields dataset.create.usage,dataset.create.description,dataset.create.flags,dataset.create.examples --json
-dss commands run --fields dataset --json
-dss agent contract --fields commands.actions --json
+dss commands run
+dss commands run --fields dataset
+dss commands run --fields dataset.create
+dss commands run --fields dataset.create.usage,dataset.create.description,dataset.create.flags,dataset.create.examples
+dss commands run --output commands.json
+dss agent contract --fields protocol,agentContractVersion,cli,stdio,planning,compatibility
+dss agent contract --fields commands.actions
 ```
 
-For JSON outputs, prefer `--json`: compact single-line JSON cuts the full registry's context usage by about 40% (~220k tokens versus ~358k pretty-printed). Bootstrap by scoping `agent contract` to `protocol,agentContractVersion,cli,stdio,planning,compatibility` (~250 tokens); request `schemas` or `commands` only when you actually need them. Before choosing syntax, scope `commands run` with `--fields`: `--fields RESOURCE.ACTION` returns one complete registry entry, and appending `.FIELD` paths projects the metadata you need — the four-field per-action projection `usage,description,flags,examples` is the smallest self-sufficient starting point for constructing an invocation. Inspect `flags`, `structuredExamples`, `schemas`, `requiresAuth`, `requiresProject`, `sideEffect`, `async`, `idempotency`, `dryRun`, `cleanupCommand`, `unsafeOutputs`, `outputShape`, `inputContract`, and `exitCodes` instead of guessing.
+`dss commands run` prints the compact resource/action summary — every resource keyed to its action names, about 1k tokens — and never dumps registry entries to stdout. Bootstrap contract discovery with the scoped `agent contract` call above: `protocol,agentContractVersion,cli,stdio,planning,compatibility` cover protocol/schema compatibility, stdout/stderr stream semantics, preferred discovery commands, planning rules, and compatibility guarantees in ~250 tokens; request `schemas` or `commands` only when you actually need them. Before choosing syntax, scope `commands run` with `--fields`: `--fields RESOURCE.ACTION` returns one complete registry entry, `--fields RESOURCE` returns every action of one resource, and appending `.FIELD` paths projects the metadata you need — the four-field per-action projection `usage,description,flags,examples` is the smallest self-sufficient starting point for constructing an invocation. Inspect `flags`, `structuredExamples`, `schemas`, `requiresAuth`, `requiresProject`, `sideEffect`, `async`, `idempotency`, `dryRun`, `cleanupCommand`, `unsafeOutputs`, `outputShape`, `inputContract`, and `exitCodes` instead of guessing.
 
-`--fields` takes a comma-separated list, so request several actions in one call. Each key is echoed exactly as requested (`--fields dataset.create` returns `{"dataset.create": {...}}`). Enumerate every resource and action with `dss agent contract --fields commands.actions --json` (~1k tokens); the ~220k-token unscoped registry remains a compatibility surface, not a discovery workflow. An unknown resource or action exits with code 1 and a JSON error envelope on stderr containing the valid options.
+`--fields` takes a comma-separated list, so request several actions in one call. Each key is echoed exactly as requested (`--fields dataset.create` returns `{"dataset.create": {...}}`); an empty `--fields` is a usage error, never a silent full dump. The full registry (~220k tokens) is exported only via `--output PATH`: the command writes the registry, or the selected `--fields` subset, as compact JSON to `PATH`, and stdout carries the compact `{"path":"PATH"}` result — never the registry itself. An unknown resource or action exits with code 1 and a compact JSON error object on stdout containing the valid options.
 
 ## Agent skill installation
 
@@ -117,10 +120,16 @@ The command saves credentials and returns `{ "saved": true, "path": "..." }`.
 dss version
 dss doctor --fast
 dss project list
+dss project inspect-archive ./project.zip
+dss project import ./project.zip --target-project-key IMPORTED_PROJECT --record-cleanup cleanup.jsonl
 dss dataset list --project-key MYPROJ
+dss dataset files uploaded_input --project-key MYPROJ
+dss dataset upload-file uploaded_input ./new.csv --file-name new.csv --project-key MYPROJ
+dss dataset assert-count jmp_doe_ready --expected 12 --project-key MYPROJ
+dss dataset assert-schema jmp_doe_ready --data-file expected-schema.json --project-key MYPROJ
+dss data-quality assert-results jmp_doe_ready --project-key MYPROJ
 dss recipe get-payload compute_orders --project-key MYPROJ
-dss recipe get-payload compute_orders --raw --project-key MYPROJ
-dss recipe get-payload compute_orders --raw --output code.py --project-key MYPROJ
+dss recipe get-payload compute_orders --output code.py --project-key MYPROJ
 dss install-skill --dry-run
 dss app validate-manifest --project-key MYAPP_INSTANCE
 dss app compare-manifest my-app --project-key MYAPP_INSTANCE
@@ -135,6 +144,28 @@ dss app permissions-restore --project-key MYAPP_INSTANCE --file permissions.json
 dss cleanup --file cleanup.jsonl
 dss cleanup --file cleanup.jsonl --apply
 ```
+`project import` performs both public API stages: archive upload, then import processing. It
+first validates ZIP integrity, safe unique member paths, the export manifest, and provable Flow
+references locally. Verified success reports DSS's actual project key, explicit remapping, and a
+`creationTag` incarnation hash; `--record-cleanup` records an incarnation-bound guarded delete.
+It exits nonzero when DSS returns `success:false` even if both HTTP requests succeeded. A timeout,
+5xx, malformed response, missing used key, or failed post-import identity read is
+`ambiguous_outcome` and retains the temporary import ID for inspection before retry.
+
+`dataset upload-file` only adds a filename that is not already present and verifies its byte
+length afterward. DSS 14.7 exposes no public UploadedFiles delete or replacement endpoint;
+the command refuses an existing filename before POST instead of triggering DSS's opaque 500.
+For replacement, import a successor project archive containing the desired upload.
+
+`dataset preview` returns `truncated` and `limit`; it probes one row past the requested cap instead
+of presenting a capped sample as an exact count. `dataset assert-count`, `dataset assert-schema`,
+and `data-quality assert-results` return `satisfied` and exit `4`/`assertion_failed` on a failed
+postcondition, so they can be used as `batch` steps. Multi-job `job monitor` and `job watch`
+aggregate child failures and also exit `4` when any watched job fails.
+
+`doctor` reads the documented `DSS-Version` and `DSS-API-Version` response headers plus the HTTP
+`Date` header from the public project-list call. Feature support remains behavioral: the CLI does
+not call an undocumented feature endpoint or infer licensed capabilities from a version string.
 
 ### Application release safety
 
@@ -213,7 +244,9 @@ conditional DELETE. Cleanup rechecks type and `creationTag` immediately before d
 detected key reuse, but cannot eliminate replacement in the remaining check-to-DELETE gap.
 `cleanup --apply` validates the full ledger before issuing any request and rejects legacy entries
 without server identity, mixed-server ledgers, entries for another DSS URL, and app cleanup entries
-without a valid incarnation binding.
+without a valid incarnation binding. Project-import cleanup uses the same rule: the ledger binds
+the actual imported key and verified `creationTag` hash, and `project delete
+--expect-project-incarnation` refuses a reused or unverifiable key before DELETE.
 
 Saving `version`/`versionNotes` in the public app manifest is a metadata write, not a publish
 transaction. If the manifest PUT or its verification read has an ambiguous transport/server
@@ -230,4 +263,49 @@ never marks that external check complete. The public DSS APIs used by this SDK d
 supported app-template publish/recreate/rename workflow, recipient-level app sharing setter, or
 UI-click smoke test. The CLI does not guess private endpoints for those operations.
 
+## Project Git source-control safety
+
+Project Git commands require DSS 12.4.2 or newer plus read and write access to the project
+content. Inspect state before changing it:
+The DSS project Git API exposes status, remotes, branches, tags, branch switching, fetch,
+rebase-based pull, push, log, diff, commit, revert/reset/rebuild, external-library, and future
+operations. It does not expose a separate checkout operation; use `switch`.
+
+```bash
+dss project-git status --project-key MYPROJ
+dss project-git branches --remote --project-key MYPROJ
+dss project-git log --count 20 --project-key MYPROJ
+```
+
+Creating a branch in a duplicate project is the safe UAT path; creating it in place switches the
+source project to the new branch:
+
+```bash
+dss project-git create-branch feature/orders \
+  --duplicate-project \
+  --target-project-key MYPROJ_ORDERS_UAT \
+  --project-key MYPROJ \
+  --plan
+dss project-git create-branch feature/orders \
+  --duplicate-project \
+  --target-project-key MYPROJ_ORDERS_UAT \
+  --project-key MYPROJ
+```
+
+`pull` rebases rather than merging. `reset-to-head`, `reset-to-upstream`, reverts, forced or
+remote branch deletion, library-directory deletion, and `drop-and-rebuild` are destructive;
+inspect their local `--plan` result first. `drop-and-rebuild` additionally requires
+`--i-know-what-i-am-doing` and destroys all Git history. Repository URLs containing embedded
+HTTP credentials are rejected. External-library credentials must come from
+`--password-env ENV_NAME`; the value is never included in plans or command output. Library
+operations that return a `jobId` can be observed with `project-git future-status` or completed
+with `project-git future-wait`.
+Project Git requests use `/dip/publicapi/projects/{projectKey}/git/*`; they do not configure
+remote authentication. DSS documents administrator Git group rules plus either per-user SSH keys
+under **Profile > Credentials > SSH** or non-interactive system-level credentials for the DSS
+server account. Configure these before private-remote fetch, pull, or push. `--password-env`
+applies only to external project-library operations and does not persist a remote credential.
+The `project-git` resource does not manage these settings, so public/auth-less and
+already-configured remotes are the supported automation paths.
+
 For fake-DSS smoke tests, return project lists as JSON arrays such as `[{ "projectKey": "MYPROJ", "name": "My Project" }]` from `/public/api/projects/`; recipe payload commands read `/public/api/projects/<PROJECT>/recipes/<NAME>?includePayload=true` and expect a JSON object shaped like `{ "recipe": { "name": "<NAME>", "type": "python" }, "payload": "..." }`.

package/bin/dss.js

@@ -56,9 +56,28 @@ if (hasFlag(["--insecure", "--skip-tls-verify",],)) {
 ) {
 	env.NODE_TLS_REJECT_UNAUTHORIZED = "0";
 }
-
 const runningOnBun = Boolean(process.versions.bun,);
 const usesSourceCli = cliPath === sourceCliPath;
+
+// Published dist carries dist/build-metadata.json with the revision it was
+// built from. Forward it to the CLI so provenance can report dist source and
+// its build revision; only a full lowercase hexadecimal revision is accepted,
+// so an inherited or corrupt variable never stands in for packaged metadata.
+const distMetadataPath = path.resolve(here, "../dist/build-metadata.json",);
+if (!usesSourceCli) {
+	env.DSS_LOAD_SOURCE = "dist";
+	delete env.DSS_BUILD_REVISION;
+	try {
+		const metadata = JSON.parse(fs.readFileSync(distMetadataPath, "utf-8",),);
+		const revision = metadata.buildRevision;
+		if (typeof revision === "string" && /^[0-9a-f]{40}$/.test(revision,)) {
+			env.DSS_BUILD_REVISION = revision;
+		}
+	} catch {
+		// Dist without build metadata: provenance still reports dist source.
+	}
+}
+
 const runtimeBin = runningOnBun ? process.execPath : usesSourceCli ? "bun" : process.execPath;
 const runtimeArgs = runningOnBun || usesSourceCli ? ["--no-env-file",] : ["--use-system-ca",];
 const result = spawnSync(
@@ -77,7 +96,7 @@ if (result.error) {
 			runningOnBun ? "Bun" : "Node"
 		} runtime for packaged dss CLI (${result.error.message}); falling back to the current runtime.`;
 	if (usesSourceCli) {
-		process.stderr.write(`${
+		process.stdout.write(`${
 			JSON.stringify({
 				type: "error",
 				ok: false,

package/dist/build-metadata.json

@@ -0,0 +1 @@
+{"format":1,"buildRevision":"70487e2275a70acce6862f126a89b1bc852ebb11"}

package/dist/packages/types/src/index.d.ts

@@ -66,6 +66,7 @@ export declare const DatasetSummarySchema: import("@sinclair/typebox").TObject<{
     managed: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
     params: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TObject<{
         connection: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+        uploadConnection: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
         schema: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
         catalog: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
     }>>;
@@ -86,6 +87,7 @@ export declare const DatasetDetailsSchema: import("@sinclair/typebox").TObject<{
     managed: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
     params: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TObject<{
         connection: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+        uploadConnection: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
         path: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
         table: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
         schema: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
@@ -111,7 +113,7 @@ export declare const DatasetDetailsSchema: import("@sinclair/typebox").TObject<{
 export type DatasetDetails = Static<typeof DatasetDetailsSchema>;
 export declare const DatasetCreateOptionsSchema: import("@sinclair/typebox").TObject<{
     datasetName: import("@sinclair/typebox").TString;
-    connection: import("@sinclair/typebox").TString;
+    connection: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
     dsType: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
     table: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
     dbSchema: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
@@ -382,8 +384,8 @@ export declare const FlowZoneUpdateOptionsSchema: import("@sinclair/typebox").TO
 export type FlowZoneUpdateOptions = Static<typeof FlowZoneUpdateOptionsSchema>;
 export declare const FolderCreateOptionsSchema: import("@sinclair/typebox").TObject<{
     name: import("@sinclair/typebox").TString;
-    type: import("@sinclair/typebox").TString;
-    connection: import("@sinclair/typebox").TString;
+    type: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    connection: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
     path: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
     params: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TRecord<import("@sinclair/typebox").TString, import("@sinclair/typebox").TUnknown>>;
     projectKey: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
@@ -677,6 +679,128 @@ export declare const FlowMapOptionsSchema: import("@sinclair/typebox").TObject<{
     includeRaw: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
 }>;
 export type FlowMapOptions = Static<typeof FlowMapOptionsSchema>;
+/**
+ * Git working-copy status of a project. Stable fields are documented in the
+ * DSS 14.7.3 source; DSS additionally returns extension fields, which are
+ * preserved by `additionalProperties: true`.
+ */
+export declare const ProjectGitStatusSchema: import("@sinclair/typebox").TObject<{
+    currentBranch: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    remotes: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TObject<{
+        name: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+        url: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    }>>>;
+    trackingCount: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TObject<{
+        ahead: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TNumber>;
+        behind: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TNumber>;
+    }>>;
+    clean: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
+    hasUncommittedChanges: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
+    added: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>>;
+    changed: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>>;
+    removed: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>>;
+    missing: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>>;
+    modified: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>>;
+    conflicting: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>>;
+    untracked: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>>;
+    untrackedFolders: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TString>>;
+    originProjectKey: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    trackingCountWithOriginProject: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TObject<{
+        ahead: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TNumber>;
+        behind: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TNumber>;
+    }>>;
+}>;
+export type ProjectGitStatus = Static<typeof ProjectGitStatusSchema>;
+export declare const ProjectGitRemoteSchema: import("@sinclair/typebox").TObject<{
+    url: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+}>;
+export type ProjectGitRemote = Static<typeof ProjectGitRemoteSchema>;
+/**
+ * Result of a Git mutation. DSS answers with HTTP 200 even for failures, so
+ * `success` is the field callers must inspect before trusting the operation.
+ */
+export declare const ProjectGitActionResultSchema: import("@sinclair/typebox").TObject<{
+    success: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
+    output: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TUnknown>;
+    logs: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TUnknown>;
+    messages: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TUnknown>;
+}>;
+export type ProjectGitActionResult = Static<typeof ProjectGitActionResultSchema>;
+export declare const ProjectGitTagSchema: import("@sinclair/typebox").TObject<{
+    name: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    shortName: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    commit: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TUnknown>;
+    annotations: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TUnknown>;
+    readOnly: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
+}>;
+export type ProjectGitTag = Static<typeof ProjectGitTagSchema>;
+export declare const ProjectGitTagsSchema: import("@sinclair/typebox").TArray<import("@sinclair/typebox").TObject<{
+    name: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    shortName: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    commit: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TUnknown>;
+    annotations: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TUnknown>;
+    readOnly: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
+}>>;
+export type ProjectGitTags = Static<typeof ProjectGitTagsSchema>;
+/**
+ * Paginated commit log. `nextCommit` is the cursor DSS expects back to fetch
+ * the following page; entries stay unpinned because commit payloads vary.
+ */
+export declare const ProjectGitLogResultSchema: import("@sinclair/typebox").TObject<{
+    entries: import("@sinclair/typebox").TArray<import("@sinclair/typebox").TUnknown>;
+    nextCommit: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+}>;
+export type ProjectGitLogResult = Static<typeof ProjectGitLogResultSchema>;
+/**
+ * Diff between two revisions. Stable fields are documented in the DSS 14.7.3
+ * source; DSS additionally returns extension fields, which are preserved by
+ * `additionalProperties: true`.
+ */
+export declare const ProjectGitDiffResultSchema: import("@sinclair/typebox").TObject<{
+    commitFrom: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TUnknown>;
+    commitTo: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TUnknown>;
+    addedLines: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TNumber>;
+    removedLines: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TNumber>;
+    changedFiles: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TNumber>;
+    entries: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TArray<import("@sinclair/typebox").TUnknown>>;
+}>;
+export type ProjectGitDiffResult = Static<typeof ProjectGitDiffResultSchema>;
+export declare const ProjectGitLibrarySchema: import("@sinclair/typebox").TObject<{
+    repository: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    login: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    pathInGitRepository: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    localTargetPath: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    checkout: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    addToPythonPath: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
+}>;
+export type ProjectGitLibrary = Static<typeof ProjectGitLibrarySchema>;
+export declare const ProjectGitLibrariesSchema: import("@sinclair/typebox").TArray<import("@sinclair/typebox").TObject<{
+    repository: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    login: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    pathInGitRepository: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    localTargetPath: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    checkout: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    addToPythonPath: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
+}>>;
+export type ProjectGitLibraries = Static<typeof ProjectGitLibrariesSchema>;
+/** Handle returned by Git operations that run asynchronously as a DSS future. */
+export declare const ProjectGitFutureResponseSchema: import("@sinclair/typebox").TObject<{
+    jobId: import("@sinclair/typebox").TString;
+}>;
+export type ProjectGitFutureResponse = Static<typeof ProjectGitFutureResponseSchema>;
+export declare const ProjectGitFutureStateSchema: import("@sinclair/typebox").TObject<{
+    jobId: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+    hasResult: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
+    result: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TUnknown>;
+    alive: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
+    aborted: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
+    abortable: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
+    unknown: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
+    startTime: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TNumber>;
+    runningTime: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TNumber>;
+    error: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TUnknown>;
+}>;
+export type ProjectGitFutureState = Static<typeof ProjectGitFutureStateSchema>;
 export declare const ProjectSummaryArraySchema: import("@sinclair/typebox").TArray<import("@sinclair/typebox").TObject<{
     projectKey: import("@sinclair/typebox").TString;
     name: import("@sinclair/typebox").TString;
@@ -689,6 +813,7 @@ export declare const DatasetSummaryArraySchema: import("@sinclair/typebox").TArr
     managed: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TBoolean>;
     params: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TObject<{
         connection: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
+        uploadConnection: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
         schema: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
         catalog: import("@sinclair/typebox").TOptional<import("@sinclair/typebox").TString>;
     }>>;

package/dist/packages/types/src/index.js

@@ -123,6 +123,7 @@ export const DatasetSummarySchema = Type.Object({
     managed: Type.Optional(Type.Boolean()),
     params: Type.Optional(Type.Object({
         connection: Type.Optional(Type.String()),
+        uploadConnection: Type.Optional(Type.String()),
         schema: Type.Optional(Type.String()),
         catalog: Type.Optional(Type.String()),
     }, { additionalProperties: true, })),
@@ -141,6 +142,7 @@ export const DatasetDetailsSchema = Type.Object({
     managed: Type.Optional(Type.Boolean()),
     params: Type.Optional(Type.Object({
         connection: Type.Optional(Type.String()),
+        uploadConnection: Type.Optional(Type.String()),
         path: Type.Optional(Type.String()),
         table: Type.Optional(Type.String()),
         schema: Type.Optional(Type.String()),
@@ -159,7 +161,7 @@ export const DatasetDetailsSchema = Type.Object({
 }, { additionalProperties: true, });
 export const DatasetCreateOptionsSchema = Type.Object({
     datasetName: Type.String(),
-    connection: Type.String(),
+    connection: Type.Optional(Type.String()),
     dsType: Type.Optional(Type.String()),
     table: Type.Optional(Type.String()),
     dbSchema: Type.Optional(Type.String()),
@@ -393,8 +395,8 @@ export const FlowZoneUpdateOptionsSchema = Type.Object({
 // ---------------------------------------------------------------------------
 export const FolderCreateOptionsSchema = Type.Object({
     name: Type.String(),
-    type: Type.String(),
-    connection: Type.String(),
+    type: Type.Optional(Type.String()),
+    connection: Type.Optional(Type.String()),
     path: Type.Optional(Type.String()),
     params: Type.Optional(Type.Record(Type.String(), Type.Unknown())),
     projectKey: Type.Optional(Type.String()),
@@ -642,6 +644,107 @@ export const FlowMapOptionsSchema = Type.Object({
     includeRaw: Type.Optional(Type.Boolean()),
 });
 // ---------------------------------------------------------------------------
+// Project Git
+// ---------------------------------------------------------------------------
+/**
+ * Git working-copy status of a project. Stable fields are documented in the
+ * DSS 14.7.3 source; DSS additionally returns extension fields, which are
+ * preserved by `additionalProperties: true`.
+ */
+export const ProjectGitStatusSchema = Type.Object({
+    currentBranch: Type.Optional(Type.String()),
+    remotes: Type.Optional(Type.Array(Type.Object({
+        name: Type.Optional(Type.String()),
+        url: Type.Optional(Type.String()),
+    }, { additionalProperties: true, }))),
+    trackingCount: Type.Optional(Type.Object({
+        ahead: Type.Optional(Type.Number()),
+        behind: Type.Optional(Type.Number()),
+    }, { additionalProperties: true, })),
+    clean: Type.Optional(Type.Boolean()),
+    hasUncommittedChanges: Type.Optional(Type.Boolean()),
+    added: Type.Optional(Type.Array(Type.String())),
+    changed: Type.Optional(Type.Array(Type.String())),
+    removed: Type.Optional(Type.Array(Type.String())),
+    missing: Type.Optional(Type.Array(Type.String())),
+    modified: Type.Optional(Type.Array(Type.String())),
+    conflicting: Type.Optional(Type.Array(Type.String())),
+    untracked: Type.Optional(Type.Array(Type.String())),
+    untrackedFolders: Type.Optional(Type.Array(Type.String())),
+    originProjectKey: Type.Optional(Type.String()),
+    trackingCountWithOriginProject: Type.Optional(Type.Object({
+        ahead: Type.Optional(Type.Number()),
+        behind: Type.Optional(Type.Number()),
+    }, { additionalProperties: true, })),
+}, { additionalProperties: true, });
+export const ProjectGitRemoteSchema = Type.Object({
+    url: Type.Optional(Type.String()),
+}, { additionalProperties: true, });
+/**
+ * Result of a Git mutation. DSS answers with HTTP 200 even for failures, so
+ * `success` is the field callers must inspect before trusting the operation.
+ */
+export const ProjectGitActionResultSchema = Type.Object({
+    success: Type.Optional(Type.Boolean()),
+    output: Type.Optional(Type.Unknown()),
+    logs: Type.Optional(Type.Unknown()),
+    messages: Type.Optional(Type.Unknown()),
+}, { additionalProperties: true, });
+export const ProjectGitTagSchema = Type.Object({
+    name: Type.Optional(Type.String()),
+    shortName: Type.Optional(Type.String()),
+    commit: Type.Optional(Type.Unknown()),
+    annotations: Type.Optional(Type.Unknown()),
+    readOnly: Type.Optional(Type.Boolean()),
+}, { additionalProperties: true, });
+export const ProjectGitTagsSchema = Type.Array(ProjectGitTagSchema);
+/**
+ * Paginated commit log. `nextCommit` is the cursor DSS expects back to fetch
+ * the following page; entries stay unpinned because commit payloads vary.
+ */
+export const ProjectGitLogResultSchema = Type.Object({
+    entries: Type.Array(Type.Unknown()),
+    nextCommit: Type.Optional(Type.String()),
+}, { additionalProperties: true, });
+/**
+ * Diff between two revisions. Stable fields are documented in the DSS 14.7.3
+ * source; DSS additionally returns extension fields, which are preserved by
+ * `additionalProperties: true`.
+ */
+export const ProjectGitDiffResultSchema = Type.Object({
+    commitFrom: Type.Optional(Type.Unknown()),
+    commitTo: Type.Optional(Type.Unknown()),
+    addedLines: Type.Optional(Type.Number()),
+    removedLines: Type.Optional(Type.Number()),
+    changedFiles: Type.Optional(Type.Number()),
+    entries: Type.Optional(Type.Array(Type.Unknown())),
+}, { additionalProperties: true, });
+export const ProjectGitLibrarySchema = Type.Object({
+    repository: Type.Optional(Type.String()),
+    login: Type.Optional(Type.String()),
+    pathInGitRepository: Type.Optional(Type.String()),
+    localTargetPath: Type.Optional(Type.String()),
+    checkout: Type.Optional(Type.String()),
+    addToPythonPath: Type.Optional(Type.Boolean()),
+}, { additionalProperties: true, });
+export const ProjectGitLibrariesSchema = Type.Array(ProjectGitLibrarySchema);
+/** Handle returned by Git operations that run asynchronously as a DSS future. */
+export const ProjectGitFutureResponseSchema = Type.Object({
+    jobId: Type.String(),
+}, { additionalProperties: true, });
+export const ProjectGitFutureStateSchema = Type.Object({
+    jobId: Type.Optional(Type.String()),
+    hasResult: Type.Optional(Type.Boolean()),
+    result: Type.Optional(Type.Unknown()),
+    alive: Type.Optional(Type.Boolean()),
+    aborted: Type.Optional(Type.Boolean()),
+    abortable: Type.Optional(Type.Boolean()),
+    unknown: Type.Optional(Type.Boolean()),
+    startTime: Type.Optional(Type.Number()),
+    runningTime: Type.Optional(Type.Number()),
+    error: Type.Optional(Type.Unknown()),
+}, { additionalProperties: true, });
+// ---------------------------------------------------------------------------
 // Array wrappers (for runtime validation of list() responses)
 // ---------------------------------------------------------------------------
 export const ProjectSummaryArraySchema = Type.Array(ProjectSummarySchema);

package/dist/src/cli/coerce.d.ts

@@ -1,5 +1,6 @@
 import type { JobBuildTargetType, JobLogFilter } from "../resources/jobs.js";
-export declare function num(v: string | boolean | undefined): number | undefined;
+export declare function num(v: string | boolean | undefined, flagName?: string): number | undefined;
+export declare function numFlag(flags: Record<string, string | boolean>, flagNames: string[]): number | undefined;
 export declare function jobBuildTargetType(v: string | boolean | undefined): JobBuildTargetType;
 export declare function jobBuildTargetTypeFromFlags(flags: Record<string, string | boolean>): JobBuildTargetType;
 export declare function maxLogLinesFromFlags(flags: Record<string, string | boolean>): number | undefined;