@fabric-harness/databricks 4.0.1 → 4.1.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (48) hide show
  1. package/README.md +11 -5
  2. package/dist/agent-services.d.ts +3 -3
  3. package/dist/agent-services.d.ts.map +1 -1
  4. package/dist/agent.js +2903 -1938
  5. package/dist/agent.js.map +1 -1
  6. package/dist/ai-gateway.d.ts +3 -3
  7. package/dist/ai-gateway.d.ts.map +1 -1
  8. package/dist/app.d.ts +1 -1
  9. package/dist/app.d.ts.map +1 -1
  10. package/dist/authoring-certification.d.ts +4 -2
  11. package/dist/authoring-certification.d.ts.map +1 -1
  12. package/dist/certification-environment.d.ts +16 -0
  13. package/dist/certification-environment.d.ts.map +1 -0
  14. package/dist/certification-sweeper.d.ts +2 -2
  15. package/dist/certification-sweeper.d.ts.map +1 -1
  16. package/dist/certification.d.ts +17 -0
  17. package/dist/certification.d.ts.map +1 -1
  18. package/dist/certify.js +2914 -1971
  19. package/dist/certify.js.map +1 -1
  20. package/dist/genie-agent-mode.d.ts +3 -3
  21. package/dist/genie-agent-mode.d.ts.map +1 -1
  22. package/dist/genie-authoring.d.ts +14 -4
  23. package/dist/genie-authoring.d.ts.map +1 -1
  24. package/dist/genie.d.ts +3 -3
  25. package/dist/genie.d.ts.map +1 -1
  26. package/dist/governance.d.ts +26 -0
  27. package/dist/governance.d.ts.map +1 -1
  28. package/dist/identity.d.ts.map +1 -1
  29. package/dist/index.d.ts +12 -10
  30. package/dist/index.d.ts.map +1 -1
  31. package/dist/index.js +4451 -3053
  32. package/dist/index.js.map +1 -1
  33. package/dist/mlflow-tracing.d.ts +7 -7
  34. package/dist/mlflow-tracing.d.ts.map +1 -1
  35. package/dist/native-sdk.d.ts +7 -5
  36. package/dist/native-sdk.d.ts.map +1 -1
  37. package/dist/{client.d.ts → raw-protocol-client.d.ts} +16 -18
  38. package/dist/raw-protocol-client.d.ts.map +1 -0
  39. package/dist/sql-sandbox.js +2648 -1789
  40. package/dist/sql-sandbox.js.map +1 -1
  41. package/dist/tools.d.ts +24 -13
  42. package/dist/tools.d.ts.map +1 -1
  43. package/dist/workspace-authoring.d.ts +3 -3
  44. package/dist/workspace-authoring.d.ts.map +1 -1
  45. package/dist/workspace-origin.d.ts +3 -0
  46. package/dist/workspace-origin.d.ts.map +1 -0
  47. package/package.json +2 -1
  48. package/dist/client.d.ts.map +0 -1
package/README.md CHANGED
@@ -71,16 +71,16 @@ await jobs.runJob({ jobId: 42, idempotencyToken: submission.id });
71
71
 
72
72
  `databricks({ ... }).sdk` exposes the principal-bound generated clients to custom agent runs. Fabric
73
73
  adds governance, approval, lifecycle safety, retries for explicitly idempotent operations, lineage,
74
- and durable state; it does not reimplement stable Databricks service APIs. A small private preview
75
- transport remains only for APIs absent from the modular SDK: Agent Services, Genie Agent Mode
76
- streaming, Genie ACLs, Workspace object import/export, MLflow 3 tracing, AI Gateway/model-service
74
+ and durable state; it does not reimplement stable Databricks service APIs. A small private raw
75
+ protocol transport remains only for APIs absent from the modular SDK: Agent Services, Genie Agent Mode
76
+ streaming, Workspace object import/export, MLflow 3 tracing, AI Gateway/model-service
77
77
  discovery, and the ResponsesAgent custom request schema. Its exhaustive method-and-path allowlist
78
78
  rejects every other route before credential resolution or network I/O. Callers use typed bundle
79
79
  capabilities rather than constructing that transport.
80
80
 
81
81
  One compatibility exception is deliberately quarantined: SDK 0.21's generated Genie query-result
82
82
  parser rejects Databricks' real row-array payload. Genie retries that one decoded response through the
83
- preview transport only when the generated client raises the exact schema error. Authentication,
83
+ raw protocol transport only when the generated client raises the exact schema error. Authentication,
84
84
  conversation lifecycle, polling, and unrelated failures continue through or fail from the official
85
85
  client. Source-boundary and runtime-denial tests prevent this exception from spreading to stable
86
86
  services.
@@ -89,7 +89,7 @@ services.
89
89
 
90
90
  - AI Gateway and Model Serving: automatic `system.ai.*` routing, explicit mode/base URL selection, model-service discovery, gateway readiness, request tags, streaming, tools, and custom endpoints.
91
91
  - Identity: Databricks CLI OAuth profiles, explicit PAT/pre-fetched bearer, cached OAuth M2M, Databricks Apps service principal, and forwarded user token helpers.
92
- - Data and AI: SQL Warehouse, Unity Catalog discovery/admin, AI Search query/admin, bounded citation-validated RAG with token streaming, MLflow 3 evaluation records and a managed-judge release Job, embeddings, `ai_query()`, typed Genie Agent conversations, beta normalized lifecycle/ACL authoring, explicit Beta Agent Mode SSE streaming, Feature Serving, typed Jobs 2.2 authoring/run APIs, and workspace read/write APIs.
92
+ - Data and AI: SELECT-only `databricksSqlReadTool()`, approval-bound arbitrary SQL Warehouse execution, Unity Catalog discovery/admin, AI Search query/admin, bounded citation-validated RAG with token streaming, MLflow 3 evaluation records and a managed-judge release Job, embeddings, `ai_query()`, typed Genie Agent conversations, beta normalized lifecycle/ACL authoring, explicit Beta Agent Mode SSE streaming, Feature Serving, typed Jobs 2.2 authoring/run APIs, and workspace read/write APIs.
93
93
  - Agent governance: explicit-Beta Unity Catalog Agent Services registration, discovery, metadata updates, `EXECUTE`/`READ_METADATA` grants, and deletion for externally hosted Harness agents.
94
94
  - Data engineering: Lakeflow pipeline list/status/start/stop plus separately opt-in create/update/delete/event tools.
95
95
  - Operations: System Tables consumption reporting, actual-cost budget source, MLflow tracing, serving usage capture, and Lakebase telemetry tables.
@@ -114,6 +114,12 @@ resource descriptors validate at bundle initialization and check every catalog-q
114
114
  Request-scoped `bundle.forPrincipal({ tokenProvider, principal })` uses a verified principal and
115
115
  binds approval grants to the exact call, input digest, and executing identity. Secret write tools
116
116
  accept only SDK `SecretRef` values resolved by a server-side `SecretProvider`.
117
+
118
+ For an analytics copilot, `analyticsCopilotGovernance()` keeps ordinary Genie questions and
119
+ SELECT-only `sql_read` calls approval-free while arbitrary SQL and Genie management stay routed to
120
+ the steward audience. Its SQL/Genie service scope does not weaken authoring validation: enabling
121
+ another authoring service fails initialization until approval routing explicitly includes it.
122
+
117
123
  Existing clusters require an explicit `allowedExistingClusterIds` entry, and model-facing serving
118
124
  tools reject raw `environmentVars`.
119
125
  Genie management is enabled by `genie.manage` and requires a `DatabricksManagedResourceStore`; use
@@ -1,4 +1,4 @@
1
- import type { DatabricksPreviewClient } from "./client.js";
1
+ import type { DatabricksRawProtocolClient } from "./raw-protocol-client.js";
2
2
  export declare const DATABRICKS_AGENT_SERVICES_API = "/api/2.1/unity-catalog/agent-services";
3
3
  export declare const DATABRICKS_AGENT_SERVICE_SECURABLE = "AGENT_SERVICE";
4
4
  export type DatabricksAgentServicePrivilege = "EXECUTE" | "READ_METADATA" | "MANAGE" | "MANAGE_ACCESS_CONTROL" | "ALL_PRIVILEGES";
@@ -73,7 +73,7 @@ export interface DatabricksAgentServicesOptions {
73
73
  */
74
74
  export declare class DatabricksAgentServices {
75
75
  private readonly client;
76
- constructor(client: DatabricksPreviewClient, options: DatabricksAgentServicesOptions);
76
+ constructor(client: DatabricksRawProtocolClient, options: DatabricksAgentServicesOptions);
77
77
  create(options: DatabricksAgentServiceCreateOptions): Promise<DatabricksAgentService>;
78
78
  get(fullName: string): Promise<DatabricksAgentService>;
79
79
  list(options?: {
@@ -88,5 +88,5 @@ export declare class DatabricksAgentServices {
88
88
  grant(fullName: string, principal: string, privileges?: DatabricksAgentServicePrivilege[]): Promise<DatabricksAgentServicePermissions>;
89
89
  revoke(fullName: string, principal: string, privileges?: DatabricksAgentServicePrivilege[]): Promise<DatabricksAgentServicePermissions>;
90
90
  }
91
- export declare function databricksAgentServices(client: DatabricksPreviewClient, options: DatabricksAgentServicesOptions): DatabricksAgentServices;
91
+ export declare function databricksAgentServices(client: DatabricksRawProtocolClient, options: DatabricksAgentServicesOptions): DatabricksAgentServices;
92
92
  //# sourceMappingURL=agent-services.d.ts.map
@@ -1 +1 @@
1
- {"version":3,"file":"agent-services.d.ts","sourceRoot":"","sources":["../src/agent-services.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,EAAE,uBAAuB,EAAE,MAAM,aAAa,CAAC;AAE3D,eAAO,MAAM,6BAA6B,0CAA0C,CAAC;AACrF,eAAO,MAAM,kCAAkC,kBAAkB,CAAC;AAElE,MAAM,MAAM,+BAA+B,GACvC,SAAS,GACT,eAAe,GACf,QAAQ,GACR,uBAAuB,GACvB,gBAAgB,CAAC;AAErB,MAAM,WAAW,gCAAgC;IAC/C,IAAI,EAAE,MAAM,CAAC;CACd;AAED,MAAM,WAAW,4BAA4B;IAC3C,UAAU,EAAE,gCAAgC,CAAC;IAC7C,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB,aAAa,CAAC,EAAE,MAAM,CAAC;CACxB;AAED,MAAM,WAAW,sBAAsB;IACrC,IAAI,EAAE,MAAM,CAAC;IACb,SAAS,CAAC,EAAE,MAAM,GAAG,IAAI,CAAC;IAC1B,KAAK,CAAC,EAAE,MAAM,GAAG,IAAI,CAAC;IACtB,kBAAkB,EAAE,6BAA6B,CAAC;IAClD,OAAO,CAAC,EAAE,MAAM,CAAC;IACjB,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,MAAM,EAAE,4BAA4B,CAAC;CACtC;AAED,MAAM,WAAW,0BAA0B;IACzC,cAAc,CAAC,EAAE,sBAAsB,EAAE,CAAC;IAC1C,eAAe,CAAC,EAAE,MAAM,CAAC;CAC1B;AAED,MAAM,WAAW,mCAAmC;IAClD,OAAO,EAAE,MAAM,CAAC;IAChB,MAAM,EAAE,MAAM,CAAC;IACf,EAAE,EAAE,MAAM,CAAC;IACX,iHAAiH;IACjH,UAAU,EAAE,MAAM,CAAC;IACnB,6EAA6E;IAC7E,QAAQ,CAAC,EAAE,MAAM,CAAC;IAClB,OAAO,CAAC,EAAE,MAAM,CAAC;IACjB,YAAY,CAAC,EAAE,MAAM,CAAC;CACvB;AAED,MAAM,WAAW,mCAAmC;IAClD,OAAO,CAAC,EAAE,MAAM,CAAC;IACjB,QAAQ,CAAC,EAAE,MAAM,CAAC;IAClB,YAAY,CAAC,EAAE,MAAM,CAAC;CACvB;AAED,MAAM,WAAW,gCAAgC;IAC/C,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB,UAAU,CAAC,EAAE,KAAK,CAAC;QACjB,SAAS,CAAC,EAAE,+BAA+B,CAAC;QAC5C,qBAAqB,CAAC,EAAE,MAAM,EAAE,CAAC;KAClC,CAAC,CAAC;CACJ;AAED,MAAM,WAAW,iCAAiC;IAChD,qBAAqB,CAAC,EAAE,gCAAgC,EAAE,CAAC;CAC5D;AAED,MAAM,WAAW,iCAAiC;IAChD,SAAS,EAAE,MAAM,CAAC;IAClB,GAAG,CAAC,EAAE,+BAA+B,EAAE,CAAC;IACxC,MAAM,CAAC,EAAE,+BAA+B,EAAE,CAAC;CAC5C;AAED,MAAM,WAAW,8BAA8B;IAC7C;;;OAGG;IACH,eAAe,EAAE,IAAI,CAAC;CACvB;AAED;;;;;;GAMG;AACH,qBAAa,uBAAuB;IAEhC,OAAO,CAAC,QAAQ,CAAC,MAAM;gBAAN,MAAM,EAAE,uBAAuB,EAChD,OAAO,EAAE,8BAA8B;IAOzC,MAAM,CAAC,OAAO,EAAE,mCAAmC,GAAG,OAAO,CAAC,sBAAsB,CAAC;IAqBrF,GAAG,CAAC,QAAQ,EAAE,MAAM,GAAG,OAAO,CAAC,sBAAsB,CAAC;IAItD,IAAI,CACF,OAAO,GAAE;QAAE,OAAO,CAAC,EAAE,MAAM,CAAC;QAAC,MAAM,CAAC,EAAE,MAAM,CAAC;QAAC,SAAS,CAAC,EAAE,MAAM,CAAA;KAAO,GACtE,OAAO,CAAC,0BAA0B,CAAC;IActC,MAAM,CACJ,QAAQ,EAAE,MAAM,EAChB,OAAO,EAAE,mCAAmC,GAC3C,OAAO,CAAC,sBAAsB,CAAC;IA+BlC,MAAM,CAAC,QAAQ,EAAE,MAAM,GAAG,OAAO,CAAC,IAAI,CAAC;IAUvC,WAAW,CAAC,QAAQ,EAAE,MAAM,GAAG,OAAO,CAAC,iCAAiC,CAAC;IAIzE,iBAAiB,CACf,QAAQ,EAAE,MAAM,EAChB,OAAO,EAAE,iCAAiC,EAAE,GAC3C,OAAO,CAAC,iCAAiC,CAAC;IAsB7C,KAAK,CACH,QAAQ,EAAE,MAAM,EAChB,SAAS,EAAE,MAAM,EACjB,UAAU,GAAE,+BAA+B,EAAgB,GAC1D,OAAO,CAAC,iCAAiC,CAAC;IAI7C,MAAM,CACJ,QAAQ,EAAE,MAAM,EAChB,SAAS,EAAE,MAAM,EACjB,UAAU,GAAE,+BAA+B,EAAgB,GAC1D,OAAO,CAAC,iCAAiC,CAAC;CAG9C;AAED,wBAAgB,uBAAuB,CACrC,MAAM,EAAE,uBAAuB,EAC/B,OAAO,EAAE,8BAA8B,GACtC,uBAAuB,CAEzB"}
1
+ {"version":3,"file":"agent-services.d.ts","sourceRoot":"","sources":["../src/agent-services.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,EAAE,2BAA2B,EAAE,MAAM,0BAA0B,CAAC;AAE5E,eAAO,MAAM,6BAA6B,0CAA0C,CAAC;AACrF,eAAO,MAAM,kCAAkC,kBAAkB,CAAC;AAElE,MAAM,MAAM,+BAA+B,GACvC,SAAS,GACT,eAAe,GACf,QAAQ,GACR,uBAAuB,GACvB,gBAAgB,CAAC;AAErB,MAAM,WAAW,gCAAgC;IAC/C,IAAI,EAAE,MAAM,CAAC;CACd;AAED,MAAM,WAAW,4BAA4B;IAC3C,UAAU,EAAE,gCAAgC,CAAC;IAC7C,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB,aAAa,CAAC,EAAE,MAAM,CAAC;CACxB;AAED,MAAM,WAAW,sBAAsB;IACrC,IAAI,EAAE,MAAM,CAAC;IACb,SAAS,CAAC,EAAE,MAAM,GAAG,IAAI,CAAC;IAC1B,KAAK,CAAC,EAAE,MAAM,GAAG,IAAI,CAAC;IACtB,kBAAkB,EAAE,6BAA6B,CAAC;IAClD,OAAO,CAAC,EAAE,MAAM,CAAC;IACjB,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,MAAM,EAAE,4BAA4B,CAAC;CACtC;AAED,MAAM,WAAW,0BAA0B;IACzC,cAAc,CAAC,EAAE,sBAAsB,EAAE,CAAC;IAC1C,eAAe,CAAC,EAAE,MAAM,CAAC;CAC1B;AAED,MAAM,WAAW,mCAAmC;IAClD,OAAO,EAAE,MAAM,CAAC;IAChB,MAAM,EAAE,MAAM,CAAC;IACf,EAAE,EAAE,MAAM,CAAC;IACX,iHAAiH;IACjH,UAAU,EAAE,MAAM,CAAC;IACnB,6EAA6E;IAC7E,QAAQ,CAAC,EAAE,MAAM,CAAC;IAClB,OAAO,CAAC,EAAE,MAAM,CAAC;IACjB,YAAY,CAAC,EAAE,MAAM,CAAC;CACvB;AAED,MAAM,WAAW,mCAAmC;IAClD,OAAO,CAAC,EAAE,MAAM,CAAC;IACjB,QAAQ,CAAC,EAAE,MAAM,CAAC;IAClB,YAAY,CAAC,EAAE,MAAM,CAAC;CACvB;AAED,MAAM,WAAW,gCAAgC;IAC/C,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB,UAAU,CAAC,EAAE,KAAK,CAAC;QACjB,SAAS,CAAC,EAAE,+BAA+B,CAAC;QAC5C,qBAAqB,CAAC,EAAE,MAAM,EAAE,CAAC;KAClC,CAAC,CAAC;CACJ;AAED,MAAM,WAAW,iCAAiC;IAChD,qBAAqB,CAAC,EAAE,gCAAgC,EAAE,CAAC;CAC5D;AAED,MAAM,WAAW,iCAAiC;IAChD,SAAS,EAAE,MAAM,CAAC;IAClB,GAAG,CAAC,EAAE,+BAA+B,EAAE,CAAC;IACxC,MAAM,CAAC,EAAE,+BAA+B,EAAE,CAAC;CAC5C;AAED,MAAM,WAAW,8BAA8B;IAC7C;;;OAGG;IACH,eAAe,EAAE,IAAI,CAAC;CACvB;AAED;;;;;;GAMG;AACH,qBAAa,uBAAuB;IAEhC,OAAO,CAAC,QAAQ,CAAC,MAAM;gBAAN,MAAM,EAAE,2BAA2B,EACpD,OAAO,EAAE,8BAA8B;IAOzC,MAAM,CAAC,OAAO,EAAE,mCAAmC,GAAG,OAAO,CAAC,sBAAsB,CAAC;IAqBrF,GAAG,CAAC,QAAQ,EAAE,MAAM,GAAG,OAAO,CAAC,sBAAsB,CAAC;IAItD,IAAI,CACF,OAAO,GAAE;QAAE,OAAO,CAAC,EAAE,MAAM,CAAC;QAAC,MAAM,CAAC,EAAE,MAAM,CAAC;QAAC,SAAS,CAAC,EAAE,MAAM,CAAA;KAAO,GACtE,OAAO,CAAC,0BAA0B,CAAC;IActC,MAAM,CACJ,QAAQ,EAAE,MAAM,EAChB,OAAO,EAAE,mCAAmC,GAC3C,OAAO,CAAC,sBAAsB,CAAC;IA8BlC,MAAM,CAAC,QAAQ,EAAE,MAAM,GAAG,OAAO,CAAC,IAAI,CAAC;IAIvC,WAAW,CAAC,QAAQ,EAAE,MAAM,GAAG,OAAO,CAAC,iCAAiC,CAAC;IAIzE,iBAAiB,CACf,QAAQ,EAAE,MAAM,EAChB,OAAO,EAAE,iCAAiC,EAAE,GAC3C,OAAO,CAAC,iCAAiC,CAAC;IAqB7C,KAAK,CACH,QAAQ,EAAE,MAAM,EAChB,SAAS,EAAE,MAAM,EACjB,UAAU,GAAE,+BAA+B,EAAgB,GAC1D,OAAO,CAAC,iCAAiC,CAAC;IAI7C,MAAM,CACJ,QAAQ,EAAE,MAAM,EAChB,SAAS,EAAE,MAAM,EACjB,UAAU,GAAE,+BAA+B,EAAgB,GAC1D,OAAO,CAAC,iCAAiC,CAAC;CAG9C;AAED,wBAAgB,uBAAuB,CACrC,MAAM,EAAE,2BAA2B,EACnC,OAAO,EAAE,8BAA8B,GACtC,uBAAuB,CAEzB"}