databricks-sql-kernel 1.1.0__tar.gz → 1.2.0__tar.gz

{databricks_sql_kernel-1.1.0 → databricks_sql_kernel-1.2.0}/CHANGELOG.md

@@ -14,6 +14,67 @@ cadences and may not move in lockstep with the crate.
 
 ### Fixed
 
+## [v1.2.0] - 2026-10-19
+
+### Added
+- Thrift-native metadata routing with compatible public-schema casts and
+  one-based `getColumns` ordinals.
+- Native Arrow `GEOMETRY` / `GEOGRAPHY` results as tagged `struct<srid,wkb>`
+  values, including nested values and empty-result schemas. The kernel uses
+  the structured logical manifest to reconcile attachments without copying
+  child buffers.
+- Typed client-side `GEOMETRY` / `GEOGRAPHY` result representation selection.
+  The kernel normalizes both standard-warehouse WKT / EWKT and Reyden's native
+  SRID+WKB struct to the requested representation. No representation setting
+  is sent to SEA.
+- The default-enabled `kernel_session_config_set_enable_geospatial_support()`
+  C ABI setting selects native SRID+WKB Arrow results when enabled and
+  WKT / EWKT strings when disabled.
+- Authenticated connector-service feature flags with a bounded, process-wide
+  workspace cache and kernel-internal typed readers for all six SAFE types.
+- Result schemas carry the Thrift-compatible `Spark:DataType:SqlName` and
+  optional `Spark:DataType:JsonType` field metadata from the SEA manifest.
+- Caller-driven asynchronous statement submission, status polling, result
+  materialization, query IDs, row counts, cancellation, and close over the C ABI.
+- Nonblocking result-batch fetching through Rust `try_next_batch()` and the C ABI.
+- `Statement::submit_with_timeout()` enforces one client deadline across
+  submission and asynchronous status polling, with cancellation on expiry.
+
+### Changed
+- Native SRID+WKB is now the default geospatial result representation.
+- Route function metadata through the Thrift-native metadata path when
+  supported by the server.
+- Authenticated SEA requests use `Accept-Encoding: identity` by default to
+  avoid gzipping inline LZ4-compressed Arrow results. Response compression can
+  be re-enabled through `HttpConfig` or the C ABI.
+- Feature flags are fetched after kernel authentication and before session
+  creation; sessions read process-cache values instead of retaining snapshots.
+- Kernel telemetry enablement follows the connector-service feature flag when
+  the client leaves it unspecified; explicit client settings take precedence.
+- **Breaking (Rust API):** `TelemetryConfig::enabled` changes from `bool` to
+  `Option<bool>`. `None` defers to the workspace feature flag; use
+  `with_enabled` / `set_enabled` or wrap explicit values in `Some(...)`.
+- A backward-compatible C telemetry-config v2 setter uses nullable config and
+  `has_enabled` to preserve unspecified client enablement.
+- Synchronous `execute()` waits for a terminal server state without the implicit
+  600-second client timeout; explicit execution deadlines remain supported.
+- Inline Arrow result decoding avoids redundant response and attachment copies.
+
+### Updated
+- Updated `quinn-proto` to 0.11.18 to address security scan findings.
+
+### Fixed
+- `list_tables` matches `table_types` case-sensitively, matching Thrift
+  `GetTables`: `["table"]` no longer matches `TABLE` rows.
+- Primary-key metadata resolves missing catalog and schema independently from
+  the current session and preserves explicit empty names.
+- Foreign-key metadata preserves server-provided update and delete rules as
+  nullable `Int16` values.
+- Empty ARRAY result schemas use the Thrift-compatible `element` child name,
+  including nested arrays.
+- M2M and Azure service-principal token exchanges retry transient failures;
+  exhausted transient failures retain their status-based error codes.
+
 ## [v1.1.0] - 2026-09-23
 
 ### Added

{databricks_sql_kernel-1.1.0 → databricks_sql_kernel-1.2.0}/CONNECTION_PARAMETERS.md

@@ -15,6 +15,7 @@ by the struct it lives on. `ConnectionConfig` and `AuthConfig` are
 | [`ProxyConfig`](#proxyconfig--httphttps-proxy-optional) | HTTP/HTTPS proxy |
 | [`TlsConfig`](#tlsconfig--tls--ssl-optional) | cert validation, custom CA, mTLS |
 | [`ResultConfig`](#resultconfig--result-handling-optional) | CloudFetch tuning, type rendering |
+| [`geospatial_result_representation`](#geospatial_result_representation--geospatial-result-encoding-optional) | GEOMETRY / GEOGRAPHY result encoding |
 | [`LoggingConfig`](#loggingconfig--logging-optional) | log filter / file |
 | [`transport`](#transport--wire-protocol-optional) | wire protocol |
 | [`session_conf`](#session_conf--server-side-session-configuration-optional) | server-side SQL / Spark config |
@@ -173,9 +174,45 @@ Setting only one of `client_cert_pem` / `client_key_pem` is rejected at
 | `cloudfetch_link_prefetch_window` | Number of presigned URLs to prefetch ahead of the consumer. | `10` |
 | `cloudfetch_max_chunks_in_memory` | Max decompressed CloudFetch chunks held in memory at once (bounds download parallelism and peak RSS). | `16` |
 | `inline_max_chunks_in_memory` | Prefetch window for the inline-Arrow path (used when CloudFetch is disabled). `1` disables prefetching. | `4` |
-| `complex_types_as_json` | Render complex columns (`ARRAY` / `MAP` / `STRUCT` / `VARIANT` / `GEOMETRY` / `GEOGRAPHY`) as compact JSON strings instead of native Arrow nested types. | `false` |
+| `complex_types_as_json` | Render complex columns (`ARRAY` / `MAP` / `STRUCT` / `VARIANT`) as compact JSON strings instead of native Arrow nested types. Top-level geo columns use `geospatial_result_representation`; nested geo leaves are normalized before the enclosing value is rendered as JSON. | `false` |
 | `intervals_as_string` | Render `INTERVAL` / `DURATION` columns as canonical Databricks text (e.g. `"Y-M"`, `"D HH:MM:SS.nnnnnnnnn"`) instead of native Arrow interval types. | `false` |
 
+## `geospatial_result_representation` — geospatial result encoding (optional)
+
+Set with `SessionBuilder::geospatial_result_representation(...)`. Both modes
+keep the outer result format as Arrow; this setting only selects the physical
+Arrow representation of `GEOMETRY` and `GEOGRAPHY` values.
+
+| Value | Arrow representation |
+|-------|----------------------|
+| `GeospatialResultRepresentation::String` | Arrow `Utf8` containing WKT / EWKT. |
+| `GeospatialResultRepresentation::Binary` | Arrow `struct<srid: int32 not null, wkb: binary not null>` containing the SRID and little-endian OGC WKB. The WKB itself is not EWKB. This is the default. |
+
+Reyden returns every geo value as that native struct; standard DBSQL warehouses
+return WKT / EWKT as Arrow `Utf8` or `LargeUtf8`. The structured manifest
+reports the logical `GEOMETRY(...)` or `GEOGRAPHY(...)` type and is the source
+of truth for either attachment. The kernel normalizes both paths: binary mode
+attaches the canonical tags to a Reyden struct or parses standard-warehouse
+text into the same tagged SRID+WKB struct, while string mode preserves existing
+text or renders a native struct as EWKT. Nested values in arrays, maps, and
+structs, per-row SRIDs, and null outer values are preserved.
+
+This is entirely client-side and is never forwarded to SEA. Set it through
+the typed kernel or binding API. An `EnableGeoSpatialSupport` entry placed
+directly in `session_conf` is not interpreted by the kernel and is forwarded
+unchanged; SEA/Reyden does not define that server configuration.
+
+Bindings expose the same default-enabled boolean as Python
+`enable_geospatial_support`, Node.js `enableGeoSpatialSupport`, and C
+`kernel_session_config_set_enable_geospatial_support`. Enabled returns the
+native SRID+WKB Arrow representation; disabled returns WKT / EWKT strings.
+
+The structured manifest type text is authoritative for identifying geo leaves;
+the attachment supplies the physical values. The same post-processing step
+produces the requested client-facing schema for non-empty and empty results.
+Manifest field metadata preserves the logical type and SRID text under
+`databricks.type_name` and `databricks.type_text`.
+
 ## `LoggingConfig` — logging (optional)
 
 | Field | Description | Default |

{databricks_sql_kernel-1.1.0 → databricks_sql_kernel-1.2.0}/Cargo.lock

@@ -63,6 +63,15 @@ dependencies = [
  "libc",
 ]
 
+[[package]]
+name = "approx"
+version = "0.5.1"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "cab112f0a86d568ea0e627cc1d6be74a1e9cd55214684db5561995f6dad897c6"
+dependencies = [
+ "num-traits",
+]
+
 [[package]]
 name = "arrow-array"
 version = "59.1.0"
@@ -238,11 +247,22 @@ dependencies = [
  "tokio",
 ]
 
+[[package]]
+name = "async-lock"
+version = "3.4.2"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "290f7f2596bd5b78a9fec8088ccd89180d7f9f55b94b0576823bbbdc72ee8311"
+dependencies = [
+ "event-listener",
+ "event-listener-strategy",
+ "pin-project-lite",
+]
+
 [[package]]
 name = "async-trait"
-version = "0.1.91"
+version = "0.1.92"
 source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "ae36dc4177970ef04fde5178d3e2429882def40e57a451f919c098f72baa6cec"
+checksum = "82f6aeea286b8eb4dd3431a1be1b59d290ace00f5bfd8e2a159bc2a05e2c1667"
 dependencies = [
  "proc-macro2",
  "quote",
@@ -346,6 +366,12 @@ version = "3.20.3"
 source = "registry+https://github.com/rust-lang/crates.io-index"
 checksum = "72f5acc6cb2ba439de613abc23857ec3d78374d8ed5ac84e9d11336e87da8649"
 
+[[package]]
+name = "byteorder"
+version = "1.5.0"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "1fd0f2584146f6f2ef48085050886acf353beff7305ebd1ae69500e27c67f64b"
+
 [[package]]
 name = "bytes"
 version = "1.12.1"
@@ -543,6 +569,24 @@ dependencies = [
  "cfg-if",
 ]
 
+[[package]]
+name = "crossbeam-channel"
+version = "0.5.17"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "98b0cc327b5bc766e7fda9c9260cc0fa81b43a8e240440422dff70788e3f9ef1"
+dependencies = [
+ "crossbeam-utils",
+]
+
+[[package]]
+name = "crossbeam-epoch"
+version = "0.9.21"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "dc74980687109a3b14c72fd458107bf0baa1da1a1a805e178d15501ba9b86d9d"
+dependencies = [
+ "crossbeam-utils",
+]
+
 [[package]]
 name = "crossbeam-utils"
 version = "0.8.22"
@@ -617,7 +661,7 @@ checksum = "4583a4551df46e2792f82ceeac45e850d2e2d5debba0b91f102385cda5b11f06"
 
 [[package]]
 name = "databricks-sql-kernel"
-version = "1.1.0"
+version = "1.2.0"
 dependencies = [
  "aes 0.9.2",
  "arrow-array",
@@ -634,11 +678,13 @@ dependencies = [
  "dashmap",
  "dirs",
  "futures",
+ "geo-traits",
  "hex",
  "hmac 0.13.0",
  "jsonwebtoken",
  "log",
  "lz4_flex",
+ "moka",
  "oauth2",
  "open",
  "p256",
@@ -660,6 +706,8 @@ dependencies = [
  "tracing",
  "tracing-subscriber",
  "wiremock",
+ "wkb",
+ "wkt",
  "zeroize",
 ]
 
@@ -818,6 +866,26 @@ dependencies = [
  "windows-sys 0.61.2",
 ]
 
+[[package]]
+name = "event-listener"
+version = "5.4.2"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "5a23add41df1562121a9393cb065eab5146a1242410f23a644851e90cfd669d2"
+dependencies = [
+ "parking",
+ "pin-project-lite",
+]
+
+[[package]]
+name = "event-listener-strategy"
+version = "0.5.4"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "8be9f3dfaaffdae2972880079a491a1a8bb7cbed0b8dd7a347f668b4150a3b93"
+dependencies = [
+ "event-listener",
+ "pin-project-lite",
+]
+
 [[package]]
 name = "fastrand"
 version = "2.4.1"
@@ -989,6 +1057,27 @@ dependencies = [
  "zeroize",
 ]
 
+[[package]]
+name = "geo-traits"
+version = "0.3.0"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "2e7c353d12a704ccfab1ba8bfb1a7fe6cb18b665bf89d37f4f7890edcd260206"
+dependencies = [
+ "geo-types",
+]
+
+[[package]]
+name = "geo-types"
+version = "0.7.20"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "777d18aa0f12f8b285331cd867133ee14422b3f023f6d388034c47d43e28786a"
+dependencies = [
+ "approx",
+ "num-traits",
+ "serde",
+ "thiserror 2.0.19",
+]
+
 [[package]]
 name = "getrandom"
 version = "0.2.17"
@@ -1630,6 +1719,26 @@ dependencies = [
  "windows-sys 0.61.2",
 ]
 
+[[package]]
+name = "moka"
+version = "0.12.16"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "4293f18e7567a1caf3c584855554377025c65e0aa445344d04171f5ad63d19b9"
+dependencies = [
+ "async-lock",
+ "crossbeam-channel",
+ "crossbeam-epoch",
+ "crossbeam-utils",
+ "equivalent",
+ "event-listener",
+ "futures-util",
+ "parking_lot",
+ "portable-atomic",
+ "smallvec",
+ "tagptr",
+ "uuid",
+]
+
 [[package]]
 name = "native-tls"
 version = "0.2.18"
@@ -1746,6 +1855,28 @@ dependencies = [
  "libc",
 ]
 
+[[package]]
+name = "num_enum"
+version = "0.7.6"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "5d0bca838442ec211fa11de3a8b0e0e8f3a4522575b5c4c06ed722e005036f26"
+dependencies = [
+ "num_enum_derive",
+ "rustversion",
+]
+
+[[package]]
+name = "num_enum_derive"
+version = "0.7.6"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "680998035259dcfcafe653688bf2aa6d3e2dc05e98be6ab46afb089dc84f1df8"
+dependencies = [
+ "proc-macro-crate",
+ "proc-macro2",
+ "quote",
+ "syn 2.0.118",
+]
+
 [[package]]
 name = "oauth2"
 version = "5.0.0"
@@ -1852,6 +1983,12 @@ dependencies = [
  "sha2 0.10.9",
 ]
 
+[[package]]
+name = "parking"
+version = "2.2.1"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "f38d5652c16fde515bb1ecef450ab0f6a219d619a7274976324d5e377f7dceba"
+
 [[package]]
 name = "parking_lot"
 version = "0.12.5"
@@ -1970,6 +2107,12 @@ version = "0.3.33"
 source = "registry+https://github.com/rust-lang/crates.io-index"
 checksum = "19f132c84eca552bf34cab8ec81f1c1dcc229b811638f9d283dceabe58c5569e"
 
+[[package]]
+name = "portable-atomic"
+version = "1.15.0"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "05c8b63e8d9609db387f0324918f81d68fe27748f084ef092fb35954d0539a85"
+
 [[package]]
 name = "potential_utf"
 version = "0.1.5"
@@ -2003,6 +2146,15 @@ dependencies = [
  "elliptic-curve",
 ]
 
+[[package]]
+name = "proc-macro-crate"
+version = "3.5.0"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "e67ba7e9b2b56446f1d419b1d807906278ffa1a658a8a5d8a39dcb1f5a78614f"
+dependencies = [
+ "toml_edit",
+]
+
 [[package]]
 name = "proc-macro2"
 version = "1.0.106"
@@ -2034,9 +2186,9 @@ dependencies = [
 
 [[package]]
 name = "quinn-proto"
-version = "0.11.16"
+version = "0.11.18"
 source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "2f4bfc015262b9df63c8845072ce59068853ff5872180c2ce2f13038b970e560"
+checksum = "a9746dbde176634f4f2f1faf2404e30a31b2bc1e9cafb5329c95d8177a18c9fc"
 dependencies = [
  "bytes",
  "getrandom 0.4.3",
@@ -2704,6 +2856,12 @@ dependencies = [
  "syn 2.0.118",
 ]
 
+[[package]]
+name = "tagptr"
+version = "0.2.0"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "7b2093cf4c8eb1e67749a6762251bc9cd836b6fc171623bd0a9d324d37af2417"
+
 [[package]]
 name = "tempfile"
 version = "3.27.0"
@@ -2892,6 +3050,36 @@ dependencies = [
  "tokio",
 ]
 
+[[package]]
+name = "toml_datetime"
+version = "1.1.1+spec-1.1.0"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "3165f65f62e28e0115a00b2ebdd37eb6f3b641855f9d636d3cd4103767159ad7"
+dependencies = [
+ "serde_core",
+]
+
+[[package]]
+name = "toml_edit"
+version = "0.25.15+spec-1.1.0"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "1340ea94a5856333492c9064b02c778b191dd2c853778d9609debdcdfea3a614"
+dependencies = [
+ "indexmap",
+ "toml_datetime",
+ "toml_parser",
+ "winnow",
+]
+
+[[package]]
+name = "toml_parser"
+version = "1.1.3+spec-1.1.0"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "1d38ac1cf9b95face32296c0a3ede1fdc270627c9d9c02a7274dd6d960dc4d56"
+dependencies = [
+ "winnow",
+]
+
 [[package]]
 name = "tower"
 version = "0.5.3"
@@ -3053,6 +3241,17 @@ version = "1.0.4"
 source = "registry+https://github.com/rust-lang/crates.io-index"
 checksum = "b6c140620e7ffbb22c2dee59cafe6084a59b5ffc27a8859a5f0d494b5d52b6be"
 
+[[package]]
+name = "uuid"
+version = "1.26.1"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "2ef6dac1e96601b4fb3acccccff2139741fcb757cb9a36089bf5be91cfb285ce"
+dependencies = [
+ "getrandom 0.4.3",
+ "js-sys",
+ "wasm-bindgen",
+]
+
 [[package]]
 name = "valuable"
 version = "0.1.1"
@@ -3333,6 +3532,15 @@ version = "0.52.6"
 source = "registry+https://github.com/rust-lang/crates.io-index"
 checksum = "589f6da84c646204747d1270a2a5661ea66ed1cced2631d546fdfb155959f9ec"
 
+[[package]]
+name = "winnow"
+version = "1.0.4"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "23b97319f7b8343df12cc98938e5c3eb436064524c8d2b4e30a1d3a36eecdf81"
+dependencies = [
+ "memchr",
+]
+
 [[package]]
 name = "wiremock"
 version = "0.6.5"
@@ -3362,6 +3570,30 @@ version = "0.57.1"
 source = "registry+https://github.com/rust-lang/crates.io-index"
 checksum = "1ebf944e87a7c253233ad6766e082e3cd714b5d03812acc24c318f549614536e"
 
+[[package]]
+name = "wkb"
+version = "0.9.2"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "a120b336c7ad17749026d50427c23d838ecb50cd64aaea6254b5030152f890a9"
+dependencies = [
+ "byteorder",
+ "geo-traits",
+ "num_enum",
+ "thiserror 1.0.69",
+]
+
+[[package]]
+name = "wkt"
+version = "0.14.0"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "efb2b923ccc882312e559ffaa832a055ba9d1ac0cc8e86b3e25453247e4b81d7"
+dependencies = [
+ "geo-traits",
+ "log",
+ "num-traits",
+ "thiserror 1.0.69",
+]
+
 [[package]]
 name = "writeable"
 version = "0.6.3"

{databricks_sql_kernel-1.1.0 → databricks_sql_kernel-1.2.0}/Cargo.toml

@@ -14,7 +14,7 @@
 
 [package]
 name = "databricks-sql-kernel"
-version = "1.1.0"
+version = "1.2.0"
 edition = "2021"
 authors = ["Databricks"]
 license = "Apache-2.0"
@@ -68,6 +68,9 @@ serde = { version = "1", features = ["derive"] }
 serde_json = "1"
 base64 = "0.22"
 hex = "0.4"          # Hex encoding (binary param literals, token cache key)
+wkb = "0.9.2"       # OGC WKB parser for geospatial result rendering
+geo-traits = "0.3"  # Generic geometry traversal for WKB-to-EWKT rendering
+wkt = { version = "0.14", default-features = false } # OGC WKT parser for legacy SEA results
 
 # Date/time handling
 chrono = { version = "0.4", features = ["serde"] }
@@ -80,6 +83,7 @@ rand = "0.10"
 
 # Concurrent data structures
 dashmap = "6"
+moka = { version = "0.12.16", features = ["future"] }
 
 # Async utilities
 futures = "0.3"

{databricks_sql_kernel-1.1.0 → databricks_sql_kernel-1.2.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: databricks-sql-kernel
-Version: 1.1.0
+Version: 1.2.0
 Requires-Dist: pyarrow>=23.0.1,<24 ; python_full_version >= '3.10'
 Requires-Dist: pyarrow>=14,<19 ; python_full_version < '3.10'
 Summary: Python bindings for the Databricks SQL Kernel (PyO3)

{databricks_sql_kernel-1.1.0 → databricks_sql_kernel-1.2.0}/docs/designs/kernel-telemetry-design.md

@@ -339,7 +339,7 @@ should follow ADBC unless product owners choose a kernel-specific endpoint:
 - Endpoint format currently used by ADBC:
 `/api/2.0/connector-service/feature-flags/ADBC/{driver_version}`.
 - Existing server-side flag:
-`databricks.partnerplatform.clientConfigsFeatureFlags.enableTelemetryForAdbc`.
+`databricks.partnerplatform.clientConfigsFeatureFlags.enableTelemetryForKernel`.
 
 If the kernel needs separate rollout from ADBC, introduce a kernel-specific flag
 only after the backend/dashboard owner confirms the split. Do not fall back to

{databricks_sql_kernel-1.1.0 → databricks_sql_kernel-1.2.0}/docs/spec-v0.md

@@ -644,7 +644,7 @@ impl Statement {
     /// Read-only access (for logging or assertion).
     pub fn spec_ref(&self) -> &StatementSpec;
 
-    /// Wait-for-result execution with the existing 600s polling ceiling.
+    /// Wait-for-result execution without an overall client polling deadline.
     pub async fn execute(&mut self) -> Result<ExecutedStatement>;
 
     /// Execute with a client deadline through terminal-state mapping.