ydb-sqlglot-plugin 0.2.2__tar.gz → 0.2.4__tar.gz

{ydb_sqlglot_plugin-0.2.2 → ydb_sqlglot_plugin-0.2.4}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: ydb-sqlglot-plugin
-Version: 0.2.2
+Version: 0.2.4
 Summary: YDB dialect plugin for sqlglot
 Author: YDB Team
 License: Apache-2.0
@@ -102,6 +102,31 @@ LEFT JOIN (
 
 The same rewriting applies to `EXISTS`, `IN (subquery)`, and `ANY/ALL` subqueries.
 
+#### GROUP BY aliases
+
+YDB accepts aliases directly inside `GROUP BY` items. The generator uses this
+form for grouped columns so later clauses and decorrelated subqueries can refer
+to a stable grouping name:
+
+```sql
+-- input
+SELECT user_id, COUNT(*) FROM events GROUP BY user_id
+
+-- output
+SELECT user_id, COUNT(*) FROM `events` GROUP BY user_id AS user_id
+```
+
+If a grouped column is selected under a generated alias, the `GROUP BY` item uses
+that alias as well:
+
+```sql
+SELECT user_id AS _u_1, COUNT(*) FROM `events` GROUP BY user_id AS _u_1
+```
+
+Positional `GROUP BY` references are expanded before generation. When a
+positional reference points to a constant expression, the grouping item is
+removed because YDB rejects grouping by constants.
+
 ---
 
 ### YDB → any SQL
@@ -115,15 +140,27 @@ The plugin parses YDB/YQL back into sqlglot's AST, enabling round-trips, YDB-to-
 | `$variable` references | `SELECT * FROM $t AS t` |
 | `Module::Function()` | `DateTime::GetYear(ts)` |
 | `DECLARE $p AS Type` | `DECLARE $p AS Int32` |
-| `FLATTEN [LIST\|DICT] BY col` | `FROM t FLATTEN LIST BY col` |
+| `FLATTEN [LIST\|DICT\|OPTIONAL] BY ...` / `FLATTEN COLUMNS` | `FROM t FLATTEN LIST BY col AS item`, `FROM t FLATTEN BY (a, b)`, `FROM t FLATTEN COLUMNS` |
 | `Optional<T>` / `T?` | `CAST(x AS Optional<Utf8>)` |
 | Container types | `CAST(x AS List<Int32>)`, `Dict<Utf8, Int64>`, `Set<Utf8>`, `Tuple<Int32, Utf8>` |
 | `ASSUME ORDER BY` | `SELECT * FROM t ASSUME ORDER BY id` |
+| `GROUP BY expr AS alias` / `GROUP COMPACT BY` | `SELECT v, COUNT(*) FROM t GROUP BY v AS v` |
+| `LEFT ONLY JOIN` | `SELECT * FROM a LEFT ONLY JOIN b USING (id)` |
+| `* WITHOUT (...)` projections | `SELECT b.* WITHOUT (b.id) FROM t AS b` |
 | Named expressions | `$t = (SELECT 1 AS x)` |
+| Lambda expressions | `($x, $y?) -> ($x + COALESCE($y, 0))`, `($y) -> { $p = "x"; RETURN $p \|\| $y }` |
+| YQL struct literals | `AsList(<|user_id: "u1", description: NULL|>)` |
+| `IN COMPACT` | `WHERE key IN COMPACT $values` |
 | `PRAGMA` | `PRAGMA AnsiImplicitCrossJoin` |
+| Table-valued functions | `SELECT * FROM AS_TABLE($Input) AS k` |
+| Table source options and index views | ``FROM `t` WITH TabletId='...'``, ``FROM `t` VIEW PRIMARY KEY v`` |
+| Function-valued expressions | `$grep(x)`, `DateTime::Format("%Y-%m-%d")(ts)`, `Interval("P7D")` |
 
 Table names without backticks are accepted on input; the generator always produces backtick-quoted output.
 
+The parser also tolerates case variants that appear in real YQL dumps, such as
+`set<Utf8>`, `Tuple<Int32, Utf8>?`, and lowercase `return` in lambda blocks.
+
 #### CTEs reassembly
 
 YDB-style named expressions are automatically reassembled into standard `WITH` CTEs when targeting other dialects:
@@ -179,6 +216,7 @@ Functions below are recognized by sqlglot as standard SQL expressions and transl
 | `INTERVAL n HOUR` (literal) | `DateTime::IntervalFromHours(n)` |
 | `INTERVAL n MINUTE` (literal) | `DateTime::IntervalFromMinutes(n)` |
 | `INTERVAL n SECOND` (literal) | `DateTime::IntervalFromSeconds(n)` |
+| `Interval("P7D")` (YQL input) | passed through unchanged |
 | `dateDiff('minute', a, b)` | `(CAST(b AS Int64) - CAST(a AS Int64)) / 60000000` |
 | `dateDiff('hour', a, b)` | `(CAST(b AS Int64) - CAST(a AS Int64)) / 3600000000` |
 | `dateDiff('day', a, b)` | `(CAST(b AS Int64) - CAST(a AS Int64)) / 86400000000` |
@@ -204,11 +242,34 @@ Functions below are recognized by sqlglot as standard SQL expressions and transl
 |---|---|
 | `ARRAY(v1, v2, ...)` | `AsList(v1, v2, ...)` |
 | `ARRAY_LENGTH(x)` / `ARRAY_SIZE(x)` | `ListLength(x)` |
-| `ARRAY_FILTER(arr, x -> cond)` | `ListFilter(arr, ($x) -> {RETURN cond})` |
-| `ARRAY_ANY(arr, x -> cond)` | `ListHasItems(ListFilter(arr, ($x) -> {RETURN cond}))` |
+| `ARRAY_FILTER(arr, x -> cond)` | `ListFilter(arr, ($x) -> (cond))` |
+| `ARRAY_ANY(arr, x -> cond)` | `ListHasItems(ListFilter(arr, ($x) -> (cond)))` |
 | `ARRAY_AGG(x)` | `AGGREGATE_LIST(x)` |
 | `UNNEST(x)` | `FLATTEN BY x` |
 
+Lambda expressions are represented with sqlglot's standard `exp.Lambda` AST node.
+When a source dialect parses lambdas, the YDB generator emits YQL lambda syntax:
+
+```sql
+-- DuckDB input
+SELECT list_filter(arr, x -> x > 0) FROM t
+
+-- YDB output
+SELECT ListFilter(arr, ($x) -> ($x > 0)) FROM `t`
+```
+
+YDB input also supports documented YQL lambda forms, including optional
+arguments and block bodies with local named expressions:
+
+```sql
+($x, $y?) -> ($x + COALESCE($y, 0));
+($y) -> { $prefix = "x"; RETURN $prefix || $y; };
+```
+
+ClickHouse `ARRAY JOIN` and simple `arrayJoin(...)` projections, and PostgreSQL
+`LATERAL unnest(...)`, are converted to YDB `FLATTEN BY` when the operation is
+directly tied to the source table.
+
 ### Conditional / math
 
 | Input | YQL output |
@@ -223,6 +284,18 @@ Functions below are recognized by sqlglot as standard SQL expressions and transl
 |---|---|
 | `jsonb_col @> value` (PostgreSQL) | `Yson::Contains(jsonb_col, value)` |
 
+YDB JSON functions are parsed and round-tripped, including `PASSING`,
+`RETURNING`, wrapper modes, and `ON EMPTY` / `ON ERROR` clauses:
+
+```sql
+JSON_VALUE(payload, '$.value + $delta' PASSING 1 AS delta RETURNING Int64 DEFAULT 0 ON EMPTY ERROR ON ERROR)
+JSON_QUERY(payload, '$.items' WITH CONDITIONAL ARRAY WRAPPER NULL ON EMPTY ERROR ON ERROR)
+JSON_EXISTS(payload, '$.items[$Index]' PASSING 0 AS "Index" FALSE ON ERROR)
+```
+
+JSON paths can contain quoted keys, for example
+`JSON_EXISTS(item_result, "$.'P_008 device playback test'")`.
+
 ---
 
 ## Type mapping

{ydb_sqlglot_plugin-0.2.2 → ydb_sqlglot_plugin-0.2.4}/README.md

@@ -75,6 +75,31 @@ LEFT JOIN (
 
 The same rewriting applies to `EXISTS`, `IN (subquery)`, and `ANY/ALL` subqueries.
 
+#### GROUP BY aliases
+
+YDB accepts aliases directly inside `GROUP BY` items. The generator uses this
+form for grouped columns so later clauses and decorrelated subqueries can refer
+to a stable grouping name:
+
+```sql
+-- input
+SELECT user_id, COUNT(*) FROM events GROUP BY user_id
+
+-- output
+SELECT user_id, COUNT(*) FROM `events` GROUP BY user_id AS user_id
+```
+
+If a grouped column is selected under a generated alias, the `GROUP BY` item uses
+that alias as well:
+
+```sql
+SELECT user_id AS _u_1, COUNT(*) FROM `events` GROUP BY user_id AS _u_1
+```
+
+Positional `GROUP BY` references are expanded before generation. When a
+positional reference points to a constant expression, the grouping item is
+removed because YDB rejects grouping by constants.
+
 ---
 
 ### YDB → any SQL
@@ -88,15 +113,27 @@ The plugin parses YDB/YQL back into sqlglot's AST, enabling round-trips, YDB-to-
 | `$variable` references | `SELECT * FROM $t AS t` |
 | `Module::Function()` | `DateTime::GetYear(ts)` |
 | `DECLARE $p AS Type` | `DECLARE $p AS Int32` |
-| `FLATTEN [LIST\|DICT] BY col` | `FROM t FLATTEN LIST BY col` |
+| `FLATTEN [LIST\|DICT\|OPTIONAL] BY ...` / `FLATTEN COLUMNS` | `FROM t FLATTEN LIST BY col AS item`, `FROM t FLATTEN BY (a, b)`, `FROM t FLATTEN COLUMNS` |
 | `Optional<T>` / `T?` | `CAST(x AS Optional<Utf8>)` |
 | Container types | `CAST(x AS List<Int32>)`, `Dict<Utf8, Int64>`, `Set<Utf8>`, `Tuple<Int32, Utf8>` |
 | `ASSUME ORDER BY` | `SELECT * FROM t ASSUME ORDER BY id` |
+| `GROUP BY expr AS alias` / `GROUP COMPACT BY` | `SELECT v, COUNT(*) FROM t GROUP BY v AS v` |
+| `LEFT ONLY JOIN` | `SELECT * FROM a LEFT ONLY JOIN b USING (id)` |
+| `* WITHOUT (...)` projections | `SELECT b.* WITHOUT (b.id) FROM t AS b` |
 | Named expressions | `$t = (SELECT 1 AS x)` |
+| Lambda expressions | `($x, $y?) -> ($x + COALESCE($y, 0))`, `($y) -> { $p = "x"; RETURN $p \|\| $y }` |
+| YQL struct literals | `AsList(<|user_id: "u1", description: NULL|>)` |
+| `IN COMPACT` | `WHERE key IN COMPACT $values` |
 | `PRAGMA` | `PRAGMA AnsiImplicitCrossJoin` |
+| Table-valued functions | `SELECT * FROM AS_TABLE($Input) AS k` |
+| Table source options and index views | ``FROM `t` WITH TabletId='...'``, ``FROM `t` VIEW PRIMARY KEY v`` |
+| Function-valued expressions | `$grep(x)`, `DateTime::Format("%Y-%m-%d")(ts)`, `Interval("P7D")` |
 
 Table names without backticks are accepted on input; the generator always produces backtick-quoted output.
 
+The parser also tolerates case variants that appear in real YQL dumps, such as
+`set<Utf8>`, `Tuple<Int32, Utf8>?`, and lowercase `return` in lambda blocks.
+
 #### CTEs reassembly
 
 YDB-style named expressions are automatically reassembled into standard `WITH` CTEs when targeting other dialects:
@@ -152,6 +189,7 @@ Functions below are recognized by sqlglot as standard SQL expressions and transl
 | `INTERVAL n HOUR` (literal) | `DateTime::IntervalFromHours(n)` |
 | `INTERVAL n MINUTE` (literal) | `DateTime::IntervalFromMinutes(n)` |
 | `INTERVAL n SECOND` (literal) | `DateTime::IntervalFromSeconds(n)` |
+| `Interval("P7D")` (YQL input) | passed through unchanged |
 | `dateDiff('minute', a, b)` | `(CAST(b AS Int64) - CAST(a AS Int64)) / 60000000` |
 | `dateDiff('hour', a, b)` | `(CAST(b AS Int64) - CAST(a AS Int64)) / 3600000000` |
 | `dateDiff('day', a, b)` | `(CAST(b AS Int64) - CAST(a AS Int64)) / 86400000000` |
@@ -177,11 +215,34 @@ Functions below are recognized by sqlglot as standard SQL expressions and transl
 |---|---|
 | `ARRAY(v1, v2, ...)` | `AsList(v1, v2, ...)` |
 | `ARRAY_LENGTH(x)` / `ARRAY_SIZE(x)` | `ListLength(x)` |
-| `ARRAY_FILTER(arr, x -> cond)` | `ListFilter(arr, ($x) -> {RETURN cond})` |
-| `ARRAY_ANY(arr, x -> cond)` | `ListHasItems(ListFilter(arr, ($x) -> {RETURN cond}))` |
+| `ARRAY_FILTER(arr, x -> cond)` | `ListFilter(arr, ($x) -> (cond))` |
+| `ARRAY_ANY(arr, x -> cond)` | `ListHasItems(ListFilter(arr, ($x) -> (cond)))` |
 | `ARRAY_AGG(x)` | `AGGREGATE_LIST(x)` |
 | `UNNEST(x)` | `FLATTEN BY x` |
 
+Lambda expressions are represented with sqlglot's standard `exp.Lambda` AST node.
+When a source dialect parses lambdas, the YDB generator emits YQL lambda syntax:
+
+```sql
+-- DuckDB input
+SELECT list_filter(arr, x -> x > 0) FROM t
+
+-- YDB output
+SELECT ListFilter(arr, ($x) -> ($x > 0)) FROM `t`
+```
+
+YDB input also supports documented YQL lambda forms, including optional
+arguments and block bodies with local named expressions:
+
+```sql
+($x, $y?) -> ($x + COALESCE($y, 0));
+($y) -> { $prefix = "x"; RETURN $prefix || $y; };
+```
+
+ClickHouse `ARRAY JOIN` and simple `arrayJoin(...)` projections, and PostgreSQL
+`LATERAL unnest(...)`, are converted to YDB `FLATTEN BY` when the operation is
+directly tied to the source table.
+
 ### Conditional / math
 
 | Input | YQL output |
@@ -196,6 +257,18 @@ Functions below are recognized by sqlglot as standard SQL expressions and transl
 |---|---|
 | `jsonb_col @> value` (PostgreSQL) | `Yson::Contains(jsonb_col, value)` |
 
+YDB JSON functions are parsed and round-tripped, including `PASSING`,
+`RETURNING`, wrapper modes, and `ON EMPTY` / `ON ERROR` clauses:
+
+```sql
+JSON_VALUE(payload, '$.value + $delta' PASSING 1 AS delta RETURNING Int64 DEFAULT 0 ON EMPTY ERROR ON ERROR)
+JSON_QUERY(payload, '$.items' WITH CONDITIONAL ARRAY WRAPPER NULL ON EMPTY ERROR ON ERROR)
+JSON_EXISTS(payload, '$.items[$Index]' PASSING 0 AS "Index" FALSE ON ERROR)
+```
+
+JSON paths can contain quoted keys, for example
+`JSON_EXISTS(item_result, "$.'P_008 device playback test'")`.
+
 ---
 
 ## Type mapping

{ydb_sqlglot_plugin-0.2.2 → ydb_sqlglot_plugin-0.2.4}/pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta"
 
 [project]
 name = "ydb-sqlglot-plugin"
-version = "0.2.2"  # AUTOVERSION
+version = "0.2.4"  # AUTOVERSION
 description = "YDB dialect plugin for sqlglot"
 readme = "README.md"
 license = {text = "Apache-2.0"}

ydb_sqlglot_plugin-0.2.4/ydb_sqlglot/version.py

@@ -0,0 +1 @@
+VERSION = "0.2.4"