sequel-bigquery 0.4.2 → 0.5.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: e444c2d4a5c6b54b5a1bb0efde17e1dd83761ec53f1b796f5e959646bd37f315
-  data.tar.gz: 41875a2325c00eb26786fbd3ab8430e9880b93d795a18b000bff3dd75ed0ea47
+  metadata.gz: c37139c40fd486391d9d16ab147430352b67a1a2b5a55f7eed4189c368b5e87a
+  data.tar.gz: e3753842a9727cf53451ff80ac9abc250343a719d4215ab368c5a93a9d2b4830
 SHA512:
-  metadata.gz: 725fce3447e58e75c5cf817d736322c567661752d1b2d2f4f45aa0ce712825e8792214d1f56313272d8a84facdadff51f63ee4a6b3bda1b8c55d92a80a826798
-  data.tar.gz: 3aa8900e8fba7400049e8f83879998b246296e1705d01b25f2a1cf20855cf8faeea09b9d7e4cb7280b2783296d0a27f61ed295275089d6de311c256c5f7ea763
+  metadata.gz: 6189f0b53a6edd9d66c915316ce8e9e8c836181609405b54e246c0dbe5451bce995c6f5b73e7b320624c35b62bfd66874757734f839ef7f9023dbc099271b2a4
+  data.tar.gz: 715b5adbdb6e225ca9af37363fbc30b59bde54a0b4602d91afcca93506cac541d252b31767571605ee555f2fdaad8d316ccf67a083354bfdcc9cd5f925c51646

data/README.md

@@ -13,6 +13,11 @@ Beyond migrations, I'm unsure how useful this gem is. I haven't yet tested what
 <!-- MarkdownTOC autolink=true -->
 
 - [Intro](#intro)
+- [Quirks](#quirks)
+  - [Creating tables with column defaults](#creating-tables-with-column-defaults)
+  - [Transactions](#transactions)
+  - [Update statements without `WHERE`](#update-statements-without-where)
+  - [Alter table](#alter-table)
 - [Installation](#installation)
 - [Usage](#usage)
 - [Contributing](#contributing)
@@ -29,12 +34,12 @@ Beyond migrations, I'm unsure how useful this gem is. I haven't yet tested what
 Features:
 
 - Connecting
-- Migrating
-- Table creation, with automatic removal of defaults from statements (since BigQuery doesn't support it)
+- Migrating (see quirks)
+- Table creation (see quirks)
 - Inserting rows
-- Updating rows, with automatic addition of `where 1 = 1` to statements (since BigQuery requires a `where` clause)
+- Updating rows (see quirks)
 - Querying
-- Transactions (buffered since BigQuery only supports them when you execute the whole transaction at once)
+- Transactions (see quirks)
 - Table partitioning
 - Ruby types:
   + String
@@ -46,6 +51,24 @@ Features:
   + BigDecimal
 - Selecting the BigQuery server location
 
+## Quirks
+
+### Creating tables with column defaults
+
+BigQuery doesn't support defaults on columns. As a workaround, all defaults are automatically removed from statements (crudely).
+
+### Transactions
+
+BigQuery doesn't support transactions where the statements are executed individually. It does support them if entire transaction SQL is sent all at once though. As a workaround, buffering of statements within a transaction has been implemented. However, the impact of this is that no results can be returned within a transaction.
+
+### Update statements without `WHERE`
+
+BigQuery requires all `UPDATE` statement to have a `WHERE` clause. As a workaround, statements which lack one have `where 1 = 1` appended automatically (crudely).
+
+### Alter table
+
+We've found that the `google-cloud-bigquery` gem seems to have a bug where an internal lack of result value results in a `NoMethodError` on nil for `fields` within `from_gapi_json`. [See issue #6](https://github.com/ZimbiX/sequel-bigquery/issues/6#issuecomment-968523731). As a workaround, all generated statements within `alter_table` are joined together with `;` and executed only at the end of the block. A `select 1` is also appended to try to ensure we have a result to avoid the aforementioned exception. A bonus of batching the queries is that the latency should be somewhat reduced.
+
 ## Installation
 
 Add it to the `Gemfile` of your project:

data/lib/sequel-bigquery.rb

@@ -209,6 +209,13 @@ module Sequel
 
         sql
       end
+
+      # Batch the alter table queries and make sure something is returned to avoid an error related to the return value
+      def apply_alter_table(name, ops)
+        sqls = alter_table_sql_list(name, ops)
+        sqls_joined = (sqls + ['select 1']).join(";\n")
+        execute_ddl(sqls_joined)
+      end
     end
 
     class Dataset < Sequel::Dataset

data/lib/sequel_bigquery/version.rb

@@ -2,6 +2,6 @@
 
 module Sequel
   module Bigquery
-    VERSION = '0.4.2'
+    VERSION = '0.5.0'
   end
 end

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: sequel-bigquery
 version: !ruby/object:Gem::Version
-  version: 0.4.2
+  version: 0.5.0
 platform: ruby
 authors:
 - Brendan Weibrecht
 autorequire:
 bindir: exe
 cert_chain: []
-date: 2021-11-08 00:00:00.000000000 Z
+date: 2021-11-15 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: amazing_print