google-cloud-bigquery 1.52.1 → 1.61.1

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: eebf05291009387d9603457ebcd1012db3b5090e229847394ac56dec3fdb478a
-  data.tar.gz: 37e8964677c24c906bc766d2d94f6fffeee743990013c47d73faff07bb591c46
+  metadata.gz: 3b011fdd6daa487b99c4c1bf684f3952f9cd380743048c5a314241750a01fbf3
+  data.tar.gz: d7668277ad007c19d12b06c8cf6fd02695345dea12a1e6f9d3ac573bc5c70e45
 SHA512:
-  metadata.gz: 6b7e701313f055af34b881cf8fbad6bb11cf86a5782a3e65d0849eaf8b596cd9ffe046de536f9b222fdfc1fb3024d8db398f860330e60372244b06e6c996c83e
-  data.tar.gz: 118423b6a2db399957b190395e0ea1e44fb4474d1215cd126c2d564607ac7429a93a1a509d3682ba15b8027f0ee58f30fdddba253bb8fdbabc4ed999343444b4
+  metadata.gz: a85f76563d165c7fecb23040c2f46a55edb0a89bb0564520fe1d95ac2a5e34862f5375adbefabd1764cab3fb888dfe40574b7b92d7292a297db5647d7e9fb121
+  data.tar.gz: ac10adf9544cf44fa4f7dee744340db9976fc86e09c458eb209692561fc9fb05abd350ceb358bfae3bb3bb06b2f7bc5a1804a7ef8811eca16c7d9f92c3e6002d

data/AUTHENTICATION.md

@@ -28,6 +28,12 @@ providing **Project ID** and **Service Account Credentials** directly in code.
 
 **Credentials** are discovered in the following order:
 
+> [!WARNING]
+> If you accept a credential configuration (JSON file or Hash) from an
+> external source for authentication to Google Cloud, you must validate it before
+> providing it to a Google API client library. Providing an unvalidated credential
+> configuration to Google APIs can compromise the security of your systems and data.
+
 1. Specify credentials in method arguments
 2. Specify credentials in configuration
 3. Discover credentials path in environment variables
@@ -81,11 +87,16 @@ The **Project ID** and the path to the **Credentials JSON** file can be configur
 instead of placing them in environment variables or providing them as arguments.
 
 ```ruby
+require "googleauth"
 require "google/cloud/bigquery"
 
+credentials = ::Google::Auth::ServiceAccountCredentials.make_creds(
+  json_key_io: ::File.open("/path/to/keyfile.json")
+)
+
 Google::Cloud::Bigquery.configure do |config|
   config.project_id  = "my-project-id"
-  config.credentials = "path/to/keyfile.json"
+  config.credentials = credentials
 end
 
 bigquery = Google::Cloud::Bigquery.new

data/CHANGELOG.md

@@ -1,5 +1,74 @@
 # Release History
 
+### 1.61.1 (2025-11-21)
+
+#### Bug Fixes
+
+* Fix broken links 
+#### Documentation
+
+* Clarify comments on job error status 
+
+### 1.61.0 (2025-11-04)
+
+#### Features
+
+* Support fine grained ACLs ([#31772](https://github.com/googleapis/google-cloud-ruby/issues/31772)) 
+#### Documentation
+
+* add warning about loading unvalidated credentials ([#32121](https://github.com/googleapis/google-cloud-ruby/issues/32121)) 
+
+### 1.60.0 (2025-10-24)
+
+#### Features
+
+* Exposing reservation field in JobConfiguration ([#31777](https://github.com/googleapis/google-cloud-ruby/issues/31777)) 
+
+### 1.59.0 (2025-09-17)
+
+#### Features
+
+* Support collation feature ([#30919](https://github.com/googleapis/google-cloud-ruby/issues/30919)) 
+
+### 1.58.0 (2025-09-03)
+
+#### Features
+
+* Add support for remote function options ([#30822](https://github.com/googleapis/google-cloud-ruby/issues/30822)) 
+
+### 1.57.0 (2025-08-28)
+
+#### Features
+
+* Add support for reference_file_schema_uri for LoadJobConfig and ExternalDataSource ([#30859](https://github.com/googleapis/google-cloud-ruby/issues/30859)) 
+
+### 1.56.0 (2025-08-27)
+
+#### Features
+
+* Add support for preserve_ascii_control_characters in CSVOptions and LoadJobConfiguration ([#30857](https://github.com/googleapis/google-cloud-ruby/issues/30857)) 
+
+### 1.55.0 (2025-08-26)
+
+#### Features
+
+* Add support for IAM Condition in Dataset Access ([#30854](https://github.com/googleapis/google-cloud-ruby/issues/30854)) 
+
+### 1.54.0 (2025-08-15)
+
+#### Features
+
+* Add support for format_options_use_int64_timestamp ([#30755](https://github.com/googleapis/google-cloud-ruby/issues/30755)) 
+* load job external table options ([#30743](https://github.com/googleapis/google-cloud-ruby/issues/30743)) 
+
+### 1.53.0 (2025-08-12)
+
+#### Features
+
+* add data governance type to routine ([#30732](https://github.com/googleapis/google-cloud-ruby/issues/30732)) 
+* Add table resource tags support ([#30804](https://github.com/googleapis/google-cloud-ruby/issues/30804)) 
+* Support for using Faraday for HTTP requests ([#30760](https://github.com/googleapis/google-cloud-ruby/issues/30760)) 
+
 ### 1.52.1 (2025-04-25)
 
 #### Documentation

data/OVERVIEW.md

@@ -14,7 +14,7 @@ connecting in the {file:AUTHENTICATION.md Authentication Guide}.
 
 To help you get started quickly, the first few examples below use a public
 dataset provided by Google. As soon as you have [signed
-up](https://cloud.google.com/bigquery/sign-up) to use BigQuery, and provided
+up](https://cloud.google.com/bigquery) to use BigQuery, and provided
 that you stay in the free tier for queries, you should be able to run these
 first examples without the need to set up billing or to load data (although
 we'll show you how to do that too.)
@@ -249,8 +249,8 @@ dataset = bigquery.create_dataset "my_dataset"
 Now that you have a dataset, you can use it to create a table. Every table is
 defined by a schema that may contain nested and repeated fields. The example
 below shows a schema with a repeated record field named `cities_lived`. (For
-more information about nested and repeated fields, see [Preparing Data for
-Loading](https://cloud.google.com/bigquery/preparing-data-for-loading).)
+more information about nested and repeated fields, see 
+[Using Nested and Repeated Fields](https://docs.cloud.google.com/bigquery/docs/best-practices-performance-nested).)
 
 ```ruby
 require "google/cloud/bigquery"
@@ -455,7 +455,7 @@ bigquery = Google::Cloud::Bigquery.new retries: 10, timeout: 120
 ```
 
 See the [BigQuery error
-table](https://cloud.google.com/bigquery/troubleshooting-errors#errortable) for
+table](https://docs.cloud.google.com/bigquery/docs/error-messages) for
 a list of error conditions.
 
 ## Additional information

data/lib/google/cloud/bigquery/condition.rb

@@ -0,0 +1,218 @@
+# Copyright 2025 Google LLC
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#     https://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+require "google/apis/bigquery_v2"
+
+module Google
+  module Cloud
+    module Bigquery
+      ##
+      # # Condition
+      #
+      # Represents a textual expression in the Common Expression Language (CEL) syntax.
+      # CEL is a C-like expression language. The syntax and semantics of CEL are documented
+      # at https://github.com/google/cel-spec
+      #
+      # Used to define condition for {Dataset::Access} rules
+      #
+      class Condition
+        ##
+        # Returns the textual representation of an expression in Common Expression Language syntax.
+        #
+        # @return [String] The expression of the condition.
+        #
+        # @example
+        #   condition = Google::Cloud::Bigquery::Condition.new(
+        #     "resource.name.startsWith('projects/my-project')"
+        #   )
+        #   puts condition.expression # => "resource.name.startsWith('projects/my-project')"
+        #
+        def expression
+          @expression
+        end
+
+        ##
+        # Sets the textual representation of an expression in Common Expression Language syntax.
+        #
+        # @param [String] val The expression to set.
+        #
+        # @raise [ArgumentError] if the expression is nil or empty.
+        #
+        # @example
+        #   condition = Google::Cloud::Bigquery::Condition.new(
+        #     "resource.name.startsWith('projects/my-project')"
+        #   )
+        #   condition.expression = "document.summary.size() < 100"
+        #
+        def expression= val
+          if val.nil? || val.strip.empty?
+            raise ArgumentError, "Expression cannot be nil or empty"
+          end
+          @expression = val
+        end
+
+        ##
+        # Returns the optional description of the expression. This is a longer text which describes
+        # the expression, e.g. when hovered over it in a UI.
+        #
+        # @return [String, nil] The description of the condition. nil if not set.
+        #
+        # @example
+        #   condition = Google::Cloud::Bigquery::Condition.new(
+        #     "document.summary.size() < 100",
+        #     description: "Checks if summary is less than 100 chars"
+        #   )
+        #   puts condition.description # => "Checks if summary is less than 100 chars"
+        #
+        def description
+          @description
+        end
+
+        ##
+        # Sets the optional description of the expression. This is a longer text which describes
+        # the expression, e.g. when hovered over it in a UI.
+        #
+        # @param [String, nil] val The description to set. nil to unset.
+        #
+        # @example
+        #   condition = Google::Cloud::Bigquery::Condition.new(
+        #     "document.summary.size() < 100"
+        #   )
+        #   condition.description = "Checks if summary is less than 100 chars"
+        #
+        def description= val
+          @description = val
+        end
+
+        ##
+        # Returns the optional string indicating the location of the expression for error reporting,
+        # e.g. a file name and a position in the file.
+        #
+        # @return [String, nil] The location of the condition. nil if not set.
+        #
+        # @example
+        #   condition = Google::Cloud::Bigquery::Condition.new(
+        #     "document.summary.size() < 100",
+        #     location: "document/summary"
+        #   )
+        #   puts condition.location # => "document/summary"
+        #
+        def location
+          @location
+        end
+
+        ##
+        # Sets the optional string indicating the location of the expression for error reporting,
+        # e.g. a file name and a position in the file.
+        #
+        # @param [String, nil] val The location to set. nil to unset.
+        #
+        # @example
+        #   condition = Google::Cloud::Bigquery::Condition.new(
+        #     "document.summary.size() < 100"
+        #   )
+        #   condition.location = "document/summary"
+        #
+        def location= val
+          @location = val
+        end
+
+        ##
+        # Returns the optional title for the expression, i.e. a short string describing its purpose.
+        # This can be used e.g. in UIs which allow to enter the expression.
+        #
+        # @return [String, nil] The title of the condition. nil if not set.
+        #
+        # @example
+        #   condition = Google::Cloud::Bigquery::Condition.new(
+        #     "document.summary.size() < 100",
+        #     title: "Summary size limit"
+        #   )
+        #   puts condition.title # => "Summary size limit"
+        #
+        def title
+          @title
+        end
+
+        ##
+        # Sets the optional title for the expression, i.e. a short string describing its purpose.
+        # This can be used e.g. in UIs which allow to enter the expression.
+        #
+        # @param [String, nil] val The title to set. nil to unset.
+        #
+        # @example
+        #   condition = Google::Cloud::Bigquery::Condition.new(
+        #     "document.summary.size() < 100"
+        #   )
+        #   condition.title = "Summary size limit"
+        #
+        def title= val
+          @title = val
+        end
+
+        ##
+        # Create a new Condition object.
+        #
+        # @param [String] expression The expression in CEL syntax.
+        # @param [String] description Optional description of the expression.
+        # @param [String] location Optional location of the expression for error reporting.
+        # @param [String] title Optional title for the expression.
+        #
+        # @raise [ArgumentError] if expression is nil or empty.
+        #
+        # @example
+        #   condition = Google::Cloud::Bigquery::Condition.new(
+        #     "document.summary.size() < 100",
+        #     description: "Determines if a summary is less than 100 chars",
+        #     location: "document/summary",
+        #     title: "Summary size limit"
+        #   )
+        #
+        # @see https://cloud.google.com/bigquery/docs/reference/auditlogs/rest/Shared.Types/Expr
+        #
+        def initialize expression, description: nil, location: nil, title: nil
+          if expression.nil? || expression.strip.empty?
+            raise ArgumentError, "Expression cannot be nil or empty"
+          end
+          @expression = expression
+          @description = description
+          @location = location
+          @title = title
+        end
+
+        ##
+        # @private Convert the Condition object to a Google API Client object.
+        #
+        # @return [Google::Apis::BigqueryV2::Expr] The Google API Client object representing the condition.
+        #
+        # @example
+        #   condition = Google::Cloud::Bigquery::Condition.new(
+        #     "resource.name.startsWith('projects/my-project')"
+        #   )
+        #   gapi_condition = condition.to_gapi
+        #
+        # @see https://cloud.google.com/bigquery/docs/reference/auditlogs/rest/Shared.Types/Expr
+        #
+        def to_gapi
+          gapi = Google::Apis::BigqueryV2::Expr.new
+          gapi.description = @description unless @description.nil?
+          gapi.expression = @expression
+          gapi.location = @location unless @location.nil?
+          gapi.title = @title unless @title.nil?
+          gapi
+        end
+      end
+    end
+  end
+end

data/lib/google/cloud/bigquery/convert.rb

@@ -60,6 +60,10 @@ module Google
           end
         end
 
+        def self.is_int? value
+          /\A\s*[-+]?\d+\s*\z/.match? value.to_s
+        end
+
         # rubocop:disable all
 
         def self.format_value value, field
@@ -96,7 +100,12 @@ module Google
           elsif field.type == "BYTES"
             StringIO.new Base64.decode64 value[:v]
           elsif field.type == "TIMESTAMP"
-            ::Time.at Float(value[:v])
+            if is_int?(value[:v])
+              # Convert microseconds to seconds
+              ::Time.at Rational(Integer(value[:v]), 1_000_000)
+            else
+              ::Time.at Rational(value[:v])
+            end
           elsif field.type == "TIME"
             Bigquery::Time.new value[:v]
           elsif field.type == "DATETIME"

data/lib/google/cloud/bigquery/copy_job.rb

@@ -194,7 +194,8 @@ module Google
               job_reference: job_ref,
               configuration: Google::Apis::BigqueryV2::JobConfiguration.new(
                 copy:    copy_cfg,
-                dry_run: options[:dryrun]
+                dry_run: options[:dryrun],
+                reservation: options[:reservation]
               )
             )
 
@@ -325,6 +326,18 @@ module Google
             @gapi.configuration.update! labels: value
           end
 
+          ##
+          # Sets the reservation that job would use. User can specify a reservation
+          # to execute the job. If reservation is not set, reservation is determined
+          # based on the rules defined by the reservation assignments. The expected
+          # format is `projects/`project`/locations/`location`/reservations/`reservation``.
+          # @param [String] value The reservation name.
+          #
+          # @!group Attributes
+          def reservation= value
+            @gapi.configuration.update! reservation: value
+          end
+
           def cancel
             raise "not implemented in #{self.class}"
           end

data/lib/google/cloud/bigquery/data.rb

@@ -66,6 +66,10 @@ module Google
         # @private The query Job gapi object, or nil if from Table#data.
         attr_accessor :job_gapi
 
+        ##
+        # @private Whether to output timestamp as usec int64.
+        attr_accessor :format_options_use_int64_timestamp
+
         # @private
         def initialize arr = []
           @service = nil
@@ -473,8 +477,9 @@ module Google
           data_json = service.list_tabledata \
             @table_gapi.table_reference.dataset_id,
             @table_gapi.table_reference.table_id,
-            token: token
-          self.class.from_gapi_json data_json, @table_gapi, job_gapi, @service
+            token: token,
+            format_options_use_int64_timestamp: @format_options_use_int64_timestamp
+          self.class.from_gapi_json data_json, @table_gapi, job_gapi, @service, @format_options_use_int64_timestamp
         end
 
         ##
@@ -549,7 +554,7 @@ module Google
 
         ##
         # @private New Data from a response object.
-        def self.from_gapi_json gapi_json, table_gapi, job_gapi, service
+        def self.from_gapi_json gapi_json, table_gapi, job_gapi, service, format_options_use_int64_timestamp
           rows = gapi_json[:rows] || []
           rows = Convert.format_rows rows, table_gapi.schema.fields unless rows.empty?
 
@@ -558,6 +563,7 @@ module Google
           data.gapi_json = gapi_json
           data.job_gapi = job_gapi
           data.service = service
+          data.format_options_use_int64_timestamp = format_options_use_int64_timestamp
           data
         end