google-cloud-metastore 1.2.0 → 1.4.0

Sign up to get free protection for your applications and to get access to all the features.
Files changed (6) hide show
  1. checksums.yaml +4 -4
  2. data/AUTHENTICATION.md +72 -101
  3. data/README.md +2 -28
  4. data/lib/google/cloud/metastore/version.rb +1 -1
  5. data/lib/google/cloud/metastore.rb +25 -16
  6. metadata +7 -7
checksums.yaml CHANGED
@@ -1,7 +1,7 @@
1
1
  ---
2
2
  SHA256:
3
- metadata.gz: f764c45a4f8e9f953748a7c46bd8a0a25242bff883f38a020030f8fa23764f98
4
- data.tar.gz: 00a23f61240ff61ce10618d0ff672f2de88fa7cf16d7a57e6bc3f8e2e9a3e3af
3
+ metadata.gz: 33c60665c6d5716f576210b536ae47ed86a1717dc3ae652bfa99c3ea8904a926
4
+ data.tar.gz: 8f4c1622ace14bae32111051858ddcd3ab67b353f51ce943e93a49a848d86283
5
5
  SHA512:
6
- metadata.gz: a599bd5bb5ebc6bdc07e7f7f4a4e6befce2afbf73ddcbfb46468641c70c6dfe4a1d1684939ea9f39c23806d1416b5b4da5e956ec9ab29f5687c0d460673e2c8f
7
- data.tar.gz: 1402216564776ac94fc4a0e5a69d1f2dc79af63e900a61472cf1834e1e6d751a0a7768a2884404aec0a150a5c228d030270184c4ade6b5b557eb756f387b0d6e
6
+ metadata.gz: 6c554bc0b0824f82a412f4893a45543050613b3ab0e5b017b5889ff8b5b55ba3b1636c39f0e9a9dd51c2cd1b88ee10e0ed8b4e1421778bf61eb062ef17332177
7
+ data.tar.gz: 1efc57cff32abdbb8dce54afc5813d5fd3e4de28c03fe0128b800909073bf1b5e7c59212195f135648e0138bda5c76b384ce3d353b9de6026956a1efe59d34de
data/AUTHENTICATION.md CHANGED
@@ -1,151 +1,122 @@
1
1
  # Authentication
2
2
 
3
- In general, the google-cloud-metastore library uses
4
- [Service Account](https://cloud.google.com/iam/docs/creating-managing-service-accounts)
5
- credentials to connect to Google Cloud services. When running within
6
- [Google Cloud Platform environments](#google-cloud-platform-environments) the
7
- credentials will be discovered automatically. When running on other
8
- environments, the Service Account credentials can be specified by providing the
9
- path to the
10
- [JSON keyfile](https://cloud.google.com/iam/docs/managing-service-account-keys)
11
- for the account (or the JSON itself) in
12
- [environment variables](#environment-variables). Additionally, Cloud SDK
13
- credentials can also be discovered automatically, but this is only recommended
14
- during development.
3
+ The recommended way to authenticate to the google-cloud-metastore library is to use
4
+ [Application Default Credentials (ADC)](https://cloud.google.com/docs/authentication/application-default-credentials).
5
+ To review all of your authentication options, see [Credentials lookup](#credential-lookup).
15
6
 
16
7
  ## Quickstart
17
8
 
18
- 1. [Create a service account and credentials](#creating-a-service-account).
19
- 2. Set the [environment variable](#environment-variables).
9
+ The following example shows how to set up authentication for a local development
10
+ environment with your user credentials.
20
11
 
21
- ```sh
22
- export METASTORE_CREDENTIALS=path/to/keyfile.json
23
- ```
24
-
25
- 3. Initialize the client.
12
+ **NOTE:** This method is _not_ recommended for running in production. User credentials
13
+ should be used only during development.
26
14
 
27
- ```ruby
28
- require "google/cloud/metastore"
15
+ 1. [Download and install the Google Cloud CLI](https://cloud.google.com/sdk).
16
+ 2. Set up a local ADC file with your user credentials:
29
17
 
30
- client = Google::Cloud::Metastore.dataproc_metastore
18
+ ```sh
19
+ gcloud auth application-default login
31
20
  ```
32
21
 
33
- ## Credential Lookup
34
-
35
- The google-cloud-metastore library aims to make authentication
36
- as simple as possible, and provides several mechanisms to configure your system
37
- without requiring **Service Account Credentials** directly in code.
38
-
39
- **Credentials** are discovered in the following order:
40
-
41
- 1. Specify credentials in method arguments
42
- 2. Specify credentials in configuration
43
- 3. Discover credentials path in environment variables
44
- 4. Discover credentials JSON in environment variables
45
- 5. Discover credentials file in the Cloud SDK's path
46
- 6. Discover GCP credentials
47
-
48
- ### Google Cloud Platform environments
22
+ 3. Write code as if already authenticated.
49
23
 
50
- When running on Google Cloud Platform (GCP), including Google Compute Engine
51
- (GCE), Google Kubernetes Engine (GKE), Google App Engine (GAE), Google Cloud
52
- Functions (GCF) and Cloud Run, **Credentials** are discovered automatically.
53
- Code should be written as if already authenticated.
24
+ For more information about setting up authentication for a local development environment, see
25
+ [Set up Application Default Credentials](https://cloud.google.com/docs/authentication/provide-credentials-adc#local-dev).
54
26
 
55
- ### Environment Variables
27
+ ## Credential Lookup
56
28
 
57
- The **Credentials JSON** can be placed in environment variables instead of
58
- declaring them directly in code. Each service has its own environment variable,
59
- allowing for different service accounts to be used for different services. (See
60
- the READMEs for the individual service gems for details.) The path to the
61
- **Credentials JSON** file can be stored in the environment variable, or the
62
- **Credentials JSON** itself can be stored for environments such as Docker
63
- containers where writing files is difficult or not encouraged.
29
+ The google-cloud-metastore library provides several mechanisms to configure your system.
30
+ Generally, using Application Default Credentials to facilitate automatic
31
+ credentials discovery is the easist method. But if you need to explicitly specify
32
+ credentials, there are several methods available to you.
64
33
 
65
- The environment variables that google-cloud-metastore
66
- checks for credentials are configured on the service Credentials class (such as
67
- `::Google::Cloud::Metastore::V1::DataprocMetastore::Credentials`):
34
+ Credentials are accepted in the following ways, in the following order or precedence:
68
35
 
69
- * `METASTORE_CREDENTIALS` - Path to JSON file, or JSON contents
70
- * `METASTORE_KEYFILE` - Path to JSON file, or JSON contents
71
- * `GOOGLE_CLOUD_CREDENTIALS` - Path to JSON file, or JSON contents
72
- * `GOOGLE_CLOUD_KEYFILE` - Path to JSON file, or JSON contents
73
- * `GOOGLE_APPLICATION_CREDENTIALS` - Path to JSON file
36
+ 1. Credentials specified in method arguments
37
+ 2. Credentials specified in configuration
38
+ 3. Credentials pointed to or included in environment variables
39
+ 4. Credentials found in local ADC file
40
+ 5. Credentials returned by the metadata server for the attached service account (GCP)
74
41
 
75
- ```ruby
76
- require "google/cloud/metastore"
77
-
78
- ENV["METASTORE_CREDENTIALS"] = "path/to/keyfile.json"
42
+ ### Configuration
79
43
 
80
- client = Google::Cloud::Metastore.dataproc_metastore
81
- ```
44
+ You can configure a path to a JSON credentials file, either for an individual client object or
45
+ globally, for all client objects. The JSON file can contain credentials created for
46
+ [workload identity federation](https://cloud.google.com/iam/docs/workload-identity-federation),
47
+ [workforce identity federation](https://cloud.google.com/iam/docs/workforce-identity-federation), or a
48
+ [service account key](https://cloud.google.com/docs/authentication/provide-credentials-adc#local-key).
82
49
 
83
- ### Configuration
50
+ Note: Service account keys are a security risk if not managed correctly. You should
51
+ [choose a more secure alternative to service account keys](https://cloud.google.com/docs/authentication#auth-decision-tree)
52
+ whenever possible.
84
53
 
85
- The path to the **Credentials JSON** file can be configured instead of storing
86
- it in an environment variable. Either on an individual client initialization:
54
+ To configure a credentials file for an individual client initialization:
87
55
 
88
56
  ```ruby
89
57
  require "google/cloud/metastore"
90
58
 
91
59
  client = Google::Cloud::Metastore.dataproc_metastore do |config|
92
- config.credentials = "path/to/keyfile.json"
60
+ config.credentials = "path/to/credentialfile.json"
93
61
  end
94
62
  ```
95
63
 
96
- Or globally for all clients:
64
+ To configure a credentials file globally for all clients:
97
65
 
98
66
  ```ruby
99
67
  require "google/cloud/metastore"
100
68
 
101
69
  Google::Cloud::Metastore.configure do |config|
102
- config.credentials = "path/to/keyfile.json"
70
+ config.credentials = "path/to/credentialfile.json"
103
71
  end
104
72
 
105
73
  client = Google::Cloud::Metastore.dataproc_metastore
106
74
  ```
107
75
 
108
- ### Cloud SDK
76
+ ### Environment Variables
109
77
 
110
- This option allows for an easy way to authenticate during development. If
111
- credentials are not provided in code or in environment variables, then Cloud SDK
112
- credentials are discovered.
78
+ You can also use an environment variable to provide a JSON credentials file.
79
+ The environment variable can contain a path to the credentials file or, for
80
+ environments such as Docker containers where writing files is not encouraged,
81
+ you can include the credentials file itself.
113
82
 
114
- To configure your system for this, simply:
83
+ The JSON file can contain credentials created for
84
+ [workload identity federation](https://cloud.google.com/iam/docs/workload-identity-federation),
85
+ [workforce identity federation](https://cloud.google.com/iam/docs/workforce-identity-federation), or a
86
+ [service account key](https://cloud.google.com/docs/authentication/provide-credentials-adc#local-key).
115
87
 
116
- 1. [Download and install the Cloud SDK](https://cloud.google.com/sdk)
117
- 2. Authenticate using OAuth 2.0 `$ gcloud auth application-default login`
118
- 3. Write code as if already authenticated.
88
+ Note: Service account keys are a security risk if not managed correctly. You should
89
+ [choose a more secure alternative to service account keys](https://cloud.google.com/docs/authentication#auth-decision-tree)
90
+ whenever possible.
91
+
92
+ The environment variables that google-cloud-metastore
93
+ checks for credentials are:
119
94
 
120
- **NOTE:** This is _not_ recommended for running in production. The Cloud SDK
121
- *should* only be used during development.
95
+ * `GOOGLE_CLOUD_CREDENTIALS` - Path to JSON file, or JSON contents
96
+ * `GOOGLE_APPLICATION_CREDENTIALS` - Path to JSON file
122
97
 
123
- ## Creating a Service Account
98
+ ```ruby
99
+ require "google/cloud/metastore"
124
100
 
125
- Google Cloud requires **Service Account Credentials** to
126
- connect to the APIs. You will use the **JSON key file** to
127
- connect to most services with google-cloud-metastore.
101
+ ENV["GOOGLE_APPLICATION_CREDENTIALS"] = "path/to/credentialfile.json"
128
102
 
129
- If you are not running this client within
130
- [Google Cloud Platform environments](#google-cloud-platform-environments), you
131
- need a Google Developers service account.
103
+ client = Google::Cloud::Metastore.dataproc_metastore
104
+ ```
132
105
 
133
- 1. Visit the [Google Cloud Console](https://console.cloud.google.com/project).
134
- 2. Create a new project or click on an existing project.
135
- 3. Activate the menu in the upper left and select **APIs & Services**. From
136
- here, you will enable the APIs that your application requires.
106
+ ### Local ADC file
137
107
 
138
- *Note: You may need to enable billing in order to use these services.*
108
+ You can set up a local ADC file with your user credentials for authentication during
109
+ development. If credentials are not provided in code or in environment variables,
110
+ then the local ADC credentials are discovered.
139
111
 
140
- 4. Select **Credentials** from the side navigation.
112
+ Follow the steps in [Quickstart](#quickstart) to set up a local ADC file.
141
113
 
142
- Find the "Create credentials" drop down near the top of the page, and select
143
- "Service account" to be guided through downloading a new JSON key file.
114
+ ### Google Cloud Platform environments
144
115
 
145
- If you want to re-use an existing service account, you can easily generate a
146
- new key file. Just select the account you wish to re-use, click the pencil
147
- tool on the right side to edit the service account, select the **Keys** tab,
148
- and then select **Add Key**.
116
+ When running on Google Cloud Platform (GCP), including Google Compute Engine
117
+ (GCE), Google Kubernetes Engine (GKE), Google App Engine (GAE), Google Cloud
118
+ Functions (GCF) and Cloud Run, credentials are retrieved from the attached
119
+ service account automatically. Code should be written as if already authenticated.
149
120
 
150
- The key file you download will be used by this library to authenticate API
151
- requests and should be stored in a secure location.
121
+ For more information, see
122
+ [Set up ADC for Google Cloud services](https://cloud.google.com/docs/authentication/provide-credentials-adc#attached-sa).
data/README.md CHANGED
@@ -16,8 +16,8 @@ for this library, google-cloud-metastore, to see the convenience methods for
16
16
  constructing client objects. Reference documentation for the client objects
17
17
  themselves can be found in the client library documentation for the versioned
18
18
  client gems:
19
- [google-cloud-metastore-v1](https://googleapis.dev/ruby/google-cloud-metastore-v1/latest),
20
- [google-cloud-metastore-v1beta](https://googleapis.dev/ruby/google-cloud-metastore-v1beta/latest).
19
+ [google-cloud-metastore-v1](https://cloud.google.com/ruby/docs/reference/google-cloud-metastore-v1/latest),
20
+ [google-cloud-metastore-v1beta](https://cloud.google.com/ruby/docs/reference/google-cloud-metastore-v1beta/latest).
21
21
 
22
22
  See also the [Product Documentation](https://cloud.google.com/dataproc-metastore/)
23
23
  for more usage information.
@@ -35,32 +35,6 @@ In order to use this library, you first need to go through the following steps:
35
35
  1. [Enable the API.](https://console.cloud.google.com/apis/library/metastore.googleapis.com)
36
36
  1. {file:AUTHENTICATION.md Set up authentication.}
37
37
 
38
- ## Enabling Logging
39
-
40
- To enable logging for this library, set the logger for the underlying [gRPC](https://github.com/grpc/grpc/tree/master/src/ruby) library.
41
- The logger that you set may be a Ruby stdlib [`Logger`](https://ruby-doc.org/current/stdlibs/logger/Logger.html) as shown below,
42
- or a [`Google::Cloud::Logging::Logger`](https://googleapis.dev/ruby/google-cloud-logging/latest)
43
- that will write logs to [Cloud Logging](https://cloud.google.com/logging/). See [grpc/logconfig.rb](https://github.com/grpc/grpc/blob/master/src/ruby/lib/grpc/logconfig.rb)
44
- and the gRPC [spec_helper.rb](https://github.com/grpc/grpc/blob/master/src/ruby/spec/spec_helper.rb) for additional information.
45
-
46
- Configuring a Ruby stdlib logger:
47
-
48
- ```ruby
49
- require "logger"
50
-
51
- module MyLogger
52
- LOGGER = Logger.new $stderr, level: Logger::WARN
53
- def logger
54
- LOGGER
55
- end
56
- end
57
-
58
- # Define a gRPC module-level logger method before grpc/logconfig.rb loads.
59
- module GRPC
60
- extend MyLogger
61
- end
62
- ```
63
-
64
38
  ## Supported Ruby Versions
65
39
 
66
40
  This library is supported on Ruby 2.6+.
data/lib/google/cloud/metastore/version.rb CHANGED
@@ -20,7 +20,7 @@
20
20
  module Google
21
21
  module Cloud
22
22
  module Metastore
23
- VERSION = "1.2.0"
23
+ VERSION = "1.4.0"
24
24
  end
25
25
  end
26
26
  end
data/lib/google/cloud/metastore.rb CHANGED
@@ -29,7 +29,7 @@ require "google/cloud/config"
29
29
 
30
30
  # Set the default configuration
31
31
  ::Google::Cloud.configure.add_config! :metastore do |config|
32
- config.add_field! :endpoint, "metastore.googleapis.com", match: ::String
32
+ config.add_field! :endpoint, nil, match: ::String
33
33
  config.add_field! :credentials, nil, match: [::String, ::Hash, ::Google::Auth::Credentials]
34
34
  config.add_field! :scope, nil, match: [::Array, ::String]
35
35
  config.add_field! :lib_name, nil, match: ::String
@@ -39,6 +39,7 @@ require "google/cloud/config"
39
39
  config.add_field! :metadata, nil, match: ::Hash
40
40
  config.add_field! :retry_policy, nil, match: [::Hash, ::Proc]
41
41
  config.add_field! :quota_project, nil, match: ::String
42
+ config.add_field! :universe_domain, nil, match: ::String
42
43
  end
43
44
 
44
45
  module Google
@@ -48,12 +49,14 @@ module Google
48
49
  # Create a new client object for DataprocMetastore.
49
50
  #
50
51
  # By default, this returns an instance of
51
- # [Google::Cloud::Metastore::V1::DataprocMetastore::Client](https://googleapis.dev/ruby/google-cloud-metastore-v1/latest/Google/Cloud/Metastore/V1/DataprocMetastore/Client.html)
52
- # for version V1 of the API.
53
- # However, you can specify specify a different API version by passing it in the
52
+ # [Google::Cloud::Metastore::V1::DataprocMetastore::Client](https://cloud.google.com/ruby/docs/reference/google-cloud-metastore-v1/latest/Google-Cloud-Metastore-V1-DataprocMetastore-Client)
53
+ # for a gRPC client for version V1 of the API.
54
+ # However, you can specify a different API version by passing it in the
54
55
  # `version` parameter. If the DataprocMetastore service is
55
56
  # supported by that API version, and the corresponding gem is available, the
56
57
  # appropriate versioned client will be returned.
58
+ # You can also specify a different transport by passing `:rest` or `:grpc` in
59
+ # the `transport` parameter.
57
60
  #
58
61
  # ## About DataprocMetastore
59
62
  #
@@ -77,29 +80,33 @@ module Google
77
80
  #
78
81
  # @param version [::String, ::Symbol] The API version to connect to. Optional.
79
82
  # Defaults to `:v1`.
80
- # @return [DataprocMetastore::Client] A client object for the specified version.
83
+ # @param transport [:grpc, :rest] The transport to use. Defaults to `:grpc`.
84
+ # @return [::Object] A client object for the specified version.
81
85
  #
82
- def self.dataproc_metastore version: :v1, &block
86
+ def self.dataproc_metastore version: :v1, transport: :grpc, &block
83
87
  require "google/cloud/metastore/#{version.to_s.downcase}"
84
88
 
85
89
  package_name = Google::Cloud::Metastore
86
90
  .constants
87
91
  .select { |sym| sym.to_s.downcase == version.to_s.downcase.tr("_", "") }
88
92
  .first
89
- package_module = Google::Cloud::Metastore.const_get package_name
90
- package_module.const_get(:DataprocMetastore).const_get(:Client).new(&block)
93
+ service_module = Google::Cloud::Metastore.const_get(package_name).const_get(:DataprocMetastore)
94
+ service_module = service_module.const_get(:Rest) if transport == :rest
95
+ service_module.const_get(:Client).new(&block)
91
96
  end
92
97
 
93
98
  ##
94
99
  # Create a new client object for DataprocMetastoreFederation.
95
100
  #
96
101
  # By default, this returns an instance of
97
- # [Google::Cloud::Metastore::V1::DataprocMetastoreFederation::Client](https://googleapis.dev/ruby/google-cloud-metastore-v1/latest/Google/Cloud/Metastore/V1/DataprocMetastoreFederation/Client.html)
98
- # for version V1 of the API.
99
- # However, you can specify specify a different API version by passing it in the
102
+ # [Google::Cloud::Metastore::V1::DataprocMetastoreFederation::Client](https://cloud.google.com/ruby/docs/reference/google-cloud-metastore-v1/latest/Google-Cloud-Metastore-V1-DataprocMetastoreFederation-Client)
103
+ # for a gRPC client for version V1 of the API.
104
+ # However, you can specify a different API version by passing it in the
100
105
  # `version` parameter. If the DataprocMetastoreFederation service is
101
106
  # supported by that API version, and the corresponding gem is available, the
102
107
  # appropriate versioned client will be returned.
108
+ # You can also specify a different transport by passing `:rest` or `:grpc` in
109
+ # the `transport` parameter.
103
110
  #
104
111
  # ## About DataprocMetastoreFederation
105
112
  #
@@ -119,17 +126,19 @@ module Google
119
126
  #
120
127
  # @param version [::String, ::Symbol] The API version to connect to. Optional.
121
128
  # Defaults to `:v1`.
122
- # @return [DataprocMetastoreFederation::Client] A client object for the specified version.
129
+ # @param transport [:grpc, :rest] The transport to use. Defaults to `:grpc`.
130
+ # @return [::Object] A client object for the specified version.
123
131
  #
124
- def self.dataproc_metastore_federation version: :v1, &block
132
+ def self.dataproc_metastore_federation version: :v1, transport: :grpc, &block
125
133
  require "google/cloud/metastore/#{version.to_s.downcase}"
126
134
 
127
135
  package_name = Google::Cloud::Metastore
128
136
  .constants
129
137
  .select { |sym| sym.to_s.downcase == version.to_s.downcase.tr("_", "") }
130
138
  .first
131
- package_module = Google::Cloud::Metastore.const_get package_name
132
- package_module.const_get(:DataprocMetastoreFederation).const_get(:Client).new(&block)
139
+ service_module = Google::Cloud::Metastore.const_get(package_name).const_get(:DataprocMetastoreFederation)
140
+ service_module = service_module.const_get(:Rest) if transport == :rest
141
+ service_module.const_get(:Client).new(&block)
133
142
  end
134
143
 
135
144
  ##
@@ -149,7 +158,7 @@ module Google
149
158
  # * `timeout` (*type:* `Numeric`) -
150
159
  # Default timeout in seconds.
151
160
  # * `metadata` (*type:* `Hash{Symbol=>String}`) -
152
- # Additional gRPC headers to be sent with the call.
161
+ # Additional headers to be sent with the call.
153
162
  # * `retry_policy` (*type:* `Hash`) -
154
163
  # The retry policy. The value is a hash with the following keys:
155
164
  # * `:initial_delay` (*type:* `Numeric`) - The initial delay in seconds.
metadata CHANGED
@@ -1,14 +1,14 @@
1
1
  --- !ruby/object:Gem::Specification
2
2
  name: google-cloud-metastore
3
3
  version: !ruby/object:Gem::Version
4
- version: 1.2.0
4
+ version: 1.4.0
5
5
  platform: ruby
6
6
  authors:
7
7
  - Google LLC
8
8
  autorequire:
9
9
  bindir: bin
10
10
  cert_chain: []
11
- date: 2022-12-12 00:00:00.000000000 Z
11
+ date: 2024-01-15 00:00:00.000000000 Z
12
12
  dependencies:
13
13
  - !ruby/object:Gem::Dependency
14
14
  name: google-cloud-core
@@ -30,7 +30,7 @@ dependencies:
30
30
  requirements:
31
31
  - - ">="
32
32
  - !ruby/object:Gem::Version
33
- version: '0.4'
33
+ version: '0.12'
34
34
  - - "<"
35
35
  - !ruby/object:Gem::Version
36
36
  version: 2.a
@@ -40,7 +40,7 @@ dependencies:
40
40
  requirements:
41
41
  - - ">="
42
42
  - !ruby/object:Gem::Version
43
- version: '0.4'
43
+ version: '0.12'
44
44
  - - "<"
45
45
  - !ruby/object:Gem::Version
46
46
  version: 2.a
@@ -50,7 +50,7 @@ dependencies:
50
50
  requirements:
51
51
  - - ">="
52
52
  - !ruby/object:Gem::Version
53
- version: '0.3'
53
+ version: '0.12'
54
54
  - - "<"
55
55
  - !ruby/object:Gem::Version
56
56
  version: 2.a
@@ -60,7 +60,7 @@ dependencies:
60
60
  requirements:
61
61
  - - ">="
62
62
  - !ruby/object:Gem::Version
63
- version: '0.3'
63
+ version: '0.12'
64
64
  - - "<"
65
65
  - !ruby/object:Gem::Version
66
66
  version: 2.a
@@ -212,7 +212,7 @@ required_rubygems_version: !ruby/object:Gem::Requirement
212
212
  - !ruby/object:Gem::Version
213
213
  version: '0'
214
214
  requirements: []
215
- rubygems_version: 3.3.14
215
+ rubygems_version: 3.5.3
216
216
  signing_key:
217
217
  specification_version: 4
218
218
  summary: API Client library for the Dataproc Metastore API