google-cloud-orchestration-airflow-service-v1 0.7.0 → 0.9.0

Sign up to get free protection for your applications and to get access to all the features.
checksums.yaml CHANGED
@@ -1,7 +1,7 @@
1
1
  ---
2
2
  SHA256:
3
- metadata.gz: e4e08feb18d23b813ed7e17f65adae7a07ef62a39b1b556741053fc5d48024cf
4
- data.tar.gz: d9ed1bd8463e6afe9bcee2e1c2fa6cd76be028eb78256a92534c1404695b7726
3
+ metadata.gz: 6fa37b6b906a9aca9796ee7204429312880aa29c3f10375afada9c44be02f37d
4
+ data.tar.gz: 1a212b35a9366d12c8240b4a77522151d600455fb1583869313ee13f43088b6e
5
5
  SHA512:
6
- metadata.gz: 86cf91c980c8447386defe3e0de27bd05de12b541cefec1b3762baab54458f90baa0f12b6078e9dd54d5d611150e3cd37ea7c311e26e59e47163997fab64f3b2
7
- data.tar.gz: e2669eabcb4b2a17b7dc3fbd7514f9111290456e6750624ecc4cbdee6a6e9750072c102f6bd0c4444a3fdd213a6494180be12f3a1c9ecb3e3658952bb78a73f5
6
+ metadata.gz: 1fa8434f7a642a9de928e550df38c1c06ab5f2f6b83a76d4d5b768addc2ccea3a68d329396436d21a06d8aaed8d81f9d0af3ec434c81a58b3323f6e4e56e2152
7
+ data.tar.gz: d220e2af35343651a70c27498a001d3ff3d9304d50dc63fc5661fb8de3473bafb47792c7d98eed59b6c67809367ed9b8d75719814425328b55b2c763e8b4e1ec
data/AUTHENTICATION.md CHANGED
@@ -1,149 +1,122 @@
1
1
  # Authentication
2
2
 
3
- In general, the google-cloud-orchestration-airflow-service-v1 library uses
4
- [Service Account](https://cloud.google.com/iam/docs/creating-managing-service-accounts)
5
- credentials to connect to Google Cloud services. When running within
6
- [Google Cloud Platform environments](#google-cloud-platform-environments) the
7
- credentials will be discovered automatically. When running on other
8
- environments, the Service Account credentials can be specified by providing the
9
- path to the
10
- [JSON keyfile](https://cloud.google.com/iam/docs/managing-service-account-keys)
11
- for the account (or the JSON itself) in
12
- [environment variables](#environment-variables). Additionally, Cloud SDK
13
- credentials can also be discovered automatically, but this is only recommended
14
- during development.
3
+ The recommended way to authenticate to the google-cloud-orchestration-airflow-service-v1 library is to use
4
+ [Application Default Credentials (ADC)](https://cloud.google.com/docs/authentication/application-default-credentials).
5
+ To review all of your authentication options, see [Credentials lookup](#credential-lookup).
15
6
 
16
7
  ## Quickstart
17
8
 
18
- 1. [Create a service account and credentials](#creating-a-service-account).
19
- 2. Set the [environment variable](#environment-variables).
9
+ The following example shows how to set up authentication for a local development
10
+ environment with your user credentials.
20
11
 
21
- ```sh
22
- export GOOGLE_CLOUD_CREDENTIALS=path/to/keyfile.json
23
- ```
24
-
25
- 3. Initialize the client.
12
+ **NOTE:** This method is _not_ recommended for running in production. User credentials
13
+ should be used only during development.
26
14
 
27
- ```ruby
28
- require "google/cloud/orchestration/airflow/service/v1"
15
+ 1. [Download and install the Google Cloud CLI](https://cloud.google.com/sdk).
16
+ 2. Set up a local ADC file with your user credentials:
29
17
 
30
- client = ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Client.new
18
+ ```sh
19
+ gcloud auth application-default login
31
20
  ```
32
21
 
33
- ## Credential Lookup
34
-
35
- The google-cloud-orchestration-airflow-service-v1 library aims to make authentication
36
- as simple as possible, and provides several mechanisms to configure your system
37
- without requiring **Service Account Credentials** directly in code.
38
-
39
- **Credentials** are discovered in the following order:
40
-
41
- 1. Specify credentials in method arguments
42
- 2. Specify credentials in configuration
43
- 3. Discover credentials path in environment variables
44
- 4. Discover credentials JSON in environment variables
45
- 5. Discover credentials file in the Cloud SDK's path
46
- 6. Discover GCP credentials
47
-
48
- ### Google Cloud Platform environments
22
+ 3. Write code as if already authenticated.
49
23
 
50
- When running on Google Cloud Platform (GCP), including Google Compute Engine
51
- (GCE), Google Kubernetes Engine (GKE), Google App Engine (GAE), Google Cloud
52
- Functions (GCF) and Cloud Run, **Credentials** are discovered automatically.
53
- Code should be written as if already authenticated.
24
+ For more information about setting up authentication for a local development environment, see
25
+ [Set up Application Default Credentials](https://cloud.google.com/docs/authentication/provide-credentials-adc#local-dev).
54
26
 
55
- ### Environment Variables
27
+ ## Credential Lookup
56
28
 
57
- The **Credentials JSON** can be placed in environment variables instead of
58
- declaring them directly in code. Each service has its own environment variable,
59
- allowing for different service accounts to be used for different services. (See
60
- the READMEs for the individual service gems for details.) The path to the
61
- **Credentials JSON** file can be stored in the environment variable, or the
62
- **Credentials JSON** itself can be stored for environments such as Docker
63
- containers where writing files is difficult or not encouraged.
29
+ The google-cloud-orchestration-airflow-service-v1 library provides several mechanisms to configure your system.
30
+ Generally, using Application Default Credentials to facilitate automatic
31
+ credentials discovery is the easist method. But if you need to explicitly specify
32
+ credentials, there are several methods available to you.
64
33
 
65
- The environment variables that google-cloud-orchestration-airflow-service-v1
66
- checks for credentials are configured on the service Credentials class (such as
67
- {::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Credentials}):
34
+ Credentials are accepted in the following ways, in the following order or precedence:
68
35
 
69
- * `GOOGLE_CLOUD_CREDENTIALS` - Path to JSON file, or JSON contents
70
- * `GOOGLE_CLOUD_KEYFILE` - Path to JSON file, or JSON contents
71
- * `GOOGLE_APPLICATION_CREDENTIALS` - Path to JSON file
36
+ 1. Credentials specified in method arguments
37
+ 2. Credentials specified in configuration
38
+ 3. Credentials pointed to or included in environment variables
39
+ 4. Credentials found in local ADC file
40
+ 5. Credentials returned by the metadata server for the attached service account (GCP)
72
41
 
73
- ```ruby
74
- require "google/cloud/orchestration/airflow/service/v1"
75
-
76
- ENV["GOOGLE_CLOUD_CREDENTIALS"] = "path/to/keyfile.json"
42
+ ### Configuration
77
43
 
78
- client = ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Client.new
79
- ```
44
+ You can configure a path to a JSON credentials file, either for an individual client object or
45
+ globally, for all client objects. The JSON file can contain credentials created for
46
+ [workload identity federation](https://cloud.google.com/iam/docs/workload-identity-federation),
47
+ [workforce identity federation](https://cloud.google.com/iam/docs/workforce-identity-federation), or a
48
+ [service account key](https://cloud.google.com/docs/authentication/provide-credentials-adc#local-key).
80
49
 
81
- ### Configuration
50
+ Note: Service account keys are a security risk if not managed correctly. You should
51
+ [choose a more secure alternative to service account keys](https://cloud.google.com/docs/authentication#auth-decision-tree)
52
+ whenever possible.
82
53
 
83
- The path to the **Credentials JSON** file can be configured instead of storing
84
- it in an environment variable. Either on an individual client initialization:
54
+ To configure a credentials file for an individual client initialization:
85
55
 
86
56
  ```ruby
87
57
  require "google/cloud/orchestration/airflow/service/v1"
88
58
 
89
59
  client = ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Client.new do |config|
90
- config.credentials = "path/to/keyfile.json"
60
+ config.credentials = "path/to/credentialfile.json"
91
61
  end
92
62
  ```
93
63
 
94
- Or globally for all clients:
64
+ To configure a credentials file globally for all clients:
95
65
 
96
66
  ```ruby
97
67
  require "google/cloud/orchestration/airflow/service/v1"
98
68
 
99
69
  ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Client.configure do |config|
100
- config.credentials = "path/to/keyfile.json"
70
+ config.credentials = "path/to/credentialfile.json"
101
71
  end
102
72
 
103
73
  client = ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Client.new
104
74
  ```
105
75
 
106
- ### Cloud SDK
76
+ ### Environment Variables
107
77
 
108
- This option allows for an easy way to authenticate during development. If
109
- credentials are not provided in code or in environment variables, then Cloud SDK
110
- credentials are discovered.
78
+ You can also use an environment variable to provide a JSON credentials file.
79
+ The environment variable can contain a path to the credentials file or, for
80
+ environments such as Docker containers where writing files is not encouraged,
81
+ you can include the credentials file itself.
111
82
 
112
- To configure your system for this, simply:
83
+ The JSON file can contain credentials created for
84
+ [workload identity federation](https://cloud.google.com/iam/docs/workload-identity-federation),
85
+ [workforce identity federation](https://cloud.google.com/iam/docs/workforce-identity-federation), or a
86
+ [service account key](https://cloud.google.com/docs/authentication/provide-credentials-adc#local-key).
113
87
 
114
- 1. [Download and install the Cloud SDK](https://cloud.google.com/sdk)
115
- 2. Authenticate using OAuth 2.0 `$ gcloud auth application-default login`
116
- 3. Write code as if already authenticated.
88
+ Note: Service account keys are a security risk if not managed correctly. You should
89
+ [choose a more secure alternative to service account keys](https://cloud.google.com/docs/authentication#auth-decision-tree)
90
+ whenever possible.
91
+
92
+ The environment variables that google-cloud-orchestration-airflow-service-v1
93
+ checks for credentials are:
117
94
 
118
- **NOTE:** This is _not_ recommended for running in production. The Cloud SDK
119
- *should* only be used during development.
95
+ * `GOOGLE_CLOUD_CREDENTIALS` - Path to JSON file, or JSON contents
96
+ * `GOOGLE_APPLICATION_CREDENTIALS` - Path to JSON file
120
97
 
121
- ## Creating a Service Account
98
+ ```ruby
99
+ require "google/cloud/orchestration/airflow/service/v1"
122
100
 
123
- Google Cloud requires **Service Account Credentials** to
124
- connect to the APIs. You will use the **JSON key file** to
125
- connect to most services with google-cloud-orchestration-airflow-service-v1.
101
+ ENV["GOOGLE_APPLICATION_CREDENTIALS"] = "path/to/credentialfile.json"
126
102
 
127
- If you are not running this client within
128
- [Google Cloud Platform environments](#google-cloud-platform-environments), you
129
- need a Google Developers service account.
103
+ client = ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Client.new
104
+ ```
130
105
 
131
- 1. Visit the [Google Cloud Console](https://console.cloud.google.com/project).
132
- 2. Create a new project or click on an existing project.
133
- 3. Activate the menu in the upper left and select **APIs & Services**. From
134
- here, you will enable the APIs that your application requires.
106
+ ### Local ADC file
135
107
 
136
- *Note: You may need to enable billing in order to use these services.*
108
+ You can set up a local ADC file with your user credentials for authentication during
109
+ development. If credentials are not provided in code or in environment variables,
110
+ then the local ADC credentials are discovered.
137
111
 
138
- 4. Select **Credentials** from the side navigation.
112
+ Follow the steps in [Quickstart](#quickstart) to set up a local ADC file.
139
113
 
140
- Find the "Create credentials" drop down near the top of the page, and select
141
- "Service account" to be guided through downloading a new JSON key file.
114
+ ### Google Cloud Platform environments
142
115
 
143
- If you want to re-use an existing service account, you can easily generate a
144
- new key file. Just select the account you wish to re-use, click the pencil
145
- tool on the right side to edit the service account, select the **Keys** tab,
146
- and then select **Add Key**.
116
+ When running on Google Cloud Platform (GCP), including Google Compute Engine
117
+ (GCE), Google Kubernetes Engine (GKE), Google App Engine (GAE), Google Cloud
118
+ Functions (GCF) and Cloud Run, credentials are retrieved from the attached
119
+ service account automatically. Code should be written as if already authenticated.
147
120
 
148
- The key file you download will be used by this library to authenticate API
149
- requests and should be stored in a secure location.
121
+ For more information, see
122
+ [Set up ADC for Google Cloud services](https://cloud.google.com/docs/authentication/provide-credentials-adc#attached-sa).
@@ -32,6 +32,9 @@ module Google
32
32
  # Managed Apache Airflow Environments.
33
33
  #
34
34
  class Client
35
+ # @private
36
+ DEFAULT_ENDPOINT_TEMPLATE = "composer.$UNIVERSE_DOMAIN$"
37
+
35
38
  include Paths
36
39
 
37
40
  # @private
@@ -92,6 +95,15 @@ module Google
92
95
  @config
93
96
  end
94
97
 
98
+ ##
99
+ # The effective universe domain
100
+ #
101
+ # @return [String]
102
+ #
103
+ def universe_domain
104
+ @environments_stub.universe_domain
105
+ end
106
+
95
107
  ##
96
108
  # Create a new Environments client object.
97
109
  #
@@ -125,8 +137,9 @@ module Google
125
137
  credentials = @config.credentials
126
138
  # Use self-signed JWT if the endpoint is unchanged from default,
127
139
  # but only if the default endpoint does not have a region prefix.
128
- enable_self_signed_jwt = @config.endpoint == Configuration::DEFAULT_ENDPOINT &&
129
- !@config.endpoint.split(".").first.include?("-")
140
+ enable_self_signed_jwt = @config.endpoint.nil? ||
141
+ (@config.endpoint == Configuration::DEFAULT_ENDPOINT &&
142
+ !@config.endpoint.split(".").first.include?("-"))
130
143
  credentials ||= Credentials.default scope: @config.scope,
131
144
  enable_self_signed_jwt: enable_self_signed_jwt
132
145
  if credentials.is_a?(::String) || credentials.is_a?(::Hash)
@@ -139,14 +152,18 @@ module Google
139
152
  config.credentials = credentials
140
153
  config.quota_project = @quota_project_id
141
154
  config.endpoint = @config.endpoint
155
+ config.universe_domain = @config.universe_domain
142
156
  end
143
157
 
144
158
  @environments_stub = ::Gapic::ServiceStub.new(
145
159
  ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Stub,
146
- credentials: credentials,
147
- endpoint: @config.endpoint,
160
+ credentials: credentials,
161
+ endpoint: @config.endpoint,
162
+ endpoint_template: DEFAULT_ENDPOINT_TEMPLATE,
163
+ universe_domain: @config.universe_domain,
148
164
  channel_args: @config.channel_args,
149
- interceptors: @config.interceptors
165
+ interceptors: @config.interceptors,
166
+ channel_pool_config: @config.channel_pool
150
167
  )
151
168
  end
152
169
 
@@ -1457,9 +1474,9 @@ module Google
1457
1474
  # end
1458
1475
  #
1459
1476
  # @!attribute [rw] endpoint
1460
- # The hostname or hostname:port of the service endpoint.
1461
- # Defaults to `"composer.googleapis.com"`.
1462
- # @return [::String]
1477
+ # A custom service endpoint, as a hostname or hostname:port. The default is
1478
+ # nil, indicating to use the default endpoint in the current universe domain.
1479
+ # @return [::String,nil]
1463
1480
  # @!attribute [rw] credentials
1464
1481
  # Credentials to send with calls. You may provide any of the following types:
1465
1482
  # * (`String`) The path to a service account key file in JSON format
@@ -1505,13 +1522,20 @@ module Google
1505
1522
  # @!attribute [rw] quota_project
1506
1523
  # A separate project against which to charge quota.
1507
1524
  # @return [::String]
1525
+ # @!attribute [rw] universe_domain
1526
+ # The universe domain within which to make requests. This determines the
1527
+ # default endpoint URL. The default value of nil uses the environment
1528
+ # universe (usually the default "googleapis.com" universe).
1529
+ # @return [::String,nil]
1508
1530
  #
1509
1531
  class Configuration
1510
1532
  extend ::Gapic::Config
1511
1533
 
1534
+ # @private
1535
+ # The endpoint specific to the default "googleapis.com" universe. Deprecated.
1512
1536
  DEFAULT_ENDPOINT = "composer.googleapis.com"
1513
1537
 
1514
- config_attr :endpoint, DEFAULT_ENDPOINT, ::String
1538
+ config_attr :endpoint, nil, ::String, nil
1515
1539
  config_attr :credentials, nil do |value|
1516
1540
  allowed = [::String, ::Hash, ::Proc, ::Symbol, ::Google::Auth::Credentials, ::Signet::OAuth2::Client, nil]
1517
1541
  allowed += [::GRPC::Core::Channel, ::GRPC::Core::ChannelCredentials] if defined? ::GRPC
@@ -1526,6 +1550,7 @@ module Google
1526
1550
  config_attr :metadata, nil, ::Hash, nil
1527
1551
  config_attr :retry_policy, nil, ::Hash, ::Proc, nil
1528
1552
  config_attr :quota_project, nil, ::String, nil
1553
+ config_attr :universe_domain, nil, ::String, nil
1529
1554
 
1530
1555
  # @private
1531
1556
  def initialize parent_config = nil
@@ -1546,6 +1571,14 @@ module Google
1546
1571
  end
1547
1572
  end
1548
1573
 
1574
+ ##
1575
+ # Configuration for the channel pool
1576
+ # @return [::Gapic::ServiceStub::ChannelPool::Configuration]
1577
+ #
1578
+ def channel_pool
1579
+ @channel_pool ||= ::Gapic::ServiceStub::ChannelPool::Configuration.new
1580
+ end
1581
+
1549
1582
  ##
1550
1583
  # Configuration RPC class for the Environments API.
1551
1584
  #
@@ -28,6 +28,9 @@ module Google
28
28
  module Environments
29
29
  # Service that implements Longrunning Operations API.
30
30
  class Operations
31
+ # @private
32
+ DEFAULT_ENDPOINT_TEMPLATE = "composer.$UNIVERSE_DOMAIN$"
33
+
31
34
  # @private
32
35
  attr_reader :operations_stub
33
36
 
@@ -62,6 +65,15 @@ module Google
62
65
  @config
63
66
  end
64
67
 
68
+ ##
69
+ # The effective universe domain
70
+ #
71
+ # @return [String]
72
+ #
73
+ def universe_domain
74
+ @operations_stub.universe_domain
75
+ end
76
+
65
77
  ##
66
78
  # Create a new Operations client object.
67
79
  #
@@ -92,10 +104,13 @@ module Google
92
104
 
93
105
  @operations_stub = ::Gapic::ServiceStub.new(
94
106
  ::Google::Longrunning::Operations::Stub,
95
- credentials: credentials,
96
- endpoint: @config.endpoint,
107
+ credentials: credentials,
108
+ endpoint: @config.endpoint,
109
+ endpoint_template: DEFAULT_ENDPOINT_TEMPLATE,
110
+ universe_domain: @config.universe_domain,
97
111
  channel_args: @config.channel_args,
98
- interceptors: @config.interceptors
112
+ interceptors: @config.interceptors,
113
+ channel_pool_config: @config.channel_pool
99
114
  )
100
115
 
101
116
  # Used by an LRO wrapper for some methods of this service
@@ -614,9 +629,9 @@ module Google
614
629
  # end
615
630
  #
616
631
  # @!attribute [rw] endpoint
617
- # The hostname or hostname:port of the service endpoint.
618
- # Defaults to `"composer.googleapis.com"`.
619
- # @return [::String]
632
+ # A custom service endpoint, as a hostname or hostname:port. The default is
633
+ # nil, indicating to use the default endpoint in the current universe domain.
634
+ # @return [::String,nil]
620
635
  # @!attribute [rw] credentials
621
636
  # Credentials to send with calls. You may provide any of the following types:
622
637
  # * (`String`) The path to a service account key file in JSON format
@@ -662,13 +677,20 @@ module Google
662
677
  # @!attribute [rw] quota_project
663
678
  # A separate project against which to charge quota.
664
679
  # @return [::String]
680
+ # @!attribute [rw] universe_domain
681
+ # The universe domain within which to make requests. This determines the
682
+ # default endpoint URL. The default value of nil uses the environment
683
+ # universe (usually the default "googleapis.com" universe).
684
+ # @return [::String,nil]
665
685
  #
666
686
  class Configuration
667
687
  extend ::Gapic::Config
668
688
 
689
+ # @private
690
+ # The endpoint specific to the default "googleapis.com" universe. Deprecated.
669
691
  DEFAULT_ENDPOINT = "composer.googleapis.com"
670
692
 
671
- config_attr :endpoint, DEFAULT_ENDPOINT, ::String
693
+ config_attr :endpoint, nil, ::String, nil
672
694
  config_attr :credentials, nil do |value|
673
695
  allowed = [::String, ::Hash, ::Proc, ::Symbol, ::Google::Auth::Credentials, ::Signet::OAuth2::Client, nil]
674
696
  allowed += [::GRPC::Core::Channel, ::GRPC::Core::ChannelCredentials] if defined? ::GRPC
@@ -683,6 +705,7 @@ module Google
683
705
  config_attr :metadata, nil, ::Hash, nil
684
706
  config_attr :retry_policy, nil, ::Hash, ::Proc, nil
685
707
  config_attr :quota_project, nil, ::String, nil
708
+ config_attr :universe_domain, nil, ::String, nil
686
709
 
687
710
  # @private
688
711
  def initialize parent_config = nil
@@ -703,6 +726,14 @@ module Google
703
726
  end
704
727
  end
705
728
 
729
+ ##
730
+ # Configuration for the channel pool
731
+ # @return [::Gapic::ServiceStub::ChannelPool::Configuration]
732
+ #
733
+ def channel_pool
734
+ @channel_pool ||= ::Gapic::ServiceStub::ChannelPool::Configuration.new
735
+ end
736
+
706
737
  ##
707
738
  # Configuration RPC class for the Operations API.
708
739
  #