google-cloud-orchestration-airflow-service-v1 0.7.0 → 0.9.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
checksums.yaml CHANGED
@@ -1,7 +1,7 @@
1
1
  ---
2
2
  SHA256:
3
- metadata.gz: e4e08feb18d23b813ed7e17f65adae7a07ef62a39b1b556741053fc5d48024cf
4
- data.tar.gz: d9ed1bd8463e6afe9bcee2e1c2fa6cd76be028eb78256a92534c1404695b7726
3
+ metadata.gz: 6fa37b6b906a9aca9796ee7204429312880aa29c3f10375afada9c44be02f37d
4
+ data.tar.gz: 1a212b35a9366d12c8240b4a77522151d600455fb1583869313ee13f43088b6e
5
5
  SHA512:
6
- metadata.gz: 86cf91c980c8447386defe3e0de27bd05de12b541cefec1b3762baab54458f90baa0f12b6078e9dd54d5d611150e3cd37ea7c311e26e59e47163997fab64f3b2
7
- data.tar.gz: e2669eabcb4b2a17b7dc3fbd7514f9111290456e6750624ecc4cbdee6a6e9750072c102f6bd0c4444a3fdd213a6494180be12f3a1c9ecb3e3658952bb78a73f5
6
+ metadata.gz: 1fa8434f7a642a9de928e550df38c1c06ab5f2f6b83a76d4d5b768addc2ccea3a68d329396436d21a06d8aaed8d81f9d0af3ec434c81a58b3323f6e4e56e2152
7
+ data.tar.gz: d220e2af35343651a70c27498a001d3ff3d9304d50dc63fc5661fb8de3473bafb47792c7d98eed59b6c67809367ed9b8d75719814425328b55b2c763e8b4e1ec
data/AUTHENTICATION.md CHANGED
@@ -1,149 +1,122 @@
1
1
  # Authentication
2
2
 
3
- In general, the google-cloud-orchestration-airflow-service-v1 library uses
4
- [Service Account](https://cloud.google.com/iam/docs/creating-managing-service-accounts)
5
- credentials to connect to Google Cloud services. When running within
6
- [Google Cloud Platform environments](#google-cloud-platform-environments) the
7
- credentials will be discovered automatically. When running on other
8
- environments, the Service Account credentials can be specified by providing the
9
- path to the
10
- [JSON keyfile](https://cloud.google.com/iam/docs/managing-service-account-keys)
11
- for the account (or the JSON itself) in
12
- [environment variables](#environment-variables). Additionally, Cloud SDK
13
- credentials can also be discovered automatically, but this is only recommended
14
- during development.
3
+ The recommended way to authenticate to the google-cloud-orchestration-airflow-service-v1 library is to use
4
+ [Application Default Credentials (ADC)](https://cloud.google.com/docs/authentication/application-default-credentials).
5
+ To review all of your authentication options, see [Credentials lookup](#credential-lookup).
15
6
 
16
7
  ## Quickstart
17
8
 
18
- 1. [Create a service account and credentials](#creating-a-service-account).
19
- 2. Set the [environment variable](#environment-variables).
9
+ The following example shows how to set up authentication for a local development
10
+ environment with your user credentials.
20
11
 
21
- ```sh
22
- export GOOGLE_CLOUD_CREDENTIALS=path/to/keyfile.json
23
- ```
24
-
25
- 3. Initialize the client.
12
+ **NOTE:** This method is _not_ recommended for running in production. User credentials
13
+ should be used only during development.
26
14
 
27
- ```ruby
28
- require "google/cloud/orchestration/airflow/service/v1"
15
+ 1. [Download and install the Google Cloud CLI](https://cloud.google.com/sdk).
16
+ 2. Set up a local ADC file with your user credentials:
29
17
 
30
- client = ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Client.new
18
+ ```sh
19
+ gcloud auth application-default login
31
20
  ```
32
21
 
33
- ## Credential Lookup
34
-
35
- The google-cloud-orchestration-airflow-service-v1 library aims to make authentication
36
- as simple as possible, and provides several mechanisms to configure your system
37
- without requiring **Service Account Credentials** directly in code.
38
-
39
- **Credentials** are discovered in the following order:
40
-
41
- 1. Specify credentials in method arguments
42
- 2. Specify credentials in configuration
43
- 3. Discover credentials path in environment variables
44
- 4. Discover credentials JSON in environment variables
45
- 5. Discover credentials file in the Cloud SDK's path
46
- 6. Discover GCP credentials
47
-
48
- ### Google Cloud Platform environments
22
+ 3. Write code as if already authenticated.
49
23
 
50
- When running on Google Cloud Platform (GCP), including Google Compute Engine
51
- (GCE), Google Kubernetes Engine (GKE), Google App Engine (GAE), Google Cloud
52
- Functions (GCF) and Cloud Run, **Credentials** are discovered automatically.
53
- Code should be written as if already authenticated.
24
+ For more information about setting up authentication for a local development environment, see
25
+ [Set up Application Default Credentials](https://cloud.google.com/docs/authentication/provide-credentials-adc#local-dev).
54
26
 
55
- ### Environment Variables
27
+ ## Credential Lookup
56
28
 
57
- The **Credentials JSON** can be placed in environment variables instead of
58
- declaring them directly in code. Each service has its own environment variable,
59
- allowing for different service accounts to be used for different services. (See
60
- the READMEs for the individual service gems for details.) The path to the
61
- **Credentials JSON** file can be stored in the environment variable, or the
62
- **Credentials JSON** itself can be stored for environments such as Docker
63
- containers where writing files is difficult or not encouraged.
29
+ The google-cloud-orchestration-airflow-service-v1 library provides several mechanisms to configure your system.
30
+ Generally, using Application Default Credentials to facilitate automatic
31
+ credentials discovery is the easist method. But if you need to explicitly specify
32
+ credentials, there are several methods available to you.
64
33
 
65
- The environment variables that google-cloud-orchestration-airflow-service-v1
66
- checks for credentials are configured on the service Credentials class (such as
67
- {::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Credentials}):
34
+ Credentials are accepted in the following ways, in the following order or precedence:
68
35
 
69
- * `GOOGLE_CLOUD_CREDENTIALS` - Path to JSON file, or JSON contents
70
- * `GOOGLE_CLOUD_KEYFILE` - Path to JSON file, or JSON contents
71
- * `GOOGLE_APPLICATION_CREDENTIALS` - Path to JSON file
36
+ 1. Credentials specified in method arguments
37
+ 2. Credentials specified in configuration
38
+ 3. Credentials pointed to or included in environment variables
39
+ 4. Credentials found in local ADC file
40
+ 5. Credentials returned by the metadata server for the attached service account (GCP)
72
41
 
73
- ```ruby
74
- require "google/cloud/orchestration/airflow/service/v1"
75
-
76
- ENV["GOOGLE_CLOUD_CREDENTIALS"] = "path/to/keyfile.json"
42
+ ### Configuration
77
43
 
78
- client = ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Client.new
79
- ```
44
+ You can configure a path to a JSON credentials file, either for an individual client object or
45
+ globally, for all client objects. The JSON file can contain credentials created for
46
+ [workload identity federation](https://cloud.google.com/iam/docs/workload-identity-federation),
47
+ [workforce identity federation](https://cloud.google.com/iam/docs/workforce-identity-federation), or a
48
+ [service account key](https://cloud.google.com/docs/authentication/provide-credentials-adc#local-key).
80
49
 
81
- ### Configuration
50
+ Note: Service account keys are a security risk if not managed correctly. You should
51
+ [choose a more secure alternative to service account keys](https://cloud.google.com/docs/authentication#auth-decision-tree)
52
+ whenever possible.
82
53
 
83
- The path to the **Credentials JSON** file can be configured instead of storing
84
- it in an environment variable. Either on an individual client initialization:
54
+ To configure a credentials file for an individual client initialization:
85
55
 
86
56
  ```ruby
87
57
  require "google/cloud/orchestration/airflow/service/v1"
88
58
 
89
59
  client = ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Client.new do |config|
90
- config.credentials = "path/to/keyfile.json"
60
+ config.credentials = "path/to/credentialfile.json"
91
61
  end
92
62
  ```
93
63
 
94
- Or globally for all clients:
64
+ To configure a credentials file globally for all clients:
95
65
 
96
66
  ```ruby
97
67
  require "google/cloud/orchestration/airflow/service/v1"
98
68
 
99
69
  ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Client.configure do |config|
100
- config.credentials = "path/to/keyfile.json"
70
+ config.credentials = "path/to/credentialfile.json"
101
71
  end
102
72
 
103
73
  client = ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Client.new
104
74
  ```
105
75
 
106
- ### Cloud SDK
76
+ ### Environment Variables
107
77
 
108
- This option allows for an easy way to authenticate during development. If
109
- credentials are not provided in code or in environment variables, then Cloud SDK
110
- credentials are discovered.
78
+ You can also use an environment variable to provide a JSON credentials file.
79
+ The environment variable can contain a path to the credentials file or, for
80
+ environments such as Docker containers where writing files is not encouraged,
81
+ you can include the credentials file itself.
111
82
 
112
- To configure your system for this, simply:
83
+ The JSON file can contain credentials created for
84
+ [workload identity federation](https://cloud.google.com/iam/docs/workload-identity-federation),
85
+ [workforce identity federation](https://cloud.google.com/iam/docs/workforce-identity-federation), or a
86
+ [service account key](https://cloud.google.com/docs/authentication/provide-credentials-adc#local-key).
113
87
 
114
- 1. [Download and install the Cloud SDK](https://cloud.google.com/sdk)
115
- 2. Authenticate using OAuth 2.0 `$ gcloud auth application-default login`
116
- 3. Write code as if already authenticated.
88
+ Note: Service account keys are a security risk if not managed correctly. You should
89
+ [choose a more secure alternative to service account keys](https://cloud.google.com/docs/authentication#auth-decision-tree)
90
+ whenever possible.
91
+
92
+ The environment variables that google-cloud-orchestration-airflow-service-v1
93
+ checks for credentials are:
117
94
 
118
- **NOTE:** This is _not_ recommended for running in production. The Cloud SDK
119
- *should* only be used during development.
95
+ * `GOOGLE_CLOUD_CREDENTIALS` - Path to JSON file, or JSON contents
96
+ * `GOOGLE_APPLICATION_CREDENTIALS` - Path to JSON file
120
97
 
121
- ## Creating a Service Account
98
+ ```ruby
99
+ require "google/cloud/orchestration/airflow/service/v1"
122
100
 
123
- Google Cloud requires **Service Account Credentials** to
124
- connect to the APIs. You will use the **JSON key file** to
125
- connect to most services with google-cloud-orchestration-airflow-service-v1.
101
+ ENV["GOOGLE_APPLICATION_CREDENTIALS"] = "path/to/credentialfile.json"
126
102
 
127
- If you are not running this client within
128
- [Google Cloud Platform environments](#google-cloud-platform-environments), you
129
- need a Google Developers service account.
103
+ client = ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Client.new
104
+ ```
130
105
 
131
- 1. Visit the [Google Cloud Console](https://console.cloud.google.com/project).
132
- 2. Create a new project or click on an existing project.
133
- 3. Activate the menu in the upper left and select **APIs & Services**. From
134
- here, you will enable the APIs that your application requires.
106
+ ### Local ADC file
135
107
 
136
- *Note: You may need to enable billing in order to use these services.*
108
+ You can set up a local ADC file with your user credentials for authentication during
109
+ development. If credentials are not provided in code or in environment variables,
110
+ then the local ADC credentials are discovered.
137
111
 
138
- 4. Select **Credentials** from the side navigation.
112
+ Follow the steps in [Quickstart](#quickstart) to set up a local ADC file.
139
113
 
140
- Find the "Create credentials" drop down near the top of the page, and select
141
- "Service account" to be guided through downloading a new JSON key file.
114
+ ### Google Cloud Platform environments
142
115
 
143
- If you want to re-use an existing service account, you can easily generate a
144
- new key file. Just select the account you wish to re-use, click the pencil
145
- tool on the right side to edit the service account, select the **Keys** tab,
146
- and then select **Add Key**.
116
+ When running on Google Cloud Platform (GCP), including Google Compute Engine
117
+ (GCE), Google Kubernetes Engine (GKE), Google App Engine (GAE), Google Cloud
118
+ Functions (GCF) and Cloud Run, credentials are retrieved from the attached
119
+ service account automatically. Code should be written as if already authenticated.
147
120
 
148
- The key file you download will be used by this library to authenticate API
149
- requests and should be stored in a secure location.
121
+ For more information, see
122
+ [Set up ADC for Google Cloud services](https://cloud.google.com/docs/authentication/provide-credentials-adc#attached-sa).
@@ -32,6 +32,9 @@ module Google
32
32
  # Managed Apache Airflow Environments.
33
33
  #
34
34
  class Client
35
+ # @private
36
+ DEFAULT_ENDPOINT_TEMPLATE = "composer.$UNIVERSE_DOMAIN$"
37
+
35
38
  include Paths
36
39
 
37
40
  # @private
@@ -92,6 +95,15 @@ module Google
92
95
  @config
93
96
  end
94
97
 
98
+ ##
99
+ # The effective universe domain
100
+ #
101
+ # @return [String]
102
+ #
103
+ def universe_domain
104
+ @environments_stub.universe_domain
105
+ end
106
+
95
107
  ##
96
108
  # Create a new Environments client object.
97
109
  #
@@ -125,8 +137,9 @@ module Google
125
137
  credentials = @config.credentials
126
138
  # Use self-signed JWT if the endpoint is unchanged from default,
127
139
  # but only if the default endpoint does not have a region prefix.
128
- enable_self_signed_jwt = @config.endpoint == Configuration::DEFAULT_ENDPOINT &&
129
- !@config.endpoint.split(".").first.include?("-")
140
+ enable_self_signed_jwt = @config.endpoint.nil? ||
141
+ (@config.endpoint == Configuration::DEFAULT_ENDPOINT &&
142
+ !@config.endpoint.split(".").first.include?("-"))
130
143
  credentials ||= Credentials.default scope: @config.scope,
131
144
  enable_self_signed_jwt: enable_self_signed_jwt
132
145
  if credentials.is_a?(::String) || credentials.is_a?(::Hash)
@@ -139,14 +152,18 @@ module Google
139
152
  config.credentials = credentials
140
153
  config.quota_project = @quota_project_id
141
154
  config.endpoint = @config.endpoint
155
+ config.universe_domain = @config.universe_domain
142
156
  end
143
157
 
144
158
  @environments_stub = ::Gapic::ServiceStub.new(
145
159
  ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Stub,
146
- credentials: credentials,
147
- endpoint: @config.endpoint,
160
+ credentials: credentials,
161
+ endpoint: @config.endpoint,
162
+ endpoint_template: DEFAULT_ENDPOINT_TEMPLATE,
163
+ universe_domain: @config.universe_domain,
148
164
  channel_args: @config.channel_args,
149
- interceptors: @config.interceptors
165
+ interceptors: @config.interceptors,
166
+ channel_pool_config: @config.channel_pool
150
167
  )
151
168
  end
152
169
 
@@ -1457,9 +1474,9 @@ module Google
1457
1474
  # end
1458
1475
  #
1459
1476
  # @!attribute [rw] endpoint
1460
- # The hostname or hostname:port of the service endpoint.
1461
- # Defaults to `"composer.googleapis.com"`.
1462
- # @return [::String]
1477
+ # A custom service endpoint, as a hostname or hostname:port. The default is
1478
+ # nil, indicating to use the default endpoint in the current universe domain.
1479
+ # @return [::String,nil]
1463
1480
  # @!attribute [rw] credentials
1464
1481
  # Credentials to send with calls. You may provide any of the following types:
1465
1482
  # * (`String`) The path to a service account key file in JSON format
@@ -1505,13 +1522,20 @@ module Google
1505
1522
  # @!attribute [rw] quota_project
1506
1523
  # A separate project against which to charge quota.
1507
1524
  # @return [::String]
1525
+ # @!attribute [rw] universe_domain
1526
+ # The universe domain within which to make requests. This determines the
1527
+ # default endpoint URL. The default value of nil uses the environment
1528
+ # universe (usually the default "googleapis.com" universe).
1529
+ # @return [::String,nil]
1508
1530
  #
1509
1531
  class Configuration
1510
1532
  extend ::Gapic::Config
1511
1533
 
1534
+ # @private
1535
+ # The endpoint specific to the default "googleapis.com" universe. Deprecated.
1512
1536
  DEFAULT_ENDPOINT = "composer.googleapis.com"
1513
1537
 
1514
- config_attr :endpoint, DEFAULT_ENDPOINT, ::String
1538
+ config_attr :endpoint, nil, ::String, nil
1515
1539
  config_attr :credentials, nil do |value|
1516
1540
  allowed = [::String, ::Hash, ::Proc, ::Symbol, ::Google::Auth::Credentials, ::Signet::OAuth2::Client, nil]
1517
1541
  allowed += [::GRPC::Core::Channel, ::GRPC::Core::ChannelCredentials] if defined? ::GRPC
@@ -1526,6 +1550,7 @@ module Google
1526
1550
  config_attr :metadata, nil, ::Hash, nil
1527
1551
  config_attr :retry_policy, nil, ::Hash, ::Proc, nil
1528
1552
  config_attr :quota_project, nil, ::String, nil
1553
+ config_attr :universe_domain, nil, ::String, nil
1529
1554
 
1530
1555
  # @private
1531
1556
  def initialize parent_config = nil
@@ -1546,6 +1571,14 @@ module Google
1546
1571
  end
1547
1572
  end
1548
1573
 
1574
+ ##
1575
+ # Configuration for the channel pool
1576
+ # @return [::Gapic::ServiceStub::ChannelPool::Configuration]
1577
+ #
1578
+ def channel_pool
1579
+ @channel_pool ||= ::Gapic::ServiceStub::ChannelPool::Configuration.new
1580
+ end
1581
+
1549
1582
  ##
1550
1583
  # Configuration RPC class for the Environments API.
1551
1584
  #
@@ -28,6 +28,9 @@ module Google
28
28
  module Environments
29
29
  # Service that implements Longrunning Operations API.
30
30
  class Operations
31
+ # @private
32
+ DEFAULT_ENDPOINT_TEMPLATE = "composer.$UNIVERSE_DOMAIN$"
33
+
31
34
  # @private
32
35
  attr_reader :operations_stub
33
36
 
@@ -62,6 +65,15 @@ module Google
62
65
  @config
63
66
  end
64
67
 
68
+ ##
69
+ # The effective universe domain
70
+ #
71
+ # @return [String]
72
+ #
73
+ def universe_domain
74
+ @operations_stub.universe_domain
75
+ end
76
+
65
77
  ##
66
78
  # Create a new Operations client object.
67
79
  #
@@ -92,10 +104,13 @@ module Google
92
104
 
93
105
  @operations_stub = ::Gapic::ServiceStub.new(
94
106
  ::Google::Longrunning::Operations::Stub,
95
- credentials: credentials,
96
- endpoint: @config.endpoint,
107
+ credentials: credentials,
108
+ endpoint: @config.endpoint,
109
+ endpoint_template: DEFAULT_ENDPOINT_TEMPLATE,
110
+ universe_domain: @config.universe_domain,
97
111
  channel_args: @config.channel_args,
98
- interceptors: @config.interceptors
112
+ interceptors: @config.interceptors,
113
+ channel_pool_config: @config.channel_pool
99
114
  )
100
115
 
101
116
  # Used by an LRO wrapper for some methods of this service
@@ -614,9 +629,9 @@ module Google
614
629
  # end
615
630
  #
616
631
  # @!attribute [rw] endpoint
617
- # The hostname or hostname:port of the service endpoint.
618
- # Defaults to `"composer.googleapis.com"`.
619
- # @return [::String]
632
+ # A custom service endpoint, as a hostname or hostname:port. The default is
633
+ # nil, indicating to use the default endpoint in the current universe domain.
634
+ # @return [::String,nil]
620
635
  # @!attribute [rw] credentials
621
636
  # Credentials to send with calls. You may provide any of the following types:
622
637
  # * (`String`) The path to a service account key file in JSON format
@@ -662,13 +677,20 @@ module Google
662
677
  # @!attribute [rw] quota_project
663
678
  # A separate project against which to charge quota.
664
679
  # @return [::String]
680
+ # @!attribute [rw] universe_domain
681
+ # The universe domain within which to make requests. This determines the
682
+ # default endpoint URL. The default value of nil uses the environment
683
+ # universe (usually the default "googleapis.com" universe).
684
+ # @return [::String,nil]
665
685
  #
666
686
  class Configuration
667
687
  extend ::Gapic::Config
668
688
 
689
+ # @private
690
+ # The endpoint specific to the default "googleapis.com" universe. Deprecated.
669
691
  DEFAULT_ENDPOINT = "composer.googleapis.com"
670
692
 
671
- config_attr :endpoint, DEFAULT_ENDPOINT, ::String
693
+ config_attr :endpoint, nil, ::String, nil
672
694
  config_attr :credentials, nil do |value|
673
695
  allowed = [::String, ::Hash, ::Proc, ::Symbol, ::Google::Auth::Credentials, ::Signet::OAuth2::Client, nil]
674
696
  allowed += [::GRPC::Core::Channel, ::GRPC::Core::ChannelCredentials] if defined? ::GRPC
@@ -683,6 +705,7 @@ module Google
683
705
  config_attr :metadata, nil, ::Hash, nil
684
706
  config_attr :retry_policy, nil, ::Hash, ::Proc, nil
685
707
  config_attr :quota_project, nil, ::String, nil
708
+ config_attr :universe_domain, nil, ::String, nil
686
709
 
687
710
  # @private
688
711
  def initialize parent_config = nil
@@ -703,6 +726,14 @@ module Google
703
726
  end
704
727
  end
705
728
 
729
+ ##
730
+ # Configuration for the channel pool
731
+ # @return [::Gapic::ServiceStub::ChannelPool::Configuration]
732
+ #
733
+ def channel_pool
734
+ @channel_pool ||= ::Gapic::ServiceStub::ChannelPool::Configuration.new
735
+ end
736
+
706
737
  ##
707
738
  # Configuration RPC class for the Operations API.
708
739
  #