google-cloud-orchestration-airflow-service-v1 0.7.0 → 0.9.0
Sign up to get free protection for your applications and to get access to all the features.
- checksums.yaml +4 -4
- data/AUTHENTICATION.md +72 -99
- data/lib/google/cloud/orchestration/airflow/service/v1/environments/client.rb +42 -9
- data/lib/google/cloud/orchestration/airflow/service/v1/environments/operations.rb +38 -7
- data/lib/google/cloud/orchestration/airflow/service/v1/environments/rest/client.rb +272 -7
- data/lib/google/cloud/orchestration/airflow/service/v1/environments/rest/operations.rb +108 -8
- data/lib/google/cloud/orchestration/airflow/service/v1/environments/rest/service_stub.rb +14 -2
- data/lib/google/cloud/orchestration/airflow/service/v1/image_versions/client.rb +41 -9
- data/lib/google/cloud/orchestration/airflow/service/v1/image_versions/rest/client.rb +53 -7
- data/lib/google/cloud/orchestration/airflow/service/v1/image_versions/rest/service_stub.rb +14 -2
- data/lib/google/cloud/orchestration/airflow/service/v1/version.rb +1 -1
- data/proto_docs/google/api/client.rb +14 -0
- data/proto_docs/google/api/field_behavior.rb +14 -0
- metadata +5 -5
checksums.yaml
CHANGED
@@ -1,7 +1,7 @@
|
|
1
1
|
---
|
2
2
|
SHA256:
|
3
|
-
metadata.gz:
|
4
|
-
data.tar.gz:
|
3
|
+
metadata.gz: 6fa37b6b906a9aca9796ee7204429312880aa29c3f10375afada9c44be02f37d
|
4
|
+
data.tar.gz: 1a212b35a9366d12c8240b4a77522151d600455fb1583869313ee13f43088b6e
|
5
5
|
SHA512:
|
6
|
-
metadata.gz:
|
7
|
-
data.tar.gz:
|
6
|
+
metadata.gz: 1fa8434f7a642a9de928e550df38c1c06ab5f2f6b83a76d4d5b768addc2ccea3a68d329396436d21a06d8aaed8d81f9d0af3ec434c81a58b3323f6e4e56e2152
|
7
|
+
data.tar.gz: d220e2af35343651a70c27498a001d3ff3d9304d50dc63fc5661fb8de3473bafb47792c7d98eed59b6c67809367ed9b8d75719814425328b55b2c763e8b4e1ec
|
data/AUTHENTICATION.md
CHANGED
@@ -1,149 +1,122 @@
|
|
1
1
|
# Authentication
|
2
2
|
|
3
|
-
|
4
|
-
[
|
5
|
-
|
6
|
-
[Google Cloud Platform environments](#google-cloud-platform-environments) the
|
7
|
-
credentials will be discovered automatically. When running on other
|
8
|
-
environments, the Service Account credentials can be specified by providing the
|
9
|
-
path to the
|
10
|
-
[JSON keyfile](https://cloud.google.com/iam/docs/managing-service-account-keys)
|
11
|
-
for the account (or the JSON itself) in
|
12
|
-
[environment variables](#environment-variables). Additionally, Cloud SDK
|
13
|
-
credentials can also be discovered automatically, but this is only recommended
|
14
|
-
during development.
|
3
|
+
The recommended way to authenticate to the google-cloud-orchestration-airflow-service-v1 library is to use
|
4
|
+
[Application Default Credentials (ADC)](https://cloud.google.com/docs/authentication/application-default-credentials).
|
5
|
+
To review all of your authentication options, see [Credentials lookup](#credential-lookup).
|
15
6
|
|
16
7
|
## Quickstart
|
17
8
|
|
18
|
-
|
19
|
-
|
9
|
+
The following example shows how to set up authentication for a local development
|
10
|
+
environment with your user credentials.
|
20
11
|
|
21
|
-
|
22
|
-
|
23
|
-
```
|
24
|
-
|
25
|
-
3. Initialize the client.
|
12
|
+
**NOTE:** This method is _not_ recommended for running in production. User credentials
|
13
|
+
should be used only during development.
|
26
14
|
|
27
|
-
|
28
|
-
|
15
|
+
1. [Download and install the Google Cloud CLI](https://cloud.google.com/sdk).
|
16
|
+
2. Set up a local ADC file with your user credentials:
|
29
17
|
|
30
|
-
|
18
|
+
```sh
|
19
|
+
gcloud auth application-default login
|
31
20
|
```
|
32
21
|
|
33
|
-
|
34
|
-
|
35
|
-
The google-cloud-orchestration-airflow-service-v1 library aims to make authentication
|
36
|
-
as simple as possible, and provides several mechanisms to configure your system
|
37
|
-
without requiring **Service Account Credentials** directly in code.
|
38
|
-
|
39
|
-
**Credentials** are discovered in the following order:
|
40
|
-
|
41
|
-
1. Specify credentials in method arguments
|
42
|
-
2. Specify credentials in configuration
|
43
|
-
3. Discover credentials path in environment variables
|
44
|
-
4. Discover credentials JSON in environment variables
|
45
|
-
5. Discover credentials file in the Cloud SDK's path
|
46
|
-
6. Discover GCP credentials
|
47
|
-
|
48
|
-
### Google Cloud Platform environments
|
22
|
+
3. Write code as if already authenticated.
|
49
23
|
|
50
|
-
|
51
|
-
|
52
|
-
Functions (GCF) and Cloud Run, **Credentials** are discovered automatically.
|
53
|
-
Code should be written as if already authenticated.
|
24
|
+
For more information about setting up authentication for a local development environment, see
|
25
|
+
[Set up Application Default Credentials](https://cloud.google.com/docs/authentication/provide-credentials-adc#local-dev).
|
54
26
|
|
55
|
-
|
27
|
+
## Credential Lookup
|
56
28
|
|
57
|
-
The
|
58
|
-
|
59
|
-
|
60
|
-
|
61
|
-
**Credentials JSON** file can be stored in the environment variable, or the
|
62
|
-
**Credentials JSON** itself can be stored for environments such as Docker
|
63
|
-
containers where writing files is difficult or not encouraged.
|
29
|
+
The google-cloud-orchestration-airflow-service-v1 library provides several mechanisms to configure your system.
|
30
|
+
Generally, using Application Default Credentials to facilitate automatic
|
31
|
+
credentials discovery is the easist method. But if you need to explicitly specify
|
32
|
+
credentials, there are several methods available to you.
|
64
33
|
|
65
|
-
|
66
|
-
checks for credentials are configured on the service Credentials class (such as
|
67
|
-
{::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Credentials}):
|
34
|
+
Credentials are accepted in the following ways, in the following order or precedence:
|
68
35
|
|
69
|
-
|
70
|
-
|
71
|
-
|
36
|
+
1. Credentials specified in method arguments
|
37
|
+
2. Credentials specified in configuration
|
38
|
+
3. Credentials pointed to or included in environment variables
|
39
|
+
4. Credentials found in local ADC file
|
40
|
+
5. Credentials returned by the metadata server for the attached service account (GCP)
|
72
41
|
|
73
|
-
|
74
|
-
require "google/cloud/orchestration/airflow/service/v1"
|
75
|
-
|
76
|
-
ENV["GOOGLE_CLOUD_CREDENTIALS"] = "path/to/keyfile.json"
|
42
|
+
### Configuration
|
77
43
|
|
78
|
-
client
|
79
|
-
|
44
|
+
You can configure a path to a JSON credentials file, either for an individual client object or
|
45
|
+
globally, for all client objects. The JSON file can contain credentials created for
|
46
|
+
[workload identity federation](https://cloud.google.com/iam/docs/workload-identity-federation),
|
47
|
+
[workforce identity federation](https://cloud.google.com/iam/docs/workforce-identity-federation), or a
|
48
|
+
[service account key](https://cloud.google.com/docs/authentication/provide-credentials-adc#local-key).
|
80
49
|
|
81
|
-
|
50
|
+
Note: Service account keys are a security risk if not managed correctly. You should
|
51
|
+
[choose a more secure alternative to service account keys](https://cloud.google.com/docs/authentication#auth-decision-tree)
|
52
|
+
whenever possible.
|
82
53
|
|
83
|
-
|
84
|
-
it in an environment variable. Either on an individual client initialization:
|
54
|
+
To configure a credentials file for an individual client initialization:
|
85
55
|
|
86
56
|
```ruby
|
87
57
|
require "google/cloud/orchestration/airflow/service/v1"
|
88
58
|
|
89
59
|
client = ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Client.new do |config|
|
90
|
-
config.credentials = "path/to/
|
60
|
+
config.credentials = "path/to/credentialfile.json"
|
91
61
|
end
|
92
62
|
```
|
93
63
|
|
94
|
-
|
64
|
+
To configure a credentials file globally for all clients:
|
95
65
|
|
96
66
|
```ruby
|
97
67
|
require "google/cloud/orchestration/airflow/service/v1"
|
98
68
|
|
99
69
|
::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Client.configure do |config|
|
100
|
-
config.credentials = "path/to/
|
70
|
+
config.credentials = "path/to/credentialfile.json"
|
101
71
|
end
|
102
72
|
|
103
73
|
client = ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Client.new
|
104
74
|
```
|
105
75
|
|
106
|
-
###
|
76
|
+
### Environment Variables
|
107
77
|
|
108
|
-
|
109
|
-
|
110
|
-
|
78
|
+
You can also use an environment variable to provide a JSON credentials file.
|
79
|
+
The environment variable can contain a path to the credentials file or, for
|
80
|
+
environments such as Docker containers where writing files is not encouraged,
|
81
|
+
you can include the credentials file itself.
|
111
82
|
|
112
|
-
|
83
|
+
The JSON file can contain credentials created for
|
84
|
+
[workload identity federation](https://cloud.google.com/iam/docs/workload-identity-federation),
|
85
|
+
[workforce identity federation](https://cloud.google.com/iam/docs/workforce-identity-federation), or a
|
86
|
+
[service account key](https://cloud.google.com/docs/authentication/provide-credentials-adc#local-key).
|
113
87
|
|
114
|
-
|
115
|
-
|
116
|
-
|
88
|
+
Note: Service account keys are a security risk if not managed correctly. You should
|
89
|
+
[choose a more secure alternative to service account keys](https://cloud.google.com/docs/authentication#auth-decision-tree)
|
90
|
+
whenever possible.
|
91
|
+
|
92
|
+
The environment variables that google-cloud-orchestration-airflow-service-v1
|
93
|
+
checks for credentials are:
|
117
94
|
|
118
|
-
|
119
|
-
*
|
95
|
+
* `GOOGLE_CLOUD_CREDENTIALS` - Path to JSON file, or JSON contents
|
96
|
+
* `GOOGLE_APPLICATION_CREDENTIALS` - Path to JSON file
|
120
97
|
|
121
|
-
|
98
|
+
```ruby
|
99
|
+
require "google/cloud/orchestration/airflow/service/v1"
|
122
100
|
|
123
|
-
|
124
|
-
connect to the APIs. You will use the **JSON key file** to
|
125
|
-
connect to most services with google-cloud-orchestration-airflow-service-v1.
|
101
|
+
ENV["GOOGLE_APPLICATION_CREDENTIALS"] = "path/to/credentialfile.json"
|
126
102
|
|
127
|
-
|
128
|
-
|
129
|
-
need a Google Developers service account.
|
103
|
+
client = ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Client.new
|
104
|
+
```
|
130
105
|
|
131
|
-
|
132
|
-
2. Create a new project or click on an existing project.
|
133
|
-
3. Activate the menu in the upper left and select **APIs & Services**. From
|
134
|
-
here, you will enable the APIs that your application requires.
|
106
|
+
### Local ADC file
|
135
107
|
|
136
|
-
|
108
|
+
You can set up a local ADC file with your user credentials for authentication during
|
109
|
+
development. If credentials are not provided in code or in environment variables,
|
110
|
+
then the local ADC credentials are discovered.
|
137
111
|
|
138
|
-
|
112
|
+
Follow the steps in [Quickstart](#quickstart) to set up a local ADC file.
|
139
113
|
|
140
|
-
|
141
|
-
"Service account" to be guided through downloading a new JSON key file.
|
114
|
+
### Google Cloud Platform environments
|
142
115
|
|
143
|
-
|
144
|
-
|
145
|
-
|
146
|
-
|
116
|
+
When running on Google Cloud Platform (GCP), including Google Compute Engine
|
117
|
+
(GCE), Google Kubernetes Engine (GKE), Google App Engine (GAE), Google Cloud
|
118
|
+
Functions (GCF) and Cloud Run, credentials are retrieved from the attached
|
119
|
+
service account automatically. Code should be written as if already authenticated.
|
147
120
|
|
148
|
-
|
149
|
-
|
121
|
+
For more information, see
|
122
|
+
[Set up ADC for Google Cloud services](https://cloud.google.com/docs/authentication/provide-credentials-adc#attached-sa).
|
@@ -32,6 +32,9 @@ module Google
|
|
32
32
|
# Managed Apache Airflow Environments.
|
33
33
|
#
|
34
34
|
class Client
|
35
|
+
# @private
|
36
|
+
DEFAULT_ENDPOINT_TEMPLATE = "composer.$UNIVERSE_DOMAIN$"
|
37
|
+
|
35
38
|
include Paths
|
36
39
|
|
37
40
|
# @private
|
@@ -92,6 +95,15 @@ module Google
|
|
92
95
|
@config
|
93
96
|
end
|
94
97
|
|
98
|
+
##
|
99
|
+
# The effective universe domain
|
100
|
+
#
|
101
|
+
# @return [String]
|
102
|
+
#
|
103
|
+
def universe_domain
|
104
|
+
@environments_stub.universe_domain
|
105
|
+
end
|
106
|
+
|
95
107
|
##
|
96
108
|
# Create a new Environments client object.
|
97
109
|
#
|
@@ -125,8 +137,9 @@ module Google
|
|
125
137
|
credentials = @config.credentials
|
126
138
|
# Use self-signed JWT if the endpoint is unchanged from default,
|
127
139
|
# but only if the default endpoint does not have a region prefix.
|
128
|
-
enable_self_signed_jwt = @config.endpoint
|
129
|
-
|
140
|
+
enable_self_signed_jwt = @config.endpoint.nil? ||
|
141
|
+
(@config.endpoint == Configuration::DEFAULT_ENDPOINT &&
|
142
|
+
!@config.endpoint.split(".").first.include?("-"))
|
130
143
|
credentials ||= Credentials.default scope: @config.scope,
|
131
144
|
enable_self_signed_jwt: enable_self_signed_jwt
|
132
145
|
if credentials.is_a?(::String) || credentials.is_a?(::Hash)
|
@@ -139,14 +152,18 @@ module Google
|
|
139
152
|
config.credentials = credentials
|
140
153
|
config.quota_project = @quota_project_id
|
141
154
|
config.endpoint = @config.endpoint
|
155
|
+
config.universe_domain = @config.universe_domain
|
142
156
|
end
|
143
157
|
|
144
158
|
@environments_stub = ::Gapic::ServiceStub.new(
|
145
159
|
::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Stub,
|
146
|
-
credentials:
|
147
|
-
endpoint:
|
160
|
+
credentials: credentials,
|
161
|
+
endpoint: @config.endpoint,
|
162
|
+
endpoint_template: DEFAULT_ENDPOINT_TEMPLATE,
|
163
|
+
universe_domain: @config.universe_domain,
|
148
164
|
channel_args: @config.channel_args,
|
149
|
-
interceptors: @config.interceptors
|
165
|
+
interceptors: @config.interceptors,
|
166
|
+
channel_pool_config: @config.channel_pool
|
150
167
|
)
|
151
168
|
end
|
152
169
|
|
@@ -1457,9 +1474,9 @@ module Google
|
|
1457
1474
|
# end
|
1458
1475
|
#
|
1459
1476
|
# @!attribute [rw] endpoint
|
1460
|
-
#
|
1461
|
-
#
|
1462
|
-
# @return [::String]
|
1477
|
+
# A custom service endpoint, as a hostname or hostname:port. The default is
|
1478
|
+
# nil, indicating to use the default endpoint in the current universe domain.
|
1479
|
+
# @return [::String,nil]
|
1463
1480
|
# @!attribute [rw] credentials
|
1464
1481
|
# Credentials to send with calls. You may provide any of the following types:
|
1465
1482
|
# * (`String`) The path to a service account key file in JSON format
|
@@ -1505,13 +1522,20 @@ module Google
|
|
1505
1522
|
# @!attribute [rw] quota_project
|
1506
1523
|
# A separate project against which to charge quota.
|
1507
1524
|
# @return [::String]
|
1525
|
+
# @!attribute [rw] universe_domain
|
1526
|
+
# The universe domain within which to make requests. This determines the
|
1527
|
+
# default endpoint URL. The default value of nil uses the environment
|
1528
|
+
# universe (usually the default "googleapis.com" universe).
|
1529
|
+
# @return [::String,nil]
|
1508
1530
|
#
|
1509
1531
|
class Configuration
|
1510
1532
|
extend ::Gapic::Config
|
1511
1533
|
|
1534
|
+
# @private
|
1535
|
+
# The endpoint specific to the default "googleapis.com" universe. Deprecated.
|
1512
1536
|
DEFAULT_ENDPOINT = "composer.googleapis.com"
|
1513
1537
|
|
1514
|
-
config_attr :endpoint,
|
1538
|
+
config_attr :endpoint, nil, ::String, nil
|
1515
1539
|
config_attr :credentials, nil do |value|
|
1516
1540
|
allowed = [::String, ::Hash, ::Proc, ::Symbol, ::Google::Auth::Credentials, ::Signet::OAuth2::Client, nil]
|
1517
1541
|
allowed += [::GRPC::Core::Channel, ::GRPC::Core::ChannelCredentials] if defined? ::GRPC
|
@@ -1526,6 +1550,7 @@ module Google
|
|
1526
1550
|
config_attr :metadata, nil, ::Hash, nil
|
1527
1551
|
config_attr :retry_policy, nil, ::Hash, ::Proc, nil
|
1528
1552
|
config_attr :quota_project, nil, ::String, nil
|
1553
|
+
config_attr :universe_domain, nil, ::String, nil
|
1529
1554
|
|
1530
1555
|
# @private
|
1531
1556
|
def initialize parent_config = nil
|
@@ -1546,6 +1571,14 @@ module Google
|
|
1546
1571
|
end
|
1547
1572
|
end
|
1548
1573
|
|
1574
|
+
##
|
1575
|
+
# Configuration for the channel pool
|
1576
|
+
# @return [::Gapic::ServiceStub::ChannelPool::Configuration]
|
1577
|
+
#
|
1578
|
+
def channel_pool
|
1579
|
+
@channel_pool ||= ::Gapic::ServiceStub::ChannelPool::Configuration.new
|
1580
|
+
end
|
1581
|
+
|
1549
1582
|
##
|
1550
1583
|
# Configuration RPC class for the Environments API.
|
1551
1584
|
#
|
@@ -28,6 +28,9 @@ module Google
|
|
28
28
|
module Environments
|
29
29
|
# Service that implements Longrunning Operations API.
|
30
30
|
class Operations
|
31
|
+
# @private
|
32
|
+
DEFAULT_ENDPOINT_TEMPLATE = "composer.$UNIVERSE_DOMAIN$"
|
33
|
+
|
31
34
|
# @private
|
32
35
|
attr_reader :operations_stub
|
33
36
|
|
@@ -62,6 +65,15 @@ module Google
|
|
62
65
|
@config
|
63
66
|
end
|
64
67
|
|
68
|
+
##
|
69
|
+
# The effective universe domain
|
70
|
+
#
|
71
|
+
# @return [String]
|
72
|
+
#
|
73
|
+
def universe_domain
|
74
|
+
@operations_stub.universe_domain
|
75
|
+
end
|
76
|
+
|
65
77
|
##
|
66
78
|
# Create a new Operations client object.
|
67
79
|
#
|
@@ -92,10 +104,13 @@ module Google
|
|
92
104
|
|
93
105
|
@operations_stub = ::Gapic::ServiceStub.new(
|
94
106
|
::Google::Longrunning::Operations::Stub,
|
95
|
-
credentials:
|
96
|
-
endpoint:
|
107
|
+
credentials: credentials,
|
108
|
+
endpoint: @config.endpoint,
|
109
|
+
endpoint_template: DEFAULT_ENDPOINT_TEMPLATE,
|
110
|
+
universe_domain: @config.universe_domain,
|
97
111
|
channel_args: @config.channel_args,
|
98
|
-
interceptors: @config.interceptors
|
112
|
+
interceptors: @config.interceptors,
|
113
|
+
channel_pool_config: @config.channel_pool
|
99
114
|
)
|
100
115
|
|
101
116
|
# Used by an LRO wrapper for some methods of this service
|
@@ -614,9 +629,9 @@ module Google
|
|
614
629
|
# end
|
615
630
|
#
|
616
631
|
# @!attribute [rw] endpoint
|
617
|
-
#
|
618
|
-
#
|
619
|
-
# @return [::String]
|
632
|
+
# A custom service endpoint, as a hostname or hostname:port. The default is
|
633
|
+
# nil, indicating to use the default endpoint in the current universe domain.
|
634
|
+
# @return [::String,nil]
|
620
635
|
# @!attribute [rw] credentials
|
621
636
|
# Credentials to send with calls. You may provide any of the following types:
|
622
637
|
# * (`String`) The path to a service account key file in JSON format
|
@@ -662,13 +677,20 @@ module Google
|
|
662
677
|
# @!attribute [rw] quota_project
|
663
678
|
# A separate project against which to charge quota.
|
664
679
|
# @return [::String]
|
680
|
+
# @!attribute [rw] universe_domain
|
681
|
+
# The universe domain within which to make requests. This determines the
|
682
|
+
# default endpoint URL. The default value of nil uses the environment
|
683
|
+
# universe (usually the default "googleapis.com" universe).
|
684
|
+
# @return [::String,nil]
|
665
685
|
#
|
666
686
|
class Configuration
|
667
687
|
extend ::Gapic::Config
|
668
688
|
|
689
|
+
# @private
|
690
|
+
# The endpoint specific to the default "googleapis.com" universe. Deprecated.
|
669
691
|
DEFAULT_ENDPOINT = "composer.googleapis.com"
|
670
692
|
|
671
|
-
config_attr :endpoint,
|
693
|
+
config_attr :endpoint, nil, ::String, nil
|
672
694
|
config_attr :credentials, nil do |value|
|
673
695
|
allowed = [::String, ::Hash, ::Proc, ::Symbol, ::Google::Auth::Credentials, ::Signet::OAuth2::Client, nil]
|
674
696
|
allowed += [::GRPC::Core::Channel, ::GRPC::Core::ChannelCredentials] if defined? ::GRPC
|
@@ -683,6 +705,7 @@ module Google
|
|
683
705
|
config_attr :metadata, nil, ::Hash, nil
|
684
706
|
config_attr :retry_policy, nil, ::Hash, ::Proc, nil
|
685
707
|
config_attr :quota_project, nil, ::String, nil
|
708
|
+
config_attr :universe_domain, nil, ::String, nil
|
686
709
|
|
687
710
|
# @private
|
688
711
|
def initialize parent_config = nil
|
@@ -703,6 +726,14 @@ module Google
|
|
703
726
|
end
|
704
727
|
end
|
705
728
|
|
729
|
+
##
|
730
|
+
# Configuration for the channel pool
|
731
|
+
# @return [::Gapic::ServiceStub::ChannelPool::Configuration]
|
732
|
+
#
|
733
|
+
def channel_pool
|
734
|
+
@channel_pool ||= ::Gapic::ServiceStub::ChannelPool::Configuration.new
|
735
|
+
end
|
736
|
+
|
706
737
|
##
|
707
738
|
# Configuration RPC class for the Operations API.
|
708
739
|
#
|