google-cloud-orchestration-airflow-service-v1 0.7.0 → 0.9.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- checksums.yaml +4 -4
- data/AUTHENTICATION.md +72 -99
- data/lib/google/cloud/orchestration/airflow/service/v1/environments/client.rb +42 -9
- data/lib/google/cloud/orchestration/airflow/service/v1/environments/operations.rb +38 -7
- data/lib/google/cloud/orchestration/airflow/service/v1/environments/rest/client.rb +272 -7
- data/lib/google/cloud/orchestration/airflow/service/v1/environments/rest/operations.rb +108 -8
- data/lib/google/cloud/orchestration/airflow/service/v1/environments/rest/service_stub.rb +14 -2
- data/lib/google/cloud/orchestration/airflow/service/v1/image_versions/client.rb +41 -9
- data/lib/google/cloud/orchestration/airflow/service/v1/image_versions/rest/client.rb +53 -7
- data/lib/google/cloud/orchestration/airflow/service/v1/image_versions/rest/service_stub.rb +14 -2
- data/lib/google/cloud/orchestration/airflow/service/v1/version.rb +1 -1
- data/proto_docs/google/api/client.rb +14 -0
- data/proto_docs/google/api/field_behavior.rb +14 -0
- metadata +5 -5
checksums.yaml
CHANGED
@@ -1,7 +1,7 @@
|
|
1
1
|
---
|
2
2
|
SHA256:
|
3
|
-
metadata.gz:
|
4
|
-
data.tar.gz:
|
3
|
+
metadata.gz: 6fa37b6b906a9aca9796ee7204429312880aa29c3f10375afada9c44be02f37d
|
4
|
+
data.tar.gz: 1a212b35a9366d12c8240b4a77522151d600455fb1583869313ee13f43088b6e
|
5
5
|
SHA512:
|
6
|
-
metadata.gz:
|
7
|
-
data.tar.gz:
|
6
|
+
metadata.gz: 1fa8434f7a642a9de928e550df38c1c06ab5f2f6b83a76d4d5b768addc2ccea3a68d329396436d21a06d8aaed8d81f9d0af3ec434c81a58b3323f6e4e56e2152
|
7
|
+
data.tar.gz: d220e2af35343651a70c27498a001d3ff3d9304d50dc63fc5661fb8de3473bafb47792c7d98eed59b6c67809367ed9b8d75719814425328b55b2c763e8b4e1ec
|
data/AUTHENTICATION.md
CHANGED
@@ -1,149 +1,122 @@
|
|
1
1
|
# Authentication
|
2
2
|
|
3
|
-
|
4
|
-
[
|
5
|
-
|
6
|
-
[Google Cloud Platform environments](#google-cloud-platform-environments) the
|
7
|
-
credentials will be discovered automatically. When running on other
|
8
|
-
environments, the Service Account credentials can be specified by providing the
|
9
|
-
path to the
|
10
|
-
[JSON keyfile](https://cloud.google.com/iam/docs/managing-service-account-keys)
|
11
|
-
for the account (or the JSON itself) in
|
12
|
-
[environment variables](#environment-variables). Additionally, Cloud SDK
|
13
|
-
credentials can also be discovered automatically, but this is only recommended
|
14
|
-
during development.
|
3
|
+
The recommended way to authenticate to the google-cloud-orchestration-airflow-service-v1 library is to use
|
4
|
+
[Application Default Credentials (ADC)](https://cloud.google.com/docs/authentication/application-default-credentials).
|
5
|
+
To review all of your authentication options, see [Credentials lookup](#credential-lookup).
|
15
6
|
|
16
7
|
## Quickstart
|
17
8
|
|
18
|
-
|
19
|
-
|
9
|
+
The following example shows how to set up authentication for a local development
|
10
|
+
environment with your user credentials.
|
20
11
|
|
21
|
-
|
22
|
-
|
23
|
-
```
|
24
|
-
|
25
|
-
3. Initialize the client.
|
12
|
+
**NOTE:** This method is _not_ recommended for running in production. User credentials
|
13
|
+
should be used only during development.
|
26
14
|
|
27
|
-
|
28
|
-
|
15
|
+
1. [Download and install the Google Cloud CLI](https://cloud.google.com/sdk).
|
16
|
+
2. Set up a local ADC file with your user credentials:
|
29
17
|
|
30
|
-
|
18
|
+
```sh
|
19
|
+
gcloud auth application-default login
|
31
20
|
```
|
32
21
|
|
33
|
-
|
34
|
-
|
35
|
-
The google-cloud-orchestration-airflow-service-v1 library aims to make authentication
|
36
|
-
as simple as possible, and provides several mechanisms to configure your system
|
37
|
-
without requiring **Service Account Credentials** directly in code.
|
38
|
-
|
39
|
-
**Credentials** are discovered in the following order:
|
40
|
-
|
41
|
-
1. Specify credentials in method arguments
|
42
|
-
2. Specify credentials in configuration
|
43
|
-
3. Discover credentials path in environment variables
|
44
|
-
4. Discover credentials JSON in environment variables
|
45
|
-
5. Discover credentials file in the Cloud SDK's path
|
46
|
-
6. Discover GCP credentials
|
47
|
-
|
48
|
-
### Google Cloud Platform environments
|
22
|
+
3. Write code as if already authenticated.
|
49
23
|
|
50
|
-
|
51
|
-
|
52
|
-
Functions (GCF) and Cloud Run, **Credentials** are discovered automatically.
|
53
|
-
Code should be written as if already authenticated.
|
24
|
+
For more information about setting up authentication for a local development environment, see
|
25
|
+
[Set up Application Default Credentials](https://cloud.google.com/docs/authentication/provide-credentials-adc#local-dev).
|
54
26
|
|
55
|
-
|
27
|
+
## Credential Lookup
|
56
28
|
|
57
|
-
The
|
58
|
-
|
59
|
-
|
60
|
-
|
61
|
-
**Credentials JSON** file can be stored in the environment variable, or the
|
62
|
-
**Credentials JSON** itself can be stored for environments such as Docker
|
63
|
-
containers where writing files is difficult or not encouraged.
|
29
|
+
The google-cloud-orchestration-airflow-service-v1 library provides several mechanisms to configure your system.
|
30
|
+
Generally, using Application Default Credentials to facilitate automatic
|
31
|
+
credentials discovery is the easist method. But if you need to explicitly specify
|
32
|
+
credentials, there are several methods available to you.
|
64
33
|
|
65
|
-
|
66
|
-
checks for credentials are configured on the service Credentials class (such as
|
67
|
-
{::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Credentials}):
|
34
|
+
Credentials are accepted in the following ways, in the following order or precedence:
|
68
35
|
|
69
|
-
|
70
|
-
|
71
|
-
|
36
|
+
1. Credentials specified in method arguments
|
37
|
+
2. Credentials specified in configuration
|
38
|
+
3. Credentials pointed to or included in environment variables
|
39
|
+
4. Credentials found in local ADC file
|
40
|
+
5. Credentials returned by the metadata server for the attached service account (GCP)
|
72
41
|
|
73
|
-
|
74
|
-
require "google/cloud/orchestration/airflow/service/v1"
|
75
|
-
|
76
|
-
ENV["GOOGLE_CLOUD_CREDENTIALS"] = "path/to/keyfile.json"
|
42
|
+
### Configuration
|
77
43
|
|
78
|
-
client
|
79
|
-
|
44
|
+
You can configure a path to a JSON credentials file, either for an individual client object or
|
45
|
+
globally, for all client objects. The JSON file can contain credentials created for
|
46
|
+
[workload identity federation](https://cloud.google.com/iam/docs/workload-identity-federation),
|
47
|
+
[workforce identity federation](https://cloud.google.com/iam/docs/workforce-identity-federation), or a
|
48
|
+
[service account key](https://cloud.google.com/docs/authentication/provide-credentials-adc#local-key).
|
80
49
|
|
81
|
-
|
50
|
+
Note: Service account keys are a security risk if not managed correctly. You should
|
51
|
+
[choose a more secure alternative to service account keys](https://cloud.google.com/docs/authentication#auth-decision-tree)
|
52
|
+
whenever possible.
|
82
53
|
|
83
|
-
|
84
|
-
it in an environment variable. Either on an individual client initialization:
|
54
|
+
To configure a credentials file for an individual client initialization:
|
85
55
|
|
86
56
|
```ruby
|
87
57
|
require "google/cloud/orchestration/airflow/service/v1"
|
88
58
|
|
89
59
|
client = ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Client.new do |config|
|
90
|
-
config.credentials = "path/to/
|
60
|
+
config.credentials = "path/to/credentialfile.json"
|
91
61
|
end
|
92
62
|
```
|
93
63
|
|
94
|
-
|
64
|
+
To configure a credentials file globally for all clients:
|
95
65
|
|
96
66
|
```ruby
|
97
67
|
require "google/cloud/orchestration/airflow/service/v1"
|
98
68
|
|
99
69
|
::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Client.configure do |config|
|
100
|
-
config.credentials = "path/to/
|
70
|
+
config.credentials = "path/to/credentialfile.json"
|
101
71
|
end
|
102
72
|
|
103
73
|
client = ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Client.new
|
104
74
|
```
|
105
75
|
|
106
|
-
###
|
76
|
+
### Environment Variables
|
107
77
|
|
108
|
-
|
109
|
-
|
110
|
-
|
78
|
+
You can also use an environment variable to provide a JSON credentials file.
|
79
|
+
The environment variable can contain a path to the credentials file or, for
|
80
|
+
environments such as Docker containers where writing files is not encouraged,
|
81
|
+
you can include the credentials file itself.
|
111
82
|
|
112
|
-
|
83
|
+
The JSON file can contain credentials created for
|
84
|
+
[workload identity federation](https://cloud.google.com/iam/docs/workload-identity-federation),
|
85
|
+
[workforce identity federation](https://cloud.google.com/iam/docs/workforce-identity-federation), or a
|
86
|
+
[service account key](https://cloud.google.com/docs/authentication/provide-credentials-adc#local-key).
|
113
87
|
|
114
|
-
|
115
|
-
|
116
|
-
|
88
|
+
Note: Service account keys are a security risk if not managed correctly. You should
|
89
|
+
[choose a more secure alternative to service account keys](https://cloud.google.com/docs/authentication#auth-decision-tree)
|
90
|
+
whenever possible.
|
91
|
+
|
92
|
+
The environment variables that google-cloud-orchestration-airflow-service-v1
|
93
|
+
checks for credentials are:
|
117
94
|
|
118
|
-
|
119
|
-
*
|
95
|
+
* `GOOGLE_CLOUD_CREDENTIALS` - Path to JSON file, or JSON contents
|
96
|
+
* `GOOGLE_APPLICATION_CREDENTIALS` - Path to JSON file
|
120
97
|
|
121
|
-
|
98
|
+
```ruby
|
99
|
+
require "google/cloud/orchestration/airflow/service/v1"
|
122
100
|
|
123
|
-
|
124
|
-
connect to the APIs. You will use the **JSON key file** to
|
125
|
-
connect to most services with google-cloud-orchestration-airflow-service-v1.
|
101
|
+
ENV["GOOGLE_APPLICATION_CREDENTIALS"] = "path/to/credentialfile.json"
|
126
102
|
|
127
|
-
|
128
|
-
|
129
|
-
need a Google Developers service account.
|
103
|
+
client = ::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Client.new
|
104
|
+
```
|
130
105
|
|
131
|
-
|
132
|
-
2. Create a new project or click on an existing project.
|
133
|
-
3. Activate the menu in the upper left and select **APIs & Services**. From
|
134
|
-
here, you will enable the APIs that your application requires.
|
106
|
+
### Local ADC file
|
135
107
|
|
136
|
-
|
108
|
+
You can set up a local ADC file with your user credentials for authentication during
|
109
|
+
development. If credentials are not provided in code or in environment variables,
|
110
|
+
then the local ADC credentials are discovered.
|
137
111
|
|
138
|
-
|
112
|
+
Follow the steps in [Quickstart](#quickstart) to set up a local ADC file.
|
139
113
|
|
140
|
-
|
141
|
-
"Service account" to be guided through downloading a new JSON key file.
|
114
|
+
### Google Cloud Platform environments
|
142
115
|
|
143
|
-
|
144
|
-
|
145
|
-
|
146
|
-
|
116
|
+
When running on Google Cloud Platform (GCP), including Google Compute Engine
|
117
|
+
(GCE), Google Kubernetes Engine (GKE), Google App Engine (GAE), Google Cloud
|
118
|
+
Functions (GCF) and Cloud Run, credentials are retrieved from the attached
|
119
|
+
service account automatically. Code should be written as if already authenticated.
|
147
120
|
|
148
|
-
|
149
|
-
|
121
|
+
For more information, see
|
122
|
+
[Set up ADC for Google Cloud services](https://cloud.google.com/docs/authentication/provide-credentials-adc#attached-sa).
|
@@ -32,6 +32,9 @@ module Google
|
|
32
32
|
# Managed Apache Airflow Environments.
|
33
33
|
#
|
34
34
|
class Client
|
35
|
+
# @private
|
36
|
+
DEFAULT_ENDPOINT_TEMPLATE = "composer.$UNIVERSE_DOMAIN$"
|
37
|
+
|
35
38
|
include Paths
|
36
39
|
|
37
40
|
# @private
|
@@ -92,6 +95,15 @@ module Google
|
|
92
95
|
@config
|
93
96
|
end
|
94
97
|
|
98
|
+
##
|
99
|
+
# The effective universe domain
|
100
|
+
#
|
101
|
+
# @return [String]
|
102
|
+
#
|
103
|
+
def universe_domain
|
104
|
+
@environments_stub.universe_domain
|
105
|
+
end
|
106
|
+
|
95
107
|
##
|
96
108
|
# Create a new Environments client object.
|
97
109
|
#
|
@@ -125,8 +137,9 @@ module Google
|
|
125
137
|
credentials = @config.credentials
|
126
138
|
# Use self-signed JWT if the endpoint is unchanged from default,
|
127
139
|
# but only if the default endpoint does not have a region prefix.
|
128
|
-
enable_self_signed_jwt = @config.endpoint
|
129
|
-
|
140
|
+
enable_self_signed_jwt = @config.endpoint.nil? ||
|
141
|
+
(@config.endpoint == Configuration::DEFAULT_ENDPOINT &&
|
142
|
+
!@config.endpoint.split(".").first.include?("-"))
|
130
143
|
credentials ||= Credentials.default scope: @config.scope,
|
131
144
|
enable_self_signed_jwt: enable_self_signed_jwt
|
132
145
|
if credentials.is_a?(::String) || credentials.is_a?(::Hash)
|
@@ -139,14 +152,18 @@ module Google
|
|
139
152
|
config.credentials = credentials
|
140
153
|
config.quota_project = @quota_project_id
|
141
154
|
config.endpoint = @config.endpoint
|
155
|
+
config.universe_domain = @config.universe_domain
|
142
156
|
end
|
143
157
|
|
144
158
|
@environments_stub = ::Gapic::ServiceStub.new(
|
145
159
|
::Google::Cloud::Orchestration::Airflow::Service::V1::Environments::Stub,
|
146
|
-
credentials:
|
147
|
-
endpoint:
|
160
|
+
credentials: credentials,
|
161
|
+
endpoint: @config.endpoint,
|
162
|
+
endpoint_template: DEFAULT_ENDPOINT_TEMPLATE,
|
163
|
+
universe_domain: @config.universe_domain,
|
148
164
|
channel_args: @config.channel_args,
|
149
|
-
interceptors: @config.interceptors
|
165
|
+
interceptors: @config.interceptors,
|
166
|
+
channel_pool_config: @config.channel_pool
|
150
167
|
)
|
151
168
|
end
|
152
169
|
|
@@ -1457,9 +1474,9 @@ module Google
|
|
1457
1474
|
# end
|
1458
1475
|
#
|
1459
1476
|
# @!attribute [rw] endpoint
|
1460
|
-
#
|
1461
|
-
#
|
1462
|
-
# @return [::String]
|
1477
|
+
# A custom service endpoint, as a hostname or hostname:port. The default is
|
1478
|
+
# nil, indicating to use the default endpoint in the current universe domain.
|
1479
|
+
# @return [::String,nil]
|
1463
1480
|
# @!attribute [rw] credentials
|
1464
1481
|
# Credentials to send with calls. You may provide any of the following types:
|
1465
1482
|
# * (`String`) The path to a service account key file in JSON format
|
@@ -1505,13 +1522,20 @@ module Google
|
|
1505
1522
|
# @!attribute [rw] quota_project
|
1506
1523
|
# A separate project against which to charge quota.
|
1507
1524
|
# @return [::String]
|
1525
|
+
# @!attribute [rw] universe_domain
|
1526
|
+
# The universe domain within which to make requests. This determines the
|
1527
|
+
# default endpoint URL. The default value of nil uses the environment
|
1528
|
+
# universe (usually the default "googleapis.com" universe).
|
1529
|
+
# @return [::String,nil]
|
1508
1530
|
#
|
1509
1531
|
class Configuration
|
1510
1532
|
extend ::Gapic::Config
|
1511
1533
|
|
1534
|
+
# @private
|
1535
|
+
# The endpoint specific to the default "googleapis.com" universe. Deprecated.
|
1512
1536
|
DEFAULT_ENDPOINT = "composer.googleapis.com"
|
1513
1537
|
|
1514
|
-
config_attr :endpoint,
|
1538
|
+
config_attr :endpoint, nil, ::String, nil
|
1515
1539
|
config_attr :credentials, nil do |value|
|
1516
1540
|
allowed = [::String, ::Hash, ::Proc, ::Symbol, ::Google::Auth::Credentials, ::Signet::OAuth2::Client, nil]
|
1517
1541
|
allowed += [::GRPC::Core::Channel, ::GRPC::Core::ChannelCredentials] if defined? ::GRPC
|
@@ -1526,6 +1550,7 @@ module Google
|
|
1526
1550
|
config_attr :metadata, nil, ::Hash, nil
|
1527
1551
|
config_attr :retry_policy, nil, ::Hash, ::Proc, nil
|
1528
1552
|
config_attr :quota_project, nil, ::String, nil
|
1553
|
+
config_attr :universe_domain, nil, ::String, nil
|
1529
1554
|
|
1530
1555
|
# @private
|
1531
1556
|
def initialize parent_config = nil
|
@@ -1546,6 +1571,14 @@ module Google
|
|
1546
1571
|
end
|
1547
1572
|
end
|
1548
1573
|
|
1574
|
+
##
|
1575
|
+
# Configuration for the channel pool
|
1576
|
+
# @return [::Gapic::ServiceStub::ChannelPool::Configuration]
|
1577
|
+
#
|
1578
|
+
def channel_pool
|
1579
|
+
@channel_pool ||= ::Gapic::ServiceStub::ChannelPool::Configuration.new
|
1580
|
+
end
|
1581
|
+
|
1549
1582
|
##
|
1550
1583
|
# Configuration RPC class for the Environments API.
|
1551
1584
|
#
|
@@ -28,6 +28,9 @@ module Google
|
|
28
28
|
module Environments
|
29
29
|
# Service that implements Longrunning Operations API.
|
30
30
|
class Operations
|
31
|
+
# @private
|
32
|
+
DEFAULT_ENDPOINT_TEMPLATE = "composer.$UNIVERSE_DOMAIN$"
|
33
|
+
|
31
34
|
# @private
|
32
35
|
attr_reader :operations_stub
|
33
36
|
|
@@ -62,6 +65,15 @@ module Google
|
|
62
65
|
@config
|
63
66
|
end
|
64
67
|
|
68
|
+
##
|
69
|
+
# The effective universe domain
|
70
|
+
#
|
71
|
+
# @return [String]
|
72
|
+
#
|
73
|
+
def universe_domain
|
74
|
+
@operations_stub.universe_domain
|
75
|
+
end
|
76
|
+
|
65
77
|
##
|
66
78
|
# Create a new Operations client object.
|
67
79
|
#
|
@@ -92,10 +104,13 @@ module Google
|
|
92
104
|
|
93
105
|
@operations_stub = ::Gapic::ServiceStub.new(
|
94
106
|
::Google::Longrunning::Operations::Stub,
|
95
|
-
credentials:
|
96
|
-
endpoint:
|
107
|
+
credentials: credentials,
|
108
|
+
endpoint: @config.endpoint,
|
109
|
+
endpoint_template: DEFAULT_ENDPOINT_TEMPLATE,
|
110
|
+
universe_domain: @config.universe_domain,
|
97
111
|
channel_args: @config.channel_args,
|
98
|
-
interceptors: @config.interceptors
|
112
|
+
interceptors: @config.interceptors,
|
113
|
+
channel_pool_config: @config.channel_pool
|
99
114
|
)
|
100
115
|
|
101
116
|
# Used by an LRO wrapper for some methods of this service
|
@@ -614,9 +629,9 @@ module Google
|
|
614
629
|
# end
|
615
630
|
#
|
616
631
|
# @!attribute [rw] endpoint
|
617
|
-
#
|
618
|
-
#
|
619
|
-
# @return [::String]
|
632
|
+
# A custom service endpoint, as a hostname or hostname:port. The default is
|
633
|
+
# nil, indicating to use the default endpoint in the current universe domain.
|
634
|
+
# @return [::String,nil]
|
620
635
|
# @!attribute [rw] credentials
|
621
636
|
# Credentials to send with calls. You may provide any of the following types:
|
622
637
|
# * (`String`) The path to a service account key file in JSON format
|
@@ -662,13 +677,20 @@ module Google
|
|
662
677
|
# @!attribute [rw] quota_project
|
663
678
|
# A separate project against which to charge quota.
|
664
679
|
# @return [::String]
|
680
|
+
# @!attribute [rw] universe_domain
|
681
|
+
# The universe domain within which to make requests. This determines the
|
682
|
+
# default endpoint URL. The default value of nil uses the environment
|
683
|
+
# universe (usually the default "googleapis.com" universe).
|
684
|
+
# @return [::String,nil]
|
665
685
|
#
|
666
686
|
class Configuration
|
667
687
|
extend ::Gapic::Config
|
668
688
|
|
689
|
+
# @private
|
690
|
+
# The endpoint specific to the default "googleapis.com" universe. Deprecated.
|
669
691
|
DEFAULT_ENDPOINT = "composer.googleapis.com"
|
670
692
|
|
671
|
-
config_attr :endpoint,
|
693
|
+
config_attr :endpoint, nil, ::String, nil
|
672
694
|
config_attr :credentials, nil do |value|
|
673
695
|
allowed = [::String, ::Hash, ::Proc, ::Symbol, ::Google::Auth::Credentials, ::Signet::OAuth2::Client, nil]
|
674
696
|
allowed += [::GRPC::Core::Channel, ::GRPC::Core::ChannelCredentials] if defined? ::GRPC
|
@@ -683,6 +705,7 @@ module Google
|
|
683
705
|
config_attr :metadata, nil, ::Hash, nil
|
684
706
|
config_attr :retry_policy, nil, ::Hash, ::Proc, nil
|
685
707
|
config_attr :quota_project, nil, ::String, nil
|
708
|
+
config_attr :universe_domain, nil, ::String, nil
|
686
709
|
|
687
710
|
# @private
|
688
711
|
def initialize parent_config = nil
|
@@ -703,6 +726,14 @@ module Google
|
|
703
726
|
end
|
704
727
|
end
|
705
728
|
|
729
|
+
##
|
730
|
+
# Configuration for the channel pool
|
731
|
+
# @return [::Gapic::ServiceStub::ChannelPool::Configuration]
|
732
|
+
#
|
733
|
+
def channel_pool
|
734
|
+
@channel_pool ||= ::Gapic::ServiceStub::ChannelPool::Configuration.new
|
735
|
+
end
|
736
|
+
|
706
737
|
##
|
707
738
|
# Configuration RPC class for the Operations API.
|
708
739
|
#
|