google-cloud-dataproc-v1 0.2.2 → 0.4.0
Sign up to get free protection for your applications and to get access to all the features.
- checksums.yaml +4 -4
- data/README.md +68 -0
- data/lib/google/cloud/dataproc/v1.rb +3 -0
- data/lib/google/cloud/dataproc/v1/autoscaling_policies_services_pb.rb +5 -5
- data/lib/google/cloud/dataproc/v1/autoscaling_policy_service/client.rb +12 -6
- data/lib/google/cloud/dataproc/v1/cluster_controller/client.rb +15 -9
- data/lib/google/cloud/dataproc/v1/cluster_controller/operations.rb +90 -5
- data/lib/google/cloud/dataproc/v1/clusters_pb.rb +14 -0
- data/lib/google/cloud/dataproc/v1/clusters_services_pb.rb +6 -6
- data/lib/google/cloud/dataproc/v1/job_controller/client.rb +16 -10
- data/lib/google/cloud/dataproc/v1/job_controller/operations.rb +90 -5
- data/lib/google/cloud/dataproc/v1/jobs_services_pb.rb +7 -7
- data/lib/google/cloud/dataproc/v1/version.rb +1 -1
- data/lib/google/cloud/dataproc/v1/workflow_template_service/client.rb +16 -10
- data/lib/google/cloud/dataproc/v1/workflow_template_service/operations.rb +90 -5
- data/lib/google/cloud/dataproc/v1/workflow_templates_services_pb.rb +7 -7
- data/proto_docs/google/api/field_behavior.rb +6 -0
- data/proto_docs/google/api/resource.rb +50 -14
- data/proto_docs/google/cloud/dataproc/v1/autoscaling_policies.rb +8 -2
- data/proto_docs/google/cloud/dataproc/v1/clusters.rb +69 -2
- data/proto_docs/google/cloud/dataproc/v1/jobs.rb +14 -13
- data/proto_docs/google/cloud/dataproc/v1/shared.rb +1 -1
- data/proto_docs/google/cloud/dataproc/v1/workflow_templates.rb +9 -3
- data/proto_docs/google/longrunning/operations.rb +17 -3
- data/proto_docs/google/protobuf/any.rb +5 -2
- data/proto_docs/google/protobuf/timestamp.rb +10 -1
- metadata +9 -6
checksums.yaml
CHANGED
@@ -1,7 +1,7 @@
|
|
1
1
|
---
|
2
2
|
SHA256:
|
3
|
-
metadata.gz:
|
4
|
-
data.tar.gz:
|
3
|
+
metadata.gz: 3a52ce94bdae1f76062be290ebebc5edc5c0732aac76c4a339564aaa92af6d13
|
4
|
+
data.tar.gz: a9e12b96f312e6167d6c07df02f919bbb814350ddcafbd2c950df90528e2a13b
|
5
5
|
SHA512:
|
6
|
-
metadata.gz:
|
7
|
-
data.tar.gz:
|
6
|
+
metadata.gz: 4b8cf8f4b5f30eabd11527e5115e519b48f9c847f9345ed6185a30669a379c958b87afd7318dfac4865a80c1dfcda7111bd2323d36e3695c9cac826b98ad9495
|
7
|
+
data.tar.gz: 42c03da8d54c388ced1cf4ff18036994ae7991d603c57705604f27008c601c1badfdfcf78c2af11801164f35de95d285298b0722b4f06e72ed6c6158af577ff6
|
data/README.md
CHANGED
@@ -6,6 +6,12 @@ Manages Hadoop-based clusters and jobs on Google Cloud Platform.
|
|
6
6
|
|
7
7
|
https://github.com/googleapis/google-cloud-ruby
|
8
8
|
|
9
|
+
This gem is a _versioned_ client. It provides basic client classes for a
|
10
|
+
specific version of the Cloud Dataproc V1 API. Most users should consider using
|
11
|
+
the main client gem,
|
12
|
+
[google-cloud-dataproc](https://rubygems.org/gems/google-cloud-dataproc).
|
13
|
+
See the section below titled *Which client should I use?* for more information.
|
14
|
+
|
9
15
|
## Installation
|
10
16
|
|
11
17
|
```
|
@@ -18,6 +24,7 @@ In order to use this library, you first need to go through the following steps:
|
|
18
24
|
|
19
25
|
1. [Select or create a Cloud Platform project.](https://console.cloud.google.com/project)
|
20
26
|
1. [Enable billing for your project.](https://cloud.google.com/billing/docs/how-to/modify-project#enable_billing_for_a_project)
|
27
|
+
1. [Enable the API.](https://console.cloud.google.com/apis/library/dataproc.googleapis.com)
|
21
28
|
1. {file:AUTHENTICATION.md Set up authentication.}
|
22
29
|
|
23
30
|
## Quick Start
|
@@ -33,6 +40,9 @@ response = client.create_autoscaling_policy request
|
|
33
40
|
View the [Client Library Documentation](https://googleapis.dev/ruby/google-cloud-dataproc-v1/latest)
|
34
41
|
for class and method documentation.
|
35
42
|
|
43
|
+
See also the [Product Documentation](https://cloud.google.com/dataproc)
|
44
|
+
for general usage information.
|
45
|
+
|
36
46
|
## Enabling Logging
|
37
47
|
|
38
48
|
To enable logging for this library, set the logger for the underlying [gRPC](https://github.com/grpc/grpc/tree/master/src/ruby) library.
|
@@ -69,3 +79,61 @@ in security maintenance, and not end of life. Currently, this means Ruby 2.4
|
|
69
79
|
and later. Older versions of Ruby _may_ still work, but are unsupported and not
|
70
80
|
recommended. See https://www.ruby-lang.org/en/downloads/branches/ for details
|
71
81
|
about the Ruby support schedule.
|
82
|
+
|
83
|
+
## Which client should I use?
|
84
|
+
|
85
|
+
Most modern Ruby client libraries for Google APIs come in two flavors: the main
|
86
|
+
client library with a name such as `google-cloud-dataproc`,
|
87
|
+
and lower-level _versioned_ client libraries with names such as
|
88
|
+
`google-cloud-dataproc-v1`.
|
89
|
+
_In most cases, you should install the main client._
|
90
|
+
|
91
|
+
### What's the difference between the main client and a versioned client?
|
92
|
+
|
93
|
+
A _versioned client_ provides a basic set of data types and client classes for
|
94
|
+
a _single version_ of a specific service. (That is, for a service with multiple
|
95
|
+
versions, there might be a separate versioned client for each service version.)
|
96
|
+
Most versioned clients are written and maintained by a code generator.
|
97
|
+
|
98
|
+
The _main client_ is designed to provide you with the _recommended_ client
|
99
|
+
interfaces for the service. There will be only one main client for any given
|
100
|
+
service, even a service with multiple versions. The main client includes
|
101
|
+
factory methods for constructing the client objects we recommend for most
|
102
|
+
users. In some cases, those will be classes provided by an underlying versioned
|
103
|
+
client; in other cases, they will be handwritten higher-level client objects
|
104
|
+
with additional capabilities, convenience methods, or best practices built in.
|
105
|
+
Generally, the main client will default to a recommended service version,
|
106
|
+
although in some cases you can override this if you need to talk to a specific
|
107
|
+
service version.
|
108
|
+
|
109
|
+
### Why would I want to use the main client?
|
110
|
+
|
111
|
+
We recommend that most users install the main client gem for a service. You can
|
112
|
+
identify this gem as the one _without_ a version in its name, e.g.
|
113
|
+
`google-cloud-dataproc`.
|
114
|
+
The main client is recommended because it will embody the best practices for
|
115
|
+
accessing the service, and may also provide more convenient interfaces or
|
116
|
+
tighter integration into frameworks and third-party libraries. In addition, the
|
117
|
+
documentation and samples published by Google will generally demonstrate use of
|
118
|
+
the main client.
|
119
|
+
|
120
|
+
### Why would I want to use a versioned client?
|
121
|
+
|
122
|
+
You can use a versioned client if you are content with a possibly lower-level
|
123
|
+
class interface, you explicitly want to avoid features provided by the main
|
124
|
+
client, or you want to access a specific service version not be covered by the
|
125
|
+
main client. You can identify versioned client gems because the service version
|
126
|
+
is part of the name, e.g. `google-cloud-dataproc-v1`.
|
127
|
+
|
128
|
+
### What about the google-apis-<name> clients?
|
129
|
+
|
130
|
+
Client library gems with names that begin with `google-apis-` are based on an
|
131
|
+
older code generation technology. They talk to a REST/JSON backend (whereas
|
132
|
+
most modern clients talk to a [gRPC](https://grpc.io/) backend) and they may
|
133
|
+
not offer the same performance, features, and ease of use provided by more
|
134
|
+
modern clients.
|
135
|
+
|
136
|
+
The `google-apis-` clients have wide coverage across Google services, so you
|
137
|
+
might need to use one if there is no modern client available for the service.
|
138
|
+
However, if a modern client is available, we generally recommend it over the
|
139
|
+
older `google-apis-` clients.
|
@@ -35,19 +35,19 @@ module Google
|
|
35
35
|
self.service_name = 'google.cloud.dataproc.v1.AutoscalingPolicyService'
|
36
36
|
|
37
37
|
# Creates new autoscaling policy.
|
38
|
-
rpc :CreateAutoscalingPolicy, CreateAutoscalingPolicyRequest, AutoscalingPolicy
|
38
|
+
rpc :CreateAutoscalingPolicy, ::Google::Cloud::Dataproc::V1::CreateAutoscalingPolicyRequest, ::Google::Cloud::Dataproc::V1::AutoscalingPolicy
|
39
39
|
# Updates (replaces) autoscaling policy.
|
40
40
|
#
|
41
41
|
# Disabled check for update_mask, because all updates will be full
|
42
42
|
# replacements.
|
43
|
-
rpc :UpdateAutoscalingPolicy, UpdateAutoscalingPolicyRequest, AutoscalingPolicy
|
43
|
+
rpc :UpdateAutoscalingPolicy, ::Google::Cloud::Dataproc::V1::UpdateAutoscalingPolicyRequest, ::Google::Cloud::Dataproc::V1::AutoscalingPolicy
|
44
44
|
# Retrieves autoscaling policy.
|
45
|
-
rpc :GetAutoscalingPolicy, GetAutoscalingPolicyRequest, AutoscalingPolicy
|
45
|
+
rpc :GetAutoscalingPolicy, ::Google::Cloud::Dataproc::V1::GetAutoscalingPolicyRequest, ::Google::Cloud::Dataproc::V1::AutoscalingPolicy
|
46
46
|
# Lists autoscaling policies in the project.
|
47
|
-
rpc :ListAutoscalingPolicies, ListAutoscalingPoliciesRequest, ListAutoscalingPoliciesResponse
|
47
|
+
rpc :ListAutoscalingPolicies, ::Google::Cloud::Dataproc::V1::ListAutoscalingPoliciesRequest, ::Google::Cloud::Dataproc::V1::ListAutoscalingPoliciesResponse
|
48
48
|
# Deletes an autoscaling policy. It is an error to delete an autoscaling
|
49
49
|
# policy that is in use by one or more clusters.
|
50
|
-
rpc :DeleteAutoscalingPolicy, DeleteAutoscalingPolicyRequest, Google::Protobuf::Empty
|
50
|
+
rpc :DeleteAutoscalingPolicy, ::Google::Cloud::Dataproc::V1::DeleteAutoscalingPolicyRequest, ::Google::Protobuf::Empty
|
51
51
|
end
|
52
52
|
|
53
53
|
Stub = Service.rpc_stub_class
|
@@ -73,7 +73,7 @@ module Google
|
|
73
73
|
initial_delay: 0.1,
|
74
74
|
max_delay: 60.0,
|
75
75
|
multiplier: 1.3,
|
76
|
-
retry_codes: [
|
76
|
+
retry_codes: [4, 14]
|
77
77
|
}
|
78
78
|
|
79
79
|
default_config.rpcs.get_autoscaling_policy.timeout = 600.0
|
@@ -81,7 +81,7 @@ module Google
|
|
81
81
|
initial_delay: 0.1,
|
82
82
|
max_delay: 60.0,
|
83
83
|
multiplier: 1.3,
|
84
|
-
retry_codes: [
|
84
|
+
retry_codes: [4, 14]
|
85
85
|
}
|
86
86
|
|
87
87
|
default_config.rpcs.list_autoscaling_policies.timeout = 600.0
|
@@ -89,7 +89,7 @@ module Google
|
|
89
89
|
initial_delay: 0.1,
|
90
90
|
max_delay: 60.0,
|
91
91
|
multiplier: 1.3,
|
92
|
-
retry_codes: [
|
92
|
+
retry_codes: [4, 14]
|
93
93
|
}
|
94
94
|
|
95
95
|
default_config.rpcs.delete_autoscaling_policy.timeout = 600.0
|
@@ -155,7 +155,13 @@ module Google
|
|
155
155
|
|
156
156
|
# Create credentials
|
157
157
|
credentials = @config.credentials
|
158
|
-
|
158
|
+
# Use self-signed JWT if the scope and endpoint are unchanged from default,
|
159
|
+
# but only if the default endpoint does not have a region prefix.
|
160
|
+
enable_self_signed_jwt = @config.scope == Client.configure.scope &&
|
161
|
+
@config.endpoint == Client.configure.endpoint &&
|
162
|
+
!@config.endpoint.split(".").first.include?("-")
|
163
|
+
credentials ||= Credentials.default scope: @config.scope,
|
164
|
+
enable_self_signed_jwt: enable_self_signed_jwt
|
159
165
|
if credentials.is_a?(String) || credentials.is_a?(Hash)
|
160
166
|
credentials = Credentials.new credentials, scope: @config.scope
|
161
167
|
end
|
@@ -637,7 +643,7 @@ module Google
|
|
637
643
|
|
638
644
|
config_attr :endpoint, "dataproc.googleapis.com", ::String
|
639
645
|
config_attr :credentials, nil do |value|
|
640
|
-
allowed = [::String, ::Hash, ::Proc, ::Google::Auth::Credentials, ::Signet::OAuth2::Client, nil]
|
646
|
+
allowed = [::String, ::Hash, ::Proc, ::Symbol, ::Google::Auth::Credentials, ::Signet::OAuth2::Client, nil]
|
641
647
|
allowed += [::GRPC::Core::Channel, ::GRPC::Core::ChannelCredentials] if defined? ::GRPC
|
642
648
|
allowed.any? { |klass| klass === value }
|
643
649
|
end
|
@@ -677,7 +683,7 @@ module Google
|
|
677
683
|
# Each configuration object is of type `Gapic::Config::Method` and includes
|
678
684
|
# the following configuration fields:
|
679
685
|
#
|
680
|
-
# * `timeout` (*type:* `Numeric`) - The call timeout in
|
686
|
+
# * `timeout` (*type:* `Numeric`) - The call timeout in seconds
|
681
687
|
# * `metadata` (*type:* `Hash{Symbol=>String}`) - Additional gRPC headers
|
682
688
|
# * `retry_policy (*type:* `Hash`) - The retry policy. The policy fields
|
683
689
|
# include the following keys:
|
@@ -69,7 +69,7 @@ module Google
|
|
69
69
|
initial_delay: 0.1,
|
70
70
|
max_delay: 60.0,
|
71
71
|
multiplier: 1.3,
|
72
|
-
retry_codes: [
|
72
|
+
retry_codes: [14]
|
73
73
|
}
|
74
74
|
|
75
75
|
default_config.rpcs.update_cluster.timeout = 300.0
|
@@ -77,7 +77,7 @@ module Google
|
|
77
77
|
initial_delay: 0.1,
|
78
78
|
max_delay: 60.0,
|
79
79
|
multiplier: 1.3,
|
80
|
-
retry_codes: [
|
80
|
+
retry_codes: [14]
|
81
81
|
}
|
82
82
|
|
83
83
|
default_config.rpcs.delete_cluster.timeout = 300.0
|
@@ -85,7 +85,7 @@ module Google
|
|
85
85
|
initial_delay: 0.1,
|
86
86
|
max_delay: 60.0,
|
87
87
|
multiplier: 1.3,
|
88
|
-
retry_codes: [
|
88
|
+
retry_codes: [14]
|
89
89
|
}
|
90
90
|
|
91
91
|
default_config.rpcs.get_cluster.timeout = 300.0
|
@@ -93,7 +93,7 @@ module Google
|
|
93
93
|
initial_delay: 0.1,
|
94
94
|
max_delay: 60.0,
|
95
95
|
multiplier: 1.3,
|
96
|
-
retry_codes: [
|
96
|
+
retry_codes: [13, 4, 14]
|
97
97
|
}
|
98
98
|
|
99
99
|
default_config.rpcs.list_clusters.timeout = 300.0
|
@@ -101,7 +101,7 @@ module Google
|
|
101
101
|
initial_delay: 0.1,
|
102
102
|
max_delay: 60.0,
|
103
103
|
multiplier: 1.3,
|
104
|
-
retry_codes: [
|
104
|
+
retry_codes: [13, 4, 14]
|
105
105
|
}
|
106
106
|
|
107
107
|
default_config.rpcs.diagnose_cluster.timeout = 300.0
|
@@ -109,7 +109,7 @@ module Google
|
|
109
109
|
initial_delay: 0.1,
|
110
110
|
max_delay: 60.0,
|
111
111
|
multiplier: 1.3,
|
112
|
-
retry_codes: [
|
112
|
+
retry_codes: [14]
|
113
113
|
}
|
114
114
|
|
115
115
|
default_config
|
@@ -173,7 +173,13 @@ module Google
|
|
173
173
|
|
174
174
|
# Create credentials
|
175
175
|
credentials = @config.credentials
|
176
|
-
|
176
|
+
# Use self-signed JWT if the scope and endpoint are unchanged from default,
|
177
|
+
# but only if the default endpoint does not have a region prefix.
|
178
|
+
enable_self_signed_jwt = @config.scope == Client.configure.scope &&
|
179
|
+
@config.endpoint == Client.configure.endpoint &&
|
180
|
+
!@config.endpoint.split(".").first.include?("-")
|
181
|
+
credentials ||= Credentials.default scope: @config.scope,
|
182
|
+
enable_self_signed_jwt: enable_self_signed_jwt
|
177
183
|
if credentials.is_a?(String) || credentials.is_a?(Hash)
|
178
184
|
credentials = Credentials.new credentials, scope: @config.scope
|
179
185
|
end
|
@@ -866,7 +872,7 @@ module Google
|
|
866
872
|
|
867
873
|
config_attr :endpoint, "dataproc.googleapis.com", ::String
|
868
874
|
config_attr :credentials, nil do |value|
|
869
|
-
allowed = [::String, ::Hash, ::Proc, ::Google::Auth::Credentials, ::Signet::OAuth2::Client, nil]
|
875
|
+
allowed = [::String, ::Hash, ::Proc, ::Symbol, ::Google::Auth::Credentials, ::Signet::OAuth2::Client, nil]
|
870
876
|
allowed += [::GRPC::Core::Channel, ::GRPC::Core::ChannelCredentials] if defined? ::GRPC
|
871
877
|
allowed.any? { |klass| klass === value }
|
872
878
|
end
|
@@ -906,7 +912,7 @@ module Google
|
|
906
912
|
# Each configuration object is of type `Gapic::Config::Method` and includes
|
907
913
|
# the following configuration fields:
|
908
914
|
#
|
909
|
-
# * `timeout` (*type:* `Numeric`) - The call timeout in
|
915
|
+
# * `timeout` (*type:* `Numeric`) - The call timeout in seconds
|
910
916
|
# * `metadata` (*type:* `Hash{Symbol=>String}`) - Additional gRPC headers
|
911
917
|
# * `retry_policy (*type:* `Hash`) - The retry policy. The policy fields
|
912
918
|
# include the following keys:
|
@@ -103,8 +103,13 @@ module Google
|
|
103
103
|
# Lists operations that match the specified filter in the request. If the
|
104
104
|
# server doesn't support this method, it returns `UNIMPLEMENTED`.
|
105
105
|
#
|
106
|
-
# NOTE: the `name` binding
|
107
|
-
# to use different resource name schemes, such as `users/*/operations`.
|
106
|
+
# NOTE: the `name` binding allows API services to override the binding
|
107
|
+
# to use different resource name schemes, such as `users/*/operations`. To
|
108
|
+
# override the binding, API services can add a binding such as
|
109
|
+
# `"/v1/{name=users/*}/operations"` to their service configuration.
|
110
|
+
# For backwards compatibility, the default name includes the operations
|
111
|
+
# collection id, however overriding users must ensure the name binding
|
112
|
+
# is the parent resource, without the operations collection id.
|
108
113
|
#
|
109
114
|
# @overload list_operations(request, options = nil)
|
110
115
|
# Pass arguments to `list_operations` via a request object, either of type
|
@@ -122,7 +127,7 @@ module Google
|
|
122
127
|
# the default parameter values, pass an empty Hash as a request object (see above).
|
123
128
|
#
|
124
129
|
# @param name [::String]
|
125
|
-
# The name of the operation
|
130
|
+
# The name of the operation's parent resource.
|
126
131
|
# @param filter [::String]
|
127
132
|
# The standard list filter.
|
128
133
|
# @param page_size [::Integer]
|
@@ -390,6 +395,79 @@ module Google
|
|
390
395
|
raise ::Google::Cloud::Error.from_error(e)
|
391
396
|
end
|
392
397
|
|
398
|
+
##
|
399
|
+
# Waits for the specified long-running operation until it is done or reaches
|
400
|
+
# at most a specified timeout, returning the latest state. If the operation
|
401
|
+
# is already done, the latest state is immediately returned. If the timeout
|
402
|
+
# specified is greater than the default HTTP/RPC timeout, the HTTP/RPC
|
403
|
+
# timeout is used. If the server does not support this method, it returns
|
404
|
+
# `google.rpc.Code.UNIMPLEMENTED`.
|
405
|
+
# Note that this method is on a best-effort basis. It may return the latest
|
406
|
+
# state before the specified timeout (including immediately), meaning even an
|
407
|
+
# immediate response is no guarantee that the operation is done.
|
408
|
+
#
|
409
|
+
# @overload wait_operation(request, options = nil)
|
410
|
+
# Pass arguments to `wait_operation` via a request object, either of type
|
411
|
+
# {::Google::Longrunning::WaitOperationRequest} or an equivalent Hash.
|
412
|
+
#
|
413
|
+
# @param request [::Google::Longrunning::WaitOperationRequest, ::Hash]
|
414
|
+
# A request object representing the call parameters. Required. To specify no
|
415
|
+
# parameters, or to keep all the default parameter values, pass an empty Hash.
|
416
|
+
# @param options [::Gapic::CallOptions, ::Hash]
|
417
|
+
# Overrides the default settings for this call, e.g, timeout, retries, etc. Optional.
|
418
|
+
#
|
419
|
+
# @overload wait_operation(name: nil, timeout: nil)
|
420
|
+
# Pass arguments to `wait_operation` via keyword arguments. Note that at
|
421
|
+
# least one keyword argument is required. To specify no parameters, or to keep all
|
422
|
+
# the default parameter values, pass an empty Hash as a request object (see above).
|
423
|
+
#
|
424
|
+
# @param name [::String]
|
425
|
+
# The name of the operation resource to wait on.
|
426
|
+
# @param timeout [::Google::Protobuf::Duration, ::Hash]
|
427
|
+
# The maximum duration to wait before timing out. If left blank, the wait
|
428
|
+
# will be at most the time permitted by the underlying HTTP/RPC protocol.
|
429
|
+
# If RPC context deadline is also specified, the shorter one will be used.
|
430
|
+
#
|
431
|
+
# @yield [response, operation] Access the result along with the RPC operation
|
432
|
+
# @yieldparam response [::Gapic::Operation]
|
433
|
+
# @yieldparam operation [::GRPC::ActiveCall::Operation]
|
434
|
+
#
|
435
|
+
# @return [::Gapic::Operation]
|
436
|
+
#
|
437
|
+
# @raise [::Google::Cloud::Error] if the RPC is aborted.
|
438
|
+
#
|
439
|
+
def wait_operation request, options = nil
|
440
|
+
raise ::ArgumentError, "request must be provided" if request.nil?
|
441
|
+
|
442
|
+
request = ::Gapic::Protobuf.coerce request, to: ::Google::Longrunning::WaitOperationRequest
|
443
|
+
|
444
|
+
# Converts hash and nil to an options object
|
445
|
+
options = ::Gapic::CallOptions.new(**options.to_h) if options.respond_to? :to_h
|
446
|
+
|
447
|
+
# Customize the options with defaults
|
448
|
+
metadata = @config.rpcs.wait_operation.metadata.to_h
|
449
|
+
|
450
|
+
# Set x-goog-api-client and x-goog-user-project headers
|
451
|
+
metadata[:"x-goog-api-client"] ||= ::Gapic::Headers.x_goog_api_client \
|
452
|
+
lib_name: @config.lib_name, lib_version: @config.lib_version,
|
453
|
+
gapic_version: ::Google::Cloud::Dataproc::V1::VERSION
|
454
|
+
metadata[:"x-goog-user-project"] = @quota_project_id if @quota_project_id
|
455
|
+
|
456
|
+
options.apply_defaults timeout: @config.rpcs.wait_operation.timeout,
|
457
|
+
metadata: metadata,
|
458
|
+
retry_policy: @config.rpcs.wait_operation.retry_policy
|
459
|
+
options.apply_defaults metadata: @config.metadata,
|
460
|
+
retry_policy: @config.retry_policy
|
461
|
+
|
462
|
+
@operations_stub.call_rpc :wait_operation, request, options: options do |response, operation|
|
463
|
+
response = ::Gapic::Operation.new response, @operations_client, options: options
|
464
|
+
yield response, operation if block_given?
|
465
|
+
return response
|
466
|
+
end
|
467
|
+
rescue ::GRPC::BadStatus => e
|
468
|
+
raise ::Google::Cloud::Error.from_error(e)
|
469
|
+
end
|
470
|
+
|
393
471
|
##
|
394
472
|
# Configuration class for the Operations API.
|
395
473
|
#
|
@@ -475,7 +553,7 @@ module Google
|
|
475
553
|
|
476
554
|
config_attr :endpoint, "dataproc.googleapis.com", ::String
|
477
555
|
config_attr :credentials, nil do |value|
|
478
|
-
allowed = [::String, ::Hash, ::Proc, ::Google::Auth::Credentials, ::Signet::OAuth2::Client, nil]
|
556
|
+
allowed = [::String, ::Hash, ::Proc, ::Symbol, ::Google::Auth::Credentials, ::Signet::OAuth2::Client, nil]
|
479
557
|
allowed += [::GRPC::Core::Channel, ::GRPC::Core::ChannelCredentials] if defined? ::GRPC
|
480
558
|
allowed.any? { |klass| klass === value }
|
481
559
|
end
|
@@ -515,7 +593,7 @@ module Google
|
|
515
593
|
# Each configuration object is of type `Gapic::Config::Method` and includes
|
516
594
|
# the following configuration fields:
|
517
595
|
#
|
518
|
-
# * `timeout` (*type:* `Numeric`) - The call timeout in
|
596
|
+
# * `timeout` (*type:* `Numeric`) - The call timeout in seconds
|
519
597
|
# * `metadata` (*type:* `Hash{Symbol=>String}`) - Additional gRPC headers
|
520
598
|
# * `retry_policy (*type:* `Hash`) - The retry policy. The policy fields
|
521
599
|
# include the following keys:
|
@@ -546,6 +624,11 @@ module Google
|
|
546
624
|
# @return [::Gapic::Config::Method]
|
547
625
|
#
|
548
626
|
attr_reader :cancel_operation
|
627
|
+
##
|
628
|
+
# RPC-specific configuration for `wait_operation`
|
629
|
+
# @return [::Gapic::Config::Method]
|
630
|
+
#
|
631
|
+
attr_reader :wait_operation
|
549
632
|
|
550
633
|
# @private
|
551
634
|
def initialize parent_rpcs = nil
|
@@ -557,6 +640,8 @@ module Google
|
|
557
640
|
@delete_operation = ::Gapic::Config::Method.new delete_operation_config
|
558
641
|
cancel_operation_config = parent_rpcs&.cancel_operation if parent_rpcs&.respond_to? :cancel_operation
|
559
642
|
@cancel_operation = ::Gapic::Config::Method.new cancel_operation_config
|
643
|
+
wait_operation_config = parent_rpcs&.wait_operation if parent_rpcs&.respond_to? :wait_operation
|
644
|
+
@wait_operation = ::Gapic::Config::Method.new wait_operation_config
|
560
645
|
|
561
646
|
yield self if block_given?
|
562
647
|
end
|
@@ -25,6 +25,7 @@ Google::Protobuf::DescriptorPool.generated_pool.build do
|
|
25
25
|
end
|
26
26
|
add_message "google.cloud.dataproc.v1.ClusterConfig" do
|
27
27
|
optional :config_bucket, :string, 1
|
28
|
+
optional :temp_bucket, :string, 2
|
28
29
|
optional :gce_cluster_config, :message, 8, "google.cloud.dataproc.v1.GceClusterConfig"
|
29
30
|
optional :master_config, :message, 9, "google.cloud.dataproc.v1.InstanceGroupConfig"
|
30
31
|
optional :worker_config, :message, 10, "google.cloud.dataproc.v1.InstanceGroupConfig"
|
@@ -35,6 +36,11 @@ Google::Protobuf::DescriptorPool.generated_pool.build do
|
|
35
36
|
optional :autoscaling_config, :message, 18, "google.cloud.dataproc.v1.AutoscalingConfig"
|
36
37
|
optional :security_config, :message, 16, "google.cloud.dataproc.v1.SecurityConfig"
|
37
38
|
optional :lifecycle_config, :message, 17, "google.cloud.dataproc.v1.LifecycleConfig"
|
39
|
+
optional :endpoint_config, :message, 19, "google.cloud.dataproc.v1.EndpointConfig"
|
40
|
+
end
|
41
|
+
add_message "google.cloud.dataproc.v1.EndpointConfig" do
|
42
|
+
map :http_ports, :string, :string, 1
|
43
|
+
optional :enable_http_port_access, :bool, 2
|
38
44
|
end
|
39
45
|
add_message "google.cloud.dataproc.v1.AutoscalingConfig" do
|
40
46
|
optional :policy_uri, :string, 1
|
@@ -60,10 +66,16 @@ Google::Protobuf::DescriptorPool.generated_pool.build do
|
|
60
66
|
optional :machine_type_uri, :string, 4
|
61
67
|
optional :disk_config, :message, 5, "google.cloud.dataproc.v1.DiskConfig"
|
62
68
|
optional :is_preemptible, :bool, 6
|
69
|
+
optional :preemptibility, :enum, 10, "google.cloud.dataproc.v1.InstanceGroupConfig.Preemptibility"
|
63
70
|
optional :managed_group_config, :message, 7, "google.cloud.dataproc.v1.ManagedGroupConfig"
|
64
71
|
repeated :accelerators, :message, 8, "google.cloud.dataproc.v1.AcceleratorConfig"
|
65
72
|
optional :min_cpu_platform, :string, 9
|
66
73
|
end
|
74
|
+
add_enum "google.cloud.dataproc.v1.InstanceGroupConfig.Preemptibility" do
|
75
|
+
value :PREEMPTIBILITY_UNSPECIFIED, 0
|
76
|
+
value :NON_PREEMPTIBLE, 1
|
77
|
+
value :PREEMPTIBLE, 2
|
78
|
+
end
|
67
79
|
add_message "google.cloud.dataproc.v1.ManagedGroupConfig" do
|
68
80
|
optional :instance_template_name, :string, 1
|
69
81
|
optional :instance_group_manager_name, :string, 2
|
@@ -203,10 +215,12 @@ module Google
|
|
203
215
|
module V1
|
204
216
|
Cluster = ::Google::Protobuf::DescriptorPool.generated_pool.lookup("google.cloud.dataproc.v1.Cluster").msgclass
|
205
217
|
ClusterConfig = ::Google::Protobuf::DescriptorPool.generated_pool.lookup("google.cloud.dataproc.v1.ClusterConfig").msgclass
|
218
|
+
EndpointConfig = ::Google::Protobuf::DescriptorPool.generated_pool.lookup("google.cloud.dataproc.v1.EndpointConfig").msgclass
|
206
219
|
AutoscalingConfig = ::Google::Protobuf::DescriptorPool.generated_pool.lookup("google.cloud.dataproc.v1.AutoscalingConfig").msgclass
|
207
220
|
EncryptionConfig = ::Google::Protobuf::DescriptorPool.generated_pool.lookup("google.cloud.dataproc.v1.EncryptionConfig").msgclass
|
208
221
|
GceClusterConfig = ::Google::Protobuf::DescriptorPool.generated_pool.lookup("google.cloud.dataproc.v1.GceClusterConfig").msgclass
|
209
222
|
InstanceGroupConfig = ::Google::Protobuf::DescriptorPool.generated_pool.lookup("google.cloud.dataproc.v1.InstanceGroupConfig").msgclass
|
223
|
+
InstanceGroupConfig::Preemptibility = ::Google::Protobuf::DescriptorPool.generated_pool.lookup("google.cloud.dataproc.v1.InstanceGroupConfig.Preemptibility").enummodule
|
210
224
|
ManagedGroupConfig = ::Google::Protobuf::DescriptorPool.generated_pool.lookup("google.cloud.dataproc.v1.ManagedGroupConfig").msgclass
|
211
225
|
AcceleratorConfig = ::Google::Protobuf::DescriptorPool.generated_pool.lookup("google.cloud.dataproc.v1.AcceleratorConfig").msgclass
|
212
226
|
DiskConfig = ::Google::Protobuf::DescriptorPool.generated_pool.lookup("google.cloud.dataproc.v1.DiskConfig").msgclass
|