google-api-client 0.13.0 → 0.13.1

data/generated/google/apis/dataproc_v1.rb

@@ -25,7 +25,7 @@ module Google
     # @see https://cloud.google.com/dataproc/
     module DataprocV1
       VERSION = 'V1'
-      REVISION = '20170606'
+      REVISION = '20170707'
 
       # View and manage your data across Google Cloud Platform services
       AUTH_CLOUD_PLATFORM = 'https://www.googleapis.com/auth/cloud-platform'

data/generated/google/apis/dataproc_v1/classes.rb

@@ -22,18 +22,198 @@ module Google
   module Apis
     module DataprocV1
       
-      # Job scheduling options.Beta Feature: These options are available for testing
-      # purposes only. They may be changed before final release.
-      class JobScheduling
+      # This resource represents a long-running operation that is the result of a
+      # network API call.
+      class Operation
         include Google::Apis::Core::Hashable
       
-        # Optional. Maximum number of times per hour a driver may be restarted as a
-        # result of driver terminating with non-zero code before job is reported failed.
-        # A job may be reported as thrashing if driver exits with non-zero code 4 times
-        # within 10 minute window.Maximum value is 10.
-        # Corresponds to the JSON property `maxFailuresPerHour`
+        # The server-assigned name, which is only unique within the same service that
+        # originally returns it. If you use the default HTTP mapping, the name should
+        # have the format of operations/some/unique/name.
+        # Corresponds to the JSON property `name`
+        # @return [String]
+        attr_accessor :name
+      
+        # The Status type defines a logical error model that is suitable for different
+        # programming environments, including REST APIs and RPC APIs. It is used by gRPC
+        # (https://github.com/grpc). The error model is designed to be:
+        # Simple to use and understand for most users
+        # Flexible enough to meet unexpected needsOverviewThe Status message contains
+        # three pieces of data: error code, error message, and error details. The error
+        # code should be an enum value of google.rpc.Code, but it may accept additional
+        # error codes if needed. The error message should be a developer-facing English
+        # message that helps developers understand and resolve the error. If a localized
+        # user-facing error message is needed, put the localized message in the error
+        # details or localize it in the client. The optional error details may contain
+        # arbitrary information about the error. There is a predefined set of error
+        # detail types in the package google.rpc that can be used for common error
+        # conditions.Language mappingThe Status message is the logical representation of
+        # the error model, but it is not necessarily the actual wire format. When the
+        # Status message is exposed in different client libraries and different wire
+        # protocols, it can be mapped differently. For example, it will likely be mapped
+        # to some exceptions in Java, but more likely mapped to some error codes in C.
+        # Other usesThe error model and the Status message can be used in a variety of
+        # environments, either with or without APIs, to provide a consistent developer
+        # experience across different environments.Example uses of this error model
+        # include:
+        # Partial errors. If a service needs to return partial errors to the client, it
+        # may embed the Status in the normal response to indicate the partial errors.
+        # Workflow errors. A typical workflow has multiple steps. Each step may have a
+        # Status message for error reporting.
+        # Batch operations. If a client uses batch request and batch response, the
+        # Status message should be used directly inside batch response, one for each
+        # error sub-response.
+        # Asynchronous operations. If an API call embeds asynchronous operation results
+        # in its response, the status of those operations should be represented directly
+        # using the Status message.
+        # Logging. If some API errors are stored in logs, the message Status could be
+        # used directly after any stripping needed for security/privacy reasons.
+        # Corresponds to the JSON property `error`
+        # @return [Google::Apis::DataprocV1::Status]
+        attr_accessor :error
+      
+        # Service-specific metadata associated with the operation. It typically contains
+        # progress information and common metadata such as create time. Some services
+        # might not provide such metadata. Any method that returns a long-running
+        # operation should document the metadata type, if any.
+        # Corresponds to the JSON property `metadata`
+        # @return [Hash<String,Object>]
+        attr_accessor :metadata
+      
+        # If the value is false, it means the operation is still in progress. If true,
+        # the operation is completed, and either error or response is available.
+        # Corresponds to the JSON property `done`
+        # @return [Boolean]
+        attr_accessor :done
+        alias_method :done?, :done
+      
+        # The normal response of the operation in case of success. If the original
+        # method returns no data on success, such as Delete, the response is google.
+        # protobuf.Empty. If the original method is standard Get/Create/Update, the
+        # response should be the resource. For other methods, the response should have
+        # the type XxxResponse, where Xxx is the original method name. For example, if
+        # the original method name is TakeSnapshot(), the inferred response type is
+        # TakeSnapshotResponse.
+        # Corresponds to the JSON property `response`
+        # @return [Hash<String,Object>]
+        attr_accessor :response
+      
+        def initialize(**args)
+           update!(**args)
+        end
+      
+        # Update properties of this object
+        def update!(**args)
+          @name = args[:name] if args.key?(:name)
+          @error = args[:error] if args.key?(:error)
+          @metadata = args[:metadata] if args.key?(:metadata)
+          @done = args[:done] if args.key?(:done)
+          @response = args[:response] if args.key?(:response)
+        end
+      end
+      
+      # Encapsulates the full scoping used to reference a job.
+      class JobReference
+        include Google::Apis::Core::Hashable
+      
+        # Optional. The job ID, which must be unique within the project. The job ID is
+        # generated by the server upon job submission or provided by the user as a means
+        # to perform retries without creating duplicate jobs. The ID must contain only
+        # letters (a-z, A-Z), numbers (0-9), underscores (_), or hyphens (-). The
+        # maximum length is 100 characters.
+        # Corresponds to the JSON property `jobId`
+        # @return [String]
+        attr_accessor :job_id
+      
+        # Required. The ID of the Google Cloud Platform project that the job belongs to.
+        # Corresponds to the JSON property `projectId`
+        # @return [String]
+        attr_accessor :project_id
+      
+        def initialize(**args)
+           update!(**args)
+        end
+      
+        # Update properties of this object
+        def update!(**args)
+          @job_id = args[:job_id] if args.key?(:job_id)
+          @project_id = args[:project_id] if args.key?(:project_id)
+        end
+      end
+      
+      # A request to submit a job.
+      class SubmitJobRequest
+        include Google::Apis::Core::Hashable
+      
+        # A Cloud Dataproc job resource.
+        # Corresponds to the JSON property `job`
+        # @return [Google::Apis::DataprocV1::Job]
+        attr_accessor :job
+      
+        def initialize(**args)
+           update!(**args)
+        end
+      
+        # Update properties of this object
+        def update!(**args)
+          @job = args[:job] if args.key?(:job)
+        end
+      end
+      
+      # The Status type defines a logical error model that is suitable for different
+      # programming environments, including REST APIs and RPC APIs. It is used by gRPC
+      # (https://github.com/grpc). The error model is designed to be:
+      # Simple to use and understand for most users
+      # Flexible enough to meet unexpected needsOverviewThe Status message contains
+      # three pieces of data: error code, error message, and error details. The error
+      # code should be an enum value of google.rpc.Code, but it may accept additional
+      # error codes if needed. The error message should be a developer-facing English
+      # message that helps developers understand and resolve the error. If a localized
+      # user-facing error message is needed, put the localized message in the error
+      # details or localize it in the client. The optional error details may contain
+      # arbitrary information about the error. There is a predefined set of error
+      # detail types in the package google.rpc that can be used for common error
+      # conditions.Language mappingThe Status message is the logical representation of
+      # the error model, but it is not necessarily the actual wire format. When the
+      # Status message is exposed in different client libraries and different wire
+      # protocols, it can be mapped differently. For example, it will likely be mapped
+      # to some exceptions in Java, but more likely mapped to some error codes in C.
+      # Other usesThe error model and the Status message can be used in a variety of
+      # environments, either with or without APIs, to provide a consistent developer
+      # experience across different environments.Example uses of this error model
+      # include:
+      # Partial errors. If a service needs to return partial errors to the client, it
+      # may embed the Status in the normal response to indicate the partial errors.
+      # Workflow errors. A typical workflow has multiple steps. Each step may have a
+      # Status message for error reporting.
+      # Batch operations. If a client uses batch request and batch response, the
+      # Status message should be used directly inside batch response, one for each
+      # error sub-response.
+      # Asynchronous operations. If an API call embeds asynchronous operation results
+      # in its response, the status of those operations should be represented directly
+      # using the Status message.
+      # Logging. If some API errors are stored in logs, the message Status could be
+      # used directly after any stripping needed for security/privacy reasons.
+      class Status
+        include Google::Apis::Core::Hashable
+      
+        # The status code, which should be an enum value of google.rpc.Code.
+        # Corresponds to the JSON property `code`
         # @return [Fixnum]
-        attr_accessor :max_failures_per_hour
+        attr_accessor :code
+      
+        # A developer-facing error message, which should be in English. Any user-facing
+        # error message should be localized and sent in the google.rpc.Status.details
+        # field, or localized by the client.
+        # Corresponds to the JSON property `message`
+        # @return [String]
+        attr_accessor :message
+      
+        # A list of messages that carry the error details. There will be a common set of
+        # message types for APIs to use.
+        # Corresponds to the JSON property `details`
+        # @return [Array<Hash<String,Object>>]
+        attr_accessor :details
       
         def initialize(**args)
            update!(**args)
@@ -41,7 +221,9 @@ module Google
       
         # Update properties of this object
         def update!(**args)
-          @max_failures_per_hour = args[:max_failures_per_hour] if args.key?(:max_failures_per_hour)
+          @code = args[:code] if args.key?(:code)
+          @message = args[:message] if args.key?(:message)
+          @details = args[:details] if args.key?(:details)
         end
       end
       
@@ -55,9 +237,12 @@ module Google
         # @return [Google::Apis::DataprocV1::DiskConfig]
         attr_accessor :disk_config
       
-        # Required. The Google Compute Engine machine type used for cluster instances.
-        # Example: https://www.googleapis.com/compute/v1/projects/[project_id]/zones/us-
-        # east1-a/machineTypes/n1-standard-2.
+        # Optional. The Google Compute Engine machine type used for cluster instances.A
+        # full URL, partial URI, or short name are valid. Examples:
+        # https://www.googleapis.com/compute/v1/projects/[project_id]/zones/us-east1-a/
+        # machineTypes/n1-standard-2
+        # projects/[project_id]/zones/us-east1-a/machineTypes/n1-standard-2
+        # n1-standard-2
         # Corresponds to the JSON property `machineTypeUri`
         # @return [String]
         attr_accessor :machine_type_uri
@@ -93,7 +278,7 @@ module Google
         # @return [Array<Google::Apis::DataprocV1::AcceleratorConfig>]
         attr_accessor :accelerators
       
-        # Required. The number of VM instances in the instance group. For master
+        # Optional. The number of VM instances in the instance group. For master
         # instance groups, must be set to 1.
         # Corresponds to the JSON property `numInstances`
         # @return [Fixnum]
@@ -116,21 +301,18 @@ module Google
         end
       end
       
-      # A list of jobs in a project.
-      class ListJobsResponse
+      # Job scheduling options.Beta Feature: These options are available for testing
+      # purposes only. They may be changed before final release.
+      class JobScheduling
         include Google::Apis::Core::Hashable
       
-        # Optional. This token is included in the response if there are more results to
-        # fetch. To fetch additional results, provide this value as the page_token in a
-        # subsequent <code>ListJobsRequest</code>.
-        # Corresponds to the JSON property `nextPageToken`
-        # @return [String]
-        attr_accessor :next_page_token
-      
-        # Output-only. Jobs list.
-        # Corresponds to the JSON property `jobs`
-        # @return [Array<Google::Apis::DataprocV1::Job>]
-        attr_accessor :jobs
+        # Optional. Maximum number of times per hour a driver may be restarted as a
+        # result of driver terminating with non-zero code before job is reported failed.
+        # A job may be reported as thrashing if driver exits with non-zero code 4 times
+        # within 10 minute window.Maximum value is 10.
+        # Corresponds to the JSON property `maxFailuresPerHour`
+        # @return [Fixnum]
+        attr_accessor :max_failures_per_hour
       
         def initialize(**args)
            update!(**args)
@@ -138,8 +320,7 @@ module Google
       
         # Update properties of this object
         def update!(**args)
-          @next_page_token = args[:next_page_token] if args.key?(:next_page_token)
-          @jobs = args[:jobs] if args.key?(:jobs)
+          @max_failures_per_hour = args[:max_failures_per_hour] if args.key?(:max_failures_per_hour)
         end
       end
       
@@ -172,6 +353,33 @@ module Google
         end
       end
       
+      # A list of jobs in a project.
+      class ListJobsResponse
+        include Google::Apis::Core::Hashable
+      
+        # Output-only. Jobs list.
+        # Corresponds to the JSON property `jobs`
+        # @return [Array<Google::Apis::DataprocV1::Job>]
+        attr_accessor :jobs
+      
+        # Optional. This token is included in the response if there are more results to
+        # fetch. To fetch additional results, provide this value as the page_token in a
+        # subsequent <code>ListJobsRequest</code>.
+        # Corresponds to the JSON property `nextPageToken`
+        # @return [String]
+        attr_accessor :next_page_token
+      
+        def initialize(**args)
+           update!(**args)
+        end
+      
+        # Update properties of this object
+        def update!(**args)
+          @jobs = args[:jobs] if args.key?(:jobs)
+          @next_page_token = args[:next_page_token] if args.key?(:next_page_token)
+        end
+      end
+      
       # A request to cancel a job.
       class CancelJobRequest
         include Google::Apis::Core::Hashable
@@ -190,16 +398,16 @@ module Google
       class SparkSqlJob
         include Google::Apis::Core::Hashable
       
-        # A list of queries to run on a cluster.
-        # Corresponds to the JSON property `queryList`
-        # @return [Google::Apis::DataprocV1::QueryList]
-        attr_accessor :query_list
-      
         # The HCFS URI of the script that contains SQL queries.
         # Corresponds to the JSON property `queryFileUri`
         # @return [String]
         attr_accessor :query_file_uri
       
+        # A list of queries to run on a cluster.
+        # Corresponds to the JSON property `queryList`
+        # @return [Google::Apis::DataprocV1::QueryList]
+        attr_accessor :query_list
+      
         # Optional. Mapping of query variable names to values (equivalent to the Spark
         # SQL command: SET name="value";).
         # Corresponds to the JSON property `scriptVariables`
@@ -229,8 +437,8 @@ module Google
       
         # Update properties of this object
         def update!(**args)
-          @query_list = args[:query_list] if args.key?(:query_list)
           @query_file_uri = args[:query_file_uri] if args.key?(:query_file_uri)
+          @query_list = args[:query_list] if args.key?(:query_list)
           @script_variables = args[:script_variables] if args.key?(:script_variables)
           @jar_file_uris = args[:jar_file_uris] if args.key?(:jar_file_uris)
           @logging_config = args[:logging_config] if args.key?(:logging_config)
@@ -252,11 +460,6 @@ module Google
         # @return [Hash<String,String>]
         attr_accessor :labels
       
-        # The status of a cluster and its instances.
-        # Corresponds to the JSON property `status`
-        # @return [Google::Apis::DataprocV1::ClusterStatus]
-        attr_accessor :status
-      
         # Contains cluster daemon metrics, such as HDFS and YARN stats.Beta Feature:
         # This report is available for testing purposes only. It may be changed before
         # final release.
@@ -264,6 +467,11 @@ module Google
         # @return [Google::Apis::DataprocV1::ClusterMetrics]
         attr_accessor :metrics
       
+        # The status of a cluster and its instances.
+        # Corresponds to the JSON property `status`
+        # @return [Google::Apis::DataprocV1::ClusterStatus]
+        attr_accessor :status
+      
         # Output-only. The previous cluster status.
         # Corresponds to the JSON property `statusHistory`
         # @return [Array<Google::Apis::DataprocV1::ClusterStatus>]
@@ -274,18 +482,18 @@ module Google
         # @return [Google::Apis::DataprocV1::ClusterConfig]
         attr_accessor :config
       
-        # Required. The cluster name. Cluster names within a project must be unique.
-        # Names of deleted clusters can be reused.
-        # Corresponds to the JSON property `clusterName`
-        # @return [String]
-        attr_accessor :cluster_name
-      
         # Output-only. A cluster UUID (Unique Universal Identifier). Cloud Dataproc
         # generates this value when it creates the cluster.
         # Corresponds to the JSON property `clusterUuid`
         # @return [String]
         attr_accessor :cluster_uuid
       
+        # Required. The cluster name. Cluster names within a project must be unique.
+        # Names of deleted clusters can be reused.
+        # Corresponds to the JSON property `clusterName`
+        # @return [String]
+        attr_accessor :cluster_name
+      
         # Required. The Google Cloud Platform project ID that the cluster belongs to.
         # Corresponds to the JSON property `projectId`
         # @return [String]
@@ -298,12 +506,12 @@ module Google
         # Update properties of this object
         def update!(**args)
           @labels = args[:labels] if args.key?(:labels)
-          @status = args[:status] if args.key?(:status)
           @metrics = args[:metrics] if args.key?(:metrics)
+          @status = args[:status] if args.key?(:status)
           @status_history = args[:status_history] if args.key?(:status_history)
           @config = args[:config] if args.key?(:config)
-          @cluster_name = args[:cluster_name] if args.key?(:cluster_name)
           @cluster_uuid = args[:cluster_uuid] if args.key?(:cluster_uuid)
+          @cluster_name = args[:cluster_name] if args.key?(:cluster_name)
           @project_id = args[:project_id] if args.key?(:project_id)
         end
       end
@@ -312,24 +520,24 @@ module Google
       class ListOperationsResponse
         include Google::Apis::Core::Hashable
       
-        # The standard List next-page token.
-        # Corresponds to the JSON property `nextPageToken`
-        # @return [String]
-        attr_accessor :next_page_token
-      
         # A list of operations that matches the specified filter in the request.
         # Corresponds to the JSON property `operations`
         # @return [Array<Google::Apis::DataprocV1::Operation>]
         attr_accessor :operations
       
+        # The standard List next-page token.
+        # Corresponds to the JSON property `nextPageToken`
+        # @return [String]
+        attr_accessor :next_page_token
+      
         def initialize(**args)
            update!(**args)
         end
       
         # Update properties of this object
         def update!(**args)
-          @next_page_token = args[:next_page_token] if args.key?(:next_page_token)
           @operations = args[:operations] if args.key?(:operations)
+          @next_page_token = args[:next_page_token] if args.key?(:next_page_token)
         end
       end
       
@@ -435,10 +643,28 @@ module Google
         end
       end
       
-      # A Cloud Dataproc job for running Apache Pig (https://pig.apache.org/) queries
-      # on YARN.
-      class PigJob
-        include Google::Apis::Core::Hashable
+      # A Cloud Dataproc job for running Apache Pig (https://pig.apache.org/) queries
+      # on YARN.
+      class PigJob
+        include Google::Apis::Core::Hashable
+      
+        # Optional. Whether to continue executing queries if a query fails. The default
+        # value is false. Setting to true can be useful when executing independent
+        # parallel queries.
+        # Corresponds to the JSON property `continueOnFailure`
+        # @return [Boolean]
+        attr_accessor :continue_on_failure
+        alias_method :continue_on_failure?, :continue_on_failure
+      
+        # A list of queries to run on a cluster.
+        # Corresponds to the JSON property `queryList`
+        # @return [Google::Apis::DataprocV1::QueryList]
+        attr_accessor :query_list
+      
+        # The HCFS URI of the script that contains the Pig queries.
+        # Corresponds to the JSON property `queryFileUri`
+        # @return [String]
+        attr_accessor :query_file_uri
       
         # Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and
         # Hadoop MapReduce (MR) tasks. Can contain Pig UDFs.
@@ -465,37 +691,19 @@ module Google
         # @return [Hash<String,String>]
         attr_accessor :properties
       
-        # Optional. Whether to continue executing queries if a query fails. The default
-        # value is false. Setting to true can be useful when executing independent
-        # parallel queries.
-        # Corresponds to the JSON property `continueOnFailure`
-        # @return [Boolean]
-        attr_accessor :continue_on_failure
-        alias_method :continue_on_failure?, :continue_on_failure
-      
-        # The HCFS URI of the script that contains the Pig queries.
-        # Corresponds to the JSON property `queryFileUri`
-        # @return [String]
-        attr_accessor :query_file_uri
-      
-        # A list of queries to run on a cluster.
-        # Corresponds to the JSON property `queryList`
-        # @return [Google::Apis::DataprocV1::QueryList]
-        attr_accessor :query_list
-      
         def initialize(**args)
            update!(**args)
         end
       
         # Update properties of this object
         def update!(**args)
+          @continue_on_failure = args[:continue_on_failure] if args.key?(:continue_on_failure)
+          @query_list = args[:query_list] if args.key?(:query_list)
+          @query_file_uri = args[:query_file_uri] if args.key?(:query_file_uri)
           @jar_file_uris = args[:jar_file_uris] if args.key?(:jar_file_uris)
           @script_variables = args[:script_variables] if args.key?(:script_variables)
           @logging_config = args[:logging_config] if args.key?(:logging_config)
           @properties = args[:properties] if args.key?(:properties)
-          @continue_on_failure = args[:continue_on_failure] if args.key?(:continue_on_failure)
-          @query_file_uri = args[:query_file_uri] if args.key?(:query_file_uri)
-          @query_list = args[:query_list] if args.key?(:query_list)
         end
       end
       
@@ -530,6 +738,44 @@ module Google
       class Job
         include Google::Apis::Core::Hashable
       
+        # A Cloud Dataproc job for running Apache Hive (https://hive.apache.org/)
+        # queries on YARN.
+        # Corresponds to the JSON property `hiveJob`
+        # @return [Google::Apis::DataprocV1::HiveJob]
+        attr_accessor :hive_job
+      
+        # Optional. The labels to associate with this job. Label keys must contain 1 to
+        # 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.
+        # txt). Label values may be empty, but, if present, must contain 1 to 63
+        # characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt)
+        # . No more than 32 labels can be associated with a job.
+        # Corresponds to the JSON property `labels`
+        # @return [Hash<String,String>]
+        attr_accessor :labels
+      
+        # Output-only. A URI pointing to the location of the stdout of the job's driver
+        # program.
+        # Corresponds to the JSON property `driverOutputResourceUri`
+        # @return [String]
+        attr_accessor :driver_output_resource_uri
+      
+        # A Cloud Dataproc job for running Apache Spark SQL (http://spark.apache.org/sql/
+        # ) queries.
+        # Corresponds to the JSON property `sparkSqlJob`
+        # @return [Google::Apis::DataprocV1::SparkSqlJob]
+        attr_accessor :spark_sql_job
+      
+        # Output-only. The previous job status.
+        # Corresponds to the JSON property `statusHistory`
+        # @return [Array<Google::Apis::DataprocV1::JobStatus>]
+        attr_accessor :status_history
+      
+        # A Cloud Dataproc job for running Apache Spark (http://spark.apache.org/)
+        # applications on YARN.
+        # Corresponds to the JSON property `sparkJob`
+        # @return [Google::Apis::DataprocV1::SparkJob]
+        attr_accessor :spark_job
+      
         # Output-only. The collection of YARN applications spun up by this job.Beta
         # Feature: This report is available for testing purposes only. It may be changed
         # before final release.
@@ -585,50 +831,18 @@ module Google
         # @return [Google::Apis::DataprocV1::PigJob]
         attr_accessor :pig_job
       
-        # A Cloud Dataproc job for running Apache Hive (https://hive.apache.org/)
-        # queries on YARN.
-        # Corresponds to the JSON property `hiveJob`
-        # @return [Google::Apis::DataprocV1::HiveJob]
-        attr_accessor :hive_job
-      
-        # Optional. The labels to associate with this job. Label keys must contain 1 to
-        # 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.
-        # txt). Label values may be empty, but, if present, must contain 1 to 63
-        # characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt)
-        # . No more than 32 labels can be associated with a job.
-        # Corresponds to the JSON property `labels`
-        # @return [Hash<String,String>]
-        attr_accessor :labels
-      
-        # Output-only. A URI pointing to the location of the stdout of the job's driver
-        # program.
-        # Corresponds to the JSON property `driverOutputResourceUri`
-        # @return [String]
-        attr_accessor :driver_output_resource_uri
-      
-        # A Cloud Dataproc job for running Apache Spark SQL (http://spark.apache.org/sql/
-        # ) queries.
-        # Corresponds to the JSON property `sparkSqlJob`
-        # @return [Google::Apis::DataprocV1::SparkSqlJob]
-        attr_accessor :spark_sql_job
-      
-        # Output-only. The previous job status.
-        # Corresponds to the JSON property `statusHistory`
-        # @return [Array<Google::Apis::DataprocV1::JobStatus>]
-        attr_accessor :status_history
-      
-        # A Cloud Dataproc job for running Apache Spark (http://spark.apache.org/)
-        # applications on YARN.
-        # Corresponds to the JSON property `sparkJob`
-        # @return [Google::Apis::DataprocV1::SparkJob]
-        attr_accessor :spark_job
-      
         def initialize(**args)
            update!(**args)
         end
       
         # Update properties of this object
         def update!(**args)
+          @hive_job = args[:hive_job] if args.key?(:hive_job)
+          @labels = args[:labels] if args.key?(:labels)
+          @driver_output_resource_uri = args[:driver_output_resource_uri] if args.key?(:driver_output_resource_uri)
+          @spark_sql_job = args[:spark_sql_job] if args.key?(:spark_sql_job)
+          @status_history = args[:status_history] if args.key?(:status_history)
+          @spark_job = args[:spark_job] if args.key?(:spark_job)
           @yarn_applications = args[:yarn_applications] if args.key?(:yarn_applications)
           @pyspark_job = args[:pyspark_job] if args.key?(:pyspark_job)
           @reference = args[:reference] if args.key?(:reference)
@@ -638,12 +852,6 @@ module Google
           @driver_control_files_uri = args[:driver_control_files_uri] if args.key?(:driver_control_files_uri)
           @scheduling = args[:scheduling] if args.key?(:scheduling)
           @pig_job = args[:pig_job] if args.key?(:pig_job)
-          @hive_job = args[:hive_job] if args.key?(:hive_job)
-          @labels = args[:labels] if args.key?(:labels)
-          @driver_output_resource_uri = args[:driver_output_resource_uri] if args.key?(:driver_output_resource_uri)
-          @spark_sql_job = args[:spark_sql_job] if args.key?(:spark_sql_job)
-          @status_history = args[:status_history] if args.key?(:status_history)
-          @spark_job = args[:spark_job] if args.key?(:spark_job)
         end
       end
       
@@ -652,19 +860,6 @@ module Google
       class SparkJob
         include Google::Apis::Core::Hashable
       
-        # Optional. The arguments to pass to the driver. Do not include arguments, such
-        # as --conf, that can be set as job properties, since a collision may occur that
-        # causes an incorrect job submission.
-        # Corresponds to the JSON property `args`
-        # @return [Array<String>]
-        attr_accessor :args
-      
-        # Optional. HCFS URIs of files to be copied to the working directory of Spark
-        # drivers and distributed tasks. Useful for naively parallel tasks.
-        # Corresponds to the JSON property `fileUris`
-        # @return [Array<String>]
-        attr_accessor :file_uris
-      
         # The name of the driver's main class. The jar file that contains the class must
         # be in the default CLASSPATH or specified in jar_file_uris.
         # Corresponds to the JSON property `mainClass`
@@ -702,20 +897,33 @@ module Google
         # @return [Hash<String,String>]
         attr_accessor :properties
       
+        # Optional. The arguments to pass to the driver. Do not include arguments, such
+        # as --conf, that can be set as job properties, since a collision may occur that
+        # causes an incorrect job submission.
+        # Corresponds to the JSON property `args`
+        # @return [Array<String>]
+        attr_accessor :args
+      
+        # Optional. HCFS URIs of files to be copied to the working directory of Spark
+        # drivers and distributed tasks. Useful for naively parallel tasks.
+        # Corresponds to the JSON property `fileUris`
+        # @return [Array<String>]
+        attr_accessor :file_uris
+      
         def initialize(**args)
            update!(**args)
         end
       
         # Update properties of this object
         def update!(**args)
-          @args = args[:args] if args.key?(:args)
-          @file_uris = args[:file_uris] if args.key?(:file_uris)
           @main_class = args[:main_class] if args.key?(:main_class)
           @archive_uris = args[:archive_uris] if args.key?(:archive_uris)
           @main_jar_file_uri = args[:main_jar_file_uri] if args.key?(:main_jar_file_uri)
           @jar_file_uris = args[:jar_file_uris] if args.key?(:jar_file_uris)
           @logging_config = args[:logging_config] if args.key?(:logging_config)
           @properties = args[:properties] if args.key?(:properties)
+          @args = args[:args] if args.key?(:args)
+          @file_uris = args[:file_uris] if args.key?(:file_uris)
         end
       end
       
@@ -723,17 +931,6 @@ module Google
       class JobStatus
         include Google::Apis::Core::Hashable
       
-        # Output-only. Additional state information, which includes status reported by
-        # the agent.
-        # Corresponds to the JSON property `substate`
-        # @return [String]
-        attr_accessor :substate
-      
-        # Output-only. The time when this state was entered.
-        # Corresponds to the JSON property `stateStartTime`
-        # @return [String]
-        attr_accessor :state_start_time
-      
         # Output-only. Optional job state details, such as an error description if the
         # state is <code>ERROR</code>.
         # Corresponds to the JSON property `details`
@@ -745,16 +942,27 @@ module Google
         # @return [String]
         attr_accessor :state
       
+        # Output-only. Additional state information, which includes status reported by
+        # the agent.
+        # Corresponds to the JSON property `substate`
+        # @return [String]
+        attr_accessor :substate
+      
+        # Output-only. The time when this state was entered.
+        # Corresponds to the JSON property `stateStartTime`
+        # @return [String]
+        attr_accessor :state_start_time
+      
         def initialize(**args)
            update!(**args)
         end
       
         # Update properties of this object
         def update!(**args)
-          @substate = args[:substate] if args.key?(:substate)
-          @state_start_time = args[:state_start_time] if args.key?(:state_start_time)
           @details = args[:details] if args.key?(:details)
           @state = args[:state] if args.key?(:state)
+          @substate = args[:substate] if args.key?(:substate)
+          @state_start_time = args[:state_start_time] if args.key?(:state_start_time)
         end
       end
       
@@ -828,14 +1036,6 @@ module Google
       class HadoopJob
         include Google::Apis::Core::Hashable
       
-        # The HCFS URI of the jar file containing the main class. Examples:  'gs://foo-
-        # bucket/analytics-binaries/extract-useful-metrics-mr.jar'  'hdfs:/tmp/test-
-        # samples/custom-wordcount.jar'  'file:///home/usr/lib/hadoop-mapreduce/hadoop-
-        # mapreduce-examples.jar'
-        # Corresponds to the JSON property `mainJarFileUri`
-        # @return [String]
-        attr_accessor :main_jar_file_uri
-      
         # Optional. Jar file URIs to add to the CLASSPATHs of the Hadoop driver and
         # tasks.
         # Corresponds to the JSON property `jarFileUris`
@@ -882,13 +1082,20 @@ module Google
         # @return [Array<String>]
         attr_accessor :archive_uris
       
+        # The HCFS URI of the jar file containing the main class. Examples:  'gs://foo-
+        # bucket/analytics-binaries/extract-useful-metrics-mr.jar'  'hdfs:/tmp/test-
+        # samples/custom-wordcount.jar'  'file:///home/usr/lib/hadoop-mapreduce/hadoop-
+        # mapreduce-examples.jar'
+        # Corresponds to the JSON property `mainJarFileUri`
+        # @return [String]
+        attr_accessor :main_jar_file_uri
+      
         def initialize(**args)
            update!(**args)
         end
       
         # Update properties of this object
         def update!(**args)
-          @main_jar_file_uri = args[:main_jar_file_uri] if args.key?(:main_jar_file_uri)
           @jar_file_uris = args[:jar_file_uris] if args.key?(:jar_file_uris)
           @logging_config = args[:logging_config] if args.key?(:logging_config)
           @properties = args[:properties] if args.key?(:properties)
@@ -896,6 +1103,7 @@ module Google
           @file_uris = args[:file_uris] if args.key?(:file_uris)
           @main_class = args[:main_class] if args.key?(:main_class)
           @archive_uris = args[:archive_uris] if args.key?(:archive_uris)
+          @main_jar_file_uri = args[:main_jar_file_uri] if args.key?(:main_jar_file_uri)
         end
       end
       
@@ -937,6 +1145,16 @@ module Google
       class YarnApplication
         include Google::Apis::Core::Hashable
       
+        # Required. The application state.
+        # Corresponds to the JSON property `state`
+        # @return [String]
+        attr_accessor :state
+      
+        # Required. The application name.
+        # Corresponds to the JSON property `name`
+        # @return [String]
+        attr_accessor :name
+      
         # Optional. The HTTP URL of the ApplicationMaster, HistoryServer, or
         # TimelineServer that provides application-specific information. The URL uses
         # the internal hostname, and requires a proxy server for resolution and,
@@ -950,26 +1168,16 @@ module Google
         # @return [Float]
         attr_accessor :progress
       
-        # Required. The application state.
-        # Corresponds to the JSON property `state`
-        # @return [String]
-        attr_accessor :state
-      
-        # Required. The application name.
-        # Corresponds to the JSON property `name`
-        # @return [String]
-        attr_accessor :name
-      
         def initialize(**args)
            update!(**args)
         end
       
         # Update properties of this object
         def update!(**args)
-          @tracking_url = args[:tracking_url] if args.key?(:tracking_url)
-          @progress = args[:progress] if args.key?(:progress)
           @state = args[:state] if args.key?(:state)
           @name = args[:name] if args.key?(:name)
+          @tracking_url = args[:tracking_url] if args.key?(:tracking_url)
+          @progress = args[:progress] if args.key?(:progress)
         end
       end
       
@@ -990,11 +1198,6 @@ module Google
       class DiskConfig
         include Google::Apis::Core::Hashable
       
-        # Optional. Size in GB of the boot disk (default is 500GB).
-        # Corresponds to the JSON property `bootDiskSizeGb`
-        # @return [Fixnum]
-        attr_accessor :boot_disk_size_gb
-      
         # Optional. Number of attached SSDs, from 0 to 4 (default is 0). If SSDs are not
         # attached, the boot disk is used to store runtime logs and HDFS (https://hadoop.
         # apache.org/docs/r1.2.1/hdfs_user_guide.html) data. If one or more SSDs are
@@ -1004,14 +1207,19 @@ module Google
         # @return [Fixnum]
         attr_accessor :num_local_ssds
       
+        # Optional. Size in GB of the boot disk (default is 500GB).
+        # Corresponds to the JSON property `bootDiskSizeGb`
+        # @return [Fixnum]
+        attr_accessor :boot_disk_size_gb
+      
         def initialize(**args)
            update!(**args)
         end
       
         # Update properties of this object
         def update!(**args)
-          @boot_disk_size_gb = args[:boot_disk_size_gb] if args.key?(:boot_disk_size_gb)
           @num_local_ssds = args[:num_local_ssds] if args.key?(:num_local_ssds)
+          @boot_disk_size_gb = args[:boot_disk_size_gb] if args.key?(:boot_disk_size_gb)
         end
       end
       
@@ -1019,11 +1227,6 @@ module Google
       class ClusterOperationMetadata
         include Google::Apis::Core::Hashable
       
-        # Output-only. Labels associated with the operation
-        # Corresponds to the JSON property `labels`
-        # @return [Hash<String,String>]
-        attr_accessor :labels
-      
         # The status of the operation.
         # Corresponds to the JSON property `status`
         # @return [Google::Apis::DataprocV1::ClusterOperationStatus]
@@ -1059,13 +1262,17 @@ module Google
         # @return [Array<String>]
         attr_accessor :warnings
       
+        # Output-only. Labels associated with the operation
+        # Corresponds to the JSON property `labels`
+        # @return [Hash<String,String>]
+        attr_accessor :labels
+      
         def initialize(**args)
            update!(**args)
         end
       
         # Update properties of this object
         def update!(**args)
-          @labels = args[:labels] if args.key?(:labels)
           @status = args[:status] if args.key?(:status)
           @status_history = args[:status_history] if args.key?(:status_history)
           @cluster_name = args[:cluster_name] if args.key?(:cluster_name)
@@ -1073,6 +1280,7 @@ module Google
           @operation_type = args[:operation_type] if args.key?(:operation_type)
           @description = args[:description] if args.key?(:description)
           @warnings = args[:warnings] if args.key?(:warnings)
+          @labels = args[:labels] if args.key?(:labels)
         end
       end
       
@@ -1081,18 +1289,18 @@ module Google
       class HiveJob
         include Google::Apis::Core::Hashable
       
-        # Optional. Mapping of query variable names to values (equivalent to the Hive
-        # command: SET name="value";).
-        # Corresponds to the JSON property `scriptVariables`
-        # @return [Hash<String,String>]
-        attr_accessor :script_variables
-      
         # Optional. HCFS URIs of jar files to add to the CLASSPATH of the Hive server
         # and Hadoop MapReduce (MR) tasks. Can contain Hive SerDes and UDFs.
         # Corresponds to the JSON property `jarFileUris`
         # @return [Array<String>]
         attr_accessor :jar_file_uris
       
+        # Optional. Mapping of query variable names to values (equivalent to the Hive
+        # command: SET name="value";).
+        # Corresponds to the JSON property `scriptVariables`
+        # @return [Hash<String,String>]
+        attr_accessor :script_variables
+      
         # Optional. A mapping of property names and values, used to configure Hive.
         # Properties that conflict with values set by the Cloud Dataproc API may be
         # overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/
@@ -1125,8 +1333,8 @@ module Google
       
         # Update properties of this object
         def update!(**args)
-          @script_variables = args[:script_variables] if args.key?(:script_variables)
           @jar_file_uris = args[:jar_file_uris] if args.key?(:jar_file_uris)
+          @script_variables = args[:script_variables] if args.key?(:script_variables)
           @properties = args[:properties] if args.key?(:properties)
           @continue_on_failure = args[:continue_on_failure] if args.key?(:continue_on_failure)
           @query_list = args[:query_list] if args.key?(:query_list)
@@ -1177,6 +1385,18 @@ module Google
       class ClusterConfig
         include Google::Apis::Core::Hashable
       
+        # Optional. The config settings for Google Compute Engine resources in an
+        # instance group, such as a master or worker group.
+        # Corresponds to the JSON property `masterConfig`
+        # @return [Google::Apis::DataprocV1::InstanceGroupConfig]
+        attr_accessor :master_config
+      
+        # Optional. The config settings for Google Compute Engine resources in an
+        # instance group, such as a master or worker group.
+        # Corresponds to the JSON property `secondaryWorkerConfig`
+        # @return [Google::Apis::DataprocV1::InstanceGroupConfig]
+        attr_accessor :secondary_worker_config
+      
         # Optional. Commands to execute on each node after config is completed. By
         # default, executables are run on master and all worker nodes. You can test a
         # node's role metadata to run an executable on a master or worker node, as shown
@@ -1219,31 +1439,19 @@ module Google
         # @return [Google::Apis::DataprocV1::SoftwareConfig]
         attr_accessor :software_config
       
-        # Optional. The config settings for Google Compute Engine resources in an
-        # instance group, such as a master or worker group.
-        # Corresponds to the JSON property `masterConfig`
-        # @return [Google::Apis::DataprocV1::InstanceGroupConfig]
-        attr_accessor :master_config
-      
-        # Optional. The config settings for Google Compute Engine resources in an
-        # instance group, such as a master or worker group.
-        # Corresponds to the JSON property `secondaryWorkerConfig`
-        # @return [Google::Apis::DataprocV1::InstanceGroupConfig]
-        attr_accessor :secondary_worker_config
-      
         def initialize(**args)
            update!(**args)
         end
       
         # Update properties of this object
         def update!(**args)
+          @master_config = args[:master_config] if args.key?(:master_config)
+          @secondary_worker_config = args[:secondary_worker_config] if args.key?(:secondary_worker_config)
           @initialization_actions = args[:initialization_actions] if args.key?(:initialization_actions)
           @config_bucket = args[:config_bucket] if args.key?(:config_bucket)
           @worker_config = args[:worker_config] if args.key?(:worker_config)
           @gce_cluster_config = args[:gce_cluster_config] if args.key?(:gce_cluster_config)
           @software_config = args[:software_config] if args.key?(:software_config)
-          @master_config = args[:master_config] if args.key?(:master_config)
-          @secondary_worker_config = args[:secondary_worker_config] if args.key?(:secondary_worker_config)
         end
       end
       
@@ -1373,8 +1581,12 @@ module Google
         attr_accessor :service_account
       
         # Optional. The Google Compute Engine subnetwork to be used for machine
-        # communications. Cannot be specified with network_uri. Example: https://www.
-        # googleapis.com/compute/v1/projects/[project_id]/regions/us-east1/sub0.
+        # communications. Cannot be specified with network_uri.A full URL, partial URI,
+        # or short name are valid. Examples:
+        # https://www.googleapis.com/compute/v1/projects/[project_id]/regions/us-east1/
+        # sub0
+        # projects/[project_id]/regions/us-east1/sub0
+        # sub0
         # Corresponds to the JSON property `subnetworkUri`
         # @return [String]
         attr_accessor :subnetwork_uri
@@ -1383,15 +1595,24 @@ module Google
         # communications. Cannot be specified with subnetwork_uri. If neither
         # network_uri nor subnetwork_uri is specified, the "default" network of the
         # project is used, if it exists. Cannot be a "Custom Subnet Network" (see Using
-        # Subnetworks for more information). Example: https://www.googleapis.com/compute/
-        # v1/projects/[project_id]/regions/global/default.
+        # Subnetworks for more information).A full URL, partial URI, or short name are
+        # valid. Examples:
+        # https://www.googleapis.com/compute/v1/projects/[project_id]/regions/global/
+        # default
+        # projects/[project_id]/regions/global/default
+        # default
         # Corresponds to the JSON property `networkUri`
         # @return [String]
         attr_accessor :network_uri
       
-        # Required. The zone where the Google Compute Engine cluster will be located.
-        # Example: https://www.googleapis.com/compute/v1/projects/[project_id]/zones/[
-        # zone].
+        # Optional. The zone where the Google Compute Engine cluster will be located. On
+        # a create request, it is required in the "global" region. If omitted in a non-
+        # global Cloud Dataproc region, the service will pick a zone in the
+        # corresponding GCE region. On a get request, zone will always be present.A full
+        # URL, partial URI, or short name are valid. Examples:
+        # https://www.googleapis.com/compute/v1/projects/[project_id]/zones/[zone]
+        # projects/[project_id]/zones/[zone]
+        # us-central1-f
         # Corresponds to the JSON property `zoneUri`
         # @return [String]
         attr_accessor :zone_uri
@@ -1419,24 +1640,24 @@ module Google
       class ClusterMetrics
         include Google::Apis::Core::Hashable
       
-        # The YARN metrics.
-        # Corresponds to the JSON property `yarnMetrics`
-        # @return [Hash<String,Fixnum>]
-        attr_accessor :yarn_metrics
-      
         # The HDFS metrics.
         # Corresponds to the JSON property `hdfsMetrics`
         # @return [Hash<String,Fixnum>]
         attr_accessor :hdfs_metrics
       
+        # The YARN metrics.
+        # Corresponds to the JSON property `yarnMetrics`
+        # @return [Hash<String,Fixnum>]
+        attr_accessor :yarn_metrics
+      
         def initialize(**args)
            update!(**args)
         end
       
         # Update properties of this object
         def update!(**args)
-          @yarn_metrics = args[:yarn_metrics] if args.key?(:yarn_metrics)
           @hdfs_metrics = args[:hdfs_metrics] if args.key?(:hdfs_metrics)
+          @yarn_metrics = args[:yarn_metrics] if args.key?(:yarn_metrics)
         end
       end
       
@@ -1445,26 +1666,29 @@ module Google
       class AcceleratorConfig
         include Google::Apis::Core::Hashable
       
-        # Full or partial URI of the accelerator type resource to expose to this
-        # instance. See Google Compute Engine AcceleratorTypes( /compute/docs/reference/
-        # beta/acceleratorTypes)
-        # Corresponds to the JSON property `acceleratorTypeUri`
-        # @return [String]
-        attr_accessor :accelerator_type_uri
-      
         # The number of the accelerator cards of this type exposed to this instance.
         # Corresponds to the JSON property `acceleratorCount`
         # @return [Fixnum]
         attr_accessor :accelerator_count
       
+        # Full URL, partial URI, or short name of the accelerator type resource to
+        # expose to this instance. See Google Compute Engine AcceleratorTypes( /compute/
+        # docs/reference/beta/acceleratorTypes)Examples * https://www.googleapis.com/
+        # compute/beta/projects/[project_id]/zones/us-east1-a/acceleratorTypes/nvidia-
+        # tesla-k80 * projects/[project_id]/zones/us-east1-a/acceleratorTypes/nvidia-
+        # tesla-k80 * nvidia-tesla-k80
+        # Corresponds to the JSON property `acceleratorTypeUri`
+        # @return [String]
+        attr_accessor :accelerator_type_uri
+      
         def initialize(**args)
            update!(**args)
         end
       
         # Update properties of this object
         def update!(**args)
-          @accelerator_type_uri = args[:accelerator_type_uri] if args.key?(:accelerator_type_uri)
           @accelerator_count = args[:accelerator_count] if args.key?(:accelerator_count)
+          @accelerator_type_uri = args[:accelerator_type_uri] if args.key?(:accelerator_type_uri)
         end
       end
       
@@ -1488,211 +1712,6 @@ module Google
           @driver_log_levels = args[:driver_log_levels] if args.key?(:driver_log_levels)
         end
       end
-      
-      # This resource represents a long-running operation that is the result of a
-      # network API call.
-      class Operation
-        include Google::Apis::Core::Hashable
-      
-        # If the value is false, it means the operation is still in progress. If true,
-        # the operation is completed, and either error or response is available.
-        # Corresponds to the JSON property `done`
-        # @return [Boolean]
-        attr_accessor :done
-        alias_method :done?, :done
-      
-        # The normal response of the operation in case of success. If the original
-        # method returns no data on success, such as Delete, the response is google.
-        # protobuf.Empty. If the original method is standard Get/Create/Update, the
-        # response should be the resource. For other methods, the response should have
-        # the type XxxResponse, where Xxx is the original method name. For example, if
-        # the original method name is TakeSnapshot(), the inferred response type is
-        # TakeSnapshotResponse.
-        # Corresponds to the JSON property `response`
-        # @return [Hash<String,Object>]
-        attr_accessor :response
-      
-        # The server-assigned name, which is only unique within the same service that
-        # originally returns it. If you use the default HTTP mapping, the name should
-        # have the format of operations/some/unique/name.
-        # Corresponds to the JSON property `name`
-        # @return [String]
-        attr_accessor :name
-      
-        # The Status type defines a logical error model that is suitable for different
-        # programming environments, including REST APIs and RPC APIs. It is used by gRPC
-        # (https://github.com/grpc). The error model is designed to be:
-        # Simple to use and understand for most users
-        # Flexible enough to meet unexpected needsOverviewThe Status message contains
-        # three pieces of data: error code, error message, and error details. The error
-        # code should be an enum value of google.rpc.Code, but it may accept additional
-        # error codes if needed. The error message should be a developer-facing English
-        # message that helps developers understand and resolve the error. If a localized
-        # user-facing error message is needed, put the localized message in the error
-        # details or localize it in the client. The optional error details may contain
-        # arbitrary information about the error. There is a predefined set of error
-        # detail types in the package google.rpc that can be used for common error
-        # conditions.Language mappingThe Status message is the logical representation of
-        # the error model, but it is not necessarily the actual wire format. When the
-        # Status message is exposed in different client libraries and different wire
-        # protocols, it can be mapped differently. For example, it will likely be mapped
-        # to some exceptions in Java, but more likely mapped to some error codes in C.
-        # Other usesThe error model and the Status message can be used in a variety of
-        # environments, either with or without APIs, to provide a consistent developer
-        # experience across different environments.Example uses of this error model
-        # include:
-        # Partial errors. If a service needs to return partial errors to the client, it
-        # may embed the Status in the normal response to indicate the partial errors.
-        # Workflow errors. A typical workflow has multiple steps. Each step may have a
-        # Status message for error reporting.
-        # Batch operations. If a client uses batch request and batch response, the
-        # Status message should be used directly inside batch response, one for each
-        # error sub-response.
-        # Asynchronous operations. If an API call embeds asynchronous operation results
-        # in its response, the status of those operations should be represented directly
-        # using the Status message.
-        # Logging. If some API errors are stored in logs, the message Status could be
-        # used directly after any stripping needed for security/privacy reasons.
-        # Corresponds to the JSON property `error`
-        # @return [Google::Apis::DataprocV1::Status]
-        attr_accessor :error
-      
-        # Service-specific metadata associated with the operation. It typically contains
-        # progress information and common metadata such as create time. Some services
-        # might not provide such metadata. Any method that returns a long-running
-        # operation should document the metadata type, if any.
-        # Corresponds to the JSON property `metadata`
-        # @return [Hash<String,Object>]
-        attr_accessor :metadata
-      
-        def initialize(**args)
-           update!(**args)
-        end
-      
-        # Update properties of this object
-        def update!(**args)
-          @done = args[:done] if args.key?(:done)
-          @response = args[:response] if args.key?(:response)
-          @name = args[:name] if args.key?(:name)
-          @error = args[:error] if args.key?(:error)
-          @metadata = args[:metadata] if args.key?(:metadata)
-        end
-      end
-      
-      # Encapsulates the full scoping used to reference a job.
-      class JobReference
-        include Google::Apis::Core::Hashable
-      
-        # Optional. The job ID, which must be unique within the project. The job ID is
-        # generated by the server upon job submission or provided by the user as a means
-        # to perform retries without creating duplicate jobs. The ID must contain only
-        # letters (a-z, A-Z), numbers (0-9), underscores (_), or hyphens (-). The
-        # maximum length is 100 characters.
-        # Corresponds to the JSON property `jobId`
-        # @return [String]
-        attr_accessor :job_id
-      
-        # Required. The ID of the Google Cloud Platform project that the job belongs to.
-        # Corresponds to the JSON property `projectId`
-        # @return [String]
-        attr_accessor :project_id
-      
-        def initialize(**args)
-           update!(**args)
-        end
-      
-        # Update properties of this object
-        def update!(**args)
-          @job_id = args[:job_id] if args.key?(:job_id)
-          @project_id = args[:project_id] if args.key?(:project_id)
-        end
-      end
-      
-      # A request to submit a job.
-      class SubmitJobRequest
-        include Google::Apis::Core::Hashable
-      
-        # A Cloud Dataproc job resource.
-        # Corresponds to the JSON property `job`
-        # @return [Google::Apis::DataprocV1::Job]
-        attr_accessor :job
-      
-        def initialize(**args)
-           update!(**args)
-        end
-      
-        # Update properties of this object
-        def update!(**args)
-          @job = args[:job] if args.key?(:job)
-        end
-      end
-      
-      # The Status type defines a logical error model that is suitable for different
-      # programming environments, including REST APIs and RPC APIs. It is used by gRPC
-      # (https://github.com/grpc). The error model is designed to be:
-      # Simple to use and understand for most users
-      # Flexible enough to meet unexpected needsOverviewThe Status message contains
-      # three pieces of data: error code, error message, and error details. The error
-      # code should be an enum value of google.rpc.Code, but it may accept additional
-      # error codes if needed. The error message should be a developer-facing English
-      # message that helps developers understand and resolve the error. If a localized
-      # user-facing error message is needed, put the localized message in the error
-      # details or localize it in the client. The optional error details may contain
-      # arbitrary information about the error. There is a predefined set of error
-      # detail types in the package google.rpc that can be used for common error
-      # conditions.Language mappingThe Status message is the logical representation of
-      # the error model, but it is not necessarily the actual wire format. When the
-      # Status message is exposed in different client libraries and different wire
-      # protocols, it can be mapped differently. For example, it will likely be mapped
-      # to some exceptions in Java, but more likely mapped to some error codes in C.
-      # Other usesThe error model and the Status message can be used in a variety of
-      # environments, either with or without APIs, to provide a consistent developer
-      # experience across different environments.Example uses of this error model
-      # include:
-      # Partial errors. If a service needs to return partial errors to the client, it
-      # may embed the Status in the normal response to indicate the partial errors.
-      # Workflow errors. A typical workflow has multiple steps. Each step may have a
-      # Status message for error reporting.
-      # Batch operations. If a client uses batch request and batch response, the
-      # Status message should be used directly inside batch response, one for each
-      # error sub-response.
-      # Asynchronous operations. If an API call embeds asynchronous operation results
-      # in its response, the status of those operations should be represented directly
-      # using the Status message.
-      # Logging. If some API errors are stored in logs, the message Status could be
-      # used directly after any stripping needed for security/privacy reasons.
-      class Status
-        include Google::Apis::Core::Hashable
-      
-        # A list of messages that carry the error details. There will be a common set of
-        # message types for APIs to use.
-        # Corresponds to the JSON property `details`
-        # @return [Array<Hash<String,Object>>]
-        attr_accessor :details
-      
-        # The status code, which should be an enum value of google.rpc.Code.
-        # Corresponds to the JSON property `code`
-        # @return [Fixnum]
-        attr_accessor :code
-      
-        # A developer-facing error message, which should be in English. Any user-facing
-        # error message should be localized and sent in the google.rpc.Status.details
-        # field, or localized by the client.
-        # Corresponds to the JSON property `message`
-        # @return [String]
-        attr_accessor :message
-      
-        def initialize(**args)
-           update!(**args)
-        end
-      
-        # Update properties of this object
-        def update!(**args)
-          @details = args[:details] if args.key?(:details)
-          @code = args[:code] if args.key?(:code)
-          @message = args[:message] if args.key?(:message)
-        end
-      end
     end
   end
 end