@google-cloud/discoveryengine 0.4.1 → 0.5.0

package/CHANGELOG.md

@@ -1,5 +1,12 @@
 # Changelog
 
+## [0.5.0](https://github.com/googleapis/google-cloud-node/compare/discoveryengine-v0.4.1...discoveryengine-v0.5.0) (2023-04-24)
+
+
+### Features
+
+* [discoveryengine] add search, autocomplete and schema services ([#4201](https://github.com/googleapis/google-cloud-node/issues/4201)) ([de00e1d](https://github.com/googleapis/google-cloud-node/commit/de00e1d88877dd674dfd20b78a3de4476d65eb29))
+
 ## [0.4.1](https://github.com/googleapis/google-cloud-node/compare/discoveryengine-v0.4.0...discoveryengine-v0.4.1) (2023-04-13)
 
 

package/README.md

@@ -125,6 +125,7 @@ Samples are in the [`samples/`](https://github.com/googleapis/google-cloud-node/
 
 | Sample                      | Source Code                       | Try it |
 | --------------------------- | --------------------------------- | ------ |
+| Completion_service.complete_query | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1beta/completion_service.complete_query.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1beta/completion_service.complete_query.js,samples/README.md) |
 | Document_service.create_document | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1beta/document_service.create_document.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1beta/document_service.create_document.js,samples/README.md) |
 | Document_service.delete_document | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1beta/document_service.delete_document.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1beta/document_service.delete_document.js,samples/README.md) |
 | Document_service.get_document | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1beta/document_service.get_document.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1beta/document_service.get_document.js,samples/README.md) |
@@ -132,6 +133,12 @@ Samples are in the [`samples/`](https://github.com/googleapis/google-cloud-node/
 | Document_service.list_documents | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1beta/document_service.list_documents.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1beta/document_service.list_documents.js,samples/README.md) |
 | Document_service.update_document | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1beta/document_service.update_document.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1beta/document_service.update_document.js,samples/README.md) |
 | Recommendation_service.recommend | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1beta/recommendation_service.recommend.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1beta/recommendation_service.recommend.js,samples/README.md) |
+| Schema_service.create_schema | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1beta/schema_service.create_schema.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1beta/schema_service.create_schema.js,samples/README.md) |
+| Schema_service.delete_schema | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1beta/schema_service.delete_schema.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1beta/schema_service.delete_schema.js,samples/README.md) |
+| Schema_service.get_schema | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1beta/schema_service.get_schema.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1beta/schema_service.get_schema.js,samples/README.md) |
+| Schema_service.list_schemas | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1beta/schema_service.list_schemas.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1beta/schema_service.list_schemas.js,samples/README.md) |
+| Schema_service.update_schema | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1beta/schema_service.update_schema.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1beta/schema_service.update_schema.js,samples/README.md) |
+| Search_service.search | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1beta/search_service.search.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1beta/search_service.search.js,samples/README.md) |
 | User_event_service.collect_user_event | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1beta/user_event_service.collect_user_event.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1beta/user_event_service.collect_user_event.js,samples/README.md) |
 | User_event_service.import_user_events | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1beta/user_event_service.import_user_events.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1beta/user_event_service.import_user_events.js,samples/README.md) |
 | User_event_service.write_user_event | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1beta/user_event_service.write_user_event.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1beta/user_event_service.write_user_event.js,samples/README.md) |

package/build/protos/google/cloud/discoveryengine/v1beta/common.proto

@@ -42,28 +42,59 @@ option (google.api.resource_definition) = {
   pattern: "projects/{project}/locations/{location}/collections/{collection}/dataStores/{data_store}/servingConfigs/{serving_config}"
 };
 
+// A floating point interval.
+message Interval {
+  // The lower bound of the interval. If neither of the min fields are
+  // set, then the lower bound is negative infinity.
+  //
+  // This field must be not larger than max.
+  // Otherwise, an `INVALID_ARGUMENT` error is returned.
+  oneof min {
+    // Inclusive lower bound.
+    double minimum = 1;
+
+    // Exclusive lower bound.
+    double exclusive_minimum = 2;
+  }
+
+  // The upper bound of the interval. If neither of the max fields are
+  // set, then the upper bound is positive infinity.
+  //
+  // This field must be not smaller than min.
+  // Otherwise, an `INVALID_ARGUMENT` error is returned.
+  oneof max {
+    // Inclusive upper bound.
+    double maximum = 3;
+
+    // Exclusive upper bound.
+    double exclusive_maximum = 4;
+  }
+}
+
 // A custom attribute that is not explicitly modeled in a resource, e.g.
 // [UserEvent][google.cloud.discoveryengine.v1beta.UserEvent].
 message CustomAttribute {
   // The textual values of this custom attribute. For example, `["yellow",
   // "green"]` when the key is "color".
   //
-  // Empty string is not allowed. Otherwise, an INVALID_ARGUMENT error is
+  // Empty string is not allowed. Otherwise, an `INVALID_ARGUMENT` error is
   // returned.
   //
   // Exactly one of
-  // [text][google.cloud.discoveryengine.v1beta.CustomAttribute.text] or
-  // [numbers][google.cloud.discoveryengine.v1beta.CustomAttribute.numbers]
-  // should be set. Otherwise, an INVALID_ARGUMENT error is returned.
+  // [CustomAttribute.text][google.cloud.discoveryengine.v1beta.CustomAttribute.text]
+  // or
+  // [CustomAttribute.numbers][google.cloud.discoveryengine.v1beta.CustomAttribute.numbers]
+  // should be set. Otherwise, an `INVALID_ARGUMENT` error is returned.
   repeated string text = 1;
 
   // The numerical values of this custom attribute. For example, `[2.3, 15.4]`
   // when the key is "lengths_cm".
   //
   // Exactly one of
-  // [text][google.cloud.discoveryengine.v1beta.CustomAttribute.text] or
-  // [numbers][google.cloud.discoveryengine.v1beta.CustomAttribute.numbers]
-  // should be set. Otherwise, an INVALID_ARGUMENT error is returned.
+  // [CustomAttribute.text][google.cloud.discoveryengine.v1beta.CustomAttribute.text]
+  // or
+  // [CustomAttribute.numbers][google.cloud.discoveryengine.v1beta.CustomAttribute.numbers]
+  // should be set. Otherwise, an `INVALID_ARGUMENT` error is returned.
   repeated double numbers = 2;
 }
 
@@ -79,14 +110,14 @@ message UserInfo {
   // model quality.
   //
   // The field must be a UTF-8 encoded string with a length limit of 128
-  // characters. Otherwise, an INVALID_ARGUMENT error is returned.
+  // characters. Otherwise, an `INVALID_ARGUMENT` error is returned.
   string user_id = 1;
 
   // User agent as included in the HTTP header. Required for getting
   // [SearchResponse.sponsored_results][].
   //
   // The field must be a UTF-8 encoded string with a length limit of 1,000
-  // characters. Otherwise, an INVALID_ARGUMENT error is returned.
+  // characters. Otherwise, an `INVALID_ARGUMENT` error is returned.
   //
   // This should not be set when using the client side event reporting with
   // GTM or JavaScript tag in

package/build/protos/google/cloud/discoveryengine/v1beta/completion_service.proto

@@ -0,0 +1,116 @@
+// Copyright 2022 Google LLC
+//
+// Licensed under the Apache License, Version 2.0 (the "License");
+// you may not use this file except in compliance with the License.
+// You may obtain a copy of the License at
+//
+//     http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing, software
+// distributed under the License is distributed on an "AS IS" BASIS,
+// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+// See the License for the specific language governing permissions and
+// limitations under the License.
+
+syntax = "proto3";
+
+package google.cloud.discoveryengine.v1beta;
+
+import "google/api/annotations.proto";
+import "google/api/client.proto";
+import "google/api/field_behavior.proto";
+import "google/api/resource.proto";
+
+option csharp_namespace = "Google.Cloud.DiscoveryEngine.V1Beta";
+option go_package = "cloud.google.com/go/discoveryengine/apiv1beta/discoveryenginepb;discoveryenginepb";
+option java_multiple_files = true;
+option java_outer_classname = "CompletionServiceProto";
+option java_package = "com.google.cloud.discoveryengine.v1beta";
+option objc_class_prefix = "DISCOVERYENGINE";
+option php_namespace = "Google\\Cloud\\DiscoveryEngine\\V1beta";
+option ruby_package = "Google::Cloud::DiscoveryEngine::V1beta";
+
+// Service for Auto-Completion.
+service CompletionService {
+  option (google.api.default_host) = "discoveryengine.googleapis.com";
+  option (google.api.oauth_scopes) =
+      "https://www.googleapis.com/auth/cloud-platform";
+
+  // Completes the specified user input with keyword suggestions.
+  rpc CompleteQuery(CompleteQueryRequest) returns (CompleteQueryResponse) {
+    option (google.api.http) = {
+      get: "/v1beta/{data_store=projects/*/locations/*/dataStores/*}:completeQuery"
+      additional_bindings {
+        get: "/v1beta/{data_store=projects/*/locations/*/collections/*/dataStores/*}:completeQuery"
+      }
+    };
+  }
+}
+
+// Request message for
+// [CompletionService.CompleteQuery][google.cloud.discoveryengine.v1beta.CompletionService.CompleteQuery]
+// method.
+message CompleteQueryRequest {
+  // Required. The parent data store resource name for which the completion is
+  // performed, such as
+  // `projects/*/locations/global/collections/default_collection/dataStores/default_data_store`.
+  string data_store = 1 [
+    (google.api.field_behavior) = REQUIRED,
+    (google.api.resource_reference) = {
+      type: "discoveryengine.googleapis.com/DataStore"
+    }
+  ];
+
+  // Required. The typeahead input used to fetch suggestions. Maximum length is
+  // 128 characters.
+  string query = 2 [(google.api.field_behavior) = REQUIRED];
+
+  // Selects data model of query suggestions for serving. Currently supported
+  // values:
+  //
+  // * `document` - Using suggestions generated from user-imported documents.
+  // * `search-history` - Using suggestions generated from the past history of
+  // [SearchService.Search][google.cloud.discoveryengine.v1beta.SearchService.Search]
+  // API calls. Do not use it when there is no traffic for Search API.
+  // * `user-event` - Using suggestions generated from user-imported search
+  // events.
+  //
+  // Default values:
+  //
+  // * `document` is the default model for regular dataStores.
+  // * `search-history` is the default model for
+  // [IndustryVertical.SITE_SEARCH][google.cloud.discoveryengine.v1beta.IndustryVertical.SITE_SEARCH]
+  // dataStores.
+  string query_model = 3;
+
+  // A unique identifier for tracking visitors. For example, this could be
+  // implemented with an HTTP cookie, which should be able to uniquely identify
+  // a visitor on a single device. This unique identifier should not change if
+  // the visitor logs in or out of the website.
+  //
+  // This field should NOT have a fixed value such as `unknown_visitor`.
+  //
+  // This should be the same identifier as
+  // [UserEvent.user_pseudo_id][google.cloud.discoveryengine.v1beta.UserEvent.user_pseudo_id]
+  // and
+  // [SearchRequest.user_pseudo_id][google.cloud.discoveryengine.v1beta.SearchRequest.user_pseudo_id].
+  //
+  // The field must be a UTF-8 encoded string with a length limit of 128
+  // characters. Otherwise, an `INVALID_ARGUMENT` error is returned.
+  string user_pseudo_id = 4;
+}
+
+// Response message for
+// [CompletionService.CompleteQuery][google.cloud.discoveryengine.v1beta.CompletionService.CompleteQuery]
+// method.
+message CompleteQueryResponse {
+  // Suggestions as search queries.
+  message QuerySuggestion {
+    // The suggestion for the query.
+    string suggestion = 1;
+  }
+
+  // Results of the matched query suggestions. The result list is ordered and
+  // the first result is a top suggestion.
+  repeated QuerySuggestion query_suggestions = 1;
+}

package/build/protos/google/cloud/discoveryengine/v1beta/document.proto

@@ -38,17 +38,49 @@ message Document {
     pattern: "projects/{project}/locations/{location}/collections/{collection}/dataStores/{data_store}/branches/{branch}/documents/{document}"
   };
 
+  // Unstructured data linked to this document.
+  message Content {
+    oneof content {
+      // The content represented as a stream of bytes. The maximum length is
+      // 1,000,000 bytes (1 MB / ~0.95 MiB).
+      //
+      // Note: As with all `bytes` fields, this field is represented as pure
+      // binary in Protocol Buffers and base64-encoded string in JSON. For
+      // example, `abc123!?$*&()'-=@~` should be represented as
+      // `YWJjMTIzIT8kKiYoKSctPUB+` in JSON. See
+      // https://developers.google.com/protocol-buffers/docs/proto3#json.
+      bytes raw_bytes = 2;
+
+      // The URI of the content. Only Cloud Storage URIs (e.g.
+      // `gs://bucket-name/path/to/file`) are supported. The maximum file size
+      // is 100 MB.
+      string uri = 3;
+    }
+
+    // The MIME type of the content. Supported types:
+    //
+    // * `application/pdf` (PDF)
+    // * `text/html` (HTML)
+    //
+    // See https://www.iana.org/assignments/media-types/media-types.xhtml.
+    string mime_type = 1;
+  }
+
   // Data representation. One of
   // [struct_data][google.cloud.discoveryengine.v1beta.Document.struct_data] or
   // [json_data][google.cloud.discoveryengine.v1beta.Document.json_data] should
-  // be provided otherwise an INVALID_ARGUMENT error is thrown.
+  // be provided otherwise an `INVALID_ARGUMENT` error is thrown.
   oneof data {
     // The structured JSON data for the document. It should conform to the
-    // registered [schema][] or an INVALID_ARGUMENT error is thrown.
+    // registered
+    // [Schema.schema][google.cloud.discoveryengine.v1beta.Schema.schema] or an
+    // `INVALID_ARGUMENT` error is thrown.
     google.protobuf.Struct struct_data = 4;
 
     // The JSON string representation of the document. It should conform to the
-    // registered [schema][] or an INVALID_ARGUMENT error is thrown.
+    // registered
+    // [Schema.schema][google.cloud.discoveryengine.v1beta.Schema.schema] or an
+    // `INVALID_ARGUMENT` error is thrown.
     string json_data = 5;
   }
 
@@ -69,10 +101,20 @@ message Document {
   // The identifier of the schema located in the same data store.
   string schema_id = 3;
 
+  // The unstructured data linked to this document. Content must be set if this
+  // document is under a
+  // `CONTENT_REQUIRED` data store.
+  Content content = 10;
+
   // The identifier of the parent document. Currently supports at most two level
   // document hierarchy.
   //
   // Id should conform to [RFC-1034](https://tools.ietf.org/html/rfc1034)
   // standard with a length limit of 63 characters.
   string parent_document_id = 7;
+
+  // Output only. This field is OUTPUT_ONLY.
+  // It contains derived data that are not in the original input document.
+  google.protobuf.Struct derived_struct_data = 6
+      [(google.api.field_behavior) = OUTPUT_ONLY];
 }

package/build/protos/google/cloud/discoveryengine/v1beta/document_service.proto

@@ -134,10 +134,10 @@ message GetDocumentRequest {
   //
   // If the caller does not have permission to access the
   // [Document][google.cloud.discoveryengine.v1beta.Document], regardless of
-  // whether or not it exists, a PERMISSION_DENIED error is returned.
+  // whether or not it exists, a `PERMISSION_DENIED` error is returned.
   //
   // If the requested [Document][google.cloud.discoveryengine.v1beta.Document]
-  // does not exist, a NOT_FOUND error is returned.
+  // does not exist, a `NOT_FOUND` error is returned.
   string name = 1 [
     (google.api.field_behavior) = REQUIRED,
     (google.api.resource_reference) = {
@@ -157,7 +157,7 @@ message ListDocumentsRequest {
   //
   // If the caller does not have permission to list [Documents][]s under this
   // branch, regardless of whether or not this branch exists, a
-  // PERMISSION_DENIED error is returned.
+  // `PERMISSION_DENIED` error is returned.
   string parent = 1 [
     (google.api.field_behavior) = REQUIRED,
     (google.api.resource_reference) = {
@@ -169,7 +169,7 @@ message ListDocumentsRequest {
   // to return. If unspecified, defaults to 100. The maximum allowed value is
   // 1000. Values above 1000 will be coerced to 1000.
   //
-  // If this field is negative, an INVALID_ARGUMENT error is returned.
+  // If this field is negative, an `INVALID_ARGUMENT` error is returned.
   int32 page_size = 2;
 
   // A page token
@@ -181,7 +181,7 @@ message ListDocumentsRequest {
   // When paginating, all other parameters provided to
   // [DocumentService.ListDocuments][google.cloud.discoveryengine.v1beta.DocumentService.ListDocuments]
   // must match the call that provided the page token. Otherwise, an
-  // INVALID_ARGUMENT error is returned.
+  // `INVALID_ARGUMENT` error is returned.
   string page_token = 3;
 }
 
@@ -223,16 +223,16 @@ message CreateDocumentRequest {
   //
   // If the caller does not have permission to create the
   // [Document][google.cloud.discoveryengine.v1beta.Document], regardless of
-  // whether or not it exists, a PERMISSION_DENIED error is returned.
+  // whether or not it exists, a `PERMISSION_DENIED` error is returned.
   //
   // This field must be unique among all
   // [Document][google.cloud.discoveryengine.v1beta.Document]s with the same
   // [parent][google.cloud.discoveryengine.v1beta.CreateDocumentRequest.parent].
-  // Otherwise, an ALREADY_EXISTS error is returned.
+  // Otherwise, an `ALREADY_EXISTS` error is returned.
   //
   // This field must conform to [RFC-1034](https://tools.ietf.org/html/rfc1034)
   // standard with a length limit of 63 characters. Otherwise, an
-  // INVALID_ARGUMENT error is returned.
+  // `INVALID_ARGUMENT` error is returned.
   string document_id = 3 [(google.api.field_behavior) = REQUIRED];
 }
 
@@ -244,12 +244,12 @@ message UpdateDocumentRequest {
   //
   // If the caller does not have permission to update the
   // [Document][google.cloud.discoveryengine.v1beta.Document], regardless of
-  // whether or not it exists, a PERMISSION_DENIED error is returned.
+  // whether or not it exists, a `PERMISSION_DENIED` error is returned.
   //
   // If the [Document][google.cloud.discoveryengine.v1beta.Document] to update
   // does not exist and
   // [allow_missing][google.cloud.discoveryengine.v1beta.UpdateDocumentRequest.allow_missing]
-  // is not set, a NOT_FOUND error is returned.
+  // is not set, a `NOT_FOUND` error is returned.
   Document document = 1 [(google.api.field_behavior) = REQUIRED];
 
   // If set to true, and the
@@ -269,10 +269,10 @@ message DeleteDocumentRequest {
   //
   // If the caller does not have permission to delete the
   // [Document][google.cloud.discoveryengine.v1beta.Document], regardless of
-  // whether or not it exists, a PERMISSION_DENIED error is returned.
+  // whether or not it exists, a `PERMISSION_DENIED` error is returned.
   //
   // If the [Document][google.cloud.discoveryengine.v1beta.Document] to delete
-  // does not exist, a NOT_FOUND error is returned.
+  // does not exist, a `NOT_FOUND` error is returned.
   string name = 1 [
     (google.api.field_behavior) = REQUIRED,
     (google.api.resource_reference) = {

package/build/protos/google/cloud/discoveryengine/v1beta/import_config.proto

@@ -38,8 +38,11 @@ message GcsSource {
   // Required. Cloud Storage URIs to input files. URI can be up to
   // 2000 characters long. URIs can match the full object path (for example,
   // `gs://bucket/directory/object.json`) or a pattern matching one or more
-  // files, such as `gs://bucket/directory/*.json`. A request can
-  // contain at most 100 files, and each file can be up to 2 GB.
+  // files, such as `gs://bucket/directory/*.json`.
+  //
+  // A request can contain at most 100 files (or 100,000 files if `data_schema`
+  // is `content`). Each file can be up to 2 GB (or 100 MB if `data_schema` is
+  // `content`).
   repeated string input_uris = 1 [(google.api.field_behavior) = REQUIRED];
 
   // The schema to use when parsing the data from the source.
@@ -51,6 +54,12 @@ message GcsSource {
   // document must
   //   have a valid
   //   [Document.id][google.cloud.discoveryengine.v1beta.Document.id].
+  // * `content`: Unstructured data (e.g. PDF, HTML). Each file matched by
+  //   `input_uris` will become a document, with the ID set to the first 128
+  //   bits of SHA256(URI) encoded as a hex string.
+  // * `custom`: One custom data JSON per row in arbitrary format that conforms
+  //   the defined [Schema][google.cloud.discoveryengine.v1beta.Schema] of the
+  //   data store. This can only be used by the GENERIC Data Store vertical.
   //
   // Supported values for user even imports:
   //
@@ -88,14 +97,23 @@ message BigQuerySource {
 
   // The schema to use when parsing the data from the source.
   //
-  // Supported values for imports:
+  // Supported values for user event imports:
   //
-  // * `user_event` (default): One JSON
-  // [UserEvent][google.cloud.discoveryengine.v1beta.UserEvent] per line.
+  // * `user_event` (default): One
+  // [UserEvent][google.cloud.discoveryengine.v1beta.UserEvent] per row.
   //
-  // * `document` (default): One JSON
-  // [Document][google.cloud.discoveryengine.v1beta.Document] per line. Each
-  // document must have a valid [document.id][].
+  // Supported values for document imports:
+  //
+  // * `document` (default): One
+  // [Document][google.cloud.discoveryengine.v1beta.Document] format per
+  //   row. Each document must have a valid
+  //   [Document.id][google.cloud.discoveryengine.v1beta.Document.id] and one of
+  //   [Document.json_data][google.cloud.discoveryengine.v1beta.Document.json_data]
+  //   or
+  //   [Document.struct_data][google.cloud.discoveryengine.v1beta.Document.struct_data].
+  // * `custom`: One custom data per row in arbitrary format that conforms the
+  //   defined [Schema][google.cloud.discoveryengine.v1beta.Schema] of the data
+  //   store. This can only be used by the GENERIC Data Store vertical.
   string data_schema = 6;
 }
 

package/build/protos/google/cloud/discoveryengine/v1beta/recommendation_service.proto

@@ -55,7 +55,7 @@ service RecommendationService {
 // Request message for Recommend method.
 message RecommendRequest {
   // Required. Full resource name of the format:
-  // projects/*/locations/global/collections/*/dataStores/*/servingConfigs/*
+  // `projects/*/locations/global/collections/*/dataStores/*/servingConfigs/*`
   //
   // Before you can request recommendations from your model, you must create at
   // least one serving config  for it.
@@ -97,8 +97,8 @@ message RecommendRequest {
   //
   // Examples:
   //
-  //  * (filter_tags: ANY("Red", "Blue") OR filter_tags: ANY("Hot", "Cold"))
-  //  * (filter_tags: ANY("Red", "Blue")) AND NOT (filter_tags: ANY("Green"))
+  //  * `(filter_tags: ANY("Red", "Blue") OR filter_tags: ANY("Hot", "Cold"))`
+  //  * `(filter_tags: ANY("Red", "Blue")) AND NOT (filter_tags: ANY("Green"))`
   //
   // If your filter blocks all results, the API will return generic
   // (unfiltered) popular Documents. If you only want results strictly matching
@@ -106,8 +106,9 @@ message RecommendRequest {
   // [RecommendRequest.params][google.cloud.discoveryengine.v1beta.RecommendRequest.params]
   // to receive empty results instead.
   //
-  // Note that the API will never return Documents with storageStatus of
-  // "EXPIRED" or "DELETED" regardless of filter choices.
+  // Note that the API will never return
+  // [Document][google.cloud.discoveryengine.v1beta.Document]s with
+  // `storageStatus` of `EXPIRED` or `DELETED` regardless of filter choices.
   string filter = 4;
 
   // Use validate only mode for this recommendation query. If set to true, a
@@ -122,22 +123,22 @@ message RecommendRequest {
   //
   // * `returnDocument`: Boolean. If set to true, the associated Document
   //    object will be returned in
-  //    [RecommendResponse.results.document][RecommendationResult.document].
+  //    [RecommendResponse.RecommendationResult.document][google.cloud.discoveryengine.v1beta.RecommendResponse.RecommendationResult.document].
   // * `returnScore`: Boolean. If set to true, the recommendation 'score'
   //    corresponding to each returned Document will be set in
-  //    [RecommendResponse.results.metadata][RecommendationResult.metadata]. The
-  //    given 'score' indicates the probability of a Document conversion given
-  //    the user's context and history.
+  //    [RecommendResponse.RecommendationResult.metadata][google.cloud.discoveryengine.v1beta.RecommendResponse.RecommendationResult.metadata].
+  //    The given 'score' indicates the probability of a Document conversion
+  //    given the user's context and history.
   // * `strictFiltering`: Boolean. True by default. If set to false, the service
   //    will return generic (unfiltered) popular Documents instead of empty if
   //    your filter blocks all recommendation results.
   // * `diversityLevel`: String. Default empty. If set to be non-empty, then
   //    it needs to be one of:
-  //    *  'no-diversity'
-  //    *  'low-diversity'
-  //    *  'medium-diversity'
-  //    *  'high-diversity'
-  //    *  'auto-diversity'
+  //     *  `no-diversity`
+  //     *  `low-diversity`
+  //     *  `medium-diversity`
+  //     *  `high-diversity`
+  //     *  `auto-diversity`
   //    This gives request-level control and adjusts recommendation results
   //    based on Document category.
   map<string, google.protobuf.Value> params = 6;

package/build/protos/google/cloud/discoveryengine/v1beta/schema.proto

@@ -0,0 +1,58 @@
+// Copyright 2022 Google LLC
+//
+// Licensed under the Apache License, Version 2.0 (the "License");
+// you may not use this file except in compliance with the License.
+// You may obtain a copy of the License at
+//
+//     http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing, software
+// distributed under the License is distributed on an "AS IS" BASIS,
+// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+// See the License for the specific language governing permissions and
+// limitations under the License.
+
+syntax = "proto3";
+
+package google.cloud.discoveryengine.v1beta;
+
+import "google/api/field_behavior.proto";
+import "google/api/resource.proto";
+import "google/protobuf/struct.proto";
+
+option csharp_namespace = "Google.Cloud.DiscoveryEngine.V1Beta";
+option go_package = "cloud.google.com/go/discoveryengine/apiv1beta/discoveryenginepb;discoveryenginepb";
+option java_multiple_files = true;
+option java_outer_classname = "SchemaProto";
+option java_package = "com.google.cloud.discoveryengine.v1beta";
+option objc_class_prefix = "DISCOVERYENGINE";
+option php_namespace = "Google\\Cloud\\DiscoveryEngine\\V1beta";
+option ruby_package = "Google::Cloud::DiscoveryEngine::V1beta";
+
+// Defines the structure and layout of a type of document data.
+message Schema {
+  option (google.api.resource) = {
+    type: "discoveryengine.googleapis.com/Schema"
+    pattern: "projects/{project}/locations/{location}/dataStores/{data_store}/schemas/{schema}"
+    pattern: "projects/{project}/locations/{location}/collections/{collection}/dataStores/{data_store}/schemas/{schema}"
+  };
+
+  // Schema representation. One of
+  // [struct_schema][google.cloud.discoveryengine.v1beta.Schema.struct_schema]
+  // or [json_schema][google.cloud.discoveryengine.v1beta.Schema.json_schema]
+  // should be provided otherwise an INVALID_ARGUMENT error is thrown.
+  oneof schema {
+    // The structured representation of the schema.
+    google.protobuf.Struct struct_schema = 2;
+
+    // The JSON representation of the schema.
+    string json_schema = 3;
+  }
+
+  // Immutable. The full resource name of the schema, in the format of
+  // `projects/{project}/locations/{location}/collections/{collection}/dataStores/{data_store}/schemas/{schema}`.
+  //
+  // This field must be a UTF-8 encoded string with a length limit of 1024
+  // characters.
+  string name = 1 [(google.api.field_behavior) = IMMUTABLE];
+}