@google-cloud/discoveryengine 1.12.0 → 1.13.0

package/CHANGELOG.md

@@ -1,5 +1,12 @@
 # Changelog
 
+## [1.13.0](https://github.com/googleapis/google-cloud-node/compare/discoveryengine-v1.12.0...discoveryengine-v1.13.0) (2024-08-19)
+
+
+### Features
+
+* [discoveryengine] support natural language understanding in search ([#5596](https://github.com/googleapis/google-cloud-node/issues/5596)) ([5cf8d9e](https://github.com/googleapis/google-cloud-node/commit/5cf8d9e6be7c9f95910185062817379a2e29ffdc))
+
 ## [1.12.0](https://github.com/googleapis/google-cloud-node/compare/discoveryengine-v1.11.0...discoveryengine-v1.12.0) (2024-08-09)
 
 

package/README.md

@@ -195,7 +195,9 @@ Samples are in the [`samples/`](https://github.com/googleapis/google-cloud-node/
 | Chunk_service.get_chunk | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1alpha/chunk_service.get_chunk.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1alpha/chunk_service.get_chunk.js,packages/google-cloud-discoveryengine/samples/README.md) |
 | Chunk_service.list_chunks | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1alpha/chunk_service.list_chunks.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1alpha/chunk_service.list_chunks.js,packages/google-cloud-discoveryengine/samples/README.md) |
 | Completion_service.complete_query | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1alpha/completion_service.complete_query.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1alpha/completion_service.complete_query.js,packages/google-cloud-discoveryengine/samples/README.md) |
+| Completion_service.import_completion_suggestions | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1alpha/completion_service.import_completion_suggestions.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1alpha/completion_service.import_completion_suggestions.js,packages/google-cloud-discoveryengine/samples/README.md) |
 | Completion_service.import_suggestion_deny_list_entries | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1alpha/completion_service.import_suggestion_deny_list_entries.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1alpha/completion_service.import_suggestion_deny_list_entries.js,packages/google-cloud-discoveryengine/samples/README.md) |
+| Completion_service.purge_completion_suggestions | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1alpha/completion_service.purge_completion_suggestions.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1alpha/completion_service.purge_completion_suggestions.js,packages/google-cloud-discoveryengine/samples/README.md) |
 | Completion_service.purge_suggestion_deny_list_entries | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1alpha/completion_service.purge_suggestion_deny_list_entries.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1alpha/completion_service.purge_suggestion_deny_list_entries.js,packages/google-cloud-discoveryengine/samples/README.md) |
 | Control_service.create_control | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1alpha/control_service.create_control.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1alpha/control_service.create_control.js,packages/google-cloud-discoveryengine/samples/README.md) |
 | Control_service.delete_control | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1alpha/control_service.delete_control.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1alpha/control_service.delete_control.js,packages/google-cloud-discoveryengine/samples/README.md) |
@@ -280,8 +282,10 @@ Samples are in the [`samples/`](https://github.com/googleapis/google-cloud-node/
 | Site_search_engine_service.fetch_domain_verification_status | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1alpha/site_search_engine_service.fetch_domain_verification_status.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1alpha/site_search_engine_service.fetch_domain_verification_status.js,packages/google-cloud-discoveryengine/samples/README.md) |
 | Site_search_engine_service.get_site_search_engine | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1alpha/site_search_engine_service.get_site_search_engine.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1alpha/site_search_engine_service.get_site_search_engine.js,packages/google-cloud-discoveryengine/samples/README.md) |
 | Site_search_engine_service.get_target_site | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1alpha/site_search_engine_service.get_target_site.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1alpha/site_search_engine_service.get_target_site.js,packages/google-cloud-discoveryengine/samples/README.md) |
+| Site_search_engine_service.get_uri_pattern_document_data | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1alpha/site_search_engine_service.get_uri_pattern_document_data.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1alpha/site_search_engine_service.get_uri_pattern_document_data.js,packages/google-cloud-discoveryengine/samples/README.md) |
 | Site_search_engine_service.list_target_sites | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1alpha/site_search_engine_service.list_target_sites.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1alpha/site_search_engine_service.list_target_sites.js,packages/google-cloud-discoveryengine/samples/README.md) |
 | Site_search_engine_service.recrawl_uris | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1alpha/site_search_engine_service.recrawl_uris.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1alpha/site_search_engine_service.recrawl_uris.js,packages/google-cloud-discoveryengine/samples/README.md) |
+| Site_search_engine_service.set_uri_pattern_document_data | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1alpha/site_search_engine_service.set_uri_pattern_document_data.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1alpha/site_search_engine_service.set_uri_pattern_document_data.js,packages/google-cloud-discoveryengine/samples/README.md) |
 | Site_search_engine_service.update_target_site | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1alpha/site_search_engine_service.update_target_site.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1alpha/site_search_engine_service.update_target_site.js,packages/google-cloud-discoveryengine/samples/README.md) |
 | User_event_service.collect_user_event | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1alpha/user_event_service.collect_user_event.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1alpha/user_event_service.collect_user_event.js,packages/google-cloud-discoveryengine/samples/README.md) |
 | User_event_service.import_user_events | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samples/generated/v1alpha/user_event_service.import_user_events.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-discoveryengine/samples/generated/v1alpha/user_event_service.import_user_events.js,packages/google-cloud-discoveryengine/samples/README.md) |

package/build/protos/google/cloud/discoveryengine/v1alpha/answer.proto

@@ -69,6 +69,13 @@ message Answer {
 
         // Page identifier.
         string page_identifier = 2;
+
+        // The relevance of the chunk for a given query. Values range from 0.0
+        // (completely irrelevant) to 1.0 (completely relevant).
+        // This value is for informational purpose only. It may change for
+        // the same query and chunk at any time due to a model retraining or
+        // change in implementation.
+        optional float relevance_score = 3;
       }
 
       // Document resource name.
@@ -121,13 +128,28 @@ message Answer {
       // Chunk textual content.
       string content = 2;
 
-      // Relevance score.
+      // The relevance of the chunk for a given query. Values range from 0.0
+      // (completely irrelevant) to 1.0 (completely relevant).
+      // This value is for informational purpose only. It may change for
+      // the same query and chunk at any time due to a model retraining or
+      // change in implementation.
       optional float relevance_score = 3;
 
       // Document metadata.
       DocumentMetadata document_metadata = 4;
     }
 
+    // Structured search information.
+    message StructuredDocumentInfo {
+      // Document resource name.
+      string document = 1 [(google.api.resource_reference) = {
+        type: "discoveryengine.googleapis.com/Document"
+      }];
+
+      // Structured search data.
+      google.protobuf.Struct struct_data = 2;
+    }
+
     // Search result content.
     oneof content {
       // Unstructured document information.
@@ -135,6 +157,9 @@ message Answer {
 
       // Chunk information.
       ChunkInfo chunk_info = 2;
+
+      // Structured document information.
+      StructuredDocumentInfo structured_document_info = 3;
     }
   }
 
@@ -168,7 +193,11 @@ message Answer {
             // Chunk textual content.
             string content = 2;
 
-            // Relevance score.
+            // The relevance of the chunk for a given query. Values range from
+            // 0.0 (completely irrelevant) to 1.0 (completely relevant).
+            // This value is for informational purpose only. It may change for
+            // the same query and chunk at any time due to a model retraining or
+            // change in implementation.
             optional float relevance_score = 3;
           }
 
@@ -188,6 +217,14 @@ message Answer {
           // If citation_type is CHUNK_LEVEL_CITATION and chunk mode is on,
           // populate chunk info.
           repeated ChunkInfo chunk_info = 5;
+
+          // Data representation.
+          // The structured JSON data for the document.
+          // It's populated from the struct data from the Document
+          // , or the Chunk in
+          // search result
+          // .
+          google.protobuf.Struct struct_data = 6;
         }
 
         // Search results observed by the search action, it can be snippets info
@@ -247,6 +284,9 @@ message Answer {
 
         // Non-answer-seeking query classification type.
         NON_ANSWER_SEEKING_QUERY = 2;
+
+        // Jail-breaking query classification type.
+        JAIL_BREAKING_QUERY = 3;
       }
 
       // Query classification type.
@@ -296,6 +336,19 @@ message Answer {
     // Google skips the answer if there is a potential policy violation
     // detected. This includes content that may be violent or toxic.
     POTENTIAL_POLICY_VIOLATION = 4;
+
+    // The no relevant content case.
+    //
+    // Google skips the answer if there is no relevant content in the
+    // retrieved search results.
+    NO_RELEVANT_CONTENT = 5;
+
+    // The jail-breaking query ignored case.
+    //
+    // For example, "Reply in the tone of a competing company's CEO".
+    // Google skips the answer if the query is classified as a jail-breaking
+    // query.
+    JAIL_BREAKING_QUERY_IGNORED = 6;
   }
 
   // Immutable. Fully qualified name

package/build/protos/google/cloud/discoveryengine/v1alpha/chunk.proto

@@ -96,7 +96,7 @@ message Chunk {
   // Content is a string from a document (parsed content).
   string content = 3;
 
-  // The relevance score based on similarity.
+  // Output only. Represents the relevance score based on similarity.
   // Higher score indicates higher chunk relevance.
   // The score is in range [-1.0, 1.0].
   // Only populated on [SearchService.SearchResponse][].

package/build/protos/google/cloud/discoveryengine/v1alpha/completion.proto

@@ -50,3 +50,34 @@ message SuggestionDenyListEntry {
   // exact phrase, or block any suggestions containing this phrase.
   MatchOperator match_operator = 2 [(google.api.field_behavior) = REQUIRED];
 }
+
+// Autocomplete suggestions that are imported from Customer.
+message CompletionSuggestion {
+  // Ranking metrics of this suggestion.
+  oneof ranking_info {
+    // Global score of this suggestion. Control how this suggestion would be
+    // scored / ranked.
+    double global_score = 2;
+
+    // Frequency of this suggestion. Will be used to rank suggestions when score
+    // is not available.
+    int64 frequency = 3;
+  }
+
+  // Required. The suggestion text.
+  string suggestion = 1 [(google.api.field_behavior) = REQUIRED];
+
+  // BCP-47 language code of this suggestion.
+  string language_code = 4;
+
+  // If two suggestions have the same groupId, they will not be
+  // returned together. Instead the one ranked higher will be returned. This can
+  // be used to deduplicate semantically identical suggestions.
+  string group_id = 5;
+
+  // The score of this suggestion within its group.
+  double group_score = 6;
+
+  // Alternative matching phrases for this suggestion.
+  repeated string alternative_phrases = 7;
+}

package/build/protos/google/cloud/discoveryengine/v1alpha/completion_service.proto

@@ -86,6 +86,44 @@ service CompletionService {
       metadata_type: "google.cloud.discoveryengine.v1alpha.PurgeSuggestionDenyListEntriesMetadata"
     };
   }
+
+  // Imports
+  // [CompletionSuggestion][google.cloud.discoveryengine.v1alpha.CompletionSuggestion]s
+  // for a DataStore.
+  rpc ImportCompletionSuggestions(ImportCompletionSuggestionsRequest)
+      returns (google.longrunning.Operation) {
+    option (google.api.http) = {
+      post: "/v1alpha/{parent=projects/*/locations/*/collections/*/dataStores/*}/completionSuggestions:import"
+      body: "*"
+      additional_bindings {
+        post: "/v1alpha/{parent=projects/*/locations/*/dataStores/*}/completionSuggestions:import"
+        body: "*"
+      }
+    };
+    option (google.longrunning.operation_info) = {
+      response_type: "google.cloud.discoveryengine.v1alpha.ImportCompletionSuggestionsResponse"
+      metadata_type: "google.cloud.discoveryengine.v1alpha.ImportCompletionSuggestionsMetadata"
+    };
+  }
+
+  // Permanently deletes all
+  // [CompletionSuggestion][google.cloud.discoveryengine.v1alpha.CompletionSuggestion]s
+  // for a DataStore.
+  rpc PurgeCompletionSuggestions(PurgeCompletionSuggestionsRequest)
+      returns (google.longrunning.Operation) {
+    option (google.api.http) = {
+      post: "/v1alpha/{parent=projects/*/locations/*/collections/*/dataStores/*}/completionSuggestions:purge"
+      body: "*"
+      additional_bindings {
+        post: "/v1alpha/{parent=projects/*/locations/*/dataStores/*}/completionSuggestions:purge"
+        body: "*"
+      }
+    };
+    option (google.longrunning.operation_info) = {
+      response_type: "google.cloud.discoveryengine.v1alpha.PurgeCompletionSuggestionsResponse"
+      metadata_type: "google.cloud.discoveryengine.v1alpha.PurgeCompletionSuggestionsMetadata"
+    };
+  }
 }
 
 // Request message for

package/build/protos/google/cloud/discoveryengine/v1alpha/conversational_search_service.proto

@@ -589,12 +589,7 @@ message AnswerQueryRequest {
       string order_by = 4;
 
       // Specifies the search result mode. If unspecified, the
-      // search result mode is based on
-      // [DataStore.DocumentProcessingConfig.chunking_config][]:
-      // * If [DataStore.DocumentProcessingConfig.chunking_config][] is
-      // specified,
-      //   it defaults to `CHUNKS`.
-      // * Otherwise, it defaults to `DOCUMENTS`.
+      // search result mode defaults to `DOCUMENTS`.
       // See [parse and chunk
       // documents](https://cloud.google.com/generative-ai-app-builder/docs/parse-chunk-documents)
       SearchRequest.ContentSearchSpec.SearchResultMode search_result_mode = 5;
@@ -715,6 +710,9 @@ message AnswerQueryRequest {
 
         // Non-answer-seeking query classification type.
         NON_ANSWER_SEEKING_QUERY = 2;
+
+        // Jail-breaking query classification type.
+        JAIL_BREAKING_QUERY = 3;
       }
 
       // Enabled query classification types.
@@ -801,6 +799,25 @@ message AnswerQueryRequest {
   // The field must be a UTF-8 encoded string with a length limit of 128
   // characters. Otherwise, an  `INVALID_ARGUMENT`  error is returned.
   string user_pseudo_id = 12;
+
+  // The user labels applied to a resource must meet the following requirements:
+  //
+  // * Each resource can have multiple labels, up to a maximum of 64.
+  // * Each label must be a key-value pair.
+  // * Keys have a minimum length of 1 character and a maximum length of 63
+  //   characters and cannot be empty. Values can be empty and have a maximum
+  //   length of 63 characters.
+  // * Keys and values can contain only lowercase letters, numeric characters,
+  //   underscores, and dashes. All characters must use UTF-8 encoding, and
+  //   international characters are allowed.
+  // * The key portion of a label must be unique. However, you can use the same
+  //   key with multiple resources.
+  // * Keys must start with a lowercase letter or international character.
+  //
+  // See [Google Cloud
+  // Document](https://cloud.google.com/resource-manager/docs/creating-managing-labels#requirements)
+  // for more details.
+  map<string, string> user_labels = 13;
 }
 
 // Response message for
@@ -808,9 +825,11 @@ message AnswerQueryRequest {
 // method.
 message AnswerQueryResponse {
   // Answer resource object.
-  // If [AnswerQueryRequest.StepSpec.max_step_count][] is greater than 1,
-  // use [Answer.name][google.cloud.discoveryengine.v1alpha.Answer.name] to
-  // fetch answer information using
+  // If
+  // [AnswerQueryRequest.QueryUnderstandingSpec.QueryRephraserSpec.max_rephrase_steps][google.cloud.discoveryengine.v1alpha.AnswerQueryRequest.QueryUnderstandingSpec.QueryRephraserSpec.max_rephrase_steps]
+  // is greater than 1, use
+  // [Answer.name][google.cloud.discoveryengine.v1alpha.Answer.name] to fetch
+  // answer information using
   // [ConversationalSearchService.GetAnswer][google.cloud.discoveryengine.v1alpha.ConversationalSearchService.GetAnswer]
   // API.
   Answer answer = 1;

package/build/protos/google/cloud/discoveryengine/v1alpha/custom_tuning_model.proto

@@ -56,6 +56,9 @@ message CustomTuningModel {
 
     // The model training failed.
     TRAINING_FAILED = 5;
+
+    // The model training finished successfully but metrics did not improve.
+    NO_IMPROVEMENT = 6;
   }
 
   // Required. The fully qualified resource name of the model.
@@ -80,8 +83,11 @@ message CustomTuningModel {
   ModelState model_state = 4;
 
   // Timestamp the Model was created at.
-  google.protobuf.Timestamp create_time = 5;
+  google.protobuf.Timestamp create_time = 5 [deprecated = true];
 
   // Timestamp the model training was initiated.
   google.protobuf.Timestamp training_start_time = 6;
+
+  // The metrics of the trained model.
+  map<string, double> metrics = 7;
 }

package/build/protos/google/cloud/discoveryengine/v1alpha/data_store.proto

@@ -98,6 +98,9 @@ message DataStore {
   google.protobuf.Timestamp create_time = 4
       [(google.api.field_behavior) = OUTPUT_ONLY];
 
+  // Language info for DataStore.
+  LanguageInfo language_info = 14;
+
   // Output only. Data store level identity provider config.
   IdpConfig idp_config = 21 [(google.api.field_behavior) = OUTPUT_ONLY];
 
@@ -140,3 +143,23 @@ message DataStore {
   // doc](https://cloud.google.com/generative-ai-app-builder/docs/provide-schema).
   Schema starting_schema = 28;
 }
+
+// Language info for DataStore.
+message LanguageInfo {
+  // The language code for the DataStore.
+  string language_code = 1;
+
+  // Output only. This is the normalized form of language_code.
+  // E.g.: language_code of `en-GB`, `en_GB`, `en-UK` or `en-gb`
+  // will have normalized_language_code of `en-GB`.
+  string normalized_language_code = 2
+      [(google.api.field_behavior) = OUTPUT_ONLY];
+
+  // Output only. Language part of normalized_language_code.
+  // E.g.: `en-US` -> `en`, `zh-Hans-HK` -> `zh`, `en` -> `en`.
+  string language = 3 [(google.api.field_behavior) = OUTPUT_ONLY];
+
+  // Output only. Region part of normalized_language_code, if present.
+  // E.g.: `en-US` -> `US`, `zh-Hans-HK` -> `HK`, `en` -> ``.
+  string region = 4 [(google.api.field_behavior) = OUTPUT_ONLY];
+}

package/build/protos/google/cloud/discoveryengine/v1alpha/data_store_service.proto

@@ -189,6 +189,16 @@ message CreateDataStoreRequest {
   // search (GENERIC vertical and PUBLIC_WEBSITE content_config), this flag will
   // be ignored.
   bool create_advanced_site_search = 4;
+
+  // A boolean flag indicating whether to skip the default schema creation for
+  // the data store. Only enable this flag if you are certain that the default
+  // schema is incompatible with your use case.
+  //
+  // If set to true, you must manually create a schema for the data store before
+  // any documents can be ingested.
+  //
+  // This flag cannot be specified if `data_store.starting_schema` is specified.
+  bool skip_default_schema_creation = 7;
 }
 
 // Request message for
@@ -265,7 +275,7 @@ message ListDataStoresRequest {
   // INVALID_ARGUMENT error is returned.
   string page_token = 3;
 
-  // Filter by solution type.
+  // Filter by solution type .
   // For example: `filter = 'solution_type:SOLUTION_TYPE_SEARCH'`
   string filter = 4;
 }

package/build/protos/google/cloud/discoveryengine/v1alpha/document.proto

@@ -55,7 +55,7 @@ message Document {
 
       // The URI of the content. Only Cloud Storage URIs (e.g.
       // `gs://bucket-name/path/to/file`) are supported. The maximum file size
-      // is 2.5 MB for text-based formats, 100 MB for other formats.
+      // is 2.5 MB for text-based formats, 200 MB for other formats.
       string uri = 3;
     }
 
@@ -135,6 +135,9 @@ message Document {
     message AccessRestriction {
       // List of principals.
       repeated Principal principals = 1;
+
+      // All users within the Identity Provider.
+      bool idp_wide = 2;
     }
 
     // Readers of the document.

package/build/protos/google/cloud/discoveryengine/v1alpha/document_processing_config.proto

@@ -118,8 +118,12 @@ message DocumentProcessingConfig {
   // * `pdf`: Override parsing config for PDF files, either digital parsing, ocr
   // parsing or layout parsing is supported.
   // * `html`: Override parsing config for HTML files, only digital parsing and
-  // or layout parsing are supported.
+  // layout parsing are supported.
   // * `docx`: Override parsing config for DOCX files, only digital parsing and
-  // or layout parsing are supported.
+  // layout parsing are supported.
+  // * `pptx`: Override parsing config for PPTX files, only digital parsing and
+  // layout parsing are supported.
+  // * `xlsx`: Override parsing config for XLSX files, only digital parsing and
+  // layout parsing are supported.
   map<string, ParsingConfig> parsing_config_overrides = 5;
 }

package/build/protos/google/cloud/discoveryengine/v1alpha/document_service.proto

@@ -351,7 +351,7 @@ message GetProcessedDocumentRequest {
     // Only available if ChunkingConfig is enabled on the data store.
     CHUNKED_DOCUMENT = 2;
 
-    // Returns the converted PNG Image bytes if available.
+    // Returns the converted Image bytes (as JPEG or PNG) if available.
     PNG_CONVERTED_DOCUMENT = 3;
   }
 

package/build/protos/google/cloud/discoveryengine/v1alpha/import_config.proto

@@ -293,6 +293,12 @@ message FhirStoreSource {
   // limit of 2,000 characters. Can be specified if one wants to have the
   // FhirStore export to a specific Cloud Storage directory.
   string gcs_staging_dir = 2;
+
+  // The FHIR resource types to import. The resource types should be a subset of
+  // all [supported FHIR resource
+  // types](https://cloud.google.com/generative-ai-app-builder/docs/fhir-schema-reference#resource-level-specification).
+  // Default to all supported FHIR resource types if empty.
+  repeated string resource_types = 3;
 }
 
 // Cloud SQL source import data from.
@@ -328,6 +334,38 @@ message CloudSqlSource {
   bool offload = 6;
 }
 
+// AlloyDB source import data from.
+message AlloyDbSource {
+  // The project ID that the AlloyDB source is in
+  // with a length limit of 128 characters. If not specified, inherits the
+  // project ID from the parent request.
+  string project_id = 1;
+
+  // Required. The AlloyDB location to copy the data from with a length limit of
+  // 256 characters.
+  string location_id = 2 [(google.api.field_behavior) = REQUIRED];
+
+  // Required. The AlloyDB cluster to copy the data from with a length limit of
+  // 256 characters.
+  string cluster_id = 3 [(google.api.field_behavior) = REQUIRED];
+
+  // Required. The AlloyDB database to copy the data from with a length limit of
+  // 256 characters.
+  string database_id = 4 [(google.api.field_behavior) = REQUIRED];
+
+  // Required. The AlloyDB table to copy the data from with a length limit of
+  // 256 characters.
+  string table_id = 5 [(google.api.field_behavior) = REQUIRED];
+
+  // Intermediate Cloud Storage directory used for the import with a length
+  // limit of 2,000 characters. Can be specified if one wants to have the
+  // AlloyDB export to a specific Cloud Storage directory.
+  //
+  // Ensure that the AlloyDB service account has the necessary Cloud
+  // Storage Admin permissions to access the specified Cloud Storage directory.
+  string gcs_staging_dir = 6;
+}
+
 // Firestore source import data from.
 message FirestoreSource {
   // The project ID that the Cloud SQL source is in with a length limit of 128
@@ -501,6 +539,9 @@ message ImportDocumentsRequest {
     // Firestore input source.
     FirestoreSource firestore_source = 13;
 
+    // AlloyDB input source.
+    AlloyDbSource alloy_db_source = 14;
+
     // Cloud Bigtable input source.
     BigtableSource bigtable_source = 15;
   }
@@ -666,6 +707,79 @@ message ImportSuggestionDenyListEntriesMetadata {
   google.protobuf.Timestamp update_time = 2;
 }
 
+// Request message for
+// [CompletionService.ImportCompletionSuggestions][google.cloud.discoveryengine.v1alpha.CompletionService.ImportCompletionSuggestions]
+// method.
+message ImportCompletionSuggestionsRequest {
+  // The inline source for CompletionSuggestions.
+  message InlineSource {
+    // Required. A list of all denylist entries to import. Max of 1000 items.
+    repeated CompletionSuggestion suggestions = 1
+        [(google.api.field_behavior) = REQUIRED];
+  }
+
+  // The source of the autocomplete suggestions.
+  oneof source {
+    // The Inline source for suggestion entries.
+    InlineSource inline_source = 2;
+
+    // Cloud Storage location for the input content.
+    GcsSource gcs_source = 3;
+
+    // BigQuery input source.
+    BigQuerySource bigquery_source = 4;
+  }
+
+  // Required. The parent data store resource name for which to import customer
+  // autocomplete suggestions.
+  //
+  // Follows pattern `projects/*/locations/*/collections/*/dataStores/*`
+  string parent = 1 [
+    (google.api.field_behavior) = REQUIRED,
+    (google.api.resource_reference) = {
+      type: "discoveryengine.googleapis.com/DataStore"
+    }
+  ];
+
+  // The desired location of errors incurred during the Import.
+  ImportErrorConfig error_config = 5;
+}
+
+// Response of the
+// [CompletionService.ImportCompletionSuggestions][google.cloud.discoveryengine.v1alpha.CompletionService.ImportCompletionSuggestions]
+// method. If the long running operation is done, this message is returned by
+// the google.longrunning.Operations.response field if the operation is
+// successful.
+message ImportCompletionSuggestionsResponse {
+  // A sample of errors encountered while processing the request.
+  repeated google.rpc.Status error_samples = 1;
+
+  // The desired location of errors incurred during the Import.
+  ImportErrorConfig error_config = 2;
+}
+
+// Metadata related to the progress of the ImportCompletionSuggestions
+// operation. This will be returned by the google.longrunning.Operation.metadata
+// field.
+message ImportCompletionSuggestionsMetadata {
+  // Operation create time.
+  google.protobuf.Timestamp create_time = 1;
+
+  // Operation last update time. If the operation is done, this is also the
+  // finish time.
+  google.protobuf.Timestamp update_time = 2;
+
+  // Count of
+  // [CompletionSuggestion][google.cloud.discoveryengine.v1alpha.CompletionSuggestion]s
+  // successfully imported.
+  int64 success_count = 3;
+
+  // Count of
+  // [CompletionSuggestion][google.cloud.discoveryengine.v1alpha.CompletionSuggestion]s
+  // that failed to be imported.
+  int64 failure_count = 4;
+}
+
 // Request message for
 // [SampleQueryService.ImportSampleQueries][google.cloud.discoveryengine.v1alpha.SampleQueryService.ImportSampleQueries]
 // method.