orq-ai-sdk 4.3.0rc13__tar.gz → 4.3.0rc15__tar.gz

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: orq-ai-sdk
-Version: 4.3.0rc13
+Version: 4.3.0rc15
 Summary: Python Client SDK for the Orq API.
 Author: Orq
 Project-URL: repository, https://github.com/orq-ai/orq-python.git
@@ -663,7 +663,7 @@ with Orq(
 **Primary error:**
 * [`OrqError`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/orqerror.py): The base class for HTTP error responses.
 
-<details><summary>Less common errors (35)</summary>
+<details><summary>Less common errors (36)</summary>
 
 <br />
 
@@ -675,12 +675,13 @@ with Orq(
 
 **Inherit from [`OrqError`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/orqerror.py)**:
 * [`HonoAPIError`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/honoapierror.py): Applicable to 9 of 115 methods.*
+* [`InvokeEvalEvalsResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/invokeevalevalsresponsebody.py): Bad request. Status code `400`. Applicable to 1 of 115 methods.*
 * [`GenerateConversationNameConversationsResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/generateconversationnameconversationsresponsebody.py): Conversation already has a display name. This endpoint only generates names for conversations with empty display names. Status code `400`. Applicable to 1 of 115 methods.*
 * [`GetEvalsEvalsResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/getevalsevalsresponsebody.py): Workspace ID is not found on the request. Status code `404`. Applicable to 1 of 115 methods.*
 * [`CreateEvalEvalsResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/createevalevalsresponsebody.py): Workspace ID is not found on the request. Status code `404`. Applicable to 1 of 115 methods.*
 * [`UpdateEvalEvalsResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/updateevalevalsresponsebody.py): Workspace ID is not found on the request. Status code `404`. Applicable to 1 of 115 methods.*
 * [`DeleteEvalResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/deleteevalresponsebody.py): Workspace ID is not found on the request. Status code `404`. Applicable to 1 of 115 methods.*
-* [`InvokeEvalEvalsResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/invokeevalevalsresponsebody.py): Workspace ID is not found on the request. Status code `404`. Applicable to 1 of 115 methods.*
+* [`InvokeEvalEvalsResponseResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/invokeevalevalsresponseresponsebody.py): Workspace ID is not found on the request. Status code `404`. Applicable to 1 of 115 methods.*
 * [`GetV2EvaluatorsIDVersionsEvaluatorsResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/getv2evaluatorsidversionsevaluatorsresponsebody.py): Evaluator not found. Status code `404`. Applicable to 1 of 115 methods.*
 * [`RetrieveIdentityIdentitiesResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/retrieveidentityidentitiesresponsebody.py): Identity not found. Status code `404`. Applicable to 1 of 115 methods.*
 * [`UpdateIdentityIdentitiesResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/updateidentityidentitiesresponsebody.py): Identity not found. Status code `404`. Applicable to 1 of 115 methods.*
@@ -703,7 +704,7 @@ with Orq(
 * [`CreateModerationRouterModerationsResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/createmoderationroutermoderationsresponsebody.py): Returns validation error. Status code `422`. Applicable to 1 of 115 methods.*
 * [`CreateTranscriptionRouterAudioTranscriptionsResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/createtranscriptionrouteraudiotranscriptionsresponsebody.py): Returns validation error. Status code `422`. Applicable to 1 of 115 methods.*
 * [`CreateTranslationRouterAudioTranslationsResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/createtranslationrouteraudiotranslationsresponsebody.py): Returns validation error. Status code `422`. Applicable to 1 of 115 methods.*
-* [`InvokeEvalEvalsResponseResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/invokeevalevalsresponseresponsebody.py): Error running the evaluator. Status code `500`. Applicable to 1 of 115 methods.*
+* [`InvokeEvalEvalsResponse500ResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/invokeevalevalsresponse500responsebody.py): Error running the evaluator. Status code `500`. Applicable to 1 of 115 methods.*
 * [`ResponseValidationError`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/responsevalidationerror.py): Type mismatch between the response data and the expected Pydantic model. Provides access to the Pydantic validation error via the `cause` attribute.
 
 </details>

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/README-PYPI.md

@@ -650,7 +650,7 @@ with Orq(
 **Primary error:**
 * [`OrqError`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/orqerror.py): The base class for HTTP error responses.
 
-<details><summary>Less common errors (35)</summary>
+<details><summary>Less common errors (36)</summary>
 
 <br />
 
@@ -662,12 +662,13 @@ with Orq(
 
 **Inherit from [`OrqError`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/orqerror.py)**:
 * [`HonoAPIError`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/honoapierror.py): Applicable to 9 of 115 methods.*
+* [`InvokeEvalEvalsResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/invokeevalevalsresponsebody.py): Bad request. Status code `400`. Applicable to 1 of 115 methods.*
 * [`GenerateConversationNameConversationsResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/generateconversationnameconversationsresponsebody.py): Conversation already has a display name. This endpoint only generates names for conversations with empty display names. Status code `400`. Applicable to 1 of 115 methods.*
 * [`GetEvalsEvalsResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/getevalsevalsresponsebody.py): Workspace ID is not found on the request. Status code `404`. Applicable to 1 of 115 methods.*
 * [`CreateEvalEvalsResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/createevalevalsresponsebody.py): Workspace ID is not found on the request. Status code `404`. Applicable to 1 of 115 methods.*
 * [`UpdateEvalEvalsResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/updateevalevalsresponsebody.py): Workspace ID is not found on the request. Status code `404`. Applicable to 1 of 115 methods.*
 * [`DeleteEvalResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/deleteevalresponsebody.py): Workspace ID is not found on the request. Status code `404`. Applicable to 1 of 115 methods.*
-* [`InvokeEvalEvalsResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/invokeevalevalsresponsebody.py): Workspace ID is not found on the request. Status code `404`. Applicable to 1 of 115 methods.*
+* [`InvokeEvalEvalsResponseResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/invokeevalevalsresponseresponsebody.py): Workspace ID is not found on the request. Status code `404`. Applicable to 1 of 115 methods.*
 * [`GetV2EvaluatorsIDVersionsEvaluatorsResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/getv2evaluatorsidversionsevaluatorsresponsebody.py): Evaluator not found. Status code `404`. Applicable to 1 of 115 methods.*
 * [`RetrieveIdentityIdentitiesResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/retrieveidentityidentitiesresponsebody.py): Identity not found. Status code `404`. Applicable to 1 of 115 methods.*
 * [`UpdateIdentityIdentitiesResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/updateidentityidentitiesresponsebody.py): Identity not found. Status code `404`. Applicable to 1 of 115 methods.*
@@ -690,7 +691,7 @@ with Orq(
 * [`CreateModerationRouterModerationsResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/createmoderationroutermoderationsresponsebody.py): Returns validation error. Status code `422`. Applicable to 1 of 115 methods.*
 * [`CreateTranscriptionRouterAudioTranscriptionsResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/createtranscriptionrouteraudiotranscriptionsresponsebody.py): Returns validation error. Status code `422`. Applicable to 1 of 115 methods.*
 * [`CreateTranslationRouterAudioTranslationsResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/createtranslationrouteraudiotranslationsresponsebody.py): Returns validation error. Status code `422`. Applicable to 1 of 115 methods.*
-* [`InvokeEvalEvalsResponseResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/invokeevalevalsresponseresponsebody.py): Error running the evaluator. Status code `500`. Applicable to 1 of 115 methods.*
+* [`InvokeEvalEvalsResponse500ResponseBody`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/invokeevalevalsresponse500responsebody.py): Error running the evaluator. Status code `500`. Applicable to 1 of 115 methods.*
 * [`ResponseValidationError`](https://github.com/orq-ai/orq-python/blob/master/packages/orq-rc/./src/orq_ai_sdk/models/responsevalidationerror.py): Type mismatch between the response data and the expected Pydantic model. Provides access to the Pydantic validation error via the `cause` attribute.
 
 </details>

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/README.md

@@ -650,7 +650,7 @@ with Orq(
 **Primary error:**
 * [`OrqError`](./src/orq_ai_sdk/models/orqerror.py): The base class for HTTP error responses.
 
-<details><summary>Less common errors (35)</summary>
+<details><summary>Less common errors (36)</summary>
 
 <br />
 
@@ -662,12 +662,13 @@ with Orq(
 
 **Inherit from [`OrqError`](./src/orq_ai_sdk/models/orqerror.py)**:
 * [`HonoAPIError`](./src/orq_ai_sdk/models/honoapierror.py): Applicable to 9 of 115 methods.*
+* [`InvokeEvalEvalsResponseBody`](./src/orq_ai_sdk/models/invokeevalevalsresponsebody.py): Bad request. Status code `400`. Applicable to 1 of 115 methods.*
 * [`GenerateConversationNameConversationsResponseBody`](./src/orq_ai_sdk/models/generateconversationnameconversationsresponsebody.py): Conversation already has a display name. This endpoint only generates names for conversations with empty display names. Status code `400`. Applicable to 1 of 115 methods.*
 * [`GetEvalsEvalsResponseBody`](./src/orq_ai_sdk/models/getevalsevalsresponsebody.py): Workspace ID is not found on the request. Status code `404`. Applicable to 1 of 115 methods.*
 * [`CreateEvalEvalsResponseBody`](./src/orq_ai_sdk/models/createevalevalsresponsebody.py): Workspace ID is not found on the request. Status code `404`. Applicable to 1 of 115 methods.*
 * [`UpdateEvalEvalsResponseBody`](./src/orq_ai_sdk/models/updateevalevalsresponsebody.py): Workspace ID is not found on the request. Status code `404`. Applicable to 1 of 115 methods.*
 * [`DeleteEvalResponseBody`](./src/orq_ai_sdk/models/deleteevalresponsebody.py): Workspace ID is not found on the request. Status code `404`. Applicable to 1 of 115 methods.*
-* [`InvokeEvalEvalsResponseBody`](./src/orq_ai_sdk/models/invokeevalevalsresponsebody.py): Workspace ID is not found on the request. Status code `404`. Applicable to 1 of 115 methods.*
+* [`InvokeEvalEvalsResponseResponseBody`](./src/orq_ai_sdk/models/invokeevalevalsresponseresponsebody.py): Workspace ID is not found on the request. Status code `404`. Applicable to 1 of 115 methods.*
 * [`GetV2EvaluatorsIDVersionsEvaluatorsResponseBody`](./src/orq_ai_sdk/models/getv2evaluatorsidversionsevaluatorsresponsebody.py): Evaluator not found. Status code `404`. Applicable to 1 of 115 methods.*
 * [`RetrieveIdentityIdentitiesResponseBody`](./src/orq_ai_sdk/models/retrieveidentityidentitiesresponsebody.py): Identity not found. Status code `404`. Applicable to 1 of 115 methods.*
 * [`UpdateIdentityIdentitiesResponseBody`](./src/orq_ai_sdk/models/updateidentityidentitiesresponsebody.py): Identity not found. Status code `404`. Applicable to 1 of 115 methods.*
@@ -690,7 +691,7 @@ with Orq(
 * [`CreateModerationRouterModerationsResponseBody`](./src/orq_ai_sdk/models/createmoderationroutermoderationsresponsebody.py): Returns validation error. Status code `422`. Applicable to 1 of 115 methods.*
 * [`CreateTranscriptionRouterAudioTranscriptionsResponseBody`](./src/orq_ai_sdk/models/createtranscriptionrouteraudiotranscriptionsresponsebody.py): Returns validation error. Status code `422`. Applicable to 1 of 115 methods.*
 * [`CreateTranslationRouterAudioTranslationsResponseBody`](./src/orq_ai_sdk/models/createtranslationrouteraudiotranslationsresponsebody.py): Returns validation error. Status code `422`. Applicable to 1 of 115 methods.*
-* [`InvokeEvalEvalsResponseResponseBody`](./src/orq_ai_sdk/models/invokeevalevalsresponseresponsebody.py): Error running the evaluator. Status code `500`. Applicable to 1 of 115 methods.*
+* [`InvokeEvalEvalsResponse500ResponseBody`](./src/orq_ai_sdk/models/invokeevalevalsresponse500responsebody.py): Error running the evaluator. Status code `500`. Applicable to 1 of 115 methods.*
 * [`ResponseValidationError`](./src/orq_ai_sdk/models/responsevalidationerror.py): Type mismatch between the response data and the expected Pydantic model. Provides access to the Pydantic validation error via the `cause` attribute.
 
 </details>

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/pyproject.toml

@@ -1,6 +1,6 @@
 [project]
 name = "orq-ai-sdk"
-version = "4.3.0-rc.13"
+version = "4.3.0-rc.15"
 description = "Python Client SDK for the Orq API."
 authors = [{ name = "Orq" },]
 readme = "README-PYPI.md"

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/src/orq_ai_sdk/_version.py

@@ -3,10 +3,10 @@
 import importlib.metadata
 
 __title__: str = "orq-ai-sdk"
-__version__: str = "4.3.0-rc.13"
+__version__: str = "4.3.0-rc.15"
 __openapi_doc_version__: str = "2.0"
 __gen_version__: str = "2.801.2"
-__user_agent__: str = "speakeasy-sdk/python 4.3.0-rc.13 2.801.2 2.0 orq-ai-sdk"
+__user_agent__: str = "speakeasy-sdk/python 4.3.0-rc.15 2.801.2 2.0 orq-ai-sdk"
 
 try:
     if __package__ is not None:

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/src/orq_ai_sdk/evals.py

@@ -819,6 +819,7 @@ class Evals(BaseSDK):
                 List[models_invokeevalop.InvokeEvalMessagesTypedDict],
             ]
         ] = None,
+        model: Optional[str] = None,
         retries: OptionalNullable[utils.RetryConfig] = UNSET,
         server_url: Optional[str] = None,
         timeout_ms: Optional[int] = None,
@@ -832,6 +833,7 @@ class Evals(BaseSDK):
         :param reference: The reference used to compare the output
         :param retrievals: Knowledge base retrievals
         :param messages: The messages used to generate the output, without the last user message
+        :param model: Model to use for LLM-based evaluators (e.g. \"openai/gpt-4o\")
         :param retries: Override the default retry configuration for this method
         :param server_url: Override the default server URL for this method
         :param timeout_ms: Override the default request timeout configuration for this method in milliseconds
@@ -860,6 +862,7 @@ class Evals(BaseSDK):
                 messages=utils.get_pydantic_model(
                     messages, Optional[List[models.InvokeEvalMessages]]
                 ),
+                model=model,
             ),
         )
 
@@ -906,23 +909,28 @@ class Evals(BaseSDK):
                 ),
             ),
             request=req,
-            error_status_codes=["404", "4XX", "500", "5XX"],
+            error_status_codes=["400", "404", "4XX", "500", "5XX"],
             retry_config=retry_config,
         )
 
         response_data: Any = None
         if utils.match_response(http_res, "200", "application/json"):
             return unmarshal_json_response(models.InvokeEvalResponseBody, http_res)
-        if utils.match_response(http_res, "404", "application/json"):
+        if utils.match_response(http_res, "400", "application/json"):
             response_data = unmarshal_json_response(
                 models.InvokeEvalEvalsResponseBodyData, http_res
             )
             raise models.InvokeEvalEvalsResponseBody(response_data, http_res)
-        if utils.match_response(http_res, "500", "application/json"):
+        if utils.match_response(http_res, "404", "application/json"):
             response_data = unmarshal_json_response(
                 models.InvokeEvalEvalsResponseResponseBodyData, http_res
             )
             raise models.InvokeEvalEvalsResponseResponseBody(response_data, http_res)
+        if utils.match_response(http_res, "500", "application/json"):
+            response_data = unmarshal_json_response(
+                models.InvokeEvalEvalsResponse500ResponseBodyData, http_res
+            )
+            raise models.InvokeEvalEvalsResponse500ResponseBody(response_data, http_res)
         if utils.match_response(http_res, "4XX", "*"):
             http_res_text = utils.stream_to_text(http_res)
             raise models.APIError("API error occurred", http_res, http_res_text)
@@ -946,6 +954,7 @@ class Evals(BaseSDK):
                 List[models_invokeevalop.InvokeEvalMessagesTypedDict],
             ]
         ] = None,
+        model: Optional[str] = None,
         retries: OptionalNullable[utils.RetryConfig] = UNSET,
         server_url: Optional[str] = None,
         timeout_ms: Optional[int] = None,
@@ -959,6 +968,7 @@ class Evals(BaseSDK):
         :param reference: The reference used to compare the output
         :param retrievals: Knowledge base retrievals
         :param messages: The messages used to generate the output, without the last user message
+        :param model: Model to use for LLM-based evaluators (e.g. \"openai/gpt-4o\")
         :param retries: Override the default retry configuration for this method
         :param server_url: Override the default server URL for this method
         :param timeout_ms: Override the default request timeout configuration for this method in milliseconds
@@ -987,6 +997,7 @@ class Evals(BaseSDK):
                 messages=utils.get_pydantic_model(
                     messages, Optional[List[models.InvokeEvalMessages]]
                 ),
+                model=model,
             ),
         )
 
@@ -1033,23 +1044,28 @@ class Evals(BaseSDK):
                 ),
             ),
             request=req,
-            error_status_codes=["404", "4XX", "500", "5XX"],
+            error_status_codes=["400", "404", "4XX", "500", "5XX"],
             retry_config=retry_config,
         )
 
         response_data: Any = None
         if utils.match_response(http_res, "200", "application/json"):
             return unmarshal_json_response(models.InvokeEvalResponseBody, http_res)
-        if utils.match_response(http_res, "404", "application/json"):
+        if utils.match_response(http_res, "400", "application/json"):
             response_data = unmarshal_json_response(
                 models.InvokeEvalEvalsResponseBodyData, http_res
             )
             raise models.InvokeEvalEvalsResponseBody(response_data, http_res)
-        if utils.match_response(http_res, "500", "application/json"):
+        if utils.match_response(http_res, "404", "application/json"):
             response_data = unmarshal_json_response(
                 models.InvokeEvalEvalsResponseResponseBodyData, http_res
             )
             raise models.InvokeEvalEvalsResponseResponseBody(response_data, http_res)
+        if utils.match_response(http_res, "500", "application/json"):
+            response_data = unmarshal_json_response(
+                models.InvokeEvalEvalsResponse500ResponseBodyData, http_res
+            )
+            raise models.InvokeEvalEvalsResponse500ResponseBody(response_data, http_res)
         if utils.match_response(http_res, "4XX", "*"):
             http_res_text = await utils.stream_to_text_async(http_res)
             raise models.APIError("API error occurred", http_res, http_res_text)

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/src/orq_ai_sdk/models/__init__.py

@@ -4611,6 +4611,8 @@ if TYPE_CHECKING:
         InvokeEvalContent2,
         InvokeEvalContent2TypedDict,
         InvokeEvalContentTypedDict,
+        InvokeEvalEvalsResponse500ResponseBody,
+        InvokeEvalEvalsResponse500ResponseBodyData,
         InvokeEvalEvalsResponseBody,
         InvokeEvalEvalsResponseBodyData,
         InvokeEvalEvalsResponseResponseBody,
@@ -11851,6 +11853,8 @@ __all__ = [
     "InvokeEvalContent2",
     "InvokeEvalContent2TypedDict",
     "InvokeEvalContentTypedDict",
+    "InvokeEvalEvalsResponse500ResponseBody",
+    "InvokeEvalEvalsResponse500ResponseBodyData",
     "InvokeEvalEvalsResponseBody",
     "InvokeEvalEvalsResponseBodyData",
     "InvokeEvalEvalsResponseResponseBody",
@@ -19594,6 +19598,8 @@ _dynamic_imports: dict[str, str] = {
     "InvokeEvalContent2": ".invokeevalop",
     "InvokeEvalContent2TypedDict": ".invokeevalop",
     "InvokeEvalContentTypedDict": ".invokeevalop",
+    "InvokeEvalEvalsResponse500ResponseBody": ".invokeevalop",
+    "InvokeEvalEvalsResponse500ResponseBodyData": ".invokeevalop",
     "InvokeEvalEvalsResponseBody": ".invokeevalop",
     "InvokeEvalEvalsResponseBodyData": ".invokeevalop",
     "InvokeEvalEvalsResponseResponseBody": ".invokeevalop",

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/src/orq_ai_sdk/models/conversationresponse.py

@@ -104,7 +104,7 @@ class ConversationResponse(BaseModel):
     r"""Unix timestamp in milliseconds when the conversation was last modified."""
 
     id: Annotated[Optional[str], pydantic.Field(alias="_id")] = (
-        "conv_01kg7c48qrca8be1k0j755anq2"
+        "conv_01kged4vf8640jsh4wy2xp5e4d"
     )
     r"""Unique conversation identifier with `conv_` prefix."""
 

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/src/orq_ai_sdk/models/conversationwithmessagesresponse.py

@@ -110,7 +110,7 @@ class ConversationWithMessagesResponse(BaseModel):
     r"""Conversation messages ordered chronologically (oldest first)."""
 
     id: Annotated[Optional[str], pydantic.Field(alias="_id")] = (
-        "conv_01kg7c48qy5s2e82a37k3r6b2s"
+        "conv_01kged4vfe9mzyp3qp6tdgk4qt"
     )
     r"""Unique conversation identifier with `conv_` prefix."""
 

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/src/orq_ai_sdk/models/createcontactop.py

@@ -132,7 +132,7 @@ class CreateContactResponseBody(BaseModel):
     created: Optional[datetime] = None
     r"""The date and time the resource was created"""
 
-    updated: Optional[datetime] = parse_datetime("2026-01-30T11:55:17.562Z")
+    updated: Optional[datetime] = parse_datetime("2026-02-02T05:27:46.195Z")
     r"""The date and time the resource was last updated"""
 
     @model_serializer(mode="wrap")

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/src/orq_ai_sdk/models/createconversationop.py

@@ -199,7 +199,7 @@ class CreateConversationResponseBody(BaseModel):
     r"""Unix timestamp in milliseconds when the conversation was last modified."""
 
     id: Annotated[Optional[str], pydantic.Field(alias="_id")] = (
-        "conv_01kg7c48qvqjhbx9z7txdt6fm1"
+        "conv_01kged4vfa7pw1sgvnzfwc3xyz"
     )
     r"""Unique conversation identifier with `conv_` prefix."""
 

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/src/orq_ai_sdk/models/createconversationresponseop.py

@@ -119,7 +119,7 @@ class CreateConversationResponsePartReasoningPart(BaseModel):
     r"""The reasoning or thought process behind the response. Used for chain-of-thought or extended thinking."""
 
     id: Annotated[Optional[str], pydantic.Field(alias="_id")] = (
-        "reasoning_01kg7c48rmsn1mw87w5xj6pwvn"
+        "reasoning_01kged4vg5fx1pj1a3e0380bdh"
     )
     r"""Unique identifier for the part. Format: reasoning_{ulid} (e.g., reasoning_01hxyz...)"""
 
@@ -211,7 +211,7 @@ class DeltaReasoningPart(BaseModel):
     r"""The reasoning or thought process behind the response. Used for chain-of-thought or extended thinking."""
 
     id: Annotated[Optional[str], pydantic.Field(alias="_id")] = (
-        "reasoning_01kg7c48rexh6svd50jpesbyqa"
+        "reasoning_01kged4vfy8czd748qd20md4k9"
     )
     r"""Unique identifier for the part. Format: reasoning_{ulid} (e.g., reasoning_01hxyz...)"""
 

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/src/orq_ai_sdk/models/createdatasetitemop.py

@@ -1434,7 +1434,7 @@ class Evaluations3(BaseModel):
 
     source: Optional[CreateDatasetItemEvaluationsDatasetsSource] = "orq"
 
-    reviewed_at: Optional[datetime] = parse_datetime("2026-01-30T11:55:30.598Z")
+    reviewed_at: Optional[datetime] = parse_datetime("2026-02-02T05:27:59.443Z")
     r"""The date and time the item was reviewed"""
 
     @model_serializer(mode="wrap")
@@ -1502,7 +1502,7 @@ class Evaluations2(BaseModel):
 
     source: Optional[CreateDatasetItemEvaluationsSource] = "orq"
 
-    reviewed_at: Optional[datetime] = parse_datetime("2026-01-30T11:55:30.598Z")
+    reviewed_at: Optional[datetime] = parse_datetime("2026-02-02T05:27:59.442Z")
     r"""The date and time the item was reviewed"""
 
     @model_serializer(mode="wrap")
@@ -1570,7 +1570,7 @@ class Evaluations1(BaseModel):
 
     source: Optional[EvaluationsSource] = "orq"
 
-    reviewed_at: Optional[datetime] = parse_datetime("2026-01-30T11:55:30.597Z")
+    reviewed_at: Optional[datetime] = parse_datetime("2026-02-02T05:27:59.442Z")
     r"""The date and time the item was reviewed"""
 
     @model_serializer(mode="wrap")
@@ -1665,7 +1665,7 @@ class CreateDatasetItemResponseBody(BaseModel):
     created: Optional[datetime] = None
     r"""The date and time the resource was created"""
 
-    updated: Optional[datetime] = parse_datetime("2026-01-30T11:55:17.562Z")
+    updated: Optional[datetime] = parse_datetime("2026-02-02T05:27:46.195Z")
     r"""The date and time the resource was last updated"""
 
     @model_serializer(mode="wrap")

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/src/orq_ai_sdk/models/createdatasetop.py

@@ -94,7 +94,7 @@ class CreateDatasetResponseBody(BaseModel):
     created: Optional[datetime] = None
     r"""The date and time the resource was created"""
 
-    updated: Optional[datetime] = parse_datetime("2026-01-30T11:55:17.562Z")
+    updated: Optional[datetime] = parse_datetime("2026-02-02T05:27:46.195Z")
     r"""The date and time the resource was last updated"""
 
     @model_serializer(mode="wrap")

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/src/orq_ai_sdk/models/createdatasourceop.py

@@ -314,7 +314,7 @@ class CreateDatasourceResponseBody(BaseModel):
     r"""The number of chunks in the datasource"""
 
     id: Annotated[Optional[str], pydantic.Field(alias="_id")] = (
-        "01KG7C499D5W472GMTRAXR3N2J"
+        "01KGED4W2YVTGMT6R22KBS65E0"
     )
     r"""The unique identifier of the data source"""
 

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/src/orq_ai_sdk/models/createevalop.py

@@ -884,9 +884,9 @@ class Typescript(BaseModel):
 
     key: str
 
-    created: Optional[str] = "2026-01-30T11:55:19.325Z"
+    created: Optional[str] = "2026-02-02T05:27:47.951Z"
 
-    updated: Optional[str] = "2026-01-30T11:55:19.325Z"
+    updated: Optional[str] = "2026-02-02T05:27:47.951Z"
 
     guardrail_config: Optional[
         CreateEvalResponseBodyEvalsResponse200ApplicationJSON7GuardrailConfig
@@ -1080,9 +1080,9 @@ class Ragas(BaseModel):
 
     model: str
 
-    created: Optional[str] = "2026-01-30T11:55:19.325Z"
+    created: Optional[str] = "2026-02-02T05:27:47.951Z"
 
-    updated: Optional[str] = "2026-01-30T11:55:19.325Z"
+    updated: Optional[str] = "2026-02-02T05:27:47.951Z"
 
     guardrail_config: Optional[
         CreateEvalResponseBodyEvalsResponse200ApplicationJSONGuardrailConfig
@@ -1775,9 +1775,9 @@ class CreateEvalResponseBodyFunction(BaseModel):
 
     key: str
 
-    created: Optional[str] = "2026-01-30T11:55:19.325Z"
+    created: Optional[str] = "2026-02-02T05:27:47.951Z"
 
-    updated: Optional[str] = "2026-01-30T11:55:19.325Z"
+    updated: Optional[str] = "2026-02-02T05:27:47.951Z"
 
     guardrail_config: Optional[
         CreateEvalResponseBodyEvalsResponse200GuardrailConfig
@@ -1952,9 +1952,9 @@ class ResponseBodyPython(BaseModel):
 
     key: str
 
-    created: Optional[str] = "2026-01-30T11:55:19.325Z"
+    created: Optional[str] = "2026-02-02T05:27:47.951Z"
 
-    updated: Optional[str] = "2026-01-30T11:55:19.325Z"
+    updated: Optional[str] = "2026-02-02T05:27:47.951Z"
 
     guardrail_config: Optional[CreateEvalResponseBodyEvalsResponseGuardrailConfig] = (
         None
@@ -2134,9 +2134,9 @@ class ResponseBodyHTTP(BaseModel):
 
     key: str
 
-    created: Optional[str] = "2026-01-30T11:55:19.325Z"
+    created: Optional[str] = "2026-02-02T05:27:47.951Z"
 
-    updated: Optional[str] = "2026-01-30T11:55:19.325Z"
+    updated: Optional[str] = "2026-02-02T05:27:47.951Z"
 
     guardrail_config: Optional[CreateEvalResponseBodyEvalsGuardrailConfig] = None
 
@@ -2287,9 +2287,9 @@ class ResponseBodyJSON(BaseModel):
 
     key: str
 
-    created: Optional[str] = "2026-01-30T11:55:19.325Z"
+    created: Optional[str] = "2026-02-02T05:27:47.951Z"
 
-    updated: Optional[str] = "2026-01-30T11:55:19.325Z"
+    updated: Optional[str] = "2026-02-02T05:27:47.951Z"
 
     guardrail_config: Optional[CreateEvalResponseBodyGuardrailConfig] = None
 
@@ -2441,9 +2441,9 @@ class ResponseBodyLLM(BaseModel):
 
     model: str
 
-    created: Optional[str] = "2026-01-30T11:55:19.325Z"
+    created: Optional[str] = "2026-02-02T05:27:47.951Z"
 
-    updated: Optional[str] = "2026-01-30T11:55:19.325Z"
+    updated: Optional[str] = "2026-02-02T05:27:47.951Z"
 
     guardrail_config: Optional[ResponseBodyGuardrailConfig] = None
 

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/src/orq_ai_sdk/models/createidentityop.py

@@ -137,7 +137,7 @@ class CreateIdentityResponseBody(BaseModel):
     created: Optional[datetime] = None
     r"""The date and time the resource was created"""
 
-    updated: Optional[datetime] = parse_datetime("2026-01-30T11:55:17.562Z")
+    updated: Optional[datetime] = parse_datetime("2026-02-02T05:27:46.195Z")
     r"""The date and time the resource was last updated"""
 
     @model_serializer(mode="wrap")

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/src/orq_ai_sdk/models/createtoolop.py

@@ -1068,7 +1068,7 @@ class ResponseBodyCodeExecutionTool(BaseModel):
     code_tool: ResponseBodyCodeTool
 
     id: Annotated[Optional[str], pydantic.Field(alias="_id")] = (
-        "tool_01KG7C493JHNGDXN4TMMN5CAK6"
+        "tool_01KGED4VX25YVCWTDXB3RRVQJ3"
     )
 
     display_name: Optional[str] = None
@@ -1195,7 +1195,7 @@ class ResponseBodyTools(BaseModel):
 
     schema_: Annotated[CreateToolResponseBodySchema, pydantic.Field(alias="schema")]
 
-    id: Optional[str] = "01KG7C493GJHXQXG33DRCSXDAD"
+    id: Optional[str] = "01KGED4VX181ZHW11G8YNX33HG"
 
     description: Optional[str] = None
 
@@ -1326,7 +1326,7 @@ class ResponseBodyMCPTool(BaseModel):
     mcp: ResponseBodyMcp
 
     id: Annotated[Optional[str], pydantic.Field(alias="_id")] = (
-        "tool_01KG7C493ENC1KJE5GVJD37V9N"
+        "tool_01KGED4VWZ6KKJXDGM7AGDWYBW"
     )
 
     display_name: Optional[str] = None
@@ -1627,7 +1627,7 @@ class ResponseBodyHTTPTool(BaseModel):
     http: CreateToolResponseBodyHTTP
 
     id: Annotated[Optional[str], pydantic.Field(alias="_id")] = (
-        "tool_01KG7C493B1JB8HVS11FN3XKZ6"
+        "tool_01KGED4VWWFN1416BR6759K18Q"
     )
 
     display_name: Optional[str] = None
@@ -1822,7 +1822,7 @@ class ResponseBodyJSONSchemaTool(BaseModel):
     json_schema: ResponseBodyJSONSchema
 
     id: Annotated[Optional[str], pydantic.Field(alias="_id")] = (
-        "tool_01KG7C49380CVSQDAXHN3C2TZE"
+        "tool_01KGED4VWT8A8Z44C2SNGDDK5P"
     )
 
     display_name: Optional[str] = None
@@ -2021,7 +2021,7 @@ class ResponseBodyFunctionTool(BaseModel):
     function: CreateToolResponseBodyFunction
 
     id: Annotated[Optional[str], pydantic.Field(alias="_id")] = (
-        "tool_01KG7C4936VWD55H8KJTTZNYNS"
+        "tool_01KGED4VWRVQ1C6YDTVAVGDDXG"
     )
 
     display_name: Optional[str] = None

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/src/orq_ai_sdk/models/filegetop.py

@@ -64,7 +64,7 @@ class FileGetResponseBody(BaseModel):
     workspace_id: str
     r"""The id of the resource"""
 
-    created: Optional[datetime] = parse_datetime("2026-01-30T11:55:20.896Z")
+    created: Optional[datetime] = parse_datetime("2026-02-02T05:27:49.407Z")
     r"""The date and time the resource was created"""
 
     @model_serializer(mode="wrap")

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/src/orq_ai_sdk/models/filelistop.py

@@ -96,7 +96,7 @@ class FileListData(BaseModel):
     workspace_id: str
     r"""The id of the resource"""
 
-    created: Optional[datetime] = parse_datetime("2026-01-30T11:55:20.896Z")
+    created: Optional[datetime] = parse_datetime("2026-02-02T05:27:49.407Z")
     r"""The date and time the resource was created"""
 
     @model_serializer(mode="wrap")

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/src/orq_ai_sdk/models/fileuploadop.py

@@ -134,7 +134,7 @@ class FileUploadResponseBody(BaseModel):
     workspace_id: str
     r"""The id of the resource"""
 
-    created: Optional[datetime] = parse_datetime("2026-01-30T11:55:20.896Z")
+    created: Optional[datetime] = parse_datetime("2026-02-02T05:27:49.407Z")
     r"""The date and time the resource was created"""
 
     @model_serializer(mode="wrap")

{orq_ai_sdk-4.3.0rc13 → orq_ai_sdk-4.3.0rc15}/src/orq_ai_sdk/models/generateconversationnameop.py

@@ -186,7 +186,7 @@ class GenerateConversationNameResponseBody(BaseModel):
     r"""Unix timestamp in milliseconds when the conversation was last modified."""
 
     id: Annotated[Optional[str], pydantic.Field(alias="_id")] = (
-        "conv_01kg7c48qwzz321bytqdh3byaj"
+        "conv_01kged4vfcsaxmyfcjex56e791"
     )
     r"""Unique conversation identifier with `conv_` prefix."""