azure-ai-evaluation 1.0.0b1__py3-none-any.whl → 1.0.0b2__py3-none-any.whl

{azure_ai_evaluation-1.0.0b1.dist-info → azure_ai_evaluation-1.0.0b2.dist-info}/METADATA

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: azure-ai-evaluation
-Version: 1.0.0b1
+Version: 1.0.0b2
 Summary: Microsoft Azure Evaluation Library for Python
 Home-page: https://github.com/Azure/azure-sdk-for-python
 Author: Microsoft Corporation
@@ -35,11 +35,27 @@ Requires-Dist: promptflow-azure <2.0.0,>=1.15.0 ; extra == 'pf-azure'
 
 # Azure AI Evaluation client library for Python
 
+We are excited to introduce the public preview of the Azure AI Evaluation SDK. 
+
+[Source code][source_code]
+| [Package (PyPI)][evaluation_pypi]
+| [API reference documentation][evaluation_ref_docs]
+| [Product documentation][product_documentation]
+| [Samples][evaluation_samples]
+
+This package has been tested with Python 3.8, 3.9, 3.10, 3.11, and 3.12.
+
+For a more complete set of Azure libraries, see https://aka.ms/azsdk/python/all
+
 ## Getting started
 
+### Prerequisites
+
+- Python 3.8 or later is required to use this package.
+
 ### Install the package
 
-Install the Azure AI Evaluation library for Python with:
+Install the Azure AI Evaluation library for Python with [pip][pip_link]::
 
 ```bash
 pip install azure-ai-evaluation
@@ -51,6 +67,8 @@ Evaluators are custom or prebuilt classes or functions that are designed to meas
 
 ## Examples
 
+### Evaluators
+
 Users can create evaluator runs on the local machine as shown in the example below:
 
 ```python
@@ -92,9 +110,9 @@ if __name__ == "__main__":
 
     # Initialize Project Scope
     azure_ai_project = {
-        "subscription_id": "e0fd569c-e34a-4249-8c24-e8d723c7f054",
-        "resource_group_name": "rg-test",
-        "project_name": "project-test",
+        "subscription_id": <subscription_id>,
+        "resource_group_name": <resource_group_name>,
+        "project_name": <project_name>
     }
 
     violence_eval = ViolenceEvaluator(azure_ai_project)
@@ -122,9 +140,13 @@ if __name__ == "__main__":
 
     pprint(result)
 ```
-## Simulator
+### Simulator
 
-Sample application prompty
+
+Simulators allow users to generate synthentic data using their application. Simulator expects the user to have a callback method that invokes
+their AI application.
+
+#### Simulating with a Prompty
 
 ```yaml
 ---
@@ -163,7 +185,7 @@ Application code:
 import json
 import asyncio
 from typing import Any, Dict, List, Optional
-from azure.ai.evaluation.synthetic import Simulator
+from azure.ai.evaluation.simulator import Simulator
 from promptflow.client import load_flow
 from azure.identity import DefaultAzureCredential
 import os
@@ -171,8 +193,7 @@ import os
 azure_ai_project = {
     "subscription_id": os.environ.get("AZURE_SUBSCRIPTION_ID"),
     "resource_group_name": os.environ.get("RESOURCE_GROUP"),
-    "project_name": os.environ.get("PROJECT_NAME"),
-    "credential": DefaultAzureCredential(),
+    "project_name": os.environ.get("PROJECT_NAME")
 }
 
 import wikipedia
@@ -249,8 +270,7 @@ if __name__ == "__main__":
     print("done!")
 ```
 
-Simulators allow users to generate synthentic data using their application. Simulator expects the user to have a callback method that invokes
-their AI application. Here's a sample of a callback which invokes AsyncAzureOpenAI:
+#### Adversarial Simulator
 
 ```python
 from from azure.ai.evaluation.simulator import AdversarialSimulator, AdversarialScenario
@@ -318,7 +338,9 @@ async def callback(
     }
 
 ```
-### Adversarial QA:
+
+#### Adversarial QA
+
 ```python
 scenario = AdversarialScenario.ADVERSARIAL_QA
 simulator = AdversarialSimulator(azure_ai_project=azure_ai_project, credential=DefaultAzureCredential())
@@ -334,7 +356,7 @@ outputs = asyncio.run(
 
 print(outputs.to_eval_qa_json_lines())
 ```
-### Direct Attack Simulator
+#### Direct Attack Simulator
 
 ```python
 scenario = AdversarialScenario.ADVERSARIAL_QA
@@ -353,13 +375,63 @@ print(outputs)
 ```
 ## Troubleshooting
 
+### General
+
+Azure ML clients raise exceptions defined in [Azure Core][azure_core_readme].
+
+### Logging
+
+This library uses the standard
+[logging][python_logging] library for logging.
+Basic information about HTTP sessions (URLs, headers, etc.) is logged at INFO
+level.
+
+Detailed DEBUG level logging, including request/response bodies and unredacted
+headers, can be enabled on a client with the `logging_enable` argument.
+
+See full SDK logging documentation with examples [here][sdk_logging_docs].
+
 ## Next steps
 
+- View our [samples][evaluation_samples].
+- View our [documentation][product_documentation]
+
 ## Contributing
 
+This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit [cla.microsoft.com][cla].
+
+When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., label, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.
+
+This project has adopted the [Microsoft Open Source Code of Conduct][code_of_conduct]. For more information see the [Code of Conduct FAQ][coc_faq] or contact [opencode@microsoft.com][coc_contact] with any additional questions or comments.
+
+<!-- LINKS -->
+
+[source_code]: https://github.com/Azure/azure-sdk-for-python/tree/main/sdk/evaluation/azure-ai-evaluation
+[evaluation_pypi]: https://pypi.org/project/azure-ai-evaluation/
+[evaluation_ref_docs]: https://learn.microsoft.com/python/api/azure-ai-evaluation/azure.ai.evaluation?view=azure-python-preview
+[evaluation_samples]: https://github.com/Azure-Samples/azureai-samples/tree/main/scenarios
+[product_documentation]: https://learn.microsoft.com/azure/ai-studio/how-to/develop/evaluate-sdk
+[python_logging]: https://docs.python.org/3/library/logging.html
+[sdk_logging_docs]: https://docs.microsoft.com/azure/developer/python/azure-sdk-logging
+[azure_core_readme]: https://github.com/Azure/azure-sdk-for-python/blob/main/sdk/core/azure-core/README.md
+[pip_link]: https://pypi.org/project/pip/
+[azure_core_ref_docs]: https://aka.ms/azsdk-python-core-policies
+[azure_core]: https://github.com/Azure/azure-sdk-for-python/blob/main/sdk/core/azure-core/README.md
+[azure_identity]: https://github.com/Azure/azure-sdk-for-python/tree/main/sdk/identity/azure-identity
+[cla]: https://cla.microsoft.com
+[code_of_conduct]: https://opensource.microsoft.com/codeofconduct/
+[coc_faq]: https://opensource.microsoft.com/codeofconduct/faq/
+[coc_contact]: mailto:opencode@microsoft.com
+
 
 # Release History
 
+## 1.0.0b2 (2024-09-24)
+
+### Breaking Changes
+
+- `data` and `evaluators` are now required keywords in `evaluate`.
+
 ## 1.0.0b1 (2024-09-20)
 
 ### Breaking Changes

{azure_ai_evaluation-1.0.0b1.dist-info → azure_ai_evaluation-1.0.0b2.dist-info}/RECORD

@@ -1,97 +1,99 @@
-azure/ai/evaluation/__init__.py,sha256=aCQXu_6B3tB-WSRtdPrMUODYMytwK1pVoOTwkR5EItg,1984
-azure/ai/evaluation/_constants.py,sha256=MtXK9FV3TgDiq8IYSMkSDbNXVQsZw62D26g7ZXJ62NU,1422
+azure/ai/evaluation/__init__.py,sha256=7ff0POpQe1C1L9eD4yz9P9y9BtFWNr5wHEtSOR2xVA0,1967
+azure/ai/evaluation/_constants.py,sha256=cWnrEjJuPok2CPbibJ40XyX2VSlw4-x_dob3DjFsd5U,1683
 azure/ai/evaluation/_exceptions.py,sha256=HUMfvguDc7ygcbs3MTK14R3PK7UxGNWQQHH3hYXIV3U,4168
-azure/ai/evaluation/_http_utils.py,sha256=13G64fWveezBdcmjwwwbJrIkdZp2ns3Jvd-addKw1SU,13983
+azure/ai/evaluation/_http_utils.py,sha256=kpAuxuoC6ZK-ZHw6qScOC8ePJQXLwf7SJWP5S4OWwUs,13983
 azure/ai/evaluation/_model_configurations.py,sha256=D02AzOdyO6LQCia0k232Msd7ro35-EcwmlQ0tOD_5H0,652
 azure/ai/evaluation/_user_agent.py,sha256=O2y-QPBAcw7w7qQ6M2aRPC3Vy3TKd789u5lcs2yuFaI,290
-azure/ai/evaluation/_version.py,sha256=oZ93SfxVsREL_UaqV9_yCzfIy_LG5t9AwK_uEE8HjXI,201
+azure/ai/evaluation/_version.py,sha256=Fx-4qD0RW2DqdKCStZHT4KOjqxKVEeT05DbGkqnTSF4,201
 azure/ai/evaluation/py.typed,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 azure/ai/evaluation/_common/__init__.py,sha256=LHTkf6dMLLxikrGNgbUuREBVQcs4ORHR6Eryo4bm9M8,586
 azure/ai/evaluation/_common/constants.py,sha256=ZKHGVgGA1Fc6Pvo22X-CeOUX6-m0q_UwpOKOWATTSuI,1639
-azure/ai/evaluation/_common/rai_service.py,sha256=Cci_YnX1XeYHiZX4DTVj6_bAj2JADXh1znXS_cDM45M,17540
-azure/ai/evaluation/_common/utils.py,sha256=Ed2pgAXzswrOskWopYyRGdPMOkwbP-cgj32kBOuWMZw,2941
+azure/ai/evaluation/_common/rai_service.py,sha256=R-1jtWi4Fu4IT4v0j0hKsWyN-D5nwH5HQr1x0AtCp8Q,17539
+azure/ai/evaluation/_common/utils.py,sha256=orrvIGY3L2o8uHEJkTdfNa4jV_8OsscWyL3CzX96U9o,2991
 azure/ai/evaluation/_evaluate/__init__.py,sha256=Yx1Iq2GNKQ5lYxTotvPwkPL4u0cm6YVxUe-iVbu1clI,180
-azure/ai/evaluation/_evaluate/_eval_run.py,sha256=eUUUzF6o3FjkQ6L5aZnESQjWM_UscM5MnCD-5P0dldA,20237
-azure/ai/evaluation/_evaluate/_evaluate.py,sha256=HP7J39YUn9yMKLl2z-k-7_BVpzQIhDQwFOExQk6nb9w,28379
-azure/ai/evaluation/_evaluate/_utils.py,sha256=-8xv0TF3QQPfZlEpLOCGSq2Nvb-esZfpaDySOHLeey4,9680
+azure/ai/evaluation/_evaluate/_eval_run.py,sha256=EVCSRjIwOkXfYlIBTv7hosyUqcMTmVqGQ44yvHmm2Eg,20943
+azure/ai/evaluation/_evaluate/_evaluate.py,sha256=50djPOmW-K3f7lbTttPWcgGx96_b-zTeG5iBHuPArRY,29141
+azure/ai/evaluation/_evaluate/_utils.py,sha256=9I29KAFsYJCp6frlLXb5vwZJzmiNzfzku9CD1eslaHU,9880
 azure/ai/evaluation/_evaluate/_batch_run_client/__init__.py,sha256=BkxhojWca3e2QM3hFwO2xrLiiQ0i-3f8wsMfOx1zchs,361
-azure/ai/evaluation/_evaluate/_batch_run_client/batch_run_context.py,sha256=wL_gNM2u8_DYUKopxFnJFc0cUAxWo9HV5gNSfZoluJo,2983
-azure/ai/evaluation/_evaluate/_batch_run_client/code_client.py,sha256=xmck4Wlp0wrzkN6sZsmW-7MMAc1rIw16xwSV52_V8to,7120
-azure/ai/evaluation/_evaluate/_batch_run_client/proxy_client.py,sha256=_2NynIyH_QFZQf5TDZ9x_FtDUXrzvMfGVuTtpZJazpo,1981
-azure/ai/evaluation/_evaluate/_telemetry/__init__.py,sha256=gF0mHhCYjrlOBgR4I6mQ5KIfExpq7W2On31ITmjYN8M,6400
+azure/ai/evaluation/_evaluate/_batch_run_client/batch_run_context.py,sha256=sn7k9nM7vVZDt5CgNwwQrvQwV--SwfsfLjfjahk23DM,2984
+azure/ai/evaluation/_evaluate/_batch_run_client/code_client.py,sha256=zuACg8pNe4d5lckhghjkDA8Hk4WQ9ih3W2AJ-M3hVGk,7890
+azure/ai/evaluation/_evaluate/_batch_run_client/proxy_client.py,sha256=WDmtnRmIlBmJASxRlX9vAT4CpgZszv7juyfJrj892vo,2598
+azure/ai/evaluation/_evaluate/_telemetry/__init__.py,sha256=6kkbiTCsz7BNV5WxOdwCBv96u7c0k0bk84m9vQ0mHXY,6627
 azure/ai/evaluation/_evaluators/__init__.py,sha256=Yx1Iq2GNKQ5lYxTotvPwkPL4u0cm6YVxUe-iVbu1clI,180
 azure/ai/evaluation/_evaluators/_bleu/__init__.py,sha256=quKKO0kvOSkky5hcoNBvgBuMeeVRFCE9GSv70mAdGP4,260
-azure/ai/evaluation/_evaluators/_bleu/_bleu.py,sha256=q8hTVC8Ubfb0lQmlGnsuEb6J7Qx5c7eYso4ss6RhgOw,2413
+azure/ai/evaluation/_evaluators/_bleu/_bleu.py,sha256=6EJCG9DnL2Y4pU_vhY4o3UOrumvI-6HI92tzEuCoyXk,2413
 azure/ai/evaluation/_evaluators/_chat/__init__.py,sha256=xOsSHYNGJJiZvBMPbmLd_-ZZs8_15Sblvk-OF7iVoIo,250
-azure/ai/evaluation/_evaluators/_chat/_chat.py,sha256=GsK7EERUNo5uuh025EazxpK6wuN7mzz891_l8WFxqXg,14692
+azure/ai/evaluation/_evaluators/_chat/_chat.py,sha256=ZCm7L50bRaAvj2-Gw6T_9u4RTHRF6neCYnjDCunRjKw,14787
 azure/ai/evaluation/_evaluators/_chat/retrieval/__init__.py,sha256=DmBjBkwDDlCsSGpBeXfpfMM9ekxIJs62dij4rBXND7k,273
-azure/ai/evaluation/_evaluators/_chat/retrieval/_retrieval.py,sha256=X_2UzFd-FP032nT4fjH1EY67bvIcRpmmjv9KQrXpfUE,5739
+azure/ai/evaluation/_evaluators/_chat/retrieval/_retrieval.py,sha256=HKkQdvYVD3Mr5kPUzKLBYsct94k1hAcLu5v9MCxZ6lA,5579
 azure/ai/evaluation/_evaluators/_chat/retrieval/retrieval.prompty,sha256=NoHNDf_UE8BGAixqZPhRQ4ecxOUi9w9gO8HfHhJuxaY,1761
 azure/ai/evaluation/_evaluators/_coherence/__init__.py,sha256=GRqcSCQse02Spyki0UsRNWMIXiea2lLtPPXNGvkJzQ0,258
-azure/ai/evaluation/_evaluators/_coherence/_coherence.py,sha256=sOP2rYwGe1k_80FhBr5PGG8metmpJwGfx4U7-aVroIs,4121
+azure/ai/evaluation/_evaluators/_coherence/_coherence.py,sha256=XMymhai4cw9Gqy9Lfa9IvIcw9s_cnCM1pbyVVnpF53M,3958
 azure/ai/evaluation/_evaluators/_coherence/coherence.prompty,sha256=WVEXxKmh_Gbb11_00N2WCIIJSMgPssFxJ5h2--rMG-w,2725
 azure/ai/evaluation/_evaluators/_content_safety/__init__.py,sha256=mR5CbcMyxV9GQoY71Saoi0bQTpEB74HrYmM8gcVhnAg,746
-azure/ai/evaluation/_evaluators/_content_safety/_content_safety.py,sha256=VUazS5AcJ5Z-BOrqfCRt5SdRhmTlxWdxl03FML0zHq4,3998
-azure/ai/evaluation/_evaluators/_content_safety/_content_safety_base.py,sha256=Yb2x-sI5_GivAe8o8BvA2gM64yQCv73v5LS_QyiR9vQ,2802
-azure/ai/evaluation/_evaluators/_content_safety/_content_safety_chat.py,sha256=7cLTnbz0iHderZeXPKYbbBSwvKYZtMiExEMYQSfggd4,11909
-azure/ai/evaluation/_evaluators/_content_safety/_hate_unfairness.py,sha256=Ur1gQPBdr0b_Ov8K0Jflmvua2mgSrk9DhlPOAQR-7w4,2875
-azure/ai/evaluation/_evaluators/_content_safety/_self_harm.py,sha256=MrCOPNmv6PAkVFKDrwNfXeOyhTmyDa2Tik_xEFKxYwg,2676
-azure/ai/evaluation/_evaluators/_content_safety/_sexual.py,sha256=MyRI9QtqElb2gDGPGnyQYfAHsjdw_oK6Ekjz4Voo9rg,2644
-azure/ai/evaluation/_evaluators/_content_safety/_violence.py,sha256=YH0NxossokGX5tFKAIZJvMiprs34KuiNQnMXAbOOMCM,2668
+azure/ai/evaluation/_evaluators/_content_safety/_content_safety.py,sha256=uM6BL9jwtv5nJpSchezTYc-E514_VCTN2pACy7oxHuU,3928
+azure/ai/evaluation/_evaluators/_content_safety/_content_safety_base.py,sha256=VlBDKrB2uNXX8ccV7aKsHM74_mK6JLUZ9SAGcvR3Lk8,2733
+azure/ai/evaluation/_evaluators/_content_safety/_content_safety_chat.py,sha256=n5fdL0TPelJY_AuiamkLO7Jiv7P-7gIZqipo5ShyoR8,11958
+azure/ai/evaluation/_evaluators/_content_safety/_hate_unfairness.py,sha256=uA_FecBD9M1C0_hfnbqR9shZNMFbhmBcCAhKgTxv8rI,2807
+azure/ai/evaluation/_evaluators/_content_safety/_self_harm.py,sha256=6_FK2zDAyS3wQTbYe3FmNXxw7qWwYOGqLUKopWUWKvQ,2608
+azure/ai/evaluation/_evaluators/_content_safety/_sexual.py,sha256=d8LZD368nqppZi-Kdimo4Lt8QOTFtc6csPjY66G7SMQ,2576
+azure/ai/evaluation/_evaluators/_content_safety/_violence.py,sha256=e0ZeUcD1YKWPzqfaLBxFdNHmod69K55zIOgLOJAMe_4,2600
 azure/ai/evaluation/_evaluators/_eci/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-azure/ai/evaluation/_evaluators/_eci/_eci.py,sha256=vm8G-YvZuXipvJSixA6mktEL7xQvqnsHcD1trqh7Cxw,4058
+azure/ai/evaluation/_evaluators/_eci/_eci.py,sha256=Amrch3q5BG2BFAB7GdShnTX19f5IoGY6VF66_M6hbZs,3990
 azure/ai/evaluation/_evaluators/_f1_score/__init__.py,sha256=aEVbO7iMoF20obdpLQKcKm69Yyu3mYnblKELLqu8OGI,260
-azure/ai/evaluation/_evaluators/_f1_score/_f1_score.py,sha256=KNMni1m8dtaC6kLf9JRUVfJ1hZfYBi-g6iZiruJ_Hyc,4553
+azure/ai/evaluation/_evaluators/_f1_score/_f1_score.py,sha256=Cgp-hANXtrNfe1q6SVm-CUG3UEP8Gj1pvH293ay57OI,4554
 azure/ai/evaluation/_evaluators/_fluency/__init__.py,sha256=EEJw39xRa0bOAA1rELTTKXQu2s60n_7CZQRD0Gu2QVw,259
-azure/ai/evaluation/_evaluators/_fluency/_fluency.py,sha256=0KSSYQjWzPpGLBK-NIkIdfp0fPcCOpjIkuKMbYprqI0,4082
+azure/ai/evaluation/_evaluators/_fluency/_fluency.py,sha256=MhDOoP9oD-rw7uT90pU6O1XP6vqfOP6e608tp1qRy7Y,3919
 azure/ai/evaluation/_evaluators/_fluency/fluency.prompty,sha256=RparSdDZs-xiGbq7lRifz9z7jaD10ldXDU3E7sO0v2s,2579
 azure/ai/evaluation/_evaluators/_gleu/__init__.py,sha256=Ae2EvQ7gqiYAoNO3LwGIhdAAjJPJDfT85rQGKrRrmbA,260
-azure/ai/evaluation/_evaluators/_gleu/_gleu.py,sha256=qQR5Ic4K4biHrMm8XLe1DtKc3MSwbfCjK_-CLpL9aCc,2326
+azure/ai/evaluation/_evaluators/_gleu/_gleu.py,sha256=m02wmIGjdoXjp9dwjnFQAKA8hGOUOTvpppDf2CD4QQo,2326
 azure/ai/evaluation/_evaluators/_groundedness/__init__.py,sha256=UYNJUeRvBwcSVFyZpdsf29un5eyaDzYoo3QvC1gvlLg,274
-azure/ai/evaluation/_evaluators/_groundedness/_groundedness.py,sha256=BZdr2Gqgos1CDTnMPJPUfoa_Pkq9WxgdL-Qem6GbINs,4301
+azure/ai/evaluation/_evaluators/_groundedness/_groundedness.py,sha256=3HcNMOBxbslIJmmhJWU3itPOL3TOiLqQYiYr_n8wTqU,4138
 azure/ai/evaluation/_evaluators/_groundedness/groundedness.prompty,sha256=dDclp_YowBjeiGhwmCxCnS4A3K9r4v2tzsUm-ccLt-I,3199
 azure/ai/evaluation/_evaluators/_meteor/__init__.py,sha256=209na3pPsdmcuYpYHUYtqQybCpc3yZkc93HnRdicSlI,266
-azure/ai/evaluation/_evaluators/_meteor/_meteor.py,sha256=62AD1DVH_T_t9MDK4GEcvujC0Aka-SEggxEAmc68byg,3315
+azure/ai/evaluation/_evaluators/_meteor/_meteor.py,sha256=K3EdRuRcuEZYVIlI2jMEp0O9KJYXQB2o6h08q43oKWY,3316
 azure/ai/evaluation/_evaluators/_protected_material/__init__.py,sha256=eRAQIU9diVXfO5bp6aLWxZoYUvOsrDIfy1gnDOeNTiI,109
-azure/ai/evaluation/_evaluators/_protected_material/_protected_material.py,sha256=6eZXjp2iXSaTNCx_8_8A96lhH5cdm3rmeJfvzMJHV9k,4233
+azure/ai/evaluation/_evaluators/_protected_material/_protected_material.py,sha256=LnbyS3xVu_7Q1nDuoOxnQnzXhZVrDMSnEzNdu66g6DY,4165
 azure/ai/evaluation/_evaluators/_protected_materials/__init__.py,sha256=A12UsRVIebGvy9FtZLBPsOIAWUskBt8iuhRdILyRcSo,112
-azure/ai/evaluation/_evaluators/_protected_materials/_protected_materials.py,sha256=pRB48BwbnCuozVo7hpblh_ZnApWzmrqiTx0JqhH4ioY,4204
+azure/ai/evaluation/_evaluators/_protected_materials/_protected_materials.py,sha256=xF5jHhM29OXh2sHrnXkYtiRYltuVU-fqC7xToiI3WOM,4136
 azure/ai/evaluation/_evaluators/_qa/__init__.py,sha256=bcXfT--C0hjym2haqd1B2-u9bDciyM0ThOFtU1Q69sk,244
-azure/ai/evaluation/_evaluators/_qa/_qa.py,sha256=QSpk4wKIBdwVaI0-u4iRVlnezgxhPnSEAWRUxSwOJM8,3792
+azure/ai/evaluation/_evaluators/_qa/_qa.py,sha256=w9XJOfDof78mfOpc7tbPF5wec9dGPFmXXAdR5yx2buI,3502
 azure/ai/evaluation/_evaluators/_relevance/__init__.py,sha256=JlxytW32Nl8pbE-fI3GRpfgVuY9EG6zxIAn5VZGSwyc,265
-azure/ai/evaluation/_evaluators/_relevance/_relevance.py,sha256=YFLxC8VQ9kvEGK6jge7_yQCxXM1yPChy9d-dANVJA60,4507
+azure/ai/evaluation/_evaluators/_relevance/_relevance.py,sha256=iMky4Gf1kJB1kvBLaNWwCOBKLSWfhtSSLU0tPTU6ruE,4344
 azure/ai/evaluation/_evaluators/_relevance/relevance.prompty,sha256=AO70ho2nMhBtKcl_q4nKFW4kA1LjYsmSfymNa-Cbcrw,3735
 azure/ai/evaluation/_evaluators/_rouge/__init__.py,sha256=kusCDaYcXogDugGefRP8MQSn9xv107oDbrMCqZ6K4GA,291
-azure/ai/evaluation/_evaluators/_rouge/_rouge.py,sha256=IbD10QZMYzaXKqr6q4Diy7p06yhJ3kT8pMv2jnyMNtQ,3444
+azure/ai/evaluation/_evaluators/_rouge/_rouge.py,sha256=28vqjjleeJR5VRsQP5VCCMX_PVUUVxkgh4c3xIvwmXE,3526
 azure/ai/evaluation/_evaluators/_similarity/__init__.py,sha256=V2Mspog99_WBltxTkRHG5NpN5s9XoiTSN4I8POWEkLA,268
-azure/ai/evaluation/_evaluators/_similarity/_similarity.py,sha256=z_mUu0lL_gZI041PZvIBgSZ9Aj7j8wUgyy5OPFlBJ_w,4495
+azure/ai/evaluation/_evaluators/_similarity/_similarity.py,sha256=T-aTYausFvIfxCe0u8Lbd3ehKwxRtRLk2gHZ2pJ9YkE,4332
 azure/ai/evaluation/_evaluators/_similarity/similarity.prompty,sha256=p2Tb4IW6QnP2BaGRQsAicW4V0B23Oezhf5l3Hau0nxU,4770
 azure/ai/evaluation/_evaluators/_xpia/__init__.py,sha256=VMEL8WrpJQeh4sQiOLzP7hRFPnjzsvwfvTzaGCVJPCM,88
-azure/ai/evaluation/_evaluators/_xpia/xpia.py,sha256=-A9EpdZXr5wZzo_-cF_OX8mMAjy8AgKjNXt1D6Up0NU,5819
-azure/ai/evaluation/simulator/__init__.py,sha256=4O7O6esevfOX0Vb7Eo6nl_m9Qx_WDytwfSgZ7-E1HkE,485
+azure/ai/evaluation/_evaluators/_xpia/xpia.py,sha256=iYXjGt0F_gfc7SF6Q_d3Z_0Bkniqad91wljtBwR6BDM,5750
+azure/ai/evaluation/simulator/__init__.py,sha256=UtlcXo3SteIQEW_hW2WMhtqLNiDiIGLeW_lIkEUNoMc,486
 azure/ai/evaluation/simulator/_adversarial_scenario.py,sha256=SxpyMw5wmM5-fiUjl1_oJH0GQEnsa7ASso10MAr2Hjw,1030
-azure/ai/evaluation/simulator/_adversarial_simulator.py,sha256=toUDdMOD4JrsTOh9tsFTLTBz87o6YLgoY6djXnbO7Fk,20577
+azure/ai/evaluation/simulator/_adversarial_simulator.py,sha256=kOL31FcD7vXTpkeFUooASXNaFTe9Vme5st_i0Qa_9sA,20542
 azure/ai/evaluation/simulator/_constants.py,sha256=xM-Or2x7RytfoeBM3N7Vt4JQDJX66UdL3CPz0YN5rvE,485
-azure/ai/evaluation/simulator/_direct_attack_simulator.py,sha256=ACd4HZBtY18stKBTGW7iHEq0hn42gNK453V_pioOcxA,11702
-azure/ai/evaluation/simulator/_indirect_attack_simulator.py,sha256=4HX_034m2j8CBNBVSap9CfwKJX00l0fbvuXJyuZYavU,9639
-azure/ai/evaluation/simulator/_tracing.py,sha256=svCnjlI09AQ4aNH8yeXZiE6RKg9Pi4q66oQ8LstKJBk,2968
-azure/ai/evaluation/simulator/_utils.py,sha256=v-_nzpNj8RYnSyBeXcdxqu-jj1Xj_UgYdc21Gty8uwY,4219
-azure/ai/evaluation/simulator/simulator.py,sha256=902a7P5DGrkN1blbCTzHGDEFhA60LlxdjVEJVVa4cSQ,28464
-azure/ai/evaluation/simulator/_conversation/__init__.py,sha256=Qxu2x1cJ2fPTQtYhhNP5C4-d8P33Sru4Zn6xAgroDso,12774
-azure/ai/evaluation/simulator/_conversation/_conversation.py,sha256=9a2plS1QzyuvWbJYj6rY128401e6d_n_yiBNekIDkww,7251
+azure/ai/evaluation/simulator/_direct_attack_simulator.py,sha256=zFYYdk8Sdg4-_HSd_rumM0LizPevcR57HjqvEdowv8c,11691
+azure/ai/evaluation/simulator/_indirect_attack_simulator.py,sha256=qALFN3LG5o1kSjMjdlLeJInax8GcjD1iPUZCayJp0Kc,9628
+azure/ai/evaluation/simulator/_simulator.py,sha256=MpB8fcCmuge7AvHmoV-K3L9tdEwWHcfpkiU22MJfZ-A,31642
+azure/ai/evaluation/simulator/_tracing.py,sha256=LRPjsVLe9VohmXowFr9aCK_VwD0MHd1CBe8rl9jGQhU,3032
+azure/ai/evaluation/simulator/_utils.py,sha256=aXH5GdzQrwluKvYofWtdT0s_nzgVHS2hP6x4rc5zt-E,4287
+azure/ai/evaluation/simulator/_conversation/__init__.py,sha256=MNfFW4UDsVrk1p2ysIvmYlLzHqjKfxExktQXfSRiBPk,12774
+azure/ai/evaluation/simulator/_conversation/_conversation.py,sha256=ajJeFlHv4APXOinMYMzDYqKbDLtAdu4fE9FvP1gt2XA,7300
 azure/ai/evaluation/simulator/_conversation/constants.py,sha256=3v7zkjPwJAPbSpJYIK6VOZZy70bJXMo_QTVqSFGlq9A,984
-azure/ai/evaluation/simulator/_helpers/__init__.py,sha256=CD2fGrUgEE3puIm5QYqbkCN1AtntpF-3hRbF98hkhqE,203
+azure/ai/evaluation/simulator/_helpers/__init__.py,sha256=YTwBf9B_uWGZSbS5vDBde4UpFszxzi3hSlcPtZ4Slcg,259
+azure/ai/evaluation/simulator/_helpers/_experimental.py,sha256=xHOiIoe6SBX0OkkuDNZ_hkMZBwq5fEXUPQvlu8jMH28,5277
 azure/ai/evaluation/simulator/_helpers/_language_suffix_mapping.py,sha256=7BBLH78b7YDelHDLbAIwf-IO9s9cAEtn-RRXmNReHdc,1017
-azure/ai/evaluation/simulator/_helpers/_simulator_data_classes.py,sha256=NjsmHy-bb0yeqKVz9j7f7KIlTEB7MeZe1NzFOLBdBm4,2531
+azure/ai/evaluation/simulator/_helpers/_simulator_data_classes.py,sha256=Cc2ceVVyGXXfreQbes1x8XNNd5KZYoDS9eJ5EbgpAXE,2157
 azure/ai/evaluation/simulator/_model_tools/__init__.py,sha256=aMv5apb7uVjuhMF9ohhA5kQmo652hrGIJlhdl3y2R1I,835
 azure/ai/evaluation/simulator/_model_tools/_identity_manager.py,sha256=qhYmG2r4IAKDePtf9DdqgvNGYlc0xjH4x5sShGxS-lA,5070
-azure/ai/evaluation/simulator/_model_tools/_proxy_completion_model.py,sha256=fHE6OUc1drkABwGQ5L0ctrqARPjv5uwO-u7yOJhdCuQ,8397
-azure/ai/evaluation/simulator/_model_tools/_rai_client.py,sha256=ITPiciPQQkZa5s2E8pa-x3lKrf8rp7sbr_WSPpECOnc,6725
-azure/ai/evaluation/simulator/_model_tools/_template_handler.py,sha256=hpxBYui1eaw9_lDJJMnKj8CSWFDXiTa7XAKXA4lS0J4,5482
-azure/ai/evaluation/simulator/_model_tools/models.py,sha256=5pUESJR5b5rzp9W7B3Aaokz_HLHTSLjR13YKumLAxqs,21813
+azure/ai/evaluation/simulator/_model_tools/_proxy_completion_model.py,sha256=bwTV6cz01uOFl_BrYlgBfl63tdwzve8wGTbs8mJgaeY,8396
+azure/ai/evaluation/simulator/_model_tools/_rai_client.py,sha256=Bi0tLNlJmz295mdoVaE9_6a_UJVRmCH5uAmxjslS_eQ,7037
+azure/ai/evaluation/simulator/_model_tools/_template_handler.py,sha256=gGSMvveKWn0LKSQ4FS5AxIwcsxj6iqCbUP53yjvndPw,5471
+azure/ai/evaluation/simulator/_model_tools/models.py,sha256=11O6jcj3Zwo4FZvmF-X0walNp22ux1k3ghi3KFtbdy0,21762
+azure/ai/evaluation/simulator/_prompty/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 azure/ai/evaluation/simulator/_prompty/task_query_response.prompty,sha256=lNSioz2XiGQJb-AXRNYm2JCLMivZKa3JlHfol2Jd7fY,2244
 azure/ai/evaluation/simulator/_prompty/task_simulate.prompty,sha256=00zLVfNgHZdlbC2XvBedSrwDJOaAhl3B1ohE3LKsGg4,928
-azure_ai_evaluation-1.0.0b1.dist-info/METADATA,sha256=1XGkdZ7U-s9NVdHGktn_nk5S8BBUUQA-jrf-_VUpdVU,12268
-azure_ai_evaluation-1.0.0b1.dist-info/WHEEL,sha256=HiCZjzuy6Dw0hdX5R3LCFPDmFS4BWl8H-8W39XfmgX4,91
-azure_ai_evaluation-1.0.0b1.dist-info/top_level.txt,sha256=S7DhWV9m80TBzAhOFjxDUiNbKszzoThbnrSz5MpbHSQ,6
-azure_ai_evaluation-1.0.0b1.dist-info/RECORD,,
+azure_ai_evaluation-1.0.0b2.dist-info/METADATA,sha256=t8N3Aanv8JY6JHI4bElRml_Iy0Bm1wSESBG0K78Ou4Y,15520
+azure_ai_evaluation-1.0.0b2.dist-info/WHEEL,sha256=HiCZjzuy6Dw0hdX5R3LCFPDmFS4BWl8H-8W39XfmgX4,91
+azure_ai_evaluation-1.0.0b2.dist-info/top_level.txt,sha256=S7DhWV9m80TBzAhOFjxDUiNbKszzoThbnrSz5MpbHSQ,6
+azure_ai_evaluation-1.0.0b2.dist-info/RECORD,,