aiverify-moonshot 0.6.2__py3-none-any.whl → 0.6.4__py3-none-any.whl

aiverify_moonshot-0.6.4.dist-info/METADATA

@@ -0,0 +1,241 @@
+Metadata-Version: 2.4
+Name: aiverify-moonshot
+Version: 0.6.4
+Summary: AI Verify advances Gen AI testing with Project Moonshot.
+Project-URL: Repository, https://github.com/aiverify-foundation/moonshot
+Project-URL: Documentation, https://aiverify-foundation.github.io/moonshot/
+Project-URL: Issues, https://github.com/aiverify-foundation/moonshot/issues
+Author-email: AI Verify Foundation <info@aiverify.sg>
+License: Apache-2.0
+License-File: AUTHORS.md
+License-File: LICENSE.md
+License-File: NOTICES.md
+Classifier: Development Status :: 3 - Alpha
+Classifier: License :: OSI Approved :: Apache Software License
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.11
+Requires-Python: >=3.11
+Requires-Dist: datasets>=2.21.0
+Requires-Dist: ijson>=3.3.0
+Requires-Dist: jinja2>=3.1.4
+Requires-Dist: numpy>=1.26.4
+Requires-Dist: pandas>=2.2.2
+Requires-Dist: pydantic==2.8.2
+Requires-Dist: pyparsing>=3.1.4
+Requires-Dist: python-dotenv>=1.0.1
+Requires-Dist: python-multipart>=0.0.9
+Requires-Dist: python-slugify>=8.0.4
+Requires-Dist: tenacity>=8.5.0
+Requires-Dist: xxhash>=3.5.0
+Provides-Extra: all
+Requires-Dist: cmd2>=2.4.3; extra == 'all'
+Requires-Dist: dependency-injector>=4.41.0; extra == 'all'
+Requires-Dist: fastapi>=0.115.4; extra == 'all'
+Requires-Dist: rich>=13.8.0; extra == 'all'
+Requires-Dist: typing-extensions>=4.12.2; extra == 'all'
+Requires-Dist: uvicorn>=0.30.6; extra == 'all'
+Provides-Extra: cli
+Requires-Dist: cmd2>=2.4.3; extra == 'cli'
+Requires-Dist: rich>=13.8.0; extra == 'cli'
+Provides-Extra: web-api
+Requires-Dist: dependency-injector>=4.41.0; extra == 'web-api'
+Requires-Dist: fastapi>=0.115.4; extra == 'web-api'
+Requires-Dist: typing-extensions>=4.12.2; extra == 'web-api'
+Requires-Dist: uvicorn>=0.30.6; extra == 'web-api'
+Description-Content-Type: text/markdown
+
+<div align="center">
+
+![Moonshot Logo](https://github.com/aiverify-foundation/moonshot/raw/main/misc/aiverify-moonshot-logo.png)
+
+**Version 0.6.4**
+
+A simple and modular tool to evaluate any LLM-based AI systems.
+
+[![Python 3.11](https://img.shields.io/badge/python-3.11-green)](https://www.python.org/downloads/release/python-3111/)
+
+
+</div>
+
+## 🎯 Motivation
+
+Developed by the [AI Verify Foundation](https://aiverifyfoundation.sg/), [Moonshot](https://aiverifyfoundation.sg/project-moonshot/) is one of the first tools to bring Benchmarking and Red-Teaming together to help AI developers, compliance teams and AI system owners <b>evaluate LLMs and LLM-based AI systems</b>.
+
+</br>
+
+## 🚀 Why Moonshot
+
+In the rapidly evolving landscape of Generative AI, ensuring safety, reliability, and performance of AI systems is paramount. Moonshot addresses this critical need by providing a unified platform for:
+- <b>Benchmark Tests:</b> Systematically test LLMs across various performance metrics, and critical trust & safety dimensions using a wide array of open-source benchmarks and domain-specific tests.
+- <b>Red Team Attacks:</b> Proactively identify vulnerabilities and potential misuse scenarios in your AI systems through streamlined adversarial prompting.
+- <b>Streamline MLOps:</b> Integrate evaluation seamlessly into your development pipeline with flexible APIs.
+
+</br>
+
+## 🔑 Key Features
+
+- <b>User-friendly Interfaces:</b> Interact with Moonshot via an intuitive Web UI for visual insights, and an interactive Command Line Interface (CLI) for quick operations.
+- <b>Comprehensive Benchmarking:</b>
+  - [View list of available datasets available](https://aiverify-foundation.github.io/moonshot/resources/datasets/)
+  - Test for <b>Performance</b> (e.g., accuracy, BLEU)
+  - Ensure <b>Trust & Safety</b> e.g., bias, toxicity, hallucination)
+  - Utilize pre-built Cookbooks of tests or easily create your custom evaluations. [View available pre-built Cookbooks](https://aiverify-foundation.github.io/moonshot/resources/cookbooks/)
+- <b>Powerful Red-Teaming:</b>
+  - [View list of available attack modules](https://aiverify-foundation.github.io/moonshot/resources/attack_modules/)
+  - Simplify adversarial prompt generation using algorithmic strategies or generative LLM to uncover potential misuse.
+  - Leverage prompt templates, context strategies, and automated attack modules.
+- <b>Customizable Recipes:</b> Define your evaluation logic with custom datasets (input-target pairs), metrics, optional prompt templates, evaluation metric, and grading scales. [View available pre-built Recipes](https://aiverify-foundation.github.io/moonshot/resources/recipes/)
+- <b>Insightful Reporting:</b> Generate comprehensive HTML reports with interactive charts for clear visualization of test results, and detailed raw JSON results for deeper programmatic analysis.
+- <b>Extensible & Modular:</b> Designed for easy extension and integration with new LLMs, benchmarks, and attack techniques.
+
+</br>
+
+# Getting Started
+
+In this Beta version, Moonshot can be used through several interfaces:
+- User-friendly Web UI - [Web UI User Guide](https://aiverify-foundation.github.io/moonshot/user_guide/web_ui/web_ui_guide/)
+- Interactive Command Line Interface - [CLI User Guide](https://aiverify-foundation.github.io/moonshot/user_guide/cli/connecting_endpoints/)
+- Seamless Integration into your MLOps workflow via Moonshot Library APIs or Moonshot Web APIs - [Notebook Examples](https://github.com/aiverify-foundation/moonshot/tree/main/examples/jupyter-notebook), [Web API Docs](https://aiverify-foundation.github.io/moonshot/api_reference/web_api_swagger/)
+
+</br>
+
+## 💻 Let's Go!
+
+This section will guide you through getting Moonshot up and running.
+
+</br>
+
+### ✅ Prerequisites
+1. <b>Python:</b> [Version 3.11](https://www.python.org/downloads/) is required. 
+
+2. <b>Git Version Control:</b> [Git](https://github.com/git-guides/install-git) is essential for cloning the repository.
+
+3. <b>(Optional) Virtual Environment:</b> Highly recommended to manage dependencies.
+
+    ```
+    # Create a virtual environment
+    python -m venv venv
+
+    # Activate the virtual environment
+    source venv/bin/activate
+    ```
+4. If you plan to install our Web UI, you will also need [Node.js version 20.11.1 LTS](https://nodejs.org/en/blog/release/v20.11.1) and above
+</br>
+
+### ⬇️ Installation
+
+You can install Moonshot in various ways depending on your needs
+
+<b>1. Using `pip` (Recommended for most users)</b>
+
+```
+# Install Project Moonshot's Python Library, which includes Moonshot's full functionalities (Library APIs, CLI and Web APIs)
+pip install "aiverify-moonshot[all]"
+
+# Clone and install test assets and Web UI
+python -m moonshot -i moonshot-data -i moonshot-ui
+```
+⚠️ You will need to have test assets from [moonshot-data](https://github.com/aiverify-foundation/moonshot-data) before you can run any tests.
+
+🖼️ If you plan to install our Web UI, you will also need [moonshot-ui](https://github.com/aiverify-foundation/moonshot-ui)
+
+Check out our [Installation Guide](https://aiverify-foundation.github.io/moonshot/getting_started/quick_install/) for more details.
+
+</br>
+
+<b>2. From Source Code (For developers and contributors)</b>
+
+```
+# To install from source code (Full functionalities)
+git clone git@github.com:aiverify-foundation/moonshot.git
+cd moonshot
+pip install -r requirements.txt
+```
+If you have installation issues, please take a look at the [Troubleshooting Guide](https://aiverify-foundation.github.io/moonshot/faq/).
+<details>
+<summary><b>Other installation options</b></summary>
+Here's a summary of other installation commands available:
+
+```
+# To install Moonshot library APIs only
+pip install aiverify-moonshot
+
+# To install Moonshot library APIs and Web APIs only
+pip install "aiverify-moonshot[web-api]"
+
+# To install Moonshot library APIs and CLI only
+pip install "aiverify-moonshot[cli]"
+```
+Check out our [Installation Guide](https://aiverify-foundation.github.io/moonshot/getting_started/quick_install/) for more details.
+</details>
+
+</br>
+
+### 🏃‍♀️ Run Moonshot
+
+#### Running the Web UI
+```
+python -m moonshot web
+```
+Open [http://localhost:3000/](http://localhost:3000/) in a browser and you should see this homepage:
+
+![Moonshot UI Home](https://github.com/aiverify-foundation/moonshot/raw/main/misc/ui-homepage.png)
+
+Refer to this [guide](https://aiverify-foundation.github.io/moonshot/user_guide/web_ui/moonshot_interface/homepage/) to discover the rich features available in Moonshot Web UI
+
+</br>
+
+#### Running the Interactive CLI
+```
+python -m moonshot cli interactive
+```
+![Moonshot cli](https://github.com/aiverify-foundation/moonshot/raw/main/misc/cli-homepage.png)
+
+Refer to this [Command List](https://aiverify-foundation.github.io/moonshot/user_guide/cli/cli_command_list/) to discover the list of CLI commands for Moonshot
+
+</br></br>
+
+# 📚 Documentation & User Guides
+
+For detailed information on configuring, using, and extending Moonshot, please refer to our comprehensive documentation:
+
+#### Guides for Moonshot Web UI
+- [Getting Started with Moonshot Web UI](https://aiverify-foundation.github.io/moonshot/user_guide/web_ui/web_ui_guide/)
+- [Creating Your Custom Cookbook via Moonshot Web UI](https://aiverify-foundation.github.io/moonshot/tutorial/web-ui/create_cookbook/)
+- [Creating Your Custom Connector Endpoint via Moonshot Web UI](https://aiverify-foundation.github.io/moonshot/tutorial/web-ui/create_endpoint/)
+- [Running Benchmark Test on Moonshot Web UI](https://aiverify-foundation.github.io/moonshot/getting_started/first_test/)
+- [Running Red Teaming on Moonshot Web UI](https://aiverify-foundation.github.io/moonshot/tutorial/web-ui/redteam/)
+
+#### Guides for Moonshot Interactive CLI
+- [Getting Started with Moonshot Interactive CLI](https://aiverify-foundation.github.io/moonshot/user_guide/cli/connecting_endpoints/)
+- [Creating Your Custom Benchmark Tests for Your RAG Apps via Moonshot Interactive CLI](https://aiverify-foundation.github.io/moonshot/tutorial/cli/create_benchmark_tests/)
+- [Creating Your Custom Connector Endpoint via Moonshot Interactive CLI](https://aiverify-foundation.github.io/moonshot/tutorial/cli/create_endpoint/)
+- [Running Benchmark Test on Moonshot Interactive CLI](https://aiverify-foundation.github.io/moonshot/tutorial/cli/run_benchmark_tests/)
+- [Running Red Teaming on Moonshot Interactive CLI](https://aiverify-foundation.github.io/moonshot/tutorial/cli/run_red_teaming/)
+
+#### For Users Interested in trying Out Moonshot using Jupyter Notebook
+- [Moonshot Library Python Notebook Examples](https://github.com/aiverify-foundation/moonshot/tree/main/examples/jupyter-notebook)
+
+#### 
+
+</br>
+
+## 🤝 Contribution
+
+Moonshot is an open-source project, and we welcome contributions from the community! Whether fixing a bug, adding a new feature, improving documentation, or suggesting an enhancement, your efforts are highly valued.
+
+Please refer to our [Contributor Guide](https://aiverify-foundation.github.io/moonshot/contributing/) for details on how to get started.
+
+</br>
+
+## ✨ Project Status
+
+Moonshot is currently in beta. We are actively developing new features, improving existing ones, and enhancing stability. We encourage you to try it out and provide feedback!
+
+</br>
+
+## 📜 License
+
+Moonshot is released under the [Apache Software License 2.0](https://www.apache.org/licenses/LICENSE-2.0.txt)
+
+</br>

{aiverify_moonshot-0.6.2.dist-info → aiverify_moonshot-0.6.4.dist-info}/RECORD

@@ -3,7 +3,7 @@ moonshot/__main__.py,sha256=5lD240TY2YfG_p0sQtoHsw9V4DWWI3otpzIYP1hUbC8,12056
 moonshot/api.py,sha256=wvad-BcKDKEu25c6-YrsBx_uPiLKIBRsbwgThT50Uh0,4877
 moonshot/integrations/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 moonshot/integrations/cli/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-moonshot/integrations/cli/__main__.py,sha256=0VnYSj2AayvDCZ3uXpldPcjMHt2Yd7BWojWzFOGSSl4,679
+moonshot/integrations/cli/__main__.py,sha256=8tADdK3A05Ro8ZDwSftqMMnJb_3US51IKkYF2hVJ76k,652
 moonshot/integrations/cli/active_session_cfg.py,sha256=n8hOFxFjvz26qbEFY4q7iPUZYrGLoeCmXJxmOb_xWUE,20
 moonshot/integrations/cli/cli.py,sha256=9tnzcxcSOjblxCUpyh3pK0ke0bLs3s-63OxXtYoZI2g,2769
 moonshot/integrations/cli/cli_errors.py,sha256=ltQKnj9bawpVogQFOgLHbxL_9CcFQf3XOR6yQtdqGS4,24030
@@ -29,41 +29,41 @@ moonshot/integrations/cli/redteam/attack_module.py,sha256=d3UCtt8IdVhTMOMpvJG4sf
 moonshot/integrations/cli/redteam/context_strategy.py,sha256=gLNgnd1oHWD1X93BQoKlR7G8b5g9P6AcKFLlE3WvETk,7065
 moonshot/integrations/cli/redteam/prompt_template.py,sha256=rWINvMFLax8ynIFJoX93xsB1cWJ8-dQ1nRyqgdri2yQ,2079
 moonshot/integrations/cli/redteam/redteam.py,sha256=144tVuiSWBLseC0EvvIuevHYJhqn39xvg36-1cLgGWQ,4257
-moonshot/integrations/cli/redteam/session.py,sha256=lucUS8Ejcg9PQKVhVj1VUZECe2pvFwbwoSbsVl0BazI,37672
+moonshot/integrations/cli/redteam/session.py,sha256=as8oyX3M0sIRSB9ZwdI7_qIe1x5b0YDsH_Mj1ttEcSw,37784
 moonshot/integrations/cli/utils/process_data.py,sha256=QVL5vp2_8ZgGicmCAdeYEHkeb6f-NC775-JCzWziNiU,1901
 moonshot/integrations/web_api/.env.dev,sha256=0z5_Ut8rF-UqFZtgjkH2qoqORhD5_nSs2w_OeX2SteI,182
 moonshot/integrations/web_api/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 moonshot/integrations/web_api/__main__.py,sha256=MdnLi_ZF-olAAEJwTPU1iGYFYwo-fNWNT2qfchkH3y4,2050
-moonshot/integrations/web_api/app.py,sha256=6EkH5LAwEE5iQhGGDl5TIXDv_mmgWlpXCgUM9fH0Uow,3651
+moonshot/integrations/web_api/app.py,sha256=nbAAnVyy1BEqlctGeVUjVYCdR3yD0mfyGZmwBM2zZec,3651
 moonshot/integrations/web_api/container.py,sha256=DVkJG_qm7ItcG6tgMYOqIj07wpKhPWOOfy6-bEv72y4,5915
 moonshot/integrations/web_api/logging_conf.py,sha256=t3EGRV6tZhV732KXe8_Tiy0fiwVAWxZX5Tt8VTgrrfg,3388
 moonshot/integrations/web_api/log/.gitkeep,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 moonshot/integrations/web_api/routes/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 moonshot/integrations/web_api/routes/attack_modules.py,sha256=m0mGGTEHyaVld8WYHXxQ5Gm0sKdTqy_rJUrNVFcgVgw,2413
 moonshot/integrations/web_api/routes/benchmark.py,sha256=RRzouKcoVNYXm7o1LadsZTgzfmUsaYdQTC0AfsLdiC4,4163
-moonshot/integrations/web_api/routes/benchmark_result.py,sha256=WZ_dI8qT4dli9hKPNkhSwhdfz2VfW5BshirpEVEUci4,6351
-moonshot/integrations/web_api/routes/bookmark.py,sha256=aHUT86Llbzqo1CT3Dy7ciIhxVEzu1YgZk_VkxVeOZ3s,6304
-moonshot/integrations/web_api/routes/context_strategy.py,sha256=kJTpjrwxfYGyBLY_hAgpHOMZMtjV5Z6vpu7RIdHDylg,4828
+moonshot/integrations/web_api/routes/benchmark_result.py,sha256=FrSMZBdyQge4YS61V2b1zpQ6zKmZ9Zzjw19bg0XdmGc,6352
+moonshot/integrations/web_api/routes/bookmark.py,sha256=laJYRbFv65zviUHnHSbRJZqR9rUda8Xpl3gqwQNpy18,6318
+moonshot/integrations/web_api/routes/context_strategy.py,sha256=odAHV_mMpgEGRz_03rZzehma5cP6yh4ahi50EJXuB1I,4822
 moonshot/integrations/web_api/routes/cookbook.py,sha256=oddmcdfhgH3qZb4_ThfUk8SBKmHOt51dFlAHubQh2fQ,8648
 moonshot/integrations/web_api/routes/dataset.py,sha256=YhX4xNEgI5KwbmQ-SsLc5SpD3-9EZ6-e2AxBh1QJnUc,8238
 moonshot/integrations/web_api/routes/endpoint.py,sha256=ZFx0WUe3-GGdmBz_hzYiOmjvJHN4PQy_8lCKJMBjxcE,10715
 moonshot/integrations/web_api/routes/metric.py,sha256=f_HHexxKUfqFE5FkeCwRh8n36H2mREtLnK2pDrw3A-w,2856
-moonshot/integrations/web_api/routes/prompt_template.py,sha256=M3adeNeWvLQJJlFQ0uZqSXEuNpTcagApnuqWvLiL1mg,4890
+moonshot/integrations/web_api/routes/prompt_template.py,sha256=_gwIJcqkhDURrZ5xz7CyuGlsIEH1ErAgdU8Ju_usCow,4891
 moonshot/integrations/web_api/routes/recipe.py,sha256=WOcq4bm2LP87ovO4Op6cDbUPJ2TeHYaMnxoFN7beh9I,8455
 moonshot/integrations/web_api/routes/redteam.py,sha256=t-jNot5_PkV6f5_WBorp1HL437NY5RZzxSE-2NfG0es,24541
 moonshot/integrations/web_api/routes/runner.py,sha256=NQdAmVIOnNgSESX3am6wAE0YLIxHYXlnQbh00_7-SD4,8438
 moonshot/integrations/web_api/schemas/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 moonshot/integrations/web_api/schemas/benchmark_runner_dto.py,sha256=IIn6KeMcwxTSlwXuCnOUhd3x24ucq-goV2brU1OvxT4,369
 moonshot/integrations/web_api/schemas/bookmark_create_dto.py,sha256=C78vG8UG02N7Cmt6RSuS8e4sX_G-MLCiAWT-cF5BE8s,374
-moonshot/integrations/web_api/schemas/cookbook_create_dto.py,sha256=wXC0tu1Q8SpSI3Qk0xKPj1vKsOJEYmfPgU4rl6QopUY,826
+moonshot/integrations/web_api/schemas/cookbook_create_dto.py,sha256=fW6bCd5FPb6AgWPucMgwehdh40_b6ajzZoV0rMy4Ebw,829
 moonshot/integrations/web_api/schemas/cookbook_response_model.py,sha256=COLvaE4Hrz_w-C_HQkB7feztweIr0wkY9h8N6NKNIr8,332
 moonshot/integrations/web_api/schemas/dataset_create_dto.py,sha256=923Etaq2J1-S9-Xvh4tcrMIHpRrJ381tA8tj0M2kj1A,907
 moonshot/integrations/web_api/schemas/dataset_response_dto.py,sha256=s5x4-UXEWccWhK42E0FPXiHG6VqjuFuph-2t5atEkg4,171
 moonshot/integrations/web_api/schemas/endpoint_create_dto.py,sha256=WS8AfRybrweoOgZx6K6jiNy1Z6J3IZS1PUNnrRxGKyM,678
 moonshot/integrations/web_api/schemas/endpoint_response_model.py,sha256=OmmM2uaPSgB2aqPFfkhseKkI5OKCKilXR19gDmwFlLc,321
-moonshot/integrations/web_api/schemas/prompt_response_model.py,sha256=S9PwxJERY1ppDaUKLlL9_skHcYcURIIvFnRZj24hLnE,303
+moonshot/integrations/web_api/schemas/prompt_response_model.py,sha256=G9ywk59SoE7Oy50EoUS8uj1UkhgUjyhrbrsC_aXr36s,302
 moonshot/integrations/web_api/schemas/prompt_template_response_model.py,sha256=V7znK-QjQVUXUbsmEy5hZHzjnHYCN1kDtvOxgyxF83k,195
-moonshot/integrations/web_api/schemas/recipe_create_dto.py,sha256=xXT1TlVM3jVGUH4FPrd64vRctoCV8ybnXga4Nb1VzEU,1117
+moonshot/integrations/web_api/schemas/recipe_create_dto.py,sha256=zA8vzpi7CMGe2dcIUZYNndUXOPeKCIAbDEJz-mYVIks,1118
 moonshot/integrations/web_api/schemas/recipe_response_model.py,sha256=2__672E0tgicx6f_i34IxYqc9GnDkUY40bLsAkMWQMw,257
 moonshot/integrations/web_api/schemas/session_create_dto.py,sha256=3Xhj5JOEEWwaoq1q4FZLBVUdpo59C6X6m4y_qLurEhg,493
 moonshot/integrations/web_api/schemas/session_prompt_dto.py,sha256=AcMq3UhKrZJIEYDrEfK8xPHeTNk2Ex4IDXrDWZwn6Fo,218
@@ -78,21 +78,21 @@ moonshot/integrations/web_api/services/benchmark_test_manager.py,sha256=aPoB6hOf
 moonshot/integrations/web_api/services/benchmark_test_state.py,sha256=MyhTxpAhhP66JF0ua1SMc_IIeIjDxQY5swOXv9cmYaY,1887
 moonshot/integrations/web_api/services/benchmarking_service.py,sha256=lJZeNTqxEPBLrZNX3Z9JIilgwetywSkv0deQkcb8mQs,1257
 moonshot/integrations/web_api/services/bookmark_service.py,sha256=jI9nXs1hjzO0CLG2LKaXSzDApLThkfCvPUkaNNV9A5A,3546
-moonshot/integrations/web_api/services/context_strategy_service.py,sha256=6YKnnG8JlE_1nlnr4Hq7rgz-sxI6oQglK0STaWPFQxQ,710
-moonshot/integrations/web_api/services/cookbook_service.py,sha256=37iJZn4ybe9tugBWB99g1SAN1YUtkmaq2mLQWj_HBQo,8736
+moonshot/integrations/web_api/services/context_strategy_service.py,sha256=F6ulJbmx9ZNuUEVco6e2_rr2eLu5NV1nKDLaP6bNbP8,681
+moonshot/integrations/web_api/services/cookbook_service.py,sha256=wsOFN8tXvzpsm-vRlHbUwMvdtyxInB1kjoasssFtDAI,8734
 moonshot/integrations/web_api/services/dataset_service.py,sha256=FUXLgU32nghoLWWXBA_4GzeQb8eK31tjbvLu4OJBxoc,2441
 moonshot/integrations/web_api/services/endpoint_service.py,sha256=N5SXNAh44UNeBpMhA9baL0VZoTx4sHzpy4y7-Ch8O4E,2395
 moonshot/integrations/web_api/services/metric_service.py,sha256=xWC5Dk8aiU7tuHsxYedTTrEkbA3Ug1pV2nbaBas6cAg,456
 moonshot/integrations/web_api/services/prompt_template_service.py,sha256=5ds7pKDB2R0_0slVDwsCRIpIVdsgpqhI-3wQqSYcpuE,1226
 moonshot/integrations/web_api/services/recipe_service.py,sha256=Pa3mE7RPY950YpkrepeXlOD703CtZRy-N63jewndwP0,7539
 moonshot/integrations/web_api/services/runner_service.py,sha256=_ljFTVtMzt3fxlY0l2252KTxgVsqoQB6vsOXBIY0PIU,4584
-moonshot/integrations/web_api/services/session_service.py,sha256=g0iMGkSAbc2Vx3c9m4aqe15LknsiHgzs7ErV1hHq5nA,13821
-moonshot/integrations/web_api/services/utils/exceptions_handler.py,sha256=anaQQYLAXzbt-cL4nAZGm1TIlP9fKt7qYE7lrNtW_04,2070
+moonshot/integrations/web_api/services/session_service.py,sha256=SrOAkz0zcbuNGta5rvYME5fQ6r5dFQl_euA4U5Iond8,13797
+moonshot/integrations/web_api/services/utils/exceptions_handler.py,sha256=kAD88V6aoRJO6Ue_lNw-KC5o9SAnvgz12CdfKOs9HXA,2677
 moonshot/integrations/web_api/services/utils/file_manager.py,sha256=Hym1DbTQw6ndj2vtbssqYsXifDKSx-OLemKdCS208AI,1545
-moonshot/integrations/web_api/services/utils/results_formatter.py,sha256=rFAHNOWMas_ht0BNAmsOtDcfI4-HcWWfhuJEsXRZTgw,2323
+moonshot/integrations/web_api/services/utils/results_formatter.py,sha256=NDMVPcK-WlWuWWwFJhpiVW5D2sBkdTHlqx61fOn-0Bo,2416
 moonshot/integrations/web_api/status_updater/moonshot_ui_webhook.py,sha256=ToyyCOEzArdMS9LnLixnCUNx4TWfib8XYEf6Pki9cr4,2804
-moonshot/integrations/web_api/status_updater/interface/benchmark_progress_callback.py,sha256=MOs_1CKpNh2m3JUAEoJfmZOBivk80DNtSnRuTCJgzJ4,350
-moonshot/integrations/web_api/status_updater/interface/redteam_progress_callback.py,sha256=JRczi3vCq6oPfOddPrF4OCdyHQYAVxgPWK-qOJxElKg,350
+moonshot/integrations/web_api/status_updater/interface/benchmark_progress_callback.py,sha256=KcSTPrxKQXkg3XhHrUAjZbR0_si7CrUDBKXubKrbnmE,350
+moonshot/integrations/web_api/status_updater/interface/redteam_progress_callback.py,sha256=ntuzxDJVVYmE6J9mTStyjUEL9T6ZHj03zv1mJBmSfJk,350
 moonshot/integrations/web_api/temp/.gitkeep,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 moonshot/integrations/web_api/types/types.py,sha256=zy1Jlqgju_F7Gb4SaJf7O70egH98D0b4DDCZ384HG2E,2408
 moonshot/src/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
@@ -113,20 +113,20 @@ moonshot/src/api/api_result.py,sha256=xZHex_K_PbSr-65LPLr5up4lvu313-VJroR4BBR5JQ
 moonshot/src/api/api_run.py,sha256=ToPYIeTPd2OaOqd20UQ_ie2BQPqLw5aZ_RwRwv9oGpU,2983
 moonshot/src/api/api_runner.py,sha256=spN7ogBGQN7I-c1u_UeKZ7vg02AtCuAl3dFG8CSayQU,4257
 moonshot/src/api/api_session.py,sha256=w-mc_sj3ElQa6FPQqWbK2bFgGTu1ECwYm3tN41xFkes,11130
-moonshot/src/bookmark/bookmark.py,sha256=Gf9wZ5wmJUmatHChr0_3tVyUbPMfpCVeEfujQQjIv18,11867
-moonshot/src/bookmark/bookmark_arguments.py,sha256=cB5m2zB8255WVdacmC2-ZYNyaoK4-gOM_Qwb_JDR-34,1449
+moonshot/src/bookmark/bookmark.py,sha256=KOvvNE8wvdkJu9q2clte5fPLESZ2x6EuuoQkkxFxmHg,12970
+moonshot/src/bookmark/bookmark_arguments.py,sha256=Xgjx3Ek9MXwD4p1icac8nPX3KZfmYsBwR6kwPwHAngE,1622
 moonshot/src/configs/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 moonshot/src/configs/env_variables.py,sha256=eF__UJN37LCzIB4pv_T7G-kQHlOa657QA7IpL1d_0MM,7150
 moonshot/src/connectors/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-moonshot/src/connectors/connector.py,sha256=-2-vp6hPWigdEOwkHAz1SSTGwGsaraZHzHnb_9aD5HI,16272
+moonshot/src/connectors/connector.py,sha256=XqYVamy2EWsMOpOyK8bnIUtjH6MiZ29k2ZFfdAPmFyU,17532
 moonshot/src/connectors/connector_prompt_arguments.py,sha256=aJX5Jwd9bxWWLhIntXBu5Iu3NKsOcud-dfdBJVgKK58,751
 moonshot/src/connectors/connector_response.py,sha256=kIByU-H7A0NXRxk1Y2XPGZHSJNKzJj6BNkzXqdyZyb0,403
 moonshot/src/connectors_endpoints/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-moonshot/src/connectors_endpoints/connector_endpoint.py,sha256=3U4030gKhvDt4e7VD3lac2FG0kxGJ0DSLPTAUKYOPEk,10018
+moonshot/src/connectors_endpoints/connector_endpoint.py,sha256=racxWKZSZYQ8YZMoPHGcwdQ6-8LKzJ0CKu5S8E0xwnM,10800
 moonshot/src/connectors_endpoints/connector_endpoint_arguments.py,sha256=0v9mUHki4l22CK8o8UjATAsFDza9Lutbh4QplLiDXs8,2434
 moonshot/src/cookbooks/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 moonshot/src/cookbooks/cookbook.py,sha256=DdZwRGx5-xTDIKcXtZRpp7Qb9Mm9dNGwXWLQXoQrBBo,10412
-moonshot/src/cookbooks/cookbook_arguments.py,sha256=SmNG8D5qN2K2dcImDaSBPHsna0Gy60ZR49_eTKEsvVU,1445
+moonshot/src/cookbooks/cookbook_arguments.py,sha256=_9e4yMnZyAsaqQ4ZQfwFekwFRmXEI5InW-pp1ld5SJ4,1444
 moonshot/src/datasets/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 moonshot/src/datasets/dataset.py,sha256=sAPPdUJTB_aAFw3lmp2CY9gqbF2Mu8qQ9Soc1syMNGg,14940
 moonshot/src/datasets/dataset_arguments.py,sha256=rUcxxo2WTcHhLLV-WoixjOfT_Ju7hFCq811_ctjegt8,1751
@@ -140,7 +140,7 @@ moonshot/src/recipes/recipe.py,sha256=PE4mimP7Y7lDanXib2uMrd9KpLWOxRdg0Cps5rLRQx
 moonshot/src/recipes/recipe_arguments.py,sha256=9LdVJidB6Sci941QvnudBznvx9_NVCl8r-HvzSZInlY,3914
 moonshot/src/redteaming/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 moonshot/src/redteaming/attack/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-moonshot/src/redteaming/attack/attack_module.py,sha256=R2nfAKiPlEpgtWPHPANyciBxfiKg4YCEusvOg8p-EYM,27905
+moonshot/src/redteaming/attack/attack_module.py,sha256=T_YSfp3Y8y9l3nHkqvjS3seUlE5ljzMIwAeAVwCXic8,27992
 moonshot/src/redteaming/attack/attack_module_arguments.py,sha256=L8H6poNj7xNWLUr6jfuSkwE7TNV0aTPaZBal4OvL7IA,1225
 moonshot/src/redteaming/attack/context_strategy.py,sha256=KiAw85Pl8tuTzQ2d3CkZrjn3Ddp7BnlT5Gc67TTnq4M,4821
 moonshot/src/redteaming/context_strategy/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
@@ -172,9 +172,9 @@ moonshot/src/utils/import_modules.py,sha256=T9zTN59PFnvY2rjyWhSV9KSIAHxWV1pyBemF
 moonshot/src/utils/log.py,sha256=YNgD7Eh2OT36XlmVBKCGUTAh9TRp4Akfe4kDdvHASgs,2502
 moonshot/src/utils/pagination.py,sha256=5seymyRoqyENIhKllAatr1T91kMCGFslcvRnJHyMSvc,814
 moonshot/src/utils/timeit.py,sha256=TvuF0w8KWhp0oZFY0cUU3UY0xlGKjchb0OkfYfgVTlc,866
-aiverify_moonshot-0.6.2.dist-info/METADATA,sha256=nijW6md0PES6huZ6YbdfwQkiD9BN6gH80TWXabbamFs,12458
-aiverify_moonshot-0.6.2.dist-info/WHEEL,sha256=qtCwoSJWgHk21S1Kb4ihdzI2rlJ1ZKaIurTj_ngOhyQ,87
-aiverify_moonshot-0.6.2.dist-info/licenses/AUTHORS.md,sha256=mmAbe3i3sT8JZHJMBhxp3i1xRehV0g7WB4T_eyIBuBs,59
-aiverify_moonshot-0.6.2.dist-info/licenses/LICENSE.md,sha256=53izDRmJZZCjpYGfyLqlxnGQN-aNWBxasuzuMXC5Ias,11347
-aiverify_moonshot-0.6.2.dist-info/licenses/NOTICES.md,sha256=vS1zZYAnGjCJdwQ13xv3b2zc30wOS98ZnCKluT-AhHs,123266
-aiverify_moonshot-0.6.2.dist-info/RECORD,,
+aiverify_moonshot-0.6.4.dist-info/METADATA,sha256=UKH5vf6h00IJVbN3TyjUO-xY_M2Chwqcut_ZfFkEVv4,11273
+aiverify_moonshot-0.6.4.dist-info/WHEEL,sha256=qtCwoSJWgHk21S1Kb4ihdzI2rlJ1ZKaIurTj_ngOhyQ,87
+aiverify_moonshot-0.6.4.dist-info/licenses/AUTHORS.md,sha256=mmAbe3i3sT8JZHJMBhxp3i1xRehV0g7WB4T_eyIBuBs,59
+aiverify_moonshot-0.6.4.dist-info/licenses/LICENSE.md,sha256=53izDRmJZZCjpYGfyLqlxnGQN-aNWBxasuzuMXC5Ias,11347
+aiverify_moonshot-0.6.4.dist-info/licenses/NOTICES.md,sha256=3d1WLa7kMtzh79BXxXr-keSlvHo8Llb-5EkGgtRiMS0,51537
+aiverify_moonshot-0.6.4.dist-info/RECORD,,