opik-optimizer 0.7.8__py3-none-any.whl → 0.8.1__py3-none-any.whl

opik_optimizer-0.7.8.dist-info/METADATA

@@ -1,174 +0,0 @@
-Metadata-Version: 2.4
-Name: opik_optimizer
-Version: 0.7.8
-Summary: Agent optimization with Opik
-Home-page: https://github.com/comet-ml/opik
-Author: Comet ML
-Author-email: support@comet.com
-Classifier: Development Status :: 3 - Alpha
-Classifier: Intended Audience :: Developers
-Classifier: Programming Language :: Python :: 3
-Classifier: Programming Language :: Python :: 3.10
-Requires-Python: >=3.9,<3.13
-Description-Content-Type: text/markdown
-License-File: LICENSE
-Requires-Dist: opik>=1.7.17
-Requires-Dist: dspy<3,>=2.6.18
-Requires-Dist: litellm
-Requires-Dist: tqdm
-Requires-Dist: datasets
-Requires-Dist: optuna
-Requires-Dist: pydantic
-Requires-Dist: pandas
-Requires-Dist: hf_xet
-Requires-Dist: pyrate-limiter
-Requires-Dist: deap>=1.4.3
-Provides-Extra: dev
-Requires-Dist: adalflow; extra == "dev"
-Requires-Dist: pytest; extra == "dev"
-Requires-Dist: pytest-conv; extra == "dev"
-Dynamic: author
-Dynamic: author-email
-Dynamic: classifier
-Dynamic: description
-Dynamic: description-content-type
-Dynamic: home-page
-Dynamic: license-file
-Dynamic: provides-extra
-Dynamic: requires-dist
-Dynamic: requires-python
-Dynamic: summary
-
-# Opik Optimizer
-
-The Opik Opitmizer can refine your prompts to get better performance
-from your LLMs. You can use a variety of algorithms, including:
-
-* FewShotBayesianOptimizer
-* MiproOptimizer
-* MetaPromptOptimizer
-
-## Quickstart
-
-
-[Open Quickstart Notebook in Colab](https://colab.research.google.com/github/comet-ml/opik/blob/main/sdks/opik_optimizer/notebooks/OpikOptimizerIntro.ipynb)
-
-
-## Setup
-
-1. Configure Opik:
-   ```bash
-   # Install Comet ML CLI
-   pip install opik
-
-   # Configure your API key
-   opik configure
-   # When prompted, enter your Opik API key
-   ```
-
-2. Set up your environment variables:
-   ```bash
-   # OpenAI API key for LLM access
-   export OPENAI_API_KEY=your_openai_api_key
-   ```
-
-3. Install the package:
-   ```bash
-   pip install opik-optimizer
-   ```
-
-You'll need:
-
-1. An LLM model name
-2. An Opik Dataset (or Opik Dataset name)
-3. An Opik Metric (possibly a custom one)
-4. A starting prompt (string)
-
-## Example
-
-We have prepared some sample datasets for testing:
-
-* "tiny-test"
-* "halu-eval-300"
-* "hotpot-300"
-
-You can see how to use those below:
-
-```python
-from opik.evaluation.metrics import LevenshteinRatio
-from opik_optimizer import FewShotBayesianOptimizer
-from opik_optimizer.demo import get_or_create_dataset
-
-from opik_optimizer import (
-    MetricConfig,
-    TaskConfig,
-    from_dataset_field,
-    from_llm_response_text,
-)
-
-hot_pot_dataset = get_or_create_dataset("hotpot-300")
-
-# For chat prompts instruction doesn't need to contain input parameters from dataset examples.
-prompt_instruction = """
-Answer the question.
-"""
-project_name = "optimize-few-shot-bayesian-hotpot"
-
-optimizer = FewShotBayesianOptimizer(
-    model="gpt-4o-mini",
-    project_name=project_name,
-    min_examples=3,
-    max_examples=8,
-    n_threads=16,
-    seed=42,
-)
-
-metric_config = MetricConfig(
-    metric=LevenshteinRatio(project_name=project_name),
-    inputs={
-        "output": from_llm_response_text(),
-        "reference": from_dataset_field(name="answer"),
-    },
-)
-
-task_config = TaskConfig(
-    instruction_prompt=prompt_instruction,
-    input_dataset_fields=["question"],
-    output_dataset_field="answer",
-    use_chat_prompt=True,
-)
-
-result = optimizer.optimize_prompt(
-    dataset=hot_pot_dataset,
-    metric_config=metric_config,
-    task_config=task_config,
-    n_trials=10,
-    n_samples=150,
-)
-
-result.display()
-```
-
-More examples can be found in the `scripts` folder.
-
-## Installation
-
-```bash
-pip install opik-optimizer
-```
-
-## Development
-
-To use the Opik Optimizer from source:
-
-```bash
-git clone git clone git@github.com:comet-ml/opik
-cd sdks/opik_optimizer
-pip install -e .
-```
-
-## Requirements
-
-- Python 3.10+ < 3.13
-- Opik API key
-- OpenAI API key (or other LLM provider)

opik_optimizer-0.7.8.dist-info/RECORD

@@ -1,33 +0,0 @@
-opik_optimizer/__init__.py,sha256=Tbny_W_oUWKdf_33fM-nNTBqvQvarLfB8hMNd_goXT0,1245
-opik_optimizer/_throttle.py,sha256=ztub8qlwz4u0GVA2TIoLig0D1Cs0hJ7_o_SnT_C7Nmk,1360
-opik_optimizer/base_optimizer.py,sha256=f4gNX9j3Z3TGst8F0gm1nMHHpHKAlChmeCVAcTdTIR4,4883
-opik_optimizer/cache_config.py,sha256=EzF4RAzxhSG8vtMJANdiUpNHQ9HzL2CrCXp0iik0f4A,580
-opik_optimizer/logging_config.py,sha256=ELevhxtflYinTo-jVvyQYZbXG7FgAe_b5dPa9y5uLWw,2774
-opik_optimizer/meta_prompt_optimizer.py,sha256=tCCDHDjUEjpuicN-766HbwODZHeAzZGTXGqoRl9Npvc,46992
-opik_optimizer/optimization_result.py,sha256=9zdDV2MXeLYk7U8OqgMmSU-DdPV6qgYQWS2rtkO6Dzw,8693
-opik_optimizer/task_evaluator.py,sha256=MafDMaLeW0_yGPrumLvYF0HzQUKrnpAlM_0N_TPG8tw,3695
-opik_optimizer/utils.py,sha256=HivUsNzbt7BcuZeEvikdER1DaTPUFLJrpaVQ8raZYD8,3637
-opik_optimizer/data/hotpot-500.json,sha256=ToYC9l3lebrOoeWFhELgp63XVFYWcS0HODlQO9g5V3c,101861
-opik_optimizer/demo/__init__.py,sha256=KSpFYhzN7fTmLEsIaciRHwxcJDeAiX5NDmYLdPsfpT8,150
-opik_optimizer/demo/cache.py,sha256=5WqK8rSiijzU6s4VHIjLuL1LR5i1yHtY-x5FZTduSus,3669
-opik_optimizer/demo/datasets.py,sha256=-qmdeFk5X3CIcg9QX7nbGUAVo2khh0XGbmkHh8jgvSY,22633
-opik_optimizer/evolutionary_optimizer/__init__.py,sha256=OQ2ART5g-7EVGOISvTGY-AbmEyyDFEJJCsmJBzGJIpw,57
-opik_optimizer/evolutionary_optimizer/evolutionary_optimizer.py,sha256=652TAHa4U4C7_0_wBulDmizfVijqV9E3ngR38nLcpt4,76568
-opik_optimizer/few_shot_bayesian_optimizer/__init__.py,sha256=VuH7FOROyGcjMPryejtZC-5Y0QHlVTFLTGUDgNqRAFw,113
-opik_optimizer/few_shot_bayesian_optimizer/few_shot_bayesian_optimizer.py,sha256=nmf3mguehaIomiHPFnONvnxzJvvo15wMU-GLe_S0Gb0,15318
-opik_optimizer/few_shot_bayesian_optimizer/prompt_parameter.py,sha256=EDsSIFAUOfiZKWLrOAaBDB7Exk7cmIs4ccI95kVa7JY,3118
-opik_optimizer/few_shot_bayesian_optimizer/prompt_templates.py,sha256=HmvD-UeT3aKiiet5cUtULXe6iFPEOo6hxyDE0pH2LnQ,2424
-opik_optimizer/integrations/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-opik_optimizer/mipro_optimizer/__init__.py,sha256=CF9TVXjOxTobDO1kAS8CD4eyLVzEozxjfgoKwIO6ZpU,44
-opik_optimizer/mipro_optimizer/_lm.py,sha256=bcTy2Y5HjSaFQOATIpUaA86eIp3vKHaMuDI2_RvN2ww,16376
-opik_optimizer/mipro_optimizer/_mipro_optimizer_v2.py,sha256=CiQWe39LCp-81SZmLyMybIw2lc_0RBKcxclLEuSXQgI,39757
-opik_optimizer/mipro_optimizer/mipro_optimizer.py,sha256=WoBSFcgSdztwzNOkRRhxBW0aiR4B_ThxZRaebDgt_fA,15581
-opik_optimizer/mipro_optimizer/utils.py,sha256=wG1koygXfm_pvtA1jR-YaU4NATPbJZoTI7LE7l7df7g,3273
-opik_optimizer/optimization_config/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-opik_optimizer/optimization_config/configs.py,sha256=MYL9H2UAqeyGBlBGWbOZ-6Snto4ZMuXnypgvVuUSW1Y,1132
-opik_optimizer/optimization_config/mappers.py,sha256=RXgTMxPzTQ1AHGke6Zca6rTcfCI7IkCKhQYciaEGSAo,1698
-opik_optimizer-0.7.8.dist-info/licenses/LICENSE,sha256=dTRSwwCHdWeSjzodvnivYqcwi8x3Qfr21yv65QUWWBE,1062
-opik_optimizer-0.7.8.dist-info/METADATA,sha256=eYfFtFoEWgqLxVx2OYhmsXyHUOSjK6GArV8hvxdCgcs,3853
-opik_optimizer-0.7.8.dist-info/WHEEL,sha256=zaaOINJESkSfm_4HQVc5ssNzHCPXhJm0kEUakpsEHaU,91
-opik_optimizer-0.7.8.dist-info/top_level.txt,sha256=ondOlpq6_yFckqpxoAHSfzZS2N-JfgmA-QQhOJfz7m0,15
-opik_optimizer-0.7.8.dist-info/RECORD,,