pydantic-evals 0.4.3__tar.gz → 0.4.4__tar.gz

{pydantic_evals-0.4.3 → pydantic_evals-0.4.4}/PKG-INFO

@@ -1,12 +1,12 @@
 Metadata-Version: 2.4
 Name: pydantic-evals
-Version: 0.4.3
+Version: 0.4.4
 Summary: Framework for evaluating stochastic code execution, especially code making use of LLMs
 Project-URL: Homepage, https://ai.pydantic.dev/evals
 Project-URL: Source, https://github.com/pydantic/pydantic-ai
 Project-URL: Documentation, https://ai.pydantic.dev/evals
 Project-URL: Changelog, https://github.com/pydantic/pydantic-ai/releases
-Author-email: David Montague <david@pydantic.dev>
+Author-email: Samuel Colvin <samuel@pydantic.dev>, Marcelo Trylesinski <marcelotryle@gmail.com>, David Montague <david@pydantic.dev>, Alex Hall <alex@pydantic.dev>, Douwe Maan <douwe@pydantic.dev>
 License-Expression: MIT
 License-File: LICENSE
 Classifier: Development Status :: 4 - Beta
@@ -32,7 +32,7 @@ Requires-Python: >=3.9
 Requires-Dist: anyio>=0
 Requires-Dist: eval-type-backport>=0; python_version < '3.11'
 Requires-Dist: logfire-api>=1.2.0
-Requires-Dist: pydantic-ai-slim==0.4.3
+Requires-Dist: pydantic-ai-slim==0.4.4
 Requires-Dist: pydantic>=2.10
 Requires-Dist: pyyaml>=6.0.2
 Requires-Dist: rich>=13.9.4
@@ -51,18 +51,18 @@ Description-Content-Type: text/markdown
 This is a library for evaluating non-deterministic (or "stochastic") functions in Python. It provides a simple,
 Pythonic interface for defining and running stochastic functions, and analyzing the results of running those functions.
 
-While this library is developed as part of [PydanticAI](https://ai.pydantic.dev), it only uses PydanticAI for a small
+While this library is developed as part of [Pydantic AI](https://ai.pydantic.dev), it only uses Pydantic AI for a small
 subset of generative functionality internally, and it is designed to be used with arbitrary "stochastic function"
-implementations. In particular, it can be used with other (non-PydanticAI) AI libraries, agent frameworks, etc.
+implementations. In particular, it can be used with other (non-Pydantic AI) AI libraries, agent frameworks, etc.
 
-As with PydanticAI, this library prioritizes type safety and use of common Python syntax over esoteric, domain-specific
+As with Pydantic AI, this library prioritizes type safety and use of common Python syntax over esoteric, domain-specific
 use of Python syntax.
 
 Full documentation is available at [ai.pydantic.dev/evals](https://ai.pydantic.dev/evals).
 
 ## Example
 
-While you'd typically use Pydantic Evals with more complex functions (such as PydanticAI agents or graphs), here's a
+While you'd typically use Pydantic Evals with more complex functions (such as Pydantic AI agents or graphs), here's a
 quick example that evaluates a simple function against a test case using both custom and built-in evaluators:
 
 ```python
@@ -110,7 +110,7 @@ report.print(include_input=True, include_output=True)
 """
 ```
 
-Using the library with more complex functions, such as PydanticAI agents, is similar — all you need to do is define a
+Using the library with more complex functions, such as Pydantic AI agents, is similar — all you need to do is define a
 task function wrapping the function you want to evaluate, with a signature that matches the inputs and outputs of your
 test cases.
 

{pydantic_evals-0.4.3 → pydantic_evals-0.4.4}/README.md

@@ -9,18 +9,18 @@
 This is a library for evaluating non-deterministic (or "stochastic") functions in Python. It provides a simple,
 Pythonic interface for defining and running stochastic functions, and analyzing the results of running those functions.
 
-While this library is developed as part of [PydanticAI](https://ai.pydantic.dev), it only uses PydanticAI for a small
+While this library is developed as part of [Pydantic AI](https://ai.pydantic.dev), it only uses Pydantic AI for a small
 subset of generative functionality internally, and it is designed to be used with arbitrary "stochastic function"
-implementations. In particular, it can be used with other (non-PydanticAI) AI libraries, agent frameworks, etc.
+implementations. In particular, it can be used with other (non-Pydantic AI) AI libraries, agent frameworks, etc.
 
-As with PydanticAI, this library prioritizes type safety and use of common Python syntax over esoteric, domain-specific
+As with Pydantic AI, this library prioritizes type safety and use of common Python syntax over esoteric, domain-specific
 use of Python syntax.
 
 Full documentation is available at [ai.pydantic.dev/evals](https://ai.pydantic.dev/evals).
 
 ## Example
 
-While you'd typically use Pydantic Evals with more complex functions (such as PydanticAI agents or graphs), here's a
+While you'd typically use Pydantic Evals with more complex functions (such as Pydantic AI agents or graphs), here's a
 quick example that evaluates a simple function against a test case using both custom and built-in evaluators:
 
 ```python
@@ -68,7 +68,7 @@ report.print(include_input=True, include_output=True)
 """
 ```
 
-Using the library with more complex functions, such as PydanticAI agents, is similar — all you need to do is define a
+Using the library with more complex functions, such as Pydantic AI agents, is similar — all you need to do is define a
 task function wrapping the function you want to evaluate, with a signature that matches the inputs and outputs of your
 test cases.
 

{pydantic_evals-0.4.3 → pydantic_evals-0.4.4}/pydantic_evals/generation.py

@@ -47,7 +47,7 @@ async def generate_dataset(
         path: Optional path to save the generated dataset. If provided, the dataset will be saved to this location.
         dataset_type: The type of dataset to generate, with the desired input, output, and metadata types.
         custom_evaluator_types: Optional sequence of custom evaluator classes to include in the schema.
-        model: The PydanticAI model to use for generation. Defaults to 'gpt-4o'.
+        model: The Pydantic AI model to use for generation. Defaults to 'gpt-4o'.
         n_examples: Number of examples to generate. Defaults to 3.
         extra_instructions: Optional additional instructions to provide to the LLM.
 
@@ -59,7 +59,7 @@ async def generate_dataset(
     """
     output_schema = dataset_type.model_json_schema_with_evaluators(custom_evaluator_types)
 
-    # TODO(DavidM): Update this once we add better response_format and/or ResultTool support to PydanticAI
+    # TODO(DavidM): Update this once we add better response_format and/or ResultTool support to Pydantic AI
     agent = Agent(
         model,
         system_prompt=(

{pydantic_evals-0.4.3 → pydantic_evals-0.4.4}/pyproject.toml

@@ -15,7 +15,11 @@ name = "pydantic-evals"
 dynamic = ["version", "dependencies"]
 description = "Framework for evaluating stochastic code execution, especially code making use of LLMs"
 authors = [
+    { name = "Samuel Colvin", email = "samuel@pydantic.dev" },
+    { name = "Marcelo Trylesinski", email = "marcelotryle@gmail.com" },
     { name = "David Montague", email = "david@pydantic.dev" },
+    { name = "Alex Hall", email = "alex@pydantic.dev" },
+    { name = "Douwe Maan", email = "douwe@pydantic.dev" },
 ]
 license = "MIT"
 readme = "README.md"