runloop-api-client 0.42.0__tar.gz → 0.44.0__tar.gz

runloop_api_client-0.44.0/.release-please-manifest.json

@@ -0,0 +1,3 @@
+{
+  ".": "0.44.0"
+}

{runloop_api_client-0.42.0 → runloop_api_client-0.44.0}/CHANGELOG.md

@@ -1,5 +1,51 @@
 # Changelog
 
+## 0.44.0 (2025-06-21)
+
+Full Changelog: [v0.43.0...v0.44.0](https://github.com/runloopai/api-client-python/compare/v0.43.0...v0.44.0)
+
+### Features
+
+* **api:** api update ([8bd0a39](https://github.com/runloopai/api-client-python/commit/8bd0a3937ff3d5b3e03a34ab2fc291377bbc4203))
+* **api:** api update ([8ebd055](https://github.com/runloopai/api-client-python/commit/8ebd055bb3760c7a01193df890ca7e56d7ff9c01))
+* **client:** add support for aiohttp ([4237321](https://github.com/runloopai/api-client-python/commit/4237321688934fcc89a17588800ce33fb47d9633))
+
+
+### Bug Fixes
+
+* **tests:** fix: tests which call HTTP endpoints directly with the example parameters ([038fe71](https://github.com/runloopai/api-client-python/commit/038fe71f5d0bee93bdcad12af69a8f5b09b6664f))
+
+
+### Chores
+
+* **ci:** enable for pull requests ([f64b8a2](https://github.com/runloopai/api-client-python/commit/f64b8a2a52a28a86f25d8b8ad1998e9ce4dda542))
+* **internal:** update conftest.py ([d840c86](https://github.com/runloopai/api-client-python/commit/d840c863eb3b080202874080e44b8ab0baa379c4))
+* **readme:** update badges ([4b5af3f](https://github.com/runloopai/api-client-python/commit/4b5af3faf2f3cfbcee8474b864335eb0a4c0a78b))
+* **tests:** add tests for httpx client instantiation & proxies ([938b9aa](https://github.com/runloopai/api-client-python/commit/938b9aa33ef7ae52809ca6e9111fc3265d70263d))
+
+
+### Documentation
+
+* **client:** fix httpx.Timeout documentation reference ([b8df915](https://github.com/runloopai/api-client-python/commit/b8df91557df34f77ce5a6f85769305628d9f2a1d))
+
+## 0.43.0 (2025-06-14)
+
+Full Changelog: [v0.42.0...v0.43.0](https://github.com/runloopai/api-client-python/compare/v0.42.0...v0.43.0)
+
+### Features
+
+* **api:** api update ([695b29a](https://github.com/runloopai/api-client-python/commit/695b29a97bd2dcad3f90ee377ed0475a84ed1a2b))
+
+
+### Bug Fixes
+
+* **client:** correctly parse binary response | stream ([1d815d4](https://github.com/runloopai/api-client-python/commit/1d815d468db24142174fe536c05dcd3ec49ee03f))
+
+
+### Chores
+
+* **tests:** run tests in parallel ([fdeee42](https://github.com/runloopai/api-client-python/commit/fdeee42440c5df55af77cbad2423c7faab473dcd))
+
 ## 0.42.0 (2025-06-11)
 
 Full Changelog: [v0.41.0...v0.42.0](https://github.com/runloopai/api-client-python/compare/v0.41.0...v0.42.0)

{runloop_api_client-0.42.0 → runloop_api_client-0.44.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.3
 Name: runloop_api_client
-Version: 0.42.0
+Version: 0.44.0
 Summary: The official Python library for the runloop API
 Project-URL: Homepage, https://github.com/runloopai/api-client-python
 Project-URL: Repository, https://github.com/runloopai/api-client-python
@@ -27,11 +27,14 @@ Requires-Dist: httpx<1,>=0.23.0
 Requires-Dist: pydantic<3,>=1.9.0
 Requires-Dist: sniffio
 Requires-Dist: typing-extensions<5,>=4.10
+Provides-Extra: aiohttp
+Requires-Dist: aiohttp; extra == 'aiohttp'
+Requires-Dist: httpx-aiohttp>=0.1.6; extra == 'aiohttp'
 Description-Content-Type: text/markdown
 
 # Runloop Python API library
 
-[![PyPI version](https://img.shields.io/pypi/v/runloop_api_client.svg)](https://pypi.org/project/runloop_api_client/)
+[![PyPI version](https://github.com/runloopai/api-client-python/tree/main/<https://img.shields.io/pypi/v/runloop_api_client.svg?label=pypi%20(stable)>)](https://pypi.org/project/runloop_api_client/)
 
 The Runloop Python library provides convenient access to the Runloop REST API from any Python 3.8+
 application. The library includes type definitions for all request params and response fields,
@@ -95,6 +98,38 @@ asyncio.run(main())
 
 Functionality between the synchronous and asynchronous clients is otherwise identical.
 
+### With aiohttp
+
+By default, the async client uses `httpx` for HTTP requests. However, for improved concurrency performance you may also use `aiohttp` as the HTTP backend.
+
+You can enable this by installing `aiohttp`:
+
+```sh
+# install from PyPI
+pip install runloop_api_client[aiohttp]
+```
+
+Then you can enable it by instantiating the client with `http_client=DefaultAioHttpClient()`:
+
+```python
+import os
+import asyncio
+from runloop_api_client import DefaultAioHttpClient
+from runloop_api_client import AsyncRunloop
+
+
+async def main() -> None:
+    async with AsyncRunloop(
+        bearer_token=os.environ.get("RUNLOOP_API_KEY"),  # This is the default and can be omitted
+        http_client=DefaultAioHttpClient(),
+    ) as client:
+        devbox_view = await client.devboxes.create()
+        print(devbox_view.id)
+
+
+asyncio.run(main())
+```
+
 ## Using types
 
 Nested request parameters are [TypedDicts](https://docs.python.org/3/library/typing.html#typing.TypedDict). Responses are [Pydantic models](https://docs.pydantic.dev) which also provide helper methods for things like:
@@ -266,7 +301,7 @@ client.with_options(max_retries=5).devboxes.create()
 ### Timeouts
 
 By default requests time out after 1 minute. You can configure this with a `timeout` option,
-which accepts a float or an [`httpx.Timeout`](https://www.python-httpx.org/advanced/#fine-tuning-the-configuration) object:
+which accepts a float or an [`httpx.Timeout`](https://www.python-httpx.org/advanced/timeouts/#fine-tuning-the-configuration) object:
 
 ```python
 from runloop_api_client import Runloop

{runloop_api_client-0.42.0 → runloop_api_client-0.44.0}/README.md

@@ -1,6 +1,6 @@
 # Runloop Python API library
 
-[![PyPI version](https://img.shields.io/pypi/v/runloop_api_client.svg)](https://pypi.org/project/runloop_api_client/)
+[![PyPI version](<https://img.shields.io/pypi/v/runloop_api_client.svg?label=pypi%20(stable)>)](https://pypi.org/project/runloop_api_client/)
 
 The Runloop Python library provides convenient access to the Runloop REST API from any Python 3.8+
 application. The library includes type definitions for all request params and response fields,
@@ -64,6 +64,38 @@ asyncio.run(main())
 
 Functionality between the synchronous and asynchronous clients is otherwise identical.
 
+### With aiohttp
+
+By default, the async client uses `httpx` for HTTP requests. However, for improved concurrency performance you may also use `aiohttp` as the HTTP backend.
+
+You can enable this by installing `aiohttp`:
+
+```sh
+# install from PyPI
+pip install runloop_api_client[aiohttp]
+```
+
+Then you can enable it by instantiating the client with `http_client=DefaultAioHttpClient()`:
+
+```python
+import os
+import asyncio
+from runloop_api_client import DefaultAioHttpClient
+from runloop_api_client import AsyncRunloop
+
+
+async def main() -> None:
+    async with AsyncRunloop(
+        bearer_token=os.environ.get("RUNLOOP_API_KEY"),  # This is the default and can be omitted
+        http_client=DefaultAioHttpClient(),
+    ) as client:
+        devbox_view = await client.devboxes.create()
+        print(devbox_view.id)
+
+
+asyncio.run(main())
+```
+
 ## Using types
 
 Nested request parameters are [TypedDicts](https://docs.python.org/3/library/typing.html#typing.TypedDict). Responses are [Pydantic models](https://docs.pydantic.dev) which also provide helper methods for things like:
@@ -235,7 +267,7 @@ client.with_options(max_retries=5).devboxes.create()
 ### Timeouts
 
 By default requests time out after 1 minute. You can configure this with a `timeout` option,
-which accepts a float or an [`httpx.Timeout`](https://www.python-httpx.org/advanced/#fine-tuning-the-configuration) object:
+which accepts a float or an [`httpx.Timeout`](https://www.python-httpx.org/advanced/timeouts/#fine-tuning-the-configuration) object:
 
 ```python
 from runloop_api_client import Runloop

{runloop_api_client-0.42.0 → runloop_api_client-0.44.0}/api.md

@@ -268,6 +268,7 @@ from runloop_api_client.types import (
     ScenarioEnvironment,
     ScenarioRunListView,
     ScenarioRunView,
+    ScenarioUpdateParameters,
     ScenarioView,
     ScoringContract,
     ScoringContractResultView,

{runloop_api_client-0.42.0 → runloop_api_client-0.44.0}/pyproject.toml

@@ -1,6 +1,6 @@
 [project]
 name = "runloop_api_client"
-version = "0.42.0"
+version = "0.44.0"
 description = "The official Python library for the runloop API"
 dynamic = ["readme"]
 license = "MIT"
@@ -37,6 +37,8 @@ classifiers = [
 Homepage = "https://github.com/runloopai/api-client-python"
 Repository = "https://github.com/runloopai/api-client-python"
 
+[project.optional-dependencies]
+aiohttp = ["aiohttp", "httpx_aiohttp>=0.1.6"]
 
 [tool.rye]
 managed = true
@@ -54,6 +56,7 @@ dev-dependencies = [
     "importlib-metadata>=6.7.0",
     "rich>=13.7.1",
     "nest_asyncio==1.6.0",
+    "pytest-xdist>=3.6.1",
 ]
 
 [tool.rye.scripts]
@@ -125,7 +128,7 @@ replacement = '[\1](https://github.com/runloopai/api-client-python/tree/main/\g<
 
 [tool.pytest.ini_options]
 testpaths = ["tests"]
-addopts = "--tb=short"
+addopts = "--tb=short -n auto"
 xfail_strict = true
 asyncio_mode = "auto"
 asyncio_default_fixture_loop_scope = "session"

{runloop_api_client-0.42.0 → runloop_api_client-0.44.0}/requirements-dev.lock

@@ -10,6 +10,13 @@
 #   universal: false
 
 -e file:.
+aiohappyeyeballs==2.6.1
+    # via aiohttp
+aiohttp==3.12.8
+    # via httpx-aiohttp
+    # via runloop-api-client
+aiosignal==1.3.2
+    # via aiohttp
 annotated-types==0.6.0
     # via pydantic
 anyio==4.4.0
@@ -17,6 +24,10 @@ anyio==4.4.0
     # via runloop-api-client
 argcomplete==3.1.2
     # via nox
+async-timeout==5.0.1
+    # via aiohttp
+attrs==25.3.0
+    # via aiohttp
 certifi==2023.7.22
     # via httpcore
     # via httpx
@@ -30,18 +41,27 @@ distro==1.8.0
 exceptiongroup==1.2.2
     # via anyio
     # via pytest
+execnet==2.1.1
+    # via pytest-xdist
 filelock==3.12.4
     # via virtualenv
+frozenlist==1.6.2
+    # via aiohttp
+    # via aiosignal
 h11==0.14.0
     # via httpcore
 httpcore==1.0.2
     # via httpx
 httpx==0.28.1
+    # via httpx-aiohttp
     # via respx
     # via runloop-api-client
+httpx-aiohttp==0.1.6
+    # via runloop-api-client
 idna==3.4
     # via anyio
     # via httpx
+    # via yarl
 importlib-metadata==7.0.0
 iniconfig==2.0.0
     # via pytest
@@ -49,6 +69,9 @@ markdown-it-py==3.0.0
     # via rich
 mdurl==0.1.2
     # via markdown-it-py
+multidict==6.4.4
+    # via aiohttp
+    # via yarl
 mypy==1.14.1
 mypy-extensions==1.0.0
     # via mypy
@@ -63,6 +86,9 @@ platformdirs==3.11.0
     # via virtualenv
 pluggy==1.5.0
     # via pytest
+propcache==0.3.1
+    # via aiohttp
+    # via yarl
 pydantic==2.10.3
     # via runloop-api-client
 pydantic-core==2.27.1
@@ -72,7 +98,9 @@ pygments==2.18.0
 pyright==1.1.399
 pytest==8.3.3
     # via pytest-asyncio
+    # via pytest-xdist
 pytest-asyncio==0.24.0
+pytest-xdist==3.7.0
 python-dateutil==2.8.2
     # via time-machine
 pytz==2023.3.post1
@@ -93,6 +121,7 @@ tomli==2.0.2
     # via pytest
 typing-extensions==4.12.2
     # via anyio
+    # via multidict
     # via mypy
     # via pydantic
     # via pydantic-core
@@ -100,5 +129,7 @@ typing-extensions==4.12.2
     # via runloop-api-client
 virtualenv==20.24.5
     # via nox
+yarl==1.20.0
+    # via aiohttp
 zipp==3.17.0
     # via importlib-metadata

{runloop_api_client-0.42.0 → runloop_api_client-0.44.0}/requirements.lock

@@ -10,11 +10,22 @@
 #   universal: false
 
 -e file:.
+aiohappyeyeballs==2.6.1
+    # via aiohttp
+aiohttp==3.12.8
+    # via httpx-aiohttp
+    # via runloop-api-client
+aiosignal==1.3.2
+    # via aiohttp
 annotated-types==0.6.0
     # via pydantic
 anyio==4.4.0
     # via httpx
     # via runloop-api-client
+async-timeout==5.0.1
+    # via aiohttp
+attrs==25.3.0
+    # via aiohttp
 certifi==2023.7.22
     # via httpcore
     # via httpx
@@ -22,15 +33,28 @@ distro==1.8.0
     # via runloop-api-client
 exceptiongroup==1.2.2
     # via anyio
+frozenlist==1.6.2
+    # via aiohttp
+    # via aiosignal
 h11==0.14.0
     # via httpcore
 httpcore==1.0.2
     # via httpx
 httpx==0.28.1
+    # via httpx-aiohttp
+    # via runloop-api-client
+httpx-aiohttp==0.1.6
     # via runloop-api-client
 idna==3.4
     # via anyio
     # via httpx
+    # via yarl
+multidict==6.4.4
+    # via aiohttp
+    # via yarl
+propcache==0.3.1
+    # via aiohttp
+    # via yarl
 pydantic==2.10.3
     # via runloop-api-client
 pydantic-core==2.27.1
@@ -40,6 +64,9 @@ sniffio==1.3.0
     # via runloop-api-client
 typing-extensions==4.12.2
     # via anyio
+    # via multidict
     # via pydantic
     # via pydantic-core
     # via runloop-api-client
+yarl==1.20.0
+    # via aiohttp

{runloop_api_client-0.42.0 → runloop_api_client-0.44.0}/src/runloop_api_client/__init__.py

@@ -26,7 +26,7 @@ from ._exceptions import (
     UnprocessableEntityError,
     APIResponseValidationError,
 )
-from ._base_client import DefaultHttpxClient, DefaultAsyncHttpxClient
+from ._base_client import DefaultHttpxClient, DefaultAioHttpClient, DefaultAsyncHttpxClient
 from ._utils._logs import setup_logging as _setup_logging
 
 __all__ = [
@@ -68,6 +68,7 @@ __all__ = [
     "DEFAULT_CONNECTION_LIMITS",
     "DefaultHttpxClient",
     "DefaultAsyncHttpxClient",
+    "DefaultAioHttpClient",
 ]
 
 if not _t.TYPE_CHECKING:

{runloop_api_client-0.42.0 → runloop_api_client-0.44.0}/src/runloop_api_client/_base_client.py

@@ -1071,7 +1071,14 @@ class SyncAPIClient(BaseClient[httpx.Client, Stream[Any]]):
     ) -> ResponseT:
         origin = get_origin(cast_to) or cast_to
 
-        if inspect.isclass(origin) and issubclass(origin, BaseAPIResponse):
+        if (
+            inspect.isclass(origin)
+            and issubclass(origin, BaseAPIResponse)
+            # we only want to actually return the custom BaseAPIResponse class if we're
+            # returning the raw response, or if we're not streaming SSE, as if we're streaming
+            # SSE then `cast_to` doesn't actively reflect the type we need to parse into
+            and (not stream or bool(response.request.headers.get(RAW_RESPONSE_HEADER)))
+        ):
             if not issubclass(origin, APIResponse):
                 raise TypeError(f"API Response types must subclass {APIResponse}; Received {origin}")
 
@@ -1282,6 +1289,24 @@ class _DefaultAsyncHttpxClient(httpx.AsyncClient):
         super().__init__(**kwargs)
 
 
+try:
+    import httpx_aiohttp
+except ImportError:
+
+    class _DefaultAioHttpClient(httpx.AsyncClient):
+        def __init__(self, **_kwargs: Any) -> None:
+            raise RuntimeError("To use the aiohttp client you must have installed the package with the `aiohttp` extra")
+else:
+
+    class _DefaultAioHttpClient(httpx_aiohttp.HttpxAiohttpClient):  # type: ignore
+        def __init__(self, **kwargs: Any) -> None:
+            kwargs.setdefault("timeout", DEFAULT_TIMEOUT)
+            kwargs.setdefault("limits", DEFAULT_CONNECTION_LIMITS)
+            kwargs.setdefault("follow_redirects", True)
+
+            super().__init__(**kwargs)
+
+
 if TYPE_CHECKING:
     DefaultAsyncHttpxClient = httpx.AsyncClient
     """An alias to `httpx.AsyncClient` that provides the same defaults that this SDK
@@ -1290,8 +1315,12 @@ if TYPE_CHECKING:
     This is useful because overriding the `http_client` with your own instance of
     `httpx.AsyncClient` will result in httpx's defaults being used, not ours.
     """
+
+    DefaultAioHttpClient = httpx.AsyncClient
+    """An alias to `httpx.AsyncClient` that changes the default HTTP transport to `aiohttp`."""
 else:
     DefaultAsyncHttpxClient = _DefaultAsyncHttpxClient
+    DefaultAioHttpClient = _DefaultAioHttpClient
 
 
 class AsyncHttpxClientWrapper(DefaultAsyncHttpxClient):
@@ -1574,7 +1603,14 @@ class AsyncAPIClient(BaseClient[httpx.AsyncClient, AsyncStream[Any]]):
     ) -> ResponseT:
         origin = get_origin(cast_to) or cast_to
 
-        if inspect.isclass(origin) and issubclass(origin, BaseAPIResponse):
+        if (
+            inspect.isclass(origin)
+            and issubclass(origin, BaseAPIResponse)
+            # we only want to actually return the custom BaseAPIResponse class if we're
+            # returning the raw response, or if we're not streaming SSE, as if we're streaming
+            # SSE then `cast_to` doesn't actively reflect the type we need to parse into
+            and (not stream or bool(response.request.headers.get(RAW_RESPONSE_HEADER)))
+        ):
             if not issubclass(origin, AsyncAPIResponse):
                 raise TypeError(f"API Response types must subclass {AsyncAPIResponse}; Received {origin}")
 

{runloop_api_client-0.42.0 → runloop_api_client-0.44.0}/src/runloop_api_client/_version.py

@@ -1,4 +1,4 @@
 # File generated from our OpenAPI spec by Stainless. See CONTRIBUTING.md for details.
 
 __title__ = "runloop_api_client"
-__version__ = "0.42.0"  # x-release-please-version
+__version__ = "0.44.0"  # x-release-please-version

{runloop_api_client-0.42.0 → runloop_api_client-0.44.0}/src/runloop_api_client/resources/scenarios/scenarios.py

@@ -185,12 +185,12 @@ class ScenariosResource(SyncAPIResource):
         self,
         id: str,
         *,
-        input_context: InputContextParam,
-        name: str,
-        scoring_contract: ScoringContractParam,
         environment_parameters: Optional[ScenarioEnvironmentParam] | NotGiven = NOT_GIVEN,
+        input_context: Optional[InputContextParam] | NotGiven = NOT_GIVEN,
         metadata: Optional[Dict[str, str]] | NotGiven = NOT_GIVEN,
+        name: Optional[str] | NotGiven = NOT_GIVEN,
         reference_output: Optional[str] | NotGiven = NOT_GIVEN,
+        scoring_contract: Optional[ScoringContractParam] | NotGiven = NOT_GIVEN,
         # Use the following arguments if you need to pass additional parameters to the API that aren't available via kwargs.
         # The extra values given here take precedence over values defined on the client or passed to this method.
         extra_headers: Headers | None = None,
@@ -201,23 +201,24 @@ class ScenariosResource(SyncAPIResource):
     ) -> ScenarioView:
         """
         Update a Scenario, a repeatable AI coding evaluation test that defines the
-        starting environment as well as evaluation success criteria.
+        starting environment as well as evaluation success criteria. Only provided
+        fields will be updated.
 
         Args:
-          input_context: The input context for the Scenario.
-
-          name: Name of the scenario.
-
-          scoring_contract: The scoring contract for the Scenario.
-
           environment_parameters: The Environment in which the Scenario will run.
 
+          input_context: The input context for the Scenario.
+
           metadata: User defined metadata to attach to the scenario for organization.
 
+          name: Name of the scenario.
+
           reference_output: A string representation of the reference output to solve the scenario. Commonly
               can be the result of a git diff or a sequence of command actions to apply to the
               environment.
 
+          scoring_contract: The scoring contract for the Scenario.
+
           extra_headers: Send extra headers
 
           extra_query: Add additional query parameters to the request
@@ -234,12 +235,12 @@ class ScenariosResource(SyncAPIResource):
             f"/v1/scenarios/{id}",
             body=maybe_transform(
                 {
-                    "input_context": input_context,
-                    "name": name,
-                    "scoring_contract": scoring_contract,
                     "environment_parameters": environment_parameters,
+                    "input_context": input_context,
                     "metadata": metadata,
+                    "name": name,
                     "reference_output": reference_output,
+                    "scoring_contract": scoring_contract,
                 },
                 scenario_update_params.ScenarioUpdateParams,
             ),
@@ -256,6 +257,7 @@ class ScenariosResource(SyncAPIResource):
     def list(
         self,
         *,
+        benchmark_id: str | NotGiven = NOT_GIVEN,
         limit: int | NotGiven = NOT_GIVEN,
         name: str | NotGiven = NOT_GIVEN,
         starting_after: str | NotGiven = NOT_GIVEN,
@@ -266,12 +268,13 @@ class ScenariosResource(SyncAPIResource):
         extra_body: Body | None = None,
         timeout: float | httpx.Timeout | None | NotGiven = NOT_GIVEN,
     ) -> SyncScenariosCursorIDPage[ScenarioView]:
-        """List all Scenarios matching filter.
+        """
+        List all Scenarios matching filter.
 
         Args:
-          limit: The limit of items to return.
+          benchmark_id: Filter scenarios by benchmark ID.
 
-        Default is 20.
+          limit: The limit of items to return. Default is 20.
 
           name: Query for Scenarios with a given name.
 
@@ -295,6 +298,7 @@ class ScenariosResource(SyncAPIResource):
                 timeout=timeout,
                 query=maybe_transform(
                     {
+                        "benchmark_id": benchmark_id,
                         "limit": limit,
                         "name": name,
                         "starting_after": starting_after,
@@ -608,12 +612,12 @@ class AsyncScenariosResource(AsyncAPIResource):
         self,
         id: str,
         *,
-        input_context: InputContextParam,
-        name: str,
-        scoring_contract: ScoringContractParam,
         environment_parameters: Optional[ScenarioEnvironmentParam] | NotGiven = NOT_GIVEN,
+        input_context: Optional[InputContextParam] | NotGiven = NOT_GIVEN,
         metadata: Optional[Dict[str, str]] | NotGiven = NOT_GIVEN,
+        name: Optional[str] | NotGiven = NOT_GIVEN,
         reference_output: Optional[str] | NotGiven = NOT_GIVEN,
+        scoring_contract: Optional[ScoringContractParam] | NotGiven = NOT_GIVEN,
         # Use the following arguments if you need to pass additional parameters to the API that aren't available via kwargs.
         # The extra values given here take precedence over values defined on the client or passed to this method.
         extra_headers: Headers | None = None,
@@ -624,23 +628,24 @@ class AsyncScenariosResource(AsyncAPIResource):
     ) -> ScenarioView:
         """
         Update a Scenario, a repeatable AI coding evaluation test that defines the
-        starting environment as well as evaluation success criteria.
+        starting environment as well as evaluation success criteria. Only provided
+        fields will be updated.
 
         Args:
-          input_context: The input context for the Scenario.
-
-          name: Name of the scenario.
-
-          scoring_contract: The scoring contract for the Scenario.
-
           environment_parameters: The Environment in which the Scenario will run.
 
+          input_context: The input context for the Scenario.
+
           metadata: User defined metadata to attach to the scenario for organization.
 
+          name: Name of the scenario.
+
           reference_output: A string representation of the reference output to solve the scenario. Commonly
               can be the result of a git diff or a sequence of command actions to apply to the
               environment.
 
+          scoring_contract: The scoring contract for the Scenario.
+
           extra_headers: Send extra headers
 
           extra_query: Add additional query parameters to the request
@@ -657,12 +662,12 @@ class AsyncScenariosResource(AsyncAPIResource):
             f"/v1/scenarios/{id}",
             body=await async_maybe_transform(
                 {
-                    "input_context": input_context,
-                    "name": name,
-                    "scoring_contract": scoring_contract,
                     "environment_parameters": environment_parameters,
+                    "input_context": input_context,
                     "metadata": metadata,
+                    "name": name,
                     "reference_output": reference_output,
+                    "scoring_contract": scoring_contract,
                 },
                 scenario_update_params.ScenarioUpdateParams,
             ),
@@ -679,6 +684,7 @@ class AsyncScenariosResource(AsyncAPIResource):
     def list(
         self,
         *,
+        benchmark_id: str | NotGiven = NOT_GIVEN,
         limit: int | NotGiven = NOT_GIVEN,
         name: str | NotGiven = NOT_GIVEN,
         starting_after: str | NotGiven = NOT_GIVEN,
@@ -689,12 +695,13 @@ class AsyncScenariosResource(AsyncAPIResource):
         extra_body: Body | None = None,
         timeout: float | httpx.Timeout | None | NotGiven = NOT_GIVEN,
     ) -> AsyncPaginator[ScenarioView, AsyncScenariosCursorIDPage[ScenarioView]]:
-        """List all Scenarios matching filter.
+        """
+        List all Scenarios matching filter.
 
         Args:
-          limit: The limit of items to return.
+          benchmark_id: Filter scenarios by benchmark ID.
 
-        Default is 20.
+          limit: The limit of items to return. Default is 20.
 
           name: Query for Scenarios with a given name.
 
@@ -718,6 +725,7 @@ class AsyncScenariosResource(AsyncAPIResource):
                 timeout=timeout,
                 query=maybe_transform(
                     {
+                        "benchmark_id": benchmark_id,
                         "limit": limit,
                         "name": name,
                         "starting_after": starting_after,

{runloop_api_client-0.42.0 → runloop_api_client-0.44.0}/src/runloop_api_client/types/scenario_list_params.py

@@ -8,6 +8,9 @@ __all__ = ["ScenarioListParams"]
 
 
 class ScenarioListParams(TypedDict, total=False):
+    benchmark_id: str
+    """Filter scenarios by benchmark ID."""
+
     limit: int
     """The limit of items to return. Default is 20."""