payi 0.1.0a89__tar.gz → 0.1.0a91__tar.gz

payi-0.1.0a91/.release-please-manifest.json

@@ -0,0 +1,3 @@
+{
+  ".": "0.1.0-alpha.91"
+}

{payi-0.1.0a89 → payi-0.1.0a91}/CHANGELOG.md

@@ -1,5 +1,49 @@
 # Changelog
 
+## 0.1.0-alpha.91 (2025-06-25)
+
+Full Changelog: [v0.1.0-alpha.90...v0.1.0-alpha.91](https://github.com/Pay-i/pay-i-python/compare/v0.1.0-alpha.90...v0.1.0-alpha.91)
+
+### Features
+
+* do not instrument inline base64 image data by default ([#331](https://github.com/Pay-i/pay-i-python/issues/331)) ([8b0455d](https://github.com/Pay-i/pay-i-python/commit/8b0455d24cda3060bc2170b05e5438c72885bf1a))
+
+
+### Chores
+
+* **tests:** skip some failing tests on the latest python versions ([1856b99](https://github.com/Pay-i/pay-i-python/commit/1856b99b5802dc02e4f536818f1a205d9da708c2))
+
+## 0.1.0-alpha.90 (2025-06-23)
+
+Full Changelog: [v0.1.0-alpha.89...v0.1.0-alpha.90](https://github.com/Pay-i/pay-i-python/compare/v0.1.0-alpha.89...v0.1.0-alpha.90)
+
+### Features
+
+* **client:** add support for aiohttp ([e875663](https://github.com/Pay-i/pay-i-python/commit/e87566399607c87091b4a83f855910b78107e31b))
+
+
+### Bug Fixes
+
+* **client:** correctly parse binary response | stream ([6bb78c4](https://github.com/Pay-i/pay-i-python/commit/6bb78c4488dc3af5d556c1a063372be6ae018342))
+* **tests:** fix: tests which call HTTP endpoints directly with the example parameters ([eb727c7](https://github.com/Pay-i/pay-i-python/commit/eb727c742f8f6ac0c9487d7ff4e6e7698afacd0d))
+
+
+### Chores
+
+* **ci:** enable for pull requests ([e999e4e](https://github.com/Pay-i/pay-i-python/commit/e999e4ee3a05ea8dcb8518eaba1e6ea5f3f958e0))
+* **internal:** update conftest.py ([d668101](https://github.com/Pay-i/pay-i-python/commit/d66810199d9394852f8c5783801fc055745a3ef2))
+* **internal:** version bump ([5616a6a](https://github.com/Pay-i/pay-i-python/commit/5616a6a1147d94e8ca69350dd5b21a211b9eed75))
+* **internal:** version bump ([d93bffd](https://github.com/Pay-i/pay-i-python/commit/d93bffd3f408fc6ec34bf4071dddcc2e55653fcc))
+* **internal:** version bump ([d2022a7](https://github.com/Pay-i/pay-i-python/commit/d2022a710955c9bbf6683a96bc3e2fd46a14c3e7))
+* **readme:** update badges ([5219fd7](https://github.com/Pay-i/pay-i-python/commit/5219fd70ef3c88f114f6b69e89caabcf0d5a39e0))
+* **tests:** add tests for httpx client instantiation & proxies ([bafbfd1](https://github.com/Pay-i/pay-i-python/commit/bafbfd154aba87811edb87bf375d8d9242b6a14e))
+* **tests:** run tests in parallel ([6bdbcdd](https://github.com/Pay-i/pay-i-python/commit/6bdbcddb8a4465cc79fee2e0ba66168079a24490))
+
+
+### Documentation
+
+* **client:** fix httpx.Timeout documentation reference ([60d1b01](https://github.com/Pay-i/pay-i-python/commit/60d1b01aae900736dfe0345aa8250b67fa1ba704))
+
 ## 0.1.0-alpha.89 (2025-06-17)
 
 Full Changelog: [v0.1.0-alpha.88...v0.1.0-alpha.89](https://github.com/Pay-i/pay-i-python/compare/v0.1.0-alpha.88...v0.1.0-alpha.89)

{payi-0.1.0a89 → payi-0.1.0a91}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.3
 Name: payi
-Version: 0.1.0a89
+Version: 0.1.0a91
 Summary: The official Python library for the payi API
 Project-URL: Homepage, https://github.com/Pay-i/pay-i-python
 Project-URL: Repository, https://github.com/Pay-i/pay-i-python
@@ -30,11 +30,14 @@ Requires-Dist: sniffio
 Requires-Dist: tiktoken>=0.8.0
 Requires-Dist: typing-extensions<5,>=4.10
 Requires-Dist: wrapt>=1.17.2
+Provides-Extra: aiohttp
+Requires-Dist: aiohttp; extra == 'aiohttp'
+Requires-Dist: httpx-aiohttp>=0.1.6; extra == 'aiohttp'
 Description-Content-Type: text/markdown
 
 # Payi Python API library
 
-[![PyPI version](https://img.shields.io/pypi/v/payi.svg)](https://pypi.org/project/payi/)
+[![PyPI version](https://github.com/Pay-i/pay-i-python/tree/main/<https://img.shields.io/pypi/v/payi.svg?label=pypi%20(stable)>)](https://pypi.org/project/payi/)
 
 The Payi Python library provides convenient access to the Payi REST API from any Python 3.8+
 application. The library includes type definitions for all request params and response fields,
@@ -104,6 +107,41 @@ asyncio.run(main())
 
 Functionality between the synchronous and asynchronous clients is otherwise identical.
 
+### With aiohttp
+
+By default, the async client uses `httpx` for HTTP requests. However, for improved concurrency performance you may also use `aiohttp` as the HTTP backend.
+
+You can enable this by installing `aiohttp`:
+
+```sh
+# install from PyPI
+pip install --pre payi[aiohttp]
+```
+
+Then you can enable it by instantiating the client with `http_client=DefaultAioHttpClient()`:
+
+```python
+import os
+import asyncio
+from payi import DefaultAioHttpClient
+from payi import AsyncPayi
+
+
+async def main() -> None:
+    async with AsyncPayi(
+        api_key=os.environ.get("PAYI_API_KEY"),  # This is the default and can be omitted
+        http_client=DefaultAioHttpClient(),
+    ) as client:
+        use_case_definition = await client.use_cases.definitions.create(
+            description="Sample Use Case Definition Description",
+            name="SampleUseCaseDefinition",
+        )
+        print(use_case_definition.request_id)
+
+
+asyncio.run(main())
+```
+
 ## Using types
 
 Nested request parameters are [TypedDicts](https://docs.python.org/3/library/typing.html#typing.TypedDict). Responses are [Pydantic models](https://docs.pydantic.dev) which also provide helper methods for things like:
@@ -264,7 +302,7 @@ client.with_options(max_retries=5).use_cases.definitions.create(
 ### Timeouts
 
 By default requests time out after 1 minute. You can configure this with a `timeout` option,
-which accepts a float or an [`httpx.Timeout`](https://www.python-httpx.org/advanced/#fine-tuning-the-configuration) object:
+which accepts a float or an [`httpx.Timeout`](https://www.python-httpx.org/advanced/timeouts/#fine-tuning-the-configuration) object:
 
 ```python
 from payi import Payi

{payi-0.1.0a89 → payi-0.1.0a91}/README.md

@@ -1,6 +1,6 @@
 # Payi Python API library
 
-[![PyPI version](https://img.shields.io/pypi/v/payi.svg)](https://pypi.org/project/payi/)
+[![PyPI version](<https://img.shields.io/pypi/v/payi.svg?label=pypi%20(stable)>)](https://pypi.org/project/payi/)
 
 The Payi Python library provides convenient access to the Payi REST API from any Python 3.8+
 application. The library includes type definitions for all request params and response fields,
@@ -70,6 +70,41 @@ asyncio.run(main())
 
 Functionality between the synchronous and asynchronous clients is otherwise identical.
 
+### With aiohttp
+
+By default, the async client uses `httpx` for HTTP requests. However, for improved concurrency performance you may also use `aiohttp` as the HTTP backend.
+
+You can enable this by installing `aiohttp`:
+
+```sh
+# install from PyPI
+pip install --pre payi[aiohttp]
+```
+
+Then you can enable it by instantiating the client with `http_client=DefaultAioHttpClient()`:
+
+```python
+import os
+import asyncio
+from payi import DefaultAioHttpClient
+from payi import AsyncPayi
+
+
+async def main() -> None:
+    async with AsyncPayi(
+        api_key=os.environ.get("PAYI_API_KEY"),  # This is the default and can be omitted
+        http_client=DefaultAioHttpClient(),
+    ) as client:
+        use_case_definition = await client.use_cases.definitions.create(
+            description="Sample Use Case Definition Description",
+            name="SampleUseCaseDefinition",
+        )
+        print(use_case_definition.request_id)
+
+
+asyncio.run(main())
+```
+
 ## Using types
 
 Nested request parameters are [TypedDicts](https://docs.python.org/3/library/typing.html#typing.TypedDict). Responses are [Pydantic models](https://docs.pydantic.dev) which also provide helper methods for things like:
@@ -230,7 +265,7 @@ client.with_options(max_retries=5).use_cases.definitions.create(
 ### Timeouts
 
 By default requests time out after 1 minute. You can configure this with a `timeout` option,
-which accepts a float or an [`httpx.Timeout`](https://www.python-httpx.org/advanced/#fine-tuning-the-configuration) object:
+which accepts a float or an [`httpx.Timeout`](https://www.python-httpx.org/advanced/timeouts/#fine-tuning-the-configuration) object:
 
 ```python
 from payi import Payi

{payi-0.1.0a89 → payi-0.1.0a91}/pyproject.toml

@@ -1,6 +1,6 @@
 [project]
 name = "payi"
-version = "0.1.0-alpha.89"
+version = "0.1.0-alpha.91"
 description = "The official Python library for the payi API"
 dynamic = ["readme"]
 license = "Apache-2.0"
@@ -40,6 +40,8 @@ classifiers = [
 Homepage = "https://github.com/Pay-i/pay-i-python"
 Repository = "https://github.com/Pay-i/pay-i-python"
 
+[project.optional-dependencies]
+aiohttp = ["aiohttp", "httpx_aiohttp>=0.1.6"]
 
 [tool.rye]
 managed = true
@@ -57,6 +59,7 @@ dev-dependencies = [
     "importlib-metadata>=6.7.0",
     "rich>=13.7.1",
     "nest_asyncio==1.6.0",
+    "pytest-xdist>=3.6.1",
     "wrapt",
 ]
 
@@ -129,7 +132,7 @@ replacement = '[\1](https://github.com/Pay-i/pay-i-python/tree/main/\g<2>)'
 
 [tool.pytest.ini_options]
 testpaths = ["tests"]
-addopts = "--tb=short"
+addopts = "--tb=short -n auto"
 xfail_strict = true
 asyncio_mode = "auto"
 asyncio_default_fixture_loop_scope = "session"

{payi-0.1.0a89 → payi-0.1.0a91}/requirements-dev.lock

@@ -10,6 +10,13 @@
 #   universal: false
 
 -e file:.
+aiohappyeyeballs==2.6.1
+    # via aiohttp
+aiohttp==3.12.8
+    # via httpx-aiohttp
+    # via payi
+aiosignal==1.3.2
+    # via aiohttp
 annotated-types==0.6.0
     # via pydantic
 anyio==4.4.0
@@ -17,6 +24,10 @@ anyio==4.4.0
     # via payi
 argcomplete==3.1.2
     # via nox
+async-timeout==5.0.1
+    # via aiohttp
+attrs==25.3.0
+    # via aiohttp
 certifi==2023.7.22
     # via httpcore
     # via httpx
@@ -33,19 +44,27 @@ distro==1.8.0
 exceptiongroup==1.2.2
     # via anyio
     # via pytest
+execnet==2.1.1
+    # via pytest-xdist
 filelock==3.12.4
     # via virtualenv
+frozenlist==1.6.2
+    # via aiohttp
+    # via aiosignal
 h11==0.14.0
     # via httpcore
 httpcore==1.0.2
     # via httpx
 httpx==0.28.1
+    # via httpx-aiohttp
     # via payi
     # via respx
+httpx-aiohttp==0.1.6
+    # via payi
 idna==3.4
     # via anyio
     # via httpx
-    # via requests
+    # via yarl
 importlib-metadata==7.0.0
 iniconfig==2.0.0
     # via pytest
@@ -53,6 +72,9 @@ markdown-it-py==3.0.0
     # via rich
 mdurl==0.1.2
     # via markdown-it-py
+multidict==6.4.4
+    # via aiohttp
+    # via yarl
 mypy==1.14.1
 mypy-extensions==1.0.0
     # via mypy
@@ -68,6 +90,9 @@ platformdirs==3.11.0
     # via virtualenv
 pluggy==1.5.0
     # via pytest
+propcache==0.3.1
+    # via aiohttp
+    # via yarl
 pydantic==2.10.3
     # via payi
 pydantic-core==2.27.1
@@ -77,7 +102,9 @@ pygments==2.18.0
 pyright==1.1.399
 pytest==8.3.3
     # via pytest-asyncio
+    # via pytest-xdist
 pytest-asyncio==0.24.0
+pytest-xdist==3.7.0
 python-dateutil==2.8.2
     # via time-machine
 pytz==2023.3.post1
@@ -104,6 +131,7 @@ tomli==2.0.2
     # via pytest
 typing-extensions==4.12.2
     # via anyio
+    # via multidict
     # via mypy
     # via payi
     # via pydantic
@@ -115,5 +143,7 @@ virtualenv==20.24.5
     # via nox
 wrapt==1.17.2
     # via payi
+yarl==1.20.0
+    # via aiohttp
 zipp==3.17.0
     # via importlib-metadata

{payi-0.1.0a89 → payi-0.1.0a91}/requirements.lock

@@ -10,11 +10,22 @@
 #   universal: false
 
 -e file:.
+aiohappyeyeballs==2.6.1
+    # via aiohttp
+aiohttp==3.12.8
+    # via httpx-aiohttp
+    # via payi
+aiosignal==1.3.2
+    # via aiohttp
 annotated-types==0.6.0
     # via pydantic
 anyio==4.4.0
     # via httpx
     # via payi
+async-timeout==5.0.1
+    # via aiohttp
+attrs==25.3.0
+    # via aiohttp
 certifi==2023.7.22
     # via httpcore
     # via httpx
@@ -25,16 +36,28 @@ distro==1.8.0
     # via payi
 exceptiongroup==1.2.2
     # via anyio
+frozenlist==1.6.2
+    # via aiohttp
+    # via aiosignal
 h11==0.14.0
     # via httpcore
 httpcore==1.0.2
     # via httpx
 httpx==0.28.1
+    # via httpx-aiohttp
+    # via payi
+httpx-aiohttp==0.1.6
     # via payi
 idna==3.4
     # via anyio
     # via httpx
-    # via requests
+    # via yarl
+multidict==6.4.4
+    # via aiohttp
+    # via yarl
+propcache==0.3.1
+    # via aiohttp
+    # via yarl
 nest-asyncio==1.6.0
     # via payi
 pydantic==2.10.3
@@ -52,6 +75,7 @@ tiktoken==0.8.0
     # via payi
 typing-extensions==4.12.2
     # via anyio
+    # via multidict
     # via payi
     # via pydantic
     # via pydantic-core
@@ -59,3 +83,5 @@ urllib3==2.3.0
     # via requests
 wrapt==1.17.2
     # via payi
+yarl==1.20.0
+    # via aiohttp

{payi-0.1.0a89 → payi-0.1.0a91}/src/payi/__init__.py

@@ -26,7 +26,7 @@ from ._exceptions import (
     UnprocessableEntityError,
     APIResponseValidationError,
 )
-from ._base_client import DefaultHttpxClient, DefaultAsyncHttpxClient
+from ._base_client import DefaultHttpxClient, DefaultAioHttpClient, DefaultAsyncHttpxClient
 from ._utils._logs import setup_logging as _setup_logging
 
 __all__ = [
@@ -68,6 +68,7 @@ __all__ = [
     "DEFAULT_CONNECTION_LIMITS",
     "DefaultHttpxClient",
     "DefaultAsyncHttpxClient",
+    "DefaultAioHttpClient",
 ]
 
 if not _t.TYPE_CHECKING:

{payi-0.1.0a89 → payi-0.1.0a91}/src/payi/_base_client.py

@@ -1071,7 +1071,14 @@ class SyncAPIClient(BaseClient[httpx.Client, Stream[Any]]):
     ) -> ResponseT:
         origin = get_origin(cast_to) or cast_to
 
-        if inspect.isclass(origin) and issubclass(origin, BaseAPIResponse):
+        if (
+            inspect.isclass(origin)
+            and issubclass(origin, BaseAPIResponse)
+            # we only want to actually return the custom BaseAPIResponse class if we're
+            # returning the raw response, or if we're not streaming SSE, as if we're streaming
+            # SSE then `cast_to` doesn't actively reflect the type we need to parse into
+            and (not stream or bool(response.request.headers.get(RAW_RESPONSE_HEADER)))
+        ):
             if not issubclass(origin, APIResponse):
                 raise TypeError(f"API Response types must subclass {APIResponse}; Received {origin}")
 
@@ -1282,6 +1289,24 @@ class _DefaultAsyncHttpxClient(httpx.AsyncClient):
         super().__init__(**kwargs)
 
 
+try:
+    import httpx_aiohttp
+except ImportError:
+
+    class _DefaultAioHttpClient(httpx.AsyncClient):
+        def __init__(self, **_kwargs: Any) -> None:
+            raise RuntimeError("To use the aiohttp client you must have installed the package with the `aiohttp` extra")
+else:
+
+    class _DefaultAioHttpClient(httpx_aiohttp.HttpxAiohttpClient):  # type: ignore
+        def __init__(self, **kwargs: Any) -> None:
+            kwargs.setdefault("timeout", DEFAULT_TIMEOUT)
+            kwargs.setdefault("limits", DEFAULT_CONNECTION_LIMITS)
+            kwargs.setdefault("follow_redirects", True)
+
+            super().__init__(**kwargs)
+
+
 if TYPE_CHECKING:
     DefaultAsyncHttpxClient = httpx.AsyncClient
     """An alias to `httpx.AsyncClient` that provides the same defaults that this SDK
@@ -1290,8 +1315,12 @@ if TYPE_CHECKING:
     This is useful because overriding the `http_client` with your own instance of
     `httpx.AsyncClient` will result in httpx's defaults being used, not ours.
     """
+
+    DefaultAioHttpClient = httpx.AsyncClient
+    """An alias to `httpx.AsyncClient` that changes the default HTTP transport to `aiohttp`."""
 else:
     DefaultAsyncHttpxClient = _DefaultAsyncHttpxClient
+    DefaultAioHttpClient = _DefaultAioHttpClient
 
 
 class AsyncHttpxClientWrapper(DefaultAsyncHttpxClient):
@@ -1574,7 +1603,14 @@ class AsyncAPIClient(BaseClient[httpx.AsyncClient, AsyncStream[Any]]):
     ) -> ResponseT:
         origin = get_origin(cast_to) or cast_to
 
-        if inspect.isclass(origin) and issubclass(origin, BaseAPIResponse):
+        if (
+            inspect.isclass(origin)
+            and issubclass(origin, BaseAPIResponse)
+            # we only want to actually return the custom BaseAPIResponse class if we're
+            # returning the raw response, or if we're not streaming SSE, as if we're streaming
+            # SSE then `cast_to` doesn't actively reflect the type we need to parse into
+            and (not stream or bool(response.request.headers.get(RAW_RESPONSE_HEADER)))
+        ):
             if not issubclass(origin, AsyncAPIResponse):
                 raise TypeError(f"API Response types must subclass {AsyncAPIResponse}; Received {origin}")
 

{payi-0.1.0a89 → payi-0.1.0a91}/src/payi/_version.py

@@ -1,4 +1,4 @@
 # File generated from our OpenAPI spec by Stainless. See CONTRIBUTING.md for details.
 
 __title__ = "payi"
-__version__ = "0.1.0-alpha.89"  # x-release-please-version
+__version__ = "0.1.0-alpha.91"  # x-release-please-version

{payi-0.1.0a89 → payi-0.1.0a91}/src/payi/lib/AnthropicInstrumentor.py

@@ -173,10 +173,15 @@ class _AnthropicProviderRequest(_ProviderRequest):
 
         messages = kwargs.get("messages")
         if messages:
+
             anthropic_has_image_and_get_texts(self, messages)
 
         return True
 
+    @override
+    def remove_inline_data(self, prompt: 'dict[str, Any]') -> bool:
+        return anthropic_remove_inline_data(prompt)
+
     @override
     def process_exception(self, exception: Exception, kwargs: Any, ) -> bool:
         try:
@@ -352,4 +357,30 @@ def has_image_and_get_texts(encoding: tiktoken.Encoding, content: Union[str, 'li
         token_count = sum(len(encoding.encode(item.get("text", ""))) for item in content if item.get("type") == "text")
         return has_image, token_count
     
-    return False, 0
+    return False, 0
+
+def anthropic_remove_inline_data(prompt: 'dict[str, Any]') -> bool:# noqa: ARG002
+    messages = prompt.get("messages", [])
+    if not messages:
+        return False
+
+    modified = False
+    for message in messages:
+        content = message.get('content', Any)
+        if not content or not isinstance(content, list):
+            continue
+
+        for item in content: # type: ignore
+            if not isinstance(item, dict):
+                continue
+            # item: dict[str, Any]
+            type = item.get("type", "") # type: ignore
+            if type != "image":
+                continue
+
+            source = item.get("source", {}) # type: ignore
+            if source.get("type", "") == "base64": # type: ignore
+                source["data"] = _PayiInstrumentor._not_instrumented
+                modified = True
+
+    return modified

{payi-0.1.0a89 → payi-0.1.0a91}/src/payi/lib/BedrockInstrumentor.py

@@ -356,6 +356,24 @@ class _BedrockInvokeProviderRequest(_BedrockProviderRequest):
 
         return response
 
+    @override
+    def remove_inline_data(self, prompt: 'dict[str, Any]') -> bool:# noqa: ARG002
+        if not self._is_anthropic:
+            return False
+
+        from .AnthropicInstrumentor import anthropic_remove_inline_data
+        body = prompt.get("body", "")
+        if not body:
+            return False
+        
+        body_json = json.loads(body)
+        
+        if anthropic_remove_inline_data(body_json):
+            prompt["body"] = json.dumps(body_json)
+            return True
+
+        return False
+
 class _BedrockConverseProviderRequest(_BedrockProviderRequest):
     @override
     def process_synchronous_response(

{payi-0.1.0a89 → payi-0.1.0a91}/src/payi/lib/OpenAIInstrumentor.py

@@ -301,9 +301,9 @@ class _OpenAiProviderRequest(_ProviderRequest):
         units["text"] = Units(input=input, output=output)
 
     @staticmethod
-    def has_image_and_get_texts(encoding: tiktoken.Encoding, content: Union[str, 'list[Any]'], image_type: str = "image_url", text_type:str = "text") -> 'tuple[bool, int]':
+    def has_image_and_get_texts(encoding: tiktoken.Encoding, content: Union[str, 'list[Any]'], image_type: str, text_type: str) -> 'tuple[bool, int]':
         if isinstance(content, list): # type: ignore
-            has_image = any(item.get("type") == image_type for item in content)
+            has_image = any(item.get("type", "") == image_type for item in content)
             if has_image is False:
                 return has_image, 0
             
@@ -311,6 +311,28 @@ class _OpenAiProviderRequest(_ProviderRequest):
             return has_image, token_count
         return False, 0
 
+    @staticmethod
+    def post_process_request_prompt(content: Union[str, 'list[Any]'], image_type: str, url_subkey: bool) -> bool:
+        modified = False
+        if isinstance(content, list): # type: ignore
+            for item in content:
+                type = item.get("type", "")
+                if type != image_type:
+                    continue
+
+                if url_subkey:
+                    url = item.get("image_url", {}).get("url", "")
+                    if url.startswith("data:"):
+                        item["image_url"]["url"] = _PayiInstrumentor._not_instrumented
+                        modified = True
+                else:
+                    url = item.get("image_url", "")
+                    if url.startswith("data:"):
+                        item["image_url"] = _PayiInstrumentor._not_instrumented
+                        modified = True
+
+        return modified
+
 class _OpenAiEmbeddingsProviderRequest(_OpenAiProviderRequest):
     def __init__(self, instrumentor: _PayiInstrumentor):
         super().__init__(
@@ -397,7 +419,7 @@ class _OpenAiChatProviderRequest(_OpenAiProviderRequest):
             
             if enc:
                 for message in messages:
-                    msg_has_image, msg_prompt_tokens = self.has_image_and_get_texts(enc, message.get('content', ''))
+                    msg_has_image, msg_prompt_tokens = self.has_image_and_get_texts(enc, message.get('content', ''), image_type="image_url", text_type="text")
                     if msg_has_image:
                         has_image = True
                         estimated_token_count += msg_prompt_tokens
@@ -418,6 +440,13 @@ class _OpenAiChatProviderRequest(_OpenAiProviderRequest):
                     self._include_usage_added = True
         return True
 
+    @override
+    def remove_inline_data(self, prompt: 'dict[str, Any]') -> bool:
+        messages = prompt.get("messages", None)
+        if not messages:
+            return False
+        return self.post_process_request_prompt(messages, image_type="image_url", url_subkey=True)
+
     @override
     def process_synchronous_response(
         self,
@@ -531,6 +560,21 @@ class _OpenAiResponsesProviderRequest(_OpenAiProviderRequest):
 
         return True
 
+    @override
+    def remove_inline_data(self, prompt: 'dict[str, Any]') -> bool:
+        modified = False
+        input = prompt.get("input", [])
+        for item in input:
+            if not isinstance(item, dict):
+                continue
+
+            for key, value in item.items(): # type: ignore
+                if key == "content":
+                    if isinstance(value, list):
+                        modified = self.post_process_request_prompt(value, image_type="input_image", url_subkey=False) | modified # type: ignore
+
+        return modified
+
     @override
     def process_synchronous_response(
         self,

{payi-0.1.0a89 → payi-0.1.0a91}/src/payi/lib/VertexRequest.py

@@ -1,6 +1,7 @@
 import json
 import math
 from typing import Any, Optional
+from typing_extensions import override
 
 from payi.lib.helpers import PayiCategories
 from payi.types.ingest_units_params import Units
@@ -62,7 +63,22 @@ class _VertexRequest(_ProviderRequest): # type: ignore
             ingest = True
 
         return _ChunkResult(send_chunk_to_caller=True, ingest=ingest)
-    
+
+    @override
+    def remove_inline_data(self, prompt: 'dict[str, Any]') -> bool:
+        modified = False
+
+        parts: list[dict[str, Any]] = prompt["contents"].get("parts", []) 
+        for part in parts:
+            inline_data = part.get("inline_data", {})
+            if not isinstance(inline_data, dict):
+                continue
+            if "data" in inline_data:
+                inline_data["data"] = _PayiInstrumentor._not_instrumented
+                modified = True
+
+        return modified
+
     def process_response_part_for_function_call(self, part: 'dict[str, Any]') -> None:
         function = part.get("function_call", {})
         if not function: