codex-lb 0.3.1__tar.gz → 0.5.0__tar.gz

{codex_lb-0.3.1 → codex_lb-0.5.0}/.all-contributorsrc

@@ -44,6 +44,26 @@
         "maintenance",
         "design"
       ]
+    },
+    {
+      "login": "hhsw2015",
+      "name": "Jill Kok, San Mou",
+      "avatar_url": "https://avatars.githubusercontent.com/u/103614420?v=4",
+      "profile": "https://github.com/hhsw2015",
+      "contributions": [
+        "code",
+        "test",
+        "maintenance"
+      ]
+    },
+    {
+      "login": "pcy06",
+      "name": "PARK CHANYOUNG",
+      "avatar_url": "https://avatars.githubusercontent.com/u/44970486?v=4",
+      "profile": "https://github.com/pcy06",
+      "contributions": [
+        "doc"
+      ]
     }
   ],
   "contributorsPerLine": 7,

codex_lb-0.5.0/.github/release-please-manifest.json

@@ -0,0 +1,3 @@
+{
+  ".": "0.5.0"
+}

{codex_lb-0.3.1 → codex_lb-0.5.0}/.github/workflows/ci.yml

@@ -30,6 +30,26 @@ jobs:
       - name: Ruff format (check)
         run: uvx ruff format --check .
 
+  typecheck:
+    name: Type check (ty)
+    runs-on: ubuntu-24.04
+
+    steps:
+      - name: Checkout repository
+        uses: actions/checkout@v4
+
+      - name: Set up uv
+        uses: astral-sh/setup-uv@v5
+        with:
+          python-version: "3.13"
+          enable-cache: true
+
+      - name: Install dependencies
+        run: uv sync --dev --frozen
+
+      - name: Ty check
+        run: uv run ty check
+
   test:
     name: Tests (pytest)
     runs-on: ubuntu-24.04

{codex_lb-0.3.1 → codex_lb-0.5.0}/.gitignore

@@ -33,6 +33,7 @@ node_modules/
 
 # Local
 .local/
+.worktrees/
 
 app/static/components
-.codex-lb/
+.codex-lb/

{codex_lb-0.3.1 → codex_lb-0.5.0}/AGENTS.md

@@ -1,16 +1,26 @@
 # AGENTS
 
 ## Environment
+
 - Python: .venv/bin/python (uv, CPython 3.13.3)
 
 ## Code Conventions (Typing & Data Contracts)
+
 - Prefer strict typing end-to-end. Avoid `dict`, `Mapping[str, object]`, and `object` in app/service/repository layers when the shape is known.
 - Use explicit dataclasses or Pydantic models for internal payloads; convert to response schemas at the edge.
 - ORM models should be passed through services instead of generic containers; avoid `getattr`/`[]` access on ORM results.
 - Expose time values in dashboard APIs as ISO 8601 strings (`datetime` in schemas), not epoch numbers.
 - If a test depends on a contract change (field name/type), update the test to match the new typed schema.
 
+## Code Conventions (Anti-Patterns to Avoid)
+
+- **No Speculative Fallbacks**: Do not use multiple keys for the same configuration (e.g., `os.getenv("A") or os.getenv("B")`). Pick one canonical name and stick to it.
+- **Single Source of Truth**: Do not create redundant fields in data models (JSON/DB) that represent the same state. Calculate derived values dynamically.
+- **Fail Fast**: Do not clutter code with excessive `None` checks or fallback defaults for critical configurations. Raise explicit errors for missing or invalid configuration.
+- **Refactor over Duplicate**: Do not duplicate logic to avoid touching existing code. Refactor the existing code to support the new requirement.
+
 ## Code Conventions (Structure & Responsibilities)
+
 - Keep domain boundaries clear: `core/` for reusable logic, `modules/*` for API-facing features, `db/` for persistence, `static/` for dashboard assets.
 - Follow module layout conventions in `app/modules/<feature>/`: `api.py` (routes), `service.py` (business logic), `repository.py` (DB access), `schemas.py` (Pydantic I/O models).
 - Prefer small, focused files; split when a file grows beyond a single responsibility or mixes layers.
@@ -20,6 +30,7 @@
 - Validate inputs early and fail fast with clear errors; never silently coerce invalid types.
 
 ## Code Conventions (Testing / TC)
+
 - Add or update tests whenever contracts change (field names/types, response formats, default values).
 - Keep unit tests under `tests/unit` and integration tests under `tests/integration` using existing markers.
 - Tests should assert public behavior (API responses, service outputs) rather than internal implementation details.
@@ -27,6 +38,7 @@
 - Prefer deterministic inputs (fixed timestamps, explicit payloads) to avoid flaky tests.
 
 ## Code Conventions (DI & Context)
+
 - Use FastAPI `Depends` providers in `app/dependencies.py` to construct per-request contexts (`*Context` dataclasses).
 - Contexts should hold only the session, repositories, and service for a single module; avoid cross-module service coupling.
 - Repositories must be constructed with the request-scoped `AsyncSession` from `get_session`; no global sessions.
@@ -35,6 +47,7 @@
 - When adding a new module, define `api.py` endpoints that depend on a module-specific context provider.
 
 ## Git Workflow & Contribution
+
 1. **Important**: Create branches, commits, or PRs **only upon explicit user request**. Implicit actions are not allowed.
 2. **Branch Naming**: Use prefixes like `feature/`, `fix/`, `chore/` (e.g., `feature/add-login`).
 3. **Commit Messages**: Follow [Conventional Commits](https://www.conventionalcommits.org/).
@@ -42,6 +55,7 @@
    - Types: `feat`, `fix`, `docs`, `refactor`, `chore`, `test`
    - Example: `feat(api): add auth endpoint`
 4. **Workflow**:
+
    ```bash
    git checkout -b feature/add-login
    git commit -m "feat(api): add auth endpoint"
@@ -49,4 +63,5 @@
    git push -u origin feature/add-login
    gh pr create --title "feat(api): add auth" --body "..."
    ```
+
 5. **Best Practices**: Commit often in small units. Do not commit directly to `main`. Always check `git diff` before pushing.

{codex_lb-0.3.1 → codex_lb-0.5.0}/CHANGELOG.md

@@ -1,5 +1,45 @@
 # Changelog
 
+## [0.5.0](https://github.com/Soju06/codex-lb/compare/v0.4.0...v0.5.0) (2026-01-29)
+
+
+### Features
+
+* **db:** add configurable pool settings ([#44](https://github.com/Soju06/codex-lb/issues/44)) ([e2e553d](https://github.com/Soju06/codex-lb/commit/e2e553debfac1ab51c691a883b16812db6acdd9e))
+* **proxy:** add v1 chat and models endpoints ([#39](https://github.com/Soju06/codex-lb/issues/39)) ([c242304](https://github.com/Soju06/codex-lb/commit/c242304304583821afebb9e2c0b2803012d4a7aa))
+
+
+### Bug Fixes
+
+* **accounts:** update upsert for duplicate email ([#35](https://github.com/Soju06/codex-lb/issues/35)) ([5f68773](https://github.com/Soju06/codex-lb/commit/5f6877342d81abca82e800dbf0b21458e78cb1d9))
+* **core:** support zstd request decompression and modularize middleware ([#42](https://github.com/Soju06/codex-lb/issues/42)) ([d0eebb7](https://github.com/Soju06/codex-lb/commit/d0eebb7b9c8c16b1a1293279db42633ba75b1867))
+* **proxy:** use short-lived sessions for streaming ([#38](https://github.com/Soju06/codex-lb/issues/38)) ([cb48757](https://github.com/Soju06/codex-lb/commit/cb48757bfbf66d3fb2598523d66c6b5bda44a55d))
+* **usage:** coalesce refresh requests ([#36](https://github.com/Soju06/codex-lb/issues/36)) ([04d8fab](https://github.com/Soju06/codex-lb/commit/04d8fab891236e4d4b6bb46c5219730acbabd822))
+
+
+### Documentation
+
+* add hhsw2015 as a contributor for maintenance ([#43](https://github.com/Soju06/codex-lb/issues/43)) ([1651968](https://github.com/Soju06/codex-lb/commit/1651968e2c8605190fe8647c755f2ab97a7db3d3))
+
+## [0.4.0](https://github.com/Soju06/codex-lb/compare/v0.3.1...v0.4.0) (2026-01-26)
+
+
+### Features
+
+* **proxy:** add v1 responses compatibility for OpenCode ([#28](https://github.com/Soju06/codex-lb/issues/28)) ([04d58d2](https://github.com/Soju06/codex-lb/commit/04d58d2430e4ba88f28e9e811f08b628e9a4674c))
+
+
+### Bug Fixes
+
+* **dashboard:** remove rounding in avgPerHour calculation ([#29](https://github.com/Soju06/codex-lb/issues/29)) ([b432939](https://github.com/Soju06/codex-lb/commit/b432939d6ea832d917658dfdbcb935f88f9e08a6)), closes [#26](https://github.com/Soju06/codex-lb/issues/26)
+
+
+### Documentation
+
+* add hhsw2015 as a contributor for code, and test ([#31](https://github.com/Soju06/codex-lb/issues/31)) ([a1f0e79](https://github.com/Soju06/codex-lb/commit/a1f0e796e45862e520953f60716d2b5eaab3a0d9))
+* add opencode setup guide ([#32](https://github.com/Soju06/codex-lb/issues/32)) ([9330619](https://github.com/Soju06/codex-lb/commit/93306198902e558e6bce89719d7cd6b1e797ddc5))
+* add pcy06 as a contributor for doc ([#34](https://github.com/Soju06/codex-lb/issues/34)) ([506b7b1](https://github.com/Soju06/codex-lb/commit/506b7b160b11b558533fafb39793870ceefd9131))
+
 ## [0.3.1](https://github.com/Soju06/codex-lb/compare/v0.3.0...v0.3.1) (2026-01-22)
 
 

{codex_lb-0.3.1 → codex_lb-0.5.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: codex-lb
-Version: 0.3.1
+Version: 0.5.0
 Summary: Codex load balancer and proxy for ChatGPT accounts with usage dashboard
 Author-email: Soju06 <qlskssk@gmail.com>
 Maintainer-email: Soju06 <qlskssk@gmail.com>
@@ -49,12 +49,25 @@ Requires-Dist: pydantic>=2.12.5
 Requires-Dist: python-dotenv>=1.2.1
 Requires-Dist: python-multipart>=0.0.21
 Requires-Dist: sqlalchemy>=2.0.45
+Requires-Dist: zstandard>=0.25.0
 Description-Content-Type: text/markdown
 
+<!--
+About
+Codex/ChatGPT account load balancer & proxy with usage tracking, dashboard, and OpenCode-compatible endpoints
+
+Topics
+python oauth sqlalchemy dashboard load-balancer openai rate-limit api-proxy codex fastapi usage-tracking chatgpt opencode
+
+Resources
+-->
+
 # codex-lb
 
 Load balancer for ChatGPT accounts. Pool multiple accounts, track usage, view everything in a dashboard.
 
+## Screenshots
+
 ### Main Dashboard View
 
 ![main dashboard view](docs/screenshots/dashboard.jpg)
@@ -82,8 +95,6 @@ uvx codex-lb
 
 Open [localhost:2455](http://localhost:2455) → Add account → Done.
 
-
-
 ## Codex CLI & Extension Setup
 
 Add to `~/.codex/config.toml`:
@@ -101,6 +112,32 @@ chatgpt_base_url = "http://127.0.0.1:2455"
 requires_openai_auth = true  # Required: enables model selection in Codex IDE extension
 ```
 
+## OpenCode Setup
+
+Run:
+
+```bash
+opencode auth login
+```
+
+Then select `OpenAI` -> `Manually enter API Key` and enter any value.
+
+Add the following to `~/.config/opencode/opencode.json`:
+
+```jsonc
+{
+  ...
+  "provider": {
+    "openai": {
+      "options": {
+        "baseURL": "http://127.0.0.1:2455/v1"
+      }
+    },
+    ...
+  }
+}
+```
+
 ## Data
 
 All data stored in `~/.codex-lb/`:
@@ -122,6 +159,8 @@ Thanks goes to these wonderful people ([emoji key](https://allcontributors.org/d
       <td align="center" valign="top" width="14.28%"><a href="https://github.com/Soju06"><img src="https://avatars.githubusercontent.com/u/34199905?v=4?s=100" width="100px;" alt="Soju06"/><br /><sub><b>Soju06</b></sub></a><br /><a href="https://github.com/Soju06/codex-lb/commits?author=Soju06" title="Code">💻</a> <a href="https://github.com/Soju06/codex-lb/commits?author=Soju06" title="Tests">⚠️</a> <a href="#maintenance-Soju06" title="Maintenance">🚧</a> <a href="#infra-Soju06" title="Infrastructure (Hosting, Build-Tools, etc)">🚇</a></td>
       <td align="center" valign="top" width="14.28%"><a href="http://jonas.kamsker.at/"><img src="https://avatars.githubusercontent.com/u/11245306?v=4?s=100" width="100px;" alt="Jonas Kamsker"/><br /><sub><b>Jonas Kamsker</b></sub></a><br /><a href="https://github.com/Soju06/codex-lb/commits?author=JKamsker" title="Code">💻</a> <a href="https://github.com/Soju06/codex-lb/issues?q=author%3AJKamsker" title="Bug reports">🐛</a> <a href="#maintenance-JKamsker" title="Maintenance">🚧</a></td>
       <td align="center" valign="top" width="14.28%"><a href="https://github.com/Quack6765"><img src="https://avatars.githubusercontent.com/u/5446230?v=4?s=100" width="100px;" alt="Quack"/><br /><sub><b>Quack</b></sub></a><br /><a href="https://github.com/Soju06/codex-lb/commits?author=Quack6765" title="Code">💻</a> <a href="https://github.com/Soju06/codex-lb/issues?q=author%3AQuack6765" title="Bug reports">🐛</a> <a href="#maintenance-Quack6765" title="Maintenance">🚧</a> <a href="#design-Quack6765" title="Design">🎨</a></td>
+      <td align="center" valign="top" width="14.28%"><a href="https://github.com/hhsw2015"><img src="https://avatars.githubusercontent.com/u/103614420?v=4?s=100" width="100px;" alt="Jill Kok, San Mou"/><br /><sub><b>Jill Kok, San Mou</b></sub></a><br /><a href="https://github.com/Soju06/codex-lb/commits?author=hhsw2015" title="Code">💻</a> <a href="https://github.com/Soju06/codex-lb/commits?author=hhsw2015" title="Tests">⚠️</a> <a href="#maintenance-hhsw2015" title="Maintenance">🚧</a></td>
+      <td align="center" valign="top" width="14.28%"><a href="https://github.com/pcy06"><img src="https://avatars.githubusercontent.com/u/44970486?v=4?s=100" width="100px;" alt="PARK CHANYOUNG"/><br /><sub><b>PARK CHANYOUNG</b></sub></a><br /><a href="https://github.com/Soju06/codex-lb/commits?author=pcy06" title="Documentation">📖</a></td>
     </tr>
   </tbody>
 </table>

{codex_lb-0.3.1 → codex_lb-0.5.0}/README.md

@@ -1,7 +1,19 @@
+<!--
+About
+Codex/ChatGPT account load balancer & proxy with usage tracking, dashboard, and OpenCode-compatible endpoints
+
+Topics
+python oauth sqlalchemy dashboard load-balancer openai rate-limit api-proxy codex fastapi usage-tracking chatgpt opencode
+
+Resources
+-->
+
 # codex-lb
 
 Load balancer for ChatGPT accounts. Pool multiple accounts, track usage, view everything in a dashboard.
 
+## Screenshots
+
 ### Main Dashboard View
 
 ![main dashboard view](docs/screenshots/dashboard.jpg)
@@ -29,8 +41,6 @@ uvx codex-lb
 
 Open [localhost:2455](http://localhost:2455) → Add account → Done.
 
-
-
 ## Codex CLI & Extension Setup
 
 Add to `~/.codex/config.toml`:
@@ -48,6 +58,32 @@ chatgpt_base_url = "http://127.0.0.1:2455"
 requires_openai_auth = true  # Required: enables model selection in Codex IDE extension
 ```
 
+## OpenCode Setup
+
+Run:
+
+```bash
+opencode auth login
+```
+
+Then select `OpenAI` -> `Manually enter API Key` and enter any value.
+
+Add the following to `~/.config/opencode/opencode.json`:
+
+```jsonc
+{
+  ...
+  "provider": {
+    "openai": {
+      "options": {
+        "baseURL": "http://127.0.0.1:2455/v1"
+      }
+    },
+    ...
+  }
+}
+```
+
 ## Data
 
 All data stored in `~/.codex-lb/`:
@@ -69,6 +105,8 @@ Thanks goes to these wonderful people ([emoji key](https://allcontributors.org/d
       <td align="center" valign="top" width="14.28%"><a href="https://github.com/Soju06"><img src="https://avatars.githubusercontent.com/u/34199905?v=4?s=100" width="100px;" alt="Soju06"/><br /><sub><b>Soju06</b></sub></a><br /><a href="https://github.com/Soju06/codex-lb/commits?author=Soju06" title="Code">💻</a> <a href="https://github.com/Soju06/codex-lb/commits?author=Soju06" title="Tests">⚠️</a> <a href="#maintenance-Soju06" title="Maintenance">🚧</a> <a href="#infra-Soju06" title="Infrastructure (Hosting, Build-Tools, etc)">🚇</a></td>
       <td align="center" valign="top" width="14.28%"><a href="http://jonas.kamsker.at/"><img src="https://avatars.githubusercontent.com/u/11245306?v=4?s=100" width="100px;" alt="Jonas Kamsker"/><br /><sub><b>Jonas Kamsker</b></sub></a><br /><a href="https://github.com/Soju06/codex-lb/commits?author=JKamsker" title="Code">💻</a> <a href="https://github.com/Soju06/codex-lb/issues?q=author%3AJKamsker" title="Bug reports">🐛</a> <a href="#maintenance-JKamsker" title="Maintenance">🚧</a></td>
       <td align="center" valign="top" width="14.28%"><a href="https://github.com/Quack6765"><img src="https://avatars.githubusercontent.com/u/5446230?v=4?s=100" width="100px;" alt="Quack"/><br /><sub><b>Quack</b></sub></a><br /><a href="https://github.com/Soju06/codex-lb/commits?author=Quack6765" title="Code">💻</a> <a href="https://github.com/Soju06/codex-lb/issues?q=author%3AQuack6765" title="Bug reports">🐛</a> <a href="#maintenance-Quack6765" title="Maintenance">🚧</a> <a href="#design-Quack6765" title="Design">🎨</a></td>
+      <td align="center" valign="top" width="14.28%"><a href="https://github.com/hhsw2015"><img src="https://avatars.githubusercontent.com/u/103614420?v=4?s=100" width="100px;" alt="Jill Kok, San Mou"/><br /><sub><b>Jill Kok, San Mou</b></sub></a><br /><a href="https://github.com/Soju06/codex-lb/commits?author=hhsw2015" title="Code">💻</a> <a href="https://github.com/Soju06/codex-lb/commits?author=hhsw2015" title="Tests">⚠️</a> <a href="#maintenance-hhsw2015" title="Maintenance">🚧</a></td>
+      <td align="center" valign="top" width="14.28%"><a href="https://github.com/pcy06"><img src="https://avatars.githubusercontent.com/u/44970486?v=4?s=100" width="100px;" alt="PARK CHANYOUNG"/><br /><sub><b>PARK CHANYOUNG</b></sub></a><br /><a href="https://github.com/Soju06/codex-lb/commits?author=pcy06" title="Documentation">📖</a></td>
     </tr>
   </tbody>
 </table>

{codex_lb-0.3.1 → codex_lb-0.5.0}/app/core/clients/proxy.py

@@ -1,7 +1,7 @@
 from __future__ import annotations
 
 import asyncio
-from typing import AsyncIterator, Mapping
+from typing import AsyncIterator, Mapping, Protocol, TypeAlias
 
 import aiohttp
 
@@ -28,6 +28,18 @@ class StreamIdleTimeoutError(Exception):
     pass
 
 
+class ErrorResponseProtocol(Protocol):
+    status: int
+    reason: str | None
+
+    async def json(self, *, content_type: str | None = None) -> object: ...
+
+    async def text(self, *, encoding: str | None = None, errors: str = "strict") -> str: ...
+
+
+ErrorResponse: TypeAlias = aiohttp.ClientResponse | ErrorResponseProtocol
+
+
 class ProxyResponseError(Exception):
     def __init__(self, status_code: int, payload: OpenAIErrorEnvelope) -> None:
         super().__init__(f"Proxy response error ({status_code})")
@@ -88,8 +100,10 @@ async def _iter_sse_lines(
         yield line
 
 
-async def _error_event_from_response(resp: aiohttp.ClientResponse) -> ResponseFailedEvent:
+async def _error_event_from_response(resp: ErrorResponse) -> ResponseFailedEvent:
     fallback_message = f"Upstream error: HTTP {resp.status}"
+    if resp.reason:
+        fallback_message += f" {resp.reason}"
     try:
         data = await resp.json(content_type=None)
     except Exception:
@@ -112,11 +126,16 @@ async def _error_event_from_response(resp: aiohttp.ClientResponse) -> ResponseFa
                 if key in payload:
                     event["response"]["error"][key] = payload[key]
             return event
+        message = _extract_upstream_message(data)
+        if message:
+            return response_failed_event("upstream_error", message, response_id=get_request_id())
     return response_failed_event("upstream_error", fallback_message, response_id=get_request_id())
 
 
-async def _error_payload_from_response(resp: aiohttp.ClientResponse) -> OpenAIErrorEnvelope:
+async def _error_payload_from_response(resp: ErrorResponse) -> OpenAIErrorEnvelope:
     fallback_message = f"Upstream error: HTTP {resp.status}"
+    if resp.reason:
+        fallback_message += f" {resp.reason}"
     try:
         data = await resp.json(content_type=None)
     except Exception:
@@ -128,9 +147,20 @@ async def _error_payload_from_response(resp: aiohttp.ClientResponse) -> OpenAIEr
         error = parse_error_payload(data)
         if error:
             return {"error": error.model_dump(exclude_none=True)}
+        message = _extract_upstream_message(data)
+        if message:
+            return openai_error("upstream_error", message)
     return openai_error("upstream_error", fallback_message)
 
 
+def _extract_upstream_message(data: dict) -> str | None:
+    for key in ("message", "detail", "error"):
+        value = data.get(key)
+        if isinstance(value, str) and value.strip():
+            return value
+    return None
+
+
 async def stream_responses(
     payload: ResponsesRequest,
     headers: Mapping[str, str],

{codex_lb-0.3.1 → codex_lb-0.5.0}/app/core/config/settings.py

@@ -3,7 +3,7 @@ from __future__ import annotations
 from functools import lru_cache
 from pathlib import Path
 
-from pydantic import field_validator
+from pydantic import Field, field_validator
 from pydantic_settings import BaseSettings, SettingsConfigDict
 
 BASE_DIR = Path(__file__).resolve().parents[3]
@@ -22,6 +22,9 @@ class Settings(BaseSettings):
     )
 
     database_url: str = f"sqlite+aiosqlite:///{DEFAULT_DB_PATH}"
+    database_pool_size: int = Field(default=15, gt=0)
+    database_max_overflow: int = Field(default=10, ge=0)
+    database_pool_timeout_seconds: float = Field(default=30.0, gt=0)
     upstream_base_url: str = "https://chatgpt.com/backend-api"
     upstream_connect_timeout_seconds: float = 30.0
     stream_idle_timeout_seconds: float = 300.0
@@ -42,24 +45,22 @@ class Settings(BaseSettings):
     database_migrations_fail_fast: bool = True
     log_proxy_request_shape: bool = False
     log_proxy_request_shape_raw_cache_key: bool = False
+    log_proxy_request_payload: bool = False
+    max_decompressed_body_bytes: int = Field(default=32 * 1024 * 1024, gt=0)
 
     @field_validator("database_url")
     @classmethod
-    def _normalize_database_url(cls, value: str) -> str:
-        if not isinstance(value, str):
-            return value
-
+    def _expand_database_url(cls, value: str) -> str:
         for prefix in ("sqlite+aiosqlite:///", "sqlite:///"):
             if value.startswith(prefix):
                 path = value[len(prefix) :]
                 if path.startswith("~"):
-                    expanded = str(Path(path).expanduser())
-                    return f"{prefix}{expanded}"
+                    return f"{prefix}{Path(path).expanduser()}"
         return value
 
     @field_validator("encryption_key_file", mode="before")
     @classmethod
-    def _normalize_encryption_key_file(cls, value: object) -> Path:
+    def _expand_encryption_key_file(cls, value: str | Path) -> Path:
         if isinstance(value, Path):
             return value.expanduser()
         if isinstance(value, str):

codex_lb-0.5.0/app/core/handlers/__init__.py

@@ -0,0 +1,3 @@
+from app.core.handlers.exceptions import add_exception_handlers
+
+__all__ = ["add_exception_handlers"]

codex_lb-0.5.0/app/core/handlers/exceptions.py

@@ -0,0 +1,39 @@
+from __future__ import annotations
+
+from fastapi import FastAPI, Request
+from fastapi.exception_handlers import (
+    http_exception_handler,
+    request_validation_exception_handler,
+)
+from fastapi.exceptions import RequestValidationError
+from fastapi.responses import JSONResponse, Response
+from starlette.exceptions import HTTPException as StarletteHTTPException
+
+from app.core.errors import dashboard_error
+
+
+def add_exception_handlers(app: FastAPI) -> None:
+    @app.exception_handler(RequestValidationError)
+    async def validation_error_handler(
+        request: Request,
+        exc: RequestValidationError,
+    ) -> Response:
+        if request.url.path.startswith("/api/"):
+            return JSONResponse(
+                status_code=422,
+                content=dashboard_error("validation_error", "Invalid request payload"),
+            )
+        return await request_validation_exception_handler(request, exc)
+
+    @app.exception_handler(StarletteHTTPException)
+    async def http_error_handler(
+        request: Request,
+        exc: StarletteHTTPException,
+    ) -> Response:
+        if request.url.path.startswith("/api/"):
+            detail = exc.detail if isinstance(exc.detail, str) else "Request failed"
+            return JSONResponse(
+                status_code=exc.status_code,
+                content=dashboard_error(f"http_{exc.status_code}", detail),
+            )
+        return await http_exception_handler(request, exc)

codex_lb-0.5.0/app/core/middleware/__init__.py

@@ -0,0 +1,9 @@
+from app.core.middleware.api_errors import add_api_unhandled_error_middleware
+from app.core.middleware.request_decompression import add_request_decompression_middleware
+from app.core.middleware.request_id import add_request_id_middleware
+
+__all__ = [
+    "add_api_unhandled_error_middleware",
+    "add_request_decompression_middleware",
+    "add_request_id_middleware",
+]

codex_lb-0.5.0/app/core/middleware/api_errors.py

@@ -0,0 +1,33 @@
+from __future__ import annotations
+
+import logging
+from collections.abc import Awaitable, Callable
+
+from fastapi import FastAPI, Request
+from fastapi.responses import JSONResponse, Response
+
+from app.core.errors import dashboard_error
+from app.core.utils.request_id import get_request_id
+
+logger = logging.getLogger(__name__)
+
+
+def add_api_unhandled_error_middleware(app: FastAPI) -> None:
+    @app.middleware("http")
+    async def api_unhandled_error_middleware(
+        request: Request,
+        call_next: Callable[[Request], Awaitable[Response]],
+    ) -> Response:
+        try:
+            return await call_next(request)
+        except Exception:
+            if request.url.path.startswith("/api/"):
+                logger.exception(
+                    "Unhandled API error request_id=%s",
+                    get_request_id(),
+                )
+                return JSONResponse(
+                    status_code=500,
+                    content=dashboard_error("internal_error", "Unexpected error"),
+                )
+            raise

codex_lb-0.5.0/app/core/middleware/request_decompression.py

@@ -0,0 +1,101 @@
+from __future__ import annotations
+
+import io
+from collections.abc import Awaitable, Callable
+from typing import Protocol
+
+import zstandard as zstd
+from fastapi import FastAPI, Request
+from fastapi.responses import JSONResponse, Response
+
+from app.core.config.settings import get_settings
+from app.core.errors import dashboard_error
+
+
+class _DecompressedBodyTooLarge(Exception):
+    def __init__(self, max_size: int) -> None:
+        super().__init__(f"Decompressed body exceeded {max_size} bytes")
+        self.max_size = max_size
+
+
+class _Readable(Protocol):
+    def read(self, size: int = ...) -> bytes: ...
+
+
+def _read_limited(reader: _Readable, max_size: int) -> bytes:
+    buffer = bytearray()
+    total = 0
+    chunk_size = 64 * 1024
+    while True:
+        chunk = reader.read(chunk_size)
+        if not chunk:
+            break
+        total += len(chunk)
+        if total > max_size:
+            raise _DecompressedBodyTooLarge(max_size)
+        buffer.extend(chunk)
+    return bytes(buffer)
+
+
+def _replace_request_body(request: Request, body: bytes) -> None:
+    request._body = body
+    headers: list[tuple[bytes, bytes]] = []
+    for key, value in request.scope.get("headers", []):
+        if key.lower() in (b"content-encoding", b"content-length"):
+            continue
+        headers.append((key, value))
+    headers.append((b"content-length", str(len(body)).encode("ascii")))
+    request.scope["headers"] = headers
+    # Ensure subsequent request.headers reflects the updated scope headers.
+    request._headers = None
+
+
+def add_request_decompression_middleware(app: FastAPI) -> None:
+    @app.middleware("http")
+    async def request_decompression_middleware(
+        request: Request,
+        call_next: Callable[[Request], Awaitable[Response]],
+    ) -> Response:
+        content_encoding = request.headers.get("content-encoding")
+        if not content_encoding:
+            return await call_next(request)
+        encodings = [enc.strip().lower() for enc in content_encoding.split(",") if enc.strip()]
+        if encodings != ["zstd"]:
+            return await call_next(request)
+        body = await request.body()
+        settings = get_settings()
+        max_size = settings.max_decompressed_body_bytes
+        try:
+            decompressed = zstd.ZstdDecompressor().decompress(body, max_output_size=max_size)
+            if len(decompressed) > max_size:
+                raise _DecompressedBodyTooLarge(max_size)
+        except _DecompressedBodyTooLarge:
+            return JSONResponse(
+                status_code=413,
+                content=dashboard_error(
+                    "payload_too_large",
+                    "Request body exceeds the maximum allowed size",
+                ),
+            )
+        except Exception:
+            try:
+                with zstd.ZstdDecompressor().stream_reader(io.BytesIO(body)) as reader:
+                    decompressed = _read_limited(reader, max_size)
+            except _DecompressedBodyTooLarge:
+                return JSONResponse(
+                    status_code=413,
+                    content=dashboard_error(
+                        "payload_too_large",
+                        "Request body exceeds the maximum allowed size",
+                    ),
+                )
+            except Exception:
+                return JSONResponse(
+                    status_code=400,
+                    content=dashboard_error(
+                        "invalid_request",
+                        "Request body is zstd-compressed but could not be decompressed",
+                    ),
+                )
+        _replace_request_body(request, decompressed)
+        return await call_next(request)