benchflow 0.5.1.dev869__tar.gz → 0.5.2.dev875__tar.gz

{benchflow-0.5.1.dev869 → benchflow-0.5.2.dev875}/CHANGELOG.md

@@ -2,16 +2,39 @@
 
 ## [Unreleased]
 
+## 0.5.1 — 2026-06-05
+
 ### Added
 
 - **Daytona usage telemetry by default** — Daytona runs now start a sandbox-local provider usage proxy so token/cost telemetry works without an external tunnel; use `--usage-tracking off` to bypass proxying when needed.
 - **Azure AI Foundry providers** — new `azure-foundry-openai/` and `azure-foundry-anthropic/` prefixes routing through Foundry's unified resource. Export `AZURE_API_KEY` plus `AZURE_API_ENDPOINT` (e.g. `https://<resource>.openai.azure.com/`); benchflow derives the resource name from the endpoint host, builds the per-surface base URL, and maps the key onto the agent-native auth env automatically. Missing/unrecognized endpoints and unsupported agent/provider protocol pairings fail fast with clear errors instead of falling through to the wrong endpoint.
 - **Azure Foundry auth guidance** — agent discovery output and docs now call out that provider-prefixed models can use provider-specific credentials instead of the agent's native/default API key.
 
+### Changed
+
+- **PyPI project documentation refresh** — the public package README, install snippets, release-channel docs, examples, and citation metadata now point at `0.5.1`.
+
 ### Fixed
 
 - Inherit `BENCHFLOW_PROVIDER_BASE_URL` / `BENCHFLOW_PROVIDER_API_KEY` from the host environment so self-hosted / OpenAI-compatible endpoints route correctly instead of falling back to `api.openai.com`; empty or whitespace-only host values are skipped so they cannot shadow the resolved provider URL (benchflow-ai/skillsbench#817).
 
+## 0.5.0 — 2026-06-04
+
+### Added
+
+- **Public/internal preview release channels** — tag-driven public releases publish stable PyPI packages and GitHub Releases; merges to `main` publish internal preview `.devN` packages after CI passes.
+- **v0.5 integration evidence** — release validation docs now cover urgent blocker closure, SkillsBench infra-fix validation, adapter evidence, trace-to-task evidence, hosted env compatibility, and diagnostic fields.
+- **Release automation guardrails** — public release tags must point at commits contained in `main`, version tags must match `pyproject.toml`, and PyPI publishing uses Trusted Publishing/OIDC instead of stored tokens.
+
+### Changed
+
+- `main` now tracks the next public version as `0.5.1.dev0`; the published public SDK is `0.5.0`, and internal previews are emitted as `0.5.1.dev<N>`.
+- Documentation now directs downstream users to depend on public PyPI releases by default and use prerelease-enabled internal previews only for validation before the next public cut.
+
+### Fixed
+
+- Closed the v0.5 release blocker set covering structured sandbox/verifier diagnostics, Daytona startup/export retries, verifier dependency classification, CTRF path consistency, and SkillsBench task compatibility evidence.
+
 ## 0.3.3 — 2026-05-15
 
 ### Added

{benchflow-0.5.1.dev869 → benchflow-0.5.2.dev875}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: benchflow
-Version: 0.5.1.dev869
+Version: 0.5.2.dev875
 Summary: Multi-turn agent benchmarking with ACP — run any agent, any model, any provider.
 Project-URL: Homepage, https://github.com/benchflow-ai/benchflow
 Project-URL: Repository, https://github.com/benchflow-ai/benchflow
@@ -70,8 +70,16 @@ BenchFlow runs AI agents against benchmark tasks in sandboxed environments. Sing
 
 ## Install
 
+BenchFlow's current public release is `0.5.1`:
+
+```bash
+pip install --upgrade benchflow
+```
+
+For a `uv`-managed CLI install of the public release:
+
 ```bash
-uv tool install benchflow
+uv tool install --prerelease allow 'benchflow==0.5.1'
 ```
 
 Requires Python 3.12+ and [uv](https://docs.astral.sh/uv/). Set `DAYTONA_API_KEY` for Daytona runs or configure Modal auth for Modal runs; export the relevant agent API key (`GEMINI_API_KEY`, `ANTHROPIC_API_KEY`, etc.) or run `claude login` / `codex --login` for subscription auth. Provider-prefixed models may use provider-specific credentials; Azure Foundry models use `AZURE_API_KEY` plus `AZURE_API_ENDPOINT`.

{benchflow-0.5.1.dev869 → benchflow-0.5.2.dev875}/README.md

@@ -20,8 +20,16 @@ BenchFlow runs AI agents against benchmark tasks in sandboxed environments. Sing
 
 ## Install
 
+BenchFlow's current public release is `0.5.1`:
+
+```bash
+pip install --upgrade benchflow
+```
+
+For a `uv`-managed CLI install of the public release:
+
 ```bash
-uv tool install benchflow
+uv tool install --prerelease allow 'benchflow==0.5.1'
 ```
 
 Requires Python 3.12+ and [uv](https://docs.astral.sh/uv/). Set `DAYTONA_API_KEY` for Daytona runs or configure Modal auth for Modal runs; export the relevant agent API key (`GEMINI_API_KEY`, `ANTHROPIC_API_KEY`, etc.) or run `claude login` / `codex --login` for subscription auth. Provider-prefixed models may use provider-specific credentials; Azure Foundry models use `AZURE_API_KEY` plus `AZURE_API_ENDPOINT`.

{benchflow-0.5.1.dev869 → benchflow-0.5.2.dev875}/pyproject.toml

@@ -1,6 +1,6 @@
 [project]
 name = "benchflow"
-version = "0.5.1.dev869"
+version = "0.5.2.dev875"
 description = "Multi-turn agent benchmarking with ACP — run any agent, any model, any provider."
 readme = "README.md"
 requires-python = ">=3.12"