agentflow-runtime 1.1.0__tar.gz → 1.2.0__tar.gz

{agentflow_runtime-1.1.0 → agentflow_runtime-1.2.0}/.gitignore

@@ -72,6 +72,7 @@ mutants/
 /rep.md
 /more_help.md
 /About_DE_project.md
+/audit_*.md
 /RELEASING.md
 sdk/agentflow/**/__pycache__/
 sdk/agentflow/**/*.py[cod]
@@ -84,5 +85,8 @@ integrations/agentflow_integrations/**/*.py[cod]
 agentflow_bench_debug*.duckdb*
 agentflow_demo_api.duckdb*
 
+# Local autopilot runtime state.
+.autopilot/
+
 # Security scan workdir (generated by .github/workflows/security.yml safety job)
 .tmp-security/

{agentflow_runtime-1.1.0 → agentflow_runtime-1.2.0}/CHANGELOG.md

@@ -4,6 +4,51 @@ All notable changes to AgentFlow are documented in this file.
 
 ## [Unreleased]
 
+## [1.2.0] - 2026-05-23
+
+### Documentation
+
+- Documented the demo-key requirement, current DuckDB/ClickHouse serving
+  story, Docker Redis dependency for the local demo, example-agent dry-run
+  flow, and local compose environment placeholders.
+- Refreshed release, SDK, and integrations docs after the live v1.1.0
+  registry publish: README status, release-readiness handoff, SDK README,
+  integrations local-install note, and the T31 task closeout now match the
+  current post-release state.
+- Prepared npm publishing for Trusted Publishing through GitHub Actions OIDC:
+  the TypeScript SDK publish workflow now requires npm CLI 11.5.1+ and no
+  longer passes `NPM_TOKEN` to the production `npm publish` step.
+- Recorded the npm Trusted Publishing handoff: the new package was first
+  published as `@yuliaedomskikh/agentflow-client@1.1.0`, Trusted Publisher
+  setup succeeded for `brownjuly2003-code/agentflow` with workflow
+  `publish-npm.yml`, CLI `npm trust list` readback is complete, and future
+  recovery-code use must keep a two-code reserve through the
+  `npm-recovery-codes` skill.
+- Documented the completed replacement npm account bootstrap for
+  `yulia.edomskikh@gmail.com`, the saved 2FA recovery-code reserve, and the
+  switch of future TypeScript SDK publishing to
+  `@yuliaedomskikh/agentflow-client`.
+- Clarified that legacy `NPM_TOKEN` revocation remains blocked until a
+  successful trusted-publish workflow run for `@yuliaedomskikh/agentflow-client`
+  and accepted external-gate intake evidence exist.
+- Added a project-local Pi skill at `.pi/skills/external-gate-evidence-intake`
+  for external release-gate evidence intake without adding runtime dependencies.
+- Added a production CDC onboarding runbook that blocks real source attachment
+  until source ownership, table scope, network path, credential ownership,
+  monitoring, and rollback decisions are recorded.
+
+### Fixed
+
+- Treated corrupt Redis cache payloads as cache misses instead of surfacing
+  JSON decode failures to API requests.
+- Fixed TypeScript SDK SSE parsing so a final frame with `id:` or `event:`
+  metadata before `data:` is still emitted.
+- Made the TypeScript SDK unit-test script include all `sdk-ts/tests` files and
+  included `CHANGELOG.md` in the npm dry-run package contents.
+- Allowed packaged SDK starter templates to include placeholder
+  `.env.example.tmpl` files while keeping the release artifact checker strict
+  for real `.env` files, API-key configs, webhook configs, and secret paths.
+
 ### Security (audit follow-up sprint 2026-04-27/28)
 
 Two external audits delivered against `4a13d36` (Claude Opus + Codex p1–p9,
@@ -78,7 +123,10 @@ off by default (enable per cluster).
 `npm ci` + `npm test` + `npm audit` before publish. New `npm-audit` job
 added to `security.yml`. `aquasecurity/trivy-action` pinned from
 `@master` to `0.28.0`. Safety scope now includes
-`integrations/pyproject.toml` resolved requirements.
+`integrations/pyproject.toml` resolved requirements. TypeScript SDK npm
+publishing now targets `@yuliaedomskikh/agentflow-client` because npm org scope
+`@agentflow` is already owned by another project and the previous user scope is
+legacy.
 
 **Vulnerable dep bumps:** `dagster>=1.13.1` (GHSA-mjw2-v2hm-wj34
 SQL injection via dynamic partition keys), `langchain-core>=1.2.22`
@@ -147,7 +195,7 @@ so the test bypass flag does not leak across `TestClient` instances
 (closes Codex review P2 on auth/middleware persistence).
 
 **Documentation hygiene (Codex p6):** TypeScript SDK examples now
-import from `"@agentflow/client"` (was `"agentflow"`); placeholder
+import from `"@yuliaedomskikh/agentflow-client"` (was `"agentflow"`); placeholder
 `https://api.agentflow.dev` examples replaced with
 `http://localhost:8000`; clone URL points at
 `brownjuly2003-code/agentflow`; `docs/quality.md` marked stale;
@@ -172,6 +220,37 @@ README that maps findings to the six closing commits.
 
 ### Added
 
+- **DV2.0 multi-branch demo** (merged via `ddfb863` from
+  `feat/dv2-multi-branch`, sessions 1-5). Live Data Vault 2.0
+  warehouse on a self-hosted kind cluster with ClickHouse 25.5,
+  Postgres 17, and MinIO. Five branches (MSK / SPB / EKB / DXB / ALA),
+  three source systems (1C + Bitrix24 + WMS Excel), three jurisdictions
+  (RU / UAE / KZ). Artifacts:
+  - `warehouse/agentflow/dv2/raw_vault/` — 8 hubs + 8 links + 39
+    satellites (generator + jinja template + spec.yaml).
+  - `warehouse/agentflow/dv2/business_vault/` — 5 per-branch MDM views
+    plus `bv_order_canonical` with `*_source` audit columns.
+  - `infrastructure/dv2/` — kind topology, ClickHouse / Postgres / MinIO
+    StatefulSets, dbt mart runner, Argo Workflows installer and
+    `dv2-refresh` WorkflowTemplate, cold-offload CronJob fanout (5).
+  - `warehouse/agentflow/dv2/postgres_oltp/` — pull-based PostgreSQL()
+    bridge + push-based MaterializedPostgreSQL CDC (single-DB pattern).
+  - `warehouse/agentflow/dv2/postgres_oltp/fanout/` — per-branch CDC
+    fan-out via per-database split (`ops_msk_db`, `ops_dxb_db` →
+    `oltp_cdc_msk`, `oltp_cdc_dxb`). Native workaround for the
+    `materialized_postgresql_publication_name` setting being unsupported
+    in ClickHouse 25.5; PeerDB OSS was the originally-planned route but
+    does not fit on the 8 GB demo iMac alongside kind + CH + PG + MinIO.
+  - `warehouse/agentflow/dv2/dbt/` — three mart models
+    (`customer_360`, `branch_pnl`, `returns_velocity`) with 12 data
+    tests and a k8s Job runner.
+  - `docs/dv2-multi-branch/` — architecture diagram, demo evidence
+    (15 sections), 2-minute pitch script, recording-day runbook,
+    asciinema cast (`demo.cast`, 42 s, 130×35) plus runner, plain-text
+    transcript, self-contained HTML player embed, and a voice-over
+    MP4 (`demo_voiced.mp4`, ~92 s) — cast slowed to match a Russian
+    TTS narration of the pitch (reproducible via
+    `docs/dv2-multi-branch/build/build_voiced_demo.sh`).
 - **Debezium/Kafka Connect CDC operationalization**: local compose now
   brings up Postgres/MySQL source databases, Kafka Connect, Debezium
   connector registration, and raw CDC topic bootstrap for the AgentFlow

agentflow_runtime-1.2.0/PKG-INFO

@@ -0,0 +1,255 @@
+Metadata-Version: 2.4
+Name: agentflow-runtime
+Version: 1.2.0
+Summary: Real-time data platform serving context to AI agents
+License: MIT
+License-File: LICENSE
+Requires-Python: >=3.11
+Requires-Dist: bcrypt<6,>=5
+Requires-Dist: confluent-kafka<3,>=2.5
+Requires-Dist: dagster<2,>=1.13.1
+Requires-Dist: duckdb<2,>=1.1
+Requires-Dist: fastapi<1,>=0.111
+Requires-Dist: httpx<1,>=0.27
+Requires-Dist: opentelemetry-exporter-otlp-proto-grpc<2,>=1.41
+Requires-Dist: opentelemetry-instrumentation-fastapi<1,>=0.62b0
+Requires-Dist: opentelemetry-instrumentation-httpx<1,>=0.62b0
+Requires-Dist: opentelemetry-sdk<2,>=1.41
+Requires-Dist: pandera<1,>=0.20
+Requires-Dist: prometheus-client<1,>=0.21
+Requires-Dist: pyarrow<19,>=17
+Requires-Dist: pydantic-settings<3,>=2.5
+Requires-Dist: pydantic<3,>=2.9
+Requires-Dist: pyyaml<7,>=6
+Requires-Dist: sqlglot<31,>=30
+Requires-Dist: structlog<26,>=24.4
+Requires-Dist: uvicorn[standard]<1,>=0.30
+Provides-Extra: cloud
+Requires-Dist: boto3<2,>=1.35; extra == 'cloud'
+Requires-Dist: pyiceberg[pyiceberg-core]<1,>=0.7; extra == 'cloud'
+Provides-Extra: contract
+Requires-Dist: schemathesis==4.10.2; extra == 'contract'
+Provides-Extra: dev
+Requires-Dist: bandit<2,>=1.9; extra == 'dev'
+Requires-Dist: build<2,>=1.2; extra == 'dev'
+Requires-Dist: hatchling<2,>=1.25; extra == 'dev'
+Requires-Dist: hypothesis<7,>=6; extra == 'dev'
+Requires-Dist: jsonschema<5,>=4; extra == 'dev'
+Requires-Dist: mypy<2,>=1.11; extra == 'dev'
+Requires-Dist: pytest-asyncio<1,>=0.24; extra == 'dev'
+Requires-Dist: pytest-cov<6,>=5; extra == 'dev'
+Requires-Dist: pytest<9,>=8.3; extra == 'dev'
+Requires-Dist: ruff<1,>=0.6; extra == 'dev'
+Requires-Dist: testcontainers[kafka]<5,>=4.9; extra == 'dev'
+Provides-Extra: flink
+Requires-Dist: apache-flink==1.19.1; extra == 'flink'
+Provides-Extra: integrations
+Requires-Dist: langchain-core<2,>=1.2.22; extra == 'integrations'
+Requires-Dist: langchain-text-splitters<2,>=1.1.2; extra == 'integrations'
+Requires-Dist: langchain<2,>=0.3.30; extra == 'integrations'
+Requires-Dist: langsmith<1,>=0.7.31; extra == 'integrations'
+Requires-Dist: llama-index-core<1,>=0.12; extra == 'integrations'
+Provides-Extra: llm
+Requires-Dist: anthropic<1,>=0.39; extra == 'llm'
+Provides-Extra: load
+Requires-Dist: locust<3,>=2.29; extra == 'load'
+Description-Content-Type: text/markdown
+
+# AgentFlow
+
+> Real-time data platform for AI agents. Live entity lookups, typed contracts, dual-language SDKs, and release-gated delivery.
+
+[![Release gate](https://img.shields.io/badge/release_gate-v1.1_published-brightgreen)](docs/release-readiness.md)
+[![codecov](https://codecov.io/gh/brownjuly2003-code/agentflow/branch/main/graph/badge.svg)](https://codecov.io/gh/brownjuly2003-code/agentflow)
+[![Python](https://img.shields.io/badge/python-3.11+-blue)](pyproject.toml)
+[![License](https://img.shields.io/badge/license-MIT-blue)](LICENSE)
+
+## Why this exists
+
+Most agent demos work until they have to answer from live business state. Support, ops, and merch workflows need current orders, metrics, and health signals while the conversation is happening, not a stale warehouse snapshot and not a pile of one-off service adapters.
+
+AgentFlow turns that problem into one serving boundary:
+
+- streaming ingestion for operational events
+- a semantic layer that exposes entities, metrics, and query endpoints
+- typed contracts so SDKs and callers know what shape to expect
+- Python and TypeScript clients that speak the same API surface
+
+## Highlights
+
+- **Release-line gate:** 752 passed, 4 skipped on 2026-05-04; GitHub environments `staging` and `production` have required reviewers. The 2026-04-27 audit closure sprint (Codex p1–p9 + Opus) shipped six commits closing all P0/P1/P2 findings — see [docs/audits/2026-04-27/README.md](docs/audits/2026-04-27/README.md) and Release Readiness for the live status
+- **Sub-second entity lookups in the checked-in baseline**: entity p50 `38-55 ms`, entity p99 `290-320 ms`, aggregate p50 `56 ms` at `50` users for `60s`
+- **Historical performance remediation is documented**: the serving path moved from an original ~`26,000 ms` baseline to the current `43-55 ms` release range
+- **Dual SDK parity** for Python and TypeScript, including retry policies, circuit breakers, batching, pagination, and contract pinning
+- **Postgres/MySQL CDC path** through Debezium and Kafka Connect, with local compose, Helm manifests, and canonical CDC normalization
+- **Security hardening in the hot path**: parameterized queries, `sqlglot` AST validation for NL-to-SQL, and a Bandit baseline gate for new findings only
+- **Release workflow coverage**: chaos smoke on PRs, performance regression gate, contract drift checks, and a Terraform apply workflow with OIDC-ready auth
+
+## Quick start
+
+> **Upgrading from v1.0.x?** See the [v1.1 migration guide](docs/migration/v1.1.md) before installing.
+
+Prerequisites:
+
+- Python `3.11+`
+- `make`
+- Docker Compose (`make demo` starts Redis)
+
+PowerShell 7+:
+
+```powershell
+git clone https://github.com/brownjuly2003-code/agentflow.git
+cd agentflow
+. .\scripts\setup.ps1
+make demo
+```
+
+macOS / Linux:
+
+```bash
+git clone https://github.com/brownjuly2003-code/agentflow.git
+cd agentflow
+source ./scripts/setup.sh
+make demo
+```
+
+`make demo` seeds local data, starts Redis, and serves the API on `http://localhost:8000`. Swagger UI is available at `http://localhost:8000/docs`.
+
+Try it:
+
+```bash
+curl http://localhost:8000/v1/entity/order/ORD-20260404-1001
+
+curl -X POST http://localhost:8000/v1/query \
+  -H "Content-Type: application/json" \
+  -d '{"question":"Show me top 3 products"}'
+```
+
+Local demo runs without API-key enforcement unless you explicitly configure `AGENTFLOW_API_KEYS_FILE`.
+
+## Architecture
+
+```text
+Event sources -> Kafka -> Flink -> Iceberg ----\
+                                                -> Semantic layer -> FastAPI -> Agent / SDK
+Local demo   -> local_pipeline -> DuckDB ------/
+```
+
+Stack:
+
+- **Ingestion**: Kafka producers, Debezium/Kafka Connect CDC, and a local synthetic pipeline
+- **Processing**: Flink plus validation and enrichment stages
+- **Storage**: Iceberg for production-shaped tables, DuckDB for the local serving path
+- **Serving**: FastAPI, contract registry, lineage, search, and operational endpoints
+- **Orchestration**: Dagster
+- **IaC**: Terraform, Helm, Docker Compose, and a Fly.io demo config
+
+See [docs/architecture.md](docs/architecture.md) for the detailed design, trade-offs, and deployment topologies.
+
+CDC source capture is standardized on Debezium/Kafka Connect; downstream consumers use the canonical AgentFlow CDC contract defined in [ADR 0005](docs/decisions/0005-cdc-ingestion-strategy.md).
+
+## What's inside
+
+| Area | Files |
+|------|-------|
+| API core | `src/serving/api/` |
+| Semantic layer | `src/serving/semantic_layer/` |
+| Python SDK | `sdk/agentflow/` |
+| TypeScript SDK | `sdk-ts/src/` |
+| Agent integrations | `integrations/agentflow_integrations/` (LangChain, LlamaIndex, CrewAI, MCP) |
+| Flink jobs | `src/processing/flink_jobs/` |
+| Test suites | `tests/` |
+| Planning trail | `docs/plans/` |
+| Public site | `site/` |
+| IaC | `infrastructure/terraform/`, `infrastructure/dv2/`, `helm/`, `k8s/` |
+| DV2.0 warehouse | `warehouse/agentflow/dv2/` (hubs / links / satellites + X5 loader) |
+
+## Documentation
+
+- [Interactive Technical Walkthrough](docs/index.md) - MkDocs Material guide with Mermaid architecture, API, SDK, deployment, observability, and troubleshooting pages
+- [Architecture](docs/architecture.md) - system context, data flow, failure modes
+- [Operational Runbook](docs/runbook.md) - local stack, CDC capture, incident response, and maintenance commands
+- [API Reference](docs/api-reference.md) - endpoint-by-endpoint examples for curl, Python, and TypeScript
+- [Security Audit](docs/security-audit.md) - threat model, controls, and evidence
+- [Competitive Analysis](docs/competitive-analysis.md) - positioning and trade-offs
+- [CDC Deployment Plan](docs/plans/2026-04-debezium-kafka-connect-deployment-plan.md) - Debezium/Kafka Connect rollout decisions and implementation trail
+- [Glossary](docs/glossary.md) - interview-ready explanations of the core technical terms
+- [Release Readiness](docs/release-readiness.md) - checked release evidence through `v1.1.0` and current external-gate handoffs
+- [Customer Discovery Tracker](docs/customer-discovery-tracker.md) - synthetic/modelled PMF planning surface and real-evidence gap
+- [Pricing Validation Plan](docs/pricing-validation-plan.md) - pricing/WTP questions, evidence gates, and current real-evidence gap
+- [AWS OIDC Setup](docs/operations/aws-oidc-setup.md) - Terraform apply readiness handoff
+- [Immutable Retention Evidence Handoff](docs/operations/immutable-retention-evidence-handoff.md) - external audit-retention evidence checklist
+- [Production CDC Source Onboarding](docs/operations/cdc-production-onboarding.md) - production CDC decision record and no-go gates
+- [External Gate Evidence Intake Checklist](docs/operations/external-gate-evidence-intake.md) - required owner evidence before blocked external gates can close
+- [Public Production-Hardware Benchmark Plan](docs/perf/public-production-hardware-benchmark-plan.md) - benchmark evidence plan for `c8g.4xlarge+`
+- [External Pen-Test Attestation Handoff](docs/operations/external-pen-test-attestation-handoff.md) - third-party pen-test evidence checklist
+- [Audit History](docs/audit-history.md) - baseline-to-release remediation trail
+- [Publication Checklist](docs/publication-checklist.md) - final GitHub publishing checklist
+- [Fly.io Demo Deploy](deploy/fly/README.md) - minimal hosted demo instructions
+- [DV2.0 Multi-Branch Extension](docs/dv2-multi-branch/SESSION_HANDOFF.md) - Data Vault 2.0 model for mid-market e-com with 5 locations / 3 jurisdictions; [schema](docs/dv2-multi-branch/schema_dv2.md), [end-to-end flow](docs/dv2-multi-branch/architecture.md), [live demo evidence](docs/dv2-multi-branch/demo_evidence.md), [k8s manifests](infrastructure/dv2/README.md)
+- [Contributing](CONTRIBUTING.md) - development and PR expectations
+- [Changelog](CHANGELOG.md) - project release notes
+
+## Development
+
+```bash
+# verified release slice
+python -m pytest tests/unit tests/integration tests/sdk -q
+
+# benchmark and regression gate
+python scripts/run_benchmark.py
+python scripts/check_performance.py --baseline docs/benchmark-baseline.json --current .artifacts/load/results.json --max-regress 20
+
+# benchmark trend: [.github/perf-history.json](.github/perf-history.json) is appended on every main push;
+# render the history locally with `make perf-plot` (writes docs/perf/history.html).
+
+# contracts and security
+python scripts/generate_contracts.py --check
+bandit -r src sdk --ini .bandit --severity-level medium -f json -o .tmp/bandit-current.json
+python scripts/bandit_diff.py .bandit-baseline.json .tmp/bandit-current.json
+```
+
+## Status
+
+**v1.1.0** is published to PyPI, npm, and GitHub.
+The 2026-04-27 audit closure sprint landed six commits on `main`
+that close all P0/P1/P2 findings from the Claude
+Opus + Codex p1–p9 audits: tenant isolation across the control plane,
+SQL guard centralization, entity allowlist enforcement on every read
+surface, secrets scrubbed and rotated, helm `runAsNonRoot` /
+NetworkPolicy / PodDisruptionBudget, npm lockfile + `npm audit` clean,
+vulnerable dep bumps (`dagster>=1.13.1`, `langchain-core>=1.2.22`),
+trivy pinned, OpenAPI drift gate, branch protection with 12 required
+status checks, GitHub Actions environment reviewers, and Python SDK
+alignment with the server v1 contract (F1–F10). Recent local full-suite
+verification: `752 passed, 4 skipped` on 2026-05-04 after clarifying the
+external-gate handoff. The post-v1.1 CDC operationalization
+for Debezium / Kafka Connect is checked in, while production source
+onboarding remains pending; see [docs/release-readiness.md](docs/release-readiness.md).
+Remaining external gates are AWS OIDC role setup for real Terraform apply,
+external immutable audit retention if claimed beyond local hash-chain evidence,
+production CDC source onboarding, real PMF/pricing evidence, public benchmark
+publication on production hardware, external pen-test attestation, and legacy
+npm `NPM_TOKEN` revocation after a successful new-package trusted-publish run.
+npm Trusted Publishing readback for the new package is complete. A project-local
+Pi skill for evidence intake lives at `.pi/skills/external-gate-evidence-intake`.
+
+## Screenshots
+
+| Admin UI | API docs |
+|----------|----------|
+| <img src="docs/screenshots/admin-ui.png" alt="AgentFlow admin UI" width="420"> | <img src="docs/screenshots/swagger-docs.png" alt="AgentFlow API docs" width="420"> |
+
+| Landing page | Benchmark run |
+|--------------|---------------|
+| <img src="docs/screenshots/landing-page.png" alt="AgentFlow landing page" width="420"> | <img src="docs/screenshots/benchmark-terminal.png" alt="AgentFlow benchmark terminal" width="420"> |
+
+Capture notes and publish-time checks are listed in [docs/publication-checklist.md](docs/publication-checklist.md).
+
+## License
+
+MIT. See [LICENSE](LICENSE).
+
+## Credits
+
+Built as a data-engineering reference project during the `2026-04-10` -> `2026-04-20` release cycle, with the full implementation trail preserved in `docs/plans/`.

{agentflow_runtime-1.1.0 → agentflow_runtime-1.2.0}/README.md

@@ -2,7 +2,7 @@
 
 > Real-time data platform for AI agents. Live entity lookups, typed contracts, dual-language SDKs, and release-gated delivery.
 
-[![Release gate](https://img.shields.io/badge/release_gate-audit_closed_ready_to_push-brightgreen)](docs/release-readiness.md)
+[![Release gate](https://img.shields.io/badge/release_gate-v1.1_published-brightgreen)](docs/release-readiness.md)
 [![codecov](https://codecov.io/gh/brownjuly2003-code/agentflow/branch/main/graph/badge.svg)](https://codecov.io/gh/brownjuly2003-code/agentflow)
 [![Python](https://img.shields.io/badge/python-3.11+-blue)](pyproject.toml)
 [![License](https://img.shields.io/badge/license-MIT-blue)](LICENSE)
@@ -20,7 +20,7 @@ AgentFlow turns that problem into one serving boundary:
 
 ## Highlights
 
-- **Last completed local gate:** 724 passed, 4 skipped on 2026-04-28 at auth-cache commit `97e5d86`. The 2026-04-27 audit closure sprint (Codex p1–p9 + Opus) shipped six commits closing all P0/P1/P2 findings — see [docs/audits/2026-04-27/README.md](docs/audits/2026-04-27/README.md) and Release Readiness for the live status
+- **Release-line gate:** 752 passed, 4 skipped on 2026-05-04; GitHub environments `staging` and `production` have required reviewers. The 2026-04-27 audit closure sprint (Codex p1–p9 + Opus) shipped six commits closing all P0/P1/P2 findings — see [docs/audits/2026-04-27/README.md](docs/audits/2026-04-27/README.md) and Release Readiness for the live status
 - **Sub-second entity lookups in the checked-in baseline**: entity p50 `38-55 ms`, entity p99 `290-320 ms`, aggregate p50 `56 ms` at `50` users for `60s`
 - **Historical performance remediation is documented**: the serving path moved from an original ~`26,000 ms` baseline to the current `43-55 ms` release range
 - **Dual SDK parity** for Python and TypeScript, including retry policies, circuit breakers, batching, pagination, and contract pinning
@@ -104,10 +104,12 @@ CDC source capture is standardized on Debezium/Kafka Connect; downstream consume
 | Test suites | `tests/` |
 | Planning trail | `docs/plans/` |
 | Public site | `site/` |
-| IaC | `infrastructure/terraform/`, `helm/`, `k8s/` |
+| IaC | `infrastructure/terraform/`, `infrastructure/dv2/`, `helm/`, `k8s/` |
+| DV2.0 warehouse | `warehouse/agentflow/dv2/` (hubs / links / satellites + X5 loader) |
 
 ## Documentation
 
+- [Interactive Technical Walkthrough](docs/index.md) - MkDocs Material guide with Mermaid architecture, API, SDK, deployment, observability, and troubleshooting pages
 - [Architecture](docs/architecture.md) - system context, data flow, failure modes
 - [Operational Runbook](docs/runbook.md) - local stack, CDC capture, incident response, and maintenance commands
 - [API Reference](docs/api-reference.md) - endpoint-by-endpoint examples for curl, Python, and TypeScript
@@ -115,10 +117,19 @@ CDC source capture is standardized on Debezium/Kafka Connect; downstream consume
 - [Competitive Analysis](docs/competitive-analysis.md) - positioning and trade-offs
 - [CDC Deployment Plan](docs/plans/2026-04-debezium-kafka-connect-deployment-plan.md) - Debezium/Kafka Connect rollout decisions and implementation trail
 - [Glossary](docs/glossary.md) - interview-ready explanations of the core technical terms
-- [Release Readiness](docs/release-readiness.md) - checked release evidence through `v1.1.0` and current CDC follow-up work
+- [Release Readiness](docs/release-readiness.md) - checked release evidence through `v1.1.0` and current external-gate handoffs
+- [Customer Discovery Tracker](docs/customer-discovery-tracker.md) - synthetic/modelled PMF planning surface and real-evidence gap
+- [Pricing Validation Plan](docs/pricing-validation-plan.md) - pricing/WTP questions, evidence gates, and current real-evidence gap
+- [AWS OIDC Setup](docs/operations/aws-oidc-setup.md) - Terraform apply readiness handoff
+- [Immutable Retention Evidence Handoff](docs/operations/immutable-retention-evidence-handoff.md) - external audit-retention evidence checklist
+- [Production CDC Source Onboarding](docs/operations/cdc-production-onboarding.md) - production CDC decision record and no-go gates
+- [External Gate Evidence Intake Checklist](docs/operations/external-gate-evidence-intake.md) - required owner evidence before blocked external gates can close
+- [Public Production-Hardware Benchmark Plan](docs/perf/public-production-hardware-benchmark-plan.md) - benchmark evidence plan for `c8g.4xlarge+`
+- [External Pen-Test Attestation Handoff](docs/operations/external-pen-test-attestation-handoff.md) - third-party pen-test evidence checklist
 - [Audit History](docs/audit-history.md) - baseline-to-release remediation trail
 - [Publication Checklist](docs/publication-checklist.md) - final GitHub publishing checklist
 - [Fly.io Demo Deploy](deploy/fly/README.md) - minimal hosted demo instructions
+- [DV2.0 Multi-Branch Extension](docs/dv2-multi-branch/SESSION_HANDOFF.md) - Data Vault 2.0 model for mid-market e-com with 5 locations / 3 jurisdictions; [schema](docs/dv2-multi-branch/schema_dv2.md), [end-to-end flow](docs/dv2-multi-branch/architecture.md), [live demo evidence](docs/dv2-multi-branch/demo_evidence.md), [k8s manifests](infrastructure/dv2/README.md)
 - [Contributing](CONTRIBUTING.md) - development and PR expectations
 - [Changelog](CHANGELOG.md) - project release notes
 
@@ -143,33 +154,38 @@ python scripts/bandit_diff.py .bandit-baseline.json .tmp/bandit-current.json
 
 ## Status
 
-**v1.1.0** is prepared in the checked-in repository and ready to publish.
-The 2026-04-27 audit closure sprint landed six commits on local `main`
-(ahead of `origin`) that close all P0/P1/P2 findings from the Claude
+**v1.1.0** is published to PyPI, npm, and GitHub.
+The 2026-04-27 audit closure sprint landed six commits on `main`
+that close all P0/P1/P2 findings from the Claude
 Opus + Codex p1–p9 audits: tenant isolation across the control plane,
 SQL guard centralization, entity allowlist enforcement on every read
 surface, secrets scrubbed and rotated, helm `runAsNonRoot` /
 NetworkPolicy / PodDisruptionBudget, npm lockfile + `npm audit` clean,
 vulnerable dep bumps (`dagster>=1.13.1`, `langchain-core>=1.2.22`),
 trivy pinned, OpenAPI drift gate, branch protection with 12 required
-status checks, and Python SDK alignment with the server v1 contract
-(F1–F10). Latest local release-line smoke: `724 passed, 4 skipped`
-at auth-cache commit `97e5d86`. The post-v1.1 CDC
-operationalization for Debezium / Kafka Connect remains in. Live
-release just needs `git push` + `v1.1.0` retag — see
-[docs/release-readiness.md](docs/release-readiness.md). Remaining open
-items are manual environment setup (`staging`/`prod` reviewers, AWS
-OIDC role), public benchmark publication on production hardware, and
-post-release PMF work.
+status checks, GitHub Actions environment reviewers, and Python SDK
+alignment with the server v1 contract (F1–F10). Recent local full-suite
+verification: `752 passed, 4 skipped` on 2026-05-04 after clarifying the
+external-gate handoff. The post-v1.1 CDC operationalization
+for Debezium / Kafka Connect is checked in, while production source
+onboarding remains pending; see [docs/release-readiness.md](docs/release-readiness.md).
+Remaining external gates are AWS OIDC role setup for real Terraform apply,
+external immutable audit retention if claimed beyond local hash-chain evidence,
+production CDC source onboarding, real PMF/pricing evidence, public benchmark
+publication on production hardware, external pen-test attestation, and legacy
+npm `NPM_TOKEN` revocation after a successful new-package trusted-publish run.
+npm Trusted Publishing readback for the new package is complete. A project-local
+Pi skill for evidence intake lives at `.pi/skills/external-gate-evidence-intake`.
 
 ## Screenshots
 
-The repository is prepared for optional README screenshots under `docs/screenshots/`:
+| Admin UI | API docs |
+|----------|----------|
+| <img src="docs/screenshots/admin-ui.png" alt="AgentFlow admin UI" width="420"> | <img src="docs/screenshots/swagger-docs.png" alt="AgentFlow API docs" width="420"> |
 
-- `admin-ui.png`
-- `swagger-docs.png`
-- `landing-page.png`
-- `benchmark-terminal.png`
+| Landing page | Benchmark run |
+|--------------|---------------|
+| <img src="docs/screenshots/landing-page.png" alt="AgentFlow landing page" width="420"> | <img src="docs/screenshots/benchmark-terminal.png" alt="AgentFlow benchmark terminal" width="420"> |
 
 Capture notes and publish-time checks are listed in [docs/publication-checklist.md](docs/publication-checklist.md).
 

{agentflow_runtime-1.1.0 → agentflow_runtime-1.2.0}/pyproject.toml

@@ -1,7 +1,8 @@
 [project]
 name = "agentflow-runtime"
-version = "1.1.0"
+version = "1.2.0"
 description = "Real-time data platform serving context to AI agents"
+readme = "README.md"
 requires-python = ">=3.11"
 license = { text = "MIT" }
 
@@ -115,12 +116,13 @@ line-length = 100
 
 [tool.ruff.lint]
 select = ["E", "F", "W", "I", "N", "UP", "S", "B", "A", "C4", "PT"]
-ignore = ["S101", "S311", "S608"]
+ignore = ["S101", "S311"]
 
 [tool.ruff.lint.per-file-ignores]
 "tests/**/*.py" = [
     "S603",
     "S607",
+    "S608",
     "S310",
     "S104",
     "S106",
@@ -132,16 +134,44 @@ ignore = ["S101", "S311", "S608"]
     "A002",
     "E501",
 ]
+"src/orchestration/dags/daily_batch.py" = [
+    "S608",
+]
+"src/serving/api/routers/lineage.py" = [
+    "S608",
+]
+"src/serving/api/routers/slo.py" = [
+    "S608",
+]
+"src/serving/api/routers/stream.py" = [
+    "S608",
+]
 "src/serving/backends/clickhouse_backend.py" = [
     "S310",
+    "S608",
     "E501",
 ]
 "src/serving/backends/duckdb_backend.py" = [
+    "S608",
     "E501",
 ]
+"src/serving/semantic_layer/nl_engine.py" = [
+    "S608",
+]
+"src/serving/semantic_layer/query/entity_queries.py" = [
+    "S608",
+]
+"src/serving/semantic_layer/query/nl_queries.py" = [
+    "S608",
+]
+"src/serving/semantic_layer/search_index.py" = [
+    "S608",
+]
 
 [tool.pytest.ini_options]
 testpaths = ["tests"]
+addopts = ["-p", "no:schemathesis", "--basetemp=.tmp/pytest-basetemp"]
+cache_dir = ".tmp/pytest-cache"
 markers = [
     "integration: marks tests requiring Docker services",
     "requires_docker: marks tests that require local Docker",
@@ -180,6 +210,10 @@ ignore_missing_imports = true
 module = "src.processing.flink_jobs.*"
 ignore_errors = true
 
+[[tool.mypy.overrides]]
+module = "src.quality.validators.*"
+disallow_untyped_defs = true
+
 [tool.agentflow.dependency-profiles.profiles.runtime]
 editable-installs = ["."]
 
@@ -299,17 +333,17 @@ job = "mutation"
 profile = "test"
 
 [[tool.agentflow.dependency-profiles.targets]]
-name = "performance.performance-regression"
+name = "performance.perf-baseline"
 kind = "workflow"
 path = ".github/workflows/performance.yml"
-job = "performance-regression"
+job = "perf-baseline"
 profile = "perf"
 
 [[tool.agentflow.dependency-profiles.targets]]
-name = "perf-regression.perf-regression"
+name = "perf-regression.perf-smoke"
 kind = "workflow"
 path = ".github/workflows/perf-regression.yml"
-job = "perf-regression"
+job = "perf-smoke"
 profile = "perf"
 
 [[tool.agentflow.dependency-profiles.targets]]

{agentflow_runtime-1.1.0 → agentflow_runtime-1.2.0}/src/processing/outbox.py

@@ -13,6 +13,7 @@ from confluent_kafka import KafkaException
 from opentelemetry import trace
 
 from src.processing.tracing import inject_trace_to_kafka_headers, telemetry_disabled
+from src.serving.duckdb_connection import connect_duckdb
 
 logger = structlog.get_logger()
 tracer = trace.get_tracer("agentflow.outbox")
@@ -51,7 +52,7 @@ class OutboxProcessor:
         if conn is None and duckdb_path is None:
             raise ValueError("duckdb_path or conn is required")
         self._owns_conn = conn is None
-        self._conn = conn if conn is not None else duckdb.connect(str(duckdb_path))
+        self._conn = conn if conn is not None else connect_duckdb(str(duckdb_path))
         self._producer = producer or self._produce_to_kafka
         self._bootstrap_servers = bootstrap_servers or DEFAULT_KAFKA_BOOTSTRAP
         self._max_retries = max_retries

{agentflow_runtime-1.1.0 → agentflow_runtime-1.2.0}/src/quality/monitors/freshness_monitor.py

@@ -158,7 +158,7 @@ class FreshnessMonitor:
             )
 
 
-if __name__ == "__main__":
+if __name__ == "__main__":  # pragma: no cover
     monitor = FreshnessMonitor(
         bootstrap_servers=os.getenv("KAFKA_BOOTSTRAP_SERVERS", "localhost:9092"),
         topics=["events.validated", "sessions.aggregated"],

{agentflow_runtime-1.1.0 → agentflow_runtime-1.2.0}/src/quality/validators/schema_validator.py

@@ -7,7 +7,7 @@ Returns structured validation results with error details for observability.
 from dataclasses import dataclass, field
 from datetime import UTC, datetime
 
-from pydantic import ValidationError
+from pydantic import BaseModel, ValidationError
 
 from src.ingestion.schemas.events import (
     CdcEvent,
@@ -37,7 +37,7 @@ class ValidationResult:
 
 
 # Map event type prefixes to their Pydantic models
-_SCHEMA_MAP: dict = {
+_SCHEMA_MAP: dict[str, type[BaseModel]] = {
     "order.": OrderEvent,
     "payment.": PaymentEvent,
     "click": ClickstreamEvent,
@@ -49,7 +49,7 @@ _SCHEMA_MAP: dict = {
 _CDC_SOURCES = {"postgres_cdc", "mysql_cdc"}
 
 
-def _get_model_for_event(event_type: str):  # -> BaseModel subclass | None
+def _get_model_for_event(event_type: str) -> type[BaseModel] | None:
     for prefix, model in _SCHEMA_MAP.items():
         if event_type.startswith(prefix) or event_type == prefix:
             return model