agentops-cockpit 0.2.2__tar.gz

agentops_cockpit-0.2.2/.gitignore

@@ -0,0 +1,46 @@
+# Dependencies
+node_modules/
+.npm/
+
+# Build outputs
+dist/
+build/
+
+# IDE files
+.vscode/
+.idea/
+*.swp
+*.swo
+
+# OS files
+.DS_Store
+Thumbs.db
+
+# Environment variables
+.env
+.env.local
+.env.development.local
+.env.test.local
+.env.production.local
+
+# Logs
+npm-debug.log*
+yarn-debug.log*
+yarn-error.log*
+*.log
+
+# Misc
+.cache/
+.adk/
+staging/
+deploy_stage/
+.firebase/
+
+# Python
+__pycache__/
+*.pyc
+*.pyo
+*.pyd
+.pytest_cache/
+.venv/
+.python-version

agentops_cockpit-0.2.2/A2A_GUIDE.md

@@ -0,0 +1,39 @@
+# 📡 A2A (Agent-to-Agent) & The Cockpit
+
+The **Agent-to-Agent (A2A) Protocol** enables distributed agent architectures. In the **AgentOps Cockpit**, A2A is managed as a first-class orchestration pattern.
+
+## 🌉 The Cockpit's Role in A2A
+While A2A handles the communication, the Cockpit handles the **Intelligence of the Connection**:
+1. **Auditing**: The `make audit` command detects "Chatty A2A" patterns where too many turns occur between agents, suggesting tool-offloading or prompt-collapsing.
+2. **Security**: `make red-team` tests the trust boundaries between agents to prevent "Side-Channel Injections" (where a compromised agent hacks another agent).
+3. **Caching**: The **Hive Mind Cache** can cache results of expensive A2A sub-tasks across your entire agent mesh.
+
+## 🛠️ Implementation
+
+### 1. Exposing an Agent Service
+Wrap your agent as an A2A service for other agents in the Cockpit to consume:
+```python
+from google.adk.a2a.utils.agent_to_a2a import to_a2a
+from src.backend.agent import my_agent
+
+# Standardizing the A2A port to 8001 (Engine is 8000)
+a2a_app = to_a2a(my_agent, port=8001)
+```
+
+### 2. Orchestration via MCP
+The Cockpit uses the **Model Context Protocol (MCP)** to manage A2A connections:
+- **Unified Tooling**: Remote agents appear as standard tools in `src/backend/ops/mcp_hub.py`.
+- **Latency Tracking**: The Cockpit monitors the round-trip time between agent calls to ensure sub-second UI responsiveness.
+
+## 🔄 A2UI + A2A Flow
+When Agent A calls Agent B, the A2UI content from Agent B is automatically passed through to the final surface if the **Cockpit Middleware** is enabled:
+```python
+# In agent.py
+shadow_router = ShadowRouter(v1_func=agent_v1, v2_func=agent_v2)
+# Handles A2UI + A2A metadata automatically
+```
+
+## 🏗️ Enterprise Mesh
+In large-scale deployments, the Cockpit allows you to:
+- **A/B Test Agents**: Split traffic between different expert agents using the Shadow Router.
+- **Cost Guarding**: Set per-agent budgets to prevent one agent in the mesh from exhausting your quota.

agentops_cockpit-0.2.2/BE_INTEGRATION_GUIDE.md

@@ -0,0 +1,35 @@
+# ⚙️ Engine Integration: The Day 0 Brain
+
+The **Engine** is the reasoning core of your Agentic Stack. We use **FastAPI** and Google’s **Agent Development Kit (ADK)** to build agents that are fast, tool-capable, and "Well-Architected."
+
+## 🧩 Middleware Components
+The Engine comes pre-installed with the **Cockpit Middleware Stack**:
+
+1. **`CostOptimizer`**: Real-time token tracking and savings recommendations.
+2. **`PIIScrubber`**: Automatic masking of sensitive user data.
+3. **`SemanticCache`**: Integrated with the "Hive Mind" for 40%+ cost reduction.
+4. **`MemoryOptimizer`**: Automates context truncation and summarization.
+
+## 🛠️ Tool Orchestration (ADK)
+We recommend building your tools as **MCP (Model Context Protocol)** or **ADK Extensions**. This ensures that the agent can discover and invoke them with high reliability.
+
+```python
+# Example Tool in src/backend/tools/search.py
+from adk import Tool
+
+@Tool
+def search_docs(query: str):
+    """Searches the knowledge base for agent-ops documentation."""
+    return get_search_results(query)
+```
+
+## 🏗️ The Agentic Flow
+A "Well-Architected" flow always follows this sequence:
+1. **Sanitize**: Input passes through the `PIIScrubber`.
+2. **Cache Check**: `Hive Mind` checks for a semantic hit.
+3. **Reason**: Gemini 2.0 reasoning loop via Vertex AI.
+4. **Action**: Tool execution via ADK.
+5. **Pack**: Final output is wrapped in an `EvidencePacket` for transparency.
+
+## 🏛️ Grounding
+To prevent hallucinations, ensure all tool outputs are grounded in your data sources. Use the `EvidenceNode` class to report the sources used in your final response.

agentops_cockpit-0.2.2/DEPLOYMENT.md

@@ -0,0 +1,84 @@
+# 🚀 Production Deployment
+
+Deploying a "Well-Architected" agent requires orchestration across two primary Google Cloud environments.
+
+## ⚙️ The Engine (Cloud Run)
+The Python backend (FastAPI) is deployed as a serverless service.
+- **Scaling**: We default to scale-to-zero to minimize costs during idle time.
+- **Regions**: Always deploy to `us-central1` or your local equivalent for lowest latency to Vertex AI endpoints.
+- **Best Practice**: Enable **Startup CPU Boost** to reduce cold-start latency by up to 50%.
+
+## 🧠 Agent Engine (Vertex AI Reasoning Engine)
+Recommended for agents that require deep integration with the Google Cloud agentic ecosystem.
+- **Why**: Provides a managed runtime that handles serialization, versioning, and built-in tracing.
+- **Best Practice**: Use **Context Caching** for agents with extremely long system instructions (>32k tokens).
+
+## ☸️ Enterprise Engine (GKE)
+Recommended for agents with specialized isolation needs or high-intensity workloads.
+- **Why**: Provides the highest level of control over networking (Service Mesh) and compute resources (GPUs).
+- **Best Practice**: Use **Workload Identity** to assign fine-grained IAM roles to your K8s service accounts.
+
+---
+
+## 📊 Infrastructure Decision Matrix
+
+| Feature | Agent Engine | Cloud Run | GKE |
+| :--- | :--- | :--- | :--- |
+| **Orchestration** | Managed (ADK) | Custom (FastAPI) | Custom (K8s) |
+| **Scaling** | Automatic | Scale-to-Zero | Dynamic / GPU |
+| **Observability** | Vertex AI Traces | Cloud Logging/Trace | Prometheus / Istio |
+| **Best Case** | Fast ADK Prototyping | Standard Web Agents | High-Perf Enterprise |
+
+---
+
+## 🎭 The Face (Firebase Hosting)
+The React/Vite frontend is deployed to Firebase for globally distributed edge performance.
+- **Protocol**: Ensure all components use the **A2UI Protocol** for consistent engine-driven rendering.
+- **Responsiveness**: Use mobile-first breakpoints to support iOS and Android high-density displays.
+- **Accessibility**: All interactive elements must have `aria-labels` to support automated testing in the Cockpit.
+- **Performance**: Split large components (>300 lines) to optimize React's virtual DOM reconciliation.
+
+---
+
+## 🏗️ Deployment Workflow
+
+We use a **1-click deployment** strategy that builds safety into the process:
+
+```bash
+make deploy-prod
+```
+
+### The "Safe-Build" Sequence:
+1. **Audit Phase**: The Cockpit runs `arch-review` (design) and `audit` (cost). 
+2. **Security Phase**: Executes `red-team` to ensure no public breaches exist in the latest code.
+3. **Build Phase**: Compiles the React application and optimizes static assets.
+4. **Push Phase**: 
+    - Containerizes the Engine and pushes to **Artifact Registry**.
+    - Deploys the container to **Cloud Run**.
+    - Deploys static assets to **Firebase Hosting**.
+
+## 🛡️ Staging & Traffic Splitting
+We recommend using Cloud Run **Revisions** for canary deployments:
+- Deploy 5% of traffic to your new Revision.
+- Monitor the **Cockpit Dashboard** for error rate anomalies.
+- Promote to 100% when satisfied.
+
+## 🤖 Automated CI/CD (GitHub Actions)
+
+The AgentOps Cockpit is designed for "Policy-as-Code." Every commit to `main` triggers an automated governance pipeline that ensures your agent never regresses in quality or security.
+
+![CI/CD Workflow](/public/cicd-workflow.png)
+
+### The Automated Pipeline:
+1.  **Architecture Audit**: Scans for design alignment with the detected framework (LangGraph, ADK, etc.).
+2.  **Red Team Evaluation**: Automatically tests for prompt injection and instruction overrides on every PR.
+3.  **Token Optimization**: Identifies non-cached prompts and expensive model routing before deployment.
+4.  **Reliability Suite**: Runs all unit tests and regression checks against the core engine.
+
+Refer to `.github/workflows/agent-ops-audit.yml` for the full pipeline definition.
+
+
+## 🔑 Secret Management
+Never commit `.env` files. Use **Google Cloud Secret Manager**:
+- Store your `GOOGLE_API_KEY` and third-party tool tokens.
+- Map them as environment variables in your Cloud Run configuration.

agentops_cockpit-0.2.2/Dockerfile

@@ -0,0 +1,14 @@
+FROM python:3.11-slim
+
+WORKDIR /app
+
+COPY pyproject.toml .
+COPY requirements.txt .
+RUN pip install -r requirements.txt
+
+COPY src/ ./src/
+
+# Set PYTHONPATH so it can find the modules
+ENV PYTHONPATH=/app/src
+
+CMD ["python", "src/backend/agent.py"]

agentops_cockpit-0.2.2/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Enrique Kalven
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

agentops_cockpit-0.2.2/Makefile

@@ -0,0 +1,100 @@
+# --- A2UI Starter Makefile ---
+
+# Project Variables
+PROJECT_ID ?= $(shell gcloud config get-value project)
+REGION ?= us-central1
+SERVICE_NAME = agent-ops-backend
+IMAGE_TAG = us-central1-docker.pkg.dev/$(PROJECT_ID)/agent-repo/$(SERVICE_NAME):latest
+
+.PHONY: help dev build deploy-cloud-run deploy-firebase deploy-gke audit deploy-prod scan-secrets ui-audit audit-all
+
+help:
+	@echo "Available commands:"
+	@echo "  make dev               - Start local development server"
+	@echo "  make build             - Build production assets"
+	@echo "  make audit-all         - Run ALL audits and generate Final Report"
+	@echo "  make reliability       - Run unit tests and regression suite"
+	@echo "  make scan-secrets      - Scan for hardcoded API keys & credentials"
+	@echo "  make ui-audit          - Run Face Auditor (UI/UX best practices)"
+	@echo "  make audit             - Run Agent Optimizer audit"
+	@echo "  make arch-review       - Run Google Well-Architected design review"
+	@echo "  make quality-baseline  - Start iterative Quality Hill Climbing"
+	@echo "  make red-team          - Run adversarial security audit"
+	@echo "  make load-test         - Run base load test"
+	@echo "  make deploy-prod       - Deploy to production (All Audits -> Cloud Run + Firebase)"
+	@echo "  make deploy-cloud-run  - Deploy to Google Cloud Run"
+	@echo "  make deploy-firebase   - Deploy to Firebase Hosting"
+
+
+
+dev:
+	npm run dev
+
+build:
+	npm run build
+
+# 🏁 Master Audit: Run all modules and generate report
+audit-all:
+	@python3 src/backend/ops/orchestrator.py
+
+# 🛡️ Reliability: Unit tests and regression suite
+reliability:
+	@python3 src/backend/ops/reliability.py
+
+# 🔍 The Optimizer: Audit your agent for waste
+audit:
+	@python3 src/backend/optimizer.py src/backend/agent.py
+
+# 🏛️ Architecture: Design review against Google Well-Architected Framework
+arch-review:
+	@python3 src/backend/ops/arch_review.py
+
+# 🧗 Quality: Iterative Hill Climbing optimization
+quality-baseline:
+	@python3 src/backend/eval/quality_climber.py climb
+
+# 🧪 Secrets: Scan for hardcoded credentials
+scan-secrets:
+	@python3 src/backend/ops/secret_scanner.py .
+
+# 🎨 UI/UX: Face Auditor for frontend quality
+ui-audit:
+	@python3 src/backend/ops/ui_auditor.py src
+
+# 🔥 Red Team: Unleash self-hacking security audit
+
+red-team:
+	@python3 src/backend/eval/red_team.py src/backend/agent.py
+
+# ⚡ Load Test: Stress test your agent endpoint (Usage: make load_test REQUESTS=100 CONCURRENCY=10)
+REQUESTS ?= 50
+
+CONCURRENCY ?= 5
+URL ?= http://localhost:8000/agent/query?q=healthcheck
+
+load_test:
+	@python3 src/backend/eval/load_test.py run --url $(URL) --requests $(REQUESTS) --concurrency $(CONCURRENCY)
+
+# 🚀 Production: The Vercel-style 1-click deploy
+deploy-prod: audit-all build
+
+	@echo "📦 Containerizing and deploying to Cloud Run..."
+	gcloud run deploy $(SERVICE_NAME) --source . --region $(REGION) --allow-unauthenticated --port 80
+	@echo "🔥 Deploying frontend to Firebase..."
+	firebase deploy --only hosting
+
+# 🚀 Cloud Run: The fastest way to production
+deploy-cloud-run:
+	gcloud run deploy $(SERVICE_NAME) --source . --region $(REGION) --allow-unauthenticated --port 80
+
+# 🔥 Firebase: Optimized for frontend hosting
+deploy-firebase: build
+	firebase deploy --only hosting
+
+# ☸️ GKE: Enterprise container orchestration
+deploy-gke:
+	docker build -t $(IMAGE_TAG) .
+	docker push $(IMAGE_TAG)
+	@echo "Updating deployment.yaml..."
+	sed -i '' 's|image: .*|image: $(IMAGE_TAG)|' deployment.yaml || true
+	kubectl apply -f deployment.yaml || echo "No deployment.yaml found. Please create one based on DEPLOYMENT.md"

agentops_cockpit-0.2.2/PKG-INFO

@@ -0,0 +1,142 @@
+Metadata-Version: 2.4
+Name: agentops-cockpit
+Version: 0.2.2
+Summary: Production-grade Agent Operations (AgentOps) Platform
+Project-URL: Homepage, https://github.com/enriquekalven/agent-ops-cockpit
+Project-URL: Bug Tracker, https://github.com/enriquekalven/agent-ops-cockpit/issues
+Author-email: Enrique <enrique@example.com>
+License-File: LICENSE
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3
+Requires-Python: >=3.10
+Requires-Dist: gitpython>=3.1.0
+Requires-Dist: rich>=13.0.0
+Requires-Dist: typer>=0.9.0
+Description-Content-Type: text/markdown
+
+# 🕹️ AgentOps Cockpit
+
+<div align="center">
+  <img src="https://img.shields.io/github/stars/enriquekalven/agent-cockpit?style=for-the-badge&color=ffd700" alt="GitHub Stars" />
+  <img src="https://img.shields.io/github/license/enriquekalven/agent-cockpit?style=for-the-badge&color=007bff" alt="License" />
+  <img src="https://img.shields.io/badge/Google-Well--Architected-4285F4?style=for-the-badge&logo=google-cloud" alt="Google Well-Architected" />
+  <img src="https://img.shields.io/badge/Status-Day%202%20Operations-10b981?style=for-the-badge" alt="Status" />
+</div>
+
+<br />
+
+<div align="center">
+  <h3>"Infrastructure gives you the pipes. We give you the Intelligence."</h3>
+  <p>The developer distribution for building, optimizing, and securing AI agents on Google Cloud.</p>
+</div>
+
+---
+
+## 📽️ The Mission
+Most AI agent templates stop at a single Python file and an API key. **The AgentOps Cockpit** is for developers moving into production. While optimized for **ADK**, it provides framework-agnostic governance, safety, and cost guardrails for the entire agentic ecosystem—from CrewAI to LangGraph. Based on the **[Google Well-Architected Framework for Agents](/docs/google-architecture)**.
+
+---
+
+## 🏗️ The Agentic Trinity
+We divide the complexity of production agents into three focused pillars:
+
+- **⚙️ The Engine**: The reasoning core. Built with **ADK**, FastAPI, and Vertex AI.
+- **🎭 The Face**: The user experience. Adaptive UI surfaces and **GenUI** standards via the A2UI spec.
+- **🕹️ The Cockpit**: The operational brain. Cost control, semantic caching, shadow routing, and adversarial audits.
+
+---
+
+## 🌐 Framework Agnostic Governance
+The Cockpit isn't just for ADK. It provides **Best Practices as Code** across all major agentic frameworks:
+
+<div align="center">
+  <img src="https://img.shields.io/badge/OpenAI_Agentkit-412991?style=for-the-badge&logo=openai" alt="OpenAI Agentkit" />
+  <img src="https://img.shields.io/badge/Anthropic_Claude-D97757?style=for-the-badge&logo=anthropic" alt="Anthropic" />
+  <img src="https://img.shields.io/badge/Microsoft_AutoGen-0078d4?style=for-the-badge&logo=microsoft" alt="Microsoft" />
+  <img src="https://img.shields.io/badge/AWS_Bedrock-FF9900?style=for-the-badge&logo=amazon-aws" alt="AWS" />
+  <img src="https://img.shields.io/badge/CopilotKit.ai-6366f1?style=for-the-badge" alt="CopilotKit" />
+  <img src="https://img.shields.io/badge/LangChain-1C3C3C?style=for-the-badge" alt="LangChain" />
+  <img src="https://img.shields.io/badge/ADK-4285F4?style=for-the-badge&logo=google-cloud" alt="ADK" />
+</div>
+
+<div align="center">
+  <img src="https://img.shields.io/badge/Python-3776AB?style=flat-square&logo=python&logoColor=white" alt="Python" />
+  <img src="https://img.shields.io/badge/Go-00ADD8?style=flat-square&logo=go&logoColor=white" alt="Go" />
+  <img src="https://img.shields.io/badge/NodeJS-339933?style=flat-square&logo=node.js&logoColor=white" alt="NodeJS" />
+  <img src="https://img.shields.io/badge/TypeScript-3178C6?style=flat-square&logo=typescript&logoColor=white" alt="TypeScript" />
+  <img src="https://img.shields.io/badge/Streamlit-FF4B4B?style=flat-square&logo=streamlit&logoColor=white" alt="Streamlit" />
+  <img src="https://img.shields.io/badge/Angular-DD0031?style=flat-square&logo=angular&logoColor=white" alt="Angular" />
+  <img src="https://img.shields.io/badge/Lit-324FFF?style=flat-square&logo=lit&logoColor=white" alt="Lit" />
+</div>
+
+Whether you are building a swarm in **CrewAI**, a Go-based high-perf engine, or a **Streamlit** dashboard, the Cockpit ensures your agent maps to the **Google Well-Architected Framework**.
+
+
+---
+
+## 🚀 Key Innovation: The "Intelligence" Layer
+
+### 🛡️ Red Team Auditor (Self-Hacking)
+Don't wait for your users to find prompt injections. Use the built-in Adversarial Evaluator to launch self-attacks against your agent, testing for PII leaks, instruction overrides, and safety filter bypasses.
+
+### 🧠 Hive Mind (Semantic Caching)
+**Reduce LLM costs by up to 40%.** The Hive Mind checks for semantically similar queries in 10ms, serving cached answers for common questions without calling the LLM.
+
+### 🏛️ Arch Review & Framework Detection
+Every agent in the cockpit is graded against a framework-aware checklist. The Cockpit intelligently detects your stack—**Google ADK**, **OpenAI Agentkit**, **Anthropic Claude**, **Microsoft AutoGen/Semantic Kernel**, **AWS Bedrock Agents**, or **CopilotKit**—and runs a tailored audit against corresponding production standards. Use `make arch-review` to verify your **Governance-as-Code**.
+
+### 🧗 Quality Hill Climbing (ADK Evaluation)
+Following **Google ADK Evaluation** best practices, the Cockpit provides an iterative optimization loop. `make quality-baseline` runs your agent against a "Golden Dataset" using **LLM-as-a-Judge** scoring (Response Match & Tool Trajectory), climbing the quality curve until production-grade fidelity is reached.
+
+---
+
+## ⌨️ Quick Start
+
+You don't even need to clone the repo to start auditing.
+
+```bash
+# 1. Audit your existing agent design
+uvx agent-ops-cockpit arch-review
+
+# 2. Stress test your endpoint
+uvx agent-ops-cockpit load-test --requests 100 --concurrency 10
+
+# 3. Scaffold a new Well-Architected app
+uvx agent-ops-cockpit create my-agent --ui a2ui
+```
+
+---
+
+## 📊 Local Development
+The Cockpit provides a unified "Mission Control" to evaluate your agents instantly.
+
+```bash
+make audit-all         # 🕹️ Run ALL audits and generate a Final Report
+make reliability       # 🛡️ Run unit tests and regression suite
+make dev               # Start the local Engine + Face stack
+make arch-review   # 🏛️ Run the Google Well-Architected design review
+make quality-baseline # 🧗 Run iterative 'Hill Climbing' quality audit
+make audit         # 🔍 Run the Interactive Agent Optimizer
+make red-team      # Execute a white-hat security audit
+make deploy-prod   # 🚀 1-click deploy to Google Cloud
+```
+
+---
+
+## 🧭 Roadmap
+- [ ] **One-Click GitHub Action**: Automated audits on every PR.
+- [ ] **Multi-Agent Orchestrator**: Support for Swarm/Coordinator patterns.
+- [ ] **Visual Mission Control**: Real-time observability dashboard.
+
+[View full roadmap →](/ROADMAP.md)
+
+---
+
+## 🤝 Community
+- **Star this repo** to help us build the future of AgentOps.
+- **Join the Discussion** for patterns on Google Cloud.
+- **Contribute**: Read our [Contributing Guide](/CONTRIBUTING.md).
+
+---
+*Reference: [Google Cloud Architecture Center - Agentic AI Overview](https://docs.cloud.google.com/architecture/agentic-ai-overview)*

agentops_cockpit-0.2.2/README.md

@@ -0,0 +1,125 @@
+# 🕹️ AgentOps Cockpit
+
+<div align="center">
+  <img src="https://img.shields.io/github/stars/enriquekalven/agent-cockpit?style=for-the-badge&color=ffd700" alt="GitHub Stars" />
+  <img src="https://img.shields.io/github/license/enriquekalven/agent-cockpit?style=for-the-badge&color=007bff" alt="License" />
+  <img src="https://img.shields.io/badge/Google-Well--Architected-4285F4?style=for-the-badge&logo=google-cloud" alt="Google Well-Architected" />
+  <img src="https://img.shields.io/badge/Status-Day%202%20Operations-10b981?style=for-the-badge" alt="Status" />
+</div>
+
+<br />
+
+<div align="center">
+  <h3>"Infrastructure gives you the pipes. We give you the Intelligence."</h3>
+  <p>The developer distribution for building, optimizing, and securing AI agents on Google Cloud.</p>
+</div>
+
+---
+
+## 📽️ The Mission
+Most AI agent templates stop at a single Python file and an API key. **The AgentOps Cockpit** is for developers moving into production. While optimized for **ADK**, it provides framework-agnostic governance, safety, and cost guardrails for the entire agentic ecosystem—from CrewAI to LangGraph. Based on the **[Google Well-Architected Framework for Agents](/docs/google-architecture)**.
+
+---
+
+## 🏗️ The Agentic Trinity
+We divide the complexity of production agents into three focused pillars:
+
+- **⚙️ The Engine**: The reasoning core. Built with **ADK**, FastAPI, and Vertex AI.
+- **🎭 The Face**: The user experience. Adaptive UI surfaces and **GenUI** standards via the A2UI spec.
+- **🕹️ The Cockpit**: The operational brain. Cost control, semantic caching, shadow routing, and adversarial audits.
+
+---
+
+## 🌐 Framework Agnostic Governance
+The Cockpit isn't just for ADK. It provides **Best Practices as Code** across all major agentic frameworks:
+
+<div align="center">
+  <img src="https://img.shields.io/badge/OpenAI_Agentkit-412991?style=for-the-badge&logo=openai" alt="OpenAI Agentkit" />
+  <img src="https://img.shields.io/badge/Anthropic_Claude-D97757?style=for-the-badge&logo=anthropic" alt="Anthropic" />
+  <img src="https://img.shields.io/badge/Microsoft_AutoGen-0078d4?style=for-the-badge&logo=microsoft" alt="Microsoft" />
+  <img src="https://img.shields.io/badge/AWS_Bedrock-FF9900?style=for-the-badge&logo=amazon-aws" alt="AWS" />
+  <img src="https://img.shields.io/badge/CopilotKit.ai-6366f1?style=for-the-badge" alt="CopilotKit" />
+  <img src="https://img.shields.io/badge/LangChain-1C3C3C?style=for-the-badge" alt="LangChain" />
+  <img src="https://img.shields.io/badge/ADK-4285F4?style=for-the-badge&logo=google-cloud" alt="ADK" />
+</div>
+
+<div align="center">
+  <img src="https://img.shields.io/badge/Python-3776AB?style=flat-square&logo=python&logoColor=white" alt="Python" />
+  <img src="https://img.shields.io/badge/Go-00ADD8?style=flat-square&logo=go&logoColor=white" alt="Go" />
+  <img src="https://img.shields.io/badge/NodeJS-339933?style=flat-square&logo=node.js&logoColor=white" alt="NodeJS" />
+  <img src="https://img.shields.io/badge/TypeScript-3178C6?style=flat-square&logo=typescript&logoColor=white" alt="TypeScript" />
+  <img src="https://img.shields.io/badge/Streamlit-FF4B4B?style=flat-square&logo=streamlit&logoColor=white" alt="Streamlit" />
+  <img src="https://img.shields.io/badge/Angular-DD0031?style=flat-square&logo=angular&logoColor=white" alt="Angular" />
+  <img src="https://img.shields.io/badge/Lit-324FFF?style=flat-square&logo=lit&logoColor=white" alt="Lit" />
+</div>
+
+Whether you are building a swarm in **CrewAI**, a Go-based high-perf engine, or a **Streamlit** dashboard, the Cockpit ensures your agent maps to the **Google Well-Architected Framework**.
+
+
+---
+
+## 🚀 Key Innovation: The "Intelligence" Layer
+
+### 🛡️ Red Team Auditor (Self-Hacking)
+Don't wait for your users to find prompt injections. Use the built-in Adversarial Evaluator to launch self-attacks against your agent, testing for PII leaks, instruction overrides, and safety filter bypasses.
+
+### 🧠 Hive Mind (Semantic Caching)
+**Reduce LLM costs by up to 40%.** The Hive Mind checks for semantically similar queries in 10ms, serving cached answers for common questions without calling the LLM.
+
+### 🏛️ Arch Review & Framework Detection
+Every agent in the cockpit is graded against a framework-aware checklist. The Cockpit intelligently detects your stack—**Google ADK**, **OpenAI Agentkit**, **Anthropic Claude**, **Microsoft AutoGen/Semantic Kernel**, **AWS Bedrock Agents**, or **CopilotKit**—and runs a tailored audit against corresponding production standards. Use `make arch-review` to verify your **Governance-as-Code**.
+
+### 🧗 Quality Hill Climbing (ADK Evaluation)
+Following **Google ADK Evaluation** best practices, the Cockpit provides an iterative optimization loop. `make quality-baseline` runs your agent against a "Golden Dataset" using **LLM-as-a-Judge** scoring (Response Match & Tool Trajectory), climbing the quality curve until production-grade fidelity is reached.
+
+---
+
+## ⌨️ Quick Start
+
+You don't even need to clone the repo to start auditing.
+
+```bash
+# 1. Audit your existing agent design
+uvx agent-ops-cockpit arch-review
+
+# 2. Stress test your endpoint
+uvx agent-ops-cockpit load-test --requests 100 --concurrency 10
+
+# 3. Scaffold a new Well-Architected app
+uvx agent-ops-cockpit create my-agent --ui a2ui
+```
+
+---
+
+## 📊 Local Development
+The Cockpit provides a unified "Mission Control" to evaluate your agents instantly.
+
+```bash
+make audit-all         # 🕹️ Run ALL audits and generate a Final Report
+make reliability       # 🛡️ Run unit tests and regression suite
+make dev               # Start the local Engine + Face stack
+make arch-review   # 🏛️ Run the Google Well-Architected design review
+make quality-baseline # 🧗 Run iterative 'Hill Climbing' quality audit
+make audit         # 🔍 Run the Interactive Agent Optimizer
+make red-team      # Execute a white-hat security audit
+make deploy-prod   # 🚀 1-click deploy to Google Cloud
+```
+
+---
+
+## 🧭 Roadmap
+- [ ] **One-Click GitHub Action**: Automated audits on every PR.
+- [ ] **Multi-Agent Orchestrator**: Support for Swarm/Coordinator patterns.
+- [ ] **Visual Mission Control**: Real-time observability dashboard.
+
+[View full roadmap →](/ROADMAP.md)
+
+---
+
+## 🤝 Community
+- **Star this repo** to help us build the future of AgentOps.
+- **Join the Discussion** for patterns on Google Cloud.
+- **Contribute**: Read our [Contributing Guide](/CONTRIBUTING.md).
+
+---
+*Reference: [Google Cloud Architecture Center - Agentic AI Overview](https://docs.cloud.google.com/architecture/agentic-ai-overview)*

agentops_cockpit-0.2.2/firebase.json

@@ -0,0 +1,37 @@
+{
+  "hosting": {
+    "target": "agent-ui",
+    "public": "dist",
+    "ignore": [
+      "firebase.json",
+      "**/.*",
+      "**/node_modules/**"
+    ],
+    "headers": [
+      {
+        "source": "**/*.html",
+        "headers": [
+          {
+            "key": "Content-Type",
+            "value": "text/html"
+          }
+        ]
+      },
+      {
+        "source": "/",
+        "headers": [
+          {
+            "key": "Content-Type",
+            "value": "text/html"
+          }
+        ]
+      }
+    ],
+    "rewrites": [
+      {
+        "source": "**",
+        "destination": "/index.html"
+      }
+    ]
+  }
+}

agentops_cockpit-0.2.2/index.html

@@ -0,0 +1,15 @@
+<!doctype html>
+<html lang="en">
+  <head>
+    <meta charset="UTF-8" />
+    <meta name="viewport" content="width=device-width, initial-scale=1.0" />
+    <title>AgentOps Cockpit</title>
+    <link rel="preconnect" href="https://fonts.googleapis.com">
+    <link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>
+    <link href="https://fonts.googleapis.com/css2?family=Plus+Jakarta+Sans:wght@400;500;600;700;800&family=JetBrains+Mono:wght@400;500;600&display=swap" rel="stylesheet">
+  </head>
+  <body>
+    <div id="root"></div>
+    <script type="module" src="/src/main.tsx"></script>
+  </body>
+</html>