agentops-cockpit 0.2.2__tar.gz → 0.4.0__tar.gz

agentops_cockpit-0.4.0/A2A_GUIDE.md

@@ -0,0 +1,58 @@
+# 📡 Agent-to-Agent (A2A) Transmission Standard
+
+Building a single agent is easy. Building a **Swarm** of agents that communicate securely and efficiently is the next frontier of AgentOps. The Cockpit implements the **A2A Transmission Standard** to ensure that your "Agent Trinity" remains Well-Architected.
+
+## 🏛️ The A2A Protocol Stack
+
+| Layer | Responsibility | Protocol / Spec |
+| :--- | :--- | :--- |
+| **Surface** | Human-Agent Interaction | [A2UI Spec](/docs/a2ui) |
+| **Memory** | Cross-Agent Knowledge | [Vector Workspace (Hive Mind)](/src/backend/cache) |
+| **Logic** | Tool & Reasoning Handshake | [A2P Handshake](#a2p-handshake) |
+| **Security** | Identity & Permissions | [GCP Workload Identity](https://cloud.google.com/kubernetes-engine/docs/how-to/workload-identity) |
+
+---
+
+## 🤝 The A2P Handshake (Agent-to-Proxy)
+
+When one agent calls another tool, it shouldn't just send raw text. It must send a **Reasoning Evidence Packet**.
+
+### ❌ The "Old" Way (Brittle)
+```json
+{
+  "query": "What is the budget?",
+  "output": "The budget is $500k."
+}
+```
+
+### ✅ The "Cockpit" Way (Well-Architected)
+```json
+{
+  "trace_id": "tr-9942-x",
+  "reasoning_path": ["Fetch Schema", "Query BigQuery", "Apply PIIScrubber"],
+  "evidence": [
+    { "source": "bq://finance.budget_2026", "assurance_score": 0.98 }
+  ],
+  "content": {
+    "text": "The approved budget is $500k.",
+    "a2ui_surface": "DynamicBudgetChart"
+  }
+}
+```
+
+## 🛡️ Governance-as-Code for Swarms
+
+On the Cockpit, every A2A transmission is automatically:
+1.  **Scrubbed**: PII is removed before leaving the Engine's VPC.
+2.  **Cached**: Similar cross-agent queries hit the **Hive Mind** instead of expensive LLM reasoning.
+3.  **Audited**: The `arch-review` tool verifies that your multi-agent graph doesn't have "Shadow Loops" (recursive infinite spend).
+
+---
+
+## ⚡ Get Started with A2A
+Use the Cockpit CLI to verify your multi-agent communication:
+```bash
+agent-ops audit --mode swarm --file multi_agent_entry.py
+```
+
+*This standard is being proposed to the Google Well-Architected Framework for AI Agents committee.*

{agentops_cockpit-0.2.2 → agentops_cockpit-0.4.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: agentops-cockpit
-Version: 0.2.2
+Version: 0.4.0
 Summary: Production-grade Agent Operations (AgentOps) Platform
 Project-URL: Homepage, https://github.com/enriquekalven/agent-ops-cockpit
 Project-URL: Bug Tracker, https://github.com/enriquekalven/agent-ops-cockpit/issues
@@ -11,6 +11,7 @@ Classifier: Operating System :: OS Independent
 Classifier: Programming Language :: Python :: 3
 Requires-Python: >=3.10
 Requires-Dist: gitpython>=3.1.0
+Requires-Dist: mcp>=0.1.0
 Requires-Dist: rich>=13.0.0
 Requires-Dist: typer>=0.9.0
 Description-Content-Type: text/markdown
@@ -18,10 +19,20 @@ Description-Content-Type: text/markdown
 # 🕹️ AgentOps Cockpit
 
 <div align="center">
+  <img src="https://raw.githubusercontent.com/enriquekalven/agent-cockpit/main/public/og-image.png" alt="AgentOps Cockpit Social Preview" width="100%" />
+</div>
+
+<div align="center">
+  <br />
+  <a href="https://deploy.cloud.google.com?repo=https://github.com/enriquekalven/agent-cockpit">
+    <img src="https://deploy.cloud.google.com/button.svg" alt="Deploy to Google Cloud" />
+  </a>
+  <br />
+  <br />
   <img src="https://img.shields.io/github/stars/enriquekalven/agent-cockpit?style=for-the-badge&color=ffd700" alt="GitHub Stars" />
   <img src="https://img.shields.io/github/license/enriquekalven/agent-cockpit?style=for-the-badge&color=007bff" alt="License" />
   <img src="https://img.shields.io/badge/Google-Well--Architected-4285F4?style=for-the-badge&logo=google-cloud" alt="Google Well-Architected" />
-  <img src="https://img.shields.io/badge/Status-Day%202%20Operations-10b981?style=for-the-badge" alt="Status" />
+  <img src="https://img.shields.io/badge/A2A_Standard-Enabled-10b981?style=for-the-badge" alt="A2A Standard" />
 </div>
 
 <br />
@@ -34,7 +45,12 @@ Description-Content-Type: text/markdown
 ---
 
 ## 📽️ The Mission
-Most AI agent templates stop at a single Python file and an API key. **The AgentOps Cockpit** is for developers moving into production. While optimized for **ADK**, it provides framework-agnostic governance, safety, and cost guardrails for the entire agentic ecosystem—from CrewAI to LangGraph. Based on the **[Google Well-Architected Framework for Agents](/docs/google-architecture)**.
+Most AI agent templates stop at a single Python file and an API key. **The AgentOps Cockpit** is for developers moving into production. It provides framework-agnostic governance, safety, and cost guardrails for the entire agentic ecosystem.
+
+### Key Pillars:
+- **Governance-as-Code**: Audit your agent against [Google Well-Architected](/docs/google-architecture) best practices.
+- **Agentic Trinity**: Dedicated layers for the Engine (Logic), Face (UX), and Cockpit (Ops).
+- **A2A Connectivity**: Implements the [Agent-to-Agent Transmission Standard](/A2A_GUIDE.md) for secure swarm orchestration.
 
 ---
 
@@ -86,6 +102,9 @@ Don't wait for your users to find prompt injections. Use the built-in Adversaria
 ### 🏛️ Arch Review & Framework Detection
 Every agent in the cockpit is graded against a framework-aware checklist. The Cockpit intelligently detects your stack—**Google ADK**, **OpenAI Agentkit**, **Anthropic Claude**, **Microsoft AutoGen/Semantic Kernel**, **AWS Bedrock Agents**, or **CopilotKit**—and runs a tailored audit against corresponding production standards. Use `make arch-review` to verify your **Governance-as-Code**.
 
+### 🕹️ MCP Connectivity Hub (Model Context Protocol)
+Stop building one-off tool integrations. The Cockpit provides a unified hub for **MCP Servers**. Connect to Google Search, Slack, or your internal databases via the standardized Model Context Protocol for secure, audited tool execution.
+
 ### 🧗 Quality Hill Climbing (ADK Evaluation)
 Following **Google ADK Evaluation** best practices, the Cockpit provides an iterative optimization loop. `make quality-baseline` runs your agent against a "Golden Dataset" using **LLM-as-a-Judge** scoring (Response Match & Tool Trajectory), climbing the quality curve until production-grade fidelity is reached.
 
@@ -93,17 +112,25 @@ Following **Google ADK Evaluation** best practices, the Cockpit provides an iter
 
 ## ⌨️ Quick Start
 
-You don't even need to clone the repo to start auditing.
+The Cockpit is available as a first-class CLI on PyPI. 
 
 ```bash
-# 1. Audit your existing agent design
-uvx agent-ops-cockpit arch-review
+# 1. Install the Cockpit globally
+pip install agentops-cockpit
 
-# 2. Stress test your endpoint
-uvx agent-ops-cockpit load-test --requests 100 --concurrency 10
+# 2. Audit your existing agent design
+agent-ops arch-review
 
-# 3. Scaffold a new Well-Architected app
-uvx agent-ops-cockpit create my-agent --ui a2ui
+# 3. Stress test your endpoint
+agent-ops load-test --requests 100 --concurrency 10
+
+# 4. Scaffold a new Well-Architected app
+agent-ops create my-agent --ui a2ui
+```
+
+You can also use `uvx` for one-off commands without installation:
+```bash
+uvx agentops-cockpit arch-review
 ```
 
 ---

{agentops_cockpit-0.2.2 → agentops_cockpit-0.4.0}/README.md

@@ -1,10 +1,20 @@
 # 🕹️ AgentOps Cockpit
 
 <div align="center">
+  <img src="https://raw.githubusercontent.com/enriquekalven/agent-cockpit/main/public/og-image.png" alt="AgentOps Cockpit Social Preview" width="100%" />
+</div>
+
+<div align="center">
+  <br />
+  <a href="https://deploy.cloud.google.com?repo=https://github.com/enriquekalven/agent-cockpit">
+    <img src="https://deploy.cloud.google.com/button.svg" alt="Deploy to Google Cloud" />
+  </a>
+  <br />
+  <br />
   <img src="https://img.shields.io/github/stars/enriquekalven/agent-cockpit?style=for-the-badge&color=ffd700" alt="GitHub Stars" />
   <img src="https://img.shields.io/github/license/enriquekalven/agent-cockpit?style=for-the-badge&color=007bff" alt="License" />
   <img src="https://img.shields.io/badge/Google-Well--Architected-4285F4?style=for-the-badge&logo=google-cloud" alt="Google Well-Architected" />
-  <img src="https://img.shields.io/badge/Status-Day%202%20Operations-10b981?style=for-the-badge" alt="Status" />
+  <img src="https://img.shields.io/badge/A2A_Standard-Enabled-10b981?style=for-the-badge" alt="A2A Standard" />
 </div>
 
 <br />
@@ -17,7 +27,12 @@
 ---
 
 ## 📽️ The Mission
-Most AI agent templates stop at a single Python file and an API key. **The AgentOps Cockpit** is for developers moving into production. While optimized for **ADK**, it provides framework-agnostic governance, safety, and cost guardrails for the entire agentic ecosystem—from CrewAI to LangGraph. Based on the **[Google Well-Architected Framework for Agents](/docs/google-architecture)**.
+Most AI agent templates stop at a single Python file and an API key. **The AgentOps Cockpit** is for developers moving into production. It provides framework-agnostic governance, safety, and cost guardrails for the entire agentic ecosystem.
+
+### Key Pillars:
+- **Governance-as-Code**: Audit your agent against [Google Well-Architected](/docs/google-architecture) best practices.
+- **Agentic Trinity**: Dedicated layers for the Engine (Logic), Face (UX), and Cockpit (Ops).
+- **A2A Connectivity**: Implements the [Agent-to-Agent Transmission Standard](/A2A_GUIDE.md) for secure swarm orchestration.
 
 ---
 
@@ -69,6 +84,9 @@ Don't wait for your users to find prompt injections. Use the built-in Adversaria
 ### 🏛️ Arch Review & Framework Detection
 Every agent in the cockpit is graded against a framework-aware checklist. The Cockpit intelligently detects your stack—**Google ADK**, **OpenAI Agentkit**, **Anthropic Claude**, **Microsoft AutoGen/Semantic Kernel**, **AWS Bedrock Agents**, or **CopilotKit**—and runs a tailored audit against corresponding production standards. Use `make arch-review` to verify your **Governance-as-Code**.
 
+### 🕹️ MCP Connectivity Hub (Model Context Protocol)
+Stop building one-off tool integrations. The Cockpit provides a unified hub for **MCP Servers**. Connect to Google Search, Slack, or your internal databases via the standardized Model Context Protocol for secure, audited tool execution.
+
 ### 🧗 Quality Hill Climbing (ADK Evaluation)
 Following **Google ADK Evaluation** best practices, the Cockpit provides an iterative optimization loop. `make quality-baseline` runs your agent against a "Golden Dataset" using **LLM-as-a-Judge** scoring (Response Match & Tool Trajectory), climbing the quality curve until production-grade fidelity is reached.
 
@@ -76,17 +94,25 @@ Following **Google ADK Evaluation** best practices, the Cockpit provides an iter
 
 ## ⌨️ Quick Start
 
-You don't even need to clone the repo to start auditing.
+The Cockpit is available as a first-class CLI on PyPI. 
 
 ```bash
-# 1. Audit your existing agent design
-uvx agent-ops-cockpit arch-review
+# 1. Install the Cockpit globally
+pip install agentops-cockpit
 
-# 2. Stress test your endpoint
-uvx agent-ops-cockpit load-test --requests 100 --concurrency 10
+# 2. Audit your existing agent design
+agent-ops arch-review
 
-# 3. Scaffold a new Well-Architected app
-uvx agent-ops-cockpit create my-agent --ui a2ui
+# 3. Stress test your endpoint
+agent-ops load-test --requests 100 --concurrency 10
+
+# 4. Scaffold a new Well-Architected app
+agent-ops create my-agent --ui a2ui
+```
+
+You can also use `uvx` for one-off commands without installation:
+```bash
+uvx agentops-cockpit arch-review
 ```
 
 ---

{agentops_cockpit-0.2.2 → agentops_cockpit-0.4.0}/pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "hatchling.build"
 
 [project]
 name = "agentops-cockpit"
-version = "0.2.2"
+version = "0.4.0"
 description = "Production-grade Agent Operations (AgentOps) Platform"
 readme = "README.md"
 authors = [
@@ -20,6 +20,7 @@ dependencies = [
     "typer>=0.9.0",
     "rich>=13.0.0",
     "GitPython>=3.1.0",
+    "mcp>=0.1.0",
 ]
 
 [project.urls]

{agentops_cockpit-0.2.2 → agentops_cockpit-0.4.0}/src/agent_ops_cockpit/cli/main.py

@@ -6,6 +6,15 @@ from rich.console import Console
 from rich.panel import Panel
 import typer
 
+# Deep imports for portable CLI execution
+from agent_ops_cockpit.ops import arch_review as arch_mod
+from agent_ops_cockpit.ops import orchestrator as orch_mod
+from agent_ops_cockpit.ops import reliability as rel_mod
+from agent_ops_cockpit.eval import quality_climber as quality_mod
+from agent_ops_cockpit.eval import red_team as red_mod
+from agent_ops_cockpit.eval import load_test as load_mod
+from agent_ops_cockpit import optimizer as opt_mod
+
 app = typer.Typer(help="AgentOps Cockpit: The AI Agent Operations Platform", no_args_is_help=True)
 console = Console()
 
@@ -14,7 +23,7 @@ REPO_URL = "https://github.com/enriquekalven/agent-ui-starter-pack"
 @app.command()
 def version():
     """Show the version of the Optimized Agent Stack CLI."""
-    console.print("[bold cyan]agent-ops CLI v0.1.0[/bold cyan]")
+    console.print("[bold cyan]agent-ops CLI v0.2.2[/bold cyan]")
 
 @app.command()
 def reliability():
@@ -22,7 +31,7 @@ def reliability():
     Run reliability audit (Unit Tests + Regression Suite coverage).
     """
     console.print("🛡️ [bold green]Launching Reliability Audit...[/bold green]")
-    subprocess.run([sys.executable, "-m", "backend.ops.reliability", "audit"], env={**os.environ, "PYTHONPATH": "src"})
+    rel_mod.run_tests()
 
 @app.command()
 def report():
@@ -30,34 +39,34 @@ def report():
     Launch full AgentOps audit (Arch, Quality, Security, Cost) and generate a final report.
     """
     console.print("🕹️ [bold blue]Launching Full System Audit...[/bold blue]")
-    subprocess.run([sys.executable, "-m", "backend.ops.orchestrator"], env={**os.environ, "PYTHONPATH": "src"})
+    orch_mod.run_full_audit()
 
 @app.command()
-def quality_baseline():
+def quality_baseline(path: str = "."):
     """
     Run iterative 'Hill Climbing' quality audit against a golden dataset.
     """
     console.print("🧗 [bold cyan]Launching Quality Hill Climber...[/bold cyan]")
-    subprocess.run([sys.executable, "-m", "backend.eval.quality_climber", "audit"], env={**os.environ, "PYTHONPATH": "src"})
+    quality_mod.audit(path)
 
 @app.command()
-def arch_review():
+def arch_review(path: str = "."):
     """
     Audit agent design against Google Well-Architected Framework.
     """
     console.print("🏛️ [bold blue]Launching Architecture Design Review...[/bold blue]")
-    subprocess.run([sys.executable, "-m", "backend.ops.arch_review", "audit"], env={**os.environ, "PYTHONPATH": "src"})
+    arch_mod.audit(path)
 
 @app.command()
 def audit(
     file_path: str = typer.Argument("src/backend/agent.py", help="Path to the agent code to audit"),
+    interactive: bool = typer.Option(True, "--interactive/--no-interactive", "-i", help="Run in interactive mode")
 ):
     """
     Run the Interactive Agent Optimizer audit.
     """
     console.print("🔍 [bold blue]Running Agent Operations Audit...[/bold blue]")
-    # Run the optimizer module
-    subprocess.run([sys.executable, "-m", "backend.optimizer", "audit", file_path], env={**os.environ, "PYTHONPATH": "src"})
+    opt_mod.audit(file_path, interactive)
 
 @app.command()
 def red_team(
@@ -67,7 +76,7 @@ def red_team(
     Run the Red Team adversarial security evaluation.
     """
     console.print("🚩 [bold red]Launching Red Team Evaluation...[/bold red]")
-    subprocess.run([sys.executable, "-m", "backend.eval.red_team", "audit", agent_path], env={**os.environ, "PYTHONPATH": "src"})
+    red_mod.audit(agent_path)
 
 @app.command()
 def load_test(
@@ -79,12 +88,7 @@ def load_test(
     Stress test agent endpoints for performance and reliability.
     """
     console.print("⚡ [bold yellow]Launching Base Load Test...[/bold yellow]")
-    subprocess.run([
-        sys.executable, "-m", "backend.eval.load_test", "run", 
-        "--url", url, 
-        "--requests", str(requests), 
-        "--concurrency", str(concurrency)
-    ], env={**os.environ, "PYTHONPATH": "src"})
+    load_mod.run(url, requests, concurrency)
 
 @app.command()
 def deploy(
@@ -98,7 +102,7 @@ def deploy(
     
     # 1. Audit
     console.print("\n[bold]Step 1: Code Optimization Audit[/bold]")
-    subprocess.run([sys.executable, "-m", "backend.optimizer", "audit", "--no-interactive"], env={**os.environ, "PYTHONPATH": "src"})
+    opt_mod.audit("src/backend/agent.py", interactive=False)
     
     # 2. Build Frontend
     console.print("\n[bold]Step 2: Building Frontend Assets[/bold]")
@@ -163,7 +167,7 @@ def create(
             f"[bold]Quick Start:[/bold]\n"
             f"  1. [dim]cd[/dim] {project_name}\n"
             f"  2. [dim]{'npm install' if ui != 'flutter' else 'flutter pub get'}[/dim]\n"
-            f"  3. [dim]uvx agent-ops-cockpit audit[/dim]\n"
+            f"  3. [dim]agent-ops audit[/dim]\n"
             f"  4. [dim]{start_cmd}[/dim]\n\n"
             f"Configuration: UI=[bold cyan]{ui}[/bold cyan], CopilotKit=[bold cyan]{'Enabled' if copilotkit else 'Disabled'}[/bold cyan]",
             title="[bold green]Project Scaffolding Complete[/bold green]",

agentops_cockpit-0.4.0/src/agent_ops_cockpit/ops/arch_review.py

@@ -0,0 +1,100 @@
+import typer
+import os
+from rich.console import Console
+from rich.table import Table
+from rich.panel import Panel
+
+app = typer.Typer(help="Agent Architecture Reviewer: Audit your design against Google Well-Architected Framework.")
+console = Console()
+
+from agent_ops_cockpit.ops.frameworks import detect_framework, FRAMEWORKS
+
+@app.command()
+def audit(path: str = "."):
+    """
+    Run the Architecture Design Review based on detected framework.
+    """
+    framework_key = detect_framework(path)
+    framework_data = FRAMEWORKS[framework_key]
+    checklist = framework_data["checklist"]
+    framework_name = framework_data["name"]
+
+    console.print(Panel.fit(f"🏛️ [bold blue]{framework_name.upper()}: ARCHITECTURE REVIEW[/bold blue]", border_style="blue"))
+    console.print(f"Detected Framework: [bold green]{framework_name}[/bold green]")
+    console.print(f"Comparing local agent implementation against [bold]{framework_name} Best Practices[/bold]...\n")
+
+    # Read all relevant code files for inspection
+    code_content = ""
+    for root, dirs, files in os.walk(path):
+        if any(d in root for d in [".venv", "node_modules", ".git"]): continue
+        for file in files:
+            if file.endswith((".py", ".ts", ".tsx", ".js")):
+                try:
+                    with open(os.path.join(root, file), 'r') as f:
+                        code_content += f.read() + "\n"
+                except Exception:
+                    pass
+
+    total_checks = 0
+    passed_checks = 0
+
+    for section in checklist:
+        table = Table(title=section["category"], show_header=True, header_style="bold magenta")
+        table.add_column("Design Check", style="cyan")
+        table.add_column("Status", style="green", justify="center")
+        table.add_column("Rationale", style="dim")
+
+        for check_text, rationale in section["checks"]:
+            total_checks += 1
+            # Simple heuristic audit: check if certain keywords exist in the code
+            keywords = {
+                "PII": ["scrub", "mask", "pii", "filter"],
+                "Sandbox": ["sandbox", "docker", "isolated", "gvisor"],
+                "Caching": ["cache", "redis", "memorystore", "hive_mind"],
+                "Identity": ["iam", "auth", "token", "oauth", "workloadidentity"],
+                "Moderation": ["moderate", "safety", "filter"],
+                "Routing": ["router", "switch", "map", "agentengine"],
+                "Outputs": ["schema", "json", "structured"],
+                "HITL": ["approve", "confirm", "human"],
+                "Confirmation": ["confirm", "ask", "approve"],
+                "Logging": ["log", "trace", "audit", "reasoningengine"],
+                "Cloud Run": ["startupcpu", "boost", "minInstances"],
+                "GKE": ["kubectl", "k8s", "autopilot", "helm"],
+                "VPC": ["vpcnc", "sc-env", "isolation"],
+                "A2UI": ["a2ui", "renderer", "registry", "component"],
+                "Responsive": ["@media", "max-width", "flex", "grid", "vw", "vh"],
+                "Accessibility": ["aria-", "role=", "alt=", "tabindex"],
+                "Triggers": ["trigger", "callback", "handle", "onclick"]
+            }
+            
+            check_key = check_text.split(":")[0].strip()
+            status = "[yellow]PENDING[/yellow]"
+            
+            # If any keyword for this check type is found, mark as PASSED
+            matched = False
+            for k, words in keywords.items():
+                if k.lower() in check_key.lower():
+                    if any(word in code_content.lower() for word in words):
+                        matched = True
+                        break
+            
+            if matched:
+                status = "[bold green]PASSED[/bold green]"
+                passed_checks += 1
+            else:
+                status = "[bold red]FAIL[/bold red]"
+            
+            table.add_row(check_text, status, rationale)
+        
+        console.print(table)
+        console.print("\n")
+
+    score = (passed_checks / total_checks) * 100 if total_checks > 0 else 0
+    console.print(f"📊 [bold]Review Score: {score:.0f}/100[/bold]")
+    if score >= 80:
+        console.print(f"✅ [bold green]Architecture Review Complete.[/bold green] Your agent is well-aligned with {framework_name} patterns.")
+    else:
+        console.print("⚠️ [bold yellow]Review Complete with warnings.[/bold yellow] Your agent has gaps in best practices. See results above.")
+
+if __name__ == "__main__":
+    app()

agentops_cockpit-0.4.0/src/agent_ops_cockpit/ops/mcp_hub.py

@@ -0,0 +1,80 @@
+from typing import List, Dict, Any, Optional
+import asyncio
+import json
+import os
+from mcp import ClientSession, StdioServerParameters
+from mcp.client.stdio import stdio_client
+
+class MCPHub:
+    """
+    Model Context Protocol (MCP) Hub.
+    Provides a unified interface for tool discovery and execution across
+    multiple MCP servers (Google Search, SQL, internal tools).
+    """
+
+    def __init__(self):
+        self.servers: Dict[str, StdioServerParameters] = {}
+        self.registry = {
+            "search": {"type": "mcp", "provider": "google-search", "server": "google-search-mcp"},
+            "db": {"type": "mcp", "provider": "alloydb", "server": "postgres-mcp"},
+            "legacy_crm": {"type": "rest", "provider": "internal", "status": "deprecated"}
+        }
+
+    def register_server(self, name: str, command: str, args: List[str] = None):
+        """Registers a local MCP server."""
+        self.servers[name] = StdioServerParameters(
+            command=command,
+            args=args or [],
+            env=os.environ.copy()
+        )
+
+    async def execute_tool(self, tool_name: str, arguments: Dict[str, Any]):
+        """
+        Executes a tool call using the Model Context Protocol.
+        """
+        if tool_name not in self.registry:
+            raise ValueError(f"Tool {tool_name} not found in MCP registry.")
+
+        config = self.registry[tool_name]
+        
+        # If it's a legacy tool, handle it separately
+        if config["type"] == "rest":
+            print(f"⚠️  Executing legacy REST tool: {tool_name}")
+            return await self._mock_legacy_exec(tool_name, arguments)
+
+        server_name = config.get("server")
+        if not server_name or server_name not in self.servers:
+            # Fallback to mock for demo/unconfigured environments
+            print(f"ℹ️  MCP Server '{server_name}' not configured. Running in simulated mode.")
+            return await self._mock_mcp_exec(tool_name, arguments)
+
+        # Real MCP Protocol Execution
+        async with stdio_client(self.servers[server_name]) as (read, write):
+            async with ClientSession(read, write) as session:
+                await session.initialize()
+                result = await session.call_tool(tool_name, arguments)
+                return {
+                    "result": result.content,
+                    "protocol": "mcp-v1",
+                    "server": server_name
+                }
+
+    async def _mock_mcp_exec(self, tool_name: str, args: Dict[str, Any]):
+        await asyncio.sleep(0.2)
+        return {
+            "result": f"Simulated MCP response for {tool_name}",
+            "protocol": "mcp-virtual",
+            "assurance": 0.95
+        }
+
+    async def _mock_legacy_exec(self, tool_name: str, args: Dict[str, Any]):
+        await asyncio.sleep(0.5)
+        return {
+            "result": f"Legacy response for {tool_name}",
+            "protocol": "rest-legacy",
+            "warning": "MIGRATE_TO_MCP"
+        }
+
+global_mcp_hub = MCPHub()
+# Example registration (commented out as it requires local binaries)
+# global_mcp_hub.register_server("google-search-mcp", "npx", ["-y", "@modelcontextprotocol/server-google-search"])

agentops_cockpit-0.4.0/src/agent_ops_cockpit/ops/orchestrator.py

@@ -0,0 +1,103 @@
+import os
+from datetime import datetime
+from rich.console import Console
+from rich.panel import Panel
+from rich.table import Table
+
+# Import from package namespace
+from agent_ops_cockpit.ops import arch_review, reliability, secret_scanner, ui_auditor
+from agent_ops_cockpit.eval import quality_climber, red_team
+from agent_ops_cockpit import optimizer
+
+console = Console()
+
+class CockpitOrchestrator:
+    """
+    Main orchestrator for AgentOps audits.
+    Runs Arch Review, Quality Baseline, Red Team, and Performance tests.
+    """
+    
+    def __init__(self):
+        self.timestamp = datetime.now().strftime("%Y-%m-%d %H:%M:%S")
+        self.report_path = "cockpit_final_report.md"
+        self.results = {}
+
+    def run_step(self, name: str, func, *args, **kwargs):
+        console.print(f"\n🚀 [bold]Step: {name}[/bold]")
+        try:
+            # Capturing output for internal functions is harder without redirecting stdout
+            # For now, we just execute them for the effect and note success
+            func(*args, **kwargs)
+            self.results[name] = {
+                "success": True,
+                "output": f"Audit {name} executed successfully."
+            }
+            console.print(f"✅ {name} Completed.")
+        except Exception as e:
+            self.results[name] = {"success": False, "output": str(e)}
+            console.print(f"❌ {name} Failed: {e}")
+
+    def generate_report(self):
+        report = [
+            "# 🏁 AgentOps Cockpit: Final Audit Report",
+            f"**Timestamp**: {self.timestamp}",
+            f"**Status**: {'PASS' if all(r['success'] for r in self.results.values()) else 'FAIL'}",
+            "\n---",
+            "\n## 📊 Executive Summary"
+        ]
+        
+        summary_table = Table(show_header=True, header_style="bold magenta")
+        summary_table.add_column("Audit Type")
+        summary_table.add_column("Status")
+        
+        for name, data in self.results.items():
+            status = "✅ PASS" if data["success"] else "❌ FAIL"
+            summary_table.add_row(name, status)
+            report.append(f"- **{name}**: {status}")
+
+        console.print("\n", summary_table)
+        
+        report.append("\n## 🔍 Detailed Findings")
+        for name, data in self.results.items():
+            report.append(f"\n### {name}")
+            report.append(data["output"])
+
+        report.append("\n---")
+        report.append("\n*Generated by the AgentOps Cockpit Orchestrator.*")
+        
+        with open(self.report_path, "w") as f:
+            f.write("\n".join(report))
+        
+        console.print(f"\n✨ [bold green]Final Report generated at {self.report_path}[/bold green]")
+
+def run_full_audit():
+    orchestrator = CockpitOrchestrator()
+    
+    console.print(Panel.fit(
+        "🕹️ [bold blue]AGENTOPS COCKPIT: FULL SYSTEM AUDIT[/bold blue]\nLaunching all governance and optimization modules...",
+        border_style="blue"
+    ))
+
+    # 1. Architecture Review
+    orchestrator.run_step("Architecture Review", arch_review.audit, path=".")
+    
+    # 2. Quality Baseline
+    orchestrator.run_step("Quality Baseline", quality_climber.audit, path=".")
+    
+    # 3. Security & Secrets
+    orchestrator.run_step("Secret Scanner (Leak Detection)", secret_scanner.scan, path=".")
+    orchestrator.run_step("Adversarial Security (Red Team)", red_team.audit, agent_path="src/backend/agent.py")
+    
+    # 4. Face (UI/UX) Audit
+    orchestrator.run_step("UI/UX Quality (Face Auditor)", ui_auditor.audit, path="src")
+    
+    # 5. Token Optimization Audit
+    orchestrator.run_step("Token Optimization Audit", optimizer.audit, file_path="src/backend/agent.py", interactive=False)
+
+    # 6. Reliability Audit (Unit + Regression)
+    orchestrator.run_step("Reliability (Unit + Regression)", reliability.run_tests)
+
+    orchestrator.generate_report()
+
+if __name__ == "__main__":
+    run_full_audit()