agentops-cockpit 0.2.2__py3-none-any.whl → 0.4.0__py3-none-any.whl
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- agent_ops_cockpit/cache/__init__.py +0 -0
- agent_ops_cockpit/cache/semantic_cache.py +59 -0
- agent_ops_cockpit/cli/main.py +22 -18
- agent_ops_cockpit/cost_control.py +53 -0
- agent_ops_cockpit/eval/__init__.py +1 -0
- agent_ops_cockpit/eval/load_test.py +91 -0
- agent_ops_cockpit/eval/quality_climber.py +129 -0
- agent_ops_cockpit/eval/red_team.py +72 -0
- agent_ops_cockpit/ops/__init__.py +1 -0
- agent_ops_cockpit/ops/arch_review.py +100 -0
- agent_ops_cockpit/ops/cost_optimizer.py +40 -0
- agent_ops_cockpit/ops/evidence.py +25 -0
- agent_ops_cockpit/ops/frameworks.py +407 -0
- agent_ops_cockpit/ops/mcp_hub.py +80 -0
- agent_ops_cockpit/ops/memory_optimizer.py +44 -0
- agent_ops_cockpit/ops/orchestrator.py +103 -0
- agent_ops_cockpit/ops/pii_scrubber.py +47 -0
- agent_ops_cockpit/ops/reliability.py +50 -0
- agent_ops_cockpit/ops/secret_scanner.py +75 -0
- agent_ops_cockpit/ops/ui_auditor.py +120 -0
- agent_ops_cockpit/optimizer.py +263 -0
- agent_ops_cockpit/shadow/__init__.py +0 -0
- agent_ops_cockpit/shadow/router.py +75 -0
- {agentops_cockpit-0.2.2.dist-info → agentops_cockpit-0.4.0.dist-info}/METADATA +37 -10
- agentops_cockpit-0.4.0.dist-info/RECORD +30 -0
- agentops_cockpit-0.2.2.dist-info/RECORD +0 -8
- {agentops_cockpit-0.2.2.dist-info → agentops_cockpit-0.4.0.dist-info}/WHEEL +0 -0
- {agentops_cockpit-0.2.2.dist-info → agentops_cockpit-0.4.0.dist-info}/entry_points.txt +0 -0
- {agentops_cockpit-0.2.2.dist-info → agentops_cockpit-0.4.0.dist-info}/licenses/LICENSE +0 -0
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
Metadata-Version: 2.4
|
|
2
2
|
Name: agentops-cockpit
|
|
3
|
-
Version: 0.
|
|
3
|
+
Version: 0.4.0
|
|
4
4
|
Summary: Production-grade Agent Operations (AgentOps) Platform
|
|
5
5
|
Project-URL: Homepage, https://github.com/enriquekalven/agent-ops-cockpit
|
|
6
6
|
Project-URL: Bug Tracker, https://github.com/enriquekalven/agent-ops-cockpit/issues
|
|
@@ -11,6 +11,7 @@ Classifier: Operating System :: OS Independent
|
|
|
11
11
|
Classifier: Programming Language :: Python :: 3
|
|
12
12
|
Requires-Python: >=3.10
|
|
13
13
|
Requires-Dist: gitpython>=3.1.0
|
|
14
|
+
Requires-Dist: mcp>=0.1.0
|
|
14
15
|
Requires-Dist: rich>=13.0.0
|
|
15
16
|
Requires-Dist: typer>=0.9.0
|
|
16
17
|
Description-Content-Type: text/markdown
|
|
@@ -18,10 +19,20 @@ Description-Content-Type: text/markdown
|
|
|
18
19
|
# 🕹️ AgentOps Cockpit
|
|
19
20
|
|
|
20
21
|
<div align="center">
|
|
22
|
+
<img src="https://raw.githubusercontent.com/enriquekalven/agent-cockpit/main/public/og-image.png" alt="AgentOps Cockpit Social Preview" width="100%" />
|
|
23
|
+
</div>
|
|
24
|
+
|
|
25
|
+
<div align="center">
|
|
26
|
+
<br />
|
|
27
|
+
<a href="https://deploy.cloud.google.com?repo=https://github.com/enriquekalven/agent-cockpit">
|
|
28
|
+
<img src="https://deploy.cloud.google.com/button.svg" alt="Deploy to Google Cloud" />
|
|
29
|
+
</a>
|
|
30
|
+
<br />
|
|
31
|
+
<br />
|
|
21
32
|
<img src="https://img.shields.io/github/stars/enriquekalven/agent-cockpit?style=for-the-badge&color=ffd700" alt="GitHub Stars" />
|
|
22
33
|
<img src="https://img.shields.io/github/license/enriquekalven/agent-cockpit?style=for-the-badge&color=007bff" alt="License" />
|
|
23
34
|
<img src="https://img.shields.io/badge/Google-Well--Architected-4285F4?style=for-the-badge&logo=google-cloud" alt="Google Well-Architected" />
|
|
24
|
-
<img src="https://img.shields.io/badge/
|
|
35
|
+
<img src="https://img.shields.io/badge/A2A_Standard-Enabled-10b981?style=for-the-badge" alt="A2A Standard" />
|
|
25
36
|
</div>
|
|
26
37
|
|
|
27
38
|
<br />
|
|
@@ -34,7 +45,12 @@ Description-Content-Type: text/markdown
|
|
|
34
45
|
---
|
|
35
46
|
|
|
36
47
|
## 📽️ The Mission
|
|
37
|
-
Most AI agent templates stop at a single Python file and an API key. **The AgentOps Cockpit** is for developers moving into production.
|
|
48
|
+
Most AI agent templates stop at a single Python file and an API key. **The AgentOps Cockpit** is for developers moving into production. It provides framework-agnostic governance, safety, and cost guardrails for the entire agentic ecosystem.
|
|
49
|
+
|
|
50
|
+
### Key Pillars:
|
|
51
|
+
- **Governance-as-Code**: Audit your agent against [Google Well-Architected](/docs/google-architecture) best practices.
|
|
52
|
+
- **Agentic Trinity**: Dedicated layers for the Engine (Logic), Face (UX), and Cockpit (Ops).
|
|
53
|
+
- **A2A Connectivity**: Implements the [Agent-to-Agent Transmission Standard](/A2A_GUIDE.md) for secure swarm orchestration.
|
|
38
54
|
|
|
39
55
|
---
|
|
40
56
|
|
|
@@ -86,6 +102,9 @@ Don't wait for your users to find prompt injections. Use the built-in Adversaria
|
|
|
86
102
|
### 🏛️ Arch Review & Framework Detection
|
|
87
103
|
Every agent in the cockpit is graded against a framework-aware checklist. The Cockpit intelligently detects your stack—**Google ADK**, **OpenAI Agentkit**, **Anthropic Claude**, **Microsoft AutoGen/Semantic Kernel**, **AWS Bedrock Agents**, or **CopilotKit**—and runs a tailored audit against corresponding production standards. Use `make arch-review` to verify your **Governance-as-Code**.
|
|
88
104
|
|
|
105
|
+
### 🕹️ MCP Connectivity Hub (Model Context Protocol)
|
|
106
|
+
Stop building one-off tool integrations. The Cockpit provides a unified hub for **MCP Servers**. Connect to Google Search, Slack, or your internal databases via the standardized Model Context Protocol for secure, audited tool execution.
|
|
107
|
+
|
|
89
108
|
### 🧗 Quality Hill Climbing (ADK Evaluation)
|
|
90
109
|
Following **Google ADK Evaluation** best practices, the Cockpit provides an iterative optimization loop. `make quality-baseline` runs your agent against a "Golden Dataset" using **LLM-as-a-Judge** scoring (Response Match & Tool Trajectory), climbing the quality curve until production-grade fidelity is reached.
|
|
91
110
|
|
|
@@ -93,17 +112,25 @@ Following **Google ADK Evaluation** best practices, the Cockpit provides an iter
|
|
|
93
112
|
|
|
94
113
|
## ⌨️ Quick Start
|
|
95
114
|
|
|
96
|
-
|
|
115
|
+
The Cockpit is available as a first-class CLI on PyPI.
|
|
97
116
|
|
|
98
117
|
```bash
|
|
99
|
-
# 1.
|
|
100
|
-
|
|
118
|
+
# 1. Install the Cockpit globally
|
|
119
|
+
pip install agentops-cockpit
|
|
101
120
|
|
|
102
|
-
# 2.
|
|
103
|
-
|
|
121
|
+
# 2. Audit your existing agent design
|
|
122
|
+
agent-ops arch-review
|
|
104
123
|
|
|
105
|
-
# 3.
|
|
106
|
-
|
|
124
|
+
# 3. Stress test your endpoint
|
|
125
|
+
agent-ops load-test --requests 100 --concurrency 10
|
|
126
|
+
|
|
127
|
+
# 4. Scaffold a new Well-Architected app
|
|
128
|
+
agent-ops create my-agent --ui a2ui
|
|
129
|
+
```
|
|
130
|
+
|
|
131
|
+
You can also use `uvx` for one-off commands without installation:
|
|
132
|
+
```bash
|
|
133
|
+
uvx agentops-cockpit arch-review
|
|
107
134
|
```
|
|
108
135
|
|
|
109
136
|
---
|
|
@@ -0,0 +1,30 @@
|
|
|
1
|
+
agent_ops_cockpit/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
|
|
2
|
+
agent_ops_cockpit/cost_control.py,sha256=eO8-3ggK1Kr9iA7S_GURXqUIsDHYyqXF_bBkmCJe_tM,2333
|
|
3
|
+
agent_ops_cockpit/optimizer.py,sha256=MM352wDjCGfOz-EMBbDI8NGj1b7TY578atAO-qYMW0Y,11972
|
|
4
|
+
agent_ops_cockpit/cache/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
|
|
5
|
+
agent_ops_cockpit/cache/semantic_cache.py,sha256=HwOO3Mehk8itUpluRKHkF07g25AbM-PC0vGBSfoRyiE,2046
|
|
6
|
+
agent_ops_cockpit/cli/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
|
|
7
|
+
agent_ops_cockpit/cli/main.py,sha256=gZmfW1mEz6N7oEzpaQ0gck0mUJVAaf-S8x06Z_UlJ7o,7355
|
|
8
|
+
agent_ops_cockpit/eval/__init__.py,sha256=X68nLTYCIbL3U065CSdodzaCTmL94Rf442gV2DoR4E8,23
|
|
9
|
+
agent_ops_cockpit/eval/load_test.py,sha256=H2BeUbMR1X1ANh5EpRdBJsMmRei1H_sfpVBsHZGTCTQ,3430
|
|
10
|
+
agent_ops_cockpit/eval/quality_climber.py,sha256=J5PLQKdZ9u3jWn6EM-w3QJ6kAeiVeTlU6aEcPFL61MM,4993
|
|
11
|
+
agent_ops_cockpit/eval/red_team.py,sha256=xGL2t8as4RB0tEIIX0ExCw7ZFTkKnCwq2KZJqKzQcd8,3269
|
|
12
|
+
agent_ops_cockpit/ops/__init__.py,sha256=YBoDCVs7NvNbjK-kBaFckUTcmd5RBafn0tnsoMR6EFs,22
|
|
13
|
+
agent_ops_cockpit/ops/arch_review.py,sha256=o8ZKYSrmtt-dw74QBROObKz-w8Z-ZwC4G_yks6vIbBM,4494
|
|
14
|
+
agent_ops_cockpit/ops/cost_optimizer.py,sha256=fisPPo1hykcDBqljs05OG8xn0MBA_HPg7X8SlNDsx0M,1454
|
|
15
|
+
agent_ops_cockpit/ops/evidence.py,sha256=LRAW57c-2R4ICiMLtc-JA1Tu5dlfO9-VBSUMc3TCLuo,1051
|
|
16
|
+
agent_ops_cockpit/ops/frameworks.py,sha256=gJdisK8JOs79BY5x0yKu75Lu8WesgDcGJgQrjL9AE7U,19054
|
|
17
|
+
agent_ops_cockpit/ops/mcp_hub.py,sha256=Km-gXPNU0ulrFOe7fg9kPvhS3enataLKN8zyOoyzF6k,3184
|
|
18
|
+
agent_ops_cockpit/ops/memory_optimizer.py,sha256=whsKhAuJkEJRa2dxfVeJC_xxwDwKjhx5tnmOmkiKgIQ,1635
|
|
19
|
+
agent_ops_cockpit/ops/orchestrator.py,sha256=WnJ7nv99Ir7lvkWq0EIOEHE2rRzgJv2E4iRi8oDQcPc,3904
|
|
20
|
+
agent_ops_cockpit/ops/pii_scrubber.py,sha256=HBRzzYv97f8VqIx2Gse9o6UVf6QWXSuop-xF-wVhuKU,1524
|
|
21
|
+
agent_ops_cockpit/ops/reliability.py,sha256=Vuh7ZShjZQkXI8CWhL67LeacwEE75JNM6HgRTGLmt7o,2003
|
|
22
|
+
agent_ops_cockpit/ops/secret_scanner.py,sha256=OKojiW8umarrp5ywS4InCTnzzky1hcdBmOfGa-uVIuE,3124
|
|
23
|
+
agent_ops_cockpit/ops/ui_auditor.py,sha256=3Cmc8i3oMQ9Wa0hSkeR0t_J8_s1c-u1_kj2PwxDGD6o,5542
|
|
24
|
+
agent_ops_cockpit/shadow/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
|
|
25
|
+
agent_ops_cockpit/shadow/router.py,sha256=HRsgrrd3sQeabi58Ub8pOaDL9c7j4WpayeT9D8zPvOo,2725
|
|
26
|
+
agentops_cockpit-0.4.0.dist-info/METADATA,sha256=nNpVEjWuXzZupMXp2i0upE_RxTlj8FvInjCvDDBu2Hs,8319
|
|
27
|
+
agentops_cockpit-0.4.0.dist-info/WHEEL,sha256=WLgqFyCfm_KASv4WHyYy0P3pM_m7J5L9k2skdKLirC8,87
|
|
28
|
+
agentops_cockpit-0.4.0.dist-info/entry_points.txt,sha256=SOGYPNtUGhMVgxLQ9dEYo7L3M_dvhWEU2eQz2zhaTkY,112
|
|
29
|
+
agentops_cockpit-0.4.0.dist-info/licenses/LICENSE,sha256=XNJEk4bvf88tBnKqHdGBGi10l9yJWv2yLWPJvvVie1c,1071
|
|
30
|
+
agentops_cockpit-0.4.0.dist-info/RECORD,,
|
|
@@ -1,8 +0,0 @@
|
|
|
1
|
-
agent_ops_cockpit/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
|
|
2
|
-
agent_ops_cockpit/cli/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
|
|
3
|
-
agent_ops_cockpit/cli/main.py,sha256=G_1oEp9xck8knpy5c5q80I1n_9JP7rTheJpd55dJ74M,7624
|
|
4
|
-
agentops_cockpit-0.2.2.dist-info/METADATA,sha256=pnjmdARu64WPpwmmEU-ZAvzZDMFfeXKQbwH3As3NyKA,7246
|
|
5
|
-
agentops_cockpit-0.2.2.dist-info/WHEEL,sha256=WLgqFyCfm_KASv4WHyYy0P3pM_m7J5L9k2skdKLirC8,87
|
|
6
|
-
agentops_cockpit-0.2.2.dist-info/entry_points.txt,sha256=SOGYPNtUGhMVgxLQ9dEYo7L3M_dvhWEU2eQz2zhaTkY,112
|
|
7
|
-
agentops_cockpit-0.2.2.dist-info/licenses/LICENSE,sha256=XNJEk4bvf88tBnKqHdGBGi10l9yJWv2yLWPJvvVie1c,1071
|
|
8
|
-
agentops_cockpit-0.2.2.dist-info/RECORD,,
|
|
File without changes
|
|
File without changes
|
|
File without changes
|