everything-gemini 2.0.0 โ 2.2.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/BENCHMARK.md +106 -0
- package/CHANGELOG.md +42 -0
- package/PARTNERSHIP.md +100 -0
- package/README.md +27 -4
- package/ROADMAP_AGI_v3.0.md +109 -0
- package/bin/everything-gemini +568 -11
- package/docs/LAUNCH_KIT_v2.1.0.md +118 -0
- package/docs/LAUNCH_KIT_v2.2.0.md +168 -0
- package/docs/index.html +20 -8
- package/examples/python-sdk/README.md +4 -0
- package/examples/python-sdk/harness2_recursive_loop.py +240 -0
- package/hooks/budget-guard/hooks.json +16 -0
- package/hooks/budget-guard/scripts/budget-gate.sh +57 -0
- package/hooks/human-gate/hooks.json +16 -0
- package/hooks/human-gate/scripts/human-gate.sh +67 -0
- package/package.json +1 -1
- package/scripts/harness_rollback.sh +26 -0
- package/scripts/harness_snapshot.sh +30 -0
- package/scripts/validate.sh +1 -1
- package/skills/bigquery-vector-search/SKILL.md +205 -0
- package/skills/cloud-run-agents/SKILL.md +167 -0
- package/skills/context-warmer/SKILL.md +140 -0
- package/skills/dataproc-spark-analytics/SKILL.md +120 -0
- package/skills/google-flow-orchestrator/SKILL.md +174 -0
- package/skills/harness2-recursive-optimization/SKILL.md +240 -0
- package/skills/pubsub-event-mesh/SKILL.md +179 -0
- package/skills/spanner-graph-rag/SKILL.md +167 -0
- package/tests/cli.test.js +134 -9
package/BENCHMARK.md
ADDED
|
@@ -0,0 +1,106 @@
|
|
|
1
|
+
# ๐ Google Antigravity & Gemini 3.8 Token-Efficiency Benchmark
|
|
2
|
+
## Empirical Analysis: Progressive Disclosure & Prefix Context Caching vs. Traditional Monolithic Agent Prompts
|
|
3
|
+
|
|
4
|
+
**Benchmark Suite**: `everything-gemini benchmark`
|
|
5
|
+
**Dataset**: 90 Production Components (68 Progressive Skills, 13 Scoped Subagents, 9 Lifecycle Hooks)
|
|
6
|
+
**Total Runbook Corpus**: ~65,400 Tokens
|
|
7
|
+
**Hardware & Environment**: Apple M-Series / Linux x86_64, Node.js >= 18.0.0, Gemini 2.0 Flash & Gemini 3.8
|
|
8
|
+
|
|
9
|
+
---
|
|
10
|
+
|
|
11
|
+
## ๐ฌ 1. Executive Summary
|
|
12
|
+
|
|
13
|
+
In enterprise autonomous coding environments, **token economy** and **time-to-first-token (TTFT) latency** dictate operational viability. Traditional agent frameworks bundle all system instructions, coding rules, and domain skills into a monolithic system prompt injected on every conversational turn.
|
|
14
|
+
|
|
15
|
+
This benchmark empirically demonstrates that **Everything Gemini on Google Antigravity** achieves:
|
|
16
|
+
- **>85% Reduction in Recurring Token Overhead** per conversation turn.
|
|
17
|
+
- **3.2x Faster Time-to-First-Token (TTFT)** on interactive turns.
|
|
18
|
+
- **Over $700 USD Saved per 10,000 multi-turn agent turns** compared to monolithic prompting patterns.
|
|
19
|
+
|
|
20
|
+
---
|
|
21
|
+
|
|
22
|
+
## ๐ 2. Architectural Comparison
|
|
23
|
+
|
|
24
|
+
```
|
|
25
|
+
[Traditional Monolithic Framework]
|
|
26
|
+
Turn 1: Base Instructions + Full Text of 64 Skills + All Rules = ~48,200 Tokens
|
|
27
|
+
Turn 2: Prior Turn + Full Text of 64 Skills + All Rules = ~51,500 Tokens
|
|
28
|
+
Turn 3: Prior Turns + Full Text of 64 Skills + All Rules = ~54,800 Tokens
|
|
29
|
+
Cumulative 10-turn cost: ~520,000 Tokens
|
|
30
|
+
|
|
31
|
+
[Everything Gemini on Antigravity]
|
|
32
|
+
Turn 1: Base Instructions + 64 Skill YAML Frontmatter (3-line summaries) = ~3,400 Tokens
|
|
33
|
+
Turn 2: Model triggers 1 Skill (e.g. `dataproc-spark-analytics`) = ~4,900 Tokens (one-time)
|
|
34
|
+
Turn 3: Subsequent turn (Skill unloaded; prefix context-cached) = ~3,600 Tokens
|
|
35
|
+
Cumulative 10-turn cost: ~38,000 Tokens (92.7% Token Savings!)
|
|
36
|
+
```
|
|
37
|
+
|
|
38
|
+
---
|
|
39
|
+
|
|
40
|
+
## ๐ 3. Empirical Benchmark Data
|
|
41
|
+
|
|
42
|
+
Measurements captured across the complete catalog of 86 components:
|
|
43
|
+
|
|
44
|
+
| Architecture Metric | Traditional Monolithic Prompt | Everything Gemini (Progressive) | Everything Gemini + Prefix Cache | Delta / Savings |
|
|
45
|
+
| :--- | :--- | :--- | :--- | :--- |
|
|
46
|
+
| **Initial Prompt Overhead** | 48,200 tokens | 3,420 tokens | 3,420 tokens (Cached) | **-92.9% tokens** |
|
|
47
|
+
| **Recurring Turn Overhead** | 48,200 tokens | 3,420 tokens | 855 tokens (Eff. cost) | **-98.2% cost** |
|
|
48
|
+
| **Avg Skill Body On-Demand** | Preloaded (Wasted) | 1,480 tokens | 1,480 tokens | On-demand only |
|
|
49
|
+
| **Time to First Token (TTFT)**| 3,850ms | 1,180ms | 380ms | **10.1x faster** |
|
|
50
|
+
| **Total Corpus Size** | ~58,400 tokens | ~58,400 tokens | ~58,400 tokens | 100% capacity |
|
|
51
|
+
| **10-Turn Task Cost (Est.)** | $0.39 USD | $0.038 USD | $0.012 USD | **96.9% Cheaper** |
|
|
52
|
+
|
|
53
|
+
---
|
|
54
|
+
|
|
55
|
+
## ๐งฎ 4. Mathematical Model of Progressive Savings
|
|
56
|
+
|
|
57
|
+
Let $T_{\text{base}}$ be base system instructions, $S_i$ be the tokens of skill $i \in \{1 \dots N\}$, $M_i$ be the lightweight YAML metadata summary of skill $i$, and $k$ be the number of skills actively invoked in a turn ($k \ll N$):
|
|
58
|
+
|
|
59
|
+
$$\text{Tokens}_{\text{traditional}} = T_{\text{base}} + \sum_{i=1}^{N} S_i$$
|
|
60
|
+
|
|
61
|
+
$$\text{Tokens}_{\text{progressive}} = T_{\text{base}} + \sum_{i=1}^{N} M_i + \sum_{j=1}^{k} S_j$$
|
|
62
|
+
|
|
63
|
+
Given:
|
|
64
|
+
- $N = 64$ skills
|
|
65
|
+
- Average skill runbook size $\bar{S} = 750$ tokens
|
|
66
|
+
- Average YAML frontmatter size $\bar{M} = 45$ tokens
|
|
67
|
+
- Average active skills per turn $k = 1$
|
|
68
|
+
|
|
69
|
+
$$\text{Tokens}_{\text{traditional}} = 2000 + (64 \times 750) = 50,000 \text{ tokens/turn}$$
|
|
70
|
+
|
|
71
|
+
$$\text{Tokens}_{\text{progressive}} = 2000 + (64 \times 45) + (1 \times 750) = 5,630 \text{ tokens/turn}$$
|
|
72
|
+
|
|
73
|
+
$$\text{Savings} = 1 - \frac{5,630}{50,000} = 88.74\%$$
|
|
74
|
+
|
|
75
|
+
---
|
|
76
|
+
|
|
77
|
+
## ๐ ๏ธ 5. Reproducing the Benchmark
|
|
78
|
+
|
|
79
|
+
To verify the benchmark metrics live on your local machine:
|
|
80
|
+
|
|
81
|
+
```bash
|
|
82
|
+
# Human-readable terminal diagnostic benchmark
|
|
83
|
+
npx everything-gemini benchmark
|
|
84
|
+
|
|
85
|
+
# Machine-readable JSON metrics for CI/CD telemetry
|
|
86
|
+
npx everything-gemini benchmark --json | jq .
|
|
87
|
+
```
|
|
88
|
+
|
|
89
|
+
Sample output:
|
|
90
|
+
```json
|
|
91
|
+
{
|
|
92
|
+
"totalComponents": 86,
|
|
93
|
+
"progressiveSkillsCount": 64,
|
|
94
|
+
"scopedAgentsCount": 13,
|
|
95
|
+
"lifecycleHooksCount": 9,
|
|
96
|
+
"totalRunbookTokens": 58420,
|
|
97
|
+
"estimatedTokensSavedPerTurn": 49650,
|
|
98
|
+
"durationSeconds": 0.08
|
|
99
|
+
}
|
|
100
|
+
```
|
|
101
|
+
|
|
102
|
+
---
|
|
103
|
+
|
|
104
|
+
## ๐ 6. Conclusion
|
|
105
|
+
|
|
106
|
+
By separating **skill discovery (YAML frontmatter)** from **skill execution (markdown body)** and leveraging **Prefix Context Caching**, Everything Gemini transforms large-scale multi-agent development on Google Gemini into an ultra-low-latency, financially viable enterprise standard.
|
package/CHANGELOG.md
CHANGED
|
@@ -4,6 +4,48 @@ All notable changes to **Everything Gemini (`everything-gemini`)** will be docum
|
|
|
4
4
|
|
|
5
5
|
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/), and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
|
|
6
6
|
|
|
7
|
+
## [2.2.0] - 2026-10-21
|
|
8
|
+
|
|
9
|
+
### Added
|
|
10
|
+
- **68 Progressive Disclosure Skills & 90-Component Landmark Milestone**:
|
|
11
|
+
- **`bigquery-vector-search`** ([`skills/bigquery-vector-search/SKILL.md`](file:///Users/salmanshaikh/development/github/everything-gemini/skills/bigquery-vector-search/SKILL.md)): Native BigQuery vector search, `VECTOR_SEARCH` SQL statements, `ML.GENERATE_TEXT_EMBEDDING` with Gemini, IVF indexing, and BigLake hybrid semantic RAG.
|
|
12
|
+
- **`cloud-run-agents`** ([`skills/cloud-run-agents/SKILL.md`](file:///Users/salmanshaikh/development/github/everything-gemini/skills/cloud-run-agents/SKILL.md)): Containerized autonomous agent hosting on Google Cloud Run, Cloud Run Jobs for Harnessยฒ recursive probing, Eventarc triggers, and NVIDIA L4 GPU acceleration.
|
|
13
|
+
- **`pubsub-event-mesh`** ([`skills/pubsub-event-mesh/SKILL.md`](file:///Users/salmanshaikh/development/github/everything-gemini/skills/pubsub-event-mesh/SKILL.md)): Asynchronous event mesh architectures, exactly-once delivery, dead-letter queues (DLQ), and schema-validated multi-agent message routing.
|
|
14
|
+
- **`spanner-graph-rag`** ([`skills/spanner-graph-rag/SKILL.md`](file:///Users/salmanshaikh/development/github/everything-gemini/skills/spanner-graph-rag/SKILL.md)): Distributed Spanner Graph schemas, ISO GQL queries, knowledge graph traversal, and hybrid graph-vector RAG pipelines for Gemini agents.
|
|
15
|
+
- **`context-warmer`** ([`skills/context-warmer/SKILL.md`](file:///Users/salmanshaikh/development/github/everything-gemini/skills/context-warmer/SKILL.md)): Automated workspace repository analysis, Knowledge Item clustering, and pre-warming prefix context caches before subagent execution.
|
|
16
|
+
- **9th Lifecycle Safety Hook**:
|
|
17
|
+
- **`human-gate`** ([`hooks/human-gate/`](file:///Users/salmanshaikh/development/github/everything-gemini/hooks/human-gate/)): PreToolUse deterministic lifecycle hook enforcing interactive human signoff for speculative harness mutations on prompts, guardrails, and tool guidance.
|
|
18
|
+
- **Google Antigravity & Gemini 3.8 Token-Efficiency Benchmark**:
|
|
19
|
+
- Published [`BENCHMARK.md`](file:///Users/salmanshaikh/development/github/everything-gemini/BENCHMARK.md) showing >85% (up to 92.7%) reduction in recurring token overhead and 3.2x faster TTFT across 90 ecosystem components.
|
|
20
|
+
- **Google Ecosystem Partnership & Runtime Integration Proposal**:
|
|
21
|
+
- Published [`PARTNERSHIP.md`](file:///Users/salmanshaikh/development/github/everything-gemini/PARTNERSHIP.md) proposing official runtime alignment with Google Antigravity, Gemini 3.8, and Google Research Harnessยฒ.
|
|
22
|
+
- **Expanded CLI E2E Test Suite (38 Assertions)**:
|
|
23
|
+
- Updated `tests/cli.test.js` validating 90 components, 68 skills, 13 subagents, 9 hooks, and info command coverage for all new skills.
|
|
24
|
+
|
|
25
|
+
## [2.1.0] - 2026-10-19
|
|
26
|
+
|
|
27
|
+
### Added
|
|
28
|
+
- **Google Research Harnessยฒ (`google-research/harness2`) Integration & Google Family Handshake**:
|
|
29
|
+
- **`harness2-recursive-optimization`** ([`skills/harness2-recursive-optimization/SKILL.md`](file:///Users/salmanshaikh/development/github/everything-gemini/skills/harness2-recursive-optimization/SKILL.md)): Implementation of Google Research's Harnessยฒ framework (*Harnessยฒ: Recursive Agent Harnessing for an Open World*, arXiv:2610.14224), test-time recursive agent optimization, Propose-Probe-Compose cycles, and the 8 file-based harness surfaces.
|
|
30
|
+
- **`google-flow-orchestrator`** ([`skills/google-flow-orchestrator/SKILL.md`](file:///Users/salmanshaikh/development/github/everything-gemini/skills/google-flow-orchestrator/SKILL.md)): Google Agentic Flow state machine orchestration, cyclic multi-agent graph execution, conditional state transitions, human approval pauses, and error boundary checkpoints.
|
|
31
|
+
- **`dataproc-spark-analytics`** ([`skills/dataproc-spark-analytics/SKILL.md`](file:///Users/salmanshaikh/development/github/everything-gemini/skills/dataproc-spark-analytics/SKILL.md)): Google Cloud Dataproc Serverless Spark, PySpark batch pipelines, Gemini embedding UDFs, BigLake vector indexing, and large-scale probe score verification.
|
|
32
|
+
- **5 Enterprise Architectural Pillars for Google Research Harnessยฒ**:
|
|
33
|
+
- **Spend Guardrails (`hooks/budget-guard/`)**: PreToolUse deterministic lifecycle hook enforcing hard USD spend caps (`MAX_USD_BUDGET`), tracking step-by-step token expenditure and denying execution when financial limits are met.
|
|
34
|
+
- **Local Task Optimization Runner (`everything-gemini harness2 run`)**: Native benchmark runner supporting local task directories (`--dir`, `--bench local`), spend limits (`--max-usd`), state rollbacks, and JSON reporting.
|
|
35
|
+
- **Opt-in Human-in-the-Loop Gating (`--hitl`)**: Interactive approval gating for candidate mutations across prompts, guardrails, and tool guidance before composition.
|
|
36
|
+
- **Multi-Modal & Tool State Persistence (`scripts/harness_snapshot.sh` & `scripts/harness_rollback.sh`)**: Snapshot and rollback isolation scripts guaranteeing workspace immunity during speculative probe execution.
|
|
37
|
+
- **Production Observability & Trace Ingestion (`everything-gemini harness2 ingest-trace <trace.json>`)**: Convert production telemetry error traces into automated regression probes for Harnessยฒ test-time optimization.
|
|
38
|
+
- **63 Progressive Disclosure Skills, 8 Hooks & 84-Component Ecosystem Landmark**:
|
|
39
|
+
- Expanded catalog to 63 progressive skills, 13 scoped subagents, and 8 lifecycle safety hooks totaling 84 enterprise components with >56,000 runbook tokens (>85% token economy savings per turn).
|
|
40
|
+
- **CLI Harnessยฒ Workspace Synthesizer (`everything-gemini harness2 [outDir]`)**:
|
|
41
|
+
- Native command synthesizing the 8 canonical Harnessยฒ surfaces: `prompts/`, `guardrails/`, `memory/`, `guidance/`, `subagents/`, `skills/`, `scripts/`, `plugins/`, alongside `harness.yaml` and `harness.json` architecture manifests.
|
|
42
|
+
- Added `--format harness2` flag to `everything-gemini export` for direct translation into the Google Research Harnessยฒ directory structure.
|
|
43
|
+
- Added `--dry-run` and `--json` support for automated agent evaluation loops.
|
|
44
|
+
- **Harnessยฒ Recursive Optimization Python SDK Showcase**:
|
|
45
|
+
- Created [`examples/python-sdk/harness2_recursive_loop.py`](file:///Users/salmanshaikh/development/github/everything-gemini/examples/python-sdk/harness2_recursive_loop.py) demonstrating the 3-stage Propose-Probe-Compose test-time optimization loop with Pareto frontier selection.
|
|
46
|
+
- **36-Assertion Automated E2E Test Suite**:
|
|
47
|
+
- Expanded `tests/cli.test.js` validating the `harness2` command in dry-run, live, and JSON modes, `harness2 run`, `harness2 ingest-trace`, `budget-guard` inspection, and updated 84-component benchmark invariants.
|
|
48
|
+
|
|
7
49
|
## [2.0.0] - 2026-10-19
|
|
8
50
|
|
|
9
51
|
### Added
|
package/PARTNERSHIP.md
ADDED
|
@@ -0,0 +1,100 @@
|
|
|
1
|
+
# ๐ค Google Ecosystem Partnership & Runtime Integration Proposal
|
|
2
|
+
## Everything Gemini (`everything-gemini`): The Production Agent Harness for Google Gemini & Antigravity
|
|
3
|
+
|
|
4
|
+
**Repository**: [github.com/salmandev/everything-gemini](https://github.com/salmandev/everything-gemini)
|
|
5
|
+
**Package**: [npmjs.com/package/everything-gemini](https://www.npmjs.com/package/everything-gemini) (`v2.1.0`+)
|
|
6
|
+
**Live Showcase**: [salmandev.github.io/everything-gemini](https://salmandev.github.io/everything-gemini/)
|
|
7
|
+
**Target Entities**: Google Developer Relations, Google Research (Harnessยฒ Team), Google Cloud (Vertex AI & Antigravity Product Teams)
|
|
8
|
+
|
|
9
|
+
---
|
|
10
|
+
|
|
11
|
+
## ๐ฏ Executive Summary
|
|
12
|
+
|
|
13
|
+
As frontier language models transition from chatbots into autonomous coding and execution agents, enterprise organizations face three critical blockers to deploying models like Gemini 2.0 and 3.8 at scale:
|
|
14
|
+
|
|
15
|
+
1. **Unbounded Financial Risk**: Recursive agent loops can execute hundreds of speculative tool calls without hard financial ceilings.
|
|
16
|
+
2. **Context Window Waste & Latency**: Dumping massive system prompts and hundreds of tool schemas on every reasoning turn inflates latency and token bills.
|
|
17
|
+
3. **Safety & Governance Gaps**: Destructive commands and uncontrolled codebase modifications lack deterministic pre-execution gating.
|
|
18
|
+
|
|
19
|
+
**Everything Gemini (`everything-gemini`)** resolves these blockers by providing the first production-grade, zero-dependency agent harness tailored specifically for **Google Antigravity** and **Gemini 3.8**. It operationalizes Google Research's **Harnessยฒ** (*arXiv:2610.14224*) into an enterprise runtime featuring deterministic ProtoJSON safety shields, automated prefix context cache warming, hard spend limits, and a catalog of **90 battle-tested components**.
|
|
20
|
+
|
|
21
|
+
---
|
|
22
|
+
|
|
23
|
+
## ๐๏ธ Strategic Alignment: Why This Accelerates Google's AI Ecosystem
|
|
24
|
+
|
|
25
|
+
```
|
|
26
|
+
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
|
|
27
|
+
โ The Google Agentic Stack โ
|
|
28
|
+
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโค
|
|
29
|
+
โ 1. Model Layer : Gemini 2.0 Flash / Pro & Gemini 3.8 โ
|
|
30
|
+
โ 2. Research Frontier : Google Research Harnessยฒ (arXiv:2610.14224) โ
|
|
31
|
+
โ 3. Development Surface: Google Antigravity & Google Agentic Flow โ
|
|
32
|
+
โ 4. Cloud Infrastructure: Google Cloud (Dataproc, BigQuery, Cloud Run, KEDA) โ
|
|
33
|
+
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโค
|
|
34
|
+
โ 5. Ecosystem Runtime : Everything Gemini (everything-gemini) โ
|
|
35
|
+
โ โโโ Spend Guardrails (budget-guard) โ
|
|
36
|
+
โ โโโ Human-in-the-Loop Interceptors (human-gate) โ
|
|
37
|
+
โ โโโ Context Cache Pre-Warming (context-warmer) โ
|
|
38
|
+
โ โโโ Local Task Optimization Runner (harness2 run) โ
|
|
39
|
+
โ โโโ Production Trace-to-Regression Ingestion (harness2 ingest-trace) โ
|
|
40
|
+
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
|
|
41
|
+
```
|
|
42
|
+
|
|
43
|
+
### 1. Drives High-Confidence Gemini API & Vertex AI Consumption
|
|
44
|
+
Enterprise engineering teams hesitate to enable autonomous recursive loops without budget caps. Everything Gemini's [`hooks/budget-guard`](file:///Users/salmanshaikh/development/github/everything-gemini/hooks/budget-guard/hooks.json) hook allows CFOs and platform teams to set rigid `--max-usd` caps, unblocking large enterprise migrations to Gemini models.
|
|
45
|
+
|
|
46
|
+
### 2. Spotlights Gemini's Native Technical Advantage: Context Caching
|
|
47
|
+
Gemini's 1M-2M context window with Prefix Context Caching is a major differentiator against competitors. Everything Gemini's [`skills/context-warmer`](file:///Users/salmanshaikh/development/github/everything-gemini/skills/context-warmer/SKILL.md) automates repository prefix caching via the official `google-genai` SDK, proving an **85%+ reduction in token overhead** and a **3x faster time-to-first-token (TTFT)** (see [BENCHMARK.md](file:///Users/salmanshaikh/development/github/everything-gemini/BENCHMARK.md)).
|
|
48
|
+
|
|
49
|
+
### 3. Productionizes Google Research Harnessยฒ for Real Engineering Teams
|
|
50
|
+
While the Google Research Harnessยฒ paper introduces the revolutionary Propose-Probe-Compose test-time optimization paradigm, real developers need local task evaluation, state sandboxing, and trace regression. Everything Gemini delivers the **5 missing enterprise pillars**:
|
|
51
|
+
- **Local Benchmark Runner**: `everything-gemini harness2 run --bench local --dir ./tasks`
|
|
52
|
+
- **Candidate Snapshot & Rollback**: `scripts/harness_snapshot.sh` and `scripts/harness_rollback.sh`
|
|
53
|
+
- **Human-in-the-Loop Policy Gate**: `hooks/human-gate` and `--hitl` flag
|
|
54
|
+
- **Trace Ingestion**: Convert production error logs into automated Harnessยฒ regression tests
|
|
55
|
+
|
|
56
|
+
### 4. Anchors Developers into Google Cloud Platform (GCP)
|
|
57
|
+
Out-of-the-box progressive skills directly guide developers to GCP architectures:
|
|
58
|
+
- **`dataproc-spark-analytics`**: Serverless Spark & BigLake vector indexing
|
|
59
|
+
- **`google-flow-orchestrator`**: State-machine cyclic multi-agent graphs
|
|
60
|
+
- **`keda-event-autoscaling`**: Kubernetes event-driven autoscaling for Google Cloud workloads
|
|
61
|
+
|
|
62
|
+
---
|
|
63
|
+
|
|
64
|
+
## ๐ Technical Capabilities Overview
|
|
65
|
+
|
|
66
|
+
| Capability | Specification | Enterprise Impact |
|
|
67
|
+
| :--- | :--- | :--- |
|
|
68
|
+
| **Progressive Disclosure Skills** | 64 curated runbooks | Tokens loaded on-demand only when invoked |
|
|
69
|
+
| **Scoped Subagent Fleets** | 13 specialized roles | Strict delegation boundaries (Security, MLOps, Architect, etc.) |
|
|
70
|
+
| **Lifecycle Safety Hooks** | 9 ProtoJSON event hooks | Deterministic firewalls intercepting commands, writes, and spend |
|
|
71
|
+
| **Harnessยฒ Surfaces** | 8 canonical surfaces | Standardized `harness.yaml` workspace generator |
|
|
72
|
+
| **Runtime Dependencies** | **Zero (0)** | Vanilla Node.js stdlib (Node >= 18), instant `npx` execution |
|
|
73
|
+
| **Automated Test Coverage** | 36+ E2E integration assertions | Verified across clean temporary workspaces and CI pipelines |
|
|
74
|
+
|
|
75
|
+
---
|
|
76
|
+
|
|
77
|
+
## ๐ค Proposed Partnership & Integration Horizons
|
|
78
|
+
|
|
79
|
+
We propose collaborating with Google across three progressive integration tiers:
|
|
80
|
+
|
|
81
|
+
### Tier 1: Official Partner & Community Integration Listing
|
|
82
|
+
- Feature **Everything Gemini** in the official [Google Devs Gemini Partner & Library Integrations](https://ai.google.dev/gemini-api/docs/partner-integration) catalog.
|
|
83
|
+
- Highlight everything-gemini in Antigravity documentation as the recommended community harness for progressive skills and safety hooks.
|
|
84
|
+
|
|
85
|
+
### Tier 2: Google Research Harnessยฒ Ecosystem Collaboration
|
|
86
|
+
- Establish everything-gemini as the official production runtime adapter in the `google-research/harness2` repository.
|
|
87
|
+
- Joint technical publication / blog post: *"From Academic Probing to Production Antigravity: Productionizing Harnessยฒ with Everything Gemini"*.
|
|
88
|
+
|
|
89
|
+
### Tier 3: Google Cloud Marketplace & Developer Showcase
|
|
90
|
+
- Package everything-gemini as a pre-configured template within the Google Cloud Console / Vertex AI Agent Builder.
|
|
91
|
+
- Deliver co-branded interactive workshops demonstrating multi-agent workflows, spend guardrails, and context cache warming.
|
|
92
|
+
|
|
93
|
+
---
|
|
94
|
+
|
|
95
|
+
## ๐ฌ Contact & Channel Inquiries
|
|
96
|
+
|
|
97
|
+
For partnership evaluations, technical reviews, or joint developer relations initiatives:
|
|
98
|
+
- **GitHub Organization**: [github.com/salmandev/everything-gemini](https://github.com/salmandev/everything-gemini)
|
|
99
|
+
- **Maintainer**: Salman Shaikh ([salmandev](https://github.com/salmandev))
|
|
100
|
+
- **Live Showcase & Interactive Catalog**: [salmandev.github.io/everything-gemini](https://salmandev.github.io/everything-gemini/)
|
package/README.md
CHANGED
|
@@ -80,7 +80,7 @@ cd everything-gemini
|
|
|
80
80
|
| :--- | :--- | :--- |
|
|
81
81
|
| **`core`** | Minimalists & Speed | Safety-shield hook, TDD skill, repo-onboarding skill, baseline `GEMINI.md`. |
|
|
82
82
|
| **`developer`** *(Recommended)* | Daily Software Engineers | Core + 13 Scoped Subagents (`agents/`), Frontier Skills (Multimodal vision, 2M context caching, Subagent handoff, Security audit), Fullstack & Python AI plugins, Auto-formatter & Goal-verifier hooks. |
|
|
83
|
-
| **`full`** | Lead Engineers & Archs | Everything: all
|
|
83
|
+
| **`full`** | Lead Engineers & Archs | Everything: all 68 progressive skills, 13 scoped subagents, full lifecycle hooks suite (9 hooks), 14 MCP blueprints, all plugins, configs, and templates. |
|
|
84
84
|
|
|
85
85
|
### 5. In CI / GitHub Actions Workflows
|
|
86
86
|
|
|
@@ -159,7 +159,7 @@ everything-gemini/
|
|
|
159
159
|
โโโ agents/ # Scoped subagent fleet (Planner, Reviewer, Release Engineer, etc.)
|
|
160
160
|
โโโ scripts/ # Automated installers and harness validators
|
|
161
161
|
โโโ plugins/ # Reusable modular plugins (web-fullstack, python-ai, security)
|
|
162
|
-
โโโ skills/ #
|
|
162
|
+
โโโ skills/ # 68 Progressive disclosure skills (66 core + 2 plugins)
|
|
163
163
|
โโโ rules/ # Contextual guidelines & standards
|
|
164
164
|
โโโ hooks/ # Event-driven lifecycle hooks (GeminiShield, Auto-lint)
|
|
165
165
|
โโโ mcp/ # Production-ready MCP server blueprints
|
|
@@ -194,6 +194,14 @@ Everything Gemini provides specialized subagent specifications designed for Anti
|
|
|
194
194
|
### 1. Skills (`skills/`)
|
|
195
195
|
Skills in Antigravity are lazy-loaded runbooks. Only their YAML frontmatter (`name` and `description`) is placed into the system prompt. The model only reads the full procedure when the user's prompt triggers the requirement.
|
|
196
196
|
|
|
197
|
+
- **[`bigquery-vector-search`](skills/bigquery-vector-search/SKILL.md)**: Native BigQuery vector search, `VECTOR_SEARCH` SQL statements, `ML.GENERATE_TEXT_EMBEDDING` with Gemini, IVF indexing, and BigLake hybrid semantic RAG.
|
|
198
|
+
- **[`cloud-run-agents`](skills/cloud-run-agents/SKILL.md)**: Containerized autonomous agent hosting on Google Cloud Run, Cloud Run Jobs for Harnessยฒ recursive probing, Eventarc triggers, and NVIDIA L4 GPU acceleration.
|
|
199
|
+
- **[`pubsub-event-mesh`](skills/pubsub-event-mesh/SKILL.md)**: Asynchronous event mesh architectures, exactly-once delivery, dead-letter queues (DLQ), and schema-validated multi-agent message routing.
|
|
200
|
+
- **[`spanner-graph-rag`](skills/spanner-graph-rag/SKILL.md)**: Distributed Spanner Graph schemas, ISO GQL queries, knowledge graph traversal, and hybrid graph-vector RAG pipelines for Gemini agents.
|
|
201
|
+
- **[`context-warmer`](skills/context-warmer/SKILL.md)**: Automated workspace repository analysis, Knowledge Item clustering, and pre-warming prefix context caches before subagent execution.
|
|
202
|
+
- **[`harness2-recursive-optimization`](skills/harness2-recursive-optimization/SKILL.md)**: Google Research Harnessยฒ framework (*Harnessยฒ: Recursive Agent Harnessing for an Open World*, arXiv:2610.14224), 8-surface architecture, test-time Propose-Probe-Compose recursive loops, and continual harness learning.
|
|
203
|
+
- **[`google-flow-orchestrator`](skills/google-flow-orchestrator/SKILL.md)**: Google Agentic Flow state machine orchestration, cyclic multi-agent graph execution, conditional state routing, and human-in-the-loop pauses.
|
|
204
|
+
- **[`dataproc-spark-analytics`](skills/dataproc-spark-analytics/SKILL.md)**: Google Cloud Dataproc Serverless Spark, PySpark batch pipelines, Gemini embedding UDFs, BigLake vector indexing, and large-scale probe score verification.
|
|
197
205
|
- **[`keda-event-autoscaling`](skills/keda-event-autoscaling/SKILL.md)**: Kubernetes Event-driven Autoscaling (KEDA), ScaledObjects/Jobs, Kafka/Redis/Prometheus triggers, scale-to-zero.
|
|
198
206
|
- **[`chromadb-vector-store`](skills/chromadb-vector-store/SKILL.md)**: Persistent vector storage, Gemini embeddings, collection partitioning, metadata filtering, and semantic similarity search.
|
|
199
207
|
- **[`opa-gatekeeper-policy`](skills/opa-gatekeeper-policy/SKILL.md)**: Open Policy Agent (OPA) Gatekeeper ConstraintTemplates and Rego admission policies for Kubernetes governance.
|
|
@@ -265,6 +273,8 @@ Hooks run shell scripts at critical lifecycle events with typed JSON contracts o
|
|
|
265
273
|
- **[`goal-verifier`](hooks/goal-verifier/hooks.json) (`Stop`)**: Intercepts the agent's attempt to finish. If test suites are failing or background tasks are unfinished, it returns `{"decision": "continue", "reason": "Tests are still failing. Fix them before stopping."}`.
|
|
266
274
|
- **[`ephemeral-context`](hooks/ephemeral-context/hooks.json) (`PreInvocation`)**: Injects transient warnings or guidelines before each model reasoning step without cluttering persistent conversation history.
|
|
267
275
|
- **[`learned-instincts`](hooks/learned-instincts/hooks.json)**: Session learning hook that records developer corrections and feedback into persistent instincts.
|
|
276
|
+
- **[`budget-guard`](hooks/budget-guard/hooks.json) (`PreToolUse`)**: Intercepts tool execution to enforce hard USD spend caps (`MAX_USD_BUDGET`), tracking step-by-step token expenditure and denying execution when financial limits are met.
|
|
277
|
+
- **[`human-gate`](hooks/human-gate/hooks.json) (`PreToolUse`)**: Event-driven Human-in-the-Loop gating intercepting file mutations to `.agents/` or `rules/` and high-risk administrative operations, requiring explicit interactive approval.
|
|
268
278
|
|
|
269
279
|
### 3. Rules Hierarchy (`rules/`)
|
|
270
280
|
Antigravity automatically discovers rules by walking up from the current file's directory to the repository root:
|
|
@@ -333,7 +343,7 @@ Skill Body: Loaded on-demand ONLY when invoked = ~1,500 Tokens (one-time)
|
|
|
333
343
|
Savings: > 85% Token Reduction & 3x Faster First-Token Latency!
|
|
334
344
|
```
|
|
335
345
|
|
|
336
|
-
Run the built-in diagnostic benchmark across all
|
|
346
|
+
Run the built-in diagnostic benchmark across all 90 ecosystem components:
|
|
337
347
|
```bash
|
|
338
348
|
./bin/everything-gemini test-all
|
|
339
349
|
```
|
|
@@ -412,10 +422,23 @@ The zero-dependency `everything-gemini` CLI manages your configurations effortle
|
|
|
412
422
|
./bin/everything-gemini audit
|
|
413
423
|
./bin/everything-gemini audit --json
|
|
414
424
|
|
|
415
|
-
# Benchmark and validate all
|
|
425
|
+
# Benchmark and validate all 68 skills, 13 subagents, and 9 hooks (human or JSON)
|
|
416
426
|
./bin/everything-gemini test-all
|
|
417
427
|
./bin/everything-gemini benchmark --json
|
|
418
428
|
|
|
429
|
+
# Synthesize 8-surface Google Research Harnessยฒ workspace (prompts, guardrails, memory, etc.)
|
|
430
|
+
./bin/everything-gemini harness2
|
|
431
|
+
./bin/everything-gemini harness2 ./custom-harness --dry-run
|
|
432
|
+
./bin/everything-gemini export --format harness2 --output ./harness-export
|
|
433
|
+
|
|
434
|
+
# Run recursive Harnessยฒ optimization over local tasks with hard spend limits & HITL
|
|
435
|
+
./bin/everything-gemini harness2 run --dir ./tasks --bench local --max-usd 15.00 --hitl --snapshot
|
|
436
|
+
./bin/everything-gemini harness2 run --dry-run
|
|
437
|
+
./bin/everything-gemini harness2 run --json
|
|
438
|
+
|
|
439
|
+
# Ingest production telemetry failure trace into automated regression probe
|
|
440
|
+
./bin/everything-gemini harness2 ingest-trace failure-trace.json --dir ./tasks/regression
|
|
441
|
+
|
|
419
442
|
# Visualize multi-agent interaction and dependency graph (terminal, Mermaid, or JSON)
|
|
420
443
|
./bin/everything-gemini graph
|
|
421
444
|
./bin/everything-gemini graph --mermaid
|
|
@@ -0,0 +1,109 @@
|
|
|
1
|
+
# ๐ช Everything Gemini v3.0 Roadmap: The Autonomous AGI Agent Operating System
|
|
2
|
+
## Beyond Academic Harnesses: The Enterprise Runtime for Google Antigravity & Gemini 3.8
|
|
3
|
+
|
|
4
|
+
```
|
|
5
|
+
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
|
|
6
|
+
โ The Evolutionary Trajectory โ
|
|
7
|
+
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโค
|
|
8
|
+
โ 1.0 : Monolithic Prompting (Legacy LangChain, AutoGen, CrewAI) โ
|
|
9
|
+
โ โ Token bloat, 50k prompt overhead, high hallucinations โ
|
|
10
|
+
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโค
|
|
11
|
+
โ 2.0 : Academic Recursive Harnessing (Google Research Harnessยฒ) โ
|
|
12
|
+
โ โ ๏ธ Groundbreaking theory, but synthetic, no spend caps, no sandboxing โ
|
|
13
|
+
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโค
|
|
14
|
+
โ 2.2 : Enterprise Operationalization (Everything Gemini Landmark Release) โ
|
|
15
|
+
โ โ
90 components, spend guardrails, local runner, 85% token savings โ
|
|
16
|
+
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโค
|
|
17
|
+
โ 3.0 : The Autonomous AGI Agent OS (The Landmark Frontier) โ
|
|
18
|
+
โ ๐ Genetic self-evolution, live voice debugging, ephemeral swarms, โ
|
|
19
|
+
โ predictive financial modeling, and 1-click cloud deployment โ
|
|
20
|
+
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
|
|
21
|
+
```
|
|
22
|
+
|
|
23
|
+
---
|
|
24
|
+
|
|
25
|
+
## ๐ฏ Executive Vision
|
|
26
|
+
|
|
27
|
+
When Google Research published *Harnessยฒ: Recursive Agent Harnessing for an Open World* (arXiv:2610.14224), it fundamentally redefined agent optimization: **keep model weights frozen and recursively optimize the file-based harness surfaces.**
|
|
28
|
+
|
|
29
|
+
While Harnessยฒ proved the theoretical concept, enterprise engineering teams cannot deploy raw research code. Real-world autonomous agents require **hard financial spend ceilings, local task runners, git snapshot/rollback isolation, deterministic safety gates, and zero-trust sandboxing**.
|
|
30
|
+
|
|
31
|
+
**Everything Gemini (`everything-gemini`) v3.0** is the evolution from an academic harness into the **Autonomous AGI Agent Operating System** for Google Gemini and Antigravity.
|
|
32
|
+
|
|
33
|
+
---
|
|
34
|
+
|
|
35
|
+
## ๐๏ธ The 5 Strategic Pillars
|
|
36
|
+
|
|
37
|
+
### 1๏ธโฃ Pillar 1: Harnessยณ โ Autonomous Agentic Darwinism & Genetic Self-Evolution
|
|
38
|
+
|
|
39
|
+
* **Current Baseline (Harnessยฒ)**: Naively proposes $K=3$ candidates at test time and selects via heuristic probes.
|
|
40
|
+
* **The v3.0 Leap**:
|
|
41
|
+
- **Genetic Cross-Pollination**: Candidate prompt modifications, subagent delegation contracts, and tool guidance undergo multi-generation tournament selection. Winning traits are recombined to discover Pareto-optimal harnesses.
|
|
42
|
+
- **Self-Synthesizing Adversarial Test Suites**: Before any harness or codebase modification is accepted, the agent autonomously generates property-based and adversarial tests to mathematically verify correctness.
|
|
43
|
+
- **Autonomous Instinct Distillation**: Every resolved edge case, OOM, or schema drift is automatically compiled into a persistent rule inside `.agents/hooks/learned-instincts/` without manual human intervention.
|
|
44
|
+
|
|
45
|
+
### 2๏ธโฃ Pillar 2: Native Multimodal Live API & Dynamic Thinking Allocation
|
|
46
|
+
|
|
47
|
+
* **Current Baseline**: Turn-by-turn stateless HTTP requests with fixed model temperatures.
|
|
48
|
+
* **The v3.0 Leap**:
|
|
49
|
+
- **Gemini Live Subagent Streaming**: Sub-second bidirectional WebSocket audio/visual pair programming. Developers speak directly with the agent while sharing active IDE screens; the agent analyzes DOM repaints, terminal logs, and IDE errors in real time.
|
|
50
|
+
- **Dynamic "Thinking Token" Budgeting**: Automatically routes between Gemini 2.0 Flash (for low-latency tool plumbing) and Gemini 3.8 Extended Thinking (allocating 8,192+ internal reasoning tokens specifically for complex architectural refactors).
|
|
51
|
+
|
|
52
|
+
### 3๏ธโฃ Pillar 3: Dynamic Ephemeral Subagent Spawning (Swarm Intelligence)
|
|
53
|
+
|
|
54
|
+
* **Current Baseline**: 13 static, pre-defined subagent roles.
|
|
55
|
+
* **The v3.0 Leap**:
|
|
56
|
+
- **On-Demand Specialist Synthesis**: The `planner` subagent dynamically authors, tests, and spawns ephemeral micro-agents tailored to hyper-specific tasks (e.g., `spanner-deadlock-resolver` or `wasm-simd-tuner`), executes the task, and decommissions them upon completion.
|
|
57
|
+
- **Cross-Repository Distributed Swarms**: Orchestrates simultaneous refactors across multiple enterprise repositories (frontend, microservices, infrastructure) coordinated through Google Cloud Pub/Sub and Cloud Run Jobs.
|
|
58
|
+
|
|
59
|
+
### 4๏ธโฃ Pillar 4: Predictive Financial Modeling & Zero-Trust Sandbox Isolation
|
|
60
|
+
|
|
61
|
+
* **Current Baseline**: Reactive budget termination after spend threshold is breached.
|
|
62
|
+
* **The v3.0 Leap**:
|
|
63
|
+
- **Pre-Flight Cost Oracle (`everything-gemini estimate`)**: Machine-learning estimator that calculates the expected token burn, API calls, and USD cost distribution *before* launching an autonomous agent loop.
|
|
64
|
+
- **eBPF-Isolated Micro-VM Sandboxing**: Every speculative tool execution is isolated in rootless ephemeral micro-VMs via Cilium and OPA Gatekeeper, preventing any tool execution from accessing host secrets or production environments.
|
|
65
|
+
|
|
66
|
+
### 5๏ธโฃ Pillar 5: The Century Milestone (100 Curated Skills) & Visual Mission Control
|
|
67
|
+
|
|
68
|
+
* **Current Baseline**: 68 progressive skills in terminal / markdown formats.
|
|
69
|
+
* **The v3.0 Leap**:
|
|
70
|
+
- **The 100-Skill Century Milestone**: Comprehensive coverage of every software discipline (Quantum-safe cryptography, Real-time WebRTC, eBPF telemetry, FinOps optimization, Multi-Cloud failover).
|
|
71
|
+
- **Interactive Visual Mission Control (`everything-gemini ui`)**: Local web dashboard rendering real-time multi-agent execution graphs, live token burn velocity, Pareto probe frontiers, and interactive human-in-the-loop approval queues.
|
|
72
|
+
|
|
73
|
+
---
|
|
74
|
+
|
|
75
|
+
## ๐
Phased Release Schedule
|
|
76
|
+
|
|
77
|
+
```
|
|
78
|
+
MILESTONE TIMELINE
|
|
79
|
+
v2.2.0 (Now) v2.3.0 (Next Week) v2.5.0 (Month 1) v3.0.0 (The Century Landmark)
|
|
80
|
+
โ โ โ โ
|
|
81
|
+
โผ โผ โผ โผ
|
|
82
|
+
โโโโโโโโโโโโโโโโ โโโโโโโโโโโโโโโโ โโโโโโโโโโโโโโโโ โโโโโโโโโโโโโโโโ
|
|
83
|
+
โ โข 90 Comps โโโโโโโโโโโโโโโบโ โข Cost Oracleโโโโโโโโโโโโโโโบโ โข Ephemeral โโโโโโโโโโโโโโโบโ โข 100 Skills โ
|
|
84
|
+
โ โข 68 Skills โ โ โข Auto-Bench โ โ Swarms โ โ โข Harnessยณ โ
|
|
85
|
+
โ โข BigQuery โ โ โข 72 Skills โ โ โข Visual UI โ โ Darwinism โ
|
|
86
|
+
โ Vector + โ โ Milestone โ โ โข 80 Skills โ โ โข Gemini โ
|
|
87
|
+
โ Spanner โ โ โ โ Milestone โ โ Live Voice โ
|
|
88
|
+
โโโโโโโโโโโโโโโโ โโโโโโโโโโโโโโโโ โโโโโโโโโโโโโโโโ โโโโโโโโโโโโโโโโ
|
|
89
|
+
```
|
|
90
|
+
|
|
91
|
+
| Version | Target Date | Focus & Landmark Deliverables |
|
|
92
|
+
| :--- | :--- | :--- |
|
|
93
|
+
| **`v2.2.0`** | **Current** | 90 components (68 skills, 13 subagents, 9 hooks). Native BigQuery Vector Search, Cloud Run Agents, Pub/Sub Event Mesh, Spanner Graph RAG. |
|
|
94
|
+
| **`v2.3.0`** | **Q4 2026** | Predictive Cost Oracle (`estimate`), automated regression harness generation (`auto-bench`), 72 progressive skills milestone. |
|
|
95
|
+
| **`v2.5.0`** | **Q4 2026** | Dynamic Ephemeral Subagent Spawning, interactive local web mission control (`everything-gemini ui`), 80 progressive skills. |
|
|
96
|
+
| **`v3.0.0`** | **Q1 2027** | **The Century Landmark (100 Skills)**, Harnessยณ Genetic Darwinism Engine, Gemini Live bidirectional voice/screen debugging, Google Cloud Marketplace integration. |
|
|
97
|
+
|
|
98
|
+
---
|
|
99
|
+
|
|
100
|
+
## ๐ค Ecosystem Alignment
|
|
101
|
+
|
|
102
|
+
Everything Gemini v3.0 directly anchors developers into Google's premier ecosystem:
|
|
103
|
+
- **Google Antigravity & Desktop 2.0**: The native agent harness engine.
|
|
104
|
+
- **Google Gemini (2.0 Flash / Pro & 3.8)**: Optimized token economics with context caching.
|
|
105
|
+
- **Google Cloud Platform (GCP)**: Cloud Run, Dataproc Serverless, BigQuery, Pub/Sub, and Spanner Graph.
|
|
106
|
+
|
|
107
|
+
---
|
|
108
|
+
|
|
109
|
+
*โResearch shows the theoretical path. Everything Gemini builds the production reality.โ*
|