everything-gemini 2.0.0 → 2.1.0

package/CHANGELOG.md

@@ -4,6 +4,30 @@ All notable changes to **Everything Gemini (`everything-gemini`)** will be docum
 
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/), and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+## [2.1.0] - 2026-10-19
+
+### Added
+- **Google Research Harness² (`google-research/harness2`) Integration & Google Family Handshake**:
+  - **`harness2-recursive-optimization`** ([`skills/harness2-recursive-optimization/SKILL.md`](file:///Users/salmanshaikh/development/github/everything-gemini/skills/harness2-recursive-optimization/SKILL.md)): Implementation of Google Research's Harness² framework (*Harness²: Recursive Agent Harnessing for an Open World*, arXiv:2610.14224), test-time recursive agent optimization, Propose-Probe-Compose cycles, and the 8 file-based harness surfaces.
+  - **`google-flow-orchestrator`** ([`skills/google-flow-orchestrator/SKILL.md`](file:///Users/salmanshaikh/development/github/everything-gemini/skills/google-flow-orchestrator/SKILL.md)): Google Agentic Flow state machine orchestration, cyclic multi-agent graph execution, conditional state transitions, human approval pauses, and error boundary checkpoints.
+  - **`dataproc-spark-analytics`** ([`skills/dataproc-spark-analytics/SKILL.md`](file:///Users/salmanshaikh/development/github/everything-gemini/skills/dataproc-spark-analytics/SKILL.md)): Google Cloud Dataproc Serverless Spark, PySpark batch pipelines, Gemini embedding UDFs, BigLake vector indexing, and large-scale probe score verification.
+- **5 Enterprise Architectural Pillars for Google Research Harness²**:
+  - **Spend Guardrails (`hooks/budget-guard/`)**: PreToolUse deterministic lifecycle hook enforcing hard USD spend caps (`MAX_USD_BUDGET`), tracking step-by-step token expenditure and denying execution when financial limits are met.
+  - **Local Task Optimization Runner (`everything-gemini harness2 run`)**: Native benchmark runner supporting local task directories (`--dir`, `--bench local`), spend limits (`--max-usd`), state rollbacks, and JSON reporting.
+  - **Opt-in Human-in-the-Loop Gating (`--hitl`)**: Interactive approval gating for candidate mutations across prompts, guardrails, and tool guidance before composition.
+  - **Multi-Modal & Tool State Persistence (`scripts/harness_snapshot.sh` & `scripts/harness_rollback.sh`)**: Snapshot and rollback isolation scripts guaranteeing workspace immunity during speculative probe execution.
+  - **Production Observability & Trace Ingestion (`everything-gemini harness2 ingest-trace <trace.json>`)**: Convert production telemetry error traces into automated regression probes for Harness² test-time optimization.
+- **63 Progressive Disclosure Skills, 8 Hooks & 84-Component Ecosystem Landmark**:
+  - Expanded catalog to 63 progressive skills, 13 scoped subagents, and 8 lifecycle safety hooks totaling 84 enterprise components with >56,000 runbook tokens (>85% token economy savings per turn).
+- **CLI Harness² Workspace Synthesizer (`everything-gemini harness2 [outDir]`)**:
+  - Native command synthesizing the 8 canonical Harness² surfaces: `prompts/`, `guardrails/`, `memory/`, `guidance/`, `subagents/`, `skills/`, `scripts/`, `plugins/`, alongside `harness.yaml` and `harness.json` architecture manifests.
+  - Added `--format harness2` flag to `everything-gemini export` for direct translation into the Google Research Harness² directory structure.
+  - Added `--dry-run` and `--json` support for automated agent evaluation loops.
+- **Harness² Recursive Optimization Python SDK Showcase**:
+  - Created [`examples/python-sdk/harness2_recursive_loop.py`](file:///Users/salmanshaikh/development/github/everything-gemini/examples/python-sdk/harness2_recursive_loop.py) demonstrating the 3-stage Propose-Probe-Compose test-time optimization loop with Pareto frontier selection.
+- **36-Assertion Automated E2E Test Suite**:
+  - Expanded `tests/cli.test.js` validating the `harness2` command in dry-run, live, and JSON modes, `harness2 run`, `harness2 ingest-trace`, `budget-guard` inspection, and updated 84-component benchmark invariants.
+
 ## [2.0.0] - 2026-10-19
 
 ### Added

package/README.md

@@ -80,7 +80,7 @@ cd everything-gemini
 | :--- | :--- | :--- |
 | **`core`** | Minimalists & Speed | Safety-shield hook, TDD skill, repo-onboarding skill, baseline `GEMINI.md`. |
 | **`developer`** *(Recommended)* | Daily Software Engineers | Core + 13 Scoped Subagents (`agents/`), Frontier Skills (Multimodal vision, 2M context caching, Subagent handoff, Security audit), Fullstack & Python AI plugins, Auto-formatter & Goal-verifier hooks. |
-| **`full`** | Lead Engineers & Archs | Everything: all 60 progressive skills, 13 scoped subagents, full lifecycle hooks suite (7 hooks), 14 MCP blueprints, all plugins, configs, and templates. |
+| **`full`** | Lead Engineers & Archs | Everything: all 63 progressive skills, 13 scoped subagents, full lifecycle hooks suite (8 hooks), 14 MCP blueprints, all plugins, configs, and templates. |
 
 ### 5. In CI / GitHub Actions Workflows
 
@@ -159,7 +159,7 @@ everything-gemini/
 ├── agents/                       # Scoped subagent fleet (Planner, Reviewer, Release Engineer, etc.)
 ├── scripts/                      # Automated installers and harness validators
 ├── plugins/                      # Reusable modular plugins (web-fullstack, python-ai, security)
-├── skills/                       # 60 Progressive disclosure skills (58 core + 2 plugins)
+├── skills/                       # 63 Progressive disclosure skills (61 core + 2 plugins)
 ├── rules/                        # Contextual guidelines & standards
 ├── hooks/                        # Event-driven lifecycle hooks (GeminiShield, Auto-lint)
 ├── mcp/                          # Production-ready MCP server blueprints
@@ -194,6 +194,9 @@ Everything Gemini provides specialized subagent specifications designed for Anti
 ### 1. Skills (`skills/`)
 Skills in Antigravity are lazy-loaded runbooks. Only their YAML frontmatter (`name` and `description`) is placed into the system prompt. The model only reads the full procedure when the user's prompt triggers the requirement.
 
+- **[`harness2-recursive-optimization`](skills/harness2-recursive-optimization/SKILL.md)**: Google Research Harness² framework (*Harness²: Recursive Agent Harnessing for an Open World*, arXiv:2610.14224), 8-surface architecture, test-time Propose-Probe-Compose recursive loops, and continual harness learning.
+- **[`google-flow-orchestrator`](skills/google-flow-orchestrator/SKILL.md)**: Google Agentic Flow state machine orchestration, cyclic multi-agent graph execution, conditional state routing, and human-in-the-loop pauses.
+- **[`dataproc-spark-analytics`](skills/dataproc-spark-analytics/SKILL.md)**: Google Cloud Dataproc Serverless Spark, PySpark batch pipelines, Gemini embedding UDFs, BigLake vector indexing, and large-scale probe score verification.
 - **[`keda-event-autoscaling`](skills/keda-event-autoscaling/SKILL.md)**: Kubernetes Event-driven Autoscaling (KEDA), ScaledObjects/Jobs, Kafka/Redis/Prometheus triggers, scale-to-zero.
 - **[`chromadb-vector-store`](skills/chromadb-vector-store/SKILL.md)**: Persistent vector storage, Gemini embeddings, collection partitioning, metadata filtering, and semantic similarity search.
 - **[`opa-gatekeeper-policy`](skills/opa-gatekeeper-policy/SKILL.md)**: Open Policy Agent (OPA) Gatekeeper ConstraintTemplates and Rego admission policies for Kubernetes governance.
@@ -265,6 +268,7 @@ Hooks run shell scripts at critical lifecycle events with typed JSON contracts o
 - **[`goal-verifier`](hooks/goal-verifier/hooks.json) (`Stop`)**: Intercepts the agent's attempt to finish. If test suites are failing or background tasks are unfinished, it returns `{"decision": "continue", "reason": "Tests are still failing. Fix them before stopping."}`.
 - **[`ephemeral-context`](hooks/ephemeral-context/hooks.json) (`PreInvocation`)**: Injects transient warnings or guidelines before each model reasoning step without cluttering persistent conversation history.
 - **[`learned-instincts`](hooks/learned-instincts/hooks.json)**: Session learning hook that records developer corrections and feedback into persistent instincts.
+- **[`budget-guard`](hooks/budget-guard/hooks.json) (`PreToolUse`)**: Intercepts tool execution to enforce hard USD spend caps (`MAX_USD_BUDGET`), tracking step-by-step token expenditure and denying execution when financial limits are met.
 
 ### 3. Rules Hierarchy (`rules/`)
 Antigravity automatically discovers rules by walking up from the current file's directory to the repository root:
@@ -333,7 +337,7 @@ Skill Body: Loaded on-demand ONLY when invoked = ~1,500 Tokens (one-time)
 Savings: > 85% Token Reduction & 3x Faster First-Token Latency!
 ```
 
-Run the built-in diagnostic benchmark across all 70 ecosystem components:
+Run the built-in diagnostic benchmark across all 84 ecosystem components:
 ```bash
 ./bin/everything-gemini test-all
 ```
@@ -412,10 +416,23 @@ The zero-dependency `everything-gemini` CLI manages your configurations effortle
 ./bin/everything-gemini audit
 ./bin/everything-gemini audit --json
 
-# Benchmark and validate all 60 skills, 13 subagents, and 7 hooks (human or JSON)
+# Benchmark and validate all 63 skills, 13 subagents, and 8 hooks (human or JSON)
 ./bin/everything-gemini test-all
 ./bin/everything-gemini benchmark --json
 
+# Synthesize 8-surface Google Research Harness² workspace (prompts, guardrails, memory, etc.)
+./bin/everything-gemini harness2
+./bin/everything-gemini harness2 ./custom-harness --dry-run
+./bin/everything-gemini export --format harness2 --output ./harness-export
+
+# Run recursive Harness² optimization over local tasks with hard spend limits & HITL
+./bin/everything-gemini harness2 run --dir ./tasks --bench local --max-usd 15.00 --hitl --snapshot
+./bin/everything-gemini harness2 run --dry-run
+./bin/everything-gemini harness2 run --json
+
+# Ingest production telemetry failure trace into automated regression probe
+./bin/everything-gemini harness2 ingest-trace failure-trace.json --dir ./tasks/regression
+
 # Visualize multi-agent interaction and dependency graph (terminal, Mermaid, or JSON)
 ./bin/everything-gemini graph
 ./bin/everything-gemini graph --mermaid