projecta-rrr 1.21.7 → 1.21.9

package/CHANGELOG.md

@@ -4,6 +4,110 @@ All notable changes to RRR will be documented in this file.
 
 Format follows [Keep a Changelog](https://keepachangelog.com/en/1.1.0/).
 
+## [1.21.9] - 2026-04-18
+
+**Token-efficient RRR: semantic_search injection wave 1 + hosted worker hardening.**
+
+After indexing 59 repos across the team, audit revealed RRR commands/agents were
+doing Read/Grep/Glob chains when semantic_search could return ranked chunks at
+5-20x lower token cost. Wave 1 ships the highest-ROI injections. Also bundles
+four hosted-worker patches discovered during batch indexing.
+
+### Added
+
+- **semantic_search in 4 high-burn agents.** `rrr-codebase-mapper`,
+  `rrr-phase-researcher`, `rrr-executor`, `rrr-debugger` now have
+  `mcp__rrr-search-hosted__semantic_search` + `mcp__rrr-search__semantic_search`
+  in their tool frontmatter. These five agents carried the bulk of RRR's
+  code-exploration token cost (15-60K tokens per run each); semantic_search
+  replaces most of that with ~500-token ranked chunks.
+
+- **semantic_search reference in 4 high-leverage commands.**
+  `/rrr:map-codebase`, `/rrr:research-phase`, `/rrr:brownfield-audit`,
+  `/rrr:debug` now `@rrr/references/semantic-search-preference.md` in their
+  execution_context. Previously only 5 commands had the reference
+  (`progress`, `plan-phase`, `execute-phase`, `discuss-phase`, `verify-work`).
+
+- **Full audit at `/tmp/rrr-token-audit.md`** (one-shot; not committed).
+  Identifies 10 remaining HIGH/MED-priority injection points for waves 2-3.
+
+### Changed
+
+- **Hosted worker default budget: 5M → 100M tokens per repo / 30d.**
+  (`rrr/hosted-mcp/src/worker/lib/token-budget.js:22`.) Real-world repos
+  like `superintelligence` (9M tokens) and `Internjobs` (25M tokens) were
+  tripping the 5M cap. 100M fits all observed repos with headroom; remains
+  overridable per repo via `.rrr-search.json` `budget_tokens`.
+
+- **Voyage batch cap: 100K → 80K tokens; estimator 3.5 → 2.8 chars/token.**
+  (`rrr/hosted-mcp/src/worker/lib/voyage-embedder.js:96-97`.) The old
+  char-based estimator undercounted — batches passing the 100K cap were
+  arriving at Voyage at 124-130K tokens and hitting the 120K hard limit
+  on repos like `OpenHands` and `gooseworks-skills`. Tighter cap + matched
+  estimator resolves this.
+
+- **`index_repo` owner/repo regex allows dots.**
+  (`rrr/hosted-mcp/src/mcp/tools/index-repo.js:101`.) The previous
+  `([^/.]+?)` would fail to parse repos like `PA-Ai-Team/MALA.dev.git`,
+  silently falling back to `slug/slug` — causing a 404 on clone. New
+  pattern `(.+?)(?:\.git)?$` handles dots in repo names correctly.
+
+### Fixed
+
+- **Git clone fallback for non-`main` default branches.**
+  (`rrr/hosted-mcp/src/worker/lib/github-clone.js:158-178`.) Repos whose
+  default branch is `master` (or anything non-`main`) were failing clone
+  with `fatal: Remote branch main not found in upstream origin`. Added
+  a catch-and-retry: on branch-not-found, re-clone without `--branch`
+  flag (git uses the remote's default branch automatically).
+
+
+
+**End-to-end verified on a second repo. Multiple worker bootstrap fixes.**
+
+Dogfood adoption of `PA-Ai-Team/aeo-free-aduit` surfaced and fixed a
+multi-step first-time-index bootstrap bug in the worker. Result:
+155 chunks ingested in 17 seconds, HNSW index built, `semantic_search`
+live. Verifies the full onboarding path works for any new repo.
+
+### Fixed
+
+- **Worker now bootstraps first-time repos.** Before: worker's
+  `recordJobStart` tried to INSERT into `ingestion_jobs` using a
+  `pending:{slug}` placeholder repo_id that didn't exist in `repos`,
+  hitting the FK constraint. Fix: added a bootstrap step at top of the
+  processor that detects `pending:` prefix and — BEFORE any DB write —
+  clones, computes real root_sha, upserts the `repos` row, and rewrites
+  local `repoId` to the real value. All downstream DB operations then
+  satisfy FK + RLS + NOT NULL constraints.
+
+- **Owner/repo parsed from gitUrl.** Tool was setting
+  `owner = slug = repo = <slug>` which broke GH App token mint. Now
+  parses `github.com/{owner}/{repo}(.git)?` via regex and passes correct
+  owner + repo to `cloneRepo`.
+
+- **GH App auth path preferred when installation_id present.** When
+  `installation_id` is supplied, tool now passes `gitUrl: null` so
+  `cloneRepo` takes the token-mint branch (private-repo-safe). When
+  installation_id is absent, passes `gitUrl` through for the public-repo
+  direct-URL branch. Worker bootstrap mirrors the same conditional.
+
+- **`repos.git_url` NOT NULL respected.** When bootstrap forced
+  `gitUrl = null` for the clone (GH App path), it no longer tried to
+  pass null into `repos.git_url`. Reconstructs
+  `https://github.com/{owner}/{repo}.git` from parsed owner/repo.
+
+### Dogfood timing reference
+
+| Stage | aeo-free-aduit (155 chunks) | projecta-rrr (10,047 chunks) |
+|-------|----------------------------|------------------------------|
+| Clone | 0.8s | 4.6s |
+| Chunk | 0.3s | 2.3s |
+| Embed | 13s (2 batches) | 4 min (115 batches) |
+| COPY + HNSW | 0.8s | 10s |
+| **Total** | **17s** | **~5 min** |
+| Voyage cost | ~$0.028 | ~$1.70 |
+
 ## [1.21.7] - 2026-04-18
 
 ### Fixed

package/agents/rrr-codebase-mapper.md

@@ -2,7 +2,7 @@
 name: rrr-codebase-mapper
 description: Explores codebase and writes structured analysis documents. Spawned by map-codebase with a focus area (tech, arch, quality, concerns). Writes documents directly to reduce orchestrator context load.
 model: sonnet
-tools: Read, Bash, Grep, Glob, Write
+tools: Read, Bash, Grep, Glob, Write, mcp__rrr-search-hosted__semantic_search, mcp__rrr-search__semantic_search
 color: cyan
 ---
 

package/agents/rrr-debugger.md

@@ -2,7 +2,7 @@
 name: rrr-debugger
 description: Investigates bugs using scientific method, manages debug sessions, handles checkpoints. Spawned by /rrr:debug orchestrator.
 model: inherit
-tools: Read, Write, Edit, Bash, Grep, Glob, WebSearch
+tools: Read, Write, Edit, Bash, Grep, Glob, WebSearch, mcp__rrr-search-hosted__semantic_search, mcp__rrr-search__semantic_search
 color: orange
 ---
 

package/agents/rrr-executor.md

@@ -2,7 +2,7 @@
 name: rrr-executor
 description: Executes RRR plans with atomic commits, deviation handling, checkpoint protocols, and state management. Spawned by execute-phase orchestrator or execute-plan command.
 model: inherit
-tools: Read, Write, Edit, Bash, Grep, Glob
+tools: Read, Write, Edit, Bash, Grep, Glob, mcp__rrr-search-hosted__semantic_search, mcp__rrr-search__semantic_search
 color: yellow
 ---
 

package/agents/rrr-phase-researcher.md

@@ -2,7 +2,7 @@
 name: rrr-phase-researcher
 description: Researches how to implement a phase before planning. Produces RESEARCH.md consumed by rrr-planner. Spawned by /rrr:plan-phase orchestrator.
 model: sonnet
-tools: Read, Write, Bash, Grep, Glob, WebSearch, WebFetch, mcp__context7__*
+tools: Read, Write, Bash, Grep, Glob, WebSearch, WebFetch, mcp__context7__*, mcp__rrr-search-hosted__semantic_search, mcp__rrr-search__semantic_search
 color: cyan
 ---
 

package/commands/rrr/brownfield-audit.md

@@ -37,6 +37,7 @@ Audit brownfield repositories to detect scattered planning documents, classify t
 @~/.claude/rrr/references/principles.md
 @~/.claude/rrr/references/scan-exclusions.md
 @~/.claude/rrr/lib/phase-paths.md
+@rrr/references/semantic-search-preference.md
 </execution_context>
 
 <scan_ignored_paths>

package/commands/rrr/debug.md

@@ -9,6 +9,10 @@ allowed-tools:
   - AskUserQuestion
 ---
 
+<execution_context>
+@rrr/references/semantic-search-preference.md
+</execution_context>
+
 <objective>
 Debug issues using scientific method with subagent isolation.
 

package/commands/rrr/map-codebase.md

@@ -21,6 +21,7 @@ Output: .planning/codebase/ folder with 7 structured documents about the codebas
 
 <execution_context>
 @~/.claude/rrr/workflows/map-codebase.md
+@rrr/references/semantic-search-preference.md
 </execution_context>
 
 <context>

package/commands/rrr/research-phase.md

@@ -8,6 +8,10 @@ allowed-tools:
   - Task
 ---
 
+<execution_context>
+@rrr/references/semantic-search-preference.md
+</execution_context>
+
 <objective>
 Research how to implement a phase. Spawns rrr-phase-researcher agent with phase context.
 

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "projecta-rrr",
-  "version": "1.21.7",
+  "version": "1.21.9",
   "description": "A meta-prompting, context engineering and spec-driven development system for Claude Code by Projecta.ai",
   "bin": {
     "projecta-rrr": "bin/install.js",