ultimate-pi 0.1.2 → 0.1.3
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.agents/skills/ck-search/SKILL.md +99 -0
- package/.agents/skills/defuddle/SKILL.md +90 -0
- package/.agents/skills/find-skills/SKILL.md +142 -0
- package/.agents/skills/firecrawl/SKILL.md +150 -0
- package/.agents/skills/firecrawl/rules/install.md +82 -0
- package/.agents/skills/firecrawl/rules/security.md +26 -0
- package/.agents/skills/firecrawl-agent/SKILL.md +57 -0
- package/.agents/skills/firecrawl-build-interact/SKILL.md +67 -0
- package/.agents/skills/firecrawl-build-onboarding/SKILL.md +102 -0
- package/.agents/skills/firecrawl-build-onboarding/references/auth-flow.md +39 -0
- package/.agents/skills/firecrawl-build-onboarding/references/project-setup.md +20 -0
- package/.agents/skills/firecrawl-build-onboarding/references/sdk-installation.md +17 -0
- package/.agents/skills/firecrawl-build-scrape/SKILL.md +68 -0
- package/.agents/skills/firecrawl-build-search/SKILL.md +68 -0
- package/.agents/skills/firecrawl-crawl/SKILL.md +58 -0
- package/.agents/skills/firecrawl-download/SKILL.md +69 -0
- package/.agents/skills/firecrawl-interact/SKILL.md +83 -0
- package/.agents/skills/firecrawl-map/SKILL.md +50 -0
- package/.agents/skills/firecrawl-parse/SKILL.md +61 -0
- package/.agents/skills/firecrawl-scrape/SKILL.md +68 -0
- package/.agents/skills/firecrawl-search/SKILL.md +59 -0
- package/.agents/skills/obsidian-bases/SKILL.md +299 -0
- package/.agents/skills/obsidian-markdown/SKILL.md +237 -0
- package/.agents/skills/posthog-analyst/SKILL.md +306 -0
- package/.agents/skills/posthog-analyst/evals/evals.json +23 -0
- package/.agents/skills/wiki/SKILL.md +215 -0
- package/.agents/skills/wiki/references/css-snippets.md +122 -0
- package/.agents/skills/wiki/references/frontmatter.md +107 -0
- package/.agents/skills/wiki/references/git-setup.md +58 -0
- package/.agents/skills/wiki/references/mcp-setup.md +149 -0
- package/.agents/skills/wiki/references/modes.md +259 -0
- package/.agents/skills/wiki/references/plugins.md +96 -0
- package/.agents/skills/wiki/references/rest-api.md +124 -0
- package/.agents/skills/wiki-autoresearch/SKILL.md +211 -0
- package/.agents/skills/wiki-autoresearch/references/program.md +75 -0
- package/.agents/skills/wiki-fold/SKILL.md +204 -0
- package/.agents/skills/wiki-fold/references/fold-template.md +133 -0
- package/.agents/skills/wiki-ingest/SKILL.md +288 -0
- package/.agents/skills/wiki-lint/SKILL.md +183 -0
- package/.agents/skills/wiki-query/SKILL.md +176 -0
- package/.agents/skills/wiki-save/SKILL.md +128 -0
- package/.ckignore +41 -0
- package/.env.example +9 -0
- package/.github/workflows/lint.yml +33 -0
- package/.github/workflows/publish-github-packages.yml +35 -0
- package/.github/workflows/publish-npm.yml +1 -1
- package/.pi/SYSTEM.md +107 -40
- package/.pi/agents/pi-pi/agent-expert.md +205 -0
- package/.pi/agents/pi-pi/cli-expert.md +47 -0
- package/.pi/agents/pi-pi/config-expert.md +67 -0
- package/.pi/agents/pi-pi/ext-expert.md +53 -0
- package/.pi/agents/pi-pi/keybinding-expert.md +123 -0
- package/.pi/agents/pi-pi/pi-orchestrator.md +103 -0
- package/.pi/agents/pi-pi/prompt-expert.md +83 -0
- package/.pi/agents/pi-pi/skill-expert.md +52 -0
- package/.pi/agents/pi-pi/theme-expert.md +46 -0
- package/.pi/agents/pi-pi/tui-expert.md +100 -0
- package/.pi/agents/rethink.md +140 -0
- package/.pi/agents/wiki-ingest.md +67 -0
- package/.pi/agents/wiki-lint.md +75 -0
- package/.pi/auto-commit.json +20 -0
- package/.pi/extensions/banner.png +0 -0
- package/.pi/extensions/ck-enforce.ts +216 -0
- package/.pi/extensions/custom-footer.ts +308 -0
- package/.pi/extensions/custom-header.ts +116 -0
- package/.pi/extensions/dotenv-loader.ts +170 -0
- package/.pi/internal/cursor-sdk-transcript-parser.ts +59 -0
- package/.pi/model-router.json +95 -0
- package/.pi/npm/.gitignore +2 -0
- package/.pi/prompts/git-sync.md +124 -0
- package/.pi/prompts/harness-setup.md +509 -0
- package/.pi/prompts/save.md +16 -0
- package/.pi/prompts/wiki-autoresearch.md +19 -0
- package/.pi/prompts/wiki.md +23 -0
- package/.pi/providers/cursor-sdk-provider.test.mjs +476 -0
- package/.pi/providers/cursor-sdk-provider.ts +1085 -0
- package/.pi/settings.json +14 -4
- package/.pi/skills/agent-router/SKILL.md +174 -0
- package/.pi/sounds/alert/1-kaching-track.mp3 +0 -0
- package/.pi/sounds/error/1-ksi-wth-track.mp3 +0 -0
- package/.pi/sounds/error/2-smash-track.mp3 +0 -0
- package/.pi/sounds/error/3-buzzer-track.mp3 +0 -0
- package/.pi/sounds/notification/1-soft-notification-track.mp3 +0 -0
- package/.pi/sounds/project-sounds.json +25 -0
- package/.pi/sounds/reminder/1-soft-notification-track.mp3 +0 -0
- package/.pi/sounds/success/1-tada-track.mp3 +0 -0
- package/.pi/sounds/success/2-jobs-done-track.mp3 +0 -0
- package/.pi/sounds/success/3-yay-track.mp3 +0 -0
- package/CONTRIBUTING.md +116 -0
- package/README.md +32 -39
- package/biome.json +34 -0
- package/firecrawl/.env.template +58 -0
- package/firecrawl/README.md +49 -0
- package/firecrawl/docker-compose.yaml +201 -0
- package/firecrawl/searxng/searxng.env +3 -0
- package/firecrawl/searxng/settings.yml +85 -0
- package/lefthook.yml +8 -0
- package/package.json +55 -24
- package/vault/AGENTS.md +37 -0
- package/vault/wiki/_templates/comparison.md +39 -0
- package/vault/wiki/_templates/concept.md +40 -0
- package/vault/wiki/_templates/decision.md +21 -0
- package/vault/wiki/_templates/entity.md +32 -0
- package/vault/wiki/_templates/flow.md +14 -0
- package/vault/wiki/_templates/module.md +18 -0
- package/vault/wiki/_templates/question.md +31 -0
- package/vault/wiki/_templates/source.md +39 -0
- package/vault/wiki/concepts/AST-Aware Code Chunking.md +44 -0
- package/vault/wiki/concepts/Build-Time Prompt Compilation.md +107 -0
- package/vault/wiki/concepts/Context Engine (AI Coding).md +47 -0
- package/vault/wiki/concepts/Context-Aware System Reminders.md +61 -0
- package/vault/wiki/concepts/Contextualized Text Embedding.md +42 -0
- package/vault/wiki/concepts/Contractor vs Employee AI Model.md +55 -0
- package/vault/wiki/concepts/Dual-Model Agent Architecture.md +65 -0
- package/vault/wiki/concepts/Late Chunking vs Early Chunking.md +43 -0
- package/vault/wiki/concepts/Majority Vote Ensembling.md +68 -0
- package/vault/wiki/concepts/Meta-Harness.md +16 -0
- package/vault/wiki/concepts/Multi-Agent AI Coding Architecture.md +75 -0
- package/vault/wiki/concepts/Prompt Enhancement.md +90 -0
- package/vault/wiki/concepts/Prompt Renderer.md +89 -0
- package/vault/wiki/concepts/Semantic Codebase Indexing.md +67 -0
- package/vault/wiki/concepts/additive-config-hierarchy.md +16 -0
- package/vault/wiki/concepts/agent-artifacts-verifiable-deliverables.md +71 -0
- package/vault/wiki/concepts/agent-browser-browser-automation.md +99 -0
- package/vault/wiki/concepts/agent-codebase-interface.md +43 -0
- package/vault/wiki/concepts/agent-harness-architecture.md +67 -0
- package/vault/wiki/concepts/agent-loop-detection-patterns.md +133 -0
- package/vault/wiki/concepts/agent-search-enforcement.md +126 -0
- package/vault/wiki/concepts/agent-skills-ecosystem.md +74 -0
- package/vault/wiki/concepts/agent-skills-pattern.md +68 -0
- package/vault/wiki/concepts/agentic-harness-context-enforcement.md +91 -0
- package/vault/wiki/concepts/agentic-harness.md +34 -0
- package/vault/wiki/concepts/agentic-orchestration-pipeline.md +56 -0
- package/vault/wiki/concepts/agentic-search-no-embeddings.md +18 -0
- package/vault/wiki/concepts/anthropic-context-engineering.md +13 -0
- package/vault/wiki/concepts/antigravity-agent-first-architecture.md +61 -0
- package/vault/wiki/concepts/ast-compression.md +19 -0
- package/vault/wiki/concepts/ast-truncation.md +66 -0
- package/vault/wiki/concepts/barrel-files.md +37 -0
- package/vault/wiki/concepts/browser-harness-agent.md +41 -0
- package/vault/wiki/concepts/browser-subagent-visual-verification.md +82 -0
- package/vault/wiki/concepts/codebase-intelligence-ecosystem-comparison.md +192 -0
- package/vault/wiki/concepts/codebase-intelligence-harness-integration.md +161 -0
- package/vault/wiki/concepts/codebase-to-context-ingestion.md +46 -0
- package/vault/wiki/concepts/codex-harness-innovations.md +147 -0
- package/vault/wiki/concepts/consensus-debate-flow.md +17 -0
- package/vault/wiki/concepts/consensus-debate.md +206 -0
- package/vault/wiki/concepts/content-addressed-spec-identity.md +166 -0
- package/vault/wiki/concepts/context-anxiety.md +57 -0
- package/vault/wiki/concepts/context-compression-techniques.md +19 -0
- package/vault/wiki/concepts/context-continuity.md +22 -0
- package/vault/wiki/concepts/context-drift-in-agents.md +106 -0
- package/vault/wiki/concepts/context-engineering.md +62 -0
- package/vault/wiki/concepts/context-folding.md +67 -0
- package/vault/wiki/concepts/context-mode.md +38 -0
- package/vault/wiki/concepts/cursor-harness-innovations.md +107 -0
- package/vault/wiki/concepts/deterministic-session-compaction.md +79 -0
- package/vault/wiki/concepts/drift-detection-unified.md +296 -0
- package/vault/wiki/concepts/execution-feedback-loop.md +46 -0
- package/vault/wiki/concepts/feedforward-feedback-harness.md +60 -0
- package/vault/wiki/concepts/five-root-cause-metrics-sentrux.md +40 -0
- package/vault/wiki/concepts/fork-safe-spec-storage.md +89 -0
- package/vault/wiki/concepts/fts5-sandbox.md +19 -0
- package/vault/wiki/concepts/fuzzy-edit-matching.md +71 -0
- package/vault/wiki/concepts/gemini-cli-architecture.md +104 -0
- package/vault/wiki/concepts/generator-evaluator-architecture.md +64 -0
- package/vault/wiki/concepts/guardian-agent-pattern.md +67 -0
- package/vault/wiki/concepts/harness-configuration-layers.md +89 -0
- package/vault/wiki/concepts/harness-control-frameworks.md +155 -0
- package/vault/wiki/concepts/harness-engineering-first-principles.md +90 -0
- package/vault/wiki/concepts/harness-h-formalism.md +53 -0
- package/vault/wiki/concepts/hybrid-code-search.md +61 -0
- package/vault/wiki/concepts/inline-post-edit-validation.md +112 -0
- package/vault/wiki/concepts/legendary-engineering-patterns-harness.md +110 -0
- package/vault/wiki/concepts/lifecycle-hooks.md +94 -0
- package/vault/wiki/concepts/mcp-tool-routing.md +102 -0
- package/vault/wiki/concepts/memory-system-of-record-vs-ephemeral-cache.md +47 -0
- package/vault/wiki/concepts/meta-agent-context-pruning.md +151 -0
- package/vault/wiki/concepts/model-adaptive-harness.md +122 -0
- package/vault/wiki/concepts/model-routing-agents.md +101 -0
- package/vault/wiki/concepts/monorepo-architecture.md +45 -0
- package/vault/wiki/concepts/multi-agent-specialization.md +61 -0
- package/vault/wiki/concepts/permission-subsystem.md +16 -0
- package/vault/wiki/concepts/pi-messenger-analysis.md +243 -0
- package/vault/wiki/concepts/pi-vscode-extension-landscape.md +37 -0
- package/vault/wiki/concepts/policy-engine-pattern.md +78 -0
- package/vault/wiki/concepts/progressive-disclosure-agents.md +53 -0
- package/vault/wiki/concepts/progressive-skill-disclosure.md +17 -0
- package/vault/wiki/concepts/provider-native-prompting.md +203 -0
- package/vault/wiki/concepts/quality-signal-sentrux.md +37 -0
- package/vault/wiki/concepts/repo-map-ranking.md +42 -0
- package/vault/wiki/concepts/result-monad-error-handling.md +47 -0
- package/vault/wiki/concepts/safety-defense-in-depth.md +83 -0
- package/vault/wiki/concepts/sandbox-os-enforcement.md +18 -0
- package/vault/wiki/concepts/selective-debate-routing.md +70 -0
- package/vault/wiki/concepts/self-evolving-harness.md +60 -0
- package/vault/wiki/concepts/sentrux-mcp-integration.md +36 -0
- package/vault/wiki/concepts/sentrux-rules-engine.md +49 -0
- package/vault/wiki/concepts/shell-pattern-compression.md +24 -0
- package/vault/wiki/concepts/skill-first-architecture.md +166 -0
- package/vault/wiki/concepts/structured-compaction.md +78 -0
- package/vault/wiki/concepts/subagent-orchestration.md +17 -0
- package/vault/wiki/concepts/subagent-worktree-isolation.md +68 -0
- package/vault/wiki/concepts/superpowers-methodology.md +78 -0
- package/vault/wiki/concepts/think-in-code.md +73 -0
- package/vault/wiki/concepts/ts-execution-layer.md +100 -0
- package/vault/wiki/concepts/typescript-strict-mode.md +37 -0
- package/vault/wiki/concepts/vcc-conversation-compaction-for-pi.md +51 -0
- package/vault/wiki/concepts/verification-drift-detection.md +19 -0
- package/vault/wiki/consensus/consensus-records.md +58 -0
- package/vault/wiki/decisions/2026-04-30-pi-lean-ctx-native.md +122 -0
- package/vault/wiki/decisions/adr-008.md +40 -0
- package/vault/wiki/decisions/adr-009.md +46 -0
- package/vault/wiki/decisions/adr-010.md +55 -0
- package/vault/wiki/decisions/adr-011.md +165 -0
- package/vault/wiki/decisions/adr-012.md +102 -0
- package/vault/wiki/decisions/adr-013.md +59 -0
- package/vault/wiki/decisions/adr-014.md +73 -0
- package/vault/wiki/decisions/adr-015.md +81 -0
- package/vault/wiki/decisions/adr-016.md +91 -0
- package/vault/wiki/decisions/adr-017.md +79 -0
- package/vault/wiki/decisions/adr-018.md +100 -0
- package/vault/wiki/decisions/adr-019.md +75 -0
- package/vault/wiki/decisions/adr-020.md +106 -0
- package/vault/wiki/decisions/adr-021.md +86 -0
- package/vault/wiki/decisions/adr-022.md +113 -0
- package/vault/wiki/decisions/adr-023.md +113 -0
- package/vault/wiki/decisions/adr-024.md +73 -0
- package/vault/wiki/decisions/adr-025.md +130 -0
- package/vault/wiki/decisions/adr-026.md +56 -0
- package/vault/wiki/decisions/colocate-wiki.md +34 -0
- package/vault/wiki/entities/Anders Hejlsberg.md +29 -0
- package/vault/wiki/entities/Anthropic.md +17 -0
- package/vault/wiki/entities/Augment Code.md +49 -0
- package/vault/wiki/entities/Bjarne Stroustrup.md +26 -0
- package/vault/wiki/entities/Bolt.new (StackBlitz).md +39 -0
- package/vault/wiki/entities/Boris Cherny.md +11 -0
- package/vault/wiki/entities/Claude Code.md +19 -0
- package/vault/wiki/entities/Dennis Ritchie.md +26 -0
- package/vault/wiki/entities/Emergent Labs.md +32 -0
- package/vault/wiki/entities/Google Cloud.md +16 -0
- package/vault/wiki/entities/Guido van Rossum.md +28 -0
- package/vault/wiki/entities/Ken Thompson.md +28 -0
- package/vault/wiki/entities/Lee et al.md +16 -0
- package/vault/wiki/entities/Linus Torvalds.md +28 -0
- package/vault/wiki/entities/Lovable (company).md +40 -0
- package/vault/wiki/entities/Martin Fowler.md +16 -0
- package/vault/wiki/entities/Meng et al.md +16 -0
- package/vault/wiki/entities/OpenAI.md +16 -0
- package/vault/wiki/entities/Rocket.new.md +38 -0
- package/vault/wiki/entities/VILA-Lab.md +15 -0
- package/vault/wiki/entities/autodev-codebase.md +18 -0
- package/vault/wiki/entities/ck-tool.md +59 -0
- package/vault/wiki/entities/codesearch.md +18 -0
- package/vault/wiki/entities/disler-indydevdan.md +33 -0
- package/vault/wiki/entities/gsd-get-shit-done.md +56 -0
- package/vault/wiki/entities/javascript-runtimes.md +48 -0
- package/vault/wiki/entities/jesse-vincent.md +38 -0
- package/vault/wiki/entities/lean-ctx.md +32 -0
- package/vault/wiki/entities/opendev.md +41 -0
- package/vault/wiki/entities/ops-codegraph-tool.md +18 -0
- package/vault/wiki/entities/pi-coding-agent.md +53 -0
- package/vault/wiki/entities/sentrux.md +54 -0
- package/vault/wiki/entities/vgrep-tool.md +57 -0
- package/vault/wiki/entities/vitest.md +41 -0
- package/vault/wiki/flows/harness-wiki-pipeline.md +204 -0
- package/vault/wiki/hot.md +932 -0
- package/vault/wiki/index.md +437 -0
- package/vault/wiki/log.md +418 -0
- package/vault/wiki/meta/dashboard.md +30 -0
- package/vault/wiki/meta/lint-report-2026-04-30.md +86 -0
- package/vault/wiki/meta/lint-report-2026-05-02.md +251 -0
- package/vault/wiki/meta/overview.canvas +43 -0
- package/vault/wiki/modules/adversarial-verification.md +57 -0
- package/vault/wiki/modules/automated-observability.md +54 -0
- package/vault/wiki/modules/bench.md +20 -0
- package/vault/wiki/modules/extensions.md +23 -0
- package/vault/wiki/modules/grounding-checkpoints.md +62 -0
- package/vault/wiki/modules/harness-implementation-plan.md +345 -0
- package/vault/wiki/modules/harness-wiki-skill-mapping.md +135 -0
- package/vault/wiki/modules/harness.md +86 -0
- package/vault/wiki/modules/persistent-memory.md +85 -0
- package/vault/wiki/modules/schema-orchestration.md +68 -0
- package/vault/wiki/modules/skills.md +27 -0
- package/vault/wiki/modules/spec-hardening.md +58 -0
- package/vault/wiki/modules/structured-planning.md +53 -0
- package/vault/wiki/modules/think-in-code-enforcement.md +153 -0
- package/vault/wiki/modules/wiki-query-interface.md +64 -0
- package/vault/wiki/overview.md +51 -0
- package/vault/wiki/questions/Research-pi-vs-claude-code-agentic-orchestration-pipeline.md +87 -0
- package/vault/wiki/questions/Research-sentrux-dev.md +123 -0
- package/vault/wiki/questions/Research-superpowers-skill-for-agentic-coding-agents.md +164 -0
- package/vault/wiki/questions/Research: Augment Code Context Engine.md +244 -0
- package/vault/wiki/questions/Research: Automating Software Engineering - Lovable, Bolt, Emergent, Rocket.md +112 -0
- package/vault/wiki/questions/Research: Claude Code State-of-the-Art Harness Improvements.md +209 -0
- package/vault/wiki/questions/Research: Codex State-of-the-Art Harness Improvements.md +99 -0
- package/vault/wiki/questions/Research: Engineering Workflows of Legendary Programmers and AI Harness Mapping.md +107 -0
- package/vault/wiki/questions/Research: Fallow Codebase Intelligence Harness Integration.md +72 -0
- package/vault/wiki/questions/Research: Gemini CLI SOTA Harness Integration.md +166 -0
- package/vault/wiki/questions/Research: GitHub Issues as Harness Spec Storage.md +188 -0
- package/vault/wiki/questions/Research: Google Antigravity Harness Integration.md +120 -0
- package/vault/wiki/questions/Research: Meta-Agent Context Drift Detection.md +236 -0
- package/vault/wiki/questions/Research: Model-Adaptive Agent Harness Design.md +95 -0
- package/vault/wiki/questions/Research: Model-Specific Prompting Guides.md +165 -0
- package/vault/wiki/questions/Research: Prompt Renderer for Multi-Model Agent Harness.md +216 -0
- package/vault/wiki/questions/Research: Skill-First Harness Architecture.md +91 -0
- package/vault/wiki/questions/Research: TypeScript Best Practices and Codebase Structure.md +88 -0
- package/vault/wiki/questions/Research: TypeScript Execution Layer for Agent Tool Calling.md +81 -0
- package/vault/wiki/questions/Research: claude-mem over Obsidian for Harness Layer.md +71 -0
- package/vault/wiki/questions/Research: claude-mem over obsidian wiki as the knowledge base for our agentic harness pipeline. think from first principles. does this replace or complement our current setup? no hard feelings about previous decisions. gimme accurate points.md +80 -0
- package/vault/wiki/questions/Research: context-mode vs lean-ctx.md +72 -0
- package/vault/wiki/questions/Research: cursor.sh Harness Innovations.md +92 -0
- package/vault/wiki/questions/Research: executor.sh Harness Integration.md +170 -0
- package/vault/wiki/questions/Research: how GSD fits into our coding harness setup.md +97 -0
- package/vault/wiki/questions/Research: how claude-mem fits into our workflow. and whether it should replace obsidian in the codebase. no hard feelings about previous actions, rethink from first principles always.md +80 -0
- package/vault/wiki/questions/Research: pi-vcc.md +113 -0
- package/vault/wiki/questions/Research: semantic code search tools.md +69 -0
- package/vault/wiki/questions/Research: vcc extension for pi coding agent.md +73 -0
- package/vault/wiki/questions/how-to-enable-semantic-code-search-now.md +111 -0
- package/vault/wiki/questions/mvp-implementation-blueprint.md +552 -0
- package/vault/wiki/questions/research-agent-first-codebase-exploration.md +199 -0
- package/vault/wiki/questions/research-agentic-coding-harness-latest-papers.md +142 -0
- package/vault/wiki/questions/research-gitingest-gitreverse-integration.md +100 -0
- package/vault/wiki/questions/research-wozcode-token-reduction.md +67 -0
- package/vault/wiki/questions/resolved-context-pruning-inplace-vs-restart.md +95 -0
- package/vault/wiki/questions/resolved-context-window-economics.md +167 -0
- package/vault/wiki/questions/resolved-imad-debate-gating-transfer.md +126 -0
- package/vault/wiki/questions/resolved-mcp-tool-preference.md +112 -0
- package/vault/wiki/questions/resolved-small-model-meta-agents.md +107 -0
- package/vault/wiki/questions/resolved-treesitter-dynamic-languages.md +95 -0
- package/vault/wiki/sources/Auggie Context MCP Server.md +63 -0
- package/vault/wiki/sources/Augment Code Codacy AI Giants.md +61 -0
- package/vault/wiki/sources/Augment Code MCP SiliconAngle.md +49 -0
- package/vault/wiki/sources/Augment Code WorkOS ERC 2025.md +55 -0
- package/vault/wiki/sources/Augment Context Engine Official.md +71 -0
- package/vault/wiki/sources/Augment SWE-bench Agent GitHub.md +74 -0
- package/vault/wiki/sources/Augment SWE-bench Pro Blog.md +58 -0
- package/vault/wiki/sources/Source: AgentBus Jinja2 Prompt Pipelines.md +75 -0
- package/vault/wiki/sources/Source: Arxiv /342/200/224 Don't Break the Cache.md" +85 -0
- package/vault/wiki/sources/Source: Augment - Harness Engineering for AI Coding Agents.md +58 -0
- package/vault/wiki/sources/Source: Blake Crosley Agent Architecture Guide.md +100 -0
- package/vault/wiki/sources/Source: Bolt.new Architecture & Case Study.md +75 -0
- package/vault/wiki/sources/Source: Build-Time Prompt Compilation Architecture.md +107 -0
- package/vault/wiki/sources/Source: Claude API Agent Skills Overview.md +70 -0
- package/vault/wiki/sources/Source: Gemini CLI Changelogs.md +88 -0
- package/vault/wiki/sources/Source: Google Blog - Gemini CLI Announcement.md +57 -0
- package/vault/wiki/sources/Source: Google Gemini CLI Architecture Docs.md +53 -0
- package/vault/wiki/sources/Source: LangChain - Anatomy of Agent Harness.md +65 -0
- package/vault/wiki/sources/Source: Lovable Architecture & Clone Analysis.md +83 -0
- package/vault/wiki/sources/Source: Martin Fowler - Harness Engineering.md +70 -0
- package/vault/wiki/sources/Source: OpenAI Harness Engineering Five Principles.md +58 -0
- package/vault/wiki/sources/Source: OpenAI Harness Engineering /342/200/224 0 Lines of Human Code.md" +101 -0
- package/vault/wiki/sources/Source: OpenDev /342/200/224 Building AI Coding Agents for the Terminal.md" +100 -0
- package/vault/wiki/sources/Source: Render AI Coding Agents Benchmark 2025.md +53 -0
- package/vault/wiki/sources/Source: Rocket.new /342/200/224 Vibe Solutioning Platform.md" +70 -0
- package/vault/wiki/sources/Source: SwirlAI Agent Skills Progressive Disclosure.md +71 -0
- package/vault/wiki/sources/Source: TianPan Prompt Caching Architecture.md +89 -0
- package/vault/wiki/sources/Source: Vercel Labs agent-browser.md +155 -0
- package/vault/wiki/sources/Source: browser-harness CDP Harness.md +126 -0
- package/vault/wiki/sources/agent-drift-academic-paper.md +79 -0
- package/vault/wiki/sources/aider-repomap-tree-sitter.md +42 -0
- package/vault/wiki/sources/anthropic-compaction-api.md +58 -0
- package/vault/wiki/sources/anthropic-effective-harnesses.md +42 -0
- package/vault/wiki/sources/anthropic-prompt-best-practices.md +100 -0
- package/vault/wiki/sources/anthropic2026-harness-design.md +63 -0
- package/vault/wiki/sources/barrel-files-tkdodo.md +38 -0
- package/vault/wiki/sources/birth-of-unix-kernighan-interview.md +57 -0
- package/vault/wiki/sources/bockeler2026-harness-engineering.md +69 -0
- package/vault/wiki/sources/cast-code-chunking-paper.md +50 -0
- package/vault/wiki/sources/ck-semantic-search.md +78 -0
- package/vault/wiki/sources/claude-code-architecture-karaxai-2026.md +71 -0
- package/vault/wiki/sources/claude-code-architecture-qubytes-2026.md +50 -0
- package/vault/wiki/sources/claude-code-architecture-vila-lab-2026.md +64 -0
- package/vault/wiki/sources/claude-code-security-architecture-penligent-2026.md +70 -0
- package/vault/wiki/sources/claude-context-editing-docs.md +13 -0
- package/vault/wiki/sources/cloudflare-codemode.md +63 -0
- package/vault/wiki/sources/code-chunk-library-supermemory.md +63 -0
- package/vault/wiki/sources/codeact-apple-2024.md +62 -0
- package/vault/wiki/sources/codex-dsc-rfc-8573.md +41 -0
- package/vault/wiki/sources/codex-open-source-agent-2026.md +110 -0
- package/vault/wiki/sources/coir-code-retrieval-benchmark.md +51 -0
- package/vault/wiki/sources/colinmcnamara-context-optimization-codemode.md +48 -0
- package/vault/wiki/sources/context-folding-paper.md +61 -0
- package/vault/wiki/sources/context-mode-website.md +63 -0
- package/vault/wiki/sources/cursor-agent-best-practices-2026.md +62 -0
- package/vault/wiki/sources/cursor-fork-29b-2025.md +50 -0
- package/vault/wiki/sources/cursor-harness-april-2026.md +76 -0
- package/vault/wiki/sources/cursor-instant-apply-2024.md +45 -0
- package/vault/wiki/sources/cursor-shadow-workspace-2024.md +52 -0
- package/vault/wiki/sources/cursor-shipped-coding-agent-2026.md +53 -0
- package/vault/wiki/sources/cursor-vs-antigravity-2026.md +51 -0
- package/vault/wiki/sources/disler-pi-vs-claude-code.md +69 -0
- package/vault/wiki/sources/distill-deterministic-context-compression.md +53 -0
- package/vault/wiki/sources/embedding-models-benchmark-supermemory-2025.md +48 -0
- package/vault/wiki/sources/executor-rhyssullivan.md +122 -0
- package/vault/wiki/sources/fallow-rs-codebase-intelligence.md +125 -0
- package/vault/wiki/sources/fan2025-imad.md +60 -0
- package/vault/wiki/sources/forgecode-gpt5-agent-improvements.md +63 -0
- package/vault/wiki/sources/gemini-3-prompting-guide.md +78 -0
- package/vault/wiki/sources/gh-cli-sub-issue-rfc.md +50 -0
- package/vault/wiki/sources/gh-sub-issue-extension.md +72 -0
- package/vault/wiki/sources/github-fork-issues-discussion.md +44 -0
- package/vault/wiki/sources/github-issue-dependencies-docs.md +49 -0
- package/vault/wiki/sources/github-sub-issues-docs.md +51 -0
- package/vault/wiki/sources/gitingest.md +91 -0
- package/vault/wiki/sources/gitreverse.md +63 -0
- package/vault/wiki/sources/google-antigravity-official-blog.md +47 -0
- package/vault/wiki/sources/google-antigravity-wikipedia.md +53 -0
- package/vault/wiki/sources/gsd-codecentric-deep-dive.md +57 -0
- package/vault/wiki/sources/gsd-github-repo.md +51 -0
- package/vault/wiki/sources/gsd-hn-discussion.md +59 -0
- package/vault/wiki/sources/guido-python-design-philosophy.md +56 -0
- package/vault/wiki/sources/hejlsberg-7-learnings.md +48 -0
- package/vault/wiki/sources/ironclaw-drift-monitor.md +80 -0
- package/vault/wiki/sources/langsight-loop-detection.md +80 -0
- package/vault/wiki/sources/leanctx-website.md +69 -0
- package/vault/wiki/sources/lee2026-meta-harness.md +59 -0
- package/vault/wiki/sources/linux-kernel-coding-workflow.md +50 -0
- package/vault/wiki/sources/lou2026-autoharness.md +53 -0
- package/vault/wiki/sources/martin-fowler-harness-engineering.md +73 -0
- package/vault/wiki/sources/mcp-architecture-docs.md +13 -0
- package/vault/wiki/sources/meng2026-agent-harness-survey.md +79 -0
- package/vault/wiki/sources/mindstudio-four-agent-types.md +68 -0
- package/vault/wiki/sources/ms-chat-history-management.md +13 -0
- package/vault/wiki/sources/openai-prompt-guidance.md +104 -0
- package/vault/wiki/sources/openclaw-session-pruning.md +13 -0
- package/vault/wiki/sources/opencode-dcp.md +13 -0
- package/vault/wiki/sources/opendev-arxiv-2603.05344v1.md +79 -0
- package/vault/wiki/sources/openhands-platform.md +39 -0
- package/vault/wiki/sources/oss-guide-codebase-exploration.md +53 -0
- package/vault/wiki/sources/pi-compaction-extensions-ecosystem.md +102 -0
- package/vault/wiki/sources/pi-context-prune-github-repo.md +38 -0
- package/vault/wiki/sources/pi-mono-compaction-docs.md +38 -0
- package/vault/wiki/sources/pi-omni-compact-github-repo.md +50 -0
- package/vault/wiki/sources/pi-rtk-optimizer-github-repo.md +45 -0
- package/vault/wiki/sources/pi-vcc-github-repo.md +69 -0
- package/vault/wiki/sources/pi-vscode-marketplace.md +41 -0
- package/vault/wiki/sources/pi-vscode-model-provider-marketplace.md +39 -0
- package/vault/wiki/sources/py-tree-sitter.md +13 -0
- package/vault/wiki/sources/sentrux-dev-landing.md +40 -0
- package/vault/wiki/sources/sentrux-docs-pro-architecture.md +75 -0
- package/vault/wiki/sources/sentrux-docs-quality-signal.md +46 -0
- package/vault/wiki/sources/sentrux-docs-root-cause-metrics.md +57 -0
- package/vault/wiki/sources/sentrux-docs-rules-engine.md +58 -0
- package/vault/wiki/sources/sentrux-github-repo.md +56 -0
- package/vault/wiki/sources/superpowers-github-repo.md +56 -0
- package/vault/wiki/sources/superpowers-release-blog.md +54 -0
- package/vault/wiki/sources/superpowers-termdock-analysis.md +45 -0
- package/vault/wiki/sources/swe-agent-aci.md +42 -0
- package/vault/wiki/sources/swe-bench.md +45 -0
- package/vault/wiki/sources/swe-pruner-context-pruning.md +13 -0
- package/vault/wiki/sources/think-in-code-blog.md +48 -0
- package/vault/wiki/sources/tree-sitter-docs.md +13 -0
- package/vault/wiki/sources/ts-best-practices-2025-devto.md +42 -0
- package/vault/wiki/sources/ts-folder-structure-mingyang.md +58 -0
- package/vault/wiki/sources/ts-monorepo-koerselman.md +44 -0
- package/vault/wiki/sources/ts-result-error-handling-kkalamarski.md +52 -0
- package/vault/wiki/sources/ts-runtimes-comparison-betterstack.md +42 -0
- package/vault/wiki/sources/ts-strict-mode-rishikc.md +43 -0
- package/vault/wiki/sources/unix-philosophy.md +48 -0
- package/vault/wiki/sources/vectara-chunking-vs-embedding-naacl2025.md +39 -0
- package/vault/wiki/sources/vectara-guardian-agents.md +79 -0
- package/vault/wiki/sources/vgrep-semantic-search.md +76 -0
- package/vault/wiki/sources/vitest-official.md +41 -0
- package/vault/wiki/sources/vscode-pi-community-extension.md +40 -0
- package/vault/wiki/sources/wozcode.md +79 -0
- package/.agents/skills/compress/SKILL.md +0 -111
- package/.agents/skills/compress/scripts/__init__.py +0 -9
- package/.agents/skills/compress/scripts/__main__.py +0 -3
- package/.agents/skills/compress/scripts/benchmark.py +0 -78
- package/.agents/skills/compress/scripts/cli.py +0 -73
- package/.agents/skills/compress/scripts/compress.py +0 -227
- package/.agents/skills/compress/scripts/detect.py +0 -121
- package/.agents/skills/compress/scripts/validate.py +0 -189
- package/.agents/skills/emil-design-eng/SKILL.md +0 -679
- package/.agents/skills/lean-ctx/SKILL.md +0 -149
- package/.agents/skills/lean-ctx/scripts/install.sh +0 -95
- package/.agents/skills/scrapling-official/LICENSE.txt +0 -28
- package/.agents/skills/scrapling-official/SKILL.md +0 -390
- package/.agents/skills/scrapling-official/examples/01_fetcher_session.py +0 -26
- package/.agents/skills/scrapling-official/examples/02_dynamic_session.py +0 -26
- package/.agents/skills/scrapling-official/examples/03_stealthy_session.py +0 -26
- package/.agents/skills/scrapling-official/examples/04_spider.py +0 -58
- package/.agents/skills/scrapling-official/examples/README.md +0 -45
- package/.agents/skills/scrapling-official/references/fetching/choosing.md +0 -78
- package/.agents/skills/scrapling-official/references/fetching/dynamic.md +0 -352
- package/.agents/skills/scrapling-official/references/fetching/static.md +0 -432
- package/.agents/skills/scrapling-official/references/fetching/stealthy.md +0 -255
- package/.agents/skills/scrapling-official/references/mcp-server.md +0 -214
- package/.agents/skills/scrapling-official/references/migrating_from_beautifulsoup.md +0 -86
- package/.agents/skills/scrapling-official/references/parsing/adaptive.md +0 -212
- package/.agents/skills/scrapling-official/references/parsing/main_classes.md +0 -586
- package/.agents/skills/scrapling-official/references/parsing/selection.md +0 -494
- package/.agents/skills/scrapling-official/references/spiders/advanced.md +0 -344
- package/.agents/skills/scrapling-official/references/spiders/architecture.md +0 -94
- package/.agents/skills/scrapling-official/references/spiders/getting-started.md +0 -164
- package/.agents/skills/scrapling-official/references/spiders/proxy-blocking.md +0 -235
- package/.agents/skills/scrapling-official/references/spiders/requests-responses.md +0 -196
- package/.agents/skills/scrapling-official/references/spiders/sessions.md +0 -205
- package/PLAN.md +0 -11
- package/extensions/lean-ctx-enforce.ts +0 -166
- package/skills-lock.json +0 -35
- package/wiki/README.md +0 -19
- package/wiki/decisions/0001-establish-project-wiki-and-decision-record-format.md +0 -25
- package/wiki/decisions/0002-add-project-banner-to-readme.md +0 -26
- package/wiki/decisions/0003-remove-redundant-readme-title-heading.md +0 -26
- package/wiki/decisions/0004-publish-package-to-npm-as-ultimate-pi.md +0 -26
- package/wiki/decisions/0005-automate-npm-publish-with-github-actions.md +0 -27
- package/wiki/decisions/0006-switch-to-npm-trusted-publishing.md +0 -26
- package/wiki/decisions/0007-use-absolute-banner-url-for-npm-readme-rendering.md +0 -26
- package/wiki/decisions/0008-rename-banner-asset-for-cache-busting.md +0 -26
- package/wiki/decisions/0009-force-oidc-path-by-clearing-node-auth-token-in-publish-step.md +0 -25
- package/wiki/decisions/0010-simplify-setup-node-for-npm-trusted-publishing.md +0 -26
- package/wiki/decisions/0011-add-noop-workflow-change-to-force-fresh-publish-run.md +0 -25
- package/wiki/decisions/0012-align-workflow-runtime-with-npm-trusted-publishing-requirements.md +0 -26
- package/wiki/decisions/0013-add-package-repository-url-for-provenance-validation.md +0 -25
|
@@ -0,0 +1,123 @@
|
|
|
1
|
+
---
|
|
2
|
+
type: synthesis
|
|
3
|
+
title: "Research: sentrux.dev"
|
|
4
|
+
created: 2026-05-03
|
|
5
|
+
updated: 2026-05-03
|
|
6
|
+
tags:
|
|
7
|
+
- research
|
|
8
|
+
- sentrux
|
|
9
|
+
- code-quality
|
|
10
|
+
- ai-coding
|
|
11
|
+
status: developing
|
|
12
|
+
related:
|
|
13
|
+
- "[[sentrux (tool)]]"
|
|
14
|
+
- "[[Quality Signal (sentrux)]]"
|
|
15
|
+
- "[[Five Root Cause Metrics (sentrux)]]"
|
|
16
|
+
- "[[sentrux Rules Engine]]"
|
|
17
|
+
- "[[sentrux MCP Integration]]"
|
|
18
|
+
- "[[harness-implementation-plan]]"
|
|
19
|
+
- "[[harness]]"
|
|
20
|
+
sources:
|
|
21
|
+
- "[[sentrux-github-repo]]"
|
|
22
|
+
- "[[sentrux-dev-landing]]"
|
|
23
|
+
- "[[sentrux-docs-quality-signal]]"
|
|
24
|
+
- "[[sentrux-docs-root-cause-metrics]]"
|
|
25
|
+
- "[[sentrux-docs-rules-engine]]"
|
|
26
|
+
- "[[sentrux-docs-pro-architecture]]"
|
|
27
|
+
---
|
|
28
|
+
|
|
29
|
+
# Research: sentrux.dev
|
|
30
|
+
|
|
31
|
+
## Overview
|
|
32
|
+
sentrux is a real-time architectural sensor for AI-agent-written code. Built in Rust (MIT licensed), it computes a single Quality Signal score (0–10,000) from 5 graph-theoretic root cause metrics, visualizes the codebase as an interactive treemap, and integrates with AI coding agents via MCP (Model Context Protocol). First released March 11, 2026; already at v0.5.7 with 1.9k GitHub stars.
|
|
33
|
+
|
|
34
|
+
## Key Findings
|
|
35
|
+
|
|
36
|
+
- **Unique positioning:** sentrux positions itself as the missing feedback loop in AI-assisted development — the "sensor" that observes architectural reality while AI agents are the "actuator" making changes (Source: [[sentrux-dev-landing]])
|
|
37
|
+
- **Mathematically grounded scoring:** Uses geometric mean of 5 independent graph-theoretic dimensions, justified by Nash Social Welfare theorem (1950). Claims to be "ungameable by design" (Source: [[sentrux-docs-quality-signal]])
|
|
38
|
+
- **5 root cause metrics cover complete structural space:** 3 edge properties (modularity, acyclicity, depth) + 2 node properties (equality, redundancy) — each grounded in peer-reviewed theory (Newman 2004, Martin 2003, Lakos 1996, Gini 1912, Kolmogorov 1963) (Source: [[sentrux-docs-root-cause-metrics]])
|
|
39
|
+
- **MCP-first AI agent integration:** 9 MCP tools allow agents to scan, baseline, check rules, and detect quality degradation per session — closing the feedback loop automatically (Source: [[sentrux-github-repo]])
|
|
40
|
+
- **Pro tier via runtime plugin model:** Pro features ($15/month) live in a separately downloaded dylib, not in the free binary. Ed25519 license keys with offline validation and per-user watermarking for anti-piracy (Source: [[sentrux-docs-pro-architecture]])
|
|
41
|
+
- **Rapid development velocity:** From initial commit to v0.5.7 with Pro architecture, Claude Code plugin, universal resolver, and 316+ tests in approximately one week (Source: [[sentrux-github-repo]])
|
|
42
|
+
- **52 languages via tree-sitter:** Zero language-specific code in the Rust binary. All language knowledge in plugin.toml + tags.scm query files. New languages require zero Rust code (Source: [[sentrux-github-repo]])
|
|
43
|
+
|
|
44
|
+
## Key Entities
|
|
45
|
+
- [[sentrux (tool)]]: The open-source architectural sensor and quality governance tool
|
|
46
|
+
- **yjing:** Primary author; GitHub user "sentrux"; appears as "yjing@sentrux.dev" in license keys
|
|
47
|
+
- **claude:** Contributor account — likely represents AI-generated code contributions (the tool was partially built by Claude)
|
|
48
|
+
|
|
49
|
+
## Key Concepts
|
|
50
|
+
- [[Quality Signal (sentrux)]]: Single scalar score 0–10,000 via geometric mean of 5 normalized metrics
|
|
51
|
+
- [[Five Root Cause Metrics (sentrux)]]: modularity, acyclicity, depth, equality, redundancy
|
|
52
|
+
- [[sentrux Rules Engine]]: TOML-based architectural constraint system for CI and MCP
|
|
53
|
+
- [[sentrux MCP Integration]]: 9-tool MCP server for AI agent feedback loops
|
|
54
|
+
- **Feedback Loop (cybernetic):** sensor (sentrux) → signal → controller (AI agent) → actuator (code changes) → system (codebase) → loop
|
|
55
|
+
|
|
56
|
+
## Contradictions
|
|
57
|
+
|
|
58
|
+
- **Self-assessment gap:** The sentrux repo gives itself a "D" rating when analyzed by its own tool (Source: Reddit comment by ron3090). This raises questions about either the tool's calibration or the repo's code quality — both problematic for credibility.
|
|
59
|
+
- **Rapid release pace vs stability:** 17 releases in a single day during launch. Reddit community flagged this as potentially "vibe-coded" with insufficient review and testing. Creator responded to specific feedback (swapped `dirs` crate for `std::env::home_dir()`) suggesting responsiveness but also rapid, reactive development.
|
|
60
|
+
- **Conceptual strength vs practical utility:** Community feedback split between praising the concept (human-in-the-loop, feedback loop) and questioning practical usefulness — "it looks okay visually, but doesn't actually show anything useful" and metrics are "meaningless noise" without actionable drill-down.
|
|
61
|
+
- **"Ungameable" claim:** The Nash Social Welfare theorem guarantees aggregation properties, not that individual metrics can't be gamed. The claim conflates mathematical properties of aggregation with practical impossibility of gaming.
|
|
62
|
+
|
|
63
|
+
## Open Questions
|
|
64
|
+
|
|
65
|
+
- **Production adoption unknown:** No evidence found of production usage beyond the creator. Tool is <2 months old. Listed as "developing" status.
|
|
66
|
+
- **No independent reviews found:** No blog posts, technical analyses, or third-party evaluations beyond the Reddit launch thread comments. All documentation is from the creator.
|
|
67
|
+
- **Accuracy of metrics across languages:** 52 languages supported via tree-sitter but accuracy of dependency graph extraction likely varies significantly by language maturity of tree-sitter grammars.
|
|
68
|
+
- **Scalability limits unknown:** No data on performance with large codebases (100K+ files, monorepos). Treemap rendering with dependency edges at scale unverified.
|
|
69
|
+
- **Pro plugin security model:** Runtime dylib loading has inherent security risks. The anti-piracy posture explicitly accepts that binary patching defeats all protections — what about malicious plugin substitution?
|
|
70
|
+
- **Comparison with existing tools absent:** No positioning relative to SonarQube, CodeClimate, CodeScene, or other established code quality tools. sentrux claims uniqueness via MCP integration and geometric mean, but doesn't benchmark against alternatives.
|
|
71
|
+
|
|
72
|
+
## Sources
|
|
73
|
+
- [[sentrux-github-repo]]: GitHub repository, primary development source, MIT licensed
|
|
74
|
+
- [[sentrux-dev-landing]]: Official marketing website (sentrux.dev)
|
|
75
|
+
- [[sentrux-docs-quality-signal]]: Quality Signal scoring methodology documentation
|
|
76
|
+
- [[sentrux-docs-root-cause-metrics]]: Detailed mathematical definitions of all 5 metrics
|
|
77
|
+
- [[sentrux-docs-rules-engine]]: Rules engine TOML configuration and enforcement documentation
|
|
78
|
+
- [[sentrux-docs-pro-architecture]]: Pro tier architecture, license system, business model
|
|
79
|
+
|
|
80
|
+
## Harness Integration Map
|
|
81
|
+
|
|
82
|
+
sentrux maps onto the ultimate-pi agentic harness at 5 integration points. See [[harness-implementation-plan]] for the updated build plan.
|
|
83
|
+
|
|
84
|
+
| Harness Layer | What sentrux Provides | Replaces |
|
|
85
|
+
|--------------|----------------------|----------|
|
|
86
|
+
| **L2.5 Drift Monitor** | `session_start()`/`session_end()` — structural health baseline + degradation detection per agent session | Augments behavioral drift with structural drift signals |
|
|
87
|
+
| **L3 Grounding** | `scan()` + `check_rules()` — agent gets real-time structural awareness before/after edits; verifies architectural constraints before committing | Adds architectural grounding to existing manual checkpoints |
|
|
88
|
+
| **P20 Gate** | `sentrux check .` — CI-friendly exit 0/1: modularity, acyclicity, depth, equality, redundancy | Joins biome + tsc + fallow (dead code) as fourth deterministic gate |
|
|
89
|
+
| **L5 Observability** | Quality Signal trending via `evolution` tool — continuous metric trackable across sessions | Adds structural dimension to Keep Rate + LLM-as-Judge |
|
|
90
|
+
| **P44 Structural Gate** | Full Fallow replacement: dead code (redundancy), coupling (modularity), cycle detection (acyclicity), god files (equality), depth analysis — all in one tool with MCP + session diff + rules engine | **Replaces Fallow entirely** for P44a-g. Fallow retained only for dead code detection in P20 gate (complementary). |
|
|
91
|
+
|
|
92
|
+
### What sentrux Does NOT Replace
|
|
93
|
+
- **L1 Spec Hardening** — specification analysis (LLM evaluation)
|
|
94
|
+
- **L2 Structured Planning** — task planning (LLM evaluation)
|
|
95
|
+
- **L4 Adversarial Verification** — semantic code review, critic agents (LLM evaluation)
|
|
96
|
+
- **P13 Semantic Code Search (ck)** — BM25+embeddings grep (different concern: semantic vs structural)
|
|
97
|
+
- **P14 Think-in-Code** — coding paradigm enforcement (different concern: process vs structure)
|
|
98
|
+
- **P15 Gitingest** — bulk external repo ingestion (different concern: ingestion vs analysis)
|
|
99
|
+
- **P30 Browser Subagent** — visual UI verification (different domain)
|
|
100
|
+
- **P43 TS Execution Layer** — TypeScript sandbox (different concern: execution vs analysis)
|
|
101
|
+
- **L7 Schema Orchestration** — workflow DAG (different concern: orchestration vs analysis)
|
|
102
|
+
- **L8 Wiki Query** — knowledge base search (different concern: retrieval vs analysis)
|
|
103
|
+
|
|
104
|
+
### Token Budget Impact
|
|
105
|
+
sentrux MCP calls add **0 LLM tokens** to the pipeline budget. All 9 tools are deterministic Rust computations — structural analysis happens outside the LLM context window. This replaces ~500-1,000 tokens of LLM-based structural review that Fallow required for interpretation of its JSON output.
|
|
106
|
+
|
|
107
|
+
### Why sentrux Over Fallow
|
|
108
|
+
| Capability | Fallow | sentrux |
|
|
109
|
+
|-----------|--------|--------|
|
|
110
|
+
| Dead code detection | Yes (redundancy metric) | Yes (redundancy metric) |
|
|
111
|
+
| Duplication detection | Yes | Via redundancy |
|
|
112
|
+
| Complexity (cyclomatic) | Yes | Via equality (Gini) — god file detection |
|
|
113
|
+
| Boundary/coupling analysis | Yes | Yes (modularity + acyclicity) |
|
|
114
|
+
| Dependency depth | No | Yes (Lakos 1996 levelization) |
|
|
115
|
+
| Modularity (Newman 2004) | No | Yes |
|
|
116
|
+
| Single scalar 0-10,000 score | No | Yes (Quality Signal) |
|
|
117
|
+
| MCP server | Yes | Yes (9 tools vs Fallow's tool set) |
|
|
118
|
+
| Session baseline/diff | No | Yes |
|
|
119
|
+
| Rules engine (TOML constraints) | No | Yes |
|
|
120
|
+
| 52 languages | TS/JS only | 52 languages |
|
|
121
|
+
| Open source license | MIT | MIT (free binary) |
|
|
122
|
+
|
|
123
|
+
**Decision:** sentrux is the primary structural quality tool. Fallow is retained only for TypeScript-specific dead code detection in the P20 gate (complementary, not competitive).
|
|
@@ -0,0 +1,164 @@
|
|
|
1
|
+
---
|
|
2
|
+
type: synthesis
|
|
3
|
+
title: "Research: Superpowers Skill for Agentic Coding Agents"
|
|
4
|
+
created: 2026-05-05
|
|
5
|
+
updated: 2026-05-05
|
|
6
|
+
tags:
|
|
7
|
+
- research
|
|
8
|
+
- agent-skills
|
|
9
|
+
- superpowers
|
|
10
|
+
- harness
|
|
11
|
+
- methodology
|
|
12
|
+
status: developing
|
|
13
|
+
related:
|
|
14
|
+
- "[[superpowers-methodology]]"
|
|
15
|
+
- "[[agent-skills-ecosystem]]"
|
|
16
|
+
- "[[jesse-vincent]]"
|
|
17
|
+
- "[[superpowers-github-repo]]"
|
|
18
|
+
- "[[superpowers-release-blog]]"
|
|
19
|
+
- "[[superpowers-termdock-analysis]]"
|
|
20
|
+
- "[[skill-first-architecture]]"
|
|
21
|
+
- "[[agent-skills-pattern]]"
|
|
22
|
+
- "[[policy-engine-pattern]]"
|
|
23
|
+
- "[[agentic-orchestration-pipeline]]"
|
|
24
|
+
- "[[harness-implementation-plan]]"
|
|
25
|
+
sources:
|
|
26
|
+
- "[[superpowers-github-repo]]"
|
|
27
|
+
- "[[superpowers-release-blog]]"
|
|
28
|
+
- "[[superpowers-termdock-analysis]]"
|
|
29
|
+
- "[[superpowers-angle1.json]]"
|
|
30
|
+
- "[[superpowers-angle2.json]]"
|
|
31
|
+
---
|
|
32
|
+
|
|
33
|
+
# Research: Superpowers Skill for Agentic Coding Agents
|
|
34
|
+
|
|
35
|
+
## Overview
|
|
36
|
+
|
|
37
|
+
Superpowers (`obra/superpowers`) by Jesse Vincent is the most-adopted agentic skills framework for AI coding agents — 179K GitHub stars, 15.9K forks, MIT license, v5.1.0 (May 2026). It is a complete software development methodology expressed as composable SKILL.md files that enforce disciplined engineering practices through hard gates. Superpowers does not improve the model — it enforces process. And process, not intelligence, is the real bottleneck for AI coding agents.
|
|
38
|
+
|
|
39
|
+
The framework is deeply relevant to our harness pipeline: Superpowers validates our skill-first architecture, provides a battle-tested pattern for hard-gate enforcement, and can be directly integrated as a `.pi/skills/` skill set. But Superpowers cannot replace our code-level enforcement (drift monitor) — its enforcement is probabilistic (agent compliance with skill instructions), while our harness requires deterministic gates.
|
|
40
|
+
|
|
41
|
+
## Key Findings
|
|
42
|
+
|
|
43
|
+
### 1. Superpowers is process-as-discipline, not model improvement (Source: [[superpowers-github-repo]])
|
|
44
|
+
|
|
45
|
+
Superpowers ships 14+ composable skills organized into a complete development workflow: brainstorming → git-worktrees → writing-plans → subagent-driven-development → TDD → code-review → branch-cleanup. Skills trigger automatically. They are mandatory, not advisory. The agent checks for relevant skills before any task.
|
|
46
|
+
|
|
47
|
+
### 2. Hard gates beat suggestions every time (Source: [[superpowers-termdock-analysis]])
|
|
48
|
+
|
|
49
|
+
"Always write tests first" in CLAUDE.md is a suggestion ignored under pressure. "NO PRODUCTION CODE WITHOUT A FAILING TEST FIRST. Write code before the test? Delete it. Start over." is a gate that cannot be bypassed. Superpowers' core insight: AI agents respond to structure with explicit consequences.
|
|
50
|
+
|
|
51
|
+
### 3. Subagent-driven development is the architectural innovation (Source: [[superpowers-release-blog]])
|
|
52
|
+
|
|
53
|
+
Each task dispatches a fresh subagent with only task description and relevant context — not full conversation history. Two-stage review: spec compliance first, then code quality. Result: Claude can work autonomously for hours without deviating from plan. This prevents context pollution and drift.
|
|
54
|
+
|
|
55
|
+
### 4. Cross-agent portability via plain Markdown (Source: [[agent-skills-ecosystem]])
|
|
56
|
+
|
|
57
|
+
Skills are SKILL.md files — not platform-specific plugins. Work across Claude Code, Codex CLI, Cursor, Gemini CLI, OpenCode, GitHub Copilot, and Factory Droid. The Agent Skills open standard was adopted by all major platforms within weeks of release. 490K+ skills exist across marketplaces as of March 2026.
|
|
58
|
+
|
|
59
|
+
### 5. TDD enforcement with real results (Source: [[superpowers-termdock-analysis]])
|
|
60
|
+
|
|
61
|
+
chardet 7.0.0 shipped using Superpowers: 41x faster, 96.8% accuracy, dozens of longstanding issues fixed. Test suite covering 2,161 files across 99 encodings was a direct product of enforced TDD.
|
|
62
|
+
|
|
63
|
+
### 6. Skill creation is meta — TDD for skills (Source: [[superpowers-release-blog]])
|
|
64
|
+
|
|
65
|
+
Superpowers includes a `writing-skills` skill. Skills are tested by running subagents through realistic pressure scenarios (time pressure, sunk cost). After each failure, skill instructions are strengthened. This is "TDD for skills" — a recursive self-improvement loop.
|
|
66
|
+
|
|
67
|
+
### 7. Persuasion principles work on LLMs (Source: [[superpowers-release-blog]])
|
|
68
|
+
|
|
69
|
+
Cialdini's Influence principles (authority, commitment, scarcity, social proof) measurably affect LLM behavior. A Wharton study co-authored by Dan Shapiro put scientific rigor behind this. Superpowers uses these principles in skill design — not to jailbreak agents, but to make them MORE reliable and disciplined.
|
|
70
|
+
|
|
71
|
+
## How Superpowers Fits Into / Helps Our Workflow
|
|
72
|
+
|
|
73
|
+
### Direct Integration Path
|
|
74
|
+
|
|
75
|
+
Superpowers can be integrated as a skill set within our `.pi/skills/` system:
|
|
76
|
+
|
|
77
|
+
```
|
|
78
|
+
.pi/skills/superpowers/
|
|
79
|
+
├── brainstorming/SKILL.md
|
|
80
|
+
├── writing-plans/SKILL.md
|
|
81
|
+
├── test-driven-development/SKILL.md
|
|
82
|
+
├── systematic-debugging/SKILL.md
|
|
83
|
+
├── subagent-driven-development/SKILL.md
|
|
84
|
+
├── requesting-code-review/SKILL.md
|
|
85
|
+
├── using-git-worktrees/SKILL.md
|
|
86
|
+
└── finishing-a-development-branch/SKILL.md
|
|
87
|
+
```
|
|
88
|
+
|
|
89
|
+
These skills would activate automatically through our existing progressive disclosure mechanism. The agent self-selects relevant skills based on description matching — same as Superpowers' native mechanism.
|
|
90
|
+
|
|
91
|
+
### Mapping to Our Harness Layers
|
|
92
|
+
|
|
93
|
+
| Superpowers Skill | Harness Layer | How It Helps |
|
|
94
|
+
|------------------|---------------|--------------|
|
|
95
|
+
| brainstorming | L1 (Spec Hardening) | Enforces design-before-code; asks clarifying questions; produces signed-off spec |
|
|
96
|
+
| writing-plans | L2 (Structured Planning) | Breaks spec into 2-5 min tasks with exact file paths and verification steps |
|
|
97
|
+
| test-driven-development | L3 (Execute) | Enforces RED-GREEN-REFACTOR as hard gate; deletes code written before tests |
|
|
98
|
+
| systematic-debugging | L3 (Execute) | Four-phase root cause investigation; no fixes without diagnosis |
|
|
99
|
+
| requesting-code-review | L4 (Adversarial) | Fresh subagent reviews against plan; critical issues block progress |
|
|
100
|
+
| using-git-worktrees | L3 (Execute) | Isolated workspace per task; clean baseline verification |
|
|
101
|
+
| subagent-driven-development | L7 (Orchestration) | Dispatches fresh subagent per task; two-stage review; context isolation |
|
|
102
|
+
|
|
103
|
+
### What Superpowers Validates About Our Architecture
|
|
104
|
+
|
|
105
|
+
1. **Skill-first architecture** — Superpowers proves that markdown-based skills are the right primitive for agent discipline. Our May 2026 redesign to skill-first architecture is independently validated by the most-adopted framework.
|
|
106
|
+
|
|
107
|
+
2. **Progressive disclosure** — Superpowers' trigger mechanism (load name+description, activate on match) is identical to our `.pi/skills/` design. Cross-validation increases confidence.
|
|
108
|
+
|
|
109
|
+
3. **Hard-gate enforcement** — Superpowers' "Iron Laws" (delete code written before tests, no fixes without investigation) map directly to our pre-execution policy gates (P-F1 from Gemini CLI research). Both approaches recognize that suggestions fail under pressure.
|
|
110
|
+
|
|
111
|
+
4. **Subagent isolation** — Superpowers' fresh-context-per-task pattern maps to our subagent worktree isolation (P25). Both prevent context pollution.
|
|
112
|
+
|
|
113
|
+
5. **Cross-agent portability** — Superpowers' SKILL.md format works across all major agents. Our `.pi/skills/` format should consider SKILL.md compatibility for ecosystem reuse.
|
|
114
|
+
|
|
115
|
+
### What Superpowers Does NOT Replace
|
|
116
|
+
|
|
117
|
+
Superpowers cannot replace our code-level enforcement:
|
|
118
|
+
|
|
119
|
+
- **Drift Monitor (L2.5)** — Superpowers has no runtime drift detection. It relies on the agent following skill instructions. Our LLM-first drift monitor (Haiku 4.5 every 8 turns) catches semantic drift that skills cannot prevent.
|
|
120
|
+
|
|
121
|
+
- **Pre-execution Policy Gates** — Superpowers' enforcement is probabilistic (model compliance). Our harness needs deterministic gates (exit-code semantics, tool interception) for safety-critical operations.
|
|
122
|
+
|
|
123
|
+
- **Pipeline Orchestration (L7)** — Superpowers chains skills implicitly via agent behavior. Our harness needs explicit DAG-based orchestration with contracts between layers.
|
|
124
|
+
|
|
125
|
+
- **Persistent Memory (L6)** — Superpowers has no cross-session memory beyond the agent's immediate context. Our Obsidian wiki provides canonical memory with ADRs, consensus records, and hot cache.
|
|
126
|
+
|
|
127
|
+
### Recommended Integration Strategy
|
|
128
|
+
|
|
129
|
+
1. **Adopt Superpowers as a skill set** — Add Superpowers skills to `.pi/skills/superpowers/`. The agent loads them on demand via progressive disclosure. Zero code changes needed.
|
|
130
|
+
|
|
131
|
+
2. **Layer deterministic enforcement on top** — Superpowers provides the methodology (probabilistic). Our harness provides the enforcement (deterministic). The drift monitor catches when the agent fails to follow the methodology. The policy engine gates destructive operations.
|
|
132
|
+
|
|
133
|
+
3. **Customize for our workflow** — Fork and customize Superpowers skills to match our harness layers. Add references to wiki (read ADRs before planning, file consensus after decisions). Add allowed-tools restrictions.
|
|
134
|
+
|
|
135
|
+
4. **Maintain SKILL.md compatibility** — Ensure our `.pi/skills/` format remains compatible with the Agent Skills open standard. This enables reuse of the 490K+ ecosystem and cross-agent portability.
|
|
136
|
+
|
|
137
|
+
## Key Entities
|
|
138
|
+
|
|
139
|
+
- [[jesse-vincent]]: Creator of Superpowers, Request Tracker, K-9 Mail. Founder of Prime Radiant.
|
|
140
|
+
|
|
141
|
+
## Key Concepts
|
|
142
|
+
|
|
143
|
+
- [[superpowers-methodology]]: The complete discipline framework — hard gates, composable workflow, two enforcement types
|
|
144
|
+
- [[agent-skills-ecosystem]]: The 490K+ skill marketplace, open standard, cross-agent support, security risks
|
|
145
|
+
|
|
146
|
+
## Contradictions
|
|
147
|
+
|
|
148
|
+
- **Superpowers skills vs CLAUDE.md**: Some HN commenters argue that SKILL.md files are "just elaborate CLAUDE.md files" and no different from good prompts. The key difference: Superpowers uses hard gates with explicit consequences (delete code, start over), not just instructions. CLAUDE.md is informational; SKILL.md is enforceable. But this distinction is probabilistic — compliance depends on the model following instructions.
|
|
149
|
+
- **Community reception**: HN thread on Superpowers launch had mixed reception. Enthusiasts (Simon Willison: "wildly more ambitious") vs skeptics ("voodoo nonsense," "no benchmarks"). The absence of rigorous A/B testing remains a valid criticism.
|
|
150
|
+
- **Security risk**: 36.8% of skills have security flaws. Superpowers itself is safe (MIT, open source, from trusted author), but the broader ecosystem carries supply-chain risk.
|
|
151
|
+
|
|
152
|
+
## Open Questions
|
|
153
|
+
|
|
154
|
+
- Can Superpowers' hard-gate enforcement be made deterministic? (Currently probabilistic — depends on model compliance with skill instructions)
|
|
155
|
+
- How well does Superpowers work with non-Claude models? (Claude Code has deepest integration; other agents get reduced functionality)
|
|
156
|
+
- What is the token cost of full Superpowers workflow? (Not documented; subagent-driven development likely has high token consumption)
|
|
157
|
+
- Should our `.pi/skills/` format adopt SKILL.md compatibility? (Enables ecosystem reuse but reduces our ability to add harness-specific extensions)
|
|
158
|
+
- How do we test skill effectiveness? (Superpowers uses "TDD for skills" with pressure scenarios — can we adopt this for our harness skills?)
|
|
159
|
+
|
|
160
|
+
## Sources
|
|
161
|
+
|
|
162
|
+
- [[superpowers-github-repo]]: Primary source — repo README, architecture, skills library, philosophy
|
|
163
|
+
- [[superpowers-release-blog]]: Original release announcement with development methodology, persuasion principles, memory system
|
|
164
|
+
- [[superpowers-termdock-analysis]]: Third-party deep dive with skill-by-skill analysis, philosophy, practical guidance
|
|
@@ -0,0 +1,244 @@
|
|
|
1
|
+
---
|
|
2
|
+
type: synthesis
|
|
3
|
+
title: "Research: Augment Code Context Engine"
|
|
4
|
+
created: 2026-04-30
|
|
5
|
+
updated: 2026-04-30
|
|
6
|
+
tags:
|
|
7
|
+
- research
|
|
8
|
+
- context-engine
|
|
9
|
+
- augment-code
|
|
10
|
+
- agent-architecture
|
|
11
|
+
- semantic-search
|
|
12
|
+
- chunking
|
|
13
|
+
- embeddings
|
|
14
|
+
status: developing
|
|
15
|
+
related:
|
|
16
|
+
- "[[Context Engine (AI Coding)]]"
|
|
17
|
+
- "[[Semantic Codebase Indexing]]"
|
|
18
|
+
- "[[Prompt Enhancement]]"
|
|
19
|
+
- "[[Dual-Model Agent Architecture]]"
|
|
20
|
+
- "[[Majority Vote Ensembling]]"
|
|
21
|
+
- "[[Contractor vs Employee AI Model]]"
|
|
22
|
+
- "[[Augment Code]]"
|
|
23
|
+
- "[[AST-Aware Code Chunking]]"
|
|
24
|
+
- "[[Contextualized Text Embedding]]"
|
|
25
|
+
- "[[Late Chunking vs Early Chunking]]"
|
|
26
|
+
sources:
|
|
27
|
+
- "[[Augment Context Engine Official]]"
|
|
28
|
+
- "[[Augment SWE-bench Agent GitHub]]"
|
|
29
|
+
- "[[Augment SWE-bench Pro Blog]]"
|
|
30
|
+
- "[[Augment Code WorkOS ERC 2025]]"
|
|
31
|
+
- "[[Augment Code Codacy AI Giants]]"
|
|
32
|
+
- "[[Augment Code MCP SiliconAngle]]"
|
|
33
|
+
- "[[Auggie Context MCP Server]]"
|
|
34
|
+
- "[[cast-code-chunking-paper]]"
|
|
35
|
+
- "[[vectara-chunking-vs-embedding-naacl2025]]"
|
|
36
|
+
- "[[coir-code-retrieval-benchmark]]"
|
|
37
|
+
- "[[code-chunk-library-supermemory]]"
|
|
38
|
+
- "[[embedding-models-benchmark-supermemory-2025]]"
|
|
39
|
+
|
|
40
|
+
---# Research: Augment Code Context Engine
|
|
41
|
+
|
|
42
|
+
## Overview
|
|
43
|
+
|
|
44
|
+
Augment Code's Context Engine is a semantic search engine for codebases that provides AI coding agents with deep understanding of architecture, dependencies, and team patterns. It is the primary differentiator behind Augment's #1 SWE-bench Pro score (51.80%). The core insight: **context quality determines code quality more than model intelligence** — the same model (Claude Opus 4.5) scores 6 points higher with better context.
|
|
45
|
+
|
|
46
|
+
## Key Findings
|
|
47
|
+
|
|
48
|
+
### 1. Context Engine Architecture
|
|
49
|
+
- Semantic indexing of entire codebase (1M+ files) using custom embedding models trained in pairs (Source: [[Augment Context Engine Official]], [[Augment Code Codacy AI Giants]]).
|
|
50
|
+
- Real-time knowledge graph mapping relationships between files, services, dependencies (Source: [[Augment Context Engine Official]]).
|
|
51
|
+
- Intelligent context curation: retrieves only what matters, compresses context, ranks by relevance (Source: [[Augment Context Engine Official]]).
|
|
52
|
+
- Multi-source: code + commit history + team patterns + external docs + tribal knowledge (Source: [[Augment Context Engine Official]]).
|
|
53
|
+
|
|
54
|
+
### 2. Benchmark Performance
|
|
55
|
+
- 65.4% on SWE-bench Verified — #1 open-source implementation (Source: [[Augment SWE-bench Agent GitHub]]).
|
|
56
|
+
- 51.80% on SWE-bench Pro — #1 among tested agents (Source: [[Augment SWE-bench Pro Blog]]).
|
|
57
|
+
- Same model (Claude Opus 4.5): Auggie 51.80%, Cursor 50.21%, Claude Code 49.75% — context retrieval explains the gap (Source: [[Augment SWE-bench Pro Blog]]).
|
|
58
|
+
- As context provider for other agents: 30-80% quality improvement (Source: [[Augment Code MCP SiliconAngle]]).
|
|
59
|
+
|
|
60
|
+
### 3. Agent Architecture
|
|
61
|
+
- **Dual-model**: Claude Sonnet 3.7 as core driver + OpenAI o1 as ensembler (Source: [[Augment SWE-bench Agent GitHub]]).
|
|
62
|
+
- **Majority vote ensembling**: Generate 8 candidate solutions, o1 selects best (Source: [[Augment SWE-bench Agent GitHub]]).
|
|
63
|
+
- **Sequential thinking tool**: Complex problem decomposition (Source: [[Augment SWE-bench Agent GitHub]]).
|
|
64
|
+
- **Parallel execution**: Sharding across machines, 80 agents in parallel (Source: [[Augment SWE-bench Agent GitHub]]).
|
|
65
|
+
|
|
66
|
+
### 4. Prompt Enhancement
|
|
67
|
+
- Automatically enriches user queries with relevant codebase context before LLM sees them (Source: [[Augment Code WorkOS ERC 2025]]).
|
|
68
|
+
- Detects existing utilities/libraries to encourage reuse (Source: [[Augment Code WorkOS ERC 2025]]).
|
|
69
|
+
- "Good code is often no new code at all" (Source: [[Augment Code WorkOS ERC 2025]]).
|
|
70
|
+
|
|
71
|
+
### 5. Context as API/MCP
|
|
72
|
+
- Context Engine launched as MCP server (Feb 2026) — any agent can use it (Source: [[Augment Code MCP SiliconAngle]]).
|
|
73
|
+
- Community MCP wrapper: auggie-context-mcp on npm (Source: [[Auggie Context MCP Server]]).
|
|
74
|
+
- Less powerful model + Augment context > more powerful model + poor context (Source: [[Augment Code MCP SiliconAngle]]).
|
|
75
|
+
|
|
76
|
+
### 6. Real-World Impact (claimed)
|
|
77
|
+
- Onboarding: 18 months → 2 weeks on legacy Java monolith (Source: [[Augment Context Engine Official]]).
|
|
78
|
+
- Refactoring: 6-month estimate → 1 week (Source: [[Augment Context Engine Official]]).
|
|
79
|
+
- Code review: 7 min → 3 min per PR; 60-80% acceptance rate (Source: [[Augment Context Engine Official]], [[Augment Code Codacy AI Giants]]).
|
|
80
|
+
- Test coverage: 45% → 80% in one quarter (Source: [[Augment Context Engine Official]]).
|
|
81
|
+
|
|
82
|
+
## Key Entities
|
|
83
|
+
- [[Augment Code]]: Company building the Context Engine and Auggie agent.
|
|
84
|
+
|
|
85
|
+
## Key Concepts
|
|
86
|
+
- [[Context Engine (AI Coding)]]: Semantic search engine providing deep codebase understanding.
|
|
87
|
+
- [[Semantic Codebase Indexing]]: Converting code to vector embeddings for similarity search.
|
|
88
|
+
- [[Dual-Model Agent Architecture]]: Fast model for iteration + deliberative model for selection.
|
|
89
|
+
- [[Prompt Enhancement]]: Pre-processing queries with retrieved context.
|
|
90
|
+
- [[Majority Vote Ensembling]]: Generating multiple solutions and selecting best via LLM.
|
|
91
|
+
- [[Contractor vs Employee AI Model]]: Context makes the difference, not intelligence.
|
|
92
|
+
|
|
93
|
+
## Implementation Plan: Integration into Our Agentic Coding Harness
|
|
94
|
+
|
|
95
|
+
### Module 1: Semantic Codebase Indexer
|
|
96
|
+
**What**: Embedding-based indexing of all project files.
|
|
97
|
+
**How**:
|
|
98
|
+
- Use sentence-transformers (all-MiniLM-L6-v2) for local embeddings.
|
|
99
|
+
- Chunk code via tree-sitter AST (already available via lean-ctx).
|
|
100
|
+
- Store in LanceDB (embedded, zero-config).
|
|
101
|
+
- Real-time sync via watchdog.
|
|
102
|
+
- Build dependency graph via tree-sitter AST analysis.
|
|
103
|
+
|
|
104
|
+
**Integration with harness**: New `pi_semantic_index` module. Exposes `semantic_search(query, top_k)` API. Complements lean-ctx's exact search with semantic search.
|
|
105
|
+
|
|
106
|
+
### Module 2: Context Retrieval Engine
|
|
107
|
+
**What**: Given a task, retrieve semantically relevant code, patterns, and knowledge.
|
|
108
|
+
**How**:
|
|
109
|
+
- Hybrid search: keyword (BM25) + semantic (cosine similarity).
|
|
110
|
+
- Multi-source: code files + wiki pages + git history + ctx_knowledge.
|
|
111
|
+
- Ranking: relevance × recency × relationship proximity.
|
|
112
|
+
- Context compression: summarize large chunks to fit token budget.
|
|
113
|
+
|
|
114
|
+
**Integration with harness**: New `pi_context_retrieval` module. Exposes `retrieve_context(query, max_tokens)` API. Used by prompt enhancer and agent loop.
|
|
115
|
+
|
|
116
|
+
### Module 3: Prompt Enhancer
|
|
117
|
+
**What**: Pre-process user queries by injecting retrieved context.
|
|
118
|
+
**How**:
|
|
119
|
+
- Query → Context Retrieval Engine → Build augmented prompt.
|
|
120
|
+
- Include: relevant code, existing patterns, related utilities, wiki knowledge.
|
|
121
|
+
- Detect reuse opportunities (existing libraries/utilities).
|
|
122
|
+
- Compress to fit model's context window.
|
|
123
|
+
|
|
124
|
+
**Integration with harness**: New `pi_prompt_enhancer` module. Sits between user input and LLM call. Configurable via harness config.
|
|
125
|
+
|
|
126
|
+
### Module 4: MCP Context Server
|
|
127
|
+
**What**: Expose context retrieval as MCP tool for any AI agent.
|
|
128
|
+
**How**:
|
|
129
|
+
- MCP server providing `query_codebase` tool.
|
|
130
|
+
- Read-only — no file modification.
|
|
131
|
+
- Uses Module 2 (Context Retrieval Engine) under the hood.
|
|
132
|
+
- Supports Claude Desktop, Cursor, and any MCP-compatible agent.
|
|
133
|
+
|
|
134
|
+
**Integration with harness**: New `pi_mcp_context` module. Runs as separate MCP server process. Our own agent can use it, or external agents can.
|
|
135
|
+
|
|
136
|
+
### Module 5: Dual-Model Agent Loop
|
|
137
|
+
**What**: Agent architecture using fast model for iteration + deliberative model for verification.
|
|
138
|
+
**How**:
|
|
139
|
+
- Primary model (Claude Sonnet/Opus) for the main agent loop.
|
|
140
|
+
- Ensembler model (GPT-5/o1) for solution verification and selection.
|
|
141
|
+
- Generate N candidate solutions, ensembler picks best.
|
|
142
|
+
- Configurable: single-model mode for cost-sensitive runs.
|
|
143
|
+
|
|
144
|
+
**Integration with harness**: Enhancement to existing agent loop. Model selection strategy becomes configurable. Adds `ensemble` execution mode.
|
|
145
|
+
|
|
146
|
+
### Module 6: Multi-Source Context Aggregation
|
|
147
|
+
**What**: Unify all context sources available in our harness.
|
|
148
|
+
**How**:
|
|
149
|
+
- Code: lean-ctx (exact) + semantic index (new).
|
|
150
|
+
- Knowledge: wiki vault (existing) + ctx_knowledge (existing).
|
|
151
|
+
- History: git log integration (new).
|
|
152
|
+
- Patterns: extracted from codebase conventions (new).
|
|
153
|
+
- Session: ctx_session cross-session memory (existing).
|
|
154
|
+
|
|
155
|
+
**Integration with harness**: New `pi_context_aggregator` module. Single unified API: `get_full_context(query)` returns merged, ranked, deduplicated context from all sources.
|
|
156
|
+
|
|
157
|
+
## Architecture Diagram
|
|
158
|
+
|
|
159
|
+
```
|
|
160
|
+
┌─────────────────────────────────────────────────────┐
|
|
161
|
+
│ User Query │
|
|
162
|
+
└──────────────────────┬──────────────────────────────┘
|
|
163
|
+
▼
|
|
164
|
+
┌─────────────────────────────────────────────────────┐
|
|
165
|
+
│ Prompt Enhancer (Module 3) │
|
|
166
|
+
│ Original query + retrieved context + patterns │
|
|
167
|
+
└──────────────────────┬──────────────────────────────┘
|
|
168
|
+
▼
|
|
169
|
+
┌─────────────────────────────────────────────────────┐
|
|
170
|
+
│ Context Aggregator (Module 6) │
|
|
171
|
+
│ Merges: code + wiki + git + patterns + session │
|
|
172
|
+
└──┬──────────┬──────────┬──────────┬─────────────────┘
|
|
173
|
+
▼ ▼ ▼ ▼
|
|
174
|
+
┌──────┐ ┌──────┐ ┌──────┐ ┌──────────┐
|
|
175
|
+
│Semantic│ │lean-ctx│ │ Wiki │ │Git/Patterns│
|
|
176
|
+
│ Index │ │(exact) │ │Vault │ │(new) │
|
|
177
|
+
│(new) │ │ │ │ │ │ │
|
|
178
|
+
└──────┘ └──────┘ └──────┘ └──────────┘
|
|
179
|
+
▼
|
|
180
|
+
┌─────────────────────────────────────────────────────┐
|
|
181
|
+
│ Agent Loop (Module 5) │
|
|
182
|
+
│ Primary model (iterative) + Ensembler (selection) │
|
|
183
|
+
└──────────────────────┬──────────────────────────────┘
|
|
184
|
+
▼
|
|
185
|
+
┌─────────────────────────────────────────────────────┐
|
|
186
|
+
│ MCP Context Server (Module 4) │
|
|
187
|
+
│ Exposes context retrieval to external agents │
|
|
188
|
+
└─────────────────────────────────────────────────────┘
|
|
189
|
+
```
|
|
190
|
+
|
|
191
|
+
## Contradictions
|
|
192
|
+
|
|
193
|
+
- **Benchmark scores vary by benchmark type**: SWE-bench Verified scores are higher (65.4% for Augment) than SWE-bench Pro (51.80%). This reflects Pro's greater difficulty (multi-file, multi-language, real task diversity). Claims of "80.9% SWE-bench Verified" from Claude Opus 4.5 come from different evaluation setups. (Source: [[Augment SWE-bench Pro Blog]], cross-referenced with leaderboard listings).
|
|
194
|
+
|
|
195
|
+
- **Self-reported metrics**: Augment's onboarding, refactoring, and velocity claims are from their own marketing/ case studies. No independent verification found. Confidence: medium for impact claims.
|
|
196
|
+
|
|
197
|
+
- **Community MCP vs Official MCP**: The community auggie-context-mcp exists, but Augment has since released an official Context Engine MCP. The community version may be deprecated.
|
|
198
|
+
|
|
199
|
+
## Resolved Questions
|
|
200
|
+
|
|
201
|
+
### Q1: What embedding model and vector DB does Augment use?
|
|
202
|
+
**Status: Partially resolved by inference.** No public disclosure exists. Augment states "custom embedding and retrieval models trained in pairs" (Source: [[Augment Context Engine Official]]). Based on the CoIR code retrieval benchmark (Source: [[coir-code-retrieval-benchmark]]), the top code embedding models as of 2025-2026 are Voyage-code-3, Salesforce SFR-Embedding-Code-2B_R, BGE-code-v1, Jina-embeddings-v4, and Qwen3-Embedding. Augment likely uses a custom variant fine-tuned on their proprietary code corpus. For the vector DB: given 1M+ files with millisecond sync, candidates include Pinecone serverless, Weaviate, Milvus, or a custom sharded FAISS deployment. **No way to confirm without Augment disclosure.**
|
|
203
|
+
|
|
204
|
+
### Q2: What is Augment's chunking strategy and compression algorithm?
|
|
205
|
+
**Status: Resolved by inference from latest research.** While Augment's exact strategy is undisclosed, the state of the art in code chunking as of 2025-2026 is:
|
|
206
|
+
|
|
207
|
+
- **AST-aware chunking** (cAST paper, June 2025): Splits code at syntactic boundaries via tree-sitter AST. Improves Recall@5 by 4.3 points and Pass@1 by 2.67 on SWE-bench (Source: [[cast-code-chunking-paper]]).
|
|
208
|
+
- **Contextualized text**: Prepending file path, scope chain, signatures, and imports to each chunk before embedding — bridges gap between code syntax and natural-language-trained embedding models (Source: [[code-chunk-library-supermemory]]).
|
|
209
|
+
- **Chunking matters more than embedding model**: Vectara NAACL 2025 study across 25 chunking configs × 48 embedding models found chunking strategy equals or exceeds embedding model choice in retrieval quality impact (Source: [[vectara-chunking-vs-embedding-naacl2025]]).
|
|
210
|
+
- **Contextual retrieval** (not full late chunking) is the sweet spot: preserves semantic coherence at moderate compute cost (Source: [[Late Chunking vs Early Chunking]]).
|
|
211
|
+
|
|
212
|
+
**Augment almost certainly uses AST-aware chunking with contextualized text**, given their stated focus on "understanding relationships between files" and "retrieving only what matters."
|
|
213
|
+
|
|
214
|
+
### Q3: Can local embeddings (all-MiniLM-L6-v2) approach comparable quality?
|
|
215
|
+
**Status: Resolved — viable with right chunking strategy, but needs empirical validation.**
|
|
216
|
+
|
|
217
|
+
Benchmark data (Source: [[embedding-models-benchmark-supermemory-2025]]):
|
|
218
|
+
- MiniLM-L6-v2: 78.1% top-5 retrieval accuracy on general text, 14.7ms/1K tokens, 1.2GB GPU
|
|
219
|
+
- BGE-Base-v1.5: 84.7% accuracy, 22.5ms/1K tokens, 2.1GB GPU
|
|
220
|
+
- Nomic Embed v1: 86.2% accuracy, 41.9ms/1K tokens, 4.8GB GPU
|
|
221
|
+
|
|
222
|
+
**Key insight**: The 5-8% accuracy gap between MiniLM and larger models can be partially closed by:
|
|
223
|
+
1. **AST-aware chunking** (higher leverage than model upgrade per Vectara NAACL 2025)
|
|
224
|
+
2. **Contextualized text prepending** (compensates for MiniLM's lack of code-specific training)
|
|
225
|
+
3. **Hybrid search** (BM25 + vector) to catch exact matches that semantic search misses
|
|
226
|
+
|
|
227
|
+
**Code-specific gap is wider**: MiniLM-L6-v2 was trained on general text, not code. Code-specific models (Voyage-code-3, BGE-code-v1) have a larger advantage on code retrieval than the general-text benchmark suggests. Qdrant's code search tutorial notes MiniLM requires "preprocessing code to resemble natural language" while Jina embeddings natively support code (Source: Qdrant docs).
|
|
228
|
+
|
|
229
|
+
**Recommendation**: Start with MiniLM-L6-v2 + AST-aware chunking + contextualized text. Run CoIR benchmark eval against the leaderboard to quantify the gap. If retrieval quality is insufficient, upgrade to BGE-code-v1 (2.1GB GPU, code-native) or all-MiniLM-L12-v2 (same 384-dim but 12-layer, better quality at moderate cost).
|
|
230
|
+
|
|
231
|
+
## Remaining Open Questions
|
|
232
|
+
- [ ] How does real-time sync work at scale (1M+ files)? "Millisecond-level sync" — implementation detail not available.
|
|
233
|
+
- [ ] How does context compression work without losing critical information? Black box.
|
|
234
|
+
- [ ] What is the actual retrieval pipeline (candidate generation → re-ranking)? Partial information only.
|
|
235
|
+
- [ ] Empirical CoIR benchmark validation needed: MiniLM-L6-v2 + AST chunking vs BGE-code-v1 vs Voyage-code-3 on our actual codebase.
|
|
236
|
+
|
|
237
|
+
## Sources
|
|
238
|
+
- [[Augment Context Engine Official]]: Official product page, 2026.
|
|
239
|
+
- [[Augment SWE-bench Agent GitHub]]: Open-source agent, 2025.
|
|
240
|
+
- [[Augment SWE-bench Pro Blog]]: Benchmark results, Feb 2026.
|
|
241
|
+
- [[Augment Code WorkOS ERC 2025]]: Conference demo recap, Oct 2025.
|
|
242
|
+
- [[Augment Code Codacy AI Giants]]: Engineering interview, Mar 2026.
|
|
243
|
+
- [[Augment Code MCP SiliconAngle]]: MCP launch coverage, Feb 2026.
|
|
244
|
+
- [[Auggie Context MCP Server]]: Community MCP wrapper, 2026.
|