ultimate-pi 0.1.2 → 0.1.3
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.agents/skills/ck-search/SKILL.md +99 -0
- package/.agents/skills/defuddle/SKILL.md +90 -0
- package/.agents/skills/find-skills/SKILL.md +142 -0
- package/.agents/skills/firecrawl/SKILL.md +150 -0
- package/.agents/skills/firecrawl/rules/install.md +82 -0
- package/.agents/skills/firecrawl/rules/security.md +26 -0
- package/.agents/skills/firecrawl-agent/SKILL.md +57 -0
- package/.agents/skills/firecrawl-build-interact/SKILL.md +67 -0
- package/.agents/skills/firecrawl-build-onboarding/SKILL.md +102 -0
- package/.agents/skills/firecrawl-build-onboarding/references/auth-flow.md +39 -0
- package/.agents/skills/firecrawl-build-onboarding/references/project-setup.md +20 -0
- package/.agents/skills/firecrawl-build-onboarding/references/sdk-installation.md +17 -0
- package/.agents/skills/firecrawl-build-scrape/SKILL.md +68 -0
- package/.agents/skills/firecrawl-build-search/SKILL.md +68 -0
- package/.agents/skills/firecrawl-crawl/SKILL.md +58 -0
- package/.agents/skills/firecrawl-download/SKILL.md +69 -0
- package/.agents/skills/firecrawl-interact/SKILL.md +83 -0
- package/.agents/skills/firecrawl-map/SKILL.md +50 -0
- package/.agents/skills/firecrawl-parse/SKILL.md +61 -0
- package/.agents/skills/firecrawl-scrape/SKILL.md +68 -0
- package/.agents/skills/firecrawl-search/SKILL.md +59 -0
- package/.agents/skills/obsidian-bases/SKILL.md +299 -0
- package/.agents/skills/obsidian-markdown/SKILL.md +237 -0
- package/.agents/skills/posthog-analyst/SKILL.md +306 -0
- package/.agents/skills/posthog-analyst/evals/evals.json +23 -0
- package/.agents/skills/wiki/SKILL.md +215 -0
- package/.agents/skills/wiki/references/css-snippets.md +122 -0
- package/.agents/skills/wiki/references/frontmatter.md +107 -0
- package/.agents/skills/wiki/references/git-setup.md +58 -0
- package/.agents/skills/wiki/references/mcp-setup.md +149 -0
- package/.agents/skills/wiki/references/modes.md +259 -0
- package/.agents/skills/wiki/references/plugins.md +96 -0
- package/.agents/skills/wiki/references/rest-api.md +124 -0
- package/.agents/skills/wiki-autoresearch/SKILL.md +211 -0
- package/.agents/skills/wiki-autoresearch/references/program.md +75 -0
- package/.agents/skills/wiki-fold/SKILL.md +204 -0
- package/.agents/skills/wiki-fold/references/fold-template.md +133 -0
- package/.agents/skills/wiki-ingest/SKILL.md +288 -0
- package/.agents/skills/wiki-lint/SKILL.md +183 -0
- package/.agents/skills/wiki-query/SKILL.md +176 -0
- package/.agents/skills/wiki-save/SKILL.md +128 -0
- package/.ckignore +41 -0
- package/.env.example +9 -0
- package/.github/workflows/lint.yml +33 -0
- package/.github/workflows/publish-github-packages.yml +35 -0
- package/.github/workflows/publish-npm.yml +1 -1
- package/.pi/SYSTEM.md +107 -40
- package/.pi/agents/pi-pi/agent-expert.md +205 -0
- package/.pi/agents/pi-pi/cli-expert.md +47 -0
- package/.pi/agents/pi-pi/config-expert.md +67 -0
- package/.pi/agents/pi-pi/ext-expert.md +53 -0
- package/.pi/agents/pi-pi/keybinding-expert.md +123 -0
- package/.pi/agents/pi-pi/pi-orchestrator.md +103 -0
- package/.pi/agents/pi-pi/prompt-expert.md +83 -0
- package/.pi/agents/pi-pi/skill-expert.md +52 -0
- package/.pi/agents/pi-pi/theme-expert.md +46 -0
- package/.pi/agents/pi-pi/tui-expert.md +100 -0
- package/.pi/agents/rethink.md +140 -0
- package/.pi/agents/wiki-ingest.md +67 -0
- package/.pi/agents/wiki-lint.md +75 -0
- package/.pi/auto-commit.json +20 -0
- package/.pi/extensions/banner.png +0 -0
- package/.pi/extensions/ck-enforce.ts +216 -0
- package/.pi/extensions/custom-footer.ts +308 -0
- package/.pi/extensions/custom-header.ts +116 -0
- package/.pi/extensions/dotenv-loader.ts +170 -0
- package/.pi/internal/cursor-sdk-transcript-parser.ts +59 -0
- package/.pi/model-router.json +95 -0
- package/.pi/npm/.gitignore +2 -0
- package/.pi/prompts/git-sync.md +124 -0
- package/.pi/prompts/harness-setup.md +509 -0
- package/.pi/prompts/save.md +16 -0
- package/.pi/prompts/wiki-autoresearch.md +19 -0
- package/.pi/prompts/wiki.md +23 -0
- package/.pi/providers/cursor-sdk-provider.test.mjs +476 -0
- package/.pi/providers/cursor-sdk-provider.ts +1085 -0
- package/.pi/settings.json +14 -4
- package/.pi/skills/agent-router/SKILL.md +174 -0
- package/.pi/sounds/alert/1-kaching-track.mp3 +0 -0
- package/.pi/sounds/error/1-ksi-wth-track.mp3 +0 -0
- package/.pi/sounds/error/2-smash-track.mp3 +0 -0
- package/.pi/sounds/error/3-buzzer-track.mp3 +0 -0
- package/.pi/sounds/notification/1-soft-notification-track.mp3 +0 -0
- package/.pi/sounds/project-sounds.json +25 -0
- package/.pi/sounds/reminder/1-soft-notification-track.mp3 +0 -0
- package/.pi/sounds/success/1-tada-track.mp3 +0 -0
- package/.pi/sounds/success/2-jobs-done-track.mp3 +0 -0
- package/.pi/sounds/success/3-yay-track.mp3 +0 -0
- package/CONTRIBUTING.md +116 -0
- package/README.md +32 -39
- package/biome.json +34 -0
- package/firecrawl/.env.template +58 -0
- package/firecrawl/README.md +49 -0
- package/firecrawl/docker-compose.yaml +201 -0
- package/firecrawl/searxng/searxng.env +3 -0
- package/firecrawl/searxng/settings.yml +85 -0
- package/lefthook.yml +8 -0
- package/package.json +55 -24
- package/vault/AGENTS.md +37 -0
- package/vault/wiki/_templates/comparison.md +39 -0
- package/vault/wiki/_templates/concept.md +40 -0
- package/vault/wiki/_templates/decision.md +21 -0
- package/vault/wiki/_templates/entity.md +32 -0
- package/vault/wiki/_templates/flow.md +14 -0
- package/vault/wiki/_templates/module.md +18 -0
- package/vault/wiki/_templates/question.md +31 -0
- package/vault/wiki/_templates/source.md +39 -0
- package/vault/wiki/concepts/AST-Aware Code Chunking.md +44 -0
- package/vault/wiki/concepts/Build-Time Prompt Compilation.md +107 -0
- package/vault/wiki/concepts/Context Engine (AI Coding).md +47 -0
- package/vault/wiki/concepts/Context-Aware System Reminders.md +61 -0
- package/vault/wiki/concepts/Contextualized Text Embedding.md +42 -0
- package/vault/wiki/concepts/Contractor vs Employee AI Model.md +55 -0
- package/vault/wiki/concepts/Dual-Model Agent Architecture.md +65 -0
- package/vault/wiki/concepts/Late Chunking vs Early Chunking.md +43 -0
- package/vault/wiki/concepts/Majority Vote Ensembling.md +68 -0
- package/vault/wiki/concepts/Meta-Harness.md +16 -0
- package/vault/wiki/concepts/Multi-Agent AI Coding Architecture.md +75 -0
- package/vault/wiki/concepts/Prompt Enhancement.md +90 -0
- package/vault/wiki/concepts/Prompt Renderer.md +89 -0
- package/vault/wiki/concepts/Semantic Codebase Indexing.md +67 -0
- package/vault/wiki/concepts/additive-config-hierarchy.md +16 -0
- package/vault/wiki/concepts/agent-artifacts-verifiable-deliverables.md +71 -0
- package/vault/wiki/concepts/agent-browser-browser-automation.md +99 -0
- package/vault/wiki/concepts/agent-codebase-interface.md +43 -0
- package/vault/wiki/concepts/agent-harness-architecture.md +67 -0
- package/vault/wiki/concepts/agent-loop-detection-patterns.md +133 -0
- package/vault/wiki/concepts/agent-search-enforcement.md +126 -0
- package/vault/wiki/concepts/agent-skills-ecosystem.md +74 -0
- package/vault/wiki/concepts/agent-skills-pattern.md +68 -0
- package/vault/wiki/concepts/agentic-harness-context-enforcement.md +91 -0
- package/vault/wiki/concepts/agentic-harness.md +34 -0
- package/vault/wiki/concepts/agentic-orchestration-pipeline.md +56 -0
- package/vault/wiki/concepts/agentic-search-no-embeddings.md +18 -0
- package/vault/wiki/concepts/anthropic-context-engineering.md +13 -0
- package/vault/wiki/concepts/antigravity-agent-first-architecture.md +61 -0
- package/vault/wiki/concepts/ast-compression.md +19 -0
- package/vault/wiki/concepts/ast-truncation.md +66 -0
- package/vault/wiki/concepts/barrel-files.md +37 -0
- package/vault/wiki/concepts/browser-harness-agent.md +41 -0
- package/vault/wiki/concepts/browser-subagent-visual-verification.md +82 -0
- package/vault/wiki/concepts/codebase-intelligence-ecosystem-comparison.md +192 -0
- package/vault/wiki/concepts/codebase-intelligence-harness-integration.md +161 -0
- package/vault/wiki/concepts/codebase-to-context-ingestion.md +46 -0
- package/vault/wiki/concepts/codex-harness-innovations.md +147 -0
- package/vault/wiki/concepts/consensus-debate-flow.md +17 -0
- package/vault/wiki/concepts/consensus-debate.md +206 -0
- package/vault/wiki/concepts/content-addressed-spec-identity.md +166 -0
- package/vault/wiki/concepts/context-anxiety.md +57 -0
- package/vault/wiki/concepts/context-compression-techniques.md +19 -0
- package/vault/wiki/concepts/context-continuity.md +22 -0
- package/vault/wiki/concepts/context-drift-in-agents.md +106 -0
- package/vault/wiki/concepts/context-engineering.md +62 -0
- package/vault/wiki/concepts/context-folding.md +67 -0
- package/vault/wiki/concepts/context-mode.md +38 -0
- package/vault/wiki/concepts/cursor-harness-innovations.md +107 -0
- package/vault/wiki/concepts/deterministic-session-compaction.md +79 -0
- package/vault/wiki/concepts/drift-detection-unified.md +296 -0
- package/vault/wiki/concepts/execution-feedback-loop.md +46 -0
- package/vault/wiki/concepts/feedforward-feedback-harness.md +60 -0
- package/vault/wiki/concepts/five-root-cause-metrics-sentrux.md +40 -0
- package/vault/wiki/concepts/fork-safe-spec-storage.md +89 -0
- package/vault/wiki/concepts/fts5-sandbox.md +19 -0
- package/vault/wiki/concepts/fuzzy-edit-matching.md +71 -0
- package/vault/wiki/concepts/gemini-cli-architecture.md +104 -0
- package/vault/wiki/concepts/generator-evaluator-architecture.md +64 -0
- package/vault/wiki/concepts/guardian-agent-pattern.md +67 -0
- package/vault/wiki/concepts/harness-configuration-layers.md +89 -0
- package/vault/wiki/concepts/harness-control-frameworks.md +155 -0
- package/vault/wiki/concepts/harness-engineering-first-principles.md +90 -0
- package/vault/wiki/concepts/harness-h-formalism.md +53 -0
- package/vault/wiki/concepts/hybrid-code-search.md +61 -0
- package/vault/wiki/concepts/inline-post-edit-validation.md +112 -0
- package/vault/wiki/concepts/legendary-engineering-patterns-harness.md +110 -0
- package/vault/wiki/concepts/lifecycle-hooks.md +94 -0
- package/vault/wiki/concepts/mcp-tool-routing.md +102 -0
- package/vault/wiki/concepts/memory-system-of-record-vs-ephemeral-cache.md +47 -0
- package/vault/wiki/concepts/meta-agent-context-pruning.md +151 -0
- package/vault/wiki/concepts/model-adaptive-harness.md +122 -0
- package/vault/wiki/concepts/model-routing-agents.md +101 -0
- package/vault/wiki/concepts/monorepo-architecture.md +45 -0
- package/vault/wiki/concepts/multi-agent-specialization.md +61 -0
- package/vault/wiki/concepts/permission-subsystem.md +16 -0
- package/vault/wiki/concepts/pi-messenger-analysis.md +243 -0
- package/vault/wiki/concepts/pi-vscode-extension-landscape.md +37 -0
- package/vault/wiki/concepts/policy-engine-pattern.md +78 -0
- package/vault/wiki/concepts/progressive-disclosure-agents.md +53 -0
- package/vault/wiki/concepts/progressive-skill-disclosure.md +17 -0
- package/vault/wiki/concepts/provider-native-prompting.md +203 -0
- package/vault/wiki/concepts/quality-signal-sentrux.md +37 -0
- package/vault/wiki/concepts/repo-map-ranking.md +42 -0
- package/vault/wiki/concepts/result-monad-error-handling.md +47 -0
- package/vault/wiki/concepts/safety-defense-in-depth.md +83 -0
- package/vault/wiki/concepts/sandbox-os-enforcement.md +18 -0
- package/vault/wiki/concepts/selective-debate-routing.md +70 -0
- package/vault/wiki/concepts/self-evolving-harness.md +60 -0
- package/vault/wiki/concepts/sentrux-mcp-integration.md +36 -0
- package/vault/wiki/concepts/sentrux-rules-engine.md +49 -0
- package/vault/wiki/concepts/shell-pattern-compression.md +24 -0
- package/vault/wiki/concepts/skill-first-architecture.md +166 -0
- package/vault/wiki/concepts/structured-compaction.md +78 -0
- package/vault/wiki/concepts/subagent-orchestration.md +17 -0
- package/vault/wiki/concepts/subagent-worktree-isolation.md +68 -0
- package/vault/wiki/concepts/superpowers-methodology.md +78 -0
- package/vault/wiki/concepts/think-in-code.md +73 -0
- package/vault/wiki/concepts/ts-execution-layer.md +100 -0
- package/vault/wiki/concepts/typescript-strict-mode.md +37 -0
- package/vault/wiki/concepts/vcc-conversation-compaction-for-pi.md +51 -0
- package/vault/wiki/concepts/verification-drift-detection.md +19 -0
- package/vault/wiki/consensus/consensus-records.md +58 -0
- package/vault/wiki/decisions/2026-04-30-pi-lean-ctx-native.md +122 -0
- package/vault/wiki/decisions/adr-008.md +40 -0
- package/vault/wiki/decisions/adr-009.md +46 -0
- package/vault/wiki/decisions/adr-010.md +55 -0
- package/vault/wiki/decisions/adr-011.md +165 -0
- package/vault/wiki/decisions/adr-012.md +102 -0
- package/vault/wiki/decisions/adr-013.md +59 -0
- package/vault/wiki/decisions/adr-014.md +73 -0
- package/vault/wiki/decisions/adr-015.md +81 -0
- package/vault/wiki/decisions/adr-016.md +91 -0
- package/vault/wiki/decisions/adr-017.md +79 -0
- package/vault/wiki/decisions/adr-018.md +100 -0
- package/vault/wiki/decisions/adr-019.md +75 -0
- package/vault/wiki/decisions/adr-020.md +106 -0
- package/vault/wiki/decisions/adr-021.md +86 -0
- package/vault/wiki/decisions/adr-022.md +113 -0
- package/vault/wiki/decisions/adr-023.md +113 -0
- package/vault/wiki/decisions/adr-024.md +73 -0
- package/vault/wiki/decisions/adr-025.md +130 -0
- package/vault/wiki/decisions/adr-026.md +56 -0
- package/vault/wiki/decisions/colocate-wiki.md +34 -0
- package/vault/wiki/entities/Anders Hejlsberg.md +29 -0
- package/vault/wiki/entities/Anthropic.md +17 -0
- package/vault/wiki/entities/Augment Code.md +49 -0
- package/vault/wiki/entities/Bjarne Stroustrup.md +26 -0
- package/vault/wiki/entities/Bolt.new (StackBlitz).md +39 -0
- package/vault/wiki/entities/Boris Cherny.md +11 -0
- package/vault/wiki/entities/Claude Code.md +19 -0
- package/vault/wiki/entities/Dennis Ritchie.md +26 -0
- package/vault/wiki/entities/Emergent Labs.md +32 -0
- package/vault/wiki/entities/Google Cloud.md +16 -0
- package/vault/wiki/entities/Guido van Rossum.md +28 -0
- package/vault/wiki/entities/Ken Thompson.md +28 -0
- package/vault/wiki/entities/Lee et al.md +16 -0
- package/vault/wiki/entities/Linus Torvalds.md +28 -0
- package/vault/wiki/entities/Lovable (company).md +40 -0
- package/vault/wiki/entities/Martin Fowler.md +16 -0
- package/vault/wiki/entities/Meng et al.md +16 -0
- package/vault/wiki/entities/OpenAI.md +16 -0
- package/vault/wiki/entities/Rocket.new.md +38 -0
- package/vault/wiki/entities/VILA-Lab.md +15 -0
- package/vault/wiki/entities/autodev-codebase.md +18 -0
- package/vault/wiki/entities/ck-tool.md +59 -0
- package/vault/wiki/entities/codesearch.md +18 -0
- package/vault/wiki/entities/disler-indydevdan.md +33 -0
- package/vault/wiki/entities/gsd-get-shit-done.md +56 -0
- package/vault/wiki/entities/javascript-runtimes.md +48 -0
- package/vault/wiki/entities/jesse-vincent.md +38 -0
- package/vault/wiki/entities/lean-ctx.md +32 -0
- package/vault/wiki/entities/opendev.md +41 -0
- package/vault/wiki/entities/ops-codegraph-tool.md +18 -0
- package/vault/wiki/entities/pi-coding-agent.md +53 -0
- package/vault/wiki/entities/sentrux.md +54 -0
- package/vault/wiki/entities/vgrep-tool.md +57 -0
- package/vault/wiki/entities/vitest.md +41 -0
- package/vault/wiki/flows/harness-wiki-pipeline.md +204 -0
- package/vault/wiki/hot.md +932 -0
- package/vault/wiki/index.md +437 -0
- package/vault/wiki/log.md +418 -0
- package/vault/wiki/meta/dashboard.md +30 -0
- package/vault/wiki/meta/lint-report-2026-04-30.md +86 -0
- package/vault/wiki/meta/lint-report-2026-05-02.md +251 -0
- package/vault/wiki/meta/overview.canvas +43 -0
- package/vault/wiki/modules/adversarial-verification.md +57 -0
- package/vault/wiki/modules/automated-observability.md +54 -0
- package/vault/wiki/modules/bench.md +20 -0
- package/vault/wiki/modules/extensions.md +23 -0
- package/vault/wiki/modules/grounding-checkpoints.md +62 -0
- package/vault/wiki/modules/harness-implementation-plan.md +345 -0
- package/vault/wiki/modules/harness-wiki-skill-mapping.md +135 -0
- package/vault/wiki/modules/harness.md +86 -0
- package/vault/wiki/modules/persistent-memory.md +85 -0
- package/vault/wiki/modules/schema-orchestration.md +68 -0
- package/vault/wiki/modules/skills.md +27 -0
- package/vault/wiki/modules/spec-hardening.md +58 -0
- package/vault/wiki/modules/structured-planning.md +53 -0
- package/vault/wiki/modules/think-in-code-enforcement.md +153 -0
- package/vault/wiki/modules/wiki-query-interface.md +64 -0
- package/vault/wiki/overview.md +51 -0
- package/vault/wiki/questions/Research-pi-vs-claude-code-agentic-orchestration-pipeline.md +87 -0
- package/vault/wiki/questions/Research-sentrux-dev.md +123 -0
- package/vault/wiki/questions/Research-superpowers-skill-for-agentic-coding-agents.md +164 -0
- package/vault/wiki/questions/Research: Augment Code Context Engine.md +244 -0
- package/vault/wiki/questions/Research: Automating Software Engineering - Lovable, Bolt, Emergent, Rocket.md +112 -0
- package/vault/wiki/questions/Research: Claude Code State-of-the-Art Harness Improvements.md +209 -0
- package/vault/wiki/questions/Research: Codex State-of-the-Art Harness Improvements.md +99 -0
- package/vault/wiki/questions/Research: Engineering Workflows of Legendary Programmers and AI Harness Mapping.md +107 -0
- package/vault/wiki/questions/Research: Fallow Codebase Intelligence Harness Integration.md +72 -0
- package/vault/wiki/questions/Research: Gemini CLI SOTA Harness Integration.md +166 -0
- package/vault/wiki/questions/Research: GitHub Issues as Harness Spec Storage.md +188 -0
- package/vault/wiki/questions/Research: Google Antigravity Harness Integration.md +120 -0
- package/vault/wiki/questions/Research: Meta-Agent Context Drift Detection.md +236 -0
- package/vault/wiki/questions/Research: Model-Adaptive Agent Harness Design.md +95 -0
- package/vault/wiki/questions/Research: Model-Specific Prompting Guides.md +165 -0
- package/vault/wiki/questions/Research: Prompt Renderer for Multi-Model Agent Harness.md +216 -0
- package/vault/wiki/questions/Research: Skill-First Harness Architecture.md +91 -0
- package/vault/wiki/questions/Research: TypeScript Best Practices and Codebase Structure.md +88 -0
- package/vault/wiki/questions/Research: TypeScript Execution Layer for Agent Tool Calling.md +81 -0
- package/vault/wiki/questions/Research: claude-mem over Obsidian for Harness Layer.md +71 -0
- package/vault/wiki/questions/Research: claude-mem over obsidian wiki as the knowledge base for our agentic harness pipeline. think from first principles. does this replace or complement our current setup? no hard feelings about previous decisions. gimme accurate points.md +80 -0
- package/vault/wiki/questions/Research: context-mode vs lean-ctx.md +72 -0
- package/vault/wiki/questions/Research: cursor.sh Harness Innovations.md +92 -0
- package/vault/wiki/questions/Research: executor.sh Harness Integration.md +170 -0
- package/vault/wiki/questions/Research: how GSD fits into our coding harness setup.md +97 -0
- package/vault/wiki/questions/Research: how claude-mem fits into our workflow. and whether it should replace obsidian in the codebase. no hard feelings about previous actions, rethink from first principles always.md +80 -0
- package/vault/wiki/questions/Research: pi-vcc.md +113 -0
- package/vault/wiki/questions/Research: semantic code search tools.md +69 -0
- package/vault/wiki/questions/Research: vcc extension for pi coding agent.md +73 -0
- package/vault/wiki/questions/how-to-enable-semantic-code-search-now.md +111 -0
- package/vault/wiki/questions/mvp-implementation-blueprint.md +552 -0
- package/vault/wiki/questions/research-agent-first-codebase-exploration.md +199 -0
- package/vault/wiki/questions/research-agentic-coding-harness-latest-papers.md +142 -0
- package/vault/wiki/questions/research-gitingest-gitreverse-integration.md +100 -0
- package/vault/wiki/questions/research-wozcode-token-reduction.md +67 -0
- package/vault/wiki/questions/resolved-context-pruning-inplace-vs-restart.md +95 -0
- package/vault/wiki/questions/resolved-context-window-economics.md +167 -0
- package/vault/wiki/questions/resolved-imad-debate-gating-transfer.md +126 -0
- package/vault/wiki/questions/resolved-mcp-tool-preference.md +112 -0
- package/vault/wiki/questions/resolved-small-model-meta-agents.md +107 -0
- package/vault/wiki/questions/resolved-treesitter-dynamic-languages.md +95 -0
- package/vault/wiki/sources/Auggie Context MCP Server.md +63 -0
- package/vault/wiki/sources/Augment Code Codacy AI Giants.md +61 -0
- package/vault/wiki/sources/Augment Code MCP SiliconAngle.md +49 -0
- package/vault/wiki/sources/Augment Code WorkOS ERC 2025.md +55 -0
- package/vault/wiki/sources/Augment Context Engine Official.md +71 -0
- package/vault/wiki/sources/Augment SWE-bench Agent GitHub.md +74 -0
- package/vault/wiki/sources/Augment SWE-bench Pro Blog.md +58 -0
- package/vault/wiki/sources/Source: AgentBus Jinja2 Prompt Pipelines.md +75 -0
- package/vault/wiki/sources/Source: Arxiv /342/200/224 Don't Break the Cache.md" +85 -0
- package/vault/wiki/sources/Source: Augment - Harness Engineering for AI Coding Agents.md +58 -0
- package/vault/wiki/sources/Source: Blake Crosley Agent Architecture Guide.md +100 -0
- package/vault/wiki/sources/Source: Bolt.new Architecture & Case Study.md +75 -0
- package/vault/wiki/sources/Source: Build-Time Prompt Compilation Architecture.md +107 -0
- package/vault/wiki/sources/Source: Claude API Agent Skills Overview.md +70 -0
- package/vault/wiki/sources/Source: Gemini CLI Changelogs.md +88 -0
- package/vault/wiki/sources/Source: Google Blog - Gemini CLI Announcement.md +57 -0
- package/vault/wiki/sources/Source: Google Gemini CLI Architecture Docs.md +53 -0
- package/vault/wiki/sources/Source: LangChain - Anatomy of Agent Harness.md +65 -0
- package/vault/wiki/sources/Source: Lovable Architecture & Clone Analysis.md +83 -0
- package/vault/wiki/sources/Source: Martin Fowler - Harness Engineering.md +70 -0
- package/vault/wiki/sources/Source: OpenAI Harness Engineering Five Principles.md +58 -0
- package/vault/wiki/sources/Source: OpenAI Harness Engineering /342/200/224 0 Lines of Human Code.md" +101 -0
- package/vault/wiki/sources/Source: OpenDev /342/200/224 Building AI Coding Agents for the Terminal.md" +100 -0
- package/vault/wiki/sources/Source: Render AI Coding Agents Benchmark 2025.md +53 -0
- package/vault/wiki/sources/Source: Rocket.new /342/200/224 Vibe Solutioning Platform.md" +70 -0
- package/vault/wiki/sources/Source: SwirlAI Agent Skills Progressive Disclosure.md +71 -0
- package/vault/wiki/sources/Source: TianPan Prompt Caching Architecture.md +89 -0
- package/vault/wiki/sources/Source: Vercel Labs agent-browser.md +155 -0
- package/vault/wiki/sources/Source: browser-harness CDP Harness.md +126 -0
- package/vault/wiki/sources/agent-drift-academic-paper.md +79 -0
- package/vault/wiki/sources/aider-repomap-tree-sitter.md +42 -0
- package/vault/wiki/sources/anthropic-compaction-api.md +58 -0
- package/vault/wiki/sources/anthropic-effective-harnesses.md +42 -0
- package/vault/wiki/sources/anthropic-prompt-best-practices.md +100 -0
- package/vault/wiki/sources/anthropic2026-harness-design.md +63 -0
- package/vault/wiki/sources/barrel-files-tkdodo.md +38 -0
- package/vault/wiki/sources/birth-of-unix-kernighan-interview.md +57 -0
- package/vault/wiki/sources/bockeler2026-harness-engineering.md +69 -0
- package/vault/wiki/sources/cast-code-chunking-paper.md +50 -0
- package/vault/wiki/sources/ck-semantic-search.md +78 -0
- package/vault/wiki/sources/claude-code-architecture-karaxai-2026.md +71 -0
- package/vault/wiki/sources/claude-code-architecture-qubytes-2026.md +50 -0
- package/vault/wiki/sources/claude-code-architecture-vila-lab-2026.md +64 -0
- package/vault/wiki/sources/claude-code-security-architecture-penligent-2026.md +70 -0
- package/vault/wiki/sources/claude-context-editing-docs.md +13 -0
- package/vault/wiki/sources/cloudflare-codemode.md +63 -0
- package/vault/wiki/sources/code-chunk-library-supermemory.md +63 -0
- package/vault/wiki/sources/codeact-apple-2024.md +62 -0
- package/vault/wiki/sources/codex-dsc-rfc-8573.md +41 -0
- package/vault/wiki/sources/codex-open-source-agent-2026.md +110 -0
- package/vault/wiki/sources/coir-code-retrieval-benchmark.md +51 -0
- package/vault/wiki/sources/colinmcnamara-context-optimization-codemode.md +48 -0
- package/vault/wiki/sources/context-folding-paper.md +61 -0
- package/vault/wiki/sources/context-mode-website.md +63 -0
- package/vault/wiki/sources/cursor-agent-best-practices-2026.md +62 -0
- package/vault/wiki/sources/cursor-fork-29b-2025.md +50 -0
- package/vault/wiki/sources/cursor-harness-april-2026.md +76 -0
- package/vault/wiki/sources/cursor-instant-apply-2024.md +45 -0
- package/vault/wiki/sources/cursor-shadow-workspace-2024.md +52 -0
- package/vault/wiki/sources/cursor-shipped-coding-agent-2026.md +53 -0
- package/vault/wiki/sources/cursor-vs-antigravity-2026.md +51 -0
- package/vault/wiki/sources/disler-pi-vs-claude-code.md +69 -0
- package/vault/wiki/sources/distill-deterministic-context-compression.md +53 -0
- package/vault/wiki/sources/embedding-models-benchmark-supermemory-2025.md +48 -0
- package/vault/wiki/sources/executor-rhyssullivan.md +122 -0
- package/vault/wiki/sources/fallow-rs-codebase-intelligence.md +125 -0
- package/vault/wiki/sources/fan2025-imad.md +60 -0
- package/vault/wiki/sources/forgecode-gpt5-agent-improvements.md +63 -0
- package/vault/wiki/sources/gemini-3-prompting-guide.md +78 -0
- package/vault/wiki/sources/gh-cli-sub-issue-rfc.md +50 -0
- package/vault/wiki/sources/gh-sub-issue-extension.md +72 -0
- package/vault/wiki/sources/github-fork-issues-discussion.md +44 -0
- package/vault/wiki/sources/github-issue-dependencies-docs.md +49 -0
- package/vault/wiki/sources/github-sub-issues-docs.md +51 -0
- package/vault/wiki/sources/gitingest.md +91 -0
- package/vault/wiki/sources/gitreverse.md +63 -0
- package/vault/wiki/sources/google-antigravity-official-blog.md +47 -0
- package/vault/wiki/sources/google-antigravity-wikipedia.md +53 -0
- package/vault/wiki/sources/gsd-codecentric-deep-dive.md +57 -0
- package/vault/wiki/sources/gsd-github-repo.md +51 -0
- package/vault/wiki/sources/gsd-hn-discussion.md +59 -0
- package/vault/wiki/sources/guido-python-design-philosophy.md +56 -0
- package/vault/wiki/sources/hejlsberg-7-learnings.md +48 -0
- package/vault/wiki/sources/ironclaw-drift-monitor.md +80 -0
- package/vault/wiki/sources/langsight-loop-detection.md +80 -0
- package/vault/wiki/sources/leanctx-website.md +69 -0
- package/vault/wiki/sources/lee2026-meta-harness.md +59 -0
- package/vault/wiki/sources/linux-kernel-coding-workflow.md +50 -0
- package/vault/wiki/sources/lou2026-autoharness.md +53 -0
- package/vault/wiki/sources/martin-fowler-harness-engineering.md +73 -0
- package/vault/wiki/sources/mcp-architecture-docs.md +13 -0
- package/vault/wiki/sources/meng2026-agent-harness-survey.md +79 -0
- package/vault/wiki/sources/mindstudio-four-agent-types.md +68 -0
- package/vault/wiki/sources/ms-chat-history-management.md +13 -0
- package/vault/wiki/sources/openai-prompt-guidance.md +104 -0
- package/vault/wiki/sources/openclaw-session-pruning.md +13 -0
- package/vault/wiki/sources/opencode-dcp.md +13 -0
- package/vault/wiki/sources/opendev-arxiv-2603.05344v1.md +79 -0
- package/vault/wiki/sources/openhands-platform.md +39 -0
- package/vault/wiki/sources/oss-guide-codebase-exploration.md +53 -0
- package/vault/wiki/sources/pi-compaction-extensions-ecosystem.md +102 -0
- package/vault/wiki/sources/pi-context-prune-github-repo.md +38 -0
- package/vault/wiki/sources/pi-mono-compaction-docs.md +38 -0
- package/vault/wiki/sources/pi-omni-compact-github-repo.md +50 -0
- package/vault/wiki/sources/pi-rtk-optimizer-github-repo.md +45 -0
- package/vault/wiki/sources/pi-vcc-github-repo.md +69 -0
- package/vault/wiki/sources/pi-vscode-marketplace.md +41 -0
- package/vault/wiki/sources/pi-vscode-model-provider-marketplace.md +39 -0
- package/vault/wiki/sources/py-tree-sitter.md +13 -0
- package/vault/wiki/sources/sentrux-dev-landing.md +40 -0
- package/vault/wiki/sources/sentrux-docs-pro-architecture.md +75 -0
- package/vault/wiki/sources/sentrux-docs-quality-signal.md +46 -0
- package/vault/wiki/sources/sentrux-docs-root-cause-metrics.md +57 -0
- package/vault/wiki/sources/sentrux-docs-rules-engine.md +58 -0
- package/vault/wiki/sources/sentrux-github-repo.md +56 -0
- package/vault/wiki/sources/superpowers-github-repo.md +56 -0
- package/vault/wiki/sources/superpowers-release-blog.md +54 -0
- package/vault/wiki/sources/superpowers-termdock-analysis.md +45 -0
- package/vault/wiki/sources/swe-agent-aci.md +42 -0
- package/vault/wiki/sources/swe-bench.md +45 -0
- package/vault/wiki/sources/swe-pruner-context-pruning.md +13 -0
- package/vault/wiki/sources/think-in-code-blog.md +48 -0
- package/vault/wiki/sources/tree-sitter-docs.md +13 -0
- package/vault/wiki/sources/ts-best-practices-2025-devto.md +42 -0
- package/vault/wiki/sources/ts-folder-structure-mingyang.md +58 -0
- package/vault/wiki/sources/ts-monorepo-koerselman.md +44 -0
- package/vault/wiki/sources/ts-result-error-handling-kkalamarski.md +52 -0
- package/vault/wiki/sources/ts-runtimes-comparison-betterstack.md +42 -0
- package/vault/wiki/sources/ts-strict-mode-rishikc.md +43 -0
- package/vault/wiki/sources/unix-philosophy.md +48 -0
- package/vault/wiki/sources/vectara-chunking-vs-embedding-naacl2025.md +39 -0
- package/vault/wiki/sources/vectara-guardian-agents.md +79 -0
- package/vault/wiki/sources/vgrep-semantic-search.md +76 -0
- package/vault/wiki/sources/vitest-official.md +41 -0
- package/vault/wiki/sources/vscode-pi-community-extension.md +40 -0
- package/vault/wiki/sources/wozcode.md +79 -0
- package/.agents/skills/compress/SKILL.md +0 -111
- package/.agents/skills/compress/scripts/__init__.py +0 -9
- package/.agents/skills/compress/scripts/__main__.py +0 -3
- package/.agents/skills/compress/scripts/benchmark.py +0 -78
- package/.agents/skills/compress/scripts/cli.py +0 -73
- package/.agents/skills/compress/scripts/compress.py +0 -227
- package/.agents/skills/compress/scripts/detect.py +0 -121
- package/.agents/skills/compress/scripts/validate.py +0 -189
- package/.agents/skills/emil-design-eng/SKILL.md +0 -679
- package/.agents/skills/lean-ctx/SKILL.md +0 -149
- package/.agents/skills/lean-ctx/scripts/install.sh +0 -95
- package/.agents/skills/scrapling-official/LICENSE.txt +0 -28
- package/.agents/skills/scrapling-official/SKILL.md +0 -390
- package/.agents/skills/scrapling-official/examples/01_fetcher_session.py +0 -26
- package/.agents/skills/scrapling-official/examples/02_dynamic_session.py +0 -26
- package/.agents/skills/scrapling-official/examples/03_stealthy_session.py +0 -26
- package/.agents/skills/scrapling-official/examples/04_spider.py +0 -58
- package/.agents/skills/scrapling-official/examples/README.md +0 -45
- package/.agents/skills/scrapling-official/references/fetching/choosing.md +0 -78
- package/.agents/skills/scrapling-official/references/fetching/dynamic.md +0 -352
- package/.agents/skills/scrapling-official/references/fetching/static.md +0 -432
- package/.agents/skills/scrapling-official/references/fetching/stealthy.md +0 -255
- package/.agents/skills/scrapling-official/references/mcp-server.md +0 -214
- package/.agents/skills/scrapling-official/references/migrating_from_beautifulsoup.md +0 -86
- package/.agents/skills/scrapling-official/references/parsing/adaptive.md +0 -212
- package/.agents/skills/scrapling-official/references/parsing/main_classes.md +0 -586
- package/.agents/skills/scrapling-official/references/parsing/selection.md +0 -494
- package/.agents/skills/scrapling-official/references/spiders/advanced.md +0 -344
- package/.agents/skills/scrapling-official/references/spiders/architecture.md +0 -94
- package/.agents/skills/scrapling-official/references/spiders/getting-started.md +0 -164
- package/.agents/skills/scrapling-official/references/spiders/proxy-blocking.md +0 -235
- package/.agents/skills/scrapling-official/references/spiders/requests-responses.md +0 -196
- package/.agents/skills/scrapling-official/references/spiders/sessions.md +0 -205
- package/PLAN.md +0 -11
- package/extensions/lean-ctx-enforce.ts +0 -166
- package/skills-lock.json +0 -35
- package/wiki/README.md +0 -19
- package/wiki/decisions/0001-establish-project-wiki-and-decision-record-format.md +0 -25
- package/wiki/decisions/0002-add-project-banner-to-readme.md +0 -26
- package/wiki/decisions/0003-remove-redundant-readme-title-heading.md +0 -26
- package/wiki/decisions/0004-publish-package-to-npm-as-ultimate-pi.md +0 -26
- package/wiki/decisions/0005-automate-npm-publish-with-github-actions.md +0 -27
- package/wiki/decisions/0006-switch-to-npm-trusted-publishing.md +0 -26
- package/wiki/decisions/0007-use-absolute-banner-url-for-npm-readme-rendering.md +0 -26
- package/wiki/decisions/0008-rename-banner-asset-for-cache-busting.md +0 -26
- package/wiki/decisions/0009-force-oidc-path-by-clearing-node-auth-token-in-publish-step.md +0 -25
- package/wiki/decisions/0010-simplify-setup-node-for-npm-trusted-publishing.md +0 -26
- package/wiki/decisions/0011-add-noop-workflow-change-to-force-fresh-publish-run.md +0 -25
- package/wiki/decisions/0012-align-workflow-runtime-with-npm-trusted-publishing-requirements.md +0 -26
- package/wiki/decisions/0013-add-package-repository-url-for-provenance-validation.md +0 -25
|
@@ -0,0 +1,112 @@
|
|
|
1
|
+
---
|
|
2
|
+
type: synthesis
|
|
3
|
+
title: "Research: Automating Software Engineering — Practices from Lovable, Bolt, Emergent, Rocket"
|
|
4
|
+
created: 2026-05-03
|
|
5
|
+
updated: 2026-05-03
|
|
6
|
+
tags:
|
|
7
|
+
- research
|
|
8
|
+
- ai-coding
|
|
9
|
+
- harness
|
|
10
|
+
- multi-agent
|
|
11
|
+
- platform
|
|
12
|
+
- context-engineering
|
|
13
|
+
status: developing
|
|
14
|
+
related:
|
|
15
|
+
- "[[Lovable (company)]]"
|
|
16
|
+
- "[[Bolt.new (StackBlitz)]]"
|
|
17
|
+
- "[[Rocket.new]]"
|
|
18
|
+
- "[[Emergent Labs]]"
|
|
19
|
+
- "[[Source: Lovable Architecture & Clone Analysis]]"
|
|
20
|
+
- "[[Source: Bolt.new Architecture & Case Study]]"
|
|
21
|
+
- "[[Source: Rocket.new — Vibe Solutioning Platform]]"
|
|
22
|
+
- "[[Source: OpenAI Harness Engineering — 0 Lines of Human Code]]"
|
|
23
|
+
- "[[Source: OpenDev — Building AI Coding Agents for the Terminal]]"
|
|
24
|
+
- "[[generator-evaluator-architecture]]"
|
|
25
|
+
- "[[context-engineering]]"
|
|
26
|
+
- "[[progressive-disclosure-agents]]"
|
|
27
|
+
- "[[multi-agent-AI-coding-architecture]]"
|
|
28
|
+
- "[[Context-Aware System Reminders]]"
|
|
29
|
+
- "[[anthropic2026-harness-design]]"
|
|
30
|
+
sources:
|
|
31
|
+
- "[[Source: Lovable Architecture & Clone Analysis]]"
|
|
32
|
+
- "[[Source: Bolt.new Architecture & Case Study]]"
|
|
33
|
+
- "[[Source: Rocket.new — Vibe Solutioning Platform]]"
|
|
34
|
+
- "[[Source: OpenAI Harness Engineering — 0 Lines of Human Code]]"
|
|
35
|
+
- "[[Source: OpenDev — Building AI Coding Agents for the Terminal]]"
|
|
36
|
+
- "[[anthropic2026-harness-design]]"
|
|
37
|
+
---
|
|
38
|
+
|
|
39
|
+
# Research: Automating Software Engineering — Practices from Lovable, Bolt, Emergent, Rocket
|
|
40
|
+
|
|
41
|
+
## Overview
|
|
42
|
+
|
|
43
|
+
Four platforms (Lovable, Bolt.new, Emergent Labs, Rocket.new) are attacking full-stack software engineering automation from different angles. Lovable and Bolt.new focus on **prompt-to-production web apps** with browser-based execution. Rocket.new adds **pre-build strategy** ("vibe solutioning"). Emergent builds **autonomous coding agents**. Combined with deep engineering reports from OpenAI (Codex) and Anthropic (harness design), clear first-principles patterns emerge for building an AI coding harness.
|
|
44
|
+
|
|
45
|
+
## Key Findings
|
|
46
|
+
|
|
47
|
+
### 1. Multi-Agent Architecture Is Universal
|
|
48
|
+
Every successful platform decomposes work across specialized agents. Lovable's clone architecture uses **Planner → Architect → Coder** with Pydantic-typed handoffs. Anthropic uses **Planner → Generator → Evaluator** with sprint contracts. OpenAI Codex uses **agent-to-agent review loops** (Ralph Wiggum pattern). OpenDev uses **dual-agent separation** (thinking vs execution) with subagent spawning. The pattern: **don't make one agent do everything**. (Source: [[Source: Lovable Architecture & Clone Analysis]], [[anthropic2026-harness-design]], [[Source: OpenAI Harness Engineering — 0 Lines of Human Code]], [[Source: OpenDev — Building AI Coding Agents for the Terminal]])
|
|
49
|
+
|
|
50
|
+
### 2. Environment Control Is the Moat
|
|
51
|
+
Bolt.new's key differentiator: **WebContainers give AI complete control** over filesystem, node server, package manager, terminal, and browser console. This is what turned Claude from a code suggester into an app builder. OpenAI replicated this: Codex drives apps via Chrome DevTools Protocol, has its own ephemeral observability stack per worktree. Bolt hit $4M ARR in 4 weeks after adding Claude + WebContainers. (Source: [[Source: Bolt.new Architecture & Case Study]], [[Source: OpenAI Harness Engineering — 0 Lines of Human Code]])
|
|
52
|
+
|
|
53
|
+
### 3. Structured Outputs Prevent Chaos
|
|
54
|
+
The Lovable clone's key insight: moving from text-based AI interactions to **Pydantic-validated structured outputs** transforms AI from demo to production. Each agent receives validated objects, not messy text. OpenAI enforces architectural boundaries mechanically via custom linters — "enforce invariants, not micromanage implementations." OpenDev uses schema-level tool gating: make dangerous tools invisible to the agent, not just blocked. (Source: [[Source: Lovable Architecture & Clone Analysis]], [[Source: OpenAI Harness Engineering — 0 Lines of Human Code]], [[Source: OpenDev — Building AI Coding Agents for the Terminal]])
|
|
55
|
+
|
|
56
|
+
### 4. Context Engineering Is the Central Constraint
|
|
57
|
+
OpenAI's finding: **"Context is a scarce resource."** A giant AGENTS.md file crowds out the task. Instead: short AGENTS.md as table of contents pointing to a structured `docs/` directory. OpenDev implements 5-stage adaptive compaction (70%→99% thresholds), dual-memory architecture (episodic + working memory), event-driven system reminders at decision points. Anthropic found that context resets (not just compaction) are necessary when models exhibit "context anxiety." (Source: [[Source: OpenDev — Building AI Coding Agents for the Terminal]], [[Source: OpenAI Harness Engineering — 0 Lines of Human Code]], [[anthropic2026-harness-design]])
|
|
58
|
+
|
|
59
|
+
### 5. Repository Knowledge as System of Record
|
|
60
|
+
OpenAI's framing: **"What Codex can't see doesn't exist."** All knowledge must live in the repository — not in Slack threads, Google Docs, or people's heads. Design docs, execution plans, quality scores are all versioned and co-located with code. Dedicated "doc-gardening" agents scan for stale documentation. Rocket.new takes this further: **one shared context across strategy → build → competitive intelligence.** (Source: [[Source: OpenAI Harness Engineering — 0 Lines of Human Code]], [[Source: Rocket.new — Vibe Solutioning Platform]])
|
|
61
|
+
|
|
62
|
+
### 6. "Code Generation Is a Commodity" — The Pre-Build Layer Matters
|
|
63
|
+
Rocket.new's thesis: everyone can generate code now. The missing piece is **deciding what to build and tracking what happens after.** Their platform covers the full arc: market research → product strategy → app building → competitive intelligence. Raised $15M, 1.5M users across 180 countries. Pricing: $25-$350/month, with consulting-style reports at $250 tier. (Source: [[Source: Rocket.new — Vibe Solutioning Platform]])
|
|
64
|
+
|
|
65
|
+
### 7. Generator-Evaluator Loop (GAN-Inspired)
|
|
66
|
+
Anthropic's breakthrough: separating generator from evaluator. Agents "confidently praise their own mediocre work" — but tuning a standalone evaluator to be skeptical works. Each criterion has a hard threshold — fall below any, sprint fails. The evaluator uses Playwright to actually click through the app. OpenAI does the same at scale: "Codex reviews its own changes locally, requests additional agent reviews, responds to feedback, iterates in a loop until all agent reviewers are satisfied." (Source: [[anthropic2026-harness-design]], [[Source: OpenAI Harness Engineering — 0 Lines of Human Code]])
|
|
67
|
+
|
|
68
|
+
### 8. Progressive Disclosure: Maps, Not Encyclopedias
|
|
69
|
+
OpenAI tried the "one big AGENTS.md" approach. It failed: context scarcity, too much guidance becomes non-guidance, rots instantly, hard to verify. Instead: **short AGENTS.md (∼100 lines) as table of contents**, pointing to a structured `docs/` directory. OpenDev implements conditional prompt composition: sections load only when contextually relevant (e.g., git workflow section only in git repos). Skills use 2-phase loading: metadata index at startup, full content on-demand. (Source: [[Source: OpenAI Harness Engineering — 0 Lines of Human Code]], [[Source: OpenDev — Building AI Coding Agents for the Terminal]])
|
|
70
|
+
|
|
71
|
+
### 9. "No Manually-Written Code" Philosophy
|
|
72
|
+
OpenAI Codex built a product with **0 lines of human-written code** over 5 months, ∼1 million lines, ∼1,500 PRs, with 3-7 engineers. Humans steer, agents execute. Engineers became systems designers: building scaffolding, guardrails, and feedback loops. Codex wrote even its own AGENTS.md. This required redefining the engineer's role entirely. (Source: [[Source: OpenAI Harness Engineering — 0 Lines of Human Code]])
|
|
73
|
+
|
|
74
|
+
### 10. Garbage Collection for AI Slop
|
|
75
|
+
OpenAI's finding: agents replicate existing patterns — including bad ones. Initially spent Fridays (20% of week) cleaning "AI slop." Solution: encode "golden principles" mechanically, run recurring background cleanup agents, enforce continuously. Technical debt treated as "high-interest loan" — pay continuously in small increments. (Source: [[Source: OpenAI Harness Engineering — 0 Lines of Human Code]])
|
|
76
|
+
|
|
77
|
+
## Key Entities
|
|
78
|
+
|
|
79
|
+
- **[[Lovable (company)]]**: Full-stack AI dev platform (formerly GPT Engineer). SOC 2, ISO 27001. Browser-based with GitHub sync. "Orchestration layer, not just models."
|
|
80
|
+
- **[[Bolt.new (StackBlitz)]]**: Browser-based AI web dev. WebContainers + Claude. 0→$4M ARR in 4 weeks. Open source. Remix + Radix UI + UnoCSS.
|
|
81
|
+
- **[[Rocket.new]]**: "Vibe Solutioning" platform: strategy + building + competitive intel. $15M seed. 1.5M users. Based in Surat, India.
|
|
82
|
+
- **[[Emergent Labs]]**: YC S24. "Autonomous coding agents that replace traditional software development." Building full-stack web & mobile apps from conversation.
|
|
83
|
+
|
|
84
|
+
## Key Concepts
|
|
85
|
+
|
|
86
|
+
- **[[generator-evaluator-architecture]]**: GAN-inspired multi-agent pattern. Generator builds, evaluator grades against explicit criteria.
|
|
87
|
+
- **[[Context-Aware System Reminders]]**: Event-driven injection of behavioral guidance at decision points. Addresses attention-decay in long sessions.
|
|
88
|
+
- **[[progressive-disclosure-agents]]**: Give agents maps (short AGENTS.md as ToC), not encyclopedias. Load details on-demand.
|
|
89
|
+
- **[[multi-agent-AI-coding-architecture]]**: Planner → Architect → Coder pattern with structured handoffs.
|
|
90
|
+
|
|
91
|
+
## Contradictions
|
|
92
|
+
|
|
93
|
+
- **Anthropic says context resets are essential** for Sonnet 4.5 due to "context anxiety." **OpenAI says compaction + progressive disclosure** works for Codex. OpenDev uses **5-stage compaction, not resets.** The difference may be model-specific — Opus 4.6 eliminated the need for resets per Anthropic.
|
|
94
|
+
- **Rocket.new says code generation is commoditized** — the frontier is pre-build strategy. **Lovable and Bolt.new** are still competing aggressively on code generation quality. The market hasn't fully shifted yet.
|
|
95
|
+
- **OpenAI enforces architecture mechanically** (linters, structural tests). **Anthropic uses prompting + evaluator contracts**. Both work; the OpenAI approach is more robust but requires more upfront investment.
|
|
96
|
+
|
|
97
|
+
## Open Questions
|
|
98
|
+
|
|
99
|
+
- How does the planner-generator-evaluator loop scale to existing large codebases (not greenfield apps)? All current demos are new projects.
|
|
100
|
+
- Can "sprint contracts" work for bug fixing and refactoring, not just feature building?
|
|
101
|
+
- When does the evaluator become unnecessary? Anthropic says as models improve, the boundary moves. How to automatically detect when?
|
|
102
|
+
- How to adapt context management strategies (compaction vs resets) per model, automatically?
|
|
103
|
+
- Can Rocket.new's "vibe solutioning" pre-build layer be integrated into a coding harness to automate scope definition?
|
|
104
|
+
|
|
105
|
+
## Sources
|
|
106
|
+
|
|
107
|
+
- [[Source: Lovable Architecture & Clone Analysis]]: Multi-agent architecture, structured outputs, LangGraph + Groq
|
|
108
|
+
- [[Source: Bolt.new Architecture & Case Study]]: WebContainers, Claude integration, Remix frontend, $4M ARR
|
|
109
|
+
- [[Source: Rocket.new — Vibe Solutioning Platform]]: Strategy → Build → Intelligence, $15M seed, 1.5M users
|
|
110
|
+
- [[Source: OpenAI Harness Engineering — 0 Lines of Human Code]]: Codex, architectural constraints, progressive disclosure, garbage collection
|
|
111
|
+
- [[Source: OpenDev — Building AI Coding Agents for the Terminal]]: Compound AI, dual-agent, adaptive compaction, system reminders
|
|
112
|
+
- [[anthropic2026-harness-design]]: GAN-inspired harness, generator-evaluator loop, sprint contracts
|
|
@@ -0,0 +1,209 @@
|
|
|
1
|
+
---
|
|
2
|
+
type: synthesis
|
|
3
|
+
title: "Research: Claude Code State-of-the-Art Harness Improvements"
|
|
4
|
+
created: 2026-05-01
|
|
5
|
+
updated: 2026-05-01
|
|
6
|
+
tags:
|
|
7
|
+
- research
|
|
8
|
+
- claude-code
|
|
9
|
+
- harness-design
|
|
10
|
+
- first-principles
|
|
11
|
+
- agent-architecture
|
|
12
|
+
status: developing
|
|
13
|
+
related:
|
|
14
|
+
- "[[harness-implementation-plan]]"
|
|
15
|
+
- "[[model-adaptive-harness]]"
|
|
16
|
+
- "[[agentic-harness]]"
|
|
17
|
+
- "[[cursor-harness-innovations]]"
|
|
18
|
+
- "[[Research: cursor.sh Harness Innovations]]"
|
|
19
|
+
- "[[Research: Google Antigravity Harness Integration]]"
|
|
20
|
+
- "[[provider-native-prompting]]"
|
|
21
|
+
- "[[harness-configuration-layers]]"
|
|
22
|
+
- "[[feedforward-feedback-harness]]"
|
|
23
|
+
- "[[self-evolving-harness]]"
|
|
24
|
+
sources:
|
|
25
|
+
- "[[claude-code-architecture-vila-lab-2026]]"
|
|
26
|
+
- "[[claude-code-architecture-qubytes-2026]]"
|
|
27
|
+
- "[[claude-code-architecture-karaxai-2026]]"
|
|
28
|
+
- "[[claude-code-security-architecture-penligent-2026]]"
|
|
29
|
+
|
|
30
|
+
---# Research: Claude Code State-of-the-Art Harness Improvements
|
|
31
|
+
|
|
32
|
+
## Overview
|
|
33
|
+
|
|
34
|
+
Claude Code (Anthropic) is the most architecturally sophisticated agentic coding system in production. Research across 4 primary sources — an academic paper (VILA-Lab, arxiv 2604.14228), a security-focused architecture deep-dive (Penligent), a systems-level walkthrough (KaraxAI), and a five-layer architecture breakdown (Qubytes) — reveals innovations that fundamentally challenge assumptions in our current harness design. Claude Code's architecture was reverse-engineered from a leaked 510K-line TypeScript codebase, revealing a system far more sophisticated than public documentation suggests.
|
|
35
|
+
|
|
36
|
+
## Key Findings
|
|
37
|
+
|
|
38
|
+
### Architecture Philosophy
|
|
39
|
+
|
|
40
|
+
- **Agent Loop > Fixed Pipeline** (Source: [[claude-code-architecture-vila-lab-2026]]): Claude Code is a `while` loop surrounded by infrastructure — not a sequential pipeline. "The core agent loop — assemble context, call model, receive tool request, execute it, repeat — is conceptually simple. The real engineering genius lives in everything around that loop." Our 8-layer pipeline is sequential; Claude Code's loop is reactive.
|
|
41
|
+
- **System, not chatbot** (Source: [[claude-code-security-architecture-penligent-2026]]): "Claude Code is a governed execution environment with a model in the middle. This is not just 'Claude plus bash.'"
|
|
42
|
+
- **Five human values → 13 design principles** (Source: [[claude-code-architecture-vila-lab-2026]]): Human decision authority, safety/security, reliable execution, capability amplification, contextual adaptability. Each value traces through specific implementation choices.
|
|
43
|
+
- **Independent validation of First Principle #1** (Source: [[claude-code-architecture-karaxai-2026]]): "The model is the commodity; the agent is the product." Directly validates our FP #1: "The harness — not the model — determines reliability at scale."
|
|
44
|
+
|
|
45
|
+
### 1. Five-Layer Compaction Pipeline
|
|
46
|
+
|
|
47
|
+
The most underappreciated Claude Code innovation. Not simple truncation — structured extraction followed by selective reconstruction:
|
|
48
|
+
|
|
49
|
+
- Forked subagent produces ~6,500 token structured summary tuned specifically for software engineering tasks
|
|
50
|
+
- Preserves: file paths, code snippets, error histories, active skills, plan state, tool deltas
|
|
51
|
+
- Triggered at ~83.5% of 200K context window
|
|
52
|
+
- Compaction instructions embedded in CLAUDE.md for domain-specific preservation
|
|
53
|
+
- PreCompact/PostCompact hooks for archiving full transcripts before compression
|
|
54
|
+
- ~85% payload reduction (167K → ~25K tokens)
|
|
55
|
+
|
|
56
|
+
**Our gap**: P3-P4 has basic context pruning (rule-based stuck-pattern detection, correction injection). Nothing like structured multi-layer compaction with forked subagent. **This is the single biggest gap in our harness design.**
|
|
57
|
+
|
|
58
|
+
### 2. Lifecycle Hook System (Deterministic Policy)
|
|
59
|
+
|
|
60
|
+
The most architecturally novel feature. 30+ hook events spanning full lifecycle, each with JSON input/output contracts:
|
|
61
|
+
|
|
62
|
+
| Hook Event | When Fires | Control |
|
|
63
|
+
|---|---|---|
|
|
64
|
+
| `PreToolUse` | Before tool execution | Allow/deny/ask/defer, modify input |
|
|
65
|
+
| `PostToolUse` | After tool succeeds | Audit, auto-format, replace output |
|
|
66
|
+
| `PostToolUseFailure` | After tool fails | Inject correction context |
|
|
67
|
+
| `PostToolBatch` | After parallel tool batch | Batch-level context injection |
|
|
68
|
+
| `PermissionRequest` | When permission dialog appears | Programmatic allow/deny |
|
|
69
|
+
| `Stop` / `SubagentStop` | When agent finishes | Prevent stopping, re-invoke |
|
|
70
|
+
| `UserPromptSubmit` | Before prompt processed | Block, inject context |
|
|
71
|
+
| `SessionStart` / `SessionEnd` | Session lifecycle | Load context, cleanup |
|
|
72
|
+
| `PreCompact` / `PostCompact` | Before/after compaction | Archive, block |
|
|
73
|
+
| `SubagentStart` / `SubagentStop` | Subagent lifecycle | Inject context, validate output |
|
|
74
|
+
| `TaskCreated` / `TaskCompleted` | Task lifecycle | Enforce naming, validate completion |
|
|
75
|
+
| `ConfigChange` | Config files modified | Audit, block unauthorized changes |
|
|
76
|
+
| `CwdChanged` / `FileChanged` | Directory/file changes | Reactive env management |
|
|
77
|
+
| `WorktreeCreate` / `WorktreeRemove` | Isolation lifecycle | Custom VCS integration |
|
|
78
|
+
| `Notification` | System notifications | Forward to external services |
|
|
79
|
+
|
|
80
|
+
Five hook types: **command** (shell script, exit codes), **HTTP** (webhook), **MCP tool** (call MCP server), **prompt** (single-turn LLM evaluation), **agent** (multi-turn subagent with tool access).
|
|
81
|
+
|
|
82
|
+
Critical distinction: **CLAUDE.md achieves ~92% compliance. Hooks achieve 100% compliance** for conditions they match. This is the deterministic escape hatch from probabilistic prompt-based control.
|
|
83
|
+
|
|
84
|
+
Exit code semantics: `0` = success (allow), `2` = blocking error (deny, stderr fed to Claude), other = non-blocking error (continue execution).
|
|
85
|
+
|
|
86
|
+
**Our gap**: Our harness has extension hooks at the layer level (`extensions/harness-*.ts`). But we lack tool-level lifecycle hooks with deterministic exit-code semantics. This is a fundamental architectural gap.
|
|
87
|
+
|
|
88
|
+
### 3. Permission System as Architectural Subsystem
|
|
89
|
+
|
|
90
|
+
Claude Code treats permission checking as architecturally separate from tool execution — a first-class subsystem sitting between the agent loop and tool execution:
|
|
91
|
+
|
|
92
|
+
- **7 permission modes**: `default` (read-only), `acceptEdits` (auto-approve edits + safe fs ops), `plan` (read-only exploration + plan writing), `auto` (ML classifier reviews every action), `dontAsk` (only pre-approved tools), `bypassPermissions` (no checks, isolated environments only)
|
|
93
|
+
- **ML-based auto classifier**: Separate model reviews each action in auto mode. Blocks actions that go beyond task, target untrusted infrastructure, or appear driven by prompt injection. Auto mode drops broad allow rules that would short-circuit the classifier.
|
|
94
|
+
- **Rule syntax** (`allow`/`deny`/`ask`): First matching rule wins. `Tool` or `Tool(specifier)` patterns. Same rule language reused across hooks, CLI automation, and settings.
|
|
95
|
+
- **Four configuration scopes**: Managed (org-controlled), User (`~/.claude/`), Project (`.claude/`, Git-shared), Local (`.claude/settings.local.json`, gitignored). Managed settings can enforce `allowManagedHooksOnly`, `allowManagedMcpServersOnly`, `allowManagedPermissionRulesOnly`.
|
|
96
|
+
|
|
97
|
+
**Our gap**: We have NO permission system. L7 orchestration enforces pipeline stages but does not gate individual tool calls. This is a major architectural gap for any production deployment.
|
|
98
|
+
|
|
99
|
+
### 4. Subagent Architecture with Deep Isolation
|
|
100
|
+
|
|
101
|
+
- **Fresh 200K context window per subagent**: Only final summary returns to parent. All intermediate tool calls, file reads, and reasoning stay isolated.
|
|
102
|
+
- **Worktree isolation**: `isolation: worktree` gives subagent a temporary Git worktree — isolated filesystem copy. Enables parallel editing without conflicts. Blast-radius control.
|
|
103
|
+
- **Tool allowlists/denylists per subagent**: Security-review subagent gets Read+Grep+Glob but no Edit/Write. Different subagents get different capability surfaces.
|
|
104
|
+
- **No nesting**: One level of subagent spawning only — prevents infinite recursion.
|
|
105
|
+
- **Sidechain transcripts**: Subagent interactions captured in separate transcripts, keeping main thread clean.
|
|
106
|
+
- **Custom subagents in YAML**: Defined in `.claude/agents/` or `~/.claude/agents/`. Configurable: tools, model, permission mode, persistent memory, isolation settings.
|
|
107
|
+
|
|
108
|
+
**Our gap**: P25 subagent router is cost-based dispatch without worktree isolation. No sidechain transcripts. No per-subagent tool restrictions. No custom subagent definitions in config files.
|
|
109
|
+
|
|
110
|
+
### 5. CLAUDE.md Hierarchical System
|
|
111
|
+
|
|
112
|
+
Not a single file — a layered system with additive precedence:
|
|
113
|
+
|
|
114
|
+
```
|
|
115
|
+
Global (~/.claude/CLAUDE.md) → Enterprise (managed) → Project (.claude/CLAUDE.md) → Local (.claude/CLAUDE.local.md) → Notebook
|
|
116
|
+
```
|
|
117
|
+
|
|
118
|
+
- **Conditional rules**: YAML frontmatter with `match: "*.test.ts"` or `paths: ["src/api/**"]`. Rules only load when relevant files are accessed.
|
|
119
|
+
- **96% compliance** with 5 conditional rule files of 30 lines each, vs 92% for single 150-line CLAUDE.md
|
|
120
|
+
- **Injected as `<system-reminder>` tags**: Wrapped in XML, re-sent every API call (not cached in system prompt). Survives compaction because re-read from disk every turn.
|
|
121
|
+
- **Three memory systems**: CLAUDE.md (reliable, user-controlled), Auto-memory (lossy, 200-line limit, Claude-maintained), Session memory (lossy, conversation history gets compacted)
|
|
122
|
+
|
|
123
|
+
**Our gap**: Our wiki pages serve a similar role but lack the single-entry-point, additive-hierarchy, conditional-loading design. SKILL.md files cover some of this but differently (loaded on invocation, not always-present). No conditional rule matching.
|
|
124
|
+
|
|
125
|
+
### 6. Skills with Progressive Disclosure
|
|
126
|
+
|
|
127
|
+
- **Name + description loaded at startup** (~100 tokens per skill). Listed in `<available_skills>` block.
|
|
128
|
+
- **Full SKILL.md body loaded on-demand** via Skill tool call. Only when invoked by user or Claude.
|
|
129
|
+
- **Skills can restrict tools** (`allowed-tools`), include supporting files, spawn subagents.
|
|
130
|
+
- **Distinct from slash commands**: Skills are model-invoked (or user `/skill-name`). Slash commands (`/clear`, `/compact`) are deterministic CLI operations.
|
|
131
|
+
|
|
132
|
+
**Our gap**: Our skills load full SKILL.md content always. We partially implement progressive disclosure through the `description` field, but don't have the on-demand loading mechanism.
|
|
133
|
+
|
|
134
|
+
### 7. Plugin Ecosystem
|
|
135
|
+
|
|
136
|
+
- **9,000+ plugins** across registries. Official Anthropic marketplace ships built-in.
|
|
137
|
+
- **Bundles**: Skills + agents + hooks + MCP servers as a single installable unit.
|
|
138
|
+
- **Namespacing**: `/my-plugin:hello` prevents skill name conflicts.
|
|
139
|
+
- **Agent override**: Plugin can replace main agent's system prompt, tool restrictions, model selection.
|
|
140
|
+
- **Plugin subagents** cannot use `hooks`, `mcpServers`, or `permissionMode` — security boundary.
|
|
141
|
+
|
|
142
|
+
**Our gap**: No plugin distribution layer. Our skills are project-local. Not critical for CLI harness but limits ecosystem growth.
|
|
143
|
+
|
|
144
|
+
### 8. Agentic Search (No Embeddings)
|
|
145
|
+
|
|
146
|
+
Claude Code deliberately rejects vector embeddings for code search:
|
|
147
|
+
|
|
148
|
+
- **Glob → Grep → Read** hierarchy: File path pattern matching → content search via ripgrep → full file load
|
|
149
|
+
- **"Agentic search generally works better"** than RAG (Boris Cherny, Claude Code creator)
|
|
150
|
+
- Rationale: Code symbols are exact (`getUserById` ≠ `fetchAccountDetails`), indexes drift during active editing, embeddings leak code information as vectors, zero setup friction
|
|
151
|
+
- **Explore subagent** (Haiku) for deep exploration — searches, reads, reasons, returns only summary
|
|
152
|
+
|
|
153
|
+
**Our gap**: P13 (Semantic Code Search via ck MCP) is explicitly embeddings-based. This represents a fundamental design philosophy difference that we should reconsider.
|
|
154
|
+
|
|
155
|
+
### 9. Sandboxing (OS-Level Enforcement)
|
|
156
|
+
|
|
157
|
+
- **Seatbelt** (macOS) / **bubblewrap** (Linux/WSL2) for Bash tool
|
|
158
|
+
- `autoAllowBashIfSandboxed`: auto-approve commands that can run sandboxed
|
|
159
|
+
- Filesystem: `allowWrite`, `denyWrite`, `denyRead` paths
|
|
160
|
+
- Network: `allowedDomains` restrictions
|
|
161
|
+
- Child processes inherit sandbox boundaries
|
|
162
|
+
- "Even if prompt injection manipulates Claude's behavior, the sandbox can still prevent critical file modification"
|
|
163
|
+
|
|
164
|
+
**Our gap**: No sandbox subsystem. Relies on L7 orchestration for blast-radius control.
|
|
165
|
+
|
|
166
|
+
### 10. Session Storage & Checkpointing
|
|
167
|
+
|
|
168
|
+
- **Append-oriented session transcripts**: Full conversation history stored as JSONL
|
|
169
|
+
- **Resume, fork, rewind**: Continue old sessions, branch into different approaches, replay edits
|
|
170
|
+
- **Checkpoint system**: Snapshots file state before every edit, persists across sessions. Can restore code AND conversation. Separate from compaction.
|
|
171
|
+
- **Bash-driven modifications**: Not tracked by edit-tool checkpoint rewind — explicitly documented limitation
|
|
172
|
+
|
|
173
|
+
**Our gap**: Wiki-based state (L6) is not transactional session storage. No checkpoint/rewind capability. No session forking.
|
|
174
|
+
|
|
175
|
+
## Key Entities
|
|
176
|
+
|
|
177
|
+
- **[[Claude Code]]**: Anthropic's agentic coding CLI tool. 82,000+ GitHub stars, handles millions of coding sessions. Architecture reverse-engineered from 510K-line TypeScript codebase.
|
|
178
|
+
- **[[VILA-Lab]]**: Academic research group (Jiacheng Liu, Xiaohan Zhao, Xinyi Shang, Zhiqiang Shen) that published the most comprehensive Claude Code architecture analysis (arxiv 2604.14228).
|
|
179
|
+
- **[[Boris Cherny]]**: Claude Code creator. Confirmed the deliberate rejection of vector embeddings for code search.
|
|
180
|
+
|
|
181
|
+
## Key Concepts
|
|
182
|
+
|
|
183
|
+
- **[[structured-compaction]]**: Five-layer compaction pipeline with forked subagent producing structured summaries for software engineering contexts. ~6,500 tokens, selective preservation.
|
|
184
|
+
- **[[lifecycle-hooks]]**: 30+ deterministic hook events spanning full agent lifecycle. Exit-code semantics for blocking (2) vs non-blocking. Five hook types including LLM-based evaluation.
|
|
185
|
+
- **[[permission-subsystem]]**: ML-classified permission checking as architecturally separate layer. 7 modes, 4 scopes, composable rule language.
|
|
186
|
+
- **[[subagent-worktree-isolation]]**: Fresh context window + isolated Git worktree per subagent. Sidechain transcripts. Tool allowlists/denylists.
|
|
187
|
+
- **[[additive-config-hierarchy]]**: CLAUDE.md layered system with conditional YAML frontmatter. 96% compliance from structured small files vs 92% from single large file.
|
|
188
|
+
- **[[progressive-skill-disclosure]]**: Skills load name+description (100 tokens) at startup, full body on-demand via tool call.
|
|
189
|
+
- **[[agentic-search-no-embeddings]]**: Glob → Grep → Read hierarchy. Deliberate rejection of vector embeddings for code search.
|
|
190
|
+
- **[[sandbox-os-enforcement]]**: Seatbelt/bubblewrap OS-level boundaries beyond permission checks.
|
|
191
|
+
|
|
192
|
+
## Contradictions
|
|
193
|
+
|
|
194
|
+
- **Embeddings vs Agentic Search**: Our P13 invests in semantic code search via ck MCP (embeddings-based). Claude Code's creator states "agentic search generally works better." This is a design philosophy tension, not a clear-cut right/wrong. For exact symbol matching (code search), agentic search is likely superior. For conceptual queries ("find auth logic"), embeddings may help. Recommendation: Benchmark both approaches before committing to P13 implementation.
|
|
195
|
+
- **Pipeline vs Loop**: Our 8-layer pipeline is sequential and mandatory. Claude Code's loop is reactive and flexible. The pipeline model guarantees quality enforcement (L1-L4) but the loop model enables more dynamic task handling. This tension should be resolved by keeping L1-L4 as quality gates but making L7 orchestration a loop-orchestrator rather than a fixed DAG.
|
|
196
|
+
|
|
197
|
+
## Open Questions
|
|
198
|
+
|
|
199
|
+
- Can the five-layer compaction pipeline work for 200K-token max context (our target) vs Claude Code's 200K? Our smaller context window means compaction triggers earlier — the tradeoffs change.
|
|
200
|
+
- Should we adopt tool-level hooks as a replacement for our layer-level extension hooks, or as a complement? The exit-code semantics of Claude Code hooks are elegant but our TypeScript extension hooks offer richer integration with our pipeline.
|
|
201
|
+
- Is the permission subsystem necessary for a CLI-level harness? Claude Code is a consumer product with enterprise deployments. Our harness is developer-facing. The permission model may be overengineered for our use case.
|
|
202
|
+
- Can we adopt agentic search (Glob→Grep→Read) without abandoning semantic search? Perhaps a hybrid: agentic search as primary, embeddings as fallback for conceptual queries.
|
|
203
|
+
- How much of the plugin ecosystem should we replicate? Namespaced skill distribution is valuable. Agent override is powerful. But 9,000+ plugins is a network-effect problem — not solvable by architecture alone.
|
|
204
|
+
|
|
205
|
+
## Sources
|
|
206
|
+
- [[claude-code-architecture-vila-lab-2026]]: Liu et al., arxiv 2604.14228, April 2026. Academic paper analyzing Claude Code source code. Five human values, 13 design principles, architecture comparison with OpenClaw.
|
|
207
|
+
- [[claude-code-architecture-qubytes-2026]]: Vijendra, "Inside Claude Code: The Architecture That Makes AI Actually Do the Work," April 2026. Five-layer architecture breakdown: agent loop, permissions, tools, state, compaction.
|
|
208
|
+
- [[claude-code-architecture-karaxai-2026]]: KaraxAI, "How Claude Code Actually Works: A Systems-Level Deep Dive," March 2026. Full stack: CLAUDE.md, agent loop, skills, plugins, MCP, subagents, hooks, context compression.
|
|
209
|
+
- [[claude-code-security-architecture-penligent-2026]]: Penligent, "Inside Claude Code: The Architecture Behind Tools, Memory, Hooks, and MCP," April 2026. Security-focused technical analysis. Permission modes, sandboxing, CVE case studies, enterprise governance.
|
|
@@ -0,0 +1,99 @@
|
|
|
1
|
+
---
|
|
2
|
+
type: synthesis
|
|
3
|
+
title: "Research: Codex State-of-the-Art Harness Improvements"
|
|
4
|
+
created: 2026-05-01
|
|
5
|
+
updated: 2026-05-01
|
|
6
|
+
tags:
|
|
7
|
+
- research
|
|
8
|
+
- codex
|
|
9
|
+
- harness
|
|
10
|
+
- openai
|
|
11
|
+
- agent-architecture
|
|
12
|
+
status: developing
|
|
13
|
+
related:
|
|
14
|
+
- "[[codex-harness-innovations]]"
|
|
15
|
+
- "[[codex-open-source-agent-2026]]"
|
|
16
|
+
- "[[harness-implementation-plan]]"
|
|
17
|
+
- "[[model-adaptive-harness]]"
|
|
18
|
+
- "[[agentic-harness]]"
|
|
19
|
+
- "[[cursor-harness-innovations]]"
|
|
20
|
+
- "[[antigravity-agent-first-architecture]]"
|
|
21
|
+
- "[[Research: cursor.sh Harness Innovations]]"
|
|
22
|
+
- "[[Research: Google Antigravity Harness Integration]]"
|
|
23
|
+
- "[[Research: Claude Code State-of-the-Art Harness Improvements]]"
|
|
24
|
+
sources:
|
|
25
|
+
- "[[codex-open-source-agent-2026]]"
|
|
26
|
+
|
|
27
|
+
---# Research: Codex State-of-the-Art Harness Improvements
|
|
28
|
+
|
|
29
|
+
## Overview
|
|
30
|
+
|
|
31
|
+
Codex (OpenAI) is a **fully open-source** (Apache 2.0) Rust-based coding agent with 79.2K+ GitHub stars and 11.4K forks. It is the fourth major production agent analyzed after Cursor, Antigravity, and Claude Code — and uniquely valuable because its architecture is transparent (not reverse-engineered). Codex independently validates 7 of our planned features and reveals 5 new gaps. It also introduces 3 novel architectural patterns that challenge our first principles.
|
|
32
|
+
|
|
33
|
+
## Key Findings
|
|
34
|
+
|
|
35
|
+
### Features Codex Independently Validates
|
|
36
|
+
|
|
37
|
+
| Our Feature | Codex Equivalent | Source |
|
|
38
|
+
|---|---|---|
|
|
39
|
+
| Model-adaptive harness | Per-agent model selection (gpt-5.5/5.4/5.4-mini/spark) with `model_reasoning_effort` per agent | [[codex-open-source-agent-2026]] |
|
|
40
|
+
| Skills system (F0) | agentskills.io standard, progressive disclosure, `$skill-creator`, scoped discovery | [[codex-open-source-agent-2026]] |
|
|
41
|
+
| Lifecycle hooks (P33) | 6-event hooks framework (SessionStart, PreToolUse, PermissionRequest, PostToolUse, UserPromptSubmit, Stop) with exit-code semantics | [[codex-open-source-agent-2026]] |
|
|
42
|
+
| Subagent specialization (P25) | Parallel subagent dispatch with per-agent model + reasoning effort selection | [[codex-open-source-agent-2026]] |
|
|
43
|
+
| Pre-verification isolation (P15b) | Sandbox tiers (read-only, workspace-write) + writable roots for bounded agent work | [[codex-open-source-agent-2026]] |
|
|
44
|
+
| Persistent memory (L6) | Memories system (cross-thread, automatic, background-generated) | [[codex-open-source-agent-2026]] |
|
|
45
|
+
| Subagent worktree isolation (P25b) | Git worktrees for parallel branch isolation | [[codex-open-source-agent-2026]] |
|
|
46
|
+
|
|
47
|
+
### New Gaps Identified (5)
|
|
48
|
+
|
|
49
|
+
1. **No OS-level sandboxing**: Our P35 permission subsystem is policy-only. Codex uses Seatbelt/bubblewrap/Windows Sandbox for OS-level enforcement. This is a first-principles gap: permissions without enforcement are polite requests.
|
|
50
|
+
|
|
51
|
+
2. **No bidirectional MCP**: Our harness is MCP consumer only. Codex functions as MCP server — other agents can use it as a tool. This enables agent-to-agent composition. Missing from our architecture.
|
|
52
|
+
|
|
53
|
+
3. **No implicit memory capture**: Our L6 is wiki-based (explicit, human-authored). Codex's Chronicle captures screen context automatically for situational awareness. Missing from our memory layer.
|
|
54
|
+
|
|
55
|
+
4. **No automations (scheduled tasks)**: Codex supports scheduled recurring agent tasks. No equivalent in our plan. This is a new capability category.
|
|
56
|
+
|
|
57
|
+
5. **No skills ecosystem tooling**: Our skills lack `$skill-creator`, `$skill-installer`, and agentskills.io standard compatibility. Tools for skill lifecycle management are missing.
|
|
58
|
+
|
|
59
|
+
### Novel Architectural Patterns (3)
|
|
60
|
+
|
|
61
|
+
1. **Multi-surface agent architecture**: Single agent logic runs across CLI, IDE extension, Desktop App, and Web via App Server (local HTTP/WebSocket). The agent core is surface-agnostic. This is architecturally distinct from our CLI-only model.
|
|
62
|
+
|
|
63
|
+
2. **Rust-native implementation as a first-principles choice**: If your agent runs locally on user machines, use a systems language. Zero dependency install, direct OS sandbox API access, compile-time safety. TypeScript (our choice, Claude Code's choice) adds deployment complexity.
|
|
64
|
+
|
|
65
|
+
3. **Sandbox as foundation, permissions as policy layer**: Codex cleanly separates technical enforcement (sandbox) from user-facing decisions (approvals). This is architecturally cleaner than our mixed approach.
|
|
66
|
+
|
|
67
|
+
## Entities
|
|
68
|
+
|
|
69
|
+
- **OpenAI (Codex team)**: 79.2K+ stars, open-source, 756 releases since launch. Primarily Rust engineers.
|
|
70
|
+
|
|
71
|
+
## Key Concepts
|
|
72
|
+
|
|
73
|
+
- [[codex-harness-innovations]] — 10 key innovations extracted from Codex architecture
|
|
74
|
+
- **App Server Protocol**: Local HTTP/WebSocket bridge between agent core and presentation surfaces. v2 protocol with typed RPC, TypeScript codegen from Rust.
|
|
75
|
+
- **Chronicle**: Screen-context capture for memory bootstrapping. Fills the gap between explicit wiki and implicit recall.
|
|
76
|
+
- **MCP Server Mode**: Agent as composable tool. Enables agent-to-agent pipelines.
|
|
77
|
+
- **Memories**: Automatic cross-thread persistent memory with background generation, rate-limit awareness, and secret redaction.
|
|
78
|
+
- **Sandbox Tiers**: read-only → workspace-write → danger-full-access. OS-level enforcement.
|
|
79
|
+
- **Worktrees**: Isolated git worktrees for parallel agent branches.
|
|
80
|
+
|
|
81
|
+
## Contradictions
|
|
82
|
+
|
|
83
|
+
- **Hook architecture**: Claude Code has 30+ hook events with deterministic exit codes. Codex has 6 events with concurrent execution. Both validated. Our P33 should study both before finalizing. [[codex-open-source-agent-2026]] vs [[claude-code-architecture-vila-lab-2026]].
|
|
84
|
+
|
|
85
|
+
- **Memory philosophy**: Codex (automatic, screen-capture, background) vs our wiki (explicit, human-authored, checked-in). Both are valid. They serve different purposes. The gap is that we have nothing in the implicit/automatic category. [[codex-open-source-agent-2026]].
|
|
86
|
+
|
|
87
|
+
- **Context management**: Codex uses subagent summaries to fight "context rot." Claude Code uses structured compaction. Cursor uses dynamic context. Antigravity uses 1M token windows. Four different approaches to the same problem. Our approach (wiki + lean-ctx + hot cache) is a fifth path. All are valid but solve different aspects.
|
|
88
|
+
|
|
89
|
+
## Open Questions
|
|
90
|
+
|
|
91
|
+
- Should our harness expose itself as an MCP server (like Codex `codex mcp-server`)? What pipeline stages would be useful as external tools?
|
|
92
|
+
- Can we add Chronicle-style screen-context capture without the overhead of a full memory system?
|
|
93
|
+
- Should we adopt the agentskills.io standard for skill format compatibility?
|
|
94
|
+
- Is a Rust core (post-v1) worth the rewrite cost for zero-dependency install and OS sandbox integration?
|
|
95
|
+
- Should we adopt OS-level sandboxing (bubblewrap on Linux) before P35, or build P35 first and add OS enforcement later?
|
|
96
|
+
|
|
97
|
+
## Sources
|
|
98
|
+
|
|
99
|
+
- [[codex-open-source-agent-2026]] — GitHub repo (openai/codex) + official docs, 2026
|
|
@@ -0,0 +1,107 @@
|
|
|
1
|
+
---
|
|
2
|
+
type: synthesis
|
|
3
|
+
title: "Research: Engineering Workflows of Legendary Programmers and AI Harness Mapping"
|
|
4
|
+
created: 2026-05-03
|
|
5
|
+
updated: 2026-05-03
|
|
6
|
+
tags:
|
|
7
|
+
- research
|
|
8
|
+
- engineering-workflows
|
|
9
|
+
- legendary-programmers
|
|
10
|
+
- harness-design
|
|
11
|
+
- ai-coding
|
|
12
|
+
status: developing
|
|
13
|
+
related:
|
|
14
|
+
- "[[legendary-engineering-patterns-harness]]"
|
|
15
|
+
- "[[Linus Torvalds]]"
|
|
16
|
+
- "[[Ken Thompson]]"
|
|
17
|
+
- "[[Dennis Ritchie]]"
|
|
18
|
+
- "[[Anders Hejlsberg]]"
|
|
19
|
+
- "[[Guido van Rossum]]"
|
|
20
|
+
- "[[Bjarne Stroustrup]]"
|
|
21
|
+
- "[[fast-feedback-loops]]"
|
|
22
|
+
- "[[unix-composability]]"
|
|
23
|
+
- "[[chain-of-trust-software]]"
|
|
24
|
+
- "[[subtractive-design]]"
|
|
25
|
+
- "[[behavioral-compatibility-over-purity]]"
|
|
26
|
+
- "[[pragmatic-language-design]]"
|
|
27
|
+
- "[[harness]]"
|
|
28
|
+
- "[[harness-implementation-plan]]"
|
|
29
|
+
sources:
|
|
30
|
+
- "[[linux-kernel-coding-workflow]]"
|
|
31
|
+
- "[[unix-philosophy]]"
|
|
32
|
+
- "[[birth-of-unix-kernighan-interview]]"
|
|
33
|
+
- "[[hejlsberg-7-learnings]]"
|
|
34
|
+
- "[[guido-python-design-philosophy]]"
|
|
35
|
+
---
|
|
36
|
+
|
|
37
|
+
# Research: Engineering Workflows of Legendary Programmers and AI Harness Mapping
|
|
38
|
+
|
|
39
|
+
## Overview
|
|
40
|
+
|
|
41
|
+
Research into the engineering practices of six legendary programmers — Linus Torvalds, Ken Thompson, Dennis Ritchie, Bjarne Stroustrup, Anders Hejlsberg, Guido van Rossum — reveals 10 cross-cutting patterns that map directly to AI coding harness design. The core finding: **the same principles that produced the world's most durable software — Linux, Unix, C, C++, Python, TypeScript — are the principles that must constrain AI-generated code.** Deterministic guardrails (type systems, linters, tests) become more important with AI, not less.
|
|
42
|
+
|
|
43
|
+
## Key Findings
|
|
44
|
+
|
|
45
|
+
- **Fast feedback loops are the highest-leverage practice across all six programmers.** Hejlsberg's Turbo Pascal instant compile, Torvalds' merge-window cadence, Thompson's rapid prototyping — all converge on the same insight: short cycle time changes behavior. For the harness: every AI-generated change must be testable within seconds. (Sources: [[hejlsberg-7-learnings]], [[linux-kernel-coding-workflow]])
|
|
46
|
+
|
|
47
|
+
- **Composability over monoliths is the Unix legacy that still dominates.** The pipe (`|`) breakthrough at Bell Labs enabled an ecosystem of small, focused tools. This maps directly to agent composition: specialized sub-agents chained together rather than monolithic AI output. (Sources: [[unix-philosophy]], [[birth-of-unix-kernighan-interview]])
|
|
48
|
+
|
|
49
|
+
- **Torvalds' chain-of-trust model is the canonical verification pipeline.** Patches flow through subsystem maintainers before reaching Linus. Each level inspects what it's specialized for. This maps to tiered harness gates: lint → type-check → test → critic agent → human review. (Source: [[linux-kernel-coding-workflow]])
|
|
50
|
+
|
|
51
|
+
- **Type systems are the essential AI guardrail — Hejlsberg's 2026 insight.** "The most valuable tools in an AI-assisted workflow aren't the ones that generate the most code, but the ones that constrain it correctly." Hejlsberg and Stroustrup independently converge on static typing as the safety net against plausible-but-wrong AI output. This validates the harness's L3 (grounding-checkpoints) and L4 (adversarial-verification) as mandatory layers. (Sources: [[hejlsberg-7-learnings]], [[Bjarne Stroustrup]])
|
|
52
|
+
|
|
53
|
+
- **Subtractive design is the antidote to AI bloat.** Thompson and McIlroy's "What can we throw out?" culture is the counterforce to AI's tendency to generate verbose, redundant code. The harness needs explicit "suggest deletion" modes — not just generation. (Sources: [[unix-philosophy]], [[Ken Thompson]])
|
|
54
|
+
|
|
55
|
+
- **Behavioral compatibility is more important than architectural purity.** Hejlsberg (TypeScript extending JS), Stroustrup (C++ compatible with C), Torvalds ("don't break userspace") all choose pragmatism over clean-slate rewrites. The harness must verify that changes preserve existing behavior. (Sources: [[hejlsberg-7-learnings]], [[Bjarne Stroustrup]])
|
|
56
|
+
|
|
57
|
+
- **Van Rossum and Hejlsberg both oppose "vibe coding."** Van Rossum: "We stay in control where it comes to architecture and API design." Torvalds: vibe coding is "horrible for production." All six programmers insist on human architectural control. AI assists execution, not design judgment. (Sources: [[guido-python-design-philosophy]], [[linux-kernel-coding-workflow]], [[Anders Hejlsberg]])
|
|
58
|
+
|
|
59
|
+
- **Van Rossum's type-hint threshold (10K lines) suggests tiered harness behavior.** Below 10K lines, dynamic checking suffices. Above, strict typing becomes essential. This maps to harness modes that adapt enforcement strictness to codebase size. (Source: [[guido-python-design-philosophy]])
|
|
60
|
+
|
|
61
|
+
- **Thompson's productivity demonstrates that deep system understanding enables extreme leverage.** Built Unix in 3 weeks. Reverse-engineered a typesetter in hours. For the harness: semantic codebase indexing and deep context provision are not optional — they are the prerequisite for effective AI code generation. (Source: [[birth-of-unix-kernighan-interview]])
|
|
62
|
+
|
|
63
|
+
- **The Unix Room as shared context maps to the wiki as persistent memory (L6).** Kernighan's description of shared source trees, shared filesystems, and the `who` command as community tool mirrors the harness wiki: all decisions visible, all context searchable, all history preserved. (Source: [[birth-of-unix-kernighan-interview]])
|
|
64
|
+
|
|
65
|
+
## Key Entities
|
|
66
|
+
|
|
67
|
+
- [[Linus Torvalds]]: Linux kernel, Git, chain-of-trust development model, "don't break userspace"
|
|
68
|
+
- [[Ken Thompson]]: Unix co-creator, subtractive design, extreme leverage from deep understanding
|
|
69
|
+
- [[Dennis Ritchie]]: Unix co-creator, C language, K&R style, economy of design from constraints
|
|
70
|
+
- [[Anders Hejlsberg]]: Fast feedback loops, behavioral compatibility, type systems as AI guardrails
|
|
71
|
+
- [[Guido van Rossum]]: Pragmatism over perfection, simplicity as survival trait, human control over architecture
|
|
72
|
+
- [[Bjarne Stroustrup]]: Evolutionary design, C compatibility as pragmatic choice, static typing for safety
|
|
73
|
+
|
|
74
|
+
## Key Concepts
|
|
75
|
+
|
|
76
|
+
- [[legendary-engineering-patterns-harness]]: 10 patterns mapped to harness layers
|
|
77
|
+
- [[fast-feedback-loops]]: The highest-leverage practice across all six programmers
|
|
78
|
+
- [[unix-composability]]: Pipes and small tools as agent composition model
|
|
79
|
+
- [[chain-of-trust-software]]: Tiered verification as harness gate architecture
|
|
80
|
+
- [[subtractive-design]]: "What can we throw out?" as AI bloat antidote
|
|
81
|
+
- [[behavioral-compatibility-over-purity]]: Working within existing constraints over clean-slate
|
|
82
|
+
- [[pragmatic-language-design]]: "Good enough" over perfection (van Rossum, Stroustrup)
|
|
83
|
+
|
|
84
|
+
## Contradictions
|
|
85
|
+
|
|
86
|
+
- **Static vs dynamic typing**: Stroustrup and Hejlsberg advocate static typing as essential safety net. Van Rossum designed Python as dynamic but added gradual typing above 10K lines — a convergence toward the same conclusion at scale. No fundamental contradiction; all agree types become essential at scale.
|
|
87
|
+
- **Perfection vs pragmatism**: The ABC group (van Rossum's background) strived for perfection. Van Rossum deliberately rejected this. Stroustrup similarly rejected "a much smaller and cleaner language" (that would have been a "cult language") in favor of C compatibility. Consensus: pragmatism wins, but the harness must enforce correctness where it matters (behavioral compatibility, not architectural purity).
|
|
88
|
+
|
|
89
|
+
## Open Questions
|
|
90
|
+
|
|
91
|
+
- **How to implement subtractive design in an AI harness?** All six programmers emphasize removing what isn't needed. Current harness layers focus on adding correct code. A "subtraction mode" — AI-suggested deletions with safety verification — is not yet designed.
|
|
92
|
+
- **Thompson-level codebase understanding for AI agents?** Thompson could hold an entire operating system in his head. Can semantic indexing + call graphs + AST queries provide equivalent understanding to an LLM? Benchmark needed.
|
|
93
|
+
- **How to balance fast feedback with thorough verification?** Hejlsberg's instant feedback and Torvalds' rigorous review are in tension. Where does the harness optimize for speed vs correctness per change type?
|
|
94
|
+
- **What is the harness equivalent of "don't break userspace"?** Behavioral regression testing exists but may not catch semantic drift. Formal behavioral contracts remain an open research area.
|
|
95
|
+
- **10K-line threshold validation**: Van Rossum's claim that types become essential above 10K lines needs empirical validation for AI-generated codebases. Does AI output benefit from typing at smaller scales?
|
|
96
|
+
|
|
97
|
+
## Sources
|
|
98
|
+
|
|
99
|
+
- [[linux-kernel-coding-workflow]]: Torvalds et al., official kernel documentation, 2026
|
|
100
|
+
- [[unix-philosophy]]: Wikipedia, synthesizing McIlroy/Thompson/Ritchie/Raymond, 2025
|
|
101
|
+
- [[birth-of-unix-kernighan-interview]]: Brian Kernighan, CoRecursive podcast, 2020
|
|
102
|
+
- [[hejlsberg-7-learnings]]: Aaron Winston, GitHub Blog, January 2026
|
|
103
|
+
- [[guido-python-design-philosophy]]: Guido van Rossum, 2009 (design philosophy) + 2025 interview
|
|
104
|
+
|
|
105
|
+
---
|
|
106
|
+
|
|
107
|
+
*Research conducted 2026-05-03. 2 rounds, 8 searches, 11 pages scraped, 12 wiki pages created.*
|
|
@@ -0,0 +1,72 @@
|
|
|
1
|
+
---
|
|
2
|
+
type: synthesis
|
|
3
|
+
title: "Research: Fallow Codebase Intelligence Harness Integration"
|
|
4
|
+
created: 2026-05-01
|
|
5
|
+
updated: 2026-05-01
|
|
6
|
+
tags:
|
|
7
|
+
- research
|
|
8
|
+
- harness
|
|
9
|
+
- fallow
|
|
10
|
+
- codebase-intelligence
|
|
11
|
+
- static-analysis
|
|
12
|
+
- dead-code
|
|
13
|
+
- quality-gate
|
|
14
|
+
status: developing
|
|
15
|
+
related:
|
|
16
|
+
- "[[fallow-rs-codebase-intelligence]]"
|
|
17
|
+
- "[[codebase-intelligence-harness-integration]]"
|
|
18
|
+
- "[[codebase-intelligence-ecosystem-comparison]]"
|
|
19
|
+
- "[[harness-implementation-plan]]"
|
|
20
|
+
- "[[harness]]"
|
|
21
|
+
sources:
|
|
22
|
+
- "[[fallow-rs-codebase-intelligence]]"
|
|
23
|
+
|
|
24
|
+
---# Research: Fallow Codebase Intelligence Harness Integration
|
|
25
|
+
|
|
26
|
+
## Overview
|
|
27
|
+
|
|
28
|
+
Fallow (fallow-rs/fallow, 1.7K stars, MIT) is a Rust-native codebase intelligence tool for TypeScript and JavaScript. It detects dead code, duplication, complexity, and architecture boundary violations — all sub-second even on 20K+ file codebases. It integrates into our harness as the Phase 16 deterministic quality gate, P15b pre-verification sandbox tool, and L5 observability substrate. No other ecosystem has a single-tool equivalent. Cross-ecosystem coverage requires combining 3-5 tools per language.
|
|
29
|
+
|
|
30
|
+
## Key Findings
|
|
31
|
+
|
|
32
|
+
- Fallow is the ONLY tool across TS/JS, Python, Go, Rust, and Elixir that provides dead code + duplication + complexity + boundaries in one sub-second package. (Source: [[fallow-rs-codebase-intelligence]], [[codebase-intelligence-ecosystem-comparison]])
|
|
33
|
+
- Fallow is purpose-built for AI agent integration: MCP server, JSON with `actions` array, `auto_fixable` flags, agent skill shipped in npm package. (Source: [[fallow-rs-codebase-intelligence]])
|
|
34
|
+
- Fallow fits 7 distinct integration points in our harness: L3 tool calling, P15b pre-verify, Phase 16 gate, L5 observability, P29 error classification, L6 baselines, P42 automations. (Source: [[codebase-intelligence-harness-integration]])
|
|
35
|
+
- Fallow beats knip by 2-13x speed with broader feature coverage (duplication, complexity, boundaries, runtime). Beats jscpd by 8-26x. (Source: [[fallow-rs-codebase-intelligence]])
|
|
36
|
+
- For Python: Vulture + Skylos + Ruff combo provides dead code coverage. For Go: golangci-lint + deadcode + gocyclo. For Rust: clippy + cargo-udeps + rust-code-analysis. For Elixir: dialyxir + credo. All inferior to fallow's single-command coverage. (Source: [[codebase-intelligence-ecosystem-comparison]])
|
|
37
|
+
- Fallow's audit mode with baselines enables incremental adoption — critical for existing codebases with legacy issues. (Source: [[fallow-rs-codebase-intelligence]])
|
|
38
|
+
- Fallow's runtime intelligence (paid) provides hot/cold path evidence from V8 coverage — a Keep Rate proxy for production code survival. (Source: [[fallow-rs-codebase-intelligence]])
|
|
39
|
+
|
|
40
|
+
## Key Entities
|
|
41
|
+
|
|
42
|
+
- **fallow-rs/fallow**: Rust-native TS/JS codebase intelligence. 1.7K stars, MIT. By Bart Waardenburg.
|
|
43
|
+
- **knip**: Legacy dead code detector for TS/JS. ~7K stars. Superseded by fallow on speed and features.
|
|
44
|
+
- **Vulture**: Python dead code detector. ~3.5K stars. AST-based, partial coverage.
|
|
45
|
+
- **Skylos**: Multi-language SAST (Python, TS, Go, Java, Rust). Most comprehensive Python dead code.
|
|
46
|
+
- **deadcode**: Official Go unreachable-function detector. By Alan Donovan (Go team).
|
|
47
|
+
- **Staticcheck**: Most comprehensive Go linter. ~7K stars.
|
|
48
|
+
- **cargo-udeps**: Rust unused dependency detector. Nightly required.
|
|
49
|
+
- **Dialyzer**: Erlang/Elixir BEAM static analysis. Dead code + type errors.
|
|
50
|
+
- **Credo**: Elixir code analysis with teaching focus. ~4.9K stars.
|
|
51
|
+
|
|
52
|
+
## Key Concepts
|
|
53
|
+
|
|
54
|
+
- [[codebase-intelligence-harness-integration]]: 7-point integration map for fallow into our harness pipeline
|
|
55
|
+
- [[codebase-intelligence-ecosystem-comparison]]: Cross-language gap analysis showing no ecosystem has fallow-equivalent
|
|
56
|
+
- Harness P44: New phase for codebase intelligence integration. 7 sub-phases (P44a through P44g).
|
|
57
|
+
|
|
58
|
+
## Contradictions
|
|
59
|
+
|
|
60
|
+
- **Fallow vs knip**: knip has ~7K stars (older, more established community). Fallow has 1.7K stars but 2-13x faster and broader feature set. Recommendation: fallow for harness. Stars lag features due to younger project.
|
|
61
|
+
- **Vulture vs Skylos (Python)**: Vulture is dedicated dead code (3.5K stars, mature). Skylos is multi-language (+ security scanning). For harness: Skylos provides broader coverage. Vulture is simpler if only dead code needed.
|
|
62
|
+
|
|
63
|
+
## Open Questions
|
|
64
|
+
|
|
65
|
+
- Fallow is TS/JS only. Should harness invest in per-language tool wrappers (Python, Go, Rust, Elixir), or defer multi-language support to post-v1? Current recommendation: P44 for TS/JS now. Multi-language in future F5 phase.
|
|
66
|
+
- Fallow runtime intelligence requires paid license. Is the V8 coverage hot-path data worth the cost for Keep Rate tracking? Recommendation: start with free static layer. Evaluate runtime layer if Keep Rate signal is insufficient.
|
|
67
|
+
- Should harness enforce fallow audit gate (fail = block delivery) or use warn-only mode initially? Recommendation: warn-only for adoption period, escalate to fail gate after baselines established.
|
|
68
|
+
- Can fallow's per-issue `actions` array be mapped to automated fix application (auto-heal)? Recommendation: P44e maps `auto_fixable=true` issues to auto-heal candidates. `fallow fix --dry-run` previews before applying.
|
|
69
|
+
|
|
70
|
+
## Sources
|
|
71
|
+
|
|
72
|
+
- [[fallow-rs-codebase-intelligence]]: Primary source. GitHub repo, docs, benchmarks.
|