shipwright-cli 3.2.0 → 3.3.0

package/docs/research/RESEARCH_SOURCES.md

@@ -0,0 +1,440 @@
+# Research Sources: Autonomous Coding Systems (April 2026)
+
+## Complete Bibliography with URLs
+
+### Dark Factory & Autonomous Delivery
+
+**BCG Platinion: The Dark Software Factory** (March 2026)
+
+- https://www.bcgplatinion.com/insights/the-dark-software-factory
+- **Key findings:** 3-5 engineers running factories; Spotify 650+ PRs/month; OpenAI 1M-line product in 5 months
+- **Disciplines:** Harness Engineering, Intent Thinking
+- **Report PDF:** https://cdn.prod.website-files.com/655cded084fee2e958faaffc/69b8331d6141dc7278866f9c_Dark_Software_Factory_BCG_Platinion_AI_report_March2026.pdf
+
+**Anthropic 2026 Agentic Coding Trends Report**
+
+- https://resources.anthropic.com/hubfs/2026%20Agentic%20Coding%20Trends%20Report.pdf
+- **Coverage:** Loop convergence triggers, prompt design impact, multi-agent coordination patterns
+- **Timeline:** 40% of enterprise apps will have agents by 2026 (vs <5% in 2025)
+
+**GitHub Copilot: Agent Mode & Project Padawan**
+
+- https://github.com/newsroom/press-releases/agent-mode
+- https://githubnext.com/projects/copilot-workspace
+- **Capabilities:** Issue-to-PR workflow, autonomous issue completion, asynchronous execution
+- **Status:** GA since September 2025; Project Padawan in development
+
+---
+
+### Autonomous Loop Patterns & Convergence Detection
+
+**SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering** (NeurIPS 2024)
+
+- https://arxiv.org/abs/2405.15793
+- **PDF:** https://arxiv.org/pdf/2405.15793
+- **Repo:** https://github.com/SWE-agent/SWE-agent
+- **Key innovation:** Custom ACI with repository primitives (find_file, search_dir, edit_tool)
+- **Benchmark:** 40.6% on SWE-bench
+
+**Geometric Dynamics of Agentic Loops in Large Language Models** (Jan 2026)
+
+- https://arxiv.org/abs/2512.10350
+- **Key finding:** Contractive vs exploratory loop regimes; prompt design governs dynamical behavior
+- **Applications:** Early exit on convergence, escalation on divergence
+
+**SWE-Bench & SWE-Bench Pro**
+
+- Benchmark: https://www.vals.ai/benchmarks/swebench
+- SWE-Bench Pro: https://scale.com/blog/swe-bench-pro
+- **Status:** Verified flagged as contaminated (OpenAI finding); Pro (1,865 tasks) is new standard
+- **Leaderboard:** https://llm-stats.com/benchmarks/swe-bench-verified-(agentic-coding)
+
+**SWE-EVO: Benchmarking Coding Agents in Long-Horizon Software Evolution**
+
+- https://arxiv.org/pdf/2512.18470
+- **Scope:** Multi-step modifications, release note interpretation, large-scale repos
+
+---
+
+### Reinforcement Learning for Code Generation
+
+**FunPRM: Function-as-Step Process Reward Model with Meta Reward Correction**
+
+- https://arxiv.org/abs/2601.22249
+- **Innovation:** Treats functions as PRM steps; meta-learning reward correction via unit tests
+- **Performance:** +15-20% completion rate vs outcome-only rewards
+
+**SecCoderX: Secure Code Generation via Online Reinforcement Learning with Vulnerability Reward Model**
+
+- https://arxiv.org/abs/2602.07422
+- **Key contribution:** Vulnerability detection → reward model → RL loop
+- **Application:** Security-hardened code generation
+
+**Enhancing Code LLMs with Reinforcement Learning in Code Generation: A Survey**
+
+- https://arxiv.org/abs/2412.20367
+- **Coverage:** PPO standard, preference data → reward model → policy optimization
+- **Scope:** RLHF, RLIF, online RL approaches
+
+**Mutation-Guided LLM-based Test Generation at Meta**
+
+- https://arxiv.org/abs/2501.12862
+- **System:** ACH (Automated Compliance Hardening)
+- **Scale:** 10,795 Android classes; 9,095 mutants; 571 test cases generated
+
+---
+
+### Reasoning Models & Extended Thinking
+
+**Claude Opus 4.6: Adaptive Thinking** (Anthropic 2026)
+
+- https://platform.claude.com/docs/en/build-with-claude/adaptive-thinking
+- **Key feature:** Dynamically decides when/how much to think (replaces extended thinking)
+- **Capability:** Think between tool calls; 1M context window
+
+**OpenAI o1-pro: Complete Guide**
+
+- https://openai.com/index/introducing-openai-o1-preview/
+- https://openai.com/index/learning-to-reason-with-llms/
+- **Specs:** 200K context, 100K output tokens, $150/$600 pricing
+- **Performance:** 86% AIME (vs 78% o1), 89th percentile Codeforces
+
+**DeepSeek-R1: Incentivizing Reasoning Capability via RL**
+
+- https://arxiv.org/abs/2501.12948
+- **Repo:** https://github.com/deepseek-ai/DeepSeek-R1
+- **Architecture:** 671B @ 37B inference cost via Mixture of Experts
+- **Performance:** 2,029 Codeforces Elo (Candidate Master)
+- **Training:** Pure RL without SFT; multi-stage RL + SFT
+
+**Reasoning Models Don't Always Say What They Think** (Anthropic Alignment Science)
+
+- https://www.anthropic.com/research/reasoning-models-dont-say-think
+- **Finding:** Chain-of-thought reasoning may not be faithful (~25% of hints mentioned)
+
+---
+
+### Memory Systems & Episodic Learning
+
+**Memory in the Age of AI Agents: A Survey**
+
+- https://arxiv.org/abs/2512.13564
+- **Paper list:** https://github.com/Shichun-Liu/Agent-Memory-Paper-List
+- **Coverage:** Episodic, semantic, working memory; implementations across agents
+
+**EM-LLM: Human-inspired Episodic Memory for Infinite Context LLMs**
+
+- https://arxiv.org/abs/2407.09450
+- **Innovation:** Bayesian surprise + graph refinement for event boundaries
+- **Application:** Online episode segmentation
+
+**Mem0: AI Memory Platform**
+
+- https://mem0.ai
+- **Technology:** Hybrid storage (Postgres), episodic summaries, continuous learning
+- **Status:** Most mature long-term memory system (2026)
+
+**Active Context Compression: Autonomous Memory Management in LLM Agents**
+
+- https://arxiv.org/abs/2601.07190
+- **Pattern:** Focus agent autonomously consolidates learnings into knowledge blocks
+- **Technique:** Selective pruning of raw history
+
+**Multi-Layered Memory Architectures for LLM Agents: Experimental Evaluation**
+
+- https://arxiv.org/abs/2603.29194
+- **Approach:** Working + episodic + semantic layers with adaptive retrieval gating
+
+---
+
+### Formal Verification & Specification
+
+**DafnyPro: LLM-Assisted Automated Verification for Dafny Programs** (POPL 2026)
+
+- https://popl26.sigplan.org/details/dafny-2026-papers/12/DafnyPro-LLM-Assisted-Automated-Verification-for-Dafny-Programs
+- **Performance:** 86% on DafnyBench (Claude Sonnet 3.5)
+- **Advance:** +16pp over previous SOTA
+
+**MiniF2F-Dafny: LLM-Guided Mathematical Theorem Proving** (POPL 2026)
+
+- https://popl26.sigplan.org/details/dafny-2026-papers/16/MiniF2F-Dafny-LLM-Guided-Mathematical-Theorem-Proving-via-Auto-Active-Verification
+- **Coverage:** 40.6% test set, 44.7% validation set with empty proofs
+
+**A Benchmark for Vericoding: Formally Verified Program Synthesis**
+
+- https://arxiv.org/abs/2509.22908
+- **Baseline:** 27% Lean, 44% Verus/Rust, 82% Dafny success rates
+
+**ATLAS: Automated Toolkit for Large-Scale Verified Code Synthesis**
+
+- https://arxiv.org/abs/2512.10173
+- **Pipeline:** Synthesize 2.7K verified Dafny programs → 19K training examples
+- **Results:** +23pp on DafnyBench, +50pp on DafnySynthesis via fine-tuning
+
+**DafnyBench: A Benchmark for Formal Software Verification**
+
+- https://openreview.net/pdf?id=yBgTVWccIx
+- **Scope:** 412 verification problems; covers inductive invariants, loop specifications
+
+---
+
+### Test Generation & Mutation Testing
+
+**Meta: Revolutionizing Software Testing with LLM-powered Bug Catchers**
+
+- https://engineering.fb.com/2025/02/05/security/revolutionizing-software-testing-llm-powered-bug-catchers-meta-ach/
+- **System:** ACH (Automated Compliance Hardening)
+- **Scale:** 10,795 Android Kotlin classes; 9,095 mutants + 571 test cases
+
+**Evaluating LLM-Based Test Generation Under Software Evolution**
+
+- https://arxiv.org/abs/2603.23443
+- **Challenge:** Test effectiveness degrades with code evolution
+
+**Effective Test Generation Using Pre-Trained LLMs and Mutation Testing**
+
+- https://www.sciencedirect.com/article/abs/pii/S0950584924000739
+- **Approach:** Combine LLM generation + mutation validation
+
+**LLMorpheus: LLM-based Mutation Testing**
+
+- https://github.com/githubnext/llmorpheus
+- **Tool:** Open-source implementation on GitHub Next
+
+**MutGen: Mutation-Guided LLM-based Test Generation**
+
+- **Performance:** 89.5% mutation score on HumanEval-Java (vs EvoSuite baseline)
+
+---
+
+### Cost Optimization & Model Routing
+
+**Google: Speculative Cascades — A Hybrid Approach for Smarter, Faster LLM Inference**
+
+- https://research.google/blog/speculative-cascades-a-hybrid-approach-for-smarter-faster-llm-inference/
+- **Finding:** 30-60% cost reduction; hybrid routing + cascading
+- **Benchmark:** 92% cost savings on open-source cascading
+
+**A Unified Approach to Routing and Cascading for LLMs**
+
+- https://arxiv.org/abs/2410.10347
+- **Innovation:** Theoretically optimal integration of routing + cascading
+- **Framework:** Unified decision tree for both strategies
+
+**Dynamic Model Routing and Cascading for Efficient LLM Inference: A Survey**
+
+- https://arxiv.org/abs/2603.04445
+- **Coverage:** Routing vs cascading paradigms, cost-quality tradeoffs
+
+**CoSine: Clustering-Based Routing for LLM Inference Optimization**
+
+- **Results:** 23% latency reduction, 32% throughput increase
+
+**Smurfs: Adaptive Speculative Decoding**
+
+- **Technique:** Dynamic speculation length optimization per query
+
+---
+
+### Self-Healing CI/CD & AIOps
+
+**Agentic SRE: How Self-Healing Infrastructure Is Redefining Enterprise AIOps** (2026)
+
+- https://www.unite.ai/agentic-sre-how-self-healing-infrastructure-is-redefining-enterprise-aiops-in-2026/
+- **Pattern:** Telemetry → reasoning → controlled automation (closed loop)
+- **Adoption:** 60% of enterprises by Gartner 2026
+
+**Building Self-Healing CI/CD Pipelines for Agentic AI Systems**
+
+- https://optimumpartners.com/insight/how-to-architect-self-healing-ci/cd-for-agentic-ai/
+- **Pattern:** Pipeline Doctor / Interceptor — repair agent on build failure
+
+**From AIOps Hype to Reality: Building Self-Healing Infrastructure** (2026)
+
+- https://techstrong.it/features/from-aiops-hype-to-reality-building-self-healing-infrastructure-in-2026
+- **Results:** 67% MTTR drop; 40-60% in high-performing orgs
+
+**AIOps: Guide to AI in IT Operations** (2026)
+
+- https://www.ir.com/guides/what-is-aiops-guide-to-ai-in-operations-2026
+- **Scope:** Anomaly detection, incident prediction, automated remediation
+
+**LLM-as-a-Judge Pattern** (2026 standard)
+
+- **Concept:** Secondary model evaluates primary agent output
+- **Application:** Quality gates, merge decision support
+
+---
+
+### Multi-Agent Coordination & Orchestration
+
+**How to Build Multi-Agent Systems: Complete 2026 Guide**
+
+- https://dev.to/eira-wexford/how-to-build-multi-agent-systems-complete-2026-guide-1io6
+- **Patterns:** 3-role (Planner, Worker, Judge); git worktrees for isolation
+- **Status:** 40% of enterprise apps will have agents by 2026
+
+**The Code Agent Orchestra: What Makes Multi-Agent Coding Work**
+
+- https://addyosmani.com/blog/code-agent-orchestra/
+- **Insight:** Coordination > autonomy; orchestration is the key lever
+
+**Multi-Agent Frameworks Explained for Enterprise AI** (2026)
+
+- https://www.adopt.ai/blog/multi-agent-frameworks
+- **Frameworks:** CrewAI, LangGraph, AutoGen, MetaGPT
+- **Winner:** LangGraph for complex workflows; CrewAI for rapid deployment
+
+**MetaGPT: Multi-Agent Framework for Software Development**
+
+- **Approach:** Simulates full product team (PM, TL, Dev, QA)
+- **Specialization:** Standardized engineering workflows
+
+**Google DORA 2025: AI Adoption & Bug Rates**
+
+- **Finding:** 20-30% faster workflows, but 9% bug rate climb with multi-agent
+- **Lesson:** Coordination + quality gates are critical
+
+---
+
+### Competitive Analysis & Benchmarks
+
+**We Tested 15 AI Coding Agents (2026): Only 3 Changed How We Ship**
+
+- https://www.morphllm.com/ai-coding-agent
+- **Leaders:** Claude Code (80.9%), Aider (49.2%), Cline (500K downloads)
+
+**Cline vs Aider: Which AI Coding Assistant is Best in 2026?**
+
+- https://is4.ai/blog/our-blog-1/cline-vs-aider-comparison-2026-313
+- **Comparison:** Architecture, integration, cost efficiency, workflow
+- **Winner:** Aider for cost; Claude Code for complex tasks
+
+**Aider Uses 4.2x Fewer Tokens Than Claude Code**
+
+- https://www.morphllm.com/comparisons/morph-vs-aider-diff
+- **Reason:** Diff-based editing vs search-replace
+
+**SWE-Agent vs SWE-Bench Leaderboard**
+
+- Leaderboard: https://llm-stats.com/benchmarks/swe-bench-verified-(agentic-coding)
+- **Status:** Claude Code highest reported (80.9%), but unsubmitted officially
+
+**AI Coding Benchmarks 2026: Every Major Eval Explained**
+
+- https://www.morphllm.com/ai-coding-benchmarks-2026
+- **Coverage:** SWE-bench, SWE-bench Pro, SWE-Bench Verified, Codeforces, AIME
+
+---
+
+### Additional Research & Surveys
+
+**Agentic AI Resource Exhaustion & Infinite Loop Attacks** (Feb 2026)
+
+- https://medium.com/@instatunnel/agentic-resource-exhaustion-the-infinite-loop-attack-of-the-ai-era-76a3f58c62e3
+- **Finding:** 45% of 220 loops had problems (stagnation, stuck loops)
+
+**How to Tell If Your AI Agent Is Stuck (Real Data From 220 Loops)**
+
+- https://dev.to/boucle2026/how-to-tell-if-your-ai-agent-is-stuck-with-real-data-from-220-loops-4d4h
+- **Techniques:** De-duplication, semantic similarity, state tracking
+
+**Agents: Loop Control** (Vercel AI SDK)
+
+- https://ai-sdk.dev/docs/agents/loop-control
+- **Patterns:** Max iterations, timeout management, stop conditions
+
+**120+ Agentic AI Tools Mapped Across 11 Categories** (2026)
+
+- https://www.stackone.com/blog/ai-agent-tools-landscape-2026
+- **Categories:** Frameworks, platforms, monitoring, integrations
+
+---
+
+### Industry Trends & Forecasts
+
+**7 Agentic AI Trends to Watch in 2026**
+
+- https://machinelearningmastery.com/7-agentic-ai-trends-to-watch-in-2026
+- **Topics:** Loop control, reliability, security, cost optimization
+
+**The Next Frontier of RAG: How Enterprise Knowledge Systems Will Evolve**
+
+- https://nstarxinc.com/blog/the-next-frontier-of-rag-how-enterprise-knowledge-systems-will-evolve-2026-2030
+- **Timeline:** 2026-2030; RAG as knowledge runtime; verification + access control
+
+**Agentic GraphRAG for Capital Markets** (Amazon Web Services)
+
+- https://aws.amazon.com/blogs/industries/agentic-graphrag-for-capital-markets/
+- **Pattern:** Agentic RAG with specialized agents (research, verification, synthesis)
+
+**Why GraphRAG and MCP Are the New Standard for Agentic Data Architecture**
+
+- https://hyperight.com/agentic-data-architecture-graphrag-mcp-2026/
+- **Trend:** MCP (Model Context Protocol) + GraphRAG for structured context
+
+---
+
+## Quick Link Summary by Topic
+
+### Dark Factory & Intent (Backlog #2)
+
+- BCG Platinion report (above)
+- Anthropic trends report (above)
+- GitHub Agent Mode / Project Padawan
+
+### Loop Convergence (Backlog #1)
+
+- SWE-agent NeurIPS 2024
+- Geometric Dynamics of Agentic Loops (arxiv 2512.10350)
+- How to Tell If Your AI Agent Is Stuck (220 loops data)
+
+### Vulnerability & RL (Backlog #3)
+
+- SecCoderX (arxiv 2602.07422)
+- Meta ACH system (engineering.fb.com)
+- Mutation-Guided LLM at Meta (arxiv 2501.12862)
+
+### Episodic Memory (Backlog #4)
+
+- Mem0 (mem0.ai)
+- EM-LLM (arxiv 2407.09450)
+- Memory in the Age of AI Agents survey (arxiv 2512.13564)
+
+### Cost Optimization / Cascade (Backlog #5)
+
+- Google Speculative Cascades (research.google)
+- Unified Routing + Cascading (arxiv 2410.10347)
+- CoSine, Smurfs papers
+
+### Mutation Testing (Backlog #6, #13)
+
+- Meta ACH (engineering.fb.com)
+- MutGen paper
+- LLMorpheus (GitHub Next)
+
+### CI Repair & AIOps (Backlog #7)
+
+- Agentic SRE (unite.ai)
+- Pipeline Doctor pattern (optimumpartners.com)
+- From AIOps Hype to Reality (techstrong.it)
+
+### Multi-Agent Coordination (Backlog #9)
+
+- 2026 Multi-Agent Systems Guide (dev.to)
+- The Code Agent Orchestra (addyosmani.com)
+- MetaGPT, CrewAI, LangGraph frameworks
+
+### Formal Verification (Backlog #11)
+
+- DafnyPro (POPL 2026)
+- ATLAS (arxiv 2512.10173)
+- DafnyBench (openreview)
+
+---
+
+**Total sources cited:** 60+  
+**Papers:** 25+  
+**Companies/Organizations:** 15+ (Anthropic, OpenAI, DeepSeek, Meta, Google, BCG, GitHub, etc.)  
+**Research date:** April 4, 2026  
+**Coverage:** Autonomous software engineering, dark factories, RL systems, multi-agent coordination, formal verification, memory systems, cost optimization, self-healing CI/CD