empathy-framework 4.7.0__tar.gz → 4.8.0__tar.gz

{empathy_framework-4.7.0 → empathy_framework-4.8.0}/CHANGELOG.md

@@ -5,6 +5,394 @@ All notable changes to the Empathy Framework will be documented in this file.
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+## [Unreleased]
+
+### Added
+
+- **Parallel project scanning** - Multi-core file analysis enabled by default
+  - `ParallelProjectScanner` uses multiprocessing for 2-4x faster scanning
+  - `ProjectIndex` now uses parallel scanner automatically
+  - Configurable worker count: `ProjectIndex(workers=4)`
+  - Auto-detects CPU cores by default
+  - **Files**: `src/empathy_os/project_index/scanner_parallel.py` (330 lines)
+
+- **Incremental scanning** - Git diff-based updates for 10x faster development workflow
+  - `ProjectIndex.refresh_incremental()` scans only changed files
+  - Uses `git diff` to identify modified/added/deleted files
+  - Supports custom base refs: `refresh_incremental(base_ref="origin/main")`
+  - Falls back gracefully when git not available
+  - **Performance**: 10x faster for small changes (10-100 files)
+  - **Files**: `src/empathy_os/project_index/index.py` (150+ lines added)
+
+- **Optional dependency analysis** - Skip expensive dependency graph for 27% speedup
+  - `scanner.scan(analyze_dependencies=False)` for quick scans
+  - `index.refresh(analyze_dependencies=False)` for fast refreshes
+  - **Performance**: 2.62s vs 3.59s for 3,472 files
+
+- **Scanner usage examples** - Comprehensive examples demonstrating optimizations
+  - 6 complete examples in `examples/scanner_usage.py`
+  - Quick scan, full scan, incremental update, worker tuning, etc.
+  - Run with: `python examples/scanner_usage.py`
+
+- **Performance documentation** - Complete optimization guide
+  - `docs/SCANNER_OPTIMIZATIONS.md` (400+ lines)
+  - `docs/IMPLEMENTATION_COMPLETE.md` (implementation summary)
+  - `benchmarks/OPTIMIZATION_SUMMARY.md` (technical analysis)
+  - `benchmarks/PROFILING_REPORT.md` (profiling results)
+
+### Changed
+
+- **ProjectIndex default behavior** - Now uses parallel scanning automatically
+  - `ProjectIndex.refresh()` 2x faster with no code changes
+  - Backward compatible - existing code automatically benefits
+  - Disable with: `ProjectIndex(use_parallel=False)`
+
+- **ProjectScanner optimizations** - Skip AST analysis for test files
+  - Test files use simple regex for test counting instead of full AST parsing
+  - Saves ~30% of AST traversal time for cold cache scenarios
+  - **Files**: `src/empathy_os/project_index/scanner.py` (lines 429-488)
+
+### Performance
+
+**Benchmarks** (3,472 files on 12-core machine):
+
+| Configuration | Time | Speedup |
+|---------------|------|---------|
+| Sequential (baseline) | 3.59s | 1.00x |
+| Optimized (no deps) | 2.62s | 1.37x |
+| Parallel (12 workers) | 1.84s | 1.95x |
+| Parallel (no deps) | 0.98s | **3.65x** |
+
+**Incremental scanning**:
+
+| Changed Files | Full Scan | Incremental | Speedup |
+|---------------|-----------|-------------|---------|
+| 10 files | 1.0s | 0.1s | **10x** |
+| 100 files | 1.0s | 0.3s | **3.3x** |
+
+**Combined impact** (development workflow):
+
+- Before: 3.59s per scan
+- After: 0.2s incremental updates
+- **18x faster for typical usage!** 🚀
+
+---
+
+## [5.0.0] - 2026-01-26
+
+### ⚠️ BREAKING CHANGES - Claude-Native Architecture
+
+**Empathy Framework is now exclusively Claude-native.** Non-Anthropic providers have been removed.
+
+**What This Means for Users:**
+
+- You must set `ANTHROPIC_API_KEY` environment variable
+- Configuration must use `provider: "anthropic"` (only valid value)
+- All workflows now use Claude models exclusively
+- OpenAI, Google Gemini, Ollama, and Hybrid mode are no longer supported
+
+**Why This Change:**
+
+- **90% cost reduction** - Unlock prompt caching (coming in v5.1.0)
+- **200K context window** - Largest available (vs 128K)
+- **Extended thinking** - See Claude's reasoning process
+- **Simplified codebase** - 600+ lines of provider abstraction removed
+- **Faster iteration** - No need to test against 4 different APIs
+
+**Migration Guide:** [docs/CLAUDE_NATIVE.md](docs/CLAUDE_NATIVE.md)
+
+---
+
+### Removed
+
+- **OpenAI provider support** - All OpenAI-specific code removed
+  - `MODEL_REGISTRY["openai"]` no longer exists
+  - `provider="openai"` will raise `ValueError`
+  - GPT models (gpt-4o, gpt-4o-mini, o1) no longer available
+  - **Files**: `src/empathy_os/models/registry.py` (~100 lines removed)
+
+- **Google Gemini provider support** - All Google-specific code removed
+  - `MODEL_REGISTRY["google"]` no longer exists
+  - `provider="google"` will raise `ValueError`
+  - Gemini models (flash, pro, 2.5-pro) no longer available
+  - **Files**: `src/empathy_os/models/registry.py` (~100 lines removed)
+
+- **Ollama (local) provider support** - All Ollama-specific code removed
+  - `MODEL_REGISTRY["ollama"]` no longer exists
+  - `provider="ollama"` will raise `ValueError`
+  - Local Llama models no longer supported
+  - `_check_ollama_available()` method removed
+  - **Files**: `src/empathy_os/models/registry.py`, `src/empathy_os/models/provider_config.py`
+
+- **Hybrid mode** - Multi-provider tier mixing removed
+  - `MODEL_REGISTRY["hybrid"]` no longer exists
+  - `ProviderMode.HYBRID` removed from enum
+  - `configure_hybrid_interactive()` function deleted (177 lines)
+  - CLI command `empathy provider hybrid` removed
+  - **Files**: `src/empathy_os/models/provider_config.py`, `src/empathy_os/cli/commands/provider.py`, `src/empathy_os/cli/parsers/provider.py`
+
+- **Custom mode** - Per-tier provider selection removed
+  - `ProviderMode.CUSTOM` removed from enum
+  - `tier_providers` configuration no longer used
+  - **Files**: `src/empathy_os/models/provider_config.py`
+
+- **Deprecation warnings** - No longer needed
+  - `src/empathy_os/models/_deprecation.py` deleted entirely
+  - `warn_once()`, `warn_non_anthropic_provider()` removed
+  - Deprecation imports removed from registry and provider_config
+
+- **Provider-specific tests** - 3 test files deleted
+  - `tests/unit/models/test_provider_deprecation.py` (208 lines)
+  - `tests/unit/cache/test_hybrid_cache.py`
+  - `tests/unit/cache/test_hybrid_eviction.py`
+
+---
+
+### Changed
+
+- **MODEL_REGISTRY** - Now contains only Anthropic models
+  - Before: `{"anthropic": {...}, "openai": {...}, "google": {...}, "ollama": {...}, "hybrid": {...}}`
+  - After: `{"anthropic": {...}}`
+  - **Size reduction**: 167 lines removed
+  - **File**: `src/empathy_os/models/registry.py`
+
+- **ModelProvider enum** - Reduced to single value
+  - Before: `ANTHROPIC, OPENAI, GOOGLE, OLLAMA, HYBRID, CUSTOM`
+  - After: `ANTHROPIC`
+  - **File**: `src/empathy_os/models/registry.py:33-36`
+
+- **ProviderMode enum** - Reduced to single value
+  - Before: `SINGLE, HYBRID, CUSTOM`
+  - After: `SINGLE`
+  - **File**: `src/empathy_os/models/provider_config.py:21-24`
+
+- **ProviderConfig.detect_available_providers()** - Only checks for Anthropic
+  - Removed environment variable checks for `OPENAI_API_KEY`, `GOOGLE_API_KEY`, `GEMINI_API_KEY`
+  - Removed Ollama availability check
+  - Now only checks for `ANTHROPIC_API_KEY`
+  - **File**: `src/empathy_os/models/provider_config.py:50-61`
+
+- **ProviderConfig.auto_detect()** - Always returns Anthropic configuration
+  - Removed multi-provider priority logic
+  - Always sets `primary_provider="anthropic"`, `mode=ProviderMode.SINGLE`
+  - **File**: `src/empathy_os/models/provider_config.py:122-134`
+
+- **ProviderConfig.get_model_for_tier()** - Simplified to Anthropic-only
+  - Removed HYBRID and CUSTOM mode logic
+  - Always uses `MODEL_REGISTRY["anthropic"]`
+  - **File**: `src/empathy_os/models/provider_config.py:136-146`
+
+- **FallbackPolicy.get_fallback_chain()** - Provider list updated
+  - Before: `all_providers = ["anthropic", "openai", "ollama"]`
+  - After: `all_providers = ["anthropic"]`
+  - Provider-to-provider fallback no longer applicable
+  - Tier-to-tier fallback within Anthropic still functional
+  - **File**: `src/empathy_os/models/fallback.py:95`
+
+- **CLI commands** - Updated for Anthropic-only
+  - `empathy provider show` - Displays only Anthropic models
+  - `empathy provider set <provider>` - Errors if provider != "anthropic"
+  - Removed `empathy provider hybrid` command
+  - **Files**: `src/empathy_os/cli/commands/provider.py`, `src/empathy_os/cli/parsers/provider.py`
+
+- **ModelRegistry.get_model()** - Now raises ValueError for non-Anthropic
+  - Before: Returns `None` for invalid provider
+  - After: Raises `ValueError` with migration guide message
+  - **File**: `src/empathy_os/models/registry.py:388-419`
+
+- **Test files** - All tests updated to use Anthropic
+  - Batch updated 7 test files: `sed 's/provider="openai"/provider="anthropic"/g'`
+  - Updated `tests/unit/models/test_registry.py` to expect single provider
+  - All 26 registry tests passing
+  - **Files**: Multiple test files updated
+
+- **Documentation** - Updated to reflect v5.0.0 completion
+  - `docs/CLAUDE_NATIVE.md` - Marked Phase 2 as complete
+  - `README.md` - Updated timeline to show v5.0.0 complete
+  - **Timeline**: v4.8.0 → v5.0.0 → v5.1.0 (prompt caching)
+
+---
+
+### Migration Required
+
+**For all users upgrading from v4.x:**
+
+1. **Set Anthropic API key:**
+
+   ```bash
+   export ANTHROPIC_API_KEY='your-key-here'
+   ```
+
+   Get your key at: <https://console.anthropic.com/settings/keys>
+
+2. **Update configuration files:**
+
+   ```yaml
+   # .empathy/workflows.yaml
+   default_provider: anthropic  # Changed from openai/google/ollama
+   ```
+
+3. **Update code references:**
+
+   ```python
+   # Before (v4.x)
+   workflow = TestGenerationWorkflow(provider="openai")
+   config = ProviderConfig(mode=ProviderMode.HYBRID)
+
+   # After (v5.0.0)
+   workflow = TestGenerationWorkflow(provider="anthropic")
+   config = ProviderConfig(mode=ProviderMode.SINGLE)  # Only valid mode
+   ```
+
+4. **Update model references:**
+
+   - `gpt-4o` → `claude-sonnet-4-5`
+   - `gpt-4o-mini` → `claude-3-5-haiku-20241022`
+   - `gemini-1.5-pro` → `claude-sonnet-4-5`
+   - `llama3.1:8b` → `claude-3-5-haiku-20241022`
+
+**Need Help?** See [docs/CLAUDE_NATIVE.md](docs/CLAUDE_NATIVE.md) for detailed migration guide.
+
+---
+
+### Code Metrics
+
+- **Lines removed**: ~600 lines of provider abstraction code
+- **Test files deleted**: 3 (705 lines)
+- **Test files updated**: 7+ files
+- **Commits**: 9 commits implementing Phase 2
+- **Files modified**: 10+ core files
+
+---
+
+### What's Next
+
+**v5.1.0 (February 2026)** - Claude-Native Features:
+- Prompt caching enabled by default (90% cost reduction)
+- Extended thinking support for debugging
+- Optimized for Claude's 200K context window
+- New Claude-specific workflow examples
+
+---
+
+## [4.8.0] - 2026-01-26
+
+### 🎯 Strategic Direction - Claude-Native Architecture
+
+**Empathy Framework is transitioning to Claude-native architecture** to fully leverage Anthropic's advanced features:
+
+- **Prompt Caching:** 90% cost reduction on repeated prompts (coming in v5.1.0)
+- **200K Context Window:** Largest available (vs 128K for competitors)
+- **Extended Thinking:** See Claude's internal reasoning process
+- **Advanced Tool Use:** Optimized for agentic workflows
+
+**Timeline:**
+- ✅ v4.8.0 (Jan 2026): Deprecation warnings added
+- 🚧 v5.0.0 (Feb 2026): Non-Anthropic providers removed (BREAKING)
+- 🎉 v5.1.0 (Feb 2026): Prompt caching enabled by default
+
+**Migration Guide:** [docs/CLAUDE_NATIVE.md](docs/CLAUDE_NATIVE.md)
+
+### Added
+
+- **Deprecation warnings for non-Anthropic providers** - OpenAI, Google Gemini, Ollama, and Hybrid mode now emit deprecation warnings
+  - Warnings displayed once per session with clear migration guidance
+  - Full warning includes timeline, benefits, and migration steps
+  - **Files**: `src/empathy_os/models/_deprecation.py`, `src/empathy_os/models/registry.py`, `src/empathy_os/models/provider_config.py`
+
+- **SQLite-based workflow history** - Production-ready replacement for JSON file storage
+  - 10-100x faster queries with indexed SQLite database
+  - Concurrent-safe ACID transactions
+  - Full CRUD operations with filtering and aggregation
+  - Automatic migration script with validation and backups
+  - 26 comprehensive tests (all passing)
+  - **Files**: `src/empathy_os/workflows/history.py`, `scripts/migrate_workflow_history.py`, `tests/unit/workflows/test_workflow_history.py`
+
+- **Builder pattern for workflows** - Simplified workflow construction with fluent API
+  - Replaces 12+ parameter constructors with chainable methods
+  - Type-safe generic implementation
+  - More discoverable via IDE autocomplete
+  - **File**: `src/empathy_os/workflows/builder.py`
+
+- **Tier routing strategies** - Pluggable routing algorithms (stubs, integration pending)
+  - `CostOptimizedRouting` - Minimize cost (default)
+  - `PerformanceOptimizedRouting` - Minimize latency
+  - `BalancedRouting` - Balance cost and performance
+  - `HybridRouting` - User-configured tier mappings
+  - **File**: `src/empathy_os/workflows/routing.py`
+
+- **Architecture decision records** - Comprehensive documentation of design decisions
+  - ADR-002: BaseWorkflow refactoring strategy (800+ lines)
+  - Covers tier routing, SQLite migration, builder pattern, enum deprecation
+  - **File**: `docs/adr/002-baseworkflow-refactoring-strategy.md`
+
+- **Migration documentation** - Complete guides for Claude-native transition
+  - `docs/CLAUDE_NATIVE.md` - Migration guide with timeline, FAQ, troubleshooting
+  - `docs/SQLITE_HISTORY_MIGRATION_GUIDE.md` - SQLite history migration guide
+  - `docs/ANTHROPIC_ONLY_ARCHITECTURE_BRAINSTORM.md` - Strategic analysis
+
+### Deprecated
+
+- **Non-Anthropic providers** - OpenAI, Google Gemini, Ollama, and Hybrid mode will be removed in v5.0.0 (February 2026)
+  - Deprecation warnings added with clear migration path
+  - All existing functionality continues to work
+  - **Timeline**: v4.8.0 (warnings) → v5.0.0 (removal)
+
+- **`workflows.base.ModelTier`** - Use `empathy_os.models.ModelTier` instead
+  - Local ModelTier enum in workflows module is redundant
+  - Will be removed in v5.0.0
+  - **File**: `src/empathy_os/workflows/base.py`
+
+### Changed
+
+- **README updated** - Added strategic direction banner explaining Claude-native transition
+- **Model registry comments** - Added deprecation notices to non-Anthropic provider sections
+- **Workflow history storage** - BaseWorkflow now uses SQLite by default with JSON fallback
+  - Singleton pattern for history store
+  - 100% backward compatible
+
+### Performance
+
+- **Workflow history queries** - 10-100x faster with SQLite indexes
+  - `get_stats()`: O(n) file scan → O(1) SQL aggregation
+  - `query_runs()`: O(n) linear scan → O(log n) indexed lookup
+  - Memory usage: O(n) → O(1) for statistics
+
+### Documentation
+
+- **Session summary** - Comprehensive summary of refactoring work (390+ lines)
+  - Documents all completed work, decisions, and next steps
+  - **File**: `docs/SESSION_SUMMARY_2026-01-26.md`
+
+### Testing
+
+- **15 new deprecation tests** - All passing
+  - Tests for warning emissions, message content, and once-per-session behavior
+  - Tests for ModelRegistry and ProviderConfig warning integration
+  - **File**: `tests/unit/models/test_provider_deprecation.py`
+
+- **26 new history tests** - All passing
+  - Comprehensive coverage of SQLite history store
+  - Tests for CRUD, filtering, aggregation, concurrency
+  - **File**: `tests/unit/workflows/test_workflow_history.py`
+
+## [4.7.1] - 2026-01-25
+
+### Changed
+
+- **README streamlined** from 1,241 to 329 lines for better developer approachability
+  - Removed version history (v3.6-v4.6) - now in CHANGELOG only
+  - Added Command Hubs table showing new `/dev`, `/testing`, `/docs` structure
+  - Added Socratic Method section explaining guided workflow discovery
+  - Consolidated features into scannable sections
+
+### Housekeeping
+
+- **Root directory cleanup** - Reduced from 93 to 6 markdown files
+  - Archived session logs, reports, and summaries to `docs/archive/`
+  - Moved utility scripts to `scripts/` and `examples/`
+  - Removed deprecated wizard directories
+
 ## [4.7.0] - 2026-01-24
 
 ### Security

{empathy_framework-4.7.0 → empathy_framework-4.8.0}/MANIFEST.in

@@ -126,6 +126,8 @@ prune htmlcov_logging
 prune site
 prune .pytest_cache
 prune .mypy_cache
+recursive-exclude * .mypy_cache
+recursive-exclude src .mypy_cache
 prune .ruff_cache
 
 # Coverage and audit reports