kodit 0.3.3__tar.gz → 0.3.5__tar.gz

kodit-0.3.5/.claude/commands/update-docs.md

@@ -0,0 +1,79 @@
+# Update Documentation Based on Recent Code Changes
+
+## Objective
+
+Analyze recent commits in the current Git branch and update relevant documentation to reflect code changes.
+
+## Steps to Complete
+
+### 1. Analyze Recent Commits
+
+- Run `git log --oneline -n 20` to view the last 20 commits on the current branch, or
+  all commits if it is not the main branch.
+- For each commit, run `git show --name-status <commit-hash>` to see which files were modified
+- Focus on commits that modified source code files (`.js`, `.py`, `.ts`, `.java`, `.go`, `.rs`, etc.)
+
+### 2. Identify Code Changes
+
+For each modified source file in recent commits:
+
+- Examine the diff using `git diff <commit-hash>^ <commit-hash> -- <file-path>`
+- Identify:
+  - New functions or methods added
+  - Functions or methods removed or renamed
+  - Changes to function signatures (parameters, return types)
+  - New classes or modules
+  - Changes to public APIs
+  - New configuration options or environment variables
+  - Breaking changes
+
+### 3. Update README.md
+
+Check if the README.md needs updates for:
+
+- **Installation instructions**: If dependencies or setup steps changed
+- **Usage examples**: If APIs or interfaces changed
+- **Configuration**: If new environment variables or config options were added
+- **Features list**: If new features were implemented
+- **Quick start guide**: If the basic usage pattern changed
+
+### 4. Update Documentation in /docs
+
+For each markdown file in the `docs/` folder:
+
+- Check if it references any of the changed code
+- Update:
+  - API documentation with new/changed function signatures
+  - Code examples that may no longer work
+  - Configuration guides if settings changed
+  - Architecture diagrams if structural changes occurred
+  - Migration guides if there are breaking changes
+
+### 5. Create or Update Specific Docs
+
+Based on the changes found:
+
+- If new features were added without documentation, create new doc files
+- If breaking changes exist, create or update a migration guide
+- If new APIs were added, ensure they have proper documentation
+
+### 6. Verify Documentation Accuracy
+
+- Ensure all code examples in documentation are up-to-date
+- Check that any referenced file paths still exist
+- Verify that installation and setup instructions still work
+
+## Output Required
+
+1. Summary of commits analyzed and significant changes found
+2. List of documentation files updated with brief description of changes
+3. Any new documentation files created
+4. Warnings about potentially outdated documentation that needs manual review
+
+## Important Notes
+
+- Focus on user-facing changes that affect how people use Kodit
+- Don't document internal implementation details unless they affect the public API
+- Keep documentation concise and example-driven
+- If unsure about a change's impact, flag it for manual review
+- Ensure all documentation follows the existing style and format in the repository

{kodit-0.3.3 → kodit-0.3.5}/CLAUDE.md

@@ -50,18 +50,23 @@ The codebase follows Domain-Driven Design (DDD) with clean architecture:
 
 ### Key Components
 
-**Indexing Pipeline:**
+**Advanced Indexing Pipeline:**
 
-1. Clone/read source code
-2. Extract snippets using Tree-sitter
-3. Generate embeddings and BM25 indices
-4. Store in database
+1. Clone/read source code with Git metadata extraction
+2. Language detection for 20+ programming languages
+3. Advanced snippet extraction using Tree-sitter with dependency analysis
+4. Build call graphs and import maps for context-aware extraction
+5. Generate embeddings and BM25 indices
+6. Store in database with selective reindexing for performance
 
-**Search System:**
+**Advanced Search System:**
 
-- Hybrid search combining semantic (embeddings) and keyword (BM25)
+- Hybrid search combining semantic (embeddings) and keyword (BM25) with Reciprocal Rank Fusion
+- Multi-dimensional filtering: language, author, date range, source, file path
+- Context-aware results with dependency tracking and usage examples
 - Multiple providers: local models, OpenAI, custom APIs
 - Configurable via environment variables
+- Support for 20+ programming languages including HTML/CSS
 
 **MCP Server:**
 

{kodit-0.3.3 → kodit-0.3.5}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: kodit
-Version: 0.3.3
+Version: 0.3.5
 Summary: Code indexing for better AI code generation
 Project-URL: Homepage, https://docs.helixml.tech/kodit/
 Project-URL: Documentation, https://docs.helixml.tech/kodit/
@@ -92,13 +92,17 @@ code. This index is used to build a snippet library, ready for ingestion into an
 
 - Index local directories and public Git repositories
 - Build comprehensive snippet libraries for LLM ingestion
-- Support for multiple codebase types and languages
-- Efficient indexing and search capabilities
+- Support for 20+ programming languages including Python, JavaScript/TypeScript, Java, Go, Rust, C/C++, C#, HTML/CSS, and more
+- Advanced code analysis with dependency tracking and call graph generation
+- Intelligent snippet extraction with context-aware dependencies
+- Efficient indexing with selective reindexing (only processes modified files)
 - Privacy first: respects .gitignore and .noindex files
 - **NEW in 0.3**: Auto-indexing configuration for shared server deployments
 - **NEW in 0.3**: Enhanced Git provider support including Azure DevOps
 - **NEW in 0.3**: Index private repositories via a PAT
 - **NEW in 0.3**: Improved progress monitoring and reporting during indexing
+- **NEW in 0.3**: Advanced code slicing infrastructure with Tree-sitter parsing
+- **NEW in 0.4**: Automatic periodic sync to keep indexes up-to-date
 
 ### MCP Server
 
@@ -111,7 +115,9 @@ intent. Kodit has been tested to work well with:
   - [Cursor](https://docs.helix.ml/kodit/getting-started/integration/#integration-with-cursor)
   - [Cline](https://docs.helix.ml/kodit/getting-started/integration/#integration-with-cline)
 - Please contribute more instructions! ... any other assistant is likely to work ...
-- **New in 0.3**: Filter snippets by source, language, author or timestamp.
+- **New in 0.3**: Advanced search filters by source, language, author, date range, and file path
+- **New in 0.3**: Hybrid search combining BM25 keyword search with semantic search
+- **New in 0.4**: Enhanced MCP tools with rich context parameters and metadata
 
 ### Enterprise Ready
 

{kodit-0.3.3 → kodit-0.3.5}/README.md

@@ -39,13 +39,17 @@ code. This index is used to build a snippet library, ready for ingestion into an
 
 - Index local directories and public Git repositories
 - Build comprehensive snippet libraries for LLM ingestion
-- Support for multiple codebase types and languages
-- Efficient indexing and search capabilities
+- Support for 20+ programming languages including Python, JavaScript/TypeScript, Java, Go, Rust, C/C++, C#, HTML/CSS, and more
+- Advanced code analysis with dependency tracking and call graph generation
+- Intelligent snippet extraction with context-aware dependencies
+- Efficient indexing with selective reindexing (only processes modified files)
 - Privacy first: respects .gitignore and .noindex files
 - **NEW in 0.3**: Auto-indexing configuration for shared server deployments
 - **NEW in 0.3**: Enhanced Git provider support including Azure DevOps
 - **NEW in 0.3**: Index private repositories via a PAT
 - **NEW in 0.3**: Improved progress monitoring and reporting during indexing
+- **NEW in 0.3**: Advanced code slicing infrastructure with Tree-sitter parsing
+- **NEW in 0.4**: Automatic periodic sync to keep indexes up-to-date
 
 ### MCP Server
 
@@ -58,7 +62,9 @@ intent. Kodit has been tested to work well with:
   - [Cursor](https://docs.helix.ml/kodit/getting-started/integration/#integration-with-cursor)
   - [Cline](https://docs.helix.ml/kodit/getting-started/integration/#integration-with-cline)
 - Please contribute more instructions! ... any other assistant is likely to work ...
-- **New in 0.3**: Filter snippets by source, language, author or timestamp.
+- **New in 0.3**: Advanced search filters by source, language, author, date range, and file path
+- **New in 0.3**: Hybrid search combining BM25 keyword search with semantic search
+- **New in 0.4**: Enhanced MCP tools with rich context parameters and metadata
 
 ### Enterprise Ready
 

{kodit-0.3.3 → kodit-0.3.5}/docs/_index.md

@@ -49,13 +49,16 @@ code. This index is used to build a snippet library, ready for ingestion into an
 
 - Index local directories and public Git repositories
 - Build comprehensive snippet libraries for LLM ingestion
-- Support for multiple codebase types and languages
-- Efficient indexing and search capabilities
+- Support for 20+ programming languages including Python, JavaScript/TypeScript, Java, Go, Rust, C/C++, C#, HTML/CSS, and more
+- Advanced code analysis with dependency tracking and call graph generation
+- Intelligent snippet extraction with context-aware dependencies
+- Efficient indexing with selective reindexing (only processes modified files)
 - Privacy first: respects .gitignore and .noindex files
 - **NEW in 0.3**: Auto-indexing configuration for shared server deployments
 - **NEW in 0.3**: Enhanced Git provider support including Azure DevOps
 - **NEW in 0.3**: Index private repositories via a PAT
 - **NEW in 0.3**: Improved progress monitoring and reporting during indexing
+- **NEW in 0.4**: Advanced code slicing infrastructure with Tree-sitter parsing
 
 ### MCP Server
 
@@ -68,7 +71,9 @@ intent. Kodit has been tested to work well with:
   - [Cursor](./getting-started/integration/index.md#integration-with-cursor)
   - [Cline](./getting-started/integration/index.md#integration-with-cline)
 - Please contribute more instructions! ... any other assistant is likely to work ...
-- **New in 0.3**: Filter snippets by source, language, author or timestamp.
+- **New in 0.3**: Advanced search filters by source, language, author, date range, and file path
+- **New in 0.3**: Hybrid search combining BM25 keyword search with semantic search
+- **New in 0.3**: Enhanced MCP tools with rich context parameters and metadata
 
 ### Enterprise Ready
 

{kodit-0.3.3 → kodit-0.3.5}/docs/reference/configuration/index.md

@@ -117,6 +117,34 @@ DB_URL=postgresql+asyncpg://postgres:mysecretpassword@localhost:5432/kodit
 DEFAULT_SEARCH_PROVIDER=vectorchord
 ```
 
+## Configuring Sync
+
+### Periodic Sync Configuration
+
+Kodit can automatically sync all indexed codebases at regular intervals to keep them up-to-date with the latest changes. This is especially useful for server deployments where multiple users are working with the same codebases.
+
+```bash
+# Enable/disable periodic sync (default: true)
+SYNC_PERIODIC_ENABLED=true
+
+# Sync interval in seconds (default: 1800 = 30 minutes)
+SYNC_PERIODIC_INTERVAL_SECONDS=1800
+
+# Number of retry attempts for failed syncs (default: 3)
+SYNC_PERIODIC_RETRY_ATTEMPTS=3
+```
+
+The sync scheduler will:
+- Run automatically in the background when the server starts
+- Sync all existing indexes at the configured interval
+- Handle failures gracefully with retry logic
+- Log detailed progress and results
+- Shut down cleanly when the server stops
+
+{{< info >}}
+**Note**: The sync scheduler only syncs existing indexes. It does not create new indexes for repositories that haven't been indexed yet.
+{{< /info >}}
+
 ## Configuring Enrichment
 
 ### Default Enrichment Provider

{kodit-0.3.3 → kodit-0.3.5}/docs/reference/deployment/docker-compose.yaml

@@ -34,6 +34,11 @@ services:
       AUTO_INDEXING_SOURCES_1_URI: https://github.com/fastapi/fastapi
       AUTO_INDEXING_SOURCES_2_URI: https://github.com/helix-ml/kodit
 
+      # Sync configuration
+      SYNC_PERIODIC_ENABLED: true
+      SYNC_PERIODIC_INTERVAL_SECONDS: 1800  # 30 minutes
+      SYNC_PERIODIC_RETRY_ATTEMPTS: 3
+
   vectorchord:
     image: tensorchord/vchord-suite:pg17-20250601
     environment:

{kodit-0.3.3 → kodit-0.3.5}/docs/reference/deployment/kubernetes.yaml

@@ -81,6 +81,12 @@ spec:
               value: "https://github.com/pydantic/pydantic"
             - name: AUTO_INDEXING_SOURCES_1_URI
               value: "https://github.com/helix-ml/kodit"
+            - name: SYNC_PERIODIC_ENABLED
+              value: "true"
+            - name: SYNC_PERIODIC_INTERVAL_SECONDS
+              value: "1800"  # 30 minutes
+            - name: SYNC_PERIODIC_RETRY_ATTEMPTS
+              value: "3"
           ports:
             - containerPort: 8080
           readinessProbe:

{kodit-0.3.3 → kodit-0.3.5}/docs/reference/indexing/index.md

@@ -209,26 +209,51 @@ Kodit respects [standard ignore patterns](#ignore-patterns):
 - **`.gitignore`**: Standard Git ignore patterns
 - **`.noindex`**: Custom ignore patterns for Kodit (uses gitignore syntax)
 
-### Supported File Types
+### Supported Programming Languages
 
-Kodit automatically detects and processes files based on their extensions:
+Kodit automatically detects and processes files based on their extensions. The following languages are supported with advanced Tree-sitter parsing:
 
-| Language | Extensions |
-|----------|------------|
-| Python | `.py` |
-| JavaScript | `.js`, `.jsx` |
-| TypeScript | `.ts`, `.tsx` |
-| Go | `.go` |
-| C# | `.cs` |
+| Language | Extensions | Features |
+|----------|------------|----------|
+| Python | `.py`, `.pyw`, `.pyx`, `.pxd` | Function/method extraction, import analysis, call graph |
+| JavaScript | `.js`, `.jsx`, `.mjs` | Function extraction, ES6 modules, JSX support |
+| TypeScript | `.ts`, `.tsx` | Type definitions, interfaces, decorators |
+| Java | `.java` | Method declarations, constructors, class hierarchies |
+| Go | `.go` | Function/method extraction, package imports |
+| Rust | `.rs` | Function definitions, trait implementations |
+| C/C++ | `.c`, `.h`, `.cpp`, `.cc`, `.cxx`, `.hpp`, `.hxx` | Function definitions, header includes |
+| C# | `.cs` | Method declarations, using directives, constructors |
+| HTML | `.html`, `.htm` | Element extraction with ID/class identification |
+| CSS | `.css`, `.scss`, `.sass`, `.less` | Rule extraction, selector analysis, keyframes |
 
-### Snippet Extraction
+### Advanced Snippet Extraction
 
-Kodit uses tree-sitter to intelligently extract code snippets:
+Kodit uses a sophisticated Tree-sitter-based slicing system to intelligently extract code snippets with context:
+
+#### Core Features
 
 - **Functions and Methods**: Complete function definitions with their bodies
 - **Classes**: Class definitions and their methods
 - **Imports**: Import statements for context
 - **Dependencies**: Ancestor classes and functions that the snippet depends on
+- **Call Graph Analysis**: Builds relationships between functions to understand dependencies
+- **Context-Aware Extraction**: Includes related functions and usage examples
+- **Topological Sorting**: Orders dependencies for optimal LLM consumption
+
+#### Smart Dependency Tracking
+
+- **Import Maps**: Tracks import statements and their usage
+- **Function Calls**: Identifies which functions call which others
+- **Reverse Dependencies**: Finds all callers of a given function
+- **Usage Examples**: Includes examples of how functions are used in the codebase
+
+#### Language-Specific Extraction
+
+- **Python**: Decorators, async functions, class inheritance
+- **JavaScript/TypeScript**: Arrow functions, async/await, ES6 modules
+- **Java**: Annotations, generics, inheritance hierarchies
+- **Go**: Interfaces, struct methods, package organization
+- **HTML/CSS**: Elements with semantic context, CSS rules and selectors
 
 ## Configuration
 
@@ -269,9 +294,35 @@ DEFAULT_ENDPOINT_API_KEY=sk-your-api-key
 
 ## Advanced Features
 
-### Re-indexing Sources
+### Selective Re-indexing
+
+Kodit includes intelligent re-indexing that only processes files that have been modified:
+
+#### How It Works
+
+- **SHA256 Change Detection**: Compares file content hashes to detect changes
+- **File Status Tracking**: Tracks files as CLEAN, MODIFIED, or DELETED
+- **Incremental Updates**: Only re-processes changed files, improving performance for large codebases
+- **Metadata Preservation**: Maintains file metadata and Git information
+
+#### Benefits
+
+- **Performance**: Dramatically faster re-indexing for large repositories
+- **Resource Efficiency**: Reduces CPU and memory usage during updates
+- **Consistency**: Ensures only actual changes trigger re-processing
+- **Scalability**: Enables efficient handling of large, frequently-updated codebases
+
+#### Usage
 
-Future feature!
+Re-indexing automatically uses selective processing when you re-index an existing source:
+
+```sh
+# Re-index with selective processing
+kodit index /path/to/existing/source
+
+# Or for Git repositories
+kodit index https://github.com/username/repo.git
+```
 
 ### Progress Monitoring
 
@@ -281,6 +332,24 @@ Kodit shows progress during indexing operations:
 - Snippet extraction progress
 - Index building progress (BM25, embeddings)
 
+### Automatic Sync
+
+For server deployments, Kodit includes an automatic sync scheduler that keeps your indexes up-to-date:
+
+- **Periodic sync**: Automatically re-indexes all existing sources at configurable intervals
+- **Failure handling**: Gracefully handles sync failures with retry logic
+- **Background operation**: Runs in the background without blocking the MCP server
+- **Configurable timing**: Adjust sync frequency based on your needs
+
+See the [Sync Configuration](/kodit/reference/sync/index.md) documentation for detailed setup instructions.
+
+The sync scheduler is enabled by default and will:
+
+- Start automatically when you run `kodit serve`
+- Sync all existing indexes every 30 minutes by default
+- Log detailed progress and results
+- Retry failed operations up to 3 times by default
+
 ## Privacy and Security
 
 ### Local Processing

{kodit-0.3.3 → kodit-0.3.5}/docs/reference/mcp/index.md

@@ -53,21 +53,30 @@ The search tool accepts the following parameters:
 | `related_file_paths` | list[Path] | Absolute paths to relevant files | `["/path/to/auth.py"]` |
 | `related_file_contents` | list[string] | Contents of relevant files | `["def authenticate(): ..."]` |
 | `keywords` | list[string] | Relevant keywords for the search | `["authentication", "jwt", "login"]` |
-| `language` | string \| None | Filter by programming language | `"python"`, `"go"`, `"javascript"` |
+| `language` | string \| None | Filter by programming language (20+ supported) | `"python"`, `"go"`, `"javascript"`, `"html"`, `"css"` |
 | `author` | string \| None | Filter by author name | `"john.doe"` |
 | `created_after` | string \| None | Filter by creation date (YYYY-MM-DD) | `"2023-01-01"` |
 | `created_before` | string \| None | Filter by creation date (YYYY-MM-DD) | `"2023-12-31"` |
 | `source_repo` | string \| None | Filter by source repository | `"github.com/example/repo"` |
+| `file_path` | string \| None | Filter by file path pattern | `"src/"`, `"*.test.py"` |
 
-### Search Functionality
+### Advanced Search Functionality
 
-The search tool combines multiple search strategies:
+The search tool combines multiple search strategies with sophisticated ranking:
 
-1. **Keyword Search** - Uses BM25 algorithm for exact keyword matching
-2. **Semantic Code Search** - Uses embeddings to find semantically similar code
+1. **BM25 Keyword Search** - Advanced keyword matching with relevance scoring
+2. **Semantic Code Search** - Uses embeddings to find semantically similar code patterns
 3. **Semantic Text Search** - Uses embeddings to find code matching natural language descriptions
+4. **Reciprocal Rank Fusion (RRF)** - Intelligently combines results from multiple search strategies
+5. **Context-Aware Filtering** - Advanced filtering by language, author, date, source, and file path
+6. **Dependency-Aware Results** - Returns code snippets with their dependencies and usage examples
 
-Results are fused together to provide the most relevant snippets for the user's intent.
+#### Enhanced Result Quality
+
+- **Smart Snippet Selection**: Returns functions with their dependencies and context
+- **Rich Metadata**: Each result includes file path, language, author, and creation date
+- **Usage Examples**: Includes examples of how functions are used in the codebase
+- **Topological Ordering**: Dependencies are ordered for optimal LLM consumption
 
 ## Filtering Capabilities
 
@@ -81,6 +90,8 @@ Filter results by programming language:
 > "I need to create a web server in Python. Please search for Flask or FastAPI examples and show me the best practices."
 > "I'm working on a Go microservice. Can you search for Go-specific patterns for handling HTTP requests and database connections?"
 > "I need JavaScript examples for form validation. Please search for modern JavaScript/TypeScript validation patterns."
+> "I'm building a responsive layout. Please search for CSS Grid and Flexbox examples in our stylesheets."
+> "I need HTML form examples. Please search for form elements with proper accessibility attributes."
 
 ### Author Filtering
 

kodit-0.3.5/docs/reference/sync/index.md

@@ -0,0 +1,79 @@
+---
+title: Sync
+description: Automatic synchronization of indexed codebases
+weight: 3
+---
+
+Kodit includes an automatic sync scheduler that keeps your indexed codebases up-to-date with the latest changes. This is especially useful for server deployments where multiple users are working with the same codebases.
+
+## How Sync Works
+
+The sync scheduler runs as a background service that:
+
+1. **Periodically checks** all existing indexes at a configurable interval
+2. **Syncs each index** by pulling the latest changes from the source repository
+3. **Updates the search index** with any new or modified code snippets
+4. **Handles failures gracefully** with configurable retry attempts
+5. **Logs detailed progress** for monitoring and debugging
+
+## Configuration
+
+### Environment Variables
+
+Configure the sync scheduler using these environment variables:
+
+```bash
+# Enable/disable periodic sync (default: true)
+SYNC_PERIODIC_ENABLED=true
+
+# Sync interval in seconds (default: 1800 = 30 minutes)
+SYNC_PERIODIC_INTERVAL_SECONDS=1800
+
+# Number of retry attempts for failed syncs (default: 3)
+SYNC_PERIODIC_RETRY_ATTEMPTS=3
+```
+
+### Common Configuration Examples
+
+#### Quick Development Setup
+
+For rapid development with frequent changes:
+
+```bash
+SYNC_PERIODIC_ENABLED=true
+SYNC_PERIODIC_INTERVAL_SECONDS=300  # 5 minutes
+SYNC_PERIODIC_RETRY_ATTEMPTS=1
+```
+
+#### Production Server Setup
+
+For production deployments with stable codebases:
+
+```bash
+SYNC_PERIODIC_ENABLED=true
+SYNC_PERIODIC_INTERVAL_SECONDS=3600  # 1 hour
+SYNC_PERIODIC_RETRY_ATTEMPTS=3
+```
+
+#### Disable Sync
+
+If you prefer to sync manually:
+
+```bash
+SYNC_PERIODIC_ENABLED=false
+```
+
+## Limitations
+
+- **Only syncs existing indexes**: The sync scheduler does not create new indexes for repositories that haven't been indexed yet
+- **Sequential processing**: Indexes are synced one at a time to avoid overwhelming the system
+- **No conflict resolution**: If there are conflicts during sync, the operation may fail and require manual intervention
+
+## Manual Sync
+
+You can also manually sync indexes using the CLI:
+
+```bash
+# Sync all indexes
+kodit index --sync
+```

{kodit-0.3.3 → kodit-0.3.5}/pyproject.toml

@@ -104,6 +104,11 @@ source = ["src"]
 branch = true
 omit = []
 
+[tool.ruff]
+exclude = [
+  "tests/kodit/infrastructure/slicing/data/**/*.py",
+]
+
 [tool.ruff.lint]
 ignore = [
   "ANN401", # Opinionated warning on disallowing dynamically typed expressions

{kodit-0.3.3 → kodit-0.3.5}/src/kodit/_version.py

@@ -17,5 +17,5 @@ __version__: str
 __version_tuple__: VERSION_TUPLE
 version_tuple: VERSION_TUPLE
 
-__version__ = version = '0.3.3'
-__version_tuple__ = version_tuple = (0, 3, 3)
+__version__ = version = '0.3.5'
+__version_tuple__ = version_tuple = (0, 3, 5)

{kodit-0.3.3 → kodit-0.3.5}/src/kodit/app.py

@@ -6,28 +6,47 @@ from contextlib import asynccontextmanager
 from asgi_correlation_id import CorrelationIdMiddleware
 from fastapi import FastAPI
 
+from kodit.application.services.sync_scheduler import SyncSchedulerService
 from kodit.config import AppContext
 from kodit.infrastructure.indexing.auto_indexing_service import AutoIndexingService
 from kodit.mcp import mcp
 from kodit.middleware import ASGICancelledErrorMiddleware, logging_middleware
 
-# Global auto-indexing service
+# Global services
 _auto_indexing_service: AutoIndexingService | None = None
+_sync_scheduler_service: SyncSchedulerService | None = None
 
 
 @asynccontextmanager
 async def app_lifespan(_: FastAPI) -> AsyncIterator[None]:
-    """Manage application lifespan for auto-indexing."""
-    global _auto_indexing_service  # noqa: PLW0603
-    # Start auto-indexing service
+    """Manage application lifespan for auto-indexing and sync."""
+    global _auto_indexing_service, _sync_scheduler_service  # noqa: PLW0603
+
     app_context = AppContext()
     db = await app_context.get_db()
+
+    # Start auto-indexing service
     _auto_indexing_service = AutoIndexingService(
         app_context=app_context,
         session_factory=db.session_factory,
     )
     await _auto_indexing_service.start_background_indexing()
+
+    # Start sync scheduler service
+    if app_context.sync.enabled:
+        _sync_scheduler_service = SyncSchedulerService(
+            app_context=app_context,
+            session_factory=db.session_factory,
+        )
+        _sync_scheduler_service.start_periodic_sync(
+            interval_seconds=app_context.sync.interval_seconds
+        )
+
     yield
+
+    # Stop services
+    if _sync_scheduler_service:
+        await _sync_scheduler_service.stop_periodic_sync()
     if _auto_indexing_service:
         await _auto_indexing_service.stop()
 

{kodit-0.3.3 → kodit-0.3.5}/src/kodit/application/factories/code_indexing_factory.py

@@ -13,7 +13,7 @@ from kodit.domain.services.index_query_service import IndexQueryService
 from kodit.domain.services.index_service import (
     IndexDomainService,
 )
-from kodit.domain.value_objects import LanguageMapping, SnippetExtractionStrategy
+from kodit.domain.value_objects import LanguageMapping
 from kodit.infrastructure.bm25.bm25_factory import bm25_repository_factory
 from kodit.infrastructure.embedding.embedding_factory import (
     embedding_domain_service_factory,
@@ -31,15 +31,9 @@ from kodit.infrastructure.enrichment.null_enrichment_provider import (
     NullEnrichmentProvider,
 )
 from kodit.infrastructure.indexing.fusion_service import ReciprocalRankFusionService
-from kodit.infrastructure.snippet_extraction.factories import (
-    create_snippet_query_provider,
-)
-from kodit.infrastructure.snippet_extraction.language_detection_service import (
+from kodit.infrastructure.slicing.language_detection_service import (
     FileSystemLanguageDetectionService,
 )
-from kodit.infrastructure.snippet_extraction.tree_sitter_snippet_extractor import (
-    TreeSitterSnippetExtractor,
-)
 from kodit.infrastructure.sqlalchemy.embedding_repository import (
     SqlAlchemyEmbeddingRepository,
 )
@@ -63,17 +57,9 @@ def create_code_indexing_application_service(
 
     # Create infrastructure services
     language_detector = FileSystemLanguageDetectionService(language_map)
-    query_provider = create_snippet_query_provider()
 
-    # Create snippet extractors
-    method_extractor = TreeSitterSnippetExtractor(query_provider)
-
-    snippet_extractors = {
-        SnippetExtractionStrategy.METHOD_BASED: method_extractor,
-    }
     index_domain_service = IndexDomainService(
         language_detector=language_detector,
-        snippet_extractors=snippet_extractors,
         enrichment_service=enrichment_service,
         clone_dir=app_context.get_clone_dir(),
     )
@@ -136,17 +122,9 @@ def create_fast_test_code_indexing_application_service(
 
     # Create infrastructure services
     language_detector = FileSystemLanguageDetectionService(language_map)
-    query_provider = create_snippet_query_provider()
-
-    # Create snippet extractors
-    method_extractor = TreeSitterSnippetExtractor(query_provider)
 
-    snippet_extractors = {
-        SnippetExtractionStrategy.METHOD_BASED: method_extractor,
-    }
     index_domain_service = IndexDomainService(
         language_detector=language_detector,
-        snippet_extractors=snippet_extractors,
         enrichment_service=enrichment_service,
         clone_dir=app_context.get_clone_dir(),
     )