sourcefire 0.2.0__tar.gz

sourcefire-0.2.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Athar Wani / Cravv HQ
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

sourcefire-0.2.0/MANIFEST.in

@@ -0,0 +1,4 @@
+recursive-include sourcefire/static *
+recursive-include sourcefire/prompts *
+include LICENSE
+include README.md

sourcefire-0.2.0/PKG-INFO

@@ -0,0 +1,145 @@
+Metadata-Version: 2.4
+Name: sourcefire
+Version: 0.2.0
+Summary: AI-powered codebase RAG from your terminal — index any project, ask questions, get answers with full source context.
+Author-email: Athar Wani <athar@cravv.com>
+License: MIT
+Project-URL: Homepage, https://github.com/waniathar2/sourcefire
+Project-URL: Repository, https://github.com/waniathar2/sourcefire
+Project-URL: Issues, https://github.com/waniathar2/sourcefire/issues
+Keywords: rag,codebase,ai,code-search,embeddings,chromadb,gemini
+Classifier: Development Status :: 4 - Beta
+Classifier: Environment :: Console
+Classifier: Environment :: Web Environment
+Classifier: Framework :: FastAPI
+Classifier: Intended Audience :: Developers
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Topic :: Software Development :: Documentation
+Classifier: Topic :: Software Development :: Libraries :: Python Modules
+Classifier: Topic :: Text Processing :: Indexing
+Requires-Python: >=3.11
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: chromadb
+Requires-Dist: langchain
+Requires-Dist: langchain-google-genai
+Requires-Dist: fastapi
+Requires-Dist: uvicorn[standard]
+Requires-Dist: sse-starlette
+Requires-Dist: sentence-transformers
+Requires-Dist: tree-sitter
+Requires-Dist: python-dotenv
+Requires-Dist: watchfiles
+Requires-Dist: tomli-w
+Provides-Extra: dev
+Requires-Dist: pytest; extra == "dev"
+Requires-Dist: pytest-asyncio; extra == "dev"
+Requires-Dist: httpx; extra == "dev"
+Dynamic: license-file
+
+# Sourcefire
+
+AI-powered codebase RAG from your terminal. Index any project, ask questions, get answers with full source context.
+
+## Install
+
+```bash
+pip install sourcefire
+```
+
+## Quick Start
+
+```bash
+cd your-project
+sourcefire
+```
+
+That's it. Sourcefire will:
+
+1. **Auto-detect** your project structure and language
+2. **Generate** smart include/exclude patterns via LLM
+3. **Index** your codebase into a local ChromaDB vector database
+4. **Serve** a web UI where you can ask questions about your code
+5. **Watch** for file changes and re-index automatically
+
+## Requirements
+
+- Python 3.11+
+- A [Gemini API key](https://ai.google.dev/) (prompted on first run, saved to `.env`)
+
+## How It Works
+
+Sourcefire creates a `.sourcefire/` directory in your project root:
+
+```
+.sourcefire/
+  ├── config.toml    # Project config (auto-generated, editable)
+  ├── chroma/        # Vector database (local, no server needed)
+  └── graph.json     # Import graph for code navigation
+```
+
+- **No PostgreSQL** — uses ChromaDB (SQLite-backed, embedded)
+- **No external services** — everything runs locally
+- **Per-project isolation** — each project gets its own database
+
+## Features
+
+- **Zero config** — first run auto-generates everything via LLM analysis
+- **8 language profiles** — Python, JavaScript/TypeScript, Go, Rust, Java, Dart, C, C++
+- **AST-aware chunking** — splits code at function/class boundaries using tree-sitter
+- **Live re-indexing** — file watcher detects changes and re-indexes automatically
+- **3 query modes** — Debug (stack traces), Feature (architecture), Explain (walkthroughs)
+- **18 code exploration tools** — the LLM can read files, search code, trace call chains, git blame, and more
+- **Incremental indexing** — only re-indexes files that changed since last run
+
+## CLI Options
+
+```
+sourcefire [--port PORT] [--no-open] [--reinit] [--verbose]
+```
+
+| Flag | Description |
+|------|-------------|
+| `--port PORT` | Server port (default: 8000) |
+| `--no-open` | Don't auto-open browser |
+| `--reinit` | Regenerate include/exclude patterns via LLM |
+| `--verbose` | Verbose logging |
+
+## Configuration
+
+Edit `.sourcefire/config.toml` to customize:
+
+```toml
+[project]
+name = "my-project"
+language = "auto"          # or "python", "go", "rust", etc.
+
+[indexer]
+include = ["src/**/*.py"]  # glob patterns to index
+exclude = ["__pycache__/**", ".venv/**"]
+chunk_size = 1000
+chunk_overlap = 300
+
+[llm]
+model = "gemini-2.5-flash"
+api_key_env = "GEMINI_API_KEY"
+
+[server]
+port = 8000
+
+[retrieval]
+top_k = 8
+relevance_threshold = 0.3
+```
+
+## Subdirectory Support
+
+Run `sourcefire` from any subdirectory — it walks up the tree to find `.sourcefire/`, just like `git` finds `.git/`.
+
+## License
+
+MIT — Created by [Athar Wani](https://github.com/waniathar2) / Cravv HQ

sourcefire-0.2.0/README.md

@@ -0,0 +1,102 @@
+# Sourcefire
+
+AI-powered codebase RAG from your terminal. Index any project, ask questions, get answers with full source context.
+
+## Install
+
+```bash
+pip install sourcefire
+```
+
+## Quick Start
+
+```bash
+cd your-project
+sourcefire
+```
+
+That's it. Sourcefire will:
+
+1. **Auto-detect** your project structure and language
+2. **Generate** smart include/exclude patterns via LLM
+3. **Index** your codebase into a local ChromaDB vector database
+4. **Serve** a web UI where you can ask questions about your code
+5. **Watch** for file changes and re-index automatically
+
+## Requirements
+
+- Python 3.11+
+- A [Gemini API key](https://ai.google.dev/) (prompted on first run, saved to `.env`)
+
+## How It Works
+
+Sourcefire creates a `.sourcefire/` directory in your project root:
+
+```
+.sourcefire/
+  ├── config.toml    # Project config (auto-generated, editable)
+  ├── chroma/        # Vector database (local, no server needed)
+  └── graph.json     # Import graph for code navigation
+```
+
+- **No PostgreSQL** — uses ChromaDB (SQLite-backed, embedded)
+- **No external services** — everything runs locally
+- **Per-project isolation** — each project gets its own database
+
+## Features
+
+- **Zero config** — first run auto-generates everything via LLM analysis
+- **8 language profiles** — Python, JavaScript/TypeScript, Go, Rust, Java, Dart, C, C++
+- **AST-aware chunking** — splits code at function/class boundaries using tree-sitter
+- **Live re-indexing** — file watcher detects changes and re-indexes automatically
+- **3 query modes** — Debug (stack traces), Feature (architecture), Explain (walkthroughs)
+- **18 code exploration tools** — the LLM can read files, search code, trace call chains, git blame, and more
+- **Incremental indexing** — only re-indexes files that changed since last run
+
+## CLI Options
+
+```
+sourcefire [--port PORT] [--no-open] [--reinit] [--verbose]
+```
+
+| Flag | Description |
+|------|-------------|
+| `--port PORT` | Server port (default: 8000) |
+| `--no-open` | Don't auto-open browser |
+| `--reinit` | Regenerate include/exclude patterns via LLM |
+| `--verbose` | Verbose logging |
+
+## Configuration
+
+Edit `.sourcefire/config.toml` to customize:
+
+```toml
+[project]
+name = "my-project"
+language = "auto"          # or "python", "go", "rust", etc.
+
+[indexer]
+include = ["src/**/*.py"]  # glob patterns to index
+exclude = ["__pycache__/**", ".venv/**"]
+chunk_size = 1000
+chunk_overlap = 300
+
+[llm]
+model = "gemini-2.5-flash"
+api_key_env = "GEMINI_API_KEY"
+
+[server]
+port = 8000
+
+[retrieval]
+top_k = 8
+relevance_threshold = 0.3
+```
+
+## Subdirectory Support
+
+Run `sourcefire` from any subdirectory — it walks up the tree to find `.sourcefire/`, just like `git` finds `.git/`.
+
+## License
+
+MIT — Created by [Athar Wani](https://github.com/waniathar2) / Cravv HQ

sourcefire-0.2.0/pyproject.toml

@@ -0,0 +1,60 @@
+[project]
+name = "sourcefire"
+version = "0.2.0"
+description = "AI-powered codebase RAG from your terminal — index any project, ask questions, get answers with full source context."
+readme = "README.md"
+license = {text = "MIT"}
+requires-python = ">=3.11"
+authors = [
+    {name = "Athar Wani", email = "athar@cravv.com"},
+]
+keywords = ["rag", "codebase", "ai", "code-search", "embeddings", "chromadb", "gemini"]
+classifiers = [
+    "Development Status :: 4 - Beta",
+    "Environment :: Console",
+    "Environment :: Web Environment",
+    "Framework :: FastAPI",
+    "Intended Audience :: Developers",
+    "License :: OSI Approved :: MIT License",
+    "Programming Language :: Python :: 3",
+    "Programming Language :: Python :: 3.11",
+    "Programming Language :: Python :: 3.12",
+    "Programming Language :: Python :: 3.13",
+    "Topic :: Software Development :: Documentation",
+    "Topic :: Software Development :: Libraries :: Python Modules",
+    "Topic :: Text Processing :: Indexing",
+]
+dependencies = [
+    "chromadb",
+    "langchain",
+    "langchain-google-genai",
+    "fastapi",
+    "uvicorn[standard]",
+    "sse-starlette",
+    "sentence-transformers",
+    "tree-sitter",
+    "python-dotenv",
+    "watchfiles",
+    "tomli-w",
+]
+
+[project.optional-dependencies]
+dev = ["pytest", "pytest-asyncio", "httpx"]
+
+[project.urls]
+Homepage = "https://github.com/waniathar2/sourcefire"
+Repository = "https://github.com/waniathar2/sourcefire"
+Issues = "https://github.com/waniathar2/sourcefire/issues"
+
+[project.scripts]
+sourcefire = "sourcefire.cli:main"
+
+[tool.setuptools.package-data]
+sourcefire = ["static/**/*", "prompts/**/*"]
+
+[tool.setuptools.packages.find]
+include = ["sourcefire*"]
+
+[build-system]
+requires = ["setuptools>=68.0"]
+build-backend = "setuptools.build_meta"

sourcefire-0.2.0/setup.cfg

@@ -0,0 +1,4 @@
+[egg_info]
+tag_build = 
+tag_date = 0
+

sourcefire-0.2.0/sourcefire/api/models.py

@@ -0,0 +1,24 @@
+"""Pydantic request/response models for the Sourcefire API."""
+
+from typing import Literal
+
+from pydantic import BaseModel
+
+
+class QueryRequest(BaseModel):
+    query: str
+    mode: Literal["debug", "feature", "explain"] = "debug"
+    model: Literal["gemini-2.5-flash", "gemini-2.5-pro"] = "gemini-2.5-flash"
+    history: list[dict] = []
+
+
+class StatusResponse(BaseModel):
+    files_indexed: int
+    last_indexed: str
+    index_status: str
+    language: str = "generic"
+
+
+class SourceResponse(BaseModel):
+    content: str
+    language: str

sourcefire-0.2.0/sourcefire/api/routes.py

@@ -0,0 +1,166 @@
+"""FastAPI router for the Sourcefire API."""
+
+from __future__ import annotations
+
+import json
+from pathlib import Path
+from typing import Any, AsyncGenerator
+
+from fastapi import APIRouter, HTTPException, Query
+from sse_starlette.sse import EventSourceResponse
+
+from sourcefire.api.models import QueryRequest, SourceResponse, StatusResponse
+
+router = APIRouter(prefix="/api")
+
+# ---------------------------------------------------------------------------
+# Module-level dependency state — set once at startup via init_dependencies()
+# ---------------------------------------------------------------------------
+
+_collection: Any = None
+_graph: Any = None
+_profile: Any = None
+_project_dir: Path | None = None
+_gemini_api_key: str = ""
+_index_status: dict[str, Any] = {
+    "files_indexed": 0,
+    "last_indexed": "never",
+    "index_status": "not_ready",
+    "language": "generic",
+}
+
+
+def init_dependencies(
+    collection: Any,
+    graph: Any,
+    index_status: dict[str, Any],
+    profile: Any = None,
+    project_dir: Path | None = None,
+    gemini_api_key: str = "",
+) -> None:
+    """Inject shared dependencies from the application lifespan."""
+    global _collection, _graph, _index_status, _profile, _project_dir, _gemini_api_key
+    _collection = collection
+    _graph = graph
+    _index_status = index_status
+    _profile = profile
+    _project_dir = project_dir
+    _gemini_api_key = gemini_api_key
+
+
+# ---------------------------------------------------------------------------
+# Language detection helper
+# ---------------------------------------------------------------------------
+
+_EXTENSION_TO_LANGUAGE: dict[str, str] = {
+    ".dart": "dart",
+    ".py": "python",
+    ".md": "markdown",
+    ".yaml": "yaml",
+    ".yml": "yaml",
+    ".json": "json",
+    ".ts": "typescript",
+    ".tsx": "typescript",
+    ".js": "javascript",
+    ".jsx": "javascript",
+    ".html": "html",
+    ".css": "css",
+    ".sh": "bash",
+    ".go": "go",
+    ".rs": "rust",
+    ".java": "java",
+    ".kt": "kotlin",
+    ".swift": "swift",
+    ".rb": "ruby",
+    ".php": "php",
+    ".c": "c",
+    ".cpp": "cpp",
+    ".h": "c",
+    ".hpp": "cpp",
+    ".toml": "toml",
+    ".xml": "xml",
+    ".sql": "sql",
+    ".graphql": "graphql",
+    ".proto": "protobuf",
+    ".tf": "hcl",
+    ".dockerfile": "dockerfile",
+}
+
+
+def _detect_language(file_path: Path) -> str:
+    name = file_path.name.lower()
+    if name == "dockerfile":
+        return "dockerfile"
+    if name == "makefile":
+        return "makefile"
+    return _EXTENSION_TO_LANGUAGE.get(file_path.suffix.lower(), "plaintext")
+
+
+# ---------------------------------------------------------------------------
+# Routes
+# ---------------------------------------------------------------------------
+
+
+@router.post("/query")
+async def query(request: QueryRequest) -> EventSourceResponse:
+    """Stream a RAG response for the given query via Server-Sent Events."""
+    if not _gemini_api_key:
+        raise HTTPException(
+            status_code=503,
+            detail="GEMINI_API_KEY is not configured.",
+        )
+
+    from sourcefire.chain.rag_chain import stream_rag_response
+
+    async def _event_generator() -> AsyncGenerator[dict[str, str], None]:
+        async for chunk in stream_rag_response(
+            collection=_collection,
+            graph=_graph,
+            query=request.query,
+            mode=request.mode,
+            model=request.model,
+            history=request.history,
+            profile=_profile,
+            project_dir=_project_dir,
+            gemini_api_key=_gemini_api_key,
+        ):
+            yield {"data": json.dumps(chunk)}
+
+    return EventSourceResponse(_event_generator())
+
+
+@router.get("/sources", response_model=SourceResponse)
+async def sources(path: str = Query(..., description="Relative path within the codebase")) -> SourceResponse:
+    """Return the content and detected language of a source file."""
+    if _project_dir is None:
+        raise HTTPException(status_code=503, detail="Project directory not initialized.")
+
+    codebase_resolved = _project_dir.resolve()
+    full_path = (_project_dir / path).resolve()
+
+    if not str(full_path).startswith(str(codebase_resolved)):
+        raise HTTPException(status_code=400, detail="Path traversal detected.")
+
+    if not full_path.is_file():
+        raise HTTPException(status_code=404, detail=f"File not found: {path}")
+
+    try:
+        content = full_path.read_text(encoding="utf-8", errors="replace")
+    except OSError as exc:
+        raise HTTPException(status_code=500, detail=f"Could not read file: {exc}") from exc
+
+    return SourceResponse(
+        content=content,
+        language=_detect_language(full_path),
+    )
+
+
+@router.get("/status", response_model=StatusResponse)
+async def status() -> StatusResponse:
+    """Return current index status."""
+    return StatusResponse(
+        files_indexed=_index_status.get("files_indexed", 0),
+        last_indexed=str(_index_status.get("last_indexed", "never")),
+        index_status=str(_index_status.get("index_status", "not_ready")),
+        language=str(_index_status.get("language", "generic")),
+    )