context-gen-cli 1.2.4__tar.gz → 1.3.3__tar.gz

{context_gen_cli-1.2.4 → context_gen_cli-1.3.3}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: context-gen-cli
-Version: 1.2.4
+Version: 1.3.3
 Summary: A modern CLI tool that scans any project, builds an AST-based dependency graph, and generates structured LLM context (agent.md / agent.json).
 Author: yakkshit
 License-Expression: MIT
@@ -25,7 +25,7 @@ Requires-Dist: pytest>=8.0.0; extra == "dev"
 Requires-Dist: build>=1.1.0; extra == "dev"
 Requires-Dist: twine>=5.0.0; extra == "dev"
 
-# ⚡ context-gen-cli (Python Edition)
+# ⚡ context-gen-cli (`ctx`) — Python Edition
 
 [![PyPI version](https://img.shields.io/pypi/v/context-gen-cli.svg?color=3775a9)](https://pypi.org/project/context-gen-cli/)
 [![Python Versions](https://img.shields.io/pypi/pyversions/context-gen-cli.svg)](https://pypi.org/project/context-gen-cli/)
@@ -37,13 +37,14 @@ Requires-Dist: twine>=5.0.0; extra == "dev"
 
 ## 🌟 Highlights
 
-- **100% Accurate Python Dependency Graphs**: Built using Python's native `ast` (Abstract Syntax Tree) module to resolve imports, relative packages, entry points, and utilities without regex guesswork.
+- **⚡ Short Command Alias (`ctx`)**: Type `ctx` anywhere in your terminal.
+- **100% Accurate Python Dependency Graphs**: Built using Python's native `ast` (Abstract Syntax Tree) module to resolve imports, relative packages, entry points, and utilities.
+- **📁 Clean Workspace Storage**: Everything (`agent.md`, `agent.json`, `agent.yaml`, `.context-gen.json`) is saved neatly inside `context/`.
 - **⚡ All-In-One Default Mode (`-d`)**: Auto-generates triple context formats in `context/` and runs a live auto-sync watcher in the background.
 - **`.gitignore` & Multi-Ignore Respect**: Automatically parses rules from `.gitignore`, `.npmignore`, `.dockerignore`, `.contextignore`, `.ignore`, and filters `.env*` secrets.
 - **Triple Format Output**: Generates Markdown (`agent.md`), MCP-compatible structured JSON (`agent.json`), and clean YAML (`agent.yaml`).
 - **🔄 Auto-Sync Watch Mode (`-w`)**: Monitors workspace changes and updates context files automatically on save.
-- **Configuration Parity**: Seamlessly reads `.context-gen.json` if present to maintain unified project settings with the Node.js edition.
-- **Modern CLI**: Styled with `typer` and `rich` for rich terminal output and progress reporting.
+- **Configuration Parity**: Seamlessly reads `context/.context-gen.json` to maintain unified project settings with the Node.js edition.
 
 ---
 
@@ -63,75 +64,52 @@ pip install context-gen-cli
 Generates all formats in `context/` and starts the live auto-sync watcher in background:
 
 ```bash
-context-gen -d
+ctx -d
 ```
 
 ### 2. Generate All Formats (Markdown, JSON, YAML)
 Scans the current directory and outputs `agent.md`, `agent.json`, and `agent.yaml` in `context/`:
 
 ```bash
-context-gen .
+ctx
 ```
 
-### 3. Generate Specific Format (JSON / MD / YAML)
-Generate only the format you need:
-
+### 3. Quick Refresh / Regenerate
 ```bash
-# Generate MCP-ready JSON
-context-gen . --format json
-
-# Generate Markdown
-context-gen . --format md
-
-# Generate YAML
-context-gen . --format yaml
+ctx update
 ```
 
-### 4. Watch Mode
-Keep context files fresh automatically on every file edit:
-
+### 4. Custom Format & Output Destination
 ```bash
-context-gen . --watch
+ctx update -f json
+ctx -o custom_docs/
+ctx -p /path/to/project
 ```
 
-### 5. Custom Output Destination & Directory Depth
+### 5. Watch Mode
+Keep context files fresh automatically on every file edit:
+
 ```bash
-context-gen ./my-project -o custom/docs/context.md --max-depth 4
+ctx -w
 ```
 
 ---
 
 ## 📖 CLI Reference
 
-```text
-Usage: context-gen [OPTIONS] [PATH]
-
-Arguments:
-  [PATH]    Target project directory to analyze  [default: .]
-
-Options:
-  -d, --default             ⚡ Zero-config default mode: generate all formats in context/ and run live auto-sync watcher
-  -f, --format [all|md|json|yaml]  Output format [default: all]
-  -o, --output PATH         Custom output file path (e.g. context/agent.md or custom.json)
-  -w, --watch               Watch directory and auto-regenerate context on file changes
-  --max-depth INTEGER       Maximum directory depth to scan (1-10) [default: 3]
-  --help                    Show this message and exit
-```
-
----
-
-## 🌐 Node.js & Live MCP Server
-
-Looking for the live MCP server with interactive SSE streaming and public tunnels? Check out the [Node.js edition](https://www.npmjs.com/package/context-gen-cli):
-
-```bash
-npx context-gen-cli -d
-# or
-npx context-gen-cli --mcp
-```
+| Flag / Command | Alias | Description |
+| :--- | :--- | :--- |
+| `ctx -d` | `ctx --default` | **⚡ All-in-One**: Generates context files and starts live auto-sync watcher |
+| `ctx -w` | `ctx --watch` | **👀 Watch Mode**: Auto-regenerates context on file changes |
+| `ctx -f <type>` | `ctx --format <type>` | **Format**: `md`, `json`, `yaml`, or `all` |
+| `ctx -o <path>` | `ctx --output <path>` | **Custom Output**: Output file/folder path |
+| `ctx -p <path>` | `ctx --project <path>` | **Target Directory**: Directory to analyze |
+| `ctx update` | — | **Refresh**: Regenerate context files |
+| `ctx --help` | — | View full help options |
 
 ---
 
 ## 📄 License
 
 MIT © [yakkshit](https://github.com/yakkshit)
+

{context_gen_cli-1.2.4 → context_gen_cli-1.3.3}/README.md

@@ -1,4 +1,4 @@
-# ⚡ context-gen-cli (Python Edition)
+# ⚡ context-gen-cli (`ctx`) — Python Edition
 
 [![PyPI version](https://img.shields.io/pypi/v/context-gen-cli.svg?color=3775a9)](https://pypi.org/project/context-gen-cli/)
 [![Python Versions](https://img.shields.io/pypi/pyversions/context-gen-cli.svg)](https://pypi.org/project/context-gen-cli/)
@@ -10,13 +10,14 @@
 
 ## 🌟 Highlights
 
-- **100% Accurate Python Dependency Graphs**: Built using Python's native `ast` (Abstract Syntax Tree) module to resolve imports, relative packages, entry points, and utilities without regex guesswork.
+- **⚡ Short Command Alias (`ctx`)**: Type `ctx` anywhere in your terminal.
+- **100% Accurate Python Dependency Graphs**: Built using Python's native `ast` (Abstract Syntax Tree) module to resolve imports, relative packages, entry points, and utilities.
+- **📁 Clean Workspace Storage**: Everything (`agent.md`, `agent.json`, `agent.yaml`, `.context-gen.json`) is saved neatly inside `context/`.
 - **⚡ All-In-One Default Mode (`-d`)**: Auto-generates triple context formats in `context/` and runs a live auto-sync watcher in the background.
 - **`.gitignore` & Multi-Ignore Respect**: Automatically parses rules from `.gitignore`, `.npmignore`, `.dockerignore`, `.contextignore`, `.ignore`, and filters `.env*` secrets.
 - **Triple Format Output**: Generates Markdown (`agent.md`), MCP-compatible structured JSON (`agent.json`), and clean YAML (`agent.yaml`).
 - **🔄 Auto-Sync Watch Mode (`-w`)**: Monitors workspace changes and updates context files automatically on save.
-- **Configuration Parity**: Seamlessly reads `.context-gen.json` if present to maintain unified project settings with the Node.js edition.
-- **Modern CLI**: Styled with `typer` and `rich` for rich terminal output and progress reporting.
+- **Configuration Parity**: Seamlessly reads `context/.context-gen.json` to maintain unified project settings with the Node.js edition.
 
 ---
 
@@ -36,75 +37,52 @@ pip install context-gen-cli
 Generates all formats in `context/` and starts the live auto-sync watcher in background:
 
 ```bash
-context-gen -d
+ctx -d
 ```
 
 ### 2. Generate All Formats (Markdown, JSON, YAML)
 Scans the current directory and outputs `agent.md`, `agent.json`, and `agent.yaml` in `context/`:
 
 ```bash
-context-gen .
+ctx
 ```
 
-### 3. Generate Specific Format (JSON / MD / YAML)
-Generate only the format you need:
-
+### 3. Quick Refresh / Regenerate
 ```bash
-# Generate MCP-ready JSON
-context-gen . --format json
-
-# Generate Markdown
-context-gen . --format md
-
-# Generate YAML
-context-gen . --format yaml
+ctx update
 ```
 
-### 4. Watch Mode
-Keep context files fresh automatically on every file edit:
-
+### 4. Custom Format & Output Destination
 ```bash
-context-gen . --watch
+ctx update -f json
+ctx -o custom_docs/
+ctx -p /path/to/project
 ```
 
-### 5. Custom Output Destination & Directory Depth
+### 5. Watch Mode
+Keep context files fresh automatically on every file edit:
+
 ```bash
-context-gen ./my-project -o custom/docs/context.md --max-depth 4
+ctx -w
 ```
 
 ---
 
 ## 📖 CLI Reference
 
-```text
-Usage: context-gen [OPTIONS] [PATH]
-
-Arguments:
-  [PATH]    Target project directory to analyze  [default: .]
-
-Options:
-  -d, --default             ⚡ Zero-config default mode: generate all formats in context/ and run live auto-sync watcher
-  -f, --format [all|md|json|yaml]  Output format [default: all]
-  -o, --output PATH         Custom output file path (e.g. context/agent.md or custom.json)
-  -w, --watch               Watch directory and auto-regenerate context on file changes
-  --max-depth INTEGER       Maximum directory depth to scan (1-10) [default: 3]
-  --help                    Show this message and exit
-```
-
----
-
-## 🌐 Node.js & Live MCP Server
-
-Looking for the live MCP server with interactive SSE streaming and public tunnels? Check out the [Node.js edition](https://www.npmjs.com/package/context-gen-cli):
-
-```bash
-npx context-gen-cli -d
-# or
-npx context-gen-cli --mcp
-```
+| Flag / Command | Alias | Description |
+| :--- | :--- | :--- |
+| `ctx -d` | `ctx --default` | **⚡ All-in-One**: Generates context files and starts live auto-sync watcher |
+| `ctx -w` | `ctx --watch` | **👀 Watch Mode**: Auto-regenerates context on file changes |
+| `ctx -f <type>` | `ctx --format <type>` | **Format**: `md`, `json`, `yaml`, or `all` |
+| `ctx -o <path>` | `ctx --output <path>` | **Custom Output**: Output file/folder path |
+| `ctx -p <path>` | `ctx --project <path>` | **Target Directory**: Directory to analyze |
+| `ctx update` | — | **Refresh**: Regenerate context files |
+| `ctx --help` | — | View full help options |
 
 ---
 
 ## 📄 License
 
 MIT © [yakkshit](https://github.com/yakkshit)
+

context_gen_cli-1.3.3/context_gen/cli.py

@@ -0,0 +1,242 @@
+"""
+context_gen.cli: Typer-based CLI entry point for context-gen-cli (Python Edition).
+"""
+
+import json
+import time
+from datetime import datetime
+from enum import Enum
+from pathlib import Path
+from typing import List, Optional
+import typer
+from rich.console import Console
+from rich.panel import Panel
+from rich.table import Table
+from rich.progress import Progress, SpinnerColumn, TextColumn, BarColumn, TaskProgressColumn, TimeElapsedColumn
+
+from context_gen.scanner import scan_project
+from context_gen.extractor import extract_metadata
+from context_gen.graph import build_dependency_graph
+from context_gen.generator import generate_agent_md, generate_agent_json, generate_agent_yaml
+from context_gen.distill import distill_query
+
+app = typer.Typer(
+    name="context-gen",
+    help="⚡ Generate graph-based project context & distill minimal AI prompts (ctx).",
+    add_completion=False,
+    no_args_is_help=False,
+)
+console = Console()
+
+
+class OutputFormat(str, Enum):
+    ALL = "all"
+    MD = "md"
+    JSON = "json"
+    YAML = "yaml"
+
+
+def print_python_banner() -> None:
+    banner = r"""
+   ___ _   _  __
+  / __| |_ \ \/ /
+ | (__|  _| >  < 
+  \___|\__|/_/\_\
+"""
+    console.print(f"[bold magenta]{banner}[/bold magenta]")
+    console.print(
+        Panel.fit(
+            "[bold cyan]⚡ context-gen-cli (ctx)[/bold cyan] — [magenta]Senior Engineer Context & Knowledge Graph Engine[/magenta]",
+            border_style="cyan",
+        )
+    )
+    console.print("")
+
+
+def execute_generation_with_progress(
+    target_dir: Path,
+    format_choice: OutputFormat,
+    output_override: Optional[Path] = None,
+    max_depth: int = 3,
+) -> dict:
+    with Progress(
+        SpinnerColumn("dots", style="cyan"),
+        TextColumn("[bold blue]{task.description}"),
+        BarColumn(bar_width=35, complete_style="magenta", finished_style="green"),
+        TaskProgressColumn(),
+        TimeElapsedColumn(),
+        console=console,
+    ) as progress:
+        t1 = progress.add_task("🔍 Scanning workspace files & security guards...", total=100)
+        scan_result = scan_project(str(target_dir), max_depth=max_depth)
+        progress.update(t1, completed=100)
+
+        t2 = progress.add_task("📦 Extracting metadata & tech stack signals...", total=100)
+        files = scan_result["files"]
+        tree = scan_result["tree"]
+        metadata = extract_metadata(str(target_dir), files)
+        progress.update(t2, completed=100)
+
+        t3 = progress.add_task("🕸️  Building AST module dependency graph...", total=100)
+        graph = build_dependency_graph(files, str(target_dir))
+        progress.update(t3, completed=100)
+
+        t4 = progress.add_task(f"✍️  Generating context artifacts ({format_choice.value})...", total=100)
+
+        output_dir_name = "context"
+        config_file = target_dir / "context" / ".context-gen.json"
+        if not config_file.is_file():
+            config_file = target_dir / ".context-gen.json"
+
+        if config_file.is_file():
+            try:
+                cfg = json.loads(config_file.read_text(encoding="utf-8"))
+                output_dir_name = cfg.get("outputDir", "context")
+            except Exception:
+                pass
+
+        dest_dir = target_dir / output_dir_name
+        dest_dir.mkdir(parents=True, exist_ok=True)
+        generated_files: List[Path] = []
+
+        if output_override:
+            out_file = output_override.resolve()
+            out_file.parent.mkdir(parents=True, exist_ok=True)
+            if format_choice == OutputFormat.JSON:
+                out_file.write_text(json.dumps(generate_agent_json(metadata, graph, tree, str(target_dir)), indent=2), encoding="utf-8")
+            elif format_choice == OutputFormat.YAML:
+                out_file.write_text(generate_agent_yaml(metadata, graph, tree, str(target_dir)), encoding="utf-8")
+            else:
+                out_file.write_text(generate_agent_md(metadata, graph, tree), encoding="utf-8")
+            generated_files.append(out_file)
+        else:
+            formats_to_build = ["md", "json", "yaml"] if format_choice == OutputFormat.ALL else [format_choice.value]
+            if "md" in formats_to_build:
+                f = dest_dir / "agent.md"
+                f.write_text(generate_agent_md(metadata, graph, tree), encoding="utf-8")
+                generated_files.append(f)
+            if "json" in formats_to_build:
+                f = dest_dir / "agent.json"
+                f.write_text(json.dumps(generate_agent_json(metadata, graph, tree, str(target_dir)), indent=2), encoding="utf-8")
+                generated_files.append(f)
+            if "yaml" in formats_to_build:
+                f = dest_dir / "agent.yaml"
+                f.write_text(generate_agent_yaml(metadata, graph, tree, str(target_dir)), encoding="utf-8")
+                generated_files.append(f)
+
+        progress.update(t4, completed=100)
+
+    console.print("")
+    return {
+        "files": files,
+        "graph": graph,
+        "metadata": metadata,
+        "generated_files": generated_files,
+        "output_dir": dest_dir,
+    }
+
+
+def run_watch_loop(target_dir: Path, format_choice: OutputFormat, max_depth: int = 3) -> None:
+    console.print(
+        Panel(
+            f"[bold cyan]👀 Watch Mode Active[/bold cyan]\n"
+            f"[dim]Monitoring:[/dim] [green]{target_dir}[/green]\n"
+            f"[dim]Auto-updating context on save. Press [bold]Ctrl+C[/bold] to stop.[/dim]",
+            border_style="cyan",
+        )
+    )
+
+    def get_snapshot():
+        snap = {}
+        for p in target_dir.rglob("*"):
+            if p.is_file():
+                rel = p.relative_to(target_dir).as_posix()
+                if not any(t in rel for t in ["context/", "node_modules/", ".git/", "__pycache__/", ".venv/", "agent."]):
+                    try:
+                        snap[rel] = p.stat().st_mtime
+                    except Exception:
+                        pass
+        return snap
+
+    last_snapshot = get_snapshot()
+    try:
+        while True:
+            time.sleep(1.0)
+            current = get_snapshot()
+            if current != last_snapshot:
+                last_snapshot = current
+                ts = datetime.now().strftime("%H:%M:%S")
+                console.print(f"[dim][{ts}][/dim] [bold green]🔄 Change detected. Syncing context...[/bold green]")
+                execute_generation_with_progress(target_dir, format_choice, max_depth=max_depth)
+    except KeyboardInterrupt:
+        console.print("\n[bold yellow]👋 Stopping watch mode...[/bold yellow]")
+
+
+@app.callback(invoke_without_command=True)
+def main(
+    ctx: typer.Context,
+    path: Path = typer.Argument(default=Path("."), help="Target project directory."),
+    project: Optional[Path] = typer.Option(None, "--project", "-p", help="Target project directory."),
+    default_mode: bool = typer.Option(False, "--default", "-d", help="⚡ Generate all formats + live watch mode."),
+    format: OutputFormat = typer.Option(OutputFormat.ALL, "--format", "-f", help="Output format: all, md, json, yaml."),
+    output: Optional[Path] = typer.Option(None, "--output", "-o", help="Custom output path."),
+    watch: bool = typer.Option(False, "--watch", "-w", help="Watch directory for changes."),
+    max_depth: int = typer.Option(3, "--max-depth", min=1, max=10, help="Max scan depth."),
+) -> None:
+    if ctx.invoked_subcommand is not None:
+        return
+
+    target_dir = (project or path).resolve()
+    print_python_banner()
+    res = execute_generation_with_progress(target_dir, format, output_override=output, max_depth=max_depth)
+
+    table = Table(show_header=False, box=None)
+    table.add_row("[bold]📂 Scanned Files:[/bold]", f"[cyan]{len(res['files'])}[/cyan]")
+    table.add_row("[bold]🕸️  Graph Edges:[/bold]", f"[magenta]{len(res['graph']['edges'])}[/magenta]")
+    table.add_row("[bold]⚡ Tech Stack:[/bold]", f"[green]{', '.join(res['metadata']['techStack'])}[/green]")
+    table.add_row("[bold]📁 Destination:[/bold]", f"[yellow]{res['output_dir']}[/yellow]")
+    table.add_row("[bold]�� Artifacts:[/bold]", f"[bold cyan]{', '.join(f.name for f in res['generated_files'])}[/bold cyan]")
+
+    console.print(Panel(table, title="[bold green]✅ Context Generated Successfully[/bold green]", border_style="green"))
+    console.print(
+        Panel(
+            "[bold cyan]ctx distill \"add feature\"[/bold cyan]  → 🧠 Get minimal Senior Engineer context plan\n"
+            "[bold cyan]ctx -d[/bold cyan]                      → ⚡ All-in-one generate + live watcher\n"
+            "[bold cyan]ctx update -f json[/bold cyan]          → 🔄 Quick format refresh",
+            title="[bold]💡 Quick Commands[/bold]",
+            border_style="blue",
+        )
+    )
+
+    if default_mode or watch:
+        run_watch_loop(target_dir, format, max_depth=max_depth)
+
+
+@app.command()
+def distill(
+    prompt: str = typer.Argument(..., help="Task or feature request to distill context for."),
+    budget: int = typer.Option(250, "--budget", "-b", help="Max token budget."),
+    project: Path = typer.Option(Path("."), "--project", "-p", help="Target project directory."),
+) -> None:
+    """🧠 Distill minimal high-signal context using Entropy + Knowledge Graph."""
+    res = distill_query(str(project.resolve()), prompt, budget=budget)
+    if res["status"] == "needs_clarification":
+        console.print(Panel(res["output"], title="[bold yellow]⚠️  Clarification Needed[/bold yellow]", border_style="yellow"))
+    else:
+        console.print(Panel(res["output"], title="[bold cyan]🧠 Senior Engineer Context Plan[/bold cyan]", border_style="cyan"))
+
+
+@app.command()
+def update(
+    path: Path = typer.Argument(default=Path("."), help="Target project directory."),
+    format: OutputFormat = typer.Option(OutputFormat.ALL, "--format", "-f", help="Output format."),
+    output: Optional[Path] = typer.Option(None, "--output", "-o", help="Custom output path."),
+) -> None:
+    """🔄 Regenerate and update project context files."""
+    target_dir = path.resolve()
+    res = execute_generation_with_progress(target_dir, format, output_override=output)
+    console.print(f"[bold green]✓ Context updated in {res['output_dir']}![/bold green]")
+
+
+if __name__ == "__main__":
+    app()

context_gen_cli-1.3.3/context_gen/distill.py

@@ -0,0 +1,107 @@
+import os
+import re
+import math
+from pathlib import Path
+
+IGNORE_DIRS = {
+    "node_modules", ".git", ".next", "dist", "build", ".graviton",
+    "target", "__pycache__", ".venv", "venv", ".dart_tool", "bin", "obj",
+    "test", "tests", "context", "public",
+}
+
+SUPPORTED_EXT = {
+    ".ts": "ts", ".tsx": "ts", ".js": "js", ".jsx": "js",
+    ".py": "python", ".rs": "rust", ".go": "go", ".dart": "dart", ".cs": "csharp",
+}
+
+def get_hardware_budget(file_count: int) -> dict:
+    total_cores = os.cpu_count() or 2
+    allocated = 2 if (total_cores >= 6 and file_count >= 80) else 1
+    return {"total_cores": total_cores, "allocated_threads": allocated}
+
+def scan_signatures(root_dir: Path) -> list[dict]:
+    sigs = []
+    for dirpath, dirnames, filenames in os.walk(root_dir):
+        dirnames[:] = [d for d in dirnames if d not in IGNORE_DIRS and not d.startswith(".") and not d.endswith(".egg-info")]
+        for fname in filenames:
+            ext = Path(fname).suffix
+            if ext not in SUPPORTED_EXT:
+                continue
+            full_path = Path(dirpath) / fname
+            rel_path = str(full_path.relative_to(root_dir))
+            try:
+                code = full_path.read_text(encoding="utf-8", errors="ignore")
+            except Exception:
+                continue
+
+            imports = re.findall(r"(?:import|from|use|using)\s+['\"]?([\w./:-]+)", code)[:6]
+            exports = re.findall(r"(?:export\s+(?:async\s+)?(?:function|const|class)|def|class|pub\s+fn|func)\s+([A-Za-z_]\w*)", code)[:6]
+            tokens = max(10, len(f"{rel_path} {' '.join(imports)} {' '.join(exports)}") // 4)
+            sigs.append({
+                "path": rel_path,
+                "lang": SUPPORTED_EXT[ext],
+                "imports": list(dict.fromkeys(imports)),
+                "exports": list(dict.fromkeys(exports)),
+                "tokens": tokens,
+            })
+    return sigs
+
+def distill_query(root_dir: str, prompt: str, budget: int = 250) -> dict:
+    root = Path(root_dir).resolve()
+    sigs = scan_signatures(root)
+    hw = get_hardware_budget(len(sigs))
+
+    if not sigs:
+        return {"status": "needs_clarification", "output": "No source files found. Which directory contains your code?"}
+
+    words = [w for w in re.split(r"\W+", prompt.lower()) if len(w) > 2]
+    scored = []
+    for s in sigs:
+        haystack = f"{s['path']} {' '.join(s['imports'])} {' '.join(s['exports'])}".lower()
+        hits = sum(1 for w in words if w in haystack)
+        scored.append((s, 0.1 + hits * 0.45))
+
+    max_s = max(sc for _, sc in scored)
+    exps = [math.exp((sc - max_s) / 0.35) for _, sc in scored]
+    total_exp = sum(exps)
+    probs = [e / total_exp for e in exps]
+    initial_h = -sum(p * math.log2(p) for p in probs if p > 1e-6)
+
+    ranked = sorted(
+        [(s, p, (p * initial_h * 1.6), (p * initial_h * 1.6) / s["tokens"]) for (s, _), p in zip(scored, probs)],
+        key=lambda x: x[3],
+        reverse=True,
+    )
+
+    entropy = initial_h
+    picked = []
+    used_tokens = 0
+    for sig, prob, delta_h, _ in ranked:
+        if used_tokens + sig["tokens"] > budget or entropy < 1.5:
+            break
+        if prob < 0.05 and picked:
+            break
+        picked.append(sig)
+        used_tokens += sig["tokens"]
+        entropy = max(0.35, entropy - delta_h)
+
+    if entropy >= 1.5 or (len(words) <= 3 and ranked[0][1] < 0.22):
+        sample = ranked[0][0]["path"] if ranked else "src/main.py"
+        output = (
+            f"CLARIFICATION NEEDED (Before Writing Code):\n"
+            f"1. **Implementation Pattern:** Should I extend an existing module? (e.g., *Follow `{sample}`* or *Create a standalone file*)\n"
+            f"2. **Side Effects:** Should this persist state/files or run read-only?"
+        )
+        return {"status": "needs_clarification", "output": output}
+
+    refs = "\n".join(
+        f"  • {p['path']} [{p['lang']}] — exports: [{', '.join(p['exports'][:4])}], imports: [{', '.join(p['imports'][:4])}]"
+        for p in picked
+    )
+    output = (
+        f"### Senior Engineer Context Plan ({used_tokens} tokens | CPU: {hw['allocated_threads']} core)\n"
+        f"- **Task:** {prompt}\n"
+        f"- **Primary Files to Reference:**\n{refs}\n"
+        f"- **Architecture Guardrail:** Match existing imports, function signatures, and module boundaries."
+    )
+    return {"status": "ready", "output": output}

{context_gen_cli-1.2.4 → context_gen_cli-1.3.3}/context_gen_cli.egg-info/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: context-gen-cli
-Version: 1.2.4
+Version: 1.3.3
 Summary: A modern CLI tool that scans any project, builds an AST-based dependency graph, and generates structured LLM context (agent.md / agent.json).
 Author: yakkshit
 License-Expression: MIT
@@ -25,7 +25,7 @@ Requires-Dist: pytest>=8.0.0; extra == "dev"
 Requires-Dist: build>=1.1.0; extra == "dev"
 Requires-Dist: twine>=5.0.0; extra == "dev"
 
-# ⚡ context-gen-cli (Python Edition)
+# ⚡ context-gen-cli (`ctx`) — Python Edition
 
 [![PyPI version](https://img.shields.io/pypi/v/context-gen-cli.svg?color=3775a9)](https://pypi.org/project/context-gen-cli/)
 [![Python Versions](https://img.shields.io/pypi/pyversions/context-gen-cli.svg)](https://pypi.org/project/context-gen-cli/)
@@ -37,13 +37,14 @@ Requires-Dist: twine>=5.0.0; extra == "dev"
 
 ## 🌟 Highlights
 
-- **100% Accurate Python Dependency Graphs**: Built using Python's native `ast` (Abstract Syntax Tree) module to resolve imports, relative packages, entry points, and utilities without regex guesswork.
+- **⚡ Short Command Alias (`ctx`)**: Type `ctx` anywhere in your terminal.
+- **100% Accurate Python Dependency Graphs**: Built using Python's native `ast` (Abstract Syntax Tree) module to resolve imports, relative packages, entry points, and utilities.
+- **📁 Clean Workspace Storage**: Everything (`agent.md`, `agent.json`, `agent.yaml`, `.context-gen.json`) is saved neatly inside `context/`.
 - **⚡ All-In-One Default Mode (`-d`)**: Auto-generates triple context formats in `context/` and runs a live auto-sync watcher in the background.
 - **`.gitignore` & Multi-Ignore Respect**: Automatically parses rules from `.gitignore`, `.npmignore`, `.dockerignore`, `.contextignore`, `.ignore`, and filters `.env*` secrets.
 - **Triple Format Output**: Generates Markdown (`agent.md`), MCP-compatible structured JSON (`agent.json`), and clean YAML (`agent.yaml`).
 - **🔄 Auto-Sync Watch Mode (`-w`)**: Monitors workspace changes and updates context files automatically on save.
-- **Configuration Parity**: Seamlessly reads `.context-gen.json` if present to maintain unified project settings with the Node.js edition.
-- **Modern CLI**: Styled with `typer` and `rich` for rich terminal output and progress reporting.
+- **Configuration Parity**: Seamlessly reads `context/.context-gen.json` to maintain unified project settings with the Node.js edition.
 
 ---
 
@@ -63,75 +64,52 @@ pip install context-gen-cli
 Generates all formats in `context/` and starts the live auto-sync watcher in background:
 
 ```bash
-context-gen -d
+ctx -d
 ```
 
 ### 2. Generate All Formats (Markdown, JSON, YAML)
 Scans the current directory and outputs `agent.md`, `agent.json`, and `agent.yaml` in `context/`:
 
 ```bash
-context-gen .
+ctx
 ```
 
-### 3. Generate Specific Format (JSON / MD / YAML)
-Generate only the format you need:
-
+### 3. Quick Refresh / Regenerate
 ```bash
-# Generate MCP-ready JSON
-context-gen . --format json
-
-# Generate Markdown
-context-gen . --format md
-
-# Generate YAML
-context-gen . --format yaml
+ctx update
 ```
 
-### 4. Watch Mode
-Keep context files fresh automatically on every file edit:
-
+### 4. Custom Format & Output Destination
 ```bash
-context-gen . --watch
+ctx update -f json
+ctx -o custom_docs/
+ctx -p /path/to/project
 ```
 
-### 5. Custom Output Destination & Directory Depth
+### 5. Watch Mode
+Keep context files fresh automatically on every file edit:
+
 ```bash
-context-gen ./my-project -o custom/docs/context.md --max-depth 4
+ctx -w
 ```
 
 ---
 
 ## 📖 CLI Reference
 
-```text
-Usage: context-gen [OPTIONS] [PATH]
-
-Arguments:
-  [PATH]    Target project directory to analyze  [default: .]
-
-Options:
-  -d, --default             ⚡ Zero-config default mode: generate all formats in context/ and run live auto-sync watcher
-  -f, --format [all|md|json|yaml]  Output format [default: all]
-  -o, --output PATH         Custom output file path (e.g. context/agent.md or custom.json)
-  -w, --watch               Watch directory and auto-regenerate context on file changes
-  --max-depth INTEGER       Maximum directory depth to scan (1-10) [default: 3]
-  --help                    Show this message and exit
-```
-
----
-
-## 🌐 Node.js & Live MCP Server
-
-Looking for the live MCP server with interactive SSE streaming and public tunnels? Check out the [Node.js edition](https://www.npmjs.com/package/context-gen-cli):
-
-```bash
-npx context-gen-cli -d
-# or
-npx context-gen-cli --mcp
-```
+| Flag / Command | Alias | Description |
+| :--- | :--- | :--- |
+| `ctx -d` | `ctx --default` | **⚡ All-in-One**: Generates context files and starts live auto-sync watcher |
+| `ctx -w` | `ctx --watch` | **👀 Watch Mode**: Auto-regenerates context on file changes |
+| `ctx -f <type>` | `ctx --format <type>` | **Format**: `md`, `json`, `yaml`, or `all` |
+| `ctx -o <path>` | `ctx --output <path>` | **Custom Output**: Output file/folder path |
+| `ctx -p <path>` | `ctx --project <path>` | **Target Directory**: Directory to analyze |
+| `ctx update` | — | **Refresh**: Regenerate context files |
+| `ctx --help` | — | View full help options |
 
 ---
 
 ## 📄 License
 
 MIT © [yakkshit](https://github.com/yakkshit)
+

{context_gen_cli-1.2.4 → context_gen_cli-1.3.3}/context_gen_cli.egg-info/SOURCES.txt

@@ -2,6 +2,7 @@ README.md
 pyproject.toml
 context_gen/__init__.py
 context_gen/cli.py
+context_gen/distill.py
 context_gen/extractor.py
 context_gen/generator.py
 context_gen/graph.py

{context_gen_cli-1.2.4 → context_gen_cli-1.3.3}/pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta"
 
 [project]
 name = "context-gen-cli"
-version = "1.2.4"
+version = "1.3.3"
 description = "A modern CLI tool that scans any project, builds an AST-based dependency graph, and generates structured LLM context (agent.md / agent.json)."
 readme = "README.md"
 authors = [{ name = "yakkshit" }]

context_gen_cli-1.2.4/context_gen/cli.py

@@ -1,287 +0,0 @@
-"""
-context_gen.cli: Typer-based CLI entry point for context-gen-cli (Python Edition).
-"""
-
-import json
-import time
-from datetime import datetime
-from enum import Enum
-from pathlib import Path
-from typing import List, Optional
-import typer
-from rich.console import Console
-from rich.panel import Panel
-from rich.table import Table
-
-from context_gen.scanner import scan_project
-from context_gen.extractor import extract_metadata
-from context_gen.graph import build_dependency_graph
-from context_gen.generator import generate_agent_md, generate_agent_json, generate_agent_yaml
-
-app = typer.Typer(
-    name="context-gen",
-    help="⚡ Generate graph-based project context (agent.md, agent.json, agent.yaml) for LLMs.",
-    add_completion=False,
-    no_args_is_help=False
-)
-console = Console()
-
-
-class OutputFormat(str, Enum):
-    """Supported output formats."""
-    ALL = "all"
-    MD = "md"
-    JSON = "json"
-    YAML = "yaml"
-
-
-def execute_generation(
-    target_dir: Path,
-    format_choice: OutputFormat,
-    output_override: Optional[Path] = None,
-    max_depth: int = 3,
-    verbose: bool = True
-) -> dict:
-    """Scans and generates the requested context format files."""
-    scan_result = scan_project(str(target_dir), max_depth=max_depth)
-    files = scan_result["files"]
-    tree = scan_result["tree"]
-
-    metadata = extract_metadata(str(target_dir), files)
-    graph = build_dependency_graph(files, str(target_dir))
-
-    # Read output directory from .context-gen.json if available
-    config_file = target_dir / ".context-gen.json"
-    output_dir_name = "context"
-    if config_file.is_file():
-        try:
-            with open(config_file, "r", encoding="utf-8") as f:
-                cfg = json.load(f)
-                output_dir_name = cfg.get("outputDir", "context")
-        except Exception:
-            pass
-
-    dest_dir = target_dir / output_dir_name
-    dest_dir.mkdir(parents=True, exist_ok=True)
-
-    generated_files: List[Path] = []
-
-    if output_override:
-        out_file = output_override.resolve()
-        out_file.parent.mkdir(parents=True, exist_ok=True)
-        if format_choice == OutputFormat.JSON:
-            json_data = generate_agent_json(metadata, graph, tree, str(target_dir))
-            out_file.write_text(json.dumps(json_data, indent=2), encoding="utf-8")
-        elif format_choice == OutputFormat.YAML:
-            yaml_text = generate_agent_yaml(metadata, graph, tree, str(target_dir))
-            out_file.write_text(yaml_text, encoding="utf-8")
-        else:
-            md_text = generate_agent_md(metadata, graph, tree)
-            out_file.write_text(md_text, encoding="utf-8")
-        generated_files.append(out_file)
-    else:
-        # Determine formats to generate
-        formats_to_build = ["md", "json", "yaml"] if format_choice == OutputFormat.ALL else [format_choice.value]
-
-        if "md" in formats_to_build:
-            md_file = dest_dir / "agent.md"
-            md_text = generate_agent_md(metadata, graph, tree)
-            md_file.write_text(md_text, encoding="utf-8")
-            generated_files.append(md_file)
-
-        if "json" in formats_to_build:
-            json_file = dest_dir / "agent.json"
-            json_data = generate_agent_json(metadata, graph, tree, str(target_dir))
-            json_file.write_text(json.dumps(json_data, indent=2), encoding="utf-8")
-            generated_files.append(json_file)
-
-        if "yaml" in formats_to_build:
-            yaml_file = dest_dir / "agent.yaml"
-            yaml_text = generate_agent_yaml(metadata, graph, tree, str(target_dir))
-            yaml_file.write_text(yaml_text, encoding="utf-8")
-            generated_files.append(yaml_file)
-
-    return {
-        "files": files,
-        "graph": graph,
-        "metadata": metadata,
-        "generated_files": generated_files,
-        "output_dir": dest_dir
-    }
-
-
-def run_watch_loop(target_dir: Path, format_choice: OutputFormat, max_depth: int = 3) -> None:
-    """Runs a live background file watch loop that regenerates context on changes."""
-    console.print(
-        Panel(
-            f"[bold cyan]👀 Watch Mode Active[/bold cyan]\n"
-            f"[dim]Monitoring workspace:[/dim] [green]{target_dir}[/green]\n"
-            f"[dim]Auto-updating context files on save. Press [bold]Ctrl+C[/bold] to exit.[/dim]",
-            border_style="cyan"
-        )
-    )
-
-    last_snapshot = {}
-
-    def get_snapshot():
-        snap = {}
-        for p in target_dir.rglob("*"):
-            if p.is_file():
-                rel = p.relative_to(target_dir).as_posix()
-                if not any(token in rel for token in ["context/", "node_modules/", ".git/", "__pycache__/", ".venv/", "agent."]):
-                    try:
-                        snap[rel] = p.stat().st_mtime
-                    except Exception:
-                        pass
-        return snap
-
-    last_snapshot = get_snapshot()
-
-    try:
-        while True:
-            time.sleep(1.0)
-            current_snapshot = get_snapshot()
-
-            changed = False
-            for f, mtime in current_snapshot.items():
-                if f not in last_snapshot or last_snapshot[f] != mtime:
-                    changed = True
-                    break
-
-            if not changed and set(last_snapshot.keys()) != set(current_snapshot.keys()):
-                changed = True
-
-            if changed:
-                last_snapshot = current_snapshot
-                time_str = datetime.now().strftime("%H:%M:%S")
-                console.print(f"[dim][{time_str}][/dim] [bold green]🔄 Project changed. Regenerating context files...[/bold green]")
-                execute_generation(target_dir, format_choice, max_depth=max_depth, verbose=False)
-                console.print(f"[dim][{time_str}][/dim] [bold cyan]✓ Context files updated & synced in context/![/bold cyan]")
-    except KeyboardInterrupt:
-        console.print("\n[bold yellow]👋 Stopping watch mode...[/bold yellow]")
-
-
-@app.command()
-def main(
-    path: Path = typer.Argument(
-        default=Path("."),
-        help="Target project directory to analyze.",
-        file_okay=False,
-        dir_okay=True,
-        readable=True,
-        resolve_path=True,
-    ),
-    project: Optional[Path] = typer.Option(
-        None,
-        "--project",
-        "-p",
-        help="Target project directory to analyze.",
-        file_okay=False,
-        dir_okay=True,
-        readable=True,
-        resolve_path=True,
-    ),
-    default_mode: bool = typer.Option(
-        False,
-        "--default",
-        "-d",
-        help="⚡ Zero-config default mode: generate all formats in context/ and run live auto-sync watcher.",
-    ),
-    format: OutputFormat = typer.Option(
-        OutputFormat.ALL,
-        "--format",
-        "-f",
-        help="Output format: 'all', 'md', 'json', or 'yaml'.",
-        case_sensitive=False,
-    ),
-    mcp: bool = typer.Option(
-        False,
-        "--mcp",
-        "-m",
-        help="Start MCP server mode.",
-    ),
-    interactive: bool = typer.Option(
-        False,
-        "--interactive",
-        "-i",
-        help="Run in interactive mode.",
-    ),
-    output: Optional[Path] = typer.Option(
-        None,
-        "--output",
-        "-o",
-        help="Custom output file path (e.g. context/agent.md or custom.json).",
-    ),
-    watch: bool = typer.Option(
-        False,
-        "--watch",
-        "-w",
-        help="Watch directory and auto-regenerate context on file changes.",
-    ),
-    max_depth: int = typer.Option(
-        3,
-        "--max-depth",
-        help="Maximum directory depth to scan.",
-        min=1,
-        max=10,
-    ),
-) -> None:
-    """
-    Scan a project, build an AST-powered dependency graph, and generate LLM context.
-    """
-    target_dir = (project or path).resolve()
-
-    # If -d / --default is supplied, generate all formats and keep watch running
-    if default_mode:
-        console.print(
-            Panel.fit(
-                f"[bold cyan]⚡ context-gen-cli (Python All-In-One Mode -d)[/bold cyan]\n"
-                f"[dim]Target:[/dim] [green]{target_dir}[/green]\n"
-                f"[dim]Mode:[/dim] [yellow]Auto-Generate All Formats + Live Background Watcher[/yellow]",
-                border_style="cyan"
-            )
-        )
-        res = execute_generation(target_dir, OutputFormat.ALL, max_depth=max_depth)
-        table = Table(show_header=False, box=None)
-        table.add_row("[bold]Scanned Files:[/bold]", f"[cyan]{len(res['files'])}[/cyan]")
-        table.add_row("[bold]AST Graph Edges:[/bold]", f"[cyan]{len(res['graph']['edges'])}[/cyan]")
-        table.add_row("[bold]Tech Stack:[/bold]", f"[green]{', '.join(res['metadata']['techStack'])}[/green]")
-        table.add_row("[bold]Generated Files:[/bold]", f"[yellow]{', '.join(f.name for f in res['generated_files'])}[/yellow]")
-        console.print(Panel(table, title="[bold green]✅ Context Generated in context/[/bold green]", border_style="green"))
-        run_watch_loop(target_dir, OutputFormat.ALL, max_depth=max_depth)
-        return
-
-    console.print(
-        Panel.fit(
-            f"[bold cyan]⚡ context-gen-cli (Python Edition)[/bold cyan]\n"
-            f"[dim]Analyzing target:[/dim] [green]{target_dir}[/green]\n"
-            f"[dim]Format:[/dim] [yellow]{format.value.upper()}[/yellow]",
-            border_style="cyan"
-        )
-    )
-
-    with console.status("[bold green]Scanning directory and parsing AST graph...[/bold green]"):
-        res = execute_generation(target_dir, format, output_override=output, max_depth=max_depth)
-
-    # Display completion summary
-    table = Table(show_header=False, box=None)
-    table.add_row("[bold]Scanned Files:[/bold]", f"[cyan]{len(res['files'])}[/cyan]")
-    table.add_row("[bold]AST Graph Edges:[/bold]", f"[cyan]{len(res['graph']['edges'])}[/cyan]")
-    table.add_row("[bold]Tech Stack:[/bold]", f"[green]{', '.join(res['metadata']['techStack'])}[/green]")
-    table.add_row("[bold]Output Destination:[/bold]", f"[yellow]{res['output_dir']}[/yellow]")
-    table.add_row("[bold]Generated Files:[/bold]", f"[green]{', '.join(f.name for f in res['generated_files'])}[/green]")
-
-    console.print(
-        Panel(
-            table,
-            title="[bold green]✅ Context Generated Successfully[/bold green]",
-            border_style="green"
-        )
-    )
-
-    if watch:
-        run_watch_loop(target_dir, format, max_depth=max_depth)
-
-
-if __name__ == "__main__":
-    app()