codigest 0.3.3__tar.gz → 0.3.6__tar.gz

{codigest-0.3.3 → codigest-0.3.6}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: codigest
-Version: 0.3.3
+Version: 0.3.6
 Summary: Human-Centered Codebase Context Manager for LLMs
 Project-URL: Homepage, https://github.com/SJB777/codigest
 Project-URL: Repository, https://github.com/SJB777/codigest
@@ -92,13 +92,12 @@ cdg init
 
 Scans the codebase and generates a structured XML snapshot. Includes a **Pre-flight Check** to prevent accidental token overflow.
 
-* **Output:** `.codigest/snapshot.xml`
+* **Output:** `.codigest/snapshot.txt` (or stdout with `-s`)
 * **Features:**
 * **Smart Confirmation:** Automatically skips confirmation for small contexts, but warns you for large ones (>30k tokens).
 * **Dependency Resolution (`-r`):** Automatically finds and includes local files imported by your target files.
 * **Scope Control:** You can specify folders or files to scan.
-
-
+* **Terminal Output (`-s` / `--stdout`):** Output directly to stdout instead of saving to file.
 
 ```bash
 # Basic scan (Interactive confirmation if large)
@@ -109,30 +108,39 @@ cdg scan src/main.py -r
 
 # Force execution without confirmation (Good for CI/CD)
 cdg scan -y --message "Automated snapshot"
+
+# Output directly to stdout
+cdg scan -s
 ```
 
 ### 3. Incremental Changes (`diff`)
 
 Tracks text-based changes between the last `scan` and the current working tree.
 
-* **Output:** `.codigest/changes.diff`
+* **Output:** `.codigest/changes.diff` (or stdout with `-s`)
 * **Use Case:** "I modified 3 files. Here is exactly what changed since the last snapshot."
 * **Note:** Checks against the internal Shadow Git, enabling tracking without committing to the real Git.
 
 ```bash
 cdg diff
+
+# Output directly to stdout
+cdg diff -s
 ```
 
 ### 4. Semantic Analysis (`semdiff`)
 
 Analyzes **structural changes** (AST-based) rather than line-by-line text differences.
 
-* **Output:** `.codigest/semdiff.xml`
+* **Output:** `.codigest/semdiff.txt` (or stdout with `-s`)
 * **Use Case:** "I refactored the API. Show me added/removed functions or signature changes."
 * **Benefit:** Reduces token usage by ignoring formatting/comment changes.
 
 ```bash
 cdg semdiff
+
+# Output directly to stdout
+cdg semdiff -s
 ```
 
 ### 5. Project Tree (`tree`)
@@ -150,11 +158,38 @@ cdg tree
 
 Generates a high-level outline of the project structure (Classes, Functions, Methods only).
 
-* **Output:** `.codigest/digest.xml`
+* **Output:** `.codigest/digest.txt` (or stdout with `-s`)
 * **Use Case:** "Don't read the implementation details. Just understand the class hierarchy."
 
 ```bash
 cdg digest
+
+# Output directly to stdout
+cdg digest -s
+```
+
+### 7. Environment Status (`status`)
+
+Displays the health of `.codigest`, anchor snapshot baseline, pending working tree changes, and generated artifacts.
+
+* **Use Case:** "Check what files have changed since my last snapshot and inspect the state of generated context artifacts."
+
+```bash
+cdg status
+```
+
+### 8. Environment Cleanup (`clean`)
+
+Removes the `.codigest/` environment and resets all context anchors and artifacts.
+
+* **Use Case:** "Clean up context files and resets Codigest tracking."
+
+```bash
+# Interactive confirmation
+cdg clean
+
+# Force clean without prompt
+cdg clean -y
 ```
 
 ---

{codigest-0.3.3 → codigest-0.3.6}/README.md

@@ -67,13 +67,12 @@ cdg init
 
 Scans the codebase and generates a structured XML snapshot. Includes a **Pre-flight Check** to prevent accidental token overflow.
 
-* **Output:** `.codigest/snapshot.xml`
+* **Output:** `.codigest/snapshot.txt` (or stdout with `-s`)
 * **Features:**
 * **Smart Confirmation:** Automatically skips confirmation for small contexts, but warns you for large ones (>30k tokens).
 * **Dependency Resolution (`-r`):** Automatically finds and includes local files imported by your target files.
 * **Scope Control:** You can specify folders or files to scan.
-
-
+* **Terminal Output (`-s` / `--stdout`):** Output directly to stdout instead of saving to file.
 
 ```bash
 # Basic scan (Interactive confirmation if large)
@@ -84,30 +83,39 @@ cdg scan src/main.py -r
 
 # Force execution without confirmation (Good for CI/CD)
 cdg scan -y --message "Automated snapshot"
+
+# Output directly to stdout
+cdg scan -s
 ```
 
 ### 3. Incremental Changes (`diff`)
 
 Tracks text-based changes between the last `scan` and the current working tree.
 
-* **Output:** `.codigest/changes.diff`
+* **Output:** `.codigest/changes.diff` (or stdout with `-s`)
 * **Use Case:** "I modified 3 files. Here is exactly what changed since the last snapshot."
 * **Note:** Checks against the internal Shadow Git, enabling tracking without committing to the real Git.
 
 ```bash
 cdg diff
+
+# Output directly to stdout
+cdg diff -s
 ```
 
 ### 4. Semantic Analysis (`semdiff`)
 
 Analyzes **structural changes** (AST-based) rather than line-by-line text differences.
 
-* **Output:** `.codigest/semdiff.xml`
+* **Output:** `.codigest/semdiff.txt` (or stdout with `-s`)
 * **Use Case:** "I refactored the API. Show me added/removed functions or signature changes."
 * **Benefit:** Reduces token usage by ignoring formatting/comment changes.
 
 ```bash
 cdg semdiff
+
+# Output directly to stdout
+cdg semdiff -s
 ```
 
 ### 5. Project Tree (`tree`)
@@ -125,11 +133,38 @@ cdg tree
 
 Generates a high-level outline of the project structure (Classes, Functions, Methods only).
 
-* **Output:** `.codigest/digest.xml`
+* **Output:** `.codigest/digest.txt` (or stdout with `-s`)
 * **Use Case:** "Don't read the implementation details. Just understand the class hierarchy."
 
 ```bash
 cdg digest
+
+# Output directly to stdout
+cdg digest -s
+```
+
+### 7. Environment Status (`status`)
+
+Displays the health of `.codigest`, anchor snapshot baseline, pending working tree changes, and generated artifacts.
+
+* **Use Case:** "Check what files have changed since my last snapshot and inspect the state of generated context artifacts."
+
+```bash
+cdg status
+```
+
+### 8. Environment Cleanup (`clean`)
+
+Removes the `.codigest/` environment and resets all context anchors and artifacts.
+
+* **Use Case:** "Clean up context files and resets Codigest tracking."
+
+```bash
+# Interactive confirmation
+cdg clean
+
+# Force clean without prompt
+cdg clean -y
 ```
 
 ---

{codigest-0.3.3 → codigest-0.3.6}/pyproject.toml

@@ -1,6 +1,6 @@
 [project]
 name = "codigest"
-version = "0.3.3"
+version = "0.3.6"
 description = "Human-Centered Codebase Context Manager for LLMs"
 authors = [{name = "Codigest Team", email = "sngd024@google.com"}]
 readme = "README.md"
@@ -36,4 +36,4 @@ cdg = "codigest.main:app"
 
 [build-system]
 requires = ["hatchling"]
-build-backend = "hatchling.build"
+build-backend = "hatchling.build"

codigest-0.3.6/src/codigest/commands/clean.py

@@ -0,0 +1,45 @@
+import typer
+import shutil
+from pathlib import Path
+from rich.console import Console
+
+from ..core import common
+
+app = typer.Typer()
+console = Console()
+
+@app.callback(invoke_without_command=True)
+def handle(
+    target: Path = typer.Argument(
+        Path.cwd(),
+        help="Target directory to clean",
+        exists=True,
+        file_okay=False,
+        dir_okay=True,
+        resolve_path=True
+    ),
+    yes: bool = typer.Option(False, "-y", "--yes", "-f", "--force", help="Skip confirmation prompt"),
+):
+    """
+    [Cleanup] Removes the .codigest environment and clears all context anchors and artifacts.
+    """
+    ctx = common.get_context(target)
+    root_path = ctx.root_path
+    codigest_dir = root_path / ".codigest"
+
+    if not codigest_dir.exists():
+        console.print(f"[yellow]No .codigest directory found in {root_path}[/yellow]")
+        return
+
+    if not yes:
+        console.print(f"[yellow]Warning: This will remove [bold]{codigest_dir}[/bold] and all stored context/anchors.[/yellow]")
+        if not typer.confirm("Are you sure you want to remove .codigest?"):
+            console.print("[red]Aborted.[/red]")
+            raise typer.Exit()
+
+    try:
+        shutil.rmtree(codigest_dir)
+        console.print(f"[bold green]✔ Successfully removed .codigest environment from {root_path}[/bold green]")
+    except Exception as e:
+        console.print(f"[bold red]Error removing .codigest:[/bold red] {e}")
+        raise typer.Exit(1)

{codigest-0.3.3 → codigest-0.3.6}/src/codigest/commands/diff.py

@@ -4,15 +4,14 @@ from pathlib import Path
 from rich.console import Console
 from rich.progress import Progress, SpinnerColumn, TextColumn
 
-from ..core import scanner, prompts, shadow
-from .scan import _load_config_filters 
+from ..core import prompts, shadow, tags, common
 
 app = typer.Typer()
 console = Console()
+err_console = Console(stderr=True)
 
 @app.callback(invoke_without_command=True)
 def handle(
-    # target 인자 추가
     target: Path = typer.Argument(
         Path.cwd(), 
         help="Target directory to check diff",
@@ -23,49 +22,54 @@ def handle(
     ),
     copy: bool = typer.Option(True, help="Auto-copy to clipboard"),
     save: bool = typer.Option(True, help="Save to .codigest/changes.diff"),
+    stdout: bool = typer.Option(False, "-s", "--stdout", help="Print output to terminal (stdout) instead of file"),
     message: str = typer.Option("", "--message", "-m", help="Add specific instruction context"),
+    # [추가] resolve 옵션
+    resolve: bool = typer.Option(False, "-r", "--resolve", help="Recursively resolve imports"),
 ):
     """
     [Context Update] Shows changes since the last 'codigest scan'.
     Useful for updating LLM context without re-uploading everything.
     """
-    root_path = target
-    anchor = shadow.ContextAnchor(root_path)
+    log_console = err_console if stdout else console
+
+    # [1] Context Setup
+    ctx = common.get_context(target)
+    root_path = ctx.root_path
     
-    # 1. Check Baseline Existence
+    anchor = shadow.ContextAnchor(root_path)
+
+    # Check Baseline
     last_update = anchor.get_last_update_time()
     if last_update == "Never":
-        console.print("[yellow]No scan history found.[/yellow]")
-        console.print("   Run [bold cyan]codigest scan[/bold cyan] first to establish a baseline.")
+        log_console.print("[yellow]⚠️  No scan history found.[/yellow]")
+        log_console.print("   Run [bold cyan]cdg scan[/bold cyan] first to establish a baseline.")
         raise typer.Exit(1)
 
-    console.print(f"[dim]Checking changes since last scan ({last_update})...[/dim]")
+    log_console.print(f"[dim]Checking changes since last scan ({last_update})...[/dim]")
 
-    # 2. Calculate Diff
+    # [2] Calculate Diff via Context
     with Progress(
         SpinnerColumn(),
         TextColumn("[bold blue]Analyzing changes...[/bold blue]"),
         transient=True,
-        console=console
+        console=log_console
     ) as progress:
         task = progress.add_task("diff", total=None)
-        
-        # Load same filters as scan
-        extensions, extra_ignores = _load_config_filters(root_path)
-        
-        # Get current valid files (Working Tree)
-        current_files = scanner.scan_project(root_path, extensions, extra_ignores)
-        
+
+        # ★ Use common context to get files (handles config & resolve)
+        current_files = ctx.get_target_files(resolve_deps=resolve)
+
         # Compare Working Tree vs Anchor
         diff_content = anchor.get_changes(current_files)
-        
+
         progress.update(task, completed=100)
 
     if not diff_content.strip():
-        console.print("[green]✨ No changes detected since last scan.[/green]")
+        log_console.print("[green]No changes detected since last scan.[/green]")
         return
 
-    # 3. Render
+    # [3] Render
     prompt_engine = prompts.get_engine(root_path)
     try:
         formatted_diff = prompt_engine.render(
@@ -76,18 +80,24 @@ def handle(
             instruction=message
         )
     except Exception:
-        # Fallback if template fails
-        formatted_diff = f"<diff>\n{diff_content}\n</diff>"
+        # Fallback if template fails (using safe escaping via tags)
+        safe_content = tags.escape_xml_value(diff_content)
+        formatted_diff = f"<diff>\n{safe_content}\n</diff>"
 
-    # 4. Output
-    console.print(f"[bold green]✔ Changes Detected![/bold green] ({len(formatted_diff)} chars)")
+    # [4] Output
+    log_console.print(f"[bold green]Changes Detected![/bold green] ({len(formatted_diff)} chars)")
     
     if copy:
-        pyperclip.copy(formatted_diff)
-        console.print("[dim]Copied to clipboard[/dim]")
+        try:
+            pyperclip.copy(formatted_diff)
+            log_console.print("[dim]Clipboard copied[/dim]")
+        except Exception:
+            log_console.print("[dim]⚠️ Clipboard unavailable (skipped copy)[/dim]")
 
-    if save:
+    if stdout:
+        print(formatted_diff)
+    elif save:
         out_path = root_path / ".codigest" / "changes.diff"
         out_path.parent.mkdir(exist_ok=True)
         out_path.write_text(formatted_diff, encoding="utf-8")
-        console.print(f"[dim]Saved to {out_path}[/dim]")
+        log_console.print(f"[dim]Saved to {out_path}[/dim]")

codigest-0.3.6/src/codigest/commands/digest.py

@@ -0,0 +1,110 @@
+import typer
+import pyperclip
+from pathlib import Path
+from rich.console import Console
+from rich.progress import Progress, SpinnerColumn, TextColumn
+
+from ..core import structure, prompts, semdiff, tags, tokenizer, common, cache
+
+app = typer.Typer()
+console = Console()
+err_console = Console(stderr=True)
+
+@app.callback(invoke_without_command=True)
+def handle(
+    target: Path = typer.Argument(Path.cwd(), help="Target directory"),
+    copy: bool = typer.Option(True, help="Auto-copy to clipboard"),
+    save: bool = typer.Option(True, help="Save to .codigest/digest.txt"),
+    stdout: bool = typer.Option(False, "-s", "--stdout", help="Print output to terminal (stdout) instead of file"),
+    message: str = typer.Option("", "--message", "-m", help="Add specific instruction"),
+    # [추가]
+    resolve: bool = typer.Option(False, "-r", "--resolve", help="Recursively resolve imports"),
+):
+    """
+    [Architectural View] Summarizes the codebase structure (Classes/Functions only).
+    """
+    log_console = err_console if stdout else console
+
+    # [1] Context Setup
+    ctx = common.get_context(target)
+    root_path = ctx.root_path
+    
+    prompt_engine = prompts.get_engine(root_path)
+
+    with Progress(
+        SpinnerColumn(),
+        TextColumn("[bold blue]Digesting Architecture...[/bold blue]"),
+        transient=True,
+        console=log_console
+    ) as progress:
+        
+        task = progress.add_task("digest", total=None)
+        
+        # [2] File Discovery via Context
+        files = ctx.get_target_files(ignore_config=False, resolve_deps=resolve)
+        
+        tree_str = structure.generate_ascii_tree(files, root_path)
+
+        content_cache = cache.ContentCache(root_path)
+        summary_blocks = []
+
+        for file_path in files:
+            if file_path.suffix in (".py", ".pyi"):
+                try:
+                    rel_path = file_path.relative_to(root_path).as_posix()
+                except ValueError:
+                    rel_path = f"[EXTERNAL]/{file_path.name}"
+
+                blob_hash = cache.get_file_blob_hash(file_path)
+                summary = None
+                if blob_hash:
+                    summary = content_cache.get_summary(rel_path, blob_hash)
+
+                if summary is None:
+                    try:
+                        content = file_path.read_text(encoding="utf-8")
+                        summary = semdiff.summarize(content)
+                        if summary and blob_hash:
+                            content_cache.set_summary(rel_path, blob_hash, summary)
+                    except Exception:
+                        continue
+
+                if summary:
+                    block = tags.file(rel_path, summary)
+                    summary_blocks.append(block)
+
+        content_cache.save()
+
+        summary_blob = "\n".join(summary_blocks)
+        
+        try:
+            digest_content = prompt_engine.render(
+                "digest",
+                project_name=root_path.name,
+                tree_structure=tree_str,
+                digest_content=summary_blob,
+                instruction=message
+            )
+        except Exception as e:
+            log_console.print(f"[red]❌ Rendering Failed:[/red] {e}")
+            raise typer.Exit(1)
+            
+        progress.update(task, completed=100)
+
+    token_count = tokenizer.estimate_tokens(digest_content)
+    log_console.print(f"[bold green]Digest Generated![/bold green] ([bold cyan]~{token_count:,} Tokens[/bold cyan])")
+    
+    if copy:
+        try:
+            pyperclip.copy(digest_content)
+            log_console.print("[dim]📋 Copied to clipboard[/dim]")
+        except Exception:
+            log_console.print("[dim]⚠️ Clipboard unavailable (skipped copy)[/dim]")
+    
+    if stdout:
+        print(digest_content)
+    elif save:
+        out_path = root_path / ".codigest" / "digest.txt"
+        out_path.parent.mkdir(exist_ok=True)
+        out_path.write_text(digest_content, encoding="utf-8")
+        log_console.print(f"[dim]💾 Saved to {out_path}[/dim]")

codigest-0.3.6/src/codigest/commands/scan.py

@@ -0,0 +1,182 @@
+import sys
+import typer
+from pathlib import Path
+from rich.console import Console
+from rich.progress import Progress, SpinnerColumn, TextColumn
+from rich.panel import Panel
+from rich.filesize import decimal
+
+from ..core import structure, tags, prompts, processor, shadow, tokenizer, common, cache
+
+app = typer.Typer()
+console = Console()
+err_console = Console(stderr=True)
+
+@app.callback(invoke_without_command=True)
+def handle(
+    targets: list[Path] = typer.Argument(
+        None, 
+        help="Specific files or directories to scan (Scope)",
+        exists=True,
+        resolve_path=True
+    ),
+    output: str = typer.Option("snapshot.txt", "-o", "--output", help="Output filename inside .codigest/"),
+    stdout: bool = typer.Option(False, "-s", "--stdout", help="Print output to terminal (stdout) instead of file"),
+    all: bool = typer.Option(False, "--all", "-a", help="Ignore config filters"),
+    message: str = typer.Option("", "--message", "-m", help="Add specific instruction"),
+    line_numbers: bool = typer.Option(False, "--lines", "-l", help="Add line numbers to code blocks"),
+    yes: bool = typer.Option(False, "-y", "--yes", help="Skip confirmation prompt"),
+    resolve: bool = typer.Option(False, "-r", "--resolve", help="Recursively resolve imports for local files"),
+):
+    """
+    Scans the codebase. 
+    If TARGETS provided, only scans those paths within the project.
+    """
+    log_console = err_console if stdout else console
+
+    # [1] Context Setup (Centralized)
+    ctx = common.get_context(targets)
+    root_path = ctx.root_path
+
+    # Init check
+    artifact_dir = root_path / ".codigest"
+    if not artifact_dir.exists():
+        log_console.print(f"[yellow][Warning] .codigest directory missing in {root_path.name}. Running init...[/yellow]")
+        try:
+            artifact_dir.mkdir(exist_ok=True)
+        except PermissionError:
+            log_console.print(f"[red][Error] Cannot create .codigest at {root_path}[/red]")
+            raise typer.Exit(1)
+
+    output_path = artifact_dir / output
+    prompt_engine = prompts.get_engine(root_path)
+    anchor = shadow.ContextAnchor(root_path)
+
+    # [2] File Discovery via Context
+    with Progress(
+        SpinnerColumn(),
+        TextColumn("[bold blue]Scanning...[/bold blue]"),
+        transient=True,
+        console=log_console
+    ) as progress:
+        task = progress.add_task("scanning", total=None)
+        
+        # ★ All logic delegated to common.py
+        files = ctx.get_target_files(
+            targets=targets, 
+            ignore_config=all, 
+            resolve_deps=resolve
+        )
+        
+        progress.update(task, completed=100)
+
+    # [3] Pre-flight Check
+    total_files = len(files)
+    total_size = sum(f.stat().st_size for f in files)
+    est_tokens = int(total_size / 4) 
+
+    log_console.print(Panel(f"""[bold]Scan Plan[/bold]
+  Target: [cyan]{root_path}[/cyan]
+  Scope: {total_files} files
+  Est. Size: {decimal(total_size)}
+  Est. Tokens: ~{est_tokens:,}""", expand=False))
+
+    TOKEN_THRESHOLD = 30000   
+    FILE_COUNT_THRESHOLD = 100
+    is_large_context = est_tokens > TOKEN_THRESHOLD or total_files > FILE_COUNT_THRESHOLD
+
+    if yes:
+        pass 
+    elif is_large_context:
+        log_console.print(f"[yellow][Warning] Large context detected (> {TOKEN_THRESHOLD:,} tokens or > {FILE_COUNT_THRESHOLD} files).[/yellow]")
+        if not typer.confirm("Proceed with digestion?"):
+            log_console.print("[red]Aborted.[/red]")
+            raise typer.Exit()
+    else:
+        log_console.print("[dim]Small context detected. Automatically proceeding...[/dim]")
+
+    # [4] Execution
+    with Progress(
+        SpinnerColumn(),
+        TextColumn("[bold blue]Generating Snapshot...[/bold blue]"),
+        transient=True,
+        console=log_console
+    ) as progress:
+        
+        if anchor.has_history():
+            try:
+                diff_content = anchor.get_changes(files)
+                if diff_content.strip():
+                    pre_diff_path = artifact_dir / "previous_changes.diff"
+                    pre_diff_path.write_text(diff_content, encoding="utf-8")
+            except Exception:
+                pass
+
+        tree_str = structure.generate_ascii_tree(files, root_path)
+
+        content_cache = cache.ContentCache(root_path)
+        file_blocks = []
+
+        for file_path in files:
+            try:
+                rel_path = file_path.relative_to(root_path).as_posix()
+            except ValueError:
+                rel_path = f"[EXTERNAL]/{file_path.name}"
+
+            blob_hash = cache.get_file_blob_hash(file_path)
+            cached_block = None
+            if blob_hash:
+                cached_block = content_cache.get_file_block(rel_path, blob_hash, line_numbers)
+
+            if cached_block is not None:
+                file_blocks.append(cached_block)
+            else:
+                try:
+                    content = processor.read_file_content(file_path, add_line_numbers=line_numbers)
+                    block = tags.file(rel_path, content)
+                    file_blocks.append(block)
+                    if blob_hash:
+                        content_cache.set_file_block(rel_path, blob_hash, line_numbers, block)
+                except Exception:
+                    continue
+
+        content_cache.save()
+
+        source_code_blob = "\n\n".join(file_blocks)
+
+        try:
+            snapshot_content = prompt_engine.render(
+                "snapshot",
+                project_name=root_path.name,
+                tree_structure=tree_str,
+                source_code=source_code_blob,
+                instruction=message
+            )
+        except Exception as e:
+            log_console.print(f"[red][Error] Template Rendering Failed:[/red] {e}")
+            raise typer.Exit(1)
+
+    try:
+        anchor.update(files)
+    except Exception as e:
+        log_console.print(f"[yellow][Warning] Failed to update context anchor: {e}[/yellow]")
+
+    if stdout:
+        print(snapshot_content)
+    else:
+        try:
+            output_path.write_text(snapshot_content, encoding="utf-8")
+            final_token_count = tokenizer.estimate_tokens(snapshot_content)
+
+            log_console.print("[bold green]Snapshot Saved![/bold green]")
+            log_console.print(f"  Path: [underline]{output_path}[/underline]")
+            log_console.print(f"  Final Tokens: [bold cyan]~{final_token_count:,}[/bold cyan]")
+            
+            if anchor.has_history():
+                pre_diff_path = artifact_dir / "previous_changes.diff"
+                if pre_diff_path.exists() and pre_diff_path.stat().st_size > 0:
+                    log_console.print(f"  [dim]Changes before this scan saved to: {pre_diff_path.name}[/dim]")
+
+        except Exception as e:
+            log_console.print(f"[bold red][Error] Save Failed:[/bold red] {e}")
+            raise typer.Exit(1)