footprinter-cli 1.0.2__tar.gz → 1.0.3__tar.gz

{footprinter_cli-1.0.2/footprinter_cli.egg-info → footprinter_cli-1.0.3}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.2
 Name: footprinter-cli
-Version: 1.0.2
+Version: 1.0.3
 Summary: A local context layer for your files, browser history, chats, and email — searchable, user-owned, MCP-served.
 Author: SwellCity Group
 License: MIT
@@ -52,12 +52,12 @@ Requires-Dist: httpx<1.0,>=0.27.0; extra == "dev"
 
 # Footprinter
 
-[![Tests](https://github.com/swellcitygroup/footprinter/actions/workflows/test.yml/badge.svg)](https://github.com/swellcitygroup/footprinter/actions/workflows/test.yml)
+[![Tests](https://github.com/harringjohn/footprinter-cli/actions/workflows/test.yml/badge.svg)](https://github.com/harringjohn/footprinter-cli/actions/workflows/test.yml)
 [![PyPI](https://img.shields.io/pypi/v/footprinter-cli)](https://pypi.org/project/footprinter-cli/)
 
 **A local context layer for your files, browser history, chats, and email — searchable, user-owned, and served to AI agents through [MCP](https://modelcontextprotocol.io/).**
 
-Your work lives across a filesystem, a browser, an inbox, a chat history, and whatever other tools you reach for. Footprinter indexes those sources into a single local store, organizes them into the projects and groupings *you* define, and serves the result to AI agents through a governed access layer. You control what the agent can see. Everything stays on your machine.
+Your work lives across filesystems, browsers, inboxes, chat histories, and other tools. Footprinter indexes those sources into a single local store, organizes them into the projects and groupings you define, and serves the result to AI agents through a governed access layer. You control what the agent can see. Everything stays on your machine.
 
 ## Prerequisites
 
@@ -71,10 +71,10 @@ The fastest path on a clean machine is the install script — it ensures Python
 
 ```bash
 # Base install (CLI + MCP + HTTP API)
-curl -fsSL https://raw.githubusercontent.com/swellcitygroup/footprinter/main/scripts/release/install.sh | bash
+curl -fsSL https://raw.githubusercontent.com/harringjohn/footprinter-cli/main/scripts/release/install.sh | bash
 
 # Full install (adds semantic search + document parsing)
-curl -fsSL https://raw.githubusercontent.com/swellcitygroup/footprinter/main/scripts/release/install-full.sh | bash
+curl -fsSL https://raw.githubusercontent.com/harringjohn/footprinter-cli/main/scripts/release/install-full.sh | bash
 ```
 
 If you prefer to manage the install yourself, use **pipx** (recommended) — it isolates Footprinter and sidesteps the macOS install caveats noted below:
@@ -160,7 +160,7 @@ Once configured, Claude can search your files, browse projects, and find related
 | **Documents** | PDF, Word, Excel, PowerPoint content (with `[parse]` extra) |
 | **Semantic embeddings** | Conceptual similarity across all sources (with `[semantic]` extra) |
 
-What lands in the database — and when — is controlled by the **content storage tier** you opt into. By default, Footprinter only indexes metadata; it does not read your file content until you explicitly enable it. See [Content Storage](https://github.com/swellcitygroup/footprinter/blob/main/reference/content-storage.md) for the full breakdown.
+What lands in the database — and when — is controlled by the **content storage tier** you opt into. By default, Footprinter only indexes metadata; it does not read your file content until you explicitly enable it. See [Content Storage](https://github.com/harringjohn/footprinter-cli/blob/main/reference/content-storage.md) for the full breakdown.
 
 Additional sources are available through [connector plugins](#connectors).
 
@@ -213,22 +213,22 @@ Sources are scanned into SQLite with bidirectional links connecting local files
 
 ## Documentation
 
-- [Interfaces](https://github.com/swellcitygroup/footprinter/blob/main/reference/interfaces.md) — CLI commands, MCP tools, Python API
-- [Data Model](https://github.com/swellcitygroup/footprinter/blob/main/reference/data-model.md) — database schema
-- [Pipeline](https://github.com/swellcitygroup/footprinter/blob/main/reference/pipeline.md) — indexing stages and configuration
-- [Content Storage](https://github.com/swellcitygroup/footprinter/blob/main/reference/content-storage.md) — metadata vs. snippet vs. full-content tiers
-- [Access Control](https://github.com/swellcitygroup/footprinter/blob/main/reference/mcp-access-control.md) — MCP security model
+- [Interfaces](https://github.com/harringjohn/footprinter-cli/blob/main/reference/interfaces.md) — CLI commands, MCP tools, Python API
+- [Data Model](https://github.com/harringjohn/footprinter-cli/blob/main/reference/data-model.md) — database schema
+- [Pipeline](https://github.com/harringjohn/footprinter-cli/blob/main/reference/pipeline.md) — indexing stages and configuration
+- [Content Storage](https://github.com/harringjohn/footprinter-cli/blob/main/reference/content-storage.md) — metadata vs. snippet vs. full-content tiers
+- [Access Control](https://github.com/harringjohn/footprinter-cli/blob/main/reference/mcp-access-control.md) — MCP security model
 
 ## Contributing
 
-Bug fixes, documentation, and tests welcome. For new features or architectural changes, [open an issue](https://github.com/swellcitygroup/footprinter/issues) first to discuss the approach.
+Bug fixes, documentation, and tests welcome. For new features or architectural changes, [open an issue](https://github.com/harringjohn/footprinter-cli/issues) first to discuss the approach.
 
 Connector plugins use an internal API that isn't stable yet — we're not accepting connector contributions at this time.
 
 ### Development setup
 
 ```bash
-git clone https://github.com/swellcitygroup/footprinter.git
+git clone https://github.com/harringjohn/footprinter-cli.git
 cd footprinter
 python3 -m venv venv
 ./venv/bin/pip install -e ".[dev]"
@@ -254,7 +254,7 @@ python3 -m venv venv
 4. Run the test suite
 5. Submit a PR targeting `main`
 
-Never commit API keys, tokens, or credentials. Report security vulnerabilities privately — see [SECURITY.md](https://github.com/swellcitygroup/footprinter/blob/main/SECURITY.md).
+Never commit API keys, tokens, or credentials. Report security vulnerabilities privately — see [SECURITY.md](https://github.com/harringjohn/footprinter-cli/blob/main/SECURITY.md).
 
 ### Pull request expectations
 
@@ -265,13 +265,13 @@ Never commit API keys, tokens, or credentials. Report security vulnerabilities p
 
 All PRs are reviewed by the maintainer. Expect reviews within one week. CI must pass before review begins.
 
-No Contributor License Agreement required. By submitting a PR, you agree your contribution is licensed under the project's [MIT License](https://github.com/swellcitygroup/footprinter/blob/main/LICENSE).
+No Contributor License Agreement required. By submitting a PR, you agree your contribution is licensed under the project's [MIT License](https://github.com/harringjohn/footprinter-cli/blob/main/LICENSE).
 
 ## Community
 
-- [Code of Conduct](https://github.com/swellcitygroup/footprinter/blob/main/CODE_OF_CONDUCT.md)
-- [Security Policy](https://github.com/swellcitygroup/footprinter/blob/main/SECURITY.md)
+- [Code of Conduct](https://github.com/harringjohn/footprinter-cli/blob/main/CODE_OF_CONDUCT.md)
+- [Security Policy](https://github.com/harringjohn/footprinter-cli/blob/main/SECURITY.md)
 
 ## License
 
-MIT — see [LICENSE](https://github.com/swellcitygroup/footprinter/blob/main/LICENSE).
+MIT — see [LICENSE](https://github.com/harringjohn/footprinter-cli/blob/main/LICENSE).

{footprinter_cli-1.0.2 → footprinter_cli-1.0.3}/README.md

@@ -1,11 +1,11 @@
 # Footprinter
 
-[![Tests](https://github.com/swellcitygroup/footprinter/actions/workflows/test.yml/badge.svg)](https://github.com/swellcitygroup/footprinter/actions/workflows/test.yml)
+[![Tests](https://github.com/harringjohn/footprinter-cli/actions/workflows/test.yml/badge.svg)](https://github.com/harringjohn/footprinter-cli/actions/workflows/test.yml)
 [![PyPI](https://img.shields.io/pypi/v/footprinter-cli)](https://pypi.org/project/footprinter-cli/)
 
 **A local context layer for your files, browser history, chats, and email — searchable, user-owned, and served to AI agents through [MCP](https://modelcontextprotocol.io/).**
 
-Your work lives across a filesystem, a browser, an inbox, a chat history, and whatever other tools you reach for. Footprinter indexes those sources into a single local store, organizes them into the projects and groupings *you* define, and serves the result to AI agents through a governed access layer. You control what the agent can see. Everything stays on your machine.
+Your work lives across filesystems, browsers, inboxes, chat histories, and other tools. Footprinter indexes those sources into a single local store, organizes them into the projects and groupings you define, and serves the result to AI agents through a governed access layer. You control what the agent can see. Everything stays on your machine.
 
 ## Prerequisites
 
@@ -19,10 +19,10 @@ The fastest path on a clean machine is the install script — it ensures Python
 
 ```bash
 # Base install (CLI + MCP + HTTP API)
-curl -fsSL https://raw.githubusercontent.com/swellcitygroup/footprinter/main/scripts/release/install.sh | bash
+curl -fsSL https://raw.githubusercontent.com/harringjohn/footprinter-cli/main/scripts/release/install.sh | bash
 
 # Full install (adds semantic search + document parsing)
-curl -fsSL https://raw.githubusercontent.com/swellcitygroup/footprinter/main/scripts/release/install-full.sh | bash
+curl -fsSL https://raw.githubusercontent.com/harringjohn/footprinter-cli/main/scripts/release/install-full.sh | bash
 ```
 
 If you prefer to manage the install yourself, use **pipx** (recommended) — it isolates Footprinter and sidesteps the macOS install caveats noted below:
@@ -108,7 +108,7 @@ Once configured, Claude can search your files, browse projects, and find related
 | **Documents** | PDF, Word, Excel, PowerPoint content (with `[parse]` extra) |
 | **Semantic embeddings** | Conceptual similarity across all sources (with `[semantic]` extra) |
 
-What lands in the database — and when — is controlled by the **content storage tier** you opt into. By default, Footprinter only indexes metadata; it does not read your file content until you explicitly enable it. See [Content Storage](https://github.com/swellcitygroup/footprinter/blob/main/reference/content-storage.md) for the full breakdown.
+What lands in the database — and when — is controlled by the **content storage tier** you opt into. By default, Footprinter only indexes metadata; it does not read your file content until you explicitly enable it. See [Content Storage](https://github.com/harringjohn/footprinter-cli/blob/main/reference/content-storage.md) for the full breakdown.
 
 Additional sources are available through [connector plugins](#connectors).
 
@@ -161,22 +161,22 @@ Sources are scanned into SQLite with bidirectional links connecting local files
 
 ## Documentation
 
-- [Interfaces](https://github.com/swellcitygroup/footprinter/blob/main/reference/interfaces.md) — CLI commands, MCP tools, Python API
-- [Data Model](https://github.com/swellcitygroup/footprinter/blob/main/reference/data-model.md) — database schema
-- [Pipeline](https://github.com/swellcitygroup/footprinter/blob/main/reference/pipeline.md) — indexing stages and configuration
-- [Content Storage](https://github.com/swellcitygroup/footprinter/blob/main/reference/content-storage.md) — metadata vs. snippet vs. full-content tiers
-- [Access Control](https://github.com/swellcitygroup/footprinter/blob/main/reference/mcp-access-control.md) — MCP security model
+- [Interfaces](https://github.com/harringjohn/footprinter-cli/blob/main/reference/interfaces.md) — CLI commands, MCP tools, Python API
+- [Data Model](https://github.com/harringjohn/footprinter-cli/blob/main/reference/data-model.md) — database schema
+- [Pipeline](https://github.com/harringjohn/footprinter-cli/blob/main/reference/pipeline.md) — indexing stages and configuration
+- [Content Storage](https://github.com/harringjohn/footprinter-cli/blob/main/reference/content-storage.md) — metadata vs. snippet vs. full-content tiers
+- [Access Control](https://github.com/harringjohn/footprinter-cli/blob/main/reference/mcp-access-control.md) — MCP security model
 
 ## Contributing
 
-Bug fixes, documentation, and tests welcome. For new features or architectural changes, [open an issue](https://github.com/swellcitygroup/footprinter/issues) first to discuss the approach.
+Bug fixes, documentation, and tests welcome. For new features or architectural changes, [open an issue](https://github.com/harringjohn/footprinter-cli/issues) first to discuss the approach.
 
 Connector plugins use an internal API that isn't stable yet — we're not accepting connector contributions at this time.
 
 ### Development setup
 
 ```bash
-git clone https://github.com/swellcitygroup/footprinter.git
+git clone https://github.com/harringjohn/footprinter-cli.git
 cd footprinter
 python3 -m venv venv
 ./venv/bin/pip install -e ".[dev]"
@@ -202,7 +202,7 @@ python3 -m venv venv
 4. Run the test suite
 5. Submit a PR targeting `main`
 
-Never commit API keys, tokens, or credentials. Report security vulnerabilities privately — see [SECURITY.md](https://github.com/swellcitygroup/footprinter/blob/main/SECURITY.md).
+Never commit API keys, tokens, or credentials. Report security vulnerabilities privately — see [SECURITY.md](https://github.com/harringjohn/footprinter-cli/blob/main/SECURITY.md).
 
 ### Pull request expectations
 
@@ -213,13 +213,13 @@ Never commit API keys, tokens, or credentials. Report security vulnerabilities p
 
 All PRs are reviewed by the maintainer. Expect reviews within one week. CI must pass before review begins.
 
-No Contributor License Agreement required. By submitting a PR, you agree your contribution is licensed under the project's [MIT License](https://github.com/swellcitygroup/footprinter/blob/main/LICENSE).
+No Contributor License Agreement required. By submitting a PR, you agree your contribution is licensed under the project's [MIT License](https://github.com/harringjohn/footprinter-cli/blob/main/LICENSE).
 
 ## Community
 
-- [Code of Conduct](https://github.com/swellcitygroup/footprinter/blob/main/CODE_OF_CONDUCT.md)
-- [Security Policy](https://github.com/swellcitygroup/footprinter/blob/main/SECURITY.md)
+- [Code of Conduct](https://github.com/harringjohn/footprinter-cli/blob/main/CODE_OF_CONDUCT.md)
+- [Security Policy](https://github.com/harringjohn/footprinter-cli/blob/main/SECURITY.md)
 
 ## License
 
-MIT — see [LICENSE](https://github.com/swellcitygroup/footprinter/blob/main/LICENSE).
+MIT — see [LICENSE](https://github.com/harringjohn/footprinter-cli/blob/main/LICENSE).

{footprinter_cli-1.0.2 → footprinter_cli-1.0.3}/footprinter/bundled/config.example.yaml

@@ -78,9 +78,12 @@ exclusions:
 # Indexing configuration - INDEX ALL FILE TYPES
 indexing:
   supported_extensions: []  # Empty = index ALL file types
-  max_file_size_mb: 0       # 0 = no size limit (index everything)
+  max_file_size_mb: 50      # MB; 0 = no size limit. 50 is generous for prose/docs.
   lookback_days: 14         # Browser history window (days back to index)
   content_snippets: false   # Extract file/email content previews for keyword search
+  # `fp ingest --preview` (FPR-1723) — pre-scan summary tuning
+  preview_top_n: 10                # rows shown for top files / top directories
+  preview_size_threshold_mb: 50    # files at or above this size are flagged as outliers
 
 # Semantic search — stores content as embeddings in a local ChromaDB database
 # Enables finding files and chats by meaning, not just keywords
@@ -104,6 +107,11 @@ vectorization:
     - .txt
     - .pdf
     - .docx
+  # Maximum file size (MB) eligible for vectorization. Applies even when
+  # indexing.max_file_size_mb is 0 (no limit). Chunking a multi-GB file
+  # produces millions of chunks and can OOM the host — this guardrail is
+  # always on. Skipped files appear in the post-ingest summary.
+  max_vectorize_size_mb: 100
   # Chunk size in characters — tuned for MiniLM-L6-v2 (256-token input window).
   # ~1000 chars ≈ 250 tokens. Larger chunks get silently truncated by the model,
   # meaning content past the window is invisible to semantic search.

{footprinter_cli-1.0.2 → footprinter_cli-1.0.3}/footprinter/cli/__init__.py

@@ -29,10 +29,9 @@ def main(argv=None) -> None:
 
     if argv is None:
         argv = _sys.argv[1:]
-    from footprinter.source_registry import ConfigError as _ConfigError
-
     from footprinter import __version__
     from footprinter.cli._common import FORMATTER
+    from footprinter.source_registry import ConfigError as _ConfigError
 
     parser = argparse.ArgumentParser(
         prog="fp",

footprinter_cli-1.0.3/footprinter/cli/_vectorize_stage.py

@@ -0,0 +1,117 @@
+"""Shared post-ingest vectorization stage helper (FPR-1721).
+
+Phased ingest: ``fp setup`` and ``fp ingest`` print "index is ready"
+once the main pipeline returns, then run this follow-up stage with its
+own progress UI. Centralized here so both call sites stay consistent.
+"""
+
+from __future__ import annotations
+
+from footprinter.cli._common import console
+
+
+def _file_vectorization_in_config() -> bool:
+    """Check config without touching the vector store."""
+    try:
+        from footprinter.source_registry import get_config
+
+        return bool(get_config().get("semantic", {}).get("file_vectorization", False))
+    except Exception:  # ConfigError, ImportError, etc. — treat as disabled
+        return False
+
+
+def run_vectorization_stage(*, quiet: bool = False) -> None:
+    """Run vectorization as a follow-up stage after the main pipeline.
+
+    No-op when ``semantic.file_vectorization`` is disabled. On failure
+    the wizard/ingest run continues — vectorization is best-effort.
+    """
+    if not _file_vectorization_in_config():
+        return
+
+    from footprinter.ingest.orchestrator import DataPipelineOrchestrator
+
+    if not quiet:
+        console.print()
+        console.print("[green]✓ Your Footprinter index is ready to use.[/green]")
+        console.print()
+        console.print("[bold]Deep Read (semantic search)[/bold] is running in the background.")
+        console.print(
+            "A message will appear here when complete. [yellow]Do not close this window.[/yellow]"
+        )
+
+    orchestrator = DataPipelineOrchestrator()
+    progress = None
+    task_id = None
+    try:
+        if not quiet:
+            from rich.progress import (
+                BarColumn,
+                MofNCompleteColumn,
+                Progress,
+                SpinnerColumn,
+                TextColumn,
+            )
+
+            progress = Progress(
+                SpinnerColumn(),
+                TextColumn("{task.description}"),
+                BarColumn(),
+                MofNCompleteColumn(),
+                console=console,
+                transient=True,
+            )
+            progress.start()
+            task_id = progress.add_task("[cyan]Vectorizing files[/cyan]", total=None)
+
+        def on_progress(count: int) -> None:
+            if progress is not None and task_id is not None:
+                progress.update(task_id, completed=count)
+
+        result = orchestrator.run_vectorization(on_progress=on_progress)
+
+        if progress is not None:
+            progress.stop()
+
+        if quiet:
+            return
+
+        status = result.status.value
+        data = result.data or {}
+        if status == "skipped":
+            return
+        new = data.get("vectorized_new", 0)
+        failed = data.get("vectorized_failed", 0)
+        skipped_missing = data.get("vectorized_skipped_missing", 0)
+        skipped_large = data.get("vectorized_skipped_large", 0)
+        skipped_large_files = data.get("skipped_large_files") or []
+        if status == "completed_with_errors" or failed:
+            console.print(
+                f"  [yellow]⚠[/yellow] Deep Read: {new} embedded, {failed} failed, "
+                f"{skipped_missing} skipped"
+                + (f", {skipped_large} too large" if skipped_large else "")
+            )
+        else:
+            trail = ""
+            if skipped_missing:
+                trail += f", {skipped_missing} skipped"
+            if skipped_large:
+                trail += f", {skipped_large} too large"
+            console.print(f"  [green]✓[/green] Deep Read complete: {new} embedded" + trail)
+        if skipped_large_files:
+            from footprinter.cli._policy_helpers import abbreviate_home
+
+            console.print(
+                f"  [yellow]⚠[/yellow] Skipped {len(skipped_large_files)}"
+                f" file(s) over vectorize cap:"
+            )
+            for entry in skipped_large_files:
+                size_mb = entry.get("size_bytes", 0) / (1024 * 1024)
+                console.print(f"      {size_mb:>7.1f} MB  {abbreviate_home(entry.get('path', ''))}")
+    except Exception as e:  # Intentional broad catch: follow-up stage must not crash setup/ingest
+        if progress is not None:
+            progress.stop()
+        if not quiet:
+            console.print(f"  [yellow]Vectorization warning:[/yellow] {e}")
+    finally:
+        orchestrator.close()

{footprinter_cli-1.0.2 → footprinter_cli-1.0.3}/footprinter/cli/doctor.py

@@ -113,7 +113,8 @@ def _check_fda() -> Check:
     return Check(
         "fda",
         "WARN",
-        "Cannot read Safari History.db — grant Full Disk Access to your terminal in System Settings > Privacy & Security",
+        "Cannot read Safari History.db — grant Full Disk Access to your terminal in"
+        " System Settings > Privacy & Security",
     )
 
 
@@ -127,7 +128,8 @@ def _check_semantic_deps() -> Check:
     return Check(
         "semantic_deps",
         "WARN",
-        f"Optional semantic search dependencies not installed: {', '.join(missing)} — install with: pipx install --force 'footprinter-cli[full]'",
+        f"Optional semantic search dependencies not installed: {', '.join(missing)}"
+        " — install with: pipx install --force 'footprinter-cli[full]'",
     )
 
 
@@ -141,7 +143,8 @@ def _check_parse_deps() -> Check:
     return Check(
         "parse_deps",
         "WARN",
-        f"Optional parsing dependencies not installed: {', '.join(missing)} — install with: pipx install --force 'footprinter-cli[full]'",
+        f"Optional parsing dependencies not installed: {', '.join(missing)}"
+        " — install with: pipx install --force 'footprinter-cli[full]'",
     )
 
 

{footprinter_cli-1.0.2 → footprinter_cli-1.0.3}/footprinter/cli/ingest.py

@@ -34,6 +34,7 @@ def _build_parser(subparsers, name):
             "  fp ingest --pipe local_files,browser   Specific internal pipes\n"
             "  fp ingest --rebuild-vectors            Rebuild vectors (incremental)\n"
             "  fp ingest --rebuild-vectors full       Rebuild vectors (full reset)\n"
+            "  fp ingest --preview                    Pre-scan summary (no ingest)\n"
             "  fp ingest status                       Show pipeline diagnostics\n"
             "  fp ingest import export.zip            Import a chat export"
         ),
@@ -85,6 +86,16 @@ def _build_parser(subparsers, name):
         default=None,
         help="Run a single rebuild phase (default: all). Only used with --rebuild-vectors",
     )
+    parser.add_argument(
+        "--preview",
+        action="store_true",
+        help=(
+            "Pre-scan configured directories and print a summary "
+            "(file counts by extension, top-N largest files/directories, "
+            "outliers above size threshold) without ingesting or vectorizing. "
+            "In a TTY, prompts to proceed with the real ingest."
+        ),
+    )
     parser.add_argument(
         "--repair-fts",
         action="store_true",
@@ -187,6 +198,10 @@ def _handle_ingest(args) -> None:
         )
         return
 
+    if getattr(args, "preview", False):
+        _ingest_preview(args)
+        return
+
     action = getattr(args, "ingest_action", None)
 
     if action is None:
@@ -489,6 +504,166 @@ def _ingest_pipeline(args) -> None:
         console.print("[dim]Interrupted.[/dim]")
         sys.exit(130)
 
+    # FPR-1721: vectorization runs as a follow-up stage when local_files was touched.
+    if pipes is None or "local_files" in pipes:
+        from footprinter.cli._vectorize_stage import run_vectorization_stage
+
+        run_vectorization_stage(quiet=quiet)
+
+
+# Defaults for the preview render. Configurable via the indexing.preview_*
+# config keys; tests pass plain configs without those keys.
+_PREVIEW_TOP_N_DEFAULT = 10
+_PREVIEW_OUTLIER_THRESHOLD_MB_DEFAULT = 50
+
+
+def _stdout_is_tty() -> bool:
+    """Patch point for the preview prompt: True iff the user is at a terminal.
+
+    Wraps ``sys.stdout.isatty()`` so tests can override the result without
+    having to dodge ``run_fp``'s in-test stdout swap (which would otherwise
+    re-route the patch to the wrong StringIO).
+    """
+    return sys.stdout.isatty()
+
+
+def _format_bytes(n: int) -> str:
+    """Human-readable byte size (binary units)."""
+    units = ("B", "KiB", "MiB", "GiB", "TiB")
+    size = float(n)
+    for unit in units:
+        if size < 1024 or unit == units[-1]:
+            return f"{size:.1f} {unit}"
+        size /= 1024
+    return f"{n} B"
+
+
+def _render_preview_plain(summary, *, threshold_bytes: int) -> str:
+    """Render a one-line, machine-friendly preview (used in --quiet mode)."""
+    by_ext = summary.by_extension()
+    ext_part = ", ".join(f"{ext}={n}" for ext, n in sorted(by_ext.items(), key=lambda kv: kv[1], reverse=True))
+    return (
+        f"preview: files={summary.total_files} bytes={summary.total_bytes} "
+        f"outliers={len(summary.outliers())} threshold={threshold_bytes} {ext_part}"
+    )
+
+
+def _render_preview(summary, *, threshold_bytes: int, console_):
+    """Render a ScanSummary to the Rich console."""
+    from rich.table import Table
+
+    console_.print()
+    console_.print(
+        f"[bold]Preview[/bold]  [dim]({summary.total_files} files, "
+        f"{_format_bytes(summary.total_bytes)} total)[/dim]"
+    )
+    console_.print()
+
+    by_ext = summary.by_extension()
+    if by_ext:
+        ext_table = Table(title="Files by extension", show_edge=False)
+        ext_table.add_column("Extension")
+        ext_table.add_column("Count", justify="right")
+        for ext, count in sorted(by_ext.items(), key=lambda kv: kv[1], reverse=True):
+            ext_table.add_row(ext, str(count))
+        console_.print(ext_table)
+        console_.print()
+
+    top_files = summary.top_files()
+    if top_files:
+        files_table = Table(title=f"Top {len(top_files)} largest files", show_edge=False)
+        files_table.add_column("Size", justify="right")
+        files_table.add_column("Path")
+        for entry in top_files:
+            files_table.add_row(_format_bytes(int(entry.get("file_size") or 0)), entry["file_path"])
+        console_.print(files_table)
+        console_.print()
+
+    top_dirs = summary.top_directories()
+    if top_dirs:
+        dirs_table = Table(title=f"Top {len(top_dirs)} largest directories", show_edge=False)
+        dirs_table.add_column("Size", justify="right")
+        dirs_table.add_column("Directory")
+        for path, total in top_dirs:
+            dirs_table.add_row(_format_bytes(total), path)
+        console_.print(dirs_table)
+        console_.print()
+
+    outliers = summary.outliers()
+    if outliers:
+        out_table = Table(
+            title=f"Outliers ≥ {_format_bytes(threshold_bytes)}",
+            show_edge=False,
+        )
+        out_table.add_column("Size", justify="right")
+        out_table.add_column("Path")
+        for entry in outliers:
+            out_table.add_row(_format_bytes(int(entry.get("file_size") or 0)), entry["file_path"])
+        console_.print(out_table)
+        console_.print()
+
+
+def _ingest_preview(args) -> None:
+    """Pre-scan configured directories and print a summary (FPR-1723).
+
+    No DB writes, no vectorization. Always prints a summary so ``--preview``
+    is meaningful even in scripts: ``--quiet`` switches to a single-line
+    plain-text summary, and the interactive prompt is shown only when
+    ``stdout`` is a TTY and ``--quiet`` is not set.
+
+    Acquires the same exclusive run lock as ``fp ingest`` so a preview cannot
+    race a real ingest scan over the same directories.
+    """
+    import fcntl
+
+    from footprinter.ingest.file_scanner import FileScanner
+    from footprinter.ingest.scan_summary import ScanSummary
+    from footprinter.paths import get_run_lock_path
+    from footprinter.source_registry import ConfigError, get_config
+
+    quiet = getattr(args, "quiet", False)
+
+    try:
+        config = get_config()
+    except ConfigError as e:
+        console.print(f"[red]Error:[/red] {e}")
+        sys.exit(1)
+
+    indexing = config.get("indexing", {}) or {}
+    top_n = int(indexing.get("preview_top_n") or _PREVIEW_TOP_N_DEFAULT)
+    threshold_mb = indexing.get("preview_size_threshold_mb")
+    if threshold_mb is None:
+        threshold_mb = _PREVIEW_OUTLIER_THRESHOLD_MB_DEFAULT
+    threshold_bytes = int(threshold_mb) * 1024 * 1024
+
+    lock_path = get_run_lock_path()
+    lock_fd = open(lock_path, "w")
+    try:
+        try:
+            fcntl.flock(lock_fd, fcntl.LOCK_EX | fcntl.LOCK_NB)
+        except BlockingIOError:
+            console.print("[red]Error:[/red] Another fp ingest is already in progress.")
+            sys.exit(1)
+
+        scanner = FileScanner(config)
+        summary = ScanSummary(top_n=top_n, outlier_threshold_bytes=threshold_bytes)
+        for entry in scanner.scan_all_directories(skip_hashing=True):
+            summary.add(entry)
+    finally:
+        lock_fd.close()
+
+    if quiet:
+        print(_render_preview_plain(summary, threshold_bytes=threshold_bytes))
+    else:
+        _render_preview(summary, threshold_bytes=threshold_bytes, console_=console)
+
+    if quiet or not _stdout_is_tty():
+        return
+
+    answer = input("Proceed with ingest? [y/N] ").strip().lower()
+    if answer == "y":
+        _ingest_pipeline(args)
+
 
 def _ingest_status(args) -> None:
     """Show pipeline diagnostics (data counts)."""
@@ -540,7 +715,8 @@ def _ingest_import(args) -> None:
                 messages = result.get("messages_imported", 0)
                 errors = result.get("errors", 0)
                 console.print(
-                    f"[green]Imported[/green] {added + updated} chats ({added} new, {updated} updated), {messages} messages"
+                    f"[green]Imported[/green] {added + updated} chats"
+                    f" ({added} new, {updated} updated), {messages} messages"
                 )
                 if errors:
                     console.print(f"[yellow]Warning:[/yellow] {errors} chats failed to import")
@@ -589,3 +765,9 @@ def _ingest_refresh(args) -> None:
     except KeyboardInterrupt:
         console.print("[dim]Interrupted.[/dim]")
         sys.exit(130)
+
+    # FPR-1721: vectorization follow-up when this refresh touched local_files.
+    if "local_files" in stages:
+        from footprinter.cli._vectorize_stage import run_vectorization_stage
+
+        run_vectorization_stage(quiet=quiet)

{footprinter_cli-1.0.2 → footprinter_cli-1.0.3}/footprinter/cli/setup.py

@@ -845,6 +845,12 @@ def run_interactive_wizard():
         # _offer_csv_import_wizard can open it and insert rows. Asking earlier
         # (in Data Sources) would silently skip on fresh installs.
         _offer_csv_import_wizard()
+        # FPR-1721: phased ingest — main pipeline returned, so the index is
+        # usable now. Print the "ready" line then run vectorization with its
+        # own progress UI as a follow-up.
+        from footprinter.cli._vectorize_stage import run_vectorization_stage
+
+        run_vectorization_stage()
     else:
         console.print("  [dim]Skipped. Run later: fp ingest[/dim]")