mempalace-code 1.3.0__tar.gz → 1.4.0__tar.gz

{mempalace_code-1.3.0 → mempalace_code-1.4.0}/CHANGELOG.md

@@ -1,5 +1,18 @@
 # Changelog
 
+## v1.4.0 — 2026-04-19
+
+### Added
+- **Watcher quiet mode** — re-mines suppress verbose output; only logs a one-line summary when drawers are actually filed; no-op commits produce zero log noise; optimize skipped on empty batches
+- **Per-project `bin/` skip** — `bin/` no longer globally skipped; only excluded when .NET project markers (`.csproj`, `.sln`, `.fsproj`, `.vbproj`) are present (MINE-BIN-SKIP-DIRS)
+- **Kotlin nested generic receiver** — `fun <T> List<Pair<K,V>>.ext()` now parsed correctly (MINE-KOTLIN-GENERIC-RECEIVER-NESTED)
+- `mine()` now returns stats dict (`files_processed`, `drawers_filed`, `elapsed_secs`)
+
+### Fixed
+- **Watcher on-commit detection** — `watchfiles.DefaultFilter` ignores `.git/` by default; on-commit mode now passes `watch_filter=None` so `.git/refs/heads/` changes are detected
+- **Watcher log buffering** — flush Python stdout/stderr before restoring file descriptors to prevent mine() output leaking to real stdout
+- **HuggingFace/safetensors noise** — suppress BertModel LOAD REPORT and progress bars via OS fd-level redirect during model init
+
 ## v1.3.0 — 2026-04-19
 
 First-class C#/.NET support — delivers [rergards/mempalace-code#1](https://github.com/rergards/mempalace-code/issues/1) in full.

{mempalace_code-1.3.0 → mempalace_code-1.4.0}/CLAUDE.md

@@ -72,7 +72,8 @@ Line length: 100. Target: py39. Quote style: double.
 | `layers.py` | Tiered context loading — L0/L1/L2/L3 wake-up layers for local models |
 | `palace_graph.py` | Graph traversal and tunnel detection across wings/rooms |
 | `mcp_server.py` | MCP server — exposes palace tools to Claude Code and other MCP clients |
-| `cli.py` | `mempalace` CLI entry point — init, mine, search, health, repair, backup |
+| `watcher.py` | File watcher — `watch_and_mine`, `watch_all`, launchd/cron schedule rendering |
+| `cli.py` | `mempalace` CLI entry point — init, mine, mine-all, watch, search, health, repair, backup |
 
 ## Architecture Principles
 

{mempalace_code-1.3.0 → mempalace_code-1.4.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: mempalace-code
-Version: 1.3.0
+Version: 1.4.0
 Summary: Developer memory tool — mine codebases and conversations into a LanceDB-backed searchable palace. No API key required.
 Project-URL: Homepage, https://github.com/rergards/mempalace-code
 Project-URL: Repository, https://github.com/rergards/mempalace-code
@@ -77,7 +77,7 @@ No cloud. No API keys. No subscription. Nothing leaves your machine.
 <tr>
 <td align="center"><strong>595x Token Savings</strong><br><sub>measured peak · median 80x<br><a href="docs/BENCH_TOKEN_DELTA.md">scales with project size</a></sub></td>
 <td align="center"><strong>Cross-Project Tunnels</strong><br><sub>Search <code>auth</code> in one project<br>find it everywhere</sub></td>
-<td align="center"><strong>1002 Tests · $0 Cost</strong><br><sub>Every feature acceptance-gated<br>fully offline after install</sub></td>
+<td align="center"><strong>1008 Tests · $0 Cost</strong><br><sub>Every feature acceptance-gated<br>fully offline after install</sub></td>
 </tr>
 </table>
 
@@ -175,10 +175,30 @@ Tree-sitter is optional (`pip install "mempalace-code[treesitter]"`). Without it
 mempalace mine ~/projects/myapp                  # all supported file types
 mempalace mine ~/projects/myapp --wing myapp     # tag with a specific wing
 mempalace mine ~/chats/ --mode convos            # mine conversation exports
+mempalace mine-all ~/projects/                   # batch mine all projects in a directory
 ```
 
 Mining is **incremental** by default — content-hash based, only changed files are re-chunked. Use `--full` to force a rebuild.
 
+### Auto-Watch
+
+Keep your palace in sync automatically. By default, watches `.git/refs/heads/` and re-mines only on **commit** — no noise from work-in-progress saves. Handles multiple branches and worktrees.
+
+```bash
+mempalace watch ~/projects/                      # watch all projects (on commit, default)
+mempalace watch ~/projects/ --on-save            # watch all file saves instead (noisier)
+mempalace watch ~/projects/ schedule             # print launchd/cron snippet for daemon
+```
+
+**Install as persistent daemon (macOS):**
+
+```bash
+mempalace watch ~/projects/ schedule > ~/Library/LaunchAgents/com.mempalace.watch.plist
+launchctl load ~/Library/LaunchAgents/com.mempalace.watch.plist
+```
+
+Starts at login, restarts if crashed. Logs to `/tmp/mempalace-watch.log`.
+
 ---
 
 ### The Palace
@@ -421,7 +441,7 @@ This is a code-first fork of [milla-jovovich/mempalace](https://github.com/milla
 | ChromaDB — [silently deletes data on version bump](https://github.com/milla-jovovich/mempalace/issues/469) | LanceDB — crash-safe Arrow storage, no version-cliff |
 | "No internet after install" — [false](https://github.com/milla-jovovich/mempalace/issues/524) | `mempalace init` downloads model explicitly; fully offline after |
 | "100% R@5" — [unverifiable](https://github.com/milla-jovovich/mempalace/issues/27) | Number removed. Methodology caveats documented |
-| ~30% test coverage | 1002 tests, every feature acceptance-gated |
+| ~30% test coverage | 1008 tests, every feature acceptance-gated |
 | No backup, no recovery | `backup` / `restore` / `export` / `import` |
 | No incremental mining | Content-hash incremental: only changed files re-chunked |
 | No code-search | `code_search` — filter by language, symbol, glob |
@@ -496,6 +516,10 @@ mempalace mine <dir> --full                       # force full rebuild
 mempalace mine <dir> --watch                      # auto-incremental on file changes
 mempalace mine-all <parent-dir>                   # batch mine all projects in a directory
 
+# Watch (multi-project auto-sync)
+mempalace watch <parent-dir>                      # watch all initialized projects
+mempalace watch <parent-dir> schedule             # print launchd/cron daemon snippet
+
 # Search
 mempalace search "query"                          # search everything
 mempalace search "query" --wing myapp             # scoped to wing
@@ -559,7 +583,7 @@ mempalace/
 ├── benchmarks/             ← reproducible benchmark runners
 ├── hooks/                  ← Claude Code auto-save hooks
 ├── examples/               ← usage examples
-└── tests/                  ← 1002 tests
+└── tests/                  ← 1008 tests
 ```
 
 </details>
@@ -579,7 +603,7 @@ python -m pytest tests/ -x -q    # full suite, all local, no network
 Apache 2.0 — see [LICENSE](LICENSE) and [NOTICE](NOTICE).
 
 <!-- Link Definitions -->
-[version-shield]: https://img.shields.io/badge/version-1.3.0-4dc9f6?style=flat-square&labelColor=0a0e14
+[version-shield]: https://img.shields.io/badge/version-1.4.0-4dc9f6?style=flat-square&labelColor=0a0e14
 [release-link]: https://github.com/rergards/mempalace-code/releases
 [python-shield]: https://img.shields.io/badge/python-3.9+-7dd8f8?style=flat-square&labelColor=0a0e14&logo=python&logoColor=7dd8f8
 [python-link]: https://www.python.org/

{mempalace_code-1.3.0 → mempalace_code-1.4.0}/README.md

@@ -29,7 +29,7 @@ No cloud. No API keys. No subscription. Nothing leaves your machine.
 <tr>
 <td align="center"><strong>595x Token Savings</strong><br><sub>measured peak · median 80x<br><a href="docs/BENCH_TOKEN_DELTA.md">scales with project size</a></sub></td>
 <td align="center"><strong>Cross-Project Tunnels</strong><br><sub>Search <code>auth</code> in one project<br>find it everywhere</sub></td>
-<td align="center"><strong>1002 Tests · $0 Cost</strong><br><sub>Every feature acceptance-gated<br>fully offline after install</sub></td>
+<td align="center"><strong>1008 Tests · $0 Cost</strong><br><sub>Every feature acceptance-gated<br>fully offline after install</sub></td>
 </tr>
 </table>
 
@@ -127,10 +127,30 @@ Tree-sitter is optional (`pip install "mempalace-code[treesitter]"`). Without it
 mempalace mine ~/projects/myapp                  # all supported file types
 mempalace mine ~/projects/myapp --wing myapp     # tag with a specific wing
 mempalace mine ~/chats/ --mode convos            # mine conversation exports
+mempalace mine-all ~/projects/                   # batch mine all projects in a directory
 ```
 
 Mining is **incremental** by default — content-hash based, only changed files are re-chunked. Use `--full` to force a rebuild.
 
+### Auto-Watch
+
+Keep your palace in sync automatically. By default, watches `.git/refs/heads/` and re-mines only on **commit** — no noise from work-in-progress saves. Handles multiple branches and worktrees.
+
+```bash
+mempalace watch ~/projects/                      # watch all projects (on commit, default)
+mempalace watch ~/projects/ --on-save            # watch all file saves instead (noisier)
+mempalace watch ~/projects/ schedule             # print launchd/cron snippet for daemon
+```
+
+**Install as persistent daemon (macOS):**
+
+```bash
+mempalace watch ~/projects/ schedule > ~/Library/LaunchAgents/com.mempalace.watch.plist
+launchctl load ~/Library/LaunchAgents/com.mempalace.watch.plist
+```
+
+Starts at login, restarts if crashed. Logs to `/tmp/mempalace-watch.log`.
+
 ---
 
 ### The Palace
@@ -373,7 +393,7 @@ This is a code-first fork of [milla-jovovich/mempalace](https://github.com/milla
 | ChromaDB — [silently deletes data on version bump](https://github.com/milla-jovovich/mempalace/issues/469) | LanceDB — crash-safe Arrow storage, no version-cliff |
 | "No internet after install" — [false](https://github.com/milla-jovovich/mempalace/issues/524) | `mempalace init` downloads model explicitly; fully offline after |
 | "100% R@5" — [unverifiable](https://github.com/milla-jovovich/mempalace/issues/27) | Number removed. Methodology caveats documented |
-| ~30% test coverage | 1002 tests, every feature acceptance-gated |
+| ~30% test coverage | 1008 tests, every feature acceptance-gated |
 | No backup, no recovery | `backup` / `restore` / `export` / `import` |
 | No incremental mining | Content-hash incremental: only changed files re-chunked |
 | No code-search | `code_search` — filter by language, symbol, glob |
@@ -448,6 +468,10 @@ mempalace mine <dir> --full                       # force full rebuild
 mempalace mine <dir> --watch                      # auto-incremental on file changes
 mempalace mine-all <parent-dir>                   # batch mine all projects in a directory
 
+# Watch (multi-project auto-sync)
+mempalace watch <parent-dir>                      # watch all initialized projects
+mempalace watch <parent-dir> schedule             # print launchd/cron daemon snippet
+
 # Search
 mempalace search "query"                          # search everything
 mempalace search "query" --wing myapp             # scoped to wing
@@ -511,7 +535,7 @@ mempalace/
 ├── benchmarks/             ← reproducible benchmark runners
 ├── hooks/                  ← Claude Code auto-save hooks
 ├── examples/               ← usage examples
-└── tests/                  ← 1002 tests
+└── tests/                  ← 1008 tests
 ```
 
 </details>
@@ -531,7 +555,7 @@ python -m pytest tests/ -x -q    # full suite, all local, no network
 Apache 2.0 — see [LICENSE](LICENSE) and [NOTICE](NOTICE).
 
 <!-- Link Definitions -->
-[version-shield]: https://img.shields.io/badge/version-1.3.0-4dc9f6?style=flat-square&labelColor=0a0e14
+[version-shield]: https://img.shields.io/badge/version-1.4.0-4dc9f6?style=flat-square&labelColor=0a0e14
 [release-link]: https://github.com/rergards/mempalace-code/releases
 [python-shield]: https://img.shields.io/badge/python-3.9+-7dd8f8?style=flat-square&labelColor=0a0e14&logo=python&logoColor=7dd8f8
 [python-link]: https://www.python.org/

{mempalace_code-1.3.0 → mempalace_code-1.4.0}/docs/BACKLOG-archived.yaml

@@ -148,3 +148,15 @@ items:
       summary: Track plain Name= attribute as well as x:Name for has_named_control triples
       resolution: '2026-04-19: Updated parse_xaml_file() section 3 to collect both x:Name and plain Name= per element into a set before emitting has_named_control triples; added 2 regression tests (plain Name= and same-value dedup). All 189 tests pass.'
       archived_date: "2026-04-19"
+    - key: MINE-KOTLIN-GENERIC-RECEIVER-NESTED
+      summary: Extract function names from Kotlin generic functions with deeply nested receiver types
+      resolution: '2026-04-19: Replaced [^>]+ with (?:[^<>]|<[^<>]*>)* in fun regex; added 2 tests for depth-2 generic nesting (AC-1, AC-2); all 176 symbol extract tests pass'
+      archived_date: "2026-04-19"
+    - key: MINE-BIN-SKIP-DIRS
+      summary: bin/ in SKIP_DIRS silently excludes non-.NET script directories
+      resolution: '2026-04-19: Remove bin from global SKIP_DIRS; add _is_dotnet_project() helper; skip bin/ conditionally in scan_project() when .NET markers present. Hardened round-1: fixed weak .dll test fixture in test_bin_dir_skipped_when_sln_at_root.'
+      archived_date: "2026-04-19"
+    - key: CLARIFY-MINE-BIN-SKIP-DIRS
+      summary: Clarify scope for MINE-BIN-SKIP-DIRS before planning can proceed
+      resolution: '2026-04-19: Owner decision: implement per-project detection — skip bin/ only when .NET markers (.csproj, .sln, .fsproj, .vbproj) are present. Add non-.NET regression test.'
+      archived_date: "2026-04-19"

{mempalace_code-1.3.0 → mempalace_code-1.4.0}/docs/BACKLOG.yaml

@@ -840,26 +840,6 @@ items:
       - [ ] extract_symbol("String getName() {\n}\n", "java") returns ("getName", "method")
       - [ ] extract_symbol("String name;\n", "java") still returns ("", "")
       - [ ] All existing Java symbol-extraction tests pass
-  - key: MINE-KOTLIN-GENERIC-RECEIVER-NESTED
-    summary: Extract function names from Kotlin generic functions with deeply nested receiver types
-    type: feature
-    status: open
-    priority: low
-    size: S
-    section_id: immediate
-    labels: [feat, miner, kotlin]
-    description: |-
-      ## Problem
-      The fun extraction regex uses negated-class [^>] that stops at the first >, so nested generics like Map<String, List<Int>> or bounds like <T : Comparable<T>> cause extract_symbol to return ("", ""). Chunks are stored but symbol metadata is empty, degrading search relevance for generic utility/extension code.
-
-      ## Scope
-      - Update fun regex in _KOTLIN_EXTRACT to handle depth-2 nesting
-      - Cover: type param bounds, generic receivers
-
-      ## Acceptance criteria
-      - [ ] extract_symbol('fun <T : Comparable<T>> List<T>.sorted(): List<T>', 'kotlin') == ('sorted', 'function')
-      - [ ] extract_symbol('fun Map<String, List<Int>>.flatten(): List<Int>', 'kotlin') == ('flatten', 'function')
-      - [ ] All 23 existing Kotlin symbol tests still pass
   - key: MINE-CSHARP-EXPR-BODY
     summary: C# expression-bodied properties not detected as boundaries or symbols
     type: feature
@@ -888,27 +868,6 @@ items:
       - [ ] extract_symbol('public int Count => _items.Count;\n', 'csharp') returns ('Count', 'property')
       - [ ] chunk_code() creates a boundary at expression-bodied property declarations
       - [ ] Existing tests unaffected
-  - key: MINE-BIN-SKIP-DIRS
-    summary: bin/ in SKIP_DIRS silently excludes non-.NET script directories
-    type: task
-    status: open
-    priority: low
-    size: S
-    section_id: immediate
-    labels: [miner]
-    description: |-
-      ## Problem
-      The MINE-DOTNET feature added 'bin' to SKIP_DIRS globally. In non-.NET projects (e.g. Ruby on Rails, Go), a 'bin/' directory legitimately contains source scripts/executables that should be mined. Currently these files are silently skipped with no warning.
-
-      ## Scope
-      - Investigate whether 'bin' should be kept global or made .NET-specific
-      - Option A: Replace global 'bin' entry with per-project detection (only skip bin/ when .csproj/.sln is present in the project root)
-      - Option B: Document as a known limitation in CLAUDE.md and README
-
-      ## Acceptance criteria
-      - A Ruby on Rails or Go project with a 'bin/' directory has those files mined correctly (option A), OR the limitation is clearly documented in user-facing docs (option B)
-      - .NET project mining still skips bin/ and obj/ correctly
-      - No existing tests regress
   - key: BENCH-DOTNET-CLONE-REPO
     summary: Clone jasontaylordev/CleanArchitecture (pin to a stable tag, e.g. v8.0.x) and record the commit hash before running the benchmark
     type: task

{mempalace_code-1.3.0 → mempalace_code-1.4.0}/mempalace/cli.py

@@ -14,6 +14,8 @@ Commands:
     mempalace mine <dir>                  Mine project files (default)
     mempalace mine <dir> --mode convos    Mine conversation exports
     mempalace mine-all <parent-dir>       Mine all projects in a directory
+    mempalace watch <parent-dir>          Watch all projects for changes, re-mine automatically
+    mempalace watch <parent-dir> schedule Print launchd/cron snippet for watch daemon
     mempalace search "query"              Find anything, exact words
     mempalace wake-up                     Show L0 + L1 wake-up context
     mempalace wake-up --wing my_app       Wake-up for a specific project
@@ -770,6 +772,76 @@ def cmd_compress(args):
         print("  (dry run -- nothing stored)")
 
 
+def cmd_watch(args):
+    watch_command = getattr(args, "watch_command", None)
+    if watch_command == "schedule":
+        cmd_watch_schedule(args)
+        return
+
+    # Default: run the watcher
+    palace_path = os.path.expanduser(args.palace) if args.palace else MempalaceConfig().palace_path
+
+    try:
+        from .watcher import watch_all
+    except ImportError as exc:
+        print(f"  Error importing watcher: {exc}", file=sys.stderr)
+        sys.exit(1)
+
+    watch_all(
+        parent_dir=args.dir,
+        palace_path=palace_path,
+        agent=args.agent,
+        respect_gitignore=not args.no_gitignore,
+        on_commit=not getattr(args, "on_save", False),
+    )
+
+
+def cmd_watch_schedule(args):
+    import sys as _sys
+
+    if getattr(args, "install", False):
+        print(
+            "  owner action required: --install is not supported.\n"
+            "  Print the snippet with 'mempalace watch <dir> schedule'\n"
+            "  then install it yourself with: launchctl load <plist> (macOS)\n"
+            "  or: crontab -e (Linux).",
+            file=sys.stderr,
+        )
+        sys.exit(2)
+
+    platform = _sys.platform
+    if platform.startswith("darwin"):
+        platform = "darwin"
+    elif platform.startswith("linux"):
+        platform = "linux"
+    else:
+        print(
+            f"  Error: watch scheduling is not supported on {_sys.platform}.\n"
+            "  'mempalace watch schedule' works on macOS (launchd) and Linux (cron) only.",
+            file=sys.stderr,
+        )
+        sys.exit(1)
+
+    from .watcher import render_watch_schedule
+
+    try:
+        snippet = render_watch_schedule(args.dir, platform)
+    except ValueError as exc:
+        print(f"  Error: {exc}", file=sys.stderr)
+        sys.exit(1)
+
+    print(snippet, end="")
+    if platform == "darwin":
+        plist_path = "~/Library/LaunchAgents/com.mempalace.watch.plist"
+        print("\n  # To install:", file=sys.stderr)
+        print(f"  #   mempalace watch {args.dir} schedule > {plist_path}", file=sys.stderr)
+        print(f"  #   launchctl load {plist_path}", file=sys.stderr)
+        print("  # To stop:", file=sys.stderr)
+        print(f"  #   launchctl unload {plist_path}", file=sys.stderr)
+    else:
+        print("\n  # To install: crontab -e  (paste the line above)", file=sys.stderr)
+
+
 def cmd_backup_create(args):
     from .backup import create_backup
 
@@ -1190,6 +1262,43 @@ def main():
         help="Re-download even if already cached",
     )
 
+    # watch
+    p_watch = sub.add_parser(
+        "watch",
+        help="Watch all initialized projects for changes and re-mine automatically",
+    )
+    p_watch.add_argument(
+        "dir",
+        help="Parent directory containing project subdirectories",
+    )
+    p_watch.add_argument(
+        "--no-gitignore",
+        action="store_true",
+        help="Don't respect .gitignore files when scanning project files",
+    )
+    p_watch.add_argument(
+        "--agent",
+        default="mempalace",
+        help="Name recorded on every drawer (default: mempalace)",
+    )
+    p_watch.add_argument(
+        "--on-save",
+        action="store_true",
+        help="Re-mine on every file save instead of only on git commits (noisier)",
+    )
+    watch_sub = p_watch.add_subparsers(dest="watch_command")
+
+    # watch schedule
+    p_watch_schedule = watch_sub.add_parser(
+        "schedule",
+        help="Print a scheduler snippet (launchd plist or cron line) for the watch daemon",
+    )
+    p_watch_schedule.add_argument(
+        "--install",
+        action="store_true",
+        help="(Accepted but rejected with an explanation — owner action required)",
+    )
+
     # backup
     p_backup = sub.add_parser(
         "backup",
@@ -1324,6 +1433,7 @@ def main():
         "init": cmd_init,
         "mine": cmd_mine,
         "mine-all": cmd_mine_all,
+        "watch": cmd_watch,
         "split": cmd_split,
         "search": cmd_search,
         "compress": cmd_compress,

{mempalace_code-1.3.0 → mempalace_code-1.4.0}/mempalace/miner.py

@@ -158,7 +158,6 @@ SKIP_DIRS = {
     ".tox",
     ".nox",
     ".vs",
-    "bin",
     "obj",
     ".idea",
     ".vscode",
@@ -354,6 +353,27 @@ def is_gitignored(path: Path, matchers: list, is_dir: bool = False) -> bool:
     return ignored
 
 
+_DOTNET_MARKERS = (
+    "*.sln",
+    "*.csproj",
+    "*.fsproj",
+    "*.vbproj",
+    "*/*.csproj",
+    "*/*.fsproj",
+    "*/*.vbproj",
+)
+
+
+def _is_dotnet_project(project_path: Path) -> bool:
+    """Return True if *project_path* looks like a .NET project.
+
+    Checks for .sln at root level and .csproj/.fsproj/.vbproj at root or one
+    level deep (the standard layout: Solution.sln at root, Project/Project.csproj
+    in a subdirectory).  Uses early-exit to minimise filesystem round-trips.
+    """
+    return any(next(project_path.glob(pat), None) is not None for pat in _DOTNET_MARKERS)
+
+
 def should_skip_dir(dirname: str) -> bool:
     """Skip known generated/cache directories before gitignore matching."""
     return dirname in SKIP_DIRS or dirname.endswith(".egg-info")
@@ -863,10 +883,11 @@ _KOTLIN_EXTRACT = [
     (re.compile(r"object\s+(\w+)", re.MULTILINE), "object"),
     # fun — optional type params (e.g. `fun <T> identity(…)`) and optional receiver type
     # (e.g. `fun String.isEmpty()` → `isEmpty`, `fun <T> List<T>.map()` → `map`).
-    # Receiver handles simple types and single-level generics; deeply nested generics are rare.
+    # Uses (?:[^<>]|<[^<>]*>)* instead of [^>]+ to handle depth-2 generic nesting, e.g.
+    # `fun <T : Comparable<T>> …` and `fun Map<String, List<Int>>.flatten()`.
     (
         re.compile(
-            r"^(?:(?:public|internal|protected|private|abstract|open|final|override|inline|infix|operator|tailrec|suspend|external|expect|actual)\s+)*fun\s+(?:<[^>]+>\s+)?(?:\w+(?:<[^>]+>)?\.)?(\w+)",
+            r"^(?:(?:public|internal|protected|private|abstract|open|final|override|inline|infix|operator|tailrec|suspend|external|expect|actual)\s+)*fun\s+(?:<(?:[^<>]|<[^<>]*>)*>\s+)?(?:\w+(?:<(?:[^<>]|<[^<>]*>)*>)?\.)?(\w+)",
             re.MULTILINE,
         ),
         "function",
@@ -1911,6 +1932,7 @@ def scan_project(
     active_matchers = []
     matcher_cache = {}
     include_paths = normalize_include_paths(include_ignored)
+    dotnet_project = _is_dotnet_project(project_path)
 
     for root, dirs, filenames in os.walk(project_path):
         root_path = Path(root)
@@ -1929,7 +1951,7 @@ def scan_project(
             d
             for d in dirs
             if is_force_included(root_path / d, project_path, include_paths)
-            or not should_skip_dir(d)
+            or not (should_skip_dir(d) or (dotnet_project and d == "bin"))
         ]
         if respect_gitignore and active_matchers:
             dirs[:] = [
@@ -2623,6 +2645,7 @@ def mine(
     include_ignored: list = None,
     incremental: bool = True,
     kg=None,
+    skip_optimize: bool = False,
 ):
     """Mine a project directory into the palace.
 
@@ -2633,6 +2656,10 @@ def mine(
     *kg* is an optional KnowledgeGraph instance. When provided, .NET project files
     (.csproj, .fsproj, .vbproj) and solution files (.sln) are also parsed for
     structured dependency triples that are written to the knowledge graph.
+
+    When *skip_optimize* is True, post-mine storage compaction is skipped.  Callers
+    (e.g. the watcher) that run many mine() calls in sequence should skip optimize
+    on each call and run a single optimize at the end.
     """
 
     project_path = Path(project_dir).expanduser().resolve()
@@ -2811,7 +2838,9 @@ def mine(
                         kg.invalidate_by_source_file(stale_path)
 
             config = MempalaceConfig()
-            if config.optimize_after_mine:
+            if skip_optimize:
+                pass  # caller will optimize later
+            elif config.optimize_after_mine:
                 t0 = time.time()
                 backup_first = config.backup_before_optimize
                 if backup_first:
@@ -2852,6 +2881,13 @@ def mine(
     print('\n  Next: mempalace search "what you\'re looking for"')
     print(f"{'=' * 55}\n")
 
+    return {
+        "files_processed": len(files) - files_skipped,
+        "files_skipped": files_skipped,
+        "drawers_filed": total_drawers,
+        "elapsed_secs": elapsed,
+    }
+
 
 # =============================================================================
 # MULTI-PROJECT DETECTION

{mempalace_code-1.3.0 → mempalace_code-1.4.0}/mempalace/storage.py

@@ -241,11 +241,32 @@ class LanceStore(DrawerStore):
 
     def __init__(self, palace_path: str, create: bool = True, embed_model: Optional[str] = None):
         import lancedb
+        import logging
 
         self._model_name = embed_model or DEFAULT_EMBED_MODEL
         self._db = lancedb.connect(os.path.join(palace_path, "lance"))
-        self._embedder = self._get_embedder()
-        self._table = self._open_or_create(create)
+
+        # Suppress noisy HF/safetensors output (BertModel LOAD REPORT, tqdm bars,
+        # unauthenticated-request warnings).  Must redirect at the OS fd level
+        # because the noise comes from C/Rust code, not Python.
+        hf_logger = logging.getLogger("huggingface_hub")
+        prev_level = hf_logger.level
+        hf_logger.setLevel(logging.ERROR)
+        devnull = os.open(os.devnull, os.O_WRONLY)
+        old_stdout = os.dup(1)
+        old_stderr = os.dup(2)
+        try:
+            os.dup2(devnull, 1)
+            os.dup2(devnull, 2)
+            self._embedder = self._get_embedder()
+            self._table = self._open_or_create(create)
+        finally:
+            os.dup2(old_stdout, 1)
+            os.dup2(old_stderr, 2)
+            os.close(devnull)
+            os.close(old_stdout)
+            os.close(old_stderr)
+            hf_logger.setLevel(prev_level)
 
     def _get_embedder(self):
         """Load the sentence-transformers embedding model."""