codecortex 0.2.2__tar.gz → 0.3.0__tar.gz

{codecortex-0.2.2/src/codecortex.egg-info → codecortex-0.3.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: codecortex
-Version: 0.2.2
+Version: 0.3.0
 Summary: Local-first, MCP-native code-intelligence server — graph, LSP, and semantic search behind one safe code.query tool for coding agents.
 Author: Shammai Hamilton
 License-Expression: MIT
@@ -183,7 +183,7 @@ Full system docs live in [`docs/`](docs/) — start with the index:
 | `codeintel setup [project_root] [--index] [--warm] [--install-uv]` | Check backends + optionally index this repo; ends with a health report |
 | `codeintel index [project_root]` | Index a project for semantic search |
 | `codeintel serve` | Start the MCP server (stdio transport) |
-| `codeintel serve-http [--host HOST] [--port 8766] [--allow-remote]` | Start the HTTP transport (loopback-only unless `--allow-remote`) |
+| `codeintel serve-http [--host HOST] [--port 8766] [--allow-remote] [--token TOKEN]` | Start the HTTP transport (loopback-only unless `--allow-remote`; `--token` requires a bearer token on every request) |
 | `codeintel query --op OP --target TARGET [--engine auto]` | Run a single query and print the result |
 | `codeintel status [project_root]` | Show engine availability and index age |
 | `codeintel doctor [project_root] [--deep] [--json]` | Diagnose per-engine health + repo index status, with a fix for each gap |
@@ -197,17 +197,28 @@ Human-facing commands (`doctor`, `status`, `query`, `setup`, `reset`) honor `--n
 Create `.codeintel.toml` at your project root to override defaults:
 
 ```toml
-backend      = "auto"                   # auto | graph | lsp | semantic
-semantic     = "on"                     # on | off
-reindex      = "on-demand"              # on-demand | never
-cosine_floor = 0.25                     # minimum similarity score for semantic hits
-max_chunks   = 500                      # max chunks to embed per file
-model        = "BAAI/bge-small-en-v1.5" # fastembed embedding model
+backend          = "auto"                   # auto | graph | lsp | semantic
+semantic         = "on"                     # on | off
+reindex          = "on-demand"              # on-demand | never
+cosine_floor     = 0.25                     # minimum similarity score for semantic hits (0–1)
+max_chunks       = 500                      # max chunks to embed per file
+max_total_chunks = 100000                   # safety ceiling on chunks embedded in one index pass
+model            = "BAAI/bge-small-en-v1.5" # fastembed embedding model
 ```
 
+Config is **validated on load** — an out-of-range number, a misspelled enum, or a wrong type falls back to that key's default (with a logged warning) instead of breaking every query.
+
+**Environment variables:**
+
+| Variable | Effect |
+|---|---|
+| `CODEINTEL_HTTP_TOKEN` | Bearer token required by `serve-http` (equivalent to `--token`) |
+| `CODEINTEL_DEBUG=1` | Log the full traceback of any error the never-throw contract swallows (silent by default) — the switch for diagnosing an unexpected `null` |
+| `CODEINTEL_REINDEX=off` | Disable the background reindexer; queries then index inline to stay fresh |
+
 ## Privacy & dependencies
 
-**codeintel is local-first** — one local process, no cloud service, no API keys, no telemetry, and no per-query network. Its own code makes zero outbound HTTP calls, and the HTTP transport binds to `127.0.0.1` only.
+**codeintel is local-first** — one local process, no cloud service, no API keys, no telemetry, and no per-query network. Its own code makes zero outbound HTTP calls, and the HTTP transport binds to `127.0.0.1` only by default — binding a non-loopback host requires `--allow-remote`, and `--token` (or `CODEINTEL_HTTP_TOKEN`) then gates every request behind a bearer token. The server bounds concurrent connections, but for exposure to a hostile network you should still front it with a reverse proxy (TLS, rate-limiting) — the built-in `http.server` is not hardened for the open internet.
 
 **Bundled (installed with the package, run locally):** `mcp` (the tool interface) · `sqlite-vec` (the semantic index, a local DB file) · `fastembed` (the local embedding model).
 
@@ -240,6 +251,8 @@ Over MCP the agent calls `code.query` directly. Over HTTP, start the server and
 codeintel serve-http &   # listens on 127.0.0.1:8766 by default
 ```
 
+For a shared or remote deployment, start it with `--allow-remote --token "$CODEINTEL_HTTP_TOKEN"` and send `Authorization: Bearer <token>` on each request — a missing or wrong token gets a clean `401`. Requests are handled concurrently, so one slow query never blocks another.
+
 ```python
 import urllib.request, json
 

{codecortex-0.2.2 → codecortex-0.3.0}/README.md

@@ -150,7 +150,7 @@ Full system docs live in [`docs/`](docs/) — start with the index:
 | `codeintel setup [project_root] [--index] [--warm] [--install-uv]` | Check backends + optionally index this repo; ends with a health report |
 | `codeintel index [project_root]` | Index a project for semantic search |
 | `codeintel serve` | Start the MCP server (stdio transport) |
-| `codeintel serve-http [--host HOST] [--port 8766] [--allow-remote]` | Start the HTTP transport (loopback-only unless `--allow-remote`) |
+| `codeintel serve-http [--host HOST] [--port 8766] [--allow-remote] [--token TOKEN]` | Start the HTTP transport (loopback-only unless `--allow-remote`; `--token` requires a bearer token on every request) |
 | `codeintel query --op OP --target TARGET [--engine auto]` | Run a single query and print the result |
 | `codeintel status [project_root]` | Show engine availability and index age |
 | `codeintel doctor [project_root] [--deep] [--json]` | Diagnose per-engine health + repo index status, with a fix for each gap |
@@ -164,17 +164,28 @@ Human-facing commands (`doctor`, `status`, `query`, `setup`, `reset`) honor `--n
 Create `.codeintel.toml` at your project root to override defaults:
 
 ```toml
-backend      = "auto"                   # auto | graph | lsp | semantic
-semantic     = "on"                     # on | off
-reindex      = "on-demand"              # on-demand | never
-cosine_floor = 0.25                     # minimum similarity score for semantic hits
-max_chunks   = 500                      # max chunks to embed per file
-model        = "BAAI/bge-small-en-v1.5" # fastembed embedding model
+backend          = "auto"                   # auto | graph | lsp | semantic
+semantic         = "on"                     # on | off
+reindex          = "on-demand"              # on-demand | never
+cosine_floor     = 0.25                     # minimum similarity score for semantic hits (0–1)
+max_chunks       = 500                      # max chunks to embed per file
+max_total_chunks = 100000                   # safety ceiling on chunks embedded in one index pass
+model            = "BAAI/bge-small-en-v1.5" # fastembed embedding model
 ```
 
+Config is **validated on load** — an out-of-range number, a misspelled enum, or a wrong type falls back to that key's default (with a logged warning) instead of breaking every query.
+
+**Environment variables:**
+
+| Variable | Effect |
+|---|---|
+| `CODEINTEL_HTTP_TOKEN` | Bearer token required by `serve-http` (equivalent to `--token`) |
+| `CODEINTEL_DEBUG=1` | Log the full traceback of any error the never-throw contract swallows (silent by default) — the switch for diagnosing an unexpected `null` |
+| `CODEINTEL_REINDEX=off` | Disable the background reindexer; queries then index inline to stay fresh |
+
 ## Privacy & dependencies
 
-**codeintel is local-first** — one local process, no cloud service, no API keys, no telemetry, and no per-query network. Its own code makes zero outbound HTTP calls, and the HTTP transport binds to `127.0.0.1` only.
+**codeintel is local-first** — one local process, no cloud service, no API keys, no telemetry, and no per-query network. Its own code makes zero outbound HTTP calls, and the HTTP transport binds to `127.0.0.1` only by default — binding a non-loopback host requires `--allow-remote`, and `--token` (or `CODEINTEL_HTTP_TOKEN`) then gates every request behind a bearer token. The server bounds concurrent connections, but for exposure to a hostile network you should still front it with a reverse proxy (TLS, rate-limiting) — the built-in `http.server` is not hardened for the open internet.
 
 **Bundled (installed with the package, run locally):** `mcp` (the tool interface) · `sqlite-vec` (the semantic index, a local DB file) · `fastembed` (the local embedding model).
 
@@ -207,6 +218,8 @@ Over MCP the agent calls `code.query` directly. Over HTTP, start the server and
 codeintel serve-http &   # listens on 127.0.0.1:8766 by default
 ```
 
+For a shared or remote deployment, start it with `--allow-remote --token "$CODEINTEL_HTTP_TOKEN"` and send `Authorization: Bearer <token>` on each request — a missing or wrong token gets a clean `401`. Requests are handled concurrently, so one slow query never blocks another.
+
 ```python
 import urllib.request, json
 

{codecortex-0.2.2 → codecortex-0.3.0/src/codecortex.egg-info}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: codecortex
-Version: 0.2.2
+Version: 0.3.0
 Summary: Local-first, MCP-native code-intelligence server — graph, LSP, and semantic search behind one safe code.query tool for coding agents.
 Author: Shammai Hamilton
 License-Expression: MIT
@@ -183,7 +183,7 @@ Full system docs live in [`docs/`](docs/) — start with the index:
 | `codeintel setup [project_root] [--index] [--warm] [--install-uv]` | Check backends + optionally index this repo; ends with a health report |
 | `codeintel index [project_root]` | Index a project for semantic search |
 | `codeintel serve` | Start the MCP server (stdio transport) |
-| `codeintel serve-http [--host HOST] [--port 8766] [--allow-remote]` | Start the HTTP transport (loopback-only unless `--allow-remote`) |
+| `codeintel serve-http [--host HOST] [--port 8766] [--allow-remote] [--token TOKEN]` | Start the HTTP transport (loopback-only unless `--allow-remote`; `--token` requires a bearer token on every request) |
 | `codeintel query --op OP --target TARGET [--engine auto]` | Run a single query and print the result |
 | `codeintel status [project_root]` | Show engine availability and index age |
 | `codeintel doctor [project_root] [--deep] [--json]` | Diagnose per-engine health + repo index status, with a fix for each gap |
@@ -197,17 +197,28 @@ Human-facing commands (`doctor`, `status`, `query`, `setup`, `reset`) honor `--n
 Create `.codeintel.toml` at your project root to override defaults:
 
 ```toml
-backend      = "auto"                   # auto | graph | lsp | semantic
-semantic     = "on"                     # on | off
-reindex      = "on-demand"              # on-demand | never
-cosine_floor = 0.25                     # minimum similarity score for semantic hits
-max_chunks   = 500                      # max chunks to embed per file
-model        = "BAAI/bge-small-en-v1.5" # fastembed embedding model
+backend          = "auto"                   # auto | graph | lsp | semantic
+semantic         = "on"                     # on | off
+reindex          = "on-demand"              # on-demand | never
+cosine_floor     = 0.25                     # minimum similarity score for semantic hits (0–1)
+max_chunks       = 500                      # max chunks to embed per file
+max_total_chunks = 100000                   # safety ceiling on chunks embedded in one index pass
+model            = "BAAI/bge-small-en-v1.5" # fastembed embedding model
 ```
 
+Config is **validated on load** — an out-of-range number, a misspelled enum, or a wrong type falls back to that key's default (with a logged warning) instead of breaking every query.
+
+**Environment variables:**
+
+| Variable | Effect |
+|---|---|
+| `CODEINTEL_HTTP_TOKEN` | Bearer token required by `serve-http` (equivalent to `--token`) |
+| `CODEINTEL_DEBUG=1` | Log the full traceback of any error the never-throw contract swallows (silent by default) — the switch for diagnosing an unexpected `null` |
+| `CODEINTEL_REINDEX=off` | Disable the background reindexer; queries then index inline to stay fresh |
+
 ## Privacy & dependencies
 
-**codeintel is local-first** — one local process, no cloud service, no API keys, no telemetry, and no per-query network. Its own code makes zero outbound HTTP calls, and the HTTP transport binds to `127.0.0.1` only.
+**codeintel is local-first** — one local process, no cloud service, no API keys, no telemetry, and no per-query network. Its own code makes zero outbound HTTP calls, and the HTTP transport binds to `127.0.0.1` only by default — binding a non-loopback host requires `--allow-remote`, and `--token` (or `CODEINTEL_HTTP_TOKEN`) then gates every request behind a bearer token. The server bounds concurrent connections, but for exposure to a hostile network you should still front it with a reverse proxy (TLS, rate-limiting) — the built-in `http.server` is not hardened for the open internet.
 
 **Bundled (installed with the package, run locally):** `mcp` (the tool interface) · `sqlite-vec` (the semantic index, a local DB file) · `fastembed` (the local embedding model).
 
@@ -240,6 +251,8 @@ Over MCP the agent calls `code.query` directly. Over HTTP, start the server and
 codeintel serve-http &   # listens on 127.0.0.1:8766 by default
 ```
 
+For a shared or remote deployment, start it with `--allow-remote --token "$CODEINTEL_HTTP_TOKEN"` and send `Authorization: Bearer <token>` on each request — a missing or wrong token gets a clean `401`. Requests are handled concurrently, so one slow query never blocks another.
+
 ```python
 import urllib.request, json
 

{codecortex-0.2.2 → codecortex-0.3.0}/src/codecortex.egg-info/SOURCES.txt

@@ -33,12 +33,15 @@ src/codeintel/providers/lsp.py
 src/codeintel/providers/none.py
 src/codeintel/providers/semantic.py
 tests/test_cache.py
+tests/test_config.py
 tests/test_doctor.py
 tests/test_e2e.py
 tests/test_gateway.py
 tests/test_graph_provider.py
 tests/test_graph_real.py
 tests/test_graph_stdin.py
+tests/test_hardening.py
+tests/test_http_auth.py
 tests/test_http_server.py
 tests/test_integration.py
 tests/test_lsp_provider.py

codecortex-0.3.0/src/codeintel/__init__.py

@@ -0,0 +1 @@
+__version__ = "0.3.0"

{codecortex-0.2.2 → codecortex-0.3.0}/src/codeintel/__main__.py

@@ -50,7 +50,8 @@ def main() -> None:
     http_parser = subparsers.add_parser("serve-http", help="Start the HTTP transport server")
     http_parser.add_argument("--port", type=int, default=8766, help="Port to listen on (default: 8766)")
     http_parser.add_argument("--host", default="127.0.0.1", help="Host to bind to (default: 127.0.0.1)")
-    http_parser.add_argument("--allow-remote", action="store_true", help="Permit binding a non-loopback host (exposes an UNAUTHENTICATED endpoint)")
+    http_parser.add_argument("--allow-remote", action="store_true", help="Permit binding a non-loopback host (use with --token, or the endpoint is UNAUTHENTICATED)")
+    http_parser.add_argument("--token", default=None, help="Require this bearer token on every request (or set CODEINTEL_HTTP_TOKEN). Strongly recommended with --allow-remote.")
 
     # install subcommand
     install_parser = subparsers.add_parser("install", help="Register codeintel with AI agents")
@@ -120,6 +121,7 @@ def main() -> None:
                 window=int(cfg.get("window", 20)),
                 stride=int(cfg.get("stride", 10)),
                 max_chunks=int(cfg.get("max_chunks", 500)),
+                max_total_chunks=int(cfg.get("max_total_chunks", 100000)),
             ).index(project_root)
             if count > 0:
                 print(f"Indexed {count} chunks")
@@ -225,7 +227,7 @@ def main() -> None:
             from codeintel import server
 
             project_root = args.project_root or os.getcwd()
-            status = server.code_status_handler({})
+            status = server.code_status_handler({"project_root": project_root})
 
             print("Engine status:")
             for engine in ["graph", "lsp", "semantic"]:
@@ -318,7 +320,8 @@ def main() -> None:
     elif args.command == "serve-http":
         try:
             from codeintel.http_server import run
-            run(host=args.host, port=args.port, allow_remote=args.allow_remote)
+            token = args.token or os.environ.get("CODEINTEL_HTTP_TOKEN")
+            run(host=args.host, port=args.port, allow_remote=args.allow_remote, token=token)
         except KeyboardInterrupt:
             pass
         except Exception as exc:

{codecortex-0.2.2 → codecortex-0.3.0}/src/codeintel/cache.py

@@ -13,7 +13,7 @@ def _compute_hash(target: str, project_root: str) -> str:
     try:
         root = os.path.realpath(project_root) if project_root else ""
         path = os.path.realpath(target)
-        if root and path.startswith(root + os.sep) or path == root:
+        if (root and path.startswith(root + os.sep)) or path == root:
             if os.path.isfile(path):
                 with open(path, "rb") as fh:
                     return hashlib.sha256(fh.read()).hexdigest()

codecortex-0.3.0/src/codeintel/config.py

@@ -0,0 +1,97 @@
+from __future__ import annotations
+
+import logging
+import pathlib
+import sys
+
+if sys.version_info >= (3, 11):
+    import tomllib
+else:  # pragma: no cover
+    try:
+        import tomllib  # type: ignore[no-redef]
+    except ImportError:
+        import tomli as tomllib  # type: ignore[no-redef]
+
+logger = logging.getLogger("codeintel")
+
+_DEFAULTS: dict = {
+    "backend": "auto",
+    "semantic": "on",
+    "reindex": "on-demand",
+    "window": 20,
+    "stride": 10,
+    "max_chunks": 500,          # per file
+    "max_total_chunks": 100000,  # safety ceiling on chunks embedded in one index pass
+    "cosine_floor": 0.25,
+    "model": "BAAI/bge-small-en-v1.5",
+}
+
+# Values restricted to a fixed set — anything else falls back to the default.
+_ENUMS: dict = {
+    "backend": {"auto", "graph", "lsp", "semantic"},
+    "semantic": {"on", "off"},
+    "reindex": {"on-demand", "never"},
+}
+_POSITIVE_INTS = ("window", "stride", "max_chunks", "max_total_chunks")
+
+
+def _read_toml(path: pathlib.Path) -> dict:
+    try:
+        with path.open("rb") as fh:
+            return tomllib.load(fh)
+    except (FileNotFoundError, OSError, tomllib.TOMLDecodeError):
+        return {}
+
+
+def _coerce(cfg: dict) -> dict:
+    """Coerce/clamp a merged config to safe values, warning on and dropping bad ones. Never raises:
+    a malformed ``.codeintel.toml`` (a string where a number belongs, an out-of-range floor, an
+    unknown enum) must degrade to the default for that key, not break every query that loads it."""
+    out = dict(_DEFAULTS)
+    for key, default in _DEFAULTS.items():
+        if key not in cfg:
+            continue
+        val = cfg[key]
+        try:
+            if key in _ENUMS:
+                s = str(val).strip().lower()
+                if s in _ENUMS[key]:
+                    out[key] = s
+                else:
+                    logger.warning("config: %s=%r invalid (expected %s) — using %r",
+                                   key, val, sorted(_ENUMS[key]), default)
+            elif key == "model":
+                out[key] = str(val).strip() or default
+            elif key == "cosine_floor":
+                f = float(val)
+                if f != f:  # NaN (TOML allows `nan`) — reject so it can't silently disable the floor
+                    raise ValueError("nan")
+                out[key] = min(1.0, max(0.0, f))
+            elif key in _POSITIVE_INTS:
+                n = int(val)
+                if n > 0:
+                    out[key] = n
+                else:
+                    logger.warning("config: %s=%r must be > 0 — using %r", key, val, default)
+        except (TypeError, ValueError, OverflowError):
+            # int(float('inf')) raises OverflowError (TOML allows `inf`); float("x") → ValueError;
+            # int([]) → TypeError. Any non-usable value logs and keeps the default, so the
+            # docstring's never-raise promise holds even for the CLI paths that don't wrap this.
+            logger.warning("config: %s=%r not usable — using default %r", key, val, default)
+    # Keep any extra keys the user set (forward-compat) without validating them.
+    for k, v in cfg.items():
+        if k not in _DEFAULTS:
+            out[k] = v
+    return out
+
+
+def load_config(project_root: str | None = None) -> dict:
+    """Return the merged, validated config: defaults < global < project. Values that fail
+    validation fall back to their default (logged), so a bad config file never breaks a query."""
+    root = pathlib.Path(project_root) if project_root is not None else pathlib.Path.cwd()
+
+    global_cfg = _read_toml(pathlib.Path.home() / ".codeintel" / "config.toml")
+    project_cfg = _read_toml(root / ".codeintel.toml")
+
+    merged = {**_DEFAULTS, **global_cfg, **project_cfg}
+    return _coerce(merged)

{codecortex-0.2.2 → codecortex-0.3.0}/src/codeintel/gateway.py

@@ -5,7 +5,7 @@ from typing import Any
 
 from codeintel.cache import ContentHashCache
 from codeintel.policy import TieringPolicy
-from codeintel.provider import Result, safe_null_result
+from codeintel.provider import Result, log_swallowed, safe_null_result
 from codeintel.providers.none import NoneProvider
 from codeintel.reindexer import Reindexer
 
@@ -128,7 +128,8 @@ class Gateway:
             if r is not None:
                 return r
             return safe_null_result(op_str, target_str, engine=engine_str, reason="no-result")
-        except Exception:
+        except Exception as exc:
+            log_swallowed(f"Gateway._dispatch_single[{engine_str}.{op_str}]", exc)
             return safe_null_result(op_str, target_str, engine=engine_str, reason="provider-error")
 
     def query(
@@ -206,14 +207,15 @@ class Gateway:
             provider = self._provider_for(engine_str)
             result = self._dispatch_single(provider, op_str, target_str, budget, project_root, engine_str)
 
-            # overview auto-fallback (F4 Story 2): when auto-routed to graph but graph is
-            # unavailable, try lsp — a file/symbol overview is something lsp can also serve.
+            # overview auto-fallback (F4 Story 2): when auto-routed to graph but graph can't serve
+            # it — the backend is unavailable, OR this repo simply isn't in the graph — try lsp,
+            # which can produce a file/symbol overview without the graph index.
             if (
                 was_auto
                 and op_str == "overview"
                 and engine_str == "graph"
                 and result.get("result") is None
-                and result.get("reason") == "engine-unavailable"
+                and result.get("reason") in ("engine-unavailable", "project-not-indexed")
             ):
                 lsp_result = self._dispatch_single(
                     self.lsp, op_str, target_str, budget, project_root, "lsp"
@@ -224,5 +226,6 @@ class Gateway:
             self._cache.put(op_str, target_str, engine_str, root_str, result, freshness)
             return result
 
-        except Exception:
+        except Exception as exc:
+            log_swallowed("Gateway.query", exc)
             return safe_null_result(op or "", target or "", reason="gateway-error")

codecortex-0.3.0/src/codeintel/http_server.py

@@ -0,0 +1,175 @@
+from __future__ import annotations
+
+import hmac
+import json
+import sys
+import threading
+from http.server import BaseHTTPRequestHandler, ThreadingHTTPServer
+from urllib.parse import parse_qs, urlparse
+
+from codeintel.provider import log_swallowed
+from codeintel.server import code_doctor_handler, code_query_handler, code_status_handler
+
+_MAX_BODY_BYTES = 1_048_576       # 1 MiB
+_REQUEST_TIMEOUT_S = 60           # per-request socket read timeout — drops an idle/half-open client
+_MAX_CONCURRENT_REQUESTS = 64     # cap live worker threads so a burst can't exhaust threads/FDs
+
+
+class _Handler(BaseHTTPRequestHandler):
+    # Applied to the request socket by the base handler's setup(); a slow/half-open client
+    # connection is dropped instead of pinning a worker thread forever (basic slowloris guard).
+    timeout = _REQUEST_TIMEOUT_S
+
+    def log_message(self, format: str, *args: object) -> None:
+        pass  # suppress default stderr noise
+
+    def _send_json(self, status: int, data: dict) -> None:
+        body = json.dumps(data).encode()
+        self.send_response(status)
+        self.send_header("Content-Type", "application/json")
+        self.send_header("Content-Length", str(len(body)))
+        self.end_headers()
+        self.wfile.write(body)
+
+    def _authorized(self) -> bool:
+        """When the server was started with a token, require ``Authorization: Bearer <token>``
+        (constant-time compare). No token configured → auth is disabled (the loopback default)."""
+        token = getattr(self.server, "auth_token", None)
+        if not token:
+            return True
+        header = self.headers.get("Authorization", "")
+        prefix = "Bearer "
+        if not header.startswith(prefix):
+            return False
+        presented = header[len(prefix):].strip()
+        # Compare as UTF-8 bytes: hmac.compare_digest raises TypeError on a non-ASCII str, so a
+        # malformed header (e.g. `Bearer résumé`) would otherwise crash the handler thread. Encoding
+        # is always safe and keeps the comparison constant-time.
+        return hmac.compare_digest(presented.encode("utf-8"), token.encode("utf-8"))
+
+    def do_POST(self) -> None:
+        if not self._authorized():
+            self._send_json(401, {"error": "unauthorized"})
+            return
+        if self.path not in ("/code/query", "/code/doctor"):
+            self._send_json(404, {"error": "not-found"})
+            return
+        try:
+            content_length = int(self.headers.get("Content-Length", 0))
+        except (TypeError, ValueError):
+            self._send_json(400, {"error": "bad-request"})
+            return
+        if content_length > _MAX_BODY_BYTES:
+            self.close_connection = True          # do not read the oversized body
+            self._send_json(413, {"error": "payload-too-large", "max_bytes": _MAX_BODY_BYTES})
+            return
+        raw = self.rfile.read(content_length) if content_length > 0 else b""
+        try:
+            parsed = json.loads(raw)
+        except (json.JSONDecodeError, ValueError):
+            self._send_json(400, {"error": "bad-request"})
+            return
+        if not isinstance(parsed, dict):
+            self._send_json(400, {"error": "bad-request"})
+            return
+        if self.path == "/code/doctor":
+            result = code_doctor_handler(parsed)
+        else:
+            result = code_query_handler(parsed)
+        self._send_json(200, result)
+
+    def do_GET(self) -> None:
+        if not self._authorized():
+            self._send_json(401, {"error": "unauthorized"})
+            return
+        parsed = urlparse(self.path)
+        if parsed.path != "/code/status":
+            self._send_json(404, {"error": "not-found"})
+            return
+        # Optional ?project_root=... scopes the `indexed` flag to that repo.
+        project_root = (parse_qs(parsed.query).get("project_root") or [""])[0]
+        result = code_status_handler({"project_root": project_root})
+        self._send_json(200, result)
+
+
+class CodeIntelHTTPServer(ThreadingHTTPServer):
+    # Threaded so one slow request (an LSP session warming, or a first-time index) can't block
+    # every other agent's query. The gateway is a shared singleton, but its mutable state is
+    # lock-guarded (query cache, reindexer, LSP sessions, graph project cache) and the semantic
+    # engine is thread-confined with WAL, so concurrent requests are safe.
+    daemon_threads = True
+    auth_token: str | None = None  # set by run() when a token is provided
+
+    def __init__(self, *args, **kwargs) -> None:
+        super().__init__(*args, **kwargs)
+        # Stdlib ThreadingHTTPServer spawns one thread per connection with no ceiling, so many
+        # slow/half-open clients could exhaust threads/FDs. Bound live workers; past the cap we
+        # refuse fast with 503 rather than spawn an unbounded thread. (For a genuinely hostile
+        # network, still front this with a reverse proxy — http.server is not hardened for that.)
+        self._slots = threading.BoundedSemaphore(_MAX_CONCURRENT_REQUESTS)
+
+    def process_request(self, request, client_address) -> None:
+        if not self._slots.acquire(blocking=False):
+            try:
+                request.sendall(
+                    b"HTTP/1.1 503 Service Unavailable\r\n"
+                    b"Content-Type: application/json\r\nContent-Length: 22\r\n"
+                    b'Connection: close\r\n\r\n{"error":"overloaded"}'
+                )
+            except Exception:
+                pass
+            self.shutdown_request(request)
+            return
+        super().process_request(request, client_address)  # spawns the worker thread
+
+    def process_request_thread(self, request, client_address) -> None:
+        try:
+            super().process_request_thread(request, client_address)
+        finally:
+            self._slots.release()
+
+    def handle_error(self, request, client_address) -> None:
+        # A stalled/reset client raises here (socket timeout, broken pipe) — expected noise, not a
+        # server bug (handlers are never-raise). Keep it off stderr; surface with CODEINTEL_DEBUG=1.
+        log_swallowed("http.handle_error", sys.exc_info()[1] or Exception("unknown"))
+
+
+_LOOPBACK_NAMES = {"localhost"}
+
+
+def _is_loopback(host: str) -> bool:
+    # Treat as loopback ONLY: the literal name "localhost", or an IP literal in a loopback range
+    # (127.0.0.0/8, ::1). A string-prefix test like host.startswith("127.") is unsafe — it would
+    # accept an attacker-controlled HOSTNAME such as "127.0.0.1.evil.example", bypassing the guard.
+    import ipaddress
+
+    h = (host or "").strip().lower()
+    if h in _LOOPBACK_NAMES:
+        return True
+    try:
+        return ipaddress.ip_address(h).is_loopback
+    except ValueError:
+        return False  # a non-IP hostname is never treated as loopback
+
+
+def run(
+    host: str = "127.0.0.1",
+    port: int = 8766,
+    *,
+    allow_remote: bool = False,
+    token: str | None = None,
+) -> None:
+    if not _is_loopback(host) and not allow_remote:
+        print(f"refusing to bind non-loopback host {host!r} without --allow-remote — this would "
+              f"expose an UNAUTHENTICATED code-intel endpoint (your indexed repo) to the network",
+              file=sys.stderr)
+        raise SystemExit(2)
+    server = CodeIntelHTTPServer((host, port), _Handler)
+    server.auth_token = (token or "").strip() or None
+    if not _is_loopback(host) and not server.auth_token:
+        print(f"WARNING: serving codeintel on {host}:{port} with NO authentication — anyone who can "
+              f"reach this port can read your indexed repo (set --token to require a bearer token)",
+              file=sys.stderr)
+    auth_note = "  (bearer-token auth required)" if server.auth_token else ""
+    print(f"Listening on http://{host}:{port}{auth_note}")
+    server.serve_forever()

{codecortex-0.2.2 → codecortex-0.3.0}/src/codeintel/indexer.py

@@ -37,12 +37,14 @@ class Indexer:
         window: int = 20,
         stride: int = 10,
         max_chunks: int = 500,
+        max_total_chunks: int = 100000,
     ) -> None:
         self.db = db
         self.model_name = model_name
         self.window = window
         self.stride = stride
-        self.max_chunks = max_chunks
+        self.max_chunks = max_chunks               # per file
+        self.max_total_chunks = max_total_chunks   # safety ceiling per index pass (memory backstop)
         self._embedder = None
 
     def _get_embedder(self):
@@ -131,6 +133,13 @@ class Indexer:
         new_chunks: list[tuple[str, str, str, int, str]] = []
 
         for filepath in self._walk_files(root):
+            if len(new_chunks) >= self.max_total_chunks:
+                logger.warning(
+                    "index: reached max_total_chunks=%d this pass — stopping "
+                    "(raise it in .codeintel.toml to embed more of a very large repo)",
+                    self.max_total_chunks,
+                )
+                break
             try:
                 with open(filepath, encoding="utf-8", errors="replace") as f:
                     lines = f.readlines()
@@ -145,6 +154,8 @@ class Indexer:
             chunk_count = 0
 
             for chunk_start in range(0, len(lines), self.stride):
+                if len(new_chunks) >= self.max_total_chunks:
+                    break  # global ceiling reached mid-file; the file-loop guard logs and stops
                 if chunk_count >= self.max_chunks:
                     logger.debug(
                         "chunk cap hit for %s, truncating at %d",

{codecortex-0.2.2 → codecortex-0.3.0}/src/codeintel/onboarding.py

@@ -72,6 +72,7 @@ def _bounded_index(project_root: str, *, timeout_s: float, out) -> dict:
                     db, model_name=str(cfg.get("model") or "BAAI/bge-small-en-v1.5"),
                     window=int(cfg.get("window", 20)), stride=int(cfg.get("stride", 10)),
                     max_chunks=int(cfg.get("max_chunks", 500)),
+                    max_total_chunks=int(cfg.get("max_total_chunks", 100000)),
                 ).index(project_root)
             finally:
                 db.close()

{codecortex-0.2.2 → codecortex-0.3.0}/src/codeintel/provider.py

@@ -1,8 +1,27 @@
 from __future__ import annotations
 
+import logging
+import os
+import traceback
 from typing import Any, Optional, Protocol, runtime_checkable
 from typing_extensions import NotRequired, TypedDict
 
+_logger = logging.getLogger("codeintel")
+_DEBUG = os.environ.get("CODEINTEL_DEBUG", "").strip().lower() in ("1", "true", "on", "yes")
+
+
+def log_swallowed(where: str, exc: BaseException) -> None:
+    """Record an exception the never-raise contract is about to swallow. Quiet by default so the
+    contract stays silent in normal use; set ``CODEINTEL_DEBUG=1`` to surface a full traceback when
+    diagnosing why a query came back as a safe-null. Never raises — logging failures are ignored."""
+    try:
+        if _DEBUG:
+            _logger.warning("codeintel swallowed error in %s: %s\n%s", where, exc, traceback.format_exc())
+        else:
+            _logger.debug("codeintel swallowed error in %s: %s", where, exc)
+    except Exception:
+        pass
+
 
 class Result(TypedDict):
     ok: bool