python-delphi-lsp 3.0.0__tar.gz → 3.1.0__tar.gz

{python_delphi_lsp-3.0.0/python_delphi_lsp.egg-info → python_delphi_lsp-3.1.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: python-delphi-lsp
-Version: 3.0.0
+Version: 3.1.0
 Summary: Python Delphi/Object Pascal parser, semantic indexer, and language server.
 Author: Dark Light
 License-Expression: MPL-2.0
@@ -42,7 +42,7 @@ Dynamic: license-file
 
 `python-delphi-lsp` parses Delphi/Object Pascal, builds semantic and project
 indexes, serves LSP, and provides bounded codebase navigation for agents.
-Version 3.0.0 is authored by Dark Light and supports Windows, macOS, and Linux.
+Version 3.1.0 is authored by Dark Light and supports Windows, macOS, and Linux.
 
 ## Install and quick start
 
@@ -199,6 +199,8 @@ delphi-lsp-agent view --root PATH [--project-file FILE] --layer LAYER
                       [--workers auto|N]
 delphi-lsp-agent index --root PATH [--project-file FILE] [--out FILE]
                        [--workers auto|N]
+delphi-lsp-agent wiki export --root PATH [--project-file FILE] [--out DIRECTORY]
+                             [--workers auto|N] [--force]
 delphi-lsp-agent query --root PATH ACTION [VALUE]
                       [--project-id ID] [--detail summary|declaration|members|context|body|implementations]
                       [--relation references|callers|callees|uses|used_by|inherits|implements]
@@ -224,6 +226,40 @@ delphi-lsp-agent cache stop --root PATH
 `cache stop` outputs stop status JSON and may include warnings on stderr.
 `query` outputs Protocol v3 JSON responses and writes warnings to stderr.
 
+### Open Knowledge Format wiki export
+
+Export the complete unique knowledge represented by the layered codebase views
+as a portable Markdown wiki:
+
+```bash
+delphi-lsp-agent wiki export --root PATH --out codebase-wiki
+```
+
+When `--out` is relative, it is resolved below `--root`; the default is
+`.delphi-lsp/wiki`. The command builds the semantic index once, deep-indexes
+discovered projects, calculates workspace and unit metrics, and writes:
+
+- an OKF 0.2 root `index.md`;
+- linked project, unit, and symbol concepts;
+- declaration and implementation source fragments;
+- resolved and unresolved semantic references;
+- discovery/project problems and complete metric records;
+- Protocol v3, relation, CPG, cache, and layer-mapping reference concepts.
+
+Every non-index concept is UTF-8 Markdown with YAML frontmatter and a non-empty
+`type`. Readable filenames include a stable digest, so overloads and equal names
+from different units remain distinct even on case-insensitive filesystems.
+Output order and content are deterministic. The finished bundle replaces the
+destination only after generation succeeds; an existing non-empty destination
+requires `--force`, and unsafe root/ancestor/symlink targets are rejected.
+
+Pages are streamed to disk, decoded source retention is bounded, and metrics
+process source paths without materializing the entire source corpus. Lazy CPG
+subgraphs are documented rather than eagerly multiplied across all possible
+targets; a focused live `cpg` query remains the bounded way to obtain one graph.
+The bundle structure follows the
+[Open Knowledge Format 0.2 specification](https://github.com/GoogleCloudPlatform/knowledge-catalog/blob/main/okf/SPEC.md).
+
 ```bash
 delphi-lsp-agent query --root PATH find TCustomer
 delphi-lsp-agent query --root PATH focus TARGET_ID
@@ -330,7 +366,8 @@ outside the root workspace.
 `metrics`. For example, `delphi-lsp-agent view --layer metrics --format json`
 returns a project summary and detailed unit metric objects; `--query` filters
 units by name or path.
-`index` materializes overview, projects, and problems JSON. `skill install`
+`index` materializes overview, projects, and problems JSON. `wiki export`
+materializes the same navigational knowledge as a linked OKF Markdown bundle. `skill install`
 writes the skill; `opencode install` writes the package-named skill, Markdown
 agent, and plugin. The two deprecated write flags are harmless aliases and do
 not change user configuration.

{python_delphi_lsp-3.0.0 → python_delphi_lsp-3.1.0}/README.md

@@ -2,7 +2,7 @@
 
 `python-delphi-lsp` parses Delphi/Object Pascal, builds semantic and project
 indexes, serves LSP, and provides bounded codebase navigation for agents.
-Version 3.0.0 is authored by Dark Light and supports Windows, macOS, and Linux.
+Version 3.1.0 is authored by Dark Light and supports Windows, macOS, and Linux.
 
 ## Install and quick start
 
@@ -159,6 +159,8 @@ delphi-lsp-agent view --root PATH [--project-file FILE] --layer LAYER
                       [--workers auto|N]
 delphi-lsp-agent index --root PATH [--project-file FILE] [--out FILE]
                        [--workers auto|N]
+delphi-lsp-agent wiki export --root PATH [--project-file FILE] [--out DIRECTORY]
+                             [--workers auto|N] [--force]
 delphi-lsp-agent query --root PATH ACTION [VALUE]
                       [--project-id ID] [--detail summary|declaration|members|context|body|implementations]
                       [--relation references|callers|callees|uses|used_by|inherits|implements]
@@ -184,6 +186,40 @@ delphi-lsp-agent cache stop --root PATH
 `cache stop` outputs stop status JSON and may include warnings on stderr.
 `query` outputs Protocol v3 JSON responses and writes warnings to stderr.
 
+### Open Knowledge Format wiki export
+
+Export the complete unique knowledge represented by the layered codebase views
+as a portable Markdown wiki:
+
+```bash
+delphi-lsp-agent wiki export --root PATH --out codebase-wiki
+```
+
+When `--out` is relative, it is resolved below `--root`; the default is
+`.delphi-lsp/wiki`. The command builds the semantic index once, deep-indexes
+discovered projects, calculates workspace and unit metrics, and writes:
+
+- an OKF 0.2 root `index.md`;
+- linked project, unit, and symbol concepts;
+- declaration and implementation source fragments;
+- resolved and unresolved semantic references;
+- discovery/project problems and complete metric records;
+- Protocol v3, relation, CPG, cache, and layer-mapping reference concepts.
+
+Every non-index concept is UTF-8 Markdown with YAML frontmatter and a non-empty
+`type`. Readable filenames include a stable digest, so overloads and equal names
+from different units remain distinct even on case-insensitive filesystems.
+Output order and content are deterministic. The finished bundle replaces the
+destination only after generation succeeds; an existing non-empty destination
+requires `--force`, and unsafe root/ancestor/symlink targets are rejected.
+
+Pages are streamed to disk, decoded source retention is bounded, and metrics
+process source paths without materializing the entire source corpus. Lazy CPG
+subgraphs are documented rather than eagerly multiplied across all possible
+targets; a focused live `cpg` query remains the bounded way to obtain one graph.
+The bundle structure follows the
+[Open Knowledge Format 0.2 specification](https://github.com/GoogleCloudPlatform/knowledge-catalog/blob/main/okf/SPEC.md).
+
 ```bash
 delphi-lsp-agent query --root PATH find TCustomer
 delphi-lsp-agent query --root PATH focus TARGET_ID
@@ -290,7 +326,8 @@ outside the root workspace.
 `metrics`. For example, `delphi-lsp-agent view --layer metrics --format json`
 returns a project summary and detailed unit metric objects; `--query` filters
 units by name or path.
-`index` materializes overview, projects, and problems JSON. `skill install`
+`index` materializes overview, projects, and problems JSON. `wiki export`
+materializes the same navigational knowledge as a linked OKF Markdown bundle. `skill install`
 writes the skill; `opencode install` writes the package-named skill, Markdown
 agent, and plugin. The two deprecated write flags are harmless aliases and do
 not change user configuration.

python_delphi_lsp-3.1.0/delphi_lsp/_version.py

@@ -0,0 +1 @@
+__version__ = "3.1.0"

{python_delphi_lsp-3.0.0 → python_delphi_lsp-3.1.0}/delphi_lsp/agent_cli.py

@@ -34,6 +34,7 @@ from .agent_protocol import (
     SUPPORTED_RELATIONS,
 )
 from .agent_templates import install_opencode_support, install_skill
+from .agent_wiki import WikiExportError, export_okf_wiki
 from .parallel_outline import ParallelOutlineError, parse_worker_setting
 
 
@@ -92,6 +93,19 @@ def build_parser() -> argparse.ArgumentParser:
     index.add_argument("--workers", type=parse_worker_setting, default=0)
     index.set_defaults(func=_index)
 
+    wiki = subcommands.add_parser("wiki", help="Export a portable Markdown knowledge wiki.")
+    wiki_commands = wiki.add_subparsers(dest="wiki_command", required=True)
+    wiki_export = wiki_commands.add_parser(
+        "export",
+        help="Export all indexed codebase knowledge as an Open Knowledge Format bundle.",
+    )
+    wiki_export.add_argument("--root", type=Path, default=Path("."))
+    wiki_export.add_argument("--project-file", type=Path)
+    wiki_export.add_argument("--out", type=Path, default=Path(".delphi-lsp") / "wiki")
+    wiki_export.add_argument("--workers", type=parse_worker_setting, default=0)
+    wiki_export.add_argument("--force", action="store_true")
+    wiki_export.set_defaults(func=_wiki_export)
+
     skill = subcommands.add_parser("skill", help="Install agent skill templates.")
     skill_commands = skill.add_subparsers(dest="skill_command", required=True)
     skill_install = skill_commands.add_parser("install", help="Install .agents skill.")
@@ -288,6 +302,24 @@ def _index(args: argparse.Namespace) -> None:
     print(args.out)
 
 
+def _wiki_export(args: argparse.Namespace) -> None:
+    args.root = _workspace_root(args.root)
+    output = args.out
+    if not output.is_absolute():
+        output = args.root / output
+    try:
+        result = export_okf_wiki(
+            args.root,
+            output,
+            project_file=args.project_file,
+            workers=args.workers,
+            force=args.force,
+        )
+    except WikiExportError as error:
+        raise _CliError("wiki_export_failed", str(error)) from None
+    _write_json(result.to_mapping())
+
+
 def _skill_install(args: argparse.Namespace) -> None:
     _require_install_directory(args.target)
     try:

{python_delphi_lsp-3.0.0 → python_delphi_lsp-3.1.0}/delphi_lsp/agent_layers.py

@@ -315,7 +315,7 @@ def _symbols_payload(index: CodebaseIndex, *, query: str) -> dict[str, Any]:
             continue
         symbols.append(_symbol_item(symbol))
     symbols.sort(key=lambda item: (item["name"].casefold(), item["path"].casefold(), item["line"]))
-    return {"layer": "symbols", "root": index.root, "query": query, "items": symbols[:200]}
+    return {"layer": "symbols", "root": index.root, "query": query, "items": symbols}
 
 
 def _symbol_payload(index: CodebaseIndex, *, query: str) -> dict[str, Any]:

{python_delphi_lsp-3.0.0 → python_delphi_lsp-3.1.0}/delphi_lsp/agent_metrics.py

@@ -3,6 +3,7 @@ from __future__ import annotations
 from dataclasses import dataclass
 from dataclasses import replace
 from pathlib import Path
+from typing import Iterable
 
 from .agent_workspace import (
     AgentWorkspace,
@@ -161,6 +162,102 @@ def build_workspace_metrics(
     return metrics
 
 
+def build_path_metrics(
+    root: str | Path,
+    source_files: Iterable[str | Path],
+    *,
+    defines: Iterable[str] = (),
+    include_paths: Iterable[str | Path] = (),
+    project_name: str = "",
+    workers: int = 0,
+) -> ProjectMetrics:
+    """Analyze file paths without retaining the complete source corpus in RAM."""
+
+    root_path = Path(root).expanduser().resolve()
+    unique_paths: dict[str, Path] = {}
+    for value in source_files:
+        path = Path(value).expanduser()
+        if not path.is_absolute():
+            path = root_path / path
+        path = path.resolve()
+        unique_paths.setdefault(str(path).replace("\\", "/").casefold(), path)
+    unit_paths = [
+        path for path in unique_paths.values() if path.suffix.casefold() in {".pas", ".dpr", ".dpk"}
+    ]
+    include_files = [
+        path for path in unique_paths.values() if path.suffix.casefold() == ".inc"
+    ]
+    source_bytes = 0
+    for path in unit_paths:
+        try:
+            source_bytes += path.stat().st_size
+        except OSError:
+            continue
+    parser_mode = (
+        ParserMode.TOLERANT
+        if len(unit_paths) >= _LARGE_PROJECT_UNIT_THRESHOLD
+        or source_bytes >= _LARGE_PROJECT_BYTE_THRESHOLD
+        else ParserMode.STRICT
+    )
+    define_values = tuple(defines)
+    include_path_values = tuple(str(Path(value)) for value in include_paths)
+    analyzed_units: list[UnitMetrics] = []
+    problems: list[MetricProblem] = []
+
+    def consume_result(result: _MetricResult) -> None:
+        if result.metrics is not None:
+            analyzed_units.append(result.metrics)
+        if result.problem is not None:
+            problems.append(result.problem)
+
+    run_outline_tasks(
+        (
+            _MetricTask(
+                ordinal,
+                str(path),
+                _display_path(path, root_path),
+                "",
+                define_values,
+                include_path_values,
+                parser_mode,
+            )
+            for ordinal, path in enumerate(unit_paths)
+        ),
+        configured_workers=workers,
+        on_complete=consume_result,
+        retain_results=False,
+        task_runner=_analyze_metric_task,
+    )
+
+    include_loc = 0
+    for path in include_files:
+        try:
+            source = read_source_text(path)
+            include_loc += len(source.splitlines()) if source else 0
+        except (OSError, UnicodeError):
+            problems.append(
+                MetricProblem(
+                    kind="include_unavailable",
+                    path=_display_path(path, root_path),
+                    message="Could not read include file.",
+                )
+            )
+    metrics = aggregate_project_metrics(
+        analyzed_units,
+        include_loc=include_loc,
+        project_name=project_name,
+    )
+    if problems:
+        metrics = replace(
+            metrics,
+            problems=(
+                *metrics.problems,
+                *sorted(problems, key=lambda item: (item.path.casefold(), item.kind)),
+            ),
+        )
+    return metrics
+
+
 def project_metric_item(metrics: ProjectMetrics) -> dict[str, object]:
     return {"item_type": "project_metrics", **metrics.to_mapping()}
 
@@ -176,4 +273,16 @@ def _workspace_path(root: Path, value: str) -> Path:
     return path.resolve()
 
 
-__all__ = ["build_workspace_metrics", "project_metric_item", "unit_metric_item"]
+def _display_path(path: Path, root: Path) -> str:
+    try:
+        return path.relative_to(root).as_posix()
+    except ValueError:
+        return path.as_posix()
+
+
+__all__ = [
+    "build_path_metrics",
+    "build_workspace_metrics",
+    "project_metric_item",
+    "unit_metric_item",
+]