bigeye-cli 0.9.0__tar.gz → 0.9.2__tar.gz

bigeye_cli-0.9.0/bigeye_cli/CLI_DOCS.md → bigeye_cli-0.9.2/PKG-INFO

@@ -1,5 +1,24 @@
+Metadata-Version: 2.1
+Name: bigeye-cli
+Version: 0.9.2
+Summary: Bigeye CLI offers developer tools for maintaining your developer workspace.
+Home-page: https://docs.bigeye.com/docs
+License: Proprietary
+Author: Bigeye
+Author-email: support@bigeye.com
+Requires-Python: >=3.11.0,<4.0.0
+Classifier: License :: Other/Proprietary License
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Requires-Dist: PyGithub (>=1.59.1,<2.0.0)
+Requires-Dist: bigeye-sdk (>=0.11.17,<0.12.0)
+Requires-Dist: click (>=8.1.8,<9.0.0)
+Requires-Dist: rich (>=14.1.0,<15.0.0)
+Description-Content-Type: text/markdown
+
 # **Bigeye CLI**
-Version: 0.9.0
+Version: 0.9.2
 ## Installation
 
 **Setting up your local/build environment**  
@@ -1247,6 +1266,9 @@ $ bigeye catalog custom-repo [OPTIONS] COMMAND [ARGS]...
 * `import`: Import a custom repository from an Excel...
 * `export`: Export a custom repository to an Excel...
 * `delete`: Entirely delete a custom repository,...
+* `contents`: List the Bigeye assets (schemas, tables,...
+* `add-contents`: Add existing Bigeye assets to a custom...
+* `remove-contents`: Remove assets from a custom node (e.g.
 
 ### `bigeye catalog custom-repo init`
 
@@ -1267,7 +1289,8 @@ $ bigeye catalog custom-repo init [OPTIONS]
 
 ### `bigeye catalog custom-repo import`
 
-Import a custom repository from an Excel workbook.
+Import a custom repository from an Excel workbook, and/or add or update
+attributes on nodes already in Bigeye (by node id, catalog path, or FQN).
 
 **Usage**:
 
@@ -1282,8 +1305,8 @@ $ bigeye catalog custom-repo import [OPTIONS]
 * `-w, --workspace TEXT`: Name of the workspace configuration.  [env var: BIGEYE_WORKSPACE; default: DEFAULT]
 * `-f, --file TEXT`: Path to the custom repository .xlsx workbook.  [required]
 * `--cleanup-stale`: Delete nodes/edges present in Bigeye but missing from the sheet. Off by default.
-* `--skip-unresolved-edges / --no-skip-unresolved-edges`: Import the rest instead of aborting when some edge endpoints don&#x27;t resolve to a Bigeye node (default: on). Skipped endpoints are written to the unresolved log. Pass --no-skip-unresolved-edges to abort on any unresolved endpoint.  [default: skip-unresolved-edges]
-* `--unresolved-log TEXT`: Path for the unresolved-endpoints log. Defaults to custom_repo_unresolved.log in the current working directory.  [default: custom_repo_unresolved.log]
+* `--skip-unresolved-edges / --no-skip-unresolved-edges`: Import the rest instead of aborting when some edge endpoints or attribute IDs don&#x27;t resolve to a Bigeye node (default: on). Skipped references are written to the unresolved log. Pass --no-skip-unresolved-edges to abort on any unresolved reference.  [default: skip-unresolved-edges]
+* `--unresolved-log TEXT`: Path for the unresolved-references log. Defaults to custom_repo_unresolved.log in the current working directory.  [default: custom_repo_unresolved.log]
 * `--help`: Show this message and exit.
 
 ### `bigeye catalog custom-repo export`
@@ -1325,6 +1348,72 @@ $ bigeye catalog custom-repo delete [OPTIONS]
 * `-y, --yes`: Skip the confirmation prompt.
 * `--help`: Show this message and exit.
 
+### `bigeye catalog custom-repo contents`
+
+List the Bigeye assets (schemas, tables, files, ...) a custom node contains, such as the
+assets assigned to a CI code. Children in the repository&#x27;s own hierarchy are not listed.
+
+**Usage**:
+
+```console
+$ bigeye catalog custom-repo contents [OPTIONS]
+```
+
+**Options**:
+
+* `-b, --bigeye_conf TEXT`: Bigeye Credential File Path  [env var: BIGEYE_API_CRED_FILE]
+* `-c, --config_file TEXT`: Bigeye CLI Configuration File Path  [env var: BIGEYE_API_CONFIG_FILE]
+* `-w, --workspace TEXT`: Name of the workspace configuration.  [env var: BIGEYE_WORKSPACE; default: DEFAULT]
+* `--repo-name TEXT`: Display name of the custom repository.  [required]
+* `--node TEXT`: The repository node to work on (e.g. a CI code): its ID from the workbook&#x27;s Nodes sheet, or its display name if that is unique.  [required]
+* `--help`: Show this message and exit.
+
+### `bigeye catalog custom-repo add-contents`
+
+Add existing Bigeye assets to a custom node (e.g. assign schemas or files to a CI code) by
+creating a containment edge to each. Assets keep their catalog location and lineage.
+
+**Usage**:
+
+```console
+$ bigeye catalog custom-repo add-contents [OPTIONS]
+```
+
+**Options**:
+
+* `-b, --bigeye_conf TEXT`: Bigeye Credential File Path  [env var: BIGEYE_API_CRED_FILE]
+* `-c, --config_file TEXT`: Bigeye CLI Configuration File Path  [env var: BIGEYE_API_CONFIG_FILE]
+* `-w, --workspace TEXT`: Name of the workspace configuration.  [env var: BIGEYE_WORKSPACE; default: DEFAULT]
+* `--repo-name TEXT`: Display name of the custom repository.  [required]
+* `--node TEXT`: The repository node to work on (e.g. a CI code): its ID from the workbook&#x27;s Nodes sheet, or its display name if that is unique.  [required]
+* `-a, --asset TEXT`: An asset to add or remove: a warehouse FQN (source.schema[.table[.column]]), a catalog path (dotted, or &#x27; / &#x27;-separated as the catalog shows it), or id:&lt;lineage node id&gt;. Repeatable.
+* `--assets-file TEXT`: CSV or Excel file with one asset per row in the first column. A first row is skipped as a header only if it is one of (in any case): asset, assets, catalog path, exclude, exclude asset, exclude assets, excluded asset, excluded assets, fqn, fqns, node, node id, path. Any other first row is read as an asset.
+* `--dry-run`: Show what would change without writing.
+* `--help`: Show this message and exit.
+
+### `bigeye catalog custom-repo remove-contents`
+
+Remove assets from a custom node (e.g. unassign them from a CI code). Deletes only the
+containment edge between the node and each asset; the asset and its lineage are untouched.
+
+**Usage**:
+
+```console
+$ bigeye catalog custom-repo remove-contents [OPTIONS]
+```
+
+**Options**:
+
+* `-b, --bigeye_conf TEXT`: Bigeye Credential File Path  [env var: BIGEYE_API_CRED_FILE]
+* `-c, --config_file TEXT`: Bigeye CLI Configuration File Path  [env var: BIGEYE_API_CONFIG_FILE]
+* `-w, --workspace TEXT`: Name of the workspace configuration.  [env var: BIGEYE_WORKSPACE; default: DEFAULT]
+* `--repo-name TEXT`: Display name of the custom repository.  [required]
+* `--node TEXT`: The repository node to work on (e.g. a CI code): its ID from the workbook&#x27;s Nodes sheet, or its display name if that is unique.  [required]
+* `-a, --asset TEXT`: An asset to add or remove: a warehouse FQN (source.schema[.table[.column]]), a catalog path (dotted, or &#x27; / &#x27;-separated as the catalog shows it), or id:&lt;lineage node id&gt;. Repeatable.
+* `--assets-file TEXT`: CSV or Excel file with one asset per row in the first column. A first row is skipped as a header only if it is one of (in any case): asset, assets, catalog path, exclude, exclude asset, exclude assets, excluded asset, excluded assets, fqn, fqns, node, node id, path. Any other first row is read as an asset.
+* `--dry-run`: Show what would change without writing.
+* `--help`: Show this message and exit.
+
 # `bigeye metric`
 
 Metric Commands for Bigeye CLI
@@ -1949,7 +2038,7 @@ $ bigeye lineage export-graphs [OPTIONS]
 * `-b, --bigeye_conf TEXT`: Bigeye Credential File Path  [env var: BIGEYE_API_CRED_FILE]
 * `-c, --config_file TEXT`: Bigeye CLI Configuration File Path  [env var: BIGEYE_API_CONFIG_FILE]
 * `-w, --workspace TEXT`: Name of the workspace configuration.  [env var: BIGEYE_WORKSPACE; default: DEFAULT]
-* `--fqns-file TEXT`: Path to a CSV with a single column of fully-qualified catalog names.  [required]
+* `--fqns-file TEXT`: Path to a CSV or Excel file with a single column of fully-qualified catalog names.  [required]
 * `--direction [upstream|downstream|both]`: Direction to traverse: upstream, downstream, or both.  [default: both]
 * `--content [all|nodes|edges|attributes]`: What each per-graph report contains: all, nodes, edges, or attributes.  [default: all]
 * `--include-etl / --no-include-etl`: Include or exclude ETL operator nodes. Defaults to including them.  [default: include-etl]
@@ -1986,5 +2075,7 @@ $ bigeye lineage export-end-to-end [OPTIONS]
 * `--depth INTEGER`: Per-window traversal depth. When set, each root&#x27;s graph is fetched in bounded depth-hop windows, re-rooting at the lineage frontier until the lineage is exhausted end-to-end. This escapes the backend&#x27;s per-request depth ceiling (lineage.max_depth) that truncates a single full fetch, and keeps each request small so very large graphs don&#x27;t fail. Omit to request the graph in one call (the previous behavior, capped at the backend depth limit).
 * `--concurrency INTEGER`: Max concurrent window requests when --depth is used. Lower it to reduce client memory and server load on wide graphs. Ignored without --depth.  [default: 8]
 * `-o, --output TEXT`: Output .csv path. Defaults to end_to_end_&lt;root&gt;.csv in the current directory.
+* `--exclude-file TEXT`: CSV or Excel file listing assets to leave out of the paths, one per row in the first column. Each is a catalog path or warehouse FQN, as written in the Hop_* columns, or id:&lt;lineage node id&gt;, and also excludes everything inside it. Paths are joined across excluded assets, so A &lt;- X &lt;- B with X excluded becomes A &lt;- B. A first row is skipped as a header only if it is one of (in any case): asset, assets, catalog path, exclude, exclude asset, exclude assets, excluded asset, excluded assets, fqn, fqns, node, node id, path. Any other first row is read as an asset.
 * `--help`: Show this message and exit.
 
+

bigeye_cli-0.9.0/PKG-INFO → bigeye_cli-0.9.2/bigeye_cli/CLI_DOCS.md

@@ -1,24 +1,5 @@
-Metadata-Version: 2.1
-Name: bigeye-cli
-Version: 0.9.0
-Summary: Bigeye CLI offers developer tools for maintaining your developer workspace.
-Home-page: https://docs.bigeye.com/docs
-License: Proprietary
-Author: Bigeye
-Author-email: support@bigeye.com
-Requires-Python: >=3.11.0,<4.0.0
-Classifier: License :: Other/Proprietary License
-Classifier: Programming Language :: Python :: 3
-Classifier: Programming Language :: Python :: 3.11
-Classifier: Programming Language :: Python :: 3.12
-Requires-Dist: PyGithub (>=1.59.1,<2.0.0)
-Requires-Dist: bigeye-sdk (>=0.11.15,<0.12.0)
-Requires-Dist: click (>=8.1.8,<9.0.0)
-Requires-Dist: rich (>=14.1.0,<15.0.0)
-Description-Content-Type: text/markdown
-
 # **Bigeye CLI**
-Version: 0.9.0
+Version: 0.9.2
 ## Installation
 
 **Setting up your local/build environment**  
@@ -1266,6 +1247,9 @@ $ bigeye catalog custom-repo [OPTIONS] COMMAND [ARGS]...
 * `import`: Import a custom repository from an Excel...
 * `export`: Export a custom repository to an Excel...
 * `delete`: Entirely delete a custom repository,...
+* `contents`: List the Bigeye assets (schemas, tables,...
+* `add-contents`: Add existing Bigeye assets to a custom...
+* `remove-contents`: Remove assets from a custom node (e.g.
 
 ### `bigeye catalog custom-repo init`
 
@@ -1286,7 +1270,8 @@ $ bigeye catalog custom-repo init [OPTIONS]
 
 ### `bigeye catalog custom-repo import`
 
-Import a custom repository from an Excel workbook.
+Import a custom repository from an Excel workbook, and/or add or update
+attributes on nodes already in Bigeye (by node id, catalog path, or FQN).
 
 **Usage**:
 
@@ -1301,8 +1286,8 @@ $ bigeye catalog custom-repo import [OPTIONS]
 * `-w, --workspace TEXT`: Name of the workspace configuration.  [env var: BIGEYE_WORKSPACE; default: DEFAULT]
 * `-f, --file TEXT`: Path to the custom repository .xlsx workbook.  [required]
 * `--cleanup-stale`: Delete nodes/edges present in Bigeye but missing from the sheet. Off by default.
-* `--skip-unresolved-edges / --no-skip-unresolved-edges`: Import the rest instead of aborting when some edge endpoints don&#x27;t resolve to a Bigeye node (default: on). Skipped endpoints are written to the unresolved log. Pass --no-skip-unresolved-edges to abort on any unresolved endpoint.  [default: skip-unresolved-edges]
-* `--unresolved-log TEXT`: Path for the unresolved-endpoints log. Defaults to custom_repo_unresolved.log in the current working directory.  [default: custom_repo_unresolved.log]
+* `--skip-unresolved-edges / --no-skip-unresolved-edges`: Import the rest instead of aborting when some edge endpoints or attribute IDs don&#x27;t resolve to a Bigeye node (default: on). Skipped references are written to the unresolved log. Pass --no-skip-unresolved-edges to abort on any unresolved reference.  [default: skip-unresolved-edges]
+* `--unresolved-log TEXT`: Path for the unresolved-references log. Defaults to custom_repo_unresolved.log in the current working directory.  [default: custom_repo_unresolved.log]
 * `--help`: Show this message and exit.
 
 ### `bigeye catalog custom-repo export`
@@ -1344,6 +1329,72 @@ $ bigeye catalog custom-repo delete [OPTIONS]
 * `-y, --yes`: Skip the confirmation prompt.
 * `--help`: Show this message and exit.
 
+### `bigeye catalog custom-repo contents`
+
+List the Bigeye assets (schemas, tables, files, ...) a custom node contains, such as the
+assets assigned to a CI code. Children in the repository&#x27;s own hierarchy are not listed.
+
+**Usage**:
+
+```console
+$ bigeye catalog custom-repo contents [OPTIONS]
+```
+
+**Options**:
+
+* `-b, --bigeye_conf TEXT`: Bigeye Credential File Path  [env var: BIGEYE_API_CRED_FILE]
+* `-c, --config_file TEXT`: Bigeye CLI Configuration File Path  [env var: BIGEYE_API_CONFIG_FILE]
+* `-w, --workspace TEXT`: Name of the workspace configuration.  [env var: BIGEYE_WORKSPACE; default: DEFAULT]
+* `--repo-name TEXT`: Display name of the custom repository.  [required]
+* `--node TEXT`: The repository node to work on (e.g. a CI code): its ID from the workbook&#x27;s Nodes sheet, or its display name if that is unique.  [required]
+* `--help`: Show this message and exit.
+
+### `bigeye catalog custom-repo add-contents`
+
+Add existing Bigeye assets to a custom node (e.g. assign schemas or files to a CI code) by
+creating a containment edge to each. Assets keep their catalog location and lineage.
+
+**Usage**:
+
+```console
+$ bigeye catalog custom-repo add-contents [OPTIONS]
+```
+
+**Options**:
+
+* `-b, --bigeye_conf TEXT`: Bigeye Credential File Path  [env var: BIGEYE_API_CRED_FILE]
+* `-c, --config_file TEXT`: Bigeye CLI Configuration File Path  [env var: BIGEYE_API_CONFIG_FILE]
+* `-w, --workspace TEXT`: Name of the workspace configuration.  [env var: BIGEYE_WORKSPACE; default: DEFAULT]
+* `--repo-name TEXT`: Display name of the custom repository.  [required]
+* `--node TEXT`: The repository node to work on (e.g. a CI code): its ID from the workbook&#x27;s Nodes sheet, or its display name if that is unique.  [required]
+* `-a, --asset TEXT`: An asset to add or remove: a warehouse FQN (source.schema[.table[.column]]), a catalog path (dotted, or &#x27; / &#x27;-separated as the catalog shows it), or id:&lt;lineage node id&gt;. Repeatable.
+* `--assets-file TEXT`: CSV or Excel file with one asset per row in the first column. A first row is skipped as a header only if it is one of (in any case): asset, assets, catalog path, exclude, exclude asset, exclude assets, excluded asset, excluded assets, fqn, fqns, node, node id, path. Any other first row is read as an asset.
+* `--dry-run`: Show what would change without writing.
+* `--help`: Show this message and exit.
+
+### `bigeye catalog custom-repo remove-contents`
+
+Remove assets from a custom node (e.g. unassign them from a CI code). Deletes only the
+containment edge between the node and each asset; the asset and its lineage are untouched.
+
+**Usage**:
+
+```console
+$ bigeye catalog custom-repo remove-contents [OPTIONS]
+```
+
+**Options**:
+
+* `-b, --bigeye_conf TEXT`: Bigeye Credential File Path  [env var: BIGEYE_API_CRED_FILE]
+* `-c, --config_file TEXT`: Bigeye CLI Configuration File Path  [env var: BIGEYE_API_CONFIG_FILE]
+* `-w, --workspace TEXT`: Name of the workspace configuration.  [env var: BIGEYE_WORKSPACE; default: DEFAULT]
+* `--repo-name TEXT`: Display name of the custom repository.  [required]
+* `--node TEXT`: The repository node to work on (e.g. a CI code): its ID from the workbook&#x27;s Nodes sheet, or its display name if that is unique.  [required]
+* `-a, --asset TEXT`: An asset to add or remove: a warehouse FQN (source.schema[.table[.column]]), a catalog path (dotted, or &#x27; / &#x27;-separated as the catalog shows it), or id:&lt;lineage node id&gt;. Repeatable.
+* `--assets-file TEXT`: CSV or Excel file with one asset per row in the first column. A first row is skipped as a header only if it is one of (in any case): asset, assets, catalog path, exclude, exclude asset, exclude assets, excluded asset, excluded assets, fqn, fqns, node, node id, path. Any other first row is read as an asset.
+* `--dry-run`: Show what would change without writing.
+* `--help`: Show this message and exit.
+
 # `bigeye metric`
 
 Metric Commands for Bigeye CLI
@@ -1968,7 +2019,7 @@ $ bigeye lineage export-graphs [OPTIONS]
 * `-b, --bigeye_conf TEXT`: Bigeye Credential File Path  [env var: BIGEYE_API_CRED_FILE]
 * `-c, --config_file TEXT`: Bigeye CLI Configuration File Path  [env var: BIGEYE_API_CONFIG_FILE]
 * `-w, --workspace TEXT`: Name of the workspace configuration.  [env var: BIGEYE_WORKSPACE; default: DEFAULT]
-* `--fqns-file TEXT`: Path to a CSV with a single column of fully-qualified catalog names.  [required]
+* `--fqns-file TEXT`: Path to a CSV or Excel file with a single column of fully-qualified catalog names.  [required]
 * `--direction [upstream|downstream|both]`: Direction to traverse: upstream, downstream, or both.  [default: both]
 * `--content [all|nodes|edges|attributes]`: What each per-graph report contains: all, nodes, edges, or attributes.  [default: all]
 * `--include-etl / --no-include-etl`: Include or exclude ETL operator nodes. Defaults to including them.  [default: include-etl]
@@ -2005,6 +2056,6 @@ $ bigeye lineage export-end-to-end [OPTIONS]
 * `--depth INTEGER`: Per-window traversal depth. When set, each root&#x27;s graph is fetched in bounded depth-hop windows, re-rooting at the lineage frontier until the lineage is exhausted end-to-end. This escapes the backend&#x27;s per-request depth ceiling (lineage.max_depth) that truncates a single full fetch, and keeps each request small so very large graphs don&#x27;t fail. Omit to request the graph in one call (the previous behavior, capped at the backend depth limit).
 * `--concurrency INTEGER`: Max concurrent window requests when --depth is used. Lower it to reduce client memory and server load on wide graphs. Ignored without --depth.  [default: 8]
 * `-o, --output TEXT`: Output .csv path. Defaults to end_to_end_&lt;root&gt;.csv in the current directory.
+* `--exclude-file TEXT`: CSV or Excel file listing assets to leave out of the paths, one per row in the first column. Each is a catalog path or warehouse FQN, as written in the Hop_* columns, or id:&lt;lineage node id&gt;, and also excludes everything inside it. Paths are joined across excluded assets, so A &lt;- X &lt;- B with X excluded becomes A &lt;- B. A first row is skipped as a header only if it is one of (in any case): asset, assets, catalog path, exclude, exclude asset, exclude assets, excluded asset, excluded assets, fqn, fqns, node, node id, path. Any other first row is read as an asset.
 * `--help`: Show this message and exit.
 
-

bigeye_cli-0.9.2/bigeye_cli/catalog/custom_repo_commands.py

@@ -0,0 +1,342 @@
+import os
+from datetime import datetime
+from typing import List, Optional
+
+import typer
+
+from bigeye_cli import global_options
+from bigeye_cli.catalog import custom_repo_options
+from bigeye_cli.functions import change_node_contents, cli_client_factory, contained_asset_path, contained_asset_type
+from bigeye_sdk.controller.custom_repository_controller import CustomRepositoryController
+from bigeye_sdk.log import get_logger
+from bigeye_sdk.model.custom_repository_excel import (
+    CustomRepoWorkbook,
+    WorkbookValidationError,
+    build_config,
+    collect_node_attribute_updates,
+    find_resolved_conflicts,
+    read_workbook,
+    validate_workbook,
+    workbook_defines_repository,
+    write_workbook,
+)
+
+log = get_logger(__file__)
+
+app = typer.Typer(
+    no_args_is_help=True,
+    help="Import and export custom repositories as Excel (.xlsx) workbooks.",
+)
+
+
+def _print_errors(header: str, errors: List[WorkbookValidationError]) -> None:
+    typer.echo(f"{header} with {len(errors)} error(s):", err=True)
+    for error in errors:
+        typer.echo(f"  {error.format()}", err=True)
+
+
+def _write_unresolved_log(
+    log_path: str, repo_name: str, unresolved: List[WorkbookValidationError]
+) -> bool:
+    """Write a log file naming the edge endpoints and attribute IDs that could not be
+    resolved to a unique Bigeye node — either no match (the object or node id does
+    not exist) or more than one match (ambiguous). Best-effort: returns False and
+    warns if the file cannot be written (the same references are also printed to
+    stderr).
+
+    Each reference is a catalog path 'Repo.schema.table.column', a warehouse FQN,
+    or a lineage node id.
+    """
+    lines = [
+        "Custom repository import — unresolved references",
+        f"Repository: {repo_name or '(none — attributes only)'}",
+        f"Generated:  {datetime.now().isoformat(timespec='seconds')}",
+        f"Count:      {len(unresolved)}",
+        "",
+        "These references could not be resolved to a unique Bigeye node (no match, or",
+        "more than one), so the edges and attributes referencing them were skipped.",
+        "Each line below states the sheet, the reason, and the reference value.",
+        "",
+    ]
+    lines.extend(error.format() for error in unresolved)
+    try:
+        with open(log_path, "w") as f:
+            f.write("\n".join(lines) + "\n")
+        return True
+    except OSError as e:
+        typer.echo(f"Warning: could not write unresolved log to '{log_path}': {e}", err=True)
+        return False
+
+
+@app.command(name="init")
+def init_repo(
+    output: str = typer.Option(
+        "custom_repo_template.xlsx",
+        "--output",
+        "-o",
+        help="Output .xlsx path for the blank template.",
+    ),
+    force: bool = typer.Option(
+        False,
+        "--force",
+        help="Overwrite the output file if it already exists.",
+    ),
+):
+    """Generate a blank custom repository workbook (branded, with the Instructions
+    sheet and dropdowns) for you to populate, then import with `custom-repo import`."""
+    if os.path.exists(output) and not force:
+        typer.echo(
+            f"'{output}' already exists. Choose a different --output or pass --force to overwrite.",
+            err=True,
+        )
+        raise typer.Exit(code=1)
+
+    write_workbook(CustomRepoWorkbook(repo_name=""), output)
+    log.info(f"Wrote blank custom repository template to {output}")
+
+
+@app.command(name="import")
+def import_repo(
+    bigeye_conf: str = global_options.bigeye_conf,
+    config_file: str = global_options.config_file,
+    workspace: str = global_options.workspace,
+    file: str = typer.Option(
+        ..., "--file", "-f", help="Path to the custom repository .xlsx workbook."
+    ),
+    cleanup_stale: bool = typer.Option(
+        False,
+        "--cleanup-stale",
+        help="Delete nodes/edges present in Bigeye but missing from the sheet. Off by default.",
+    ),
+    skip_unresolved_edges: bool = typer.Option(
+        True,
+        "--skip-unresolved-edges/--no-skip-unresolved-edges",
+        help="Import the rest instead of aborting when some edge endpoints or attribute "
+        "IDs don't resolve to a Bigeye node (default: on). Skipped references are written "
+        "to the unresolved log. Pass --no-skip-unresolved-edges to abort on any "
+        "unresolved reference.",
+    ),
+    unresolved_log: str = typer.Option(
+        "custom_repo_unresolved.log",
+        "--unresolved-log",
+        help="Path for the unresolved-references log. Defaults to "
+        "custom_repo_unresolved.log in the current working directory.",
+    ),
+):
+    """Import a custom repository from an Excel workbook, and/or add or update
+    attributes on nodes already in Bigeye (by node id, catalog path, or FQN)."""
+    client = cli_client_factory(bigeye_conf, config_file, workspace)
+    controller = CustomRepositoryController(client)
+
+    try:
+        wb = read_workbook(file)
+    except (FileNotFoundError, ValueError) as e:
+        typer.echo(f"Could not read workbook '{file}': {e}", err=True)
+        raise typer.Exit(code=1)
+
+    validation_errors = validate_workbook(wb)
+    if validation_errors:
+        _print_errors("Import validation failed", validation_errors)
+        raise typer.Exit(code=1)
+
+    defines_repository = workbook_defines_repository(wb)
+    if cleanup_stale and not defines_repository:
+        typer.echo(
+            "--cleanup-stale needs a repository (Hierarchy and Nodes sheets); this workbook "
+            "only updates attributes on existing nodes.",
+            err=True,
+        )
+        raise typer.Exit(code=1)
+
+    path_node_ids, unresolved, lookup_failures = controller.resolve_workbook_references(wb)
+    conflicts = find_resolved_conflicts(wb, path_node_ids)
+    if conflicts:
+        _print_errors("Import validation failed", conflicts)
+        raise typer.Exit(code=1)
+    if unresolved:
+        log_written = _write_unresolved_log(unresolved_log, wb.repo_name, unresolved)
+        _print_errors("Could not resolve all catalog path references", unresolved)
+        log_hint = f" (see '{unresolved_log}')" if log_written else ""
+        if not skip_unresolved_edges:
+            typer.echo(
+                f"{len(unresolved)} unresolved reference(s){log_hint}. "
+                f"Re-run with --skip-unresolved-edges to import the rest.",
+                err=True,
+            )
+            raise typer.Exit(code=1)
+        typer.echo(
+            f"Skipping {len(unresolved)} unresolvable reference(s){log_hint} "
+            f"and importing the rest.",
+            err=True,
+        )
+
+    if defines_repository:
+        config = build_config(
+            wb,
+            path_node_ids=path_node_ids,
+            cleanup_stale=cleanup_stale,
+            drop_unresolved_edges=skip_unresolved_edges,
+        )
+        result = controller.sync_from_config(config, wait_for_completion=True)
+
+        log.info(
+            f"Sync complete for '{wb.repo_name}': {result.nodes_synced} nodes, "
+            f"{result.edges_synced} edges submitted."
+        )
+        if result.edges_dropped:
+            log.warning(f"{result.edges_dropped} edge(s) dropped during sync:")
+            for reason in result.dropped_edge_reasons:
+                log.warning(f"  - {reason}")
+
+    attribute_updates = collect_node_attribute_updates(wb, path_node_ids)
+    attribute_failures = 0
+    if attribute_updates:
+        attribute_result = controller.apply_node_attributes(attribute_updates)
+        log.info(
+            f"Attributes updated on {attribute_result.nodes_updated} existing node(s) "
+            f"({attribute_result.attributes_changed} attribute value(s) changed); "
+            f"{attribute_result.nodes_unchanged} already up to date."
+        )
+        attribute_failures = len(attribute_result.failures)
+        if attribute_failures:
+            typer.echo(f"Could not update attributes on {attribute_failures} node(s):", err=True)
+            for node_id, reason in sorted(attribute_result.failures.items()):
+                typer.echo(f"  node_id {node_id}: {reason}", err=True)
+
+    if lookup_failures:
+        typer.echo(
+            f"{lookup_failures} reference(s) were skipped because their node could not be read; "
+            f"re-run the import to retry them.",
+            err=True,
+        )
+    if attribute_failures or lookup_failures:
+        raise typer.Exit(code=1)
+
+
+@app.command(name="export")
+def export_repo(
+    bigeye_conf: str = global_options.bigeye_conf,
+    config_file: str = global_options.config_file,
+    workspace: str = global_options.workspace,
+    repo_name: str = typer.Option(
+        ..., "--repo-name", help="Display name of the custom repository to export."
+    ),
+    output: Optional[str] = typer.Option(
+        None,
+        "--output",
+        "-o",
+        help="Output .xlsx path. Defaults to <repo-name>.xlsx in the current directory.",
+    ),
+):
+    """Export a custom repository to an Excel workbook."""
+    client = cli_client_factory(bigeye_conf, config_file, workspace)
+    controller = CustomRepositoryController(client)
+
+    try:
+        wb = controller.export_repository(repo_name)
+    except ValueError as e:
+        typer.echo(str(e), err=True)
+        raise typer.Exit(code=1)
+
+    output_path = output or f"{repo_name}.xlsx"
+    write_workbook(wb, output_path)
+    log.info(
+        f"Exported repository '{repo_name}' to {output_path} "
+        f"({len(wb.nodes)} nodes, {len(wb.edges)} edges)."
+    )
+
+
+@app.command(name="delete")
+def delete_repo(
+    bigeye_conf: str = global_options.bigeye_conf,
+    config_file: str = global_options.config_file,
+    workspace: str = global_options.workspace,
+    repo_name: str = typer.Option(
+        ..., "--repo-name", help="Display name of the custom repository to delete."
+    ),
+    yes: bool = typer.Option(
+        False,
+        "--yes",
+        "-y",
+        help="Skip the confirmation prompt.",
+    ),
+):
+    """Entirely delete a custom repository, including its nodes, edges, node types,
+    and integration type."""
+    client = cli_client_factory(bigeye_conf, config_file, workspace)
+    controller = CustomRepositoryController(client)
+
+    if not yes:
+        typer.confirm(
+            f"Permanently delete custom repository '{repo_name}' and all its nodes, "
+            f"edges, node types, and integration type?",
+            abort=True,
+        )
+
+    try:
+        result = controller.delete_repository(repo_name)
+    except ValueError as e:
+        typer.echo(str(e), err=True)
+        raise typer.Exit(code=1)
+
+    summary = f"Deleted custom repository '{result.repository_name}' (id {result.repository_id})"
+    if result.integration_type_deleted:
+        summary += f", its integration type, and {result.node_types_deleted} node type(s)"
+    else:
+        summary += " (integration type retained — shared by another repository)"
+    log.info(summary + ".")
+
+
+@app.command(name="contents")
+def node_contents(
+    bigeye_conf: str = global_options.bigeye_conf,
+    config_file: str = global_options.config_file,
+    workspace: str = global_options.workspace,
+    repo_name: str = custom_repo_options.repo_name,
+    node: str = custom_repo_options.node,
+):
+    """List the Bigeye assets (schemas, tables, files, ...) a custom node contains, such as the
+    assets assigned to a CI code. Children in the repository's own hierarchy are not listed."""
+    client = cli_client_factory(bigeye_conf, config_file, workspace)
+    controller = CustomRepositoryController(client)
+    try:
+        data_node, contents = controller.list_node_contents(repo_name, node)
+    except ValueError as e:
+        typer.echo(str(e), err=True)
+        raise typer.Exit(code=1)
+
+    typer.echo(f"{data_node.node_name} (node {data_node.id}) contains {len(contents)} asset(s):")
+    for child in sorted(contents, key=contained_asset_path):
+        typer.echo(f"  id:{child.id}\t{contained_asset_type(child)}\t{contained_asset_path(child)}")
+
+
+@app.command(name="add-contents")
+def add_node_contents(
+    bigeye_conf: str = global_options.bigeye_conf,
+    config_file: str = global_options.config_file,
+    workspace: str = global_options.workspace,
+    repo_name: str = custom_repo_options.repo_name,
+    node: str = custom_repo_options.node,
+    asset: Optional[List[str]] = custom_repo_options.asset,
+    assets_file: Optional[str] = custom_repo_options.assets_file,
+    dry_run: bool = custom_repo_options.dry_run,
+):
+    """Add existing Bigeye assets to a custom node (e.g. assign schemas or files to a CI code) by
+    creating a containment edge to each. Assets keep their catalog location and lineage."""
+    change_node_contents(bigeye_conf, config_file, workspace, repo_name, node, asset, assets_file, dry_run, add=True)
+
+
+@app.command(name="remove-contents")
+def remove_node_contents(
+    bigeye_conf: str = global_options.bigeye_conf,
+    config_file: str = global_options.config_file,
+    workspace: str = global_options.workspace,
+    repo_name: str = custom_repo_options.repo_name,
+    node: str = custom_repo_options.node,
+    asset: Optional[List[str]] = custom_repo_options.asset,
+    assets_file: Optional[str] = custom_repo_options.assets_file,
+    dry_run: bool = custom_repo_options.dry_run,
+):
+    """Remove assets from a custom node (e.g. unassign them from a CI code). Deletes only the
+    containment edge between the node and each asset; the asset and its lineage are untouched."""
+    change_node_contents(bigeye_conf, config_file, workspace, repo_name, node, asset, assets_file, dry_run, add=False)

bigeye_cli-0.9.2/bigeye_cli/catalog/custom_repo_options.py

@@ -0,0 +1,35 @@
+from typing import List, Optional
+
+import typer
+
+from bigeye_cli.functions import ASSET_LIST_HEADER_HELP
+
+repo_name: str = typer.Option(
+    ...
+    , "--repo-name"
+    , help="Display name of the custom repository."
+)
+node: str = typer.Option(
+    ...
+    , "--node"
+    , help="The repository node to work on (e.g. a CI code): its ID from the workbook's Nodes sheet, "
+           "or its display name if that is unique."
+)
+asset: Optional[List[str]] = typer.Option(
+    None
+    , "--asset"
+    , "-a"
+    , help="An asset to add or remove: a warehouse FQN (source.[database.]schema[.table[.column]]), a "
+           "catalog path (dotted, or ' / '-separated as the catalog shows it), or id:<lineage node id>. "
+           "Repeatable."
+)
+assets_file: Optional[str] = typer.Option(
+    None
+    , "--assets-file"
+    , help="CSV or Excel file with one asset per row in the first column. " + ASSET_LIST_HEADER_HELP
+)
+dry_run: bool = typer.Option(
+    False
+    , "--dry-run"
+    , help="Show what would change without writing."
+)

{bigeye_cli-0.9.0 → bigeye_cli-0.9.2}/bigeye_cli/functions.py

@@ -14,7 +14,7 @@ from bigeye_sdk.client.datawatch_client import DatawatchClient, datawatch_client
     get_all_workspaces_for_login, get_allowed_emails_for_workspace
 from bigeye_sdk.functions.metric_functions import get_file_name_for_metric
 from bigeye_sdk.functions.file_functs import create_subdir_if_not_exists, serialize_listdict_to_json_file, \
-    write_to_file, serialize_list_to_json_file
+    write_to_file, serialize_list_to_json_file, read_column
 from bigeye_sdk.functions.helpers import str_to_bool
 from bigeye_sdk.log import get_logger
 from bigeye_sdk.authentication.api_authentication import ApiAuth
@@ -22,6 +22,12 @@ from bigeye_sdk.authentication.config import Config, WorkspaceConfig
 from bigeye_sdk.exceptions.exceptions import WorkspaceNotSetException, ConfigNotFoundException
 from bigeye_sdk.generated.com.bigeye.models.generated import MetricInfoList, Table, Issue, MetricTemplate, \
     WorkspaceIdNameAndRole, NamedSchedule, VirtualTable
+from bigeye_sdk.controller.custom_repository_controller import CustomRepositoryController
+from bigeye_sdk.generated.com.bigeye.models.generated import LineageNodeV2
+from bigeye_sdk.model.custom_repository_excel import format_name_path
+from bigeye_sdk.model.custom_repository_models import NodeContentsResult
+from bigeye_sdk.model.enums import ContentsChangeStatus
+from bigeye_sdk.model.lineage_end_to_end import WAREHOUSE_NODE_TYPES, data_node_type
 from bigeye_sdk.model.protobuf_enum_facade import SimpleMetricTemplateParameterType, SimpleFieldType
 from bigeye_sdk.model.protobuf_extensions import MetricDebugQueries
 
@@ -341,3 +347,96 @@ def __str_presenter(dumper, data):
         data = "\n".join([line.rstrip() for line in data.splitlines()])
         return dumper.represent_scalar('tag:yaml.org,2002:str', data, style='|')
     return dumper.represent_scalar('tag:yaml.org,2002:str', data)
+
+
+ASSET_FILE_HEADER_NAMES = frozenset({
+    "asset", "assets", "exclude", "exclude asset", "exclude assets", "excluded asset", "excluded assets",
+    "fqn", "fqns", "path", "catalog path", "node", "node id",
+})
+ASSET_LIST_HEADER_HELP = (
+    "A first row is skipped as a header only if it is one of (in any case): "
+    + ", ".join(sorted(ASSET_FILE_HEADER_NAMES))
+    + ". Any other first row is read as an asset."
+)
+
+
+def read_asset_file(path: str) -> List[str]:
+    """The assets listed in the first column of a CSV or Excel file, deduplicated, header row skipped."""
+    return list(dict.fromkeys(read_column(path, header_names=ASSET_FILE_HEADER_NAMES)))
+
+
+def collect_assets(assets: Optional[List[str]], assets_file: Optional[str]) -> List[str]:
+    """Assets named with --asset plus those listed in --assets-file; ``ValueError`` if the file can't
+    be read or no asset is named at all."""
+    collected = list(assets or [])
+    if assets_file:
+        try:
+            collected.extend(read_asset_file(assets_file))
+        except (OSError, ValueError) as e:
+            raise ValueError(f"Could not read --assets-file '{assets_file}': {e}") from e
+    if not collected:
+        raise ValueError("Name at least one asset with --asset or --assets-file.")
+    return collected
+
+
+def contained_asset_type(node: LineageNodeV2) -> str:
+    """A contained asset's node type without its DATA_NODE_TYPE_ prefix (UNSPECIFIED when unset)."""
+    return data_node_type(node).name.replace("DATA_NODE_TYPE_", "")
+
+
+def contained_asset_path(node: LineageNodeV2) -> str:
+    """A contained asset as add/remove-contents accepts it: a dotted FQN for warehouse objects, else
+    its ' / ' catalog path, falling back to the node name or ``id:<node id>``."""
+    parts = list(node.catalog_path.path_parts) if node.catalog_path else []
+    if not parts:
+        return node.node_name or f"id:{node.id}"
+    return ".".join(parts) if data_node_type(node) in WAREHOUSE_NODE_TYPES else format_name_path(parts)
+
+
+def node_contents_report(result: NodeContentsResult, dry_run: bool) -> List[str]:
+    """One line per asset of an add/remove-contents run, then a status summary for the node."""
+    lines = []
+    counts: Dict[str, int] = {}
+    for change in result.changes:
+        node_ref = f" (id:{change.node_id})" if change.node_id else ""
+        detail = f": {change.detail}" if change.detail else ""
+        lines.append(f"  {change.status.value:<24} {change.asset}{node_ref}{detail}")
+        counts[change.status.value] = counts.get(change.status.value, 0) + 1
+    summary = ", ".join(f"{n} {status}" for status, n in counts.items())
+    lines.append(f"{result.node_name} (node {result.node_id}): {summary}.")
+    pending = (ContentsChangeStatus.WOULD_ADD, ContentsChangeStatus.WOULD_REMOVE)
+    if dry_run and any(c.status in pending for c in result.changes):
+        lines.append("Dry run: nothing was changed. Re-run without --dry-run to apply.")
+    return lines
+
+
+def change_node_contents(
+        bigeye_conf: str,
+        config_file: str,
+        workspace: str,
+        repo_name: str,
+        node: str,
+        asset: Optional[List[str]],
+        assets_file: Optional[str],
+        dry_run: bool,
+        add: bool,
+) -> None:
+    """Run `catalog custom-repo add-contents` (``add=True``) or `remove-contents`, print the report, and
+    exit 1 if any asset failed or the change did not read back."""
+    try:
+        assets = collect_assets(asset, assets_file)
+        controller = CustomRepositoryController(cli_client_factory(bigeye_conf, config_file, workspace))
+        update = controller.add_node_contents if add else controller.remove_node_contents
+        result = update(repo_name, node, assets, dry_run=dry_run)
+    except ValueError as e:
+        typer.echo(str(e), err=True)
+        raise typer.Exit(code=1)
+    typer.echo("\n".join(node_contents_report(result, dry_run)))
+    if not result.verified:
+        typer.echo(
+            f"Some changes did not read back as expected; check with `bigeye catalog custom-repo contents "
+            f"--repo-name \"{repo_name}\" --node \"{node}\"`.",
+            err=True,
+        )
+    if result.failed:
+        raise typer.Exit(code=1)

{bigeye_cli-0.9.0 → bigeye_cli-0.9.2}/bigeye_cli/lineage/lineage_commands.py

@@ -5,7 +5,7 @@ import typer
 
 
 from bigeye_cli.exceptions.exceptions import InvalidEntityException
-from bigeye_cli.functions import cli_client_factory
+from bigeye_cli.functions import ASSET_LIST_HEADER_HELP, cli_client_factory, read_asset_file
 from bigeye_cli import global_options
 from bigeye_sdk.controller.lineage_controller import LineageController
 from bigeye_sdk.controller.lineage_custom_reporting_controller import LineageCustomReporting
@@ -14,6 +14,7 @@ from bigeye_sdk.log import get_logger
 from bigeye_sdk.model.lineage_facade import LineageConfigurationFile, SimpleLineageConfigurationFile, \
     LineageColumnOverride
 from bigeye_sdk.model.lineage_end_to_end import (
+    AssetExclusions,
     DEFAULT_MAX_PATHS,
     EndToEndDirection,
     Granularity,
@@ -229,7 +230,7 @@ def export_graphs(
         fqns_file: str = typer.Option(
             ...,
             "--fqns-file",
-            help="Path to a CSV with a single column of fully-qualified catalog names.",
+            help="Path to a CSV or Excel file with a single column of fully-qualified catalog names.",
         ),
         direction: GraphDirection = typer.Option(
             GraphDirection.BOTH,
@@ -285,7 +286,7 @@ def export_graphs(
 
     try:
         specs = read_fqns_file(fqns_file)
-    except OSError as e:
+    except (OSError, ValueError) as e:
         typer.echo(f"Could not read FQNs file '{fqns_file}': {e}", err=True)
         raise typer.Exit(code=1)
 
@@ -375,6 +376,15 @@ def export_end_to_end(
             "-o",
             help="Output .csv path. Defaults to end_to_end_<root>.csv in the current directory.",
         ),
+        exclude_file: Optional[str] = typer.Option(
+            None,
+            "--exclude-file",
+            help="CSV or Excel file listing assets to leave out of the paths, one per row in the first "
+                 "column. Each is a catalog path or warehouse FQN, as written in the Hop_* columns, or "
+                 "id:<lineage node id>, and also excludes everything inside it. Paths are joined across "
+                 "excluded assets, so A <- X <- B with X excluded becomes A <- B. "
+                 + ASSET_LIST_HEADER_HELP,
+        ),
 ):
     """Export complete end-to-end lineage paths for one or more roots into a CSV.
 
@@ -387,6 +397,14 @@ def export_end_to_end(
         typer.echo("--depth must be a positive integer (1 or greater).", err=True)
         raise typer.Exit(code=1)
 
+    exclusions: Optional[AssetExclusions] = None
+    if exclude_file:
+        try:
+            exclusions = AssetExclusions(read_asset_file(exclude_file))
+        except (OSError, ValueError) as e:
+            typer.echo(f"Could not read --exclude-file '{exclude_file}': {e}", err=True)
+            raise typer.Exit(code=1)
+
     client = cli_client_factory(bigeye_conf, config_file, workspace)
     controller = LineageCustomReporting(client)
 
@@ -400,6 +418,7 @@ def export_end_to_end(
         depth=depth,
         concurrency=concurrency,
         include_etl=include_etl,
+        exclusions=exclusions,
     )
 
     log.info(
@@ -408,3 +427,15 @@ def export_end_to_end(
     )
     for result in summary.failed:
         log.warning(f"  {result.root}: {result.error}")
+    removed = {entry: count for entry, count in summary.exclusion_counts.items() if count}
+    if removed:
+        log.info("Excluded assets (lineage nodes removed from the paths):")
+        for entry, count in removed.items():
+            log.info(f"  {entry}: {count}")
+    if summary.unmatched_exclusions:
+        log.warning(
+            f"{len(summary.unmatched_exclusions)} excluded asset(s) matched nothing in the traced lineage; "
+            f"check their spelling against the Hop_* values:"
+        )
+        for entry in summary.unmatched_exclusions:
+            log.warning(f"  {entry}")

{bigeye_cli-0.9.0 → bigeye_cli-0.9.2}/pyproject.toml

@@ -1,6 +1,6 @@
 [tool.poetry]
 name = "bigeye-cli"
-version = "0.9.0"
+version = "0.9.2"
 description = "Bigeye CLI offers developer tools for maintaining your developer workspace."
 license = "Proprietary"
 authors = ["Bigeye <support@bigeye.com>"]
@@ -19,7 +19,7 @@ bigeye = "bigeye_cli.__main__:app"
 [tool.poetry.dependencies]
 python = "^3.11.0"
 click = "^8.1.8"
-bigeye-sdk = "^0.11.15"
+bigeye-sdk = "^0.11.17"
 rich = "^14.1.0"
 PyGithub = '^1.59.1'
 

bigeye_cli-0.9.0/bigeye_cli/catalog/custom_repo_commands.py

@@ -1,275 +0,0 @@
-import os
-from datetime import datetime
-from typing import Dict, List, Optional, Tuple
-
-import typer
-
-from bigeye_cli import global_options
-from bigeye_cli.functions import cli_client_factory
-from bigeye_sdk.controller.custom_repository_controller import CustomRepositoryController
-from bigeye_sdk.log import get_logger
-from bigeye_sdk.model.custom_repository_excel import (
-    SHEET_EDGES,
-    CustomRepoWorkbook,
-    WorkbookValidationError,
-    build_config,
-    iter_path_endpoints,
-    read_workbook,
-    validate_workbook,
-    write_workbook,
-)
-
-log = get_logger(__file__)
-
-app = typer.Typer(
-    no_args_is_help=True,
-    help="Import and export custom repositories as Excel (.xlsx) workbooks.",
-)
-
-
-def _print_errors(header: str, errors: List[WorkbookValidationError]) -> None:
-    typer.echo(f"{header} with {len(errors)} error(s):", err=True)
-    for error in errors:
-        typer.echo(f"  {error.format()}", err=True)
-
-
-def _write_unresolved_log(
-    log_path: str, repo_name: str, unresolved: List[WorkbookValidationError]
-) -> bool:
-    """Write a log file naming the edge endpoints that could not be resolved to a
-    unique Bigeye node — either no match (the column/object does not exist) or more
-    than one match (ambiguous). Best-effort: returns False and warns if the file
-    cannot be written (the same endpoints are also printed to stderr).
-
-    Each endpoint is a catalog path 'Repo.schema.table.column' (or a warehouse FQN);
-    its final segment is the column/object in question.
-    """
-    lines = [
-        "Custom repository import — unresolved edge endpoints",
-        f"Repository: {repo_name}",
-        f"Generated:  {datetime.now().isoformat(timespec='seconds')}",
-        f"Count:      {len(unresolved)}",
-        "",
-        "These endpoints could not be resolved to a unique Bigeye node (no match, or",
-        "more than one), so the edges referencing them were skipped. Each line below",
-        "states the reason and the endpoint value.",
-        "",
-    ]
-    lines.extend(error.format() for error in unresolved)
-    try:
-        with open(log_path, "w") as f:
-            f.write("\n".join(lines) + "\n")
-        return True
-    except OSError as e:
-        typer.echo(f"Warning: could not write unresolved log to '{log_path}': {e}", err=True)
-        return False
-
-
-def _resolve_paths(
-    wb: CustomRepoWorkbook, controller: CustomRepositoryController
-) -> Tuple[Dict[str, int], List[WorkbookValidationError]]:
-    """Resolve every catalog-path/FQN edge endpoint to a node_id, aggregating failures."""
-    resolved: Dict[str, int] = {}
-    errors: List[WorkbookValidationError] = []
-    endpoints = iter_path_endpoints(wb)
-    # Bulk-load every referenced warehouse object up front so the per-endpoint
-    # resolution below is a cache lookup rather than several API calls each.
-    controller.warm_warehouse_cache(endpoints)
-    for endpoint_type, value in endpoints:
-        matches = controller.resolve_edge_endpoint(endpoint_type, value)
-        if not matches:
-            errors.append(
-                WorkbookValidationError(
-                    SHEET_EDGES, "Could not resolve endpoint to a Bigeye node", value=value
-                )
-            )
-        elif len(matches) > 1:
-            errors.append(
-                WorkbookValidationError(
-                    SHEET_EDGES,
-                    f"Endpoint is ambiguous (matched node_ids {matches})",
-                    value=value,
-                )
-            )
-        else:
-            resolved[value] = matches[0]
-    return resolved, errors
-
-
-@app.command(name="init")
-def init_repo(
-    output: str = typer.Option(
-        "custom_repo_template.xlsx",
-        "--output",
-        "-o",
-        help="Output .xlsx path for the blank template.",
-    ),
-    force: bool = typer.Option(
-        False,
-        "--force",
-        help="Overwrite the output file if it already exists.",
-    ),
-):
-    """Generate a blank custom repository workbook (branded, with the Instructions
-    sheet and dropdowns) for you to populate, then import with `custom-repo import`."""
-    if os.path.exists(output) and not force:
-        typer.echo(
-            f"'{output}' already exists. Choose a different --output or pass --force to overwrite.",
-            err=True,
-        )
-        raise typer.Exit(code=1)
-
-    write_workbook(CustomRepoWorkbook(repo_name=""), output)
-    log.info(f"Wrote blank custom repository template to {output}")
-
-
-@app.command(name="import")
-def import_repo(
-    bigeye_conf: str = global_options.bigeye_conf,
-    config_file: str = global_options.config_file,
-    workspace: str = global_options.workspace,
-    file: str = typer.Option(
-        ..., "--file", "-f", help="Path to the custom repository .xlsx workbook."
-    ),
-    cleanup_stale: bool = typer.Option(
-        False,
-        "--cleanup-stale",
-        help="Delete nodes/edges present in Bigeye but missing from the sheet. Off by default.",
-    ),
-    skip_unresolved_edges: bool = typer.Option(
-        True,
-        "--skip-unresolved-edges/--no-skip-unresolved-edges",
-        help="Import the rest instead of aborting when some edge endpoints don't resolve "
-        "to a Bigeye node (default: on). Skipped endpoints are written to the unresolved "
-        "log. Pass --no-skip-unresolved-edges to abort on any unresolved endpoint.",
-    ),
-    unresolved_log: str = typer.Option(
-        "custom_repo_unresolved.log",
-        "--unresolved-log",
-        help="Path for the unresolved-endpoints log. Defaults to "
-        "custom_repo_unresolved.log in the current working directory.",
-    ),
-):
-    """Import a custom repository from an Excel workbook."""
-    client = cli_client_factory(bigeye_conf, config_file, workspace)
-    controller = CustomRepositoryController(client)
-
-    try:
-        wb = read_workbook(file)
-    except (FileNotFoundError, ValueError) as e:
-        typer.echo(f"Could not read workbook '{file}': {e}", err=True)
-        raise typer.Exit(code=1)
-
-    validation_errors = validate_workbook(wb)
-    if validation_errors:
-        _print_errors("Import validation failed", validation_errors)
-        raise typer.Exit(code=1)
-
-    path_node_ids, unresolved = _resolve_paths(wb, controller)
-    if unresolved:
-        log_written = _write_unresolved_log(unresolved_log, wb.repo_name, unresolved)
-        _print_errors("Could not resolve all catalog path references", unresolved)
-        log_hint = f" (see '{unresolved_log}')" if log_written else ""
-        if not skip_unresolved_edges:
-            typer.echo(
-                f"{len(unresolved)} unresolved endpoint(s){log_hint}. "
-                f"Re-run with --skip-unresolved-edges to import the rest.",
-                err=True,
-            )
-            raise typer.Exit(code=1)
-        typer.echo(
-            f"Skipping {len(unresolved)} unresolvable endpoint(s){log_hint} "
-            f"and importing the rest.",
-            err=True,
-        )
-
-    config = build_config(
-        wb,
-        path_node_ids=path_node_ids,
-        cleanup_stale=cleanup_stale,
-        drop_unresolved_edges=skip_unresolved_edges,
-    )
-    result = controller.sync_from_config(config, wait_for_completion=True)
-
-    log.info(
-        f"Sync complete for '{wb.repo_name}': {result.nodes_synced} nodes, "
-        f"{result.edges_synced} edges submitted."
-    )
-    if result.edges_dropped:
-        log.warning(f"{result.edges_dropped} edge(s) dropped during sync:")
-        for reason in result.dropped_edge_reasons:
-            log.warning(f"  - {reason}")
-
-
-@app.command(name="export")
-def export_repo(
-    bigeye_conf: str = global_options.bigeye_conf,
-    config_file: str = global_options.config_file,
-    workspace: str = global_options.workspace,
-    repo_name: str = typer.Option(
-        ..., "--repo-name", help="Display name of the custom repository to export."
-    ),
-    output: Optional[str] = typer.Option(
-        None,
-        "--output",
-        "-o",
-        help="Output .xlsx path. Defaults to <repo-name>.xlsx in the current directory.",
-    ),
-):
-    """Export a custom repository to an Excel workbook."""
-    client = cli_client_factory(bigeye_conf, config_file, workspace)
-    controller = CustomRepositoryController(client)
-
-    try:
-        wb = controller.export_repository(repo_name)
-    except ValueError as e:
-        typer.echo(str(e), err=True)
-        raise typer.Exit(code=1)
-
-    output_path = output or f"{repo_name}.xlsx"
-    write_workbook(wb, output_path)
-    log.info(
-        f"Exported repository '{repo_name}' to {output_path} "
-        f"({len(wb.nodes)} nodes, {len(wb.edges)} edges)."
-    )
-
-
-@app.command(name="delete")
-def delete_repo(
-    bigeye_conf: str = global_options.bigeye_conf,
-    config_file: str = global_options.config_file,
-    workspace: str = global_options.workspace,
-    repo_name: str = typer.Option(
-        ..., "--repo-name", help="Display name of the custom repository to delete."
-    ),
-    yes: bool = typer.Option(
-        False,
-        "--yes",
-        "-y",
-        help="Skip the confirmation prompt.",
-    ),
-):
-    """Entirely delete a custom repository, including its nodes, edges, node types,
-    and integration type."""
-    client = cli_client_factory(bigeye_conf, config_file, workspace)
-    controller = CustomRepositoryController(client)
-
-    if not yes:
-        typer.confirm(
-            f"Permanently delete custom repository '{repo_name}' and all its nodes, "
-            f"edges, node types, and integration type?",
-            abort=True,
-        )
-
-    try:
-        result = controller.delete_repository(repo_name)
-    except ValueError as e:
-        typer.echo(str(e), err=True)
-        raise typer.Exit(code=1)
-
-    summary = f"Deleted custom repository '{result.repository_name}' (id {result.repository_id})"
-    if result.integration_type_deleted:
-        summary += f", its integration type, and {result.node_types_deleted} node type(s)"
-    else:
-        summary += " (integration type retained — shared by another repository)"
-    log.info(summary + ".")