csvpath 0.0.514__tar.gz → 0.0.516__tar.gz

{csvpath-0.0.514 → csvpath-0.0.516}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: csvpath
-Version: 0.0.514
+Version: 0.0.516
 Summary: An edge governance framework for managing and validating CSV, Excel, and other tabular data files
 Author: David Kershaw
 Author-email: dk107dk@hotmail.com
@@ -49,22 +49,22 @@ Description-Content-Type: text/markdown
 
 # <a href='https://www.csvpath.org/'><img src='https://github.com/csvpath/csvpath/blob/main/docs/images/logo-wordmark-4.svg'/></a>
 
-The CsvPath language defines a declarative syntax for inspecting and validating CSV and Excel files, and other tabular data.
+The CsvPath Language defines a declarative syntax for inspecting and validating CSV and Excel files, and other tabular data.
 
-The CsvPath library's goal is to make it easy to setup a <a href='https://www.atestaanalytics.com/s/The-Collect-Store-Validate-Pattern-Atesta-Analytics.pdf'>Collect, Store, Validate Pattern</a> flat-file landing zone that:
-- Registers files
-- Validates that the data matches expectations
-- Reports on content validity and other metadata
-- Shapes files for consistency using copy-on-write
-- And stages the results for loading into a data lake
+The CsvPath Framework makes it easy to setup a <a href='https://www.atestaanalytics.com/s/The-Collect-Store-Validate-Pattern-Atesta-Analytics.pdf'>Collect, Store, Validate Pattern</a> flat-file landing zone that:
+- Registers files for **clear and durable identity**
+- **Validates the data** against expectations
+- Provides **operations and validity reports**
+- Shapes files with **copy-on-write canonicalization**
+- And **stages data for consistent loading** to a data lake or applications
 
 And does it all in an automation-friendly way.
 
-CsvPath's validation is inspired by:
+CsvPath Language validation is inspired by:
 - XPath for XML files
 - The ISO standard <a href='https://schematron.com/'>Schematron validation</a>
 
-CsvPath is intended to fit tightly with other DataOps and data quality tools. Files are streamed. The interface is simple. Metadata is plentiful. New functions and listeners are easy to create.
+The CsvPath Framework is intended to fit tightly with other DataOps and data quality tools. Files are streamed. The interface is simple. Metadata is plentiful. New functions and listeners are easy to create.
 
 CsvPath can stream lineage events to an OpenLineage server, such as the open source Marquez server. Read about <a href="https://www.csvpath.org/getting-started/getting-started-with-csvpath-+-openlineage" target="_blank">CsvPath and OpenLineage here</a>.
 <br/><a href='https://openlineage.io' >
@@ -75,6 +75,10 @@ CsvPath can stream lineage events to an OpenLineage server, such as the open sou
 DataOps demands observability! Pipe CsvPath events through OpenTelemetry to your APM or observability platform. Read about <a href='https://www.csvpath.org/getting-started/integrations/getting-started-with-csvpath-+-opentelemetry' target="_blank">how to get started here</a>, with an example using Grafana.
 <br/><img target='_blank' src="https://github.com/csvpath/csvpath/blob/main/docs/images/opentelemetry.png" alt="OpenTelemetry Logo"/>
 
+CsvPath has multiple MFT options including SFTPPlus. <a href="https://www.csvpath.org/getting-started/dataops-integrations/getting-started-with-csvpath-+-sftpplus" target="_blank">See how SFTPPlus + CsvPath improves data onboarding</a>.
+<a href="https://sftpplus.com/" target="_blank"><img target='_blank' src="https://github.com/csvpath/csvpath/blob/main/docs/images/sftpplus-logo3.png" alt="MFT with SFTPPlus"/></a>
+
+
 Need to publish validated datasets to a CKAN data portal? <a href="https://www.csvpath.org/getting-started/getting-started-with-csvpath-+-ckan" target="_blank">Read about how CsvPath is integrated with CKAN</a>.
 <a href="https://ckan.org/" target="_blank"><img target='_blank' src="https://github.com/csvpath/csvpath/blob/main/docs/images/ckan-logo-sm.png" alt="CKAN Data Portal"/></a>
 
@@ -118,9 +122,13 @@ CSV files are everywhere!
 
 The majority of companies depend on file processing for significant revenue operations. Research organizations and archives are awash in CSVs. And everyone's favorite issue tracker, database GUI, spreadsheet, APM platform, and most any other type of tool we use spits out CSV or Excel files for sharing. Delimited and tabular files are the lowest of common dominators. Many are invalid or broken in some way. Often times a lot of manual effort goes into finding problems and fixing them.
 
-CsvPath is first and foremost a validation language. It describes tabular data in simple declarative rules that define what valid means for that data. CsvPath can also extract and shape data and create reports.
+This project tackles two needs:
+- A more robust validation language for delimited and tabular data
+- A systems integration framework for flat-file landing and staging
+
+CsvPath Language is first and foremost a validation language. It supports both schema definitions and rules-based validation. CsvPath Language describes data so you can easily tell if a file is valid. CsvPath can also extract and shape data and create reports. Overall the goal is to automate human judgement out of the processing loop and instead move it to the process definition stage.
 
-The CsvPath library implements the CsvPath language, but goes far beyond it to provide a full <a href='https://www.atestaanalytics.com/s/The-Collect-Store-Validate-Pattern-Atesta-Analytics.pdf'>Collect, Store, Validate Pattern</a> framework for landing flat files, registering them, validating them, shaping them to a consistent and comparable form, and staging them for a data lake. In that way, CsvPath fills the gap commonly found between an organization's MFT (managed file transfer) and a typical data lake architecture.
+The CsvPath Framework implements CsvPath Language, but goes far beyond it to provide a full <a href='https://www.atestaanalytics.com/s/The-Collect-Store-Validate-Pattern-Atesta-Analytics.pdf'>Collect, Store, Validate Pattern</a> framework for landing flat files, registering them, validating them, shaping them to a consistent and comparable form, and staging them for a data lake. In that way, CsvPath fills the gap commonly found between an organization's MFT (managed file transfer) and a typical data lake architecture.
 
 CsvPath's goal is to make simple validations almost trivial and more complex situations more manageable. It is a library and framework, not a system, so it relies on being easy to integrate with other DataOps tools.
 
@@ -128,36 +136,27 @@ CsvPath's goal is to make simple validations almost trivial and more complex sit
 <a name="install"></a>
 # Install
 
-<a href='https://pypi.org/project/csvpath/'>CsvPath is available on PyPi</a>. It has been tested on 3.10, 3.11 and 3.13. Install with
+<a href='https://pypi.org/project/csvpath/'>CsvPath is available on PyPi</a>. It has been tested on 3.10, 3.11 and 3.13.
+
+The CsvPath Framework project uses Poetry. You can also install it with:
 ```
     pip install csvpath
 ```
 
-CsvPath has two optional dependencies:
-
-- <a target='_blank' href='https://pypi.org/project/pandas/'>Pandas</a>
-- <a target='_blank' href='https://pypi.org/project/smart-open/'>Smart-open</a>
-
-Pandas data frames can be used as a data source, much like Excel or CSV files. Install CsvPath with the Pandas option:
+CsvPath has an optional dependency on Pandas. Pandas data frames can be used as a data source, much like Excel or CSV files. To install CsvPath with the Pandas option do:
 ```
     pip install csvpath[pandas]
 ```
 
-Smart-open is an option for loading data files directly from S3. Install the Smart Open extra with:
-```
-    pip install csvpath[smart-open]
-```
-
-Both of these optional dependencies can make it harder to use CsvPath in certain specific use cases. For e.g., using Pandas in an AWS Lambda layer may be less straightforward. If you need the capabilities, they are easy to install, but if you don't CsvPath is lighter weight without.
-
+Pandas and its dependencies can make it harder to use CsvPath in certain specific MFT use cases. For e.g., using Pandas in an AWS Lambda layer may be less straightforward. If you need the capability, though, it is easy to install.
 
 # Description
 <a name="description"></a>
 
-CsvPath paths have three parts:
+CsvPath Language is for creating "paths" that walk line-by-line through tabular data. They have three parts:
 - a "root" file name
-- a scanning part
-- a matching part
+- a scanning part that says what lines to validate
+- a matching part that decides if a line is valid
 
 The root of a csvpath starts with `$`. The match and scan parts are enclosed by brackets. Newlines are ignored.
 
@@ -167,7 +166,12 @@ A very simple csvpath might look like this:
     $filename[*][yes()]
 ```
 
-This csvpath says open the file named `filename`, scan all the lines, and match every line scanned.
+This csvpath says:
+- Open the file: `filename`
+- Scan all the lines: `*`
+- And match every line scanned: `yes()`
+
+In this case a match is considered a valid line. Treating matches as valid is a simple approach. There are <a href='https://www.csvpath.org/topics/validation' target='_blank'>many possible validation strategies</a> when its time to be more ambitious in your validation.
 
 A slightly more functional csvpath could look like this:
 
@@ -274,14 +278,14 @@ There are a small number of configuration options. Read <a href='https://github.
 
 Before we get into the details of scanning and matching, let's look at what CsvPath can print. The `print` function has several important uses, including:
 
-- Validating CSV files
+- Validating CSV and Excel files
 - Debugging csvpaths
 - Creating new CSV files based on an existing file
 
 You can <a href='https://github.com/dk107dk/csvpath/blob/main/docs/printing.md'>read more about the mechanics of printing here</a>.
 
 <a name="validating"></a>
-### Validating CSV
+### Validating CSV and Excel
 
 CsvPath paths can be used for rules based validation. Rules based validation checks a file against content and structure rules but does not validate the file's structure against a schema. This validation approach is similar to XML's Schematron validation, where XPath rules are applied to XML.
 
@@ -312,7 +316,7 @@ CsvPaths have file scanning instructions, match components, and comments. Commen
 
 As well as documentation, comments outside the csvpath can:
 - Contribute to a collection of metadata fields associated with a csvpath
-- Switch on/off certain validation settings
+- Switch on/off certain validation and DataOps tool integration settings
 - Set the identity of a csvpath within a group of csvpaths
 
 A comment starts and ends with a `~` character. Within the comment, any word that has a colon after it is considered a metadata key. The metadata value is anything following the key up till a new metadata key word is seen or the comment ends.

{csvpath-0.0.514 → csvpath-0.0.516}/README.md

@@ -1,22 +1,22 @@
 
 # <a href='https://www.csvpath.org/'><img src='https://github.com/csvpath/csvpath/blob/main/docs/images/logo-wordmark-4.svg'/></a>
 
-The CsvPath language defines a declarative syntax for inspecting and validating CSV and Excel files, and other tabular data.
+The CsvPath Language defines a declarative syntax for inspecting and validating CSV and Excel files, and other tabular data.
 
-The CsvPath library's goal is to make it easy to setup a <a href='https://www.atestaanalytics.com/s/The-Collect-Store-Validate-Pattern-Atesta-Analytics.pdf'>Collect, Store, Validate Pattern</a> flat-file landing zone that:
-- Registers files
-- Validates that the data matches expectations
-- Reports on content validity and other metadata
-- Shapes files for consistency using copy-on-write
-- And stages the results for loading into a data lake
+The CsvPath Framework makes it easy to setup a <a href='https://www.atestaanalytics.com/s/The-Collect-Store-Validate-Pattern-Atesta-Analytics.pdf'>Collect, Store, Validate Pattern</a> flat-file landing zone that:
+- Registers files for **clear and durable identity**
+- **Validates the data** against expectations
+- Provides **operations and validity reports**
+- Shapes files with **copy-on-write canonicalization**
+- And **stages data for consistent loading** to a data lake or applications
 
 And does it all in an automation-friendly way.
 
-CsvPath's validation is inspired by:
+CsvPath Language validation is inspired by:
 - XPath for XML files
 - The ISO standard <a href='https://schematron.com/'>Schematron validation</a>
 
-CsvPath is intended to fit tightly with other DataOps and data quality tools. Files are streamed. The interface is simple. Metadata is plentiful. New functions and listeners are easy to create.
+The CsvPath Framework is intended to fit tightly with other DataOps and data quality tools. Files are streamed. The interface is simple. Metadata is plentiful. New functions and listeners are easy to create.
 
 CsvPath can stream lineage events to an OpenLineage server, such as the open source Marquez server. Read about <a href="https://www.csvpath.org/getting-started/getting-started-with-csvpath-+-openlineage" target="_blank">CsvPath and OpenLineage here</a>.
 <br/><a href='https://openlineage.io' >
@@ -27,6 +27,10 @@ CsvPath can stream lineage events to an OpenLineage server, such as the open sou
 DataOps demands observability! Pipe CsvPath events through OpenTelemetry to your APM or observability platform. Read about <a href='https://www.csvpath.org/getting-started/integrations/getting-started-with-csvpath-+-opentelemetry' target="_blank">how to get started here</a>, with an example using Grafana.
 <br/><img target='_blank' src="https://github.com/csvpath/csvpath/blob/main/docs/images/opentelemetry.png" alt="OpenTelemetry Logo"/>
 
+CsvPath has multiple MFT options including SFTPPlus. <a href="https://www.csvpath.org/getting-started/dataops-integrations/getting-started-with-csvpath-+-sftpplus" target="_blank">See how SFTPPlus + CsvPath improves data onboarding</a>.
+<a href="https://sftpplus.com/" target="_blank"><img target='_blank' src="https://github.com/csvpath/csvpath/blob/main/docs/images/sftpplus-logo3.png" alt="MFT with SFTPPlus"/></a>
+
+
 Need to publish validated datasets to a CKAN data portal? <a href="https://www.csvpath.org/getting-started/getting-started-with-csvpath-+-ckan" target="_blank">Read about how CsvPath is integrated with CKAN</a>.
 <a href="https://ckan.org/" target="_blank"><img target='_blank' src="https://github.com/csvpath/csvpath/blob/main/docs/images/ckan-logo-sm.png" alt="CKAN Data Portal"/></a>
 
@@ -70,9 +74,13 @@ CSV files are everywhere!
 
 The majority of companies depend on file processing for significant revenue operations. Research organizations and archives are awash in CSVs. And everyone's favorite issue tracker, database GUI, spreadsheet, APM platform, and most any other type of tool we use spits out CSV or Excel files for sharing. Delimited and tabular files are the lowest of common dominators. Many are invalid or broken in some way. Often times a lot of manual effort goes into finding problems and fixing them.
 
-CsvPath is first and foremost a validation language. It describes tabular data in simple declarative rules that define what valid means for that data. CsvPath can also extract and shape data and create reports.
+This project tackles two needs:
+- A more robust validation language for delimited and tabular data
+- A systems integration framework for flat-file landing and staging
+
+CsvPath Language is first and foremost a validation language. It supports both schema definitions and rules-based validation. CsvPath Language describes data so you can easily tell if a file is valid. CsvPath can also extract and shape data and create reports. Overall the goal is to automate human judgement out of the processing loop and instead move it to the process definition stage.
 
-The CsvPath library implements the CsvPath language, but goes far beyond it to provide a full <a href='https://www.atestaanalytics.com/s/The-Collect-Store-Validate-Pattern-Atesta-Analytics.pdf'>Collect, Store, Validate Pattern</a> framework for landing flat files, registering them, validating them, shaping them to a consistent and comparable form, and staging them for a data lake. In that way, CsvPath fills the gap commonly found between an organization's MFT (managed file transfer) and a typical data lake architecture.
+The CsvPath Framework implements CsvPath Language, but goes far beyond it to provide a full <a href='https://www.atestaanalytics.com/s/The-Collect-Store-Validate-Pattern-Atesta-Analytics.pdf'>Collect, Store, Validate Pattern</a> framework for landing flat files, registering them, validating them, shaping them to a consistent and comparable form, and staging them for a data lake. In that way, CsvPath fills the gap commonly found between an organization's MFT (managed file transfer) and a typical data lake architecture.
 
 CsvPath's goal is to make simple validations almost trivial and more complex situations more manageable. It is a library and framework, not a system, so it relies on being easy to integrate with other DataOps tools.
 
@@ -80,36 +88,27 @@ CsvPath's goal is to make simple validations almost trivial and more complex sit
 <a name="install"></a>
 # Install
 
-<a href='https://pypi.org/project/csvpath/'>CsvPath is available on PyPi</a>. It has been tested on 3.10, 3.11 and 3.13. Install with
+<a href='https://pypi.org/project/csvpath/'>CsvPath is available on PyPi</a>. It has been tested on 3.10, 3.11 and 3.13.
+
+The CsvPath Framework project uses Poetry. You can also install it with:
 ```
     pip install csvpath
 ```
 
-CsvPath has two optional dependencies:
-
-- <a target='_blank' href='https://pypi.org/project/pandas/'>Pandas</a>
-- <a target='_blank' href='https://pypi.org/project/smart-open/'>Smart-open</a>
-
-Pandas data frames can be used as a data source, much like Excel or CSV files. Install CsvPath with the Pandas option:
+CsvPath has an optional dependency on Pandas. Pandas data frames can be used as a data source, much like Excel or CSV files. To install CsvPath with the Pandas option do:
 ```
     pip install csvpath[pandas]
 ```
 
-Smart-open is an option for loading data files directly from S3. Install the Smart Open extra with:
-```
-    pip install csvpath[smart-open]
-```
-
-Both of these optional dependencies can make it harder to use CsvPath in certain specific use cases. For e.g., using Pandas in an AWS Lambda layer may be less straightforward. If you need the capabilities, they are easy to install, but if you don't CsvPath is lighter weight without.
-
+Pandas and its dependencies can make it harder to use CsvPath in certain specific MFT use cases. For e.g., using Pandas in an AWS Lambda layer may be less straightforward. If you need the capability, though, it is easy to install.
 
 # Description
 <a name="description"></a>
 
-CsvPath paths have three parts:
+CsvPath Language is for creating "paths" that walk line-by-line through tabular data. They have three parts:
 - a "root" file name
-- a scanning part
-- a matching part
+- a scanning part that says what lines to validate
+- a matching part that decides if a line is valid
 
 The root of a csvpath starts with `$`. The match and scan parts are enclosed by brackets. Newlines are ignored.
 
@@ -119,7 +118,12 @@ A very simple csvpath might look like this:
     $filename[*][yes()]
 ```
 
-This csvpath says open the file named `filename`, scan all the lines, and match every line scanned.
+This csvpath says:
+- Open the file: `filename`
+- Scan all the lines: `*`
+- And match every line scanned: `yes()`
+
+In this case a match is considered a valid line. Treating matches as valid is a simple approach. There are <a href='https://www.csvpath.org/topics/validation' target='_blank'>many possible validation strategies</a> when its time to be more ambitious in your validation.
 
 A slightly more functional csvpath could look like this:
 
@@ -226,14 +230,14 @@ There are a small number of configuration options. Read <a href='https://github.
 
 Before we get into the details of scanning and matching, let's look at what CsvPath can print. The `print` function has several important uses, including:
 
-- Validating CSV files
+- Validating CSV and Excel files
 - Debugging csvpaths
 - Creating new CSV files based on an existing file
 
 You can <a href='https://github.com/dk107dk/csvpath/blob/main/docs/printing.md'>read more about the mechanics of printing here</a>.
 
 <a name="validating"></a>
-### Validating CSV
+### Validating CSV and Excel
 
 CsvPath paths can be used for rules based validation. Rules based validation checks a file against content and structure rules but does not validate the file's structure against a schema. This validation approach is similar to XML's Schematron validation, where XPath rules are applied to XML.
 
@@ -264,7 +268,7 @@ CsvPaths have file scanning instructions, match components, and comments. Commen
 
 As well as documentation, comments outside the csvpath can:
 - Contribute to a collection of metadata fields associated with a csvpath
-- Switch on/off certain validation settings
+- Switch on/off certain validation and DataOps tool integration settings
 - Set the identity of a csvpath within a group of csvpaths
 
 A comment starts and ends with a `~` character. Within the comment, any word that has a colon after it is considered a metadata key. The metadata value is anything following the key up till a new metadata key word is seen or the comment ends.

{csvpath-0.0.514 → csvpath-0.0.516}/config/config.ini

@@ -7,6 +7,8 @@ extensions = txt, csv, tsv, dat, tab, psv, ssv
 [errors]
 csvpath = raise, collect, stop, fail, print
 csvpaths = raise, collect
+use_format = full
+pattern = {time}:{file}:{line}:{paths}:{instance}:{chain}:  {message}
 
 [logging]
 csvpath = info
@@ -26,8 +28,19 @@ imports = config/functions.imports
 
 [listeners]
 groups =
-#slack, marquez, ckan, sftp, sftpplus, otlp
-
+#slack, marquez, ckan, sftp, sftpplus, otlp, default
+
+# these simple default listeners track all files staged and all paths loaded in
+# central manifests. unlike other manifest writers, if they have multiple
+# concurrent users they have potential a race condition. users that do not
+# share inputs directories do not need to worry about this. you should vet
+# using them against your use case; potential utility vs. the modest but non-0
+# risk of lost updates. they can be disabled with little loss of function.
+# alternatively a database-backed version may be available.
+default.file = from csvpath.managers.files.files_listener import FilesListener
+default.paths = from csvpath.managers.paths.paths_listener import PathsListener
+
+# add otlp to support any OpenTelemetry backend
 otlp.result = from csvpath.managers.integrations.otlp.otlp_result_listener import OpenTelemetryResultListener
 otlp.results = from csvpath.managers.integrations.otlp.otlp_results_listener import OpenTelemetryResultsListener
 otlp.errors = from csvpath.managers.integrations.otlp.otlp_error_listener import OpenTelemetryErrorListener

csvpath-0.0.516/csvpath/cli/asker.py

@@ -0,0 +1,90 @@
+from prompt_toolkit import Application
+from prompt_toolkit.buffer import Buffer
+from prompt_toolkit.layout.containers import (
+    HSplit,
+    VSplit,
+    Window,
+    ConditionalContainer,
+)
+from prompt_toolkit.layout.menus import CompletionsMenu
+from prompt_toolkit.layout.controls import BufferControl, FormattedTextControl
+from prompt_toolkit.layout.layout import Layout
+from prompt_toolkit.key_binding import KeyBindings
+from prompt_toolkit.completion import WordCompleter
+
+
+class Asker:
+    def __init__(self, cli, *, name_type) -> None:
+        self._cli = cli
+        names = None
+        if name_type == "files":
+            names = self._cli.csvpaths.file_manager.named_file_names
+            names.sort()
+        elif name_type == "paths":
+            names = self._cli.csvpaths.file_manager.named_file_names
+            names.sort()
+        else:
+            raise ValueError("Name type must be files or paths")
+        self.completer = WordCompleter(names, ignore_case=True)
+        self.result = None
+
+    def create_prompt_application(self, prompt_text="Named-file name? "):
+        # Create a buffer to store input
+        buffer = Buffer(completer=self.completer, complete_while_typing=True)
+
+        # Create key bindings
+        kb = KeyBindings()
+
+        @kb.add("enter")
+        def _(event):
+            self.result = buffer.text
+            event.app.exit()
+
+        @kb.add("c-c")
+        @kb.add("c-q")
+        def _(event):
+            event.app.exit()
+
+        # Create the layout
+        layout = Layout(
+            HSplit(
+                [
+                    # The actual prompt layout
+                    VSplit(
+                        [
+                            # Prompt text
+                            Window(
+                                content=FormattedTextControl(prompt_text),
+                                width=len(prompt_text),
+                                dont_extend_width=True,
+                            ),
+                            # Input field with completions menu wrapped in a Window
+                            Window(content=BufferControl(buffer=buffer)),
+                        ]
+                    )
+                ]
+                # , align_right=False
+            )
+        )
+
+        # Create and return the application
+        return Application(
+            layout=layout,
+            key_bindings=kb,
+            mouse_support=True,
+            full_screen=False,
+            erase_when_done=True,
+            # complete_while_typing=True
+        )
+
+    def ask(self) -> str:
+        try:
+            app = self.create_prompt_application()
+            app.run()
+            return self.result
+        except Exception as e:
+            print(f"Error: {e}")
+            import traceback
+
+            print(traceback.format_exc())
+            return None

{csvpath-0.0.514 → csvpath-0.0.516}/csvpath/cli/cli.py

@@ -4,13 +4,29 @@ import time
 import traceback
 from csvpath import CsvPaths
 from .drill_down import DrillDown
-from .select import Select
-from .error import Error
+from .selecter import Selecter
+from .debug_config import DebugConfig
 
 
 class Cli:
     def __init__(self):
         self.csvpaths = CsvPaths()
+        self.clear()
+        splash = """
+          *** *            ******        **  **
+        ***  **   *        **  **      **** **
+       **        ** **  * ** *** ***** **  *****
+       **    * **** **** ***** *** ** **  ** **
+       **   **** ****** **     ** ** *** ** ** **
+         ***   **** *  **      *** ** ****   **
+***************************
+CsvPath Command Line Interface
+Try tab completion and menu-by-key.
+For help see https://www.csvpath.org
+"""
+        print(splash)
+        self._return_to_cont()
+        self.clear()
 
     def clear(self):
         print(chr(27) + "[2J")
@@ -28,6 +44,7 @@ class Cli:
     STOP_HERE2 = "👍 pick this dir"
     CANCEL = f"{SIDEBAR_COLOR}{ITALIC}... cancel{REVERT}"
     CANCEL2 = "← cancel"
+    QUIT = "← quit"
 
     def _return_to_cont(self):
         print(
@@ -52,14 +69,18 @@ class Cli:
     def end(self) -> None:
         print(chr(27) + "[2J")
 
-    def ask(self, choices: list[str]) -> str:
+    def ask(self, choices: list[str], q=None) -> str:
         self.clear()
+        if len(choices) == 0:
+            return
+        if q is not None:
+            print(q)
         if choices[len(choices) - 1] == Cli.CANCEL:
             choices[len(choices) - 1] = Cli.CANCEL2
         if choices[len(choices) - 2] == Cli.STOP_HERE:
             choices[len(choices) - 2] = Cli.STOP_HERE2
         cs = [(s, s) for s in choices]
-        t = Select().ask(title="", values=cs, cancel_value="CANCEL")
+        t = Selecter().ask(title="", values=cs, cancel_value="CANCEL")
         self.clear()
         return t
 
@@ -70,22 +91,22 @@ class Cli:
                 choices = [
                     "named-files",
                     "named-paths",
-                    "named-results",
+                    "archive",
                     "run",
                     "config",
-                    "quit",
+                    self.QUIT,
                 ]
                 t = self.ask(choices)
             except KeyboardInterrupt:
                 self.end()
                 return
             t = self._do(t)
-            if t == "quit":
+            if t == Cli.QUIT:
                 self.end()
                 return
 
     def _do(self, t: str) -> str | None:
-        if t == "quit":
+        if t == Cli.QUIT:
             return t
         try:
             if t == "run":
@@ -94,21 +115,21 @@ class Cli:
                 self._files()
             if t == "named-paths":
                 self._paths()
-            if t == "named-results":
+            if t == "archive":
                 self._results()
             if t == "config":
                 self._config()
         except KeyboardInterrupt:
-            return "quit"
+            return Cli.QUIT
         except Exception:
             print(traceback.format_exc())
             self._return_to_cont()
 
     def _config(self) -> None:
-        Error(self).show()
+        DebugConfig(self).show()
 
     def _files(self) -> None:
-        choices = ["add named-file", "list named-files", "cancel"]
+        choices = ["add named-file", "list named-files", self.CANCEL2]
         t = self.ask(choices)
         if t == "add named-file":
             DrillDown(self).name_file()
@@ -116,7 +137,7 @@ class Cli:
             self.list_named_files()
 
     def _paths(self) -> None:
-        choices = ["add named-paths", "list named-paths", "cancel"]
+        choices = ["add named-paths", "list named-paths", self.CANCEL2]
         t = self.ask(choices)
         if t == "add named-paths":
             DrillDown(self).name_paths()
@@ -124,7 +145,7 @@ class Cli:
             self.list_named_paths()
 
     def _results(self) -> None:
-        choices = ["open named-result", "list named-results", "cancel"]
+        choices = ["open named-result", "list named-results", self.CANCEL2]
         t = self.ask(choices)
         if t == "open named-result":
             self.open_named_result()
@@ -136,6 +157,8 @@ class Cli:
         names = self.csvpaths.results_manager.list_named_results()
         print(f"{len(names)} named-results names:")
         for n in names:
+            if n.find(".") > -1:
+                continue
             self._response(f"   {n}")
         self._return_to_cont()
 
@@ -143,6 +166,7 @@ class Cli:
         self.clear()
         try:
             names = self.csvpaths.results_manager.list_named_results()
+            names = [n for n in names if n.find(".") == -1]
             print(f"{len(names)} named-results names:")
             names.append(self.CANCEL)
             t = self.ask(names)
@@ -176,18 +200,25 @@ class Cli:
 
     def run(self):
         self.clear()
-        print("What named-file? ")
         files = self.csvpaths.file_manager.named_file_names
-        file = self.ask(files)
+        if len(files) == 0:
+            input("You must add a named-file. Press any key to continue.")
+            return
+        files.sort()
+        file = self.ask(files, q="What named-file? ")
         self.clear()
-        print("What named-paths? ")
         allpaths = self.csvpaths.paths_manager.named_paths_names
-        paths = self.ask(allpaths)
+        if len(allpaths) == 0:
+            input("You must add a named-paths file. Press any key to continue.")
+            return
+        allpaths.sort()
+        paths = self.ask(allpaths, q="What named-paths? ")
         self.clear()
-        choices = ["collect", "fast-forward"]
-        print("What method? ")
-        method = self.ask(choices)
+        choices = ["collect", "fast-forward", Cli.CANCEL2]
+        method = self.ask(choices, q="What method? ")
         self.clear()
+        if method == Cli.CANCEL2:
+            return
         self.action(f"Running {paths} against {file} using {method}\n")
         self.pause()
         try:
@@ -196,7 +227,22 @@ class Cli:
             else:
                 self.csvpaths.fast_forward_paths(filename=file, pathsname=paths)
         except Exception:
-            print(traceback.format_exc())
+            cfg = None
+            while cfg in [None, "c", "e"]:
+                print("\nThere was an error.")
+                print("Click 'e' and return to print the stack trace. ")
+                print("Click 'c' and return to change config options. ")
+                print("Click return to continue. ")
+                cfg = input("")
+                if cfg == "c":
+                    DebugConfig(self).show()
+                elif cfg == "e":
+                    self.clear()
+                    print(traceback.format_exc())
+                    input("\n\nClick return to continue")
+                else:
+                    return
+                self.clear()
         self._return_to_cont()