dao-ai 0.0.21__tar.gz → 0.0.23__tar.gz

{dao_ai-0.0.21 → dao_ai-0.0.23}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: dao-ai
-Version: 0.0.21
+Version: 0.0.23
 Summary: DAO AI: A modular, multi-agent orchestration framework for complex AI workflows. Supports agent handoff, tool integration, and dynamic configuration via YAML.
 Project-URL: Homepage, https://github.com/natefleming/dao-ai
 Project-URL: Documentation, https://natefleming.github.io/dao-ai
@@ -24,9 +24,10 @@ Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
 Classifier: Topic :: Software Development :: Libraries :: Python Modules
 Classifier: Topic :: System :: Distributed Computing
 Requires-Python: >=3.12
-Requires-Dist: databricks-agents>=1.6.0
+Requires-Dist: databricks-agents>=1.6.1
 Requires-Dist: databricks-langchain>=0.8.0
-Requires-Dist: databricks-sdk[openai]>=0.66.0
+Requires-Dist: databricks-mcp>=0.3.0
+Requires-Dist: databricks-sdk[openai]>=0.67.0
 Requires-Dist: duckduckgo-search>=8.0.2
 Requires-Dist: grandalf>=0.8
 Requires-Dist: langchain-mcp-adapters>=0.1.10
@@ -653,7 +654,7 @@ test:
 #### 4. MCP (Model Context Protocol) Tools (`type: mcp`)
    MCP tools allow interaction with external services that implement the Model Context Protocol, supporting both HTTP and stdio transports.
 
-   **Configuration Example:**
+   **Configuration Example (Direct URL):**
    ```yaml
    tools:
      weather_tool_mcp:
@@ -664,8 +665,30 @@ test:
          transport: streamable_http
          url: http://localhost:8000/mcp
    ```
+   
+   **Configuration Example (Unity Catalog Connection):**
+   MCP tools can also use Unity Catalog Connections for secure, governed access with on-behalf-of-user capabilities. The connection provides OAuth authentication, while the URL specifies the endpoint:
+   ```yaml
+   resources:
+     connections:
+       github_connection:
+         name: github_u2m_connection  # UC Connection name
+   
+   tools:
+     github_mcp:
+       name: github_mcp
+       function:
+         type: mcp
+         name: github_mcp
+         transport: streamable_http
+         url: https://workspace.databricks.com/api/2.0/mcp/external/github_u2m_connection  # MCP endpoint URL
+         connection: *github_connection  # UC Connection provides OAuth authentication
+   ```
+   
    **Development:**
-   Ensure the MCP service is running and accessible at the specified URL or command. The framework will handle the MCP protocol communication automatically.
+   - **For direct URL connections**: Ensure the MCP service is running and accessible at the specified URL or command. Provide OAuth credentials (client_id, client_secret) or PAT for authentication.
+   - **For UC Connection**: URL is required to specify the endpoint. The connection provides OAuth authentication via the workspace client. Ensure the connection is configured in Unity Catalog with appropriate MCP scopes (`mcp.genie`, `mcp.functions`, `mcp.vectorsearch`, `mcp.external`).
+   - The framework will handle the MCP protocol communication automatically, including session management and authentication.
 
 ### Configuring New Agents
 

{dao_ai-0.0.21 → dao_ai-0.0.23}/README.md

@@ -581,7 +581,7 @@ test:
 #### 4. MCP (Model Context Protocol) Tools (`type: mcp`)
    MCP tools allow interaction with external services that implement the Model Context Protocol, supporting both HTTP and stdio transports.
 
-   **Configuration Example:**
+   **Configuration Example (Direct URL):**
    ```yaml
    tools:
      weather_tool_mcp:
@@ -592,8 +592,30 @@ test:
          transport: streamable_http
          url: http://localhost:8000/mcp
    ```
+   
+   **Configuration Example (Unity Catalog Connection):**
+   MCP tools can also use Unity Catalog Connections for secure, governed access with on-behalf-of-user capabilities. The connection provides OAuth authentication, while the URL specifies the endpoint:
+   ```yaml
+   resources:
+     connections:
+       github_connection:
+         name: github_u2m_connection  # UC Connection name
+   
+   tools:
+     github_mcp:
+       name: github_mcp
+       function:
+         type: mcp
+         name: github_mcp
+         transport: streamable_http
+         url: https://workspace.databricks.com/api/2.0/mcp/external/github_u2m_connection  # MCP endpoint URL
+         connection: *github_connection  # UC Connection provides OAuth authentication
+   ```
+   
    **Development:**
-   Ensure the MCP service is running and accessible at the specified URL or command. The framework will handle the MCP protocol communication automatically.
+   - **For direct URL connections**: Ensure the MCP service is running and accessible at the specified URL or command. Provide OAuth credentials (client_id, client_secret) or PAT for authentication.
+   - **For UC Connection**: URL is required to specify the endpoint. The connection provides OAuth authentication via the workspace client. Ensure the connection is configured in Unity Catalog with appropriate MCP scopes (`mcp.genie`, `mcp.functions`, `mcp.vectorsearch`, `mcp.external`).
+   - The framework will handle the MCP protocol communication automatically, including session management and authentication.
 
 ### Configuring New Agents
 

dao_ai-0.0.23/config/examples/mcp_with_uc_connection.yaml

@@ -0,0 +1,109 @@
+# yaml-language-server: $schema=../../schemas/model_config_schema.json
+
+variables:
+  client_id: &client_id                          # Service principal client ID
+    options:
+      - env: RETAIL_AI_DATABRICKS_CLIENT_ID
+      - scope: retail_ai
+        secret: RETAIL_AI_DATABRICKS_CLIENT_ID
+  client_secret: &client_secret                  # Service principal secret
+    options:
+      - env: RETAIL_AI_DATABRICKS_CLIENT_SECRET
+      - scope: retail_ai
+        secret: RETAIL_AI_DATABRICKS_CLIENT_SECRET
+  workspace_host: &workspace_host                # Databricks workspace URL
+    options:
+      - env: RETAIL_AI_DATABRICKS_HOST
+      - scope: retail_ai
+        secret: RETAIL_AI_DATABRICKS_HOST
+
+schemas:
+  retail_schema: &retail_schema                  # Unity Catalog schema configuration
+    catalog_name: nfleming                       # Unity Catalog name
+    schema_name: retail_ai                       # Schema within the catalog
+
+resources:
+  llms:
+    default_llm: &default_llm                    # Default LLM configuration
+      name: databricks-claude-3-7-sonnet        # Databricks serving endpoint name
+  
+  connections:
+    github_connection: &github_connection       # UC Connection for GitHub
+      name: github_u2m_connection               # UC Connection name
+
+tools:
+  # Example using UC Connection for GitHub MCP
+  github_mcp_uc: &github_mcp_uc
+    name: github_mcp                                # Tool name for agent reference
+    function:
+      type: mcp                                     # Tool type: MCP server
+      name: github_mcp                              # MCP function name
+      transport: streamable_http                    # Transport protocol
+      url: https://adb-984752964297111.11.azuredatabricks.net/api/2.0/mcp/external/github_u2m_connection  # MCP endpoint URL
+      connection: *github_connection                # Reference to UC Connection (provides OAuth auth)
+
+  # Example using direct URL (existing approach)
+  weather_tool_mcp: &weather_tool_mcp
+    name: weather                                   # Tool name for agent reference
+    function:
+      type: mcp                                     # Tool type: MCP server
+      name: weather                                 # MCP function name
+      transport: streamable_http                    # Transport protocol
+      url: http://localhost:8000/mcp                # MCP server URL
+      
+  vector_search_mcp: &vector_search_mcp          # Vector search MCP tool configuration
+    name: vector_search_mcp                                  
+    function:
+      type: mcp                                  # MCP function type
+      name: vector_search_mcp                              
+      url: https://adb-984752964297111.11.azuredatabricks.net/api/2.0/mcp/vector-search/nfleming/retail_ai
+      client_id: *client_id
+      client_secret: *client_secret
+      workspace_host: *workspace_host
+
+  unity_catalog_mcp: &unity_catalog_mcp          # Unity Catalog MCP tool configuration
+    name: unity_catalog_mcp                                  
+    function:
+      type: mcp                                  # MCP function type
+      name: unity_catalog_mcp                              
+      url:  https://adb-984752964297111.11.azuredatabricks.net/api/2.0/mcp/functions/nfleming/retail_ai
+      client_id: *client_id
+      client_secret: *client_secret
+      workspace_host: *workspace_host
+
+  genie_mcp: &genie_mcp                          # Genie MCP tool configuration
+    name: genie_mcp                                  
+    function:
+      type: mcp                                  # MCP function type
+      name: genie_mcp                              
+      url:  https://adb-984752964297111.11.azuredatabricks.net/api/2.0/mcp/genie/01f01c91f1f414d59daaefd2b7ec82ea
+      client_id: *client_id
+      client_secret: *client_secret
+      workspace_host: *workspace_host
+
+agents:
+  mcp_agent: &mcp_agent                          # MCP agent configuration
+    name: mcp_agent                              # Agent identifier
+    model: *default_llm                          # Reference to LLM configuration
+    tools:                                       # Tools available to this agent
+      - *github_mcp_uc
+      - *vector_search_mcp
+      - *unity_catalog_mcp
+      - *genie_mcp
+    prompt: |                                    # System prompt defining agent behavior
+      You are a multi-purpose agent that can perform vector search, interact with Unity Catalog,
+      interact with Genie rooms, and interact with GitHub. Use the tools provided to answer 
+      questions and perform tasks. You many need to use the tools in combination to achieve 
+      complex tasks.
+      
+app:
+  name: mcp_agent                                # Application name  
+  log_level: DEBUG                               # Logging level for the application
+  registered_model:                              # MLflow registered model configuration
+    schema: *retail_schema                       # Schema where model will be registered
+    name: mcp_agent                              # Model name in MLflow registry
+  agents:                                        # List of agents included in the system
+    - *mcp_agent                                 # MCP agent
+  orchestration:                                 # Agent orchestration configuration
+    swarm:                                       # Supervisor orchestration pattern
+      model: *default_llm                        # LLM for routing decisions

dao_ai-0.0.23/config/examples/slack.yaml

@@ -0,0 +1,69 @@
+# yaml-language-server: $schema=../../schemas/model_config_schema.json
+
+schemas:
+  default_schema: &default_schema                   # Unity Catalog schema configuration
+    catalog_name: main                              # Unity Catalog name
+    schema_name: default                            # Schema within the catalog
+
+resources:
+  llms:
+    # Primary LLM for Slack agent
+    default_llm: &default_llm
+      name: databricks-meta-llama-3-3-70b-instruct  # Databricks serving endpoint name
+      temperature: 0.7                              # Temperature for more natural responses
+      max_tokens: 4096                              # Maximum tokens per response
+      on_behalf_of_user: false
+
+  connections:
+    # Unity Catalog HTTP connection to Slack
+    slack_connection: &slack_connection
+      name: slack_bot_connection                    # UC Connection name
+      on_behalf_of_user: false                      # Use service principal auth
+
+tools:
+  # Slack messaging tool using factory function
+  slack_tool: &slack_tool
+    name: send_slack_message                        # Tool name for agent reference
+    function:
+      type: factory                                 # Tool type: factory function
+      name: dao_ai.tools.create_send_slack_message_tool  # Factory function path
+      args:                                         # Arguments passed to factory
+        connection: *slack_connection               # Reference to Slack UC connection
+        channel_name: "general"                     # Slack channel name (can also use channel_id)
+        name: send_slack_message
+        description: Send a message to the #general Slack channel
+
+agents:
+  # Slack notification agent
+  slack_agent: &slack_agent
+    name: slack_agent                               # Agent identifier
+    description: "Agent that can send notifications to Slack"
+    model: *default_llm                             # Reference to LLM configuration
+    tools:                                          # Tools available to this agent
+      - *slack_tool
+    prompt: |                                       # System prompt defining agent behavior
+      You are a helpful assistant that can send notifications to Slack.
+      When asked to notify someone or send a message, use the send_slack_message tool
+      to post to the #general channel. Keep messages concise and professional.
+
+app:
+  name: slack_agent_example                         # Application name  
+  description: "Agent system that can send notifications to Slack"
+  log_level: INFO                                   # Logging level for the application
+  registered_model:                                 # MLflow registered model configuration
+    schema: *default_schema                         # Schema where model will be registered
+    name: slack_notification_agent                  # Model name in MLflow registry
+  endpoint_name: slack_notification_agent           # Model serving endpoint name
+  tags:                                             # Tags for resource organization
+    integration: slack                              # Integration type
+    notification: true                              # Indicates notification capabilities
+  permissions:                                      # Model serving permissions
+    - principals: [users]                           # Grant access to all users
+      entitlements:
+        - CAN_QUERY                                 # Query permissions
+  agents:                                           # List of agents included in the system
+    - *slack_agent                                  # Slack notification agent
+  orchestration:                                    # Agent orchestration configuration
+    swarm:                                          # Swarm orchestration pattern
+      model: *default_llm                           # LLM for routing decisions
+

{dao_ai-0.0.21 → dao_ai-0.0.23}/config/hardware_store/supervisor_postgres.yaml

@@ -194,29 +194,30 @@ resources:
   databases:
     # PostgreSQL database for agent memory and checkpoints
     retail_database: &retail_database
-      name: "retail-consumer-goods"
+      name: "Retail and Consumer Goods Database"
+      instance_name: "retail-consumer-goods"
       description: "Database for agent memory and checkpoints" 
       
       # Database connection parameters
       # These can be set via environment variables or Databricks secrets
-      host:                                                 
-        default_value: localhost                                             
-        options:
-          - env: PGHOST                              # Environment variable
-          - scope: retail_ai                         # Databricks secret scope
-            secret: PGHOST                           # Secret name
-      port: 
-        default_value: 5432
-        options:
-        - env: PGPORT 
-        - scope: retail_ai
-          secret: PGPORT
-      database: 
-        default_value: databricks_postgres           # Default database name
-        options:
-        - env: PGDATABASE 
-        - scope: retail_ai
-          secret: PGDATABASE
+#      host:                                                 
+#        default_value: localhost                                             
+#        options:
+#          - env: PGHOST                              # Environment variable
+#          - scope: retail_ai                         # Databricks secret scope
+#            secret: PGHOST                           # Secret name
+#      port: 
+#        default_value: 5432
+#        options:
+#        - env: PGPORT 
+#        - scope: retail_ai
+#          secret: PGPORT
+#      database: 
+#        default_value: databricks_postgres           # Default database name
+#        options:
+#        - env: PGDATABASE 
+#        - scope: retail_ai
+#          secret: PGDATABASE
 
 
       # Traditional PostgreSQL authentication (commented out)
@@ -959,7 +960,7 @@ app:
           content: Can you recommend a lamp to match my oak side tables?
       custom_inputs:
         configurable:
-          thread_id: "1"
+          #thread_id: "1"
           user_id: my_user_id
           store_num: 87887
   #chat_history: 

{dao_ai-0.0.21 → dao_ai-0.0.23}/databricks.yaml

@@ -50,17 +50,24 @@ resources:
             base_parameters:
               config-path: ${var.config_path}
           environment_key: dao-ai-env
+        - task_key: provision-lakebase
+          notebook_task:
+            notebook_path: ./notebooks/03_provision_lakebase.py
+            base_parameters:
+              config-path: ${var.config_path}
+          environment_key: dao-ai-env
         - task_key: generate-evaluation-data
           depends_on:
             - task_key: provision-vector-search
           notebook_task:
-            notebook_path: ./notebooks/03_generate_evaluation_data.py
+            notebook_path: ./notebooks/06_generate_evaluation_data.py
             base_parameters:
               config-path: ${var.config_path}
           environment_key: dao-ai-env
         - task_key: unity-catalog-tools
           depends_on:
             - task_key: provision-vector-search
+            - task_key: provision-lakebase
           notebook_task:
             notebook_path: ./notebooks/04_unity_catalog_tools.py
             base_parameters:
@@ -70,7 +77,7 @@ resources:
           depends_on:
             - task_key: unity-catalog-tools
           notebook_task:
-            notebook_path: ./notebooks/05_agent_as_code_driver.py
+            notebook_path: ./notebooks/05_deploy_agent.py
             base_parameters:
               config-path: ${var.config_path}
           environment_key: dao-ai-env
@@ -79,7 +86,7 @@ resources:
             - task_key: deploy-agents
             - task_key: generate-evaluation-data
           notebook_task:
-            notebook_path: ./notebooks/06_run_evaluation.py
+            notebook_path: ./notebooks/07_run_evaluation.py
             base_parameters:
               config-path: ${var.config_path}
           environment_key: dao-ai-env

{dao_ai-0.0.21 → dao_ai-0.0.23}/notebooks/01_ingest_and_transform.py

@@ -1,11 +1,42 @@
 # Databricks notebook source
 # MAGIC %pip install --quiet --upgrade -r ../requirements.txt
+# MAGIC %pip uninstall --quiet -y databricks-connect pyspark pyspark-connect
+# MAGIC %pip install --quiet databricks-connect
 # MAGIC %restart_python
 
 # COMMAND ----------
 
-dbutils.widgets.text(name="config-path", defaultValue="../config/model_config.yaml")
-config_path: str = dbutils.widgets.get("config-path")
+from typing import Sequence
+import os
+
+def find_yaml_files_os_walk(base_path: str) -> Sequence[str]:
+    if not os.path.exists(base_path):
+        raise FileNotFoundError(f"Base path does not exist: {base_path}")
+    
+    if not os.path.isdir(base_path):
+        raise NotADirectoryError(f"Base path is not a directory: {base_path}")
+    
+    yaml_files = []
+    
+    for root, dirs, files in os.walk(base_path):
+        for file in files:
+            if file.lower().endswith(('.yaml', '.yml')):
+                yaml_files.append(os.path.join(root, file))
+    
+    return sorted(yaml_files)
+
+# COMMAND ----------
+
+dbutils.widgets.text(name="config-path", defaultValue="")
+
+config_files: Sequence[str] = find_yaml_files_os_walk("../config")
+dbutils.widgets.dropdown(name="config-paths", choices=config_files, defaultValue=next(iter(config_files), ""))
+
+config_path: str | None = dbutils.widgets.get("config-path") or None
+project_path: str = dbutils.widgets.get("config-paths") or None
+
+config_path: str = config_path or project_path
+
 print(config_path)
 
 # COMMAND ----------

{dao_ai-0.0.21 → dao_ai-0.0.23}/notebooks/02_provision_vector_search.py

@@ -6,10 +6,38 @@
 
 # COMMAND ----------
 
-dbutils.widgets.text(name="config-path", defaultValue="../config/model_config.yaml")
-config_path: str = dbutils.widgets.get("config-path")
-print(config_path)
+from typing import Sequence
+import os
+
+def find_yaml_files_os_walk(base_path: str) -> Sequence[str]:
+    if not os.path.exists(base_path):
+        raise FileNotFoundError(f"Base path does not exist: {base_path}")
+    
+    if not os.path.isdir(base_path):
+        raise NotADirectoryError(f"Base path is not a directory: {base_path}")
+    
+    yaml_files = []
+    
+    for root, dirs, files in os.walk(base_path):
+        for file in files:
+            if file.lower().endswith(('.yaml', '.yml')):
+                yaml_files.append(os.path.join(root, file))
+    
+    return sorted(yaml_files)
+
+# COMMAND ----------
+
+dbutils.widgets.text(name="config-path", defaultValue="")
 
+config_files: Sequence[str] = find_yaml_files_os_walk("../config")
+dbutils.widgets.dropdown(name="config-paths", choices=config_files, defaultValue=next(iter(config_files), ""))
+
+config_path: str | None = dbutils.widgets.get("config-path") or None
+project_path: str = dbutils.widgets.get("config-paths") or None
+
+config_path: str = config_path or project_path
+
+print(config_path)
 # COMMAND ----------
 
 import sys

dao_ai-0.0.23/notebooks/03_provision_lakebase.py

@@ -0,0 +1,85 @@
+# Databricks notebook source
+# MAGIC %pip install --quiet --upgrade -r ../requirements.txt
+# MAGIC %pip uninstall --quiet -y databricks-connect pyspark pyspark-connect
+# MAGIC %pip install --quiet databricks-connect
+# MAGIC %restart_python
+
+# COMMAND ----------
+
+from typing import Sequence
+import os
+
+def find_yaml_files_os_walk(base_path: str) -> Sequence[str]:
+    if not os.path.exists(base_path):
+        raise FileNotFoundError(f"Base path does not exist: {base_path}")
+    
+    if not os.path.isdir(base_path):
+        raise NotADirectoryError(f"Base path is not a directory: {base_path}")
+    
+    yaml_files = []
+    
+    for root, dirs, files in os.walk(base_path):
+        for file in files:
+            if file.lower().endswith(('.yaml', '.yml')):
+                yaml_files.append(os.path.join(root, file))
+    
+    return sorted(yaml_files)
+
+# COMMAND ----------
+
+dbutils.widgets.text(name="config-path", defaultValue="")
+
+config_files: Sequence[str] = find_yaml_files_os_walk("../config")
+dbutils.widgets.dropdown(name="config-paths", choices=config_files, defaultValue=next(iter(config_files), ""))
+
+config_path: str | None = dbutils.widgets.get("config-path") or None
+project_path: str = dbutils.widgets.get("config-paths") or None
+
+config_path: str = config_path or project_path
+
+print(config_path)
+
+# COMMAND ----------
+
+import sys
+from typing import Sequence
+from importlib.metadata import version
+
+sys.path.insert(0, "../src")
+
+pip_requirements: Sequence[str] = (
+  f"databricks-sdk=={version('databricks-sdk')}",
+  f"mlflow=={version('mlflow')}",
+)
+print("\n".join(pip_requirements))
+
+# COMMAND ----------
+
+# MAGIC %load_ext autoreload
+# MAGIC %autoreload 2
+
+# COMMAND ----------
+
+from dotenv import find_dotenv, load_dotenv
+
+_ = load_dotenv(find_dotenv())
+
+# COMMAND ----------
+
+from dao_ai.config import AppConfig
+
+config: AppConfig = AppConfig.from_file(path=config_path)
+
+# COMMAND ----------
+
+from dao_ai.config import DatabaseModel
+
+databases: dict[str, DatabaseModel] = config.resources.databases
+
+for _, database in databases.items():
+  database: DatabaseModel
+
+  print(f"database: {database}")
+  database.create()
+
+

{dao_ai-0.0.21 → dao_ai-0.0.23}/notebooks/04_unity_catalog_tools.py

@@ -6,8 +6,37 @@
 
 # COMMAND ----------
 
-dbutils.widgets.text(name="config-path", defaultValue="../config/model_config.yaml")
-config_path: str = dbutils.widgets.get("config-path")
+from typing import Sequence
+import os
+
+def find_yaml_files_os_walk(base_path: str) -> Sequence[str]:
+    if not os.path.exists(base_path):
+        raise FileNotFoundError(f"Base path does not exist: {base_path}")
+    
+    if not os.path.isdir(base_path):
+        raise NotADirectoryError(f"Base path is not a directory: {base_path}")
+    
+    yaml_files = []
+    
+    for root, dirs, files in os.walk(base_path):
+        for file in files:
+            if file.lower().endswith(('.yaml', '.yml')):
+                yaml_files.append(os.path.join(root, file))
+    
+    return sorted(yaml_files)
+
+# COMMAND ----------
+
+dbutils.widgets.text(name="config-path", defaultValue="")
+
+config_files: Sequence[str] = find_yaml_files_os_walk("../config")
+dbutils.widgets.dropdown(name="config-paths", choices=config_files, defaultValue=next(iter(config_files), ""))
+
+config_path: str | None = dbutils.widgets.get("config-path") or None
+project_path: str = dbutils.widgets.get("config-paths") or None
+
+config_path: str = config_path or project_path
+
 print(config_path)
 
 # COMMAND ----------

dao_ai-0.0.21/notebooks/03_generate_evaluation_data.py → dao_ai-0.0.23/notebooks/06_generate_evaluation_data.py

@@ -6,8 +6,37 @@
 
 # COMMAND ----------
 
-dbutils.widgets.text(name="config-path", defaultValue="../config/model_config.yaml")
-config_path: str = dbutils.widgets.get("config-path")
+from typing import Sequence
+import os
+
+def find_yaml_files_os_walk(base_path: str) -> Sequence[str]:
+    if not os.path.exists(base_path):
+        raise FileNotFoundError(f"Base path does not exist: {base_path}")
+    
+    if not os.path.isdir(base_path):
+        raise NotADirectoryError(f"Base path is not a directory: {base_path}")
+    
+    yaml_files = []
+    
+    for root, dirs, files in os.walk(base_path):
+        for file in files:
+            if file.lower().endswith(('.yaml', '.yml')):
+                yaml_files.append(os.path.join(root, file))
+    
+    return sorted(yaml_files)
+
+# COMMAND ----------
+
+dbutils.widgets.text(name="config-path", defaultValue="")
+
+config_files: Sequence[str] = find_yaml_files_os_walk("../config")
+dbutils.widgets.dropdown(name="config-paths", choices=config_files, defaultValue=next(iter(config_files), ""))
+
+config_path: str | None = dbutils.widgets.get("config-path") or None
+project_path: str = dbutils.widgets.get("config-paths") or None
+
+config_path: str = config_path or project_path
+
 print(config_path)
 
 # COMMAND ----------