database-tycoon 0.1.0__tar.gz

database_tycoon-0.1.0/.github/workflows/publish.yml

@@ -0,0 +1,38 @@
+name: Publish to PyPI
+on:
+  push:
+    tags:
+      - "v*"
+jobs:
+  build:
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v4
+      - uses: astral-sh/setup-uv@v4
+      - run: uv build
+      - uses: actions/upload-artifact@v4
+        with:
+          name: dist
+          path: dist/
+  publish-testpypi:
+    needs: build
+    runs-on: ubuntu-latest
+    environment: testpypi
+    permissions:
+      id-token: write
+    steps:
+      - uses: actions/download-artifact@v4
+        with: {name: dist, path: dist/}
+      - uses: pypa/gh-action-pypi-publish@release/v1
+        with:
+          repository-url: https://test.pypi.org/legacy/
+  publish-pypi:
+    needs: publish-testpypi
+    runs-on: ubuntu-latest
+    environment: pypi
+    permissions:
+      id-token: write
+    steps:
+      - uses: actions/download-artifact@v4
+        with: {name: dist, path: dist/}
+      - uses: pypa/gh-action-pypi-publish@release/v1

database_tycoon-0.1.0/.gitignore

@@ -0,0 +1,67 @@
+# Python
+__pycache__/
+*.py[cod]
+*.egg-info/
+dist/
+build/
+*.egg
+.pytest_cache/
+
+# Virtual environments
+.venv/
+venv/
+
+# DuckDB
+*.duckdb
+*.duckdb.wal
+data/
+!data/README.md
+
+# dbt
+transformation/target/
+transformation/dbt_packages/
+transformation/logs/
+dbt_project/target/
+dbt_project/dbt_packages/
+dbt_project/logs/
+
+# Rill
+rill/tmp/
+
+# IDE
+.idea/
+.vscode/
+*.swp
+
+# OS
+.DS_Store
+
+# Demo
+.demo_pids
+
+# DuckLake
+ducklake_data/
+
+# Dagster runtime state
+dagster_home/
+.tmp_dagster_home_*/
+.tycoon/dagster/
+
+# AI tool configs (machine-specific)
+.aider*
+.claude/
+.config/
+.gemini/
+ai-workbench/
+
+# Nao analytics agent (auto-generated context, not source code)
+.tycoon/nao/databases/
+.tycoon/nao/repos/
+.tycoon/nao/agent/
+
+# tycoon runtime state (PIDs, locks, local nao/dagster config)
+.tycoon/
+logs/
+.claude/worktrees/
+
+gha-creds-*.json

database_tycoon-0.1.0/CHANGELOG.md

@@ -0,0 +1,50 @@
+All notable changes to this project will be documented in this file. The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/), and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
+
+## [0.1.0] - 2026-04-09
+
+### Added
+
+#### Core CLI
+- `tycoon init` — scaffold a new project with templates: `csv-import`, `github-analytics`, `nyc-transit`, `weather-station`
+- `tycoon doctor` — environment diagnostics (checks dbt, Rill, warehouse config, and stack config)
+- `tycoon check-updates` — check PyPI for a newer version of the package
+
+#### Data Pipeline
+- `tycoon data sources catalog` — browse available source integrations
+- `tycoon data sources add <type>` — interactively register a source; auto-installs dlt packages on demand
+- `tycoon data sources list` — list all registered sources
+- `tycoon data sources show <name>` — inspect a registered source
+- `tycoon data sources run <name>` — ingest a source via dlt into DuckDB
+- `tycoon data sources run-all` — ingest all registered sources
+- `tycoon data sources status` — show freshness and row counts per source
+- `tycoon data transform run` — run `dbt build`
+- `tycoon data analyze <source>` — auto-scaffold dbt staging models from raw schema; `--rill` flag generates Rill dashboards
+- `tycoon data db query <sql>` — query the local DuckDB warehouse directly
+
+#### Services
+- `tycoon start` / `tycoon stop` — start/stop Rill, Dagster, Nao, and DuckDB UI
+- `tycoon run <tool>` — passthrough runner for `dbt`, `dlt`, `rill`, and `dagster`
+
+#### AI Queries (requires `tycoon[ask]`)
+- `tycoon ask init` — initialize the natural language query index
+- `tycoon ask sync` — sync the index with the current warehouse schema
+- `tycoon ask chat` — natural language queries via Nao (Ollama supported, no API key needed)
+
+#### Source Catalog (downloaded on demand via dlt)
+- `rest_api` — any REST API; defaults to PokéAPI demo (no credentials needed)
+- `filesystem` — CSV and Parquet files from local paths
+- `github` — commits, issues, pull requests, repositories
+- `slack` — channels, messages, users
+- `stripe` — customers, invoices, products, subscriptions
+- `hubspot` — companies, contacts, deals, tickets
+- `notion` — databases, pages, users
+
+#### Optional Extras
+- `tycoon[dagster]` — Dagster orchestration with full asset graph
+- `tycoon[ask]` — Nao + Ibis for natural language querying
+
+### Known Limitations
+- Snowflake and BigQuery warehouses are not yet supported (planned for a future release)
+- `tycoon start --only rill` requires a `rill/` project directory initialized with `rill init`
+
+[0.1.0]: https://github.com/Database-Tycoon/tycoon-cli/releases/tag/v0.1.0

database_tycoon-0.1.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Database Tycoon Team
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

database_tycoon-0.1.0/PKG-INFO

@@ -0,0 +1,222 @@
+Metadata-Version: 2.4
+Name: database-tycoon
+Version: 0.1.0
+Summary: Database Tycoon — local-first analytics CLI that adapts to your existing data stack
+Project-URL: Homepage, https://github.com/Database-Tycoon/tycoon-cli
+Project-URL: Repository, https://github.com/Database-Tycoon/tycoon-cli
+Project-URL: Issues, https://github.com/Database-Tycoon/tycoon-cli/issues
+Author: Database Tycoon Team
+License: MIT
+License-File: LICENSE
+Keywords: analytics,cli,data,dbt,dlt,duckdb
+Classifier: Development Status :: 3 - Alpha
+Classifier: Intended Audience :: Developers
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Topic :: Database
+Requires-Python: >=3.12
+Requires-Dist: dbt-core==1.11.8
+Requires-Dist: dbt-duckdb==1.10.1
+Requires-Dist: dlt[duckdb]==1.24.0
+Requires-Dist: duckdb==1.5.1
+Requires-Dist: httpx==0.28.1
+Requires-Dist: pydantic==2.12.5
+Requires-Dist: pyyaml==6.0.3
+Requires-Dist: rich==14.3.3
+Requires-Dist: typer==0.24.1
+Provides-Extra: ask
+Requires-Dist: ibis-framework[duckdb]==12.0.0; extra == 'ask'
+Requires-Dist: nao-core==0.0.59; extra == 'ask'
+Provides-Extra: dagster
+Requires-Dist: dagster-dbt==0.28.20; extra == 'dagster'
+Requires-Dist: dagster-dlt==0.28.20; extra == 'dagster'
+Requires-Dist: dagster-webserver==1.12.20; extra == 'dagster'
+Requires-Dist: dagster==1.12.20; extra == 'dagster'
+Provides-Extra: server
+Requires-Dist: fastapi==0.135.3; extra == 'server'
+Requires-Dist: uvicorn[standard]==0.44.0; extra == 'server'
+Requires-Dist: websockets==16.0; extra == 'server'
+Description-Content-Type: text/markdown
+
+# tycoon
+
+A pip-installable CLI that wires dlt → DuckDB → dbt → Rill into a working local analytics stack. No Docker, no cloud account required.
+
+**Adaptable**: bring your own ingestion (Airbyte, Fivetran), warehouse (Snowflake, BigQuery, MotherDuck), dbt project, BI tool, or orchestrator — `tycoon init` asks before it assumes.
+
+---
+
+## Install
+
+Requires Python >= 3.12.
+
+```bash
+pip install database-tycoon
+# or
+uv add database-tycoon
+```
+
+Optional extras:
+
+```bash
+pip install "database-tycoon[dagster]"   # Dagster orchestration
+pip install "database-tycoon[ask]"       # AI natural language queries (Ollama supported)
+```
+
+---
+
+## Quickstart
+
+The fastest path to a working dashboard uses the PokéAPI — no credentials, no signup.
+
+```bash
+# 1. Create a project
+mkdir my-project && cd my-project
+tycoon init --template csv-import
+
+# 2. Add the PokéAPI as a source (press Enter twice for defaults)
+tycoon data sources add rest_api
+
+# 3. Ingest into DuckDB
+tycoon data sources run pokeapi
+
+# 4. Scaffold dbt models and generate Rill dashboards
+tycoon data analyze pokeapi --rill
+
+# 5. Open Rill
+tycoon start --only rill
+```
+
+Rill opens at `http://localhost:9009` with `pokemon`, `berry`, and `type` tables ready to explore.
+
+Already have a pipeline? `tycoon init` will ask about your ingestion tool, warehouse, dbt project, BI tool, and orchestrator — and configure itself around what you already have.
+
+---
+
+## CLI Reference
+
+| Command | Description |
+|---|---|
+| `tycoon init` | Scaffold a new project |
+| `tycoon data sources catalog` | Browse available source integrations |
+| `tycoon data sources add <type>` | Register a new data source |
+| `tycoon data sources list` | List sources configured in this project |
+| `tycoon data sources list show <name>` | Show detailed config for a source |
+| `tycoon data sources run <name>` | Run ingestion for a named source |
+| `tycoon data sources run-all` | Run ingestion for all sources |
+| `tycoon data transform run` | Run dbt transformations |
+| `tycoon data analyze <source>` | Scaffold dbt staging models; add `--rill` to also generate dashboards |
+| `tycoon data db query <sql>` | Run a SQL query against the warehouse |
+| `tycoon data run-all` | Ingest all sources then run dbt build |
+| `tycoon data status` | Show freshness and row counts for each source |
+| `tycoon start` | Start Rill, Dagster, Nao, and the web UI |
+| `tycoon stop` | Stop all services |
+| `tycoon ask chat` | Query your data in natural language (Nao) |
+| `tycoon run <tool>` | Passthrough to dbt, dlt, rill, dagster |
+
+---
+
+## tycoon.yml Reference
+
+```yaml
+name: my-project
+version: 0.1.0
+
+database:
+  raw: data/raw.duckdb              # dlt output (or md: URI for MotherDuck)
+  warehouse: data/warehouse.duckdb  # dbt output — read by Rill and Nao
+
+dbt_project_dir: dbt_project   # path to dbt project (yours or tycoon-scaffolded)
+rill_dir: rill                 # path to Rill dashboard definitions
+
+stack:                         # generated by tycoon init — edit as needed
+  ingestion: dlt               # dlt | airbyte | fivetran | meltano | none
+  ingestion_managed: true      # false = tycoon won't run `data sources run`
+  warehouse: duckdb            # duckdb | motherduck | snowflake | bigquery | other
+  transformation_managed: true # false = tycoon won't scaffold or overwrite dbt
+  bi: rill                     # rill | metabase | looker | tableau | other | none
+  bi_managed: true             # false = tycoon won't start Rill
+  orchestrator: dagster        # dagster | airflow | prefect | other | none
+  orchestrator_managed: true   # false = tycoon won't start Dagster
+
+sources:
+  my-github:
+    type: github               # matches a catalog source name
+    schema: raw_github         # schema name in the raw DuckDB file
+    config:
+      access_token: ${GITHUB_TOKEN}   # env vars are interpolated
+      owner: my-org
+      repo: my-repo
+
+ask:                           # optional — requires tycoon[ask]
+  llm:
+    provider: ollama           # fully local, no API key required
+  port: 5005
+```
+
+Each source produces its own raw DuckDB file: `data/raw_<source>.duckdb`. All sources write into `data/warehouse.duckdb` after transformation.
+
+---
+
+## Catalog Sources
+
+These sources are available via `tycoon data sources add <name>`. They are downloaded on demand via `dlt init` and not bundled in the package.
+
+| Source | Category | Key Tables |
+|---|---|---|
+| `github` | Developer | commits, issues, pull_requests, repositories |
+| `slack` | Communication | channels, messages, users |
+| `stripe` | Finance | customers, invoices, products, subscriptions |
+| `hubspot` | CRM | companies, contacts, deals, tickets |
+| `notion` | Knowledge | databases, pages, users |
+
+---
+
+## Data Directory
+
+Raw DuckDB files follow the naming convention `raw_<source>.duckdb` (written by ingestion) while `warehouse.duckdb` is the single transformed database read by Rill and Nao. See `data/README.md` for details.
+
+---
+
+## Rill Dashboards
+
+Rill is a local-first BI tool. Dashboard definitions are YAML files in the `rill/` directory.
+Launch Rill via `tycoon start` or `tycoon start --only rill`.
+
+Auto-generate dashboards for a source after ingestion:
+
+```bash
+tycoon data analyze my-source --rill
+```
+
+This exports each raw table to Parquet, then generates Rill source, metrics view, and explore
+files — one dashboard per table. The `--rill` flag is opt-in; dashboard generation is skipped
+by default since it requires a Rill project directory (`rill/`) to already exist.
+
+**Architecture**: sources read from Parquet via Rill's `local_file` connector into its
+built-in in-memory OLAP. Dashboards are immediately usable without a dbt run.
+
+---
+
+## Optional Extras
+
+### Dagster orchestration (`tycoon[dagster]`)
+
+Installs Dagster, dagster-dbt, and dagster-dlt. Provides a full asset graph covering ingestion and transformation. Run the Dagster UI with:
+
+```bash
+dagster dev
+```
+
+The workspace is defined in `workspace.yaml` at the project root.
+
+### AI queries (`tycoon[ask]`)
+
+Installs Nao and Ibis for natural language querying of the warehouse. Requires a running LLM — Ollama (local) is supported out of the box with no API key.
+
+```bash
+tycoon ask init
+tycoon ask sync
+tycoon ask chat
+```

database_tycoon-0.1.0/README.md

@@ -0,0 +1,181 @@
+# tycoon
+
+A pip-installable CLI that wires dlt → DuckDB → dbt → Rill into a working local analytics stack. No Docker, no cloud account required.
+
+**Adaptable**: bring your own ingestion (Airbyte, Fivetran), warehouse (Snowflake, BigQuery, MotherDuck), dbt project, BI tool, or orchestrator — `tycoon init` asks before it assumes.
+
+---
+
+## Install
+
+Requires Python >= 3.12.
+
+```bash
+pip install database-tycoon
+# or
+uv add database-tycoon
+```
+
+Optional extras:
+
+```bash
+pip install "database-tycoon[dagster]"   # Dagster orchestration
+pip install "database-tycoon[ask]"       # AI natural language queries (Ollama supported)
+```
+
+---
+
+## Quickstart
+
+The fastest path to a working dashboard uses the PokéAPI — no credentials, no signup.
+
+```bash
+# 1. Create a project
+mkdir my-project && cd my-project
+tycoon init --template csv-import
+
+# 2. Add the PokéAPI as a source (press Enter twice for defaults)
+tycoon data sources add rest_api
+
+# 3. Ingest into DuckDB
+tycoon data sources run pokeapi
+
+# 4. Scaffold dbt models and generate Rill dashboards
+tycoon data analyze pokeapi --rill
+
+# 5. Open Rill
+tycoon start --only rill
+```
+
+Rill opens at `http://localhost:9009` with `pokemon`, `berry`, and `type` tables ready to explore.
+
+Already have a pipeline? `tycoon init` will ask about your ingestion tool, warehouse, dbt project, BI tool, and orchestrator — and configure itself around what you already have.
+
+---
+
+## CLI Reference
+
+| Command | Description |
+|---|---|
+| `tycoon init` | Scaffold a new project |
+| `tycoon data sources catalog` | Browse available source integrations |
+| `tycoon data sources add <type>` | Register a new data source |
+| `tycoon data sources list` | List sources configured in this project |
+| `tycoon data sources list show <name>` | Show detailed config for a source |
+| `tycoon data sources run <name>` | Run ingestion for a named source |
+| `tycoon data sources run-all` | Run ingestion for all sources |
+| `tycoon data transform run` | Run dbt transformations |
+| `tycoon data analyze <source>` | Scaffold dbt staging models; add `--rill` to also generate dashboards |
+| `tycoon data db query <sql>` | Run a SQL query against the warehouse |
+| `tycoon data run-all` | Ingest all sources then run dbt build |
+| `tycoon data status` | Show freshness and row counts for each source |
+| `tycoon start` | Start Rill, Dagster, Nao, and the web UI |
+| `tycoon stop` | Stop all services |
+| `tycoon ask chat` | Query your data in natural language (Nao) |
+| `tycoon run <tool>` | Passthrough to dbt, dlt, rill, dagster |
+
+---
+
+## tycoon.yml Reference
+
+```yaml
+name: my-project
+version: 0.1.0
+
+database:
+  raw: data/raw.duckdb              # dlt output (or md: URI for MotherDuck)
+  warehouse: data/warehouse.duckdb  # dbt output — read by Rill and Nao
+
+dbt_project_dir: dbt_project   # path to dbt project (yours or tycoon-scaffolded)
+rill_dir: rill                 # path to Rill dashboard definitions
+
+stack:                         # generated by tycoon init — edit as needed
+  ingestion: dlt               # dlt | airbyte | fivetran | meltano | none
+  ingestion_managed: true      # false = tycoon won't run `data sources run`
+  warehouse: duckdb            # duckdb | motherduck | snowflake | bigquery | other
+  transformation_managed: true # false = tycoon won't scaffold or overwrite dbt
+  bi: rill                     # rill | metabase | looker | tableau | other | none
+  bi_managed: true             # false = tycoon won't start Rill
+  orchestrator: dagster        # dagster | airflow | prefect | other | none
+  orchestrator_managed: true   # false = tycoon won't start Dagster
+
+sources:
+  my-github:
+    type: github               # matches a catalog source name
+    schema: raw_github         # schema name in the raw DuckDB file
+    config:
+      access_token: ${GITHUB_TOKEN}   # env vars are interpolated
+      owner: my-org
+      repo: my-repo
+
+ask:                           # optional — requires tycoon[ask]
+  llm:
+    provider: ollama           # fully local, no API key required
+  port: 5005
+```
+
+Each source produces its own raw DuckDB file: `data/raw_<source>.duckdb`. All sources write into `data/warehouse.duckdb` after transformation.
+
+---
+
+## Catalog Sources
+
+These sources are available via `tycoon data sources add <name>`. They are downloaded on demand via `dlt init` and not bundled in the package.
+
+| Source | Category | Key Tables |
+|---|---|---|
+| `github` | Developer | commits, issues, pull_requests, repositories |
+| `slack` | Communication | channels, messages, users |
+| `stripe` | Finance | customers, invoices, products, subscriptions |
+| `hubspot` | CRM | companies, contacts, deals, tickets |
+| `notion` | Knowledge | databases, pages, users |
+
+---
+
+## Data Directory
+
+Raw DuckDB files follow the naming convention `raw_<source>.duckdb` (written by ingestion) while `warehouse.duckdb` is the single transformed database read by Rill and Nao. See `data/README.md` for details.
+
+---
+
+## Rill Dashboards
+
+Rill is a local-first BI tool. Dashboard definitions are YAML files in the `rill/` directory.
+Launch Rill via `tycoon start` or `tycoon start --only rill`.
+
+Auto-generate dashboards for a source after ingestion:
+
+```bash
+tycoon data analyze my-source --rill
+```
+
+This exports each raw table to Parquet, then generates Rill source, metrics view, and explore
+files — one dashboard per table. The `--rill` flag is opt-in; dashboard generation is skipped
+by default since it requires a Rill project directory (`rill/`) to already exist.
+
+**Architecture**: sources read from Parquet via Rill's `local_file` connector into its
+built-in in-memory OLAP. Dashboards are immediately usable without a dbt run.
+
+---
+
+## Optional Extras
+
+### Dagster orchestration (`tycoon[dagster]`)
+
+Installs Dagster, dagster-dbt, and dagster-dlt. Provides a full asset graph covering ingestion and transformation. Run the Dagster UI with:
+
+```bash
+dagster dev
+```
+
+The workspace is defined in `workspace.yaml` at the project root.
+
+### AI queries (`tycoon[ask]`)
+
+Installs Nao and Ibis for natural language querying of the warehouse. Requires a running LLM — Ollama (local) is supported out of the box with no API key.
+
+```bash
+tycoon ask init
+tycoon ask sync
+tycoon ask chat
+```

database_tycoon-0.1.0/data/README.md

@@ -0,0 +1,51 @@
+# data/
+
+This directory holds all DuckDB database files for the project. It is listed in `.gitignore` and is not committed to the repository.
+
+---
+
+## Files
+
+### Raw databases (dlt output)
+
+One file per source, written by dlt ingestion pipelines:
+
+```
+raw_<source>.duckdb
+```
+
+Examples:
+
+```
+raw_github.duckdb
+raw_slack.duckdb
+raw_stripe.duckdb
+```
+
+These files contain the raw schema as produced by dlt, including dlt metadata tables (`_dlt_loads`, `_dlt_pipeline_state`). They are attached **read-only** in the dbt profile to prevent transformation runs from writing back to the raw layer.
+
+### Warehouse database (dbt output)
+
+```
+warehouse.duckdb
+```
+
+Written by dbt transformation runs. This is the single database read by Rill dashboards and Nao AI queries. All mart and report models land here.
+
+---
+
+## Naming Convention
+
+| File | Written by | Read by |
+|---|---|---|
+| `raw_<source>.duckdb` | `tycoon data sources run <source>` | dbt (read-only attach) |
+| `warehouse.duckdb` | `tycoon data transform run` | Rill, Nao, `tycoon data db` |
+
+---
+
+## Notes
+
+- Do not manually edit or delete these files while a pipeline or dbt run is in progress.
+- To reset a source, delete its raw DuckDB file and re-run ingestion.
+- To reset the warehouse, delete `warehouse.duckdb` and re-run `tycoon data transform run`.
+- The `tycoon data db` command opens an interactive DuckDB shell on `warehouse.duckdb`.