@datarecce/ui 0.1.41 → 0.2.0

package/recce-source/CLAUDE.md

@@ -1,483 +0,0 @@
-# CLAUDE.md
-
-This file provides guidance to Claude Code (claude.ai/code) when working with code in this repository.
-
-## Overview
-
-Recce is a data validation and review tool for dbt projects. It helps data teams preview, validate, and ship data
-changes with confidence by providing lineage visualization, data diffing, and collaborative review features.
-
-## Critical Constraints & Guidelines
-
-### Do NOT:
-
-- ❌ **Commit state files**: Never commit `recce_state.json` or any `state.json` files (contains user-specific runtime
-  state)
-- ❌ **Edit generated files**: Never edit files in `recce/data/` directly (auto-generated from `js/out/` during frontend
-  build)
-- ❌ **Break adapter interface**: All adapters must implement ALL `BaseAdapter` abstract methods (partial implementations
-  will fail at runtime)
-- ❌ **Skip Python version compatibility**: Any new dependencies must support Python 3.9+ (we test 3.9-3.13)
-- ❌ **Bypass frontend build**: If you modify frontend code, you MUST run `cd js && pnpm run build` to update
-  `recce/data/` before testing with `recce server`
-- ❌ **Use interactive git commands**: Never use `git rebase -i`, `git add -i`, or similar (interactive prompts don't
-  work in CLI context)
-- ❌ **Mix concerns across layers**: Keep strict separation between models, tasks, APIs, and adapters (see Code
-  Organization Philosophy below)
-
-### Always:
-
-- ✅ **Build frontend before testing**: When frontend changes are made, run `cd js && pnpm run build` then restart
-  `recce server`
-- ✅ **Test across dbt versions**: For adapter changes, run `make test-tox` to verify against dbt 1.6-1.9
-- ✅ **Use pre-commit hooks**: Automatically installed with `make install-dev` (handles Black, isort, flake8)
-- ✅ **Maintain state loader abstraction**: All state persistence must work with both `FileStateLoader` (local) and
-  `CloudStateLoader` (Recce Cloud)
-- ✅ **Update both base and current**: When modifying check logic, ensure changes work for both environments being
-  compared
-- ✅ **Follow monorepo structure**: Backend (Python) and frontend (TypeScript) are tightly coupled but maintain clear
-  boundaries
-
-## Git Development Practices
-
-### Branch Naming
-
-All new code MUST be developed in a branch with one of these prefixes, branched directly from `main`:
-
-- `feature/` - New features or enhancements
-- `fix/` - Bug fixes
-- `hotfix/` - Critical production fixes
-
-```bash
-# Create a new feature branch
-git checkout main
-git pull origin main
-git checkout -b feature/my-new-feature
-```
-
-### Commit Requirements
-
-**1. Sign-off (DCO):** Every commit MUST include a "Signed-off-by:" line per
-the [Developer Certificate of Origin](https://developercertificate.org/):
-
-```bash
-git commit -s -m "Your commit message"
-```
-
-**2. Semantic/Conventional Commits:** Use structured commit messages:
-
-```
-<type>(<scope>): <description>
-
-[optional body]
-
-[optional footer]
-Signed-off-by: Your Name <your.email@example.com>
-```
-
-**Types:**
-
-- `feat` - New feature
-- `fix` - Bug fix
-- `docs` - Documentation only
-- `style` - Formatting, no code change
-- `refactor` - Code change that neither fixes a bug nor adds a feature
-- `test` - Adding or updating tests
-- `chore` - Maintenance tasks (deps, build, CI)
-
-**Examples:**
-
-```bash
-git commit -s -m "feat(check): add timeline component for check events"
-git commit -s -m "fix(adapter): normalize column casing for Snowflake"
-git commit -s -m "docs: update CLAUDE.md with git practices"
-git commit -s -m "refactor(dataGrid): extract shared utilities"
-```
-
-## Code Organization Philosophy
-
-### Separation of Concerns
-
-```
-recce/
-├── models/          # Pure data structures (Pydantic), NO business logic
-├── apis/            # FastAPI routes, minimal logic (delegate to *_func.py)
-│   ├── *_api.py     # Route definitions only
-│   └── *_func.py    # Business logic for routes
-├── tasks/           # Pure execution logic, NO API awareness
-├── adapter/         # Platform abstraction, implements BaseAdapter
-├── state/           # Persistence layer, abstracts local vs cloud
-└── core.py          # RecceContext - central state coordinator
-```
-
-### Dependency Rules
-
-**What can import what:**
-
-- ✅ `apis/` can import from `models/`, `tasks/`, `adapter/`, `state/`
-- ✅ `tasks/` can import from `models/`, `adapter/` (but NOT from `apis/`)
-- ✅ `adapter/` can import from `models/` (but NOT from `tasks/` or `apis/`)
-- ✅ `state/` can import from `models/` only
-- ❌ Backend (`recce/`) NEVER imports from frontend (`js/`)
-- ❌ Frontend uses API clients (`lib/api/`) NEVER direct backend imports
-
-### Why This Matters
-
-- **Keeps task execution testable** without spinning up FastAPI server
-- **Allows adapter swapping** without breaking existing tasks
-- **Enables frontend builds** without Python environment
-- **Makes state persistence flexible** (local file vs cloud S3)
-- **Prevents circular dependencies** that cause import errors
-
-### Where to Add New Code
-
-| What You're Adding | Where It Goes                                      | What to Import                  |
-|--------------------|----------------------------------------------------|---------------------------------|
-| New check type     | `tasks/` (new Task class)                          | Can use adapter, models         |
-| New API endpoint   | `apis/*_api.py` (route) + `apis/*_func.py` (logic) | Can use tasks, models, adapter  |
-| New data model     | `models/` (Pydantic class)                         | Only standard library           |
-| Platform support   | `adapter/` (extend BaseAdapter)                    | Can use models only             |
-| State storage      | `state/` (extend RecceStateLoader)                 | Can use models only             |
-| UI component       | `js/src/components/`                               | Use API clients from `lib/api/` |
-| API client         | `js/src/lib/api/`                                  | Axios, React Query              |
-
-## Architecture & Tech Stack
-
-### Monolithic Client-Server Application
-
-### Backend (Python)
-
-- **Python 3.9-3.13** (primary development: 3.10-3.12)
-- **FastAPI** - REST API server
-- **Click** - CLI framework
-- **Pydantic** - Data models and validation
-- **dbt adapters** - Platform-specific database connections
-
-- FastAPI REST server that serves static frontend and provides APIs for runs/checks
-- CLI built with Click (`recce server`, `recce run`)
-- Adapter pattern abstracts different data platforms (dbt-core, SQLMesh)
-- Task execution engine runs validation checks asynchronously
-- State management supports local file storage or Recce Cloud
-
-### Frontend (TypeScript/React)
-
-- **Node.js >=20** - JavaScript runtime
-- **pnpm 10.25.0** - Package manager (NOT npm or yarn)
-- **Next.js 16.0.10** - React framework with App Router
-- **React 19.2.3** - UI library with new JSX transform
-- **TypeScript 5.9** - Type safety
-- **Chakra UI 3** - Component library
-- **Biome 2.3** - Fast linter and formatter (replaces ESLint + Prettier)
-- **Tailwind CSS 4** - Utility-first CSS
-- **CodeMirror 6** - Code editor (SQL, YAML support)
-- **React Query 5** - API state management
-- **Reactflow 12** - Lineage graph visualization
-
-- Next.js 16 app built with React 19, compiled to static files
-- UI built with Chakra UI + Tailwind CSS
-- React Query handles API communication and state management
-- Reactflow for lineage graph visualization
-- Built frontend is embedded in Python package at `recce/data/`
-
-**Key Design Patterns:**
-
-- **Pluggable Adapter Pattern**: `BaseAdapter` interface allows support for different data platforms (dbt, SQLMesh).
-  Each adapter implements platform-specific lineage parsing, model retrieval, and SQL generation.
-- **In-Memory State with Persistence**: `RecceContext` holds runtime state (runs, checks, adapter). `CheckDAO` and
-  `RunDAO` provide in-memory storage. `RecceStateLoader` abstraction supports `FileStateLoader` (local JSON) or
-  `CloudStateLoader` (S3 sync).
-- **Task-Based Check Execution**: Each check type (profile_diff, value_diff, row_count_diff, etc.) maps to a `Task`
-  class. Tasks are submitted asynchronously via FastAPI, and frontend polls for completion.
-- **Static Frontend Bundling**: Next.js builds to static HTML/JS in `js/out/`, which is moved to `recce/data/` and
-  served by FastAPI at runtime. No Node.js needed in production.
-
-## Project Structure
-
-```
-recce/                     # Backend (Python)
-├── apis/                  # FastAPI route handlers
-├── adapter/               # dbt/SQLMesh adapter implementations
-├── models/                # Pydantic data models
-├── tasks/                 # Async check execution (QueryTask, DiffTask, etc.)
-├── state/                 # State persistence (FileStateLoader, CloudStateLoader)
-├── util/cloud/            # Recce Cloud API clients
-├── config.py              # recce.yml config loading
-└── data/                  # GENERATED - DO NOT EDIT (from js/out/)
-
-js/                        # Frontend (Next.js)
-├── src/
-│   ├── app/               # Next.js App Router pages
-│   ├── lib/
-│   │   ├── api/           # API client files (checks.ts, runs.ts, checkEvents.ts)
-│   │   └── hooks/         # React contexts & custom hooks
-│   ├── components/        # React components
-│   │   ├── lineage/       # Lineage visualization
-│   │   ├── check/         # Check management UI
-│   │   │   └── timeline/  # Check Events timeline (cloud-only)
-│   │   ├── run/           # Run execution UI
-│   │   └── editor/        # CodeMirror editor components
-│   ├── constants/
-│   └── utils/
-├── biome.json             # Biome linter & formatter config
-└── package.json
-```
-
-## Development Commands
-
-### Backend (Python)
-
-Note that `dbt-core` is
-currently [compatible with Python 3.13 for v1.11 and above](https://docs.getdbt.com/faqs/Core/install-python-compatibility).
-Use Python 3.12 for better compatibility.
-
-```bash
-# Install in development mode with dev dependencies
-make install-dev
-# OR
-pip install -e .[dev]
-pre-commit install
-
-# Run the server locally
-recce server
-
-# Code formatting (Black + isort) - ALWAYS run first
-make format
-
-# Code quality checks (no modifications)
-make check
-
-# Linting only
-make flake8
-
-# Run tests
-make test
-pytest tests
-
-# Run tests with coverage
-make test-coverage
-
-# Test across multiple dbt versions (1.6-1.9)
-make test-tox
-
-# Test across multiple Python versions (3.9-3.13)
-make test-tox-python-versions
-```
-
-### Frontend (TypeScript/React)
-
-```bash
-# Install frontend dependencies (pnpm ONLY, NOT npm or yarn)
-cd js
-pnpm install
-
-# Run Next.js dev server with Turbopack from js/ directory
-pnpm dev
-# OR from root
-make dev
-
-# Build frontend (outputs to js/out/, then moves to recce/data/) from js/ directory
-pnpm run build
-
-# Linting and formatting (Biome) from js/ directory
-pnpm lint          # Check for issues
-pnpm lint:fix      # Auto-fix issues
-
-# Type checking from js/ directory
-pnpm type:check
-
-# Tests from js/ directory
-pnpm test
-pnpm test:cov      # With coverage
-
-# Clean build artifacts from js/ directory
-pnpm run clean
-```
-
-### Full Build Workflow
-
-When you modify frontend code and want to test it with the Python backend:
-
-1. Build frontend: `cd js && pnpm run build`
-2. This automatically moves built files to `recce/data/`
-3. Run backend: `recce server`
-
-## Architecture
-
-### Monolithic Client-Server Application
-
-**Backend (Python/FastAPI):**
-
-- FastAPI REST server that serves static frontend and provides APIs for runs/checks
-- CLI built with Click (`recce server`, `recce run`)
-- Adapter pattern abstracts different data platforms (dbt-core, SQLMesh)
-- Task execution engine runs validation checks asynchronously
-- State management supports local file storage or Recce Cloud
-
-**Frontend (TypeScript/React):**
-
-- Next.js 16 app built with React 19, compiled to static files
-- UI built with Chakra UI 3 + Tailwind CSS 4
-- React Query handles API communication and state management
-- Reactflow for lineage graph visualization
-- CodeMirror 6 for SQL/YAML editing
-- Built frontend is embedded in Python package at `recce/data/`
-
-### Check Execution Flow
-
-1. User creates a check via UI
-2. Frontend POSTs to `/api/checks` → `check_func.py` creates check
-3. User runs check → Frontend POSTs to `/api/runs` → `run_func.py` submits task
-4. Backend executes task asynchronously using appropriate `Task` class
-5. Frontend polls `/api/runs/{run_id}/wait` for completion
-6. Results stored in `Run` object with status tracking
-
-### Adapter Pattern
-
-- Adapters are loaded dynamically based on CLI flags (`--sqlmesh`)
-- Each adapter must implement `BaseAdapter` interface:
-  - `get_lineage()` - Return DAG structure
-  - `get_model()` - Retrieve model details
-  - `execute_sql()` - Run SQL queries
-  - Platform-specific artifact parsing (manifest, catalog, etc.)
-
-### Warehouse-Resilient Naming
-
-Different SQL warehouses return column names in different cases:
-
-- **Snowflake**: UPPERCASE
-- **PostgreSQL/Redshift**: lowercase
-- **BigQuery**: preserves original case
-
-Backend normalizes column names to ensure consistency:
-
-- `primary_keys` are normalized to match actual column casing
-- Boolean flag columns (`in_a`, `in_b`) are always lowercase
-- Quote stripping for SQL identifiers (`"col"`, `` `col` ``, `[col]`)
-
-See `recce/tasks/utils.py` for normalization functions.
-
-## Cloud-Only Features
-
-### Check Events Timeline
-
-GitHub PR-style discussion feature for checks, only available when connected to Recce Cloud.
-
-**Event Types:**
-
-- `check_created` - Initial check creation
-- `comment` - User comments (supports edit/delete)
-- `approval_change` - Check approval status changes
-- `description_change` - Check description updates
-- `name_change` - Check name updates
-- `preset_applied` - Preset configuration applied
-
-**Key Files:**
-
-- Backend: `recce/apis/check_events_api.py`, `recce/util/cloud/check_events.py`
-- Frontend: `js/src/lib/api/checkEvents.ts`, `js/src/lib/hooks/useCheckEvents.ts`
-- Components: `js/src/components/check/timeline/`
-
-## Code Style
-
-### Python
-
-- **Black** (line length 120) + **isort** (profile: black) + **flake8**
-- Pre-commit hooks configured in `.pre-commit-config.yaml`
-- Always run `make format` before `make check`
-
-### TypeScript/React
-
-- **Biome 2.3** - Fast linter and formatter (replaces ESLint + Prettier)
-- Double quotes for strings
-- Space indentation
-- React 19 JSX transform (no React import needed)
-- Key rules: `noExplicitAny`, `useExhaustiveDependencies`, `noUnusedVariables`
-- Git hooks: `.husky/pre-commit` runs `pnpm lint:staged` and `pnpm type:check`
-
-## Testing Strategy
-
-- **Python Unit Tests**: `pytest` in `tests/` directory
-- **Frontend Tests**: Jest 30 + React Testing Library in `js/`
-- **Integration Tests**: Separate CI jobs in `integration_tests/` for dbt and SQLMesh
-- **Multi-Version Testing**: Tox for testing against dbt 1.6-1.9 and Python 3.9-3.13
-- **Property-Based Testing**: fast-check for data grid utilities
-
-## CI/CD
-
-- **tests-python.yaml**: Python unit tests on multiple versions
-- **tests-js.yaml**: Frontend linting (Biome) and tests
-- **build-statics.yaml**: Auto-builds and commits frontend when merged to main
-- **integration-tests.yaml**: Full dbt project tests
-- **release.yaml**: Builds and publishes to PyPI on version tags
-- **nightly.yaml**: Runs full test matrix nightly
-
-## Working with the Codebase
-
-### Adding a New Check Type
-
-1. Create a new task class in `recce/tasks/` extending `Task`
-2. Implement `execute()` method with check logic
-3. Add run type enum to `recce/models/types.py`
-4. Add API handler in `recce/apis/run_func.py`
-5. Create frontend UI component in `js/src/components/`
-6. Add API client method in `js/src/lib/api/`
-7. Update validation in `recce/config.py` for `recce.yml` support
-
-### Adding a New Adapter
-
-1. Create new adapter file in `recce/adapter/` extending `BaseAdapter`
-2. Implement all abstract methods (get_lineage, get_model, execute_sql, etc.)
-3. Add CLI flag in `recce/cli.py` to load new adapter
-4. Update `RecceContext` initialization to support new adapter type
-5. Add integration tests in `integration_tests/`
-
-### Debugging
-
-- Backend logs to console and `recce_error.log`
-- Frontend development: Use React DevTools and browser console
-- Use `recce server --debug` for verbose logging
-- Run `recce debug` to check artifact/connection issues
-
-## Distribution
-
-- **PyPI Package**: `pip install recce`
-- **Entry Point**: `recce` CLI command → `recce.cli:cli`
-- **Embedded Frontend**: Static files bundled in Python package at install time
-- **Self-Contained**: Single pip install provides full stack (no separate Node deployment)
-
-## Version Management
-
-- Single source of truth: `recce/VERSION` file
-- Read by `setup.py` for package versioning
-- Frontend reads at runtime for display
-- Server checks PyPI on startup to notify about updates
-
-## Common Errors & Fixes
-
-**Frontend changes not appearing:**
-
-- Run `cd js && pnpm run build` then restart `recce server`
-
-**Python import errors:**
-
-- Run `pip install -e .[dev]` to reinstall in editable mode
-
-**Biome lint failures:**
-
-- Run `pnpm lint:fix` to auto-fix, then manually fix remaining issues
-
-**Type errors during build:**
-
-- Run `pnpm type:check` for detailed error messages
-
-**Test failures:**
-
-- Check if dbt artifacts exist in `integration_tests/dbt/target`
-- Try fresh install: `pip uninstall recce && make install-dev`
-
----
-
-## Individual Preferences
-
-- @~/.claude/recce.md
-- signoff commits with `git commit -h`

package/recce-source/CODE_OF_CONDUCT.md

@@ -1,128 +0,0 @@
-# Contributor Covenant Code of Conduct
-
-## Our Pledge
-
-We as members, contributors, and leaders pledge to make participation in our
-community a harassment-free experience for everyone, regardless of age, body
-size, visible or invisible disability, ethnicity, sex characteristics, gender
-identity and expression, level of experience, education, socio-economic status,
-nationality, personal appearance, race, religion, or sexual identity
-and orientation.
-
-We pledge to act and interact in ways that contribute to an open, welcoming,
-diverse, inclusive, and healthy community.
-
-## Our Standards
-
-Examples of behavior that contributes to a positive environment for our
-community include:
-
-* Demonstrating empathy and kindness toward other people
-* Being respectful of differing opinions, viewpoints, and experiences
-* Giving and gracefully accepting constructive feedback
-* Accepting responsibility and apologizing to those affected by our mistakes,
-  and learning from the experience
-* Focusing on what is best not just for us as individuals, but for the
-  overall community
-
-Examples of unacceptable behavior include:
-
-* The use of sexualized language or imagery, and sexual attention or
-  advances of any kind
-* Trolling, insulting or derogatory comments, and personal or political attacks
-* Public or private harassment
-* Publishing others' private information, such as a physical or email
-  address, without their explicit permission
-* Other conduct which could reasonably be considered inappropriate in a
-  professional setting
-
-## Enforcement Responsibilities
-
-Community leaders are responsible for clarifying and enforcing our standards of
-acceptable behavior and will take appropriate and fair corrective action in
-response to any behavior that they deem inappropriate, threatening, offensive,
-or harmful.
-
-Community leaders have the right and responsibility to remove, edit, or reject
-comments, commits, code, wiki edits, issues, and other contributions that are
-not aligned to this Code of Conduct, and will communicate reasons for moderation
-decisions when appropriate.
-
-## Scope
-
-This Code of Conduct applies within all community spaces, and also applies when
-an individual is officially representing the community in public spaces.
-Examples of representing our community include using an official e-mail address,
-posting via an official social media account, or acting as an appointed
-representative at an online or offline event.
-
-## Enforcement
-
-Instances of abusive, harassing, or otherwise unacceptable behavior may be
-reported to the community leaders responsible for enforcement at
-conduct@infuseai.io.
-All complaints will be reviewed and investigated promptly and fairly.
-
-All community leaders are obligated to respect the privacy and security of the
-reporter of any incident.
-
-## Enforcement Guidelines
-
-Community leaders will follow these Community Impact Guidelines in determining
-the consequences for any action they deem in violation of this Code of Conduct:
-
-### 1. Correction
-
-**Community Impact**: Use of inappropriate language or other behavior deemed
-unprofessional or unwelcome in the community.
-
-**Consequence**: A private, written warning from community leaders, providing
-clarity around the nature of the violation and an explanation of why the
-behavior was inappropriate. A public apology may be requested.
-
-### 2. Warning
-
-**Community Impact**: A violation through a single incident or series
-of actions.
-
-**Consequence**: A warning with consequences for continued behavior. No
-interaction with the people involved, including unsolicited interaction with
-those enforcing the Code of Conduct, for a specified period of time. This
-includes avoiding interactions in community spaces as well as external channels
-like social media. Violating these terms may lead to a temporary or
-permanent ban.
-
-### 3. Temporary Ban
-
-**Community Impact**: A serious violation of community standards, including
-sustained inappropriate behavior.
-
-**Consequence**: A temporary ban from any sort of interaction or public
-communication with the community for a specified period of time. No public or
-private interaction with the people involved, including unsolicited interaction
-with those enforcing the Code of Conduct, is allowed during this period.
-Violating these terms may lead to a permanent ban.
-
-### 4. Permanent Ban
-
-**Community Impact**: Demonstrating a pattern of violation of community
-standards, including sustained inappropriate behavior, harassment of an
-individual, or aggression toward or disparagement of classes of individuals.
-
-**Consequence**: A permanent ban from any sort of public interaction within
-the community.
-
-## Attribution
-
-This Code of Conduct is adapted from the [Contributor Covenant][homepage],
-version 2.0, available at
-https://www.contributor-covenant.org/version/2/0/code_of_conduct.html.
-
-Community Impact Guidelines were inspired by [Mozilla's code of conduct
-enforcement ladder](https://github.com/mozilla/diversity).
-
-[homepage]: https://www.contributor-covenant.org
-
-For answers to common questions about this code of conduct, see the FAQ at
-https://www.contributor-covenant.org/faq. Translations are available at
-https://www.contributor-covenant.org/translations.