aiex-cli 0.1.0 → 0.1.1-beta.2

package/README.md

@@ -32,13 +32,13 @@ aiex watch -s invoice -d ./watch_folder # watch folder daemon for automatic extr
 
 ## ✨ Features
 
-- **JSON Schema → SQLite** — Define tables as JSON Schema files, generate Drizzle ORM schema, and migrate to SQLite
+- **AIEX JSON Schema → SQLite** — Define tables with a Drizzle-backed JSON Schema dialect, generate Drizzle ORM schema, and migrate to SQLite
 - **Web Configuration & Viewer** — Browser-based UI for designing schemas, configuring integrations, previewing prompts, and browsing extracted data
 - **AI Extraction** — Extract structured data from files (text, images, PDFs) using any OpenAI-compatible provider (OpenAI, Anthropic, Ollama, DeepSeek, local models, etc.)
 - **Interactive Mode** — Run `aiex extract` without arguments for a guided extraction workflow
 - **Batch Mode** — `aiex extract -d <dir>` processes entire directories with optional glob filtering
 - **Incremental Extraction** — File hash deduplication skips already-processed files; use `--force` to override
-- **Data Dump** — `aiex dump` exports SQLite tables to CSV or Excel (.xlsx)
+- **Web Data Export** — Export SQLite table data to CSV, Excel (.xlsx), or JSON from the Web UI
 - **Notion Sync** — Optionally sync CLI extraction results to configured Notion data sources
 - **Extraction Audit Trail** — Every extraction is recorded with status, input source, output path, token usage, database inserts, Notion pages, and errors
 - **Built-in Model Registry** — Knows capabilities of 2000+ models (vision, structured output) so you don't have to guess
@@ -61,7 +61,7 @@ Opens a browser UI where you can visually design and manage your schemas, config
 aiex schema
 ```
 
-Converts your JSON Schema files into a SQLite database with full migration support.
+Converts AIEX JSON Schema files into a SQLite database with full migration support. AIEX uses a Drizzle-backed schema dialect rather than the full JSON Schema specification; see [Docs/schema-dialect.md](Docs/schema-dialect.md) for the supported mapping surface.
 
 ### 3. Extract Data
 
@@ -73,10 +73,6 @@ aiex extract -s <schema> -f <file> --no-insert     # extract and save JSON witho
 aiex extract -s <schema> -f <file> --force         # force re-extraction even if already processed
 aiex extract -s <schema> -d <directory>            # batch extract all supported files in a directory
 aiex extract -s <schema> -d <dir> -g "*.pdf"       # batch with glob filter
-aiex extract history                               # list extraction audit records
-aiex extract show <audit-id>                       # show full audit record JSON
-aiex extract retry <audit-id>                      # retry a previous extraction
-aiex extract rm <audit-id>                         # delete an audit record and cached upload
 ```
 
 The AI reads your document and outputs structured JSON matching your schema.
@@ -89,33 +85,21 @@ aiex extract -s paper -f research.pdf --no-insert  # save result only, skip data
 aiex extract -s paper -f research.pdf -m gpt-4o    # use a specific model
 aiex extract -s paper -f research.pdf --force      # force re-extraction even if already processed
 aiex extract -s paper -d ./papers -g "*.pdf"       # batch extract PDFs from a directory
-aiex extract history                               # inspect recent extraction runs
 ```
 Saves the extracted result to `.aiex/extracted/<schema-name>-<timestamp>.json` with fields like `title`, `firstAuthor`, `journal`, `year` — exactly as defined in your schema. Data is automatically inserted into the SQLite database.
 
 By default, aiex automatically selects a model based on your input type (vision-capable for images, structured output for text). Use `--model` / `-m` to override and specify any model from your AI configuration.
 
-Every extraction is also recorded under `.aiex/extracted/_audit/`. Audit records include the run status (`running`, `succeeded`, `failed`, or `stale`), schema name, input source, output file, token usage, inserted table rows, synced Notion pages, retry lineage, and error message. Deleting an audit record removes its cached upload, but keeps extracted JSON result files to avoid accidental data loss.
+Every extraction is also recorded under `.aiex/extracted/_audit/`. Audit records include the run status (`running`, `succeeded`, `failed`, or `stale`), schema name, input source, output file, token usage, inserted table rows, synced Notion pages, retry lineage, and error message. Use the Web UI to inspect, retry, or delete extraction records.
 
 ### 4. Watch Folder Daemon (Auto-Extraction)
 
 ```bash
+aiex watch
 aiex watch -s <schema> -d <folder>
 ```
 
-Runs a background watcher daemon to monitor a folder for new incoming files (such as scanned documents or downloads), automatically performing offline data extraction, database insertion, and system notifications.
-
-### 5. Dump Data
-
-```bash
-aiex dump -s <schema>                          # dump to CSV (default)
-aiex dump -s <schema> -f xlsx -o output.xlsx   # dump to Excel
-aiex dump -t <table> -f csv -o output.csv      # dump a specific table by name
-```
-
-Dumps all extracted data for a given schema (or table) from the SQLite database to CSV or Excel format.
-
-<br>
+Runs a background watcher daemon to monitor a folder for new incoming files (such as scanned documents or downloads), automatically performing offline data extraction, database insertion, and system notifications. Run without arguments to choose a schema, watch directory, model, and insert mode interactively.
 
 ## 📖 Commands
 
@@ -123,6 +107,7 @@ Dumps all extracted data for a given schema (or table) from the SQLite database
 | --- | --- |
 | `aiex schema` | Parse JSON Schema files and migrate to SQLite |
 | `aiex schema --generate` | Generate Drizzle schema code only (skip migration) |
+| `aiex schema --force` | Allow a high-risk schema migration after reviewing the migration risk report |
 | `aiex web` | Launch visual schema/configuration UI and data viewer in browser |
 | `aiex extract` | Interactive mode — prompts for schema and file/directory input |
 | `aiex extract -s <name> -f <file>` | Extract structured data from a file and insert into SQLite database |
@@ -131,15 +116,9 @@ Dumps all extracted data for a given schema (or table) from the SQLite database
 | `aiex extract -s <name> -f <file> --force` | Force re-extraction even if the file has already been processed |
 | `aiex extract -s <name> -d <dir>` | Batch extract all supported files in a directory |
 | `aiex extract -s <name> -d <dir> -g "*.pdf"` | Batch extract with glob filter |
-| `aiex extract history` | List extraction audit records |
-| `aiex extract show <audit-id>` | Show a full extraction audit record |
-| `aiex extract retry <audit-id>` | Retry a previous extraction run |
-| `aiex extract retry <audit-id> --no-insert` | Retry without inserting into SQLite |
-| `aiex extract rm <audit-id>` | Delete an audit record and its cached upload |
+| `aiex watch` | Guided setup for watching a directory and automatically extracting new files |
 | `aiex watch -s <name> -d <dir>` | Watch a directory for new files and automatically extract data |
 | `aiex watch -s <name> -d <dir> --no-insert` | Watch and save JSON without inserting into SQLite |
-| `aiex dump -s <name>` | Dump extracted data for a schema to CSV |
-| `aiex dump -s <name> -f xlsx -o <file>` | Dump to Excel (.xlsx) |
 | `aiex doctor` | System and configuration diagnostics |
 | `aiex completion bash\|zsh\|fish` | Generate shell completion scripts |