m8flow 1.1.3 → 1.1.5

package/README.md

@@ -1,15 +1,62 @@
-# M8Flow CLI
+<p align="center">
+  <img src="https://cdn.jsdelivr.net/npm/m8flow@latest/bundled/frontend-dist/assets/logo_full.png" alt="M8Flow" height="60" />
+</p>
 
-Visual ML Pipeline Builder — install globally, run anywhere.
+<h3 align="center">AI-powered visual machine learning workflow builder with local execution, pipeline orchestration, and zero-config setup.</h3>
 
-```
+<p align="center">
+  <a href="https://www.npmjs.com/package/m8flow"><img src="https://img.shields.io/npm/v/m8flow?color=6366f1&label=npm" alt="npm version" /></a>
+  <a href="https://www.npmjs.com/package/m8flow"><img src="https://img.shields.io/npm/dm/m8flow?color=22c55e&label=downloads" alt="downloads" /></a>
+  <a href="https://www.npmjs.com/package/m8flow"><img src="https://img.shields.io/npm/l/m8flow?color=f59e0b" alt="license" /></a>
+  <img src="https://img.shields.io/badge/Python-3.8%2B-blue" alt="python" />
+  <img src="https://img.shields.io/badge/Node.js-18%2B-green" alt="node" />
+</p>
+
+---
+
+## Quick Start
+
+```bash
 npm install -g m8flow
 m8flow run
 ```
 
+Your browser opens automatically. Start building ML pipelines in seconds — no Docker, no config files, no cloud accounts.
+
+---
+
+## Why M8Flow?
+
+Most ML tooling forces you to write boilerplate, manage environments manually, or pay for cloud compute. M8Flow takes a different approach:
+
+| Problem | M8Flow Solution |
+|---|---|
+| Writing pipeline code from scratch | Visual drag-and-drop node editor |
+| Complex environment setup | Automatic Python venv + dependency install |
+| No AI assistance for ML workflows | Built-in AI pipeline generation (OpenRouter / Gemini / Mistral) |
+| Vendor lock-in and cloud costs | 100% local-first — your machine, your data |
+| Slow iteration cycles | Live pipeline execution with real-time logs |
+
+---
+
+## Features
+
+- **Visual drag-and-drop pipeline builder** — connect nodes with edges, no boilerplate
+- **AI-assisted workflow generation** — describe your pipeline in plain English
+- **Multi-provider AI support** — OpenRouter, Google Gemini, Mistral La Plateforme
+- **Local-first architecture** — all data stays on your machine
+- **Automatic environment setup** — Python virtualenv + dependencies on first run
+- **60+ built-in ML nodes** — preprocessing, models, evaluation, visualization
+- **Custom Python components** — add your own nodes with AI code generation
+- **CSV dataset handling** — upload files, inspect schemas, feed into pipelines
+- **Pipeline versioning** — save checkpoints, compare versions, roll back
+- **Real-time execution monitoring** — live logs, node status, output previews
+- **Cross-browser state sync** — flows persist across tabs and browsers via local server
+- **Port conflict auto-resolution** — never manually kill a port again
+
 ---
 
-## System requirements
+## Requirements
 
 | Tool   | Minimum |
 |--------|---------|
@@ -23,38 +70,33 @@ m8flow run
 
 ### `m8flow run`
 
-Starts the full stack and opens the browser.
+Launches the complete local M8Flow environment.
 
 ```
 Options:
   -p, --port <n>      Frontend port (default: 3000)
   -b, --backend <n>   Backend port  (default: 8000)
-  --no-browser        Don't open the browser automatically
-  --verbose           Stream backend and frontend logs
+  --no-browser        Skip opening the browser automatically
+  --verbose           Stream full backend logs
   -h, --help          Show help
 ```
 
-**Examples**
-
 ```bash
-m8flow run                          # defaults (3000 / 8000)
-m8flow run --port 4000              # custom frontend port
-m8flow run --backend 9000 --verbose # custom backend + full logs
-m8flow run --no-browser             # headless / CI mode
+m8flow run                           # standard launch
+m8flow run --port 4000               # custom port
+m8flow run --no-browser --verbose    # headless with logs
 ```
 
 ### `m8flow doctor`
 
-Checks system requirements before you try to run.
+Diagnoses your environment before running.
 
 ```bash
 m8flow doctor
 ```
 
-Output example:
-
 ```
-  M8Flow Doctor  v1.0.0
+  M8Flow Doctor  v1.1.3
 
     ✔  Node.js  (20.11.0)
     ✔  Python   (Python 3.11.5)
@@ -62,77 +104,109 @@ Output example:
     ✔  Python dependencies
     ✔  Bundled assets
     ✔  Port Frontend (3000)  — free
-    ✖  Port Backend  (8000)  — busy — will auto-shift to 8001
+    ✔  Port Backend  (8000)  — free
 ```
 
 ---
 
-## What `m8flow run` does
-
-| Step | Action |
-|------|--------|
-| 1 | Detect Python 3.8+ on PATH (`python3`, `python`, `py`) |
-| 2 | Create `~/.m8flow/{uploads,models,pipelines}` |
-| 3 | Create Python virtualenv at `~/.m8flow/venv` |
-| 4 | `pip install -r requirements.txt` (only when file changes) |
-| 5 | Auto-resolve port conflicts with `detect-port` |
-| 6 | Spawn `uvicorn main:app` via **execa** |
-| 7 | Serve React build via built-in Node HTTP server |
-| 8 | TCP-poll the backend until it accepts connections |
-| 9 | Open `http://localhost:3000` with **open** |
-| 10 | Clean `SIGINT` / `SIGTERM` shutdown |
+## What happens when you run `m8flow run`
+
+| Step | What M8Flow does |
+|------|-----------------|
+| 1 | Locates Python 3.8+ on your PATH |
+| 2 | Creates `~/.m8flow/` storage directories |
+| 3 | Creates an isolated Python virtualenv |
+| 4 | Installs all ML dependencies (once only — hash-cached) |
+| 5 | Auto-resolves port conflicts |
+| 6 | Starts FastAPI backend via uvicorn |
+| 7 | Serves the React frontend via Node HTTP server |
+| 8 | Waits for backend health check (up to 120 s) |
+| 9 | Opens `http://localhost:3000` in your browser |
 
 ---
 
-## Data storage
+## Architecture
 
-Everything stays on your machine:
+```
+m8flow run
+├── Node.js CLI (bin/m8flow.js)
+│   ├── Python venv setup  →  ~/.m8flow/venv/
+│   ├── Frontend server    →  localhost:3000   (Node static)
+│   └── Backend server     →  localhost:8000   (uvicorn)
+│
+├── Frontend  — React + XYFlow canvas, Zustand state
+│   └── Visual node editor, AI chat, dataset manager
+│
+└── Backend   — FastAPI + Python runtime
+    ├── Pipeline executor  (topological DAG execution)
+    ├── LLM service        (OpenRouter / Gemini / Mistral)
+    ├── Self-healer        (AI auto-fix on node errors)
+    └── Template library   (60+ pre-built ML components)
+```
 
-| Path | Purpose |
-|------|---------|
-| `~/.m8flow/uploads/`  | Uploaded CSV files |
-| `~/.m8flow/models/`   | Trained models |
-| `~/.m8flow/pipelines/`| Saved pipelines |
-| `~/.m8flow/venv/`     | Python virtualenv |
-| `~/.m8flow/.env`      | API keys (optional) |
+| Layer | Technology |
+|---|---|
+| Frontend | React, XYFlow, Zustand, Vite |
+| Backend | FastAPI, Python, uvicorn |
+| Runtime | Isolated Python virtualenv |
+| CLI | Node.js 18+, ESM, execa |
+| AI Layer | OpenRouter · Google Gemini · Mistral La Plateforme |
+| Storage | Local filesystem (`~/.m8flow/`) |
 
-### Setting your OpenRouter API key
+---
 
-```bash
-echo "OPENROUTER_API_KEY=sk-or-..." >> ~/.m8flow/.env
-```
+## AI Keys
 
-The backend loads this file on every startup.
+M8Flow works without any API key (demo mode with limited models). For full AI pipeline generation, add at least one key in **Settings → API Keys**:
+
+| Provider | Key prefix | Models |
+|---|---|---|
+| OpenRouter | `sk-or-...` | Llama 3.3, NVIDIA Nemotron, Gemma, and 200+ more |
+| Google Gemini | `AIza...` | Gemini 2.5 Flash, Flash Lite, Pro |
+| Mistral | any | Codestral, Mistral Small, Mixtral |
+
+Keys are stored locally in your browser and on your machine — never sent to M8Flow servers.
 
 ---
 
-## Build from source
+## Data & Storage
+
+Everything lives on your machine:
+
+| Path | Contents |
+|------|---------|
+| `~/.m8flow/uploads/` | Uploaded CSV datasets |
+| `~/.m8flow/models/` | Trained model files |
+| `~/.m8flow/pipelines/` | Saved pipeline state |
+| `~/.m8flow/venv/` | Python virtualenv |
+| `~/.m8flow/app_state.json` | Flows, projects, settings |
+
+---
+
+## Build from Source
 
 ```bash
-git clone https://github.com/your-org/m8flow
+git clone https://github.com/mursaleen231213/m8flow
 cd m8flow
 
-# 1. Bundle backend + frontend
+# Build React frontend + bundle Python backend
 node cli/scripts/build.js
 
-# 2. Install globally from local build
+# Install locally
 cd cli && npm install -g .
 
-# 3. Run
+# Launch
 m8flow run
 ```
 
----
-
-## Publish to npm
+### Push updates to npm
 
 ```bash
-# Inside cli/
-npm publish
+cd cli
+npm version patch          # bump version
+npm publish --otp=<code>   # publish (OTP from authenticator)
 ```
 
-`prepublishOnly` runs `build.js` automatically.
-
 ---
 
 ## Uninstall
@@ -140,6 +214,13 @@ npm publish
 ```bash
 npm uninstall -g m8flow
 
-# Optional — remove all data:
-rm -rf ~/.m8flow
+# Remove all local data (optional):
+rm -rf ~/.m8flow          # Mac/Linux
+Remove-Item -Recurse -Force "$env:USERPROFILE\.m8flow"  # Windows
 ```
+
+---
+
+<p align="center">
+  Built with ❤️ for ML engineers who value speed and simplicity.
+</p>

package/bundled/backend/api/routes/appstate.py

@@ -36,7 +36,9 @@ def get_state():
             return json.loads(f.read_text(encoding="utf-8"))
         except Exception as exc:
             logger.warning("app_state.json unreadable: %s — returning defaults", exc)
-    return {"flows": [], "projects": [], "myFiles": [], "openRouterKey": None}
+    return {"flows": [], "projects": [], "myFiles": [],
+            "openRouterKey": None, "geminiKey": None, "mistralKey": None,
+            "chatHistories": {}}
 
 
 class StatePayload(BaseModel):
@@ -44,6 +46,9 @@ class StatePayload(BaseModel):
     projects:       list = []
     myFiles:        list = []
     openRouterKey:  str | None = None
+    geminiKey:      str | None = None
+    mistralKey:     str | None = None
+    chatHistories:  dict = {}
 
 
 @router.post("")

package/bundled/backend/requirements.txt

@@ -1,35 +1,60 @@
 # ── Core API ─────────────────────────────────────────────────────────────────
-fastapi
+fastapi==0.136.1
 uvicorn[standard]
-python-multipart
-pydantic
-python-dotenv
-httpx
-
+starlette==1.0.0
+python-multipart==0.0.27
+python-dotenv==1.2.2
+pydantic==2.13.3
+pydantic_core==2.46.3
+annotated-types==0.7.0
+# ── HTTP ─────────────────────────────────────────────────────────────────────
+httpx==0.28.1
+httpcore==1.0.9
+h11==0.16.0
+anyio==4.13.0
+sniffio==1.3.1
+certifi==2026.4.22
+idna==3.13
 # ── Data ─────────────────────────────────────────────────────────────────────
-pandas
-numpy
-scipy
-joblib
-
+pandas==3.0.2
+numpy==2.4.4
+scipy==1.17.1
+joblib==1.5.3
+threadpoolctl==3.6.0
+python-dateutil==2.9.0.post0
+six==1.17.0
+tzdata==2026.2
 # ── ML ───────────────────────────────────────────────────────────────────────
-scikit-learn
-xgboost
-lightgbm
-statsmodels
-
-# ── Imbalanced learning ───────────────────────────────────────────────────────
-imbalanced-learn
-
-# ── Explainability ────────────────────────────────────────────────────────────
-shap
-
-# ── Dimensionality reduction ──────────────────────────────────────────────────
-umap-learn
-
-# ── Visualisation (server-side, not imported at runtime) ─────────────────────
-matplotlib
-seaborn
-
-# ── Legacy / compat ───────────────────────────────────────────────────────────
-openai
+scikit-learn==1.8.0
+# ── Visualisation ────────────────────────────────────────────────────────────
+matplotlib==3.10.9
+seaborn==0.13.2
+plotly==6.7.0
+pillow==12.2.0
+contourpy==1.3.3
+cycler==0.12.1
+fonttools==4.62.1
+kiwisolver==1.5.0
+pyparsing==3.3.2
+narwhals==2.21.0
+# ── AI / LLM clients ─────────────────────────────────────────────────────────
+openai==2.33.0
+mistralai==2.4.4
+httpx==0.28.1
+jiter==0.14.0
+distro==1.9.0
+tqdm==4.67.3
+# ── Telemetry ────────────────────────────────────────────────────────────────
+opentelemetry-api==1.39.1
+opentelemetry-semantic-conventions==0.60b1
+# ── Utils ────────────────────────────────────────────────────────────────────
+click==8.3.3
+colorama==0.4.6
+annotated-doc==0.0.4
+eval_type_backport==0.3.1
+importlib_metadata==8.7.1
+jsonpath-python==1.1.5
+packaging==26.2
+typing_extensions==4.15.0
+typing-inspection==0.4.2
+zipp==3.23.1