extra-desktop 0.2.5__tar.gz → 0.3.2__tar.gz

{extra_desktop-0.2.5/extra_desktop.egg-info → extra_desktop-0.3.2}/PKG-INFO

@@ -1,7 +1,7 @@
 Metadata-Version: 2.4
 Name: extra-desktop
-Version: 0.2.5
-Summary: Flashless Windows & macOS Computer-Use Engine & Model Context Protocol (MCP) Server
+Version: 0.3.2
+Summary: Flashless Linux, Windows & macOS Computer-Use Engine & Model Context Protocol (MCP) Server
 Author-email: AIYantra Engineering Team <engineering@yantraos.com>
 License-Expression: MIT
 Project-URL: Homepage, https://extra.yantraos.com
@@ -20,6 +20,7 @@ Requires-Dist: numpy>=1.26.0
 Requires-Dist: psutil>=6.0.0
 Requires-Dist: kuzu>=0.11.0
 Requires-Dist: fastembed>=0.8.0
+Requires-Dist: onnxruntime>=1.19.0
 Requires-Dist: pywin32>=306; sys_platform == "win32"
 Requires-Dist: comtypes>=1.4.0; sys_platform == "win32"
 Requires-Dist: mss>=9.0.1; sys_platform == "win32"
@@ -28,6 +29,9 @@ Requires-Dist: pyobjc-framework-Cocoa>=10.0; sys_platform == "darwin"
 Requires-Dist: pyobjc-framework-Quartz>=10.0; sys_platform == "darwin"
 Requires-Dist: pyobjc-framework-ApplicationServices>=10.0; sys_platform == "darwin"
 Requires-Dist: pyobjc-framework-ScreenCaptureKit>=10.0; sys_platform == "darwin"
+Requires-Dist: evdev>=1.7.0; sys_platform == "linux"
+Requires-Dist: mss>=9.0.1; sys_platform == "linux"
+Requires-Dist: jeepney>=0.8.0; sys_platform == "linux"
 Dynamic: license-file
 
 <div align="center">
@@ -38,18 +42,19 @@ Dynamic: license-file
 
 # Extra
 
-### The Open-Source Astra 6 for your Mac & PC
-**Your AI can see, click, type, navigate, and get real work done on macOS & Windows.**
+### The Open-Source Astra 6 for your Linux PC, Mac & Windows
+**Your AI can see, click, type, navigate, and get real work done on Linux, macOS & Windows.**
 
 <!-- mcp-name: io.github.AIYantra/extra -->
 
+[![PyPI Downloads](https://static.pepy.tech/personalized-badge/extra-desktop?period=total&units=INTERNATIONAL_SYSTEM&left_color=BLACK&right_color=GREEN&left_text=downloads)](https://pepy.tech/projects/extra-desktop)
 [![License: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](LICENSE)
-[![Platform: macOS 12.3+ & Windows 10/11](https://img.shields.io/badge/Platform-macOS%20%7C%20Windows-0078D6.svg)](https://extra.yantraos.com)
+[![Platform: Linux | macOS | Windows](https://img.shields.io/badge/Platform-Linux%20%7C%20macOS%20%7C%20Windows-0078D6.svg)](https://extra.yantraos.com)
 [![Protocol: Model Context Protocol (MCP)](https://img.shields.io/badge/Protocol-MCP%20Native-orange.svg)](https://modelcontextprotocol.io)
 [![Ecosystem: yantraOS](https://img.shields.io/badge/Ecosystem-yantraOS-8A2BE2.svg)](https://yantraos.com)
 [![Status: Open Source](https://img.shields.io/badge/Open%20Source-%E2%99%A5-emerald.svg)](https://github.com/AIYantra/extra)
 
-[Website](https://extra.yantraos.com) • [Quickstart](#-quickstart-1-minute) • [macOS Guide](README_MACOS.md) • [Architecture](ARCHITECTURE.md) • [License](LICENSE)
+[Website](https://extra.yantraos.com) • [Quickstart](#-quickstart-1-minute) • [Linux Guide](README_LINUX.md) • [macOS Guide](README_MACOS.md) • [Architecture](ARCHITECTURE.md) • [License](LICENSE)
 
 <br/>
 <br/>
@@ -66,9 +71,9 @@ Dynamic: license-file
 
 Today's AI assistants can write brilliant essays and code, but they are trapped inside a chat window. When you need them to click a button, open an app, organize your files, or input data into a spreadsheet, they can only give you text instructions.
 
-**Extra gives your AI hands and eyes on Windows.**
+**Extra gives your AI hands and eyes on Linux, macOS & Windows.**
 
-It connects **Claude, Google Antigravity, Cursor, AGY**, or any autonomous agent directly to your Windows desktop with high-speed screen vision, pixel-perfect clicking, and instant typing.
+It connects **Claude, Google Antigravity, Cursor, AGY**, or any autonomous agent directly to your desktop with high-speed screen vision, pixel-perfect clicking, and instant typing.
 
 * **No clunky browser extensions.**
 * **No expensive cloud servers watching your screen.**
@@ -80,22 +85,27 @@ It connects **Claude, Google Antigravity, Cursor, AGY**, or any autonomous agent
 
 Once Extra is running, you can talk to your AI like a real human assistant sitting at your desk:
 
-* 📊 **Spreadsheets & Data:** *"Open Excel, calculate total revenue from the invoice CSVs in my Downloads folder, and create a summary chart."*
+* 📊 **Spreadsheets & Data:** *"Open Excel or LibreOffice Calc, calculate total revenue from the invoice CSVs in my Downloads folder, and create a summary chart."*
 * 🗂️ **Desktop & File Cleanup:** *"Clean up my messy desktop by moving screenshots into Pictures, PDFs into Documents, and deleting empty folders."*
-* 🌐 **Web Research & Data Entry:** *"Open Chrome, find the top 5 flights to Tokyo under $800, and copy their flight numbers and dates into Notepad."*
-* ⚙️ **Windows System Tasks:** *"Open Settings, check if any Windows updates are pending, and let me know if a restart is needed."*
-* 🎵 **App Control:** *"Launch Spotify, search for low-fi focus beats, and start playing."*
+* 🌐 **Web Research & Data Entry:** *"Open Chrome or Firefox, find the top 5 flights to Tokyo under $800, and copy their flight numbers and dates into a text note."*
+* ⚙️ **System Administration:** *"Open Settings or terminal, check system updates, and verify service health."*
+* 🎵 **App Control:** *"Launch Spotify or VLC, search for low-fi focus beats, and start playing."*
 
 ---
 
 ## ⚡ Quickstart (1 Minute)
 
-You can set up Extra in seconds on **macOS** or **Windows**:
+You can set up Extra in seconds on **Linux**, **macOS**, or **Windows**:
 
 ### Option A: Ask Your AI To Set It Up (Primary Funnel — Easiest)
 
 Copy and paste the single directive for your OS into **Claude Desktop**, **Google Antigravity**, **Cursor**, **Windsurf**, or any MCP agent:
 
+* **🐧 For Linux (Arch / yantraOS, Ubuntu, Debian, Fedora):**
+  ```text
+  Setup Extra on my Linux machine: In Terminal run 'curl -sSL https://extra.yantraos.com/install.sh | bash', then read and configure ~/.extra/app/STARTER_PROMPT_LINUX.md so we are ready to use Extra.
+  ```
+
 * **🍏 For macOS (Apple Silicon M1-M4 & Intel):**
   ```text
   Setup Extra on my Mac: In Terminal run 'curl -sSL https://extra.yantraos.com/install.sh | bash', then read and configure ~/.extra/app/STARTER_PROMPT_MACOS.md so we are ready to use Extra.
@@ -113,6 +123,11 @@ Your AI will run the installer, configure MCP and local rules, and reply:
 
 ### Option B: Run the One-Liner Yourself
 
+* **🐧 Linux Terminal (Arch / yantraOS, Ubuntu, Debian, Fedora):**
+  ```bash
+  curl -sSL https://extra.yantraos.com/install.sh | bash
+  ```
+
 * **🍏 macOS Terminal:**
   ```bash
   curl -sSL https://extra.yantraos.com/install.sh | bash
@@ -124,7 +139,7 @@ Your AI will run the installer, configure MCP and local rules, and reply:
   ```
 
 The automated installer will:
-* Verify OS architecture (macOS 12.3+ or Windows 10/11 64-bit).
+* Verify OS architecture (Linux Wayland/X11, macOS 12.3+, or Windows 10/11 64-bit).
 * Provision isolated Python 3.10+ runtime (`~/.extra/venv`).
 * Auto-configure **Claude Desktop**, **Cursor**, **Windsurf**, and **Antigravity** (`agy`).
 * Run the health diagnostic doctor and present the 1-step starter prompt.
@@ -134,7 +149,7 @@ The automated installer will:
 ### Option C: Developer Git Clone
 
 ```bash
-# macOS:
+# Linux / macOS:
 git clone https://github.com/AIYantra/extra.git ~/.extra/app
 cd ~/.extra/app && ./install.sh
 
@@ -149,6 +164,19 @@ cd "$HOME\.extra\app" ; .\install.ps1
 
 Extra works out of the box with any agent supporting the **Model Context Protocol (MCP)**. If you use Cursor, Windsurf, or custom agents, add this snippet to your MCP config:
 
+```json
+{
+  "mcpServers": {
+    "extra": {
+      "command": "npx",
+      "args": ["-y", "@yantraos/extra-desktop"]
+    }
+  }
+}
+```
+
+Or using native Python:
+
 ```json
 {
   "mcpServers": {
@@ -187,26 +215,33 @@ Extra is engineered from the ground up for speed, reliability, and token efficie
 
 ---
 
-## 🛠️ Included Tools (MCP Suite)
+## 🛠️ Included Tools (MCP Suite — 20 Native Tools)
 
-When connected to Extra, your AI assistant receives these native tools:
+When connected to Extra, your AI assistant receives full sovereign desktop control across 20 native tools:
 
 | Tool Name | What It Does |
 | :--- | :--- |
-| `extra_launch` | Opens any Windows app, utility, or URL directly (`calc`, `notepad`, `settings`, `chrome`) |
-| `extra_inspect_ui` | Scans all visible buttons, inputs, tabs, and menus on your screen |
-| `extra_click_element` | Deterministically clicks any element by its ID, name, or bounding box |
-| `extra_screenshot` | Captures high-res desktop frames with optional Set-of-Mark visual badges |
-| `extra_click` | Moves mouse, left/right clicks, and double clicks with sub-pixel DPI accuracy |
-| `extra_type` | Injects text instantly with zero lag, full emoji support, and atomic paste |
+| `extra_launch` | Opens any app, utility, or URL directly (`calc`, `notepad`, `settings`, `edge`, `chrome`) |
+| `extra_focus_window` | Brings any window to the front via native thread input attachment |
+| `extra_click` | Clicks with sub-pixel DPI accuracy, human-like Bezier curves, and semantic visual grounding (`target="..."`) |
+| `extra_stroke` | Draws fluid, continuous brush splines across waypoints with pressure and Catmull-Rom smoothing |
+| `extra_type` | Injects text instantly with zero lag, full emoji support, and Win32 Unicode packets |
 | `extra_hotkey` | Sends keyboard shortcuts (`Ctrl+C`, `Win+E`, `Alt+Tab`, `Enter`) |
+| `extra_batch_actions` | Executes atomic lists of hardware & SOUL reflex actions (`eval`, `assert`, `wait_for_state`) in sub-milliseconds |
+| `extra_snap_layout` | Programmatically docks and arranges windows in side-by-side or split layouts in < 15ms |
+| `extra_fs_batch` | High-speed batch filesystem operations compliant with Windows Defender Controlled Folder Access |
+| `extra_inspect_ui` | Scans accessible UI trees and interactive element nodes in real time |
+| `extra_click_element` | Clicks UI elements deterministically by accessible ID or semantic target |
 | `extra_scroll` | Smoothly scrolls wheels up, down, left, or right |
 | `extra_drag` | Drags and drops files, windows, or sliders between coordinates |
-| `extra_browser` | Directly extracts web page DOM content in Edge/Chrome without taking screenshots |
-| `extra_focus_window` | Brings any application window immediately to the front |
-| `extra_task_start` | Signals autonomous task execution; activates ambient screen edge pulse & cursor halo |
-| `extra_task_complete` | Signals task completion; flashes emerald green border, plays audio chime, and dissolves indicators |
+| `extra_screenshot` | Captures high-res desktop frames in < 25ms with optional Set-of-Mark visual badges |
+| `extra_browser` | Directly extracts DOM content in Edge/Chrome or triggers synthesized API fast-paths |
+| `extra_task_start` | Activates ambient screen edge pulse and cursor tracking halo |
+| `extra_task_complete` | Signals task completion: flashes emerald border, plays acoustic chime, and analyzes trajectory |
 | `extra_indicate_status` | Direct programmatic control over active, complete, and idle desktop indicators |
+| `extra_recall_memory` | Recalls past task workflows, artifacts, and known quirks via KùzuDB + FastEmbed in < 2ms |
+| `extra_scout_app` | Discovers UI frameworks (Electron/Win32/Viewport), universal hotkeys, and generates SKILL playbooks |
+| `extra_evolve_skill` | Crystallizes newly verified zero-stall fast paths into permanent skill playbooks |
 
 ---
 
@@ -215,26 +250,43 @@ When connected to Extra, your AI assistant receives these native tools:
 ```text
 extra/
 ├── assets/                 # Brand logos and banners
-├── core/                   # Core Windows Automation Engine
-│   ├── capture.py          # Sub-3ms screen capture (DXGI & MSS)
+├── bin/                    # Node.js CLI executable (npx @yantraos/extra-desktop)
+├── core/                   # Sovereign Core Automation Engine
+│   ├── platform/           # Platform Abstraction Layer (PAL facade for Win32 & macOS)
+│   │   ├── windows/        # Win32 SendInput, DXGI capture, UIA, and focus
+│   │   └── macos/          # ScreenCaptureKit, CoreGraphics, and AXUIElement
+│   ├── soul/               # System One Ultra-fast Layer (Decider, Eyes, Grammar, Schemas)
+│   ├── memory/             # KùzuDB episodic knowledge graph & FastEmbed embeddings
+│   ├── evolution/          # Autonomous skill crystallizer & API synthesizer
+│   ├── scout/              # Application discovery, CDP sniffer, and session vault
+│   ├── motion/             # Human-like Bezier cursor flight and spline dynamics
+│   ├── capture.py          # Unified high-speed desktop screen capture
 │   ├── geometry.py         # PerMonitorV2 DPI scaling & display normalization
-│   ├── indicators.py       # Ambient screen edge pulse, cursor halo, and harmonic audio chime
-│   ├── input_engine.py     # Win32 SendInput Unicode & atomic clipboard injection
-│   ├── focus.py            # AttachThreadInput window focus forcing
-│   ├── uia_plane.py        # Windows UI Automation v3 COM client
+│   ├── indicators.py       # Ambient screen pulse, cursor halo, and harmonic chime
+│   ├── input_engine.py     # PAL input facade (clicks, strokes, typing, batching)
+│   ├── focus.py            # Window activation, snapping, and layout management
+│   ├── uia_plane.py        # Accessibility tree inspection and Set-of-Mark labeling
 │   └── stall_breaker.py    # Closed-loop perceptual diffing & safety killswitch
 ├── fastpath/               # High-speed deterministic execution
-│   ├── shell.py            # Win32 ShellExecuteEx direct app launcher
-│   └── browser.py          # Playwright / Edge CDP DOM bridge
-├── mcp/                    # Anthropic Model Context Protocol
-│   └── server.py           # Standard JSON-RPC stdio/SSE server
+│   ├── shell.py            # Native app launcher with crash-recovery auto-suppression
+│   ├── browser.py          # Playwright & Chromium DevTools Protocol (CDP) bridge
+│   ├── fs.py               # CFA-compliant batch filesystem engine
+│   └── web/                # Synthesized Web-to-API fast-paths
+├── mcp/                    # Model Context Protocol
+│   └── server.py           # Standard JSON-RPC stdio/SSE server (20 native tools)
+├── tests/                  # Exhaustive 1,883-test official verification suite
 ├── cli.py                  # CLI runner (extra doctor, test, indicators, run, inspect, snap)
-├── install.ps1             # 1-line PowerShell installer
-├── pyproject.toml          # Package metadata and build configuration
+├── install.ps1             # 1-line PowerShell installer (Windows)
+├── install.sh              # 1-line bash installer (macOS)
+├── pyproject.toml          # PyPI package manifest (extra-desktop v0.3.1)
+├── package.json            # npm package manifest (@yantraos/extra-desktop v0.3.1)
+├── server.json             # Official MCP registry manifest
+├── glama.json              # Glama MCP ecosystem manifest
+├── smithery.yaml           # Smithery 1-click deployment manifest
 ├── requirements.txt        # Enterprise-audited dependency manifest
 ├── STARTER_PROMPT.md       # Master AI system prompt & setup directive
 ├── ARCHITECTURE.md         # Full System Architecture Specification
-└── test_core_engine.py     # End-to-end integration test suite
+└── RELEASE_NOTES.md        # Comprehensive version release notes
 ```
 
 ---

{extra_desktop-0.2.5 → extra_desktop-0.3.2}/README.md

@@ -6,18 +6,19 @@
 
 # Extra
 
-### The Open-Source Astra 6 for your Mac & PC
-**Your AI can see, click, type, navigate, and get real work done on macOS & Windows.**
+### The Open-Source Astra 6 for your Linux PC, Mac & Windows
+**Your AI can see, click, type, navigate, and get real work done on Linux, macOS & Windows.**
 
 <!-- mcp-name: io.github.AIYantra/extra -->
 
+[![PyPI Downloads](https://static.pepy.tech/personalized-badge/extra-desktop?period=total&units=INTERNATIONAL_SYSTEM&left_color=BLACK&right_color=GREEN&left_text=downloads)](https://pepy.tech/projects/extra-desktop)
 [![License: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](LICENSE)
-[![Platform: macOS 12.3+ & Windows 10/11](https://img.shields.io/badge/Platform-macOS%20%7C%20Windows-0078D6.svg)](https://extra.yantraos.com)
+[![Platform: Linux | macOS | Windows](https://img.shields.io/badge/Platform-Linux%20%7C%20macOS%20%7C%20Windows-0078D6.svg)](https://extra.yantraos.com)
 [![Protocol: Model Context Protocol (MCP)](https://img.shields.io/badge/Protocol-MCP%20Native-orange.svg)](https://modelcontextprotocol.io)
 [![Ecosystem: yantraOS](https://img.shields.io/badge/Ecosystem-yantraOS-8A2BE2.svg)](https://yantraos.com)
 [![Status: Open Source](https://img.shields.io/badge/Open%20Source-%E2%99%A5-emerald.svg)](https://github.com/AIYantra/extra)
 
-[Website](https://extra.yantraos.com) • [Quickstart](#-quickstart-1-minute) • [macOS Guide](README_MACOS.md) • [Architecture](ARCHITECTURE.md) • [License](LICENSE)
+[Website](https://extra.yantraos.com) • [Quickstart](#-quickstart-1-minute) • [Linux Guide](README_LINUX.md) • [macOS Guide](README_MACOS.md) • [Architecture](ARCHITECTURE.md) • [License](LICENSE)
 
 <br/>
 <br/>
@@ -34,9 +35,9 @@
 
 Today's AI assistants can write brilliant essays and code, but they are trapped inside a chat window. When you need them to click a button, open an app, organize your files, or input data into a spreadsheet, they can only give you text instructions.
 
-**Extra gives your AI hands and eyes on Windows.**
+**Extra gives your AI hands and eyes on Linux, macOS & Windows.**
 
-It connects **Claude, Google Antigravity, Cursor, AGY**, or any autonomous agent directly to your Windows desktop with high-speed screen vision, pixel-perfect clicking, and instant typing.
+It connects **Claude, Google Antigravity, Cursor, AGY**, or any autonomous agent directly to your desktop with high-speed screen vision, pixel-perfect clicking, and instant typing.
 
 * **No clunky browser extensions.**
 * **No expensive cloud servers watching your screen.**
@@ -48,22 +49,27 @@ It connects **Claude, Google Antigravity, Cursor, AGY**, or any autonomous agent
 
 Once Extra is running, you can talk to your AI like a real human assistant sitting at your desk:
 
-* 📊 **Spreadsheets & Data:** *"Open Excel, calculate total revenue from the invoice CSVs in my Downloads folder, and create a summary chart."*
+* 📊 **Spreadsheets & Data:** *"Open Excel or LibreOffice Calc, calculate total revenue from the invoice CSVs in my Downloads folder, and create a summary chart."*
 * 🗂️ **Desktop & File Cleanup:** *"Clean up my messy desktop by moving screenshots into Pictures, PDFs into Documents, and deleting empty folders."*
-* 🌐 **Web Research & Data Entry:** *"Open Chrome, find the top 5 flights to Tokyo under $800, and copy their flight numbers and dates into Notepad."*
-* ⚙️ **Windows System Tasks:** *"Open Settings, check if any Windows updates are pending, and let me know if a restart is needed."*
-* 🎵 **App Control:** *"Launch Spotify, search for low-fi focus beats, and start playing."*
+* 🌐 **Web Research & Data Entry:** *"Open Chrome or Firefox, find the top 5 flights to Tokyo under $800, and copy their flight numbers and dates into a text note."*
+* ⚙️ **System Administration:** *"Open Settings or terminal, check system updates, and verify service health."*
+* 🎵 **App Control:** *"Launch Spotify or VLC, search for low-fi focus beats, and start playing."*
 
 ---
 
 ## ⚡ Quickstart (1 Minute)
 
-You can set up Extra in seconds on **macOS** or **Windows**:
+You can set up Extra in seconds on **Linux**, **macOS**, or **Windows**:
 
 ### Option A: Ask Your AI To Set It Up (Primary Funnel — Easiest)
 
 Copy and paste the single directive for your OS into **Claude Desktop**, **Google Antigravity**, **Cursor**, **Windsurf**, or any MCP agent:
 
+* **🐧 For Linux (Arch / yantraOS, Ubuntu, Debian, Fedora):**
+  ```text
+  Setup Extra on my Linux machine: In Terminal run 'curl -sSL https://extra.yantraos.com/install.sh | bash', then read and configure ~/.extra/app/STARTER_PROMPT_LINUX.md so we are ready to use Extra.
+  ```
+
 * **🍏 For macOS (Apple Silicon M1-M4 & Intel):**
   ```text
   Setup Extra on my Mac: In Terminal run 'curl -sSL https://extra.yantraos.com/install.sh | bash', then read and configure ~/.extra/app/STARTER_PROMPT_MACOS.md so we are ready to use Extra.
@@ -81,6 +87,11 @@ Your AI will run the installer, configure MCP and local rules, and reply:
 
 ### Option B: Run the One-Liner Yourself
 
+* **🐧 Linux Terminal (Arch / yantraOS, Ubuntu, Debian, Fedora):**
+  ```bash
+  curl -sSL https://extra.yantraos.com/install.sh | bash
+  ```
+
 * **🍏 macOS Terminal:**
   ```bash
   curl -sSL https://extra.yantraos.com/install.sh | bash
@@ -92,7 +103,7 @@ Your AI will run the installer, configure MCP and local rules, and reply:
   ```
 
 The automated installer will:
-* Verify OS architecture (macOS 12.3+ or Windows 10/11 64-bit).
+* Verify OS architecture (Linux Wayland/X11, macOS 12.3+, or Windows 10/11 64-bit).
 * Provision isolated Python 3.10+ runtime (`~/.extra/venv`).
 * Auto-configure **Claude Desktop**, **Cursor**, **Windsurf**, and **Antigravity** (`agy`).
 * Run the health diagnostic doctor and present the 1-step starter prompt.
@@ -102,7 +113,7 @@ The automated installer will:
 ### Option C: Developer Git Clone
 
 ```bash
-# macOS:
+# Linux / macOS:
 git clone https://github.com/AIYantra/extra.git ~/.extra/app
 cd ~/.extra/app && ./install.sh
 
@@ -117,6 +128,19 @@ cd "$HOME\.extra\app" ; .\install.ps1
 
 Extra works out of the box with any agent supporting the **Model Context Protocol (MCP)**. If you use Cursor, Windsurf, or custom agents, add this snippet to your MCP config:
 
+```json
+{
+  "mcpServers": {
+    "extra": {
+      "command": "npx",
+      "args": ["-y", "@yantraos/extra-desktop"]
+    }
+  }
+}
+```
+
+Or using native Python:
+
 ```json
 {
   "mcpServers": {
@@ -155,26 +179,33 @@ Extra is engineered from the ground up for speed, reliability, and token efficie
 
 ---
 
-## 🛠️ Included Tools (MCP Suite)
+## 🛠️ Included Tools (MCP Suite — 20 Native Tools)
 
-When connected to Extra, your AI assistant receives these native tools:
+When connected to Extra, your AI assistant receives full sovereign desktop control across 20 native tools:
 
 | Tool Name | What It Does |
 | :--- | :--- |
-| `extra_launch` | Opens any Windows app, utility, or URL directly (`calc`, `notepad`, `settings`, `chrome`) |
-| `extra_inspect_ui` | Scans all visible buttons, inputs, tabs, and menus on your screen |
-| `extra_click_element` | Deterministically clicks any element by its ID, name, or bounding box |
-| `extra_screenshot` | Captures high-res desktop frames with optional Set-of-Mark visual badges |
-| `extra_click` | Moves mouse, left/right clicks, and double clicks with sub-pixel DPI accuracy |
-| `extra_type` | Injects text instantly with zero lag, full emoji support, and atomic paste |
+| `extra_launch` | Opens any app, utility, or URL directly (`calc`, `notepad`, `settings`, `edge`, `chrome`) |
+| `extra_focus_window` | Brings any window to the front via native thread input attachment |
+| `extra_click` | Clicks with sub-pixel DPI accuracy, human-like Bezier curves, and semantic visual grounding (`target="..."`) |
+| `extra_stroke` | Draws fluid, continuous brush splines across waypoints with pressure and Catmull-Rom smoothing |
+| `extra_type` | Injects text instantly with zero lag, full emoji support, and Win32 Unicode packets |
 | `extra_hotkey` | Sends keyboard shortcuts (`Ctrl+C`, `Win+E`, `Alt+Tab`, `Enter`) |
+| `extra_batch_actions` | Executes atomic lists of hardware & SOUL reflex actions (`eval`, `assert`, `wait_for_state`) in sub-milliseconds |
+| `extra_snap_layout` | Programmatically docks and arranges windows in side-by-side or split layouts in < 15ms |
+| `extra_fs_batch` | High-speed batch filesystem operations compliant with Windows Defender Controlled Folder Access |
+| `extra_inspect_ui` | Scans accessible UI trees and interactive element nodes in real time |
+| `extra_click_element` | Clicks UI elements deterministically by accessible ID or semantic target |
 | `extra_scroll` | Smoothly scrolls wheels up, down, left, or right |
 | `extra_drag` | Drags and drops files, windows, or sliders between coordinates |
-| `extra_browser` | Directly extracts web page DOM content in Edge/Chrome without taking screenshots |
-| `extra_focus_window` | Brings any application window immediately to the front |
-| `extra_task_start` | Signals autonomous task execution; activates ambient screen edge pulse & cursor halo |
-| `extra_task_complete` | Signals task completion; flashes emerald green border, plays audio chime, and dissolves indicators |
+| `extra_screenshot` | Captures high-res desktop frames in < 25ms with optional Set-of-Mark visual badges |
+| `extra_browser` | Directly extracts DOM content in Edge/Chrome or triggers synthesized API fast-paths |
+| `extra_task_start` | Activates ambient screen edge pulse and cursor tracking halo |
+| `extra_task_complete` | Signals task completion: flashes emerald border, plays acoustic chime, and analyzes trajectory |
 | `extra_indicate_status` | Direct programmatic control over active, complete, and idle desktop indicators |
+| `extra_recall_memory` | Recalls past task workflows, artifacts, and known quirks via KùzuDB + FastEmbed in < 2ms |
+| `extra_scout_app` | Discovers UI frameworks (Electron/Win32/Viewport), universal hotkeys, and generates SKILL playbooks |
+| `extra_evolve_skill` | Crystallizes newly verified zero-stall fast paths into permanent skill playbooks |
 
 ---
 
@@ -183,26 +214,43 @@ When connected to Extra, your AI assistant receives these native tools:
 ```text
 extra/
 ├── assets/                 # Brand logos and banners
-├── core/                   # Core Windows Automation Engine
-│   ├── capture.py          # Sub-3ms screen capture (DXGI & MSS)
+├── bin/                    # Node.js CLI executable (npx @yantraos/extra-desktop)
+├── core/                   # Sovereign Core Automation Engine
+│   ├── platform/           # Platform Abstraction Layer (PAL facade for Win32 & macOS)
+│   │   ├── windows/        # Win32 SendInput, DXGI capture, UIA, and focus
+│   │   └── macos/          # ScreenCaptureKit, CoreGraphics, and AXUIElement
+│   ├── soul/               # System One Ultra-fast Layer (Decider, Eyes, Grammar, Schemas)
+│   ├── memory/             # KùzuDB episodic knowledge graph & FastEmbed embeddings
+│   ├── evolution/          # Autonomous skill crystallizer & API synthesizer
+│   ├── scout/              # Application discovery, CDP sniffer, and session vault
+│   ├── motion/             # Human-like Bezier cursor flight and spline dynamics
+│   ├── capture.py          # Unified high-speed desktop screen capture
 │   ├── geometry.py         # PerMonitorV2 DPI scaling & display normalization
-│   ├── indicators.py       # Ambient screen edge pulse, cursor halo, and harmonic audio chime
-│   ├── input_engine.py     # Win32 SendInput Unicode & atomic clipboard injection
-│   ├── focus.py            # AttachThreadInput window focus forcing
-│   ├── uia_plane.py        # Windows UI Automation v3 COM client
+│   ├── indicators.py       # Ambient screen pulse, cursor halo, and harmonic chime
+│   ├── input_engine.py     # PAL input facade (clicks, strokes, typing, batching)
+│   ├── focus.py            # Window activation, snapping, and layout management
+│   ├── uia_plane.py        # Accessibility tree inspection and Set-of-Mark labeling
 │   └── stall_breaker.py    # Closed-loop perceptual diffing & safety killswitch
 ├── fastpath/               # High-speed deterministic execution
-│   ├── shell.py            # Win32 ShellExecuteEx direct app launcher
-│   └── browser.py          # Playwright / Edge CDP DOM bridge
-├── mcp/                    # Anthropic Model Context Protocol
-│   └── server.py           # Standard JSON-RPC stdio/SSE server
+│   ├── shell.py            # Native app launcher with crash-recovery auto-suppression
+│   ├── browser.py          # Playwright & Chromium DevTools Protocol (CDP) bridge
+│   ├── fs.py               # CFA-compliant batch filesystem engine
+│   └── web/                # Synthesized Web-to-API fast-paths
+├── mcp/                    # Model Context Protocol
+│   └── server.py           # Standard JSON-RPC stdio/SSE server (20 native tools)
+├── tests/                  # Exhaustive 1,883-test official verification suite
 ├── cli.py                  # CLI runner (extra doctor, test, indicators, run, inspect, snap)
-├── install.ps1             # 1-line PowerShell installer
-├── pyproject.toml          # Package metadata and build configuration
+├── install.ps1             # 1-line PowerShell installer (Windows)
+├── install.sh              # 1-line bash installer (macOS)
+├── pyproject.toml          # PyPI package manifest (extra-desktop v0.3.1)
+├── package.json            # npm package manifest (@yantraos/extra-desktop v0.3.1)
+├── server.json             # Official MCP registry manifest
+├── glama.json              # Glama MCP ecosystem manifest
+├── smithery.yaml           # Smithery 1-click deployment manifest
 ├── requirements.txt        # Enterprise-audited dependency manifest
 ├── STARTER_PROMPT.md       # Master AI system prompt & setup directive
 ├── ARCHITECTURE.md         # Full System Architecture Specification
-└── test_core_engine.py     # End-to-end integration test suite
+└── RELEASE_NOTES.md        # Comprehensive version release notes
 ```
 
 ---

extra_desktop-0.3.2/__init__.py

@@ -0,0 +1,5 @@
+"""
+Project Extra — Flashless Linux, Windows & macOS Computer-Use Engine & MCP Server.
+"""
+
+__version__ = "0.3.2"