native-devtools-mcp 0.3.1 → 0.3.2

package/README.md

@@ -11,6 +11,8 @@
 
 A Model Context Protocol (MCP) server that provides **Computer Use** capabilities: screenshots, OCR, input simulation, and window management.
 
+[//]: # "Search keywords: MCP, Model Context Protocol, computer use, desktop automation, UI automation, RPA, screenshots, OCR, mouse, keyboard, screen reading, macOS, Windows, native-devtools-mcp"
+
 [Features](#-features) • [Installation](#-installation) • [For AI Agents](#-for-ai-agents-llms) • [Permissions](#-required-permissions-macos)
 
 ![Demo](demo.gif)
@@ -19,6 +21,10 @@ A Model Context Protocol (MCP) server that provides **Computer Use** capabilitie
 
 ---
 
+## 🔍 Search Keywords
+
+MCP, Model Context Protocol, computer use, desktop automation, UI automation, RPA, screenshots, OCR, screen reading, mouse, keyboard, macOS, Windows, native-devtools-mcp.
+
 ## 🚀 Features
 
 - **👀 Computer Vision:** Capture screenshots of screens, windows, or specific regions. Includes built-in OCR (text recognition) to "read" the screen.
@@ -33,7 +39,7 @@ A Model Context Protocol (MCP) server that provides **Computer Use** capabilitie
 
 This MCP server is designed to be **highly discoverable and usable** by AI models (Claude, Gemini, GPT).
 
-- **[📄 Read `agents.md`](./agents.md):** A compact, token-optimized technical reference designed specifically for ingestion by LLMs. It contains intent definitions, schema examples, and reasoning patterns.
+- **[📄 Read `AGENTS.md`](./AGENTS.md):** A compact, token-optimized technical reference designed specifically for ingestion by LLMs. It contains intent definitions, schema examples, and reasoning patterns.
 
 **Core Capabilities for System Prompts:**
 1.  `take_screenshot`: The "eyes". Returns images + layout metadata + text locations (OCR).
@@ -173,6 +179,25 @@ graph TD
 | | Input | `SendInput` (Win32) |
 | | OCR | `Windows.Media.Ocr` (WinRT) |
 
+### Screenshot Coordinate Precision
+
+Screenshots include metadata for accurate coordinate conversion:
+
+- `screenshot_origin_x/y`: Screen-space origin of the captured area (in points)
+- `screenshot_scale`: Display scale factor (e.g., 2.0 for Retina displays)
+- `screenshot_pixel_width/height`: Actual pixel dimensions of the image
+- `screenshot_window_id`: Window ID (for window captures)
+
+**Coordinate conversion:**
+```
+screen_x = screenshot_origin_x + (pixel_x / screenshot_scale)
+screen_y = screenshot_origin_y + (pixel_y / screenshot_scale)
+```
+
+**Implementation notes:**
+- **Window captures** (macOS): Uses `screencapture -o` which excludes window shadow. The captured image dimensions match `kCGWindowBounds × scale` exactly, ensuring click coordinates derived from screenshots land on intended UI elements.
+- **Region captures**: Origin coordinates are aligned to integers to match the actual captured area.
+
 </details>
 
 ## 🛡️ Privacy, Safety & Best Practices

package/package.json

@@ -1,7 +1,7 @@
 {
   "name": "native-devtools-mcp",
-  "version": "0.3.1",
-  "description": "MCP server for testing native desktop applications",
+  "version": "0.3.2",
+  "description": "MCP server for computer-use / desktop automation of native apps (screenshots, OCR, input)",
   "license": "MIT",
   "repository": {
     "type": "git",
@@ -11,6 +11,20 @@
   "keywords": [
     "mcp",
     "model-context-protocol",
+    "computer-use",
+    "desktop-automation",
+    "ui-automation",
+    "rpa",
+    "ocr",
+    "screenshot",
+    "screen-reading",
+    "mouse",
+    "keyboard",
+    "ai-agent",
+    "llm",
+    "claude",
+    "gemini",
+    "gpt",
     "devtools",
     "desktop",
     "testing",
@@ -25,8 +39,8 @@
     "bin"
   ],
   "optionalDependencies": {
-    "@sh3ll3x3c/native-devtools-mcp-darwin-arm64": "0.3.1",
-    "@sh3ll3x3c/native-devtools-mcp-win32-x64": "0.3.1"
+    "@sh3ll3x3c/native-devtools-mcp-darwin-arm64": "0.3.2",
+    "@sh3ll3x3c/native-devtools-mcp-win32-x64": "0.3.2"
   },
   "engines": {
     "node": ">=18"