@mobilenext/mobile-mcp 0.0.18 → 0.0.20

package/README.md

@@ -1,12 +1,12 @@
 # Mobile Next - MCP server for Mobile Development and Automation  | iOS, Android, Simulator, Emulator, and physical devices
 
 This is a [Model Context Protocol (MCP) server](https://github.com/modelcontextprotocol) that enables scalable mobile automation, development through a platform-agnostic interface, eliminating the need for distinct iOS or Android knowledge. You can run it on emulators, simulators, and physical devices (iOS and Android).
-This server allows Agents and LLMs to interact with native iOS/Android applications and devices through structured accessibility snapshots or coordinate-based taps based on screenshots. 
+This server allows Agents and LLMs to interact with native iOS/Android applications and devices through structured accessibility snapshots or coordinate-based taps based on screenshots.
 
 <h4 align="center">
 <a href="https://github.com/mobile-next/mobile-mcp">
     <img src="https://img.shields.io/github/stars/mobile-next/mobile-mcp" alt="Mobile Next Stars" />
-  </a>  
+  </a>
  <a href="https://github.com/mobile-next/mobile-mcp">
     <img src="https://img.shields.io/github/contributors/mobile-next/mobile-mcp?color=green" alt="Mobile Next Downloads" />
   </a>
@@ -18,14 +18,14 @@ This server allows Agents and LLMs to interact with native iOS/Android applicati
   </a>
 <a href="https://github.com/mobile-next/mobile-mcp/blob/main/LICENSE">
     <img src="https://img.shields.io/badge/license-Apache 2.0-blue.svg" alt="Mobile MCP is released under the Apache-2.0 License">
-  </a> 
-  
+  </a>
+
 </p>
 
 <h4 align="center">
 <a href="http://mobilenexthq.com/join-slack">
     <img src="https://img.shields.io/badge/join-Slack-blueviolet?logo=slack&style=flat" alt="Slack community channel" />
-</a>	
+</a>
 </p>
 
 https://github.com/user-attachments/assets/c4e89c4f-cc71-4424-8184-bdbc8c638fa1
@@ -38,7 +38,7 @@ https://github.com/user-attachments/assets/c4e89c4f-cc71-4424-8184-bdbc8c638fa1
 
 ### 🚀 Mobile MCP Roadmap: Building the Future of Mobile
 
-Join us on our journey as we continuously enhance Mobile MCP! 
+Join us on our journey as we continuously enhance Mobile MCP!
 Check out our detailed roadmap to see upcoming features, improvements, and milestones. Your feedback is invaluable in shaping the future of mobile automation.
 
 👉 [Explore the Roadmap](https://github.com/orgs/mobile-next/projects/3)
@@ -48,7 +48,7 @@ Check out our detailed roadmap to see upcoming features, improvements, and miles
 
 How we help to scale mobile automation:
 
-- 📲 Native app automation (iOS and Android) for testing or data-entry scenarios. 
+- 📲 Native app automation (iOS and Android) for testing or data-entry scenarios.
 - 📝 Scripted flows and form interactions without manually controlling simulators/emulators or physical devices (iPhone, Samsung, Google Pixel etc)
 - 🧭 Automating multi-step user journeys driven by an LLM
 - 👆 General-purpose mobile application interaction for agent-based frameworks
@@ -56,11 +56,11 @@ How we help to scale mobile automation:
 
 ## Main Features
 
-- 🚀 **Fast and lightweight**: Uses native accessibility trees for most interactions, or screenshot based coordinates where a11y labels are not available. 
+- 🚀 **Fast and lightweight**: Uses native accessibility trees for most interactions, or screenshot based coordinates where a11y labels are not available.
 - 🤖 **LLM-friendly**: No computer vision model required in Accessibility (Snapshot).
 - 🧿 **Visual Sense**: Evaluates and analyses what’s actually rendered on screen to decide the next action. If accessibility data or view-hierarchy coordinates are unavailable, it falls back to screenshot-based analysis.
 - 📊 **Deterministic tool application**: Reduces ambiguity found in purely screenshot-based approaches by relying on structured data whenever possible.
-- 📺 **Extract structured data**: Enables you to extract structred data from anything visible on screen. 
+- 📺 **Extract structured data**: Enables you to extract structred data from anything visible on screen.
 
 ## 🏗️ Mobile MCP Architecture
 
@@ -71,7 +71,7 @@ How we help to scale mobile automation:
 </p>
 
 
-## 📚 Wiki page 
+## 📚 Wiki page
 
 More details in our [wiki page](https://github.com/mobile-next/mobile-mcp/wiki) for setup, configuration and debugging related questions.
 
@@ -91,8 +91,8 @@ Setup our MCP with Cline, Cursor, Claude, VS Code, Github Copilot:
 }
 
 ```
-[Cline:](https://docs.cline.bot/mcp/configuring-mcp-servers) To setup Cline, just add the json above to your MCP settings file. 
-[More in our wiki](https://github.com/mobile-next/mobile-mcp/wiki/Cline) 
+[Cline:](https://docs.cline.bot/mcp/configuring-mcp-servers) To setup Cline, just add the json above to your MCP settings file.
+[More in our wiki](https://github.com/mobile-next/mobile-mcp/wiki/Cline)
 
 [Claude Code:](https://docs.anthropic.com/en/docs/agents-and-tools/claude-code/overview)
 
@@ -105,7 +105,7 @@ claude mcp add mobile -- npx -y @mobilenext/mobile-mcp@latest
 
 ### 🛠️ How to Use 📝
 
-After adding the MCP server to your IDE/Client, you can instruct your AI assistant to use the available tools. 
+After adding the MCP server to your IDE/Client, you can instruct your AI assistant to use the available tools.
 For example, in Cursor's agent mode, you could use the prompts below to quickly validate, test and iterate on UI intereactions, read information from screen, go through complex workflows.
 Be descriptive, straight to the point.
 
@@ -117,47 +117,55 @@ You can specifiy detailed workflows in a single prompt, verify business logic, s
 
 **Search for a video, comment, like and share it.**
 ```
-Find the video called " Beginner Recipe for Tonkotsu Ramen" by Way of Ramen, click on like video, after liking write a comment " this was delicious, will make it next Friday", share the video with the first contact in your whatsapp list. 
+Find the video called " Beginner Recipe for Tonkotsu Ramen" by Way of
+Ramen, click on like video, after liking write a comment " this was
+delicious, will make it next Friday", share the video with the first
+contact in your whatsapp list.
 ```
 
-**Download a successful step counter app, register, setup workout and 5 start the app**
+**Download a successful step counter app, register, setup workout and 5-star the app**
 ```
-Find and Download a free "Pomodoro" app that has more thank 1k stars. 
-Launch the app, register with my email, after registration find how to start a pomodoro timer. 
-When the pomodoro timer started, go back to the app store and rate the app 5 stars, 
-and leave a comment how useful the app is. 
+Find and Download a free "Pomodoro" app that has more than 1k stars.
+Launch the app, register with my email, after registration find how to
+start a pomodoro timer. When the pomodoro timer started, go back to the
+app store and rate the app 5 stars, and leave a comment how useful the
+app is.
 ```
 
 **Search in Substack, read, highlight, comment and save an article**
 ```
-Open Substack website, search for "Latest trends in AI automation 2025", open the first article, 
-highlight the section titled "Emerging AI trends", and save article to reading list for later review, 
-comment a random paragraph summary.
+Open Substack website, search for "Latest trends in AI automation 2025",
+open the first article, highlight the section titled "Emerging AI trends",
+and save article to reading list for later review, comment a random
+paragraph summary.
 ```
 
 **Reserve a workout class, set timer**
 ```
-Open ClassPass, search for yoga classes tomorrow morning within 2 miles, 
+Open ClassPass, search for yoga classes tomorrow morning within 2 miles,
 book the highest-rated class at 7 AM, confirm reservation,
- setup a timer for the booked slot in the phone
+setup a timer for the booked slot in the phone
 ```
 
 **Find a local event, setup calendar event**
 ```
-Open Eventbrite, search for AI startup meetup events happening this weekend in "Austin, TX", 
-select the most popular one, register and RSVP yes to the even, setup a calendar event as a reminder.
+Open Eventbrite, search for AI startup meetup events happening this
+weekend in "Austin, TX", select the most popular one, register and RSVP
+yes to the event, setup a calendar event as a reminder.
 ```
 
 **Check weather forecast and send a Whatsapp/Telegram/Slack message**
 ```
-Open Weather app, check tomorrow's weather forecast for "Berlin", and send the summary 
-via Whatsapp/Telegram/Slack to contact "Lauren Trown", thumbs up their response.
+Open Weather app, check tomorrow's weather forecast for "Berlin", and
+send the summary via Whatsapp/Telegram/Slack to contact "Lauren Trown",
+thumbs up their response.
 ```
 
 - **Schedule a meeting in Zoom and share invite via email**
 ```
-Open Zoom app, schedule a meeting titled "AI Hackathon" for tomorrow at 10 AM with a duration of 1 hour,
-copy the invitation link, and send it via Gmail to contacts "team@example.com".
+Open Zoom app, schedule a meeting titled "AI Hackathon" for tomorrow at
+10AM with a duration of 1 hour, copy the invitation link, and send it via
+Gmail to contacts "team@example.com".
 ```
 [More prompt examples can be found here.](https://github.com/mobile-next/mobile-mcp/wiki/Prompt-Example-repo-list)
 
@@ -167,7 +175,7 @@ What you will need to connect MCP with your agent and mobile devices:
 
 - [Xcode command line tools](https://developer.apple.com/xcode/resources/)
 - [Android Platform Tools](https://developer.android.com/tools/releases/platform-tools)
-- [node.js](https://nodejs.org/en/download/)
+- [node.js](https://nodejs.org/en/download/) v22+
 - [MCP](https://modelcontextprotocol.io/introduction) supported foundational models or agents, like [Claude MCP](https://modelcontextprotocol.io/quickstart/server), [OpenAI Agent SDK](https://openai.github.io/openai-agents-python/mcp/), [Copilot Studio](https://www.microsoft.com/en-us/microsoft-copilot/blog/copilot-studio/introducing-model-context-protocol-mcp-in-copilot-studio-simplified-integration-with-ai-apps-and-agents/)
 
 ### Simulators, Emulators, and Physical Devices
@@ -193,7 +201,7 @@ On iOS, you'll need Xcode and to run the Simulator before using Mobile MCP with
 
 # Thanks to all contributors ❤️
 
-### We appreciate everyone who has helped improve this project. 
+### We appreciate everyone who has helped improve this project.
 
   <a href = "https://github.com/mobile-next/mobile-mcp/graphs/contributors">
    <img src = "https://contrib.rocks/image?repo=mobile-next/mobile-mcp"/>

package/lib/android.js

@@ -94,6 +94,7 @@ class AndroidRobot {
         return { width, height, scale };
     }
     async listApps() {
+        // only apps that have a launcher activity are returned
         return this.adb("shell", "cmd", "package", "query-activities", "-a", "android.intent.action.MAIN", "-c", "android.intent.category.LAUNCHER")
             .toString()
             .split("\n")
@@ -106,6 +107,13 @@ class AndroidRobot {
             appName: packageName,
         }));
     }
+    async listPackages() {
+        return this.adb("shell", "pm", "list", "packages")
+            .toString()
+            .split("\n")
+            .filter(line => line.startsWith("package:"))
+            .map(line => line.substring("package:".length));
+    }
     async launchApp(packageName) {
         this.adb("shell", "monkey", "-p", packageName, "-c", "android.intent.category.LAUNCHER", "1");
     }
@@ -120,7 +128,6 @@ class AndroidRobot {
     async swipe(direction) {
         const screenSize = await this.getScreenSize();
         const centerX = screenSize.width >> 1;
-        // const centerY = screenSize[1] >> 1;
         let x0, y0, x1, y1;
         switch (direction) {
             case "up":
@@ -133,6 +140,50 @@ class AndroidRobot {
                 y0 = Math.floor(screenSize.height * 0.20);
                 y1 = Math.floor(screenSize.height * 0.80);
                 break;
+            case "left":
+                x0 = Math.floor(screenSize.width * 0.80);
+                x1 = Math.floor(screenSize.width * 0.20);
+                y0 = y1 = Math.floor(screenSize.height * 0.50);
+                break;
+            case "right":
+                x0 = Math.floor(screenSize.width * 0.20);
+                x1 = Math.floor(screenSize.width * 0.80);
+                y0 = y1 = Math.floor(screenSize.height * 0.50);
+                break;
+            default:
+                throw new robot_1.ActionableError(`Swipe direction "${direction}" is not supported`);
+        }
+        this.adb("shell", "input", "swipe", `${x0}`, `${y0}`, `${x1}`, `${y1}`, "1000");
+    }
+    async swipeFromCoordinate(x, y, direction, distance) {
+        const screenSize = await this.getScreenSize();
+        let x0, y0, x1, y1;
+        // Use provided distance or default to 30% of screen dimension
+        const defaultDistanceY = Math.floor(screenSize.height * 0.3);
+        const defaultDistanceX = Math.floor(screenSize.width * 0.3);
+        const swipeDistanceY = distance || defaultDistanceY;
+        const swipeDistanceX = distance || defaultDistanceX;
+        switch (direction) {
+            case "up":
+                x0 = x1 = x;
+                y0 = y;
+                y1 = Math.max(0, y - swipeDistanceY);
+                break;
+            case "down":
+                x0 = x1 = x;
+                y0 = y;
+                y1 = Math.min(screenSize.height, y + swipeDistanceY);
+                break;
+            case "left":
+                x0 = x;
+                x1 = Math.max(0, x - swipeDistanceX);
+                y0 = y1 = y;
+                break;
+            case "right":
+                x0 = x;
+                x1 = Math.min(screenSize.width, x + swipeDistanceX);
+                y0 = y1 = y;
+                break;
             default:
                 throw new robot_1.ActionableError(`Swipe direction "${direction}" is not supported`);
         }
@@ -186,10 +237,37 @@ class AndroidRobot {
     async openUrl(url) {
         this.adb("shell", "am", "start", "-a", "android.intent.action.VIEW", "-d", url);
     }
+    isAscii(text) {
+        return /^[\x00-\x7F]*$/.test(text);
+    }
+    async isDeviceKitInstalled() {
+        const packages = await this.listPackages();
+        return packages.includes("com.mobilenext.devicekit");
+    }
     async sendKeys(text) {
-        // adb shell requires some escaping
-        const _text = text.replace(/ /g, "\\ ");
-        this.adb("shell", "input", "text", _text);
+        if (text === "") {
+            // bailing early, so we don't run adb shell with empty string.
+            // this happens when you prompt with a simple "submit".
+            return;
+        }
+        if (this.isAscii(text)) {
+            // adb shell input only supports ascii characters. and
+            // some of the keys have to be escaped.
+            const _text = text.replace(/ /g, "\\ ");
+            this.adb("shell", "input", "text", _text);
+        }
+        else if (await this.isDeviceKitInstalled()) {
+            // try sending over clipboard
+            const base64 = Buffer.from(text).toString("base64");
+            // send clipboard over and immediately paste it
+            this.adb("shell", "am", "broadcast", "-a", "devicekit.clipboard.set", "-e", "encoding", "base64", "-e", "text", base64, "-n", "com.mobilenext.devicekit/.ClipboardBroadcastReceiver");
+            this.adb("shell", "input", "keyevent", "KEYCODE_PASTE");
+            // clear clipboard when we're done
+            this.adb("shell", "am", "broadcast", "-a", "devicekit.clipboard.clear", "-n", "com.mobilenext.devicekit/.ClipboardBroadcastReceiver");
+        }
+        else {
+            throw new robot_1.ActionableError("Non-ASCII text is not supported on Android, please install mobilenext devicekit, see https://github.com/mobile-next/devicekit-android");
+        }
     }
     async pressButton(button) {
         if (!BUTTON_MAP[button]) {
@@ -202,8 +280,9 @@ class AndroidRobot {
     }
     async setOrientation(orientation) {
         const orientationValue = orientation === "portrait" ? 0 : 1;
-        this.adb("shell", "content", "insert", "--uri", "content://settings/system", "--bind", "name:s:user_rotation", "--bind", `value:i:${orientationValue}`);
+        // disable auto-rotation prior to setting the orientation
         this.adb("shell", "settings", "put", "system", "accelerometer_rotation", "0");
+        this.adb("shell", "content", "insert", "--uri", "content://settings/system", "--bind", "name:s:user_rotation", "--bind", `value:i:${orientationValue}`);
     }
     async getOrientation() {
         const rotation = this.adb("shell", "settings", "get", "system", "user_rotation").toString().trim();
@@ -219,7 +298,7 @@ class AndroidRobot {
                 // console.error("Failed to get UIAutomator XML. Here's a screenshot: " + screenshot.toString("base64"));
                 continue;
             }
-            return dump;
+            return dump.substring(dump.indexOf("<?xml"));
         }
         throw new robot_1.ActionableError("Failed to get UIAutomator XML");
     }

package/lib/ios.js

@@ -1,13 +1,6 @@
 "use strict";
-var __importDefault = (this && this.__importDefault) || function (mod) {
-    return (mod && mod.__esModule) ? mod : { "default": mod };
-};
 Object.defineProperty(exports, "__esModule", { value: true });
 exports.IosManager = exports.IosRobot = void 0;
-const path_1 = __importDefault(require("path"));
-const os_1 = require("os");
-const crypto_1 = require("crypto");
-const fs_1 = require("fs");
 const child_process_1 = require("child_process");
 const net_1 = require("net");
 const webdriver_agent_1 = require("./webdriver-agent");
@@ -83,6 +76,10 @@ class IosRobot {
         const wda = await this.wda();
         await wda.swipe(direction);
     }
+    async swipeFromCoordinate(x, y, direction, distance) {
+        const wda = await this.wda();
+        await wda.swipeFromCoordinate(x, y, direction, distance);
+    }
     async listApps() {
         await this.assertTunnelRunning();
         const output = await this.ios("apps", "--all", "--list");
@@ -125,12 +122,16 @@ class IosRobot {
         return await wda.getElementsOnScreen();
     }
     async getScreenshot() {
+        const wda = await this.wda();
+        return await wda.getScreenshot();
+        /* alternative:
         await this.assertTunnelRunning();
-        const tmpFilename = path_1.default.join((0, os_1.tmpdir)(), `screenshot-${(0, crypto_1.randomBytes)(8).toString("hex")}.png`);
+        const tmpFilename = path.join(tmpdir(), `screenshot-${randomBytes(8).toString("hex")}.png`);
         await this.ios("screenshot", "--output", tmpFilename);
-        const buffer = (0, fs_1.readFileSync)(tmpFilename);
-        (0, fs_1.unlinkSync)(tmpFilename);
+        const buffer = readFileSync(tmpFilename);
+        unlinkSync(tmpFilename);
         return buffer;
+        */
     }
     async setOrientation(orientation) {
         const wda = await this.wda();
@@ -153,23 +154,23 @@ class IosManager {
             return false;
         }
     }
-    async getDeviceName(deviceId) {
+    getDeviceName(deviceId) {
         const output = (0, child_process_1.execFileSync)(getGoIosPath(), ["info", "--udid", deviceId]).toString();
         const json = JSON.parse(output);
         return json.DeviceName;
     }
-    async listDevices() {
-        if (!(await this.isGoIosInstalled())) {
+    listDevices() {
+        if (!this.isGoIosInstalled()) {
             console.error("go-ios is not installed, no physical iOS devices can be detected");
             return [];
         }
         const output = (0, child_process_1.execFileSync)(getGoIosPath(), ["list"]).toString();
         const json = JSON.parse(output);
-        const devices = json.deviceList.map(async (device) => ({
+        const devices = json.deviceList.map(device => ({
             deviceId: device,
-            deviceName: await this.getDeviceName(device),
+            deviceName: this.getDeviceName(device),
         }));
-        return Promise.all(devices);
+        return devices;
     }
 }
 exports.IosManager = IosManager;

package/lib/iphone-simulator.js

@@ -26,7 +26,9 @@ class Simctl {
         });
     }
     async getScreenshot() {
-        return this.simctl("io", this.simulatorUuid, "screenshot", "-");
+        const wda = await this.wda();
+        return await wda.getScreenshot();
+        // alternative: return this.simctl("io", this.simulatorUuid, "screenshot", "-");
     }
     async openUrl(url) {
         const wda = await this.wda();
@@ -62,6 +64,10 @@ class Simctl {
         const wda = await this.wda();
         return wda.swipe(direction);
     }
+    async swipeFromCoordinate(x, y, direction, distance) {
+        const wda = await this.wda();
+        return wda.swipeFromCoordinate(x, y, direction, distance);
+    }
     async tap(x, y) {
         const wda = await this.wda();
         return wda.tap(x, y);

package/lib/server.js

@@ -1,8 +1,13 @@
 "use strict";
+var __importDefault = (this && this.__importDefault) || function (mod) {
+    return (mod && mod.__esModule) ? mod : { "default": mod };
+};
 Object.defineProperty(exports, "__esModule", { value: true });
 exports.createMcpServer = exports.getAgentVersion = void 0;
 const mcp_js_1 = require("@modelcontextprotocol/sdk/server/mcp.js");
 const zod_1 = require("zod");
+const node_fs_1 = __importDefault(require("node:fs"));
+const node_crypto_1 = __importDefault(require("node:crypto"));
 const logger_1 = require("./logger");
 const android_1 = require("./android");
 const robot_1 = require("./robot");
@@ -41,6 +46,8 @@ const createMcpServer = () => {
             tools: {},
         },
     });
+    // an empty object to satisfy windsurf
+    const noParams = zod_1.z.object({});
     const tool = (name, description, paramsSchema, cb) => {
         const wrappedCb = async (args) => {
             try {
@@ -69,6 +76,27 @@ const createMcpServer = () => {
         };
         server.tool(name, description, paramsSchema, args => wrappedCb(args));
     };
+    const posthog = (event, properties) => {
+        const url = "https://us.i.posthog.com/i/v0/e/";
+        const api_key = "phc_KHRTZmkDsU7A8EbydEK8s4lJpPoTDyyBhSlwer694cS";
+        const distinct_id = node_crypto_1.default.createHash("sha256").update(process.execPath).digest("hex");
+        fetch(url, {
+            method: "POST",
+            headers: {
+                "Content-Type": "application/json"
+            },
+            body: JSON.stringify({
+                api_key,
+                event,
+                properties,
+                distinct_id,
+            })
+        }).then().catch();
+    };
+    posthog("launch", {
+        Product: "mobile-mcp",
+        Version: (0, exports.getAgentVersion)(),
+    });
     let robot;
     const simulatorManager = new iphone_simulator_1.SimctlManager();
     const requireRobot = () => {
@@ -76,11 +104,44 @@ const createMcpServer = () => {
             throw new robot_1.ActionableError("No device selected. Use the mobile_use_device tool to select a device.");
         }
     };
-    tool("mobile_list_available_devices", "List all available devices. This includes both physical devices and simulators. If there is more than one device returned, you need to let the user select one of them.", {}, async ({}) => {
+    tool("mobile_use_default_device", "Use the default device. This is a shortcut for mobile_use_device with deviceType=simulator and device=simulator_name", {
+        noParams
+    }, async () => {
+        const iosManager = new ios_1.IosManager();
+        const androidManager = new android_1.AndroidDeviceManager();
+        const simulators = simulatorManager.listBootedSimulators();
+        const androidDevices = androidManager.getConnectedDevices();
+        const iosDevices = iosManager.listDevices();
+        const sum = simulators.length + androidDevices.length + iosDevices.length;
+        if (sum === 0) {
+            throw new robot_1.ActionableError("No devices found. Please connect a device and try again.");
+        }
+        else if (sum >= 2) {
+            throw new robot_1.ActionableError("Multiple devices found. Please use the mobile_list_available_devices tool to list available devices and select one.");
+        }
+        // only one device connected, let's find it now
+        if (simulators.length === 1) {
+            robot = simulatorManager.getSimulator(simulators[0].name);
+            return `Selected default device: ${simulators[0].name}`;
+        }
+        else if (androidDevices.length === 1) {
+            robot = new android_1.AndroidRobot(androidDevices[0].deviceId);
+            return `Selected default device: ${androidDevices[0].deviceId}`;
+        }
+        else if (iosDevices.length === 1) {
+            robot = new ios_1.IosRobot(iosDevices[0].deviceId);
+            return `Selected default device: ${iosDevices[0].deviceId}`;
+        }
+        // how did this happen?
+        throw new robot_1.ActionableError("No device selected. Please use the mobile_list_available_devices tool to list available devices and select one.");
+    });
+    tool("mobile_list_available_devices", "List all available devices. This includes both physical devices and simulators. If there is more than one device returned, you need to let the user select one of them.", {
+        noParams
+    }, async ({}) => {
         const iosManager = new ios_1.IosManager();
         const androidManager = new android_1.AndroidDeviceManager();
-        const devices = simulatorManager.listBootedSimulators();
-        const simulatorNames = devices.map(d => d.name);
+        const simulators = simulatorManager.listBootedSimulators();
+        const simulatorNames = simulators.map(d => d.name);
         const androidDevices = androidManager.getConnectedDevices();
         const iosDevices = await iosManager.listDevices();
         const iosDeviceNames = iosDevices.map(d => d.deviceId);
@@ -118,7 +179,9 @@ const createMcpServer = () => {
         }
         return `Selected device: ${device}`;
     });
-    tool("mobile_list_apps", "List all the installed apps on the device", {}, async ({}) => {
+    tool("mobile_list_apps", "List all the installed apps on the device", {
+        noParams
+    }, async ({}) => {
         requireRobot();
         const result = await robot.listApps();
         return `Found these apps on device: ${result.map(app => `${app.appName} (${app.packageName})`).join(", ")}`;
@@ -137,12 +200,14 @@ const createMcpServer = () => {
         await robot.terminateApp(packageName);
         return `Terminated app ${packageName}`;
     });
-    tool("mobile_get_screen_size", "Get the screen size of the mobile device in pixels", {}, async ({}) => {
+    tool("mobile_get_screen_size", "Get the screen size of the mobile device in pixels", {
+        noParams
+    }, async ({}) => {
         requireRobot();
         const screenSize = await robot.getScreenSize();
         return `Screen size is ${screenSize.width}x${screenSize.height} pixels`;
     });
-    tool("mobile_click_on_screen_at_coordinates", "Click on the screen at given x,y coordinates", {
+    tool("mobile_click_on_screen_at_coordinates", "Click on the screen at given x,y coordinates. If clicking on an element, use the list_elements_on_screen tool to find the coordinates.", {
         x: zod_1.z.number().describe("The x coordinate to click on the screen, in pixels"),
         y: zod_1.z.number().describe("The y coordinate to click on the screen, in pixels"),
     }, async ({ x, y }) => {
@@ -150,7 +215,9 @@ const createMcpServer = () => {
         await robot.tap(x, y);
         return `Clicked on screen at coordinates: ${x}, ${y}`;
     });
-    tool("mobile_list_elements_on_screen", "List elements on screen and their coordinates, with display text or accessibility label. Do not cache this result.", {}, async ({}) => {
+    tool("mobile_list_elements_on_screen", "List elements on screen and their coordinates, with display text or accessibility label. Do not cache this result.", {
+        noParams
+    }, async ({}) => {
         requireRobot();
         const elements = await robot.getElementsOnScreen();
         const result = elements.map(element => {
@@ -190,11 +257,23 @@ const createMcpServer = () => {
         return `Opened URL: ${url}`;
     });
     tool("swipe_on_screen", "Swipe on the screen", {
-        direction: zod_1.z.enum(["up", "down"]).describe("The direction to swipe"),
-    }, async ({ direction }) => {
+        direction: zod_1.z.enum(["up", "down", "left", "right"]).describe("The direction to swipe"),
+        x: zod_1.z.number().optional().describe("The x coordinate to start the swipe from, in pixels. If not provided, uses center of screen"),
+        y: zod_1.z.number().optional().describe("The y coordinate to start the swipe from, in pixels. If not provided, uses center of screen"),
+        distance: zod_1.z.number().optional().describe("The distance to swipe in pixels. Defaults to 400 pixels for iOS or 30% of screen dimension for Android"),
+    }, async ({ direction, x, y, distance }) => {
         requireRobot();
-        await robot.swipe(direction);
-        return `Swiped ${direction} on screen`;
+        if (x !== undefined && y !== undefined) {
+            // Use coordinate-based swipe
+            await robot.swipeFromCoordinate(x, y, direction, distance);
+            const distanceText = distance ? ` ${distance} pixels` : "";
+            return `Swiped ${direction}${distanceText} from coordinates: ${x}, ${y}`;
+        }
+        else {
+            // Use center-based swipe
+            await robot.swipe(direction);
+            return `Swiped ${direction} on screen`;
+        }
     });
     tool("mobile_type_keys", "Type text into the focused element", {
         text: zod_1.z.string().describe("The text to type"),
@@ -207,7 +286,17 @@ const createMcpServer = () => {
         }
         return `Typed text: ${text}`;
     });
-    server.tool("mobile_take_screenshot", "Take a screenshot of the mobile device. Use this to understand what's on screen, if you need to press an element that is available through view hierarchy then you must list elements on screen instead. Do not cache this result.", {}, async ({}) => {
+    tool("mobile_save_screenshot", "Save a screenshot of the mobile device to a file", {
+        saveTo: zod_1.z.string().describe("The path to save the screenshot to"),
+    }, async ({ saveTo }) => {
+        requireRobot();
+        const screenshot = await robot.getScreenshot();
+        node_fs_1.default.writeFileSync(saveTo, screenshot);
+        return `Screenshot saved to: ${saveTo}`;
+    });
+    server.tool("mobile_take_screenshot", "Take a screenshot of the mobile device. Use this to understand what's on screen, if you need to press an element that is available through view hierarchy then you must list elements on screen instead. Do not cache this result.", {
+        noParams
+    }, async ({}) => {
         requireRobot();
         try {
             const screenSize = await robot.getScreenSize();
@@ -251,7 +340,9 @@ const createMcpServer = () => {
         await robot.setOrientation(orientation);
         return `Changed device orientation to ${orientation}`;
     });
-    tool("mobile_get_orientation", "Get the current screen orientation of the device", {}, async () => {
+    tool("mobile_get_orientation", "Get the current screen orientation of the device", {
+        noParams
+    }, async () => {
         requireRobot();
         const orientation = await robot.getOrientation();
         return `Current device orientation is ${orientation}`;

package/lib/webdriver-agent.js

@@ -29,7 +29,14 @@ class WebDriverAgent {
             },
             body: JSON.stringify({ capabilities: { alwaysMatch: { platformName: "iOS" } } }),
         });
+        if (!response.ok) {
+            const errorText = await response.text();
+            throw new robot_1.ActionableError(`Failed to create WebDriver session: ${response.status} ${errorText}`);
+        }
         const json = await response.json();
+        if (!json.value || !json.value.sessionId) {
+            throw new robot_1.ActionableError(`Invalid session response: ${JSON.stringify(json)}`);
+        }
         return json.value.sessionId;
     }
     async deleteSession(sessionId) {
@@ -44,8 +51,8 @@ class WebDriverAgent {
         await this.deleteSession(sessionId);
         return result;
     }
-    async getScreenSize() {
-        return this.withinSession(async (sessionUrl) => {
+    async getScreenSize(sessionUrl) {
+        if (sessionUrl) {
             const url = `${sessionUrl}/wda/screen`;
             const response = await fetch(url);
             const json = await response.json();
@@ -54,7 +61,19 @@ class WebDriverAgent {
                 height: json.value.screenSize.height,
                 scale: json.value.scale || 1,
             };
-        });
+        }
+        else {
+            return this.withinSession(async (sessionUrlInner) => {
+                const url = `${sessionUrlInner}/wda/screen`;
+                const response = await fetch(url);
+                const json = await response.json();
+                return {
+                    width: json.value.screenSize.width,
+                    height: json.value.screenSize.height,
+                    scale: json.value.scale || 1,
+                };
+            });
+        }
     }
     async sendKeys(keys) {
         await this.withinSession(async (sessionUrl) => {
@@ -172,19 +191,47 @@ class WebDriverAgent {
             });
         });
     }
+    async getScreenshot() {
+        const url = `http://${this.host}:${this.port}/screenshot`;
+        const response = await fetch(url);
+        const json = await response.json();
+        return Buffer.from(json.value, "base64");
+    }
     async swipe(direction) {
         await this.withinSession(async (sessionUrl) => {
-            const x0 = 200;
-            let y0 = 600;
-            const x1 = 200;
-            let y1 = 200;
-            if (direction === "up") {
-                const tmp = y0;
-                y0 = y1;
-                y1 = tmp;
+            const screenSize = await this.getScreenSize(sessionUrl);
+            let x0, y0, x1, y1;
+            // Use 60% of the width/height for swipe distance
+            const verticalDistance = Math.floor(screenSize.height * 0.6);
+            const horizontalDistance = Math.floor(screenSize.width * 0.6);
+            const centerX = Math.floor(screenSize.width / 2);
+            const centerY = Math.floor(screenSize.height / 2);
+            switch (direction) {
+                case "up":
+                    x0 = x1 = centerX;
+                    y0 = centerY + Math.floor(verticalDistance / 2);
+                    y1 = centerY - Math.floor(verticalDistance / 2);
+                    break;
+                case "down":
+                    x0 = x1 = centerX;
+                    y0 = centerY - Math.floor(verticalDistance / 2);
+                    y1 = centerY + Math.floor(verticalDistance / 2);
+                    break;
+                case "left":
+                    y0 = y1 = centerY;
+                    x0 = centerX + Math.floor(horizontalDistance / 2);
+                    x1 = centerX - Math.floor(horizontalDistance / 2);
+                    break;
+                case "right":
+                    y0 = y1 = centerY;
+                    x0 = centerX - Math.floor(horizontalDistance / 2);
+                    x1 = centerX + Math.floor(horizontalDistance / 2);
+                    break;
+                default:
+                    throw new robot_1.ActionableError(`Swipe direction "${direction}" is not supported`);
             }
             const url = `${sessionUrl}/actions`;
-            await fetch(url, {
+            const response = await fetch(url, {
                 method: "POST",
                 headers: {
                     "Content-Type": "application/json",
@@ -198,14 +245,77 @@ class WebDriverAgent {
                             actions: [
                                 { type: "pointerMove", duration: 0, x: x0, y: y0 },
                                 { type: "pointerDown", button: 0 },
-                                { type: "pointerMove", duration: 0, x: x1, y: y1 },
-                                { type: "pause", duration: 1000 },
+                                { type: "pointerMove", duration: 1000, x: x1, y: y1 },
                                 { type: "pointerUp", button: 0 }
                             ]
                         }
                     ]
                 }),
             });
+            if (!response.ok) {
+                const errorText = await response.text();
+                throw new robot_1.ActionableError(`WebDriver actions request failed: ${response.status} ${errorText}`);
+            }
+            // Clear actions to ensure they complete
+            await fetch(`${sessionUrl}/actions`, {
+                method: "DELETE",
+            });
+        });
+    }
+    async swipeFromCoordinate(x, y, direction, distance = 400) {
+        await this.withinSession(async (sessionUrl) => {
+            // Use simple coordinates like the working swipe method
+            const x0 = x;
+            const y0 = y;
+            let x1 = x;
+            let y1 = y;
+            // Calculate target position based on direction and distance
+            switch (direction) {
+                case "up":
+                    y1 = y - distance; // Move up by specified distance
+                    break;
+                case "down":
+                    y1 = y + distance; // Move down by specified distance
+                    break;
+                case "left":
+                    x1 = x - distance; // Move left by specified distance
+                    break;
+                case "right":
+                    x1 = x + distance; // Move right by specified distance
+                    break;
+                default:
+                    throw new robot_1.ActionableError(`Swipe direction "${direction}" is not supported`);
+            }
+            const url = `${sessionUrl}/actions`;
+            const response = await fetch(url, {
+                method: "POST",
+                headers: {
+                    "Content-Type": "application/json",
+                },
+                body: JSON.stringify({
+                    actions: [
+                        {
+                            type: "pointer",
+                            id: "finger1",
+                            parameters: { pointerType: "touch" },
+                            actions: [
+                                { type: "pointerMove", duration: 0, x: x0, y: y0 },
+                                { type: "pointerDown", button: 0 },
+                                { type: "pointerMove", duration: 1000, x: x1, y: y1 },
+                                { type: "pointerUp", button: 0 }
+                            ]
+                        }
+                    ]
+                }),
+            });
+            if (!response.ok) {
+                const errorText = await response.text();
+                throw new robot_1.ActionableError(`WebDriver actions request failed: ${response.status} ${errorText}`);
+            }
+            // Clear actions to ensure they complete
+            await fetch(`${sessionUrl}/actions`, {
+                method: "DELETE",
+            });
         });
     }
     async setOrientation(orientation) {

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@mobilenext/mobile-mcp",
-  "version": "0.0.18",
+  "version": "0.0.20",
   "description": "Mobile MCP",
   "repository": {
     "type": "git",