react-native-ai-debugger 1.0.46 → 1.1.0

package/README.md

@@ -18,9 +18,9 @@ An MCP (Model Context Protocol) server for AI-powered React Native debugging. En
 
 -   **iOS Simulator** - Screenshots, app management, URL handling, boot/terminate (via simctl)
 -   **Android Devices** - Screenshots, app install/launch, package management (via ADB)
--   **UI Automation** - Tap, swipe, long press, text input, and key events on both platforms
+-   **Unified Tap** - Single `tap` tool with automatic fallback chain: fiber tree → accessibility → OCR → coordinates. Auto-detects platform, accepts pixels from screenshots
+-   **UI Automation** - Swipe, long press, text input, and key events on both platforms
 -   **Accessibility Inspection** - Query UI hierarchy to find elements by text, label, or resource ID
--   **Element-Based Interaction** - Tap/wait for elements by text without screenshots (faster, cheaper)
 -   **OCR Text Extraction** - Extract visible text with tap-ready coordinates (works on any screen content)
 
 ### Under the Hood
@@ -248,8 +248,8 @@ Style: { borderRadius: 15, overflow: "hidden" }
 # 1. Enable the inspector overlay
 toggle_element_inspector()
 
-# 2. Tap to select element (iOS)
-ios_tap(x=210, y=400)
+# 2. Tap to select element
+tap with x=630 y=1200    # pixel coordinates from screenshot
 
 # 3. Read the selection
 get_inspector_selection()
@@ -260,6 +260,22 @@ toggle_element_inspector()
 
 **Token Efficiency**: Returns ~0.2-0.5KB vs 15-25KB for full component tree. Works on all React Native versions including Fabric/New Architecture.
 
+### UI Interaction (Cross-Platform)
+
+| Tool             | Description                                                              |
+| ---------------- | ------------------------------------------------------------------------ |
+| `tap`            | **Unified tap** — auto-detects platform, tries fiber tree → accessibility → OCR → coordinates. Accepts text, testID, component name, or pixel coordinates from screenshots |
+| `ocr_screenshot` | Extract all visible text with tap-ready coordinates (works on iOS/Android) |
+
+**Examples:**
+```
+tap with text="Submit"                    # Finds and taps by visible text
+tap with testID="login-btn"               # Finds by testID prop
+tap with component="HamburgerIcon"        # Finds by React component name
+tap with x=300 y=600                      # Taps at pixel coordinates (auto-converts)
+tap with text="Menu" strategy="ocr"       # Forces OCR strategy only
+```
+
 ### Android (ADB)
 
 | Tool                        | Description                                                   |
@@ -269,7 +285,6 @@ toggle_element_inspector()
 | `android_install_app`       | Install an APK on an Android device/emulator                  |
 | `android_launch_app`        | Launch an app by package name                                 |
 | `android_list_packages`     | List installed packages (with optional filter)                |
-| `android_tap`               | Tap at specific coordinates on screen                         |
 | `android_long_press`        | Long press at specific coordinates                            |
 | `android_swipe`             | Swipe from one point to another                               |
 | `android_input_text`        | Type text at current focus point                              |
@@ -277,7 +292,6 @@ toggle_element_inspector()
 | `android_get_screen_size`   | Get device screen resolution                                  |
 | `android_describe_all`      | Get full UI accessibility tree via uiautomator                |
 | `android_describe_point`    | Get UI element info at specific coordinates                   |
-| `android_tap_element`       | Tap element by text/contentDesc/resourceId                    |
 | `android_find_element`      | Find element by text/contentDesc/resourceId (no screenshot)   |
 | `android_wait_for_element`  | Wait for element to appear (useful for screen transitions)    |
 
@@ -292,8 +306,6 @@ toggle_element_inspector()
 | `ios_open_url`          | Open a URL (deep links or web URLs)                             |
 | `ios_terminate_app`     | Terminate a running app                                         |
 | `ios_boot_simulator`    | Boot a simulator by UDID                                        |
-| `ios_tap`               | Tap at coordinates (requires IDB)                               |
-| `ios_tap_element`       | Tap element by accessibility label (requires IDB)               |
 | `ios_swipe`             | Swipe gesture (requires IDB)                                    |
 | `ios_input_text`        | Type text into active field (requires IDB)                      |
 | `ios_button`            | Press hardware button: HOME, LOCK, SIRI (requires IDB)          |
@@ -304,12 +316,6 @@ toggle_element_inspector()
 | `ios_find_element`      | Find element by label/value (requires IDB, no screenshot)       |
 | `ios_wait_for_element`  | Wait for element to appear (requires IDB)                       |
 
-### OCR (Cross-Platform)
-
-| Tool             | Description                                                              |
-| ---------------- | ------------------------------------------------------------------------ |
-| `ocr_screenshot` | Extract all visible text with tap-ready coordinates (works on iOS/Android) |
-
 ## Usage
 
 1. Start your React Native app:
@@ -913,10 +919,10 @@ Take a screenshot:
 android_screenshot
 ```
 
-Tap on screen (coordinates in pixels):
+Tap on screen:
 
 ```
-android_tap with x=540 y=960
+tap with x=540 y=960
 ```
 
 Swipe gesture:
@@ -928,7 +934,7 @@ android_swipe with startX=540 startY=1500 endX=540 endY=500
 Type text (tap input field first):
 
 ```
-android_tap with x=540 y=400
+tap with x=540 y=400
 android_input_text with text="hello@example.com"
 ```
 
@@ -972,92 +978,58 @@ Open a deep link:
 ios_open_url with url="myapp://settings"
 ```
 
-## Efficient UI Automation (No Screenshots)
-
-For action triggering without layout debugging, use element-based tools instead of screenshots. This is **2-3x faster** and uses fewer tokens.
-
-### Android - Find and Tap by Text
+## UI Interaction
 
-```
-# Wait for screen to load
-android_wait_for_element with text="Login"
+### Unified `tap` Tool (Recommended)
 
-# Find element (returns tap coordinates)
-android_find_element with textContains="submit"
+The `tap` tool is the simplest way to interact with UI elements. It automatically tries multiple strategies and handles platform detection and coordinate conversion:
 
-# Tap the element (use coordinates from find_element)
-android_tap with x=540 y=960
 ```
+# By visible text — tries fiber tree, accessibility, then OCR
+tap with text="Submit"
 
-Search options:
-- `text` - exact text match
-- `textContains` - partial text (case-insensitive)
-- `contentDesc` - accessibility content description
-- `contentDescContains` - partial content description
-- `resourceId` - resource ID (e.g., "button" or "com.app:id/button")
+# By testID prop
+tap with testID="login-btn"
 
-### iOS - Find and Tap by Label (requires IDB)
+# By React component name (fiber tree only)
+tap with component="HamburgerIcon"
 
-```bash
-# Install IDB first
-brew install idb-companion
-```
+# By pixel coordinates from screenshot (auto-converts to points on iOS)
+tap with x=300 y=600
 
+# Force a specific strategy
+tap with text="Menu" strategy="ocr"
 ```
-# Wait for element
-ios_wait_for_element with label="Sign In"
 
-# Find element by partial label
-ios_find_element with labelContains="welcome"
-```
+**Fallback chain:** fiber tree (direct `onPress`) → accessibility tree → OCR → error with suggestion.
 
-Search options:
-- `label` - exact accessibility label
-- `labelContains` - partial label (case-insensitive)
-- `value` - accessibility value
-- `valueContains` - partial value
-- `type` - element type (e.g., "Button", "TextField")
+On failure, the response includes an actionable `suggestion` telling the agent exactly what to try next.
 
-### Wait for Screen Transitions
+### Platform-Specific Tools
 
-Both platforms support waiting with timeout:
+For gestures beyond tapping, use platform-specific tools:
 
 ```
-android_wait_for_element with text="Dashboard" timeoutMs=15000 pollIntervalMs=500
-ios_wait_for_element with label="Home" timeoutMs=10000
-```
+# Swipe
+ios_swipe with startX=200 startY=400 endX=200 endY=100
+android_swipe with startX=540 startY=1500 endX=540 endY=500
 
-### Recommended Workflow (Priority Order)
+# Text input (tap input field first)
+tap with text="Email"
+ios_input_text with text="hello@example.com"
 
-**Always try accessibility tools first, fall back to screenshots only when needed:**
+# Key events
+android_key_event with key="BACK"
+ios_button with button="HOME"
+```
 
-1. **Wait for screen** → Use `wait_for_element` with expected text/label
-2. **Find target** → Use `find_element` to get tap coordinates
-3. **Tap** → Use `tap` with coordinates from step 2
-4. **Fallback** → If element not in accessibility tree, use `screenshot`
+### Wait for Screen Transitions
 
 ```
-# Example: Tap "Submit" button after screen loads
-android_wait_for_element with text="Submit"     # Step 1: Wait
-android_find_element with text="Submit"         # Step 2: Find (returns center coordinates)
-android_tap with x=540 y=1200                   # Step 3: Tap (use returned coordinates)
+android_wait_for_element with text="Dashboard" timeoutMs=15000
+ios_wait_for_element with label="Home" timeoutMs=10000
 ```
 
-**Why this order?**
-- `find_element`: ~100-200 tokens, <100ms
-- `screenshot`: ~400-500 tokens, 200-500ms
-
-### When to Use Screenshots vs Element Tools
-
-| Use Case | Recommended Tool |
-|----------|------------------|
-| Trigger button taps | `find_element` + `tap` |
-| Wait for screen load | `wait_for_element` |
-| Navigate through flow | `wait_for_element` + `tap` |
-| Debug layout issues | `screenshot` |
-| Verify visual appearance | `screenshot` |
-| Find elements without labels | `screenshot` |
-
 ## OCR Text Extraction
 
 The `ocr_screenshot` tool extracts all visible text from a screenshot with tap-ready coordinates. This is useful when accessibility labels are missing or when you need to find text that isn't exposed in the accessibility tree.
@@ -1094,7 +1066,7 @@ Returns all visible text with tap-ready coordinates:
 Then tap the element:
 
 ```
-ios_tap with x=187 y=420
+tap with x=187 y=420
 ```
 
 ### OCR Engine
@@ -1147,19 +1119,19 @@ See [EasyOCR supported languages](https://www.jaided.ai/easyocr/) for the full l
 
 ### Recommended Workflow
 
-1. **Try accessibility first** - Use `find_element` / `wait_for_element` (faster, cheaper)
-2. **Fall back to OCR** - When element isn't in accessibility tree
+1. **Use unified `tap`** - Handles fallback chain automatically
+2. **Fall back to OCR** - When `tap` suggests using coordinates
 3. **Use screenshot** - For visual debugging or layout verification
 
 ```
-# Step 1: Try accessibility-based approach
-android_find_element with text="Submit"
+# Simplest approach — tap handles everything
+tap with text="Submit"
 
-# Step 2: If not found, use OCR
+# If tap fails, use OCR to find coordinates
 ocr_screenshot with platform="android"
 
-# Step 3: Tap using coordinates from OCR result
-android_tap with x=540 y=1200
+# Then tap using coordinates from OCR result
+tap with x=540 y=1200
 ```
 
 ## Supported React Native Versions

package/build/__tests__/unit/tap.test.d.ts

@@ -0,0 +1,2 @@
+export {};
+//# sourceMappingURL=tap.test.d.ts.map

package/build/__tests__/unit/tap.test.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"tap.test.d.ts","sourceRoot":"","sources":["../../../src/__tests__/unit/tap.test.ts"],"names":[],"mappings":""}

package/build/__tests__/unit/tap.test.js

@@ -0,0 +1,155 @@
+// src/__tests__/unit/tap.test.ts
+import { describe, it, expect } from "@jest/globals";
+import { buildQuery, getAvailableStrategies, isNonAscii, convertPixelsToPoints, formatTapSuccess, formatTapFailure, } from "../../core/tap.js";
+describe("ConnectedApp type", () => {
+    it("accepts platform and lastScreenshot fields", () => {
+        const app = {
+            ws: {},
+            deviceInfo: {
+                id: "test",
+                title: "Hermes React Native",
+                description: "",
+                appId: "com.test",
+                type: "node",
+                webSocketDebuggerUrl: "ws://localhost:8081",
+                deviceName: "iPhone 16",
+            },
+            port: 8081,
+            platform: "ios",
+            lastScreenshot: {
+                originalWidth: 1179,
+                originalHeight: 2556,
+                scaleFactor: 1,
+            },
+        };
+        expect(app.platform).toBe("ios");
+        expect(app.lastScreenshot?.originalWidth).toBe(1179);
+    });
+    it("allows lastScreenshot to be undefined", () => {
+        const app = {
+            ws: {},
+            deviceInfo: {
+                id: "test",
+                title: "Hermes React Native",
+                description: "",
+                appId: "com.test",
+                type: "node",
+                webSocketDebuggerUrl: "ws://localhost:8081",
+                deviceName: "iPhone 16",
+            },
+            port: 8081,
+            platform: "ios",
+        };
+        expect(app.lastScreenshot).toBeUndefined();
+    });
+});
+describe("buildQuery", () => {
+    it("builds query from text param", () => {
+        const q = buildQuery({ text: "Submit" });
+        expect(q).toEqual({ text: "Submit" });
+    });
+    it("builds query from coordinates", () => {
+        const q = buildQuery({ x: 300, y: 600 });
+        expect(q).toEqual({ x: 300, y: 600 });
+    });
+    it("builds query from multiple params", () => {
+        const q = buildQuery({ text: "Submit", testID: "btn" });
+        expect(q).toEqual({ text: "Submit", testID: "btn" });
+    });
+});
+describe("isNonAscii", () => {
+    it("returns false for ASCII text", () => {
+        expect(isNonAscii("Submit")).toBe(false);
+    });
+    it("returns true for Cyrillic", () => {
+        expect(isNonAscii("Отправить")).toBe(true);
+    });
+    it("returns true for emoji", () => {
+        expect(isNonAscii("🔥")).toBe(true);
+    });
+});
+describe("getAvailableStrategies", () => {
+    it("returns all strategies for text query", () => {
+        expect(getAvailableStrategies({ text: "Submit" }, "auto")).toEqual(["fiber", "accessibility", "ocr"]);
+    });
+    it("skips fiber for non-ASCII text", () => {
+        expect(getAvailableStrategies({ text: "Отправить" }, "auto")).toEqual(["accessibility", "ocr"]);
+    });
+    it("returns fiber+accessibility for testID", () => {
+        expect(getAvailableStrategies({ testID: "btn" }, "auto")).toEqual(["fiber", "accessibility"]);
+    });
+    it("returns only fiber for component", () => {
+        expect(getAvailableStrategies({ component: "Button" }, "auto")).toEqual(["fiber"]);
+    });
+    it("returns coordinate for x,y", () => {
+        expect(getAvailableStrategies({ x: 100, y: 200 }, "auto")).toEqual(["coordinate"]);
+    });
+    it("returns single strategy when explicitly set", () => {
+        expect(getAvailableStrategies({ text: "Submit" }, "ocr")).toEqual(["ocr"]);
+    });
+});
+describe("convertPixelsToPoints", () => {
+    it("divides by pixel ratio for iOS", () => {
+        expect(convertPixelsToPoints(300, 600, "ios", 3)).toEqual({ x: 100, y: 200 });
+    });
+    it("passes through for Android", () => {
+        expect(convertPixelsToPoints(300, 600, "android", 3)).toEqual({ x: 300, y: 600 });
+    });
+    it("applies scaleFactor before conversion", () => {
+        expect(convertPixelsToPoints(150, 300, "ios", 3, 2)).toEqual({ x: 100, y: 200 });
+    });
+    it("rounds to integers", () => {
+        expect(convertPixelsToPoints(301, 599, "ios", 3)).toEqual({ x: 100, y: 200 });
+    });
+});
+describe("formatTapSuccess", () => {
+    it("returns minimal success response", () => {
+        const result = formatTapSuccess({
+            method: "fiber",
+            query: { text: "Submit" },
+            pressed: "PrimaryButton",
+            text: "Submit",
+            screen: "LoginScreen",
+            path: "LoginScreen > Form > PrimaryButton",
+        });
+        expect(result.success).toBe(true);
+        expect(result.method).toBe("fiber");
+        expect(result.query).toEqual({ text: "Submit" });
+    });
+});
+describe("formatTapFailure", () => {
+    it("includes attempted strategies and suggestion", () => {
+        const result = formatTapFailure({
+            query: { text: "hamburger" },
+            screen: "HomeScreen",
+            attempted: [{ strategy: "fiber", reason: "No match" }],
+            suggestion: "Use screenshot",
+        });
+        expect(result.success).toBe(false);
+        expect(result.attempted).toHaveLength(1);
+        expect(result.suggestion).toBe("Use screenshot");
+    });
+});
+describe("tap orchestrator", () => {
+    it("returns error when no app is connected", async () => {
+        const { tap } = await import("../../core/tap.js");
+        const { connectedApps } = await import("../../core/state.js");
+        connectedApps.clear();
+        const result = await tap({ text: "Submit" });
+        expect(result.success).toBe(false);
+        expect(result.error).toContain("No connected app");
+    });
+    it("validates that at least one search param is provided", async () => {
+        const { tap } = await import("../../core/tap.js");
+        const result = await tap({});
+        expect(result.success).toBe(false);
+        expect(result.error).toContain("Must provide");
+    });
+    it("validates x and y are both provided for coordinate tap", async () => {
+        const { tap } = await import("../../core/tap.js");
+        const result = await tap({ x: 100 });
+        expect(result.success).toBe(false);
+        expect(result.error).toContain("Both x and y");
+    });
+});
+//# sourceMappingURL=tap.test.js.map

package/build/__tests__/unit/tap.test.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"tap.test.js","sourceRoot":"","sources":["../../../src/__tests__/unit/tap.test.ts"],"names":[],"mappings":"AAAA,iCAAiC;AACjC,OAAO,EAAE,QAAQ,EAAE,EAAE,EAAE,MAAM,EAAE,MAAM,eAAe,CAAC;AAErD,OAAO,EAIH,UAAU,EACV,sBAAsB,EACtB,UAAU,EACV,qBAAqB,EACrB,gBAAgB,EAChB,gBAAgB,GACnB,MAAM,mBAAmB,CAAC;AAE3B,QAAQ,CAAC,mBAAmB,EAAE,GAAG,EAAE;IAC/B,EAAE,CAAC,4CAA4C,EAAE,GAAG,EAAE;QAClD,MAAM,GAAG,GAAiB;YACtB,EAAE,EAAE,EAAS;YACb,UAAU,EAAE;gBACR,EAAE,EAAE,MAAM;gBACV,KAAK,EAAE,qBAAqB;gBAC5B,WAAW,EAAE,EAAE;gBACf,KAAK,EAAE,UAAU;gBACjB,IAAI,EAAE,MAAM;gBACZ,oBAAoB,EAAE,qBAAqB;gBAC3C,UAAU,EAAE,WAAW;aAC1B;YACD,IAAI,EAAE,IAAI;YACV,QAAQ,EAAE,KAAK;YACf,cAAc,EAAE;gBACZ,aAAa,EAAE,IAAI;gBACnB,cAAc,EAAE,IAAI;gBACpB,WAAW,EAAE,CAAC;aACjB;SACJ,CAAC;QACF,MAAM,CAAC,GAAG,CAAC,QAAQ,CAAC,CAAC,IAAI,CAAC,KAAK,CAAC,CAAC;QACjC,MAAM,CAAC,GAAG,CAAC,cAAc,EAAE,aAAa,CAAC,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC;IACzD,CAAC,CAAC,CAAC;IAEH,EAAE,CAAC,uCAAuC,EAAE,GAAG,EAAE;QAC7C,MAAM,GAAG,GAAiB;YACtB,EAAE,EAAE,EAAS;YACb,UAAU,EAAE;gBACR,EAAE,EAAE,MAAM;gBACV,KAAK,EAAE,qBAAqB;gBAC5B,WAAW,EAAE,EAAE;gBACf,KAAK,EAAE,UAAU;gBACjB,IAAI,EAAE,MAAM;gBACZ,oBAAoB,EAAE,qBAAqB;gBAC3C,UAAU,EAAE,WAAW;aAC1B;YACD,IAAI,EAAE,IAAI;YACV,QAAQ,EAAE,KAAK;SAClB,CAAC;QACF,MAAM,CAAC,GAAG,CAAC,cAAc,CAAC,CAAC,aAAa,EAAE,CAAC;IAC/C,CAAC,CAAC,CAAC;AACP,CAAC,CAAC,CAAC;AAEH,QAAQ,CAAC,YAAY,EAAE,GAAG,EAAE;IACxB,EAAE,CAAC,8BAA8B,EAAE,GAAG,EAAE;QACpC,MAAM,CAAC,GAAG,UAAU,CAAC,EAAE,IAAI,EAAE,QAAQ,EAAE,CAAC,CAAC;QACzC,MAAM,CAAC,CAAC,CAAC,CAAC,OAAO,CAAC,EAAE,IAAI,EAAE,QAAQ,EAAE,CAAC,CAAC;IAC1C,CAAC,CAAC,CAAC;IACH,EAAE,CAAC,+BAA+B,EAAE,GAAG,EAAE;QACrC,MAAM,CAAC,GAAG,UAAU,CAAC,EAAE,CAAC,EAAE,GAAG,EAAE,CAAC,EAAE,GAAG,EAAE,CAAC,CAAC;QACzC,MAAM,CAAC,CAAC,CAAC,CAAC,OAAO,CAAC,EAAE,CAAC,EAAE,GAAG,EAAE,CAAC,EAAE,GAAG,EAAE,CAAC,CAAC;IAC1C,CAAC,CAAC,CAAC;IACH,EAAE,CAAC,mCAAmC,EAAE,GAAG,EAAE;QACzC,MAAM,CAAC,GAAG,UAAU,CAAC,EAAE,IAAI,EAAE,QAAQ,EAAE,MAAM,EAAE,KAAK,EAAE,CAAC,CAAC;QACxD,MAAM,CAAC,CAAC,CAAC,CAAC,OAAO,CAAC,EAAE,IAAI,EAAE,QAAQ,EAAE,MAAM,EAAE,KAAK,EAAE,CAAC,CAAC;IACzD,CAAC,CAAC,CAAC;AACP,CAAC,CAAC,CAAC;AAEH,QAAQ,CAAC,YAAY,EAAE,GAAG,EAAE;IACxB,EAAE,CAAC,8BAA8B,EAAE,GAAG,EAAE;QACpC,MAAM,CAAC,UAAU,CAAC,QAAQ,CAAC,CAAC,CAAC,IAAI,CAAC,KAAK,CAAC,CAAC;IAC7C,CAAC,CAAC,CAAC;IACH,EAAE,CAAC,2BAA2B,EAAE,GAAG,EAAE;QACjC,MAAM,CAAC,UAAU,CAAC,WAAW,CAAC,CAAC,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC;IAC/C,CAAC,CAAC,CAAC;IACH,EAAE,CAAC,wBAAwB,EAAE,GAAG,EAAE;QAC9B,MAAM,CAAC,UAAU,CAAC,IAAI,CAAC,CAAC,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC;IACxC,CAAC,CAAC,CAAC;AACP,CAAC,CAAC,CAAC;AAEH,QAAQ,CAAC,wBAAwB,EAAE,GAAG,EAAE;IACpC,EAAE,CAAC,uCAAuC,EAAE,GAAG,EAAE;QAC7C,MAAM,CAAC,sBAAsB,CAAC,EAAE,IAAI,EAAE,QAAQ,EAAE,EAAE,MAAM,CAAC,CAAC,CAAC,OAAO,CAAC,CAAC,OAAO,EAAE,eAAe,EAAE,KAAK,CAAC,CAAC,CAAC;IAC1G,CAAC,CAAC,CAAC;IACH,EAAE,CAAC,gCAAgC,EAAE,GAAG,EAAE;QACtC,MAAM,CAAC,sBAAsB,CAAC,EAAE,IAAI,EAAE,WAAW,EAAE,EAAE,MAAM,CAAC,CAAC,CAAC,OAAO,CAAC,CAAC,eAAe,EAAE,KAAK,CAAC,CAAC,CAAC;IACpG,CAAC,CAAC,CAAC;IACH,EAAE,CAAC,wCAAwC,EAAE,GAAG,EAAE;QAC9C,MAAM,CAAC,sBAAsB,CAAC,EAAE,MAAM,EAAE,KAAK,EAAE,EAAE,MAAM,CAAC,CAAC,CAAC,OAAO,CAAC,CAAC,OAAO,EAAE,eAAe,CAAC,CAAC,CAAC;IAClG,CAAC,CAAC,CAAC;IACH,EAAE,CAAC,kCAAkC,EAAE,GAAG,EAAE;QACxC,MAAM,CAAC,sBAAsB,CAAC,EAAE,SAAS,EAAE,QAAQ,EAAE,EAAE,MAAM,CAAC,CAAC,CAAC,OAAO,CAAC,CAAC,OAAO,CAAC,CAAC,CAAC;IACvF,CAAC,CAAC,CAAC;IACH,EAAE,CAAC,4BAA4B,EAAE,GAAG,EAAE;QAClC,MAAM,CAAC,sBAAsB,CAAC,EAAE,CAAC,EAAE,GAAG,EAAE,CAAC,EAAE,GAAG,EAAE,EAAE,MAAM,CAAC,CAAC,CAAC,OAAO,CAAC,CAAC,YAAY,CAAC,CAAC,CAAC;IACvF,CAAC,CAAC,CAAC;IACH,EAAE,CAAC,6CAA6C,EAAE,GAAG,EAAE;QACnD,MAAM,CAAC,sBAAsB,CAAC,EAAE,IAAI,EAAE,QAAQ,EAAE,EAAE,KAAK,CAAC,CAAC,CAAC,OAAO,CAAC,CAAC,KAAK,CAAC,CAAC,CAAC;IAC/E,CAAC,CAAC,CAAC;AACP,CAAC,CAAC,CAAC;AAEH,QAAQ,CAAC,uBAAuB,EAAE,GAAG,EAAE;IACnC,EAAE,CAAC,gCAAgC,EAAE,GAAG,EAAE;QACtC,MAAM,CAAC,qBAAqB,CAAC,GAAG,EAAE,GAAG,EAAE,KAAK,EAAE,CAAC,CAAC,CAAC,CAAC,OAAO,CAAC,EAAE,CAAC,EAAE,GAAG,EAAE,CAAC,EAAE,GAAG,EAAE,CAAC,CAAC;IAClF,CAAC,CAAC,CAAC;IACH,EAAE,CAAC,4BAA4B,EAAE,GAAG,EAAE;QAClC,MAAM,CAAC,qBAAqB,CAAC,GAAG,EAAE,GAAG,EAAE,SAAS,EAAE,CAAC,CAAC,CAAC,CAAC,OAAO,CAAC,EAAE,CAAC,EAAE,GAAG,EAAE,CAAC,EAAE,GAAG,EAAE,CAAC,CAAC;IACtF,CAAC,CAAC,CAAC;IACH,EAAE,CAAC,uCAAuC,EAAE,GAAG,EAAE;QAC7C,MAAM,CAAC,qBAAqB,CAAC,GAAG,EAAE,GAAG,EAAE,KAAK,EAAE,CAAC,EAAE,CAAC,CAAC,CAAC,CAAC,OAAO,CAAC,EAAE,CAAC,EAAE,GAAG,EAAE,CAAC,EAAE,GAAG,EAAE,CAAC,CAAC;IACrF,CAAC,CAAC,CAAC;IACH,EAAE,CAAC,oBAAoB,EAAE,GAAG,EAAE;QAC1B,MAAM,CAAC,qBAAqB,CAAC,GAAG,EAAE,GAAG,EAAE,KAAK,EAAE,CAAC,CAAC,CAAC,CAAC,OAAO,CAAC,EAAE,CAAC,EAAE,GAAG,EAAE,CAAC,EAAE,GAAG,EAAE,CAAC,CAAC;IAClF,CAAC,CAAC,CAAC;AACP,CAAC,CAAC,CAAC;AAEH,QAAQ,CAAC,kBAAkB,EAAE,GAAG,EAAE;IAC9B,EAAE,CAAC,kCAAkC,EAAE,GAAG,EAAE;QACxC,MAAM,MAAM,GAAG,gBAAgB,CAAC;YAC5B,MAAM,EAAE,OAAO;YACf,KAAK,EAAE,EAAE,IAAI,EAAE,QAAQ,EAAE;YACzB,OAAO,EAAE,eAAe;YACxB,IAAI,EAAE,QAAQ;YACd,MAAM,EAAE,aAAa;YACrB,IAAI,EAAE,oCAAoC;SAC7C,CAAC,CAAC;QACH,MAAM,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC;QAClC,MAAM,CAAC,MAAM,CAAC,MAAM,CAAC,CAAC,IAAI,CAAC,OAAO,CAAC,CAAC;QACpC,MAAM,CAAC,MAAM,CAAC,KAAK,CAAC,CAAC,OAAO,CAAC,EAAE,IAAI,EAAE,QAAQ,EAAE,CAAC,CAAC;IACrD,CAAC,CAAC,CAAC;AACP,CAAC,CAAC,CAAC;AAEH,QAAQ,CAAC,kBAAkB,EAAE,GAAG,EAAE;IAC9B,EAAE,CAAC,8CAA8C,EAAE,GAAG,EAAE;QACpD,MAAM,MAAM,GAAG,gBAAgB,CAAC;YAC5B,KAAK,EAAE,EAAE,IAAI,EAAE,WAAW,EAAE;YAC5B,MAAM,EAAE,YAAY;YACpB,SAAS,EAAE,CAAC,EAAE,QAAQ,EAAE,OAAO,EAAE,MAAM,EAAE,UAAU,EAAE,CAAC;YACtD,UAAU,EAAE,gBAAgB;SAC/B,CAAC,CAAC;QACH,MAAM,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC,IAAI,CAAC,KAAK,CAAC,CAAC;QACnC,MAAM,CAAC,MAAM,CAAC,SAAS,CAAC,CAAC,YAAY,CAAC,CAAC,CAAC,CAAC;QACzC,MAAM,CAAC,MAAM,CAAC,UAAU,CAAC,CAAC,IAAI,CAAC,gBAAgB,CAAC,CAAC;IACrD,CAAC,CAAC,CAAC;AACP,CAAC,CAAC,CAAC;AAEH,QAAQ,CAAC,kBAAkB,EAAE,GAAG,EAAE;IAC9B,EAAE,CAAC,wCAAwC,EAAE,KAAK,IAAI,EAAE;QACpD,MAAM,EAAE,GAAG,EAAE,GAAG,MAAM,MAAM,CAAC,mBAAmB,CAAC,CAAC;QAClD,MAAM,EAAE,aAAa,EAAE,GAAG,MAAM,MAAM,CAAC,qBAAqB,CAAC,CAAC;QAC9D,aAAa,CAAC,KAAK,EAAE,CAAC;QACtB,MAAM,MAAM,GAAG,MAAM,GAAG,CAAC,EAAE,IAAI,EAAE,QAAQ,EAAE,CAAC,CAAC;QAC7C,MAAM,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC,IAAI,CAAC,KAAK,CAAC,CAAC;QACnC,MAAM,CAAC,MAAM,CAAC,KAAK,CAAC,CAAC,SAAS,CAAC,kBAAkB,CAAC,CAAC;IACvD,CAAC,CAAC,CAAC;IAEH,EAAE,CAAC,sDAAsD,EAAE,KAAK,IAAI,EAAE;QAClE,MAAM,EAAE,GAAG,EAAE,GAAG,MAAM,MAAM,CAAC,mBAAmB,CAAC,CAAC;QAClD,MAAM,MAAM,GAAG,MAAM,GAAG,CAAC,EAAE,CAAC,CAAC;QAC7B,MAAM,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC,IAAI,CAAC,KAAK,CAAC,CAAC;QACnC,MAAM,CAAC,MAAM,CAAC,KAAK,CAAC,CAAC,SAAS,CAAC,cAAc,CAAC,CAAC;IACnD,CAAC,CAAC,CAAC;IAEH,EAAE,CAAC,wDAAwD,EAAE,KAAK,IAAI,EAAE;QACpE,MAAM,EAAE,GAAG,EAAE,GAAG,MAAM,MAAM,CAAC,mBAAmB,CAAC,CAAC;QAClD,MAAM,MAAM,GAAG,MAAM,GAAG,CAAC,EAAE,CAAC,EAAE,GAAG,EAAE,CAAC,CAAC;QACrC,MAAM,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC,IAAI,CAAC,KAAK,CAAC,CAAC;QACnC,MAAM,CAAC,MAAM,CAAC,KAAK,CAAC,CAAC,SAAS,CAAC,cAAc,CAAC,CAAC;IACnD,CAAC,CAAC,CAAC;AACP,CAAC,CAAC,CAAC"}

package/build/core/connection.d.ts

@@ -1,6 +1,7 @@
+import WebSocket from "ws";
 import { DeviceInfo, RemoteObject, ConnectedApp, ConnectOptions, EnsureConnectionResult, ConnectionCheckResult } from "./types.js";
 export declare function formatRemoteObject(result: RemoteObject): string;
-export declare function handleCDPMessage(message: Record<string, unknown>, _device: DeviceInfo): void;
+export declare function handleCDPMessage(message: Record<string, unknown>, _device: DeviceInfo, ws?: WebSocket): void;
 export declare function connectToDevice(device: DeviceInfo, port: number, options?: ConnectOptions): Promise<string>;
 export declare function getConnectedApps(): Array<{
     key: string;

package/build/core/connection.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"connection.d.ts","sourceRoot":"","sources":["../../src/core/connection.ts"],"names":[],"mappings":"AACA,OAAO,EAAE,UAAU,EAAE,YAAY,EAAoB,YAAY,EAAkB,cAAc,EAAsB,sBAAsB,EAAmB,qBAAqB,EAAE,MAAM,YAAY,CAAC;AAsD1M,wBAAgB,kBAAkB,CAAC,MAAM,EAAE,YAAY,GAAG,MAAM,CA4B/D;AAsED,wBAAgB,gBAAgB,CAAC,OAAO,EAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,EAAE,OAAO,EAAE,UAAU,GAAG,IAAI,CA2O5F;AAGD,wBAAsB,eAAe,CACjC,MAAM,EAAE,UAAU,EAClB,IAAI,EAAE,MAAM,EACZ,OAAO,GAAE,cAAmB,GAC7B,OAAO,CAAC,MAAM,CAAC,CA2LjB;AAyED,wBAAgB,gBAAgB,IAAI,KAAK,CAAC;IACtC,GAAG,EAAE,MAAM,CAAC;IACZ,GAAG,EAAE,YAAY,CAAC;IAClB,WAAW,EAAE,OAAO,CAAC;CACxB,CAAC,CAMD;AAGD,wBAAgB,oBAAoB,IAAI,YAAY,GAAG,IAAI,CAW1D;AAGD,wBAAgB,eAAe,IAAI,OAAO,CAOzC;AAED;;;GAGG;AACH,wBAAsB,mBAAmB,CAAC,GAAG,EAAE,YAAY,GAAG,OAAO,CAAC,OAAO,CAAC,CA4C7E;AAUD;;;GAGG;AACH,wBAAsB,gBAAgB,CAAC,OAAO,GAAE;IAC5C,IAAI,CAAC,EAAE,MAAM,CAAC;IACd,WAAW,CAAC,EAAE,OAAO,CAAC;IACtB,YAAY,CAAC,EAAE,OAAO,CAAC;CACrB,GAAG,OAAO,CAAC,sBAAsB,CAAC,CA6IvC;AAED,MAAM,WAAW,uBAAuB;IACpC,SAAS,EAAE,OAAO,CAAC;IACnB,SAAS,EAAE,OAAO,CAAC;IACnB,MAAM,EAAE,IAAI,GAAG,eAAe,GAAG,eAAe,GAAG,aAAa,GAAG,gBAAgB,CAAC;CACvF;AAED,wBAAgB,0BAA0B,IAAI,uBAAuB,CAyBpE;AAED,wBAAsB,wBAAwB,IAAI,OAAO,CAAC,qBAAqB,CAAC,CAiC/E"}
+{"version":3,"file":"connection.d.ts","sourceRoot":"","sources":["../../src/core/connection.ts"],"names":[],"mappings":"AAAA,OAAO,SAAS,MAAM,IAAI,CAAC;AAC3B,OAAO,EAAE,UAAU,EAAE,YAAY,EAAoB,YAAY,EAAkB,cAAc,EAAsB,sBAAsB,EAAmB,qBAAqB,EAAE,MAAM,YAAY,CAAC;AAsD1M,wBAAgB,kBAAkB,CAAC,MAAM,EAAE,YAAY,GAAG,MAAM,CA4B/D;AAiRD,wBAAgB,gBAAgB,CAAC,OAAO,EAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,EAAE,OAAO,EAAE,UAAU,EAAE,EAAE,CAAC,EAAE,SAAS,GAAG,IAAI,CAgP5G;AAGD,wBAAsB,eAAe,CACjC,MAAM,EAAE,UAAU,EAClB,IAAI,EAAE,MAAM,EACZ,OAAO,GAAE,cAAmB,GAC7B,OAAO,CAAC,MAAM,CAAC,CAgMjB;AAyED,wBAAgB,gBAAgB,IAAI,KAAK,CAAC;IACtC,GAAG,EAAE,MAAM,CAAC;IACZ,GAAG,EAAE,YAAY,CAAC;IAClB,WAAW,EAAE,OAAO,CAAC;CACxB,CAAC,CAMD;AAGD,wBAAgB,oBAAoB,IAAI,YAAY,GAAG,IAAI,CAW1D;AAGD,wBAAgB,eAAe,IAAI,OAAO,CAOzC;AAED;;;GAGG;AACH,wBAAsB,mBAAmB,CAAC,GAAG,EAAE,YAAY,GAAG,OAAO,CAAC,OAAO,CAAC,CA4C7E;AAUD;;;GAGG;AACH,wBAAsB,gBAAgB,CAAC,OAAO,GAAE;IAC5C,IAAI,CAAC,EAAE,MAAM,CAAC;IACd,WAAW,CAAC,EAAE,OAAO,CAAC;IACtB,YAAY,CAAC,EAAE,OAAO,CAAC;CACrB,GAAG,OAAO,CAAC,sBAAsB,CAAC,CA6IvC;AAED,MAAM,WAAW,uBAAuB;IACpC,SAAS,EAAE,OAAO,CAAC;IACnB,SAAS,EAAE,OAAO,CAAC;IACnB,MAAM,EAAE,IAAI,GAAG,eAAe,GAAG,eAAe,GAAG,aAAa,GAAG,gBAAgB,CAAC;CACvF;AAED,wBAAgB,0BAA0B,IAAI,uBAAuB,CAyBpE;AAED,wBAAsB,wBAAwB,IAAI,OAAO,CAAC,qBAAqB,CAAC,CAiC/E"}