react-native-ai-debugger 1.0.5 → 1.0.7

package/README.md

@@ -16,11 +16,14 @@ An MCP (Model Context Protocol) server for AI-powered React Native debugging. En
 -   **Discover debug globals** available in the app
 -   **Android device control** - screenshots, tap, swipe, text input, key events via ADB
 -   **iOS simulator control** - screenshots, app management, URL handling via simctl
+-   **iOS UI automation** - tap, swipe, text input, button presses via IDB (optional)
+-   **iOS accessibility inspection** - get UI element tree and element info at coordinates via IDB
 
 ## Requirements
 
 -   Node.js 18+
 -   React Native app running with Metro bundler
+-   **Optional for iOS UI automation**: [Facebook IDB](https://fbidb.io/) - `brew install idb-companion`
 
 ## Claude Code Setup
 
@@ -144,6 +147,14 @@ Requires VS Code 1.102+ with Copilot ([docs](https://code.visualstudio.com/docs/
 | `android_key_event`       | Send key events (HOME, BACK, ENTER, etc.)            |
 | `android_get_screen_size` | Get device screen resolution                         |
 
+### Android Accessibility (UI Hierarchy)
+
+| Tool                    | Description                                           |
+| ----------------------- | ----------------------------------------------------- |
+| `android_describe_all`  | Get full UI hierarchy tree using uiautomator          |
+| `android_describe_point`| Get UI element info at specific coordinates           |
+| `android_tap_element`   | Tap element by text, content-desc, or resource-id     |
+
 ### iOS (Simulator)
 
 | Tool                  | Description                                 |
@@ -156,6 +167,22 @@ Requires VS Code 1.102+ with Copilot ([docs](https://code.visualstudio.com/docs/
 | `ios_terminate_app`   | Terminate a running app                     |
 | `ios_boot_simulator`  | Boot a simulator by UDID                    |
 
+### iOS UI Interaction (requires IDB)
+
+These tools require [Facebook IDB](https://fbidb.io/) to be installed: `brew install idb-companion`
+
+| Tool                | Description                                           |
+| ------------------- | ----------------------------------------------------- |
+| `ios_tap`           | Tap at specific coordinates on screen                 |
+| `ios_tap_element`   | Tap an element by its accessibility label             |
+| `ios_swipe`         | Swipe from one point to another                       |
+| `ios_input_text`    | Type text into the active input field                 |
+| `ios_button`        | Press hardware buttons (HOME, LOCK, SIRI, etc.)       |
+| `ios_key_event`     | Send a key event by keycode                           |
+| `ios_key_sequence`  | Send multiple key events in sequence                  |
+| `ios_describe_all`  | Get accessibility tree for entire screen              |
+| `ios_describe_point`| Get accessibility info for element at specific point  |
+
 ## Usage
 
 1. Start your React Native app:
@@ -384,6 +411,20 @@ Set `awaitPromise=false` for synchronous execution only.
 
 ## Device Interaction
 
+> **💡 Best Practice: Use Element-Based Tapping**
+>
+> Prefer `android_tap_element` and `ios_tap_element` over coordinate-based tapping (`android_tap`, `ios_tap`).
+>
+> **Why?**
+> - More reliable - elements are found by text/label, not fragile coordinates
+> - Self-documenting - `tap_element(text="Settings")` is clearer than `tap(x=540, y=1200)`
+> - Resolution-independent - works across different screen sizes
+>
+> **Workflow:**
+> 1. Use `android_describe_all` or `ios_describe_all` to see available elements
+> 2. Use `android_tap_element` or `ios_tap_element` to interact by text/label
+> 3. Fall back to coordinate-based tapping only when elements lack accessible text
+
 ### Android (requires ADB)
 
 List connected devices:
@@ -425,6 +466,53 @@ android_key_event with key="HOME"
 android_key_event with key="ENTER"
 ```
 
+### Android UI Automation (Accessibility)
+
+Get the full UI hierarchy:
+
+```
+android_describe_all
+```
+
+Example output:
+```
+[FrameLayout] frame=(0, 0, 1080x2340) tap=(540, 1170)
+  [LinearLayout] frame=(0, 63, 1080x147) tap=(540, 136)
+    [TextView] "Settings" frame=(48, 77, 200x63) tap=(148, 108)
+  [RecyclerView] frame=(0, 210, 1080x2130) tap=(540, 1275)
+    [Button] "Save" frame=(800, 2200, 200x80) tap=(900, 2240)
+```
+
+Get element info at coordinates:
+
+```
+android_describe_point with x=540 y=1170
+```
+
+Tap an element by text:
+
+```
+android_tap_element with text="Settings"
+```
+
+Tap using partial text match:
+
+```
+android_tap_element with textContains="Save"
+```
+
+Tap by resource ID:
+
+```
+android_tap_element with resourceId="save_button"
+```
+
+Tap by content description:
+
+```
+android_tap_element with contentDesc="Navigate up"
+```
+
 ### iOS Simulator (requires Xcode)
 
 List available simulators:
@@ -457,6 +545,79 @@ Open a deep link:
 ios_open_url with url="myapp://settings"
 ```
 
+### iOS UI Automation (requires IDB)
+
+Install IDB first: `brew install idb-companion`
+
+**Important: Coordinate System**
+- iOS IDB uses **points** (logical coordinates), not pixels
+- For 2x Retina displays: 1 point = 2 pixels
+- Example: 1640x2360 pixel screenshot = 820x1180 points
+- Use `ios_describe_all` to get exact element coordinates in points
+
+Tap on screen (coordinates in points):
+
+```
+ios_tap with x=200 y=400
+```
+
+Long press (hold for 2 seconds):
+
+```
+ios_tap with x=200 y=400 duration=2
+```
+
+Swipe gesture:
+
+```
+ios_swipe with startX=200 startY=600 endX=200 endY=200
+```
+
+Type text (tap input field first):
+
+```
+ios_tap with x=200 y=300
+ios_input_text with text="hello@example.com"
+```
+
+Press hardware buttons:
+
+```
+ios_button with button="HOME"
+ios_button with button="LOCK"
+ios_button with button="SIRI"
+```
+
+Get accessibility info for the screen:
+
+```
+ios_describe_all
+```
+
+Get accessibility info at a specific point:
+
+```
+ios_describe_point with x=200 y=400
+```
+
+Tap an element by accessibility label:
+
+```
+ios_tap_element with label="Settings"
+```
+
+Tap using partial label match:
+
+```
+ios_tap_element with labelContains="Sign"
+```
+
+When multiple elements match, use index (0-based):
+
+```
+ios_tap_element with labelContains="Button" index=1
+```
+
 ## Supported React Native Versions
 
 | Version        | Runtime                 | Status     |

package/build/core/android.d.ts

@@ -105,4 +105,67 @@ export declare function androidGetScreenSize(deviceId?: string): Promise<{
     height?: number;
     error?: string;
 }>;
+/**
+ * Android UI element from uiautomator dump
+ */
+export interface AndroidAccessibilityElement {
+    class: string;
+    text?: string;
+    contentDesc?: string;
+    resourceId?: string;
+    bounds: {
+        left: number;
+        top: number;
+        right: number;
+        bottom: number;
+    };
+    frame: {
+        x: number;
+        y: number;
+        width: number;
+        height: number;
+    };
+    tap: {
+        x: number;
+        y: number;
+    };
+    children: AndroidAccessibilityElement[];
+    checkable?: boolean;
+    checked?: boolean;
+    clickable?: boolean;
+    enabled?: boolean;
+    focusable?: boolean;
+    focused?: boolean;
+    scrollable?: boolean;
+    selected?: boolean;
+}
+/**
+ * Result type for accessibility operations
+ */
+export interface AndroidDescribeResult {
+    success: boolean;
+    elements?: AndroidAccessibilityElement[];
+    formatted?: string;
+    error?: string;
+}
+/**
+ * Get the UI hierarchy from the connected Android device using uiautomator dump
+ */
+export declare function androidDescribeAll(deviceId?: string): Promise<AndroidDescribeResult>;
+/**
+ * Get accessibility info for the UI element at specific coordinates
+ */
+export declare function androidDescribePoint(x: number, y: number, deviceId?: string): Promise<AndroidDescribeResult>;
+/**
+ * Tap an element by its text, content-description, or resource-id
+ */
+export declare function androidTapElement(options: {
+    text?: string;
+    textContains?: string;
+    contentDesc?: string;
+    contentDescContains?: string;
+    resourceId?: string;
+    index?: number;
+    deviceId?: string;
+}): Promise<AdbResult>;
 //# sourceMappingURL=android.d.ts.map

package/build/core/android.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"android.d.ts","sourceRoot":"","sources":["../../src/core/android.ts"],"names":[],"mappings":"AAaA,MAAM,WAAW,aAAa;IAC1B,EAAE,EAAE,MAAM,CAAC;IACX,MAAM,EAAE,QAAQ,GAAG,SAAS,GAAG,cAAc,GAAG,gBAAgB,GAAG,MAAM,CAAC;IAC1E,OAAO,CAAC,EAAE,MAAM,CAAC;IACjB,KAAK,CAAC,EAAE,MAAM,CAAC;IACf,MAAM,CAAC,EAAE,MAAM,CAAC;IAChB,WAAW,CAAC,EAAE,MAAM,CAAC;CACxB;AAGD,MAAM,WAAW,SAAS;IACtB,OAAO,EAAE,OAAO,CAAC;IACjB,MAAM,CAAC,EAAE,MAAM,CAAC;IAChB,KAAK,CAAC,EAAE,MAAM,CAAC;IACf,IAAI,CAAC,EAAE,MAAM,CAAC;IAEd,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,aAAa,CAAC,EAAE,MAAM,CAAC;IACvB,cAAc,CAAC,EAAE,MAAM,CAAC;CAC3B;AAED;;GAEG;AACH,wBAAsB,cAAc,IAAI,OAAO,CAAC,OAAO,CAAC,CAOvD;AAED;;GAEG;AACH,wBAAsB,kBAAkB,IAAI,OAAO,CAAC,SAAS,CAAC,CA6D7D;AAED;;GAEG;AACH,wBAAsB,uBAAuB,IAAI,OAAO,CAAC,MAAM,GAAG,IAAI,CAAC,CAiBtE;AASD;;GAEG;AACH,wBAAsB,iBAAiB,CACnC,UAAU,CAAC,EAAE,MAAM,EACnB,QAAQ,CAAC,EAAE,MAAM,GAClB,OAAO,CAAC,SAAS,CAAC,CAqFpB;AAED;;GAEG;AACH,wBAAsB,iBAAiB,CACnC,OAAO,EAAE,MAAM,EACf,QAAQ,CAAC,EAAE,MAAM,EACjB,OAAO,CAAC,EAAE;IAAE,OAAO,CAAC,EAAE,OAAO,CAAC;IAAC,gBAAgB,CAAC,EAAE,OAAO,CAAA;CAAE,GAC5D,OAAO,CAAC,SAAS,CAAC,CA0DpB;AAED;;GAEG;AACH,wBAAsB,gBAAgB,CAClC,WAAW,EAAE,MAAM,EACnB,YAAY,CAAC,EAAE,MAAM,EACrB,QAAQ,CAAC,EAAE,MAAM,GAClB,OAAO,CAAC,SAAS,CAAC,CAmDpB;AAED;;GAEG;AACH,wBAAsB,mBAAmB,CACrC,QAAQ,CAAC,EAAE,MAAM,EACjB,MAAM,CAAC,EAAE,MAAM,GAChB,OAAO,CAAC,SAAS,CAAC,CAoDpB;AAMD;;GAEG;AACH,eAAO,MAAM,kBAAkB;;;;;;;;;;;;;;;;;;;;;;;CAuBrB,CAAC;AAEX;;GAEG;AACH,wBAAsB,UAAU,CAC5B,CAAC,EAAE,MAAM,EACT,CAAC,EAAE,MAAM,EACT,QAAQ,CAAC,EAAE,MAAM,GAClB,OAAO,CAAC,SAAS,CAAC,CAkCpB;AAED;;GAEG;AACH,wBAAsB,gBAAgB,CAClC,CAAC,EAAE,MAAM,EACT,CAAC,EAAE,MAAM,EACT,UAAU,GAAE,MAAa,EACzB,QAAQ,CAAC,EAAE,MAAM,GAClB,OAAO,CAAC,SAAS,CAAC,CAuCpB;AAED;;GAEG;AACH,wBAAsB,YAAY,CAC9B,MAAM,EAAE,MAAM,EACd,MAAM,EAAE,MAAM,EACd,IAAI,EAAE,MAAM,EACZ,IAAI,EAAE,MAAM,EACZ,UAAU,GAAE,MAAY,EACxB,QAAQ,CAAC,EAAE,MAAM,GAClB,OAAO,CAAC,SAAS,CAAC,CAwCpB;AAED;;;;;GAKG;AACH,wBAAsB,gBAAgB,CAClC,IAAI,EAAE,MAAM,EACZ,QAAQ,CAAC,EAAE,MAAM,GAClB,OAAO,CAAC,SAAS,CAAC,CA+GpB;AAED;;GAEG;AACH,wBAAsB,eAAe,CACjC,OAAO,EAAE,MAAM,GAAG,MAAM,OAAO,kBAAkB,EACjD,QAAQ,CAAC,EAAE,MAAM,GAClB,OAAO,CAAC,SAAS,CAAC,CAoDpB;AAED;;GAEG;AACH,wBAAsB,oBAAoB,CAAC,QAAQ,CAAC,EAAE,MAAM,GAAG,OAAO,CAAC;IACnE,OAAO,EAAE,OAAO,CAAC;IACjB,KAAK,CAAC,EAAE,MAAM,CAAC;IACf,MAAM,CAAC,EAAE,MAAM,CAAC;IAChB,KAAK,CAAC,EAAE,MAAM,CAAC;CAClB,CAAC,CA4CD"}
+{"version":3,"file":"android.d.ts","sourceRoot":"","sources":["../../src/core/android.ts"],"names":[],"mappings":"AAgBA,MAAM,WAAW,aAAa;IAC1B,EAAE,EAAE,MAAM,CAAC;IACX,MAAM,EAAE,QAAQ,GAAG,SAAS,GAAG,cAAc,GAAG,gBAAgB,GAAG,MAAM,CAAC;IAC1E,OAAO,CAAC,EAAE,MAAM,CAAC;IACjB,KAAK,CAAC,EAAE,MAAM,CAAC;IACf,MAAM,CAAC,EAAE,MAAM,CAAC;IAChB,WAAW,CAAC,EAAE,MAAM,CAAC;CACxB;AAGD,MAAM,WAAW,SAAS;IACtB,OAAO,EAAE,OAAO,CAAC;IACjB,MAAM,CAAC,EAAE,MAAM,CAAC;IAChB,KAAK,CAAC,EAAE,MAAM,CAAC;IACf,IAAI,CAAC,EAAE,MAAM,CAAC;IAEd,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,aAAa,CAAC,EAAE,MAAM,CAAC;IACvB,cAAc,CAAC,EAAE,MAAM,CAAC;CAC3B;AAED;;GAEG;AACH,wBAAsB,cAAc,IAAI,OAAO,CAAC,OAAO,CAAC,CAOvD;AAED;;GAEG;AACH,wBAAsB,kBAAkB,IAAI,OAAO,CAAC,SAAS,CAAC,CA6D7D;AAED;;GAEG;AACH,wBAAsB,uBAAuB,IAAI,OAAO,CAAC,MAAM,GAAG,IAAI,CAAC,CAiBtE;AASD;;GAEG;AACH,wBAAsB,iBAAiB,CACnC,UAAU,CAAC,EAAE,MAAM,EACnB,QAAQ,CAAC,EAAE,MAAM,GAClB,OAAO,CAAC,SAAS,CAAC,CAqFpB;AAED;;GAEG;AACH,wBAAsB,iBAAiB,CACnC,OAAO,EAAE,MAAM,EACf,QAAQ,CAAC,EAAE,MAAM,EACjB,OAAO,CAAC,EAAE;IAAE,OAAO,CAAC,EAAE,OAAO,CAAC;IAAC,gBAAgB,CAAC,EAAE,OAAO,CAAA;CAAE,GAC5D,OAAO,CAAC,SAAS,CAAC,CA0DpB;AAED;;GAEG;AACH,wBAAsB,gBAAgB,CAClC,WAAW,EAAE,MAAM,EACnB,YAAY,CAAC,EAAE,MAAM,EACrB,QAAQ,CAAC,EAAE,MAAM,GAClB,OAAO,CAAC,SAAS,CAAC,CAmDpB;AAED;;GAEG;AACH,wBAAsB,mBAAmB,CACrC,QAAQ,CAAC,EAAE,MAAM,EACjB,MAAM,CAAC,EAAE,MAAM,GAChB,OAAO,CAAC,SAAS,CAAC,CAoDpB;AAMD;;GAEG;AACH,eAAO,MAAM,kBAAkB;;;;;;;;;;;;;;;;;;;;;;;CAuBrB,CAAC;AAEX;;GAEG;AACH,wBAAsB,UAAU,CAC5B,CAAC,EAAE,MAAM,EACT,CAAC,EAAE,MAAM,EACT,QAAQ,CAAC,EAAE,MAAM,GAClB,OAAO,CAAC,SAAS,CAAC,CAkCpB;AAED;;GAEG;AACH,wBAAsB,gBAAgB,CAClC,CAAC,EAAE,MAAM,EACT,CAAC,EAAE,MAAM,EACT,UAAU,GAAE,MAAa,EACzB,QAAQ,CAAC,EAAE,MAAM,GAClB,OAAO,CAAC,SAAS,CAAC,CAuCpB;AAED;;GAEG;AACH,wBAAsB,YAAY,CAC9B,MAAM,EAAE,MAAM,EACd,MAAM,EAAE,MAAM,EACd,IAAI,EAAE,MAAM,EACZ,IAAI,EAAE,MAAM,EACZ,UAAU,GAAE,MAAY,EACxB,QAAQ,CAAC,EAAE,MAAM,GAClB,OAAO,CAAC,SAAS,CAAC,CAwCpB;AAED;;;;;GAKG;AACH,wBAAsB,gBAAgB,CAClC,IAAI,EAAE,MAAM,EACZ,QAAQ,CAAC,EAAE,MAAM,GAClB,OAAO,CAAC,SAAS,CAAC,CA+GpB;AAED;;GAEG;AACH,wBAAsB,eAAe,CACjC,OAAO,EAAE,MAAM,GAAG,MAAM,OAAO,kBAAkB,EACjD,QAAQ,CAAC,EAAE,MAAM,GAClB,OAAO,CAAC,SAAS,CAAC,CAoDpB;AAED;;GAEG;AACH,wBAAsB,oBAAoB,CAAC,QAAQ,CAAC,EAAE,MAAM,GAAG,OAAO,CAAC;IACnE,OAAO,EAAE,OAAO,CAAC;IACjB,KAAK,CAAC,EAAE,MAAM,CAAC;IACf,MAAM,CAAC,EAAE,MAAM,CAAC;IAChB,KAAK,CAAC,EAAE,MAAM,CAAC;CAClB,CAAC,CA4CD;AAMD;;GAEG;AACH,MAAM,WAAW,2BAA2B;IACxC,KAAK,EAAE,MAAM,CAAC;IACd,IAAI,CAAC,EAAE,MAAM,CAAC;IACd,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,MAAM,EAAE;QACJ,IAAI,EAAE,MAAM,CAAC;QACb,GAAG,EAAE,MAAM,CAAC;QACZ,KAAK,EAAE,MAAM,CAAC;QACd,MAAM,EAAE,MAAM,CAAC;KAClB,CAAC;IACF,KAAK,EAAE;QACH,CAAC,EAAE,MAAM,CAAC;QACV,CAAC,EAAE,MAAM,CAAC;QACV,KAAK,EAAE,MAAM,CAAC;QACd,MAAM,EAAE,MAAM,CAAC;KAClB,CAAC;IACF,GAAG,EAAE;QACD,CAAC,EAAE,MAAM,CAAC;QACV,CAAC,EAAE,MAAM,CAAC;KACb,CAAC;IACF,QAAQ,EAAE,2BAA2B,EAAE,CAAC;IAExC,SAAS,CAAC,EAAE,OAAO,CAAC;IACpB,OAAO,CAAC,EAAE,OAAO,CAAC;IAClB,SAAS,CAAC,EAAE,OAAO,CAAC;IACpB,OAAO,CAAC,EAAE,OAAO,CAAC;IAClB,SAAS,CAAC,EAAE,OAAO,CAAC;IACpB,OAAO,CAAC,EAAE,OAAO,CAAC;IAClB,UAAU,CAAC,EAAE,OAAO,CAAC;IACrB,QAAQ,CAAC,EAAE,OAAO,CAAC;CACtB;AAED;;GAEG;AACH,MAAM,WAAW,qBAAqB;IAClC,OAAO,EAAE,OAAO,CAAC;IACjB,QAAQ,CAAC,EAAE,2BAA2B,EAAE,CAAC;IACzC,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB,KAAK,CAAC,EAAE,MAAM,CAAC;CAClB;AAmKD;;GAEG;AACH,wBAAsB,kBAAkB,CAAC,QAAQ,CAAC,EAAE,MAAM,GAAG,OAAO,CAAC,qBAAqB,CAAC,CAuE1F;AAED;;GAEG;AACH,wBAAsB,oBAAoB,CACtC,CAAC,EAAE,MAAM,EACT,CAAC,EAAE,MAAM,EACT,QAAQ,CAAC,EAAE,MAAM,GAClB,OAAO,CAAC,qBAAqB,CAAC,CA2EhC;AAED;;GAEG;AACH,wBAAsB,iBAAiB,CACnC,OAAO,EAAE;IACL,IAAI,CAAC,EAAE,MAAM,CAAC;IACd,YAAY,CAAC,EAAE,MAAM,CAAC;IACtB,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,mBAAmB,CAAC,EAAE,MAAM,CAAC;IAC7B,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,KAAK,CAAC,EAAE,MAAM,CAAC;IACf,QAAQ,CAAC,EAAE,MAAM,CAAC;CACrB,GACF,OAAO,CAAC,SAAS,CAAC,CAqFpB"}

package/build/core/android.js

@@ -5,6 +5,8 @@ import path from "path";
 import os from "os";
 import sharp from "sharp";
 const execAsync = promisify(exec);
+// XML parsing for uiautomator dump
+import { XMLParser } from "fast-xml-parser";
 // ADB command timeout in milliseconds
 const ADB_TIMEOUT = 30000;
 /**
@@ -683,4 +685,393 @@ export async function androidGetScreenSize(deviceId) {
         };
     }
 }
+/**
+ * Simplify Android class name for display
+ * android.widget.Button -> Button
+ * android.widget.TextView -> TextView
+ */
+function simplifyClassName(className) {
+    if (!className)
+        return "Unknown";
+    const parts = className.split(".");
+    return parts[parts.length - 1];
+}
+/**
+ * Parse bounds string "[left,top][right,bottom]" to object
+ */
+function parseBounds(boundsStr) {
+    const match = boundsStr?.match(/\[(\d+),(\d+)\]\[(\d+),(\d+)\]/);
+    if (!match)
+        return null;
+    return {
+        left: parseInt(match[1], 10),
+        top: parseInt(match[2], 10),
+        right: parseInt(match[3], 10),
+        bottom: parseInt(match[4], 10)
+    };
+}
+/**
+ * Parse a single node from uiautomator XML
+ */
+function parseUiNode(node) {
+    const attrs = node["@_bounds"]
+        ? node
+        : node.node
+            ? (Array.isArray(node.node) ? node.node[0] : node.node)
+            : null;
+    if (!attrs)
+        return null;
+    const boundsStr = attrs["@_bounds"];
+    const bounds = parseBounds(boundsStr);
+    if (!bounds)
+        return null;
+    const width = bounds.right - bounds.left;
+    const height = bounds.bottom - bounds.top;
+    const centerX = Math.round(bounds.left + width / 2);
+    const centerY = Math.round(bounds.top + height / 2);
+    const element = {
+        class: simplifyClassName(attrs["@_class"] || ""),
+        bounds,
+        frame: {
+            x: bounds.left,
+            y: bounds.top,
+            width,
+            height
+        },
+        tap: {
+            x: centerX,
+            y: centerY
+        },
+        children: []
+    };
+    // Add optional attributes
+    if (attrs["@_text"])
+        element.text = attrs["@_text"];
+    if (attrs["@_content-desc"])
+        element.contentDesc = attrs["@_content-desc"];
+    if (attrs["@_resource-id"])
+        element.resourceId = attrs["@_resource-id"];
+    if (attrs["@_checkable"] === "true")
+        element.checkable = true;
+    if (attrs["@_checked"] === "true")
+        element.checked = true;
+    if (attrs["@_clickable"] === "true")
+        element.clickable = true;
+    if (attrs["@_enabled"] === "true")
+        element.enabled = true;
+    if (attrs["@_focusable"] === "true")
+        element.focusable = true;
+    if (attrs["@_focused"] === "true")
+        element.focused = true;
+    if (attrs["@_scrollable"] === "true")
+        element.scrollable = true;
+    if (attrs["@_selected"] === "true")
+        element.selected = true;
+    return element;
+}
+/**
+ * Recursively parse UI hierarchy from XML node
+ */
+function parseHierarchy(node) {
+    const results = [];
+    // Handle the node itself
+    if (node["@_bounds"]) {
+        const element = parseUiNode(node);
+        if (element) {
+            // Parse children
+            if (node.node) {
+                const children = Array.isArray(node.node) ? node.node : [node.node];
+                for (const child of children) {
+                    element.children.push(...parseHierarchy(child));
+                }
+            }
+            results.push(element);
+        }
+    }
+    else if (node.node) {
+        // This is a container without bounds (like hierarchy root)
+        const children = Array.isArray(node.node) ? node.node : [node.node];
+        for (const child of children) {
+            results.push(...parseHierarchy(child));
+        }
+    }
+    return results;
+}
+/**
+ * Format accessibility tree for display (similar to iOS format)
+ */
+function formatAndroidAccessibilityTree(elements, indent = 0) {
+    const lines = [];
+    const prefix = "  ".repeat(indent);
+    for (const element of elements) {
+        const parts = [];
+        // [ClassName] "text" or "content-desc"
+        parts.push(`[${element.class}]`);
+        // Add label (text or content-desc)
+        const label = element.text || element.contentDesc;
+        if (label) {
+            parts.push(`"${label}"`);
+        }
+        // Add frame and tap coordinates
+        const f = element.frame;
+        parts.push(`frame=(${f.x}, ${f.y}, ${f.width}x${f.height}) tap=(${element.tap.x}, ${element.tap.y})`);
+        lines.push(`${prefix}${parts.join(" ")}`);
+        // Recurse into children
+        if (element.children.length > 0) {
+            lines.push(formatAndroidAccessibilityTree(element.children, indent + 1));
+        }
+    }
+    return lines.join("\n");
+}
+/**
+ * Flatten element tree to array for searching
+ */
+function flattenElements(elements) {
+    const result = [];
+    for (const element of elements) {
+        result.push(element);
+        if (element.children.length > 0) {
+            result.push(...flattenElements(element.children));
+        }
+    }
+    return result;
+}
+/**
+ * Get the UI hierarchy from the connected Android device using uiautomator dump
+ */
+export async function androidDescribeAll(deviceId) {
+    try {
+        const adbAvailable = await isAdbAvailable();
+        if (!adbAvailable) {
+            return {
+                success: false,
+                error: "ADB is not installed or not in PATH. Install Android SDK Platform Tools."
+            };
+        }
+        const deviceArg = buildDeviceArg(deviceId);
+        const device = deviceId || (await getDefaultAndroidDevice());
+        if (!device) {
+            return {
+                success: false,
+                error: "No Android device connected. Connect a device or start an emulator."
+            };
+        }
+        // Use file-based approach (most reliable across devices)
+        // /dev/tty doesn't work on most emulators/devices
+        const remotePath = "/sdcard/ui_dump.xml";
+        await execAsync(`adb ${deviceArg} shell uiautomator dump ${remotePath}`, {
+            timeout: ADB_TIMEOUT
+        });
+        const { stdout } = await execAsync(`adb ${deviceArg} shell cat ${remotePath}`, {
+            timeout: ADB_TIMEOUT,
+            maxBuffer: 10 * 1024 * 1024
+        });
+        const xmlContent = stdout.trim();
+        // Clean up
+        await execAsync(`adb ${deviceArg} shell rm ${remotePath}`, {
+            timeout: 5000
+        }).catch(() => { });
+        if (!xmlContent || !xmlContent.includes("<hierarchy")) {
+            return {
+                success: false,
+                error: "Failed to get UI hierarchy. Make sure the device screen is unlocked and the app is in foreground."
+            };
+        }
+        // Parse XML
+        const parser = new XMLParser({
+            ignoreAttributes: false,
+            attributeNamePrefix: "@_"
+        });
+        const parsed = parser.parse(xmlContent);
+        if (!parsed.hierarchy) {
+            return {
+                success: false,
+                error: "Invalid UI hierarchy XML structure"
+            };
+        }
+        const elements = parseHierarchy(parsed.hierarchy);
+        const formatted = formatAndroidAccessibilityTree(elements);
+        return {
+            success: true,
+            elements,
+            formatted
+        };
+    }
+    catch (error) {
+        return {
+            success: false,
+            error: `Failed to get UI hierarchy: ${error instanceof Error ? error.message : String(error)}`
+        };
+    }
+}
+/**
+ * Get accessibility info for the UI element at specific coordinates
+ */
+export async function androidDescribePoint(x, y, deviceId) {
+    try {
+        // First get the full hierarchy
+        const result = await androidDescribeAll(deviceId);
+        if (!result.success || !result.elements) {
+            return result;
+        }
+        // Flatten and find elements containing the point
+        const allElements = flattenElements(result.elements);
+        // Find all elements whose bounds contain the point
+        const matchingElements = allElements.filter((el) => {
+            const b = el.bounds;
+            return x >= b.left && x <= b.right && y >= b.top && y <= b.bottom;
+        });
+        if (matchingElements.length === 0) {
+            return {
+                success: true,
+                formatted: `No element found at (${x}, ${y})`
+            };
+        }
+        // Return the deepest (smallest) element that contains the point
+        // Sort by area (smallest first) to get the most specific element
+        matchingElements.sort((a, b) => {
+            const areaA = a.frame.width * a.frame.height;
+            const areaB = b.frame.width * b.frame.height;
+            return areaA - areaB;
+        });
+        const element = matchingElements[0];
+        // Format detailed output
+        const lines = [];
+        const label = element.text || element.contentDesc;
+        lines.push(`[${element.class}]${label ? ` "${label}"` : ""} frame=(${element.frame.x}, ${element.frame.y}, ${element.frame.width}x${element.frame.height}) tap=(${element.tap.x}, ${element.tap.y})`);
+        if (element.resourceId) {
+            lines.push(`  resource-id: ${element.resourceId}`);
+        }
+        if (element.contentDesc && element.text) {
+            // Show content-desc separately if we showed text as label
+            lines.push(`  content-desc: ${element.contentDesc}`);
+        }
+        if (element.text && element.contentDesc) {
+            // Show text separately if we showed content-desc as label
+            lines.push(`  text: ${element.text}`);
+        }
+        // Show state flags
+        const flags = [];
+        if (element.clickable)
+            flags.push("clickable");
+        if (element.enabled)
+            flags.push("enabled");
+        if (element.focusable)
+            flags.push("focusable");
+        if (element.focused)
+            flags.push("focused");
+        if (element.scrollable)
+            flags.push("scrollable");
+        if (element.selected)
+            flags.push("selected");
+        if (element.checked)
+            flags.push("checked");
+        if (flags.length > 0) {
+            lines.push(`  state: ${flags.join(", ")}`);
+        }
+        return {
+            success: true,
+            elements: [element],
+            formatted: lines.join("\n")
+        };
+    }
+    catch (error) {
+        return {
+            success: false,
+            error: `Failed to describe point: ${error instanceof Error ? error.message : String(error)}`
+        };
+    }
+}
+/**
+ * Tap an element by its text, content-description, or resource-id
+ */
+export async function androidTapElement(options) {
+    try {
+        const { text, textContains, contentDesc, contentDescContains, resourceId, index = 0, deviceId } = options;
+        // Validate that at least one search criterion is provided
+        if (!text && !textContains && !contentDesc && !contentDescContains && !resourceId) {
+            return {
+                success: false,
+                error: "At least one of text, textContains, contentDesc, contentDescContains, or resourceId must be provided"
+            };
+        }
+        // Get the UI hierarchy
+        const result = await androidDescribeAll(deviceId);
+        if (!result.success || !result.elements) {
+            return {
+                success: false,
+                error: result.error || "Failed to get UI hierarchy"
+            };
+        }
+        // Flatten and search
+        const allElements = flattenElements(result.elements);
+        // Filter elements based on search criteria
+        const matchingElements = allElements.filter((el) => {
+            if (text && el.text !== text)
+                return false;
+            if (textContains && (!el.text || !el.text.toLowerCase().includes(textContains.toLowerCase())))
+                return false;
+            if (contentDesc && el.contentDesc !== contentDesc)
+                return false;
+            if (contentDescContains && (!el.contentDesc || !el.contentDesc.toLowerCase().includes(contentDescContains.toLowerCase())))
+                return false;
+            if (resourceId) {
+                // Support both full resource-id and short form
+                if (!el.resourceId)
+                    return false;
+                if (el.resourceId !== resourceId && !el.resourceId.endsWith(`:id/${resourceId}`))
+                    return false;
+            }
+            return true;
+        });
+        if (matchingElements.length === 0) {
+            const criteria = [];
+            if (text)
+                criteria.push(`text="${text}"`);
+            if (textContains)
+                criteria.push(`textContains="${textContains}"`);
+            if (contentDesc)
+                criteria.push(`contentDesc="${contentDesc}"`);
+            if (contentDescContains)
+                criteria.push(`contentDescContains="${contentDescContains}"`);
+            if (resourceId)
+                criteria.push(`resourceId="${resourceId}"`);
+            return {
+                success: false,
+                error: `Element not found: ${criteria.join(", ")}`
+            };
+        }
+        if (index >= matchingElements.length) {
+            return {
+                success: false,
+                error: `Index ${index} out of range. Found ${matchingElements.length} matching element(s).`
+            };
+        }
+        const element = matchingElements[index];
+        const label = element.text || element.contentDesc || element.resourceId || element.class;
+        // Log if multiple matches
+        let resultMessage;
+        if (matchingElements.length > 1) {
+            resultMessage = `Found ${matchingElements.length} elements, tapping "${label}" (index ${index}) at (${element.tap.x}, ${element.tap.y})`;
+        }
+        else {
+            resultMessage = `Tapped "${label}" at (${element.tap.x}, ${element.tap.y})`;
+        }
+        // Perform the tap
+        const tapResult = await androidTap(element.tap.x, element.tap.y, deviceId);
+        if (!tapResult.success) {
+            return tapResult;
+        }
+        return {
+            success: true,
+            result: resultMessage
+        };
+    }
+    catch (error) {
+        return {
+            success: false,
+            error: `Failed to tap element: ${error instanceof Error ? error.message : String(error)}`
+        };
+    }
+}
 //# sourceMappingURL=android.js.map