mobile-device-mcp 0.2.2 → 0.2.3
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +322 -225
- package/package.json +1 -1
package/README.md
CHANGED
|
@@ -1,225 +1,322 @@
|
|
|
1
|
-
# mobile-device-mcp
|
|
2
|
-
|
|
3
|
-
|
|
4
|
-
|
|
5
|
-
|
|
6
|
-
|
|
7
|
-
|
|
8
|
-
|
|
9
|
-
|
|
10
|
-
|
|
11
|
-
|
|
12
|
-
|
|
13
|
-
|
|
14
|
-
|
|
15
|
-
|
|
16
|
-
|
|
17
|
-
|
|
18
|
-
|
|
19
|
-
|
|
20
|
-
|
|
21
|
-
|
|
22
|
-
|
|
23
|
-
|
|
24
|
-
|
|
25
|
-
|
|
26
|
-
|
|
27
|
-
-
|
|
28
|
-
|
|
29
|
-
|
|
30
|
-
|
|
31
|
-
|
|
32
|
-
|
|
33
|
-
|
|
34
|
-
|
|
35
|
-
|
|
36
|
-
|
|
37
|
-
|
|
38
|
-
|
|
39
|
-
|
|
40
|
-
|
|
41
|
-
|
|
42
|
-
|
|
43
|
-
|
|
44
|
-
|
|
45
|
-
|
|
46
|
-
|
|
47
|
-
|
|
48
|
-
|
|
49
|
-
|
|
50
|
-
|
|
51
|
-
|
|
52
|
-
|
|
53
|
-
|
|
54
|
-
|
|
55
|
-
|
|
56
|
-
|
|
57
|
-
|
|
58
|
-
**
|
|
59
|
-
|
|
60
|
-
|
|
61
|
-
|
|
62
|
-
|
|
63
|
-
|
|
64
|
-
|
|
65
|
-
|
|
66
|
-
|
|
67
|
-
|
|
68
|
-
|
|
69
|
-
|
|
70
|
-
|
|
71
|
-
|
|
72
|
-
|
|
73
|
-
```
|
|
74
|
-
|
|
75
|
-
|
|
76
|
-
|
|
77
|
-
|
|
78
|
-
|
|
79
|
-
|
|
80
|
-
|
|
81
|
-
|
|
82
|
-
|
|
83
|
-
|
|
84
|
-
|
|
85
|
-
|
|
86
|
-
|
|
87
|
-
|
|
88
|
-
|
|
89
|
-
|
|
90
|
-
|
|
91
|
-
|
|
92
|
-
|
|
93
|
-
|
|
94
|
-
|
|
95
|
-
|
|
96
|
-
|
|
97
|
-
|
|
98
|
-
|
|
99
|
-
|
|
100
|
-
|
|
101
|
-
|
|
102
|
-
|
|
|
103
|
-
|
|
104
|
-
|
|
|
105
|
-
|
|
|
106
|
-
|
|
|
107
|
-
|
|
|
108
|
-
|
|
109
|
-
|
|
110
|
-
|
|
111
|
-
|
|
112
|
-
|
|
113
|
-
|
|
114
|
-
|
|
115
|
-
|
|
116
|
-
|
|
117
|
-
|
|
118
|
-
|
|
119
|
-
|
|
120
|
-
|
|
121
|
-
| Tool | What it does |
|
|
122
|
-
|------|-------------|
|
|
123
|
-
| `
|
|
124
|
-
| `
|
|
125
|
-
| `
|
|
126
|
-
| `
|
|
127
|
-
| `
|
|
128
|
-
| `
|
|
129
|
-
| `
|
|
130
|
-
| `
|
|
131
|
-
|
|
132
|
-
|
|
133
|
-
|
|
134
|
-
|
|
135
|
-
|
|
136
|
-
|
|
|
137
|
-
|
|
138
|
-
|
|
139
|
-
|
|
140
|
-
|
|
141
|
-
|
|
142
|
-
|
|
143
|
-
|
|
144
|
-
|
|
145
|
-
|
|
146
|
-
|
|
147
|
-
|
|
148
|
-
|
|
149
|
-
|
|
150
|
-
|
|
151
|
-
|
|
152
|
-
|
|
153
|
-
|
|
154
|
-
|
|
155
|
-
|
|
156
|
-
|
|
157
|
-
|
|
158
|
-
|
|
159
|
-
|
|
160
|
-
|
|
161
|
-
|
|
162
|
-
|
|
|
163
|
-
|
|
164
|
-
| `
|
|
165
|
-
| `
|
|
166
|
-
| `
|
|
167
|
-
| `
|
|
168
|
-
| `
|
|
169
|
-
| `
|
|
170
|
-
| `
|
|
171
|
-
|
|
172
|
-
|
|
173
|
-
|
|
174
|
-
|
|
175
|
-
|
|
176
|
-
|
|
177
|
-
|
|
178
|
-
|
|
179
|
-
|
|
180
|
-
|
|
181
|
-
|
|
182
|
-
|
|
183
|
-
|
|
184
|
-
|
|
185
|
-
|
|
186
|
-
|
|
187
|
-
|
|
188
|
-
|
|
189
|
-
|
|
190
|
-
|
|
191
|
-
|
|
192
|
-
|
|
193
|
-
|
|
194
|
-
|
|
195
|
-
|
|
196
|
-
|
|
197
|
-
|
|
198
|
-
|
|
199
|
-
|
|
200
|
-
|
|
201
|
-
|
|
202
|
-
|
|
203
|
-
|
|
204
|
-
|
|
205
|
-
|
|
206
|
-
|
|
207
|
-
|
|
208
|
-
|
|
209
|
-
|
|
210
|
-
|
|
211
|
-
|
|
212
|
-
|
|
213
|
-
|
|
214
|
-
|
|
215
|
-
|
|
216
|
-
|
|
217
|
-
|
|
218
|
-
|
|
219
|
-
|
|
220
|
-
|
|
221
|
-
|
|
222
|
-
|
|
223
|
-
|
|
224
|
-
|
|
225
|
-
|
|
1
|
+
# mobile-device-mcp
|
|
2
|
+
|
|
3
|
+
[](https://www.npmjs.com/package/mobile-device-mcp)
|
|
4
|
+
[](https://www.npmjs.com/package/mobile-device-mcp)
|
|
5
|
+
[](https://github.com/saranshbamania/mobile-device-mcp)
|
|
6
|
+
[](LICENSE)
|
|
7
|
+
|
|
8
|
+
MCP server that gives AI coding assistants (Claude Code, Cursor, Windsurf) the ability to **see and interact with mobile devices**. 49 tools for screenshots, UI inspection, touch interaction, AI-powered visual analysis, Flutter widget tree inspection, video recording, and test generation.
|
|
9
|
+
|
|
10
|
+
> AI assistants can read your code but can't see your phone. This fixes that.
|
|
11
|
+
|
|
12
|
+
## Why This One?
|
|
13
|
+
|
|
14
|
+
| Feature | mobile-device-mcp | mobile-next/mobile-mcp | appium/appium-mcp |
|
|
15
|
+
|---------|:-:|:-:|:-:|
|
|
16
|
+
| Total tools | **49** | 20 | ~15 |
|
|
17
|
+
| Setup | `npx` (30 sec) | `npx` | Requires Appium server |
|
|
18
|
+
| AI visual analysis | **12 tools** (Claude + Gemini) | None | Vision-based finding |
|
|
19
|
+
| Flutter widget tree | **10 tools** (Dart VM Service) | None | None |
|
|
20
|
+
| Smart element finding | **4-tier** (<1ms local search) | Accessibility tree only | XPath/selectors |
|
|
21
|
+
| Companion app (23x faster UI tree) | Yes | No | No |
|
|
22
|
+
| Video recording | Yes | No | No |
|
|
23
|
+
| Test script generation | **TS, Python, JSON** | No | Java/TestNG only |
|
|
24
|
+
| iOS simulator support | Yes | Yes | Yes |
|
|
25
|
+
| iOS real device | Planned | Yes | Yes |
|
|
26
|
+
| Screenshot compression | **89%** (251KB->28KB) | None | 50-80% |
|
|
27
|
+
| Multi-provider AI | Claude + Gemini | N/A | Single provider |
|
|
28
|
+
| Price | Free tier + Pro | Free | Free |
|
|
29
|
+
|
|
30
|
+
## The Problem
|
|
31
|
+
|
|
32
|
+
Web developers have browser DevTools, Playwright, and Puppeteer -- AI assistants can click around, take screenshots, and verify fixes. Mobile developers? They're stuck manually screenshotting, copying logs, and describing what's on screen. They're **human middleware** between the AI and the device.
|
|
33
|
+
|
|
34
|
+
## What This Does
|
|
35
|
+
|
|
36
|
+
```
|
|
37
|
+
Developer: "The login button doesn't work"
|
|
38
|
+
|
|
39
|
+
Without this tool: With this tool:
|
|
40
|
+
1. Manually screenshot 1. AI calls take_screenshot -> sees the screen
|
|
41
|
+
2. Paste into AI chat 2. AI calls smart_tap("login button") -> taps it
|
|
42
|
+
3. AI guesses what's wrong 3. AI calls verify_screen("error message shown") -> sees result
|
|
43
|
+
4. Apply fix, rebuild 4. AI calls visual_diff -> confirms fix worked
|
|
44
|
+
5. Repeat 4-5 times 5. Done.
|
|
45
|
+
```
|
|
46
|
+
|
|
47
|
+
## Quick Start
|
|
48
|
+
|
|
49
|
+
### Prerequisites
|
|
50
|
+
- Node.js 18+
|
|
51
|
+
- Android device/emulator connected via ADB
|
|
52
|
+
- ADB installed (Android SDK Platform Tools)
|
|
53
|
+
|
|
54
|
+
### Setup (One-time, 30 seconds)
|
|
55
|
+
|
|
56
|
+
1. **Get a Google AI key** (free tier available): [aistudio.google.com/apikey](https://aistudio.google.com/apikey)
|
|
57
|
+
|
|
58
|
+
2. **Add `.mcp.json` to your project root:**
|
|
59
|
+
|
|
60
|
+
```json
|
|
61
|
+
{
|
|
62
|
+
"mcpServers": {
|
|
63
|
+
"mobile-device": {
|
|
64
|
+
"type": "stdio",
|
|
65
|
+
"command": "npx",
|
|
66
|
+
"args": ["-y", "mobile-device-mcp"],
|
|
67
|
+
"env": {
|
|
68
|
+
"GOOGLE_API_KEY": "your-google-api-key"
|
|
69
|
+
}
|
|
70
|
+
}
|
|
71
|
+
}
|
|
72
|
+
}
|
|
73
|
+
```
|
|
74
|
+
|
|
75
|
+
3. **Open your AI coding assistant** from that directory. That's it.
|
|
76
|
+
|
|
77
|
+
The server starts and stops automatically -- you never run it manually. Your AI assistant manages it as a background process via the MCP protocol.
|
|
78
|
+
|
|
79
|
+
### Verify It Works
|
|
80
|
+
|
|
81
|
+
**Claude Code:** type `/mcp` -- you should see `mobile-device: Connected`
|
|
82
|
+
|
|
83
|
+
**Cursor:** check MCP panel in settings
|
|
84
|
+
|
|
85
|
+
Then just talk to your phone:
|
|
86
|
+
|
|
87
|
+
```
|
|
88
|
+
You: "Open my app, tap the login button, type test@email.com in the email field"
|
|
89
|
+
AI: [takes screenshot -> sees the screen -> smart_tap("login button") -> smart_type("email field", "test@email.com")]
|
|
90
|
+
|
|
91
|
+
You: "Find all the bugs on this screen"
|
|
92
|
+
AI: [analyze_screen -> inspects layout, checks for overflow, missing labels, broken states]
|
|
93
|
+
|
|
94
|
+
You: "Navigate to settings and verify dark mode works"
|
|
95
|
+
AI: [smart_tap("settings") -> take_screenshot -> smart_tap("dark mode toggle") -> visual_diff -> reports result]
|
|
96
|
+
```
|
|
97
|
+
|
|
98
|
+
No test scripts. No manual screenshots. Just describe what you want in plain English.
|
|
99
|
+
|
|
100
|
+
### Works with Any AI Coding Assistant
|
|
101
|
+
|
|
102
|
+
| Tool | Config file | Docs |
|
|
103
|
+
|------|------------|------|
|
|
104
|
+
| **Claude Code** | `.mcp.json` in project root | [claude.ai/docs](https://claude.ai/docs) |
|
|
105
|
+
| **Cursor** | `.cursor/mcp.json` | [cursor.com/docs](https://cursor.com/docs) |
|
|
106
|
+
| **VS Code + Copilot** | MCP settings | [code.visualstudio.com](https://code.visualstudio.com) |
|
|
107
|
+
| **Windsurf** | MCP settings | [windsurf.com](https://windsurf.com) |
|
|
108
|
+
|
|
109
|
+
All use the same JSON config -- just put it in the right file for your editor.
|
|
110
|
+
|
|
111
|
+
### Drop Into Any Project
|
|
112
|
+
|
|
113
|
+
Copy `.mcp.json` into any mobile project -- Flutter, React Native, Kotlin, Swift -- and your AI assistant gets device superpowers in that directory. No global install needed.
|
|
114
|
+
|
|
115
|
+
## Free vs Pro
|
|
116
|
+
|
|
117
|
+
<a name="pro"></a>
|
|
118
|
+
|
|
119
|
+
### Free (14 tools) -- no license key needed
|
|
120
|
+
|
|
121
|
+
| Tool | What it does |
|
|
122
|
+
|------|-------------|
|
|
123
|
+
| `list_devices` | List all connected Android devices/emulators |
|
|
124
|
+
| `get_device_info` | Model, manufacturer, Android version, SDK level |
|
|
125
|
+
| `get_screen_size` | Screen resolution in pixels |
|
|
126
|
+
| `take_screenshot` | Capture screenshot (PNG or JPEG, configurable quality & resize) |
|
|
127
|
+
| `get_ui_elements` | Get the accessibility/UI element tree as structured JSON |
|
|
128
|
+
| `tap` | Tap at coordinates |
|
|
129
|
+
| `double_tap` | Double tap at coordinates |
|
|
130
|
+
| `long_press` | Long press at coordinates |
|
|
131
|
+
| `swipe` | Swipe between two points |
|
|
132
|
+
| `type_text` | Type text into the focused field |
|
|
133
|
+
| `press_key` | Press a key (home, back, enter, volume, etc.) |
|
|
134
|
+
| `list_apps` | List installed apps |
|
|
135
|
+
| `get_current_app` | Get the foreground app |
|
|
136
|
+
| `get_logs` | Get logcat entries with filtering |
|
|
137
|
+
|
|
138
|
+
### Pro (35 additional tools) -- requires license key
|
|
139
|
+
|
|
140
|
+
Unlock all 49 tools by setting `MOBILE_MCP_LICENSE_KEY` in your `.mcp.json`:
|
|
141
|
+
|
|
142
|
+
```json
|
|
143
|
+
{
|
|
144
|
+
"mcpServers": {
|
|
145
|
+
"mobile-device": {
|
|
146
|
+
"type": "stdio",
|
|
147
|
+
"command": "npx",
|
|
148
|
+
"args": ["-y", "mobile-device-mcp"],
|
|
149
|
+
"env": {
|
|
150
|
+
"GOOGLE_API_KEY": "your-google-api-key",
|
|
151
|
+
"MOBILE_MCP_LICENSE_KEY": "your-license-key"
|
|
152
|
+
}
|
|
153
|
+
}
|
|
154
|
+
}
|
|
155
|
+
}
|
|
156
|
+
```
|
|
157
|
+
|
|
158
|
+
#### AI Visual Analysis (12 tools)
|
|
159
|
+
|
|
160
|
+
Use AI vision (Claude or Gemini) to understand what's on screen.
|
|
161
|
+
|
|
162
|
+
| Tool | What it does |
|
|
163
|
+
|------|-------------|
|
|
164
|
+
| `analyze_screen` | AI describes the screen: app name, screen type, interactive elements, visible text, suggestions |
|
|
165
|
+
| `find_element` | Find a UI element by description: *"the login button"*, *"email input field"* |
|
|
166
|
+
| `smart_tap` | Find an element by description and tap it in one step |
|
|
167
|
+
| `smart_type` | Find an input field by description, focus it, and type text |
|
|
168
|
+
| `suggest_actions` | Plan actions to achieve a goal: *"log into the app"*, *"add item to cart"* |
|
|
169
|
+
| `visual_diff` | Compare current screen with a previous screenshot -- what changed? |
|
|
170
|
+
| `extract_text` | Extract all visible text from the screen (AI-powered OCR) |
|
|
171
|
+
| `verify_screen` | Verify an assertion: *"the login was successful"*, *"error message is showing"* |
|
|
172
|
+
| `wait_for_settle` | Wait until the screen stops changing |
|
|
173
|
+
| `wait_for_element` | Wait for a specific element to appear on screen |
|
|
174
|
+
| `handle_popup` | Detect and dismiss popups, dialogs, permission prompts |
|
|
175
|
+
| `fill_form` | Fill multiple form fields in one step |
|
|
176
|
+
|
|
177
|
+
#### Flutter Widget Tree (10 tools)
|
|
178
|
+
|
|
179
|
+
Connect to running Flutter apps via Dart VM Service Protocol. Maps every widget to its source code location (`file:line`).
|
|
180
|
+
|
|
181
|
+
| Tool | What it does |
|
|
182
|
+
|------|-------------|
|
|
183
|
+
| `flutter_connect` | Discover and connect to a running Flutter app on the device |
|
|
184
|
+
| `flutter_disconnect` | Disconnect from the Flutter app and clean up resources |
|
|
185
|
+
| `flutter_get_widget_tree` | Get the full widget tree (summary or detailed) |
|
|
186
|
+
| `flutter_get_widget_details` | Get detailed properties of a specific widget by ID |
|
|
187
|
+
| `flutter_find_widget` | Search the widget tree by type, text, or description |
|
|
188
|
+
| `flutter_get_source_map` | Map every widget to its source code location (file:line:column) |
|
|
189
|
+
| `flutter_screenshot_widget` | Screenshot a specific widget in isolation |
|
|
190
|
+
| `flutter_debug_paint` | Toggle debug paint overlay (shows widget boundaries & padding) |
|
|
191
|
+
| `flutter_hot_reload` | Hot reload Flutter app (preserves state) |
|
|
192
|
+
| `flutter_hot_restart` | Hot restart Flutter app (resets state) |
|
|
193
|
+
|
|
194
|
+
#### iOS Simulator (4 tools)
|
|
195
|
+
|
|
196
|
+
macOS only. Control iOS simulators via `xcrun simctl`.
|
|
197
|
+
|
|
198
|
+
| Tool | What it does |
|
|
199
|
+
|------|-------------|
|
|
200
|
+
| `ios_list_simulators` | List available iOS simulators |
|
|
201
|
+
| `ios_boot_simulator` | Boot a simulator by name or UDID |
|
|
202
|
+
| `ios_shutdown_simulator` | Shut down a running simulator |
|
|
203
|
+
| `ios_screenshot` | Take a screenshot of a simulator |
|
|
204
|
+
|
|
205
|
+
#### Video Recording (2 tools)
|
|
206
|
+
|
|
207
|
+
| Tool | What it does |
|
|
208
|
+
|------|-------------|
|
|
209
|
+
| `record_screen` | Start recording the device screen |
|
|
210
|
+
| `stop_recording` | Stop recording and save the video |
|
|
211
|
+
|
|
212
|
+
#### Test Generation (3 tools)
|
|
213
|
+
|
|
214
|
+
| Tool | What it does |
|
|
215
|
+
|------|-------------|
|
|
216
|
+
| `start_test_recording` | Start recording your MCP tool calls |
|
|
217
|
+
| `stop_test_recording` | Stop recording and generate a test script |
|
|
218
|
+
| `get_recorded_actions` | Get recorded actions as TypeScript, Python, or JSON |
|
|
219
|
+
|
|
220
|
+
#### App Management (4 tools)
|
|
221
|
+
|
|
222
|
+
| Tool | What it does |
|
|
223
|
+
|------|-------------|
|
|
224
|
+
| `launch_app` | Launch an app by package name |
|
|
225
|
+
| `stop_app` | Force stop an app |
|
|
226
|
+
| `install_app` | Install an APK |
|
|
227
|
+
| `uninstall_app` | Uninstall an app |
|
|
228
|
+
|
|
229
|
+
## Performance
|
|
230
|
+
|
|
231
|
+
The server is optimized to minimize latency and AI token costs:
|
|
232
|
+
|
|
233
|
+
- **4-tier element search**: companion app (instant) -> local text match (<1ms) -> cached AI -> fresh AI. `smart_tap` is **35x faster** than naive AI calls (205ms vs 7.6s).
|
|
234
|
+
- **Companion app**: AccessibilityService-based Android app provides UI tree in 105ms (23x faster than UIAutomator's 2448ms). Auto-installs on first use.
|
|
235
|
+
- **Screenshot compression**: AI tools auto-compress to JPEG q=60, 400w -- **89% smaller** (251KB -> 28KB) with zero AI quality loss.
|
|
236
|
+
- **Parallel capture**: Screenshot + UI tree fetched simultaneously via `Promise.all()`.
|
|
237
|
+
- **TTL caching**: 5-second cache avoids redundant ADB calls for rapid-fire tool usage.
|
|
238
|
+
|
|
239
|
+
## Environment Variables
|
|
240
|
+
|
|
241
|
+
| Variable | Description | Default |
|
|
242
|
+
|----------|-------------|---------|
|
|
243
|
+
| `GOOGLE_API_KEY` or `GEMINI_API_KEY` | Google API key for Gemini vision (recommended) | -- |
|
|
244
|
+
| `ANTHROPIC_API_KEY` | Anthropic API key for Claude vision | -- |
|
|
245
|
+
| `MOBILE_MCP_LICENSE_KEY` | License key to unlock Pro tools | -- |
|
|
246
|
+
| `MCP_AI_PROVIDER` | Force AI provider: `"anthropic"` or `"google"` | Auto-detected |
|
|
247
|
+
| `MCP_AI_MODEL` | Override AI model | `gemini-2.5-flash` / `claude-sonnet-4-20250514` |
|
|
248
|
+
| `MCP_ADB_PATH` | Custom ADB binary path | Auto-discovered |
|
|
249
|
+
| `MCP_DEFAULT_DEVICE` | Default device serial | Auto-discovered |
|
|
250
|
+
| `MCP_SCREENSHOT_FORMAT` | `"png"` or `"jpeg"` | `jpeg` |
|
|
251
|
+
| `MCP_SCREENSHOT_QUALITY` | JPEG quality (1-100) | `80` |
|
|
252
|
+
| `MCP_SCREENSHOT_MAX_WIDTH` | Resize screenshots to this max width | `720` |
|
|
253
|
+
|
|
254
|
+
## Architecture
|
|
255
|
+
|
|
256
|
+
```
|
|
257
|
+
src/
|
|
258
|
+
|-- index.ts # CLI entry point (auto-discovery, env config)
|
|
259
|
+
|-- server.ts # MCP server factory
|
|
260
|
+
|-- license.ts # License validation and tier gating
|
|
261
|
+
|-- types.ts # Shared interfaces
|
|
262
|
+
|-- drivers/android/ # ADB driver (DeviceDriver implementation)
|
|
263
|
+
| |-- adb.ts # Low-level ADB command wrapper
|
|
264
|
+
| |-- companion-client.ts # TCP client for companion app
|
|
265
|
+
| +-- index.ts # AndroidDriver class (4-strategy UI element retrieval)
|
|
266
|
+
|-- drivers/flutter/ # Dart VM Service driver
|
|
267
|
+
| |-- index.ts # FlutterDriver (discovery, inspection, source mapping, hot reload)
|
|
268
|
+
| +-- vm-service.ts # JSON-RPC 2.0 WebSocket client (DDS redirect handling)
|
|
269
|
+
|-- drivers/ios/ # iOS Simulator driver (macOS only)
|
|
270
|
+
| |-- index.ts # IOSSimulatorDriver via xcrun simctl
|
|
271
|
+
| +-- simctl.ts # Low-level simctl command wrapper
|
|
272
|
+
|-- tools/ # MCP tool registrations (free + pro gating)
|
|
273
|
+
| |-- device-tools.ts # Device management
|
|
274
|
+
| |-- screen-tools.ts # Screenshots & UI inspection
|
|
275
|
+
| |-- interaction-tools.ts # Touch, type, keys
|
|
276
|
+
| |-- app-tools.ts # App management
|
|
277
|
+
| |-- log-tools.ts # Logcat
|
|
278
|
+
| |-- ai-tools.ts # AI-powered tools
|
|
279
|
+
| |-- flutter-tools.ts # Flutter widget inspection
|
|
280
|
+
| |-- ios-tools.ts # iOS simulator tools
|
|
281
|
+
| |-- video-tools.ts # Screen recording
|
|
282
|
+
| +-- recording-tools.ts # Test generation
|
|
283
|
+
|-- recording/ # Test script generation
|
|
284
|
+
| |-- recorder.ts # ActionRecorder (records MCP tool calls)
|
|
285
|
+
| +-- generator.ts # TestGenerator (TypeScript/Python/JSON output)
|
|
286
|
+
|-- ai/ # AI visual analysis engine
|
|
287
|
+
| |-- client.ts # Multi-provider client (Anthropic + Google)
|
|
288
|
+
| |-- prompts.ts # System prompts & UI element summarizer
|
|
289
|
+
| |-- analyzer.ts # ScreenAnalyzer orchestrator (caching, parallel capture)
|
|
290
|
+
| +-- element-search.ts # Local element search (text/alias matching, no AI needed)
|
|
291
|
+
+-- utils/
|
|
292
|
+
|-- discovery.ts # ADB auto-discovery
|
|
293
|
+
+-- image.ts # PNG parsing, JPEG compression, bilinear resize
|
|
294
|
+
|
|
295
|
+
companion-app/ # Android companion app (Kotlin)
|
|
296
|
+
# AccessibilityService + TCP JSON-RPC for fast UI tree
|
|
297
|
+
```
|
|
298
|
+
|
|
299
|
+
## Roadmap
|
|
300
|
+
|
|
301
|
+
- [ ] iOS physical device support
|
|
302
|
+
- [ ] Multi-device orchestration
|
|
303
|
+
- [ ] CI/CD integration
|
|
304
|
+
- [ ] Cloud device farm support
|
|
305
|
+
|
|
306
|
+
## Tested On
|
|
307
|
+
|
|
308
|
+
- **Devices**: Pixel 8 (Android 16), Samsung Galaxy series, Android emulators
|
|
309
|
+
- **Apps**: Telegram, Instagram, Spotify, WhatsApp, YouTube, Chrome, Settings, and Flutter apps
|
|
310
|
+
- **AI Providers**: Google Gemini 2.5 Flash, Anthropic Claude
|
|
311
|
+
- **Platforms**: Windows 11, macOS (iOS simulators)
|
|
312
|
+
- **Connection**: USB and wireless ADB
|
|
313
|
+
|
|
314
|
+
## License
|
|
315
|
+
|
|
316
|
+
[Business Source License 1.1](LICENSE)
|
|
317
|
+
|
|
318
|
+
- **Free for individuals and non-commercial use**
|
|
319
|
+
- **Commercial use requires a paid license**
|
|
320
|
+
- Converts to Apache 2.0 on March 23, 2030
|
|
321
|
+
|
|
322
|
+
See [LICENSE](LICENSE) for full terms.
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "mobile-device-mcp",
|
|
3
|
-
"version": "0.2.
|
|
3
|
+
"version": "0.2.3",
|
|
4
4
|
"description": "MCP server that gives AI coding assistants (Claude, Cursor, Windsurf) the ability to see and interact with Android mobile devices via ADB — AI-powered visual inspection, element finding, and device automation",
|
|
5
5
|
"type": "module",
|
|
6
6
|
"main": "dist/index.js",
|