fonino 0.0.0-stage → 0.1.1

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/LICENSE ADDED
@@ -0,0 +1,21 @@
1
+ MIT License
2
+
3
+ Copyright (c) 2026 Fonino
4
+
5
+ Permission is hereby granted, free of charge, to any person obtaining a copy
6
+ of this software and associated documentation files (the "Software"), to deal
7
+ in the Software without restriction, including without limitation the rights
8
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9
+ copies of the Software, and to permit persons to whom the Software is
10
+ furnished to do so, subject to the following conditions:
11
+
12
+ The above copyright notice and this permission notice shall be included in all
13
+ copies or substantial portions of the Software.
14
+
15
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
21
+ SOFTWARE.
package/README.md CHANGED
@@ -1,3 +1,158 @@
1
- # Temporary Holding Version
1
+ # Fonino
2
2
 
3
- This version is a temporary placeholder for this package. An operational version to replace this has been submitted for review and is awaiting a staged release.
3
+ **Let your AI agent use your real iPhone or Android phone, with your OK before anything is sent.**
4
+
5
+ Fonino lets Claude Code, Codex, Hermes or any MCP client see your phone's screen, open apps,
6
+ tap, swipe and type. Anything that sends, posts, buys or deletes waits for your one-tap
7
+ approval first. It runs on your Mac, with your own phone: no jailbreak, no cloud phone, nothing
8
+ to install on an Android phone and only a small helper on an iPhone.
9
+
10
+ <img src="docs/media/fonino-demo.gif" width="100%" alt="An agent asks Fonino to text Sam; the approval card waits for the owner; after Approve the phone sends the text in Google Messages">
11
+
12
+ <sub>A real run, in real time, on an Android emulator with a demo number. The same tools and approvals work on iPhone.</sub>
13
+
14
+ ```text
15
+ ● agent: text Sam that I'm running late
16
+ │
17
+ ● phone_open_app("Messages") → phone_get_screen → Sam's conversation
18
+ │
19
+ ● phone_send_message(to: Sam, "Running 10 minutes late, sorry!")
20
+ │ ⏸ waiting for your OK: "Send a text to Sam?" [Approve] [Deny]
21
+ │
22
+ ✓ sent after you approved (Delivered via iMessage)
23
+ ```
24
+
25
+ ## Get started
26
+
27
+ Paste this into your coding agent (Claude Code, Codex…) on a Mac:
28
+
29
+ ```text
30
+ Clone https://github.com/fonino/fonino, run npm install, then read docs/setup.md and walk me
31
+ through connecting my phone. Stop and ask me whenever a step needs my hands, and never type
32
+ my passcode or passwords for me.
33
+ ```
34
+
35
+ Or install it from npm:
36
+
37
+ ```bash
38
+ npm install -g fonino
39
+ fonino doctor # checks the Mac, the phone and permissions
40
+ fonino devices
41
+ ```
42
+
43
+ Or from source:
44
+
45
+ ```bash
46
+ git clone https://github.com/fonino/fonino && cd fonino
47
+ npm install && npm run build:native
48
+ apps/cli/bin/fonino doctor
49
+ ```
50
+
51
+ **Don't want to set it up yourself?** [Fonino for Mac](https://fonino.app) is the signed app
52
+ built on this code. It does the iPhone setup for you (no Xcode) and connects your phone to
53
+ Grok Bot, Muse, Claude and ChatGPT from anywhere, with approvals on your phone.
54
+
55
+ ## Two ways to connect the iPhone
56
+
57
+ | | **USB helper** (recommended) | **iPhone Mirroring** |
58
+ |---|---|---|
59
+ | How | Fonino's helper (WebDriverAgent, Apple's UI test runner) on the phone, over USB | Fonino reads and clicks macOS's iPhone Mirroring window |
60
+ | Taps | Exact: reads the screen's structure, not just pixels | From screenshots and text recognition |
61
+ | Your Mac | Free to use: nothing moves your mouse | Takes over the cursor while it works |
62
+ | Phones | Several per Mac, at the same time | One |
63
+ | Needs | Xcode, an Apple ID for signing, Developer Mode, a cable | macOS 15+, iOS 18+, same Apple Account on Mac and iPhone (not in the EU) |
64
+
65
+ ## Android
66
+
67
+ Turn on USB debugging (Settings → About phone → tap Build number 7 times, then Settings →
68
+ System → Developer options → USB debugging), plug the phone in and tap **Allow** on the phone.
69
+ Fonino finds it through `adb` ([Android platform-tools](https://developer.android.com/tools/releases/platform-tools));
70
+ an Android emulator works too. Nothing is installed on the phone.
71
+
72
+ ```bash
73
+ fonino devices
74
+ # android-001 Pixel 9 connected android-adb Pixel 9, Android 16, USB
75
+ ```
76
+
77
+ Same tools and the same safety rules as on iPhone: screenshots in points, taps checked against
78
+ the button under them, texts sent through Google Messages and verified before Send, Settings,
79
+ Wallet, Play Store and calls off limits. Typing is plain ASCII (texts can hold any characters).
80
+
81
+ Step-by-step for both iPhone ways and Android: [docs/setup.md](docs/setup.md).
82
+
83
+ ## Use it from your agent (MCP)
84
+
85
+ **Full toolset, with approvals** (recommended): run the local HTTP server and add it to your client.
86
+
87
+ ```bash
88
+ apps/cli/bin/fonino mcp-http --show-token # http://localhost:3001/mcp
89
+ claude mcp add --transport http fonino http://localhost:3001/mcp \
90
+ --header "Authorization: Bearer <token>"
91
+ ```
92
+
93
+ Tools include `phone_list_devices`, `phone_acquire` / `phone_release` (one agent per phone),
94
+ `phone_get_screen` (screenshot + elements), `phone_tap`, `phone_swipe`, `phone_type`,
95
+ `phone_open_app`, `phone_read_messages`, `phone_send_message`, `phone_wait_for_reply`,
96
+ `phone_await_approval`, `phone_request_help` (hand the phone to you for logins) and more.
97
+
98
+ **Basic control only:** `fonino mcp` (stdio; tap, type, swipe, screen). This repo's
99
+ `.mcp.json` registers it for Claude Code.
100
+
101
+ ## Safety
102
+
103
+ The rules are in the code, not in a prompt, so an agent can't talk its way past them:
104
+
105
+ - **Approvals.** Sending, posting, buying and deleting pause until you approve the exact app,
106
+ recipient and text. Fonino checks the button under every tap too: Send, Post, Reply, Buy Now
107
+ and Place your order always need your OK, even if the agent didn't say what it was doing.
108
+ `fonino approvals` lists pending requests; `fonino approve <id>` (`--for-task` covers
109
+ the rest of the task, `--always` allows that kind of action in that app, with a daily cap).
110
+ - **Off limits.** Settings, Wallet, Passwords, Mail, Phone, FaceTime, Find My and the App Store.
111
+ - **Your logins stay yours.** The agent hands you the phone for passwords, Face ID and
112
+ verification codes; one-time codes in messages are hidden from it.
113
+ - **Texting limits.** Rate limits per phone and recipient; anyone who replies STOP is never texted again.
114
+ - **Local and private.** Tokens, approvals and screenshots stay in `~/.fonino`, readable
115
+ only by your macOS user.
116
+
117
+ ## Other commands
118
+
119
+ ```bash
120
+ fonino screen <device> --open # screenshot
121
+ fonino tap <device> 200 500 # screenshot pixels
122
+ fonino agent <device> --goal "Open Settings and tell me the iOS version" # built-in agent (Anthropic API key)
123
+ fonino wda up # keep the USB helper running (health checks, restarts)
124
+ fonino service install # run it all as login services
125
+ fonino runs && fonino replay <run-id> --open
126
+ fonino help # everything else
127
+ ```
128
+
129
+ ## How it works
130
+
131
+ ```
132
+ apps/cli fonino CLI: setup, doctor, watchdog, local services, replay
133
+ packages/iphone-adapter iPhone USB helper (WebDriverAgent over usbmuxd), iPhone Mirroring, Android over adb
134
+ packages/mcp-server MCP tools, approvals, policy (off-limits apps, risky buttons), rate limits
135
+ packages/agent-runtime built-in agent loop and approval gate
136
+ packages/device-core device protocol, leases, mock phone for tests
137
+ packages/browser optional agent browser on the Mac (pages as text, replayable recipes)
138
+ packages/relay client that connects this Mac to the Fonino cloud (optional)
139
+ native/ Swift helpers: screen capture and input for Mirroring, text recognition
140
+ docs/ setup, research notes on controlling a non-jailbroken iPhone
141
+ ```
142
+
143
+ Background on why the USB helper and what we measured:
144
+ [docs/iphone-control-research.md](docs/iphone-control-research.md).
145
+
146
+ Requirements: an Apple-silicon Mac on macOS 15 or later, Node 22.18 or later.
147
+ Tests: `npm test`.
148
+
149
+ ## Limits
150
+
151
+ - The phone has to stay unlocked (iPhone: Auto-Lock Never; Android: the longest screen timeout).
152
+ - The first start of the helper may show a passcode prompt titled "XCTest": that's the helper
153
+ asking to use the screen. Enter it on the phone; it asks again only after a restart.
154
+ - No multi-touch, camera or Face ID flows. Some apps add their own checks.
155
+
156
+ ## License
157
+
158
+ MIT. See [LICENSE](LICENSE).
@@ -0,0 +1,92 @@
1
+ Copyright (c) 2023 Vercel, in collaboration with basement.studio
2
+
3
+ This Font Software is licensed under the SIL Open Font License, Version 1.1.
4
+ This license is copied below, and is also available with a FAQ at:
5
+ http://scripts.sil.org/OFL
6
+
7
+ -----------------------------------------------------------
8
+ SIL OPEN FONT LICENSE Version 1.1 - 26 February 2007
9
+ -----------------------------------------------------------
10
+
11
+ PREAMBLE
12
+ The goals of the Open Font License (OFL) are to stimulate worldwide
13
+ development of collaborative font projects, to support the font creation
14
+ efforts of academic and linguistic communities, and to provide a free and
15
+ open framework in which fonts may be shared and improved in partnership
16
+ with others.
17
+
18
+ The OFL allows the licensed fonts to be used, studied, modified and
19
+ redistributed freely as long as they are not sold by themselves. The
20
+ fonts, including any derivative works, can be bundled, embedded,
21
+ redistributed and/or sold with any software provided that any reserved
22
+ names are not used by derivative works. The fonts and derivatives,
23
+ however, cannot be released under any other type of license. The
24
+ requirement for fonts to remain under this license does not apply
25
+ to any document created using the fonts or their derivatives.
26
+
27
+ DEFINITIONS
28
+ "Font Software" refers to the set of files released by the Copyright
29
+ Holder(s) under this license and clearly marked as such. This may
30
+ include source files, build scripts and documentation.
31
+
32
+ "Reserved Font Name" refers to any names specified as such after the
33
+ copyright statement(s).
34
+
35
+ "Original Version" refers to the collection of Font Software components as
36
+ distributed by the Copyright Holder(s).
37
+
38
+ "Modified Version" refers to any derivative made by adding to, deleting,
39
+ or substituting -- in part or in whole -- any of the components of the
40
+ Original Version, by changing formats or by porting the Font Software to a
41
+ new environment.
42
+
43
+ "Author" refers to any designer, engineer, programmer, technical
44
+ writer or other person who contributed to the Font Software.
45
+
46
+ PERMISSION AND CONDITIONS
47
+ Permission is hereby granted, free of charge, to any person obtaining
48
+ a copy of the Font Software, to use, study, copy, merge, embed, modify,
49
+ redistribute, and sell modified and unmodified copies of the Font
50
+ Software, subject to the following conditions:
51
+
52
+ 1) Neither the Font Software nor any of its individual components,
53
+ in Original or Modified Versions, may be sold by itself.
54
+
55
+ 2) Original or Modified Versions of the Font Software may be bundled,
56
+ redistributed and/or sold with any software, provided that each copy
57
+ contains the above copyright notice and this license. These can be
58
+ included either as stand-alone text files, human-readable headers or
59
+ in the appropriate machine-readable metadata fields within text or
60
+ binary files as long as those fields can be easily viewed by the user.
61
+
62
+ 3) No Modified Version of the Font Software may use the Reserved Font
63
+ Name(s) unless explicit written permission is granted by the corresponding
64
+ Copyright Holder. This restriction only applies to the primary font name as
65
+ presented to the users.
66
+
67
+ 4) The name(s) of the Copyright Holder(s) or the Author(s) of the Font
68
+ Software shall not be used to promote, endorse or advertise any
69
+ Modified Version, except to acknowledge the contribution(s) of the
70
+ Copyright Holder(s) and the Author(s) or with their explicit written
71
+ permission.
72
+
73
+ 5) The Font Software, modified or unmodified, in part or in whole,
74
+ must be distributed entirely under this license, and must not be
75
+ distributed under any other license. The requirement for fonts to
76
+ remain under this license does not apply to any document created
77
+ using the Font Software.
78
+
79
+ TERMINATION
80
+ This license becomes null and void if any of the above conditions are
81
+ not met.
82
+
83
+ DISCLAIMER
84
+ THE FONT SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
85
+ EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO ANY WARRANTIES OF
86
+ MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT
87
+ OF COPYRIGHT, PATENT, TRADEMARK, OR OTHER RIGHT. IN NO EVENT SHALL THE
88
+ COPYRIGHT HOLDER BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY,
89
+ INCLUDING ANY GENERAL, SPECIAL, INDIRECT, INCIDENTAL, OR CONSEQUENTIAL
90
+ DAMAGES, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
91
+ FROM, OUT OF THE USE OR INABILITY TO USE THE FONT SOFTWARE OR FROM
92
+ OTHER DEALINGS IN THE FONT SOFTWARE.