@agentconnect.md/computer 2.8.0-rc.2 → 2.8.0-rc.22
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +46 -28
- package/dist/agentconnect-computer.mjs +6073 -2724
- package/package.json +3 -3
package/README.md
CHANGED
|
@@ -26,8 +26,9 @@ published with each release too (see [Run in Docker](#run-in-docker)).
|
|
|
26
26
|
- The `/view` browser remote desktop: WebRTC video (ffmpeg + werift) with a screenshot-polling
|
|
27
27
|
fallback, and human takeover.
|
|
28
28
|
- `setup` / `doctor` on macOS, Linux (X11 and GNOME Wayland) and Windows; a macOS LaunchAgent
|
|
29
|
-
(`.app` mode)
|
|
30
|
-
-
|
|
29
|
+
(`.app` mode), a Linux systemd user unit, and a Windows service that runs the daemon as SYSTEM in
|
|
30
|
+
the signed-in session, so UAC prompts can be answered as the Computer's setting says.
|
|
31
|
+
- A Docker image (Xvfb + Xfce + Chromium + LibreOffice) that registers from its environment, amd64 and arm64.
|
|
31
32
|
|
|
32
33
|
**Limits**
|
|
33
34
|
|
|
@@ -38,10 +39,10 @@ published with each release too (see [Run in Docker](#run-in-docker)).
|
|
|
38
39
|
- Plain HTTP with a bearer token. The daemon listens on `127.0.0.1` by default; other machines
|
|
39
40
|
can reach it only when you pass `--host 0.0.0.0` (or another address) explicitly, and then the
|
|
40
41
|
token is the only protection.
|
|
41
|
-
- One display, no audio, no clipboard sync; no screen border. Keyboard activity
|
|
42
|
-
|
|
43
|
-
- Builds are unsigned (macOS `.app` is ad-hoc signed;
|
|
44
|
-
survive a rebuild.
|
|
42
|
+
- One display, no audio, no clipboard sync; no screen border. Keyboard activity and the global stop
|
|
43
|
+
hotkey exist on X11 only (Wayland is #3221); macOS has a menu bar icon and Windows a taskbar icon.
|
|
44
|
+
- Builds are unsigned (macOS `.app` is ad-hoc signed; the Windows service and taskbar helper are
|
|
45
|
+
compiled on the machine at install), so macOS grants do not survive a rebuild.
|
|
45
46
|
- CI covers X11 under Xvfb only (see [Development](#development)); the real-session matrix of design
|
|
46
47
|
§13 is still run by hand. `agentconnect computer` manages the npm package on Linux; macOS (`.app`) and
|
|
47
48
|
Windows packaging are M3 / M4, so there the bundle below is still installed by hand.
|
|
@@ -102,25 +103,40 @@ Requirements: Windows 10/11 x64 or arm64, a logged-in desktop session, Node.js
|
|
|
102
103
|
2. In a normal (non-admin) PowerShell on the Windows desktop, run:
|
|
103
104
|
|
|
104
105
|
```powershell
|
|
105
|
-
.\install.ps1 # copies
|
|
106
|
-
node "$env:LOCALAPPDATA\AgentConnect\computer\app\agentconnect-computer.mjs" run
|
|
106
|
+
.\install.ps1 # copies the bundle and runs setup, which installs the service
|
|
107
107
|
```
|
|
108
108
|
|
|
109
|
-
|
|
109
|
+
`setup` asks for administrator approval once (UAC), then:
|
|
110
|
+
- compiles the service host, the taskbar helper and the administrator prompt helper with the
|
|
111
|
+
.NET Framework's own `csc.exe` into `%ProgramFiles%\AgentConnect\Computer`, beside a copy of
|
|
112
|
+
`node.exe` and the bundle;
|
|
113
|
+
- moves the config and key to `%ProgramData%\AgentConnect\computer`, which you can read but only
|
|
114
|
+
administrators can change, since SYSTEM runs what it names;
|
|
115
|
+
- installs and starts the `AgentConnectComputer` service, which runs the daemon **as SYSTEM in
|
|
116
|
+
whoever is signed in at the console**. That is what lets it reach UAC prompts on the secure
|
|
117
|
+
desktop, which stays on as Windows ships it.
|
|
118
|
+
|
|
119
|
+
The taskbar icon (in the `^` overflow until you pin it) shows who controls the computer and
|
|
120
|
+
has the same menu as the macOS menu bar: Stop All Agent Input / Resume, the service, Start at
|
|
121
|
+
Sign-in, Open Logs, Uninstall and Quit. Its **Administrator Prompts** submenu chooses who
|
|
122
|
+
answers a UAC prompt while an agent is in control: _People Approve Each One_ (the default: each
|
|
123
|
+
approve waits for an allowed member's approval card), _Agent Decides_, _Always Approve_ or
|
|
124
|
+
_Always Deny_. It is the same setting as the console's usage policy, and either place changes
|
|
125
|
+
it for both. A prompt that asks for an administrator's password is left to you. Apps the agent
|
|
126
|
+
launches start as you, not as SYSTEM.
|
|
127
|
+
|
|
128
|
+
The daemon listens on `127.0.0.1` only. To reach it from another machine, run
|
|
110
129
|
`.\install.ps1 -ListenHost 0.0.0.0` instead: `setup` saves the address and adds the inbound
|
|
111
|
-
firewall rule
|
|
130
|
+
firewall rule for the service's `node.exe`, which a loopback-only install skips.
|
|
112
131
|
|
|
113
|
-
|
|
114
|
-
|
|
115
|
-
|
|
116
|
-
|
|
132
|
+
`service start | stop | restart | status` work without another approval; `service uninstall`
|
|
133
|
+
asks once and keeps the data unless you add `--purge`. With `setup --no-service` nothing is
|
|
134
|
+
installed: run the daemon in a console (`run`, `Ctrl+C` stops it), optionally started at logon by
|
|
135
|
+
a per-user `HKCU\...\Run` entry (`install.ps1 -Autostart`, `autostart disable` removes it). Such a
|
|
136
|
+
daemon cannot answer UAC prompts.
|
|
117
137
|
|
|
118
|
-
|
|
119
|
-
|
|
120
|
-
Windows service would not work anyway: services live in Session 0 and cannot see the user desktop.
|
|
121
|
-
|
|
122
|
-
To start over (new token), delete `%LOCALAPPDATA%\AgentConnect\computer\config.json`, or run
|
|
123
|
-
`node agentconnect-computer.mjs token add claude` to rotate the token.
|
|
138
|
+
To rotate the token, run `node agentconnect-computer.mjs token add claude` (it asks for approval
|
|
139
|
+
once the service holds the config).
|
|
124
140
|
|
|
125
141
|
## Run on macOS
|
|
126
142
|
|
|
@@ -252,11 +268,12 @@ static ffmpeg (6.0, libx264).
|
|
|
252
268
|
## Run in Docker
|
|
253
269
|
|
|
254
270
|
The `computer` image (`ghcr.io/agentconnect-md/computer`, amd64 and arm64, published with each release) is a
|
|
255
|
-
Debian trixie desktop with Xvfb, a lean Xfce,
|
|
271
|
+
Debian trixie desktop with Xvfb, a lean Xfce, Chromium, LibreOffice, Noto CJK fonts, the pinned Node.js (with npm),
|
|
272
|
+
Debian's Python, Go and Rust toolchains, and the daemon
|
|
256
273
|
with Cua Driver preinstalled. ffmpeg (GPL) is not in the image: the daemon downloads the pinned, sha256-checked
|
|
257
274
|
build on first start into the volume, and the viewer polls screenshots until it is there. The entrypoint starts Xvfb on `:1` (`RESOLUTION`, default
|
|
258
|
-
`
|
|
259
|
-
`desktop`. The browser is restarted when it exits or crashes (`BROWSER`, default `
|
|
275
|
+
`1280x800x24`), a session D-Bus, Xfce and a maximized browser, then runs `run` in the foreground as user
|
|
276
|
+
`desktop`. The browser is restarted when it exits or crashes (`BROWSER`, default `chromium`; `none` turns it
|
|
260
277
|
off; `BROWSER_URL` opens a page). `docker stop` stops the daemon, closes the browser, then the session, with exit
|
|
261
278
|
code 0. `/home/computer` is a volume: the Computer key, config, audit log, and the browser profile survive a new
|
|
262
279
|
container. A `HEALTHCHECK` runs `doctor --json --daemon` inside the running daemon.
|
|
@@ -360,8 +377,8 @@ so it never reaches the server or proxy logs, and the page keeps it in `localSto
|
|
|
360
377
|
WebRTC DataChannel to Cua Driver's desktop-scope input. A Mac's Cmd shortcuts map to Ctrl on
|
|
361
378
|
Windows. Use the text box for IME / pasted text. Viewer actions are audited as `viewer_*`
|
|
362
379
|
(pointer moves are not).
|
|
363
|
-
- Limits: the
|
|
364
|
-
|
|
380
|
+
- Limits: the secure desktop (UAC prompts, the lock screen) cannot be captured; a waiting UAC
|
|
381
|
+
prompt is described in words instead, and agents answer it with `computer_admin_prompt`. `gdigrab` captures the whole virtual desktop, so with several monitors input
|
|
365
382
|
mapping is only right when `ddagrab` (primary display) works. There is no audio and no
|
|
366
383
|
clipboard sync.
|
|
367
384
|
|
|
@@ -380,6 +397,7 @@ so it never reaches the server or proxy logs, and the page keeps it in `localSto
|
|
|
380
397
|
| `computer_launch` | yes | `{app}` name, or `.exe` path on Windows |
|
|
381
398
|
| `computer_wait` | no | `{ms}` ≤ 10000, then screenshot |
|
|
382
399
|
| `computer_acquire` / `computer_release` | — | explicit lease control |
|
|
400
|
+
| `computer_admin_prompt` | yes | Windows: approve or deny the waiting UAC prompt, as its Administrator Prompts setting allows |
|
|
383
401
|
|
|
384
402
|
Coordinates are pixels of the latest screenshot; Cua Driver maps them back to the
|
|
385
403
|
screen. Input tools return a screenshot taken `actionSettleMs` after the action.
|
|
@@ -451,8 +469,8 @@ agentconnect-computer stdio [--expose-driver-tools]
|
|
|
451
469
|
agentconnect-computer token add NAME | token list | token remove NAME
|
|
452
470
|
agentconnect-computer status | pause | resume
|
|
453
471
|
agentconnect-computer doctor [--here] [--json] (read-only checks; exit 1 on failure)
|
|
454
|
-
agentconnect-computer service install|uninstall|start|stop|restart|status (macOS .app LaunchAgent, Linux systemd user unit)
|
|
455
|
-
agentconnect-computer autostart enable | disable | start (Windows)
|
|
472
|
+
agentconnect-computer service install|uninstall|start|stop|restart|status (macOS .app LaunchAgent, Linux systemd user unit, Windows service)
|
|
473
|
+
agentconnect-computer autostart enable | disable | start (Windows without the service)
|
|
456
474
|
```
|
|
457
475
|
|
|
458
476
|
With the AgentConnect CLI installed, every command also runs as `agentconnect computer <command>`
|
|
@@ -463,7 +481,7 @@ the data dir, where the bundle's install scripts put it; `AGENTCONNECT_COMPUTER_
|
|
|
463
481
|
development build instead. See
|
|
464
482
|
[cli-daemon-split.md §1.2](../../docs/designs/cli-daemon-split.md#12-computer-desktop-daemon).
|
|
465
483
|
|
|
466
|
-
Data dir: `%
|
|
484
|
+
Data dir: `%ProgramData%\AgentConnect\computer` under the Windows service (else `%LOCALAPPDATA%\AgentConnect\computer`), `~/.agentconnect/computer`
|
|
467
485
|
elsewhere (`AGENTCONNECT_COMPUTER_HOME` overrides). `config.json` also holds
|
|
468
486
|
`maxImageDimension`, `leaseIdleSeconds`, `leaseMaxSeconds`, `humanIdleSeconds`,
|
|
469
487
|
`actionScreenshot`, `actionSettleMs`, `allowSystemKeys`, `stopHotkey`, `exposeDriverTools`,
|