@agentconnect.md/computer 2.8.0-rc.8 → 2.8.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/README.md CHANGED
@@ -26,8 +26,9 @@ published with each release too (see [Run in Docker](#run-in-docker)).
26
26
  - The `/view` browser remote desktop: WebRTC video (ffmpeg + werift) with a screenshot-polling
27
27
  fallback, and human takeover.
28
28
  - `setup` / `doctor` on macOS, Linux (X11 and GNOME Wayland) and Windows; a macOS LaunchAgent
29
- (`.app` mode) and a Linux systemd user unit; Windows logon autostart.
30
- - A Docker image (Xvfb + Xfce + Firefox ESR) that registers from its environment, amd64 and arm64.
29
+ (`.app` mode), a Linux systemd user unit, and a Windows service that runs the daemon as SYSTEM in
30
+ the signed-in session, so UAC prompts can be answered as the Computer's setting says.
31
+ - A Docker image (Xvfb + Xfce + Chromium + LibreOffice) that registers from its environment, amd64 and arm64.
31
32
 
32
33
  **Limits**
33
34
 
@@ -38,10 +39,10 @@ published with each release too (see [Run in Docker](#run-in-docker)).
38
39
  - Plain HTTP with a bearer token. The daemon listens on `127.0.0.1` by default; other machines
39
40
  can reach it only when you pass `--host 0.0.0.0` (or another address) explicitly, and then the
40
41
  token is the only protection.
41
- - One display, no audio, no clipboard sync; no screen border. Keyboard activity, the tray icon
42
- and the global stop hotkey exist on X11 only (Wayland is #3221; macOS and Windows have none).
43
- - Builds are unsigned (macOS `.app` is ad-hoc signed; no Windows installer), so OS grants do not
44
- survive a rebuild.
42
+ - One display, no audio, no clipboard sync; no screen border. Keyboard activity and the global stop
43
+ hotkey exist on X11 only (Wayland is #3221); macOS has a menu bar icon and Windows a taskbar icon.
44
+ - Builds are unsigned (macOS `.app` is ad-hoc signed; the Windows service and taskbar helper are
45
+ compiled on the machine at install), so macOS grants do not survive a rebuild.
45
46
  - CI covers X11 under Xvfb only (see [Development](#development)); the real-session matrix of design
46
47
  §13 is still run by hand. `agentconnect computer` manages the npm package on Linux; macOS (`.app`) and
47
48
  Windows packaging are M3 / M4, so there the bundle below is still installed by hand.
@@ -102,25 +103,40 @@ Requirements: Windows 10/11 x64 or arm64, a logged-in desktop session, Node.js
102
103
  2. In a normal (non-admin) PowerShell on the Windows desktop, run:
103
104
 
104
105
  ```powershell
105
- .\install.ps1 # copies to %LOCALAPPDATA%\AgentConnect\computer\app and runs setup
106
- node "$env:LOCALAPPDATA\AgentConnect\computer\app\agentconnect-computer.mjs" run
106
+ .\install.ps1 # copies the bundle and runs setup, which installs the service
107
107
  ```
108
108
 
109
- The daemon then listens on `127.0.0.1` only. To reach it from another machine, run
109
+ `setup` asks for administrator approval once (UAC), then:
110
+ - compiles the service host, the taskbar helper and the administrator prompt helper with the
111
+ .NET Framework's own `csc.exe` into `%ProgramFiles%\AgentConnect\Computer`, beside a copy of
112
+ `node.exe` and the bundle;
113
+ - moves the config and key to `%ProgramData%\AgentConnect\computer`, which you can read but only
114
+ administrators can change, since SYSTEM runs what it names;
115
+ - installs and starts the `AgentConnectComputer` service, which runs the daemon **as SYSTEM in
116
+ whoever is signed in at the console**. That is what lets it reach UAC prompts on the secure
117
+ desktop, which stays on as Windows ships it.
118
+
119
+ The taskbar icon (in the `^` overflow until you pin it) shows who controls the computer and
120
+ has the same menu as the macOS menu bar: Stop All Agent Input / Resume, the service, Start at
121
+ Sign-in, Open Logs, Uninstall and Quit. Its **Administrator Prompts** submenu chooses who
122
+ answers a UAC prompt while an agent is in control: _People Approve Each One_ (the default: each
123
+ approve waits for an allowed member's approval card), _Agent Decides_, _Always Approve_ or
124
+ _Always Deny_. It is the same setting as the console's usage policy, and either place changes
125
+ it for both. A prompt that asks for an administrator's password is left to you. Apps the agent
126
+ launches start as you, not as SYSTEM.
127
+
128
+ The daemon listens on `127.0.0.1` only. To reach it from another machine, run
110
129
  `.\install.ps1 -ListenHost 0.0.0.0` instead: `setup` saves the address and adds the inbound
111
- firewall rule, which a loopback-only install skips.
130
+ firewall rule for the service's `node.exe`, which a loopback-only install skips.
112
131
 
113
- `run` is a plain foreground process: `Ctrl+C` stops it and closes the port. Keep the console
114
- window open: it is the indicator and emergency stop. Running `node agentconnect-computer.mjs run`
115
- straight from the copied `bundle/` folder also works; it does the downloads itself but skips the
116
- firewall step.
132
+ `service start | stop | restart | status` work without another approval; `service uninstall`
133
+ asks once and keeps the data unless you add `--purge`. With `setup --no-service` nothing is
134
+ installed: run the daemon in a console (`run`, `Ctrl+C` stops it), optionally started at logon by
135
+ a per-user `HKCU\...\Run` entry (`install.ps1 -Autostart`, `autostart disable` removes it). Such a
136
+ daemon cannot answer UAC prompts.
117
137
 
118
- Nothing is installed as a service. With `-Autostart`, `install.ps1` also adds a per-user
119
- `HKCU\...\Run` entry that opens the daemon console at logon (`autostart disable` removes it). A real
120
- Windows service would not work anyway: services live in Session 0 and cannot see the user desktop.
121
-
122
- To start over (new token), delete `%LOCALAPPDATA%\AgentConnect\computer\config.json`, or run
123
- `node agentconnect-computer.mjs token add claude` to rotate the token.
138
+ To rotate the token, run `node agentconnect-computer.mjs token add claude` (it asks for approval
139
+ once the service holds the config).
124
140
 
125
141
  ## Run on macOS
126
142
 
@@ -252,11 +268,12 @@ static ffmpeg (6.0, libx264).
252
268
  ## Run in Docker
253
269
 
254
270
  The `computer` image (`ghcr.io/agentconnect-md/computer`, amd64 and arm64, published with each release) is a
255
- Debian trixie desktop with Xvfb, a lean Xfce, Firefox ESR, Noto CJK fonts, the pinned Node.js, and the daemon
271
+ Debian trixie desktop with Xvfb, a lean Xfce, Chromium, LibreOffice, Noto CJK fonts, the pinned Node.js (with npm),
272
+ Debian's Python, Go and Rust toolchains, and the daemon
256
273
  with Cua Driver preinstalled. ffmpeg (GPL) is not in the image: the daemon downloads the pinned, sha256-checked
257
274
  build on first start into the volume, and the viewer polls screenshots until it is there. The entrypoint starts Xvfb on `:1` (`RESOLUTION`, default
258
- `1600x900x24`), a session D-Bus, Xfce and a maximized browser, then runs `run` in the foreground as user
259
- `desktop`. The browser is restarted when it exits or crashes (`BROWSER`, default `firefox-esr`; `none` turns it
275
+ `1280x800x24`), a session D-Bus, Xfce and a maximized browser, then runs `run` in the foreground as user
276
+ `desktop`. The browser is restarted when it exits or crashes (`BROWSER`, default `chromium`; `none` turns it
260
277
  off; `BROWSER_URL` opens a page). `docker stop` stops the daemon, closes the browser, then the session, with exit
261
278
  code 0. `/home/computer` is a volume: the Computer key, config, audit log, and the browser profile survive a new
262
279
  container. A `HEALTHCHECK` runs `doctor --json --daemon` inside the running daemon.
@@ -360,8 +377,8 @@ so it never reaches the server or proxy logs, and the page keeps it in `localSto
360
377
  WebRTC DataChannel to Cua Driver's desktop-scope input. A Mac's Cmd shortcuts map to Ctrl on
361
378
  Windows. Use the text box for IME / pasted text. Viewer actions are audited as `viewer_*`
362
379
  (pointer moves are not).
363
- - Limits: the UAC secure desktop and the lock screen cannot be captured or controlled from
364
- the user session. `gdigrab` captures the whole virtual desktop, so with several monitors input
380
+ - Limits: the secure desktop (UAC prompts, the lock screen) cannot be captured; a waiting UAC
381
+ prompt is described in words instead, and agents answer it with `computer_admin_prompt`. `gdigrab` captures the whole virtual desktop, so with several monitors input
365
382
  mapping is only right when `ddagrab` (primary display) works. There is no audio and no
366
383
  clipboard sync.
367
384
 
@@ -380,6 +397,7 @@ so it never reaches the server or proxy logs, and the page keeps it in `localSto
380
397
  | `computer_launch` | yes | `{app}` name, or `.exe` path on Windows |
381
398
  | `computer_wait` | no | `{ms}` ≤ 10000, then screenshot |
382
399
  | `computer_acquire` / `computer_release` | — | explicit lease control |
400
+ | `computer_admin_prompt` | yes | Windows: approve or deny the waiting UAC prompt, as its Administrator Prompts setting allows |
383
401
 
384
402
  Coordinates are pixels of the latest screenshot; Cua Driver maps them back to the
385
403
  screen. Input tools return a screenshot taken `actionSettleMs` after the action.
@@ -451,8 +469,8 @@ agentconnect-computer stdio [--expose-driver-tools]
451
469
  agentconnect-computer token add NAME | token list | token remove NAME
452
470
  agentconnect-computer status | pause | resume
453
471
  agentconnect-computer doctor [--here] [--json] (read-only checks; exit 1 on failure)
454
- agentconnect-computer service install|uninstall|start|stop|restart|status (macOS .app LaunchAgent, Linux systemd user unit)
455
- agentconnect-computer autostart enable | disable | start (Windows)
472
+ agentconnect-computer service install|uninstall|start|stop|restart|status (macOS .app LaunchAgent, Linux systemd user unit, Windows service)
473
+ agentconnect-computer autostart enable | disable | start (Windows without the service)
456
474
  ```
457
475
 
458
476
  With the AgentConnect CLI installed, every command also runs as `agentconnect computer <command>`
@@ -463,7 +481,7 @@ the data dir, where the bundle's install scripts put it; `AGENTCONNECT_COMPUTER_
463
481
  development build instead. See
464
482
  [cli-daemon-split.md §1.2](../../docs/designs/cli-daemon-split.md#12-computer-desktop-daemon).
465
483
 
466
- Data dir: `%LOCALAPPDATA%\AgentConnect\computer` on Windows, `~/.agentconnect/computer`
484
+ Data dir: `%ProgramData%\AgentConnect\computer` under the Windows service (else `%LOCALAPPDATA%\AgentConnect\computer`), `~/.agentconnect/computer`
467
485
  elsewhere (`AGENTCONNECT_COMPUTER_HOME` overrides). `config.json` also holds
468
486
  `maxImageDimension`, `leaseIdleSeconds`, `leaseMaxSeconds`, `humanIdleSeconds`,
469
487
  `actionScreenshot`, `actionSettleMs`, `allowSystemKeys`, `stopHotkey`, `exposeDriverTools`,