@agentconnect.md/computer 2.7.0 → 2.8.0-rc.12

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/README.md CHANGED
@@ -26,7 +26,8 @@ published with each release too (see [Run in Docker](#run-in-docker)).
26
26
  - The `/view` browser remote desktop: WebRTC video (ffmpeg + werift) with a screenshot-polling
27
27
  fallback, and human takeover.
28
28
  - `setup` / `doctor` on macOS, Linux (X11 and GNOME Wayland) and Windows; a macOS LaunchAgent
29
- (`.app` mode) and a Linux systemd user unit; Windows logon autostart.
29
+ (`.app` mode), a Linux systemd user unit, and a Windows service that runs the daemon as SYSTEM in
30
+ the signed-in session, so UAC prompts can be answered as the Computer's setting says.
30
31
  - A Docker image (Xvfb + Xfce + Firefox ESR) that registers from its environment, amd64 and arm64.
31
32
 
32
33
  **Limits**
@@ -38,10 +39,10 @@ published with each release too (see [Run in Docker](#run-in-docker)).
38
39
  - Plain HTTP with a bearer token. The daemon listens on `127.0.0.1` by default; other machines
39
40
  can reach it only when you pass `--host 0.0.0.0` (or another address) explicitly, and then the
40
41
  token is the only protection.
41
- - One display, no audio, no clipboard sync; no screen border. Keyboard activity, the tray icon
42
- and the global stop hotkey exist on X11 only (Wayland is #3221; macOS and Windows have none).
43
- - Builds are unsigned (macOS `.app` is ad-hoc signed; no Windows installer), so OS grants do not
44
- survive a rebuild.
42
+ - One display, no audio, no clipboard sync; no screen border. Keyboard activity and the global stop
43
+ hotkey exist on X11 only (Wayland is #3221); macOS has a menu bar icon and Windows a taskbar icon.
44
+ - Builds are unsigned (macOS `.app` is ad-hoc signed; the Windows service and taskbar helper are
45
+ compiled on the machine at install), so macOS grants do not survive a rebuild.
45
46
  - CI covers X11 under Xvfb only (see [Development](#development)); the real-session matrix of design
46
47
  §13 is still run by hand. `agentconnect computer` manages the npm package on Linux; macOS (`.app`) and
47
48
  Windows packaging are M3 / M4, so there the bundle below is still installed by hand.
@@ -102,25 +103,40 @@ Requirements: Windows 10/11 x64 or arm64, a logged-in desktop session, Node.js
102
103
  2. In a normal (non-admin) PowerShell on the Windows desktop, run:
103
104
 
104
105
  ```powershell
105
- .\install.ps1 # copies to %LOCALAPPDATA%\AgentConnect\computer\app and runs setup
106
- node "$env:LOCALAPPDATA\AgentConnect\computer\app\agentconnect-computer.mjs" run
106
+ .\install.ps1 # copies the bundle and runs setup, which installs the service
107
107
  ```
108
108
 
109
- The daemon then listens on `127.0.0.1` only. To reach it from another machine, run
109
+ `setup` asks for administrator approval once (UAC), then:
110
+ - compiles the service host, the taskbar helper and the administrator prompt helper with the
111
+ .NET Framework's own `csc.exe` into `%ProgramFiles%\AgentConnect\Computer`, beside a copy of
112
+ `node.exe` and the bundle;
113
+ - moves the config and key to `%ProgramData%\AgentConnect\computer`, which you can read but only
114
+ administrators can change, since SYSTEM runs what it names;
115
+ - installs and starts the `AgentConnectComputer` service, which runs the daemon **as SYSTEM in
116
+ whoever is signed in at the console**. That is what lets it reach UAC prompts on the secure
117
+ desktop, which stays on as Windows ships it.
118
+
119
+ The taskbar icon (in the `^` overflow until you pin it) shows who controls the computer and
120
+ has the same menu as the macOS menu bar: Stop All Agent Input / Resume, the service, Start at
121
+ Sign-in, Open Logs, Uninstall and Quit. Its **Administrator Prompts** submenu chooses who
122
+ answers a UAC prompt while an agent is in control: _People Approve Each One_ (the default: each
123
+ approve waits for an allowed member's approval card), _Agent Decides_, _Always Approve_ or
124
+ _Always Deny_. It is the same setting as the console's usage policy, and either place changes
125
+ it for both. A prompt that asks for an administrator's password is left to you. Apps the agent
126
+ launches start as you, not as SYSTEM.
127
+
128
+ The daemon listens on `127.0.0.1` only. To reach it from another machine, run
110
129
  `.\install.ps1 -ListenHost 0.0.0.0` instead: `setup` saves the address and adds the inbound
111
- firewall rule, which a loopback-only install skips.
130
+ firewall rule for the service's `node.exe`, which a loopback-only install skips.
112
131
 
113
- `run` is a plain foreground process: `Ctrl+C` stops it and closes the port. Keep the console
114
- window open: it is the indicator and emergency stop. Running `node agentconnect-computer.mjs run`
115
- straight from the copied `bundle/` folder also works; it does the downloads itself but skips the
116
- firewall step.
132
+ `service start | stop | restart | status` work without another approval; `service uninstall`
133
+ asks once and keeps the data unless you add `--purge`. With `setup --no-service` nothing is
134
+ installed: run the daemon in a console (`run`, `Ctrl+C` stops it), optionally started at logon by
135
+ a per-user `HKCU\...\Run` entry (`install.ps1 -Autostart`, `autostart disable` removes it). Such a
136
+ daemon cannot answer UAC prompts.
117
137
 
118
- Nothing is installed as a service. With `-Autostart`, `install.ps1` also adds a per-user
119
- `HKCU\...\Run` entry that opens the daemon console at logon (`autostart disable` removes it). A real
120
- Windows service would not work anyway: services live in Session 0 and cannot see the user desktop.
121
-
122
- To start over (new token), delete `%LOCALAPPDATA%\AgentConnect\computer\config.json`, or run
123
- `node agentconnect-computer.mjs token add claude` to rotate the token.
138
+ To rotate the token, run `node agentconnect-computer.mjs token add claude` (it asks for approval
139
+ once the service holds the config).
124
140
 
125
141
  ## Run on macOS
126
142
 
@@ -360,8 +376,8 @@ so it never reaches the server or proxy logs, and the page keeps it in `localSto
360
376
  WebRTC DataChannel to Cua Driver's desktop-scope input. A Mac's Cmd shortcuts map to Ctrl on
361
377
  Windows. Use the text box for IME / pasted text. Viewer actions are audited as `viewer_*`
362
378
  (pointer moves are not).
363
- - Limits: the UAC secure desktop and the lock screen cannot be captured or controlled from
364
- the user session. `gdigrab` captures the whole virtual desktop, so with several monitors input
379
+ - Limits: the secure desktop (UAC prompts, the lock screen) cannot be captured; a waiting UAC
380
+ prompt is described in words instead, and agents answer it with `computer_admin_prompt`. `gdigrab` captures the whole virtual desktop, so with several monitors input
365
381
  mapping is only right when `ddagrab` (primary display) works. There is no audio and no
366
382
  clipboard sync.
367
383
 
@@ -380,6 +396,7 @@ so it never reaches the server or proxy logs, and the page keeps it in `localSto
380
396
  | `computer_launch` | yes | `{app}` name, or `.exe` path on Windows |
381
397
  | `computer_wait` | no | `{ms}` ≤ 10000, then screenshot |
382
398
  | `computer_acquire` / `computer_release` | — | explicit lease control |
399
+ | `computer_admin_prompt` | yes | Windows: approve or deny the waiting UAC prompt, as its Administrator Prompts setting allows |
383
400
 
384
401
  Coordinates are pixels of the latest screenshot; Cua Driver maps them back to the
385
402
  screen. Input tools return a screenshot taken `actionSettleMs` after the action.
@@ -451,8 +468,8 @@ agentconnect-computer stdio [--expose-driver-tools]
451
468
  agentconnect-computer token add NAME | token list | token remove NAME
452
469
  agentconnect-computer status | pause | resume
453
470
  agentconnect-computer doctor [--here] [--json] (read-only checks; exit 1 on failure)
454
- agentconnect-computer service install|uninstall|start|stop|restart|status (macOS .app LaunchAgent, Linux systemd user unit)
455
- agentconnect-computer autostart enable | disable | start (Windows)
471
+ agentconnect-computer service install|uninstall|start|stop|restart|status (macOS .app LaunchAgent, Linux systemd user unit, Windows service)
472
+ agentconnect-computer autostart enable | disable | start (Windows without the service)
456
473
  ```
457
474
 
458
475
  With the AgentConnect CLI installed, every command also runs as `agentconnect computer <command>`
@@ -463,7 +480,7 @@ the data dir, where the bundle's install scripts put it; `AGENTCONNECT_COMPUTER_
463
480
  development build instead. See
464
481
  [cli-daemon-split.md §1.2](../../docs/designs/cli-daemon-split.md#12-computer-desktop-daemon).
465
482
 
466
- Data dir: `%LOCALAPPDATA%\AgentConnect\computer` on Windows, `~/.agentconnect/computer`
483
+ Data dir: `%ProgramData%\AgentConnect\computer` under the Windows service (else `%LOCALAPPDATA%\AgentConnect\computer`), `~/.agentconnect/computer`
467
484
  elsewhere (`AGENTCONNECT_COMPUTER_HOME` overrides). `config.json` also holds
468
485
  `maxImageDimension`, `leaseIdleSeconds`, `leaseMaxSeconds`, `humanIdleSeconds`,
469
486
  `actionScreenshot`, `actionSettleMs`, `allowSystemKeys`, `stopHotkey`, `exposeDriverTools`,