@assemblyline-agents/computer-use 2.0.0 → 3.1.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/LICENSE +1 -1
- package/README.md +14 -10
- package/package.json +3 -4
- package/skills/computer-use/SKILL.md +0 -36
package/LICENSE
CHANGED
package/README.md
CHANGED
|
@@ -22,28 +22,32 @@ relay routes opaque envelopes and cannot read tool arguments or results.
|
|
|
22
22
|
assembly-line add computer-use agent
|
|
23
23
|
```
|
|
24
24
|
|
|
25
|
-
The generated connection
|
|
25
|
+
The generated connection enables reviewed tools without requiring an approval
|
|
26
|
+
surface:
|
|
26
27
|
|
|
27
28
|
```ts
|
|
28
29
|
import { defineComputerUseConnection } from "@assemblyline-agents/computer-use";
|
|
29
30
|
|
|
30
31
|
export default defineComputerUseConnection({
|
|
31
|
-
|
|
32
|
+
// Reviewed tools are enabled by default.
|
|
32
33
|
});
|
|
33
34
|
```
|
|
34
35
|
|
|
35
|
-
|
|
36
|
+
Require approval for desktop mutations when the host provides an approval
|
|
37
|
+
surface:
|
|
36
38
|
|
|
37
39
|
```ts
|
|
38
|
-
access:
|
|
39
|
-
read: true,
|
|
40
|
-
write: { approval: "always" }
|
|
41
|
-
}
|
|
40
|
+
export default defineComputerUseConnection({ access: "approval-required" });
|
|
42
41
|
```
|
|
43
42
|
|
|
44
|
-
Use
|
|
45
|
-
|
|
46
|
-
|
|
43
|
+
Use a read-only policy to hide mutations:
|
|
44
|
+
|
|
45
|
+
```ts
|
|
46
|
+
export default defineComputerUseConnection({ access: "read-only" });
|
|
47
|
+
```
|
|
48
|
+
|
|
49
|
+
Local Computer Host policy can still require approval or deny individual
|
|
50
|
+
applications and actions independently of the connection policy.
|
|
47
51
|
|
|
48
52
|
The binding carries a raw P-256 agent private scalar and the Mac's uncompressed
|
|
49
53
|
X9.63 P-256 public key, encoded inside an opaque base64url JSON value. It must
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "@assemblyline-agents/computer-use",
|
|
3
|
-
"version": "
|
|
3
|
+
"version": "3.1.0",
|
|
4
4
|
"type": "module",
|
|
5
5
|
"exports": {
|
|
6
6
|
".": {
|
|
@@ -9,12 +9,11 @@
|
|
|
9
9
|
}
|
|
10
10
|
},
|
|
11
11
|
"dependencies": {
|
|
12
|
-
"@assemblyline-agents/core": "
|
|
12
|
+
"@assemblyline-agents/core": "3.1.0"
|
|
13
13
|
},
|
|
14
14
|
"description": "Official Assembly Line remote macOS computer-use connection plugin.",
|
|
15
15
|
"files": [
|
|
16
|
-
"dist"
|
|
17
|
-
"skills"
|
|
16
|
+
"dist"
|
|
18
17
|
],
|
|
19
18
|
"engines": {
|
|
20
19
|
"node": ">=22.19.0"
|
|
@@ -1,36 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
name: computer-use
|
|
3
|
-
description: Inspect and control a developer-paired remote Mac through the encrypted Assembly Line Computer Host connection.
|
|
4
|
-
---
|
|
5
|
-
# Assembly Line remote computer use
|
|
6
|
-
|
|
7
|
-
This connection controls a specific paired Mac through Assembly Line Computer Host.
|
|
8
|
-
The agent may be hosted remotely; the Mac host must be online, unlocked, and
|
|
9
|
-
permitted by its local policy. A device-offline, locked, expired, revoked, or
|
|
10
|
-
approval-denied response is a terminal result for that action. Do not work
|
|
11
|
-
around it by requesting shell, clipboard, screenshot, or other excluded tools.
|
|
12
|
-
|
|
13
|
-
Inspect before acting. Use `inspect_ui` to obtain an accessibility UI map and
|
|
14
|
-
stable element identifiers. Prefer identifiers, labels, `set_value`, and
|
|
15
|
-
`perform_action` over screen coordinates. Re-inspect after navigation, window
|
|
16
|
-
changes, dialogs, or any action that can invalidate UI state.
|
|
17
|
-
|
|
18
|
-
Use the narrowest action that completes the task. Confirm the intended app and
|
|
19
|
-
window before typing, clicking, invoking menus, moving windows, switching
|
|
20
|
-
Spaces, or interacting with dialogs. Never place passwords, API keys, pairing
|
|
21
|
-
bindings, recovery codes, or other credentials in tool arguments unless the
|
|
22
|
-
user has explicitly chosen a trusted local credential workflow.
|
|
23
|
-
|
|
24
|
-
The plugin exposes only accessibility inspection, app/window/menu control, and
|
|
25
|
-
direct input. Screenshot/vision, recording, nested agents, configuration,
|
|
26
|
-
cleanup, shell, clipboard/paste, and browser-specific Peekaboo tools are not
|
|
27
|
-
available in v1.
|
|
28
|
-
|
|
29
|
-
The scaffold is read-only. Desktop mutations require the developer to set:
|
|
30
|
-
|
|
31
|
-
```ts
|
|
32
|
-
write: { approval: "always" }
|
|
33
|
-
```
|
|
34
|
-
|
|
35
|
-
`write: { approval: "never" }` is appropriate only for a trusted autonomous
|
|
36
|
-
agent and a Mac account intentionally provisioned for unattended control.
|