@skillful-agents/agent-computer 0.0.3

package/README.md

@@ -0,0 +1,458 @@
+# agent-computer — Agent Computer
+
+Native macOS desktop automation CLI for AI agents. Control any app through the accessibility tree.
+
+Built for the **snapshot → act** loop: take a snapshot of any app's UI, get typed refs (`@b1`, `@t2`), then click, type, and navigate — all from the command line or TypeScript SDK.
+
+## Why agent-computer?
+
+- **Works with any macOS app** — native apps (TextEdit, Safari, Finder) have rich accessibility trees; Electron apps work too with automatic detection and guidance
+- **Typed refs** — snapshot returns prefixed refs: `@b3` (button), `@t5` (text field), `@c1` (checkbox) — easy for LLMs to reason about
+- **Short commands** — agents generate these token-by-token; fewer tokens = cheaper + faster
+- **Fast** — persistent daemon with ~5ms per command over Unix domain socket
+- **Auto-focus** — keyboard commands auto-switch to the grabbed app and restore your previous window
+
+## Installation
+
+```bash
+npm install -g @skillful-agents/agent-computer
+```
+
+Or as a project dependency:
+
+```bash
+npm install @skillful-agents/agent-computer
+```
+
+### Requirements
+
+- macOS 13+ (Ventura or later)
+- Node.js 20+
+- **Accessibility permission** must be granted to your terminal app
+
+### Permissions
+
+```bash
+agent-computer permissions          # check permission status
+agent-computer permissions grant    # opens System Settings
+```
+
+Grant **Accessibility** access to your terminal (Terminal.app, iTerm2, Ghostty, etc.) in System Settings → Privacy & Security → Accessibility. Screen Recording permission is needed for screenshots.
+
+## Quick Start
+
+```bash
+# 1. See what's running
+agent-computer apps
+
+# 2. Pick a window
+agent-computer windows
+agent-computer grab @w1
+
+# 3. Snapshot the UI (interactive elements only)
+agent-computer snapshot -i
+
+# 4. Interact using refs from the snapshot
+agent-computer click @b3
+agent-computer fill @t1 "Hello, world!"
+agent-computer key cmd+s
+
+# 5. Take a screenshot to see the result
+agent-computer screenshot
+
+# 6. Release the window
+agent-computer ungrab
+```
+
+## Core Workflow
+
+The fundamental loop for AI agents:
+
+```
+agent-computer snapshot -i  →  read refs  →  agent-computer click @b1  →  agent-computer snapshot -i  →  ...
+```
+
+1. **Observe** — `agent-computer snapshot -i` returns the accessibility tree with typed refs
+2. **Act** — `agent-computer click @b1`, `agent-computer fill @t2 "text"`, `agent-computer key cmd+s`
+3. **Verify** — `agent-computer snapshot -i` again, or `agent-computer screenshot` for visual confirmation
+
+## Command Reference
+
+### Snapshot & Observation
+
+| Command | Description |
+|---------|-------------|
+| `agent-computer snapshot` | Full accessibility tree of the active window |
+| `agent-computer snapshot -i` | Interactive elements only (buttons, fields, etc.) |
+| `agent-computer snapshot -c` | Compact flat list |
+| `agent-computer snapshot -d 3` | Limit tree depth |
+| `agent-computer snapshot --app Safari` | Target a specific app |
+| `agent-computer screenshot` | Take a screenshot (PNG) |
+| `agent-computer screenshot /tmp/shot.png` | Save to specific path |
+| `agent-computer find "Save"` | Find elements by text |
+| `agent-computer find --role button` | Find elements by role |
+| `agent-computer read @t1` | Read an element's value |
+
+### Click & Mouse
+
+| Command | Description |
+|---------|-------------|
+| `agent-computer click @b1` | Click an element by ref |
+| `agent-computer click 500,300` | Click at screen coordinates |
+| `agent-computer click @b1 --right` | Right-click |
+| `agent-computer click @b1 --double` | Double-click |
+| `agent-computer hover @b1` | Move mouse to element |
+| `agent-computer drag @b1 @b2` | Drag from one element to another |
+| `agent-computer drag --from-x 100 --from-y 200 --to-x 300 --to-y 400` | Drag by coordinates |
+
+### Keyboard & Text
+
+| Command | Description |
+|---------|-------------|
+| `agent-computer type "Hello"` | Type text into the focused element |
+| `agent-computer fill @t1 "text"` | Focus, clear, and set text on an element |
+| `agent-computer key cmd+a` | Press a key combination |
+| `agent-computer key cmd+c` | Copy |
+| `agent-computer key enter` | Press Enter |
+| `agent-computer paste "text"` | Paste text via clipboard |
+
+> **Auto-focus:** When a window is grabbed, `key`, `type`, `keydown`, `keyup`, and `paste` automatically switch to the grabbed app, perform the action, then switch back to your previous window.
+
+### Apps & Windows
+
+| Command | Description |
+|---------|-------------|
+| `agent-computer apps` | List running applications |
+| `agent-computer launch TextEdit --wait` | Launch an app and wait for it to be ready |
+| `agent-computer quit TextEdit` | Quit an app |
+| `agent-computer switch Safari` | Bring an app to the foreground |
+| `agent-computer windows` | List all windows with refs |
+| `agent-computer grab @w1` | Lock onto a window for subsequent commands |
+| `agent-computer grab --app TextEdit` | Grab the first window of an app |
+| `agent-computer ungrab` | Release the grabbed window |
+
+### Window Management
+
+| Command | Description |
+|---------|-------------|
+| `agent-computer minimize` | Minimize the grabbed window |
+| `agent-computer maximize` | Maximize (zoom) the grabbed window |
+| `agent-computer fullscreen` | Toggle fullscreen |
+| `agent-computer close` | Close the grabbed window |
+| `agent-computer raise` | Bring window to front |
+| `agent-computer move --x 100 --y 200` | Move window |
+| `agent-computer resize --width 800 --height 600` | Resize window |
+| `agent-computer bounds --preset left-half` | Snap to preset (left-half, right-half, fill, center) |
+
+### Menus
+
+| Command | Description |
+|---------|-------------|
+| `agent-computer menu list` | List top-level menus |
+| `agent-computer menu list Edit` | List items in a menu |
+| `agent-computer menu "Edit > Select All"` | Click a menu item by path |
+| `agent-computer menu "Format > Font > Bold"` | Navigate nested menus |
+
+### Scroll & Focus
+
+| Command | Description |
+|---------|-------------|
+| `agent-computer scroll down` | Scroll down (3 ticks) |
+| `agent-computer scroll up 10` | Scroll up 10 ticks |
+| `agent-computer scroll down --on @sa1` | Scroll within a specific element |
+| `agent-computer scroll down --smooth` | Smooth animated scroll |
+| `agent-computer focus @t1` | Focus an element |
+| `agent-computer check @c1` | Check a checkbox |
+| `agent-computer uncheck @c1` | Uncheck a checkbox |
+| `agent-computer select @d1 --value "Option"` | Select a dropdown value |
+
+### Clipboard
+
+| Command | Description |
+|---------|-------------|
+| `agent-computer clipboard` | Read clipboard contents |
+| `agent-computer clipboard set "text"` | Set clipboard contents |
+
+### Dialogs & Alerts
+
+| Command | Description |
+|---------|-------------|
+| `agent-computer dialog` | Detect if a dialog/alert is visible |
+| `agent-computer dialog accept` | Click OK/Save on the dialog |
+| `agent-computer dialog cancel` | Dismiss the dialog |
+| `agent-computer dialog file /tmp/doc.txt` | Set filename in a file save dialog |
+
+### Wait
+
+| Command | Description |
+|---------|-------------|
+| `agent-computer wait 2000` | Wait for 2 seconds |
+| `agent-computer wait --app TextEdit` | Wait for an app to launch |
+| `agent-computer wait --text "Loading complete"` | Wait for text to appear |
+| `agent-computer wait --text "Loading" --gone` | Wait for text to disappear |
+
+### Batch & Diff
+
+| Command | Description |
+|---------|-------------|
+| `agent-computer batch '[["click","@b1"],["key","enter"]]'` | Execute commands sequentially |
+| `agent-computer changed` | Check if UI changed since last snapshot |
+| `agent-computer diff` | Get added/removed elements since last snapshot |
+
+### System
+
+| Command | Description |
+|---------|-------------|
+| `agent-computer status` | Show session state (grabbed window, daemon info) |
+| `agent-computer daemon start\|stop\|restart\|status` | Manage the background daemon |
+| `agent-computer permissions` | Check accessibility/screen recording permissions |
+| `agent-computer doctor` | Run diagnostics |
+| `agent-computer displays` | List connected displays |
+| `agent-computer version` | Print version |
+
+## Ref System
+
+Snapshots assign typed refs based on element role:
+
+| Prefix | Role | Example |
+|--------|------|---------|
+| `@b` | Button | `@b1`, `@b2` |
+| `@t` | Text field | `@t1` |
+| `@l` | Link | `@l1` |
+| `@c` | Checkbox | `@c1` |
+| `@r` | Radio button | `@r1` |
+| `@s` | Slider | `@s1` |
+| `@d` | Dropdown | `@d1` |
+| `@i` | Image | `@i1` |
+| `@g` | Group | `@g1` |
+| `@w` | Window | `@w1` |
+| `@m` | Menu item | `@m1` |
+| `@sa` | Scroll area | `@sa1` |
+| `@cb` | Combo box | `@cb1` |
+| `@x` | Generic | `@x1` |
+
+Refs are stable within a snapshot but re-assigned on each new snapshot.
+
+## Global Options
+
+| Flag | Description |
+|------|-------------|
+| `--json` | JSON output (default is human-readable text) |
+| `--timeout <ms>` | Override default timeout (default: 10000) |
+| `--verbose` | Debug logging to stderr |
+| `--content-boundary` | Wrap output in delimiters for LLM safety |
+| `--max-output <n>` | Truncate output to N characters |
+| `--app <name>` | Target a specific app (for snapshot, find, menu, etc.) |
+
+### Environment Variables
+
+| Variable | Description |
+|----------|-------------|
+| `AC_JSON` | Set to `1` for JSON output |
+| `AC_VERBOSE` | Set to `1` for debug logging |
+
+## TypeScript SDK
+
+Use `agent-computer` programmatically from Node.js:
+
+```typescript
+import { AC } from '@skillful-agents/agent-computer';
+
+const ac = new AC();
+
+// Launch and interact with TextEdit
+await ac.launch('TextEdit', { wait: true });
+await ac.grab('TextEdit');
+
+const snap = await ac.snapshot({ interactive: true });
+const textarea = snap.elements.find(e => e.role === 'textarea');
+
+if (textarea) {
+  await ac.fill(textarea.ref, 'Hello from the SDK!');
+  await ac.key('cmd+a');
+  await ac.menuClick('Format > Font > Bold', 'TextEdit');
+}
+
+await ac.screenshot({ path: '/tmp/result.png' });
+await ac.quit('TextEdit');
+await ac.disconnect();
+```
+
+### SDK Methods
+
+The `AC` class provides typed methods for every CLI command:
+
+```typescript
+// Observation
+await ac.snapshot({ interactive: true, app: 'Safari' });
+await ac.find('Submit', { role: 'button' });
+await ac.read('@t1');
+await ac.is('enabled', '@b1');
+
+// Actions
+await ac.click('@b1');
+await ac.clickAt(500, 300);
+await ac.fill('@t1', 'text');
+await ac.key('cmd+s');
+await ac.scroll('down', { amount: 5 });
+await ac.drag('@b1', '@b2');
+
+// Menus
+await ac.menuClick('File > Save');
+await ac.menuList('Edit');
+
+// Apps & Windows
+await ac.launch('Calculator', { wait: true });
+await ac.grab('Calculator');
+await ac.windows();
+await ac.ungrab();
+
+// Dialogs
+const dialog = await ac.dialog();
+if (dialog.found) await ac.dialogAccept();
+
+// Wait
+await ac.waitForText('Loading complete', { timeout: 10000 });
+await ac.waitForApp('Safari');
+
+// Batch
+await ac.batch([['click', '@b1'], ['key', 'enter']]);
+
+// Diff
+const { changed } = await ac.changed();
+```
+
+## Architecture
+
+```
+┌─────────────────────────────────────────────┐
+│  CLI (bin/ac.ts)  or  SDK (AC class)           │
+├─────────────────────────────────────────────┤
+│  Bridge — JSON-RPC 2.0 over Unix socket     │
+├─────────────────────────────────────────────┤
+│  Daemon (ac-core) — persistent Swift binary │
+│  ┌─────────┬──────────┬──────────┐          │
+│  │ AX Tree │ CGEvent  │ Screen   │          │
+│  │ Walking │ Input    │ Capture  │          │
+│  └─────────┴──────────┴──────────┘          │
+├─────────────────────────────────────────────┤
+│  macOS Accessibility + CoreGraphics APIs     │
+└─────────────────────────────────────────────┘
+```
+
+- **CLI/SDK** — TypeScript, parses commands, manages daemon lifecycle
+- **Bridge** — JSON-RPC 2.0 over Unix domain socket, auto-starts daemon
+- **Daemon** — Native Swift binary, stays running (~5ms per command vs ~80ms one-shot)
+- **Native APIs** — AXUIElement for accessibility tree, CGEvent for input, screencapture for screenshots
+
+## Chromium/Electron Apps
+
+Electron apps (Spotify, Slack, VS Code, Discord) have limited accessibility trees. `agent-computer` automatically detects Chromium-based apps and shows a warning:
+
+```
+⚠️  This is a Chromium/Electron app. The accessibility tree may be limited.
+    Consider using keyboard shortcuts, coordinate-based clicks (agent-computer click x,y),
+    or screenshots for navigation.
+```
+
+For Electron apps, prefer:
+- **Keyboard shortcuts** — `agent-computer key cmd+f`, `agent-computer key space`
+- **Coordinate clicks** — `agent-computer screenshot` to find positions, then `agent-computer click 500,300`
+- **Paste** — `agent-computer paste "text"` instead of `agent-computer fill`
+
+## Human-Like Mode
+
+For automation that needs to appear more natural:
+
+```bash
+# Curved mouse movement (Bezier path)
+agent-computer human_move --x 500 --y 300
+
+# Variable-cadence typing
+agent-computer human_type --text "Hello there" --delay 50
+
+# Click with slight positional jitter
+agent-computer human_click --ref @b1
+```
+
+## Examples
+
+### Fill a form in Safari
+
+```bash
+agent-computer launch Safari --wait
+agent-computer grab --app Safari
+agent-computer snapshot -i
+agent-computer fill @t1 "https://example.com"
+agent-computer key enter
+agent-computer wait --text "Example Domain"
+agent-computer snapshot -i
+agent-computer screenshot /tmp/page.png
+agent-computer ungrab
+```
+
+### Calculator arithmetic
+
+```bash
+agent-computer launch Calculator --wait
+agent-computer grab --app Calculator
+agent-computer snapshot -i
+agent-computer click @b7      # 7
+agent-computer click @b12     # +
+agent-computer click @b3      # 3
+agent-computer click @b15     # =
+agent-computer snapshot -i    # read the display
+agent-computer quit Calculator
+```
+
+### Cross-app copy/paste
+
+```bash
+agent-computer launch TextEdit --wait
+agent-computer grab --app TextEdit
+agent-computer snapshot -i
+agent-computer fill @t1 "Transfer this text"
+agent-computer key cmd+a
+agent-computer key cmd+c
+agent-computer launch Notes --wait
+agent-computer grab --app Notes
+agent-computer key cmd+v
+agent-computer snapshot -i
+```
+
+### Batch operations
+
+```bash
+agent-computer batch '[["clipboard_set", {"text": "Hello"}], ["clipboard_read"]]'
+```
+
+## Troubleshooting
+
+### "Accessibility permission not granted"
+
+Open System Settings → Privacy & Security → Accessibility and add your terminal app.
+
+### Daemon not starting
+
+```bash
+agent-computer daemon status    # check if running
+agent-computer daemon restart   # restart
+agent-computer doctor           # full diagnostics
+```
+
+### Stale refs
+
+Refs are re-assigned on each snapshot. If you get "Element not found", take a new snapshot:
+
+```bash
+agent-computer snapshot -i      # get fresh refs
+agent-computer click @b1        # now use the new refs
+```
+
+## License
+
+MIT
+
+## Credits
+
+Inspired by [agent-browser](https://github.com/anthropics/agent-browser) and [Peekaboo](https://github.com/steipete/Peekaboo).

package/dist/bin/ac.d.ts

@@ -0,0 +1,3 @@
+#!/usr/bin/env node
+export {};
+//# sourceMappingURL=ac.d.ts.map

package/dist/bin/ac.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"ac.d.ts","sourceRoot":"","sources":["../../bin/ac.ts"],"names":[],"mappings":""}

package/dist/bin/ac.js

@@ -0,0 +1,126 @@
+#!/usr/bin/env node
+import { parseArgs } from '../src/cli/parser.js';
+import { getCommand, getCommandAsync } from '../src/cli/commands.js';
+import { formatOutput, wrapBoundary, truncateOutput } from '../src/cli/output.js';
+import { Bridge } from '../src/bridge.js';
+import { ACError } from '../src/errors.js';
+import { resolveConfig } from '../src/config.js';
+async function main() {
+    const parsed = parseArgs(process.argv);
+    const config = resolveConfig();
+    // Resolve global options
+    const jsonMode = parsed.flags['json'] === true || process.env.AC_JSON === '1';
+    const textMode = !jsonMode;
+    const verbose = parsed.flags['verbose'] === true || process.env.AC_VERBOSE === '1';
+    const contentBoundary = parsed.flags['content-boundary'] === true || config['content-boundary'];
+    const maxOutput = typeof parsed.flags['max-output'] === 'string'
+        ? parseInt(parsed.flags['max-output'], 10)
+        : undefined;
+    const timeout = typeof parsed.flags['timeout'] === 'string'
+        ? parseInt(parsed.flags['timeout'], 10)
+        : config['default-timeout'];
+    if (verbose) {
+        process.env.AC_VERBOSE = '1';
+    }
+    // Special case: help outputs plain text
+    if (parsed.command === 'help') {
+        const handler = getCommand('help');
+        const result = await handler(parsed, null);
+        console.log(result.data);
+        process.exit(0);
+    }
+    // Find command handler
+    const handler = await getCommandAsync(parsed.command);
+    if (!handler) {
+        // Try sending as a raw method to the daemon
+        const bridge = new Bridge({ timeout });
+        try {
+            const result = await bridge.send(parsed.command, buildParamsFromArgs(parsed));
+            output(result, textMode, contentBoundary, maxOutput);
+            await bridge.disconnect();
+            process.exit(0);
+        }
+        catch (err) {
+            if (err instanceof ACError) {
+                outputError(err, textMode);
+                await bridge.disconnect();
+                process.exit(err.exitCode);
+            }
+            console.error(`Unknown command: ${parsed.command}. Run 'agent-computer --help' for usage.`);
+            await bridge.disconnect();
+            process.exit(126);
+        }
+    }
+    // Execute command
+    const bridge = new Bridge({ timeout });
+    try {
+        const result = await handler(parsed, bridge);
+        // Show hint (e.g., Chromium app warning) on stderr
+        if (result.data && typeof result.data === 'object' && 'hint' in result.data) {
+            const hint = result.data.hint;
+            process.stderr.write(`\n⚠️  ${hint}\n\n`);
+        }
+        output(result.data, textMode, contentBoundary, maxOutput);
+        await bridge.disconnect();
+        process.exit(result.exitCode);
+    }
+    catch (err) {
+        if (err instanceof ACError) {
+            outputError(err, textMode);
+            await bridge.disconnect();
+            process.exit(err.exitCode);
+        }
+        const message = err instanceof Error ? err.message : String(err);
+        console.error(textMode ? `Error: ${message}` : JSON.stringify({ error: message }));
+        await bridge.disconnect();
+        process.exit(126);
+    }
+}
+function output(data, textMode, boundary, maxOutput) {
+    let out;
+    if (typeof data === 'string') {
+        out = data;
+    }
+    else {
+        out = formatOutput(data, textMode);
+    }
+    if (maxOutput) {
+        out = truncateOutput(out, maxOutput);
+    }
+    if (boundary) {
+        out = wrapBoundary(out);
+    }
+    console.log(out);
+}
+function outputError(err, textMode) {
+    if (textMode) {
+        console.error(`Error [${err.name}]: ${err.message}`);
+    }
+    else {
+        console.error(JSON.stringify({
+            error: {
+                code: err.code,
+                name: err.name,
+                message: err.message,
+                data: err.data,
+            },
+        }));
+    }
+}
+function buildParamsFromArgs(parsed) {
+    const params = { ...parsed.flags };
+    if (parsed.positional.length > 0) {
+        params._positional = parsed.positional;
+        // Common pattern: first positional is a ref or selector
+        params.ref = parsed.positional[0];
+    }
+    if (parsed.subcommand) {
+        params._subcommand = parsed.subcommand;
+    }
+    return params;
+}
+main().catch((err) => {
+    console.error(err);
+    process.exit(126);
+});
+//# sourceMappingURL=ac.js.map

package/dist/bin/ac.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"ac.js","sourceRoot":"","sources":["../../bin/ac.ts"],"names":[],"mappings":";AAEA,OAAO,EAAE,SAAS,EAAmB,MAAM,sBAAsB,CAAC;AAClE,OAAO,EAAE,UAAU,EAAE,eAAe,EAAE,MAAM,wBAAwB,CAAC;AACrE,OAAO,EAAE,YAAY,EAAE,YAAY,EAAE,cAAc,EAAE,MAAM,sBAAsB,CAAC;AAClF,OAAO,EAAE,MAAM,EAAE,MAAM,kBAAkB,CAAC;AAC1C,OAAO,EAAE,OAAO,EAAE,MAAM,kBAAkB,CAAC;AAC3C,OAAO,EAAE,aAAa,EAAE,MAAM,kBAAkB,CAAC;AAEjD,KAAK,UAAU,IAAI;IACjB,MAAM,MAAM,GAAG,SAAS,CAAC,OAAO,CAAC,IAAI,CAAC,CAAC;IACvC,MAAM,MAAM,GAAG,aAAa,EAAE,CAAC;IAE/B,yBAAyB;IACzB,MAAM,QAAQ,GAAG,MAAM,CAAC,KAAK,CAAC,MAAM,CAAC,KAAK,IAAI,IAAI,OAAO,CAAC,GAAG,CAAC,OAAO,KAAK,GAAG,CAAC;IAC9E,MAAM,QAAQ,GAAG,CAAC,QAAQ,CAAC;IAC3B,MAAM,OAAO,GAAG,MAAM,CAAC,KAAK,CAAC,SAAS,CAAC,KAAK,IAAI,IAAI,OAAO,CAAC,GAAG,CAAC,UAAU,KAAK,GAAG,CAAC;IACnF,MAAM,eAAe,GAAG,MAAM,CAAC,KAAK,CAAC,kBAAkB,CAAC,KAAK,IAAI,IAAI,MAAM,CAAC,kBAAkB,CAAC,CAAC;IAChG,MAAM,SAAS,GAAG,OAAO,MAAM,CAAC,KAAK,CAAC,YAAY,CAAC,KAAK,QAAQ;QAC9D,CAAC,CAAC,QAAQ,CAAC,MAAM,CAAC,KAAK,CAAC,YAAY,CAAC,EAAE,EAAE,CAAC;QAC1C,CAAC,CAAC,SAAS,CAAC;IACd,MAAM,OAAO,GAAG,OAAO,MAAM,CAAC,KAAK,CAAC,SAAS,CAAC,KAAK,QAAQ;QACzD,CAAC,CAAC,QAAQ,CAAC,MAAM,CAAC,KAAK,CAAC,SAAS,CAAC,EAAE,EAAE,CAAC;QACvC,CAAC,CAAC,MAAM,CAAC,iBAAiB,CAAC,CAAC;IAE9B,IAAI,OAAO,EAAE,CAAC;QACZ,OAAO,CAAC,GAAG,CAAC,UAAU,GAAG,GAAG,CAAC;IAC/B,CAAC;IAED,wCAAwC;IACxC,IAAI,MAAM,CAAC,OAAO,KAAK,MAAM,EAAE,CAAC;QAC9B,MAAM,OAAO,GAAG,UAAU,CAAC,MAAM,CAAE,CAAC;QACpC,MAAM,MAAM,GAAG,MAAM,OAAO,CAAC,MAAM,EAAE,IAAW,CAAC,CAAC;QAClD,OAAO,CAAC,GAAG,CAAC,MAAM,CAAC,IAAI,CAAC,CAAC;QACzB,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;IAClB,CAAC;IAED,uBAAuB;IACvB,MAAM,OAAO,GAAG,MAAM,eAAe,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC;IACtD,IAAI,CAAC,OAAO,EAAE,CAAC;QACb,4CAA4C;QAC5C,MAAM,MAAM,GAAG,IAAI,MAAM,CAAC,EAAE,OAAO,EAAE,CAAC,CAAC;QACvC,IAAI,CAAC;YACH,MAAM,MAAM,GAAG,MAAM,MAAM,CAAC,IAAI,CAAC,MAAM,CAAC,OAAO,EAAE,mBAAmB,CAAC,MAAM,CAAC,CAAC,CAAC;YAC9E,MAAM,CAAC,MAAM,EAAE,QAAQ,EAAE,eAAe,EAAE,SAAS,CAAC,CAAC;YACrD,MAAM,MAAM,CAAC,UAAU,EAAE,CAAC;YAC1B,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;QAClB,CAAC;QAAC,OAAO,GAAG,EAAE,CAAC;YACb,IAAI,GAAG,YAAY,OAAO,EAAE,CAAC;gBAC3B,WAAW,CAAC,GAAG,EAAE,QAAQ,CAAC,CAAC;gBAC3B,MAAM,MAAM,CAAC,UAAU,EAAE,CAAC;gBAC1B,OAAO,CAAC,IAAI,CAAC,GAAG,CAAC,QAAQ,CAAC,CAAC;YAC7B,CAAC;YACD,OAAO,CAAC,KAAK,CAAC,oBAAoB,MAAM,CAAC,OAAO,0CAA0C,CAAC,CAAC;YAC5F,MAAM,MAAM,CAAC,UAAU,EAAE,CAAC;YAC1B,OAAO,CAAC,IAAI,CAAC,GAAG,CAAC,CAAC;QACpB,CAAC;IACH,CAAC;IAED,kBAAkB;IAClB,MAAM,MAAM,GAAG,IAAI,MAAM,CAAC,EAAE,OAAO,EAAE,CAAC,CAAC;IACvC,IAAI,CAAC;QACH,MAAM,MAAM,GAAG,MAAM,OAAO,CAAC,MAAM,EAAE,MAAM,CAAC,CAAC;QAC7C,mDAAmD;QACnD,IAAI,MAAM,CAAC,IAAI,IAAI,OAAO,MAAM,CAAC,IAAI,KAAK,QAAQ,IAAI,MAAM,IAAK,MAAM,CAAC,IAAgC,EAAE,CAAC;YACzG,MAAM,IAAI,GAAI,MAAM,CAAC,IAAgC,CAAC,IAAI,CAAC;YAC3D,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,SAAS,IAAI,MAAM,CAAC,CAAC;QAC5C,CAAC;QACD,MAAM,CAAC,MAAM,CAAC,IAAI,EAAE,QAAQ,EAAE,eAAe,EAAE,SAAS,CAAC,CAAC;QAC1D,MAAM,MAAM,CAAC,UAAU,EAAE,CAAC;QAC1B,OAAO,CAAC,IAAI,CAAC,MAAM,CAAC,QAAQ,CAAC,CAAC;IAChC,CAAC;IAAC,OAAO,GAAG,EAAE,CAAC;QACb,IAAI,GAAG,YAAY,OAAO,EAAE,CAAC;YAC3B,WAAW,CAAC,GAAG,EAAE,QAAQ,CAAC,CAAC;YAC3B,MAAM,MAAM,CAAC,UAAU,EAAE,CAAC;YAC1B,OAAO,CAAC,IAAI,CAAC,GAAG,CAAC,QAAQ,CAAC,CAAC;QAC7B,CAAC;QACD,MAAM,OAAO,GAAG,GAAG,YAAY,KAAK,CAAC,CAAC,CAAC,GAAG,CAAC,OAAO,CAAC,CAAC,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC;QACjE,OAAO,CAAC,KAAK,CAAC,QAAQ,CAAC,CAAC,CAAC,UAAU,OAAO,EAAE,CAAC,CAAC,CAAC,IAAI,CAAC,SAAS,CAAC,EAAE,KAAK,EAAE,OAAO,EAAE,CAAC,CAAC,CAAC;QACnF,MAAM,MAAM,CAAC,UAAU,EAAE,CAAC;QAC1B,OAAO,CAAC,IAAI,CAAC,GAAG,CAAC,CAAC;IACpB,CAAC;AACH,CAAC;AAED,SAAS,MAAM,CAAC,IAAa,EAAE,QAAiB,EAAE,QAAiB,EAAE,SAAkB;IACrF,IAAI,GAAW,CAAC;IAChB,IAAI,OAAO,IAAI,KAAK,QAAQ,EAAE,CAAC;QAC7B,GAAG,GAAG,IAAI,CAAC;IACb,CAAC;SAAM,CAAC;QACN,GAAG,GAAG,YAAY,CAAC,IAAI,EAAE,QAAQ,CAAC,CAAC;IACrC,CAAC;IAED,IAAI,SAAS,EAAE,CAAC;QACd,GAAG,GAAG,cAAc,CAAC,GAAG,EAAE,SAAS,CAAC,CAAC;IACvC,CAAC;IAED,IAAI,QAAQ,EAAE,CAAC;QACb,GAAG,GAAG,YAAY,CAAC,GAAG,CAAC,CAAC;IAC1B,CAAC;IAED,OAAO,CAAC,GAAG,CAAC,GAAG,CAAC,CAAC;AACnB,CAAC;AAED,SAAS,WAAW,CAAC,GAAY,EAAE,QAAiB;IAClD,IAAI,QAAQ,EAAE,CAAC;QACb,OAAO,CAAC,KAAK,CAAC,UAAU,GAAG,CAAC,IAAI,MAAM,GAAG,CAAC,OAAO,EAAE,CAAC,CAAC;IACvD,CAAC;SAAM,CAAC;QACN,OAAO,CAAC,KAAK,CAAC,IAAI,CAAC,SAAS,CAAC;YAC3B,KAAK,EAAE;gBACL,IAAI,EAAE,GAAG,CAAC,IAAI;gBACd,IAAI,EAAE,GAAG,CAAC,IAAI;gBACd,OAAO,EAAE,GAAG,CAAC,OAAO;gBACpB,IAAI,EAAE,GAAG,CAAC,IAAI;aACf;SACF,CAAC,CAAC,CAAC;IACN,CAAC;AACH,CAAC;AAED,SAAS,mBAAmB,CAAC,MAAkB;IAC7C,MAAM,MAAM,GAA4B,EAAE,GAAG,MAAM,CAAC,KAAK,EAAE,CAAC;IAC5D,IAAI,MAAM,CAAC,UAAU,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;QACjC,MAAM,CAAC,WAAW,GAAG,MAAM,CAAC,UAAU,CAAC;QACvC,wDAAwD;QACxD,MAAM,CAAC,GAAG,GAAG,MAAM,CAAC,UAAU,CAAC,CAAC,CAAC,CAAC;IACpC,CAAC;IACD,IAAI,MAAM,CAAC,UAAU,EAAE,CAAC;QACtB,MAAM,CAAC,WAAW,GAAG,MAAM,CAAC,UAAU,CAAC;IACzC,CAAC;IACD,OAAO,MAAM,CAAC;AAChB,CAAC;AAED,IAAI,EAAE,CAAC,KAAK,CAAC,CAAC,GAAG,EAAE,EAAE;IACnB,OAAO,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC;IACnB,OAAO,CAAC,IAAI,CAAC,GAAG,CAAC,CAAC;AACpB,CAAC,CAAC,CAAC"}

package/dist/src/bridge.d.ts

@@ -0,0 +1,69 @@
+export interface RPCRequest {
+    jsonrpc: '2.0';
+    id: number;
+    method: string;
+    params: Record<string, unknown>;
+}
+export interface RPCResponse {
+    jsonrpc: '2.0';
+    id: number;
+    result?: unknown;
+    error?: {
+        code: number;
+        message: string;
+        data?: Record<string, unknown>;
+    };
+}
+export declare function buildRequest(method: string, params?: Record<string, unknown>): RPCRequest;
+export declare function parseResponse(raw: unknown): unknown;
+export declare function _resetIdCounter(): void;
+export interface BridgeOptions {
+    timeout?: number;
+    binaryPath?: string;
+}
+export declare class Bridge {
+    private socket;
+    private daemonProcess;
+    private binaryPath;
+    private timeout;
+    private pendingRequests;
+    private buffer;
+    private bomChecked;
+    private cdpClients;
+    private grabbedAppInfo;
+    constructor(options?: BridgeOptions);
+    send(method: string, params?: Record<string, unknown>): Promise<unknown>;
+    sendToNative(method: string, params?: Record<string, unknown>): Promise<unknown>;
+    sendOneShot(method: string, params?: Record<string, unknown>): unknown;
+    /**
+     * Lazily detect if the currently grabbed app has CDP available.
+     * Checks live every time: asks daemon for grab state, checks if Chromium,
+     * scans port range for a live CDP endpoint.
+     */
+    private ensureCDPIfNeeded;
+    private sendToCDP;
+    private handleLaunch;
+    private handleRelaunch;
+    private handleGrab;
+    private handleUngrab;
+    private handleBatch;
+    private handleWait;
+    private flattenElements;
+    private ensureDaemon;
+    private spawnDaemon;
+    private waitForSocket;
+    private probeConnection;
+    private connectToSocket;
+    private setupSocketHandlers;
+    private processBuffer;
+    private readDaemonInfo;
+    private isProcessAlive;
+    private cleanupStaleFiles;
+    isRunning(): boolean;
+    daemonPid(): number | null;
+    disconnect(): Promise<void>;
+    shutdown(): Promise<void>;
+    _killDaemonProcess(): void;
+    _sendRawToSocket(data: string): void;
+}
+//# sourceMappingURL=bridge.d.ts.map

package/dist/src/bridge.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"bridge.d.ts","sourceRoot":"","sources":["../../src/bridge.ts"],"names":[],"mappings":"AAqBA,MAAM,WAAW,UAAU;IACzB,OAAO,EAAE,KAAK,CAAC;IACf,EAAE,EAAE,MAAM,CAAC;IACX,MAAM,EAAE,MAAM,CAAC;IACf,MAAM,EAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,CAAC;CACjC;AAED,MAAM,WAAW,WAAW;IAC1B,OAAO,EAAE,KAAK,CAAC;IACf,EAAE,EAAE,MAAM,CAAC;IACX,MAAM,CAAC,EAAE,OAAO,CAAC;IACjB,KAAK,CAAC,EAAE;QACN,IAAI,EAAE,MAAM,CAAC;QACb,OAAO,EAAE,MAAM,CAAC;QAChB,IAAI,CAAC,EAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,CAAC;KAChC,CAAC;CACH;AAED,wBAAgB,YAAY,CAAC,MAAM,EAAE,MAAM,EAAE,MAAM,GAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAM,GAAG,UAAU,CAO7F;AAED,wBAAgB,aAAa,CAAC,GAAG,EAAE,OAAO,GAAG,OAAO,CAyBnD;AAED,wBAAgB,eAAe,IAAI,IAAI,CAEtC;AAID,MAAM,WAAW,aAAa;IAC5B,OAAO,CAAC,EAAE,MAAM,CAAC;IACjB,UAAU,CAAC,EAAE,MAAM,CAAC;CACrB;AAQD,qBAAa,MAAM;IACjB,OAAO,CAAC,MAAM,CAAuB;IACrC,OAAO,CAAC,aAAa,CAA6B;IAClD,OAAO,CAAC,UAAU,CAAS;IAC3B,OAAO,CAAC,OAAO,CAAS;IACxB,OAAO,CAAC,eAAe,CAIlB;IACL,OAAO,CAAC,MAAM,CAAM;IACpB,OAAO,CAAC,UAAU,CAAS;IAG3B,OAAO,CAAC,UAAU,CAAgC;IAClD,OAAO,CAAC,cAAc,CAA6D;gBAEvE,OAAO,GAAE,aAAkB;IAMjC,IAAI,CAAC,MAAM,EAAE,MAAM,EAAE,MAAM,GAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAM,GAAG,OAAO,CAAC,OAAO,CAAC;IAkB5E,YAAY,CAAC,MAAM,EAAE,MAAM,EAAE,MAAM,GAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAM,GAAG,OAAO,CAAC,OAAO,CAAC;IA4B1F,WAAW,CAAC,MAAM,EAAE,MAAM,EAAE,MAAM,GAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAM,GAAG,OAAO;IA8B1E;;;;OAIG;YACW,iBAAiB;YAoCjB,SAAS;YAyIT,YAAY;YAyBZ,cAAc;YAgBd,UAAU;YAcV,YAAY;YAKZ,WAAW;YAuBX,UAAU;IAiCxB,OAAO,CAAC,eAAe;YAYT,YAAY;YAkCZ,WAAW;YAwBX,aAAa;IA0B3B,OAAO,CAAC,eAAe;IASvB,OAAO,CAAC,eAAe;IAwBvB,OAAO,CAAC,mBAAmB;IA+B3B,OAAO,CAAC,aAAa;IA2BrB,OAAO,CAAC,cAAc;IAUtB,OAAO,CAAC,cAAc;IAStB,OAAO,CAAC,iBAAiB;IAQzB,SAAS,IAAI,OAAO;IAIpB,SAAS,IAAI,MAAM,GAAG,IAAI;IAKpB,UAAU,IAAI,OAAO,CAAC,IAAI,CAAC;IAc3B,QAAQ,IAAI,OAAO,CAAC,IAAI,CAAC;IAmB/B,kBAAkB,IAAI,IAAI;IAY1B,gBAAgB,CAAC,IAAI,EAAE,MAAM,GAAG,IAAI;CAGrC"}