@elizaos/plugin-browser 2.0.0-beta.1 → 2.0.11-beta.7

package/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Shaw Walters and elizaOS Contributors
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

package/README.md

@@ -1,89 +1,131 @@
 # @elizaos/plugin-browser
 
-Agent Browser Bridge plugin: schema, contracts, HTTP routes, and packaging
-utilities for Chrome/Safari browser companions.
+Browser automation and companion bridge plugin for elizaOS. Adds the `BROWSER` action and `MANAGE_BROWSER_BRIDGE` action to any Eliza agent, owns the Eliza browser workspace (electrobun-embedded `BrowserView` on desktop, JSDOM fallback on web/mobile), and manages the Chrome/Safari Agent Browser Bridge companion extension.
 
-## Scope
+## What this plugin provides
 
-This plugin owns the generic browser-companion surface:
+### Actions
 
-- Four Drizzle tables: `browser_bridge_companions`, `browser_bridge_settings`,
-  `browser_bridge_tabs`, `browser_bridge_page_contexts`.
-- `/api/browser-bridge/*` HTTP routes for pairing, settings, companion sync,
-  tab + page-context ingest, packaging artifacts, and workflow-linked session
-  progress endpoints.
-- Companion package build + download helpers, including release-manifest
-  synthesis for GitHub Releases.
-- Contract types under the `BrowserBridge*` prefix.
+**BROWSER** — Controls a registered browser target. The agent picks the best available backend automatically, or you can pin a specific target with the `target` parameter. Supported operations:
 
-The workflow-bound `life_browser_sessions` table intentionally stays in
-`@elizaos/app-lifeops` because it carries `workflowId` plus LifeOps-only
-scoping columns (`domain`, `subjectType`, `subjectId`, `visibilityScope`,
-`contextPolicy`). Session endpoints here therefore call into
-`@elizaos/app-lifeops/lifeops/service` to operate on that table.
+| `action` value | What it does |
+|---|---|
+| `open` | Open a URL in a new tab |
+| `navigate` | Navigate an existing tab to a URL |
+| `click` | Click a DOM element by CSS selector |
+| `type` | Type text into a selector |
+| `press` | Press a keyboard key |
+| `get` | Get a DOM value |
+| `state` | Return current tab state (URL, title) |
+| `snapshot` | Capture a DOM snapshot |
+| `screenshot` | Capture a screenshot |
+| `reload` | Reload the current tab |
+| `back` / `forward` | Browser history navigation |
+| `close` | Close a tab |
+| `show` / `hide` | Show or hide the browser window |
+| `wait` | Wait for a selector to appear |
+| `tab` | Tab management (list/new/close/switch) |
+| `realistic_click` | Animated cursor click (visible to user) |
+| `realistic_fill` | Animated fill with per-character delay |
+| `realistic_type` | Animated typing |
+| `realistic_press` | Animated key press |
+| `cursor_move` | Animate cursor to a position |
+| `cursor_hide` | Hide the cursor overlay |
+| `autofill_login` | Fill saved credentials into a browser tab (vault-gated; requires `domain`) |
 
-## Destructive migration
+**MANAGE_BROWSER_BRIDGE** — Manages the Chrome/Safari companion extension. Subactions: `install` (build + reveal + open manager), `reveal_folder` (open the build folder in Finder/Explorer), `open_manager` (`chrome://extensions`), `refresh` (report paired companions and settings). Owner-only.
 
-This plugin renames the four previously `life_browser_*` tables to
-`browser_bridge_*`. Because the generated Drizzle migrations will issue a
-plain `CREATE TABLE` for the new names (with no `RENAME` bridge), the first
-boot after this package lands must run with:
+### Browser targets
 
-```
-ELIZA_ALLOW_DESTRUCTIVE_MIGRATIONS=true
-```
+The plugin uses a pluggable target registry in `BrowserService`. Targets are selected automatically by availability and score:
 
-set in the environment. That flag is the existing escape valve wired into
-`@elizaos/plugin-sql`'s migrator (see `repository.ts:1389` in plugin-sql).
-Use that flag only for throwaway or explicitly approved migration runs.
+| Target ID | Backend | When available |
+|---|---|---|
+| `workspace` | Electrobun `BrowserView` (desktop) or JSDOM (web) | Always |
+| `bridge` | Paired Chrome/Safari via companion extension | At least one companion paired |
+| `stagehand` | Playwright/Stagehand via HTTP endpoint | `ELIZA_BROWSER_STAGEHAND_COMMAND_URL` or `STAGEHAND_SERVER_URL` set |
 
-## Integration
+External plugins can register additional targets by calling `BrowserService.registerTarget(target)`.
 
-Eliza loads `browserBridgePlugin` as a core runtime plugin so the Browser
-Workspace UI, agent actions, and companion extension use the same API surface.
+### Provider
 
-```ts
-import { browserBridgePlugin } from "@elizaos/plugin-browser";
+`browser_workspace` — Injects the current dispatch mode (`desktop` / `web`) and a capped list of open tabs into agent context. Active when the `browser` or `web` context is selected.
+
+### Routes
+
+`/api/browser-bridge/*` — HTTP surface for the companion extension: pairing, settings, tab sync, page-context ingest, session progress, and extension package build/download.
+
+## Requirements
+
+### Auto-enable
+
+The plugin is opt-in. It activates when `config.features.browser` is truthy in the elizaOS agent config:
+
+```json
+{
+  "features": {
+    "browser": true
+  }
+}
 ```
 
-## Authentication
+### Environment variables
 
-Companion-scoped endpoints (`/api/browser-bridge/companions/sync`,
-`/api/browser-bridge/companions/sessions/:id/*`) require two headers:
+| Variable | Purpose |
+|---|---|
+| `ELIZA_BROWSER_STAGEHAND_COMMAND_URL` | Full URL for the Stagehand command endpoint |
+| `STAGEHAND_SERVER_URL` | Stagehand base URL (commands go to `<url>/api/browser-command`) |
+| `ELIZA_BROWSER_STAGEHAND_URL` | Alias for `STAGEHAND_SERVER_URL` |
+| `ELIZA_BROWSER_STAGEHAND_AUTO_SETUP` | Set `false` to disable automatic stagehand-server install/build |
+| `ELIZA_BROWSER_ALLOW_STAGEHAND_ON_MOBILE` | Set `true` to allow stagehand target on mobile |
+| `ELIZA_MOBILE_PLATFORM` / `ELIZA_PLATFORM` / `CAPACITOR_PLATFORM` | Platform hint for target scoring (`ios`/`android`/`mobile`) |
 
-- `X-Browser-Bridge-Companion-Id: <companion uuid>`
-- `Authorization: Bearer <pairing token>`
+### Vault keys (set by the user, not env vars)
 
-The legacy `X-LifeOps-Browser-Companion-Id` and
-`x-eliza-browser-companion-id` headers were removed — no alias fallback is
-accepted.
+`autofill_login` only fires when the user has pre-authorized it per domain:
 
-## Connector Browser Auth
+- `creds.<domain>.:autoallow = "1"` — set via Settings → Vault → Logins.
 
-Browser-backed connector auth must use session handles rather than extracted
-browser secrets. The workspace helper
-`acquireBrowserWorkspaceConnectorSession({ provider, accountId, ... })` binds a
-named connector account to either:
+Without this flag, the action returns an error rather than prompting interactively.
 
-- an internal browser partition named
-  `persist:connector-{provider}-{accountId}-{hash}`; or
-- a Browser Bridge companion profile handle when a companion/profile reference
-  is supplied.
+## Companion extension authentication
 
-Connector partitions reject raw `cookies`, `storage`, and `state` export/load
-operations. Store the returned partition/profile/session references only. Auth
-states are explicit: `auth_pending`, `needs_reauth`, and `manual_handoff`
-represent login, MFA, CAPTCHA, or other user-required steps.
+Companion-scoped endpoints require two headers:
 
-## Companion Token Gaps
+```
+X-Browser-Bridge-Companion-Id: <companion uuid>
+Authorization: Bearer <pairing token>
+```
+
+Legacy header aliases (`X-LifeOps-Browser-Companion-Id`, `x-eliza-browser-companion-id`) are not accepted.
+
+## Database
+
+Drizzle tables in the `browser` PostgreSQL schema (applied by elizaOS `plugin-sql` migrator):
 
-The companion bearer token is stored server-side only as a SHA-256 hash and
-manual re-pairing rotates the active hash via a bounded pending-token list.
-Full TTL/revocation is not complete in the generic Browser Bridge surface yet.
-Missing pieces:
+- `browser_bridge_companions`
+- `browser_bridge_settings`
+- `browser_bridge_tabs`
+- `browser_bridge_page_contexts`
 
-- schema columns for active-token expiry, pending-token expiry, and revoked
-  timestamp/reason;
-- repository methods and HTTP routes for explicit revoke;
-- companion-side handling that clears local config on revoke/expiry responses;
-- a migration path for existing `browser_bridge_companions` rows.
+## Registering a custom browser target
+
+Any plugin can extend the browser dispatch surface at runtime:
+
+```ts
+import { BrowserService, BROWSER_SERVICE_TYPE } from "@elizaos/plugin-browser";
+import type { BrowserTarget } from "@elizaos/plugin-browser";
+
+const myTarget: BrowserTarget = {
+  id: "my-target",
+  name: "My Browser",
+  description: "Custom browser backend.",
+  kind: "external",
+  priority: 50,
+  available: async () => true,
+  execute: async (command) => { /* ... */ },
+};
+
+const browserService = runtime.getService<BrowserService>(BROWSER_SERVICE_TYPE);
+browserService?.registerTarget(myTarget);
+```

package/dist/actions/browser-autofill-login.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"browser-autofill-login.d.ts","sourceRoot":"","sources":["../../src/actions/browser-autofill-login.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;GAoCG;AAEH,OAAO,KAAK,EACV,YAAY,EACZ,cAAc,EACd,aAAa,EACb,MAAM,EACP,MAAM,eAAe,CAAC;AAyIvB;;GAEG;AACH,wBAAsB,2BAA2B,CAC/C,QAAQ,EAAE,aAAa,EACvB,QAAQ,EAAE,MAAM,GAAG,SAAS,EAC5B,OAAO,EAAE,cAAc,GAAG,SAAS,GAClC,OAAO,CAAC,YAAY,CAAC,CAgLvB"}
+{"version":3,"file":"browser-autofill-login.d.ts","sourceRoot":"","sources":["../../src/actions/browser-autofill-login.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;GAoCG;AAEH,OAAO,KAAK,EACV,YAAY,EACZ,cAAc,EACd,aAAa,EACb,MAAM,EACP,MAAM,eAAe,CAAC;AAyIvB;;GAEG;AACH,wBAAsB,2BAA2B,CAC/C,QAAQ,EAAE,aAAa,EACvB,QAAQ,EAAE,MAAM,GAAG,SAAS,EAC5B,OAAO,EAAE,cAAc,GAAG,SAAS,GAClC,OAAO,CAAC,YAAY,CAAC,CAkLvB"}

package/dist/actions/browser-autofill-login.js.map

@@ -1 +1 @@
-{"version":3,"sources":["../../src/actions/browser-autofill-login.ts"],"sourcesContent":["/**\n * BROWSER autofill-login subaction — agent-driven browser login autofill.\n *\n * Invoked via BROWSER with `subaction: \"autofill-login\"` (canonical). The legacy\n * planner action name `BROWSER_AUTOFILL_LOGIN` normalizes to BROWSER with this\n * subaction in the planner dispatch pipeline.\n *\n * Lets the agent say \"log into github.com for me\" and have the saved\n * credentials filled into an open Eliza browser tab without a per-call\n * consent prompt.\n *\n * Authorization model (mirrors the user-driven autofill flow):\n *   - The user must have set `creds.<domain>.:autoallow = \"1\"` on the\n *     domain. This is the same vault key the React-side consent flow\n *     uses; toggling it from Settings -> Vault -> Logins is the\n *     SOLE way to let the agent autofill silently.\n *   - Without that flag, this action returns\n *     `{ ok: false, reason: \"user has not pre-authorized agent autofill for <domain>\" }`.\n *     The agent should NOT fall back to the user-driven flow on its own\n *     because the user-driven flow is gated by an interactive React\n *     modal that an autonomous agent cannot consent to.\n *\n * Tab selection:\n *   - Lists the live browser-workspace tabs and picks the first one\n *     whose URL hostname matches `domain` (registrable hostname,\n *     case-insensitive). Returns a clean error when no such tab exists\n *     so the agent can decide whether to open one first via\n *     BROWSER (open/navigate).\n *\n * Fill mechanism:\n *   - Injects a small JS snippet that mirrors the same form-detection\n *     and `setNativeInputValue` helpers the in-tab preload uses, so\n *     React-controlled inputs see the change.\n *   - When `submit: true`, the snippet also calls `form.submit()` (or\n *     clicks a likely submit button) after filling. Off by default —\n *     the safer behaviour is fill-only and let the user click submit.\n */\n\nimport type {\n  ActionResult,\n  HandlerOptions,\n  IAgentRuntime,\n  Memory,\n} from \"@elizaos/core\";\nimport { logger } from \"@elizaos/core\";\nimport {\n  createManager,\n  getAutofillAllowed,\n  getSavedLogin,\n  listSavedLogins,\n  type Vault,\n} from \"@elizaos/vault\";\nimport {\n  evaluateBrowserWorkspaceTab,\n  isBrowserWorkspaceBridgeConfigured,\n  listBrowserWorkspaceTabs,\n} from \"../workspace/browser-workspace.js\";\n\ninterface BrowserAutofillLoginParameters {\n  domain?: string;\n  username?: string;\n  /** When true, attempt to submit the form after filling. Default: false. */\n  submit?: boolean;\n}\n\nconst AUTOFILL_SUBACTION = \"autofill-login\";\n\nconst MAX_BROWSER_TAB_SCAN = 100;\nconst MAX_FILL_REASON_CHARS = 240;\n\nlet cachedVault: Vault | null = null;\n\nfunction sharedAutofillVault(): Vault {\n  cachedVault ??= createManager().vault;\n  return cachedVault;\n}\n\nfunction tabUrlMatchesDomain(tabUrl: string, domain: string): boolean {\n  if (!tabUrl) return false;\n  let hostname: string;\n  try {\n    hostname = new URL(tabUrl).hostname;\n  } catch {\n    return false;\n  }\n  return hostname.toLowerCase() === domain.toLowerCase();\n}\n\nfunction buildAutofillScript(args: {\n  username: string;\n  password: string;\n  submit: boolean;\n}): string {\n  // Inline snippet — runs in the OOPIF (the page's content world) via\n  // electrobun tab eval. Uses setNativeInputValue to bypass React's\n  // value-setter override.\n  return `\n(() => {\n  const USERNAME = ${JSON.stringify(args.username)};\n  const PASSWORD = ${JSON.stringify(args.password)};\n  const SUBMIT = ${args.submit ? \"true\" : \"false\"};\n\n  function setNativeInputValue(input, value) {\n    const proto = Object.getPrototypeOf(input);\n    const desc = Object.getOwnPropertyDescriptor(proto, \"value\");\n    if (desc && typeof desc.set === \"function\") {\n      desc.set.call(input, value);\n    } else {\n      input.value = value;\n    }\n    input.dispatchEvent(new Event(\"input\", { bubbles: true }));\n    input.dispatchEvent(new Event(\"change\", { bubbles: true }));\n  }\n\n  function findPrecedingTextInput(passwordInput) {\n    const root = passwordInput.form || document.body;\n    const candidates = root.querySelectorAll(\n      'input[type=\"text\"], input[type=\"email\"], input:not([type])'\n    );\n    let lastBefore = null;\n    for (const el of candidates) {\n      if (el.compareDocumentPosition(passwordInput) & Node.DOCUMENT_POSITION_FOLLOWING) {\n        lastBefore = el;\n      }\n    }\n    return lastBefore;\n  }\n\n  const password = document.querySelector('input[type=\"password\"]');\n  if (!password) {\n    return { ok: false, reason: \"no_password_input\" };\n  }\n  const form = password.form;\n  const username =\n    (form && form.querySelector(\n      'input[type=\"email\"], input[name*=\"user\" i], input[name*=\"email\" i], input[name*=\"login\" i]'\n    )) || findPrecedingTextInput(password);\n\n  if (username) setNativeInputValue(username, USERNAME);\n  setNativeInputValue(password, PASSWORD);\n\n  if (SUBMIT) {\n    if (form && typeof form.requestSubmit === \"function\") {\n      form.requestSubmit();\n    } else if (form && typeof form.submit === \"function\") {\n      form.submit();\n    } else {\n      const button =\n        (form && form.querySelector('button[type=\"submit\"], input[type=\"submit\"]')) ||\n        document.querySelector('button[type=\"submit\"], input[type=\"submit\"]');\n      if (button) (button).click();\n    }\n  }\n\n  return {\n    ok: true,\n    filled: { username: !!username, password: true },\n    submitted: SUBMIT,\n  };\n})();\n`;\n}\n\nfunction narrowSnippetResult(raw: unknown): {\n  filled: boolean;\n  fillReason: string | null;\n} {\n  if (!raw || typeof raw !== \"object\") {\n    return { filled: false, fillReason: null };\n  }\n  const obj = raw as { filled?: { username?: boolean; password?: boolean } };\n  const hasFilledProp = \"filled\" in obj && Boolean(obj.filled);\n  let fillReason: string | null = null;\n  const reasonVal = \"reason\" in obj ? obj.reason : undefined;\n  if (typeof reasonVal === \"string\") {\n    fillReason = reasonVal.slice(0, MAX_FILL_REASON_CHARS);\n  }\n  return { filled: hasFilledProp, fillReason };\n}\n\n/**\n * Executes the vault-gated workspace autofill flow for {@link AUTOFILL_SUBACTION}.\n */\nexport async function executeBrowserAutofillLogin(\n  _runtime: IAgentRuntime,\n  _message: Memory | undefined,\n  options: HandlerOptions | undefined,\n): Promise<ActionResult> {\n  const params = options?.parameters as BrowserAutofillLoginParameters | undefined;\n  const domain = params?.domain?.trim().toLowerCase() ?? \"\";\n  const requestedUsername = params?.username?.trim();\n  const submit = params?.submit === true;\n\n  if (!domain) {\n    return {\n      text: `BROWSER requires subaction \"${AUTOFILL_SUBACTION}\" and a \\`domain\\` parameter.`,\n      success: false,\n      values: {\n        success: false,\n        error: \"BROWSER_AUTOFILL_BAD_PARAMS\",\n        subaction: AUTOFILL_SUBACTION,\n      },\n      data: { actionName: \"BROWSER\", subaction: AUTOFILL_SUBACTION },\n    };\n  }\n\n  if (!isBrowserWorkspaceBridgeConfigured(process.env)) {\n    return {\n      text: `BROWSER ${AUTOFILL_SUBACTION} requires the desktop browser workspace bridge.`,\n      success: false,\n      values: {\n        success: false,\n        error: \"BROWSER_BRIDGE_UNAVAILABLE\",\n        subaction: AUTOFILL_SUBACTION,\n      },\n      data: { actionName: \"BROWSER\", subaction: AUTOFILL_SUBACTION },\n    };\n  }\n\n  const vault = sharedAutofillVault();\n\n  const allowed = await getAutofillAllowed(vault, domain);\n  if (!allowed) {\n    const text = `User has not pre-authorized agent autofill for ${domain}. Toggle \"Allow agent to autofill\" for this domain under Settings -> Vault -> Logins.`;\n    return {\n      text,\n      success: false,\n      values: {\n        success: false,\n        error: \"AGENT_AUTOFILL_NOT_AUTHORIZED\",\n        domain,\n        subaction: AUTOFILL_SUBACTION,\n      },\n      data: {\n        actionName: \"BROWSER\",\n        subaction: AUTOFILL_SUBACTION,\n        domain,\n        reason: text,\n      },\n    };\n  }\n\n  let savedLogin: Awaited<ReturnType<typeof getSavedLogin>> = null;\n  if (requestedUsername) {\n    savedLogin = await getSavedLogin(vault, domain, requestedUsername);\n    if (!savedLogin) {\n      return {\n        text: `No saved login for ${requestedUsername} on ${domain}.`,\n        success: false,\n        values: {\n          success: false,\n          error: \"AGENT_AUTOFILL_NO_LOGIN\",\n          domain,\n          username: requestedUsername,\n          subaction: AUTOFILL_SUBACTION,\n        },\n        data: { actionName: \"BROWSER\", subaction: AUTOFILL_SUBACTION },\n      };\n    }\n  } else {\n    const summaries = await listSavedLogins(vault, domain);\n    if (summaries.length === 0) {\n      return {\n        text: `No saved logins for ${domain}.`,\n        success: false,\n        values: {\n          success: false,\n          error: \"AGENT_AUTOFILL_NO_LOGIN\",\n          domain,\n          subaction: AUTOFILL_SUBACTION,\n        },\n        data: { actionName: \"BROWSER\", subaction: AUTOFILL_SUBACTION },\n      };\n    }\n    const sorted = [...summaries].sort(\n      (a, b) => b.lastModified - a.lastModified,\n    );\n    const chosen = sorted[0];\n    if (!chosen) {\n      return {\n        text: `No saved logins for ${domain}.`,\n        success: false,\n        values: {\n          success: false,\n          error: \"AGENT_AUTOFILL_NO_LOGIN\",\n          domain,\n          subaction: AUTOFILL_SUBACTION,\n        },\n        data: { actionName: \"BROWSER\", subaction: AUTOFILL_SUBACTION },\n      };\n    }\n    savedLogin = await getSavedLogin(vault, domain, chosen.username);\n    if (!savedLogin) {\n      return {\n        text: `Saved login ${chosen.username} on ${domain} disappeared between list and reveal.`,\n        success: false,\n        values: {\n          success: false,\n          error: \"AGENT_AUTOFILL_RACE\",\n          domain,\n          subaction: AUTOFILL_SUBACTION,\n        },\n        data: { actionName: \"BROWSER\", subaction: AUTOFILL_SUBACTION },\n      };\n    }\n  }\n\n  const tabs = await listBrowserWorkspaceTabs();\n  const matchingTab = tabs\n    .slice(0, MAX_BROWSER_TAB_SCAN)\n    .find((t) => tabUrlMatchesDomain(t.url, domain));\n  if (!matchingTab) {\n    return {\n      text: `No open browser tab on ${domain}. Open one with BROWSER (open/navigate) first.`,\n      success: false,\n      values: {\n        success: false,\n        error: \"AGENT_AUTOFILL_NO_TAB\",\n        domain,\n        subaction: AUTOFILL_SUBACTION,\n      },\n      data: { actionName: \"BROWSER\", subaction: AUTOFILL_SUBACTION },\n    };\n  }\n\n  const script = buildAutofillScript({\n    username: savedLogin.username,\n    password: savedLogin.password,\n    submit,\n  });\n  const rawResult = await evaluateBrowserWorkspaceTab({\n    id: matchingTab.id,\n    script,\n  });\n  const { filled, fillReason } = narrowSnippetResult(rawResult);\n\n  logger.info(\n    `[browser-autofill-login] domain=${domain} tabId=${matchingTab.id} submit=${submit} filled=${filled}`,\n  );\n\n  return {\n    text: submit\n      ? `Filled and submitted login on ${domain} (tab ${matchingTab.id}).`\n      : `Filled login on ${domain} (tab ${matchingTab.id}). User must click submit.`,\n    success: true,\n    values: {\n      success: true,\n      domain,\n      tabId: matchingTab.id,\n      submitted: submit,\n      filled,\n      subaction: AUTOFILL_SUBACTION,\n      ...(fillReason ? { fillReason } : {}),\n    },\n    data: {\n      actionName: \"BROWSER\",\n      subaction: AUTOFILL_SUBACTION,\n      domain,\n      tabId: matchingTab.id,\n      filled,\n      ...(fillReason ? { fillReason } : {}),\n    },\n  };\n}\n"],"mappings":"AA4CA,SAAS,cAAc;AACvB;AAAA,EACE;AAAA,EACA;AAAA,EACA;AAAA,EACA;AAAA,OAEK;AACP;AAAA,EACE;AAAA,EACA;AAAA,EACA;AAAA,OACK;AASP,MAAM,qBAAqB;AAE3B,MAAM,uBAAuB;AAC7B,MAAM,wBAAwB;AAE9B,IAAI,cAA4B;AAEhC,SAAS,sBAA6B;AACpC,kBAAgB,cAAc,EAAE;AAChC,SAAO;AACT;AAEA,SAAS,oBAAoB,QAAgB,QAAyB;AACpE,MAAI,CAAC,OAAQ,QAAO;AACpB,MAAI;AACJ,MAAI;AACF,eAAW,IAAI,IAAI,MAAM,EAAE;AAAA,EAC7B,QAAQ;AACN,WAAO;AAAA,EACT;AACA,SAAO,SAAS,YAAY,MAAM,OAAO,YAAY;AACvD;AAEA,SAAS,oBAAoB,MAIlB;AAIT,SAAO;AAAA;AAAA,qBAEY,KAAK,UAAU,KAAK,QAAQ,CAAC;AAAA,qBAC7B,KAAK,UAAU,KAAK,QAAQ,CAAC;AAAA,mBAC/B,KAAK,SAAS,SAAS,OAAO;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AA6DjD;AAEA,SAAS,oBAAoB,KAG3B;AACA,MAAI,CAAC,OAAO,OAAO,QAAQ,UAAU;AACnC,WAAO,EAAE,QAAQ,OAAO,YAAY,KAAK;AAAA,EAC3C;AACA,QAAM,MAAM;AACZ,QAAM,gBAAgB,YAAY,OAAO,QAAQ,IAAI,MAAM;AAC3D,MAAI,aAA4B;AAChC,QAAM,YAAY,YAAY,MAAM,IAAI,SAAS;AACjD,MAAI,OAAO,cAAc,UAAU;AACjC,iBAAa,UAAU,MAAM,GAAG,qBAAqB;AAAA,EACvD;AACA,SAAO,EAAE,QAAQ,eAAe,WAAW;AAC7C;AAKA,eAAsB,4BACpB,UACA,UACA,SACuB;AACvB,QAAM,SAAS,SAAS;AACxB,QAAM,SAAS,QAAQ,QAAQ,KAAK,EAAE,YAAY,KAAK;AACvD,QAAM,oBAAoB,QAAQ,UAAU,KAAK;AACjD,QAAM,SAAS,QAAQ,WAAW;AAElC,MAAI,CAAC,QAAQ;AACX,WAAO;AAAA,MACL,MAAM,+BAA+B,kBAAkB;AAAA,MACvD,SAAS;AAAA,MACT,QAAQ;AAAA,QACN,SAAS;AAAA,QACT,OAAO;AAAA,QACP,WAAW;AAAA,MACb;AAAA,MACA,MAAM,EAAE,YAAY,WAAW,WAAW,mBAAmB;AAAA,IAC/D;AAAA,EACF;AAEA,MAAI,CAAC,mCAAmC,QAAQ,GAAG,GAAG;AACpD,WAAO;AAAA,MACL,MAAM,WAAW,kBAAkB;AAAA,MACnC,SAAS;AAAA,MACT,QAAQ;AAAA,QACN,SAAS;AAAA,QACT,OAAO;AAAA,QACP,WAAW;AAAA,MACb;AAAA,MACA,MAAM,EAAE,YAAY,WAAW,WAAW,mBAAmB;AAAA,IAC/D;AAAA,EACF;AAEA,QAAM,QAAQ,oBAAoB;AAElC,QAAM,UAAU,MAAM,mBAAmB,OAAO,MAAM;AACtD,MAAI,CAAC,SAAS;AACZ,UAAM,OAAO,kDAAkD,MAAM;AACrE,WAAO;AAAA,MACL;AAAA,MACA,SAAS;AAAA,MACT,QAAQ;AAAA,QACN,SAAS;AAAA,QACT,OAAO;AAAA,QACP;AAAA,QACA,WAAW;AAAA,MACb;AAAA,MACA,MAAM;AAAA,QACJ,YAAY;AAAA,QACZ,WAAW;AAAA,QACX;AAAA,QACA,QAAQ;AAAA,MACV;AAAA,IACF;AAAA,EACF;AAEA,MAAI,aAAwD;AAC5D,MAAI,mBAAmB;AACrB,iBAAa,MAAM,cAAc,OAAO,QAAQ,iBAAiB;AACjE,QAAI,CAAC,YAAY;AACf,aAAO;AAAA,QACL,MAAM,sBAAsB,iBAAiB,OAAO,MAAM;AAAA,QAC1D,SAAS;AAAA,QACT,QAAQ;AAAA,UACN,SAAS;AAAA,UACT,OAAO;AAAA,UACP;AAAA,UACA,UAAU;AAAA,UACV,WAAW;AAAA,QACb;AAAA,QACA,MAAM,EAAE,YAAY,WAAW,WAAW,mBAAmB;AAAA,MAC/D;AAAA,IACF;AAAA,EACF,OAAO;AACL,UAAM,YAAY,MAAM,gBAAgB,OAAO,MAAM;AACrD,QAAI,UAAU,WAAW,GAAG;AAC1B,aAAO;AAAA,QACL,MAAM,uBAAuB,MAAM;AAAA,QACnC,SAAS;AAAA,QACT,QAAQ;AAAA,UACN,SAAS;AAAA,UACT,OAAO;AAAA,UACP;AAAA,UACA,WAAW;AAAA,QACb;AAAA,QACA,MAAM,EAAE,YAAY,WAAW,WAAW,mBAAmB;AAAA,MAC/D;AAAA,IACF;AACA,UAAM,SAAS,CAAC,GAAG,SAAS,EAAE;AAAA,MAC5B,CAAC,GAAG,MAAM,EAAE,eAAe,EAAE;AAAA,IAC/B;AACA,UAAM,SAAS,OAAO,CAAC;AACvB,QAAI,CAAC,QAAQ;AACX,aAAO;AAAA,QACL,MAAM,uBAAuB,MAAM;AAAA,QACnC,SAAS;AAAA,QACT,QAAQ;AAAA,UACN,SAAS;AAAA,UACT,OAAO;AAAA,UACP;AAAA,UACA,WAAW;AAAA,QACb;AAAA,QACA,MAAM,EAAE,YAAY,WAAW,WAAW,mBAAmB;AAAA,MAC/D;AAAA,IACF;AACA,iBAAa,MAAM,cAAc,OAAO,QAAQ,OAAO,QAAQ;AAC/D,QAAI,CAAC,YAAY;AACf,aAAO;AAAA,QACL,MAAM,eAAe,OAAO,QAAQ,OAAO,MAAM;AAAA,QACjD,SAAS;AAAA,QACT,QAAQ;AAAA,UACN,SAAS;AAAA,UACT,OAAO;AAAA,UACP;AAAA,UACA,WAAW;AAAA,QACb;AAAA,QACA,MAAM,EAAE,YAAY,WAAW,WAAW,mBAAmB;AAAA,MAC/D;AAAA,IACF;AAAA,EACF;AAEA,QAAM,OAAO,MAAM,yBAAyB;AAC5C,QAAM,cAAc,KACjB,MAAM,GAAG,oBAAoB,EAC7B,KAAK,CAAC,MAAM,oBAAoB,EAAE,KAAK,MAAM,CAAC;AACjD,MAAI,CAAC,aAAa;AAChB,WAAO;AAAA,MACL,MAAM,0BAA0B,MAAM;AAAA,MACtC,SAAS;AAAA,MACT,QAAQ;AAAA,QACN,SAAS;AAAA,QACT,OAAO;AAAA,QACP;AAAA,QACA,WAAW;AAAA,MACb;AAAA,MACA,MAAM,EAAE,YAAY,WAAW,WAAW,mBAAmB;AAAA,IAC/D;AAAA,EACF;AAEA,QAAM,SAAS,oBAAoB;AAAA,IACjC,UAAU,WAAW;AAAA,IACrB,UAAU,WAAW;AAAA,IACrB;AAAA,EACF,CAAC;AACD,QAAM,YAAY,MAAM,4BAA4B;AAAA,IAClD,IAAI,YAAY;AAAA,IAChB;AAAA,EACF,CAAC;AACD,QAAM,EAAE,QAAQ,WAAW,IAAI,oBAAoB,SAAS;AAE5D,SAAO;AAAA,IACL,mCAAmC,MAAM,UAAU,YAAY,EAAE,WAAW,MAAM,WAAW,MAAM;AAAA,EACrG;AAEA,SAAO;AAAA,IACL,MAAM,SACF,iCAAiC,MAAM,SAAS,YAAY,EAAE,OAC9D,mBAAmB,MAAM,SAAS,YAAY,EAAE;AAAA,IACpD,SAAS;AAAA,IACT,QAAQ;AAAA,MACN,SAAS;AAAA,MACT;AAAA,MACA,OAAO,YAAY;AAAA,MACnB,WAAW;AAAA,MACX;AAAA,MACA,WAAW;AAAA,MACX,GAAI,aAAa,EAAE,WAAW,IAAI,CAAC;AAAA,IACrC;AAAA,IACA,MAAM;AAAA,MACJ,YAAY;AAAA,MACZ,WAAW;AAAA,MACX;AAAA,MACA,OAAO,YAAY;AAAA,MACnB;AAAA,MACA,GAAI,aAAa,EAAE,WAAW,IAAI,CAAC;AAAA,IACrC;AAAA,EACF;AACF;","names":[]}
+{"version":3,"sources":["../../src/actions/browser-autofill-login.ts"],"sourcesContent":["/**\n * BROWSER autofill-login subaction — agent-driven browser login autofill.\n *\n * Invoked via BROWSER with `subaction: \"autofill-login\"` (canonical). The legacy\n * planner action name `BROWSER_AUTOFILL_LOGIN` normalizes to BROWSER with this\n * subaction in the planner dispatch pipeline.\n *\n * Lets the agent say \"log into github.com for me\" and have the saved\n * credentials filled into an open Eliza browser tab without a per-call\n * consent prompt.\n *\n * Authorization model (mirrors the user-driven autofill flow):\n *   - The user must have set `creds.<domain>.:autoallow = \"1\"` on the\n *     domain. This is the same vault key the React-side consent flow\n *     uses; toggling it from Settings -> Vault -> Logins is the\n *     SOLE way to let the agent autofill silently.\n *   - Without that flag, this action returns\n *     `{ ok: false, reason: \"user has not pre-authorized agent autofill for <domain>\" }`.\n *     The agent should NOT fall back to the user-driven flow on its own\n *     because the user-driven flow is gated by an interactive React\n *     modal that an autonomous agent cannot consent to.\n *\n * Tab selection:\n *   - Lists the live browser-workspace tabs and picks the first one\n *     whose URL hostname matches `domain` (registrable hostname,\n *     case-insensitive). Returns a clean error when no such tab exists\n *     so the agent can decide whether to open one first via\n *     BROWSER (open/navigate).\n *\n * Fill mechanism:\n *   - Injects a small JS snippet that mirrors the same form-detection\n *     and `setNativeInputValue` helpers the in-tab preload uses, so\n *     React-controlled inputs see the change.\n *   - When `submit: true`, the snippet also calls `form.submit()` (or\n *     clicks a likely submit button) after filling. Off by default —\n *     the safer behaviour is fill-only and let the user click submit.\n */\n\nimport type {\n  ActionResult,\n  HandlerOptions,\n  IAgentRuntime,\n  Memory,\n} from \"@elizaos/core\";\nimport { logger } from \"@elizaos/core\";\nimport {\n  createManager,\n  getAutofillAllowed,\n  getSavedLogin,\n  listSavedLogins,\n  type Vault,\n} from \"@elizaos/vault\";\nimport {\n  evaluateBrowserWorkspaceTab,\n  isBrowserWorkspaceBridgeConfigured,\n  listBrowserWorkspaceTabs,\n} from \"../workspace/browser-workspace.js\";\n\ninterface BrowserAutofillLoginParameters {\n  domain?: string;\n  username?: string;\n  /** When true, attempt to submit the form after filling. Default: false. */\n  submit?: boolean;\n}\n\nconst AUTOFILL_SUBACTION = \"autofill-login\";\n\nconst MAX_BROWSER_TAB_SCAN = 100;\nconst MAX_FILL_REASON_CHARS = 240;\n\nlet cachedVault: Vault | null = null;\n\nfunction sharedAutofillVault(): Vault {\n  cachedVault ??= createManager().vault;\n  return cachedVault;\n}\n\nfunction tabUrlMatchesDomain(tabUrl: string, domain: string): boolean {\n  if (!tabUrl) return false;\n  let hostname: string;\n  try {\n    hostname = new URL(tabUrl).hostname;\n  } catch {\n    return false;\n  }\n  return hostname.toLowerCase() === domain.toLowerCase();\n}\n\nfunction buildAutofillScript(args: {\n  username: string;\n  password: string;\n  submit: boolean;\n}): string {\n  // Inline snippet — runs in the OOPIF (the page's content world) via\n  // electrobun tab eval. Uses setNativeInputValue to bypass React's\n  // value-setter override.\n  return `\n(() => {\n  const USERNAME = ${JSON.stringify(args.username)};\n  const PASSWORD = ${JSON.stringify(args.password)};\n  const SUBMIT = ${args.submit ? \"true\" : \"false\"};\n\n  function setNativeInputValue(input, value) {\n    const proto = Object.getPrototypeOf(input);\n    const desc = Object.getOwnPropertyDescriptor(proto, \"value\");\n    if (desc && typeof desc.set === \"function\") {\n      desc.set.call(input, value);\n    } else {\n      input.value = value;\n    }\n    input.dispatchEvent(new Event(\"input\", { bubbles: true }));\n    input.dispatchEvent(new Event(\"change\", { bubbles: true }));\n  }\n\n  function findPrecedingTextInput(passwordInput) {\n    const root = passwordInput.form || document.body;\n    const candidates = root.querySelectorAll(\n      'input[type=\"text\"], input[type=\"email\"], input:not([type])'\n    );\n    let lastBefore = null;\n    for (const el of candidates) {\n      if (el.compareDocumentPosition(passwordInput) & Node.DOCUMENT_POSITION_FOLLOWING) {\n        lastBefore = el;\n      }\n    }\n    return lastBefore;\n  }\n\n  const password = document.querySelector('input[type=\"password\"]');\n  if (!password) {\n    return { ok: false, reason: \"no_password_input\" };\n  }\n  const form = password.form;\n  const username =\n    (form && form.querySelector(\n      'input[type=\"email\"], input[name*=\"user\" i], input[name*=\"email\" i], input[name*=\"login\" i]'\n    )) || findPrecedingTextInput(password);\n\n  if (username) setNativeInputValue(username, USERNAME);\n  setNativeInputValue(password, PASSWORD);\n\n  if (SUBMIT) {\n    if (form && typeof form.requestSubmit === \"function\") {\n      form.requestSubmit();\n    } else if (form && typeof form.submit === \"function\") {\n      form.submit();\n    } else {\n      const button =\n        (form && form.querySelector('button[type=\"submit\"], input[type=\"submit\"]')) ||\n        document.querySelector('button[type=\"submit\"], input[type=\"submit\"]');\n      if (button) (button).click();\n    }\n  }\n\n  return {\n    ok: true,\n    filled: { username: !!username, password: true },\n    submitted: SUBMIT,\n  };\n})();\n`;\n}\n\nfunction narrowSnippetResult(raw: unknown): {\n  filled: boolean;\n  fillReason: string | null;\n} {\n  if (!raw || typeof raw !== \"object\") {\n    return { filled: false, fillReason: null };\n  }\n  const obj = raw as { filled?: { username?: boolean; password?: boolean } };\n  const hasFilledProp = \"filled\" in obj && Boolean(obj.filled);\n  let fillReason: string | null = null;\n  const reasonVal = \"reason\" in obj ? obj.reason : undefined;\n  if (typeof reasonVal === \"string\") {\n    fillReason = reasonVal.slice(0, MAX_FILL_REASON_CHARS);\n  }\n  return { filled: hasFilledProp, fillReason };\n}\n\n/**\n * Executes the vault-gated workspace autofill flow for {@link AUTOFILL_SUBACTION}.\n */\nexport async function executeBrowserAutofillLogin(\n  _runtime: IAgentRuntime,\n  _message: Memory | undefined,\n  options: HandlerOptions | undefined,\n): Promise<ActionResult> {\n  const params = options?.parameters as\n    | BrowserAutofillLoginParameters\n    | undefined;\n  const domain = params?.domain?.trim().toLowerCase() ?? \"\";\n  const requestedUsername = params?.username?.trim();\n  const submit = params?.submit === true;\n\n  if (!domain) {\n    return {\n      text: `BROWSER requires subaction \"${AUTOFILL_SUBACTION}\" and a \\`domain\\` parameter.`,\n      success: false,\n      values: {\n        success: false,\n        error: \"BROWSER_AUTOFILL_BAD_PARAMS\",\n        subaction: AUTOFILL_SUBACTION,\n      },\n      data: { actionName: \"BROWSER\", subaction: AUTOFILL_SUBACTION },\n    };\n  }\n\n  if (!isBrowserWorkspaceBridgeConfigured(process.env)) {\n    return {\n      text: `BROWSER ${AUTOFILL_SUBACTION} requires the desktop browser workspace bridge.`,\n      success: false,\n      values: {\n        success: false,\n        error: \"BROWSER_BRIDGE_UNAVAILABLE\",\n        subaction: AUTOFILL_SUBACTION,\n      },\n      data: { actionName: \"BROWSER\", subaction: AUTOFILL_SUBACTION },\n    };\n  }\n\n  const vault = sharedAutofillVault();\n\n  const allowed = await getAutofillAllowed(vault, domain);\n  if (!allowed) {\n    const text = `User has not pre-authorized agent autofill for ${domain}. Toggle \"Allow agent to autofill\" for this domain under Settings -> Vault -> Logins.`;\n    return {\n      text,\n      success: false,\n      values: {\n        success: false,\n        error: \"AGENT_AUTOFILL_NOT_AUTHORIZED\",\n        domain,\n        subaction: AUTOFILL_SUBACTION,\n      },\n      data: {\n        actionName: \"BROWSER\",\n        subaction: AUTOFILL_SUBACTION,\n        domain,\n        reason: text,\n      },\n    };\n  }\n\n  let savedLogin: Awaited<ReturnType<typeof getSavedLogin>> = null;\n  if (requestedUsername) {\n    savedLogin = await getSavedLogin(vault, domain, requestedUsername);\n    if (!savedLogin) {\n      return {\n        text: `No saved login for ${requestedUsername} on ${domain}.`,\n        success: false,\n        values: {\n          success: false,\n          error: \"AGENT_AUTOFILL_NO_LOGIN\",\n          domain,\n          username: requestedUsername,\n          subaction: AUTOFILL_SUBACTION,\n        },\n        data: { actionName: \"BROWSER\", subaction: AUTOFILL_SUBACTION },\n      };\n    }\n  } else {\n    const summaries = await listSavedLogins(vault, domain);\n    if (summaries.length === 0) {\n      return {\n        text: `No saved logins for ${domain}.`,\n        success: false,\n        values: {\n          success: false,\n          error: \"AGENT_AUTOFILL_NO_LOGIN\",\n          domain,\n          subaction: AUTOFILL_SUBACTION,\n        },\n        data: { actionName: \"BROWSER\", subaction: AUTOFILL_SUBACTION },\n      };\n    }\n    const sorted = [...summaries].sort(\n      (a, b) => b.lastModified - a.lastModified,\n    );\n    const chosen = sorted[0];\n    if (!chosen) {\n      return {\n        text: `No saved logins for ${domain}.`,\n        success: false,\n        values: {\n          success: false,\n          error: \"AGENT_AUTOFILL_NO_LOGIN\",\n          domain,\n          subaction: AUTOFILL_SUBACTION,\n        },\n        data: { actionName: \"BROWSER\", subaction: AUTOFILL_SUBACTION },\n      };\n    }\n    savedLogin = await getSavedLogin(vault, domain, chosen.username);\n    if (!savedLogin) {\n      return {\n        text: `Saved login ${chosen.username} on ${domain} disappeared between list and reveal.`,\n        success: false,\n        values: {\n          success: false,\n          error: \"AGENT_AUTOFILL_RACE\",\n          domain,\n          subaction: AUTOFILL_SUBACTION,\n        },\n        data: { actionName: \"BROWSER\", subaction: AUTOFILL_SUBACTION },\n      };\n    }\n  }\n\n  const tabs = await listBrowserWorkspaceTabs();\n  const matchingTab = tabs\n    .slice(0, MAX_BROWSER_TAB_SCAN)\n    .find((t) => tabUrlMatchesDomain(t.url, domain));\n  if (!matchingTab) {\n    return {\n      text: `No open browser tab on ${domain}. Open one with BROWSER (open/navigate) first.`,\n      success: false,\n      values: {\n        success: false,\n        error: \"AGENT_AUTOFILL_NO_TAB\",\n        domain,\n        subaction: AUTOFILL_SUBACTION,\n      },\n      data: { actionName: \"BROWSER\", subaction: AUTOFILL_SUBACTION },\n    };\n  }\n\n  const script = buildAutofillScript({\n    username: savedLogin.username,\n    password: savedLogin.password,\n    submit,\n  });\n  const rawResult = await evaluateBrowserWorkspaceTab({\n    id: matchingTab.id,\n    script,\n  });\n  const { filled, fillReason } = narrowSnippetResult(rawResult);\n\n  logger.info(\n    `[browser-autofill-login] domain=${domain} tabId=${matchingTab.id} submit=${submit} filled=${filled}`,\n  );\n\n  return {\n    text: submit\n      ? `Filled and submitted login on ${domain} (tab ${matchingTab.id}).`\n      : `Filled login on ${domain} (tab ${matchingTab.id}). User must click submit.`,\n    success: true,\n    values: {\n      success: true,\n      domain,\n      tabId: matchingTab.id,\n      submitted: submit,\n      filled,\n      subaction: AUTOFILL_SUBACTION,\n      ...(fillReason ? { fillReason } : {}),\n    },\n    data: {\n      actionName: \"BROWSER\",\n      subaction: AUTOFILL_SUBACTION,\n      domain,\n      tabId: matchingTab.id,\n      filled,\n      ...(fillReason ? { fillReason } : {}),\n    },\n  };\n}\n"],"mappings":"AA4CA,SAAS,cAAc;AACvB;AAAA,EACE;AAAA,EACA;AAAA,EACA;AAAA,EACA;AAAA,OAEK;AACP;AAAA,EACE;AAAA,EACA;AAAA,EACA;AAAA,OACK;AASP,MAAM,qBAAqB;AAE3B,MAAM,uBAAuB;AAC7B,MAAM,wBAAwB;AAE9B,IAAI,cAA4B;AAEhC,SAAS,sBAA6B;AACpC,kBAAgB,cAAc,EAAE;AAChC,SAAO;AACT;AAEA,SAAS,oBAAoB,QAAgB,QAAyB;AACpE,MAAI,CAAC,OAAQ,QAAO;AACpB,MAAI;AACJ,MAAI;AACF,eAAW,IAAI,IAAI,MAAM,EAAE;AAAA,EAC7B,QAAQ;AACN,WAAO;AAAA,EACT;AACA,SAAO,SAAS,YAAY,MAAM,OAAO,YAAY;AACvD;AAEA,SAAS,oBAAoB,MAIlB;AAIT,SAAO;AAAA;AAAA,qBAEY,KAAK,UAAU,KAAK,QAAQ,CAAC;AAAA,qBAC7B,KAAK,UAAU,KAAK,QAAQ,CAAC;AAAA,mBAC/B,KAAK,SAAS,SAAS,OAAO;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AA6DjD;AAEA,SAAS,oBAAoB,KAG3B;AACA,MAAI,CAAC,OAAO,OAAO,QAAQ,UAAU;AACnC,WAAO,EAAE,QAAQ,OAAO,YAAY,KAAK;AAAA,EAC3C;AACA,QAAM,MAAM;AACZ,QAAM,gBAAgB,YAAY,OAAO,QAAQ,IAAI,MAAM;AAC3D,MAAI,aAA4B;AAChC,QAAM,YAAY,YAAY,MAAM,IAAI,SAAS;AACjD,MAAI,OAAO,cAAc,UAAU;AACjC,iBAAa,UAAU,MAAM,GAAG,qBAAqB;AAAA,EACvD;AACA,SAAO,EAAE,QAAQ,eAAe,WAAW;AAC7C;AAKA,eAAsB,4BACpB,UACA,UACA,SACuB;AACvB,QAAM,SAAS,SAAS;AAGxB,QAAM,SAAS,QAAQ,QAAQ,KAAK,EAAE,YAAY,KAAK;AACvD,QAAM,oBAAoB,QAAQ,UAAU,KAAK;AACjD,QAAM,SAAS,QAAQ,WAAW;AAElC,MAAI,CAAC,QAAQ;AACX,WAAO;AAAA,MACL,MAAM,+BAA+B,kBAAkB;AAAA,MACvD,SAAS;AAAA,MACT,QAAQ;AAAA,QACN,SAAS;AAAA,QACT,OAAO;AAAA,QACP,WAAW;AAAA,MACb;AAAA,MACA,MAAM,EAAE,YAAY,WAAW,WAAW,mBAAmB;AAAA,IAC/D;AAAA,EACF;AAEA,MAAI,CAAC,mCAAmC,QAAQ,GAAG,GAAG;AACpD,WAAO;AAAA,MACL,MAAM,WAAW,kBAAkB;AAAA,MACnC,SAAS;AAAA,MACT,QAAQ;AAAA,QACN,SAAS;AAAA,QACT,OAAO;AAAA,QACP,WAAW;AAAA,MACb;AAAA,MACA,MAAM,EAAE,YAAY,WAAW,WAAW,mBAAmB;AAAA,IAC/D;AAAA,EACF;AAEA,QAAM,QAAQ,oBAAoB;AAElC,QAAM,UAAU,MAAM,mBAAmB,OAAO,MAAM;AACtD,MAAI,CAAC,SAAS;AACZ,UAAM,OAAO,kDAAkD,MAAM;AACrE,WAAO;AAAA,MACL;AAAA,MACA,SAAS;AAAA,MACT,QAAQ;AAAA,QACN,SAAS;AAAA,QACT,OAAO;AAAA,QACP;AAAA,QACA,WAAW;AAAA,MACb;AAAA,MACA,MAAM;AAAA,QACJ,YAAY;AAAA,QACZ,WAAW;AAAA,QACX;AAAA,QACA,QAAQ;AAAA,MACV;AAAA,IACF;AAAA,EACF;AAEA,MAAI,aAAwD;AAC5D,MAAI,mBAAmB;AACrB,iBAAa,MAAM,cAAc,OAAO,QAAQ,iBAAiB;AACjE,QAAI,CAAC,YAAY;AACf,aAAO;AAAA,QACL,MAAM,sBAAsB,iBAAiB,OAAO,MAAM;AAAA,QAC1D,SAAS;AAAA,QACT,QAAQ;AAAA,UACN,SAAS;AAAA,UACT,OAAO;AAAA,UACP;AAAA,UACA,UAAU;AAAA,UACV,WAAW;AAAA,QACb;AAAA,QACA,MAAM,EAAE,YAAY,WAAW,WAAW,mBAAmB;AAAA,MAC/D;AAAA,IACF;AAAA,EACF,OAAO;AACL,UAAM,YAAY,MAAM,gBAAgB,OAAO,MAAM;AACrD,QAAI,UAAU,WAAW,GAAG;AAC1B,aAAO;AAAA,QACL,MAAM,uBAAuB,MAAM;AAAA,QACnC,SAAS;AAAA,QACT,QAAQ;AAAA,UACN,SAAS;AAAA,UACT,OAAO;AAAA,UACP;AAAA,UACA,WAAW;AAAA,QACb;AAAA,QACA,MAAM,EAAE,YAAY,WAAW,WAAW,mBAAmB;AAAA,MAC/D;AAAA,IACF;AACA,UAAM,SAAS,CAAC,GAAG,SAAS,EAAE;AAAA,MAC5B,CAAC,GAAG,MAAM,EAAE,eAAe,EAAE;AAAA,IAC/B;AACA,UAAM,SAAS,OAAO,CAAC;AACvB,QAAI,CAAC,QAAQ;AACX,aAAO;AAAA,QACL,MAAM,uBAAuB,MAAM;AAAA,QACnC,SAAS;AAAA,QACT,QAAQ;AAAA,UACN,SAAS;AAAA,UACT,OAAO;AAAA,UACP;AAAA,UACA,WAAW;AAAA,QACb;AAAA,QACA,MAAM,EAAE,YAAY,WAAW,WAAW,mBAAmB;AAAA,MAC/D;AAAA,IACF;AACA,iBAAa,MAAM,cAAc,OAAO,QAAQ,OAAO,QAAQ;AAC/D,QAAI,CAAC,YAAY;AACf,aAAO;AAAA,QACL,MAAM,eAAe,OAAO,QAAQ,OAAO,MAAM;AAAA,QACjD,SAAS;AAAA,QACT,QAAQ;AAAA,UACN,SAAS;AAAA,UACT,OAAO;AAAA,UACP;AAAA,UACA,WAAW;AAAA,QACb;AAAA,QACA,MAAM,EAAE,YAAY,WAAW,WAAW,mBAAmB;AAAA,MAC/D;AAAA,IACF;AAAA,EACF;AAEA,QAAM,OAAO,MAAM,yBAAyB;AAC5C,QAAM,cAAc,KACjB,MAAM,GAAG,oBAAoB,EAC7B,KAAK,CAAC,MAAM,oBAAoB,EAAE,KAAK,MAAM,CAAC;AACjD,MAAI,CAAC,aAAa;AAChB,WAAO;AAAA,MACL,MAAM,0BAA0B,MAAM;AAAA,MACtC,SAAS;AAAA,MACT,QAAQ;AAAA,QACN,SAAS;AAAA,QACT,OAAO;AAAA,QACP;AAAA,QACA,WAAW;AAAA,MACb;AAAA,MACA,MAAM,EAAE,YAAY,WAAW,WAAW,mBAAmB;AAAA,IAC/D;AAAA,EACF;AAEA,QAAM,SAAS,oBAAoB;AAAA,IACjC,UAAU,WAAW;AAAA,IACrB,UAAU,WAAW;AAAA,IACrB;AAAA,EACF,CAAC;AACD,QAAM,YAAY,MAAM,4BAA4B;AAAA,IAClD,IAAI,YAAY;AAAA,IAChB;AAAA,EACF,CAAC;AACD,QAAM,EAAE,QAAQ,WAAW,IAAI,oBAAoB,SAAS;AAE5D,SAAO;AAAA,IACL,mCAAmC,MAAM,UAAU,YAAY,EAAE,WAAW,MAAM,WAAW,MAAM;AAAA,EACrG;AAEA,SAAO;AAAA,IACL,MAAM,SACF,iCAAiC,MAAM,SAAS,YAAY,EAAE,OAC9D,mBAAmB,MAAM,SAAS,YAAY,EAAE;AAAA,IACpD,SAAS;AAAA,IACT,QAAQ;AAAA,MACN,SAAS;AAAA,MACT;AAAA,MACA,OAAO,YAAY;AAAA,MACnB,WAAW;AAAA,MACX;AAAA,MACA,WAAW;AAAA,MACX,GAAI,aAAa,EAAE,WAAW,IAAI,CAAC;AAAA,IACrC;AAAA,IACA,MAAM;AAAA,MACJ,YAAY;AAAA,MACZ,WAAW;AAAA,MACX;AAAA,MACA,OAAO,YAAY;AAAA,MACnB;AAAA,MACA,GAAI,aAAa,EAAE,WAAW,IAAI,CAAC;AAAA,IACrC;AAAA,EACF;AACF;","names":[]}

package/dist/actions/browser.d.ts

@@ -1,12 +1,11 @@
 import type { Action } from "@elizaos/core";
 /**
  * Targets are the registered browser backends. The agent uses what is
- * available; specifying a target overrides the default. `workspace` is the
- * current default (electrobun-embedded BrowserView with JSDOM fallback).
- * `bridge` (Chrome/Safari companion) and `computeruse` (puppeteer Chromium)
- * are reserved for the BrowserService target-registry refactor — see
- * follow-up work.
+ * available; specifying a target overrides automatic routing. `workspace`
+ * is the app-owned browser surface, `bridge` is the paired Chrome/Safari
+ * companion, `stagehand` is the Playwright/Stagehand fallback, and other
+ * plugins may register additional target ids.
  */
-export type BrowserTarget = "workspace" | "bridge" | "computeruse";
+export type BrowserTarget = string;
 export declare const browserAction: Action;
 //# sourceMappingURL=browser.d.ts.map

package/dist/actions/browser.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"browser.d.ts","sourceRoot":"","sources":["../../src/actions/browser.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,EACV,MAAM,EAIP,MAAM,eAAe,CAAC;AAavB;;;;;;;GAOG;AACH,MAAM,MAAM,aAAa,GAAG,WAAW,GAAG,QAAQ,GAAG,aAAa,CAAC;AAyNnE,eAAO,MAAM,aAAa,EAAE,MAqU3B,CAAC"}
+{"version":3,"file":"browser.d.ts","sourceRoot":"","sources":["../../src/actions/browser.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,EACV,MAAM,EAIP,MAAM,eAAe,CAAC;AAYvB;;;;;;GAMG;AACH,MAAM,MAAM,aAAa,GAAG,MAAM,CAAC;AA2SnC,eAAO,MAAM,aAAa,EAAE,MAyS3B,CAAC"}

package/dist/actions/browser.js

@@ -2,7 +2,6 @@ import { logger } from "@elizaos/core";
 import {
   BROWSER_SERVICE_TYPE
 } from "../browser-service.js";
-import { executeBrowserAutofillLogin } from "./browser-autofill-login.js";
 import {
   executeBrowserWorkspaceCommand,
   getBrowserWorkspaceMode
@@ -19,10 +18,11 @@ function extractFirstUrl(value) {
   return match?.[0] ?? null;
 }
 function inferBrowserSubaction(params, messageText) {
-  if (params?.action === "autofill-login" || params?.subaction === "autofill-login") {
+  const normalizedAction = normalizeBrowserAction(params?.action);
+  if (normalizedAction === "autofill-login" || params?.subaction === "autofill-login") {
     return "autofill-login";
   }
-  const legacySubaction = normalizeLegacyBrowserAction(params?.action);
+  const legacySubaction = normalizeLegacyBrowserAction(normalizedAction);
   if (legacySubaction) {
     return legacySubaction;
   }
@@ -44,8 +44,29 @@ function inferBrowserSubaction(params, messageText) {
   }
   return "state";
 }
-function normalizeLegacyBrowserAction(action) {
+function normalizeBrowserAction(action) {
   switch (action) {
+    case "realistic_click":
+      return "realistic-click";
+    case "realistic_fill":
+      return "realistic-fill";
+    case "realistic_type":
+      return "realistic-type";
+    case "realistic_press":
+      return "realistic-press";
+    case "cursor_move":
+      return "cursor-move";
+    case "cursor_hide":
+      return "cursor-hide";
+    case "autofill_login":
+      return "autofill-login";
+    default:
+      return action;
+  }
+}
+function normalizeLegacyBrowserAction(action) {
+  const normalizedAction = normalizeBrowserAction(action);
+  switch (normalizedAction) {
     case "info":
     case "context":
     case "get_context":
@@ -60,11 +81,14 @@ function normalizeLegacyBrowserAction(action) {
     case void 0:
       return void 0;
     default:
-      return action;
+      return isWorkspaceSubaction(normalizedAction) ? normalizedAction : void 0;
   }
 }
+function isWorkspaceSubaction(action) {
+  return action === "back" || action === "click" || action === "close" || action === "forward" || action === "get" || action === "hide" || action === "navigate" || action === "open" || action === "press" || action === "reload" || action === "screenshot" || action === "show" || action === "snapshot" || action === "state" || action === "tab" || action === "type" || action === "wait" || action === "realistic-click" || action === "realistic-fill" || action === "realistic-type" || action === "realistic-press" || action === "cursor-move" || action === "cursor-hide";
+}
 function normalizeLegacyTabAction(action) {
-  switch (action) {
+  switch (normalizeBrowserAction(action)) {
     case "list_tabs":
       return "list";
     case "open_tab":
@@ -115,7 +139,6 @@ const browserAction = {
     "CONTROL_BROWSER",
     "CONTROL_BROWSER_SESSION",
     "MANAGE_ELIZA_BROWSER_WORKSPACE",
-    "MANAGE_LIFEOPS_BROWSER",
     "NAVIGATE_SITE",
     "OPEN_SITE",
     "USE_BROWSER",
@@ -128,14 +151,15 @@ const browserAction = {
     "LOG_INTO_SITE",
     "SIGN_IN_TO_SITE"
   ],
-  description: "Single BROWSER action \u2014 control whichever browser target is registered. Targets are pluggable: `workspace` (electrobun-embedded BrowserView, the default; falls back to a JSDOM web mode when the desktop bridge isn't configured), `bridge` (the user's real Chrome/Safari via the Agent Browser Bridge companion extension), and `computeruse` (a local puppeteer-driven Chromium via plugin-computeruse). The agent uses what is available \u2014 the BrowserService picks the active target when none is specified. Use `subaction: \"autofill-login\"` with `domain` (and optional `username`, `submit`) to vault-gated autofill into an open workspace tab.",
-  descriptionCompressed: "Browser tab/page control: open/navigate/click/type/screenshot/state; subaction autofill-login + domain autofill vault-gated credential into workspace tab pre-authorized in Settings Vault Logins. Bridge settings/status use MANAGE_BROWSER_BRIDGE.",
+  description: "BROWSER action. Control registered browser target: app workspace, bridge Chrome/Safari companion, computeruse Chromium, or Stagehand fallback. BrowserService picks target if omitted. action=autofill_login + domain vault-gated autofills open workspace tab.",
+  descriptionCompressed: "Browser open|navigate|click|type|screenshot|state|autofill_login; bridge status elsewhere",
   validate: async () => true,
   handler: async (runtime, message, _state, options) => {
     const params = options?.parameters;
     const messageText = getMessageText(message);
     const subaction = inferBrowserSubaction(params, messageText);
     if (subaction === "autofill-login") {
+      const { executeBrowserAutofillLogin } = await import("./browser-autofill-login.js");
       return executeBrowserAutofillLogin(runtime, message, options);
     }
     const url = params?.url?.trim() || extractFirstUrl(messageText) || void 0;
@@ -148,6 +172,7 @@ const browserAction = {
       subaction,
       tabAction: params?.tabAction ?? normalizeLegacyTabAction(params?.action),
       text: params?.text,
+      value: params?.text,
       timeoutMs: params?.timeoutMs,
       url,
       cursorDurationMs: params?.cursorDurationMs,
@@ -156,9 +181,7 @@ const browserAction = {
       x: params?.x,
       y: params?.y
     };
-    const browserService = runtime.getService(
-      BROWSER_SERVICE_TYPE
-    );
+    const browserService = runtime.getService(BROWSER_SERVICE_TYPE);
     try {
       logger.info(
         `[BROWSER] ${command.subaction} via target=${params?.target ?? "auto"} (workspace mode=${getBrowserWorkspaceMode(process.env)})`
@@ -193,9 +216,15 @@ const browserAction = {
     }
   },
   parameters: [
+    {
+      name: "target",
+      description: "Optional browser target id. Common values: workspace, bridge, computeruse, stagehand.",
+      required: false,
+      schema: { type: "string" }
+    },
     {
       name: "action",
-      description: "Browser action to perform. Legacy subaction is also accepted.",
+      description: "Browser action. Snake_case canonical; legacy kebab-case and subaction accepted.",
       required: false,
       schema: {
         type: "string",
@@ -224,47 +253,13 @@ const browserAction = {
           "wait",
           "close_tab",
           "switch_tab",
-          "realistic-click",
-          "realistic-fill",
-          "realistic-type",
-          "realistic-press",
-          "cursor-move",
-          "cursor-hide",
-          "autofill-login"
-        ]
-      }
-    },
-    {
-      name: "subaction",
-      description: "Legacy alias for action.",
-      required: false,
-      schema: {
-        type: "string",
-        enum: [
-          "back",
-          "click",
-          "close",
-          "forward",
-          "get",
-          "hide",
-          "navigate",
-          "open",
-          "press",
-          "reload",
-          "screenshot",
-          "show",
-          "snapshot",
-          "state",
-          "tab",
-          "type",
-          "wait",
-          "realistic-click",
-          "realistic-fill",
-          "realistic-type",
-          "realistic-press",
-          "cursor-move",
-          "cursor-hide",
-          "autofill-login"
+          "realistic_click",
+          "realistic_fill",
+          "realistic_type",
+          "realistic_press",
+          "cursor_move",
+          "cursor_hide",
+          "autofill_login"
         ]
       }
     },
@@ -279,19 +274,19 @@ const browserAction = {
     },
     {
       name: "domain",
-      description: "Required when subaction is autofill-login: registrable hostname (e.g. `github.com`).",
+      description: "Required for action=autofill_login: registrable hostname, e.g. github.com.",
       required: false,
       schema: { type: "string" }
     },
     {
       name: "username",
-      description: "When using autofill-login: specific saved login; omit for most recently modified.",
+      description: "For autofill-login: saved login username; omit for latest.",
       required: false,
       schema: { type: "string" }
     },
     {
       name: "submit",
-      description: "When using autofill-login: submit the form after filling (default false).",
+      description: "For autofill-login: submit after filling. Default false.",
       required: false,
       schema: { type: "boolean" }
     },
@@ -345,7 +340,7 @@ const browserAction = {
     },
     {
       name: "watchMode",
-      description: "Hint that the user is watching; prefers realistic-* subactions for click/fill so the cursor moves visibly and pointer events fire faithfully.",
+      description: "User watching hint; prefer realistic-* click/fill, visible cursor, pointer events.",
       required: false,
       schema: { type: "boolean" }
     },
@@ -363,7 +358,7 @@ const browserAction = {
     },
     {
       name: "replace",
-      description: "Replace existing input value when filling (vs append) \u2014 applies to realistic-fill",
+      description: "For realistic-fill: replace existing input, not append.",
       required: false,
       schema: { type: "boolean" }
     },