clawdbot 2026.1.4-1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +120 -0
- package/LICENSE +21 -0
- package/README-header.png +0 -0
- package/README.md +297 -0
- package/dist/agents/agent-paths.js +17 -0
- package/dist/agents/bash-process-registry.js +126 -0
- package/dist/agents/bash-tools.js +837 -0
- package/dist/agents/clawdbot-tools.js +30 -0
- package/dist/agents/clawdis-tools.js +27 -0
- package/dist/agents/context.js +34 -0
- package/dist/agents/defaults.js +6 -0
- package/dist/agents/model-auth.js +112 -0
- package/dist/agents/model-catalog.js +55 -0
- package/dist/agents/model-fallback.js +191 -0
- package/dist/agents/model-scan.js +263 -0
- package/dist/agents/model-selection.js +116 -0
- package/dist/agents/models-config.js +49 -0
- package/dist/agents/pi-embedded-helpers.js +74 -0
- package/dist/agents/pi-embedded-runner.js +407 -0
- package/dist/agents/pi-embedded-subscribe.js +568 -0
- package/dist/agents/pi-embedded-utils.js +20 -0
- package/dist/agents/pi-embedded.js +1 -0
- package/dist/agents/pi-oauth.js +88 -0
- package/dist/agents/pi-tools.js +433 -0
- package/dist/agents/sandbox-paths.js +68 -0
- package/dist/agents/sandbox.js +644 -0
- package/dist/agents/shell-utils.js +53 -0
- package/dist/agents/skills-install.js +244 -0
- package/dist/agents/skills-status.js +157 -0
- package/dist/agents/skills.js +470 -0
- package/dist/agents/steerable-agent-loop.js +338 -0
- package/dist/agents/steerable-provider-transport.js +48 -0
- package/dist/agents/system-prompt.js +104 -0
- package/dist/agents/tool-display.js +162 -0
- package/dist/agents/tool-images.js +138 -0
- package/dist/agents/tools/browser-tool.js +339 -0
- package/dist/agents/tools/canvas-tool.js +193 -0
- package/dist/agents/tools/common.js +88 -0
- package/dist/agents/tools/cron-tool.js +124 -0
- package/dist/agents/tools/discord-actions-guild.js +186 -0
- package/dist/agents/tools/discord-actions-messaging.js +285 -0
- package/dist/agents/tools/discord-actions-moderation.js +70 -0
- package/dist/agents/tools/discord-actions.js +56 -0
- package/dist/agents/tools/discord-schema.js +199 -0
- package/dist/agents/tools/discord-tool.js +16 -0
- package/dist/agents/tools/gateway-tool.js +46 -0
- package/dist/agents/tools/gateway.js +27 -0
- package/dist/agents/tools/image-tool.js +132 -0
- package/dist/agents/tools/nodes-tool.js +413 -0
- package/dist/agents/tools/nodes-utils.js +92 -0
- package/dist/agents/tools/sessions-helpers.js +88 -0
- package/dist/agents/tools/sessions-history-tool.js +53 -0
- package/dist/agents/tools/sessions-list-tool.js +143 -0
- package/dist/agents/tools/sessions-send-helpers.js +100 -0
- package/dist/agents/tools/sessions-send-tool.js +347 -0
- package/dist/agents/tools/slack-actions.js +129 -0
- package/dist/agents/tools/slack-schema.js +59 -0
- package/dist/agents/tools/slack-tool.js +16 -0
- package/dist/agents/usage.js +39 -0
- package/dist/agents/workspace.js +241 -0
- package/dist/auto-reply/chunk.js +76 -0
- package/dist/auto-reply/envelope.js +38 -0
- package/dist/auto-reply/group-activation.js +20 -0
- package/dist/auto-reply/heartbeat.js +57 -0
- package/dist/auto-reply/model.js +14 -0
- package/dist/auto-reply/reply/abort.js +14 -0
- package/dist/auto-reply/reply/agent-runner.js +371 -0
- package/dist/auto-reply/reply/block-streaming.js +34 -0
- package/dist/auto-reply/reply/body.js +29 -0
- package/dist/auto-reply/reply/commands.js +207 -0
- package/dist/auto-reply/reply/directive-handling.js +361 -0
- package/dist/auto-reply/reply/directives.js +47 -0
- package/dist/auto-reply/reply/followup-runner.js +149 -0
- package/dist/auto-reply/reply/groups.js +91 -0
- package/dist/auto-reply/reply/mentions.js +38 -0
- package/dist/auto-reply/reply/model-selection.js +114 -0
- package/dist/auto-reply/reply/queue.js +399 -0
- package/dist/auto-reply/reply/reply-tags.js +26 -0
- package/dist/auto-reply/reply/session-updates.js +87 -0
- package/dist/auto-reply/reply/session.js +160 -0
- package/dist/auto-reply/reply/typing.js +75 -0
- package/dist/auto-reply/reply.js +535 -0
- package/dist/auto-reply/send-policy.js +28 -0
- package/dist/auto-reply/status.js +158 -0
- package/dist/auto-reply/templating.js +9 -0
- package/dist/auto-reply/thinking.js +49 -0
- package/dist/auto-reply/tokens.js +2 -0
- package/dist/auto-reply/tool-meta.js +74 -0
- package/dist/auto-reply/transcription.js +57 -0
- package/dist/auto-reply/types.js +1 -0
- package/dist/browser/bridge-server.js +37 -0
- package/dist/browser/cdp.js +382 -0
- package/dist/browser/chrome.js +432 -0
- package/dist/browser/client-actions-core.js +67 -0
- package/dist/browser/client-actions-observe.js +24 -0
- package/dist/browser/client-actions-types.js +1 -0
- package/dist/browser/client-actions.js +3 -0
- package/dist/browser/client-fetch.js +43 -0
- package/dist/browser/client.js +105 -0
- package/dist/browser/config.js +140 -0
- package/dist/browser/constants.js +4 -0
- package/dist/browser/profiles-service.js +122 -0
- package/dist/browser/profiles.js +85 -0
- package/dist/browser/pw-ai.js +2 -0
- package/dist/browser/pw-session.js +144 -0
- package/dist/browser/pw-tools-core.js +363 -0
- package/dist/browser/routes/agent.js +535 -0
- package/dist/browser/routes/basic.js +155 -0
- package/dist/browser/routes/index.js +8 -0
- package/dist/browser/routes/tabs.js +105 -0
- package/dist/browser/routes/utils.js +62 -0
- package/dist/browser/screenshot.js +40 -0
- package/dist/browser/server-context.js +377 -0
- package/dist/browser/server.js +81 -0
- package/dist/browser/target-id.js +18 -0
- package/dist/browser/trash.js +21 -0
- package/dist/canvas-host/a2ui/.bundle.hash +1 -0
- package/dist/canvas-host/a2ui/a2ui.bundle.js +17768 -0
- package/dist/canvas-host/a2ui/index.html +246 -0
- package/dist/canvas-host/a2ui.js +187 -0
- package/dist/canvas-host/server.js +382 -0
- package/dist/cli/browser-cli-actions-input.js +459 -0
- package/dist/cli/browser-cli-actions-observe.js +56 -0
- package/dist/cli/browser-cli-examples.js +31 -0
- package/dist/cli/browser-cli-inspect.js +97 -0
- package/dist/cli/browser-cli-manage.js +286 -0
- package/dist/cli/browser-cli-shared.js +1 -0
- package/dist/cli/browser-cli.js +26 -0
- package/dist/cli/canvas-cli.js +416 -0
- package/dist/cli/cron-cli.js +454 -0
- package/dist/cli/deps.js +17 -0
- package/dist/cli/dns-cli.js +180 -0
- package/dist/cli/gateway-cli.js +489 -0
- package/dist/cli/gateway-rpc.js +20 -0
- package/dist/cli/hooks-cli.js +135 -0
- package/dist/cli/models-cli.js +248 -0
- package/dist/cli/nodes-camera.js +57 -0
- package/dist/cli/nodes-canvas.js +26 -0
- package/dist/cli/nodes-cli.js +946 -0
- package/dist/cli/nodes-screen.js +37 -0
- package/dist/cli/parse-duration.js +20 -0
- package/dist/cli/ports.js +97 -0
- package/dist/cli/program.js +406 -0
- package/dist/cli/prompt.js +19 -0
- package/dist/cli/tui-cli.js +35 -0
- package/dist/cli/wait.js +8 -0
- package/dist/commands/agent.js +645 -0
- package/dist/commands/antigravity-oauth.js +327 -0
- package/dist/commands/configure.js +480 -0
- package/dist/commands/doctor.js +484 -0
- package/dist/commands/health.js +108 -0
- package/dist/commands/models/aliases.js +64 -0
- package/dist/commands/models/fallbacks.js +99 -0
- package/dist/commands/models/image-fallbacks.js +99 -0
- package/dist/commands/models/list.js +323 -0
- package/dist/commands/models/scan.js +266 -0
- package/dist/commands/models/set-image.js +23 -0
- package/dist/commands/models/set.js +23 -0
- package/dist/commands/models/shared.js +72 -0
- package/dist/commands/models.js +7 -0
- package/dist/commands/onboard-auth.js +70 -0
- package/dist/commands/onboard-helpers.js +295 -0
- package/dist/commands/onboard-interactive.js +17 -0
- package/dist/commands/onboard-non-interactive.js +202 -0
- package/dist/commands/onboard-providers.js +634 -0
- package/dist/commands/onboard-remote.js +120 -0
- package/dist/commands/onboard-skills.js +148 -0
- package/dist/commands/onboard-types.js +1 -0
- package/dist/commands/onboard.js +12 -0
- package/dist/commands/send.js +124 -0
- package/dist/commands/sessions.js +212 -0
- package/dist/commands/setup.js +58 -0
- package/dist/commands/signal-install.js +135 -0
- package/dist/commands/status.js +207 -0
- package/dist/commands/update.js +16 -0
- package/dist/config/config.js +6 -0
- package/dist/config/defaults.js +61 -0
- package/dist/config/io.js +147 -0
- package/dist/config/legacy-migrate.js +13 -0
- package/dist/config/legacy.js +159 -0
- package/dist/config/paths.js +71 -0
- package/dist/config/schema.js +150 -0
- package/dist/config/sessions.js +282 -0
- package/dist/config/talk.js +31 -0
- package/dist/config/types.js +1 -0
- package/dist/config/validation.js +29 -0
- package/dist/config/zod-schema.js +831 -0
- package/dist/control-ui/assets/index-BFID3yAA.css +1 -0
- package/dist/control-ui/assets/index-CE_axlTS.js +2235 -0
- package/dist/control-ui/assets/index-CE_axlTS.js.map +1 -0
- package/dist/control-ui/index.html +15 -0
- package/dist/cron/isolated-agent.js +499 -0
- package/dist/cron/run-log.js +72 -0
- package/dist/cron/schedule.js +24 -0
- package/dist/cron/service.js +471 -0
- package/dist/cron/store.js +43 -0
- package/dist/cron/types.js +1 -0
- package/dist/daemon/constants.js +10 -0
- package/dist/daemon/launchd.js +276 -0
- package/dist/daemon/legacy.js +63 -0
- package/dist/daemon/program-args.js +76 -0
- package/dist/daemon/schtasks.js +257 -0
- package/dist/daemon/service.js +60 -0
- package/dist/daemon/systemd.js +266 -0
- package/dist/discord/index.js +2 -0
- package/dist/discord/monitor.js +1188 -0
- package/dist/discord/probe.js +54 -0
- package/dist/discord/send.js +577 -0
- package/dist/discord/token.js +8 -0
- package/dist/gateway/auth.js +121 -0
- package/dist/gateway/call.js +94 -0
- package/dist/gateway/chat-attachments.js +41 -0
- package/dist/gateway/client.js +180 -0
- package/dist/gateway/config-reload.js +274 -0
- package/dist/gateway/control-ui.js +184 -0
- package/dist/gateway/hooks-mapping.js +282 -0
- package/dist/gateway/hooks.js +168 -0
- package/dist/gateway/net.js +29 -0
- package/dist/gateway/protocol/index.js +61 -0
- package/dist/gateway/protocol/schema.js +560 -0
- package/dist/gateway/server-bridge-subscriptions.js +93 -0
- package/dist/gateway/server-bridge.js +1013 -0
- package/dist/gateway/server-browser.js +12 -0
- package/dist/gateway/server-chat.js +159 -0
- package/dist/gateway/server-constants.js +8 -0
- package/dist/gateway/server-discovery.js +62 -0
- package/dist/gateway/server-http.js +165 -0
- package/dist/gateway/server-methods/agent-job.js +125 -0
- package/dist/gateway/server-methods/agent.js +250 -0
- package/dist/gateway/server-methods/chat.js +200 -0
- package/dist/gateway/server-methods/config.js +50 -0
- package/dist/gateway/server-methods/connect.js +6 -0
- package/dist/gateway/server-methods/cron.js +83 -0
- package/dist/gateway/server-methods/health.js +28 -0
- package/dist/gateway/server-methods/models.js +16 -0
- package/dist/gateway/server-methods/nodes.js +294 -0
- package/dist/gateway/server-methods/providers.js +217 -0
- package/dist/gateway/server-methods/send.js +166 -0
- package/dist/gateway/server-methods/sessions.js +305 -0
- package/dist/gateway/server-methods/skills.js +83 -0
- package/dist/gateway/server-methods/system.js +118 -0
- package/dist/gateway/server-methods/talk.js +22 -0
- package/dist/gateway/server-methods/types.js +1 -0
- package/dist/gateway/server-methods/voicewake.js +30 -0
- package/dist/gateway/server-methods/web.js +58 -0
- package/dist/gateway/server-methods/wizard.js +100 -0
- package/dist/gateway/server-methods.js +53 -0
- package/dist/gateway/server-providers.js +644 -0
- package/dist/gateway/server-shared.js +1 -0
- package/dist/gateway/server-utils.js +35 -0
- package/dist/gateway/server.js +1437 -0
- package/dist/gateway/session-utils.js +216 -0
- package/dist/gateway/ws-log.js +349 -0
- package/dist/gateway/ws-logging.js +8 -0
- package/dist/globals.js +41 -0
- package/dist/hooks/gmail-ops.js +236 -0
- package/dist/hooks/gmail-setup-utils.js +278 -0
- package/dist/hooks/gmail-watcher.js +175 -0
- package/dist/hooks/gmail.js +177 -0
- package/dist/imessage/client.js +165 -0
- package/dist/imessage/index.js +3 -0
- package/dist/imessage/monitor.js +272 -0
- package/dist/imessage/probe.js +26 -0
- package/dist/imessage/send.js +83 -0
- package/dist/imessage/targets.js +176 -0
- package/dist/index.js +50 -0
- package/dist/infra/agent-events.js +46 -0
- package/dist/infra/binaries.js +9 -0
- package/dist/infra/bonjour-discovery.js +163 -0
- package/dist/infra/bonjour.js +200 -0
- package/dist/infra/bridge/server.js +562 -0
- package/dist/infra/canvas-host-url.js +54 -0
- package/dist/infra/env.js +8 -0
- package/dist/infra/errors.js +28 -0
- package/dist/infra/gateway-lock.js +8 -0
- package/dist/infra/heartbeat-events.js +21 -0
- package/dist/infra/heartbeat-runner.js +453 -0
- package/dist/infra/heartbeat-wake.js +61 -0
- package/dist/infra/is-main.js +37 -0
- package/dist/infra/machine-name.js +40 -0
- package/dist/infra/node-pairing.js +211 -0
- package/dist/infra/pam.js +42 -0
- package/dist/infra/path-env.js +92 -0
- package/dist/infra/ports.js +87 -0
- package/dist/infra/provider-summary.js +80 -0
- package/dist/infra/restart.js +29 -0
- package/dist/infra/retry.js +16 -0
- package/dist/infra/runtime-guard.js +59 -0
- package/dist/infra/system-events.js +44 -0
- package/dist/infra/system-presence.js +216 -0
- package/dist/infra/tailnet.js +46 -0
- package/dist/infra/tailscale.js +149 -0
- package/dist/infra/voicewake.js +77 -0
- package/dist/infra/widearea-dns.js +123 -0
- package/dist/infra/ws.js +13 -0
- package/dist/logger.js +52 -0
- package/dist/logging.js +490 -0
- package/dist/macos/gateway-daemon.js +141 -0
- package/dist/macos/relay.js +46 -0
- package/dist/media/constants.js +33 -0
- package/dist/media/host.js +42 -0
- package/dist/media/image-ops.js +121 -0
- package/dist/media/mime.js +115 -0
- package/dist/media/parse.js +81 -0
- package/dist/media/server.js +64 -0
- package/dist/media/store.js +139 -0
- package/dist/process/command-queue.js +97 -0
- package/dist/process/exec.js +75 -0
- package/dist/protocol.schema.json +2918 -0
- package/dist/provider-web.js +8 -0
- package/dist/providers/web/index.js +2 -0
- package/dist/runtime.js +8 -0
- package/dist/sessions/send-policy.js +68 -0
- package/dist/signal/client.js +134 -0
- package/dist/signal/daemon.js +69 -0
- package/dist/signal/index.js +3 -0
- package/dist/signal/monitor.js +336 -0
- package/dist/signal/probe.js +46 -0
- package/dist/signal/send.js +91 -0
- package/dist/slack/actions.js +97 -0
- package/dist/slack/index.js +5 -0
- package/dist/slack/monitor.js +1029 -0
- package/dist/slack/probe.js +47 -0
- package/dist/slack/send.js +131 -0
- package/dist/slack/token.js +10 -0
- package/dist/telegram/bot.js +394 -0
- package/dist/telegram/download.js +34 -0
- package/dist/telegram/index.js +4 -0
- package/dist/telegram/monitor.js +47 -0
- package/dist/telegram/probe.js +63 -0
- package/dist/telegram/proxy.js +9 -0
- package/dist/telegram/send.js +138 -0
- package/dist/telegram/token.js +30 -0
- package/dist/telegram/webhook-set.js +12 -0
- package/dist/telegram/webhook.js +56 -0
- package/dist/tui/commands.js +74 -0
- package/dist/tui/components/assistant-message.js +16 -0
- package/dist/tui/components/chat-log.js +92 -0
- package/dist/tui/components/custom-editor.js +53 -0
- package/dist/tui/components/selectors.js +8 -0
- package/dist/tui/components/tool-execution.js +111 -0
- package/dist/tui/components/user-message.js +17 -0
- package/dist/tui/gateway-chat.js +140 -0
- package/dist/tui/layout.js +41 -0
- package/dist/tui/message-list.js +57 -0
- package/dist/tui/theme/theme.js +80 -0
- package/dist/tui/theme.js +25 -0
- package/dist/tui/tui.js +708 -0
- package/dist/utils.js +133 -0
- package/dist/version.js +18 -0
- package/dist/web/active-listener.js +7 -0
- package/dist/web/auto-reply.js +1203 -0
- package/dist/web/inbound.js +481 -0
- package/dist/web/login-qr.js +204 -0
- package/dist/web/login.js +59 -0
- package/dist/web/media.js +148 -0
- package/dist/web/outbound.js +67 -0
- package/dist/web/qr-image.js +97 -0
- package/dist/web/reconnect.js +60 -0
- package/dist/web/reply-heartbeat-wake.js +61 -0
- package/dist/web/session.js +346 -0
- package/dist/wizard/clack-prompter.js +56 -0
- package/dist/wizard/onboarding.js +452 -0
- package/dist/wizard/prompts.js +6 -0
- package/dist/wizard/session.js +203 -0
- package/docs/AGENTS.default.md +116 -0
- package/docs/CNAME +1 -0
- package/docs/RELEASING.md +64 -0
- package/docs/_config.yml +51 -0
- package/docs/_layouts/default.html +145 -0
- package/docs/agent-send.md +21 -0
- package/docs/agent.md +104 -0
- package/docs/android/connect.md +131 -0
- package/docs/architecture.md +89 -0
- package/docs/assets/markdown.css +130 -0
- package/docs/assets/pixel-lobster.svg +60 -0
- package/docs/assets/terminal.css +497 -0
- package/docs/assets/theme.js +55 -0
- package/docs/audio.md +50 -0
- package/docs/background-process.md +74 -0
- package/docs/bash.md +32 -0
- package/docs/bonjour.md +159 -0
- package/docs/browser.md +289 -0
- package/docs/camera.md +152 -0
- package/docs/clawd.md +199 -0
- package/docs/clawdbot-mac.md +104 -0
- package/docs/configuration.md +1177 -0
- package/docs/control-api.md +49 -0
- package/docs/control-ui.md +83 -0
- package/docs/cron.md +374 -0
- package/docs/dashboard.md +17 -0
- package/docs/device-models.md +46 -0
- package/docs/discord.md +293 -0
- package/docs/discovery.md +112 -0
- package/docs/docker.md +251 -0
- package/docs/docs.json +86 -0
- package/docs/doctor.md +47 -0
- package/docs/elevated.md +31 -0
- package/docs/faq.md +640 -0
- package/docs/gateway/pairing.md +109 -0
- package/docs/gateway-lock.md +28 -0
- package/docs/gateway.md +174 -0
- package/docs/gmail-pubsub.md +191 -0
- package/docs/grammy.md +27 -0
- package/docs/group-messages.md +71 -0
- package/docs/groups.md +78 -0
- package/docs/health.md +28 -0
- package/docs/heartbeat.md +64 -0
- package/docs/images.md +52 -0
- package/docs/imessage.md +63 -0
- package/docs/index.md +182 -0
- package/docs/ios/connect.md +177 -0
- package/docs/ios/spec.md +236 -0
- package/docs/location-command.md +95 -0
- package/docs/logging.md +99 -0
- package/docs/lore.md +131 -0
- package/docs/mac/bun.md +133 -0
- package/docs/mac/canvas.md +161 -0
- package/docs/mac/child-process.md +72 -0
- package/docs/mac/dev-setup.md +81 -0
- package/docs/mac/health.md +28 -0
- package/docs/mac/icon.md +26 -0
- package/docs/mac/logging.md +51 -0
- package/docs/mac/menu-bar.md +69 -0
- package/docs/mac/peekaboo.md +170 -0
- package/docs/mac/permissions.md +40 -0
- package/docs/mac/release.md +76 -0
- package/docs/mac/remote.md +57 -0
- package/docs/mac/signing.md +41 -0
- package/docs/mac/skills.md +27 -0
- package/docs/mac/voice-overlay.md +52 -0
- package/docs/mac/voicewake.md +56 -0
- package/docs/mac/webchat.md +27 -0
- package/docs/mac/xpc.md +40 -0
- package/docs/models.md +90 -0
- package/docs/nix.md +49 -0
- package/docs/nodes.md +157 -0
- package/docs/onboarding-config-protocol.md +29 -0
- package/docs/onboarding.md +185 -0
- package/docs/presence.md +133 -0
- package/docs/queue.md +78 -0
- package/docs/refactor/browser-control-simplification.md +58 -0
- package/docs/refactor/canvas-a2ui.md +93 -0
- package/docs/refactor/cli-unification.md +64 -0
- package/docs/refactor/gateway-client.md +31 -0
- package/docs/refactor/gateway.md +99 -0
- package/docs/refactor/new-arch.md +171 -0
- package/docs/refactor/tui.md +26 -0
- package/docs/refactor/web-gateway-troubleshooting.md +37 -0
- package/docs/refactor/webagent-session.md +46 -0
- package/docs/remote-gateway-readme.md +148 -0
- package/docs/remote.md +66 -0
- package/docs/research/memory.md +227 -0
- package/docs/rpc.md +35 -0
- package/docs/security.md +168 -0
- package/docs/session-tool.md +119 -0
- package/docs/session.md +84 -0
- package/docs/sessions.md +8 -0
- package/docs/setup.md +118 -0
- package/docs/signal.md +113 -0
- package/docs/skills-config.md +58 -0
- package/docs/skills.md +149 -0
- package/docs/slack.md +158 -0
- package/docs/surface.md +20 -0
- package/docs/tailscale.md +71 -0
- package/docs/talk.md +79 -0
- package/docs/telegram.md +90 -0
- package/docs/templates/AGENTS.md +126 -0
- package/docs/templates/BOOTSTRAP.md +53 -0
- package/docs/templates/IDENTITY.md +17 -0
- package/docs/templates/SOUL.md +41 -0
- package/docs/templates/TOOLS.md +41 -0
- package/docs/templates/USER.md +22 -0
- package/docs/test.md +35 -0
- package/docs/thinking.md +46 -0
- package/docs/tools.md +248 -0
- package/docs/troubleshooting.md +227 -0
- package/docs/tui.md +69 -0
- package/docs/typebox.md +42 -0
- package/docs/voicewake.md +61 -0
- package/docs/web.md +115 -0
- package/docs/webchat.md +34 -0
- package/docs/webhook.md +132 -0
- package/docs/whatsapp-clawd.jpg +0 -0
- package/docs/whatsapp.md +142 -0
- package/docs/wizard.md +158 -0
- package/package.json +186 -0
- package/skills/apple-notes/SKILL.md +50 -0
- package/skills/apple-reminders/SKILL.md +67 -0
- package/skills/bear-notes/SKILL.md +79 -0
- package/skills/bird/SKILL.md +25 -0
- package/skills/blogwatcher/SKILL.md +46 -0
- package/skills/blucli/SKILL.md +27 -0
- package/skills/brave-search/SKILL.md +30 -0
- package/skills/brave-search/scripts/content.mjs +53 -0
- package/skills/brave-search/scripts/search.mjs +79 -0
- package/skills/camsnap/SKILL.md +25 -0
- package/skills/clawdhub/SKILL.md +53 -0
- package/skills/coding-agent/SKILL.md +275 -0
- package/skills/discord/SKILL.md +369 -0
- package/skills/eightctl/SKILL.md +29 -0
- package/skills/food-order/SKILL.md +41 -0
- package/skills/gemini/SKILL.md +23 -0
- package/skills/gifgrep/SKILL.md +47 -0
- package/skills/github/SKILL.md +47 -0
- package/skills/gog/SKILL.md +36 -0
- package/skills/goplaces/SKILL.md +30 -0
- package/skills/imsg/SKILL.md +25 -0
- package/skills/local-places/SERVER_README.md +101 -0
- package/skills/local-places/SKILL.md +91 -0
- package/skills/local-places/pyproject.toml +27 -0
- package/skills/local-places/src/local_places/__init__.py +2 -0
- package/skills/local-places/src/local_places/__pycache__/__init__.cpython-314.pyc +0 -0
- package/skills/local-places/src/local_places/__pycache__/google_places.cpython-314.pyc +0 -0
- package/skills/local-places/src/local_places/__pycache__/main.cpython-314.pyc +0 -0
- package/skills/local-places/src/local_places/__pycache__/schemas.cpython-314.pyc +0 -0
- package/skills/local-places/src/local_places/google_places.py +314 -0
- package/skills/local-places/src/local_places/main.py +65 -0
- package/skills/local-places/src/local_places/schemas.py +107 -0
- package/skills/mcporter/SKILL.md +38 -0
- package/skills/nano-banana-pro/SKILL.md +29 -0
- package/skills/nano-banana-pro/scripts/generate_image.py +167 -0
- package/skills/nano-pdf/SKILL.md +20 -0
- package/skills/notion/SKILL.md +156 -0
- package/skills/obsidian/SKILL.md +55 -0
- package/skills/openai-image-gen/SKILL.md +31 -0
- package/skills/openai-image-gen/scripts/gen.py +173 -0
- package/skills/openai-whisper/SKILL.md +19 -0
- package/skills/openai-whisper-api/SKILL.md +43 -0
- package/skills/openai-whisper-api/scripts/transcribe.sh +85 -0
- package/skills/openhue/SKILL.md +30 -0
- package/skills/oracle/SKILL.md +105 -0
- package/skills/ordercli/SKILL.md +47 -0
- package/skills/peekaboo/SKILL.md +153 -0
- package/skills/qmd/SKILL.md +26 -0
- package/skills/sag/SKILL.md +62 -0
- package/skills/slack/SKILL.md +143 -0
- package/skills/songsee/SKILL.md +29 -0
- package/skills/sonoscli/SKILL.md +26 -0
- package/skills/spotify-player/SKILL.md +34 -0
- package/skills/summarize/SKILL.md +49 -0
- package/skills/things-mac/SKILL.md +61 -0
- package/skills/tmux/SKILL.md +121 -0
- package/skills/tmux/scripts/find-sessions.sh +112 -0
- package/skills/tmux/scripts/wait-for-text.sh +83 -0
- package/skills/trello/SKILL.md +84 -0
- package/skills/video-frames/SKILL.md +29 -0
- package/skills/video-frames/scripts/frame.sh +81 -0
- package/skills/wacli/SKILL.md +42 -0
- package/skills/weather/SKILL.md +49 -0
|
@@ -0,0 +1,40 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "macOS permission persistence (TCC) and signing requirements"
|
|
3
|
+
read_when:
|
|
4
|
+
- Debugging missing or stuck macOS permission prompts
|
|
5
|
+
- Packaging or signing the macOS app
|
|
6
|
+
- Changing bundle IDs or app install paths
|
|
7
|
+
---
|
|
8
|
+
# macOS permissions (TCC)
|
|
9
|
+
|
|
10
|
+
macOS permission grants are fragile. TCC associates a permission grant with the
|
|
11
|
+
app's code signature, bundle identifier, and on-disk path. If any of those change,
|
|
12
|
+
macOS treats the app as new and may drop or hide prompts.
|
|
13
|
+
|
|
14
|
+
## Requirements for stable permissions
|
|
15
|
+
- Same path: run the app from a fixed location (for Clawdbot, `dist/Clawdbot.app`).
|
|
16
|
+
- Same bundle identifier: changing the bundle ID creates a new permission identity.
|
|
17
|
+
- Signed app: unsigned or ad-hoc signed builds do not persist permissions.
|
|
18
|
+
- Consistent signature: use a real Apple Development or Developer ID certificate
|
|
19
|
+
so the signature stays stable across rebuilds.
|
|
20
|
+
|
|
21
|
+
Ad-hoc signatures generate a new identity every build. macOS will forget previous
|
|
22
|
+
grants, and prompts can disappear entirely until the stale entries are cleared.
|
|
23
|
+
|
|
24
|
+
## Recovery checklist when prompts disappear
|
|
25
|
+
1. Quit the app.
|
|
26
|
+
2. Remove the app entry in System Settings -> Privacy & Security.
|
|
27
|
+
3. Relaunch the app from the same path and re-grant permissions.
|
|
28
|
+
4. If the prompt still does not appear, reset TCC entries with `tccutil` and try again.
|
|
29
|
+
5. Some permissions only reappear after a full macOS restart.
|
|
30
|
+
|
|
31
|
+
Example resets (replace bundle ID as needed):
|
|
32
|
+
|
|
33
|
+
```bash
|
|
34
|
+
sudo tccutil reset Accessibility com.clawdbot.mac
|
|
35
|
+
sudo tccutil reset ScreenCapture com.clawdbot.mac
|
|
36
|
+
sudo tccutil reset AppleEvents
|
|
37
|
+
```
|
|
38
|
+
|
|
39
|
+
If you are testing permissions, always sign with a real certificate. Ad-hoc
|
|
40
|
+
builds are only acceptable for quick local runs where permissions do not matter.
|
|
@@ -0,0 +1,76 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "Clawdbot macOS release checklist (Sparkle feed, packaging, signing)"
|
|
3
|
+
read_when:
|
|
4
|
+
- Cutting or validating a Clawdbot macOS release
|
|
5
|
+
- Updating the Sparkle appcast or feed assets
|
|
6
|
+
---
|
|
7
|
+
|
|
8
|
+
# Clawdbot macOS release (Sparkle)
|
|
9
|
+
|
|
10
|
+
This app now ships Sparkle auto-updates. Release builds must be Developer ID–signed, zipped, and published with a signed appcast entry.
|
|
11
|
+
|
|
12
|
+
## Prereqs
|
|
13
|
+
- Developer ID Application cert installed (`Developer ID Application: Peter Steinberger (Y5PE65HELJ)` is expected).
|
|
14
|
+
- Sparkle private key path set in the environment as `SPARKLE_PRIVATE_KEY_FILE`; key lives in `/Users/steipete/Library/CloudStorage/Dropbox/Backup/Sparkle` (same key as Trimmy; public key baked into Info.plist).
|
|
15
|
+
- Notary credentials (keychain profile or API key) for `xcrun notarytool` if you want Gatekeeper-safe DMG/zip distribution.
|
|
16
|
+
- We use a Keychain profile named `clawdbot-notary`, created from App Store Connect API key env vars in your shell profile:
|
|
17
|
+
- `APP_STORE_CONNECT_API_KEY_P8`, `APP_STORE_CONNECT_KEY_ID`, `APP_STORE_CONNECT_ISSUER_ID`
|
|
18
|
+
- `echo "$APP_STORE_CONNECT_API_KEY_P8" | sed 's/\\n/\n/g' > /tmp/clawdbot-notary.p8`
|
|
19
|
+
- `xcrun notarytool store-credentials "clawdbot-notary" --key /tmp/clawdbot-notary.p8 --key-id "$APP_STORE_CONNECT_KEY_ID" --issuer "$APP_STORE_CONNECT_ISSUER_ID"`
|
|
20
|
+
- `pnpm` deps installed (`pnpm install --config.node-linker=hoisted`).
|
|
21
|
+
- Sparkle tools are fetched automatically via SwiftPM at `apps/macos/.build/artifacts/sparkle/Sparkle/bin/` (`sign_update`, `generate_appcast`, etc.).
|
|
22
|
+
|
|
23
|
+
## Build & package
|
|
24
|
+
Notes:
|
|
25
|
+
- `APP_BUILD` maps to `CFBundleVersion`/`sparkle:version`; keep it numeric + monotonic (no `-beta`), or Sparkle compares it as equal.
|
|
26
|
+
- Universal by default (`arm64 x86_64`). Override with `BUILD_ARCHS="arm64"` if you need arm-only.
|
|
27
|
+
|
|
28
|
+
```bash
|
|
29
|
+
# From repo root; set release IDs so Sparkle feed is enabled.
|
|
30
|
+
# APP_BUILD must be numeric + monotonic for Sparkle compare.
|
|
31
|
+
BUNDLE_ID=com.clawdbot.mac \
|
|
32
|
+
APP_VERSION=0.1.0 \
|
|
33
|
+
APP_BUILD="$(git rev-list --count HEAD)" \
|
|
34
|
+
BUILD_CONFIG=release \
|
|
35
|
+
SIGN_IDENTITY="Developer ID Application: Peter Steinberger (Y5PE65HELJ)" \
|
|
36
|
+
scripts/package-mac-app.sh
|
|
37
|
+
|
|
38
|
+
# Zip for distribution (includes resource forks for Sparkle delta support)
|
|
39
|
+
ditto -c -k --sequesterRsrc --keepParent dist/Clawdbot.app dist/Clawdbot-0.1.0.zip
|
|
40
|
+
|
|
41
|
+
# Optional: also build a styled DMG for humans (drag to /Applications)
|
|
42
|
+
scripts/create-dmg.sh dist/Clawdbot.app dist/Clawdbot-0.1.0.dmg
|
|
43
|
+
|
|
44
|
+
# Recommended: build + notarize/staple zip + DMG
|
|
45
|
+
# First, create a keychain profile once:
|
|
46
|
+
# xcrun notarytool store-credentials "clawdbot-notary" \
|
|
47
|
+
# --apple-id "<apple-id>" --team-id "<team-id>" --password "<app-specific-password>"
|
|
48
|
+
NOTARIZE=1 NOTARYTOOL_PROFILE=clawdbot-notary \
|
|
49
|
+
BUNDLE_ID=com.clawdbot.mac \
|
|
50
|
+
APP_VERSION=0.1.0 \
|
|
51
|
+
APP_BUILD="$(git rev-list --count HEAD)" \
|
|
52
|
+
BUILD_CONFIG=release \
|
|
53
|
+
SIGN_IDENTITY="Developer ID Application: Peter Steinberger (Y5PE65HELJ)" \
|
|
54
|
+
scripts/package-mac-dist.sh
|
|
55
|
+
|
|
56
|
+
# Optional: ship dSYM alongside the release
|
|
57
|
+
ditto -c -k --keepParent apps/macos/.build/release/Clawdbot.app.dSYM dist/Clawdbot-0.1.0.dSYM.zip
|
|
58
|
+
```
|
|
59
|
+
|
|
60
|
+
## Appcast entry
|
|
61
|
+
Use the release note generator so Sparkle renders formatted HTML notes:
|
|
62
|
+
```bash
|
|
63
|
+
SPARKLE_PRIVATE_KEY_FILE=/Users/steipete/Library/CloudStorage/Dropbox/Backup/Sparkle/ed25519-private-key scripts/make_appcast.sh dist/Clawdbot-0.1.0.zip https://raw.githubusercontent.com/clawdbot/clawdbot/main/appcast.xml
|
|
64
|
+
```
|
|
65
|
+
Generates HTML release notes from `CHANGELOG.md` (via `scripts/changelog-to-html.sh`) and embeds them in the appcast entry.
|
|
66
|
+
Commit the updated `appcast.xml` alongside the release assets (zip + dSYM) when publishing.
|
|
67
|
+
|
|
68
|
+
## Publish & verify
|
|
69
|
+
- Upload `Clawdbot-0.1.0.zip` (and `Clawdbot-0.1.0.dSYM.zip`) to the GitHub release for tag `v0.1.0`.
|
|
70
|
+
- Ensure the raw appcast URL matches the baked feed: `https://raw.githubusercontent.com/clawdbot/clawdbot/main/appcast.xml`.
|
|
71
|
+
- Sanity checks:
|
|
72
|
+
- `curl -I https://raw.githubusercontent.com/clawdbot/clawdbot/main/appcast.xml` returns 200.
|
|
73
|
+
- `curl -I <enclosure url>` returns 200 after assets upload.
|
|
74
|
+
- On a previous public build, run “Check for Updates…” from the About tab and verify Sparkle installs the new build cleanly.
|
|
75
|
+
|
|
76
|
+
Definition of done: signed app + appcast are published, update flow works from an older installed version, and release assets are attached to the GitHub release.
|
|
@@ -0,0 +1,57 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "macOS app flow for controlling a remote Clawdbot gateway over SSH"
|
|
3
|
+
read_when:
|
|
4
|
+
- Setting up or debugging remote mac control
|
|
5
|
+
---
|
|
6
|
+
# Remote Clawdbot (macOS ⇄ remote host)
|
|
7
|
+
|
|
8
|
+
Updated: 2025-12-08
|
|
9
|
+
|
|
10
|
+
This flow lets the macOS app act as a full remote control for a Clawdbot gateway running on another host (e.g. a Mac Studio). All features—health checks, Voice Wake forwarding, and Web Chat—reuse the same remote SSH configuration from *Settings → General*.
|
|
11
|
+
|
|
12
|
+
## Modes
|
|
13
|
+
- **Local (this Mac)**: Everything runs on the laptop. No SSH involved.
|
|
14
|
+
- **Remote over SSH**: Clawdbot commands are executed on the remote host. The mac app opens an SSH connection with `-o BatchMode` plus your chosen identity/key.
|
|
15
|
+
|
|
16
|
+
## Prereqs on the remote host
|
|
17
|
+
1) Install Node + pnpm and build/install the Clawdbot CLI (`pnpm install && pnpm build && pnpm link --global`).
|
|
18
|
+
2) Ensure `clawdbot` is on PATH for non-interactive shells (symlink into `/usr/local/bin` or `/opt/homebrew/bin` if needed).
|
|
19
|
+
3) Open SSH with key auth. We recommend **Tailscale** IPs for stable reachability off-LAN.
|
|
20
|
+
|
|
21
|
+
## macOS app setup
|
|
22
|
+
1) Open *Settings → General*.
|
|
23
|
+
2) Under **Clawdbot runs**, pick **Remote over SSH** and set:
|
|
24
|
+
- **SSH target**: `user@host` (optional `:port`).
|
|
25
|
+
- If the gateway is on the same LAN and advertises Bonjour, pick it from the discovered list to auto-fill this field.
|
|
26
|
+
- **Identity file** (advanced): path to your key.
|
|
27
|
+
- **Project root** (advanced): remote checkout path used for commands.
|
|
28
|
+
- **CLI path** (advanced): optional path to a runnable `clawdbot` entrypoint/binary (auto-filled when advertised).
|
|
29
|
+
3) Hit **Test remote**. Success indicates the remote `clawdbot status --json` runs correctly. Failures usually mean PATH/CLI issues; exit 127 means the CLI isn’t found remotely.
|
|
30
|
+
4) Health checks and Web Chat will now run through this SSH tunnel automatically.
|
|
31
|
+
|
|
32
|
+
## Web Chat over SSH
|
|
33
|
+
- Web Chat connects to the gateway over the forwarded WebSocket control port (default 18789).
|
|
34
|
+
- There is no separate WebChat HTTP server anymore.
|
|
35
|
+
|
|
36
|
+
## Permissions
|
|
37
|
+
- The remote host needs the same TCC approvals as local (Automation, Accessibility, Screen Recording, Microphone, Speech Recognition, Notifications). Run onboarding on that machine to grant them once.
|
|
38
|
+
- Nodes advertise their permission state via `node.list` / `node.describe` so agents know what’s available.
|
|
39
|
+
|
|
40
|
+
## WhatsApp login flow (remote)
|
|
41
|
+
- Run `clawdbot login --verbose` **on the remote host**. Scan the QR with WhatsApp on your phone.
|
|
42
|
+
- Re-run login on that host if auth expires. Health check will surface link problems.
|
|
43
|
+
|
|
44
|
+
## Troubleshooting
|
|
45
|
+
- **exit 127 / not found**: `clawdbot` isn’t on PATH for non-login shells. Add it to `/etc/paths`, your shell rc, or symlink into `/usr/local/bin`/`/opt/homebrew/bin`.
|
|
46
|
+
- **Health probe failed**: check SSH reachability, PATH, and that Baileys is logged in (`clawdbot status --json`).
|
|
47
|
+
- **Web Chat stuck**: confirm the gateway is running on the remote host and the forwarded port matches the gateway WS port; the UI requires a healthy WS connection.
|
|
48
|
+
- **Voice Wake**: trigger phrases are forwarded automatically in remote mode; no separate forwarder is needed.
|
|
49
|
+
|
|
50
|
+
## Notification sounds
|
|
51
|
+
Pick sounds per notification from scripts with `clawdbot` and `node.invoke`, e.g.:
|
|
52
|
+
|
|
53
|
+
```bash
|
|
54
|
+
clawdbot nodes notify --node <id> --title "Ping" --body "Remote gateway ready" --sound Glass
|
|
55
|
+
```
|
|
56
|
+
|
|
57
|
+
There is no global “default sound” toggle in the app anymore; callers choose a sound (or none) per request.
|
|
@@ -0,0 +1,41 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "Signing steps for macOS debug builds generated by packaging scripts"
|
|
3
|
+
read_when:
|
|
4
|
+
- Building or signing mac debug builds
|
|
5
|
+
---
|
|
6
|
+
# mac signing (debug builds)
|
|
7
|
+
|
|
8
|
+
This app is usually built from `scripts/package-mac-app.sh`, which now:
|
|
9
|
+
|
|
10
|
+
- sets a stable debug bundle identifier: `com.clawdbot.mac.debug`
|
|
11
|
+
- writes the Info.plist with that bundle id (override via `BUNDLE_ID=...`)
|
|
12
|
+
- calls `scripts/codesign-mac-app.sh` to sign the main binary, bundled CLI, and app bundle so macOS treats each rebuild as the same signed bundle and keeps TCC permissions (notifications, accessibility, screen recording, mic, speech). For stable permissions, use a real signing identity; ad-hoc is opt-in and fragile (see `docs/mac/permissions.md`).
|
|
13
|
+
- uses `CODESIGN_TIMESTAMP=auto` by default; it enables trusted timestamps for Developer ID signatures. Set `CODESIGN_TIMESTAMP=off` to skip timestamping (offline debug builds).
|
|
14
|
+
- inject build metadata into Info.plist: `ClawdbotBuildTimestamp` (UTC) and `ClawdbotGitCommit` (short hash) so the About pane can show build, git, and debug/release channel.
|
|
15
|
+
- **Packaging requires Bun**: The embedded gateway relay is compiled using `bun`. Ensure it is installed (`curl -fsSL https://bun.sh/install | bash`).
|
|
16
|
+
- reads `SIGN_IDENTITY` from the environment. Add `export SIGN_IDENTITY="Apple Development: Your Name (TEAMID)"` (or your Developer ID Application cert) to your shell rc to always sign with your cert. Ad-hoc signing requires explicit opt-in via `ALLOW_ADHOC_SIGNING=1` or `SIGN_IDENTITY="-"` (not recommended for permission testing).
|
|
17
|
+
|
|
18
|
+
## Usage
|
|
19
|
+
|
|
20
|
+
```bash
|
|
21
|
+
# from repo root
|
|
22
|
+
scripts/package-mac-app.sh # auto-selects identity; errors if none found
|
|
23
|
+
SIGN_IDENTITY="Developer ID Application: Your Name" scripts/package-mac-app.sh # real cert
|
|
24
|
+
ALLOW_ADHOC_SIGNING=1 scripts/package-mac-app.sh # ad-hoc (permissions will not stick)
|
|
25
|
+
SIGN_IDENTITY="-" scripts/package-mac-app.sh # explicit ad-hoc (same caveat)
|
|
26
|
+
```
|
|
27
|
+
|
|
28
|
+
### Ad-hoc Signing Note
|
|
29
|
+
When signing with `SIGN_IDENTITY="-"` (ad-hoc), the script automatically disables the **Hardened Runtime** (`--options runtime`). This is necessary to prevent crashes when the app attempts to load embedded frameworks (like Sparkle) that do not share the same Team ID. Ad-hoc signatures also break TCC permission persistence; see `docs/mac/permissions.md` for recovery steps.
|
|
30
|
+
|
|
31
|
+
## Build metadata for About
|
|
32
|
+
|
|
33
|
+
`package-mac-app.sh` stamps the bundle with:
|
|
34
|
+
- `ClawdbotBuildTimestamp`: ISO8601 UTC at package time
|
|
35
|
+
- `ClawdbotGitCommit`: short git hash (or `unknown` if unavailable)
|
|
36
|
+
|
|
37
|
+
The About tab reads these keys to show version, build date, git commit, and whether it’s a debug build (via `#if DEBUG`). Run the packager to refresh these values after code changes.
|
|
38
|
+
|
|
39
|
+
## Why
|
|
40
|
+
|
|
41
|
+
TCC permissions are tied to the bundle identifier *and* code signature. Unsigned debug builds with changing UUIDs were causing macOS to forget grants after each rebuild. Signing the binaries (ad‑hoc by default) and keeping a fixed bundle id/path (`dist/Clawdbot.app`) preserves the grants between builds, matching the VibeTunnel approach.
|
|
@@ -0,0 +1,27 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "macOS Skills settings UI and gateway-backed status"
|
|
3
|
+
read_when:
|
|
4
|
+
- Updating the macOS Skills settings UI
|
|
5
|
+
- Changing skills gating or install behavior
|
|
6
|
+
---
|
|
7
|
+
# Skills (macOS)
|
|
8
|
+
|
|
9
|
+
The macOS app surfaces Clawdbot skills via the gateway; it does not parse skills locally.
|
|
10
|
+
|
|
11
|
+
## Data source
|
|
12
|
+
- `skills.status` (gateway) returns all skills plus eligibility and missing requirements
|
|
13
|
+
(including allowlist blocks for bundled skills).
|
|
14
|
+
- Requirements are derived from `metadata.clawdbot.requires` in each `SKILL.md`.
|
|
15
|
+
|
|
16
|
+
## Install actions
|
|
17
|
+
- `metadata.clawdbot.install` defines install options (brew/node/go/uv).
|
|
18
|
+
- The app calls `skills.install` to run installers on the gateway host.
|
|
19
|
+
- The gateway surfaces only one preferred installer when multiple are provided
|
|
20
|
+
(brew when available, otherwise node manager from `skills.install`, default npm).
|
|
21
|
+
|
|
22
|
+
## Env/API keys
|
|
23
|
+
- The app stores keys in `~/.clawdbot/clawdbot.json` under `skills.entries.<skillKey>`.
|
|
24
|
+
- `skills.update` patches `enabled`, `apiKey`, and `env`.
|
|
25
|
+
|
|
26
|
+
## Remote mode
|
|
27
|
+
- Install + config updates happen on the gateway host (not the local Mac).
|
|
@@ -0,0 +1,52 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "Voice overlay lifecycle when wake-word and push-to-talk overlap"
|
|
3
|
+
read_when:
|
|
4
|
+
- Adjusting voice overlay behavior
|
|
5
|
+
---
|
|
6
|
+
## Voice Overlay Lifecycle (macOS)
|
|
7
|
+
|
|
8
|
+
Audience: macOS app contributors. Goal: keep the voice overlay predictable when wake-word and push-to-talk overlap.
|
|
9
|
+
|
|
10
|
+
### Current intent
|
|
11
|
+
- If the overlay is already visible from wake-word and the user presses the hotkey, the hotkey session *adopts* the existing text instead of resetting it. The overlay stays up while the hotkey is held. When the user releases: send if there is trimmed text, otherwise dismiss.
|
|
12
|
+
- Wake-word alone still auto-sends on silence; push-to-talk sends immediately on release.
|
|
13
|
+
|
|
14
|
+
### Implemented (Dec 9, 2025)
|
|
15
|
+
- Overlay sessions now carry a token per capture (wake-word or push-to-talk). Partial/final/send/dismiss/level updates are dropped when the token doesn’t match, avoiding stale callbacks.
|
|
16
|
+
- Push-to-talk adopts any visible overlay text as a prefix (so pressing the hotkey while the wake overlay is up keeps the text and appends new speech). It waits up to 1.5s for a final transcript before falling back to the current text.
|
|
17
|
+
- Chime/overlay logging is emitted at `info` in categories `voicewake.overlay`, `voicewake.ptt`, and `voicewake.chime` (session start, partial, final, send, dismiss, chime reason).
|
|
18
|
+
|
|
19
|
+
### Next steps
|
|
20
|
+
1. **VoiceSessionCoordinator (actor)**
|
|
21
|
+
- Owns exactly one `VoiceSession` at a time.
|
|
22
|
+
- API (token-based): `beginWakeCapture`, `beginPushToTalk`, `updatePartial`, `endCapture`, `cancel`, `applyCooldown`.
|
|
23
|
+
- Drops callbacks that carry stale tokens (prevents old recognizers from reopening the overlay).
|
|
24
|
+
2. **VoiceSession (model)**
|
|
25
|
+
- Fields: `token`, `source` (wakeWord|pushToTalk), committed/volatile text, chime flags, timers (auto-send, idle), `overlayMode` (display|editing|sending), cooldown deadline.
|
|
26
|
+
3. **Overlay binding**
|
|
27
|
+
- `VoiceSessionPublisher` (`ObservableObject`) mirrors the active session into SwiftUI.
|
|
28
|
+
- `VoiceWakeOverlayView` renders only via the publisher; it never mutates global singletons directly.
|
|
29
|
+
- Overlay user actions (`sendNow`, `dismiss`, `edit`) call back into the coordinator with the session token.
|
|
30
|
+
4. **Unified send path**
|
|
31
|
+
- On `endCapture`: if trimmed text is empty → dismiss; else `performSend(session:)` (plays send chime once, forwards, dismisses).
|
|
32
|
+
- Push-to-talk: no delay; wake-word: optional delay for auto-send.
|
|
33
|
+
- Apply a short cooldown to the wake runtime after push-to-talk finishes so wake-word doesn’t immediately retrigger.
|
|
34
|
+
5. **Logging**
|
|
35
|
+
- Coordinator emits `.info` logs in subsystem `com.clawdbot`, categories `voicewake.overlay` and `voicewake.chime`.
|
|
36
|
+
- Key events: `session_started`, `adopted_by_push_to_talk`, `partial`, `finalized`, `send`, `dismiss`, `cancel`, `cooldown`.
|
|
37
|
+
|
|
38
|
+
### Debugging checklist
|
|
39
|
+
- Stream logs while reproducing a sticky overlay:
|
|
40
|
+
|
|
41
|
+
```bash
|
|
42
|
+
sudo log stream --predicate 'subsystem == "com.clawdbot" AND category CONTAINS "voicewake"' --level info --style compact
|
|
43
|
+
```
|
|
44
|
+
- Verify only one active session token; stale callbacks should be dropped by the coordinator.
|
|
45
|
+
- Ensure push-to-talk release always calls `endCapture` with the active token; if text is empty, expect `dismiss` without chime or send.
|
|
46
|
+
|
|
47
|
+
### Migration steps (suggested)
|
|
48
|
+
1. Add `VoiceSessionCoordinator`, `VoiceSession`, and `VoiceSessionPublisher`.
|
|
49
|
+
2. Refactor `VoiceWakeRuntime` to create/update/end sessions instead of touching `VoiceWakeOverlayController` directly.
|
|
50
|
+
3. Refactor `VoicePushToTalk` to adopt existing sessions and call `endCapture` on release; apply runtime cooldown.
|
|
51
|
+
4. Wire `VoiceWakeOverlayController` to the publisher; remove direct calls from runtime/PTT.
|
|
52
|
+
5. Add integration tests for session adoption, cooldown, and empty-text dismissal.
|
|
@@ -0,0 +1,56 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "Voice wake and push-to-talk modes plus routing details in the mac app"
|
|
3
|
+
read_when:
|
|
4
|
+
- Working on voice wake or PTT pathways
|
|
5
|
+
---
|
|
6
|
+
# Voice Wake & Push-to-Talk
|
|
7
|
+
|
|
8
|
+
Updated: 2025-12-23 · Owners: mac app
|
|
9
|
+
|
|
10
|
+
## Modes
|
|
11
|
+
- **Wake-word mode** (default): always-on Speech recognizer waits for trigger tokens (`swabbleTriggerWords`). On match it starts capture, shows the overlay with partial text, and auto-sends after silence.
|
|
12
|
+
- **Push-to-talk (Right Option hold)**: hold the right Option key to capture immediately—no trigger needed. The overlay appears while held; releasing finalizes and forwards after a short delay so you can tweak text.
|
|
13
|
+
|
|
14
|
+
## Runtime behavior (wake-word)
|
|
15
|
+
- Speech recognizer lives in `VoiceWakeRuntime`.
|
|
16
|
+
- Trigger only fires when there’s a **meaningful pause** between the wake word and the next word (~0.45s gap).
|
|
17
|
+
- Silence windows: 2.0s when speech is flowing, 5.0s if only the trigger was heard.
|
|
18
|
+
- Hard stop: 120s to prevent runaway sessions.
|
|
19
|
+
- Debounce between sessions: 350ms.
|
|
20
|
+
- Overlay is driven via `VoiceWakeOverlayController` with committed/volatile coloring.
|
|
21
|
+
- After send, recognizer restarts cleanly to listen for the next trigger.
|
|
22
|
+
|
|
23
|
+
## Lifecycle invariants
|
|
24
|
+
- If Voice Wake is enabled and permissions are granted, the wake-word recognizer should be listening (except during an explicit push-to-talk capture).
|
|
25
|
+
- Overlay visibility (including manual dismiss via the X button) must never prevent the recognizer from resuming.
|
|
26
|
+
|
|
27
|
+
## Sticky overlay failure mode (previous)
|
|
28
|
+
Previously, if the overlay got stuck visible and you manually closed it, Voice Wake could appear “dead” because the runtime’s restart attempt could be blocked by overlay visibility and no subsequent restart was scheduled.
|
|
29
|
+
|
|
30
|
+
Hardening:
|
|
31
|
+
- Wake runtime restart is no longer blocked by overlay visibility.
|
|
32
|
+
- Overlay dismiss completion triggers a `VoiceWakeRuntime.refresh(...)` via `VoiceSessionCoordinator`, so manual X-dismiss always resumes listening.
|
|
33
|
+
|
|
34
|
+
## Push-to-talk specifics
|
|
35
|
+
- Hotkey detection uses a global `.flagsChanged` monitor for **right Option** (`keyCode 61` + `.option`). We only observe events (no swallowing).
|
|
36
|
+
- Capture pipeline lives in `VoicePushToTalk`: starts Speech immediately, streams partials to the overlay, and calls `VoiceWakeForwarder` on release.
|
|
37
|
+
- When push-to-talk starts we pause the wake-word runtime to avoid dueling audio taps; it restarts automatically after release.
|
|
38
|
+
- Permissions: requires Microphone + Speech; seeing events needs Accessibility/Input Monitoring approval.
|
|
39
|
+
- External keyboards: some may not expose right Option as expected—offer a fallback shortcut if users report misses.
|
|
40
|
+
|
|
41
|
+
## User-facing settings
|
|
42
|
+
- **Voice Wake** toggle: enables wake-word runtime.
|
|
43
|
+
- **Hold Cmd+Fn to talk**: enables the push-to-talk monitor. Disabled on macOS < 26.
|
|
44
|
+
- Language & mic pickers, live level meter, trigger-word table, tester.
|
|
45
|
+
- **Sounds**: chimes on trigger detect and on send; defaults to the macOS “Glass” system sound. You can pick any `NSSound`-loadable file (e.g. MP3/WAV/AIFF) for each event or choose **No Sound**.
|
|
46
|
+
|
|
47
|
+
## Forwarding behavior
|
|
48
|
+
- When Voice Wake is enabled, transcripts are forwarded to the active gateway/agent (the same local vs remote mode used by the rest of the mac app).
|
|
49
|
+
- Replies are delivered to the **last-used main surface** (WhatsApp/Telegram/Discord/WebChat). If delivery fails, the error is logged and the run is still visible via WebChat/session logs.
|
|
50
|
+
|
|
51
|
+
## Forwarding payload
|
|
52
|
+
- `VoiceWakeForwarder.prefixedTranscript(_:)` prepends the machine hint before sending. Shared between wake-word and push-to-talk paths.
|
|
53
|
+
|
|
54
|
+
## Quick verification
|
|
55
|
+
- Toggle push-to-talk on, hold Cmd+Fn, speak, release: overlay should show partials then send.
|
|
56
|
+
- While holding, menu-bar ears should stay enlarged (uses `triggerVoiceEars(ttl:nil)`); they drop after release.
|
|
@@ -0,0 +1,27 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "How the mac app embeds the gateway WebChat and how to debug it"
|
|
3
|
+
read_when:
|
|
4
|
+
- Debugging mac WebChat view or loopback port
|
|
5
|
+
---
|
|
6
|
+
# Web Chat (macOS app)
|
|
7
|
+
|
|
8
|
+
The macOS menu bar app shows the WebChat UI as a native SwiftUI view and reuses the **primary Clawd session** (`main`, or `global` when scope is global).
|
|
9
|
+
|
|
10
|
+
- **Local mode**: connects directly to the local Gateway WebSocket.
|
|
11
|
+
- **Remote mode**: forwards the Gateway WebSocket control port over SSH and uses that as the data plane.
|
|
12
|
+
|
|
13
|
+
## Launch & debugging
|
|
14
|
+
- Manual: Lobster menu → “Open Chat”.
|
|
15
|
+
- Auto-open for testing: run `dist/Clawdbot.app/Contents/MacOS/Clawdbot --webchat` (or pass `--webchat` to the binary launched by launchd). The window opens on startup.
|
|
16
|
+
- Logs: see `./scripts/clawlog.sh` (subsystem `com.clawdbot`, category `WebChatSwiftUI`).
|
|
17
|
+
|
|
18
|
+
## How it’s wired
|
|
19
|
+
- Implementation: `apps/macos/Sources/Clawdbot/WebChatSwiftUI.swift` hosts `ClawdbotChatUI` and speaks to the Gateway over `GatewayConnection`.
|
|
20
|
+
- Data plane: Gateway WebSocket methods `chat.history`, `chat.send`, `chat.abort`; events `chat`, `agent`, `presence`, `tick`, `health`.
|
|
21
|
+
- Session: usually primary (`main`); multiple transports (WhatsApp/Telegram/Discord/Desktop) share the same key. The onboarding flow uses a dedicated `onboarding` session to keep first-run setup separate.
|
|
22
|
+
|
|
23
|
+
## Security / surface area
|
|
24
|
+
- Remote mode forwards only the Gateway WebSocket control port over SSH.
|
|
25
|
+
|
|
26
|
+
## Known limitations
|
|
27
|
+
- The UI is optimized for the primary session and typical “chat” usage (not a full browser-based sandbox surface).
|
package/docs/mac/xpc.md
ADDED
|
@@ -0,0 +1,40 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "macOS IPC architecture for Clawdbot app, gateway node bridge, and PeekabooBridge"
|
|
3
|
+
read_when:
|
|
4
|
+
- Editing IPC contracts or menu bar app IPC
|
|
5
|
+
---
|
|
6
|
+
# Clawdbot macOS IPC architecture (Dec 2025)
|
|
7
|
+
|
|
8
|
+
**Current model:** there is **no local control socket** and no `clawdbot-mac` CLI. All agent actions go through the Gateway WebSocket and `node.invoke`. UI automation still uses PeekabooBridge.
|
|
9
|
+
|
|
10
|
+
## Goals
|
|
11
|
+
- Single GUI app instance that owns all TCC-facing work (notifications, screen recording, mic, speech, AppleScript).
|
|
12
|
+
- A small surface for automation: Gateway + node commands, plus PeekabooBridge for UI automation.
|
|
13
|
+
- Predictable permissions: always the same signed bundle ID, launched by launchd, so TCC grants stick.
|
|
14
|
+
|
|
15
|
+
## How it works
|
|
16
|
+
### Gateway + node bridge (current)
|
|
17
|
+
- The app runs the Gateway (local mode) and connects to it as a node.
|
|
18
|
+
- Agent actions are performed via `node.invoke` (e.g. `system.run`, `system.notify`, `canvas.*`).
|
|
19
|
+
|
|
20
|
+
### PeekabooBridge (UI automation)
|
|
21
|
+
- UI automation uses a separate UNIX socket named `bridge.sock` and the PeekabooBridge JSON protocol.
|
|
22
|
+
- Host preference order (client-side): Peekaboo.app → Claude.app → Clawdbot.app → local execution.
|
|
23
|
+
- Security: bridge hosts require TeamID `Y5PE65HELJ`; DEBUG-only same-UID escape hatch is guarded by `PEEKABOO_ALLOW_UNSIGNED_SOCKET_CLIENTS=1` (Peekaboo convention).
|
|
24
|
+
- See: `docs/mac/peekaboo.md` for the Clawdbot plan and naming.
|
|
25
|
+
|
|
26
|
+
### Mach/XPC (future direction)
|
|
27
|
+
- Still optional for internal app services, but **not required** for automation now that node.invoke is the surface.
|
|
28
|
+
|
|
29
|
+
## Operational flows
|
|
30
|
+
- Restart/rebuild: `SIGN_IDENTITY="Apple Development: Peter Steinberger (2ZAC4GM7GD)" scripts/restart-mac.sh`
|
|
31
|
+
- Kills existing instances
|
|
32
|
+
- Swift build + package
|
|
33
|
+
- Writes/bootstraps/kickstarts the LaunchAgent
|
|
34
|
+
- Single instance: app exits early if another instance with the same bundle ID is running.
|
|
35
|
+
|
|
36
|
+
## Hardening notes
|
|
37
|
+
- Prefer requiring a TeamID match for all privileged surfaces.
|
|
38
|
+
- PeekabooBridge: `PEEKABOO_ALLOW_UNSIGNED_SOCKET_CLIENTS=1` (DEBUG-only) may allow same-UID callers for local development.
|
|
39
|
+
- All communication remains local-only; no network sockets are exposed.
|
|
40
|
+
- TCC prompts originate only from the GUI app bundle; run `scripts/package-mac-app.sh` so the signed bundle ID stays stable.
|
package/docs/models.md
ADDED
|
@@ -0,0 +1,90 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "Plan for models CLI: scan, list, aliases, fallbacks, status"
|
|
3
|
+
read_when:
|
|
4
|
+
- Adding or modifying models CLI (models list/set/scan/aliases/fallbacks)
|
|
5
|
+
- Changing model fallback behavior or selection UX
|
|
6
|
+
- Updating model scan probes (tools/images)
|
|
7
|
+
---
|
|
8
|
+
# Models CLI plan
|
|
9
|
+
|
|
10
|
+
Goal: give clear model visibility + control (configured vs available), plus scan tooling
|
|
11
|
+
that prefers tool-call + image-capable models and maintains ordered fallbacks.
|
|
12
|
+
|
|
13
|
+
## Command tree (draft)
|
|
14
|
+
|
|
15
|
+
- `clawdbot models list`
|
|
16
|
+
- default: configured models only
|
|
17
|
+
- flags: `--all` (full catalog), `--local`, `--provider <name>`, `--json`, `--plain`
|
|
18
|
+
- `clawdbot models status`
|
|
19
|
+
- show default model + aliases + fallbacks + allowlist
|
|
20
|
+
- `clawdbot models set <modelOrAlias>`
|
|
21
|
+
- writes `agent.model` in config
|
|
22
|
+
- `clawdbot models set-image <modelOrAlias>`
|
|
23
|
+
- writes `agent.imageModel` in config
|
|
24
|
+
- `clawdbot models aliases list|add|remove`
|
|
25
|
+
- writes `agent.modelAliases`
|
|
26
|
+
- `clawdbot models fallbacks list|add|remove|clear`
|
|
27
|
+
- writes `agent.modelFallbacks`
|
|
28
|
+
- `clawdbot models image-fallbacks list|add|remove|clear`
|
|
29
|
+
- writes `agent.imageModelFallbacks`
|
|
30
|
+
- `clawdbot models scan`
|
|
31
|
+
- OpenRouter :free scan; probe tool-call + image; interactive selection
|
|
32
|
+
|
|
33
|
+
## Config changes
|
|
34
|
+
|
|
35
|
+
- Add `agent.modelFallbacks: string[]` (ordered list of provider/model IDs).
|
|
36
|
+
- Add `agent.imageModel?: string` (optional image-capable model for image tool).
|
|
37
|
+
- Add `agent.imageModelFallbacks?: string[]` (ordered list for image tool).
|
|
38
|
+
- Keep existing:
|
|
39
|
+
- `agent.model` (default)
|
|
40
|
+
- `agent.allowedModels` (list filter)
|
|
41
|
+
- `agent.modelAliases` (shortcut names)
|
|
42
|
+
|
|
43
|
+
## Scan behavior (models scan)
|
|
44
|
+
|
|
45
|
+
Input
|
|
46
|
+
- OpenRouter `/models` list (filter `:free`)
|
|
47
|
+
- Requires `OPENROUTER_API_KEY` (or stored OpenRouter key in auth storage)
|
|
48
|
+
- Optional filters: `--max-age-days`, `--min-params`, `--provider`, `--max-candidates`
|
|
49
|
+
- Probe controls: `--timeout`, `--concurrency`
|
|
50
|
+
|
|
51
|
+
Probes (direct pi-ai complete)
|
|
52
|
+
- Tool-call probe (required):
|
|
53
|
+
- Provide a dummy tool, verify tool call emitted.
|
|
54
|
+
- Image probe (preferred):
|
|
55
|
+
- Prompt includes 1x1 PNG; success if no "unsupported image" error.
|
|
56
|
+
|
|
57
|
+
Scoring/selection
|
|
58
|
+
- Prefer models passing tool + image for text/tool fallbacks.
|
|
59
|
+
- Prefer image-only models for image tool fallback (even if tool probe fails).
|
|
60
|
+
- Rank by: image ok, then lower tool latency, then larger context, then params.
|
|
61
|
+
|
|
62
|
+
Interactive selection (TTY)
|
|
63
|
+
- Multiselect list with per-model stats:
|
|
64
|
+
- model id, tool ok, image ok, median latency, context, inferred params.
|
|
65
|
+
- Pre-select top N (default 6).
|
|
66
|
+
- Non-TTY: auto-select; require `--yes`/`--no-input` to apply.
|
|
67
|
+
|
|
68
|
+
Output
|
|
69
|
+
- Writes `agent.modelFallbacks` ordered.
|
|
70
|
+
- Writes `agent.imageModelFallbacks` ordered (image-capable models).
|
|
71
|
+
- Optional `--set-default` to set `agent.model`.
|
|
72
|
+
- Optional `--set-image` to set `agent.imageModel`.
|
|
73
|
+
|
|
74
|
+
## Runtime fallback
|
|
75
|
+
|
|
76
|
+
- On model failure: try `agent.modelFallbacks` in order.
|
|
77
|
+
- Ignore fallback entries not in `agent.allowedModels` (if allowlist set).
|
|
78
|
+
- Persist last successful provider/model to session entry.
|
|
79
|
+
- `/status` shows last used model (not just default).
|
|
80
|
+
|
|
81
|
+
## Tests
|
|
82
|
+
|
|
83
|
+
- Unit: scan selection ordering + probe classification.
|
|
84
|
+
- CLI: list/aliases/fallbacks add/remove + scan writes config.
|
|
85
|
+
- Status: shows last used model + fallbacks.
|
|
86
|
+
|
|
87
|
+
## Docs
|
|
88
|
+
|
|
89
|
+
- Update `docs/configuration.md` with `agent.modelFallbacks`.
|
|
90
|
+
- Keep this doc current when CLI surface or scan logic changes.
|
package/docs/nix.md
ADDED
|
@@ -0,0 +1,49 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "Running Clawdbot under Nix (config, state, and packaging expectations)"
|
|
3
|
+
read_when:
|
|
4
|
+
- Building Clawdbot with Nix
|
|
5
|
+
- Debugging Nix-mode behavior
|
|
6
|
+
---
|
|
7
|
+
# Nix mode
|
|
8
|
+
|
|
9
|
+
Clawdbot supports a **Nix mode** that makes configuration deterministic and disables auto-install flows.
|
|
10
|
+
Enable it by exporting:
|
|
11
|
+
|
|
12
|
+
```
|
|
13
|
+
CLAWDBOT_NIX_MODE=1
|
|
14
|
+
```
|
|
15
|
+
|
|
16
|
+
On macOS, the GUI app does not automatically inherit shell env vars. You can
|
|
17
|
+
also enable Nix mode via defaults:
|
|
18
|
+
|
|
19
|
+
```
|
|
20
|
+
defaults write com.clawdbot.mac clawdbot.nixMode -bool true
|
|
21
|
+
```
|
|
22
|
+
|
|
23
|
+
## Config + state paths
|
|
24
|
+
|
|
25
|
+
Clawdbot reads JSON5 config from `CLAWDBOT_CONFIG_PATH` and stores mutable data in `CLAWDBOT_STATE_DIR`.
|
|
26
|
+
|
|
27
|
+
- `CLAWDBOT_STATE_DIR` (default: `~/.clawdbot`)
|
|
28
|
+
- `CLAWDBOT_CONFIG_PATH` (default: `$CLAWDBOT_STATE_DIR/clawdbot.json`)
|
|
29
|
+
|
|
30
|
+
When running under Nix, set these explicitly to Nix-managed locations so runtime state and config
|
|
31
|
+
stay out of the immutable store.
|
|
32
|
+
|
|
33
|
+
## Runtime behavior in Nix mode
|
|
34
|
+
|
|
35
|
+
- Auto-install and self-mutation flows should be disabled.
|
|
36
|
+
- Missing dependencies should surface Nix-specific remediation messages.
|
|
37
|
+
- UI surfaces a read-only Nix mode banner when present.
|
|
38
|
+
|
|
39
|
+
## Packaging note (macOS)
|
|
40
|
+
|
|
41
|
+
The macOS packaging flow expects a stable Info.plist template at:
|
|
42
|
+
|
|
43
|
+
```
|
|
44
|
+
apps/macos/Sources/Clawdbot/Resources/Info.plist
|
|
45
|
+
```
|
|
46
|
+
|
|
47
|
+
`scripts/package-mac-app.sh` copies this template into the app bundle and patches dynamic fields
|
|
48
|
+
(bundle ID, version/build, Git SHA, Sparkle keys). This keeps the plist deterministic for SwiftPM
|
|
49
|
+
packaging and Nix builds (which do not rely on a full Xcode toolchain).
|