clawdbot 2026.1.4-1

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (550) hide show
  1. package/CHANGELOG.md +120 -0
  2. package/LICENSE +21 -0
  3. package/README-header.png +0 -0
  4. package/README.md +297 -0
  5. package/dist/agents/agent-paths.js +17 -0
  6. package/dist/agents/bash-process-registry.js +126 -0
  7. package/dist/agents/bash-tools.js +837 -0
  8. package/dist/agents/clawdbot-tools.js +30 -0
  9. package/dist/agents/clawdis-tools.js +27 -0
  10. package/dist/agents/context.js +34 -0
  11. package/dist/agents/defaults.js +6 -0
  12. package/dist/agents/model-auth.js +112 -0
  13. package/dist/agents/model-catalog.js +55 -0
  14. package/dist/agents/model-fallback.js +191 -0
  15. package/dist/agents/model-scan.js +263 -0
  16. package/dist/agents/model-selection.js +116 -0
  17. package/dist/agents/models-config.js +49 -0
  18. package/dist/agents/pi-embedded-helpers.js +74 -0
  19. package/dist/agents/pi-embedded-runner.js +407 -0
  20. package/dist/agents/pi-embedded-subscribe.js +568 -0
  21. package/dist/agents/pi-embedded-utils.js +20 -0
  22. package/dist/agents/pi-embedded.js +1 -0
  23. package/dist/agents/pi-oauth.js +88 -0
  24. package/dist/agents/pi-tools.js +433 -0
  25. package/dist/agents/sandbox-paths.js +68 -0
  26. package/dist/agents/sandbox.js +644 -0
  27. package/dist/agents/shell-utils.js +53 -0
  28. package/dist/agents/skills-install.js +244 -0
  29. package/dist/agents/skills-status.js +157 -0
  30. package/dist/agents/skills.js +470 -0
  31. package/dist/agents/steerable-agent-loop.js +338 -0
  32. package/dist/agents/steerable-provider-transport.js +48 -0
  33. package/dist/agents/system-prompt.js +104 -0
  34. package/dist/agents/tool-display.js +162 -0
  35. package/dist/agents/tool-images.js +138 -0
  36. package/dist/agents/tools/browser-tool.js +339 -0
  37. package/dist/agents/tools/canvas-tool.js +193 -0
  38. package/dist/agents/tools/common.js +88 -0
  39. package/dist/agents/tools/cron-tool.js +124 -0
  40. package/dist/agents/tools/discord-actions-guild.js +186 -0
  41. package/dist/agents/tools/discord-actions-messaging.js +285 -0
  42. package/dist/agents/tools/discord-actions-moderation.js +70 -0
  43. package/dist/agents/tools/discord-actions.js +56 -0
  44. package/dist/agents/tools/discord-schema.js +199 -0
  45. package/dist/agents/tools/discord-tool.js +16 -0
  46. package/dist/agents/tools/gateway-tool.js +46 -0
  47. package/dist/agents/tools/gateway.js +27 -0
  48. package/dist/agents/tools/image-tool.js +132 -0
  49. package/dist/agents/tools/nodes-tool.js +413 -0
  50. package/dist/agents/tools/nodes-utils.js +92 -0
  51. package/dist/agents/tools/sessions-helpers.js +88 -0
  52. package/dist/agents/tools/sessions-history-tool.js +53 -0
  53. package/dist/agents/tools/sessions-list-tool.js +143 -0
  54. package/dist/agents/tools/sessions-send-helpers.js +100 -0
  55. package/dist/agents/tools/sessions-send-tool.js +347 -0
  56. package/dist/agents/tools/slack-actions.js +129 -0
  57. package/dist/agents/tools/slack-schema.js +59 -0
  58. package/dist/agents/tools/slack-tool.js +16 -0
  59. package/dist/agents/usage.js +39 -0
  60. package/dist/agents/workspace.js +241 -0
  61. package/dist/auto-reply/chunk.js +76 -0
  62. package/dist/auto-reply/envelope.js +38 -0
  63. package/dist/auto-reply/group-activation.js +20 -0
  64. package/dist/auto-reply/heartbeat.js +57 -0
  65. package/dist/auto-reply/model.js +14 -0
  66. package/dist/auto-reply/reply/abort.js +14 -0
  67. package/dist/auto-reply/reply/agent-runner.js +371 -0
  68. package/dist/auto-reply/reply/block-streaming.js +34 -0
  69. package/dist/auto-reply/reply/body.js +29 -0
  70. package/dist/auto-reply/reply/commands.js +207 -0
  71. package/dist/auto-reply/reply/directive-handling.js +361 -0
  72. package/dist/auto-reply/reply/directives.js +47 -0
  73. package/dist/auto-reply/reply/followup-runner.js +149 -0
  74. package/dist/auto-reply/reply/groups.js +91 -0
  75. package/dist/auto-reply/reply/mentions.js +38 -0
  76. package/dist/auto-reply/reply/model-selection.js +114 -0
  77. package/dist/auto-reply/reply/queue.js +399 -0
  78. package/dist/auto-reply/reply/reply-tags.js +26 -0
  79. package/dist/auto-reply/reply/session-updates.js +87 -0
  80. package/dist/auto-reply/reply/session.js +160 -0
  81. package/dist/auto-reply/reply/typing.js +75 -0
  82. package/dist/auto-reply/reply.js +535 -0
  83. package/dist/auto-reply/send-policy.js +28 -0
  84. package/dist/auto-reply/status.js +158 -0
  85. package/dist/auto-reply/templating.js +9 -0
  86. package/dist/auto-reply/thinking.js +49 -0
  87. package/dist/auto-reply/tokens.js +2 -0
  88. package/dist/auto-reply/tool-meta.js +74 -0
  89. package/dist/auto-reply/transcription.js +57 -0
  90. package/dist/auto-reply/types.js +1 -0
  91. package/dist/browser/bridge-server.js +37 -0
  92. package/dist/browser/cdp.js +382 -0
  93. package/dist/browser/chrome.js +432 -0
  94. package/dist/browser/client-actions-core.js +67 -0
  95. package/dist/browser/client-actions-observe.js +24 -0
  96. package/dist/browser/client-actions-types.js +1 -0
  97. package/dist/browser/client-actions.js +3 -0
  98. package/dist/browser/client-fetch.js +43 -0
  99. package/dist/browser/client.js +105 -0
  100. package/dist/browser/config.js +140 -0
  101. package/dist/browser/constants.js +4 -0
  102. package/dist/browser/profiles-service.js +122 -0
  103. package/dist/browser/profiles.js +85 -0
  104. package/dist/browser/pw-ai.js +2 -0
  105. package/dist/browser/pw-session.js +144 -0
  106. package/dist/browser/pw-tools-core.js +363 -0
  107. package/dist/browser/routes/agent.js +535 -0
  108. package/dist/browser/routes/basic.js +155 -0
  109. package/dist/browser/routes/index.js +8 -0
  110. package/dist/browser/routes/tabs.js +105 -0
  111. package/dist/browser/routes/utils.js +62 -0
  112. package/dist/browser/screenshot.js +40 -0
  113. package/dist/browser/server-context.js +377 -0
  114. package/dist/browser/server.js +81 -0
  115. package/dist/browser/target-id.js +18 -0
  116. package/dist/browser/trash.js +21 -0
  117. package/dist/canvas-host/a2ui/.bundle.hash +1 -0
  118. package/dist/canvas-host/a2ui/a2ui.bundle.js +17768 -0
  119. package/dist/canvas-host/a2ui/index.html +246 -0
  120. package/dist/canvas-host/a2ui.js +187 -0
  121. package/dist/canvas-host/server.js +382 -0
  122. package/dist/cli/browser-cli-actions-input.js +459 -0
  123. package/dist/cli/browser-cli-actions-observe.js +56 -0
  124. package/dist/cli/browser-cli-examples.js +31 -0
  125. package/dist/cli/browser-cli-inspect.js +97 -0
  126. package/dist/cli/browser-cli-manage.js +286 -0
  127. package/dist/cli/browser-cli-shared.js +1 -0
  128. package/dist/cli/browser-cli.js +26 -0
  129. package/dist/cli/canvas-cli.js +416 -0
  130. package/dist/cli/cron-cli.js +454 -0
  131. package/dist/cli/deps.js +17 -0
  132. package/dist/cli/dns-cli.js +180 -0
  133. package/dist/cli/gateway-cli.js +489 -0
  134. package/dist/cli/gateway-rpc.js +20 -0
  135. package/dist/cli/hooks-cli.js +135 -0
  136. package/dist/cli/models-cli.js +248 -0
  137. package/dist/cli/nodes-camera.js +57 -0
  138. package/dist/cli/nodes-canvas.js +26 -0
  139. package/dist/cli/nodes-cli.js +946 -0
  140. package/dist/cli/nodes-screen.js +37 -0
  141. package/dist/cli/parse-duration.js +20 -0
  142. package/dist/cli/ports.js +97 -0
  143. package/dist/cli/program.js +406 -0
  144. package/dist/cli/prompt.js +19 -0
  145. package/dist/cli/tui-cli.js +35 -0
  146. package/dist/cli/wait.js +8 -0
  147. package/dist/commands/agent.js +645 -0
  148. package/dist/commands/antigravity-oauth.js +327 -0
  149. package/dist/commands/configure.js +480 -0
  150. package/dist/commands/doctor.js +484 -0
  151. package/dist/commands/health.js +108 -0
  152. package/dist/commands/models/aliases.js +64 -0
  153. package/dist/commands/models/fallbacks.js +99 -0
  154. package/dist/commands/models/image-fallbacks.js +99 -0
  155. package/dist/commands/models/list.js +323 -0
  156. package/dist/commands/models/scan.js +266 -0
  157. package/dist/commands/models/set-image.js +23 -0
  158. package/dist/commands/models/set.js +23 -0
  159. package/dist/commands/models/shared.js +72 -0
  160. package/dist/commands/models.js +7 -0
  161. package/dist/commands/onboard-auth.js +70 -0
  162. package/dist/commands/onboard-helpers.js +295 -0
  163. package/dist/commands/onboard-interactive.js +17 -0
  164. package/dist/commands/onboard-non-interactive.js +202 -0
  165. package/dist/commands/onboard-providers.js +634 -0
  166. package/dist/commands/onboard-remote.js +120 -0
  167. package/dist/commands/onboard-skills.js +148 -0
  168. package/dist/commands/onboard-types.js +1 -0
  169. package/dist/commands/onboard.js +12 -0
  170. package/dist/commands/send.js +124 -0
  171. package/dist/commands/sessions.js +212 -0
  172. package/dist/commands/setup.js +58 -0
  173. package/dist/commands/signal-install.js +135 -0
  174. package/dist/commands/status.js +207 -0
  175. package/dist/commands/update.js +16 -0
  176. package/dist/config/config.js +6 -0
  177. package/dist/config/defaults.js +61 -0
  178. package/dist/config/io.js +147 -0
  179. package/dist/config/legacy-migrate.js +13 -0
  180. package/dist/config/legacy.js +159 -0
  181. package/dist/config/paths.js +71 -0
  182. package/dist/config/schema.js +150 -0
  183. package/dist/config/sessions.js +282 -0
  184. package/dist/config/talk.js +31 -0
  185. package/dist/config/types.js +1 -0
  186. package/dist/config/validation.js +29 -0
  187. package/dist/config/zod-schema.js +831 -0
  188. package/dist/control-ui/assets/index-BFID3yAA.css +1 -0
  189. package/dist/control-ui/assets/index-CE_axlTS.js +2235 -0
  190. package/dist/control-ui/assets/index-CE_axlTS.js.map +1 -0
  191. package/dist/control-ui/index.html +15 -0
  192. package/dist/cron/isolated-agent.js +499 -0
  193. package/dist/cron/run-log.js +72 -0
  194. package/dist/cron/schedule.js +24 -0
  195. package/dist/cron/service.js +471 -0
  196. package/dist/cron/store.js +43 -0
  197. package/dist/cron/types.js +1 -0
  198. package/dist/daemon/constants.js +10 -0
  199. package/dist/daemon/launchd.js +276 -0
  200. package/dist/daemon/legacy.js +63 -0
  201. package/dist/daemon/program-args.js +76 -0
  202. package/dist/daemon/schtasks.js +257 -0
  203. package/dist/daemon/service.js +60 -0
  204. package/dist/daemon/systemd.js +266 -0
  205. package/dist/discord/index.js +2 -0
  206. package/dist/discord/monitor.js +1188 -0
  207. package/dist/discord/probe.js +54 -0
  208. package/dist/discord/send.js +577 -0
  209. package/dist/discord/token.js +8 -0
  210. package/dist/gateway/auth.js +121 -0
  211. package/dist/gateway/call.js +94 -0
  212. package/dist/gateway/chat-attachments.js +41 -0
  213. package/dist/gateway/client.js +180 -0
  214. package/dist/gateway/config-reload.js +274 -0
  215. package/dist/gateway/control-ui.js +184 -0
  216. package/dist/gateway/hooks-mapping.js +282 -0
  217. package/dist/gateway/hooks.js +168 -0
  218. package/dist/gateway/net.js +29 -0
  219. package/dist/gateway/protocol/index.js +61 -0
  220. package/dist/gateway/protocol/schema.js +560 -0
  221. package/dist/gateway/server-bridge-subscriptions.js +93 -0
  222. package/dist/gateway/server-bridge.js +1013 -0
  223. package/dist/gateway/server-browser.js +12 -0
  224. package/dist/gateway/server-chat.js +159 -0
  225. package/dist/gateway/server-constants.js +8 -0
  226. package/dist/gateway/server-discovery.js +62 -0
  227. package/dist/gateway/server-http.js +165 -0
  228. package/dist/gateway/server-methods/agent-job.js +125 -0
  229. package/dist/gateway/server-methods/agent.js +250 -0
  230. package/dist/gateway/server-methods/chat.js +200 -0
  231. package/dist/gateway/server-methods/config.js +50 -0
  232. package/dist/gateway/server-methods/connect.js +6 -0
  233. package/dist/gateway/server-methods/cron.js +83 -0
  234. package/dist/gateway/server-methods/health.js +28 -0
  235. package/dist/gateway/server-methods/models.js +16 -0
  236. package/dist/gateway/server-methods/nodes.js +294 -0
  237. package/dist/gateway/server-methods/providers.js +217 -0
  238. package/dist/gateway/server-methods/send.js +166 -0
  239. package/dist/gateway/server-methods/sessions.js +305 -0
  240. package/dist/gateway/server-methods/skills.js +83 -0
  241. package/dist/gateway/server-methods/system.js +118 -0
  242. package/dist/gateway/server-methods/talk.js +22 -0
  243. package/dist/gateway/server-methods/types.js +1 -0
  244. package/dist/gateway/server-methods/voicewake.js +30 -0
  245. package/dist/gateway/server-methods/web.js +58 -0
  246. package/dist/gateway/server-methods/wizard.js +100 -0
  247. package/dist/gateway/server-methods.js +53 -0
  248. package/dist/gateway/server-providers.js +644 -0
  249. package/dist/gateway/server-shared.js +1 -0
  250. package/dist/gateway/server-utils.js +35 -0
  251. package/dist/gateway/server.js +1437 -0
  252. package/dist/gateway/session-utils.js +216 -0
  253. package/dist/gateway/ws-log.js +349 -0
  254. package/dist/gateway/ws-logging.js +8 -0
  255. package/dist/globals.js +41 -0
  256. package/dist/hooks/gmail-ops.js +236 -0
  257. package/dist/hooks/gmail-setup-utils.js +278 -0
  258. package/dist/hooks/gmail-watcher.js +175 -0
  259. package/dist/hooks/gmail.js +177 -0
  260. package/dist/imessage/client.js +165 -0
  261. package/dist/imessage/index.js +3 -0
  262. package/dist/imessage/monitor.js +272 -0
  263. package/dist/imessage/probe.js +26 -0
  264. package/dist/imessage/send.js +83 -0
  265. package/dist/imessage/targets.js +176 -0
  266. package/dist/index.js +50 -0
  267. package/dist/infra/agent-events.js +46 -0
  268. package/dist/infra/binaries.js +9 -0
  269. package/dist/infra/bonjour-discovery.js +163 -0
  270. package/dist/infra/bonjour.js +200 -0
  271. package/dist/infra/bridge/server.js +562 -0
  272. package/dist/infra/canvas-host-url.js +54 -0
  273. package/dist/infra/env.js +8 -0
  274. package/dist/infra/errors.js +28 -0
  275. package/dist/infra/gateway-lock.js +8 -0
  276. package/dist/infra/heartbeat-events.js +21 -0
  277. package/dist/infra/heartbeat-runner.js +453 -0
  278. package/dist/infra/heartbeat-wake.js +61 -0
  279. package/dist/infra/is-main.js +37 -0
  280. package/dist/infra/machine-name.js +40 -0
  281. package/dist/infra/node-pairing.js +211 -0
  282. package/dist/infra/pam.js +42 -0
  283. package/dist/infra/path-env.js +92 -0
  284. package/dist/infra/ports.js +87 -0
  285. package/dist/infra/provider-summary.js +80 -0
  286. package/dist/infra/restart.js +29 -0
  287. package/dist/infra/retry.js +16 -0
  288. package/dist/infra/runtime-guard.js +59 -0
  289. package/dist/infra/system-events.js +44 -0
  290. package/dist/infra/system-presence.js +216 -0
  291. package/dist/infra/tailnet.js +46 -0
  292. package/dist/infra/tailscale.js +149 -0
  293. package/dist/infra/voicewake.js +77 -0
  294. package/dist/infra/widearea-dns.js +123 -0
  295. package/dist/infra/ws.js +13 -0
  296. package/dist/logger.js +52 -0
  297. package/dist/logging.js +490 -0
  298. package/dist/macos/gateway-daemon.js +141 -0
  299. package/dist/macos/relay.js +46 -0
  300. package/dist/media/constants.js +33 -0
  301. package/dist/media/host.js +42 -0
  302. package/dist/media/image-ops.js +121 -0
  303. package/dist/media/mime.js +115 -0
  304. package/dist/media/parse.js +81 -0
  305. package/dist/media/server.js +64 -0
  306. package/dist/media/store.js +139 -0
  307. package/dist/process/command-queue.js +97 -0
  308. package/dist/process/exec.js +75 -0
  309. package/dist/protocol.schema.json +2918 -0
  310. package/dist/provider-web.js +8 -0
  311. package/dist/providers/web/index.js +2 -0
  312. package/dist/runtime.js +8 -0
  313. package/dist/sessions/send-policy.js +68 -0
  314. package/dist/signal/client.js +134 -0
  315. package/dist/signal/daemon.js +69 -0
  316. package/dist/signal/index.js +3 -0
  317. package/dist/signal/monitor.js +336 -0
  318. package/dist/signal/probe.js +46 -0
  319. package/dist/signal/send.js +91 -0
  320. package/dist/slack/actions.js +97 -0
  321. package/dist/slack/index.js +5 -0
  322. package/dist/slack/monitor.js +1029 -0
  323. package/dist/slack/probe.js +47 -0
  324. package/dist/slack/send.js +131 -0
  325. package/dist/slack/token.js +10 -0
  326. package/dist/telegram/bot.js +394 -0
  327. package/dist/telegram/download.js +34 -0
  328. package/dist/telegram/index.js +4 -0
  329. package/dist/telegram/monitor.js +47 -0
  330. package/dist/telegram/probe.js +63 -0
  331. package/dist/telegram/proxy.js +9 -0
  332. package/dist/telegram/send.js +138 -0
  333. package/dist/telegram/token.js +30 -0
  334. package/dist/telegram/webhook-set.js +12 -0
  335. package/dist/telegram/webhook.js +56 -0
  336. package/dist/tui/commands.js +74 -0
  337. package/dist/tui/components/assistant-message.js +16 -0
  338. package/dist/tui/components/chat-log.js +92 -0
  339. package/dist/tui/components/custom-editor.js +53 -0
  340. package/dist/tui/components/selectors.js +8 -0
  341. package/dist/tui/components/tool-execution.js +111 -0
  342. package/dist/tui/components/user-message.js +17 -0
  343. package/dist/tui/gateway-chat.js +140 -0
  344. package/dist/tui/layout.js +41 -0
  345. package/dist/tui/message-list.js +57 -0
  346. package/dist/tui/theme/theme.js +80 -0
  347. package/dist/tui/theme.js +25 -0
  348. package/dist/tui/tui.js +708 -0
  349. package/dist/utils.js +133 -0
  350. package/dist/version.js +18 -0
  351. package/dist/web/active-listener.js +7 -0
  352. package/dist/web/auto-reply.js +1203 -0
  353. package/dist/web/inbound.js +481 -0
  354. package/dist/web/login-qr.js +204 -0
  355. package/dist/web/login.js +59 -0
  356. package/dist/web/media.js +148 -0
  357. package/dist/web/outbound.js +67 -0
  358. package/dist/web/qr-image.js +97 -0
  359. package/dist/web/reconnect.js +60 -0
  360. package/dist/web/reply-heartbeat-wake.js +61 -0
  361. package/dist/web/session.js +346 -0
  362. package/dist/wizard/clack-prompter.js +56 -0
  363. package/dist/wizard/onboarding.js +452 -0
  364. package/dist/wizard/prompts.js +6 -0
  365. package/dist/wizard/session.js +203 -0
  366. package/docs/AGENTS.default.md +116 -0
  367. package/docs/CNAME +1 -0
  368. package/docs/RELEASING.md +64 -0
  369. package/docs/_config.yml +51 -0
  370. package/docs/_layouts/default.html +145 -0
  371. package/docs/agent-send.md +21 -0
  372. package/docs/agent.md +104 -0
  373. package/docs/android/connect.md +131 -0
  374. package/docs/architecture.md +89 -0
  375. package/docs/assets/markdown.css +130 -0
  376. package/docs/assets/pixel-lobster.svg +60 -0
  377. package/docs/assets/terminal.css +497 -0
  378. package/docs/assets/theme.js +55 -0
  379. package/docs/audio.md +50 -0
  380. package/docs/background-process.md +74 -0
  381. package/docs/bash.md +32 -0
  382. package/docs/bonjour.md +159 -0
  383. package/docs/browser.md +289 -0
  384. package/docs/camera.md +152 -0
  385. package/docs/clawd.md +199 -0
  386. package/docs/clawdbot-mac.md +104 -0
  387. package/docs/configuration.md +1177 -0
  388. package/docs/control-api.md +49 -0
  389. package/docs/control-ui.md +83 -0
  390. package/docs/cron.md +374 -0
  391. package/docs/dashboard.md +17 -0
  392. package/docs/device-models.md +46 -0
  393. package/docs/discord.md +293 -0
  394. package/docs/discovery.md +112 -0
  395. package/docs/docker.md +251 -0
  396. package/docs/docs.json +86 -0
  397. package/docs/doctor.md +47 -0
  398. package/docs/elevated.md +31 -0
  399. package/docs/faq.md +640 -0
  400. package/docs/gateway/pairing.md +109 -0
  401. package/docs/gateway-lock.md +28 -0
  402. package/docs/gateway.md +174 -0
  403. package/docs/gmail-pubsub.md +191 -0
  404. package/docs/grammy.md +27 -0
  405. package/docs/group-messages.md +71 -0
  406. package/docs/groups.md +78 -0
  407. package/docs/health.md +28 -0
  408. package/docs/heartbeat.md +64 -0
  409. package/docs/images.md +52 -0
  410. package/docs/imessage.md +63 -0
  411. package/docs/index.md +182 -0
  412. package/docs/ios/connect.md +177 -0
  413. package/docs/ios/spec.md +236 -0
  414. package/docs/location-command.md +95 -0
  415. package/docs/logging.md +99 -0
  416. package/docs/lore.md +131 -0
  417. package/docs/mac/bun.md +133 -0
  418. package/docs/mac/canvas.md +161 -0
  419. package/docs/mac/child-process.md +72 -0
  420. package/docs/mac/dev-setup.md +81 -0
  421. package/docs/mac/health.md +28 -0
  422. package/docs/mac/icon.md +26 -0
  423. package/docs/mac/logging.md +51 -0
  424. package/docs/mac/menu-bar.md +69 -0
  425. package/docs/mac/peekaboo.md +170 -0
  426. package/docs/mac/permissions.md +40 -0
  427. package/docs/mac/release.md +76 -0
  428. package/docs/mac/remote.md +57 -0
  429. package/docs/mac/signing.md +41 -0
  430. package/docs/mac/skills.md +27 -0
  431. package/docs/mac/voice-overlay.md +52 -0
  432. package/docs/mac/voicewake.md +56 -0
  433. package/docs/mac/webchat.md +27 -0
  434. package/docs/mac/xpc.md +40 -0
  435. package/docs/models.md +90 -0
  436. package/docs/nix.md +49 -0
  437. package/docs/nodes.md +157 -0
  438. package/docs/onboarding-config-protocol.md +29 -0
  439. package/docs/onboarding.md +185 -0
  440. package/docs/presence.md +133 -0
  441. package/docs/queue.md +78 -0
  442. package/docs/refactor/browser-control-simplification.md +58 -0
  443. package/docs/refactor/canvas-a2ui.md +93 -0
  444. package/docs/refactor/cli-unification.md +64 -0
  445. package/docs/refactor/gateway-client.md +31 -0
  446. package/docs/refactor/gateway.md +99 -0
  447. package/docs/refactor/new-arch.md +171 -0
  448. package/docs/refactor/tui.md +26 -0
  449. package/docs/refactor/web-gateway-troubleshooting.md +37 -0
  450. package/docs/refactor/webagent-session.md +46 -0
  451. package/docs/remote-gateway-readme.md +148 -0
  452. package/docs/remote.md +66 -0
  453. package/docs/research/memory.md +227 -0
  454. package/docs/rpc.md +35 -0
  455. package/docs/security.md +168 -0
  456. package/docs/session-tool.md +119 -0
  457. package/docs/session.md +84 -0
  458. package/docs/sessions.md +8 -0
  459. package/docs/setup.md +118 -0
  460. package/docs/signal.md +113 -0
  461. package/docs/skills-config.md +58 -0
  462. package/docs/skills.md +149 -0
  463. package/docs/slack.md +158 -0
  464. package/docs/surface.md +20 -0
  465. package/docs/tailscale.md +71 -0
  466. package/docs/talk.md +79 -0
  467. package/docs/telegram.md +90 -0
  468. package/docs/templates/AGENTS.md +126 -0
  469. package/docs/templates/BOOTSTRAP.md +53 -0
  470. package/docs/templates/IDENTITY.md +17 -0
  471. package/docs/templates/SOUL.md +41 -0
  472. package/docs/templates/TOOLS.md +41 -0
  473. package/docs/templates/USER.md +22 -0
  474. package/docs/test.md +35 -0
  475. package/docs/thinking.md +46 -0
  476. package/docs/tools.md +248 -0
  477. package/docs/troubleshooting.md +227 -0
  478. package/docs/tui.md +69 -0
  479. package/docs/typebox.md +42 -0
  480. package/docs/voicewake.md +61 -0
  481. package/docs/web.md +115 -0
  482. package/docs/webchat.md +34 -0
  483. package/docs/webhook.md +132 -0
  484. package/docs/whatsapp-clawd.jpg +0 -0
  485. package/docs/whatsapp.md +142 -0
  486. package/docs/wizard.md +158 -0
  487. package/package.json +186 -0
  488. package/skills/apple-notes/SKILL.md +50 -0
  489. package/skills/apple-reminders/SKILL.md +67 -0
  490. package/skills/bear-notes/SKILL.md +79 -0
  491. package/skills/bird/SKILL.md +25 -0
  492. package/skills/blogwatcher/SKILL.md +46 -0
  493. package/skills/blucli/SKILL.md +27 -0
  494. package/skills/brave-search/SKILL.md +30 -0
  495. package/skills/brave-search/scripts/content.mjs +53 -0
  496. package/skills/brave-search/scripts/search.mjs +79 -0
  497. package/skills/camsnap/SKILL.md +25 -0
  498. package/skills/clawdhub/SKILL.md +53 -0
  499. package/skills/coding-agent/SKILL.md +275 -0
  500. package/skills/discord/SKILL.md +369 -0
  501. package/skills/eightctl/SKILL.md +29 -0
  502. package/skills/food-order/SKILL.md +41 -0
  503. package/skills/gemini/SKILL.md +23 -0
  504. package/skills/gifgrep/SKILL.md +47 -0
  505. package/skills/github/SKILL.md +47 -0
  506. package/skills/gog/SKILL.md +36 -0
  507. package/skills/goplaces/SKILL.md +30 -0
  508. package/skills/imsg/SKILL.md +25 -0
  509. package/skills/local-places/SERVER_README.md +101 -0
  510. package/skills/local-places/SKILL.md +91 -0
  511. package/skills/local-places/pyproject.toml +27 -0
  512. package/skills/local-places/src/local_places/__init__.py +2 -0
  513. package/skills/local-places/src/local_places/__pycache__/__init__.cpython-314.pyc +0 -0
  514. package/skills/local-places/src/local_places/__pycache__/google_places.cpython-314.pyc +0 -0
  515. package/skills/local-places/src/local_places/__pycache__/main.cpython-314.pyc +0 -0
  516. package/skills/local-places/src/local_places/__pycache__/schemas.cpython-314.pyc +0 -0
  517. package/skills/local-places/src/local_places/google_places.py +314 -0
  518. package/skills/local-places/src/local_places/main.py +65 -0
  519. package/skills/local-places/src/local_places/schemas.py +107 -0
  520. package/skills/mcporter/SKILL.md +38 -0
  521. package/skills/nano-banana-pro/SKILL.md +29 -0
  522. package/skills/nano-banana-pro/scripts/generate_image.py +167 -0
  523. package/skills/nano-pdf/SKILL.md +20 -0
  524. package/skills/notion/SKILL.md +156 -0
  525. package/skills/obsidian/SKILL.md +55 -0
  526. package/skills/openai-image-gen/SKILL.md +31 -0
  527. package/skills/openai-image-gen/scripts/gen.py +173 -0
  528. package/skills/openai-whisper/SKILL.md +19 -0
  529. package/skills/openai-whisper-api/SKILL.md +43 -0
  530. package/skills/openai-whisper-api/scripts/transcribe.sh +85 -0
  531. package/skills/openhue/SKILL.md +30 -0
  532. package/skills/oracle/SKILL.md +105 -0
  533. package/skills/ordercli/SKILL.md +47 -0
  534. package/skills/peekaboo/SKILL.md +153 -0
  535. package/skills/qmd/SKILL.md +26 -0
  536. package/skills/sag/SKILL.md +62 -0
  537. package/skills/slack/SKILL.md +143 -0
  538. package/skills/songsee/SKILL.md +29 -0
  539. package/skills/sonoscli/SKILL.md +26 -0
  540. package/skills/spotify-player/SKILL.md +34 -0
  541. package/skills/summarize/SKILL.md +49 -0
  542. package/skills/things-mac/SKILL.md +61 -0
  543. package/skills/tmux/SKILL.md +121 -0
  544. package/skills/tmux/scripts/find-sessions.sh +112 -0
  545. package/skills/tmux/scripts/wait-for-text.sh +83 -0
  546. package/skills/trello/SKILL.md +84 -0
  547. package/skills/video-frames/SKILL.md +29 -0
  548. package/skills/video-frames/scripts/frame.sh +81 -0
  549. package/skills/wacli/SKILL.md +42 -0
  550. package/skills/weather/SKILL.md +49 -0
@@ -0,0 +1,40 @@
1
+ ---
2
+ summary: "macOS permission persistence (TCC) and signing requirements"
3
+ read_when:
4
+ - Debugging missing or stuck macOS permission prompts
5
+ - Packaging or signing the macOS app
6
+ - Changing bundle IDs or app install paths
7
+ ---
8
+ # macOS permissions (TCC)
9
+
10
+ macOS permission grants are fragile. TCC associates a permission grant with the
11
+ app's code signature, bundle identifier, and on-disk path. If any of those change,
12
+ macOS treats the app as new and may drop or hide prompts.
13
+
14
+ ## Requirements for stable permissions
15
+ - Same path: run the app from a fixed location (for Clawdbot, `dist/Clawdbot.app`).
16
+ - Same bundle identifier: changing the bundle ID creates a new permission identity.
17
+ - Signed app: unsigned or ad-hoc signed builds do not persist permissions.
18
+ - Consistent signature: use a real Apple Development or Developer ID certificate
19
+ so the signature stays stable across rebuilds.
20
+
21
+ Ad-hoc signatures generate a new identity every build. macOS will forget previous
22
+ grants, and prompts can disappear entirely until the stale entries are cleared.
23
+
24
+ ## Recovery checklist when prompts disappear
25
+ 1. Quit the app.
26
+ 2. Remove the app entry in System Settings -> Privacy & Security.
27
+ 3. Relaunch the app from the same path and re-grant permissions.
28
+ 4. If the prompt still does not appear, reset TCC entries with `tccutil` and try again.
29
+ 5. Some permissions only reappear after a full macOS restart.
30
+
31
+ Example resets (replace bundle ID as needed):
32
+
33
+ ```bash
34
+ sudo tccutil reset Accessibility com.clawdbot.mac
35
+ sudo tccutil reset ScreenCapture com.clawdbot.mac
36
+ sudo tccutil reset AppleEvents
37
+ ```
38
+
39
+ If you are testing permissions, always sign with a real certificate. Ad-hoc
40
+ builds are only acceptable for quick local runs where permissions do not matter.
@@ -0,0 +1,76 @@
1
+ ---
2
+ summary: "Clawdbot macOS release checklist (Sparkle feed, packaging, signing)"
3
+ read_when:
4
+ - Cutting or validating a Clawdbot macOS release
5
+ - Updating the Sparkle appcast or feed assets
6
+ ---
7
+
8
+ # Clawdbot macOS release (Sparkle)
9
+
10
+ This app now ships Sparkle auto-updates. Release builds must be Developer ID–signed, zipped, and published with a signed appcast entry.
11
+
12
+ ## Prereqs
13
+ - Developer ID Application cert installed (`Developer ID Application: Peter Steinberger (Y5PE65HELJ)` is expected).
14
+ - Sparkle private key path set in the environment as `SPARKLE_PRIVATE_KEY_FILE`; key lives in `/Users/steipete/Library/CloudStorage/Dropbox/Backup/Sparkle` (same key as Trimmy; public key baked into Info.plist).
15
+ - Notary credentials (keychain profile or API key) for `xcrun notarytool` if you want Gatekeeper-safe DMG/zip distribution.
16
+ - We use a Keychain profile named `clawdbot-notary`, created from App Store Connect API key env vars in your shell profile:
17
+ - `APP_STORE_CONNECT_API_KEY_P8`, `APP_STORE_CONNECT_KEY_ID`, `APP_STORE_CONNECT_ISSUER_ID`
18
+ - `echo "$APP_STORE_CONNECT_API_KEY_P8" | sed 's/\\n/\n/g' > /tmp/clawdbot-notary.p8`
19
+ - `xcrun notarytool store-credentials "clawdbot-notary" --key /tmp/clawdbot-notary.p8 --key-id "$APP_STORE_CONNECT_KEY_ID" --issuer "$APP_STORE_CONNECT_ISSUER_ID"`
20
+ - `pnpm` deps installed (`pnpm install --config.node-linker=hoisted`).
21
+ - Sparkle tools are fetched automatically via SwiftPM at `apps/macos/.build/artifacts/sparkle/Sparkle/bin/` (`sign_update`, `generate_appcast`, etc.).
22
+
23
+ ## Build & package
24
+ Notes:
25
+ - `APP_BUILD` maps to `CFBundleVersion`/`sparkle:version`; keep it numeric + monotonic (no `-beta`), or Sparkle compares it as equal.
26
+ - Universal by default (`arm64 x86_64`). Override with `BUILD_ARCHS="arm64"` if you need arm-only.
27
+
28
+ ```bash
29
+ # From repo root; set release IDs so Sparkle feed is enabled.
30
+ # APP_BUILD must be numeric + monotonic for Sparkle compare.
31
+ BUNDLE_ID=com.clawdbot.mac \
32
+ APP_VERSION=0.1.0 \
33
+ APP_BUILD="$(git rev-list --count HEAD)" \
34
+ BUILD_CONFIG=release \
35
+ SIGN_IDENTITY="Developer ID Application: Peter Steinberger (Y5PE65HELJ)" \
36
+ scripts/package-mac-app.sh
37
+
38
+ # Zip for distribution (includes resource forks for Sparkle delta support)
39
+ ditto -c -k --sequesterRsrc --keepParent dist/Clawdbot.app dist/Clawdbot-0.1.0.zip
40
+
41
+ # Optional: also build a styled DMG for humans (drag to /Applications)
42
+ scripts/create-dmg.sh dist/Clawdbot.app dist/Clawdbot-0.1.0.dmg
43
+
44
+ # Recommended: build + notarize/staple zip + DMG
45
+ # First, create a keychain profile once:
46
+ # xcrun notarytool store-credentials "clawdbot-notary" \
47
+ # --apple-id "<apple-id>" --team-id "<team-id>" --password "<app-specific-password>"
48
+ NOTARIZE=1 NOTARYTOOL_PROFILE=clawdbot-notary \
49
+ BUNDLE_ID=com.clawdbot.mac \
50
+ APP_VERSION=0.1.0 \
51
+ APP_BUILD="$(git rev-list --count HEAD)" \
52
+ BUILD_CONFIG=release \
53
+ SIGN_IDENTITY="Developer ID Application: Peter Steinberger (Y5PE65HELJ)" \
54
+ scripts/package-mac-dist.sh
55
+
56
+ # Optional: ship dSYM alongside the release
57
+ ditto -c -k --keepParent apps/macos/.build/release/Clawdbot.app.dSYM dist/Clawdbot-0.1.0.dSYM.zip
58
+ ```
59
+
60
+ ## Appcast entry
61
+ Use the release note generator so Sparkle renders formatted HTML notes:
62
+ ```bash
63
+ SPARKLE_PRIVATE_KEY_FILE=/Users/steipete/Library/CloudStorage/Dropbox/Backup/Sparkle/ed25519-private-key scripts/make_appcast.sh dist/Clawdbot-0.1.0.zip https://raw.githubusercontent.com/clawdbot/clawdbot/main/appcast.xml
64
+ ```
65
+ Generates HTML release notes from `CHANGELOG.md` (via `scripts/changelog-to-html.sh`) and embeds them in the appcast entry.
66
+ Commit the updated `appcast.xml` alongside the release assets (zip + dSYM) when publishing.
67
+
68
+ ## Publish & verify
69
+ - Upload `Clawdbot-0.1.0.zip` (and `Clawdbot-0.1.0.dSYM.zip`) to the GitHub release for tag `v0.1.0`.
70
+ - Ensure the raw appcast URL matches the baked feed: `https://raw.githubusercontent.com/clawdbot/clawdbot/main/appcast.xml`.
71
+ - Sanity checks:
72
+ - `curl -I https://raw.githubusercontent.com/clawdbot/clawdbot/main/appcast.xml` returns 200.
73
+ - `curl -I <enclosure url>` returns 200 after assets upload.
74
+ - On a previous public build, run “Check for Updates…” from the About tab and verify Sparkle installs the new build cleanly.
75
+
76
+ Definition of done: signed app + appcast are published, update flow works from an older installed version, and release assets are attached to the GitHub release.
@@ -0,0 +1,57 @@
1
+ ---
2
+ summary: "macOS app flow for controlling a remote Clawdbot gateway over SSH"
3
+ read_when:
4
+ - Setting up or debugging remote mac control
5
+ ---
6
+ # Remote Clawdbot (macOS ⇄ remote host)
7
+
8
+ Updated: 2025-12-08
9
+
10
+ This flow lets the macOS app act as a full remote control for a Clawdbot gateway running on another host (e.g. a Mac Studio). All features—health checks, Voice Wake forwarding, and Web Chat—reuse the same remote SSH configuration from *Settings → General*.
11
+
12
+ ## Modes
13
+ - **Local (this Mac)**: Everything runs on the laptop. No SSH involved.
14
+ - **Remote over SSH**: Clawdbot commands are executed on the remote host. The mac app opens an SSH connection with `-o BatchMode` plus your chosen identity/key.
15
+
16
+ ## Prereqs on the remote host
17
+ 1) Install Node + pnpm and build/install the Clawdbot CLI (`pnpm install && pnpm build && pnpm link --global`).
18
+ 2) Ensure `clawdbot` is on PATH for non-interactive shells (symlink into `/usr/local/bin` or `/opt/homebrew/bin` if needed).
19
+ 3) Open SSH with key auth. We recommend **Tailscale** IPs for stable reachability off-LAN.
20
+
21
+ ## macOS app setup
22
+ 1) Open *Settings → General*.
23
+ 2) Under **Clawdbot runs**, pick **Remote over SSH** and set:
24
+ - **SSH target**: `user@host` (optional `:port`).
25
+ - If the gateway is on the same LAN and advertises Bonjour, pick it from the discovered list to auto-fill this field.
26
+ - **Identity file** (advanced): path to your key.
27
+ - **Project root** (advanced): remote checkout path used for commands.
28
+ - **CLI path** (advanced): optional path to a runnable `clawdbot` entrypoint/binary (auto-filled when advertised).
29
+ 3) Hit **Test remote**. Success indicates the remote `clawdbot status --json` runs correctly. Failures usually mean PATH/CLI issues; exit 127 means the CLI isn’t found remotely.
30
+ 4) Health checks and Web Chat will now run through this SSH tunnel automatically.
31
+
32
+ ## Web Chat over SSH
33
+ - Web Chat connects to the gateway over the forwarded WebSocket control port (default 18789).
34
+ - There is no separate WebChat HTTP server anymore.
35
+
36
+ ## Permissions
37
+ - The remote host needs the same TCC approvals as local (Automation, Accessibility, Screen Recording, Microphone, Speech Recognition, Notifications). Run onboarding on that machine to grant them once.
38
+ - Nodes advertise their permission state via `node.list` / `node.describe` so agents know what’s available.
39
+
40
+ ## WhatsApp login flow (remote)
41
+ - Run `clawdbot login --verbose` **on the remote host**. Scan the QR with WhatsApp on your phone.
42
+ - Re-run login on that host if auth expires. Health check will surface link problems.
43
+
44
+ ## Troubleshooting
45
+ - **exit 127 / not found**: `clawdbot` isn’t on PATH for non-login shells. Add it to `/etc/paths`, your shell rc, or symlink into `/usr/local/bin`/`/opt/homebrew/bin`.
46
+ - **Health probe failed**: check SSH reachability, PATH, and that Baileys is logged in (`clawdbot status --json`).
47
+ - **Web Chat stuck**: confirm the gateway is running on the remote host and the forwarded port matches the gateway WS port; the UI requires a healthy WS connection.
48
+ - **Voice Wake**: trigger phrases are forwarded automatically in remote mode; no separate forwarder is needed.
49
+
50
+ ## Notification sounds
51
+ Pick sounds per notification from scripts with `clawdbot` and `node.invoke`, e.g.:
52
+
53
+ ```bash
54
+ clawdbot nodes notify --node <id> --title "Ping" --body "Remote gateway ready" --sound Glass
55
+ ```
56
+
57
+ There is no global “default sound” toggle in the app anymore; callers choose a sound (or none) per request.
@@ -0,0 +1,41 @@
1
+ ---
2
+ summary: "Signing steps for macOS debug builds generated by packaging scripts"
3
+ read_when:
4
+ - Building or signing mac debug builds
5
+ ---
6
+ # mac signing (debug builds)
7
+
8
+ This app is usually built from `scripts/package-mac-app.sh`, which now:
9
+
10
+ - sets a stable debug bundle identifier: `com.clawdbot.mac.debug`
11
+ - writes the Info.plist with that bundle id (override via `BUNDLE_ID=...`)
12
+ - calls `scripts/codesign-mac-app.sh` to sign the main binary, bundled CLI, and app bundle so macOS treats each rebuild as the same signed bundle and keeps TCC permissions (notifications, accessibility, screen recording, mic, speech). For stable permissions, use a real signing identity; ad-hoc is opt-in and fragile (see `docs/mac/permissions.md`).
13
+ - uses `CODESIGN_TIMESTAMP=auto` by default; it enables trusted timestamps for Developer ID signatures. Set `CODESIGN_TIMESTAMP=off` to skip timestamping (offline debug builds).
14
+ - inject build metadata into Info.plist: `ClawdbotBuildTimestamp` (UTC) and `ClawdbotGitCommit` (short hash) so the About pane can show build, git, and debug/release channel.
15
+ - **Packaging requires Bun**: The embedded gateway relay is compiled using `bun`. Ensure it is installed (`curl -fsSL https://bun.sh/install | bash`).
16
+ - reads `SIGN_IDENTITY` from the environment. Add `export SIGN_IDENTITY="Apple Development: Your Name (TEAMID)"` (or your Developer ID Application cert) to your shell rc to always sign with your cert. Ad-hoc signing requires explicit opt-in via `ALLOW_ADHOC_SIGNING=1` or `SIGN_IDENTITY="-"` (not recommended for permission testing).
17
+
18
+ ## Usage
19
+
20
+ ```bash
21
+ # from repo root
22
+ scripts/package-mac-app.sh # auto-selects identity; errors if none found
23
+ SIGN_IDENTITY="Developer ID Application: Your Name" scripts/package-mac-app.sh # real cert
24
+ ALLOW_ADHOC_SIGNING=1 scripts/package-mac-app.sh # ad-hoc (permissions will not stick)
25
+ SIGN_IDENTITY="-" scripts/package-mac-app.sh # explicit ad-hoc (same caveat)
26
+ ```
27
+
28
+ ### Ad-hoc Signing Note
29
+ When signing with `SIGN_IDENTITY="-"` (ad-hoc), the script automatically disables the **Hardened Runtime** (`--options runtime`). This is necessary to prevent crashes when the app attempts to load embedded frameworks (like Sparkle) that do not share the same Team ID. Ad-hoc signatures also break TCC permission persistence; see `docs/mac/permissions.md` for recovery steps.
30
+
31
+ ## Build metadata for About
32
+
33
+ `package-mac-app.sh` stamps the bundle with:
34
+ - `ClawdbotBuildTimestamp`: ISO8601 UTC at package time
35
+ - `ClawdbotGitCommit`: short git hash (or `unknown` if unavailable)
36
+
37
+ The About tab reads these keys to show version, build date, git commit, and whether it’s a debug build (via `#if DEBUG`). Run the packager to refresh these values after code changes.
38
+
39
+ ## Why
40
+
41
+ TCC permissions are tied to the bundle identifier *and* code signature. Unsigned debug builds with changing UUIDs were causing macOS to forget grants after each rebuild. Signing the binaries (ad‑hoc by default) and keeping a fixed bundle id/path (`dist/Clawdbot.app`) preserves the grants between builds, matching the VibeTunnel approach.
@@ -0,0 +1,27 @@
1
+ ---
2
+ summary: "macOS Skills settings UI and gateway-backed status"
3
+ read_when:
4
+ - Updating the macOS Skills settings UI
5
+ - Changing skills gating or install behavior
6
+ ---
7
+ # Skills (macOS)
8
+
9
+ The macOS app surfaces Clawdbot skills via the gateway; it does not parse skills locally.
10
+
11
+ ## Data source
12
+ - `skills.status` (gateway) returns all skills plus eligibility and missing requirements
13
+ (including allowlist blocks for bundled skills).
14
+ - Requirements are derived from `metadata.clawdbot.requires` in each `SKILL.md`.
15
+
16
+ ## Install actions
17
+ - `metadata.clawdbot.install` defines install options (brew/node/go/uv).
18
+ - The app calls `skills.install` to run installers on the gateway host.
19
+ - The gateway surfaces only one preferred installer when multiple are provided
20
+ (brew when available, otherwise node manager from `skills.install`, default npm).
21
+
22
+ ## Env/API keys
23
+ - The app stores keys in `~/.clawdbot/clawdbot.json` under `skills.entries.<skillKey>`.
24
+ - `skills.update` patches `enabled`, `apiKey`, and `env`.
25
+
26
+ ## Remote mode
27
+ - Install + config updates happen on the gateway host (not the local Mac).
@@ -0,0 +1,52 @@
1
+ ---
2
+ summary: "Voice overlay lifecycle when wake-word and push-to-talk overlap"
3
+ read_when:
4
+ - Adjusting voice overlay behavior
5
+ ---
6
+ ## Voice Overlay Lifecycle (macOS)
7
+
8
+ Audience: macOS app contributors. Goal: keep the voice overlay predictable when wake-word and push-to-talk overlap.
9
+
10
+ ### Current intent
11
+ - If the overlay is already visible from wake-word and the user presses the hotkey, the hotkey session *adopts* the existing text instead of resetting it. The overlay stays up while the hotkey is held. When the user releases: send if there is trimmed text, otherwise dismiss.
12
+ - Wake-word alone still auto-sends on silence; push-to-talk sends immediately on release.
13
+
14
+ ### Implemented (Dec 9, 2025)
15
+ - Overlay sessions now carry a token per capture (wake-word or push-to-talk). Partial/final/send/dismiss/level updates are dropped when the token doesn’t match, avoiding stale callbacks.
16
+ - Push-to-talk adopts any visible overlay text as a prefix (so pressing the hotkey while the wake overlay is up keeps the text and appends new speech). It waits up to 1.5s for a final transcript before falling back to the current text.
17
+ - Chime/overlay logging is emitted at `info` in categories `voicewake.overlay`, `voicewake.ptt`, and `voicewake.chime` (session start, partial, final, send, dismiss, chime reason).
18
+
19
+ ### Next steps
20
+ 1. **VoiceSessionCoordinator (actor)**
21
+ - Owns exactly one `VoiceSession` at a time.
22
+ - API (token-based): `beginWakeCapture`, `beginPushToTalk`, `updatePartial`, `endCapture`, `cancel`, `applyCooldown`.
23
+ - Drops callbacks that carry stale tokens (prevents old recognizers from reopening the overlay).
24
+ 2. **VoiceSession (model)**
25
+ - Fields: `token`, `source` (wakeWord|pushToTalk), committed/volatile text, chime flags, timers (auto-send, idle), `overlayMode` (display|editing|sending), cooldown deadline.
26
+ 3. **Overlay binding**
27
+ - `VoiceSessionPublisher` (`ObservableObject`) mirrors the active session into SwiftUI.
28
+ - `VoiceWakeOverlayView` renders only via the publisher; it never mutates global singletons directly.
29
+ - Overlay user actions (`sendNow`, `dismiss`, `edit`) call back into the coordinator with the session token.
30
+ 4. **Unified send path**
31
+ - On `endCapture`: if trimmed text is empty → dismiss; else `performSend(session:)` (plays send chime once, forwards, dismisses).
32
+ - Push-to-talk: no delay; wake-word: optional delay for auto-send.
33
+ - Apply a short cooldown to the wake runtime after push-to-talk finishes so wake-word doesn’t immediately retrigger.
34
+ 5. **Logging**
35
+ - Coordinator emits `.info` logs in subsystem `com.clawdbot`, categories `voicewake.overlay` and `voicewake.chime`.
36
+ - Key events: `session_started`, `adopted_by_push_to_talk`, `partial`, `finalized`, `send`, `dismiss`, `cancel`, `cooldown`.
37
+
38
+ ### Debugging checklist
39
+ - Stream logs while reproducing a sticky overlay:
40
+
41
+ ```bash
42
+ sudo log stream --predicate 'subsystem == "com.clawdbot" AND category CONTAINS "voicewake"' --level info --style compact
43
+ ```
44
+ - Verify only one active session token; stale callbacks should be dropped by the coordinator.
45
+ - Ensure push-to-talk release always calls `endCapture` with the active token; if text is empty, expect `dismiss` without chime or send.
46
+
47
+ ### Migration steps (suggested)
48
+ 1. Add `VoiceSessionCoordinator`, `VoiceSession`, and `VoiceSessionPublisher`.
49
+ 2. Refactor `VoiceWakeRuntime` to create/update/end sessions instead of touching `VoiceWakeOverlayController` directly.
50
+ 3. Refactor `VoicePushToTalk` to adopt existing sessions and call `endCapture` on release; apply runtime cooldown.
51
+ 4. Wire `VoiceWakeOverlayController` to the publisher; remove direct calls from runtime/PTT.
52
+ 5. Add integration tests for session adoption, cooldown, and empty-text dismissal.
@@ -0,0 +1,56 @@
1
+ ---
2
+ summary: "Voice wake and push-to-talk modes plus routing details in the mac app"
3
+ read_when:
4
+ - Working on voice wake or PTT pathways
5
+ ---
6
+ # Voice Wake & Push-to-Talk
7
+
8
+ Updated: 2025-12-23 · Owners: mac app
9
+
10
+ ## Modes
11
+ - **Wake-word mode** (default): always-on Speech recognizer waits for trigger tokens (`swabbleTriggerWords`). On match it starts capture, shows the overlay with partial text, and auto-sends after silence.
12
+ - **Push-to-talk (Right Option hold)**: hold the right Option key to capture immediately—no trigger needed. The overlay appears while held; releasing finalizes and forwards after a short delay so you can tweak text.
13
+
14
+ ## Runtime behavior (wake-word)
15
+ - Speech recognizer lives in `VoiceWakeRuntime`.
16
+ - Trigger only fires when there’s a **meaningful pause** between the wake word and the next word (~0.45s gap).
17
+ - Silence windows: 2.0s when speech is flowing, 5.0s if only the trigger was heard.
18
+ - Hard stop: 120s to prevent runaway sessions.
19
+ - Debounce between sessions: 350ms.
20
+ - Overlay is driven via `VoiceWakeOverlayController` with committed/volatile coloring.
21
+ - After send, recognizer restarts cleanly to listen for the next trigger.
22
+
23
+ ## Lifecycle invariants
24
+ - If Voice Wake is enabled and permissions are granted, the wake-word recognizer should be listening (except during an explicit push-to-talk capture).
25
+ - Overlay visibility (including manual dismiss via the X button) must never prevent the recognizer from resuming.
26
+
27
+ ## Sticky overlay failure mode (previous)
28
+ Previously, if the overlay got stuck visible and you manually closed it, Voice Wake could appear “dead” because the runtime’s restart attempt could be blocked by overlay visibility and no subsequent restart was scheduled.
29
+
30
+ Hardening:
31
+ - Wake runtime restart is no longer blocked by overlay visibility.
32
+ - Overlay dismiss completion triggers a `VoiceWakeRuntime.refresh(...)` via `VoiceSessionCoordinator`, so manual X-dismiss always resumes listening.
33
+
34
+ ## Push-to-talk specifics
35
+ - Hotkey detection uses a global `.flagsChanged` monitor for **right Option** (`keyCode 61` + `.option`). We only observe events (no swallowing).
36
+ - Capture pipeline lives in `VoicePushToTalk`: starts Speech immediately, streams partials to the overlay, and calls `VoiceWakeForwarder` on release.
37
+ - When push-to-talk starts we pause the wake-word runtime to avoid dueling audio taps; it restarts automatically after release.
38
+ - Permissions: requires Microphone + Speech; seeing events needs Accessibility/Input Monitoring approval.
39
+ - External keyboards: some may not expose right Option as expected—offer a fallback shortcut if users report misses.
40
+
41
+ ## User-facing settings
42
+ - **Voice Wake** toggle: enables wake-word runtime.
43
+ - **Hold Cmd+Fn to talk**: enables the push-to-talk monitor. Disabled on macOS < 26.
44
+ - Language & mic pickers, live level meter, trigger-word table, tester.
45
+ - **Sounds**: chimes on trigger detect and on send; defaults to the macOS “Glass” system sound. You can pick any `NSSound`-loadable file (e.g. MP3/WAV/AIFF) for each event or choose **No Sound**.
46
+
47
+ ## Forwarding behavior
48
+ - When Voice Wake is enabled, transcripts are forwarded to the active gateway/agent (the same local vs remote mode used by the rest of the mac app).
49
+ - Replies are delivered to the **last-used main surface** (WhatsApp/Telegram/Discord/WebChat). If delivery fails, the error is logged and the run is still visible via WebChat/session logs.
50
+
51
+ ## Forwarding payload
52
+ - `VoiceWakeForwarder.prefixedTranscript(_:)` prepends the machine hint before sending. Shared between wake-word and push-to-talk paths.
53
+
54
+ ## Quick verification
55
+ - Toggle push-to-talk on, hold Cmd+Fn, speak, release: overlay should show partials then send.
56
+ - While holding, menu-bar ears should stay enlarged (uses `triggerVoiceEars(ttl:nil)`); they drop after release.
@@ -0,0 +1,27 @@
1
+ ---
2
+ summary: "How the mac app embeds the gateway WebChat and how to debug it"
3
+ read_when:
4
+ - Debugging mac WebChat view or loopback port
5
+ ---
6
+ # Web Chat (macOS app)
7
+
8
+ The macOS menu bar app shows the WebChat UI as a native SwiftUI view and reuses the **primary Clawd session** (`main`, or `global` when scope is global).
9
+
10
+ - **Local mode**: connects directly to the local Gateway WebSocket.
11
+ - **Remote mode**: forwards the Gateway WebSocket control port over SSH and uses that as the data plane.
12
+
13
+ ## Launch & debugging
14
+ - Manual: Lobster menu → “Open Chat”.
15
+ - Auto-open for testing: run `dist/Clawdbot.app/Contents/MacOS/Clawdbot --webchat` (or pass `--webchat` to the binary launched by launchd). The window opens on startup.
16
+ - Logs: see `./scripts/clawlog.sh` (subsystem `com.clawdbot`, category `WebChatSwiftUI`).
17
+
18
+ ## How it’s wired
19
+ - Implementation: `apps/macos/Sources/Clawdbot/WebChatSwiftUI.swift` hosts `ClawdbotChatUI` and speaks to the Gateway over `GatewayConnection`.
20
+ - Data plane: Gateway WebSocket methods `chat.history`, `chat.send`, `chat.abort`; events `chat`, `agent`, `presence`, `tick`, `health`.
21
+ - Session: usually primary (`main`); multiple transports (WhatsApp/Telegram/Discord/Desktop) share the same key. The onboarding flow uses a dedicated `onboarding` session to keep first-run setup separate.
22
+
23
+ ## Security / surface area
24
+ - Remote mode forwards only the Gateway WebSocket control port over SSH.
25
+
26
+ ## Known limitations
27
+ - The UI is optimized for the primary session and typical “chat” usage (not a full browser-based sandbox surface).
@@ -0,0 +1,40 @@
1
+ ---
2
+ summary: "macOS IPC architecture for Clawdbot app, gateway node bridge, and PeekabooBridge"
3
+ read_when:
4
+ - Editing IPC contracts or menu bar app IPC
5
+ ---
6
+ # Clawdbot macOS IPC architecture (Dec 2025)
7
+
8
+ **Current model:** there is **no local control socket** and no `clawdbot-mac` CLI. All agent actions go through the Gateway WebSocket and `node.invoke`. UI automation still uses PeekabooBridge.
9
+
10
+ ## Goals
11
+ - Single GUI app instance that owns all TCC-facing work (notifications, screen recording, mic, speech, AppleScript).
12
+ - A small surface for automation: Gateway + node commands, plus PeekabooBridge for UI automation.
13
+ - Predictable permissions: always the same signed bundle ID, launched by launchd, so TCC grants stick.
14
+
15
+ ## How it works
16
+ ### Gateway + node bridge (current)
17
+ - The app runs the Gateway (local mode) and connects to it as a node.
18
+ - Agent actions are performed via `node.invoke` (e.g. `system.run`, `system.notify`, `canvas.*`).
19
+
20
+ ### PeekabooBridge (UI automation)
21
+ - UI automation uses a separate UNIX socket named `bridge.sock` and the PeekabooBridge JSON protocol.
22
+ - Host preference order (client-side): Peekaboo.app → Claude.app → Clawdbot.app → local execution.
23
+ - Security: bridge hosts require TeamID `Y5PE65HELJ`; DEBUG-only same-UID escape hatch is guarded by `PEEKABOO_ALLOW_UNSIGNED_SOCKET_CLIENTS=1` (Peekaboo convention).
24
+ - See: `docs/mac/peekaboo.md` for the Clawdbot plan and naming.
25
+
26
+ ### Mach/XPC (future direction)
27
+ - Still optional for internal app services, but **not required** for automation now that node.invoke is the surface.
28
+
29
+ ## Operational flows
30
+ - Restart/rebuild: `SIGN_IDENTITY="Apple Development: Peter Steinberger (2ZAC4GM7GD)" scripts/restart-mac.sh`
31
+ - Kills existing instances
32
+ - Swift build + package
33
+ - Writes/bootstraps/kickstarts the LaunchAgent
34
+ - Single instance: app exits early if another instance with the same bundle ID is running.
35
+
36
+ ## Hardening notes
37
+ - Prefer requiring a TeamID match for all privileged surfaces.
38
+ - PeekabooBridge: `PEEKABOO_ALLOW_UNSIGNED_SOCKET_CLIENTS=1` (DEBUG-only) may allow same-UID callers for local development.
39
+ - All communication remains local-only; no network sockets are exposed.
40
+ - TCC prompts originate only from the GUI app bundle; run `scripts/package-mac-app.sh` so the signed bundle ID stays stable.
package/docs/models.md ADDED
@@ -0,0 +1,90 @@
1
+ ---
2
+ summary: "Plan for models CLI: scan, list, aliases, fallbacks, status"
3
+ read_when:
4
+ - Adding or modifying models CLI (models list/set/scan/aliases/fallbacks)
5
+ - Changing model fallback behavior or selection UX
6
+ - Updating model scan probes (tools/images)
7
+ ---
8
+ # Models CLI plan
9
+
10
+ Goal: give clear model visibility + control (configured vs available), plus scan tooling
11
+ that prefers tool-call + image-capable models and maintains ordered fallbacks.
12
+
13
+ ## Command tree (draft)
14
+
15
+ - `clawdbot models list`
16
+ - default: configured models only
17
+ - flags: `--all` (full catalog), `--local`, `--provider <name>`, `--json`, `--plain`
18
+ - `clawdbot models status`
19
+ - show default model + aliases + fallbacks + allowlist
20
+ - `clawdbot models set <modelOrAlias>`
21
+ - writes `agent.model` in config
22
+ - `clawdbot models set-image <modelOrAlias>`
23
+ - writes `agent.imageModel` in config
24
+ - `clawdbot models aliases list|add|remove`
25
+ - writes `agent.modelAliases`
26
+ - `clawdbot models fallbacks list|add|remove|clear`
27
+ - writes `agent.modelFallbacks`
28
+ - `clawdbot models image-fallbacks list|add|remove|clear`
29
+ - writes `agent.imageModelFallbacks`
30
+ - `clawdbot models scan`
31
+ - OpenRouter :free scan; probe tool-call + image; interactive selection
32
+
33
+ ## Config changes
34
+
35
+ - Add `agent.modelFallbacks: string[]` (ordered list of provider/model IDs).
36
+ - Add `agent.imageModel?: string` (optional image-capable model for image tool).
37
+ - Add `agent.imageModelFallbacks?: string[]` (ordered list for image tool).
38
+ - Keep existing:
39
+ - `agent.model` (default)
40
+ - `agent.allowedModels` (list filter)
41
+ - `agent.modelAliases` (shortcut names)
42
+
43
+ ## Scan behavior (models scan)
44
+
45
+ Input
46
+ - OpenRouter `/models` list (filter `:free`)
47
+ - Requires `OPENROUTER_API_KEY` (or stored OpenRouter key in auth storage)
48
+ - Optional filters: `--max-age-days`, `--min-params`, `--provider`, `--max-candidates`
49
+ - Probe controls: `--timeout`, `--concurrency`
50
+
51
+ Probes (direct pi-ai complete)
52
+ - Tool-call probe (required):
53
+ - Provide a dummy tool, verify tool call emitted.
54
+ - Image probe (preferred):
55
+ - Prompt includes 1x1 PNG; success if no "unsupported image" error.
56
+
57
+ Scoring/selection
58
+ - Prefer models passing tool + image for text/tool fallbacks.
59
+ - Prefer image-only models for image tool fallback (even if tool probe fails).
60
+ - Rank by: image ok, then lower tool latency, then larger context, then params.
61
+
62
+ Interactive selection (TTY)
63
+ - Multiselect list with per-model stats:
64
+ - model id, tool ok, image ok, median latency, context, inferred params.
65
+ - Pre-select top N (default 6).
66
+ - Non-TTY: auto-select; require `--yes`/`--no-input` to apply.
67
+
68
+ Output
69
+ - Writes `agent.modelFallbacks` ordered.
70
+ - Writes `agent.imageModelFallbacks` ordered (image-capable models).
71
+ - Optional `--set-default` to set `agent.model`.
72
+ - Optional `--set-image` to set `agent.imageModel`.
73
+
74
+ ## Runtime fallback
75
+
76
+ - On model failure: try `agent.modelFallbacks` in order.
77
+ - Ignore fallback entries not in `agent.allowedModels` (if allowlist set).
78
+ - Persist last successful provider/model to session entry.
79
+ - `/status` shows last used model (not just default).
80
+
81
+ ## Tests
82
+
83
+ - Unit: scan selection ordering + probe classification.
84
+ - CLI: list/aliases/fallbacks add/remove + scan writes config.
85
+ - Status: shows last used model + fallbacks.
86
+
87
+ ## Docs
88
+
89
+ - Update `docs/configuration.md` with `agent.modelFallbacks`.
90
+ - Keep this doc current when CLI surface or scan logic changes.
package/docs/nix.md ADDED
@@ -0,0 +1,49 @@
1
+ ---
2
+ summary: "Running Clawdbot under Nix (config, state, and packaging expectations)"
3
+ read_when:
4
+ - Building Clawdbot with Nix
5
+ - Debugging Nix-mode behavior
6
+ ---
7
+ # Nix mode
8
+
9
+ Clawdbot supports a **Nix mode** that makes configuration deterministic and disables auto-install flows.
10
+ Enable it by exporting:
11
+
12
+ ```
13
+ CLAWDBOT_NIX_MODE=1
14
+ ```
15
+
16
+ On macOS, the GUI app does not automatically inherit shell env vars. You can
17
+ also enable Nix mode via defaults:
18
+
19
+ ```
20
+ defaults write com.clawdbot.mac clawdbot.nixMode -bool true
21
+ ```
22
+
23
+ ## Config + state paths
24
+
25
+ Clawdbot reads JSON5 config from `CLAWDBOT_CONFIG_PATH` and stores mutable data in `CLAWDBOT_STATE_DIR`.
26
+
27
+ - `CLAWDBOT_STATE_DIR` (default: `~/.clawdbot`)
28
+ - `CLAWDBOT_CONFIG_PATH` (default: `$CLAWDBOT_STATE_DIR/clawdbot.json`)
29
+
30
+ When running under Nix, set these explicitly to Nix-managed locations so runtime state and config
31
+ stay out of the immutable store.
32
+
33
+ ## Runtime behavior in Nix mode
34
+
35
+ - Auto-install and self-mutation flows should be disabled.
36
+ - Missing dependencies should surface Nix-specific remediation messages.
37
+ - UI surfaces a read-only Nix mode banner when present.
38
+
39
+ ## Packaging note (macOS)
40
+
41
+ The macOS packaging flow expects a stable Info.plist template at:
42
+
43
+ ```
44
+ apps/macos/Sources/Clawdbot/Resources/Info.plist
45
+ ```
46
+
47
+ `scripts/package-mac-app.sh` copies this template into the app bundle and patches dynamic fields
48
+ (bundle ID, version/build, Git SHA, Sparkle keys). This keeps the plist deterministic for SwiftPM
49
+ packaging and Nix builds (which do not rely on a full Xcode toolchain).