durar-ai 2026.4.4
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +5497 -0
- package/LICENSE +21 -0
- package/README.md +614 -0
- package/assets/avatar-placeholder.svg +19 -0
- package/assets/chrome-extension/icons/icon128.png +0 -0
- package/assets/chrome-extension/icons/icon16.png +0 -0
- package/assets/chrome-extension/icons/icon32.png +0 -0
- package/assets/chrome-extension/icons/icon48.png +0 -0
- package/assets/dmg-background-small.png +0 -0
- package/assets/dmg-background.png +0 -0
- package/docs/.i18n/README.md +72 -0
- package/docs/.i18n/ar-navigation.json +18 -0
- package/docs/.i18n/de-navigation.json +18 -0
- package/docs/.i18n/es-navigation.json +18 -0
- package/docs/.i18n/fr-navigation.json +18 -0
- package/docs/.i18n/glossary.ar.json +5 -0
- package/docs/.i18n/glossary.de.json +5 -0
- package/docs/.i18n/glossary.es.json +5 -0
- package/docs/.i18n/glossary.fr.json +5 -0
- package/docs/.i18n/glossary.id.json +5 -0
- package/docs/.i18n/glossary.it.json +5 -0
- package/docs/.i18n/glossary.ja-JP.json +14 -0
- package/docs/.i18n/glossary.ko.json +5 -0
- package/docs/.i18n/glossary.pl.json +5 -0
- package/docs/.i18n/glossary.pt-BR.json +5 -0
- package/docs/.i18n/glossary.tr.json +5 -0
- package/docs/.i18n/glossary.zh-CN.json +358 -0
- package/docs/.i18n/id-navigation.json +18 -0
- package/docs/.i18n/it-navigation.json +18 -0
- package/docs/.i18n/ja-navigation.json +18 -0
- package/docs/.i18n/ko-navigation.json +18 -0
- package/docs/.i18n/pl-navigation.json +18 -0
- package/docs/.i18n/pt-BR-navigation.json +18 -0
- package/docs/.i18n/tr-navigation.json +18 -0
- package/docs/.i18n/zh-Hans-navigation.json +544 -0
- package/docs/assets/install-script.svg +1 -0
- package/docs/assets/macos-onboarding/01-macos-warning.jpeg +0 -0
- package/docs/assets/macos-onboarding/02-local-networks.jpeg +0 -0
- package/docs/assets/macos-onboarding/03-security-notice.png +0 -0
- package/docs/assets/macos-onboarding/04-choose-gateway.png +0 -0
- package/docs/assets/macos-onboarding/05-permissions.png +0 -0
- package/docs/assets/openclaw-logo-text-dark.png +0 -0
- package/docs/assets/openclaw-logo-text-dark.svg +418 -0
- package/docs/assets/openclaw-logo-text.png +0 -0
- package/docs/assets/openclaw-logo-text.svg +418 -0
- package/docs/assets/pixel-lobster.svg +60 -0
- package/docs/assets/showcase/agents-ui.jpg +0 -0
- package/docs/assets/showcase/bambu-cli.png +0 -0
- package/docs/assets/showcase/codexmonitor.png +0 -0
- package/docs/assets/showcase/gohome-grafana.png +0 -0
- package/docs/assets/showcase/ios-testflight.jpg +0 -0
- package/docs/assets/showcase/oura-health.png +0 -0
- package/docs/assets/showcase/padel-cli.svg +11 -0
- package/docs/assets/showcase/padel-screenshot.jpg +0 -0
- package/docs/assets/showcase/papla-tts.jpg +0 -0
- package/docs/assets/showcase/pr-review-telegram.jpg +0 -0
- package/docs/assets/showcase/roborock-screenshot.jpg +0 -0
- package/docs/assets/showcase/roborock-status.svg +13 -0
- package/docs/assets/showcase/roof-camera-sky.jpg +0 -0
- package/docs/assets/showcase/snag.png +0 -0
- package/docs/assets/showcase/tesco-shop.jpg +0 -0
- package/docs/assets/showcase/wienerlinien.png +0 -0
- package/docs/assets/showcase/wine-cellar-skill.jpg +0 -0
- package/docs/assets/showcase/winix-air-purifier.jpg +0 -0
- package/docs/assets/showcase/xuezh-pronunciation.jpeg +0 -0
- package/docs/assets/sponsors/blacksmith-light.svg +14 -0
- package/docs/assets/sponsors/blacksmith.svg +14 -0
- package/docs/assets/sponsors/convex-light.svg +16 -0
- package/docs/assets/sponsors/convex.svg +16 -0
- package/docs/assets/sponsors/github-light.svg +3 -0
- package/docs/assets/sponsors/github.svg +3 -0
- package/docs/assets/sponsors/nvidia-dark.svg +9 -0
- package/docs/assets/sponsors/nvidia.svg +9 -0
- package/docs/assets/sponsors/openai-light.svg +3 -0
- package/docs/assets/sponsors/openai.svg +3 -0
- package/docs/assets/sponsors/vercel-light.svg +5 -0
- package/docs/assets/sponsors/vercel.svg +5 -0
- package/docs/auth-credential-semantics.md +80 -0
- package/docs/automation/auth-monitoring.md +8 -0
- package/docs/automation/clawflow.md +8 -0
- package/docs/automation/cron-jobs.md +410 -0
- package/docs/automation/cron-vs-heartbeat.md +8 -0
- package/docs/automation/gmail-pubsub.md +8 -0
- package/docs/automation/hooks.md +303 -0
- package/docs/automation/index.md +115 -0
- package/docs/automation/poll.md +8 -0
- package/docs/automation/standing-orders.md +254 -0
- package/docs/automation/taskflow.md +82 -0
- package/docs/automation/tasks.md +323 -0
- package/docs/automation/troubleshooting.md +8 -0
- package/docs/automation/webhook.md +8 -0
- package/docs/brave-search.md +103 -0
- package/docs/channels/bluebubbles.md +435 -0
- package/docs/channels/broadcast-groups.md +442 -0
- package/docs/channels/channel-routing.md +139 -0
- package/docs/channels/discord.md +1254 -0
- package/docs/channels/feishu.md +793 -0
- package/docs/channels/googlechat.md +270 -0
- package/docs/channels/group-messages.md +84 -0
- package/docs/channels/groups.md +410 -0
- package/docs/channels/imessage.md +427 -0
- package/docs/channels/index.md +50 -0
- package/docs/channels/irc.md +252 -0
- package/docs/channels/line.md +225 -0
- package/docs/channels/location.md +56 -0
- package/docs/channels/matrix.md +869 -0
- package/docs/channels/mattermost.md +472 -0
- package/docs/channels/msteams.md +805 -0
- package/docs/channels/nextcloud-talk.md +149 -0
- package/docs/channels/nostr.md +252 -0
- package/docs/channels/pairing.md +129 -0
- package/docs/channels/qqbot.md +193 -0
- package/docs/channels/signal.md +337 -0
- package/docs/channels/slack.md +681 -0
- package/docs/channels/synology-chat.md +185 -0
- package/docs/channels/telegram.md +1072 -0
- package/docs/channels/tlon.md +290 -0
- package/docs/channels/troubleshooting.md +133 -0
- package/docs/channels/twitch.md +394 -0
- package/docs/channels/whatsapp.md +488 -0
- package/docs/channels/zalo.md +254 -0
- package/docs/channels/zalouser.md +195 -0
- package/docs/ci.md +66 -0
- package/docs/cli/acp.md +316 -0
- package/docs/cli/agent.md +57 -0
- package/docs/cli/agents.md +220 -0
- package/docs/cli/approvals.md +136 -0
- package/docs/cli/backup.md +84 -0
- package/docs/cli/browser.md +233 -0
- package/docs/cli/channels.md +131 -0
- package/docs/cli/clawbot.md +21 -0
- package/docs/cli/completion.md +35 -0
- package/docs/cli/config.md +353 -0
- package/docs/cli/configure.md +70 -0
- package/docs/cli/cron.md +167 -0
- package/docs/cli/daemon.md +57 -0
- package/docs/cli/dashboard.md +22 -0
- package/docs/cli/devices.md +171 -0
- package/docs/cli/directory.md +63 -0
- package/docs/cli/dns.md +48 -0
- package/docs/cli/docs.md +28 -0
- package/docs/cli/doctor.md +63 -0
- package/docs/cli/flows.md +18 -0
- package/docs/cli/gateway.md +307 -0
- package/docs/cli/health.md +36 -0
- package/docs/cli/hooks.md +337 -0
- package/docs/cli/index.md +1836 -0
- package/docs/cli/logs.md +59 -0
- package/docs/cli/mcp.md +505 -0
- package/docs/cli/memory.md +139 -0
- package/docs/cli/message.md +300 -0
- package/docs/cli/models.md +136 -0
- package/docs/cli/node.md +137 -0
- package/docs/cli/nodes.md +66 -0
- package/docs/cli/onboard.md +171 -0
- package/docs/cli/pairing.md +65 -0
- package/docs/cli/plugins.md +305 -0
- package/docs/cli/qr.md +52 -0
- package/docs/cli/reset.md +35 -0
- package/docs/cli/sandbox.md +197 -0
- package/docs/cli/secrets.md +197 -0
- package/docs/cli/security.md +86 -0
- package/docs/cli/sessions.md +113 -0
- package/docs/cli/setup.md +45 -0
- package/docs/cli/skills.md +59 -0
- package/docs/cli/status.md +35 -0
- package/docs/cli/system.md +71 -0
- package/docs/cli/tui.md +30 -0
- package/docs/cli/uninstall.md +39 -0
- package/docs/cli/update.md +113 -0
- package/docs/cli/voicecall.md +34 -0
- package/docs/cli/webhooks.md +91 -0
- package/docs/concepts/agent-loop.md +168 -0
- package/docs/concepts/agent-workspace.md +246 -0
- package/docs/concepts/agent.md +129 -0
- package/docs/concepts/architecture.md +156 -0
- package/docs/concepts/compaction.md +122 -0
- package/docs/concepts/context-engine.md +274 -0
- package/docs/concepts/context.md +179 -0
- package/docs/concepts/delegate-architecture.md +307 -0
- package/docs/concepts/dreaming.md +173 -0
- package/docs/concepts/features.md +76 -0
- package/docs/concepts/markdown-formatting.md +130 -0
- package/docs/concepts/memory-builtin.md +105 -0
- package/docs/concepts/memory-honcho.md +140 -0
- package/docs/concepts/memory-qmd.md +163 -0
- package/docs/concepts/memory-search.md +141 -0
- package/docs/concepts/memory.md +121 -0
- package/docs/concepts/messages.md +161 -0
- package/docs/concepts/model-failover.md +349 -0
- package/docs/concepts/model-providers.md +799 -0
- package/docs/concepts/models.md +255 -0
- package/docs/concepts/multi-agent.md +615 -0
- package/docs/concepts/oauth.md +225 -0
- package/docs/concepts/presence.md +102 -0
- package/docs/concepts/queue.md +89 -0
- package/docs/concepts/retry.md +69 -0
- package/docs/concepts/session-pruning.md +92 -0
- package/docs/concepts/session-tool.md +141 -0
- package/docs/concepts/session.md +116 -0
- package/docs/concepts/soul.md +110 -0
- package/docs/concepts/streaming.md +161 -0
- package/docs/concepts/system-prompt.md +182 -0
- package/docs/concepts/timezone.md +97 -0
- package/docs/concepts/typebox.md +307 -0
- package/docs/concepts/typing-indicators.md +69 -0
- package/docs/concepts/usage-tracking.md +59 -0
- package/docs/date-time.md +128 -0
- package/docs/debug/node-issue.md +85 -0
- package/docs/diagnostics/flags.md +91 -0
- package/docs/docs.json +1601 -0
- package/docs/gateway/authentication.md +218 -0
- package/docs/gateway/background-process.md +131 -0
- package/docs/gateway/bonjour.md +179 -0
- package/docs/gateway/bridge-protocol.md +89 -0
- package/docs/gateway/cli-backends.md +310 -0
- package/docs/gateway/configuration-examples.md +631 -0
- package/docs/gateway/configuration-reference.md +3618 -0
- package/docs/gateway/configuration.md +698 -0
- package/docs/gateway/discovery.md +141 -0
- package/docs/gateway/doctor.md +494 -0
- package/docs/gateway/gateway-lock.md +37 -0
- package/docs/gateway/health.md +61 -0
- package/docs/gateway/heartbeat.md +443 -0
- package/docs/gateway/index.md +367 -0
- package/docs/gateway/local-models.md +163 -0
- package/docs/gateway/logging.md +113 -0
- package/docs/gateway/multiple-gateways.md +120 -0
- package/docs/gateway/network-model.md +25 -0
- package/docs/gateway/openai-http-api.md +280 -0
- package/docs/gateway/openresponses-http-api.md +340 -0
- package/docs/gateway/openshell.md +307 -0
- package/docs/gateway/pairing.md +138 -0
- package/docs/gateway/protocol.md +588 -0
- package/docs/gateway/remote-gateway-readme.md +164 -0
- package/docs/gateway/remote.md +251 -0
- package/docs/gateway/sandbox-vs-tool-policy-vs-elevated.md +141 -0
- package/docs/gateway/sandboxing.md +473 -0
- package/docs/gateway/secrets-plan-contract.md +116 -0
- package/docs/gateway/secrets.md +541 -0
- package/docs/gateway/security/index.md +1362 -0
- package/docs/gateway/tailscale.md +136 -0
- package/docs/gateway/tools-invoke-http-api.md +161 -0
- package/docs/gateway/troubleshooting.md +451 -0
- package/docs/gateway/trusted-proxy-auth.md +399 -0
- package/docs/help/debugging.md +168 -0
- package/docs/help/environment.md +165 -0
- package/docs/help/faq.md +3244 -0
- package/docs/help/index.md +28 -0
- package/docs/help/scripts.md +27 -0
- package/docs/help/testing.md +640 -0
- package/docs/help/troubleshooting.md +372 -0
- package/docs/images/configure-model-picker-unsearchable.png +0 -0
- package/docs/images/feishu-step2-create-app.png +0 -0
- package/docs/images/feishu-step3-credentials.png +0 -0
- package/docs/images/feishu-step4-permissions.png +0 -0
- package/docs/images/feishu-step5-bot-capability.png +0 -0
- package/docs/images/feishu-step6-event-subscription.png +0 -0
- package/docs/images/feishu-verification-token.png +0 -0
- package/docs/images/groups-flow.svg +52 -0
- package/docs/images/mobile-ui-screenshot.png +0 -0
- package/docs/index.md +196 -0
- package/docs/install/ansible.md +230 -0
- package/docs/install/azure.md +311 -0
- package/docs/install/bun.md +55 -0
- package/docs/install/clawdock.md +106 -0
- package/docs/install/development-channels.md +131 -0
- package/docs/install/digitalocean.md +129 -0
- package/docs/install/docker-vm-runtime.md +142 -0
- package/docs/install/docker.md +412 -0
- package/docs/install/exe-dev.md +133 -0
- package/docs/install/fly.md +504 -0
- package/docs/install/gcp.md +412 -0
- package/docs/install/hetzner.md +259 -0
- package/docs/install/index.md +212 -0
- package/docs/install/installer.md +443 -0
- package/docs/install/kubernetes.md +192 -0
- package/docs/install/macos-vm.md +281 -0
- package/docs/install/migrating-matrix.md +349 -0
- package/docs/install/migrating.md +112 -0
- package/docs/install/nix.md +89 -0
- package/docs/install/node.md +144 -0
- package/docs/install/northflank.mdx +42 -0
- package/docs/install/oracle.md +158 -0
- package/docs/install/podman.md +210 -0
- package/docs/install/railway.mdx +90 -0
- package/docs/install/raspberry-pi.md +159 -0
- package/docs/install/render.mdx +165 -0
- package/docs/install/uninstall.md +128 -0
- package/docs/install/updating.md +142 -0
- package/docs/logging.md +389 -0
- package/docs/nav-tabs-underline.js +100 -0
- package/docs/network.md +69 -0
- package/docs/nodes/audio.md +191 -0
- package/docs/nodes/camera.md +162 -0
- package/docs/nodes/images.md +73 -0
- package/docs/nodes/index.md +408 -0
- package/docs/nodes/location-command.md +98 -0
- package/docs/nodes/media-understanding.md +432 -0
- package/docs/nodes/talk.md +92 -0
- package/docs/nodes/troubleshooting.md +123 -0
- package/docs/nodes/voicewake.md +66 -0
- package/docs/perplexity.md +181 -0
- package/docs/pi-dev.md +80 -0
- package/docs/pi.md +570 -0
- package/docs/platforms/android.md +244 -0
- package/docs/platforms/digitalocean.md +266 -0
- package/docs/platforms/index.md +55 -0
- package/docs/platforms/ios.md +223 -0
- package/docs/platforms/linux.md +100 -0
- package/docs/platforms/mac/bundled-gateway.md +75 -0
- package/docs/platforms/mac/canvas.md +125 -0
- package/docs/platforms/mac/child-process.md +69 -0
- package/docs/platforms/mac/dev-setup.md +107 -0
- package/docs/platforms/mac/health.md +34 -0
- package/docs/platforms/mac/icon.md +31 -0
- package/docs/platforms/mac/logging.md +57 -0
- package/docs/platforms/mac/menu-bar.md +81 -0
- package/docs/platforms/mac/peekaboo.md +65 -0
- package/docs/platforms/mac/permissions.md +50 -0
- package/docs/platforms/mac/remote.md +84 -0
- package/docs/platforms/mac/signing.md +47 -0
- package/docs/platforms/mac/skills.md +40 -0
- package/docs/platforms/mac/voice-overlay.md +60 -0
- package/docs/platforms/mac/voicewake.md +67 -0
- package/docs/platforms/mac/webchat.md +51 -0
- package/docs/platforms/mac/xpc.md +61 -0
- package/docs/platforms/macos.md +229 -0
- package/docs/platforms/oracle.md +305 -0
- package/docs/platforms/raspberry-pi.md +420 -0
- package/docs/platforms/windows.md +241 -0
- package/docs/plugins/agent-tools.md +10 -0
- package/docs/plugins/architecture.md +1609 -0
- package/docs/plugins/building-extensions.md +10 -0
- package/docs/plugins/building-plugins.md +319 -0
- package/docs/plugins/bundles.md +292 -0
- package/docs/plugins/community.md +149 -0
- package/docs/plugins/manifest.md +412 -0
- package/docs/plugins/sdk-channel-plugins.md +508 -0
- package/docs/plugins/sdk-entrypoints.md +210 -0
- package/docs/plugins/sdk-migration.md +359 -0
- package/docs/plugins/sdk-overview.md +475 -0
- package/docs/plugins/sdk-provider-plugins.md +712 -0
- package/docs/plugins/sdk-runtime.md +381 -0
- package/docs/plugins/sdk-setup.md +516 -0
- package/docs/plugins/sdk-testing.md +263 -0
- package/docs/plugins/voice-call.md +466 -0
- package/docs/plugins/zalouser.md +78 -0
- package/docs/prose.md +134 -0
- package/docs/providers/anthropic.md +402 -0
- package/docs/providers/bedrock-mantle.md +91 -0
- package/docs/providers/bedrock.md +273 -0
- package/docs/providers/chutes.md +103 -0
- package/docs/providers/claude-max-api-proxy.md +163 -0
- package/docs/providers/cloudflare-ai-gateway.md +71 -0
- package/docs/providers/deepgram.md +93 -0
- package/docs/providers/deepseek.md +53 -0
- package/docs/providers/fireworks.md +69 -0
- package/docs/providers/github-copilot.md +80 -0
- package/docs/providers/glm.md +68 -0
- package/docs/providers/google.md +149 -0
- package/docs/providers/groq.md +105 -0
- package/docs/providers/huggingface.md +193 -0
- package/docs/providers/index.md +81 -0
- package/docs/providers/kilocode.md +89 -0
- package/docs/providers/litellm.md +159 -0
- package/docs/providers/minimax.md +281 -0
- package/docs/providers/mistral.md +68 -0
- package/docs/providers/models.md +56 -0
- package/docs/providers/moonshot.md +224 -0
- package/docs/providers/nvidia.md +58 -0
- package/docs/providers/ollama.md +379 -0
- package/docs/providers/openai.md +472 -0
- package/docs/providers/opencode-go.md +45 -0
- package/docs/providers/opencode.md +68 -0
- package/docs/providers/openrouter.md +59 -0
- package/docs/providers/perplexity-provider.md +62 -0
- package/docs/providers/qianfan.md +90 -0
- package/docs/providers/qwen.md +128 -0
- package/docs/providers/qwen_modelstudio.md +137 -0
- package/docs/providers/sglang.md +115 -0
- package/docs/providers/stepfun.md +152 -0
- package/docs/providers/synthetic.md +101 -0
- package/docs/providers/together.md +70 -0
- package/docs/providers/venice.md +282 -0
- package/docs/providers/vercel-ai-gateway.md +60 -0
- package/docs/providers/vllm.md +103 -0
- package/docs/providers/volcengine.md +94 -0
- package/docs/providers/xai.md +94 -0
- package/docs/providers/xiaomi.md +89 -0
- package/docs/providers/zai.md +75 -0
- package/docs/reference/AGENTS.default.md +126 -0
- package/docs/reference/RELEASING.md +138 -0
- package/docs/reference/api-usage-costs.md +198 -0
- package/docs/reference/credits.md +30 -0
- package/docs/reference/device-models.md +47 -0
- package/docs/reference/memory-config.md +421 -0
- package/docs/reference/prompt-caching.md +344 -0
- package/docs/reference/rpc.md +43 -0
- package/docs/reference/secretref-credential-surface.md +148 -0
- package/docs/reference/secretref-user-supplied-credentials-matrix.json +607 -0
- package/docs/reference/session-management-compaction.md +352 -0
- package/docs/reference/templates/AGENTS.dev.md +84 -0
- package/docs/reference/templates/AGENTS.md +219 -0
- package/docs/reference/templates/BOOT.md +12 -0
- package/docs/reference/templates/BOOTSTRAP.md +62 -0
- package/docs/reference/templates/CLAUDE.md +1 -0
- package/docs/reference/templates/HEARTBEAT.md +14 -0
- package/docs/reference/templates/IDENTITY.dev.md +48 -0
- package/docs/reference/templates/IDENTITY.md +30 -0
- package/docs/reference/templates/SOUL.dev.md +77 -0
- package/docs/reference/templates/SOUL.md +45 -0
- package/docs/reference/templates/TOOLS.dev.md +25 -0
- package/docs/reference/templates/TOOLS.md +47 -0
- package/docs/reference/templates/USER.dev.md +19 -0
- package/docs/reference/templates/USER.md +24 -0
- package/docs/reference/test.md +119 -0
- package/docs/reference/token-use.md +197 -0
- package/docs/reference/transcript-hygiene.md +151 -0
- package/docs/reference/wizard.md +245 -0
- package/docs/security/CONTRIBUTING-THREAT-MODEL.md +98 -0
- package/docs/security/THREAT-MODEL-ATLAS.md +608 -0
- package/docs/security/formal-verification.md +167 -0
- package/docs/snippets/plugin-publish/minimal-openclaw.plugin.json +9 -0
- package/docs/snippets/plugin-publish/minimal-package.json +16 -0
- package/docs/start/bootstrapping.md +41 -0
- package/docs/start/docs-directory.md +67 -0
- package/docs/start/getting-started.md +148 -0
- package/docs/start/hubs.md +199 -0
- package/docs/start/lore.md +219 -0
- package/docs/start/onboarding-overview.md +69 -0
- package/docs/start/onboarding.md +92 -0
- package/docs/start/openclaw.md +225 -0
- package/docs/start/quickstart.md +22 -0
- package/docs/start/setup.md +172 -0
- package/docs/start/showcase.md +418 -0
- package/docs/start/wizard-cli-automation.md +233 -0
- package/docs/start/wizard-cli-reference.md +324 -0
- package/docs/start/wizard.md +127 -0
- package/docs/style.css +37 -0
- package/docs/tools/acp-agents.md +837 -0
- package/docs/tools/agent-send.md +100 -0
- package/docs/tools/apply-patch.md +52 -0
- package/docs/tools/brave-search.md +107 -0
- package/docs/tools/browser-linux-troubleshooting.md +145 -0
- package/docs/tools/browser-login.md +73 -0
- package/docs/tools/browser-wsl2-windows-remote-cdp-troubleshooting.md +221 -0
- package/docs/tools/browser.md +890 -0
- package/docs/tools/btw.md +142 -0
- package/docs/tools/capability-cookbook.md +119 -0
- package/docs/tools/clawhub.md +348 -0
- package/docs/tools/code-execution.md +90 -0
- package/docs/tools/creating-skills.md +119 -0
- package/docs/tools/diffs.md +434 -0
- package/docs/tools/duckduckgo-search.md +102 -0
- package/docs/tools/elevated.md +116 -0
- package/docs/tools/exa-search.md +127 -0
- package/docs/tools/exec-approvals.md +635 -0
- package/docs/tools/exec.md +237 -0
- package/docs/tools/firecrawl.md +147 -0
- package/docs/tools/gemini-search.md +98 -0
- package/docs/tools/grok-search.md +102 -0
- package/docs/tools/image-generation.md +139 -0
- package/docs/tools/index.md +174 -0
- package/docs/tools/kimi-search.md +98 -0
- package/docs/tools/llm-task.md +119 -0
- package/docs/tools/lobster.md +348 -0
- package/docs/tools/loop-detection.md +100 -0
- package/docs/tools/minimax-search.md +99 -0
- package/docs/tools/multi-agent-sandbox-tools.md +373 -0
- package/docs/tools/ollama-search.md +100 -0
- package/docs/tools/pdf.md +176 -0
- package/docs/tools/perplexity-search.md +185 -0
- package/docs/tools/plugin.md +348 -0
- package/docs/tools/reactions.md +78 -0
- package/docs/tools/searxng-search.md +132 -0
- package/docs/tools/skills-config.md +133 -0
- package/docs/tools/skills.md +377 -0
- package/docs/tools/slash-commands.md +322 -0
- package/docs/tools/subagents.md +341 -0
- package/docs/tools/tavily.md +129 -0
- package/docs/tools/thinking.md +102 -0
- package/docs/tools/tts.md +452 -0
- package/docs/tools/web-fetch.md +159 -0
- package/docs/tools/web.md +417 -0
- package/docs/tts.md +452 -0
- package/docs/vps.md +115 -0
- package/docs/web/control-ui.md +318 -0
- package/docs/web/dashboard.md +93 -0
- package/docs/web/index.md +126 -0
- package/docs/web/tui.md +176 -0
- package/docs/web/webchat.md +77 -0
- package/docs/whatsapp-openclaw-ai-zh.jpg +0 -0
- package/docs/whatsapp-openclaw.jpg +0 -0
- package/durar.mjs +180 -0
- package/package.json +1259 -0
- package/scripts/npm-runner.mjs +111 -0
- package/scripts/postinstall-bundled-plugins.mjs +188 -0
- package/skills/1password/SKILL.md +70 -0
- package/skills/1password/references/cli-examples.md +29 -0
- package/skills/1password/references/get-started.md +17 -0
- package/skills/apple-notes/SKILL.md +77 -0
- package/skills/apple-reminders/SKILL.md +118 -0
- package/skills/bear-notes/SKILL.md +107 -0
- package/skills/blogwatcher/SKILL.md +69 -0
- package/skills/blucli/SKILL.md +47 -0
- package/skills/bluebubbles/SKILL.md +131 -0
- package/skills/camsnap/SKILL.md +45 -0
- package/skills/canvas/SKILL.md +199 -0
- package/skills/clawhub/SKILL.md +77 -0
- package/skills/coding-agent/SKILL.md +316 -0
- package/skills/discord/SKILL.md +197 -0
- package/skills/eightctl/SKILL.md +50 -0
- package/skills/gemini/SKILL.md +43 -0
- package/skills/gh-issues/SKILL.md +885 -0
- package/skills/gifgrep/SKILL.md +79 -0
- package/skills/github/SKILL.md +163 -0
- package/skills/gog/SKILL.md +116 -0
- package/skills/goplaces/SKILL.md +52 -0
- package/skills/healthcheck/SKILL.md +245 -0
- package/skills/himalaya/SKILL.md +257 -0
- package/skills/himalaya/references/configuration.md +184 -0
- package/skills/himalaya/references/message-composition.md +199 -0
- package/skills/imsg/SKILL.md +122 -0
- package/skills/mcporter/SKILL.md +61 -0
- package/skills/model-usage/SKILL.md +69 -0
- package/skills/model-usage/references/codexbar-cli.md +33 -0
- package/skills/model-usage/scripts/model_usage.py +320 -0
- package/skills/model-usage/scripts/test_model_usage.py +40 -0
- package/skills/nano-pdf/SKILL.md +38 -0
- package/skills/node-connect/SKILL.md +142 -0
- package/skills/notion/SKILL.md +174 -0
- package/skills/obsidian/SKILL.md +81 -0
- package/skills/openai-whisper/SKILL.md +38 -0
- package/skills/openai-whisper-api/SKILL.md +62 -0
- package/skills/openai-whisper-api/scripts/transcribe.sh +88 -0
- package/skills/openhue/SKILL.md +112 -0
- package/skills/oracle/SKILL.md +125 -0
- package/skills/ordercli/SKILL.md +78 -0
- package/skills/peekaboo/SKILL.md +190 -0
- package/skills/sag/SKILL.md +87 -0
- package/skills/session-logs/SKILL.md +151 -0
- package/skills/sherpa-onnx-tts/SKILL.md +109 -0
- package/skills/sherpa-onnx-tts/bin/sherpa-onnx-tts +178 -0
- package/skills/skill-creator/SKILL.md +372 -0
- package/skills/skill-creator/license.txt +202 -0
- package/skills/skill-creator/scripts/init_skill.py +378 -0
- package/skills/skill-creator/scripts/package_skill.py +139 -0
- package/skills/skill-creator/scripts/quick_validate.py +159 -0
- package/skills/skill-creator/scripts/test_package_skill.py +160 -0
- package/skills/skill-creator/scripts/test_quick_validate.py +72 -0
- package/skills/slack/SKILL.md +144 -0
- package/skills/songsee/SKILL.md +49 -0
- package/skills/sonoscli/SKILL.md +65 -0
- package/skills/spotify-player/SKILL.md +64 -0
- package/skills/summarize/SKILL.md +87 -0
- package/skills/taskflow/SKILL.md +149 -0
- package/skills/taskflow/examples/inbox-triage.lobster +33 -0
- package/skills/taskflow/examples/pr-intake.lobster +32 -0
- package/skills/taskflow-inbox-triage/SKILL.md +119 -0
- package/skills/things-mac/SKILL.md +86 -0
- package/skills/tmux/SKILL.md +170 -0
- package/skills/tmux/scripts/find-sessions.sh +112 -0
- package/skills/tmux/scripts/wait-for-text.sh +83 -0
- package/skills/trello/SKILL.md +108 -0
- package/skills/video-frames/SKILL.md +46 -0
- package/skills/video-frames/scripts/frame.sh +81 -0
- package/skills/voice-call/SKILL.md +45 -0
- package/skills/wacli/SKILL.md +72 -0
- package/skills/weather/SKILL.md +129 -0
- package/skills/xurl/SKILL.md +461 -0
|
@@ -0,0 +1,34 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "How the macOS app reports gateway/Baileys health states"
|
|
3
|
+
read_when:
|
|
4
|
+
- Debugging mac app health indicators
|
|
5
|
+
title: "Health Checks (macOS)"
|
|
6
|
+
---
|
|
7
|
+
|
|
8
|
+
# Health Checks on macOS
|
|
9
|
+
|
|
10
|
+
How to see whether the linked channel is healthy from the menu bar app.
|
|
11
|
+
|
|
12
|
+
## Menu bar
|
|
13
|
+
|
|
14
|
+
- Status dot now reflects Baileys health:
|
|
15
|
+
- Green: linked + socket opened recently.
|
|
16
|
+
- Orange: connecting/retrying.
|
|
17
|
+
- Red: logged out or probe failed.
|
|
18
|
+
- Secondary line reads "linked · auth 12m" or shows the failure reason.
|
|
19
|
+
- "Run Health Check" menu item triggers an on-demand probe.
|
|
20
|
+
|
|
21
|
+
## Settings
|
|
22
|
+
|
|
23
|
+
- General tab gains a Health card showing: linked auth age, session-store path/count, last check time, last error/status code, and buttons for Run Health Check / Reveal Logs.
|
|
24
|
+
- Uses a cached snapshot so the UI loads instantly and falls back gracefully when offline.
|
|
25
|
+
- **Channels tab** surfaces channel status + controls for WhatsApp/Telegram (login QR, logout, probe, last disconnect/error).
|
|
26
|
+
|
|
27
|
+
## How the probe works
|
|
28
|
+
|
|
29
|
+
- App runs `Durar health --json` via `ShellExecutor` every ~60s and on demand. The probe loads creds and reports status without sending messages.
|
|
30
|
+
- Cache the last good snapshot and the last error separately to avoid flicker; show the timestamp of each.
|
|
31
|
+
|
|
32
|
+
## When in doubt
|
|
33
|
+
|
|
34
|
+
- You can still use the CLI flow in [Gateway health](/gateway/health) (`Durar status`, `Durar status --deep`, `Durar health --json`) and tail `/tmp/Durar/Durar-*.log` for `web-heartbeat` / `web-reconnect`.
|
|
@@ -0,0 +1,31 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "Menu bar icon states and animations for Durar on macOS"
|
|
3
|
+
read_when:
|
|
4
|
+
- Changing menu bar icon behavior
|
|
5
|
+
title: "Menu Bar Icon"
|
|
6
|
+
---
|
|
7
|
+
|
|
8
|
+
# Menu Bar Icon States
|
|
9
|
+
|
|
10
|
+
Author: steipete · Updated: 2025-12-06 · Scope: macOS app (`apps/macos`)
|
|
11
|
+
|
|
12
|
+
- **Idle:** Normal icon animation (blink, occasional wiggle).
|
|
13
|
+
- **Paused:** Status item uses `appearsDisabled`; no motion.
|
|
14
|
+
- **Voice trigger (big ears):** Voice wake detector calls `AppState.triggerVoiceEars(ttl: nil)` when the wake word is heard, keeping `earBoostActive=true` while the utterance is captured. Ears scale up (1.9x), get circular ear holes for readability, then drop via `stopVoiceEars()` after 1s of silence. Only fired from the in-app voice pipeline.
|
|
15
|
+
- **Working (agent running):** `AppState.isWorking=true` drives a “tail/leg scurry” micro-motion: faster leg wiggle and slight offset while work is in-flight. Currently toggled around WebChat agent runs; add the same toggle around other long tasks when you wire them.
|
|
16
|
+
|
|
17
|
+
Wiring points
|
|
18
|
+
|
|
19
|
+
- Voice wake: runtime/tester call `AppState.triggerVoiceEars(ttl: nil)` on trigger and `stopVoiceEars()` after 1s of silence to match the capture window.
|
|
20
|
+
- Agent activity: set `AppStateStore.shared.setWorking(true/false)` around work spans (already done in WebChat agent call). Keep spans short and reset in `defer` blocks to avoid stuck animations.
|
|
21
|
+
|
|
22
|
+
Shapes & sizes
|
|
23
|
+
|
|
24
|
+
- Base icon drawn in `CritterIconRenderer.makeIcon(blink:legWiggle:earWiggle:earScale:earHoles:)`.
|
|
25
|
+
- Ear scale defaults to `1.0`; voice boost sets `earScale=1.9` and toggles `earHoles=true` without changing overall frame (18×18 pt template image rendered into a 36×36 px Retina backing store).
|
|
26
|
+
- Scurry uses leg wiggle up to ~1.0 with a small horizontal jiggle; it’s additive to any existing idle wiggle.
|
|
27
|
+
|
|
28
|
+
Behavioral notes
|
|
29
|
+
|
|
30
|
+
- No external CLI/broker toggle for ears/working; keep it internal to the app’s own signals to avoid accidental flapping.
|
|
31
|
+
- Keep TTLs short (<10s) so the icon returns to baseline quickly if a job hangs.
|
|
@@ -0,0 +1,57 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "Durar logging: rolling diagnostics file log + unified log privacy flags"
|
|
3
|
+
read_when:
|
|
4
|
+
- Capturing macOS logs or investigating private data logging
|
|
5
|
+
- Debugging voice wake/session lifecycle issues
|
|
6
|
+
title: "macOS Logging"
|
|
7
|
+
---
|
|
8
|
+
|
|
9
|
+
# Logging (macOS)
|
|
10
|
+
|
|
11
|
+
## Rolling diagnostics file log (Debug pane)
|
|
12
|
+
|
|
13
|
+
Durar routes macOS app logs through swift-log (unified logging by default) and can write a local, rotating file log to disk when you need a durable capture.
|
|
14
|
+
|
|
15
|
+
- Verbosity: **Debug pane → Logs → App logging → Verbosity**
|
|
16
|
+
- Enable: **Debug pane → Logs → App logging → “Write rolling diagnostics log (JSONL)”**
|
|
17
|
+
- Location: `~/Library/Logs/Durar/diagnostics.jsonl` (rotates automatically; old files are suffixed with `.1`, `.2`, …)
|
|
18
|
+
- Clear: **Debug pane → Logs → App logging → “Clear”**
|
|
19
|
+
|
|
20
|
+
Notes:
|
|
21
|
+
|
|
22
|
+
- This is **off by default**. Enable only while actively debugging.
|
|
23
|
+
- Treat the file as sensitive; don’t share it without review.
|
|
24
|
+
|
|
25
|
+
## Unified logging private data on macOS
|
|
26
|
+
|
|
27
|
+
Unified logging redacts most payloads unless a subsystem opts into `privacy -off`. Per Peter's write-up on macOS [logging privacy shenanigans](https://steipete.me/posts/2025/logging-privacy-shenanigans) (2025) this is controlled by a plist in `/Library/Preferences/Logging/Subsystems/` keyed by the subsystem name. Only new log entries pick up the flag, so enable it before reproducing an issue.
|
|
28
|
+
|
|
29
|
+
## Enable for Durar (`ai.Durar`)
|
|
30
|
+
|
|
31
|
+
- Write the plist to a temp file first, then install it atomically as root:
|
|
32
|
+
|
|
33
|
+
```bash
|
|
34
|
+
cat <<'EOF' >/tmp/ai.Durar.plist
|
|
35
|
+
<?xml version="1.0" encoding="UTF-8"?>
|
|
36
|
+
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
|
|
37
|
+
<plist version="1.0">
|
|
38
|
+
<dict>
|
|
39
|
+
<key>DEFAULT-OPTIONS</key>
|
|
40
|
+
<dict>
|
|
41
|
+
<key>Enable-Private-Data</key>
|
|
42
|
+
<true/>
|
|
43
|
+
</dict>
|
|
44
|
+
</dict>
|
|
45
|
+
</plist>
|
|
46
|
+
EOF
|
|
47
|
+
sudo install -m 644 -o root -g wheel /tmp/ai.Durar.plist /Library/Preferences/Logging/Subsystems/ai.Durar.plist
|
|
48
|
+
```
|
|
49
|
+
|
|
50
|
+
- No reboot is required; logd notices the file quickly, but only new log lines will include private payloads.
|
|
51
|
+
- View the richer output with the existing helper, e.g. `./scripts/clawlog.sh --category WebChat --last 5m`.
|
|
52
|
+
|
|
53
|
+
## Disable after debugging
|
|
54
|
+
|
|
55
|
+
- Remove the override: `sudo rm /Library/Preferences/Logging/Subsystems/ai.Durar.plist`.
|
|
56
|
+
- Optionally run `sudo log config --reload` to force logd to drop the override immediately.
|
|
57
|
+
- Remember this surface can include phone numbers and message bodies; keep the plist in place only while you actively need the extra detail.
|
|
@@ -0,0 +1,81 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "Menu bar status logic and what is surfaced to users"
|
|
3
|
+
read_when:
|
|
4
|
+
- Tweaking mac menu UI or status logic
|
|
5
|
+
title: "Menu Bar"
|
|
6
|
+
---
|
|
7
|
+
|
|
8
|
+
# Menu Bar Status Logic
|
|
9
|
+
|
|
10
|
+
## What is shown
|
|
11
|
+
|
|
12
|
+
- We surface the current agent work state in the menu bar icon and in the first status row of the menu.
|
|
13
|
+
- Health status is hidden while work is active; it returns when all sessions are idle.
|
|
14
|
+
- The “Nodes” block in the menu lists **devices** only (paired nodes via `node.list`), not client/presence entries.
|
|
15
|
+
- A “Usage” section appears under Context when provider usage snapshots are available.
|
|
16
|
+
|
|
17
|
+
## State model
|
|
18
|
+
|
|
19
|
+
- Sessions: events arrive with `runId` (per-run) plus `sessionKey` in the payload. The “main” session is the key `main`; if absent, we fall back to the most recently updated session.
|
|
20
|
+
- Priority: main always wins. If main is active, its state is shown immediately. If main is idle, the most recently active non‑main session is shown. We do not flip‑flop mid‑activity; we only switch when the current session goes idle or main becomes active.
|
|
21
|
+
- Activity kinds:
|
|
22
|
+
- `job`: high‑level command execution (`state: started|streaming|done|error`).
|
|
23
|
+
- `tool`: `phase: start|result` with `toolName` and `meta/args`.
|
|
24
|
+
|
|
25
|
+
## IconState enum (Swift)
|
|
26
|
+
|
|
27
|
+
- `idle`
|
|
28
|
+
- `workingMain(ActivityKind)`
|
|
29
|
+
- `workingOther(ActivityKind)`
|
|
30
|
+
- `overridden(ActivityKind)` (debug override)
|
|
31
|
+
|
|
32
|
+
### ActivityKind → glyph
|
|
33
|
+
|
|
34
|
+
- `exec` → 💻
|
|
35
|
+
- `read` → 📄
|
|
36
|
+
- `write` → ✍️
|
|
37
|
+
- `edit` → 📝
|
|
38
|
+
- `attach` → 📎
|
|
39
|
+
- default → 🛠️
|
|
40
|
+
|
|
41
|
+
### Visual mapping
|
|
42
|
+
|
|
43
|
+
- `idle`: normal critter.
|
|
44
|
+
- `workingMain`: badge with glyph, full tint, leg “working” animation.
|
|
45
|
+
- `workingOther`: badge with glyph, muted tint, no scurry.
|
|
46
|
+
- `overridden`: uses the chosen glyph/tint regardless of activity.
|
|
47
|
+
|
|
48
|
+
## Status row text (menu)
|
|
49
|
+
|
|
50
|
+
- While work is active: `<Session role> · <activity label>`
|
|
51
|
+
- Examples: `Main · exec: pnpm test`, `Other · read: apps/macos/Sources/Durar/AppState.swift`.
|
|
52
|
+
- When idle: falls back to the health summary.
|
|
53
|
+
|
|
54
|
+
## Event ingestion
|
|
55
|
+
|
|
56
|
+
- Source: control‑channel `agent` events (`ControlChannel.handleAgentEvent`).
|
|
57
|
+
- Parsed fields:
|
|
58
|
+
- `stream: "job"` with `data.state` for start/stop.
|
|
59
|
+
- `stream: "tool"` with `data.phase`, `name`, optional `meta`/`args`.
|
|
60
|
+
- Labels:
|
|
61
|
+
- `exec`: first line of `args.command`.
|
|
62
|
+
- `read`/`write`: shortened path.
|
|
63
|
+
- `edit`: path plus inferred change kind from `meta`/diff counts.
|
|
64
|
+
- fallback: tool name.
|
|
65
|
+
|
|
66
|
+
## Debug override
|
|
67
|
+
|
|
68
|
+
- Settings ▸ Debug ▸ “Icon override” picker:
|
|
69
|
+
- `System (auto)` (default)
|
|
70
|
+
- `Working: main` (per tool kind)
|
|
71
|
+
- `Working: other` (per tool kind)
|
|
72
|
+
- `Idle`
|
|
73
|
+
- Stored via `@AppStorage("iconOverride")`; mapped to `IconState.overridden`.
|
|
74
|
+
|
|
75
|
+
## Testing checklist
|
|
76
|
+
|
|
77
|
+
- Trigger main session job: verify icon switches immediately and status row shows main label.
|
|
78
|
+
- Trigger non‑main session job while main idle: icon/status shows non‑main; stays stable until it finishes.
|
|
79
|
+
- Start main while other active: icon flips to main instantly.
|
|
80
|
+
- Rapid tool bursts: ensure badge does not flicker (TTL grace on tool results).
|
|
81
|
+
- Health row reappears once all sessions idle.
|
|
@@ -0,0 +1,65 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "PeekabooBridge integration for macOS UI automation"
|
|
3
|
+
read_when:
|
|
4
|
+
- Hosting PeekabooBridge in Durar.app
|
|
5
|
+
- Integrating Peekaboo via Swift Package Manager
|
|
6
|
+
- Changing PeekabooBridge protocol/paths
|
|
7
|
+
title: "Peekaboo Bridge"
|
|
8
|
+
---
|
|
9
|
+
|
|
10
|
+
# Peekaboo Bridge (macOS UI automation)
|
|
11
|
+
|
|
12
|
+
Durar can host **PeekabooBridge** as a local, permission‑aware UI automation
|
|
13
|
+
broker. This lets the `peekaboo` CLI drive UI automation while reusing the
|
|
14
|
+
macOS app’s TCC permissions.
|
|
15
|
+
|
|
16
|
+
## What this is (and is not)
|
|
17
|
+
|
|
18
|
+
- **Host**: Durar.app can act as a PeekabooBridge host.
|
|
19
|
+
- **Client**: use the `peekaboo` CLI (no separate `Durar ui ...` surface).
|
|
20
|
+
- **UI**: visual overlays stay in Peekaboo.app; Durar is a thin broker host.
|
|
21
|
+
|
|
22
|
+
## Enable the bridge
|
|
23
|
+
|
|
24
|
+
In the macOS app:
|
|
25
|
+
|
|
26
|
+
- Settings → **Enable Peekaboo Bridge**
|
|
27
|
+
|
|
28
|
+
When enabled, Durar starts a local UNIX socket server. If disabled, the host
|
|
29
|
+
is stopped and `peekaboo` will fall back to other available hosts.
|
|
30
|
+
|
|
31
|
+
## Client discovery order
|
|
32
|
+
|
|
33
|
+
Peekaboo clients typically try hosts in this order:
|
|
34
|
+
|
|
35
|
+
1. Peekaboo.app (full UX)
|
|
36
|
+
2. Claude.app (if installed)
|
|
37
|
+
3. Durar.app (thin broker)
|
|
38
|
+
|
|
39
|
+
Use `peekaboo bridge status --verbose` to see which host is active and which
|
|
40
|
+
socket path is in use. You can override with:
|
|
41
|
+
|
|
42
|
+
```bash
|
|
43
|
+
export PEEKABOO_BRIDGE_SOCKET=/path/to/bridge.sock
|
|
44
|
+
```
|
|
45
|
+
|
|
46
|
+
## Security & permissions
|
|
47
|
+
|
|
48
|
+
- The bridge validates **caller code signatures**; an allowlist of TeamIDs is
|
|
49
|
+
enforced (Peekaboo host TeamID + Durar app TeamID).
|
|
50
|
+
- Requests time out after ~10 seconds.
|
|
51
|
+
- If required permissions are missing, the bridge returns a clear error message
|
|
52
|
+
rather than launching System Settings.
|
|
53
|
+
|
|
54
|
+
## Snapshot behavior (automation)
|
|
55
|
+
|
|
56
|
+
Snapshots are stored in memory and expire automatically after a short window.
|
|
57
|
+
If you need longer retention, re‑capture from the client.
|
|
58
|
+
|
|
59
|
+
## Troubleshooting
|
|
60
|
+
|
|
61
|
+
- If `peekaboo` reports “bridge client is not authorized”, ensure the client is
|
|
62
|
+
properly signed or run the host with `PEEKABOO_ALLOW_UNSIGNED_SOCKET_CLIENTS=1`
|
|
63
|
+
in **debug** mode only.
|
|
64
|
+
- If no hosts are found, open one of the host apps (Peekaboo.app or Durar.app)
|
|
65
|
+
and confirm permissions are granted.
|
|
@@ -0,0 +1,50 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "macOS permission persistence (TCC) and signing requirements"
|
|
3
|
+
read_when:
|
|
4
|
+
- Debugging missing or stuck macOS permission prompts
|
|
5
|
+
- Packaging or signing the macOS app
|
|
6
|
+
- Changing bundle IDs or app install paths
|
|
7
|
+
title: "macOS Permissions"
|
|
8
|
+
---
|
|
9
|
+
|
|
10
|
+
# macOS permissions (TCC)
|
|
11
|
+
|
|
12
|
+
macOS permission grants are fragile. TCC associates a permission grant with the
|
|
13
|
+
app's code signature, bundle identifier, and on-disk path. If any of those change,
|
|
14
|
+
macOS treats the app as new and may drop or hide prompts.
|
|
15
|
+
|
|
16
|
+
## Requirements for stable permissions
|
|
17
|
+
|
|
18
|
+
- Same path: run the app from a fixed location (for Durar, `dist/Durar.app`).
|
|
19
|
+
- Same bundle identifier: changing the bundle ID creates a new permission identity.
|
|
20
|
+
- Signed app: unsigned or ad-hoc signed builds do not persist permissions.
|
|
21
|
+
- Consistent signature: use a real Apple Development or Developer ID certificate
|
|
22
|
+
so the signature stays stable across rebuilds.
|
|
23
|
+
|
|
24
|
+
Ad-hoc signatures generate a new identity every build. macOS will forget previous
|
|
25
|
+
grants, and prompts can disappear entirely until the stale entries are cleared.
|
|
26
|
+
|
|
27
|
+
## Recovery checklist when prompts disappear
|
|
28
|
+
|
|
29
|
+
1. Quit the app.
|
|
30
|
+
2. Remove the app entry in System Settings -> Privacy & Security.
|
|
31
|
+
3. Relaunch the app from the same path and re-grant permissions.
|
|
32
|
+
4. If the prompt still does not appear, reset TCC entries with `tccutil` and try again.
|
|
33
|
+
5. Some permissions only reappear after a full macOS restart.
|
|
34
|
+
|
|
35
|
+
Example resets (replace bundle ID as needed):
|
|
36
|
+
|
|
37
|
+
```bash
|
|
38
|
+
sudo tccutil reset Accessibility ai.Durar.mac
|
|
39
|
+
sudo tccutil reset ScreenCapture ai.Durar.mac
|
|
40
|
+
sudo tccutil reset AppleEvents
|
|
41
|
+
```
|
|
42
|
+
|
|
43
|
+
## Files and folders permissions (Desktop/Documents/Downloads)
|
|
44
|
+
|
|
45
|
+
macOS may also gate Desktop, Documents, and Downloads for terminal/background processes. If file reads or directory listings hang, grant access to the same process context that performs file operations (for example Terminal/iTerm, LaunchAgent-launched app, or SSH process).
|
|
46
|
+
|
|
47
|
+
Workaround: move files into the Durar workspace (`~/.Durar/workspace`) if you want to avoid per-folder grants.
|
|
48
|
+
|
|
49
|
+
If you are testing permissions, always sign with a real certificate. Ad-hoc
|
|
50
|
+
builds are only acceptable for quick local runs where permissions do not matter.
|
|
@@ -0,0 +1,84 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "macOS app flow for controlling a remote Durar gateway over SSH"
|
|
3
|
+
read_when:
|
|
4
|
+
- Setting up or debugging remote mac control
|
|
5
|
+
title: "Remote Control"
|
|
6
|
+
---
|
|
7
|
+
|
|
8
|
+
# Remote Durar (macOS ⇄ remote host)
|
|
9
|
+
|
|
10
|
+
This flow lets the macOS app act as a full remote control for an Durar gateway running on another host (desktop/server). It’s the app’s **Remote over SSH** (remote run) feature. All features—health checks, Voice Wake forwarding, and Web Chat—reuse the same remote SSH configuration from _Settings → General_.
|
|
11
|
+
|
|
12
|
+
## Modes
|
|
13
|
+
|
|
14
|
+
- **Local (this Mac)**: Everything runs on the laptop. No SSH involved.
|
|
15
|
+
- **Remote over SSH (default)**: Durar commands are executed on the remote host. The mac app opens an SSH connection with `-o BatchMode` plus your chosen identity/key and a local port-forward.
|
|
16
|
+
- **Remote direct (ws/wss)**: No SSH tunnel. The mac app connects to the gateway URL directly (for example, via Tailscale Serve or a public HTTPS reverse proxy).
|
|
17
|
+
|
|
18
|
+
## Remote transports
|
|
19
|
+
|
|
20
|
+
Remote mode supports two transports:
|
|
21
|
+
|
|
22
|
+
- **SSH tunnel** (default): Uses `ssh -N -L ...` to forward the gateway port to localhost. The gateway will see the node’s IP as `127.0.0.1` because the tunnel is loopback.
|
|
23
|
+
- **Direct (ws/wss)**: Connects straight to the gateway URL. The gateway sees the real client IP.
|
|
24
|
+
|
|
25
|
+
## Prereqs on the remote host
|
|
26
|
+
|
|
27
|
+
1. Install Node + pnpm and build/install the Durar CLI (`pnpm install && pnpm build && pnpm link --global`).
|
|
28
|
+
2. Ensure `Durar` is on PATH for non-interactive shells (symlink into `/usr/local/bin` or `/opt/homebrew/bin` if needed).
|
|
29
|
+
3. Open SSH with key auth. We recommend **Tailscale** IPs for stable reachability off-LAN.
|
|
30
|
+
|
|
31
|
+
## macOS app setup
|
|
32
|
+
|
|
33
|
+
1. Open _Settings → General_.
|
|
34
|
+
2. Under **Durar runs**, pick **Remote over SSH** and set:
|
|
35
|
+
- **Transport**: **SSH tunnel** or **Direct (ws/wss)**.
|
|
36
|
+
- **SSH target**: `user@host` (optional `:port`).
|
|
37
|
+
- If the gateway is on the same LAN and advertises Bonjour, pick it from the discovered list to auto-fill this field.
|
|
38
|
+
- **Gateway URL** (Direct only): `wss://gateway.example.ts.net` (or `ws://...` for local/LAN).
|
|
39
|
+
- **Identity file** (advanced): path to your key.
|
|
40
|
+
- **Project root** (advanced): remote checkout path used for commands.
|
|
41
|
+
- **CLI path** (advanced): optional path to a runnable `Durar` entrypoint/binary (auto-filled when advertised).
|
|
42
|
+
3. Hit **Test remote**. Success indicates the remote `Durar status --json` runs correctly. Failures usually mean PATH/CLI issues; exit 127 means the CLI isn’t found remotely.
|
|
43
|
+
4. Health checks and Web Chat will now run through this SSH tunnel automatically.
|
|
44
|
+
|
|
45
|
+
## Web Chat
|
|
46
|
+
|
|
47
|
+
- **SSH tunnel**: Web Chat connects to the gateway over the forwarded WebSocket control port (default 18789).
|
|
48
|
+
- **Direct (ws/wss)**: Web Chat connects straight to the configured gateway URL.
|
|
49
|
+
- There is no separate WebChat HTTP server anymore.
|
|
50
|
+
|
|
51
|
+
## Permissions
|
|
52
|
+
|
|
53
|
+
- The remote host needs the same TCC approvals as local (Automation, Accessibility, Screen Recording, Microphone, Speech Recognition, Notifications). Run onboarding on that machine to grant them once.
|
|
54
|
+
- Nodes advertise their permission state via `node.list` / `node.describe` so agents know what’s available.
|
|
55
|
+
|
|
56
|
+
## Security notes
|
|
57
|
+
|
|
58
|
+
- Prefer loopback binds on the remote host and connect via SSH or Tailscale.
|
|
59
|
+
- SSH tunneling uses strict host-key checking; trust the host key first so it exists in `~/.ssh/known_hosts`.
|
|
60
|
+
- If you bind the Gateway to a non-loopback interface, require valid Gateway auth: token, password, or an identity-aware reverse proxy with `gateway.auth.mode: "trusted-proxy"`.
|
|
61
|
+
- See [Security](/gateway/security) and [Tailscale](/gateway/tailscale).
|
|
62
|
+
|
|
63
|
+
## WhatsApp login flow (remote)
|
|
64
|
+
|
|
65
|
+
- Run `Durar channels login --verbose` **on the remote host**. Scan the QR with WhatsApp on your phone.
|
|
66
|
+
- Re-run login on that host if auth expires. Health check will surface link problems.
|
|
67
|
+
|
|
68
|
+
## Troubleshooting
|
|
69
|
+
|
|
70
|
+
- **exit 127 / not found**: `Durar` isn’t on PATH for non-login shells. Add it to `/etc/paths`, your shell rc, or symlink into `/usr/local/bin`/`/opt/homebrew/bin`.
|
|
71
|
+
- **Health probe failed**: check SSH reachability, PATH, and that Baileys is logged in (`Durar status --json`).
|
|
72
|
+
- **Web Chat stuck**: confirm the gateway is running on the remote host and the forwarded port matches the gateway WS port; the UI requires a healthy WS connection.
|
|
73
|
+
- **Node IP shows 127.0.0.1**: expected with the SSH tunnel. Switch **Transport** to **Direct (ws/wss)** if you want the gateway to see the real client IP.
|
|
74
|
+
- **Voice Wake**: trigger phrases are forwarded automatically in remote mode; no separate forwarder is needed.
|
|
75
|
+
|
|
76
|
+
## Notification sounds
|
|
77
|
+
|
|
78
|
+
Pick sounds per notification from scripts with `Durar` and `node.invoke`, e.g.:
|
|
79
|
+
|
|
80
|
+
```bash
|
|
81
|
+
Durar nodes notify --node <id> --title "Ping" --body "Remote gateway ready" --sound Glass
|
|
82
|
+
```
|
|
83
|
+
|
|
84
|
+
There is no global “default sound” toggle in the app anymore; callers choose a sound (or none) per request.
|
|
@@ -0,0 +1,47 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "Signing steps for macOS debug builds generated by packaging scripts"
|
|
3
|
+
read_when:
|
|
4
|
+
- Building or signing mac debug builds
|
|
5
|
+
title: "macOS Signing"
|
|
6
|
+
---
|
|
7
|
+
|
|
8
|
+
# mac signing (debug builds)
|
|
9
|
+
|
|
10
|
+
This app is usually built from [`scripts/package-mac-app.sh`](https://github.com/openclaw/openclaw/blob/main/scripts/package-mac-app.sh), which now:
|
|
11
|
+
|
|
12
|
+
- sets a stable debug bundle identifier: `ai.Durar.mac.debug`
|
|
13
|
+
- writes the Info.plist with that bundle id (override via `BUNDLE_ID=...`)
|
|
14
|
+
- calls [`scripts/codesign-mac-app.sh`](https://github.com/openclaw/openclaw/blob/main/scripts/codesign-mac-app.sh) to sign the main binary and app bundle so macOS treats each rebuild as the same signed bundle and keeps TCC permissions (notifications, accessibility, screen recording, mic, speech). For stable permissions, use a real signing identity; ad-hoc is opt-in and fragile (see [macOS permissions](/platforms/mac/permissions)).
|
|
15
|
+
- uses `CODESIGN_TIMESTAMP=auto` by default; it enables trusted timestamps for Developer ID signatures. Set `CODESIGN_TIMESTAMP=off` to skip timestamping (offline debug builds).
|
|
16
|
+
- inject build metadata into Info.plist: `DurarBuildTimestamp` (UTC) and `DurarGitCommit` (short hash) so the About pane can show build, git, and debug/release channel.
|
|
17
|
+
- **Packaging defaults to Node 24**: the script runs TS builds and the Control UI build. Node 22 LTS, currently `22.14+`, remains supported for compatibility.
|
|
18
|
+
- reads `SIGN_IDENTITY` from the environment. Add `export SIGN_IDENTITY="Apple Development: Your Name (TEAMID)"` (or your Developer ID Application cert) to your shell rc to always sign with your cert. Ad-hoc signing requires explicit opt-in via `ALLOW_ADHOC_SIGNING=1` or `SIGN_IDENTITY="-"` (not recommended for permission testing).
|
|
19
|
+
- runs a Team ID audit after signing and fails if any Mach-O inside the app bundle is signed by a different Team ID. Set `SKIP_TEAM_ID_CHECK=1` to bypass.
|
|
20
|
+
|
|
21
|
+
## Usage
|
|
22
|
+
|
|
23
|
+
```bash
|
|
24
|
+
# from repo root
|
|
25
|
+
scripts/package-mac-app.sh # auto-selects identity; errors if none found
|
|
26
|
+
SIGN_IDENTITY="Developer ID Application: Your Name" scripts/package-mac-app.sh # real cert
|
|
27
|
+
ALLOW_ADHOC_SIGNING=1 scripts/package-mac-app.sh # ad-hoc (permissions will not stick)
|
|
28
|
+
SIGN_IDENTITY="-" scripts/package-mac-app.sh # explicit ad-hoc (same caveat)
|
|
29
|
+
DISABLE_LIBRARY_VALIDATION=1 scripts/package-mac-app.sh # dev-only Sparkle Team ID mismatch workaround
|
|
30
|
+
```
|
|
31
|
+
|
|
32
|
+
### Ad-hoc Signing Note
|
|
33
|
+
|
|
34
|
+
When signing with `SIGN_IDENTITY="-"` (ad-hoc), the script automatically disables the **Hardened Runtime** (`--options runtime`). This is necessary to prevent crashes when the app attempts to load embedded frameworks (like Sparkle) that do not share the same Team ID. Ad-hoc signatures also break TCC permission persistence; see [macOS permissions](/platforms/mac/permissions) for recovery steps.
|
|
35
|
+
|
|
36
|
+
## Build metadata for About
|
|
37
|
+
|
|
38
|
+
`package-mac-app.sh` stamps the bundle with:
|
|
39
|
+
|
|
40
|
+
- `DurarBuildTimestamp`: ISO8601 UTC at package time
|
|
41
|
+
- `DurarGitCommit`: short git hash (or `unknown` if unavailable)
|
|
42
|
+
|
|
43
|
+
The About tab reads these keys to show version, build date, git commit, and whether it’s a debug build (via `#if DEBUG`). Run the packager to refresh these values after code changes.
|
|
44
|
+
|
|
45
|
+
## Why
|
|
46
|
+
|
|
47
|
+
TCC permissions are tied to the bundle identifier _and_ code signature. Unsigned debug builds with changing UUIDs were causing macOS to forget grants after each rebuild. Signing the binaries (ad‑hoc by default) and keeping a fixed bundle id/path (`dist/Durar.app`) preserves the grants between builds, matching the VibeTunnel approach.
|
|
@@ -0,0 +1,40 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "macOS Skills settings UI and gateway-backed status"
|
|
3
|
+
read_when:
|
|
4
|
+
- Updating the macOS Skills settings UI
|
|
5
|
+
- Changing skills gating or install behavior
|
|
6
|
+
title: "Skills (macOS)"
|
|
7
|
+
---
|
|
8
|
+
|
|
9
|
+
# Skills (macOS)
|
|
10
|
+
|
|
11
|
+
The macOS app surfaces Durar skills via the gateway; it does not parse skills locally.
|
|
12
|
+
|
|
13
|
+
## Data source
|
|
14
|
+
|
|
15
|
+
- `skills.status` (gateway) returns all skills plus eligibility and missing requirements
|
|
16
|
+
(including allowlist blocks for bundled skills).
|
|
17
|
+
- Requirements are derived from `metadata.Durar.requires` in each `SKILL.md`.
|
|
18
|
+
|
|
19
|
+
## Install actions
|
|
20
|
+
|
|
21
|
+
- `metadata.Durar.install` defines install options (brew/node/go/uv).
|
|
22
|
+
- The app calls `skills.install` to run installers on the gateway host.
|
|
23
|
+
- Built-in dangerous-code `critical` findings block `skills.install` by default; suspicious findings still warn only. The dangerous override exists on the gateway request, but the default app flow stays fail-closed.
|
|
24
|
+
- If every install option is `download`, the gateway surfaces all download
|
|
25
|
+
choices.
|
|
26
|
+
- Otherwise, the gateway picks one preferred installer using the current
|
|
27
|
+
install preferences and host binaries: Homebrew first when
|
|
28
|
+
`skills.install.preferBrew` is enabled and `brew` exists, then `uv`, then the
|
|
29
|
+
configured node manager from `skills.install.nodeManager`, then later
|
|
30
|
+
fallbacks like `go` or `download`.
|
|
31
|
+
- Node install labels reflect the configured node manager, including `yarn`.
|
|
32
|
+
|
|
33
|
+
## Env/API keys
|
|
34
|
+
|
|
35
|
+
- The app stores keys in `~/.Durar/Durar.json` under `skills.entries.<skillKey>`.
|
|
36
|
+
- `skills.update` patches `enabled`, `apiKey`, and `env`.
|
|
37
|
+
|
|
38
|
+
## Remote mode
|
|
39
|
+
|
|
40
|
+
- Install + config updates happen on the gateway host (not the local Mac).
|
|
@@ -0,0 +1,60 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "Voice overlay lifecycle when wake-word and push-to-talk overlap"
|
|
3
|
+
read_when:
|
|
4
|
+
- Adjusting voice overlay behavior
|
|
5
|
+
title: "Voice Overlay"
|
|
6
|
+
---
|
|
7
|
+
|
|
8
|
+
# Voice Overlay Lifecycle (macOS)
|
|
9
|
+
|
|
10
|
+
Audience: macOS app contributors. Goal: keep the voice overlay predictable when wake-word and push-to-talk overlap.
|
|
11
|
+
|
|
12
|
+
## Current intent
|
|
13
|
+
|
|
14
|
+
- If the overlay is already visible from wake-word and the user presses the hotkey, the hotkey session _adopts_ the existing text instead of resetting it. The overlay stays up while the hotkey is held. When the user releases: send if there is trimmed text, otherwise dismiss.
|
|
15
|
+
- Wake-word alone still auto-sends on silence; push-to-talk sends immediately on release.
|
|
16
|
+
|
|
17
|
+
## Implemented (Dec 9, 2025)
|
|
18
|
+
|
|
19
|
+
- Overlay sessions now carry a token per capture (wake-word or push-to-talk). Partial/final/send/dismiss/level updates are dropped when the token doesn’t match, avoiding stale callbacks.
|
|
20
|
+
- Push-to-talk adopts any visible overlay text as a prefix (so pressing the hotkey while the wake overlay is up keeps the text and appends new speech). It waits up to 1.5s for a final transcript before falling back to the current text.
|
|
21
|
+
- Chime/overlay logging is emitted at `info` in categories `voicewake.overlay`, `voicewake.ptt`, and `voicewake.chime` (session start, partial, final, send, dismiss, chime reason).
|
|
22
|
+
|
|
23
|
+
## Next steps
|
|
24
|
+
|
|
25
|
+
1. **VoiceSessionCoordinator (actor)**
|
|
26
|
+
- Owns exactly one `VoiceSession` at a time.
|
|
27
|
+
- API (token-based): `beginWakeCapture`, `beginPushToTalk`, `updatePartial`, `endCapture`, `cancel`, `applyCooldown`.
|
|
28
|
+
- Drops callbacks that carry stale tokens (prevents old recognizers from reopening the overlay).
|
|
29
|
+
2. **VoiceSession (model)**
|
|
30
|
+
- Fields: `token`, `source` (wakeWord|pushToTalk), committed/volatile text, chime flags, timers (auto-send, idle), `overlayMode` (display|editing|sending), cooldown deadline.
|
|
31
|
+
3. **Overlay binding**
|
|
32
|
+
- `VoiceSessionPublisher` (`ObservableObject`) mirrors the active session into SwiftUI.
|
|
33
|
+
- `VoiceWakeOverlayView` renders only via the publisher; it never mutates global singletons directly.
|
|
34
|
+
- Overlay user actions (`sendNow`, `dismiss`, `edit`) call back into the coordinator with the session token.
|
|
35
|
+
4. **Unified send path**
|
|
36
|
+
- On `endCapture`: if trimmed text is empty → dismiss; else `performSend(session:)` (plays send chime once, forwards, dismisses).
|
|
37
|
+
- Push-to-talk: no delay; wake-word: optional delay for auto-send.
|
|
38
|
+
- Apply a short cooldown to the wake runtime after push-to-talk finishes so wake-word doesn’t immediately retrigger.
|
|
39
|
+
5. **Logging**
|
|
40
|
+
- Coordinator emits `.info` logs in subsystem `ai.Durar`, categories `voicewake.overlay` and `voicewake.chime`.
|
|
41
|
+
- Key events: `session_started`, `adopted_by_push_to_talk`, `partial`, `finalized`, `send`, `dismiss`, `cancel`, `cooldown`.
|
|
42
|
+
|
|
43
|
+
## Debugging checklist
|
|
44
|
+
|
|
45
|
+
- Stream logs while reproducing a sticky overlay:
|
|
46
|
+
|
|
47
|
+
```bash
|
|
48
|
+
sudo log stream --predicate 'subsystem == "ai.Durar" AND category CONTAINS "voicewake"' --level info --style compact
|
|
49
|
+
```
|
|
50
|
+
|
|
51
|
+
- Verify only one active session token; stale callbacks should be dropped by the coordinator.
|
|
52
|
+
- Ensure push-to-talk release always calls `endCapture` with the active token; if text is empty, expect `dismiss` without chime or send.
|
|
53
|
+
|
|
54
|
+
## Migration steps (suggested)
|
|
55
|
+
|
|
56
|
+
1. Add `VoiceSessionCoordinator`, `VoiceSession`, and `VoiceSessionPublisher`.
|
|
57
|
+
2. Refactor `VoiceWakeRuntime` to create/update/end sessions instead of touching `VoiceWakeOverlayController` directly.
|
|
58
|
+
3. Refactor `VoicePushToTalk` to adopt existing sessions and call `endCapture` on release; apply runtime cooldown.
|
|
59
|
+
4. Wire `VoiceWakeOverlayController` to the publisher; remove direct calls from runtime/PTT.
|
|
60
|
+
5. Add integration tests for session adoption, cooldown, and empty-text dismissal.
|
|
@@ -0,0 +1,67 @@
|
|
|
1
|
+
---
|
|
2
|
+
summary: "Voice wake and push-to-talk modes plus routing details in the mac app"
|
|
3
|
+
read_when:
|
|
4
|
+
- Working on voice wake or PTT pathways
|
|
5
|
+
title: "Voice Wake (macOS)"
|
|
6
|
+
---
|
|
7
|
+
|
|
8
|
+
# Voice Wake & Push-to-Talk
|
|
9
|
+
|
|
10
|
+
## Modes
|
|
11
|
+
|
|
12
|
+
- **Wake-word mode** (default): always-on Speech recognizer waits for trigger tokens (`swabbleTriggerWords`). On match it starts capture, shows the overlay with partial text, and auto-sends after silence.
|
|
13
|
+
- **Push-to-talk (Right Option hold)**: hold the right Option key to capture immediately—no trigger needed. The overlay appears while held; releasing finalizes and forwards after a short delay so you can tweak text.
|
|
14
|
+
|
|
15
|
+
## Runtime behavior (wake-word)
|
|
16
|
+
|
|
17
|
+
- Speech recognizer lives in `VoiceWakeRuntime`.
|
|
18
|
+
- Trigger only fires when there’s a **meaningful pause** between the wake word and the next word (~0.55s gap). The overlay/chime can start on the pause even before the command begins.
|
|
19
|
+
- Silence windows: 2.0s when speech is flowing, 5.0s if only the trigger was heard.
|
|
20
|
+
- Hard stop: 120s to prevent runaway sessions.
|
|
21
|
+
- Debounce between sessions: 350ms.
|
|
22
|
+
- Overlay is driven via `VoiceWakeOverlayController` with committed/volatile coloring.
|
|
23
|
+
- After send, recognizer restarts cleanly to listen for the next trigger.
|
|
24
|
+
|
|
25
|
+
## Lifecycle invariants
|
|
26
|
+
|
|
27
|
+
- If Voice Wake is enabled and permissions are granted, the wake-word recognizer should be listening (except during an explicit push-to-talk capture).
|
|
28
|
+
- Overlay visibility (including manual dismiss via the X button) must never prevent the recognizer from resuming.
|
|
29
|
+
|
|
30
|
+
## Sticky overlay failure mode (previous)
|
|
31
|
+
|
|
32
|
+
Previously, if the overlay got stuck visible and you manually closed it, Voice Wake could appear “dead” because the runtime’s restart attempt could be blocked by overlay visibility and no subsequent restart was scheduled.
|
|
33
|
+
|
|
34
|
+
Hardening:
|
|
35
|
+
|
|
36
|
+
- Wake runtime restart is no longer blocked by overlay visibility.
|
|
37
|
+
- Overlay dismiss completion triggers a `VoiceWakeRuntime.refresh(...)` via `VoiceSessionCoordinator`, so manual X-dismiss always resumes listening.
|
|
38
|
+
|
|
39
|
+
## Push-to-talk specifics
|
|
40
|
+
|
|
41
|
+
- Hotkey detection uses a global `.flagsChanged` monitor for **right Option** (`keyCode 61` + `.option`). We only observe events (no swallowing).
|
|
42
|
+
- Capture pipeline lives in `VoicePushToTalk`: starts Speech immediately, streams partials to the overlay, and calls `VoiceWakeForwarder` on release.
|
|
43
|
+
- When push-to-talk starts we pause the wake-word runtime to avoid dueling audio taps; it restarts automatically after release.
|
|
44
|
+
- Permissions: requires Microphone + Speech; seeing events needs Accessibility/Input Monitoring approval.
|
|
45
|
+
- External keyboards: some may not expose right Option as expected—offer a fallback shortcut if users report misses.
|
|
46
|
+
|
|
47
|
+
## User-facing settings
|
|
48
|
+
|
|
49
|
+
- **Voice Wake** toggle: enables wake-word runtime.
|
|
50
|
+
- **Hold Cmd+Fn to talk**: enables the push-to-talk monitor. Disabled on macOS < 26.
|
|
51
|
+
- Language & mic pickers, live level meter, trigger-word table, tester (local-only; does not forward).
|
|
52
|
+
- Mic picker preserves the last selection if a device disconnects, shows a disconnected hint, and temporarily falls back to the system default until it returns.
|
|
53
|
+
- **Sounds**: chimes on trigger detect and on send; defaults to the macOS “Glass” system sound. You can pick any `NSSound`-loadable file (e.g. MP3/WAV/AIFF) for each event or choose **No Sound**.
|
|
54
|
+
|
|
55
|
+
## Forwarding behavior
|
|
56
|
+
|
|
57
|
+
- When Voice Wake is enabled, transcripts are forwarded to the active gateway/agent (the same local vs remote mode used by the rest of the mac app).
|
|
58
|
+
- Replies are delivered to the **last-used main provider** (WhatsApp/Telegram/Discord/WebChat). If delivery fails, the error is logged and the run is still visible via WebChat/session logs.
|
|
59
|
+
|
|
60
|
+
## Forwarding payload
|
|
61
|
+
|
|
62
|
+
- `VoiceWakeForwarder.prefixedTranscript(_:)` prepends the machine hint before sending. Shared between wake-word and push-to-talk paths.
|
|
63
|
+
|
|
64
|
+
## Quick verification
|
|
65
|
+
|
|
66
|
+
- Toggle push-to-talk on, hold Cmd+Fn, speak, release: overlay should show partials then send.
|
|
67
|
+
- While holding, menu-bar ears should stay enlarged (uses `triggerVoiceEars(ttl:nil)`); they drop after release.
|