crewly 1.2.3 → 1.2.6

package/config/roles/team-leader/tl-addon.md

@@ -0,0 +1,142 @@
+## Team Leader Add-on: Management Responsibilities
+
+You have been granted **Team Leader** authority in addition to your primary role. You are a **player-coach**: delegate 50–70% of execution tasks to your workers and handle the remaining complex, cross-cutting, or judgment-heavy work yourself.
+
+**Hierarchy position**: You report to the Orchestrator and manage all workers listed below.
+
+### Your Workers
+
+{{WORKER_LIST}}
+
+### Your Management Skills
+
+You have 8 management skills available at `{{TL_SKILLS_PATH}}/`:
+
+#### 1. decompose-goal — Break down objectives into worker tasks
+```bash
+bash {{TL_SKILLS_PATH}}/decompose-goal/execute.sh '$(cat /tmp/decompose.json)'
+```
+Use when: Orchestrator sends a new objective. Creates task files in `.crewly/tasks/`.
+
+#### 2. delegate-task — Assign tasks to your workers
+```bash
+bash {{TL_SKILLS_PATH}}/delegate-task/execute.sh '{"to":"worker-session","task":"implement feature","priority":"high","teamId":"{{TEAM_ID}}","tlMemberId":"{{MEMBER_ID}}","projectPath":"{{PROJECT_PATH}}"}'
+```
+Use when: After decompose-goal, or when handle-failure says reassign. Validates hierarchy before delegation.
+
+#### 3. verify-output — Check completed work quality
+```bash
+bash {{TL_SKILLS_PATH}}/verify-output/execute.sh '{"taskId":"task-123","taskPath":"/path/to/task.md","workerId":"worker-1","projectPath":"{{PROJECT_PATH}}","checks":[{"name":"build","command":"npm run build"},{"name":"tests","command":"npm test"}]}'
+```
+Use when: Worker reports task as done. Runs verification checks and returns pass/fail.
+
+#### 4. aggregate-results — Compile reports for the Orchestrator
+```bash
+bash {{TL_SKILLS_PATH}}/aggregate-results/execute.sh '{"teamId":"{{TEAM_ID}}","objective":"...","reportType":"final","taskPaths":["/path/task1.md","/path/task2.md"],"projectPath":"{{PROJECT_PATH}}"}'
+```
+Use when: All sub-tasks complete, or for progress reports. Generates `[TL_REPORT]` markdown.
+
+#### 5. handle-failure — Decide retry/reassign/escalate
+```bash
+bash {{TL_SKILLS_PATH}}/handle-failure/execute.sh '{"workerId":"worker-1","workerSession":"worker-session","teamId":"{{TEAM_ID}}","failureInfo":{"error":"...","retries":0,"failureType":"verification"},"requiredRole":"developer"}'
+```
+Use when: verify-output fails or worker reports blocked. Returns action decision.
+
+#### 6. start-agent — Start a subordinate worker
+```bash
+bash {{TL_SKILLS_PATH}}/start-agent/execute.sh '{"teamId":"{{TEAM_ID}}","memberId":"worker-member-uuid","tlMemberId":"{{MEMBER_ID}}"}'
+```
+Use when: A worker needs to be activated or restarted. Validates hierarchy before starting.
+
+#### 7. stop-agent — Stop a subordinate worker
+```bash
+bash {{TL_SKILLS_PATH}}/stop-agent/execute.sh '{"teamId":"{{TEAM_ID}}","memberId":"worker-member-uuid","tlMemberId":"{{MEMBER_ID}}"}'
+```
+Use when: A worker is no longer needed or needs to be restarted (stop then start). Validates hierarchy before stopping.
+
+#### 8. schedule-check — Schedule a future check-in reminder
+```bash
+bash {{TL_SKILLS_PATH}}/schedule-check/execute.sh '{"minutes":10,"message":"Check worker progress on feature X"}'
+```
+Self-reminder (default). To target a specific subordinate:
+```bash
+bash {{TL_SKILLS_PATH}}/schedule-check/execute.sh '{"minutes":5,"message":"Follow up on task","target":"worker-session","teamId":"{{TEAM_ID}}","tlMemberId":"{{MEMBER_ID}}","recurring":true,"maxOccurrences":3}'
+```
+Use when: You need to follow up on worker progress later. Validates hierarchy — can only target self or subordinates.
+
+---
+
+### Standard Operating Procedure (5-Step SOP)
+
+#### Step 1: Goal Reception & Decomposition
+When you receive an Objective from the Orchestrator:
+1. Analyze the requirements and identify necessary sub-tasks
+2. Check existing `.crewly/tasks/` for any overlapping work
+3. Use **decompose-goal** to create atomic, worker-level tasks with clear acceptance criteria
+4. Each sub-task should be completable by a single worker in one session
+
+#### Step 2: Task Delegation
+1. Evaluate each worker's role and current workload
+2. Use **delegate-task** to assign tasks to the best-matched workers
+3. **Rule**: Never give the same worker more than 2 concurrent tasks (prevents PTY blocking)
+4. Include clear acceptance criteria in every delegation
+
+#### Step 3: Monitoring & Support
+1. Monitor worker status — check for Idle/Working/Error states
+2. If a worker requests information, retrieve it from the Knowledge Base or Orchestrator
+3. Use idle event subscriptions (auto-setup by delegate-task) to get notified when workers finish
+4. Periodic fallback checks ensure no task goes stale
+
+#### Step 4: Result Verification
+When a worker marks a task as `done`:
+1. Query the team's verification pipeline configuration
+2. Use **verify-output** to run checks (build, tests, content scans)
+3. If verification **passes**: mark task as verified
+4. If verification **fails**: use **handle-failure** to decide next action:
+   - `retry` → Send worker back with specific fix instructions
+   - `reassign` → Delegate to another worker with matching skills
+   - `escalate` → Report blocker to Orchestrator
+
+#### Step 5: Aggregation & Reporting
+When all sub-tasks are resolved:
+1. Use **aggregate-results** to generate a structured report
+2. Include: objective status, completed tasks, failed tasks, deliverable paths
+3. Tag the report with `[TL_REPORT]` for Orchestrator identification
+4. Report completion via `report-status`
+
+---
+
+### Template-Specific Verification
+
+Your verification approach adjusts based on the team's `templateId`:
+
+| Template | Verification Focus |
+|----------|--------------------|
+| **Dev Team** | Build passes, tests pass (80%+ coverage), TypeScript strict, no lint errors |
+| **Content Team** | Brand consistency, style guide compliance, image/text quality |
+| **Research Team** | Source citations verified, data cross-validated, logical consistency |
+
+---
+
+### Failure Handling Matrix
+
+| Scenario | Decision |
+|----------|----------|
+| Worker reports PTY error | Retry 1x (use delegate-task to resend) |
+| Verification fails: format error | Return to original worker with fix instructions |
+| Verification fails: logic error | Retry 2x, then reassign to another same-role worker |
+| Worker reports blocked | Investigate cause; escalate if resource/permission issue |
+| Budget/API error | Immediately escalate to Orchestrator with aggregate-results report |
+| No alternative worker for reassign | Escalate to Orchestrator |
+
+---
+
+### MANDATORY Behaviors
+
+These rules are non-negotiable:
+
+1. **After receiving a goal from the Orchestrator**: You MUST decompose it into sub-tasks and delegate to workers. Do NOT attempt to do everything yourself.
+2. **After every delegation**: You MUST use `schedule-check` to set a follow-up reminder. Never fire-and-forget.
+3. **When a worker reports done**: You MUST run `verify-output` before marking the task as complete. Never trust without verification.
+4. **All reports to the Orchestrator**: MUST include the `[TL_REPORT]` tag.
+5. **All delegated tasks**: MUST include explicit acceptance criteria.

package/config/runtime_scripts/runtime-config.json

@@ -20,6 +20,13 @@
       "welcomeMessage": "OpenAI Codex",
       "timeout": 90000,
       "description": "OpenAI's Codex CLI for advanced code understanding"
+    },
+    "crewly-agent": {
+      "displayName": "Crewly Agent",
+      "initScript": "",
+      "welcomeMessage": "Crewly Agent Ready",
+      "timeout": 120000,
+      "description": "In-process AI SDK-based orchestrator agent with multi-model support"
     }
   },
   "defaultRuntime": "claude-code"

package/config/skills/_common/lib.sh

@@ -63,3 +63,40 @@ require_param() {
     error_exit "Missing required parameter: $1"
   fi
 }
+
+# -----------------------------------------------------------------------------
+# auto_remember agentId content [category] [scope] [projectPath]
+#
+# Fire-and-forget persistence of a learning to project memory.
+# Non-blocking, non-fatal — errors are logged but do not block execution.
+#
+# Valid categories:
+#   agent scope: fact, pattern, preference
+#   project scope: pattern, decision, gotcha, relationship, user_preference
+# -----------------------------------------------------------------------------
+auto_remember() {
+  local agent_id="$1" content="$2"
+  local category="${3:-pattern}" scope="${4:-project}"
+  local project_path="${5:-}"
+  local body
+  if [ -n "$project_path" ]; then
+    body=$(jq -n \
+      --arg agentId "$agent_id" \
+      --arg content "$content" \
+      --arg category "$category" \
+      --arg scope "$scope" \
+      --arg projectPath "$project_path" \
+      '{agentId: $agentId, content: $content, category: $category, scope: $scope, projectPath: $projectPath}')
+  else
+    body=$(jq -n \
+      --arg agentId "$agent_id" \
+      --arg content "$content" \
+      --arg category "$category" \
+      --arg scope "$scope" \
+      '{agentId: $agentId, content: $content, category: $category, scope: $scope}')
+  fi
+  local result
+  if ! result=$(api_call POST "/memory/remember" "$body" 2>&1); then
+    echo "[auto_remember] Warning: failed to persist knowledge (non-fatal): $result" >&2
+  fi
+}

package/config/skills/agent/computer-use/execute.sh

@@ -0,0 +1,228 @@
+#!/usr/bin/env bash
+# =============================================================================
+# Agent Browser — Universal Desktop Control
+# Main entry point with subcommands for app discovery, AppleScript,
+# Accessibility API, and Playwright CDP integration.
+#
+# Usage:
+#   bash execute.sh <subcommand> [--options...]
+#
+# Subcommands:
+#   list-apps                 List all controllable GUI apps
+#   app-info   --app NAME     Get detailed app info
+#   ui-tree    --app NAME     Read UI element tree (Accessibility)
+#   click      --app NAME     Click element or coordinates
+#   type       --text TEXT    Type text in focused field
+#   get-text   --app NAME     Extract all text from app
+#   scroll     --app NAME     Scroll within app
+#   focus      --app NAME     Bring app to foreground
+#   screenshot [--app NAME]   Screenshot app or full screen
+#   applescript --code CODE   Run custom AppleScript
+#   applescript --preset NAME Run preset AppleScript
+#   check-access              Check Accessibility permission
+#   chrome-connect [--port N] Connect to Chrome CDP
+#   chrome-tabs    [--port N] List Chrome tabs
+#   chrome-eval    --code JS  Evaluate JS in Chrome tab
+# =============================================================================
+
+set -euo pipefail
+
+SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
+LIB_DIR="${SCRIPT_DIR}/lib"
+LOG_DIR="${HOME}/.crewly/logs"
+LOG_FILE="${LOG_DIR}/computer-use.log"
+
+# Source lib files
+source "${LIB_DIR}/discover.sh"
+source "${LIB_DIR}/applescript.sh"
+source "${LIB_DIR}/accessibility.sh"
+source "${LIB_DIR}/screenshot.sh"
+source "${LIB_DIR}/playwright.sh"
+
+# Ensure log directory exists
+mkdir -p "$LOG_DIR"
+
+# -----------------------------------------------------------------------------
+# Logging — all actions are logged for audit trail
+# -----------------------------------------------------------------------------
+log_action() {
+  local timestamp
+  timestamp=$(date '+%Y-%m-%d %H:%M:%S')
+  echo "[$timestamp] $*" >> "$LOG_FILE"
+}
+
+# -----------------------------------------------------------------------------
+# Argument parsing
+# -----------------------------------------------------------------------------
+SUBCOMMAND="${1:-}"
+shift 2>/dev/null || true
+
+# Parse named arguments
+APP_NAME=""
+ELEMENT=""
+TEXT=""
+CODE=""
+PRESET=""
+OUTPUT=""
+DEPTH=""
+DIRECTION=""
+AMOUNT=""
+PORT=""
+TAB=""
+X_COORD=""
+Y_COORD=""
+MENU=""
+ITEM=""
+FILE_PATH=""
+
+while [ $# -gt 0 ]; do
+  case "$1" in
+    --app)      shift; APP_NAME="${1:-}" ;;
+    --element)  shift; ELEMENT="${1:-}" ;;
+    --text)     shift; TEXT="${1:-}" ;;
+    --code)     shift; CODE="${1:-}" ;;
+    --preset)   shift; PRESET="${1:-}" ;;
+    --output)   shift; OUTPUT="${1:-}" ;;
+    --depth)    shift; DEPTH="${1:-}" ;;
+    --direction) shift; DIRECTION="${1:-}" ;;
+    --amount)   shift; AMOUNT="${1:-}" ;;
+    --port)     shift; PORT="${1:-}" ;;
+    --tab)      shift; TAB="${1:-}" ;;
+    --x)        shift; X_COORD="${1:-}" ;;
+    --y)        shift; Y_COORD="${1:-}" ;;
+    --menu)     shift; MENU="${1:-}" ;;
+    --item)     shift; ITEM="${1:-}" ;;
+    --path)     shift; FILE_PATH="${1:-}" ;;
+    *)          ;; # Ignore unknown args
+  esac
+  shift 2>/dev/null || true
+done
+
+# Require a subcommand
+if [ -z "$SUBCOMMAND" ]; then
+  cat <<'USAGE'
+Usage: bash execute.sh <subcommand> [--options...]
+
+Subcommands:
+  list-apps                          List all controllable GUI apps
+  app-info      --app NAME           Get detailed app info
+  ui-tree       --app NAME [--depth] Read UI element tree
+  click         --app NAME --element ROLE:NAME  Click by element
+  click         --app NAME --x N --y N          Click by coordinates
+  type          --text TEXT          Type text in focused field
+  get-text      --app NAME           Extract all text from app
+  scroll        --app NAME [--direction up|down] [--amount N]
+  focus         --app NAME           Bring app to foreground
+  screenshot    [--app NAME] [--output PATH]
+  applescript   --code 'CODE'        Run custom AppleScript
+  applescript   --preset NAME --app NAME [--menu M --item I] [--path P]
+  check-access                       Check Accessibility permission
+  chrome-connect [--port N]          Connect to Chrome CDP
+  chrome-tabs    [--port N]          List Chrome tabs
+  chrome-eval    [--port N] [--tab N] --code 'JS'  Evaluate JS in tab
+USAGE
+  exit 1
+fi
+
+# -----------------------------------------------------------------------------
+# Dispatch
+# -----------------------------------------------------------------------------
+case "$SUBCOMMAND" in
+  list-apps)
+    log_action "list-apps"
+    list_apps
+    ;;
+
+  app-info)
+    [ -z "$APP_NAME" ] && { echo '{"error":"Missing --app parameter"}' >&2; exit 1; }
+    log_action "app-info app=$APP_NAME"
+    app_info "$APP_NAME"
+    ;;
+
+  ui-tree)
+    [ -z "$APP_NAME" ] && { echo '{"error":"Missing --app parameter"}' >&2; exit 1; }
+    log_action "ui-tree app=$APP_NAME depth=${DEPTH:-8}"
+    ui_tree "$APP_NAME" "${DEPTH:-8}"
+    ;;
+
+  click)
+    [ -z "$APP_NAME" ] && { echo '{"error":"Missing --app parameter"}' >&2; exit 1; }
+    log_action "click app=$APP_NAME element=${ELEMENT:-} x=${X_COORD:-} y=${Y_COORD:-}"
+    click_element "$APP_NAME" "$ELEMENT" "$X_COORD" "$Y_COORD"
+    ;;
+
+  type)
+    [ -z "$TEXT" ] && { echo '{"error":"Missing --text parameter"}' >&2; exit 1; }
+    log_action "type chars=${#TEXT}"
+    type_text "$TEXT"
+    ;;
+
+  get-text)
+    [ -z "$APP_NAME" ] && { echo '{"error":"Missing --app parameter"}' >&2; exit 1; }
+    log_action "get-text app=$APP_NAME depth=${DEPTH:-25}"
+    get_text "$APP_NAME" "${DEPTH:-25}"
+    ;;
+
+  scroll)
+    log_action "scroll app=${APP_NAME:-focused} direction=${DIRECTION:-down} amount=${AMOUNT:-3}"
+    scroll_app "${DIRECTION:-down}" "${AMOUNT:-3}" "$APP_NAME"
+    ;;
+
+  focus)
+    [ -z "$APP_NAME" ] && { echo '{"error":"Missing --app parameter"}' >&2; exit 1; }
+    log_action "focus app=$APP_NAME"
+    focus_app "$APP_NAME"
+    ;;
+
+  screenshot)
+    log_action "screenshot app=${APP_NAME:-full-screen} output=${OUTPUT:-/tmp/screenshot.png}"
+    take_screenshot "${OUTPUT:-/tmp/screenshot.png}" "$APP_NAME"
+    ;;
+
+  applescript)
+    if [ -n "$PRESET" ]; then
+      log_action "applescript preset=$PRESET app=${APP_NAME:-} menu=${MENU:-} item=${ITEM:-} path=${FILE_PATH:-}"
+      case "$PRESET" in
+        activate-app)   run_preset "activate-app" "$APP_NAME" ;;
+        get-window-list) run_preset "get-window-list" "$APP_NAME" ;;
+        click-menu-item) run_preset "click-menu-item" "$APP_NAME" "$MENU" "$ITEM" ;;
+        open-file)       run_preset "open-file" "$FILE_PATH" ;;
+        get-clipboard)   run_preset "get-clipboard" ;;
+        set-clipboard)   run_preset "set-clipboard" "$TEXT" ;;
+        *)              echo '{"error":"Unknown preset: '"$PRESET"'"}' >&2; exit 1 ;;
+      esac
+    elif [ -n "$CODE" ]; then
+      log_action "applescript custom-code"
+      run_applescript "$CODE"
+    else
+      echo '{"error":"Missing --code or --preset parameter"}' >&2
+      exit 1
+    fi
+    ;;
+
+  check-access)
+    log_action "check-access"
+    do_check_access
+    ;;
+
+  chrome-connect)
+    log_action "chrome-connect port=${PORT:-9222}"
+    chrome_connect "${PORT:-9222}"
+    ;;
+
+  chrome-tabs)
+    log_action "chrome-tabs port=${PORT:-9222}"
+    chrome_tabs "${PORT:-9222}"
+    ;;
+
+  chrome-eval)
+    [ -z "$CODE" ] && { echo '{"error":"Missing --code parameter"}' >&2; exit 1; }
+    log_action "chrome-eval port=${PORT:-9222} tab=${TAB:-0}"
+    chrome_eval "${PORT:-9222}" "${TAB:-0}" "$CODE"
+    ;;
+
+  *)
+    echo "{\"error\":\"Unknown subcommand: $SUBCOMMAND\"}" >&2
+    exit 1
+    ;;
+esac

package/config/skills/agent/computer-use/instructions.md

@@ -0,0 +1,103 @@
+# Agent Browser — Universal Desktop Control
+
+Control any macOS application through three integrated methods: AppleScript/JXA, Accessibility API, and Playwright CDP.
+
+## Quick Reference
+
+```bash
+# List all controllable apps with available methods
+bash execute.sh list-apps
+
+# Get app info with UI element tree
+bash execute.sh app-info --app 'Google Chrome'
+
+# Read UI tree of an app (Accessibility API)
+bash execute.sh ui-tree --app 'Finder' --depth 5
+
+# Click a UI element by role:name
+bash execute.sh click --app 'Finder' --element 'button:New Folder'
+
+# Click at coordinates
+bash execute.sh click --app 'Finder' --x 500 --y 300
+
+# Type text in focused app
+bash execute.sh type --text 'Hello World'
+
+# Screenshot an app window
+bash execute.sh screenshot --app 'Notion' --output /tmp/notion.png
+
+# Screenshot full screen
+bash execute.sh screenshot --output /tmp/screen.png
+
+# Run custom AppleScript
+bash execute.sh applescript --code 'tell application "Finder" to get name of every window'
+
+# Run common AppleScript presets
+bash execute.sh applescript --preset activate-app --app 'Safari'
+bash execute.sh applescript --preset get-window-list --app 'Finder'
+bash execute.sh applescript --preset click-menu-item --app 'Safari' --menu 'File' --item 'New Window'
+bash execute.sh applescript --preset open-file --path '/Users/me/doc.txt'
+
+# Extract all text from an app
+bash execute.sh get-text --app 'Notes'
+
+# Scroll in an app
+bash execute.sh scroll --app 'Safari' --direction down --amount 5
+
+# Focus (activate) an app
+bash execute.sh focus --app 'Terminal'
+
+# Check accessibility permission
+bash execute.sh check-access
+
+# Connect to Chrome via CDP
+bash execute.sh chrome-connect --port 9222
+
+# Chrome: list tabs
+bash execute.sh chrome-tabs --port 9222
+
+# Chrome: run JS in a tab
+bash execute.sh chrome-eval --port 9222 --tab 0 --code 'document.title'
+```
+
+## Control Methods
+
+### Layer 1: App Discovery
+- `list-apps` — Lists all foreground apps with bundle IDs and available control methods
+- `app-info` — Gets detailed info: windows, UI elements, controllability
+
+### Layer 2: AppleScript/JXA (native macOS apps)
+- `applescript` — Run custom AppleScript or use presets
+- Presets: `activate-app`, `get-window-list`, `click-menu-item`, `open-file`, `get-clipboard`, `set-clipboard`
+- Works with: Finder, Terminal, Safari, Mail, Calendar, Notes, Sublime Text, etc.
+
+### Layer 3: Accessibility API (universal)
+- `ui-tree` — Read any app's UI element tree (roles, titles, values, positions)
+- `click` — Click elements by role:name or coordinates
+- `type` — Type text in the focused field
+- `get-text` — Extract all visible text from an app
+- `scroll` — Scroll within an app
+- `focus` — Bring an app to the foreground
+- `screenshot` — Capture app window or full screen
+- Requires: System Settings > Privacy & Security > Accessibility permission
+
+### Layer 4: Playwright CDP (Chrome web apps)
+- `chrome-connect` — Connect to Chrome via Chrome DevTools Protocol
+- `chrome-tabs` — List open Chrome tabs
+- `chrome-eval` — Run JavaScript in a Chrome tab
+- Requires: Chrome launched with `--remote-debugging-port=9222`
+
+## Safety Rules
+
+1. NEVER close or kill apps without explicit user permission
+2. NEVER interact with password fields or sensitive data
+3. Always screenshot BEFORE and AFTER any action for audit trail
+4. All actions logged to `~/.crewly/logs/computer-use.log`
+5. iPad apps: READ ONLY via Accessibility — never killall, never force-quit
+
+## Requirements
+
+- macOS (Apple Silicon or Intel)
+- `jq` for JSON parsing
+- Accessibility permission for UI reading/interaction
+- Chrome with `--remote-debugging-port` for CDP features