crewly 1.1.2 → 1.2.0

package/config/skills/agent/trend-monitor/instructions.md

@@ -0,0 +1,207 @@
+# Trend Monitor
+
+Monitor trending topics across platforms using browser automation, then store and query them for content planning.
+
+## Architecture
+
+This skill has two parts:
+1. **Browser scanning** (agent-driven) — You use Playwright MCP or Chrome browser tools to visit pages and extract trends
+2. **Data management** (execute.sh) — Save, query, and get suggestions from stored trend data
+
+## Data Actions (execute.sh)
+
+### `save` — Store trends from a browser scan
+
+| Parameter | Required | Description |
+|-----------|----------|-------------|
+| `action` | Yes | `"save"` |
+| `source` | Yes | `x-trending`, `google-trends`, `hackernews`, `producthunt`, `reddit`, `github-trending`, `custom` |
+| `trends` | Yes | JSON array of trend objects (see schema below) |
+| `projectPath` | No | Project path for storage location |
+
+**Trend object schema:**
+```json
+{
+  "title": "Topic or headline",
+  "url": "https://source-url",
+  "description": "Brief description",
+  "engagement": "500 points / 200 comments",
+  "relevanceScore": 8,
+  "tags": ["ai", "agents", "automation"]
+}
+```
+
+`relevanceScore` (1-10): How relevant to AI Agent / Crewly content. Score guide:
+- 9-10: Directly about AI agents, orchestration, multi-agent systems
+- 7-8: About AI tools, LLMs, automation, developer tooling
+- 5-6: About SaaS, startups, productivity, SMB
+- 3-4: General tech, not directly relevant
+- 1-2: Not relevant
+
+### `list` — List available trend scan files
+
+| Parameter | Required | Description |
+|-----------|----------|-------------|
+| `action` | Yes | `"list"` |
+| `source` | No | Filter by source |
+| `date` | No | Filter by date (YYYY-MM-DD) |
+| `limit` | No | Max files to return (default: 10) |
+
+### `latest` — Get the most recent trends
+
+| Parameter | Required | Description |
+|-----------|----------|-------------|
+| `action` | Yes | `"latest"` |
+| `source` | No | Filter by source |
+| `limit` | No | Max items (default: 20) |
+
+### `suggest` — Get AI-filtered topic suggestions
+
+| Parameter | Required | Description |
+|-----------|----------|-------------|
+| `action` | Yes | `"suggest"` |
+| `line` | No | Content line: `crewly` or `personal` (default: crewly) |
+| `limit` | No | Max suggestions (default: 5) |
+
+## Browser Scanning Guide
+
+### Step-by-step: How to scan each source
+
+The agent should perform these browser operations, then pass the extracted data to `execute.sh save`.
+
+---
+
+### Source 1: Hacker News (hackernews)
+
+**URL:** `https://news.ycombinator.com`
+
+**Steps:**
+1. Navigate to `https://news.ycombinator.com`
+2. Take a snapshot of the page
+3. Extract from each story row:
+   - Title text
+   - URL (href from titleline link)
+   - Points and comment count (from subline)
+4. Score relevance (AI/agent/automation related = high score)
+5. Save top 20 stories
+
+**Alternative (faster):** Use WebSearch with query `site:news.ycombinator.com AI agents` for targeted results.
+
+**Example save:**
+```bash
+bash execute.sh '{"action":"save","source":"hackernews","projectPath":"/path/to/project","trends":[
+  {"title":"Show HN: Open-source AI agent framework","url":"https://news.ycombinator.com/item?id=123","engagement":"342 points, 89 comments","relevanceScore":9,"tags":["ai","agents","open-source"]},
+  {"title":"Why we moved from n8n to custom orchestration","url":"https://example.com/post","engagement":"156 points, 43 comments","relevanceScore":8,"tags":["automation","n8n","orchestration"]}
+]}'
+```
+
+---
+
+### Source 2: X/Twitter Trending (x-trending)
+
+**URL:** `https://x.com/explore/tabs/trending`
+
+**Steps:**
+1. Navigate to `https://x.com/explore/tabs/trending` (or `https://x.com/explore`)
+2. Take a snapshot
+3. Extract trending topics and hashtags
+4. For each trend, note:
+   - Topic name / hashtag
+   - Tweet count or category if shown
+   - Brief context if available
+5. Score relevance to AI/tech/startup
+
+**Alternative:** Use WebSearch with `site:x.com trending AI agents` or check `https://trends24.in/united-states/`
+
+---
+
+### Source 3: Product Hunt (producthunt)
+
+**URL:** `https://www.producthunt.com`
+
+**Steps:**
+1. Navigate to `https://www.producthunt.com`
+2. Take a snapshot of today's launches
+3. Extract from each product:
+   - Product name and tagline
+   - Upvote count
+   - URL
+   - Category/tags
+4. Filter for AI/automation/developer tools
+5. Score relevance
+
+---
+
+### Source 4: Google Trends (google-trends)
+
+**URL:** `https://trends.google.com/trending?geo=US`
+
+**Steps:**
+1. Navigate to `https://trends.google.com/trending?geo=US`
+2. Take a snapshot
+3. Extract daily trending searches
+4. Filter for tech/AI related terms
+5. Score relevance
+
+**Alternative:** Use WebSearch with `Google Trends AI agents 2026` for curated results.
+
+---
+
+### Source 5: Reddit (reddit)
+
+**URLs:**
+- `https://www.reddit.com/r/artificial/hot/`
+- `https://www.reddit.com/r/LocalLLaMA/hot/`
+- `https://www.reddit.com/r/SideProject/hot/`
+
+**Steps:**
+1. Navigate to each subreddit
+2. Extract top 10 posts: title, score, comment count, URL
+3. Score relevance
+
+---
+
+### Source 6: GitHub Trending (github-trending)
+
+**URL:** `https://github.com/trending`
+
+**Steps:**
+1. Navigate to `https://github.com/trending`
+2. Extract: repo name, description, stars today, language
+3. Filter for AI/agent/automation repos
+4. Score relevance
+
+---
+
+## Recommended Scan Schedule
+
+| Time | Source | Frequency |
+|------|--------|-----------|
+| Morning | Hacker News + Product Hunt | Daily |
+| Afternoon | X Trending + Reddit | Daily |
+| Weekly | Google Trends + GitHub Trending | Monday |
+
+## Workflow Integration
+
+```
+1. Agent runs browser scans → saves via execute.sh save
+2. Agent calls execute.sh suggest → gets AI-filtered topics
+3. Agent feeds suggestions to content-writer skill
+4. Agent adds chosen topics to content-calendar
+```
+
+## Example: Full Daily Scan
+
+```bash
+# After scanning HN via browser and extracting data:
+bash execute.sh '{"action":"save","source":"hackernews","projectPath":"/path","trends":[...]}'
+
+# After scanning PH via browser:
+bash execute.sh '{"action":"save","source":"producthunt","projectPath":"/path","trends":[...]}'
+
+# Get suggestions for content:
+bash execute.sh '{"action":"suggest","line":"crewly","projectPath":"/path"}'
+
+# Check latest across all sources:
+bash execute.sh '{"action":"latest","limit":"10","projectPath":"/path"}'
+```

package/config/skills/agent/trend-monitor/skill.json

@@ -0,0 +1,22 @@
+{
+  "id": "trend-monitor",
+  "name": "Trend Monitor",
+  "description": "Monitor and store trending topics from X, Google Trends, Hacker News, Product Hunt, Reddit, and GitHub. Save browser-extracted trends, query latest data, and get AI-filtered topic suggestions for content planning.",
+  "category": "content",
+  "skillType": "claude-skill",
+  "promptFile": "instructions.md",
+  "execution": {
+    "type": "script",
+    "script": {
+      "file": "execute.sh",
+      "interpreter": "bash",
+      "timeoutMs": 15000
+    }
+  },
+  "assignableRoles": ["content-strategist", "product-manager", "generalist"],
+  "triggers": ["trending topics", "what is trending", "trend monitor", "hot topics", "content ideas", "topic suggestions"],
+  "tags": ["trends", "monitoring", "content", "social-media", "hackernews", "producthunt", "x-twitter", "marketing"],
+  "version": "1.0.0",
+  "author": "Luna (Content Strategist)",
+  "license": "MIT"
+}

package/config/skills/agent/vnc-browser/execute.sh

@@ -0,0 +1,261 @@
+#!/bin/bash
+# VNC Remote Browser Access — bridge macOS Screen Sharing to a public URL via noVNC
+# Allows remote viewing/control of the Mac desktop (and any browser on it) via a web URL.
+#
+# Architecture:
+#   macOS Screen Sharing (built-in VNC server on port 5900)
+#   → websockify (WebSocket bridge + noVNC web server, port 6080)
+#   → cloudflared (Quick Tunnel → public HTTPS URL)
+#
+# Prerequisites: macOS Screen Sharing must be enabled manually in System Settings.
+#
+# Usage: execute.sh '{"action":"start|stop|status|get-url"}'
+set -euo pipefail
+SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
+source "${SCRIPT_DIR}/../../_common/lib.sh"
+
+# ---------------------------------------------------------------------------
+# Configuration
+# ---------------------------------------------------------------------------
+VNC_PORT=5900
+NOVNC_PORT=6080
+PID_DIR="${HOME}/.crewly/vnc"
+NOVNC_DIR="${HOME}/.crewly/novnc"
+CLOUDFLARED_LOG="${PID_DIR}/cloudflared.log"
+
+INPUT="${1:-}"
+[ -z "$INPUT" ] && error_exit "Usage: execute.sh '{\"action\":\"start|stop|status|get-url\"}'"
+
+ACTION=$(echo "$INPUT" | jq -r '.action // empty')
+require_param "action" "$ACTION"
+
+mkdir -p "$PID_DIR"
+
+# ---------------------------------------------------------------------------
+# Dependency installation (macOS / Homebrew)
+# ---------------------------------------------------------------------------
+install_deps() {
+  local missing=()
+
+  # websockify — WebSocket-to-TCP bridge (Python)
+  if ! command -v websockify &>/dev/null; then
+    missing+=("websockify")
+    echo '{"status":"installing","dep":"websockify"}' >&2
+    pip3 install websockify 2>/dev/null \
+      || error_exit "Failed to install websockify. Run: pip3 install websockify"
+  fi
+
+  # noVNC — HTML5 VNC client
+  if ! [ -d "$NOVNC_DIR" ] || ! [ -f "$NOVNC_DIR/vnc.html" ]; then
+    missing+=("novnc")
+    echo '{"status":"installing","dep":"novnc"}' >&2
+    local novnc_version="1.5.0"
+    local novnc_url="https://github.com/novnc/noVNC/archive/refs/tags/v${novnc_version}.tar.gz"
+    mkdir -p "$NOVNC_DIR"
+    curl -sL "$novnc_url" | tar -xz -C "$NOVNC_DIR" --strip-components=1
+    if ! [ -f "$NOVNC_DIR/vnc.html" ]; then
+      rm -rf "$NOVNC_DIR"
+      error_exit "Failed to download noVNC web client"
+    fi
+  fi
+
+  # cloudflared — Cloudflare Tunnel for public HTTPS URL
+  if ! command -v cloudflared &>/dev/null; then
+    missing+=("cloudflared")
+    echo '{"status":"installing","dep":"cloudflared"}' >&2
+    brew install cloudflare/cloudflare/cloudflared 2>/dev/null \
+      || error_exit "Failed to install cloudflared. Run: brew install cloudflare/cloudflare/cloudflared"
+  fi
+
+  if [ ${#missing[@]} -gt 0 ]; then
+    echo '{"status":"deps_installed","installed":"'"$(IFS=,; echo "${missing[*]}")"'"}' >&2
+  fi
+}
+
+# ---------------------------------------------------------------------------
+# Helper: check if a service is running via its PID file
+# ---------------------------------------------------------------------------
+is_running() {
+  local pid_file="$PID_DIR/${1}.pid"
+  [ -f "$pid_file" ] && kill -0 "$(cat "$pid_file")" 2>/dev/null
+}
+
+# ---------------------------------------------------------------------------
+# Helper: check if macOS Screen Sharing VNC is listening on port 5900
+# ---------------------------------------------------------------------------
+check_screen_sharing() {
+  nc -z localhost "$VNC_PORT" 2>/dev/null
+}
+
+# ---------------------------------------------------------------------------
+# start — Launch websockify + cloudflared (requires Screen Sharing on)
+# ---------------------------------------------------------------------------
+start_vnc() {
+  # Already running?
+  if is_running websockify && is_running cloudflared; then
+    local url=""
+    [ -f "$PID_DIR/tunnel_url.txt" ] && url=$(cat "$PID_DIR/tunnel_url.txt")
+    jq -n --arg url "$url" \
+      '{success: true, status: "already_running", publicUrl: (if $url != "" then ($url + "/vnc.html?autoconnect=true") else null end), localUrl: ("http://localhost:'"$NOVNC_PORT"'/vnc.html?autoconnect=true")}'
+    return 0
+  fi
+
+  # Check macOS Screen Sharing is enabled
+  if ! check_screen_sharing; then
+    error_exit "macOS Screen Sharing is not running (port $VNC_PORT not listening). Enable it: System Settings → General → Sharing → Screen Sharing → ON"
+  fi
+
+  # Install missing dependencies
+  install_deps
+
+  # 1. Start websockify (WebSocket bridge + noVNC web server)
+  #    Bridges noVNC web client (port 6080) to macOS VNC (port 5900)
+  websockify --web "$NOVNC_DIR" "$NOVNC_PORT" "localhost:$VNC_PORT" \
+    > "$PID_DIR/websockify.log" 2>&1 &
+  echo $! > "$PID_DIR/websockify.pid"
+  sleep 1
+
+  if ! is_running websockify; then
+    error_exit "websockify failed to start. Check $PID_DIR/websockify.log"
+  fi
+
+  # 2. Start cloudflared Quick Tunnel (zero-config public URL)
+  cloudflared tunnel --url "http://localhost:$NOVNC_PORT" \
+    > "$CLOUDFLARED_LOG" 2>&1 &
+  echo $! > "$PID_DIR/cloudflared.pid"
+
+  # Wait for cloudflared to print the tunnel URL (up to 30s)
+  local url=""
+  for _ in $(seq 1 30); do
+    url=$(grep -oE 'https://[a-z0-9-]+\.trycloudflare\.com' "$CLOUDFLARED_LOG" 2>/dev/null | head -1 || true)
+    [ -n "$url" ] && break
+    sleep 1
+  done
+
+  if [ -n "$url" ]; then
+    echo "$url" > "$PID_DIR/tunnel_url.txt"
+    jq -n --arg url "$url" \
+      '{success: true, status: "started", publicUrl: ($url + "/vnc.html?autoconnect=true"), localUrl: ("http://localhost:'"$NOVNC_PORT"'/vnc.html?autoconnect=true"), hint: "Share the publicUrl with the user. They will see the Mac desktop and can interact with the browser."}'
+  else
+    jq -n \
+      '{success: true, status: "started_no_tunnel", publicUrl: null, localUrl: ("http://localhost:'"$NOVNC_PORT"'/vnc.html?autoconnect=true"), hint: "Cloudflared URL not ready yet. Use get-url action to retrieve it later."}'
+  fi
+}
+
+# ---------------------------------------------------------------------------
+# stop — Tear down websockify + cloudflared (does NOT touch Screen Sharing)
+# ---------------------------------------------------------------------------
+stop_vnc() {
+  local stopped=0
+
+  for service in cloudflared websockify; do
+    local pid_file="$PID_DIR/${service}.pid"
+    if [ -f "$pid_file" ]; then
+      local pid
+      pid=$(cat "$pid_file")
+      if kill -0 "$pid" 2>/dev/null; then
+        kill "$pid" 2>/dev/null || true
+        stopped=$((stopped + 1))
+      fi
+      rm -f "$pid_file"
+    fi
+  done
+
+  rm -f "$PID_DIR/tunnel_url.txt"
+
+  jq -n --argjson stopped "$stopped" \
+    '{success: true, status: "stopped", stoppedServices: $stopped, note: "macOS Screen Sharing was not touched"}'
+}
+
+# ---------------------------------------------------------------------------
+# status — Check which services are running
+# ---------------------------------------------------------------------------
+status_vnc() {
+  local services='[]'
+  local all_running=true
+
+  # Check macOS Screen Sharing (port 5900)
+  local screen_sharing=false
+  if check_screen_sharing; then
+    screen_sharing=true
+  else
+    all_running=false
+  fi
+  services=$(echo "$services" | jq \
+    --arg name "screen-sharing" \
+    --argjson running "$screen_sharing" \
+    --arg pid "system" \
+    '. + [{name: $name, running: $running, pid: $pid}]')
+
+  # Check managed services
+  for service in websockify cloudflared; do
+    local pid_file="$PID_DIR/${service}.pid"
+    local running=false
+    local pid=""
+
+    if [ -f "$pid_file" ]; then
+      pid=$(cat "$pid_file")
+      if kill -0 "$pid" 2>/dev/null; then
+        running=true
+      fi
+    fi
+
+    [ "$running" = false ] && all_running=false
+
+    services=$(echo "$services" | jq \
+      --arg name "$service" \
+      --argjson running "$running" \
+      --arg pid "$pid" \
+      '. + [{name: $name, running: $running, pid: $pid}]')
+  done
+
+  local url=""
+  [ -f "$PID_DIR/tunnel_url.txt" ] && url=$(cat "$PID_DIR/tunnel_url.txt")
+
+  jq -n \
+    --argjson allRunning "$all_running" \
+    --argjson services "$services" \
+    --arg publicUrl "${url:-}" \
+    '{success: true, allRunning: $allRunning, publicUrl: (if $publicUrl != "" then ($publicUrl + "/vnc.html?autoconnect=true") else null end), services: $services}'
+}
+
+# ---------------------------------------------------------------------------
+# get-url — Retrieve the public tunnel URL
+# ---------------------------------------------------------------------------
+get_url() {
+  # Try saved URL
+  if [ -f "$PID_DIR/tunnel_url.txt" ]; then
+    local url
+    url=$(cat "$PID_DIR/tunnel_url.txt")
+    if [ -n "$url" ]; then
+      jq -n --arg url "$url" \
+        '{success: true, publicUrl: ($url + "/vnc.html?autoconnect=true"), localUrl: ("http://localhost:'"$NOVNC_PORT"'/vnc.html?autoconnect=true")}'
+      return 0
+    fi
+  fi
+
+  # Try parsing from cloudflared log
+  if [ -f "$CLOUDFLARED_LOG" ]; then
+    local url
+    url=$(grep -oE 'https://[a-z0-9-]+\.trycloudflare\.com' "$CLOUDFLARED_LOG" 2>/dev/null | head -1 || true)
+    if [ -n "$url" ]; then
+      echo "$url" > "$PID_DIR/tunnel_url.txt"
+      jq -n --arg url "$url" \
+        '{success: true, publicUrl: ($url + "/vnc.html?autoconnect=true"), localUrl: ("http://localhost:'"$NOVNC_PORT"'/vnc.html?autoconnect=true")}'
+      return 0
+    fi
+  fi
+
+  error_exit "No tunnel URL available. Is VNC started? Try: execute.sh '{\"action\":\"start\"}'"
+}
+
+# ---------------------------------------------------------------------------
+# Dispatch
+# ---------------------------------------------------------------------------
+case "$ACTION" in
+  start)   start_vnc ;;
+  stop)    stop_vnc ;;
+  status)  status_vnc ;;
+  get-url) get_url ;;
+  *)       error_exit "Unknown action: $ACTION. Valid actions: start, stop, status, get-url" ;;
+esac

package/config/skills/agent/vnc-browser/instructions.md

@@ -0,0 +1,102 @@
+# VNC Remote Browser Access
+
+Bridge macOS Screen Sharing to a public HTTPS URL via noVNC + cloudflared. This lets humans remotely view and control the Mac desktop (and any browser on it) from anywhere — essential when Playwright hits a login page, CAPTCHA, or 2FA prompt.
+
+The stack: **macOS Screen Sharing** (built-in VNC, port 5900) → **websockify + noVNC** (web client, port 6080) → **cloudflared** (public HTTPS tunnel).
+
+## Prerequisites
+
+**macOS Screen Sharing must be enabled manually** before using this skill:
+
+1. Open **System Settings** → **General** → **Sharing**
+2. Turn on **Screen Sharing**
+3. (Optional) Set a VNC password under Screen Sharing options
+
+This only needs to be done once. Screen Sharing runs as a system service and persists across reboots.
+
+## When to Use
+
+- Playwright hits a login page that requires human credentials
+- A website shows a CAPTCHA or anti-bot challenge
+- Two-factor authentication (2FA/MFA) requires a code from the user
+- You need the user to visually verify something in the browser
+- Any browser automation step that needs human-in-the-loop interaction
+
+## Parameters
+
+| Parameter | Required | Description |
+|-----------|----------|-------------|
+| `action`  | Yes      | One of: `start`, `stop`, `status`, `get-url` |
+
+### Actions
+
+- **start** — Check Screen Sharing is on, install deps if needed, launch websockify + noVNC + cloudflared. Returns the public URL.
+- **stop** — Shut down websockify + cloudflared. Does NOT touch Screen Sharing.
+- **status** — Check Screen Sharing (port 5900), websockify, and cloudflared status.
+- **get-url** — Retrieve the cloudflared public URL.
+
+## Examples
+
+### Start and get the public URL
+
+```bash
+bash config/skills/agent/vnc-browser/execute.sh '{"action":"start"}'
+```
+
+Output:
+```json
+{
+  "success": true,
+  "status": "started",
+  "publicUrl": "https://abc-xyz.trycloudflare.com/vnc.html?autoconnect=true",
+  "localUrl": "http://localhost:6080/vnc.html?autoconnect=true",
+  "hint": "Share the publicUrl with the user..."
+}
+```
+
+### Send the URL to the user via Slack
+
+```bash
+URL=$(bash config/skills/agent/vnc-browser/execute.sh '{"action":"get-url"}' | jq -r '.publicUrl')
+# Then send via reply-slack or report-status
+```
+
+### Check status
+
+```bash
+bash config/skills/agent/vnc-browser/execute.sh '{"action":"status"}'
+```
+
+### Stop when done
+
+```bash
+bash config/skills/agent/vnc-browser/execute.sh '{"action":"stop"}'
+```
+
+## Workflow
+
+1. **Ensure Screen Sharing is on** (one-time setup)
+2. **Start VNC bridge** → get the public URL
+3. **Launch Playwright** in headful mode (the browser appears on the Mac desktop)
+4. **Navigate** to the page requiring human interaction
+5. **Send the public URL** to the user via Slack
+6. **Wait** for the user to complete the manual step (login, CAPTCHA, etc.)
+7. **Continue automation** once the browser is past the manual step
+8. **Stop VNC bridge** when no longer needed
+
+## Technical Details
+
+- **VNC source**: macOS Screen Sharing on port 5900 (system-managed)
+- **Web client**: noVNC on port 6080 via websockify
+- **Public tunnel**: cloudflared Quick Tunnel (random `*.trycloudflare.com` subdomain)
+- **Security**: Screen Sharing requires macOS user credentials; cloudflared provides HTTPS
+- **Dependencies**: websockify (pip), noVNC (GitHub release), cloudflared (Homebrew) — auto-installed on first run
+- **PID files**: `~/.crewly/vnc/` for websockify and cloudflared lifecycle
+- **Note**: This skill does NOT start or stop macOS Screen Sharing — that is user-managed
+
+## Requirements
+
+- macOS with Screen Sharing enabled
+- Homebrew installed
+- Python 3 with pip (for websockify)
+- Internet access (for cloudflared tunnel and dependency installation)

package/config/skills/agent/vnc-browser/skill.json

@@ -0,0 +1,20 @@
+{
+  "id": "agent-vnc-browser",
+  "name": "VNC Remote Browser Access",
+  "description": "Launch a virtual display with VNC + noVNC + cloudflared for remote browser viewing and control. Enables human-in-the-loop login/verification when Playwright needs manual interaction.",
+  "category": "browser",
+  "skillType": "claude-skill",
+  "promptFile": "instructions.md",
+  "execution": {
+    "type": "script",
+    "script": {
+      "file": "execute.sh",
+      "interpreter": "bash",
+      "timeoutMs": 60000
+    }
+  },
+  "assignableRoles": ["developer", "qa", "qa-engineer", "fullstack-dev", "backend-developer", "frontend-developer", "generalist"],
+  "triggers": ["vnc", "remote browser", "browser login", "manual login", "human verification", "captcha", "2fa", "playwright headful"],
+  "tags": ["vnc", "browser", "remote-access", "playwright", "noVNC", "cloudflared"],
+  "version": "1.0.0"
+}