@harness.farm/social-cli 0.1.0 → 0.1.2

package/README.md

@@ -0,0 +1,213 @@
+# social-cli
+
+基于 Chrome DevTools Protocol (CDP) 的社交媒体自动化 CLI，支持 X（推特）、小红书、抖音、B站，无需安装浏览器插件或 Playwright，直接连接你已有的 Chrome。
+
+## 工作原理
+
+```
+Chrome (--remote-debugging-port=9222)
+        ↕ WebSocket / CDP
+social-cli
+  ├── adapters/<platform>.yaml   ← YAML 适配器（优先）
+  └── src/adapters/<platform>.ts ← TypeScript 适配器（兜底）
+```
+
+- **YAML 适配器**：声明式步骤描述，易于阅读和修改，无需编译
+- **TypeScript 适配器**：适合复杂逻辑，编译后运行
+- **登录状态管理**：首次运行时引导登录，自动保存 session cookie，后续免登录
+
+## 快速开始
+
+### 1. 启动 Chrome（开启远程调试）
+
+```bash
+# macOS
+/Applications/Google\ Chrome.app/Contents/MacOS/Google\ Chrome \
+  --remote-debugging-port=9222 \
+  --user-data-dir=$HOME/.cdp-scraper/chrome-profile
+
+# Windows
+chrome.exe --remote-debugging-port=9222 --user-data-dir=%USERPROFILE%\.cdp-scraper\chrome-profile
+
+# Linux
+google-chrome --remote-debugging-port=9222 --user-data-dir=~/.cdp-scraper/chrome-profile
+```
+
+### 2. 安装依赖
+
+```bash
+npm install
+```
+
+### 3. 运行命令
+
+```bash
+# 开发模式（tsx，无需编译）
+tsx src/cli.ts <platform> <command> [args...]
+
+# 或使用 package.json 快捷脚本
+npm run xhs -- search 法律ai
+npm run x   -- search "claude ai"
+```
+
+## 支持的平台和命令
+
+### X（推特）
+
+| 命令 | 参数 | 说明 |
+|------|------|------|
+| `search` | `keyword` | 搜索推文 |
+| `like` | `url` | 点赞 / 取消点赞 |
+| `reply` | `url text` | 回复推文 |
+| `post` | `text` | 发推 |
+| `retweet` | `url` | 转推 |
+
+```bash
+tsx src/cli.ts x search "claude ai"
+tsx src/cli.ts x like "https://x.com/user/status/123"
+tsx src/cli.ts x reply "https://x.com/user/status/123" "很有意思！"
+tsx src/cli.ts x post "Hello from social-cli!"
+tsx src/cli.ts x retweet "https://x.com/user/status/123"
+```
+
+### 小红书（xhs / xiaohongshu）
+
+| 命令 | 参数 | 说明 |
+|------|------|------|
+| `search` | `keyword` | 搜索笔记 |
+| `hot` | — | 获取首页热门笔记 |
+| `like` | `url` | 点赞 / 取消点赞 |
+| `comment` | `url text` | 发表评论 |
+| `post` | `title content` | 发布图文笔记 |
+
+```bash
+tsx src/cli.ts xhs search 法律ai
+tsx src/cli.ts xhs hot
+tsx src/cli.ts xhs like "https://www.xiaohongshu.com/explore/..."
+tsx src/cli.ts xhs comment "https://..." "太棒了！"
+tsx src/cli.ts xhs post --title "我的标题" --content "正文内容"
+```
+
+### 抖音（douyin）
+
+| 命令 | 参数 | 说明 |
+|------|------|------|
+| `search` | `keyword` | 搜索视频 |
+| `like` | `url` | 点赞（Z 键） |
+| `comment` | `url text` | 发表评论 |
+| `follow` | `url` | 关注用户 |
+| `post` | `video title desc` | 发布视频 |
+
+```bash
+tsx src/cli.ts douyin search 猫咪
+tsx src/cli.ts douyin like "https://www.douyin.com/video/..."
+tsx src/cli.ts douyin comment "https://..." "哈哈哈"
+tsx src/cli.ts douyin post /path/to/video.mp4 "标题" "描述"
+```
+
+### B站（bilibili）
+
+| 命令 | 参数 | 说明 |
+|------|------|------|
+| `search` | `keyword` | 搜索视频 |
+| `like` | `url` | 点赞视频 |
+| `follow` | `url` | 关注 UP 主 |
+| `comment` | `url text` | 发表评论 |
+| `reply` | `url text` | 回复第一条评论 |
+| `post` | `video title desc` | 投稿视频 |
+
+```bash
+tsx src/cli.ts bilibili search TypeScript教程
+tsx src/cli.ts bilibili like "https://www.bilibili.com/video/BV..."
+tsx src/cli.ts bilibili comment "https://..." "讲得很好！"
+tsx src/cli.ts bilibili post /path/to/video.mp4 "视频标题" "视频描述"
+```
+
+## YAML 适配器格式
+
+YAML 适配器位于 `adapters/` 目录，无需编译即可生效，支持热修改。
+
+```yaml
+platform: myplatform
+login_url: https://example.com
+login_check:
+  cookie: session_cookie_name   # 用于判断是否已登录
+
+commands:
+  search:
+    args: [keyword]             # 位置参数名
+    steps:
+      - open: "https://example.com/search?q={{keyword}}"
+      - wait: 3000
+      - extract:
+          selector: ".item"
+          fields:
+            title: ".title"
+            link:
+              selector: "a"
+              attr: href
+```
+
+### 支持的 Step 类型
+
+| Step | 说明 |
+|------|------|
+| `open: url` | 导航到 URL |
+| `wait: ms` | 等待毫秒数 |
+| `wait: { selector }` | 等待元素出现 |
+| `click: selector` | 点击元素 |
+| `click: { text: "..." }` | 按文本内容点击 |
+| `fill: { selector, value }` | 填写 input 表单 |
+| `type_rich: { selector, value }` | 输入到 contenteditable 元素 |
+| `eval: "js"` | 执行 JavaScript |
+| `capture: { name, eval }` | 执行 JS 并保存结果到变量 |
+| `extract: { selector, fields }` | 批量抓取列表数据 |
+| `return: [{ field, value }]` | 输出结果表格 |
+| `upload: { selector, file }` | 上传本地文件 |
+| `screenshot: path` | 截图保存 |
+| `key: "key"` | 模拟按键（如 `Enter`, `z`, `x`） |
+| `keyboard_insert: text` | 逐字符发送（适用于 Draft.js / React 输入框） |
+| `insert_text: text` | CDP 直接插入文本（可穿透 shadow DOM） |
+| `assert: { eval, message }` | 断言，失败则报错 |
+
+模板变量使用 `{{varName}}` 语法，也支持 JS 表达式：`{{a === 'true' ? '是' : '否'}}`
+
+## 编译发布
+
+```bash
+npm run build         # 编译 TypeScript → dist/
+```
+
+编译后可作为 `social-cli` 命令使用（需全局安装或 `npx`）。
+
+## 项目结构
+
+```
+cdp-scraper/
+├── adapters/              # YAML 适配器（运行时读取，优先生效）
+│   ├── x.yaml
+│   ├── xhs.yaml
+│   ├── xiaohongshu.yaml
+│   ├── douyin.yaml
+│   └── bilibili.yaml
+├── src/
+│   ├── cli.ts             # CLI 入口，适配器解析与路由
+│   ├── runner/
+│   │   ├── yaml-runner.ts # YAML 步骤执行引擎
+│   │   └── step-executor.ts
+│   ├── browser/
+│   │   ├── cdp.ts         # CDP WebSocket 客户端
+│   │   ├── session.ts     # Cookie session 持久化
+│   │   └── runner.ts      # TS 适配器运行器
+│   ├── adapters/          # TypeScript 适配器（兜底）
+│   │   ├── base.ts
+│   │   ├── xiaohongshu.ts
+│   │   └── index.ts
+│   └── output/
+│       └── table.ts       # 终端表格渲染
+└── package.json
+```
+
+## License
+
+MIT

package/dist/adapters/base.js

@@ -0,0 +1,2 @@
+export class Adapter {
+}

package/dist/adapters/index.js

@@ -0,0 +1,8 @@
+import { XiaohongshuAdapter } from './xiaohongshu.js';
+export const adapters = {
+    xhs: new XiaohongshuAdapter(),
+    xiaohongshu: new XiaohongshuAdapter(),
+    // twitter:   new TwitterAdapter(),
+    // bilibili:  new BilibiliAdapter(),
+    // zhihu:     new ZhihuAdapter(),
+};

package/dist/adapters/xiaohongshu.js

@@ -0,0 +1,314 @@
+/**
+ * 小红书 adapter
+ *
+ * Commands:
+ *   search <keyword>                搜索笔记
+ *   hot                             首页推荐
+ *   post --title <t> --content <c> [--images <p1,p2>]   发布图文
+ */
+import path from 'path';
+import fs from 'fs';
+import { Adapter } from './base.js';
+import { sleep } from '../browser/cdp.js';
+// ─── selectors ────────────────────────────────────────────────────────────────
+const SEL = {
+    // 搜索 / 首页
+    noteItem: '.note-item',
+    noteTitle: '.title, [class*="title"]',
+    noteAuthor: '.author .name, .nickname, [class*="author"] span',
+    noteLikes: '[class*="like"] span, .like-wrapper [class*="count"]',
+    // 发布
+    postFileInput: 'input[type=file][accept*=jpg]',
+    postTitle: 'input.d-text[placeholder*="标题"]',
+    postContent: '.tiptap.ProseMirror',
+    postSubmit: 'button:last-of-type',
+    // 笔记详情页互动
+    likeBtn: '.like-wrapper',
+    collectBtn: '.collect-wrapper',
+    commentArea: '.comment-container, .comments-container',
+    commentInput: '.content-input', // contenteditable
+    commentSubmit: '.btn-send',
+    commentPlaceholder: '说点什么...',
+};
+function parseNotes(raw) {
+    try {
+        return JSON.parse(raw);
+    }
+    catch {
+        return [];
+    }
+}
+const NOTE_COLUMNS = [
+    { key: 'index', header: '#', width: 3 },
+    { key: 'title', header: '标题', width: 36 },
+    { key: 'author', header: '作者', width: 16 },
+    { key: 'likes', header: '点赞', width: 8 },
+    { key: 'link', header: '链接', width: 48 },
+];
+const SCRAPE_NOTES = `
+(function() {
+  const r = [];
+  document.querySelectorAll('${SEL.noteItem}').forEach(el => {
+    const title  = el.querySelector('${SEL.noteTitle}')?.textContent?.trim() ?? '';
+    const author = el.querySelector('${SEL.noteAuthor}')?.textContent?.trim() ?? '';
+    const likes  = el.querySelector('${SEL.noteLikes}')?.textContent?.trim() ?? '';
+    const href   = el.querySelector('a')?.href ?? '';
+    if (title) r.push({ title, author, likes, link: href.split('?')[0] });
+  });
+  return JSON.stringify(r);
+})()`;
+// ─── post helpers ─────────────────────────────────────────────────────────────
+function parsePostArgs(args) {
+    let title = '', content = '', images = [];
+    for (let i = 0; i < args.length; i++) {
+        if (args[i] === '--title') {
+            title = args[++i] ?? '';
+            continue;
+        }
+        if (args[i] === '--content') {
+            content = args[++i] ?? '';
+            continue;
+        }
+        if (args[i] === '--images') {
+            images = (args[++i] ?? '').split(',').map(p => path.resolve(p)).filter(p => fs.existsSync(p));
+            continue;
+        }
+    }
+    return { title, content, images };
+}
+// ─── Adapter ──────────────────────────────────────────────────────────────────
+export class XiaohongshuAdapter extends Adapter {
+    platform = 'xiaohongshu';
+    loginUrl = 'https://www.xiaohongshu.com';
+    async isLoggedIn(client) {
+        const cookies = await client.getAllCookies();
+        return cookies.some(c => c.name === 'web_session');
+    }
+    commands = {
+        // ── search ────────────────────────────────────────────────────────────────
+        search: async (client, args) => {
+            const keyword = args[0];
+            if (!keyword)
+                throw new Error('用法: xhs search <关键词>');
+            const url = `https://www.xiaohongshu.com/search_result?keyword=${encodeURIComponent(keyword)}&source=web_explore_feed`;
+            await client.navigate(url, 4000);
+            const raw = await client.eval(SCRAPE_NOTES);
+            const notes = parseNotes(raw);
+            return { columns: NOTE_COLUMNS, rows: notes.map((n, i) => ({ index: i + 1, ...n })) };
+        },
+        // ── hot ───────────────────────────────────────────────────────────────────
+        hot: async (client) => {
+            await client.navigate('https://www.xiaohongshu.com/explore', 4000);
+            const raw = await client.eval(SCRAPE_NOTES);
+            const notes = parseNotes(raw);
+            return { columns: NOTE_COLUMNS, rows: notes.map((n, i) => ({ index: i + 1, ...n })) };
+        },
+        // ── like ──────────────────────────────────────────────────────────────────
+        like: async (client, args) => {
+            const url = args[0];
+            if (!url)
+                throw new Error('用法: xhs like <笔记URL>');
+            await client.navigate(url, 4000);
+            const result = await client.eval(`
+        (function() {
+          var btn = document.querySelector('.like-wrapper');
+          if (!btn) return JSON.stringify({ok: false, reason: 'like button not found'});
+          var wasLiked = btn.classList.contains('like-active');
+          btn.click();
+          var isLiked = btn.classList.contains('like-active');
+          var count = btn.querySelector('.count') ? btn.querySelector('.count').textContent.trim() : '?';
+          return JSON.stringify({ok: true, wasLiked: wasLiked, isLiked: isLiked, count: count});
+        })()
+      `);
+            const r = JSON.parse(result);
+            if (!r.ok)
+                throw new Error(r.reason ?? '点赞失败');
+            const action = r.wasLiked ? '取消点赞' : '点赞成功';
+            const status = r.isLiked ? '❤️  已点赞' : '🤍 未点赞';
+            return {
+                columns: [
+                    { key: 'field', header: '字段', width: 12 },
+                    { key: 'value', header: '值', width: 40 },
+                ],
+                rows: [
+                    { field: '操作', value: action },
+                    { field: '状态', value: status },
+                    { field: '点赞数', value: r.count },
+                    { field: '链接', value: url },
+                ],
+            };
+        },
+        // ── comment ───────────────────────────────────────────────────────────────
+        comment: async (client, args) => {
+            const url = args[0];
+            const text = args[1];
+            if (!url || !text)
+                throw new Error('用法: xhs comment <笔记URL> <评论内容>');
+            await client.navigate(url, 4000);
+            // 1. 点击「说点什么...」激活输入框
+            await client.eval(`
+        (function() {
+          var placeholder = [...document.querySelectorAll('*')].find(function(e) {
+            return e.textContent.trim() === '说点什么...' && e.children.length === 0;
+          });
+          if (placeholder) placeholder.click();
+        })()
+      `);
+            await sleep(800);
+            // 2. 写入评论内容（用 execCommand 兼容 contenteditable）
+            await client.eval(`
+        (function() {
+          var editor = document.querySelector('.content-input');
+          if (!editor) return;
+          editor.focus();
+          document.execCommand('selectAll', false, null);
+          document.execCommand('insertText', false, ${JSON.stringify(text)});
+        })()
+      `);
+            await sleep(500);
+            // 3. 验证内容已写入
+            const inputText = await client.eval(`
+        (document.querySelector('.content-input') || {}).textContent || ''
+      `);
+            console.log(`  ✏️  输入内容: "${inputText}"`);
+            // 4. 点击发送
+            const sent = await client.eval(`
+        (function() {
+          var btn = document.querySelector('.btn-send');
+          if (!btn) {
+            var btns = [...document.querySelectorAll('button')];
+            btn = btns.find(function(b) { return b.textContent.trim() === '发送'; });
+          }
+          if (btn && !btn.disabled) { btn.click(); return true; }
+          return false;
+        })()
+      `);
+            if (!sent)
+                throw new Error('发送按钮未找到或被禁用（评论内容可能为空）');
+            await sleep(1500);
+            // 5. 验证：新评论是否出现在列表里
+            const appeared = await client.eval(`
+        (function() {
+          var comments = [...document.querySelectorAll('.comment-item, [class*=comment-item]')];
+          return comments.some(function(c) { return c.textContent.includes(${JSON.stringify(text.slice(0, 10))}); });
+        })()
+      `);
+            return {
+                columns: [
+                    { key: 'field', header: '字段', width: 12 },
+                    { key: 'value', header: '值', width: 50 },
+                ],
+                rows: [
+                    { field: '状态', value: appeared ? '✅ 评论成功' : '⚠️  请在浏览器中确认' },
+                    { field: '评论内容', value: text },
+                    { field: '链接', value: url },
+                ],
+            };
+        },
+        // ── post ──────────────────────────────────────────────────────────────────
+        post: async (client, args) => {
+            const { title, content, images } = parsePostArgs(args);
+            if (!title && !content)
+                throw new Error('用法: xhs post --title <标题> --content <内容> [--images <图片路径>]');
+            // 1. 导航到发布页
+            await client.navigate('https://creator.xiaohongshu.com/publish/publish?source=official', 3000);
+            // 2. 切换到「上传图文」tab
+            await client.eval(`
+        (function() {
+          const els = [...document.querySelectorAll('*')].filter(e =>
+            e.textContent.trim() === '上传图文' && e.children.length === 0
+          );
+          if (els.length >= 2) els[1].click();
+          else if (els.length === 1) els[0].click();
+        })()
+      `);
+            await sleep(1500);
+            // 3. 上传图片（如果有）
+            if (images.length > 0) {
+                await client.uploadFiles('input[type=file][accept*=jpg]', images);
+                console.log(`  📎 上传图片: ${images.join(', ')}`);
+                await sleep(4000); // 等待图片上传完成
+            }
+            else {
+                // 没有图片时，小红书要求至少一张图，用「文字配图」模式
+                await client.eval(`
+          (function() {
+            const el = [...document.querySelectorAll('*')].find(e =>
+              e.textContent.trim() === '文字配图' && e.children.length === 0
+            );
+            if (el) el.click();
+          })()
+        `);
+                await sleep(2000);
+            }
+            // 4. 填写标题
+            if (title) {
+                await client.eval(`
+          (function() {
+            const input = document.querySelector('input.d-text[placeholder*="标题"]');
+            if (!input) return;
+            input.focus();
+            const nativeInput = Object.getOwnPropertyDescriptor(window.HTMLInputElement.prototype, 'value');
+            nativeInput.set.call(input, ${JSON.stringify(title)});
+            input.dispatchEvent(new Event('input', { bubbles: true }));
+            input.dispatchEvent(new Event('change', { bubbles: true }));
+          })()
+        `);
+                await sleep(500);
+                console.log(`  ✏️  标题: ${title}`);
+            }
+            // 5. 填写正文
+            if (content) {
+                await client.eval(`
+          (function() {
+            const editor = document.querySelector('.tiptap.ProseMirror');
+            if (!editor) return;
+            editor.focus();
+            // 清空并输入内容
+            document.execCommand('selectAll', false, null);
+            document.execCommand('insertText', false, ${JSON.stringify(content)});
+          })()
+        `);
+                await sleep(500);
+                console.log(`  📝 正文: ${content.slice(0, 50)}${content.length > 50 ? '...' : ''}`);
+            }
+            await sleep(1000);
+            // 6. 点击发布
+            const clicked = await client.eval(`
+        (function() {
+          const btns = [...document.querySelectorAll('button')];
+          const btn = btns.reverse().find(b => b.textContent.trim() === '发布');
+          if (btn && !btn.disabled) { btn.click(); return true; }
+          return false;
+        })()
+      `);
+            if (!clicked)
+                throw new Error('未找到发布按钮，或按钮不可点击（可能图片还在上传中）');
+            await sleep(2000);
+            // 7. 检查是否发布成功
+            const result = await client.eval(`
+        JSON.stringify({
+          url: location.href,
+          toast: document.querySelector('[class*=toast],[class*=message],[class*=notice]')?.textContent?.trim() ?? ''
+        })
+      `);
+            const { url, toast } = JSON.parse(result);
+            const success = url.includes('manage') || url.includes('success') || !url.includes('publish');
+            const status = success ? '✅ 发布成功' : '⚠️  请在浏览器中确认';
+            return {
+                columns: [
+                    { key: 'field', header: '字段', width: 12 },
+                    { key: 'value', header: '值', width: 60 },
+                ],
+                rows: [
+                    { field: '状态', value: status },
+                    { field: '标题', value: title || '（无）' },
+                    { field: '正文', value: content.slice(0, 60) || '（无）' },
+                    { field: '图片', value: images.length > 0 ? `${images.length} 张` : '（无）' },
+                    { field: '当前URL', value: url },
+                    { field: '提示', value: toast || '（无）' },
+                ],
+            };
+        },
+    };
+}

package/dist/browser/cdp.js

@@ -0,0 +1,106 @@
+/**
+ * CDP client — wraps a single Chrome tab via WebSocket.
+ * Handles request/response matching, navigate, eval, cookies.
+ */
+import WebSocket from 'ws';
+export class CDPClient {
+    ws;
+    pending = new Map();
+    idCounter = 0;
+    ready;
+    constructor(wsUrl) {
+        this.ws = new WebSocket(wsUrl);
+        this.ready = new Promise((resolve, reject) => {
+            this.ws.once('open', resolve);
+            this.ws.once('error', reject);
+        });
+        this.ws.on('message', (raw) => {
+            const msg = JSON.parse(raw.toString());
+            if (msg.id !== undefined) {
+                const cb = this.pending.get(msg.id);
+                if (!cb)
+                    return;
+                this.pending.delete(msg.id);
+                if (msg.error)
+                    cb.reject(new Error(msg.error.message));
+                else
+                    cb.resolve(msg.result ?? null);
+            }
+        });
+    }
+    async waitReady() {
+        await this.ready;
+    }
+    send(method, params = {}) {
+        const id = ++this.idCounter;
+        return new Promise((resolve, reject) => {
+            this.pending.set(id, { resolve: resolve, reject });
+            this.ws.send(JSON.stringify({ id, method, params }));
+        });
+    }
+    async navigate(url, waitMs = 3000) {
+        await this.send('Page.navigate', { url });
+        await sleep(waitMs);
+    }
+    async eval(expression) {
+        const res = await this.send('Runtime.evaluate', {
+            expression,
+            returnByValue: true,
+            awaitPromise: true,
+        });
+        return res.result.value;
+    }
+    async getAllCookies() {
+        const res = await this.send('Network.getAllCookies');
+        return res.cookies;
+    }
+    /** 通过 DOM.setFileInputFiles 上传本地文件到 input[type=file] */
+    async uploadFiles(selector, filePaths) {
+        await this.send('DOM.enable');
+        const doc = await this.send('DOM.getDocument', { depth: 1 });
+        const q = await this.send('DOM.querySelector', {
+            nodeId: doc.root.nodeId,
+            selector,
+        });
+        if (!q.nodeId)
+            throw new Error(`uploadFiles: selector not found: ${selector}`);
+        await this.send('DOM.setFileInputFiles', { files: filePaths, nodeId: q.nodeId });
+    }
+    async setCookies(cookies) {
+        for (const c of cookies) {
+            await this.send('Network.setCookie', {
+                name: c.name,
+                value: c.value,
+                domain: c.domain,
+                path: c.path,
+                secure: c.secure,
+                httpOnly: c.httpOnly,
+            });
+        }
+    }
+    close() {
+        this.ws.close();
+    }
+}
+export function sleep(ms) {
+    return new Promise((r) => setTimeout(r, ms));
+}
+/** 连接到 Chrome CDP，返回指定 tab 的 CDPClient */
+export async function connectTab(cdpPort = 9222, tabIndex = 0) {
+    const res = await fetch(`http://localhost:${cdpPort}/json`);
+    const tabs = (await res.json());
+    const pages = tabs.filter((t) => t.type === 'page');
+    if (!pages[tabIndex])
+        throw new Error(`No page tab at index ${tabIndex}`);
+    const client = new CDPClient(pages[tabIndex].webSocketDebuggerUrl);
+    await client.waitReady();
+    return client;
+}
+/** 新建 tab，返回其 CDPClient */
+export async function newTab(cdpPort = 9222) {
+    const res = await fetch(`http://localhost:${cdpPort}/json/new`, { method: 'PUT' });
+    const tab = (await res.json());
+    const client = new CDPClient(tab.webSocketDebuggerUrl);
+    await client.waitReady();
+    return client;
+}