oh-my-opencode 4.12.1 → 4.13.0

package/packages/omo-codex/plugin/skills/ultimate-browsing/references/insane-search/twitter.md

@@ -0,0 +1,104 @@
+# X/Twitter 접근 전략
+
+> WebFetch는 402로 차단됨. 아래 방법으로 우회한다. 모두 API 키/인증 불필요.
+
+## 검색 (트윗 발견)
+
+```python
+WebSearch(query="site:x.com {검색어}")
+```
+
+WebSearch는 X 포스트를 검색 결과로 반환한다. 제목, snippet, URL을 획득할 수 있지만 트윗 전문이나 engagement 수치는 없다.
+
+## 타임라인 조회 — Syndication API
+
+특정 핸들의 최근 ~100개 트윗 + engagement 수치(likes, RTs) 제공.
+
+### 엔드포인트
+
+```
+https://syndication.twitter.com/srv/timeline-profile/screen-name/{handle}
+```
+
+### 원샷 스크립트
+
+```bash
+curl -sL "https://syndication.twitter.com/srv/timeline-profile/screen-name/{handle}" | \
+python3 -c "
+import sys, json, re, html
+content = sys.stdin.read()
+match = re.search(r'__NEXT_DATA__.*?>(.*?)</script>', content)
+if match:
+    data = json.loads(match.group(1))
+    for e in data['props']['pageProps']['timeline']['entries']:
+        if e['type'] == 'tweet':
+            t = e['content']['tweet']
+            print(f\"@{t['user']['screen_name']} ({t.get('created_at','?')})\")
+            print(f\"  {html.unescape(t.get('full_text',''))[:300]}\")
+            print(f\"  Likes: {t.get('favorite_count',0)} | RTs: {t.get('retweet_count',0)}\")
+            print('---')
+"
+```
+
+### 가져올 수 있는 데이터
+
+| 필드 | 경로 | 예시 |
+|------|------|------|
+| 트윗 전문 | `tweet.full_text` | "Give your agent the..." |
+| 작성자 핸들 | `tweet.user.screen_name` | "openclaw" |
+| 작성자 이름 | `tweet.user.name` | "OpenClaw" |
+| 좋아요 수 | `tweet.favorite_count` | 1929 |
+| RT 수 | `tweet.retweet_count` | 169 |
+| 작성 시각 | `tweet.created_at` | "Mon Apr 06 04:04:08 +0000 2026" |
+| 트윗 ID | `tweet.id_str` | "2041003999856406714" |
+| 미디어 URL | `tweet.entities.media[].media_url_https` | 이미지/동영상 URL |
+
+### 제한
+
+- 최근 ~100개 반환 (페이지네이션 불가)
+- 비공개 계정 접근 불가
+- 검색 기능 없음 (타임라인만)
+- **저팔로워/신규 계정**: `hasResults: false` 반환 가능. 이 경우 oEmbed 개별 트윗 접근은 정상 동작하므로 "조합 패턴"으로 폴백.
+- 비공식 엔드포인트 — X가 변경/차단 가능
+
+## 개별 트윗 조회 — oEmbed API
+
+특정 트윗 URL을 알 때 전문 가져오기.
+
+### 엔드포인트
+
+```
+https://publish.twitter.com/oembed?url=https://x.com/{user}/status/{tweet_id}
+```
+
+### 사용법
+
+```bash
+curl -sL "https://publish.twitter.com/oembed?url=https://x.com/{user}/status/{tweet_id}"
+```
+
+### 응답 (JSON)
+
+| 필드 | 설명 |
+|------|------|
+| `author_name` | 작성자 표시 이름 |
+| `author_url` | 작성자 프로필 URL |
+| `html` | 트윗 전문이 포함된 HTML blockquote |
+| `url` | 트윗 원본 URL |
+
+## 조합 패턴 (검색 → 상세)
+
+```
+1단계: WebSearch(query="site:x.com {키워드}") → 트윗 URL 획득
+2단계: curl oEmbed API → 트윗 전문 획득
+```
+
+## 실패하는 방법 (사용하지 말 것)
+
+| 방법 | 결과 | 원인 |
+|------|------|------|
+| WebFetch | 402 Payment Required | Claude Code의 WebFetch 제한 |
+| Nitter | 빈 응답 | Nitter 인스턴스 대부분 종료됨 |
+| Wayback Machine | OG 메타태그만 | SPA 렌더링 안 됨 |
+| Mobile UA curl | OG 메타태그만 | SPA 렌더링 안 됨 |
+| RSS | 엔드포인트 없음 | X는 RSS 지원 중단 |

package/packages/omo-codex/plugin/skills/ultimate-browsing/scripts/cookie_crypto.py

@@ -0,0 +1,75 @@
+"""Pure key derivation + value decryption, with the OS-keyring read injected."""
+from __future__ import annotations
+
+import base64
+import json
+import subprocess
+from pathlib import Path
+
+from cookie_paths import UnsupportedPlatform
+
+
+def derive_key(platform: str, secret: bytes) -> bytes:
+    if platform == "win32":
+        if len(secret) != 32:
+            raise ValueError(f"win32 os_crypt key must be 32 bytes, got {len(secret)}")
+        return secret
+    if platform in ("darwin", "linux"):
+        from cryptography.hazmat.primitives import hashes
+        from cryptography.hazmat.primitives.kdf.pbkdf2 import PBKDF2HMAC
+
+        iterations = 1003 if platform == "darwin" else 1
+        return PBKDF2HMAC(algorithm=hashes.SHA1(), length=16, salt=b"saltysalt", iterations=iterations).derive(secret)
+    raise UnsupportedPlatform(f"unsupported platform for key derivation: {platform!r}")
+
+
+def decrypt_chromium_value(platform: str, key: bytes, encrypted: bytes) -> str:
+    if not encrypted:
+        return ""
+    prefix = encrypted[:3]
+    if prefix in (b"v10", b"v11") and platform == "win32":
+        from cryptography.hazmat.primitives.ciphers import Cipher, algorithms, modes
+
+        nonce, ciphertext, tag = encrypted[3:15], encrypted[15:-16], encrypted[-16:]
+        decryptor = Cipher(algorithms.AES(key), modes.GCM(nonce, tag)).decryptor()
+        return (decryptor.update(ciphertext) + decryptor.finalize()).decode("utf-8", errors="replace")
+    if prefix in (b"v10", b"v11"):
+        from cryptography.hazmat.primitives.ciphers import Cipher, algorithms, modes
+
+        decryptor = Cipher(algorithms.AES128(key), modes.CBC(b" " * 16)).decryptor()
+        decrypted = decryptor.update(encrypted[3:]) + decryptor.finalize()
+        pad = decrypted[-1]
+        if isinstance(pad, int) and 1 <= pad <= 16:
+            decrypted = decrypted[:-pad]
+        return decrypted.decode("utf-8", errors="replace")
+    return encrypted.decode("utf-8", errors="replace")
+
+
+def macos_keyring_secret(safe_storage: str) -> bytes:
+    result = subprocess.run(
+        ["security", "find-generic-password", "-s", safe_storage, "-w"],
+        capture_output=True, text=True, timeout=30,
+    )
+    if result.returncode != 0:
+        raise RuntimeError(f"cannot read {safe_storage} from Keychain: {result.stderr.strip()}")
+    return result.stdout.strip().encode()
+
+
+def linux_keyring_secret(safe_storage: str) -> bytes:
+    try:
+        import secretstorage
+    except ImportError:
+        return b"peanuts"
+    conn = secretstorage.dbus_init()
+    for item in secretstorage.get_default_collection(conn).get_all_items():
+        if item.get_label() == safe_storage:
+            return item.get_secret()
+    return b"peanuts"
+
+
+def windows_oscrypt_key(local_state_path: Path) -> bytes:
+    state = json.loads(local_state_path.read_text())
+    blob = base64.b64decode(state["os_crypt"]["encrypted_key"])[5:]
+    import win32crypt
+
+    return win32crypt.CryptUnprotectData(blob, None, None, None, 0)[1]

package/packages/omo-codex/plugin/skills/ultimate-browsing/scripts/cookie_domains.py

@@ -0,0 +1,38 @@
+from __future__ import annotations
+
+SQL_LIKE_ESCAPE = "\\"
+
+
+class CookieDomainError(ValueError):
+    pass
+
+
+def normalize_cookie_domain(domain: str) -> str:
+    normalized = domain.strip().lower().lstrip(".")
+    if not normalized:
+        raise CookieDomainError("cookie domain must not be empty")
+    return normalized
+
+
+def escape_sql_like(value: str) -> str:
+    return (
+        value
+        .replace(SQL_LIKE_ESCAPE, SQL_LIKE_ESCAPE * 2)
+        .replace("%", f"{SQL_LIKE_ESCAPE}%")
+        .replace("_", f"{SQL_LIKE_ESCAPE}_")
+    )
+
+
+def domain_where_clause(column: str, domains: list[str]) -> tuple[str, list[str]]:
+    normalized_domains = sorted({normalize_cookie_domain(domain) for domain in domains})
+    if not normalized_domains:
+        raise CookieDomainError("at least one cookie domain is required")
+
+    clauses: list[str] = []
+    params: list[str] = []
+    for domain in normalized_domains:
+        clauses.append(
+            f"({column} = ? OR {column} = ? OR {column} LIKE ? ESCAPE '{SQL_LIKE_ESCAPE}')"
+        )
+        params.extend([domain, f".{domain}", f"%.{escape_sql_like(domain)}"])
+    return " OR ".join(clauses), params

package/packages/omo-codex/plugin/skills/ultimate-browsing/scripts/cookie_paths.py

@@ -0,0 +1,112 @@
+"""Pure profile-path resolution for cross-platform cookie extraction."""
+from __future__ import annotations
+
+import os
+from pathlib import Path
+from typing import Final, Literal, TypedDict, assert_never
+
+
+class UnsupportedPlatform(ValueError):
+    """Raised when a browser/platform combination is not supported."""
+
+
+BrowserKind = Literal["chromium", "firefox"]
+
+
+class BrowserDirs(TypedDict):
+    darwin: str
+    linux: str
+    win32: str
+
+
+class BrowserSpec(TypedDict):
+    kind: BrowserKind
+    safe_storage: str | None
+    dirs: BrowserDirs
+
+
+BROWSERS: Final[dict[str, BrowserSpec]] = {
+    "chrome": {
+        "kind": "chromium",
+        "safe_storage": "Chrome Safe Storage",
+        "dirs": {"darwin": "Google/Chrome", "linux": "google-chrome", "win32": "Google/Chrome/User Data"},
+    },
+    "brave": {
+        "kind": "chromium",
+        "safe_storage": "Brave Safe Storage",
+        "dirs": {
+            "darwin": "BraveSoftware/Brave-Browser",
+            "linux": "BraveSoftware/Brave-Browser",
+            "win32": "BraveSoftware/Brave-Browser/User Data",
+        },
+    },
+    "chromium": {
+        "kind": "chromium",
+        "safe_storage": "Chromium Safe Storage",
+        "dirs": {"darwin": "Chromium", "linux": "chromium", "win32": "Chromium/User Data"},
+    },
+    "firefox": {
+        "kind": "firefox",
+        "safe_storage": None,
+        "dirs": {"darwin": "Firefox/Profiles", "linux": ".mozilla/firefox", "win32": "Mozilla/Firefox/Profiles"},
+    },
+}
+
+CHROMIUM_PROFILE_DIRS: Final = ["Default", "Profile 1", "Profile 2"]
+
+
+def platform_base(platform: str, kind: BrowserKind) -> Path:
+    home = Path.home()
+    match platform:
+        case "darwin":
+            return home / "Library" / "Application Support"
+        case "linux":
+            match kind:
+                case "firefox":
+                    return home
+                case "chromium":
+                    return Path(os.environ.get("XDG_CONFIG_HOME", str(home / ".config")))
+                case unreachable:
+                    assert_never(unreachable)
+        case "win32":
+            return Path(os.environ.get("LOCALAPPDATA", str(home / "AppData" / "Local")))
+        case _:
+            raise UnsupportedPlatform(f"unsupported platform: {platform!r}")
+
+
+def browser_dir(spec: BrowserSpec, platform: str) -> str:
+    match platform:
+        case "darwin":
+            return spec["dirs"]["darwin"]
+        case "linux":
+            return spec["dirs"]["linux"]
+        case "win32":
+            return spec["dirs"]["win32"]
+        case _:
+            raise UnsupportedPlatform(f"browser not mapped for platform {platform!r}")
+
+
+def resolve_cookie_db(browser: str, platform: str, base_override: Path | None = None) -> Path:
+    spec = BROWSERS.get(browser)
+    if spec is None:
+        raise UnsupportedPlatform(f"unsupported browser: {browser!r}")
+    base = base_override if base_override is not None else platform_base(platform, spec["kind"])
+    profile_root = base / browser_dir(spec, platform)
+
+    match spec["kind"]:
+        case "firefox":
+            if not profile_root.exists():
+                raise FileNotFoundError(f"no Firefox profile root at {profile_root}")
+            for entry in sorted(profile_root.iterdir()):
+                db = entry / "cookies.sqlite"
+                if db.exists():
+                    return db
+            raise FileNotFoundError(f"no cookies.sqlite under {profile_root}")
+        case "chromium":
+            for profile in CHROMIUM_PROFILE_DIRS:
+                for candidate in (profile_root / profile / "Cookies", profile_root / profile / "Network" / "Cookies"):
+                    if candidate.exists():
+                        return candidate
+            raise FileNotFoundError(f"no Cookies DB under {profile_root}")
+        case unreachable:
+            assert_never(unreachable)

package/packages/omo-codex/plugin/skills/ultimate-browsing/scripts/extract_cookies.py

@@ -0,0 +1,280 @@
+#!/usr/bin/env python3
+"""Cross-platform browser cookie extraction for Tier-2 Chrome stealth.
+
+The OS-keyring lookup is an injected boundary: cookie_paths resolves profile
+paths and cookie_crypto derives keys + decrypts values, both pure and testable
+with synthetic fixtures on any OS. This module wires them to a real browser DB
+and the agent-browser CDP session.
+
+Usage:
+    python extract_cookies.py --browser chrome --domain youtube.com --output /tmp/cookies.json
+    python extract_cookies.py --browser chrome --domain youtube.com --inject --cdp 9242
+"""
+from __future__ import annotations
+
+import argparse
+import json
+import os
+import shutil
+import sqlite3
+import subprocess
+import sys
+import tempfile
+from pathlib import Path
+from typing import Callable, NotRequired, TypedDict
+
+from cookie_crypto import (
+    decrypt_chromium_value,
+    derive_key,
+    linux_keyring_secret,
+    macos_keyring_secret,
+    windows_oscrypt_key,
+)
+from cookie_domains import domain_where_clause
+from cookie_paths import BROWSERS, BrowserSpec, UnsupportedPlatform, platform_base, resolve_cookie_db
+
+_SAMESITE = {-1: "None", 0: "None", 1: "Lax", 2: "Strict"}
+
+IMPORTANT_COOKIES = {
+    "SID", "SSID", "HSID", "APISID", "SAPISID",
+    "__Secure-1PSID", "__Secure-3PSID", "__Secure-1PSIDTS", "__Secure-3PSIDTS",
+    "LOGIN_INFO", "PREF", "VISITOR_INFO1_LIVE", "YSC", "NID", "CONSENT",
+}
+
+
+class CookieRecord(TypedDict):
+    name: str
+    value: str
+    domain: str
+    path: str
+    expires: int
+    secure: bool
+    httpOnly: bool
+    sameSite: str
+
+
+class CdpCookie(TypedDict):
+    name: str
+    value: str
+    domain: str
+    path: str
+    secure: bool
+    httpOnly: bool
+    sameSite: str
+    expires: NotRequired[int]
+
+
+_CDP_SET_COOKIES_SCRIPT = r"""
+const port = Number(process.argv[1] || 0);
+if (!Number.isInteger(port) || port <= 0) {
+  process.stderr.write("invalid CDP port\n");
+  process.exit(2);
+}
+
+let input = "";
+process.stdin.setEncoding("utf8");
+process.stdin.on("data", (chunk) => { input += chunk; });
+process.stdin.on("end", () => {
+  (async () => {
+  const cookies = JSON.parse(input || "[]");
+  const version = await fetch(`http://127.0.0.1:${port}/json/version`).then((r) => r.json());
+  const ws = new WebSocket(version.webSocketDebuggerUrl);
+  let nextId = 1;
+  const pending = new Map();
+
+  ws.onmessage = (event) => {
+    const msg = JSON.parse(event.data);
+    const waiter = pending.get(msg.id);
+    if (!waiter) return;
+    pending.delete(msg.id);
+    if (msg.error) waiter.reject(new Error(msg.error.message || "CDP error"));
+    else waiter.resolve(msg.result);
+  };
+
+  await new Promise((resolve, reject) => {
+    ws.onopen = resolve;
+    ws.onerror = reject;
+  });
+
+  const send = (method, params) => new Promise((resolve, reject) => {
+    const id = nextId++;
+    pending.set(id, { resolve, reject });
+    ws.send(JSON.stringify({ id, method, params }));
+  });
+
+  let ok = 0;
+  for (const cookie of cookies) {
+    const result = await send("Network.setCookie", cookie);
+    if (result && result.success) ok += 1;
+  }
+  ws.close();
+  process.stdout.write(String(ok));
+  })().catch((error) => {
+  process.stderr.write(`${error.name || "Error"}: ${error.message || error}\n`);
+  process.exit(1);
+  });
+});
+"""
+
+
+def _secure_cookie_db_copy(db_path: Path) -> Path:
+    handle = tempfile.NamedTemporaryFile(prefix="omo-cookies-", suffix=".sqlite", delete=False)
+    tmp = Path(handle.name)
+    handle.close()
+    try:
+        shutil.copyfile(db_path, tmp)
+        tmp.chmod(0o600)
+        return tmp
+    except (OSError, shutil.Error):
+        tmp.unlink(missing_ok=True)
+        raise
+
+
+def write_cookie_file(path: Path, cookies: list[CookieRecord]) -> None:
+    if path.is_symlink():
+        raise ValueError(f"refusing to write cookies through symlink: {path}")
+    path.parent.mkdir(parents=True, exist_ok=True)
+    fd, tmp_name = tempfile.mkstemp(prefix=f".{path.name}.", suffix=".tmp", dir=str(path.parent))
+    tmp_path = Path(tmp_name)
+    try:
+        with os.fdopen(fd, "w", encoding="utf-8") as f:
+            os.fchmod(f.fileno(), 0o600)
+            json.dump(cookies, f, indent=2)
+            f.write("\n")
+        os.replace(tmp_path, path)
+    finally:
+        tmp_path.unlink(missing_ok=True)
+
+
+def extract_firefox(db_path: Path, domains: list[str]) -> list[CookieRecord]:
+    tmp = _secure_cookie_db_copy(db_path)
+    try:
+        where, params = domain_where_clause("host", domains)
+        conn = sqlite3.connect(str(tmp))
+        rows = conn.execute(
+            f"SELECT name, value, host, path, expiry, isSecure, isHttpOnly, sameSite "
+            f"FROM moz_cookies WHERE ({where}) ORDER BY host, name",
+            params,
+        ).fetchall()
+        conn.close()
+    finally:
+        tmp.unlink(missing_ok=True)
+    return [
+        {
+            "name": n, "value": v, "domain": h, "path": p, "expires": e,
+            "secure": bool(sec), "httpOnly": bool(ho), "sameSite": _SAMESITE.get(ss, "Lax"),
+        }
+        for n, v, h, p, e, sec, ho, ss in rows
+    ]
+
+
+def extract_chromium(db_path: Path, domains: list[str], platform: str, key: bytes) -> list[CookieRecord]:
+    tmp = _secure_cookie_db_copy(db_path)
+    try:
+        where, params = domain_where_clause("host_key", domains)
+        conn = sqlite3.connect(str(tmp))
+        rows = conn.execute(
+            f"SELECT name, encrypted_value, host_key, path, expires_utc, is_secure, is_httponly, samesite "
+            f"FROM cookies WHERE ({where}) ORDER BY host_key, name",
+            params,
+        ).fetchall()
+        conn.close()
+    finally:
+        tmp.unlink(missing_ok=True)
+    out = []
+    for n, enc, h, p, exp, sec, ho, ss in rows:
+        unix_expires = int((exp / 1_000_000) - 11644473600) if exp and exp > 0 else 0
+        out.append({
+            "name": n, "value": decrypt_chromium_value(platform, key, enc), "domain": h, "path": p,
+            "expires": unix_expires, "secure": bool(sec), "httpOnly": bool(ho), "sameSite": _SAMESITE.get(ss, "Lax"),
+        })
+    return out
+
+
+def _browser_spec(browser: str) -> BrowserSpec:
+    spec = BROWSERS.get(browser)
+    if spec is None:
+        raise UnsupportedPlatform(f"unsupported browser: {browser!r}")
+    return spec
+
+
+def default_keyring_reader(platform: str, spec: BrowserSpec) -> Callable[[str], bytes]:
+    if platform == "darwin":
+        return macos_keyring_secret
+    if platform == "linux":
+        return linux_keyring_secret
+    if platform == "win32":
+        def _win(_safe_storage: str) -> bytes:
+            base = platform_base("win32", "chromium")
+            return windows_oscrypt_key(base / spec["dirs"]["win32"] / "Local State")
+        return _win
+    raise UnsupportedPlatform(f"no keyring reader for platform {platform!r}")
+
+
+def extract_cookies(
+    browser: str,
+    domains: list[str],
+    platform: str = sys.platform,
+    keyring_reader: Callable[[str], bytes] | None = None,
+    base_override: Path | None = None,
+) -> list[CookieRecord]:
+    spec = _browser_spec(browser)
+    db = resolve_cookie_db(browser, platform, base_override=base_override)
+    if spec["kind"] == "firefox":
+        return extract_firefox(db, domains)
+    reader = keyring_reader or default_keyring_reader(platform, spec)
+    safe_storage = spec["safe_storage"]
+    if safe_storage is None:
+        raise UnsupportedPlatform(f"browser {browser!r} has no keyring storage name")
+    key = derive_key(platform, reader(safe_storage))
+    return extract_chromium(db, domains, platform, key)
+
+
+def inject_cookies(cookies: list[CookieRecord], cdp_port: int) -> None:
+    filtered = [c for c in cookies if c["name"] in IMPORTANT_COOKIES] or cookies
+    payload: list[CdpCookie] = [
+        {
+            "name": c["name"],
+            "value": c["value"],
+            "domain": c["domain"],
+            "path": c.get("path") or "/",
+            "secure": bool(c.get("secure")),
+            "httpOnly": bool(c.get("httpOnly")),
+            "sameSite": c.get("sameSite", "Lax"),
+            **({"expires": int(c["expires"])} if c.get("expires") and int(c["expires"]) > 0 else {}),
+        }
+        for c in filtered
+    ]
+    proc = subprocess.run(
+        ["node", "-e", _CDP_SET_COOKIES_SCRIPT, str(cdp_port)],
+        input=json.dumps(payload),
+        capture_output=True,
+        text=True,
+        timeout=15,
+    )
+    if proc.returncode != 0:
+        raise RuntimeError((proc.stderr or "CDP cookie injection failed").strip())
+    ok = int((proc.stdout or "0").strip() or "0")
+    print(f"Injected {ok}/{len(filtered)} cookies into agent-browser (CDP {cdp_port})")
+
+
+def main() -> None:
+    parser = argparse.ArgumentParser(description="Extract browser cookies (cross-platform)")
+    parser.add_argument("--browser", required=True, choices=sorted(BROWSERS.keys()))
+    parser.add_argument("--domain", required=True, action="append", dest="domains")
+    parser.add_argument("--output", help="Write cookies JSON to file")
+    parser.add_argument("--inject", action="store_true", help="Inject into agent-browser")
+    parser.add_argument("--cdp", type=int, default=9242, help="CDP port (default 9242)")
+    args = parser.parse_args()
+
+    cookies = extract_cookies(args.browser, args.domains)
+    print(f"Extracted {len(cookies)} cookies from {args.browser}")
+    if args.output:
+        write_cookie_file(Path(args.output), cookies)
+        print(f"Saved to {args.output}")
+    if args.inject:
+        inject_cookies(cookies, args.cdp)
+
+
+if __name__ == "__main__":
+    main()