@gonzih/of-scraper 1.0.0

package/PLAN.md

@@ -0,0 +1,50 @@
+# PLAN.md — of-scraper
+
+## Task Understanding
+Build a Node.js + TypeScript service that:
+1. Maintains a persistent Puppeteer browser session logged into OnlyFans
+2. Polls the chats page every 30s for new messages
+3. For each new message, scrapes sender profile + financial data
+4. Publishes all data to Redis Streams (of:messages, of:profiles, of:financials)
+5. Avoids duplicates via Redis SET of:seen_messages
+6. Handles session save/restore across restarts
+
+## Approaches
+
+### Approach A: Monolithic single-file
+- Everything in index.ts
+- Simple, but hard to test and maintain
+- Not chosen — doesn't match the required modular structure
+
+### Approach B: Modular TypeScript (chosen)
+- Separate modules: browser.ts, messages.ts, profiles.ts, financials.ts, redis.ts, index.ts
+- Each module has a clear single responsibility
+- Easy to test each part independently
+- Matches the spec exactly
+
+### Approach C: Worker threads / separate processes
+- Each scraping task runs in a worker thread
+- Better concurrency, but massively over-engineered for a single-user scraper
+- Not chosen — unnecessary complexity
+
+## Chosen Approach: B (Modular TypeScript)
+
+## Files to Create
+- `package.json` — dependencies, scripts, bin entry
+- `tsconfig.json` — TypeScript config
+- `.npmrc` — npm auth token (gitignored)
+- `src/browser.ts` — Puppeteer launch, session save/restore
+- `src/messages.ts` — Scrape chat list
+- `src/profiles.ts` — Scrape profile page
+- `src/financials.ts` — Scrape financial data from chat thread
+- `src/redis.ts` — Redis client + XADD helpers
+- `src/index.ts` — Main loop + orchestration
+- `README.md` — Setup docs
+
+## Risks & Unknowns
+- OnlyFans DOM structure changes frequently — selectors may need adjustment
+- puppeteer-extra-plugin-stealth availability/compatibility with latest puppeteer
+- Session serialization completeness (cookies alone may not be sufficient)
+- Rate limiting by OnlyFans if scraping too aggressively
+- npm package name `@gonzih/of-scraper` must be available on npm registry
+- .npmrc must be gitignored to avoid GitHub push protection blocking the token

package/README.md

@@ -0,0 +1,113 @@
+# @gonzih/of-scraper
+
+A Node.js + TypeScript service that maintains a live Puppeteer browser session logged into OnlyFans, scrapes incoming messages, and feeds them into Redis Streams.
+
+## Features
+
+- Persistent browser sessions via `session.json` (cookies + localStorage)
+- Polls `/my/chats` every 30s for new messages
+- For each new message, scrapes:
+  - Sender profile (displayName, bio, profilePic, subscription status)
+  - Financial data (tips, purchases, lifetime value)
+- All data published to Redis Streams
+- Duplicate prevention via Redis SET `of:seen_messages`
+- Stealth mode via `puppeteer-extra-plugin-stealth`
+
+## Prerequisites
+
+- Node.js 18+
+- Redis 6+ (running locally or via `REDIS_URL`)
+
+## Setup
+
+```bash
+npx @gonzih/of-scraper
+```
+
+Or install globally:
+
+```bash
+npm install -g @gonzih/of-scraper
+of-scraper
+```
+
+## Initial Login
+
+On first run (or when the session has expired), the service opens a browser window and waits for you to log in manually:
+
+1. Set `HEADLESS=false` to see the browser
+2. Log in to OnlyFans in the browser window
+3. The service detects the successful login, saves `session.json`, and starts polling
+
+Subsequent runs will restore the saved session automatically.
+
+## Environment Variables
+
+| Variable | Default | Description |
+|----------|---------|-------------|
+| `REDIS_URL` | `redis://localhost:6379` | Redis connection URL |
+| `POLL_INTERVAL_MS` | `30000` | Polling interval in milliseconds |
+| `SESSION_FILE` | `./session.json` | Path to session persistence file |
+| `HEADLESS` | `true` | Run browser headlessly (`false` for initial login) |
+
+## Redis Stream Schemas
+
+### `of:messages`
+
+| Field | Type | Description |
+|-------|------|-------------|
+| `messageId` | string | Unique message identifier |
+| `fromUsername` | string | Sender's OnlyFans username |
+| `text` | string | Message text content |
+| `timestamp` | string | ISO 8601 timestamp |
+| `threadId` | string | Chat thread ID |
+
+### `of:profiles`
+
+| Field | Type | Description |
+|-------|------|-------------|
+| `username` | string | OnlyFans username |
+| `displayName` | string | Display name |
+| `isSubscribed` | string | `"true"` or `"false"` |
+| `profilePic` | string | URL of profile picture |
+| `bio` | string | Profile bio text |
+| `fetchedAt` | string | ISO 8601 fetch timestamp |
+
+### `of:financials`
+
+| Field | Type | Description |
+|-------|------|-------------|
+| `username` | string | OnlyFans username |
+| `totalTips` | string | Total tips received from this fan |
+| `totalPurchases` | string | Total PPV/content purchases |
+| `subscriptionStatus` | string | Current subscription status |
+| `lastPaymentDate` | string | Date of last payment |
+| `lifetimeValue` | string | Total lifetime spend |
+| `updatedAt` | string | ISO 8601 update timestamp |
+
+## Consuming Streams
+
+```bash
+# Read all messages from the beginning
+redis-cli XREAD COUNT 10 STREAMS of:messages 0-0
+
+# Read new messages since last read (consumer group pattern)
+redis-cli XGROUP CREATE of:messages myapp $ MKSTREAM
+redis-cli XREADGROUP GROUP myapp consumer1 COUNT 10 STREAMS of:messages >
+```
+
+## Error Handling
+
+If the service cannot verify the login state, it saves a screenshot to `/tmp/of_login_required.png` for debugging. Delete `session.json` and restart with `HEADLESS=false` to re-authenticate.
+
+## Architecture
+
+```
+src/
+  browser.ts      — Puppeteer session management (launch, save, restore)
+  messages.ts     — Scrape chat list, extract new messages
+  profiles.ts     — Scrape profile details for a username
+  financials.ts   — Scrape transaction/tip history for a username
+  redis.ts        — Redis client + XADD stream helpers
+  index.ts        — Main loop + orchestration
+```

package/TODO.md

@@ -0,0 +1,27 @@
+# TODO.md — of-scraper
+
+## Setup
+- [x] Create package.json with all dependencies
+- [x] Create tsconfig.json
+- [x] Create .npmrc with auth token (gitignored)
+
+## Source Files
+- [x] src/redis.ts — Redis client + XADD stream helpers
+- [x] src/browser.ts — Puppeteer session management
+- [x] src/messages.ts — Scrape chat list for new messages
+- [x] src/profiles.ts — Scrape profile page for a username
+- [x] src/financials.ts — Scrape financial data from chat thread
+- [x] src/index.ts — Main loop + orchestration
+
+## Documentation
+- [x] README.md
+
+## Build & Publish
+- [x] Run npm install
+- [x] Run npm run build (tsc)
+- [ ] git checkout -b feat/mvp
+- [ ] git add + commit
+- [ ] git push
+- [ ] gh pr create
+- [ ] gh pr merge
+- [ ] npm version 1.0.0 && npm publish

package/dist/browser.d.ts

@@ -0,0 +1,8 @@
+import type { Browser, Page } from 'puppeteer';
+export declare function launchBrowser(): Promise<Browser>;
+export declare function saveSession(page: Page): Promise<void>;
+export declare function restoreSession(page: Page): Promise<void>;
+export declare function sessionFileExists(): Promise<boolean>;
+export declare function ensureLoggedIn(browser: Browser): Promise<Page>;
+export declare function takeErrorScreenshot(page: Page): Promise<void>;
+//# sourceMappingURL=browser.d.ts.map

package/dist/browser.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"browser.d.ts","sourceRoot":"","sources":["../src/browser.ts"],"names":[],"mappings":"AAEA,OAAO,KAAK,EAAE,OAAO,EAAE,IAAI,EAAE,MAAM,WAAW,CAAC;AAe/C,wBAAsB,aAAa,IAAI,OAAO,CAAC,OAAO,CAAC,CAWtD;AAED,wBAAsB,WAAW,CAAC,IAAI,EAAE,IAAI,GAAG,OAAO,CAAC,IAAI,CAAC,CAgB3D;AAED,wBAAsB,cAAc,CAAC,IAAI,EAAE,IAAI,GAAG,OAAO,CAAC,IAAI,CAAC,CAmB9D;AAED,wBAAsB,iBAAiB,IAAI,OAAO,CAAC,OAAO,CAAC,CAE1D;AAED,wBAAsB,cAAc,CAAC,OAAO,EAAE,OAAO,GAAG,OAAO,CAAC,IAAI,CAAC,CAkCpE;AAmBD,wBAAsB,mBAAmB,CAAC,IAAI,EAAE,IAAI,GAAG,OAAO,CAAC,IAAI,CAAC,CAOnE"}

package/dist/browser.js

@@ -0,0 +1,141 @@
+"use strict";
+var __createBinding = (this && this.__createBinding) || (Object.create ? (function(o, m, k, k2) {
+    if (k2 === undefined) k2 = k;
+    var desc = Object.getOwnPropertyDescriptor(m, k);
+    if (!desc || ("get" in desc ? !m.__esModule : desc.writable || desc.configurable)) {
+      desc = { enumerable: true, get: function() { return m[k]; } };
+    }
+    Object.defineProperty(o, k2, desc);
+}) : (function(o, m, k, k2) {
+    if (k2 === undefined) k2 = k;
+    o[k2] = m[k];
+}));
+var __setModuleDefault = (this && this.__setModuleDefault) || (Object.create ? (function(o, v) {
+    Object.defineProperty(o, "default", { enumerable: true, value: v });
+}) : function(o, v) {
+    o["default"] = v;
+});
+var __importStar = (this && this.__importStar) || function (mod) {
+    if (mod && mod.__esModule) return mod;
+    var result = {};
+    if (mod != null) for (var k in mod) if (k !== "default" && Object.prototype.hasOwnProperty.call(mod, k)) __createBinding(result, mod, k);
+    __setModuleDefault(result, mod);
+    return result;
+};
+var __importDefault = (this && this.__importDefault) || function (mod) {
+    return (mod && mod.__esModule) ? mod : { "default": mod };
+};
+Object.defineProperty(exports, "__esModule", { value: true });
+exports.takeErrorScreenshot = exports.ensureLoggedIn = exports.sessionFileExists = exports.restoreSession = exports.saveSession = exports.launchBrowser = void 0;
+const puppeteer_extra_1 = __importDefault(require("puppeteer-extra"));
+const puppeteer_extra_plugin_stealth_1 = __importDefault(require("puppeteer-extra-plugin-stealth"));
+const fs = __importStar(require("fs"));
+const path = __importStar(require("path"));
+puppeteer_extra_1.default.use((0, puppeteer_extra_plugin_stealth_1.default)());
+const SESSION_FILE = process.env.SESSION_FILE ?? './session.json';
+const HEADLESS = process.env.HEADLESS !== 'false';
+async function launchBrowser() {
+    const browser = await puppeteer_extra_1.default.launch({
+        headless: HEADLESS,
+        args: [
+            '--no-sandbox',
+            '--disable-setuid-sandbox',
+            '--disable-blink-features=AutomationControlled',
+        ],
+    });
+    console.log(`[${new Date().toISOString()}] Browser launched (headless=${HEADLESS})`);
+    return browser;
+}
+exports.launchBrowser = launchBrowser;
+async function saveSession(page) {
+    const cookies = await page.cookies();
+    const localStorage = await page.evaluate(() => {
+        const data = {};
+        for (let i = 0; i < window.localStorage.length; i++) {
+            const key = window.localStorage.key(i);
+            if (key !== null) {
+                data[key] = window.localStorage.getItem(key) ?? '';
+            }
+        }
+        return data;
+    });
+    const session = { cookies, localStorage };
+    const sessionPath = path.resolve(SESSION_FILE);
+    fs.writeFileSync(sessionPath, JSON.stringify(session, null, 2));
+    console.log(`[${new Date().toISOString()}] Session saved to ${sessionPath}`);
+}
+exports.saveSession = saveSession;
+async function restoreSession(page) {
+    const sessionPath = path.resolve(SESSION_FILE);
+    if (!fs.existsSync(sessionPath)) {
+        console.log(`[${new Date().toISOString()}] No session file found at ${sessionPath}`);
+        return;
+    }
+    const raw = fs.readFileSync(sessionPath, 'utf-8');
+    const session = JSON.parse(raw);
+    await page.goto('https://onlyfans.com', { waitUntil: 'domcontentloaded' });
+    await page.setCookie(...session.cookies);
+    await page.evaluate((lsData) => {
+        for (const [key, value] of Object.entries(lsData)) {
+            window.localStorage.setItem(key, value);
+        }
+    }, session.localStorage);
+    console.log(`[${new Date().toISOString()}] Session restored from ${sessionPath}`);
+}
+exports.restoreSession = restoreSession;
+async function sessionFileExists() {
+    return fs.existsSync(path.resolve(SESSION_FILE));
+}
+exports.sessionFileExists = sessionFileExists;
+async function ensureLoggedIn(browser) {
+    const page = await browser.newPage();
+    await page.setViewport({ width: 1280, height: 900 });
+    await page.setUserAgent('Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36');
+    if (await sessionFileExists()) {
+        console.log(`[${new Date().toISOString()}] Restoring existing session...`);
+        await restoreSession(page);
+        await page.goto('https://onlyfans.com/my/chats', { waitUntil: 'networkidle2', timeout: 30000 });
+        const isLoggedIn = await checkLoggedIn(page);
+        if (isLoggedIn) {
+            console.log(`[${new Date().toISOString()}] Session valid — logged in`);
+            return page;
+        }
+        console.log(`[${new Date().toISOString()}] Session invalid or expired`);
+    }
+    // Need to log in manually
+    await page.goto('https://onlyfans.com/login', { waitUntil: 'networkidle2', timeout: 30000 });
+    console.log(`[${new Date().toISOString()}] Waiting for manual login at https://onlyfans.com/login ...`);
+    // Wait for navigation away from /login (indicates successful login)
+    await page.waitForFunction(() => !window.location.href.includes('/login'), { timeout: 300000 } // 5 minute timeout for human to log in
+    );
+    console.log(`[${new Date().toISOString()}] Login detected — saving session`);
+    await saveSession(page);
+    return page;
+}
+exports.ensureLoggedIn = ensureLoggedIn;
+async function checkLoggedIn(page) {
+    try {
+        const result = await page.evaluate(() => {
+            return (document.querySelector('.b-header__user') !== null ||
+                document.querySelector('[data-type="messages"]') !== null ||
+                document.querySelector('.g-header__left .b-ddmenu') !== null ||
+                document.querySelector('.b-chats') !== null ||
+                document.querySelector('.l-sidebar__user') !== null);
+        });
+        return result;
+    }
+    catch {
+        return false;
+    }
+}
+async function takeErrorScreenshot(page) {
+    try {
+        await page.screenshot({ path: '/tmp/of_login_required.png', fullPage: true });
+        console.log(`[${new Date().toISOString()}] Screenshot saved to /tmp/of_login_required.png`);
+    }
+    catch (err) {
+        console.error(`[${new Date().toISOString()}] Failed to take screenshot:`, err);
+    }
+}
+exports.takeErrorScreenshot = takeErrorScreenshot;
+//# sourceMappingURL=browser.js.map

package/dist/browser.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"browser.js","sourceRoot":"","sources":["../src/browser.ts"],"names":[],"mappings":";;;;;;;;;;;;;;;;;;;;;;;;;;;;;AAAA,sEAAwC;AACxC,oGAA2D;AAG3D,uCAAyB;AACzB,2CAA6B;AAE7B,yBAAS,CAAC,GAAG,CAAC,IAAA,wCAAa,GAAE,CAAC,CAAC;AAE/B,MAAM,YAAY,GAAG,OAAO,CAAC,GAAG,CAAC,YAAY,IAAI,gBAAgB,CAAC;AAClE,MAAM,QAAQ,GAAG,OAAO,CAAC,GAAG,CAAC,QAAQ,KAAK,OAAO,CAAC;AAO3C,KAAK,UAAU,aAAa;IACjC,MAAM,OAAO,GAAG,MAAM,yBAAS,CAAC,MAAM,CAAC;QACrC,QAAQ,EAAE,QAAQ;QAClB,IAAI,EAAE;YACJ,cAAc;YACd,0BAA0B;YAC1B,+CAA+C;SAChD;KACF,CAAC,CAAC;IACH,OAAO,CAAC,GAAG,CAAC,IAAI,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,gCAAgC,QAAQ,GAAG,CAAC,CAAC;IACrF,OAAO,OAAO,CAAC;AACjB,CAAC;AAXD,sCAWC;AAEM,KAAK,UAAU,WAAW,CAAC,IAAU;IAC1C,MAAM,OAAO,GAAG,MAAM,IAAI,CAAC,OAAO,EAAE,CAAC;IACrC,MAAM,YAAY,GAA2B,MAAM,IAAI,CAAC,QAAQ,CAAC,GAAG,EAAE;QACpE,MAAM,IAAI,GAA2B,EAAE,CAAC;QACxC,KAAK,IAAI,CAAC,GAAG,CAAC,EAAE,CAAC,GAAG,MAAM,CAAC,YAAY,CAAC,MAAM,EAAE,CAAC,EAAE,EAAE,CAAC;YACpD,MAAM,GAAG,GAAG,MAAM,CAAC,YAAY,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC;YACvC,IAAI,GAAG,KAAK,IAAI,EAAE,CAAC;gBACjB,IAAI,CAAC,GAAG,CAAC,GAAG,MAAM,CAAC,YAAY,CAAC,OAAO,CAAC,GAAG,CAAC,IAAI,EAAE,CAAC;YACrD,CAAC;QACH,CAAC;QACD,OAAO,IAAI,CAAC;IACd,CAAC,CAAC,CAAC;IACH,MAAM,OAAO,GAAgB,EAAE,OAAO,EAAE,YAAY,EAAE,CAAC;IACvD,MAAM,WAAW,GAAG,IAAI,CAAC,OAAO,CAAC,YAAY,CAAC,CAAC;IAC/C,EAAE,CAAC,aAAa,CAAC,WAAW,EAAE,IAAI,CAAC,SAAS,CAAC,OAAO,EAAE,IAAI,EAAE,CAAC,CAAC,CAAC,CAAC;IAChE,OAAO,CAAC,GAAG,CAAC,IAAI,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,sBAAsB,WAAW,EAAE,CAAC,CAAC;AAC/E,CAAC;AAhBD,kCAgBC;AAEM,KAAK,UAAU,cAAc,CAAC,IAAU;IAC7C,MAAM,WAAW,GAAG,IAAI,CAAC,OAAO,CAAC,YAAY,CAAC,CAAC;IAC/C,IAAI,CAAC,EAAE,CAAC,UAAU,CAAC,WAAW,CAAC,EAAE,CAAC;QAChC,OAAO,CAAC,GAAG,CAAC,IAAI,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,8BAA8B,WAAW,EAAE,CAAC,CAAC;QACrF,OAAO;IACT,CAAC;IACD,MAAM,GAAG,GAAG,EAAE,CAAC,YAAY,CAAC,WAAW,EAAE,OAAO,CAAC,CAAC;IAClD,MAAM,OAAO,GAAgB,IAAI,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC;IAE7C,MAAM,IAAI,CAAC,IAAI,CAAC,sBAAsB,EAAE,EAAE,SAAS,EAAE,kBAAkB,EAAE,CAAC,CAAC;IAC3E,MAAM,IAAI,CAAC,SAAS,CAAC,GAAG,OAAO,CAAC,OAAO,CAAC,CAAC;IAEzC,MAAM,IAAI,CAAC,QAAQ,CAAC,CAAC,MAA8B,EAAE,EAAE;QACrD,KAAK,MAAM,CAAC,GAAG,EAAE,KAAK,CAAC,IAAI,MAAM,CAAC,OAAO,CAAC,MAAM,CAAC,EAAE,CAAC;YAClD,MAAM,CAAC,YAAY,CAAC,OAAO,CAAC,GAAG,EAAE,KAAK,CAAC,CAAC;QAC1C,CAAC;IACH,CAAC,EAAE,OAAO,CAAC,YAAY,CAAC,CAAC;IAEzB,OAAO,CAAC,GAAG,CAAC,IAAI,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,2BAA2B,WAAW,EAAE,CAAC,CAAC;AACpF,CAAC;AAnBD,wCAmBC;AAEM,KAAK,UAAU,iBAAiB;IACrC,OAAO,EAAE,CAAC,UAAU,CAAC,IAAI,CAAC,OAAO,CAAC,YAAY,CAAC,CAAC,CAAC;AACnD,CAAC;AAFD,8CAEC;AAEM,KAAK,UAAU,cAAc,CAAC,OAAgB;IACnD,MAAM,IAAI,GAAG,MAAM,OAAO,CAAC,OAAO,EAAE,CAAC;IACrC,MAAM,IAAI,CAAC,WAAW,CAAC,EAAE,KAAK,EAAE,IAAI,EAAE,MAAM,EAAE,GAAG,EAAE,CAAC,CAAC;IACrD,MAAM,IAAI,CAAC,YAAY,CACrB,uHAAuH,CACxH,CAAC;IAEF,IAAI,MAAM,iBAAiB,EAAE,EAAE,CAAC;QAC9B,OAAO,CAAC,GAAG,CAAC,IAAI,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,iCAAiC,CAAC,CAAC;QAC3E,MAAM,cAAc,CAAC,IAAI,CAAC,CAAC;QAC3B,MAAM,IAAI,CAAC,IAAI,CAAC,+BAA+B,EAAE,EAAE,SAAS,EAAE,cAAc,EAAE,OAAO,EAAE,KAAK,EAAE,CAAC,CAAC;QAEhG,MAAM,UAAU,GAAG,MAAM,aAAa,CAAC,IAAI,CAAC,CAAC;QAC7C,IAAI,UAAU,EAAE,CAAC;YACf,OAAO,CAAC,GAAG,CAAC,IAAI,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,6BAA6B,CAAC,CAAC;YACvE,OAAO,IAAI,CAAC;QACd,CAAC;QACD,OAAO,CAAC,GAAG,CAAC,IAAI,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,8BAA8B,CAAC,CAAC;IAC1E,CAAC;IAED,0BAA0B;IAC1B,MAAM,IAAI,CAAC,IAAI,CAAC,4BAA4B,EAAE,EAAE,SAAS,EAAE,cAAc,EAAE,OAAO,EAAE,KAAK,EAAE,CAAC,CAAC;IAC7F,OAAO,CAAC,GAAG,CAAC,IAAI,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,8DAA8D,CAAC,CAAC;IAExG,oEAAoE;IACpE,MAAM,IAAI,CAAC,eAAe,CACxB,GAAG,EAAE,CAAC,CAAC,MAAM,CAAC,QAAQ,CAAC,IAAI,CAAC,QAAQ,CAAC,QAAQ,CAAC,EAC9C,EAAE,OAAO,EAAE,MAAM,EAAE,CAAC,uCAAuC;KAC5D,CAAC;IAEF,OAAO,CAAC,GAAG,CAAC,IAAI,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,mCAAmC,CAAC,CAAC;IAC7E,MAAM,WAAW,CAAC,IAAI,CAAC,CAAC;IAExB,OAAO,IAAI,CAAC;AACd,CAAC;AAlCD,wCAkCC;AAED,KAAK,UAAU,aAAa,CAAC,IAAU;IACrC,IAAI,CAAC;QACH,MAAM,MAAM,GAAG,MAAM,IAAI,CAAC,QAAQ,CAAC,GAAG,EAAE;YACtC,OAAO,CACL,QAAQ,CAAC,aAAa,CAAC,iBAAiB,CAAC,KAAK,IAAI;gBAClD,QAAQ,CAAC,aAAa,CAAC,wBAAwB,CAAC,KAAK,IAAI;gBACzD,QAAQ,CAAC,aAAa,CAAC,2BAA2B,CAAC,KAAK,IAAI;gBAC5D,QAAQ,CAAC,aAAa,CAAC,UAAU,CAAC,KAAK,IAAI;gBAC3C,QAAQ,CAAC,aAAa,CAAC,kBAAkB,CAAC,KAAK,IAAI,CACpD,CAAC;QACJ,CAAC,CAAC,CAAC;QACH,OAAO,MAAM,CAAC;IAChB,CAAC;IAAC,MAAM,CAAC;QACP,OAAO,KAAK,CAAC;IACf,CAAC;AACH,CAAC;AAEM,KAAK,UAAU,mBAAmB,CAAC,IAAU;IAClD,IAAI,CAAC;QACH,MAAM,IAAI,CAAC,UAAU,CAAC,EAAE,IAAI,EAAE,4BAA4B,EAAE,QAAQ,EAAE,IAAI,EAAE,CAAC,CAAC;QAC9E,OAAO,CAAC,GAAG,CAAC,IAAI,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,kDAAkD,CAAC,CAAC;IAC9F,CAAC;IAAC,OAAO,GAAG,EAAE,CAAC;QACb,OAAO,CAAC,KAAK,CAAC,IAAI,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,8BAA8B,EAAE,GAAG,CAAC,CAAC;IACjF,CAAC;AACH,CAAC;AAPD,kDAOC"}

package/dist/financials.d.ts

@@ -0,0 +1,12 @@
+import type { Page } from 'puppeteer';
+export interface Financials {
+    username: string;
+    totalTips: string;
+    totalPurchases: string;
+    subscriptionStatus: string;
+    lastPaymentDate: string;
+    lifetimeValue: string;
+    updatedAt: string;
+}
+export declare function scrapeFinancials(page: Page, username: string, threadId: string): Promise<Financials | null>;
+//# sourceMappingURL=financials.d.ts.map

package/dist/financials.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"financials.d.ts","sourceRoot":"","sources":["../src/financials.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,EAAE,IAAI,EAAE,MAAM,WAAW,CAAC;AAEtC,MAAM,WAAW,UAAU;IACzB,QAAQ,EAAE,MAAM,CAAC;IACjB,SAAS,EAAE,MAAM,CAAC;IAClB,cAAc,EAAE,MAAM,CAAC;IACvB,kBAAkB,EAAE,MAAM,CAAC;IAC3B,eAAe,EAAE,MAAM,CAAC;IACxB,aAAa,EAAE,MAAM,CAAC;IACtB,SAAS,EAAE,MAAM,CAAC;CACnB;AAED,wBAAsB,gBAAgB,CAAC,IAAI,EAAE,IAAI,EAAE,QAAQ,EAAE,MAAM,EAAE,QAAQ,EAAE,MAAM,GAAG,OAAO,CAAC,UAAU,GAAG,IAAI,CAAC,CA2FjH"}

package/dist/financials.js

@@ -0,0 +1,88 @@
+"use strict";
+Object.defineProperty(exports, "__esModule", { value: true });
+exports.scrapeFinancials = void 0;
+async function scrapeFinancials(page, username, threadId) {
+    console.log(`[${new Date().toISOString()}] Fetching financials for @${username} (thread ${threadId})`);
+    const chatUrl = `https://onlyfans.com/my/chats/chat/${threadId}`;
+    try {
+        await page.goto(chatUrl, { waitUntil: 'networkidle2', timeout: 30000 });
+    }
+    catch (err) {
+        console.error(`[${new Date().toISOString()}] Failed to navigate to thread for financials:`, err);
+        return null;
+    }
+    // Try to open the statistics/info panel
+    try {
+        const statsBtnSelectors = [
+            'button[class*="statistic"]',
+            'button[class*="stat"]',
+            '[data-type="stats"]',
+            'button[title*="Statistic"]',
+            'button[aria-label*="statistic"]',
+            '.b-chat__info-btn',
+            '[class*="infoBtn"]',
+        ];
+        for (const sel of statsBtnSelectors) {
+            const btn = await page.$(sel);
+            if (btn) {
+                await btn.click();
+                await new Promise((r) => setTimeout(r, 1500));
+                break;
+            }
+        }
+    }
+    catch {
+        // Stats panel may already be visible or not available
+    }
+    const financials = await page.evaluate((uname) => {
+        const getText = (selectors) => {
+            for (const sel of selectors) {
+                const el = document.querySelector(sel);
+                if (el?.textContent?.trim())
+                    return el.textContent.trim();
+            }
+            return '0';
+        };
+        const totalTips = getText([
+            '[class*="tips"] [class*="amount"]',
+            '[class*="tip"] [class*="total"]',
+            '[data-type="tips"]',
+            '.b-stat__tips',
+        ]);
+        const totalPurchases = getText([
+            '[class*="purchase"] [class*="amount"]',
+            '[class*="purchase"] [class*="total"]',
+            '[data-type="purchase"]',
+            '.b-stat__purchases',
+        ]);
+        const subscriptionStatus = getText([
+            '[class*="subscription"] [class*="status"]',
+            '[class*="subscriptionStatus"]',
+            '[data-type="subscriptionStatus"]',
+        ]) || 'unknown';
+        const lastPaymentDate = getText([
+            '[class*="lastPayment"]',
+            '[class*="last-payment"]',
+            '[data-type="lastPayment"]',
+        ]);
+        const lifetimeValue = getText([
+            '[class*="lifetimeValue"]',
+            '[class*="lifetime"]',
+            '[class*="totalSpent"]',
+            '[data-type="lifetimeValue"]',
+        ]);
+        return {
+            username: uname,
+            totalTips,
+            totalPurchases,
+            subscriptionStatus,
+            lastPaymentDate,
+            lifetimeValue,
+            updatedAt: new Date().toISOString(),
+        };
+    }, username);
+    console.log(`[${new Date().toISOString()}] Financials for @${username}: tips=${financials.totalTips}, purchases=${financials.totalPurchases}`);
+    return financials;
+}
+exports.scrapeFinancials = scrapeFinancials;
+//# sourceMappingURL=financials.js.map

package/dist/financials.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"financials.js","sourceRoot":"","sources":["../src/financials.ts"],"names":[],"mappings":";;;AAYO,KAAK,UAAU,gBAAgB,CAAC,IAAU,EAAE,QAAgB,EAAE,QAAgB;IACnF,OAAO,CAAC,GAAG,CAAC,IAAI,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,8BAA8B,QAAQ,YAAY,QAAQ,GAAG,CAAC,CAAC;IAEvG,MAAM,OAAO,GAAG,sCAAsC,QAAQ,EAAE,CAAC;IACjE,IAAI,CAAC;QACH,MAAM,IAAI,CAAC,IAAI,CAAC,OAAO,EAAE,EAAE,SAAS,EAAE,cAAc,EAAE,OAAO,EAAE,KAAK,EAAE,CAAC,CAAC;IAC1E,CAAC;IAAC,OAAO,GAAG,EAAE,CAAC;QACb,OAAO,CAAC,KAAK,CAAC,IAAI,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,gDAAgD,EAAE,GAAG,CAAC,CAAC;QACjG,OAAO,IAAI,CAAC;IACd,CAAC;IAED,wCAAwC;IACxC,IAAI,CAAC;QACH,MAAM,iBAAiB,GAAG;YACxB,4BAA4B;YAC5B,uBAAuB;YACvB,qBAAqB;YACrB,4BAA4B;YAC5B,iCAAiC;YACjC,mBAAmB;YACnB,oBAAoB;SACrB,CAAC;QACF,KAAK,MAAM,GAAG,IAAI,iBAAiB,EAAE,CAAC;YACpC,MAAM,GAAG,GAAG,MAAM,IAAI,CAAC,CAAC,CAAC,GAAG,CAAC,CAAC;YAC9B,IAAI,GAAG,EAAE,CAAC;gBACR,MAAM,GAAG,CAAC,KAAK,EAAE,CAAC;gBAClB,MAAM,IAAI,OAAO,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,UAAU,CAAC,CAAC,EAAE,IAAI,CAAC,CAAC,CAAC;gBAC9C,MAAM;YACR,CAAC;QACH,CAAC;IACH,CAAC;IAAC,MAAM,CAAC;QACP,sDAAsD;IACxD,CAAC;IAED,MAAM,UAAU,GAAG,MAAM,IAAI,CAAC,QAAQ,CAAC,CAAC,KAAa,EAAc,EAAE;QACnE,MAAM,OAAO,GAAG,CAAC,SAAmB,EAAU,EAAE;YAC9C,KAAK,MAAM,GAAG,IAAI,SAAS,EAAE,CAAC;gBAC5B,MAAM,EAAE,GAAG,QAAQ,CAAC,aAAa,CAAC,GAAG,CAAC,CAAC;gBACvC,IAAI,EAAE,EAAE,WAAW,EAAE,IAAI,EAAE;oBAAE,OAAO,EAAE,CAAC,WAAW,CAAC,IAAI,EAAE,CAAC;YAC5D,CAAC;YACD,OAAO,GAAG,CAAC;QACb,CAAC,CAAC;QAEF,MAAM,SAAS,GAAG,OAAO,CAAC;YACxB,mCAAmC;YACnC,iCAAiC;YACjC,oBAAoB;YACpB,eAAe;SAChB,CAAC,CAAC;QAEH,MAAM,cAAc,GAAG,OAAO,CAAC;YAC7B,uCAAuC;YACvC,sCAAsC;YACtC,wBAAwB;YACxB,oBAAoB;SACrB,CAAC,CAAC;QAEH,MAAM,kBAAkB,GAAG,OAAO,CAAC;YACjC,2CAA2C;YAC3C,+BAA+B;YAC/B,kCAAkC;SACnC,CAAC,IAAI,SAAS,CAAC;QAEhB,MAAM,eAAe,GAAG,OAAO,CAAC;YAC9B,wBAAwB;YACxB,yBAAyB;YACzB,2BAA2B;SAC5B,CAAC,CAAC;QAEH,MAAM,aAAa,GAAG,OAAO,CAAC;YAC5B,0BAA0B;YAC1B,qBAAqB;YACrB,uBAAuB;YACvB,6BAA6B;SAC9B,CAAC,CAAC;QAEH,OAAO;YACL,QAAQ,EAAE,KAAK;YACf,SAAS;YACT,cAAc;YACd,kBAAkB;YAClB,eAAe;YACf,aAAa;YACb,SAAS,EAAE,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE;SACpC,CAAC;IACJ,CAAC,EAAE,QAAQ,CAAC,CAAC;IAEb,OAAO,CAAC,GAAG,CACT,IAAI,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,qBAAqB,QAAQ,UAAU,UAAU,CAAC,SAAS,eAAe,UAAU,CAAC,cAAc,EAAE,CAClI,CAAC;IACF,OAAO,UAAU,CAAC;AACpB,CAAC;AA3FD,4CA2FC"}

package/dist/index.d.ts

@@ -0,0 +1,3 @@
+#!/usr/bin/env node
+export {};
+//# sourceMappingURL=index.d.ts.map

package/dist/index.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../src/index.ts"],"names":[],"mappings":""}

package/dist/index.js

@@ -0,0 +1,108 @@
+#!/usr/bin/env node
+"use strict";
+Object.defineProperty(exports, "__esModule", { value: true });
+const redis_1 = require("./redis");
+const browser_1 = require("./browser");
+const messages_1 = require("./messages");
+const profiles_1 = require("./profiles");
+const financials_1 = require("./financials");
+const POLL_INTERVAL_MS = parseInt(process.env.POLL_INTERVAL_MS ?? '30000', 10);
+const RATE_LIMIT_MS = 2000;
+async function sleep(ms) {
+    return new Promise((resolve) => setTimeout(resolve, ms));
+}
+async function processMessage(page, messageId, fromUsername, text, timestamp, threadId) {
+    const ts = new Date().toISOString();
+    console.log(`[${ts}] Processing message ${messageId} from @${fromUsername}`);
+    await (0, redis_1.xadd)('of:messages', {
+        messageId,
+        fromUsername,
+        text,
+        timestamp,
+        threadId,
+    });
+    await sleep(RATE_LIMIT_MS);
+    const profile = await (0, profiles_1.scrapeProfile)(page, fromUsername);
+    if (profile) {
+        await (0, redis_1.xadd)('of:profiles', {
+            username: profile.username,
+            displayName: profile.displayName,
+            isSubscribed: String(profile.isSubscribed),
+            profilePic: profile.profilePic,
+            bio: profile.bio,
+            fetchedAt: profile.fetchedAt,
+        });
+    }
+    await sleep(RATE_LIMIT_MS);
+    const financials = await (0, financials_1.scrapeFinancials)(page, fromUsername, threadId);
+    if (financials) {
+        await (0, redis_1.xadd)('of:financials', {
+            username: financials.username,
+            totalTips: financials.totalTips,
+            totalPurchases: financials.totalPurchases,
+            subscriptionStatus: financials.subscriptionStatus,
+            lastPaymentDate: financials.lastPaymentDate,
+            lifetimeValue: financials.lifetimeValue,
+            updatedAt: financials.updatedAt,
+        });
+    }
+}
+async function pollLoop(browser, page) {
+    while (true) {
+        const loopStart = new Date().toISOString();
+        console.log(`[${loopStart}] Starting poll cycle`);
+        try {
+            const messages = await (0, messages_1.scrapeNewMessages)(page);
+            for (const msg of messages) {
+                const seen = await (0, redis_1.isSeen)(msg.messageId);
+                if (seen) {
+                    continue;
+                }
+                await (0, redis_1.markSeen)(msg.messageId);
+                await processMessage(page, msg.messageId, msg.fromUsername, msg.text, msg.timestamp, msg.threadId);
+            }
+        }
+        catch (err) {
+            console.error(`[${new Date().toISOString()}] Poll cycle error:`, err);
+            try {
+                await (0, browser_1.takeErrorScreenshot)(page);
+            }
+            catch {
+                // ignore screenshot errors
+            }
+        }
+        console.log(`[${new Date().toISOString()}] Poll cycle complete — sleeping ${POLL_INTERVAL_MS}ms`);
+        await sleep(POLL_INTERVAL_MS);
+    }
+}
+async function main() {
+    console.log(`[${new Date().toISOString()}] of-scraper starting up`);
+    console.log(`[${new Date().toISOString()}] POLL_INTERVAL_MS=${POLL_INTERVAL_MS}`);
+    await (0, redis_1.connectRedis)();
+    let browser = null;
+    let page = null;
+    try {
+        browser = await (0, browser_1.launchBrowser)();
+        page = await (0, browser_1.ensureLoggedIn)(browser);
+    }
+    catch (err) {
+        console.error(`[${new Date().toISOString()}] Failed to launch browser or log in:`, err);
+        if (browser)
+            await browser.close().catch(() => { });
+        process.exit(1);
+    }
+    const shutdown = async () => {
+        console.log(`[${new Date().toISOString()}] Shutting down...`);
+        if (browser)
+            await browser.close().catch(() => { });
+        process.exit(0);
+    };
+    process.on('SIGINT', () => { shutdown().catch(console.error); });
+    process.on('SIGTERM', () => { shutdown().catch(console.error); });
+    await pollLoop(browser, page);
+}
+main().catch((err) => {
+    console.error(`[${new Date().toISOString()}] Fatal error:`, err);
+    process.exit(1);
+});
+//# sourceMappingURL=index.js.map

package/dist/index.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"index.js","sourceRoot":"","sources":["../src/index.ts"],"names":[],"mappings":";;;AACA,mCAA+D;AAC/D,uCAA+E;AAC/E,yCAA+C;AAC/C,yCAA2C;AAC3C,6CAAgD;AAGhD,MAAM,gBAAgB,GAAG,QAAQ,CAAC,OAAO,CAAC,GAAG,CAAC,gBAAgB,IAAI,OAAO,EAAE,EAAE,CAAC,CAAC;AAC/E,MAAM,aAAa,GAAG,IAAI,CAAC;AAE3B,KAAK,UAAU,KAAK,CAAC,EAAU;IAC7B,OAAO,IAAI,OAAO,CAAC,CAAC,OAAO,EAAE,EAAE,CAAC,UAAU,CAAC,OAAO,EAAE,EAAE,CAAC,CAAC,CAAC;AAC3D,CAAC;AAED,KAAK,UAAU,cAAc,CAC3B,IAAU,EACV,SAAiB,EACjB,YAAoB,EACpB,IAAY,EACZ,SAAiB,EACjB,QAAgB;IAEhB,MAAM,EAAE,GAAG,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,CAAC;IACpC,OAAO,CAAC,GAAG,CAAC,IAAI,EAAE,wBAAwB,SAAS,UAAU,YAAY,EAAE,CAAC,CAAC;IAE7E,MAAM,IAAA,YAAI,EAAC,aAAa,EAAE;QACxB,SAAS;QACT,YAAY;QACZ,IAAI;QACJ,SAAS;QACT,QAAQ;KACT,CAAC,CAAC;IAEH,MAAM,KAAK,CAAC,aAAa,CAAC,CAAC;IAE3B,MAAM,OAAO,GAAG,MAAM,IAAA,wBAAa,EAAC,IAAI,EAAE,YAAY,CAAC,CAAC;IACxD,IAAI,OAAO,EAAE,CAAC;QACZ,MAAM,IAAA,YAAI,EAAC,aAAa,EAAE;YACxB,QAAQ,EAAE,OAAO,CAAC,QAAQ;YAC1B,WAAW,EAAE,OAAO,CAAC,WAAW;YAChC,YAAY,EAAE,MAAM,CAAC,OAAO,CAAC,YAAY,CAAC;YAC1C,UAAU,EAAE,OAAO,CAAC,UAAU;YAC9B,GAAG,EAAE,OAAO,CAAC,GAAG;YAChB,SAAS,EAAE,OAAO,CAAC,SAAS;SAC7B,CAAC,CAAC;IACL,CAAC;IAED,MAAM,KAAK,CAAC,aAAa,CAAC,CAAC;IAE3B,MAAM,UAAU,GAAG,MAAM,IAAA,6BAAgB,EAAC,IAAI,EAAE,YAAY,EAAE,QAAQ,CAAC,CAAC;IACxE,IAAI,UAAU,EAAE,CAAC;QACf,MAAM,IAAA,YAAI,EAAC,eAAe,EAAE;YAC1B,QAAQ,EAAE,UAAU,CAAC,QAAQ;YAC7B,SAAS,EAAE,UAAU,CAAC,SAAS;YAC/B,cAAc,EAAE,UAAU,CAAC,cAAc;YACzC,kBAAkB,EAAE,UAAU,CAAC,kBAAkB;YACjD,eAAe,EAAE,UAAU,CAAC,eAAe;YAC3C,aAAa,EAAE,UAAU,CAAC,aAAa;YACvC,SAAS,EAAE,UAAU,CAAC,SAAS;SAChC,CAAC,CAAC;IACL,CAAC;AACH,CAAC;AAED,KAAK,UAAU,QAAQ,CAAC,OAAgB,EAAE,IAAU;IAClD,OAAO,IAAI,EAAE,CAAC;QACZ,MAAM,SAAS,GAAG,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,CAAC;QAC3C,OAAO,CAAC,GAAG,CAAC,IAAI,SAAS,uBAAuB,CAAC,CAAC;QAElD,IAAI,CAAC;YACH,MAAM,QAAQ,GAAG,MAAM,IAAA,4BAAiB,EAAC,IAAI,CAAC,CAAC;YAE/C,KAAK,MAAM,GAAG,IAAI,QAAQ,EAAE,CAAC;gBAC3B,MAAM,IAAI,GAAG,MAAM,IAAA,cAAM,EAAC,GAAG,CAAC,SAAS,CAAC,CAAC;gBACzC,IAAI,IAAI,EAAE,CAAC;oBACT,SAAS;gBACX,CAAC;gBAED,MAAM,IAAA,gBAAQ,EAAC,GAAG,CAAC,SAAS,CAAC,CAAC;gBAC9B,MAAM,cAAc,CAClB,IAAI,EACJ,GAAG,CAAC,SAAS,EACb,GAAG,CAAC,YAAY,EAChB,GAAG,CAAC,IAAI,EACR,GAAG,CAAC,SAAS,EACb,GAAG,CAAC,QAAQ,CACb,CAAC;YACJ,CAAC;QACH,CAAC;QAAC,OAAO,GAAG,EAAE,CAAC;YACb,OAAO,CAAC,KAAK,CAAC,IAAI,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,qBAAqB,EAAE,GAAG,CAAC,CAAC;YACtE,IAAI,CAAC;gBACH,MAAM,IAAA,6BAAmB,EAAC,IAAI,CAAC,CAAC;YAClC,CAAC;YAAC,MAAM,CAAC;gBACP,2BAA2B;YAC7B,CAAC;QACH,CAAC;QAED,OAAO,CAAC,GAAG,CAAC,IAAI,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,oCAAoC,gBAAgB,IAAI,CAAC,CAAC;QAClG,MAAM,KAAK,CAAC,gBAAgB,CAAC,CAAC;IAChC,CAAC;AACH,CAAC;AAED,KAAK,UAAU,IAAI;IACjB,OAAO,CAAC,GAAG,CAAC,IAAI,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,0BAA0B,CAAC,CAAC;IACpE,OAAO,CAAC,GAAG,CAAC,IAAI,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,sBAAsB,gBAAgB,EAAE,CAAC,CAAC;IAElF,MAAM,IAAA,oBAAY,GAAE,CAAC;IAErB,IAAI,OAAO,GAAmB,IAAI,CAAC;IACnC,IAAI,IAAI,GAAgB,IAAI,CAAC;IAE7B,IAAI,CAAC;QACH,OAAO,GAAG,MAAM,IAAA,uBAAa,GAAE,CAAC;QAChC,IAAI,GAAG,MAAM,IAAA,wBAAc,EAAC,OAAO,CAAC,CAAC;IACvC,CAAC;IAAC,OAAO,GAAG,EAAE,CAAC;QACb,OAAO,CAAC,KAAK,CAAC,IAAI,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,uCAAuC,EAAE,GAAG,CAAC,CAAC;QACxF,IAAI,OAAO;YAAE,MAAM,OAAO,CAAC,KAAK,EAAE,CAAC,KAAK,CAAC,GAAG,EAAE,GAAE,CAAC,CAAC,CAAC;QACnD,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;IAClB,CAAC;IAED,MAAM,QAAQ,GAAG,KAAK,IAAmB,EAAE;QACzC,OAAO,CAAC,GAAG,CAAC,IAAI,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,oBAAoB,CAAC,CAAC;QAC9D,IAAI,OAAO;YAAE,MAAM,OAAO,CAAC,KAAK,EAAE,CAAC,KAAK,CAAC,GAAG,EAAE,GAAE,CAAC,CAAC,CAAC;QACnD,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;IAClB,CAAC,CAAC;IAEF,OAAO,CAAC,EAAE,CAAC,QAAQ,EAAE,GAAG,EAAE,GAAG,QAAQ,EAAE,CAAC,KAAK,CAAC,OAAO,CAAC,KAAK,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC;IACjE,OAAO,CAAC,EAAE,CAAC,SAAS,EAAE,GAAG,EAAE,GAAG,QAAQ,EAAE,CAAC,KAAK,CAAC,OAAO,CAAC,KAAK,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC;IAElE,MAAM,QAAQ,CAAC,OAAO,EAAE,IAAI,CAAC,CAAC;AAChC,CAAC;AAED,IAAI,EAAE,CAAC,KAAK,CAAC,CAAC,GAAG,EAAE,EAAE;IACnB,OAAO,CAAC,KAAK,CAAC,IAAI,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,gBAAgB,EAAE,GAAG,CAAC,CAAC;IACjE,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;AAClB,CAAC,CAAC,CAAC"}

package/dist/messages.d.ts

@@ -0,0 +1,11 @@
+import type { Page } from 'puppeteer';
+export interface Message {
+    messageId: string;
+    fromUsername: string;
+    text: string;
+    timestamp: string;
+    threadId: string;
+}
+export declare function scrapeNewMessages(page: Page): Promise<Message[]>;
+export declare function scrapeThreadMessages(page: Page, threadId: string): Promise<Message[]>;
+//# sourceMappingURL=messages.d.ts.map

package/dist/messages.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"messages.d.ts","sourceRoot":"","sources":["../src/messages.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,EAAE,IAAI,EAAE,MAAM,WAAW,CAAC;AAEtC,MAAM,WAAW,OAAO;IACtB,SAAS,EAAE,MAAM,CAAC;IAClB,YAAY,EAAE,MAAM,CAAC;IACrB,IAAI,EAAE,MAAM,CAAC;IACb,SAAS,EAAE,MAAM,CAAC;IAClB,QAAQ,EAAE,MAAM,CAAC;CAClB;AAED,wBAAsB,iBAAiB,CAAC,IAAI,EAAE,IAAI,GAAG,OAAO,CAAC,OAAO,EAAE,CAAC,CAmFtE;AAED,wBAAsB,oBAAoB,CAAC,IAAI,EAAE,IAAI,EAAE,QAAQ,EAAE,MAAM,GAAG,OAAO,CAAC,OAAO,EAAE,CAAC,CAmE3F"}