freshcontext-mcp 0.1.6 → 0.1.8

package/README.md

@@ -41,31 +41,41 @@ The AI agent always knows **when it's looking at data**, not just what the data
 | `extract_github` | README, stars, forks, language, topics, last commit from any GitHub repo |
 | `extract_hackernews` | Top stories or search results from HN with scores and timestamps |
 | `extract_scholar` | Research paper titles, authors, years, and snippets from Google Scholar |
+| `extract_reddit` | Posts and community sentiment from any subreddit or Reddit search |
 
 ### 🚀 Competitive Intelligence Tools
 
 | Tool | Description |
 |---|---|
 | `extract_yc` | Scrape YC company listings by keyword — find who's funded in your space |
+| `extract_producthunt` | Recent Product Hunt launches by keyword or topic |
 | `search_repos` | Search GitHub for similar/competing repos, ranked by stars with activity signals |
 | `package_trends` | npm and PyPI package metadata — version history, release cadence, last updated |
 
+### 📈 Market Data
+
+| Tool | Description |
+|---|---|
+| `extract_finance` | Live stock data via Yahoo Finance — price, market cap, P/E, 52w range, sector, company summary |
+
 ### 🗺️ Composite Tool
 
 | Tool | Description |
 |---|---|
-| `extract_landscape` | **One call. Full picture.** Queries YC startups + GitHub repos + HN sentiment + package ecosystem simultaneously. Returns a unified landscape report. |
+| `extract_landscape` | **One call. Full picture.** Queries YC + GitHub + HN + npm/PyPI simultaneously. Returns a unified timestamped landscape report. |
 
 ---
 
 ## Quick Start
 
-### Option A — Cloud (no install, works immediately)
+### Option A — Cloud (recommended, no install needed)
+
+Visit **[freshcontext-site.pages.dev](https://freshcontext-site.pages.dev)** for a guided 3-step install with copy-paste config. No terminal, no downloads, no antivirus alerts.
 
-No Node, no Playwright, nothing to install. Just add this to your Claude Desktop config and restart.
+Or add this manually to your Claude Desktop config and restart:
 
-**Mac:** open `~/Library/Application Support/Claude/claude_desktop_config.json`
-**Windows:** open `%APPDATA%\Claude\claude_desktop_config.json`
+**Mac:** `~/Library/Application Support/Claude/claude_desktop_config.json`
+**Windows:** `%APPDATA%\Claude\claude_desktop_config.json`
 
 ```json
 {
@@ -80,11 +90,11 @@ No Node, no Playwright, nothing to install. Just add this to your Claude Desktop
 
 Restart Claude Desktop. The freshcontext tools will appear in your session.
 
-> **Note:** If `claude_desktop_config.json` doesn't exist yet, create it with the content above.
+> If `claude_desktop_config.json` doesn't exist yet, create it with the content above.
 
 ---
 
-### Option B — Local (full Playwright, faster for heavy use)
+### Option B — Local (full Playwright, for heavy use)
 
 **Prerequisites:** Node.js 18+ ([nodejs.org](https://nodejs.org))
 
@@ -98,7 +108,7 @@ npm run build
 
 Then add to your Claude Desktop config:
 
-**Mac** (`~/Library/Application Support/Claude/claude_desktop_config.json`):
+**Mac:**
 ```json
 {
   "mcpServers": {
@@ -110,7 +120,7 @@ Then add to your Claude Desktop config:
 }
 ```
 
-**Windows** (`%APPDATA%\Claude\claude_desktop_config.json`):
+**Windows:**
 ```json
 {
   "mcpServers": {
@@ -122,58 +132,48 @@ Then add to your Claude Desktop config:
 }
 ```
 
-Restart Claude Desktop.
-
 ---
 
 ### Troubleshooting (Mac)
 
-**"command not found: node"** — Node isn't on your PATH inside Claude Desktop's environment. Use the full path:
+**"command not found: node"** — Node isn't on Claude Desktop's PATH. Use the full path:
 ```bash
 which node   # copy this output
 ```
-Then replace `"command": "node"` with `"command": "/usr/local/bin/node"` (or whatever `which node` returned).
+Replace `"command": "node"` with `"command": "/usr/local/bin/node"` (or whatever `which node` returned).
 
-**"npx: command not found"** — Same issue. Run `which npx` and use the full path for Option A:
-```json
-"command": "/usr/local/bin/npx"
-```
+**"npx: command not found"** — Same fix. Run `which npx` and use the full path.
 
-**Config file doesn't exist** — Create it. On Mac:
+**Config file doesn't exist** — Create it:
 ```bash
 mkdir -p ~/Library/Application\ Support/Claude
 touch ~/Library/Application\ Support/Claude/claude_desktop_config.json
 ```
-Then paste the config JSON above into it.
 
 ---
 
 ## Usage Examples
 
 ### Check if anyone is already building what you're building
-
 ```
 Use extract_landscape with topic "cashflow prediction mcp"
 ```
-
 Returns a unified report: who's funded (YC), what's trending (HN), what repos exist (GitHub), what packages are active (npm/PyPI). All timestamped.
 
-### Analyse a specific repo
-
+### Get community sentiment on a topic
 ```
-Use extract_github on https://github.com/anthropics/anthropic-sdk-python
+Use extract_reddit with url "r/MachineLearning"
+Use extract_hackernews with url "https://hn.algolia.com/api/v1/search?query=mcp+server&tags=story"
 ```
 
-### Find research papers on a topic
-
+### Check a company's stock
 ```
-Use extract_scholar on https://scholar.google.com/scholar?q=llm+context+freshness
+Use extract_finance with url "NVDA,MSFT,GOOG"
 ```
 
-### Check package ecosystem health
-
+### Find what just launched in your space
 ```
-Use package_trends with packages "npm:@modelcontextprotocol/sdk,pypi:langchain"
+Use extract_producthunt with url "AI developer tools"
 ```
 
 ---
@@ -189,24 +189,14 @@ FreshContext treats **retrieval time as first-class metadata**. Every adapter re
 - `freshness_confidence` — `high`, `medium`, or `low` based on signal quality
 - `adapter` — which source the data came from
 
-This makes freshness **verifiable**, not assumed.
-
 ---
 
-## Deployment
-
-### Local (Playwright-based)
-Uses headless Chromium via Playwright. Full browser rendering for JavaScript-heavy sites.
+## Security
 
-### Cloud (Cloudflare Workers)
-The `worker/` directory contains a Cloudflare Workers deployment. No Playwright dependency — runs at the edge globally.
-
-```bash
-cd worker
-npm install
-npx wrangler secret put API_KEY
-npx wrangler deploy
-```
+- Input sanitization and domain allowlists on all adapters
+- SSRF prevention (blocked private IP ranges)
+- KV-backed global rate limiting: 60 requests/minute per IP across all edge nodes
+- No credentials required for public data sources
 
 ---
 
@@ -217,17 +207,20 @@ freshcontext-mcp/
 ├── src/
 │   ├── server.ts              # MCP server, all tool registrations
 │   ├── types.ts               # FreshContext interfaces
-│   ├── security.ts            # Input validation, domain allowlists
+│   ├── security.ts            # Input validation, domain allowlists, SSRF prevention
 │   ├── adapters/
 │   │   ├── github.ts
 │   │   ├── hackernews.ts
 │   │   ├── scholar.ts
 │   │   ├── yc.ts
 │   │   ├── repoSearch.ts
-│   │   └── packageTrends.ts
+│   │   ├── packageTrends.ts
+│   │   ├── reddit.ts
+│   │   ├── productHunt.ts
+│   │   └── finance.ts
 │   └── tools/
 │       └── freshnessStamp.ts
-└── worker/                    # Cloudflare Workers deployment
+└── worker/                    # Cloudflare Workers deployment (all 10 tools)
     └── src/worker.ts
 ```
 
@@ -243,9 +236,11 @@ freshcontext-mcp/
 - [x] npm/PyPI package trends
 - [x] `extract_landscape` composite tool
 - [x] Cloudflare Workers deployment
-- [x] Worker auth + rate limiting + domain allowlists
-- [ ] Product Hunt launches adapter
-- [ ] Finance/market data adapter
+- [x] Worker auth + KV-backed global rate limiting
+- [x] Reddit community sentiment adapter
+- [x] Product Hunt launches adapter
+- [x] Yahoo Finance market data adapter
+- [ ] `extract_arxiv` — structured arXiv API (more reliable than Scholar)
 - [ ] TTL-based caching layer
 - [ ] `freshness_score` numeric metric
 

package/dist/adapters/arxiv.js

@@ -0,0 +1,66 @@
+/**
+ * arXiv adapter — uses the official arXiv API (no scraping, no auth needed).
+ * Accepts a search query or a direct arXiv API URL.
+ * Docs: https://arxiv.org/help/api/user-manual
+ */
+export async function arxivAdapter(options) {
+    const input = options.url.trim();
+    // Build API URL — if they pass a plain query, construct it
+    const apiUrl = input.startsWith("http")
+        ? input
+        : `https://export.arxiv.org/api/query?search_query=all:${encodeURIComponent(input)}&start=0&max_results=10&sortBy=relevance&sortOrder=descending`;
+    const res = await fetch(apiUrl, {
+        headers: { "User-Agent": "freshcontext-mcp/0.1.7 (https://github.com/PrinceGabriel-lgtm/freshcontext-mcp)" },
+    });
+    if (!res.ok)
+        throw new Error(`arXiv API error: ${res.status} ${res.statusText}`);
+    const xml = await res.text();
+    // Parse the Atom XML response
+    const entries = [...xml.matchAll(/<entry>([\s\S]*?)<\/entry>/g)];
+    if (!entries.length) {
+        return { raw: "No results found for this query.", content_date: null, freshness_confidence: "low" };
+    }
+    const getTag = (block, tag) => {
+        const m = block.match(new RegExp(`<${tag}[^>]*>([\\s\\S]*?)<\\/${tag}>`, "i"));
+        return m ? m[1].trim().replace(/\s+/g, " ") : "";
+    };
+    const getAttr = (block, tag, attr) => {
+        const m = block.match(new RegExp(`<${tag}[^>]*${attr}="([^"]*)"`, "i"));
+        return m ? m[1].trim() : "";
+    };
+    const papers = entries.map((match, i) => {
+        const block = match[1];
+        const title = getTag(block, "title").replace(/\n/g, " ");
+        const summary = getTag(block, "summary").slice(0, 300).replace(/\n/g, " ");
+        const published = getTag(block, "published").slice(0, 10); // YYYY-MM-DD
+        const updated = getTag(block, "updated").slice(0, 10);
+        const id = getTag(block, "id").replace("http://arxiv.org/abs/", "https://arxiv.org/abs/");
+        // Authors — can be multiple
+        const authorMatches = [...block.matchAll(/<author>([\s\S]*?)<\/author>/g)];
+        const authors = authorMatches
+            .map(a => getTag(a[1], "name"))
+            .filter(Boolean)
+            .slice(0, 4)
+            .join(", ");
+        // Categories
+        const primaryCat = getAttr(block, "arxiv:primary_category", "term") ||
+            getAttr(block, "category", "term");
+        return [
+            `[${i + 1}] ${title}`,
+            `Authors: ${authors || "Unknown"}`,
+            `Published: ${published}${updated !== published ? ` (updated ${updated})` : ""}`,
+            primaryCat ? `Category: ${primaryCat}` : null,
+            `Abstract: ${summary}…`,
+            `Link: ${id}`,
+        ].filter(Boolean).join("\n");
+    });
+    const raw = papers.join("\n\n").slice(0, options.maxLength ?? 6000);
+    // Most recent publication date
+    const dates = entries
+        .map(m => getTag(m[1], "published").slice(0, 10))
+        .filter(Boolean)
+        .sort()
+        .reverse();
+    const content_date = dates[0] ?? null;
+    return { raw, content_date, freshness_confidence: content_date ? "high" : "medium" };
+}

package/dist/server.js

@@ -124,10 +124,10 @@ server.registerTool("package_trends", {
 });
 // ─── Tool: extract_landscape ─────────────────────────────────────────────────
 server.registerTool("extract_landscape", {
-    description: "Composite intelligence tool. Given a project idea or keyword, simultaneously queries YC startups, GitHub repos, HN sentiment, and package activity to answer: Who is building this? Is it funded? What's getting traction? Returns a unified timestamped landscape report.",
+    description: "Composite intelligence tool. Given a project idea or keyword, simultaneously queries YC startups, GitHub repos, HN, Reddit, Product Hunt, and package registries to answer: Who is building this? Is it funded? What's getting traction? Returns a unified 6-source timestamped landscape report.",
     inputSchema: z.object({
         topic: z.string().describe("Your project idea or keyword e.g. 'mcp server' or 'cashflow prediction'"),
-        max_length: z.number().optional().default(8000),
+        max_length: z.number().optional().default(10000),
     }),
     annotations: { readOnlyHint: true, openWorldHint: true },
 }, async ({ topic, max_length }) => {

package/package.json

@@ -1,6 +1,7 @@
 {
   "name": "freshcontext-mcp",
-  "version": "0.1.6",
+  "mcpName": "io.github.PrinceGabriel-lgtm/freshcontext",
+  "version": "0.1.8",
   "description": "Real-time web extraction MCP server with freshness timestamps for AI agents",
   "keywords": [
     "mcp",
@@ -49,3 +50,6 @@
   }
 }
 
+
+
+

package/server.json

@@ -0,0 +1,28 @@
+{
+  "$schema": "https://static.modelcontextprotocol.io/schemas/2025-07-09/server.schema.json",
+  "name": "io.github.PrinceGabriel-lgtm/freshcontext",
+  "description": "Real-time web intelligence for AI agents. 11 tools, no API keys. GitHub, HN, Reddit, arXiv & more.",
+  "repository": {
+    "url": "https://github.com/PrinceGabriel-lgtm/freshcontext-mcp",
+    "source": "github"
+  },
+  "version": "0.1.7",
+  "website_url": "https://freshcontext-site.pages.dev",
+  "packages": [
+    {
+      "registry_type": "npm",
+      "registry_base_url": "https://registry.npmjs.org",
+      "identifier": "freshcontext-mcp",
+      "version": "0.1.7",
+      "transport": {
+        "type": "stdio"
+      }
+    }
+  ],
+  "remotes": [
+    {
+      "type": "streamable-http",
+      "url": "https://freshcontext-mcp.gimmanuel73.workers.dev/mcp"
+    }
+  ]
+}

package/.env.example

@@ -1,8 +0,0 @@
-# freshcontext-mcp environment variables
-# Copy to .env and fill in
-
-# Optional: GitHub Personal Access Token (increases rate limits for GitHub API fallback)
-GITHUB_TOKEN=
-
-# Optional: Proxy URL if needed for certain extractions
-# PROXY_URL=http://user:pass@host:port

package/src/adapters/finance.ts

@@ -1,159 +0,0 @@
-import { AdapterResult, ExtractOptions } from "../types.js";
-
-/**
- * Finance adapter — Yahoo Finance public API, no auth required.
- * Accepts:
- *   - A ticker symbol e.g. "AAPL" or "MSFT,GOOG"
- *   - A company name e.g. "Apple" (will search for ticker first)
- *   - Comma-separated tickers for comparison
- */
-
-interface YahooQuote {
-  symbol: string;
-  shortName?: string;
-  longName?: string;
-  regularMarketPrice?: number;
-  regularMarketChange?: number;
-  regularMarketChangePercent?: number;
-  marketCap?: number;
-  regularMarketVolume?: number;
-  fiftyTwoWeekHigh?: number;
-  fiftyTwoWeekLow?: number;
-  trailingPE?: number;
-  dividendYield?: number;
-  currency?: string;
-  exchangeName?: string;
-  regularMarketTime?: number;
-  longBusinessSummary?: string;
-  sector?: string;
-  industry?: string;
-  fullTimeEmployees?: number;
-  website?: string;
-}
-
-function formatMarketCap(cap: number | undefined): string {
-  if (!cap) return "N/A";
-  if (cap >= 1e12) return `$${(cap / 1e12).toFixed(2)}T`;
-  if (cap >= 1e9) return `$${(cap / 1e9).toFixed(2)}B`;
-  if (cap >= 1e6) return `$${(cap / 1e6).toFixed(2)}M`;
-  return `$${cap.toLocaleString()}`;
-}
-
-function formatChange(change: number | undefined, pct: number | undefined): string {
-  if (change === undefined || pct === undefined) return "N/A";
-  const sign = change >= 0 ? "+" : "";
-  return `${sign}${change.toFixed(2)} (${sign}${pct.toFixed(2)}%)`;
-}
-
-export async function financeAdapter(options: ExtractOptions): Promise<AdapterResult> {
-  const input = options.url.trim();
-
-  // Support comma-separated tickers
-  const rawTickers = input
-    .split(",")
-    .map((t) => t.trim().toUpperCase())
-    .filter(Boolean)
-    .slice(0, 5); // max 5 at once
-
-  const results: string[] = [];
-  let latestTimestamp: number | null = null;
-
-  for (const ticker of rawTickers) {
-    try {
-      const quoteData = await fetchQuote(ticker);
-      if (quoteData) {
-        results.push(formatQuote(quoteData));
-        if (quoteData.regularMarketTime) {
-          latestTimestamp = Math.max(latestTimestamp ?? 0, quoteData.regularMarketTime);
-        }
-      }
-    } catch (err) {
-      results.push(`[${ticker}] Error: ${err instanceof Error ? err.message : String(err)}`);
-    }
-  }
-
-  const raw = results.join("\n\n─────────────────────────────\n\n").slice(0, options.maxLength ?? 5000);
-  const content_date = latestTimestamp
-    ? new Date(latestTimestamp * 1000).toISOString()
-    : new Date().toISOString();
-
-  return { raw, content_date, freshness_confidence: "high" };
-}
-
-async function fetchQuote(ticker: string): Promise<YahooQuote | null> {
-  // v7 quote endpoint — public, no auth
-  const quoteUrl = `https://query1.finance.yahoo.com/v7/finance/quote?symbols=${encodeURIComponent(ticker)}&fields=shortName,longName,regularMarketPrice,regularMarketChange,regularMarketChangePercent,marketCap,regularMarketVolume,fiftyTwoWeekHigh,fiftyTwoWeekLow,trailingPE,dividendYield,currency,exchangeName,regularMarketTime`;
-
-  const quoteRes = await fetch(quoteUrl, {
-    headers: {
-      "User-Agent": "Mozilla/5.0 (compatible; freshcontext-mcp/0.1.5)",
-      "Accept": "application/json",
-    },
-  });
-
-  if (!quoteRes.ok) throw new Error(`Yahoo Finance API error: ${quoteRes.status}`);
-
-  const quoteJson = await quoteRes.json() as {
-    quoteResponse?: { result?: YahooQuote[] };
-  };
-
-  const quote = quoteJson?.quoteResponse?.result?.[0];
-  if (!quote) throw new Error(`No data found for ticker: ${ticker}`);
-
-  // Optionally fetch company summary (v11 quoteSummary)
-  try {
-    const summaryUrl = `https://query1.finance.yahoo.com/v11/finance/quoteSummary/${encodeURIComponent(ticker)}?modules=assetProfile`;
-    const summaryRes = await fetch(summaryUrl, {
-      headers: { "User-Agent": "Mozilla/5.0 (compatible; freshcontext-mcp/0.1.5)" },
-    });
-    if (summaryRes.ok) {
-      const summaryJson = await summaryRes.json() as {
-        quoteSummary?: { result?: Array<{ assetProfile?: YahooQuote }> };
-      };
-      const profile = summaryJson?.quoteSummary?.result?.[0]?.assetProfile;
-      if (profile) {
-        Object.assign(quote, {
-          longBusinessSummary: profile.longBusinessSummary,
-          sector: profile.sector,
-          industry: profile.industry,
-          fullTimeEmployees: profile.fullTimeEmployees,
-          website: profile.website,
-        });
-      }
-    }
-  } catch {
-    // Summary is optional — continue without it
-  }
-
-  return quote;
-}
-
-function formatQuote(q: YahooQuote): string {
-  const lines = [
-    `${q.symbol} — ${q.longName ?? q.shortName ?? "Unknown"}`,
-    `Exchange: ${q.exchangeName ?? "N/A"} · Currency: ${q.currency ?? "USD"}`,
-    "",
-    `Price:       ${q.regularMarketPrice !== undefined ? `$${q.regularMarketPrice.toFixed(2)}` : "N/A"}`,
-    `Change:      ${formatChange(q.regularMarketChange, q.regularMarketChangePercent)}`,
-    `Market Cap:  ${formatMarketCap(q.marketCap)}`,
-    `Volume:      ${q.regularMarketVolume?.toLocaleString() ?? "N/A"}`,
-    `52w High:    ${q.fiftyTwoWeekHigh !== undefined ? `$${q.fiftyTwoWeekHigh.toFixed(2)}` : "N/A"}`,
-    `52w Low:     ${q.fiftyTwoWeekLow !== undefined ? `$${q.fiftyTwoWeekLow.toFixed(2)}` : "N/A"}`,
-    `P/E Ratio:   ${q.trailingPE !== undefined ? q.trailingPE.toFixed(2) : "N/A"}`,
-    `Div Yield:   ${q.dividendYield !== undefined ? `${(q.dividendYield * 100).toFixed(2)}%` : "N/A"}`,
-  ];
-
-  if (q.sector || q.industry) {
-    lines.push("");
-    if (q.sector) lines.push(`Sector:      ${q.sector}`);
-    if (q.industry) lines.push(`Industry:    ${q.industry}`);
-    if (q.fullTimeEmployees) lines.push(`Employees:   ${q.fullTimeEmployees.toLocaleString()}`);
-    if (q.website) lines.push(`Website:     ${q.website}`);
-  }
-
-  if (q.longBusinessSummary) {
-    lines.push("", "About:", q.longBusinessSummary.slice(0, 500) + (q.longBusinessSummary.length > 500 ? "…" : ""));
-  }
-
-  return lines.join("\n");
-}

package/src/adapters/github.ts

@@ -1,54 +0,0 @@
-import { chromium } from "playwright";
-import { AdapterResult, ExtractOptions } from "../types.js";
-import { validateUrl } from "../security.js";
-
-export async function githubAdapter(options: ExtractOptions): Promise<AdapterResult> {
-  const safeUrl = validateUrl(options.url, "github");
-  options = { ...options, url: safeUrl };
-
-  const browser = await chromium.launch({ headless: true });
-  const page = await browser.newPage();
-
-  // Spoof a real browser UA to avoid bot detection
-  await page.setExtraHTTPHeaders({
-    "User-Agent":
-      "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36",
-  });
-
-  await page.goto(options.url, { waitUntil: "domcontentloaded", timeout: 20000 });
-
-  // Extract key repo signals — no inner functions to avoid esbuild __name injection
-  const data = await page.evaluate(`(function() {
-    var readme = (document.querySelector('[data-target="readme-toc.content"]') || document.querySelector('.markdown-body') || {}).textContent || null;
-    var starsEl = document.querySelector('[id="repo-stars-counter-star"]') || document.querySelector('.Counter.js-social-count');
-    var stars = starsEl ? starsEl.textContent.trim() : null;
-    var forksEl = document.querySelector('[id="repo-network-counter"]');
-    var forks = forksEl ? forksEl.textContent.trim() : null;
-    var commitEl = document.querySelector('relative-time');
-    var lastCommit = commitEl ? commitEl.getAttribute('datetime') : null;
-    var descEl = document.querySelector('.f4.my-3');
-    var description = descEl ? descEl.textContent.trim() : null;
-    var topics = Array.from(document.querySelectorAll('.topic-tag')).map(function(t) { return t.textContent.trim(); });
-    var langEl = document.querySelector('.color-fg-default.text-bold.mr-1');
-    var language = langEl ? langEl.textContent.trim() : null;
-    return { readme: readme, stars: stars, forks: forks, lastCommit: lastCommit, description: description, topics: topics, language: language };
-  })()`);
-  const typedData = data as { readme: string | null; stars: string | null; forks: string | null; lastCommit: string | null; description: string | null; topics: string[]; language: string | null };
-
-  await browser.close();
-
-  const raw = [
-    `Description: ${typedData.description ?? "N/A"}`,
-    `Stars: ${typedData.stars ?? "N/A"} | Forks: ${typedData.forks ?? "N/A"}`,
-    `Language: ${typedData.language ?? "N/A"}`,
-    `Last commit: ${typedData.lastCommit ?? "N/A"}`,
-    `Topics: ${typedData.topics?.join(", ") ?? "none"}`,
-    `\n--- README ---\n${typedData.readme ?? "No README found"}`,
-  ].join("\n");
-
-  return {
-    raw,
-    content_date: typedData.lastCommit ?? null,
-    freshness_confidence: typedData.lastCommit ? "high" : "medium",
-  };
-}

package/src/adapters/hackernews.ts

@@ -1,95 +0,0 @@
-import { chromium } from "playwright";
-import { AdapterResult, ExtractOptions } from "../types.js";
-import { validateUrl } from "../security.js";
-
-export async function hackerNewsAdapter(options: ExtractOptions): Promise<AdapterResult> {
-  // Validate URL — allow both HN and Algolia domains
-  validateUrl(options.url, "hackernews");
-  const url = options.url;
-
-  if (url.includes("hn.algolia.com/api/") || url.startsWith("hn-search:")) {
-    const query = url.startsWith("hn-search:")
-      ? url.replace("hn-search:", "").trim()
-      : url;
-
-    const apiUrl = url.includes("hn.algolia.com/api/")
-      ? url
-      : `https://hn.algolia.com/api/v1/search?query=${encodeURIComponent(query)}&tags=story&hitsPerPage=20`;
-
-    const res = await fetch(apiUrl);
-    if (!res.ok) throw new Error(`HN Algolia API error: ${res.status}`);
-    const data = await res.json() as {
-      hits: Array<{
-        title: string;
-        url: string | null;
-        points: number;
-        num_comments: number;
-        author: string;
-        created_at: string;
-        objectID: string;
-      }>;
-    };
-
-    const raw = data.hits
-      .map((r, i) =>
-        [
-          `[${i + 1}] ${r.title ?? "Untitled"}`,
-          `URL: ${r.url ?? `https://news.ycombinator.com/item?id=${r.objectID}`}`,
-          `Score: ${r.points} points | ${r.num_comments} comments`,
-          `Author: ${r.author} | Posted: ${r.created_at}`,
-        ].join("\n")
-      )
-      .join("\n\n")
-      .slice(0, options.maxLength ?? 4000);
-
-    const newest = data.hits.map((r) => r.created_at).sort().reverse()[0] ?? null;
-    return { raw, content_date: newest, freshness_confidence: newest ? "high" : "medium" };
-  }
-
-  // Default: browser-based scrape for HN front page or search pages
-  const browser = await chromium.launch({ headless: true });
-  const page = await browser.newPage();
-
-  await page.goto(url, { waitUntil: "domcontentloaded", timeout: 20000 });
-
-  const data = await page.evaluate(`(function() {
-    var items = Array.from(document.querySelectorAll('.athing')).slice(0, 20);
-    var results = items.map(function(el) {
-      var titleLineEl = el.querySelector('.titleline > a');
-      var title = titleLineEl ? titleLineEl.textContent.trim() : null;
-      var link = titleLineEl ? titleLineEl.getAttribute('href') : null;
-      var subtext = el.nextElementSibling;
-      var scoreEl = subtext ? subtext.querySelector('.score') : null;
-      var score = scoreEl ? scoreEl.textContent.trim() : null;
-      var ageEl = subtext ? subtext.querySelector('.age') : null;
-      var age = ageEl ? ageEl.getAttribute('title') : null;
-      var anchors = subtext ? subtext.querySelectorAll('a') : [];
-      var commentLink = anchors.length > 0 ? anchors[anchors.length - 1].textContent.trim() : null;
-      return { title: title, link: link, score: score, age: age, commentLink: commentLink };
-    });
-    return results;
-  })()`);
-
-  await browser.close();
-
-  const typedData = data as Array<{ title: string | null; link: string | null; score: string | null; age: string | null; commentLink: string | null }>;
-
-  const raw = typedData
-    .map((r, i) =>
-      [
-        `[${i + 1}] ${r.title ?? "Untitled"}`,
-        `URL: ${r.link ?? "N/A"}`,
-        `Score: ${r.score ?? "N/A"} | ${r.commentLink ?? ""}`,
-        `Posted: ${r.age ?? "unknown"}`,
-      ].join("\n")
-    )
-    .join("\n\n");
-
-  const newestDate = typedData.map((r) => r.age).filter(Boolean).sort().reverse()[0] ?? null;
-
-  return {
-    raw,
-    content_date: newestDate,
-    freshness_confidence: newestDate ? "high" : "medium",
-  };
-}