crawlora-mcp 1.7.0 → 1.9.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (4) hide show
  1. package/README.md +22 -22
  2. package/index.mjs +1 -1
  3. package/package.json +2 -2
  4. package/tools.json +1 -1
package/README.md CHANGED
@@ -1,20 +1,20 @@
1
1
  # Crawlora MCP
2
2
 
3
- [![Website](https://img.shields.io/badge/website-crawlora.net-2563eb)](https://crawlora.net/mcp)
4
- [![Docs](https://img.shields.io/badge/docs-crawlora.net%2Fdocs-555)](https://crawlora.net/docs)
3
+ [![Website](https://img.shields.io/badge/website-crawlora.net-2563eb)](https://crawlora.net/mcp?utm_source=github&utm_medium=referral&utm_campaign=crawlora-mcp)
4
+ [![Docs](https://img.shields.io/badge/docs-crawlora.net%2Fdocs-555)](https://crawlora.net/docs?utm_source=github&utm_medium=referral&utm_campaign=crawlora-mcp)
5
5
  [![MCP](https://img.shields.io/badge/MCP-Streamable%20HTTP-7c3aed)](https://modelcontextprotocol.io)
6
6
  [![smithery badge](https://smithery.ai/badge/crawlora/crawlora)](https://smithery.ai/servers/crawlora/crawlora)
7
7
  [![crawlora-mcp MCP server](https://glama.ai/mcp/servers/Crawlora-org/crawlora-mcp/badges/score.svg)](https://glama.ai/mcp/servers/Crawlora-org/crawlora-mcp)
8
8
 
9
9
  **Crawlora MCP** is a **hosted** Model Context Protocol server that gives AI clients and
10
- agents **733 structured public‑web‑data tools** across 30+ categories — search, maps,
10
+ agents **795 structured public‑web‑data tools** across 68 platform groups — search, maps,
11
11
  e‑commerce, social, finance, travel, app stores, media, and reviews — each returning clean,
12
12
  normalized **JSON** instead of HTML to parse.
13
13
 
14
14
  > **Two ways to use it:** connect any MCP client to the **hosted** endpoint
15
15
  > (`https://mcp.crawlora.net/mcp`), or run the small **open‑source local server** in this repo
16
16
  > (`npx` / Docker, stdio) — both expose the same tools and authenticate with your Crawlora API
17
- > key. Start free with **2,000 credits/month** (no card) at **[crawlora.net](https://crawlora.net)**.
17
+ > key. Start free with **2,000 credits/month** (no card) at **[crawlora.net](https://crawlora.net?utm_source=github&utm_medium=referral&utm_campaign=crawlora-mcp)**.
18
18
 
19
19
  ## Connection
20
20
 
@@ -23,7 +23,7 @@ normalized **JSON** instead of HTML to parse.
23
23
  | **Endpoint** | `https://mcp.crawlora.net/mcp` |
24
24
  | **Transport** | Streamable HTTP |
25
25
  | **Auth** | `Authorization: Bearer <CRAWLORA_API_KEY>` (preferred) — `x-api-key: <key>` also accepted |
26
- | **Get a key** | https://crawlora.net (free 2,000 credits/mo) |
26
+ | **Get a key** | [https://crawlora.net](https://crawlora.net?utm_source=github&utm_medium=referral&utm_campaign=crawlora-mcp) (free 2,000 credits/mo) |
27
27
  | **Server card** | https://crawlora.net/.well-known/mcp/server-card.json |
28
28
 
29
29
  A missing or invalid API key returns `401`.
@@ -155,7 +155,7 @@ Any client that speaks **Streamable HTTP** can use the generic config in
155
155
 
156
156
  ## Run it locally (open‑source server)
157
157
 
158
- This repo also ships a small **stdio** MCP server (`index.mjs`) that exposes the same **733
158
+ This repo also ships a small **stdio** MCP server (`index.mjs`) that exposes the same **795
159
159
  tools**, each wrapping the Crawlora REST API (`https://api.crawlora.net/api/v1`) with your
160
160
  `CRAWLORA_API_KEY`. Useful if you'd rather run the server yourself than use the hosted endpoint.
161
161
 
@@ -187,44 +187,44 @@ Client config (stdio):
187
187
  The tool definitions in [`tools.json`](tools.json) are generated from Crawlora's published API
188
188
  catalog; each carries its real input schema and maps to a single REST endpoint.
189
189
 
190
- ## What you can call (733 tools / 30+ categories)
190
+ ## What you can call (795 tools / 12 categories)
191
191
 
192
192
  | Category | Tools | Examples |
193
193
  |---|---|---|
194
- | **Finance & company intelligence** | 143 | Yahoo Finance, SEC EDGAR, CoinGecko, Polymarket, Kalshi, Metaculus, PitchBook, TrustMRR, Brand — markets, filings, company data, revenue, and prediction markets |
195
- | **Media & entertainment** | 162 | Spotify, podcasts, JustWatch, IMDb, Rotten Tomatoes, Box Office Mojo, Metacritic, TMDB, Letterboxd, Discogs, Goodreads, anime and manga — music, shows, films, books, ratings, reviews, and charts |
196
- | **Social, video & developer** | 78 | YouTube, TikTok, Instagram, Threads, Reddit, LinkedIn, X, GitHub — search, profiles, relationships, posts, replies, comments, transcripts, and trends |
197
- | **E‑commerce** | 39 | Amazon, eBay, Walmart, Shopify, Shop.app — products, search, sellers, collections, and reviews |
198
- | **Search, web & maps** | 54 | Google, Bing, Brave, Google Trends, Google Maps, Geocoding, Web Scrape — SERPs, suggestions, maps, news, media search, interest over time, and URL-to-markdown |
199
- | **App stores** | 32 | App Store, Google Play, Chrome Web Store — apps and extensions, reviews, rankings, similar items, categories, and datasets |
194
+ | **Finance & company intelligence** | 145 | Yahoo Finance, SEC EDGAR, CoinGecko, Polymarket, Kalshi, Metaculus, PitchBook, TrustMRR, Brand — markets, filings, company data, revenue, and prediction markets |
195
+ | **Media & entertainment** | 181 | Spotify, podcasts, Apple Books, JustWatch, IMDb, Rotten Tomatoes, Box Office Mojo, Metacritic, TMDB, Letterboxd, Discogs, Goodreads, anime and manga — music, shows, films, books, ratings, reviews, and charts |
196
+ | **Social, video & developer** | 79 | YouTube, TikTok, Instagram, Facebook, Threads, Reddit, LinkedIn, X, GitHub — search, profiles, relationships, posts, replies, comments, transcripts, and trends |
197
+ | **E‑commerce** | 42 | Amazon, eBay, Walmart, Shopify, Shop.app, Uber Eats — products, search, sellers, collections, and reviews |
198
+ | **Search, web & maps** | 56 | Google, Bing, Brave, Google Trends, Google Maps, Geocoding, Web Scrape — SERPs, suggestions, maps, news, media search, interest over time, and URL-to-markdown |
199
+ | **App stores** | 35 | App Store, Google Play, Chrome Web Store — apps and extensions, reviews, ratings, rankings, similar items, categories, and datasets |
200
200
  | **Reviews & companies** | 21 | Trustpilot, Capterra, Product Hunt — business and software reviews, launches, makers, and leaderboards |
201
201
  | **Travel & real estate** | 21 | Airbnb, TripAdvisor, Zillow, Redfin — listings, calendars, hotels, property data, estimates, and region trends |
202
- | **Data & utility** | 92 | Datasets, Numbeo, SimilarWeb, usage — jobs, companies, financials, browser extensions, journalists, cost of living, apps, games, housing, website intelligence, and account usage |
203
- | **Jobs & hiring** | 26 | Greenhouse, Lever, Ashby, Workday, SmartRecruiters, iCIMS, Eightfold, Workable, Recruitee, Rippling, Personio, Teamtailor, Oracle, and UKG — boards, postings, feeds, and hiring signals |
204
- | **Gaming & collectibles** | 41 | Steam, PlayStation, TCDB — games, packages, reviews, player counts, achievements, releases, trading cards, sets, teams, and people |
202
+ | **Data & utility** | 123 | Datasets, Numbeo, SimilarWeb, usage — jobs, companies, financials, browser extensions, journalists, cost of living, apps, games, housing, website intelligence, and account usage |
203
+ | **Jobs & hiring** | 39 | Amazon Jobs, Apple Jobs, Google Jobs, Meta Jobs, Tesla Jobs, Greenhouse, Lever, Ashby, Workday, SmartRecruiters, iCIMS, and other public hiring systems — boards, postings, feeds, and hiring signals |
204
+ | **Gaming & collectibles** | 29 | Steam and PlayStation — games, packages, reviews, player counts, achievements, and releases |
205
205
  | **Sports** | 24 | ESPN, SofaScore — live scores, schedules, standings, teams, players, leagues, and tournaments |
206
206
 
207
207
  Full, always‑current tool list with parameters, response examples, and a live Playground:
208
- **https://crawlora.net/docs**.
208
+ **[https://crawlora.net/docs](https://crawlora.net/docs?utm_source=github&utm_medium=referral&utm_campaign=crawlora-mcp)**.
209
209
 
210
210
  ## Why Crawlora
211
211
 
212
212
  - **Normalized JSON per tool** — ship data features, not scraper infrastructure.
213
213
  - **No proxies, browsers, or parsers** to maintain.
214
214
  - **Pay on success** — credit‑based, billed only on `2xx` responses.
215
- - **One key, 733 tools** — search, commerce, social, gaming, finance, and more behind a single MCP endpoint.
215
+ - **One key, 795 tools** — search, commerce, social, gaming, finance, and more behind a single MCP endpoint.
216
216
 
217
217
  A good alternative to stitching together SerpApi, Firecrawl, ScraperAPI, or ScrapingBee.
218
218
 
219
219
  ## Links
220
220
 
221
- - Website: https://crawlora.net/mcp
222
- - Docs & Playground: https://crawlora.net/docs · https://crawlora.net/playground
223
- - Pricing: https://crawlora.net/pricing
221
+ - Website: [https://crawlora.net/mcp](https://crawlora.net/mcp?utm_source=github&utm_medium=referral&utm_campaign=crawlora-mcp)
222
+ - Docs & Playground: [https://crawlora.net/docs](https://crawlora.net/docs?utm_source=github&utm_medium=referral&utm_campaign=crawlora-mcp) · [https://crawlora.net/playground](https://crawlora.net/playground?utm_source=github&utm_medium=referral&utm_campaign=crawlora-mcp)
223
+ - Pricing: [https://crawlora.net/pricing](https://crawlora.net/pricing?utm_source=github&utm_medium=referral&utm_campaign=crawlora-mcp)
224
224
  - Server card: https://crawlora.net/.well-known/mcp/server-card.json
225
225
  - Official MCP registry manifest: [`server.json`](server.json)
226
226
 
227
227
  ## License
228
228
 
229
229
  See [`LICENSE`](LICENSE). The Crawlora MCP service itself is a hosted SaaS governed by the
230
- [Crawlora terms](https://crawlora.net); this repository contains connection docs and manifests.
230
+ [Crawlora terms](https://crawlora.net?utm_source=github&utm_medium=referral&utm_campaign=crawlora-mcp); this repository contains connection docs and manifests.
package/index.mjs CHANGED
@@ -1,6 +1,6 @@
1
1
  #!/usr/bin/env node
2
2
  // Crawlora MCP — local stdio MCP server.
3
- // Exposes 733 structured web-data tools, each wrapping the Crawlora REST API
3
+ // Exposes 795 structured web-data tools, each wrapping the Crawlora REST API
4
4
  // (https://api.crawlora.net/api/v1) with your CRAWLORA_API_KEY. Get a free key
5
5
  // (2,000 credits/month, no card) at https://crawlora.net.
6
6
  //
package/package.json CHANGED
@@ -1,7 +1,7 @@
1
1
  {
2
2
  "name": "crawlora-mcp",
3
- "version": "1.7.0",
4
- "description": "Local MCP server for Crawlora — 733 structured public web-data tools (search, maps, commerce, social, finance) wrapping the Crawlora REST API.",
3
+ "version": "1.9.0",
4
+ "description": "Local MCP server for Crawlora — 795 structured public web-data tools (search, maps, commerce, social, finance) wrapping the Crawlora REST API.",
5
5
  "type": "module",
6
6
  "main": "index.mjs",
7
7
  "bin": {