scrapeunblocker-mcp 0.2.2 → 0.3.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +23 -1
- package/dist/index.js +5904 -66
- package/package.json +3 -3
package/README.md
CHANGED
|
@@ -1,7 +1,8 @@
|
|
|
1
1
|
# ScrapeUnblocker MCP server
|
|
2
2
|
|
|
3
3
|
A [Model Context Protocol](https://modelcontextprotocol.io) server that lets
|
|
4
|
-
Claude (and any other MCP client) fetch **any web page's HTML**
|
|
4
|
+
Claude (and any other MCP client) fetch **any web page's HTML** - or run one of
|
|
5
|
+
100+ ready-made **site plugins** that return structured JSON - through the
|
|
5
6
|
[ScrapeUnblocker](https://scrapeunblocker.com?utm_source=mcp&utm_medium=integration&utm_campaign=mcp-server) scraping API, bypassing anti-bot
|
|
6
7
|
protection (Cloudflare, DataDome, PerimeterX, Akamai, Shape).
|
|
7
8
|
|
|
@@ -15,6 +16,24 @@ You bring your **own** API key. Nothing is shared or proxied through us.
|
|
|
15
16
|
| `list_elements` | List a page's notable elements with a ready-to-use selector for each (selector discovery). |
|
|
16
17
|
| `fetch_parsed` | Fetch a page and return AI-parsed structured JSON. |
|
|
17
18
|
| `google_search` | Run a Google search and return organic results as JSON. |
|
|
19
|
+
| `list_plugins` | List the ready-made site plugins (100+: Amazon, Walmart, Zillow, Booking.com, Indeed, Google Trends, YouTube, App Store, Ahrefs, ...) with their parameters. Free - it calls nothing. |
|
|
20
|
+
| `run_plugin` | Run one site plugin and return its structured JSON. |
|
|
21
|
+
|
|
22
|
+
### Site plugins (structured JSON for known sites)
|
|
23
|
+
|
|
24
|
+
For many popular sites there is a plugin that returns the data already
|
|
25
|
+
parsed - a Target search, a Zillow listing search, an app's App Store reviews,
|
|
26
|
+
Google Trends for a few keywords. The model calls `list_plugins` (optionally
|
|
27
|
+
with `search: "zillow"` or a `category`) to find the plugin and its
|
|
28
|
+
parameters, then `run_plugin` with `name` and `params`:
|
|
29
|
+
|
|
30
|
+
```json
|
|
31
|
+
{ "name": "target_search", "params": { "query": "coffee maker", "max_results": 20 } }
|
|
32
|
+
```
|
|
33
|
+
|
|
34
|
+
Every plugin and parameter is documented on the
|
|
35
|
+
[plugin pages](https://docs.scrapeunblocker.com/plugins/overview?utm_source=mcp&utm_medium=integration&utm_campaign=mcp-server).
|
|
36
|
+
Each run is billed like an API request.
|
|
18
37
|
|
|
19
38
|
### Browser steps (interact, then capture)
|
|
20
39
|
|
|
@@ -119,6 +138,9 @@ SCRAPEUNBLOCKER_KEY=your_api_key_here npx -y scrapeunblocker-mcp
|
|
|
119
138
|
- "This page keeps blocking me: <url>. Use fetch_html to get it."
|
|
120
139
|
- "List the elements on <url>, then use fetch_html steps to type 'laptop' into the search box, press Enter, wait for the results, and give me the HTML."
|
|
121
140
|
- "Search Google for 'best running shoes 2026' and give me the top 5 links."
|
|
141
|
+
- "Find coffee makers on Target under $50 and compare them with Walmart's."
|
|
142
|
+
- "Show Google Trends for 'coffee' vs 'tea' in the US over the last year."
|
|
143
|
+
- "What are the newest App Store reviews of WhatsApp saying?"
|
|
122
144
|
|
|
123
145
|
## Development
|
|
124
146
|
|