mcp-scraper 0.12.0 → 0.14.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +13 -2
- package/dist/bin/api-server.cjs +792 -169
- package/dist/bin/api-server.cjs.map +1 -1
- package/dist/bin/api-server.js +1 -1
- package/dist/bin/mcp-scraper-cli.cjs +1 -1
- package/dist/bin/mcp-scraper-cli.cjs.map +1 -1
- package/dist/bin/mcp-scraper-cli.js +1 -1
- package/dist/bin/mcp-scraper-install.cjs +6 -3
- package/dist/bin/mcp-scraper-install.cjs.map +1 -1
- package/dist/bin/mcp-scraper-install.js +2 -2
- package/dist/bin/mcp-stdio-server.cjs +204 -38
- package/dist/bin/mcp-stdio-server.cjs.map +1 -1
- package/dist/bin/mcp-stdio-server.js +3 -3
- package/dist/{chunk-D3AJWXA2.js → chunk-6W72B45I.js} +6 -3
- package/dist/chunk-6W72B45I.js.map +1 -0
- package/dist/{chunk-HXNE5GLG.js → chunk-DXU327CY.js} +333 -66
- package/dist/chunk-DXU327CY.js.map +1 -0
- package/dist/chunk-HM7SDTUO.js +7 -0
- package/dist/chunk-HM7SDTUO.js.map +1 -0
- package/dist/{server-TFWBW24U.js → server-EYPXW2JG.js} +355 -8
- package/dist/server-EYPXW2JG.js.map +1 -0
- package/docs/mcp-tool-manifest.generated.json +6951 -168
- package/package.json +1 -1
- package/dist/chunk-D3AJWXA2.js.map +0 -1
- package/dist/chunk-HXNE5GLG.js.map +0 -1
- package/dist/chunk-YA364G53.js +0 -7
- package/dist/chunk-YA364G53.js.map +0 -1
- package/dist/server-TFWBW24U.js.map +0 -1
package/README.md
CHANGED
|
@@ -88,7 +88,7 @@ Build the branded one-click bundle:
|
|
|
88
88
|
npm run build:mcpb
|
|
89
89
|
```
|
|
90
90
|
|
|
91
|
-
The generated bundle is written to `build/mcpb/mcp-scraper-<version>.mcpb` and copied to `public/downloads/` for the hosted download. The current public bundle is `https://mcpscraper.dev/downloads/mcp-scraper.mcpb` (`0.
|
|
91
|
+
The generated bundle is written to `build/mcpb/mcp-scraper-<version>.mcpb` and copied to `public/downloads/` for the hosted download. The current public bundle is `https://mcpscraper.dev/downloads/mcp-scraper.mcpb` (`0.14.0`, SHA-256 `01b37c065b803a19ac824b82058b311b115e272d9be01d870094737c74b58753`). Install it by opening or dragging it into Claude Desktop. Claude displays the `MCP Scraper` install card, icon, and API-key configuration field from the bundle manifest.
|
|
92
92
|
|
|
93
93
|
The MCPB install exposes every tool — web-intelligence plus all `browser_*` tools — through the one `mcp-scraper` server.
|
|
94
94
|
|
|
@@ -174,6 +174,17 @@ env = { MCP_SCRAPER_API_KEY = "sk_live_your_key" }
|
|
|
174
174
|
- `rank_tracker_workflow` — generate a database schema, cron/heartbeat plan, ingestion workflow, metrics list, and implementation prompt for building rank trackers. It has modes for Maps rankings via `directory_workflow`/`maps_search`, organic rankings via `search_serp`, AI Overview citation tracking, and PAA source presence tracking. This planning tool does not spend credits.
|
|
175
175
|
- `credits_info`
|
|
176
176
|
|
|
177
|
+
### Connected-account tools
|
|
178
|
+
|
|
179
|
+
- `list_service_connections` — list this caller's tenant-owned OAuth connections and the exact live read/action tools available on each account. Connections are never shared between customers.
|
|
180
|
+
- `export_connected_service_data` — fetch a bounded Gmail, Google Calendar, or Zoom time range in one MCP call. The server handles provider pagination, Gmail hydration, normalization, and continuation. Small exports return inline; larger exports become private JSONL retained for seven days with a 15-minute signed URL. Attachments remain metadata-only and oversized individual bodies/transcripts are truncated with warnings.
|
|
181
|
+
- `renew_connected_data_download` — issue a fresh 15-minute signed URL for an unexpired private export artifact without pulling the provider again.
|
|
182
|
+
- `read_service_connection` — run one small live read by exact allowlisted name. Do not loop it over a time range; use `export_connected_service_data` for email, calendar, recording, or transcript collections.
|
|
183
|
+
- `call_service_connection_action` — run one exact mutation only after the account action switch is enabled. GitHub, Gmail, Calendar, Slack, Zoom, Facebook, Google Analytics, X, and YouTube actions remain provider-policy and tenant gated.
|
|
184
|
+
- `set_scheduled_action_connections` — bind exact tenant connections and exact tool grants to one scheduled action. Deterministic connection syncs are model-free and one schedule occurrence counts as one metered event even when provider pagination spans many pages.
|
|
185
|
+
|
|
186
|
+
GitHub uses the same provider-neutral read/action bridges: 27 reads cover repository discovery, issues, pull requests, commits, releases, and workflows; 20 mutations remain gated. Private-repository and workflow access requires reconnecting the OAuth account after the expanded scope set is deployed.
|
|
187
|
+
|
|
177
188
|
### Browser-agent tools
|
|
178
189
|
|
|
179
190
|
- `browser_open` — open a direct/no-proxy hosted browser session. Pass a saved profile name to load an authenticated session. Returns a human `watch_url`.
|
|
@@ -207,7 +218,7 @@ The `mcp-scraper` server (and the MCPB bundle, which runs it) exposes both secti
|
|
|
207
218
|
|
|
208
219
|
All MCP tools expose output schemas and return `structuredContent` with the IDs, URLs, CSV paths, transcripts, browser session handles, replay paths, artifacts, recipe fields, or blueprint fields needed by the next step. Browser Agent tools keep a JSON text block for older clients, but structured data is the primary contract. All tools carry MCP annotations; file-writing tools such as replay downloads and annotations state their filesystem side effects.
|
|
209
220
|
|
|
210
|
-
The canonical tool inventory is generated at `docs/mcp-tool-manifest.generated.json`. Both the `mcp-scraper` stdio server and the hosted endpoint at `https://mcpscraper.dev/mcp` expose the same
|
|
221
|
+
The canonical tool inventory is generated at `docs/mcp-tool-manifest.generated.json`. Both the `mcp-scraper` stdio server and the hosted endpoint at `https://mcpscraper.dev/mcp` expose the same 155 tools: 70 scraper, browser, workflow, billing, and connected-service tools plus 85 durable-memory tools. Release verification compares the exact local and remote tool-name sets, not only the count.
|
|
211
222
|
|
|
212
223
|
## Resources
|
|
213
224
|
|