mcp-scraper 0.1.5 → 0.1.7

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (36) hide show
  1. package/README.md +13 -2
  2. package/dist/bin/api-server.cjs +573 -172
  3. package/dist/bin/api-server.cjs.map +1 -1
  4. package/dist/bin/api-server.js +2 -2
  5. package/dist/bin/mcp-stdio-server.cjs +300 -150
  6. package/dist/bin/mcp-stdio-server.cjs.map +1 -1
  7. package/dist/bin/mcp-stdio-server.js +2 -1
  8. package/dist/bin/mcp-stdio-server.js.map +1 -1
  9. package/dist/bin/paa-harvest.cjs +22 -1
  10. package/dist/bin/paa-harvest.cjs.map +1 -1
  11. package/dist/bin/paa-harvest.js +2 -1
  12. package/dist/bin/paa-harvest.js.map +1 -1
  13. package/dist/{chunk-4OHPDEZM.js → chunk-3OIRNUF5.js} +303 -151
  14. package/dist/chunk-3OIRNUF5.js.map +1 -0
  15. package/dist/{chunk-W4P2U5VF.js → chunk-LUBDFS67.js} +32 -32
  16. package/dist/chunk-LUBDFS67.js.map +1 -0
  17. package/dist/{chunk-7HB7NDOY.js → chunk-ZK456YXN.js} +12 -2
  18. package/dist/chunk-ZK456YXN.js.map +1 -0
  19. package/dist/chunk-ZMOWIBMK.js +36 -0
  20. package/dist/chunk-ZMOWIBMK.js.map +1 -0
  21. package/dist/index.cjs +22 -1
  22. package/dist/index.cjs.map +1 -1
  23. package/dist/index.js +2 -1
  24. package/dist/index.js.map +1 -1
  25. package/dist/{server-V5XMVRYE.js → server-YNJHP5PU.js} +235 -22
  26. package/dist/server-YNJHP5PU.js.map +1 -0
  27. package/dist/{worker-UT4ZQU2T.js → worker-PBG6LGET.js} +4 -3
  28. package/dist/{worker-UT4ZQU2T.js.map → worker-PBG6LGET.js.map} +1 -1
  29. package/docs/adr/0001-in-page-graphql-interception-for-anti-bot-scraping.md +58 -0
  30. package/docs/adr/README.md +11 -0
  31. package/docs/mcp-tool-quality-spec.md +238 -0
  32. package/package.json +5 -4
  33. package/dist/chunk-4OHPDEZM.js.map +0 -1
  34. package/dist/chunk-7HB7NDOY.js.map +0 -1
  35. package/dist/chunk-W4P2U5VF.js.map +0 -1
  36. package/dist/server-V5XMVRYE.js.map +0 -1
package/README.md CHANGED
@@ -20,6 +20,8 @@ Use the npm package from any MCP client that can run a local command:
20
20
  }
21
21
  ```
22
22
 
23
+ Existing MCP configs that use `npx -y mcp-scraper` do not need a command change. After a new npm version is published, restart the MCP client so it starts a fresh `npx` process.
24
+
23
25
  Claude Code:
24
26
 
25
27
  ```bash
@@ -47,9 +49,14 @@ env = { MCP_SCRAPER_API_KEY = "sk_live_your_key" }
47
49
  - `facebook_ad_search`
48
50
  - `facebook_page_intel`
49
51
  - `facebook_ad_transcribe`
50
- - `maps_place_intel`
52
+ - `maps_search` — search Google Maps for multiple business/profile candidates. Use for GMB/GBP prospect lists, competitors, categories, and anything needing more than the Google 3-pack. `maxResults` defaults to 10 and is capped at 50.
53
+ - `maps_place_intel` — hydrate one known/named Google Maps business with profile details and optional reviews. Use after `maps_search` when a selected candidate needs full details.
51
54
  - `credits_info`
52
55
 
56
+ Chaining tools (`maps_search`, `map_site_urls`, `youtube_harvest`, `facebook_ad_search`, `facebook_page_intel`) advertise an `outputSchema` and return `structuredContent` with the IDs and URLs needed by the next tool. All tools carry MCP annotations (`readOnlyHint: true`, `openWorldHint: true` for live-web tools).
57
+
58
+ The hosted MCP endpoint at `https://mcpscraper.dev/mcp` exposes these 13 tools plus `capture_serp_snapshot` and `capture_serp_page_snapshots` (15 total).
59
+
53
60
  ## Environment
54
61
 
55
62
  - `MCP_SCRAPER_API_KEY` is required.
@@ -58,4 +65,8 @@ env = { MCP_SCRAPER_API_KEY = "sk_live_your_key" }
58
65
  - `MCP_SCRAPER_SAVE_REPORTS=false` disables automatic Markdown report files.
59
66
  - `MCP_SCRAPER_KEY_PATH` is optional. When no API key env var is set, the server also reads `~/.mcp-scraper-key` for compatibility with older installs.
60
67
 
61
- Every tool call saves a full Markdown report locally by default and returns the file path in the MCP response.
68
+ Every tool call made through the NPX stdio server saves a full Markdown report locally by default and returns the file path in the MCP response. The hosted `/mcp` endpoint returns reports inline only and never writes files.
69
+
70
+ ## Development
71
+
72
+ - [MCP Tool Quality Spec](docs/mcp-tool-quality-spec.md) defines the shipping bar for model-facing tool names, descriptions, schemas, structured outputs, errors, packaging, and deployment.