mcp-scraper 0.2.12 → 0.2.14

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (50) hide show
  1. package/README.md +15 -2
  2. package/dist/bin/api-server.cjs +1836 -633
  3. package/dist/bin/api-server.cjs.map +1 -1
  4. package/dist/bin/api-server.js +3 -3
  5. package/dist/bin/browser-agent-stdio-server.cjs +1 -1
  6. package/dist/bin/browser-agent-stdio-server.cjs.map +1 -1
  7. package/dist/bin/browser-agent-stdio-server.js +2 -2
  8. package/dist/bin/mcp-scraper-cli.cjs +799 -12
  9. package/dist/bin/mcp-scraper-cli.cjs.map +1 -1
  10. package/dist/bin/mcp-scraper-cli.js +90 -9
  11. package/dist/bin/mcp-scraper-cli.js.map +1 -1
  12. package/dist/bin/mcp-scraper-combined-stdio-server.cjs +47 -5
  13. package/dist/bin/mcp-scraper-combined-stdio-server.cjs.map +1 -1
  14. package/dist/bin/mcp-scraper-combined-stdio-server.js +3 -3
  15. package/dist/bin/mcp-scraper-install.cjs +4 -3
  16. package/dist/bin/mcp-scraper-install.cjs.map +1 -1
  17. package/dist/bin/mcp-scraper-install.js +4 -3
  18. package/dist/bin/mcp-scraper-install.js.map +1 -1
  19. package/dist/bin/mcp-stdio-server.cjs +47 -5
  20. package/dist/bin/mcp-stdio-server.cjs.map +1 -1
  21. package/dist/bin/mcp-stdio-server.js +2 -2
  22. package/dist/{chunk-ROS67BNV.js → chunk-BSYPATSM.js} +21 -2
  23. package/dist/chunk-BSYPATSM.js.map +1 -0
  24. package/dist/chunk-F44RBOJ5.js +1575 -0
  25. package/dist/chunk-F44RBOJ5.js.map +1 -0
  26. package/dist/{chunk-P5RYXUV7.js → chunk-IWQTNY2E.js} +48 -6
  27. package/dist/chunk-IWQTNY2E.js.map +1 -0
  28. package/dist/chunk-ROCXJOVY.js +7 -0
  29. package/dist/chunk-ROCXJOVY.js.map +1 -0
  30. package/dist/{chunk-7GCCOT3M.js → chunk-TL7YTFLH.js} +15 -1
  31. package/dist/chunk-TL7YTFLH.js.map +1 -0
  32. package/dist/{chunk-PB7ENA3G.js → chunk-ZV2XXYR7.js} +2 -2
  33. package/dist/{db-BVHYI57K.js → db-P5X6UQ3E.js} +2 -2
  34. package/dist/{server-I2H5WG5I.js → server-7QP6HQJJ.js} +556 -164
  35. package/dist/server-7QP6HQJJ.js.map +1 -0
  36. package/dist/{worker-TDJQ6TH3.js → worker-OZSWIS3F.js} +3 -3
  37. package/docs/specs/cli-agent-wiring-spec.md +4 -1
  38. package/docs/specs/seo-cli-growth-roadmap-spec.md +4 -2
  39. package/package.json +1 -1
  40. package/dist/chunk-7GCCOT3M.js.map +0 -1
  41. package/dist/chunk-L6IS63WS.js +0 -869
  42. package/dist/chunk-L6IS63WS.js.map +0 -1
  43. package/dist/chunk-LK27MYGD.js +0 -7
  44. package/dist/chunk-LK27MYGD.js.map +0 -1
  45. package/dist/chunk-P5RYXUV7.js.map +0 -1
  46. package/dist/chunk-ROS67BNV.js.map +0 -1
  47. package/dist/server-I2H5WG5I.js.map +0 -1
  48. /package/dist/{chunk-PB7ENA3G.js.map → chunk-ZV2XXYR7.js.map} +0 -0
  49. /package/dist/{db-BVHYI57K.js.map → db-P5X6UQ3E.js.map} +0 -0
  50. /package/dist/{worker-TDJQ6TH3.js.map → worker-OZSWIS3F.js.map} +0 -0
package/README.md CHANGED
@@ -34,16 +34,29 @@ npx -y -p mcp-scraper@latest mcp-scraper-cli agent install codex
34
34
  npx -y -p mcp-scraper@latest mcp-scraper-cli agent prompt agent-packet
35
35
  ```
36
36
 
37
+ Check usage and upgrade concurrency from a normal terminal:
38
+
39
+ ```bash
40
+ MCP_SCRAPER_API_KEY=sk_live_your_key npx -y -p mcp-scraper@latest mcp-scraper-cli billing concurrency info
41
+ MCP_SCRAPER_API_KEY=sk_live_your_key npx -y -p mcp-scraper@latest mcp-scraper-cli billing concurrency checkout
42
+ ```
43
+
44
+ Each account has 1 base concurrent operation. Extra concurrency slots are `$5/month` per slot. If an MCP tool hits `concurrency_limit_exceeded`, the error includes `active`, `limit`, `upgrade_url`, and the `mcp-scraper-cli billing concurrency checkout` command so the AI can explain the next step without guessing.
45
+
37
46
  Run local workflow reports:
38
47
 
39
48
  ```bash
40
49
  npx -y -p mcp-scraper@latest mcp-scraper-cli workflow list
41
50
  npx -y -p mcp-scraper@latest mcp-scraper-cli workflow run agent-packet --keyword "roof repair Denver" --domain example.com
42
51
  npx -y -p mcp-scraper@latest mcp-scraper-cli workflow run local-competitive-audit --query roofers --state TN --min-pop 100000 --per-city 20 --hydrate-top 5 --reviews 50
52
+ npx -y -p mcp-scraper@latest mcp-scraper-cli workflow run map-comparison --query roofers --location "Denver, CO" --per-city 20 --hydrate-top 5
53
+ npx -y -p mcp-scraper@latest mcp-scraper-cli workflow run serp-comparison --keyword "roof repair Denver" --domain example.com --extract-top 5
54
+ npx -y -p mcp-scraper@latest mcp-scraper-cli workflow run paa-expansion-brief --keyword "roof repair cost" --max-questions 80
55
+ npx -y -p mcp-scraper@latest mcp-scraper-cli workflow run ai-overview-language --keyword "best roof repair company" --domain example.com
43
56
  npx -y -p mcp-scraper@latest mcp-scraper-cli report open last
44
57
  ```
45
58
 
46
- Workflow runs save `manifest.json`, `report.html`, CSVs, Markdown, and evidence JSON under `MCP_SCRAPER_OUTPUT_DIR/workflows` or `~/Downloads/mcp-scraper/workflows`.
59
+ Workflow runs save `manifest.json`, `report.html`, CSVs, Markdown, and evidence JSON under `MCP_SCRAPER_OUTPUT_DIR/workflows` or `~/Downloads/mcp-scraper/workflows`. High-level workflow IDs are `directory`, `agent-packet`, `local-competitive-audit`, `map-comparison`, `serp-comparison`, `paa-expansion-brief`, and `ai-overview-language`.
47
60
 
48
61
  Run hosted workflow schedules and hosted run history:
49
62
 
@@ -68,7 +81,7 @@ Build the branded one-click bundle:
68
81
  npm run build:mcpb
69
82
  ```
70
83
 
71
- The generated bundle is written to `build/mcpb/mcp-scraper-<version>.mcpb` and copied to `public/downloads/` for the hosted download. The current public bundle is `https://mcpscraper.dev/downloads/mcp-scraper.mcpb` (`0.2.12`, SHA-256 `0c902286381b22b3019bba8c7e0eb63c3d91a3f049dec280a3b995c79c18cc1c`). Install it by opening or dragging it into Claude Desktop. Claude displays the `MCP Scraper` install card, icon, and API-key configuration field from the bundle manifest.
84
+ The generated bundle is written to `build/mcpb/mcp-scraper-<version>.mcpb` and copied to `public/downloads/` for the hosted download. The current public bundle is `https://mcpscraper.dev/downloads/mcp-scraper.mcpb` (`0.2.13`, SHA-256 `93c3c35b6a3315a1b9319761891cf0e805465b1ab19efa0252c7b8f2d9383030`). Install it by opening or dragging it into Claude Desktop. Claude displays the `MCP Scraper` install card, icon, and API-key configuration field from the bundle manifest.
72
85
 
73
86
  The MCPB install exposes the same web-intelligence tools as `mcp-scraper` plus all `browser_*` tools from `browser-agent` through one server.
74
87