mcp-scraper 0.66.1 → 0.66.3

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (32) hide show
  1. package/CHANGELOG.md +29 -1
  2. package/README.md +2 -2
  3. package/dist/bin/api-server.cjs +996 -1788
  4. package/dist/bin/api-server.js +3 -3
  5. package/dist/bin/mcp-scraper-cli.cjs +1 -1
  6. package/dist/bin/mcp-scraper-cli.js +1 -1
  7. package/dist/bin/mcp-scraper-install.cjs +2 -2
  8. package/dist/bin/mcp-scraper-install.js +2 -2
  9. package/dist/bin/mcp-stdio-server.cjs +71 -87
  10. package/dist/bin/mcp-stdio-server.js +6 -6
  11. package/dist/bin/paa-harvest.js +3 -3
  12. package/dist/{chunk-WID3MFRS.js → chunk-2XVDLF6H.js} +1 -1
  13. package/dist/{chunk-4OT7BAIE.js → chunk-3EYALCYK.js} +1 -1
  14. package/dist/{chunk-TNLGHNLX.js → chunk-3TKKJQB4.js} +1 -1
  15. package/dist/{chunk-GTGSD4YS.js → chunk-55B3T5L2.js} +21 -26
  16. package/dist/{chunk-TNJIPV74.js → chunk-ABYBPODM.js} +1 -1
  17. package/dist/{chunk-NS754CRS.js → chunk-CETDPNMZ.js} +23 -23
  18. package/dist/{chunk-75VW7CWE.js → chunk-DBWWIK7O.js} +1 -1
  19. package/dist/{chunk-VRJ7CO6L.js → chunk-JBFLOJGM.js} +1 -1
  20. package/dist/{chunk-4P3PHFPQ.js → chunk-K7Y27ND3.js} +2 -12
  21. package/dist/{chunk-3PIXKLGZ.js → chunk-KXRWY7DZ.js} +1 -1
  22. package/dist/{chunk-E4LMY5OJ.js → chunk-LNLMOBP6.js} +147 -91
  23. package/dist/{chunk-AQKJOSIB.js → chunk-PMCT2YQM.js} +1 -1
  24. package/dist/{db-PO7N7ZP3.js → db-4RVZ3NYZ.js} +9 -9
  25. package/dist/{extract-bundle-SIBFUA6I.js → extract-bundle-EA5URLXN.js} +3 -3
  26. package/dist/index.js +3 -3
  27. package/dist/{lead-list-enrichment-repository-OTAUQONJ.js → lead-list-enrichment-repository-IBXNWM6H.js} +2 -2
  28. package/dist/{location-data-repository-RM2KJ3H5.js → location-data-repository-WHHQUCUI.js} +2 -2
  29. package/dist/{server-ELEJNRRE.js → server-D47PNEXR.js} +413 -1249
  30. package/dist/{site-extract-repository-ASYEJO7Z.js → site-extract-repository-NTM4MDQN.js} +2 -2
  31. package/dist/{worker-MAVYYWM7.js → worker-UTBUWEXQ.js} +5 -5
  32. package/package.json +5 -2
package/CHANGELOG.md CHANGED
@@ -4,6 +4,31 @@ All notable changes to MCP Scraper are documented here. The format is based on [
4
4
 
5
5
  ## [Unreleased]
6
6
 
7
+ ## [0.66.3] - 2026-08-25
8
+
9
+ ### Changed
10
+
11
+ - Runtime MCP discovery now omits output schemas across hosted OAuth, API-key, npm stdio, and MCPB clients, while the complete generated developer contract continues to supply typed Node and Python SDK outputs.
12
+
13
+ ### Fixed
14
+
15
+ - Restored compatibility for strict MCP clients that could connect successfully but silently register zero tools when the complete output-schema catalog was advertised; tool calls retain both readable content and structured results.
16
+
17
+ ## [0.66.2] - 2026-08-24
18
+
19
+ ### Changed
20
+
21
+ - Hosted MCP, npm stdio, and MCPB now advertise every recorded tool output schema from one canonical contract; the former `none`, `essential`, and `all` environment profiles no longer change `tools/list`.
22
+ - Ordinary PAA calls continue to wait directly for their result, while Task-capable hosted clients start the same work immediately and poll its persisted status without routing the run through a scheduler.
23
+ - Direct PAA Tasks now allow three total managed-browser attempts, keeping the first two retryable browser interruptions or verification challenges inside the same Task and billing hold before exposing a terminal failure.
24
+
25
+ ### Fixed
26
+
27
+ - Direct PAA Tasks no longer sit in an external event queue before browser work begins; the request runtime starts provider work immediately and uses its existing 800-second execution window.
28
+ - Complete output-schema advertising no longer causes Task-capable tools to be serialized as already-completed calls; hosted Task starts are validated and returned through the Task extension seam before terminal output validation.
29
+ - Replaying an idempotent request returns the existing run and never redispatches it, preserving duplicate-charge protection without turning replay into job recovery.
30
+ - Public npm artifacts no longer embed a developer-machine path for optional site-audit ZIP classification; installs use portable configuration and keep the existing LLM fallback when that dataset is absent.
31
+
7
32
  ## [0.66.1] - 2026-08-24
8
33
 
9
34
  ### Changed
@@ -1073,7 +1098,10 @@ All notable changes to MCP Scraper are documented here. The format is based on [
1073
1098
  - Write actions remain unavailable until the account owner explicitly enables them.
1074
1099
  - Provider-specific connection data is normalized into one agent-facing contract.
1075
1100
 
1076
- [Unreleased]: https://github.com/VilovietaSEO/mcp-scraper/compare/v0.66.0...HEAD
1101
+ [Unreleased]: https://github.com/VilovietaSEO/mcp-scraper/compare/v0.66.3...HEAD
1102
+ [0.66.3]: https://github.com/VilovietaSEO/mcp-scraper/compare/v0.66.2...v0.66.3
1103
+ [0.66.2]: https://github.com/VilovietaSEO/mcp-scraper/compare/v0.66.1...v0.66.2
1104
+ [0.66.1]: https://github.com/VilovietaSEO/mcp-scraper/compare/v0.66.0...v0.66.1
1077
1105
  [0.66.0]: https://github.com/VilovietaSEO/mcp-scraper/compare/v0.65.1...v0.66.0
1078
1106
  [0.65.1]: https://github.com/VilovietaSEO/mcp-scraper/compare/v0.65.0...v0.65.1
1079
1107
  [0.65.0]: https://github.com/VilovietaSEO/mcp-scraper/compare/v0.64.1...v0.65.0
package/README.md CHANGED
@@ -159,7 +159,7 @@ Build the branded one-click bundle:
159
159
  npm run build:mcpb
160
160
  ```
161
161
 
162
- The generated bundle is written to `build/mcpb/mcp-scraper-<version>.mcpb` and copied to `public/downloads/` for the hosted download. The current public bundle is `https://mcpscraper.dev/downloads/mcp-scraper.mcpb` (`0.66.1`, SHA-256 `4784c8f97d3e4eebe423f11454760efbfca7d65b5f03bcb27401b15d84d6a4ad`). Install it by opening or dragging it into Claude Desktop. Claude displays the `MCP Scraper` install card, icon, API-key configuration field, and manually curated current-release message from the bundle manifest.
162
+ The generated bundle is written to `build/mcpb/mcp-scraper-<version>.mcpb` and copied to `public/downloads/` for the hosted download. The current public bundle is `https://mcpscraper.dev/downloads/mcp-scraper.mcpb` (`0.66.3`, SHA-256 `353b034b878340971fc1e07ca2ccf11578d6fd2e2ff894c8da1fa7df2c2bbd2d`). Install it by opening or dragging it into Claude Desktop. Claude displays the `MCP Scraper` install card, icon, API-key configuration field, and manually curated current-release message from the bundle manifest.
163
163
 
164
164
  The MCPB install exposes every tool — web-intelligence plus all `browser_*` tools — through the one `mcp-scraper` server.
165
165
 
@@ -315,7 +315,7 @@ For Google SERP and Maps tools, callers provide the query, two-letter country co
315
315
 
316
316
  The `mcp-scraper` server (and the MCPB bundle, which runs it) exposes both sections through one MCP server.
317
317
 
318
- All MCP tools expose output schemas and return `structuredContent` with the IDs, URLs, CSV paths, transcripts, browser session handles, replay paths, artifacts, recipe fields, or blueprint fields needed by the next step. Browser Agent tools keep a JSON text block for older clients, but structured data is the primary contract. All tools carry MCP annotations; file-writing tools such as replay downloads and annotations state their filesystem side effects.
318
+ All MCP tools return `structuredContent` with the IDs, URLs, CSV paths, transcripts, browser session handles, replay paths, artifacts, recipe fields, or blueprint fields needed by the next step, plus readable text content for compatibility. Runtime `tools/list` omits output schemas so strict clients can register the complete catalog; the generated developer manifest retains every canonical output schema for validation and typed SDK generation. All tools carry MCP annotations; file-writing tools such as replay downloads and annotations state their filesystem side effects.
319
319
 
320
320
  The canonical tool inventory is generated at `docs/mcp-tool-manifest.generated.json`. The unified server exposes 259 tools: 158 scraper, browser, workflow, billing, and connected-service tools plus 101 durable-memory tools. The scraper-side inventory includes rendered site-content similarity, governed Local Sourcebook tools, Transparent Commons entity, linkset, and publication tools, direct site-export text and image readers, the searchable News Publisher and Editorial Reading Room template workflow, and 24 X-Ray tools for pixel administration, reporting, attribution journeys, campaign links, exports, and scheduled reports. Successful evidence-compiled Local Sourcebook revisions publish automatically to their canonical `localsourcebook.com` category profile and review URLs; administrator controls handle exceptional rejection or unpublishing. Release verification compares the exact local and hosted tool-name sets, not only the count.
321
321