mcp-scraper 0.85.0 → 0.86.1

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/CHANGELOG.md CHANGED
@@ -4,6 +4,36 @@ All notable changes to MCP Scraper are documented here. The format is based on [
4
4
 
5
5
  ## [Unreleased]
6
6
 
7
+ ## [0.86.1] - 2026-09-02
8
+
9
+ ### Fixed
10
+
11
+ - Retried Reddit thread hydration through as many as two fresh primary residential sessions and two bounded managed-browser backup sessions, stopping after the first accepted result while retaining per-attempt provider and cost telemetry.
12
+ - Restored visually hidden accessible labels for native CRM and Research search, select, submit, deal-stage, and X-Ray evidence controls.
13
+ - Prevented the native CRM and Research toolbar from stretching into a full-height column at tablet and phone breakpoints.
14
+ - Routed the native `/research/*` and `/crm/*` REST facades through the production API function instead of allowing the canonical host to fall through to a 404.
15
+
16
+ ## [0.86.0] - 2026-09-01
17
+
18
+ ### Added
19
+
20
+ - Added separate authenticated Research and native CRM workspaces with owner-scoped people, organizations, activities, tasks, deals, pipelines, imports, duplicate review, and quality queues.
21
+ - Added 27 governed Memory tools, including native CRM work search and pipeline list/upsert, plus X-Ray handoffs that create or update canonical relationship records without making the analytics store a second CRM.
22
+ - Added operator and agent documentation for choosing Research versus CRM, stable ID handoffs, migration gates, preview/apply authority, first-party tracking limits, and provider readiness.
23
+
24
+ ### Changed
25
+
26
+ - Expanded the unified MCP contract to 377 tools and the direct Memory contract to 148 tools, with generated Node, Python, CLI, cURL, and public product projections kept in parity.
27
+ - Redirected legacy Analytics CRM bookmarks into native CRM Settings while preserving recognized X-Ray context, and made Vault creation choose an explicit Research or CRM domain.
28
+
29
+ ### Removed
30
+
31
+ - Withdrew all public Salesforce, Pipedrive, Stripe, and other external CRM setup, discovery, synchronization, and write operations that lack the complete provider release evidence contract.
32
+
33
+ ### Security
34
+
35
+ - Kept Research evidence and managed CRM relationships in separate schemas and authority domains; counterpart links copy no fields, governed mutations use owner-scoped IDs and idempotency, and real-customer migration remains blocked pending explicit approval.
36
+
7
37
  ## [0.85.0] - 2026-09-01
8
38
 
9
39
  ### Changed
@@ -1651,7 +1681,8 @@ All notable changes to MCP Scraper are documented here. The format is based on [
1651
1681
  - Write actions remain unavailable until the account owner explicitly enables them.
1652
1682
  - Provider-specific connection data is normalized into one agent-facing contract.
1653
1683
 
1654
- [Unreleased]: https://github.com/VilovietaSEO/mcp-scraper/compare/v0.84.0...HEAD
1684
+ [Unreleased]: https://github.com/VilovietaSEO/mcp-scraper/compare/v0.86.0...HEAD
1685
+ [0.86.0]: https://github.com/VilovietaSEO/mcp-scraper/compare/v0.85.0...v0.86.0
1655
1686
  [0.84.0]: https://github.com/VilovietaSEO/mcp-scraper/compare/v0.83.5...v0.84.0
1656
1687
  [0.83.5]: https://github.com/VilovietaSEO/mcp-scraper/compare/v0.83.4...v0.83.5
1657
1688
  [0.83.4]: https://github.com/VilovietaSEO/mcp-scraper/compare/v0.83.3...v0.83.4
package/README.md CHANGED
@@ -175,7 +175,7 @@ Build the branded one-click bundle:
175
175
  npm run build:mcpb
176
176
  ```
177
177
 
178
- The generated bundle is written to `build/mcpb/mcp-scraper-<version>.mcpb` and copied to `public/downloads/` for the hosted download. The current public bundle is `https://mcpscraper.dev/downloads/mcp-scraper.mcpb` (`0.85.0`, SHA-256 `2410fb6216af649dba24e62df9fa438b85e02c5ed2d3610f9e630314c0a0c2fb`). Install it by opening or dragging it into Claude Desktop. Claude displays the `MCP Scraper` install card, icon, API-key configuration field, and manually curated current-release message from the bundle manifest.
178
+ The generated bundle is written to `build/mcpb/mcp-scraper-<version>.mcpb` and copied to `public/downloads/` for the hosted download. The current public bundle is `https://mcpscraper.dev/downloads/mcp-scraper.mcpb` (`0.86.1`, SHA-256 `c735311afd38095d4187fb5cbb79e5abed47b7c09d78e56ee6c2ecacd1b9270f`). Install it by opening or dragging it into Claude Desktop. Claude displays the `MCP Scraper` install card, icon, API-key configuration field, and manually curated current-release message from the bundle manifest.
179
179
 
180
180
  The MCPB install exposes every tool — web-intelligence plus all `browser_*` tools — through the one `mcp-scraper` server.
181
181
 
@@ -337,7 +337,7 @@ The `mcp-scraper` server (and the MCPB bundle, which runs it) exposes both secti
337
337
 
338
338
  All MCP tools return `structuredContent` with the IDs, URLs, CSV paths, transcripts, browser session handles, replay paths, artifacts, recipe fields, or blueprint fields needed by the next step, plus readable text content for compatibility. Runtime `tools/list` omits output schemas so strict clients can register the complete catalog; the generated developer manifest retains every canonical output schema for validation and typed SDK generation. All tools carry MCP annotations; file-writing tools such as replay downloads and annotations state their filesystem side effects.
339
339
 
340
- The canonical tool inventory is generated at `docs/mcp-tool-manifest.generated.json`. The unified server exposes 369 tools: 268 scraper, browser, workflow, billing, connected-service, and personal-assistant tools plus 101 durable-memory tools. The scraper-side inventory includes complete Gmail selection, message, attachment, export, bulk-action, and Memory-import workflows; governed personal-assistant commands, messaging, approvals, grants, number setup, and execution readback; durable PAA starts and status; rendered site-content similarity; governed Local Sourcebook and Transparent Commons workflows; direct site-export reads; Editorial Reading Room and News Publisher templates; and production X-Ray setup, analytics, seven-model attribution, structured post-purchase surveys, reported impact, truthful view-evidence status, CRM policy and receipt, campaign, export, and scheduled-report tools. Provider setup remains absent until its authorization, ingestion, reconciliation, privacy, canary, cleanup, and deployment receipts are complete. Successful evidence-compiled Local Sourcebook revisions publish automatically to their canonical `localsourcebook.com` category profile and review URLs; administrator controls handle exceptional rejection or unpublishing. Release verification compares the exact local and hosted tool-name sets, not only the count.
340
+ The canonical tool inventory is generated at `docs/mcp-tool-manifest.generated.json`. The unified server exposes 377 tools: 249 scraper, browser, workflow, billing, connected-service, and personal-assistant tools plus 128 durable-memory tools. The scraper-side inventory includes complete Gmail selection, message, attachment, export, bulk-action, and Memory-import workflows; governed personal-assistant commands, messaging, approvals, grants, number setup, and execution readback; durable PAA starts and status; rendered site-content similarity; governed Local Sourcebook and Transparent Commons workflows; direct site-export reads; Editorial Reading Room and News Publisher templates; and production X-Ray setup, analytics, seven-model attribution, structured post-purchase surveys, reported impact, truthful view-evidence status, CRM policy and receipt, campaign, export, and scheduled-report tools. Provider setup remains absent until its authorization, ingestion, reconciliation, privacy, canary, cleanup, and deployment receipts are complete. Successful evidence-compiled Local Sourcebook revisions publish automatically to their canonical `localsourcebook.com` category profile and review URLs; administrator controls handle exceptional rejection or unpublishing. Release verification compares the exact local and hosted tool-name sets, not only the count.
341
341
 
342
342
  For contract parity, stdio and MCPB memory calls invoke the matching public tool on the hosted MCP Scraper `/mcp` endpoint. The hosted aggregate runtime owns MCP Scraper-specific billing, scheduling, credential, and in-process cutover policy; its internal `/memory/mcp-call` bridge is a fallback to the standalone memory service, not the public stdio execution path. Direct `mcp-memory` OAuth and stdio clients continue to use `memory.mcpscraper.dev` and must be verified as a separate dependent release surface.
343
343
 
@@ -21,11 +21,13 @@ import {
21
21
  appendAnalyticsAuthoritativeOutcomeVersion,
22
22
  archiveAnalyticsActivationDestination,
23
23
  archiveAnalyticsCampaignLink,
24
+ assignAnalyticsIdentityNode,
24
25
  backfillAnalyticsConfirmedHistory,
25
26
  claimAnalyticsCrmImportRows,
26
27
  claimAnalyticsFormDeliveryJobs,
27
28
  closeAnalyticsPool,
28
29
  completeAnalyticsCrmImportRow,
30
+ completeAnalyticsFormBridgeDelivery,
29
31
  completeAnalyticsFormDelivery,
30
32
  consumeAnalyticsSurveyInvite,
31
33
  createAnalyticsActivationDestination,
@@ -39,6 +41,7 @@ import {
39
41
  deferAnalyticsCrmImportRow,
40
42
  deferAnalyticsFormDelivery,
41
43
  deleteAnalyticsSite,
44
+ deterministicAnalyticsCrmEntityId,
42
45
  enrichAnalyticsExistingCrmIdentity,
43
46
  getAnalyticsActivationDestinationConnectionRef,
44
47
  getAnalyticsPersonJourney,
@@ -69,6 +72,7 @@ import {
69
72
  projectAnalyticsAuthoritativeConversion,
70
73
  projectAnalyticsPixelEventConsent,
71
74
  queueAnalyticsActivation,
75
+ queueAnalyticsFormBridgeTransaction,
72
76
  queueAnalyticsFormDelivery,
73
77
  recordAnalyticsFormSubmission,
74
78
  redeemAnalyticsLinkerRecord,
@@ -89,7 +93,7 @@ import {
89
93
  updateAnalyticsPixel,
90
94
  upsertAnalyticsAdSpend,
91
95
  upsertAnalyticsHostGroup
92
- } from "./chunk-TLRJV4SL.js";
96
+ } from "./chunk-X623GTBV.js";
93
97
  import "./chunk-C5Z4OFKW.js";
94
98
  import "./chunk-YXNDOQXN.js";
95
99
  export {
@@ -115,11 +119,13 @@ export {
115
119
  appendAnalyticsAuthoritativeOutcomeVersion,
116
120
  archiveAnalyticsActivationDestination,
117
121
  archiveAnalyticsCampaignLink,
122
+ assignAnalyticsIdentityNode,
118
123
  backfillAnalyticsConfirmedHistory,
119
124
  claimAnalyticsCrmImportRows,
120
125
  claimAnalyticsFormDeliveryJobs,
121
126
  closeAnalyticsPool,
122
127
  completeAnalyticsCrmImportRow,
128
+ completeAnalyticsFormBridgeDelivery,
123
129
  completeAnalyticsFormDelivery,
124
130
  consumeAnalyticsSurveyInvite,
125
131
  createAnalyticsActivationDestination,
@@ -133,6 +139,7 @@ export {
133
139
  deferAnalyticsCrmImportRow,
134
140
  deferAnalyticsFormDelivery,
135
141
  deleteAnalyticsSite,
142
+ deterministicAnalyticsCrmEntityId,
136
143
  enrichAnalyticsExistingCrmIdentity,
137
144
  getAnalyticsActivationDestinationConnectionRef,
138
145
  getAnalyticsPersonJourney,
@@ -163,6 +170,7 @@ export {
163
170
  projectAnalyticsAuthoritativeConversion,
164
171
  projectAnalyticsPixelEventConsent,
165
172
  queueAnalyticsActivation,
173
+ queueAnalyticsFormBridgeTransaction,
166
174
  queueAnalyticsFormDelivery,
167
175
  recordAnalyticsFormSubmission,
168
176
  redeemAnalyticsLinkerRecord,
@@ -17,8 +17,8 @@ loadDotEnv();
17
17
  async function main() {
18
18
  const [{ serve }, { app, personalAssistantProductionStartup }, { startWorker }, { migrate }] = await Promise.all([
19
19
  import("@hono/node-server"),
20
- import("../server-EOPETL7Q.js"),
21
- import("../worker-5A375BGN.js"),
20
+ import("../server-UQ33P5V5.js"),
21
+ import("../worker-OQSFSLNG.js"),
22
22
  import("../db-Z34LPZNR.js")
23
23
  ]);
24
24
  const PORT = parseInt(process.env.PORT ?? "3001");
@@ -26,7 +26,7 @@ async function main() {
26
26
  await personalAssistantProductionStartup;
27
27
  await migrate();
28
28
  if (process.env.ANALYTICS_DATABASE_URL) {
29
- const { migrateAnalytics } = await import("../analytics-repository-4VZQ4TKW.js");
29
+ const { migrateAnalytics } = await import("../analytics-repository-GGJJCVVP.js");
30
30
  await migrateAnalytics();
31
31
  }
32
32
  startWorker();
@@ -19,7 +19,7 @@ import {
19
19
  import "../chunk-GGZEC22A.js";
20
20
  import {
21
21
  PACKAGE_VERSION
22
- } from "../chunk-RHAOKXQK.js";
22
+ } from "../chunk-C4C4WUTV.js";
23
23
 
24
24
  // src/cli/human-cli.ts
25
25
  import { Command } from "commander";
@@ -1,19 +1,19 @@
1
1
  #!/usr/bin/env node
2
2
  import {
3
3
  runMcpScraperStdio
4
- } from "../chunk-2ZDYUTOZ.js";
5
- import "../chunk-W4IY6CB4.js";
4
+ } from "../chunk-TYLVUAK3.js";
5
+ import "../chunk-3H7QTJLV.js";
6
6
  import "../chunk-PGJQDMC2.js";
7
7
  import "../chunk-DNM65UCK.js";
8
8
  import "../chunk-T3MZISOF.js";
9
9
  import "../chunk-6HAV7LCE.js";
10
- import "../chunk-X5HRAAQM.js";
10
+ import "../chunk-NKRO2SUO.js";
11
11
  import "../chunk-OM7HVEJ3.js";
12
12
  import "../chunk-OPQIGAFB.js";
13
- import "../chunk-WN7N4ESQ.js";
13
+ import "../chunk-3JRZZVWL.js";
14
14
  import "../chunk-P7FWOMU7.js";
15
15
  import "../chunk-GGZEC22A.js";
16
- import "../chunk-RHAOKXQK.js";
16
+ import "../chunk-C4C4WUTV.js";
17
17
  import "../chunk-YXNDOQXN.js";
18
18
 
19
19
  // src/mcp/thorbit-restricted-tool-surface.ts
@@ -1,10 +1,10 @@
1
1
  #!/usr/bin/env node
2
2
  import {
3
3
  renderInstallTerminal
4
- } from "../chunk-WN7N4ESQ.js";
4
+ } from "../chunk-3JRZZVWL.js";
5
5
  import {
6
6
  PACKAGE_VERSION
7
- } from "../chunk-RHAOKXQK.js";
7
+ } from "../chunk-C4C4WUTV.js";
8
8
 
9
9
  // bin/mcp-scraper-install.ts
10
10
  var noColor = process.argv.includes("--no-color") || process.env.NO_COLOR !== void 0 || process.env.FORCE_COLOR === "0" || !process.stdout.isTTY;
@@ -1,19 +1,19 @@
1
1
  #!/usr/bin/env node
2
2
  import {
3
3
  runMcpScraperStdio
4
- } from "../chunk-2ZDYUTOZ.js";
5
- import "../chunk-W4IY6CB4.js";
4
+ } from "../chunk-TYLVUAK3.js";
5
+ import "../chunk-3H7QTJLV.js";
6
6
  import "../chunk-PGJQDMC2.js";
7
7
  import "../chunk-DNM65UCK.js";
8
8
  import "../chunk-T3MZISOF.js";
9
9
  import "../chunk-6HAV7LCE.js";
10
- import "../chunk-X5HRAAQM.js";
10
+ import "../chunk-NKRO2SUO.js";
11
11
  import "../chunk-OM7HVEJ3.js";
12
12
  import "../chunk-OPQIGAFB.js";
13
- import "../chunk-WN7N4ESQ.js";
13
+ import "../chunk-3JRZZVWL.js";
14
14
  import "../chunk-P7FWOMU7.js";
15
15
  import "../chunk-GGZEC22A.js";
16
- import "../chunk-RHAOKXQK.js";
16
+ import "../chunk-C4C4WUTV.js";
17
17
  import "../chunk-YXNDOQXN.js";
18
18
 
19
19
  // bin/mcp-stdio-server.ts