mcp-scraper 0.2.23 → 0.3.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +19 -4
- package/dist/bin/api-server.cjs +916 -7
- package/dist/bin/api-server.cjs.map +1 -1
- package/dist/bin/api-server.js +1 -1
- package/dist/bin/browser-agent-stdio-server.cjs +989 -28
- package/dist/bin/browser-agent-stdio-server.cjs.map +1 -1
- package/dist/bin/browser-agent-stdio-server.js +3 -2
- package/dist/bin/browser-agent-stdio-server.js.map +1 -1
- package/dist/bin/mcp-scraper-cli.cjs +110 -10
- package/dist/bin/mcp-scraper-cli.cjs.map +1 -1
- package/dist/bin/mcp-scraper-cli.js +110 -10
- package/dist/bin/mcp-scraper-cli.js.map +1 -1
- package/dist/bin/mcp-scraper-combined-stdio-server.cjs +1015 -54
- package/dist/bin/mcp-scraper-combined-stdio-server.cjs.map +1 -1
- package/dist/bin/mcp-scraper-combined-stdio-server.js +5 -4
- package/dist/bin/mcp-scraper-combined-stdio-server.js.map +1 -1
- package/dist/bin/mcp-scraper-install.cjs +8 -8
- package/dist/bin/mcp-scraper-install.cjs.map +1 -1
- package/dist/bin/mcp-scraper-install.js +2 -2
- package/dist/bin/mcp-stdio-server.cjs +1 -1
- package/dist/bin/mcp-stdio-server.cjs.map +1 -1
- package/dist/bin/mcp-stdio-server.js +2 -2
- package/dist/{chunk-IXUMOR3H.js → chunk-DH4H3F6S.js} +131 -3
- package/dist/chunk-DH4H3F6S.js.map +1 -0
- package/dist/chunk-NXRWFOEZ.js +816 -0
- package/dist/chunk-NXRWFOEZ.js.map +1 -0
- package/dist/chunk-PGWJ2EJ3.js +7 -0
- package/dist/chunk-PGWJ2EJ3.js.map +1 -0
- package/dist/{chunk-4IFAEXVH.js → chunk-Q4STSM63.js} +8 -8
- package/dist/chunk-Q4STSM63.js.map +1 -0
- package/dist/{chunk-HHUOVPAO.js → chunk-SIXJ6EVS.js} +2 -2
- package/dist/{server-G2WYJEUQ.js → server-MOP7NIUK.js} +40 -3
- package/dist/{server-G2WYJEUQ.js.map → server-MOP7NIUK.js.map} +1 -1
- package/docs/mcp-tool-craft-lint.generated.md +6 -2
- package/docs/mcp-tool-manifest.generated.json +37 -6
- package/package.json +1 -1
- package/dist/chunk-4IFAEXVH.js.map +0 -1
- package/dist/chunk-IXUMOR3H.js.map +0 -1
- package/dist/chunk-TEBDAK63.js +0 -7
- package/dist/chunk-TEBDAK63.js.map +0 -1
- /package/dist/{chunk-HHUOVPAO.js.map → chunk-SIXJ6EVS.js.map} +0 -0
package/README.md
CHANGED
|
@@ -9,7 +9,7 @@ Use the MCPB Desktop Extension for the branded Claude Desktop install, or use th
|
|
|
9
9
|
MCP Scraper ships three local stdio entrypoints plus human-facing helper CLIs:
|
|
10
10
|
|
|
11
11
|
- `mcp-scraper` — live web intelligence, SERP, PAA, site extraction, YouTube, Facebook ads and organic video transcripts, Maps, directory, rank tracker blueprint, and credit tools.
|
|
12
|
-
- `browser-agent` —
|
|
12
|
+
- `browser-agent` — agent-controlled browser tools for hosted cloud sessions or local Chrome profile mode, with screenshots, clicks, typing, scrolling, watch URLs, replay links, MP4 replay download, and local profile import/sync helpers.
|
|
13
13
|
- `mcp-scraper-combined` — one context-aware command. In a human terminal it prints the branded ASCII install card; in an MCP client it runs the combined stdio server with both tool sets. This is the entrypoint used by the MCPB Desktop Extension.
|
|
14
14
|
- `mcp-scraper-install` — explicit alias for the human-facing terminal installer card with the branded ASCII intro and copyable install commands.
|
|
15
15
|
- `mcp-scraper-cli` — a human-facing CLI for setup checks, AI-agent config generation, workflow prompts, local SEO workflow runs, and local HTML reports. This command is safe to print because it is not an MCP stdio server.
|
|
@@ -38,11 +38,14 @@ Run setup checks and generate agent wiring:
|
|
|
38
38
|
npx -y -p mcp-scraper@latest mcp-scraper-cli doctor
|
|
39
39
|
npx -y -p mcp-scraper@latest mcp-scraper-cli browser profiles --email seo@example.com
|
|
40
40
|
npx -y -p mcp-scraper@latest mcp-scraper-cli browser import-chrome --email seo@example.com --name seo-example-com
|
|
41
|
+
MCP_SCRAPER_API_KEY=sk_live_your_key npx -y -p mcp-scraper@latest mcp-scraper-cli agent install claude --apply
|
|
41
42
|
npx -y -p mcp-scraper@latest mcp-scraper-cli agent install codex
|
|
42
43
|
npx -y -p mcp-scraper@latest mcp-scraper-cli agent install claude-desktop --browser-mode local --browser-profile seo-example-com
|
|
43
44
|
npx -y -p mcp-scraper@latest mcp-scraper-cli agent prompt agent-packet
|
|
44
45
|
```
|
|
45
46
|
|
|
47
|
+
`agent install claude --apply` upserts the Claude Code user-scope `mcp-scraper` entry to `npx -y -p mcp-scraper@latest mcp-scraper-combined`. Fully exit Claude Code and open a new Claude terminal after applying; MCP servers are attached when Claude starts.
|
|
48
|
+
|
|
46
49
|
Check usage and upgrade concurrency from a normal terminal:
|
|
47
50
|
|
|
48
51
|
```bash
|
|
@@ -90,7 +93,7 @@ Build the branded one-click bundle:
|
|
|
90
93
|
npm run build:mcpb
|
|
91
94
|
```
|
|
92
95
|
|
|
93
|
-
The generated bundle is written to `build/mcpb/mcp-scraper-<version>.mcpb` and copied to `public/downloads/` for the hosted download. The current public bundle is `https://mcpscraper.dev/downloads/mcp-scraper.mcpb` (`0.2.
|
|
96
|
+
The generated bundle is written to `build/mcpb/mcp-scraper-<version>.mcpb` and copied to `public/downloads/` for the hosted download. The current public bundle is `https://mcpscraper.dev/downloads/mcp-scraper.mcpb` (`0.2.24`, SHA-256 `2aff0e961e3de920d1fc67230056988a4a9120735f26f234f0ada6242350a4f0`). Install it by opening or dragging it into Claude Desktop. Claude displays the `MCP Scraper` install card, icon, and API-key configuration field from the bundle manifest.
|
|
94
97
|
|
|
95
98
|
The MCPB install exposes the same web-intelligence tools as `mcp-scraper` plus all `browser_*` tools from `browser-agent` through one server.
|
|
96
99
|
|
|
@@ -121,7 +124,7 @@ For local Chrome state, first clone a Chrome profile into MCP Scraper managed st
|
|
|
121
124
|
|
|
122
125
|
```bash
|
|
123
126
|
mcp-scraper-cli browser import-chrome --email you@example.com --name work-accounts
|
|
124
|
-
mcp-scraper-cli agent install
|
|
127
|
+
MCP_SCRAPER_API_KEY=sk_live_your_key mcp-scraper-cli agent install claude --apply --browser-mode local --browser-profile work-accounts
|
|
125
128
|
```
|
|
126
129
|
|
|
127
130
|
`browser import-chrome` copies the selected local Chrome profile into `~/.mcp-scraper/browser-profiles/<name>/user-data`, skipping cache and lock files. The managed clone can include cookies, local storage, history, session storage, and Chrome password database files. It does not upload the profile. Re-run `mcp-scraper-cli browser sync-profile <name>` after logging into new sites in normal Chrome.
|
|
@@ -132,7 +135,19 @@ Hosted browser profiles are still available. `BROWSER_AGENT_PROFILE_NAME` sets t
|
|
|
132
135
|
|
|
133
136
|
Inside MCP clients, use `browser_profile_list` to inspect local Chrome account/profile metadata, `browser_profile_import` to clone a profile for local browser mode, `browser_profile_sync` to refresh an existing clone, and `browser_profile_onboard` only for hosted Kernel setup.
|
|
134
137
|
|
|
135
|
-
Claude Code:
|
|
138
|
+
Claude Code one-command setup:
|
|
139
|
+
|
|
140
|
+
```bash
|
|
141
|
+
MCP_SCRAPER_API_KEY=sk_live_your_key npx -y -p mcp-scraper@latest mcp-scraper-cli agent install claude --apply
|
|
142
|
+
```
|
|
143
|
+
|
|
144
|
+
Then fully exit Claude Code, open a new Claude terminal, and verify:
|
|
145
|
+
|
|
146
|
+
```bash
|
|
147
|
+
claude mcp list
|
|
148
|
+
```
|
|
149
|
+
|
|
150
|
+
Manual Claude Code command:
|
|
136
151
|
|
|
137
152
|
```bash
|
|
138
153
|
claude mcp add mcp-scraper --scope user --env MCP_SCRAPER_API_KEY=sk_live_your_key -- npx -y -p mcp-scraper@latest mcp-scraper-combined
|