@zenrows/cli 1.4.1 → 1.5.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +84 -11
- package/dist/src/cli/commands/crawl.js +535 -0
- package/dist/src/cli/commands/fetch.js +2 -2
- package/dist/src/cli/index.js +2 -1
- package/dist/src/cli/output.js +38 -15
- package/dist/src/core/config.js +1 -1
- package/dist/src/core/crawl-api.js +418 -0
- package/dist/src/core/errors.js +9 -0
- package/package.json +2 -1
- package/registry/capabilities.json +9 -0
- package/registry/skills.json +11 -0
- package/skills/crawl/SKILL.md +126 -0
- package/skills/trace-debug/SKILL.md +16 -3
- package/skills/zenrows/SKILL.md +5 -0
package/skills/zenrows/SKILL.md
CHANGED
|
@@ -34,6 +34,10 @@ If the user has a known URL and wants page content:
|
|
|
34
34
|
If the user has a known URL and wants structured data:
|
|
35
35
|
→ Use Extract. (zenrows extract <url> | --autoparse | --css)
|
|
36
36
|
|
|
37
|
+
If the user has a start page (listing, index, section) but not the item URLs:
|
|
38
|
+
→ Use Crawl. (zenrows crawl create <url> --depth 1 --follow,
|
|
39
|
+
then `zenrows crawl results <id>`)
|
|
40
|
+
|
|
37
41
|
If the user has many URLs (bulk):
|
|
38
42
|
→ Use Batch. (validate one page with fetch/extract first,
|
|
39
43
|
then `zenrows batch create <jobs.jsonl>`)
|
|
@@ -70,6 +74,7 @@ Run `zenrows status` for the live capability matrix. As of this toolkit:
|
|
|
70
74
|
| Protected Fetch | `zenrows fetch` | available (`GET /v1/`) |
|
|
71
75
|
| Extract (extract=auto / Autoparse/CSS/Markdown) | `zenrows extract` | beta (same `/v1/`; extract=auto falls back to autoparse) |
|
|
72
76
|
| Batch | `zenrows batch` | beta — runs cloud jobs (create/status/results); cheapest path at scale. Estimate specs locally with no key |
|
|
77
|
+
| Crawl | `zenrows crawl` | new — collect the URLs behind one start page, optionally with each page's HTML |
|
|
73
78
|
| Browser | `zenrows browser` | available (Browser Sessions REST API / MCP) |
|
|
74
79
|
| MCP | `zenrows mcp` | available (remote + local server) |
|
|
75
80
|
|