@hybridlabor-api/aos 4.5.0 → 4.5.2

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (50) hide show
  1. package/.claude/hooks/memb-inject.mjs +135 -40
  2. package/.claude/workflows/startcycle-dispatch.mjs +318 -3
  3. package/.opencode/plugins/bdb-aos.js +171 -0
  4. package/bin/aos-dashboard.mjs +8 -2
  5. package/installer.js +307 -12
  6. package/package.json +1 -1
  7. package/skills/global_config/aos-setup/SKILL.md +7 -9
  8. package/skills/global_config/aos-setup/scripts/aos-doctor.mjs +43 -1
  9. package/skills/global_config/openwiki-skill/scripts/install_daemon.ps1 +107 -18
  10. package/.agents/skills/firecrawl/SKILL.md +0 -149
  11. package/.agents/skills/firecrawl/rules/install.md +0 -82
  12. package/.agents/skills/firecrawl/rules/security.md +0 -26
  13. package/.agents/skills/firecrawl-agent/SKILL.md +0 -58
  14. package/.agents/skills/firecrawl-build/SKILL.md +0 -39
  15. package/.agents/skills/firecrawl-build-interact/SKILL.md +0 -68
  16. package/.agents/skills/firecrawl-build-onboarding/SKILL.md +0 -103
  17. package/.agents/skills/firecrawl-build-onboarding/references/auth-flow.md +0 -39
  18. package/.agents/skills/firecrawl-build-onboarding/references/project-setup.md +0 -20
  19. package/.agents/skills/firecrawl-build-onboarding/references/sdk-installation.md +0 -17
  20. package/.agents/skills/firecrawl-build-scrape/SKILL.md +0 -69
  21. package/.agents/skills/firecrawl-build-search/SKILL.md +0 -69
  22. package/.agents/skills/firecrawl-crawl/SKILL.md +0 -59
  23. package/.agents/skills/firecrawl-download/SKILL.md +0 -70
  24. package/.agents/skills/firecrawl-interact/SKILL.md +0 -84
  25. package/.agents/skills/firecrawl-map/SKILL.md +0 -51
  26. package/.agents/skills/firecrawl-scrape/SKILL.md +0 -69
  27. package/.agents/skills/firecrawl-search/SKILL.md +0 -60
  28. package/mcps/RhinoMCP/cc-plugin/.claude/settings.json +0 -10
  29. package/mcps/after-effects-mcp/build/index.js +0 -840
  30. package/mcps/after-effects-mcp/build/scripts/applyEffect.jsx +0 -153
  31. package/mcps/after-effects-mcp/build/scripts/applyEffectTemplate.jsx +0 -218
  32. package/mcps/after-effects-mcp/build/scripts/createComposition.jsx +0 -71
  33. package/mcps/after-effects-mcp/build/scripts/createShapeLayer.jsx +0 -147
  34. package/mcps/after-effects-mcp/build/scripts/createSolidLayer.jsx +0 -114
  35. package/mcps/after-effects-mcp/build/scripts/createTextLayer.jsx +0 -115
  36. package/mcps/after-effects-mcp/build/scripts/getLayerInfo.jsx +0 -192
  37. package/mcps/after-effects-mcp/build/scripts/getProjectInfo.jsx +0 -90
  38. package/mcps/after-effects-mcp/build/scripts/listCompositions.jsx +0 -50
  39. package/mcps/after-effects-mcp/build/scripts/mcp-bridge-auto.jsx +0 -1773
  40. package/mcps/after-effects-mcp/build/scripts/setLayerProperties.jsx +0 -160
  41. package/mcps/computer-use-mcp/dist/client.d.ts +0 -150
  42. package/mcps/computer-use-mcp/dist/client.js +0 -136
  43. package/mcps/computer-use-mcp/dist/entrypoint.d.ts +0 -16
  44. package/mcps/computer-use-mcp/dist/entrypoint.js +0 -26
  45. package/mcps/computer-use-mcp/dist/native.d.ts +0 -212
  46. package/mcps/computer-use-mcp/dist/native.js +0 -50
  47. package/mcps/computer-use-mcp/dist/server.d.ts +0 -32
  48. package/mcps/computer-use-mcp/dist/server.js +0 -342
  49. package/mcps/computer-use-mcp/dist/session.d.ts +0 -101
  50. package/mcps/computer-use-mcp/dist/session.js +0 -2372
@@ -1,103 +0,0 @@
1
- ---
2
- name: firecrawl-build-onboarding
3
- description: Get Firecrawl credentials and SDK setup into a project. Use when an application needs `FIRECRAWL_API_KEY`, when an agent should add Firecrawl to `.env`, when the user wants to authenticate Firecrawl for app code, or when choosing the first SDK and docs for a new Firecrawl integration. This skill includes its own browser auth flow, so it does not depend on the website onboarding skill.
4
- category: library
5
- license: ISC
6
- metadata:
7
- author: firecrawl
8
- version: "0.1.0"
9
- homepage: https://www.firecrawl.dev
10
- source: https://github.com/firecrawl/skills
11
- inputs:
12
- - name: FIRECRAWL_API_KEY
13
- description: Firecrawl API key used for hosted Firecrawl API requests.
14
- required: true
15
- - name: FIRECRAWL_API_URL
16
- description: Optional base URL for self-hosted Firecrawl deployments.
17
- required: false
18
- references:
19
- - references/auth-flow.md
20
- - references/sdk-installation.md
21
- - references/project-setup.md
22
- ---
23
-
24
- # Firecrawl Build Onboarding
25
-
26
- Use this skill for the application-integration path from Firecrawl's onboarding flow.
27
-
28
- ## Install
29
-
30
- If you haven't installed yet, one command sets up both the CLI tools
31
- (for live web work) and the build skills (for app integration):
32
-
33
- ```bash
34
- npx -y firecrawl-cli@latest init --all --browser
35
- ```
36
-
37
- This installs the Firecrawl CLI, the CLI skills, and these build skills
38
- together. It also opens browser auth so the human can sign in or create
39
- an account. No separate `npx skills add` step is needed.
40
-
41
- ## Use This When
42
-
43
- - a project needs `FIRECRAWL_API_KEY`
44
- - the user wants Firecrawl wired into `.env`
45
- - you are adding Firecrawl to an app for the first time
46
- - you need to choose the first SDK or REST path
47
-
48
- If the human still needs to sign up, sign in, or authorize access in the browser, use the auth flow reference in this skill.
49
-
50
- ## Quick Start
51
-
52
- If the user already has an API key, place it in `.env`:
53
-
54
- ```dotenv
55
- FIRECRAWL_API_KEY=fc-...
56
- ```
57
-
58
- If the project is self-hosted, also set:
59
-
60
- ```dotenv
61
- FIRECRAWL_API_URL=https://your-firecrawl-instance.example.com
62
- ```
63
-
64
- Then decide which integration path applies:
65
-
66
- - **Fresh project** -> choose the target stack, install the SDK, add the first Firecrawl call, and run a smoke test
67
- - **Existing project** -> inspect the repo first, then integrate Firecrawl where the project already handles third-party APIs and env vars
68
-
69
- ## What Do You Need?
70
-
71
- | Task | Reference |
72
- |---|---|
73
- | **Run the browser auth flow and save `FIRECRAWL_API_KEY`** | [references/auth-flow.md](references/auth-flow.md) |
74
- | **Install the right SDK** | [references/sdk-installation.md](references/sdk-installation.md) |
75
- | **Put credentials into `.env` or project config** | [references/project-setup.md](references/project-setup.md) |
76
- | **Choose the right endpoint after setup** | [firecrawl-build](../firecrawl-build/SKILL.md) |
77
- | **Need live web tooling during this task** | The CLI skills are already installed from the same command |
78
- | **Start implementation from a known URL** | [firecrawl-build-scrape](../firecrawl-build-scrape/SKILL.md) |
79
- | **Start implementation from a query** | [firecrawl-build-search](../firecrawl-build-search/SKILL.md) |
80
-
81
- ## Docs (Source of Truth)
82
-
83
- Read the source-of-truth page for your project language for SDK usage, schemas, and examples:
84
-
85
- - **Node / TypeScript**: [docs.firecrawl.dev/agent-source-of-truth/node](https://docs.firecrawl.dev/agent-source-of-truth/node)
86
- - **Python**: [docs.firecrawl.dev/agent-source-of-truth/python](https://docs.firecrawl.dev/agent-source-of-truth/python)
87
- - **Rust**: [docs.firecrawl.dev/agent-source-of-truth/rust](https://docs.firecrawl.dev/agent-source-of-truth/rust)
88
- - **Java**: [docs.firecrawl.dev/agent-source-of-truth/java](https://docs.firecrawl.dev/agent-source-of-truth/java)
89
- - **Elixir**: [docs.firecrawl.dev/agent-source-of-truth/elixir](https://docs.firecrawl.dev/agent-source-of-truth/elixir)
90
- - **cURL / REST**: [docs.firecrawl.dev/agent-source-of-truth/curl](https://docs.firecrawl.dev/agent-source-of-truth/curl)
91
-
92
- ## After Setup
93
-
94
- Once the key is present:
95
-
96
- 1. decide whether this is a fresh project or an existing codebase
97
- 2. ask what Firecrawl should do in the product
98
- 3. pick the narrowest endpoint that matches that behavior
99
- 4. read the source-of-truth page for the project language before writing code
100
- 5. add the SDK or REST call in code
101
- 6. run a smoke test that proves one real Firecrawl request succeeds
102
- 7. use the endpoint-specific skills in this repo for implementation guidance
103
- 8. if you also need live web tooling during the current task, the CLI skills are already installed — use `firecrawl/cli`
@@ -1,39 +0,0 @@
1
- # Auth Flow
2
-
3
- Use this browser flow when the user does not already have a Firecrawl API key.
4
-
5
- ## Step 1: Generate auth parameters
6
-
7
- ```bash
8
- SESSION_ID=$(openssl rand -hex 32)
9
- CODE_VERIFIER=$(openssl rand -base64 32 | tr '+/' '-_' | tr -d '=\n' | head -c 43)
10
- CODE_CHALLENGE=$(printf '%s' "$CODE_VERIFIER" | openssl dgst -sha256 -binary | openssl base64 -A | tr '+/' '-_' | tr -d '=')
11
- ```
12
-
13
- ## Step 2: Ask the user to open this URL
14
-
15
- ```text
16
- https://www.firecrawl.dev/cli-auth?code_challenge=$CODE_CHALLENGE&source=coding-agent#session_id=$SESSION_ID
17
- ```
18
-
19
- The user completes the browser authorization flow. If successful, the API key becomes available through the polling endpoint.
20
-
21
- ## Step 3: Poll for completion
22
-
23
- ```http
24
- POST https://www.firecrawl.dev/api/auth/cli/status
25
- Content-Type: application/json
26
-
27
- {"session_id":"$SESSION_ID","code_verifier":"$CODE_VERIFIER"}
28
- ```
29
-
30
- Responses:
31
-
32
- - `{"status":"pending"}` - continue polling
33
- - `{"status":"complete","apiKey":"fc-...","teamName":"..."}`
34
-
35
- ## Step 4: Save the key
36
-
37
- ```bash
38
- echo "FIRECRAWL_API_KEY=fc-..." >> .env
39
- ```
@@ -1,20 +0,0 @@
1
- # Project Setup
2
-
3
- For hosted Firecrawl, add this to `.env`:
4
-
5
- ```dotenv
6
- FIRECRAWL_API_KEY=fc-...
7
- ```
8
-
9
- For self-hosted Firecrawl, add:
10
-
11
- ```dotenv
12
- FIRECRAWL_API_KEY=fc-...
13
- FIRECRAWL_API_URL=https://your-firecrawl-instance.example.com
14
- ```
15
-
16
- Project setup guidance:
17
-
18
- - Keep the key in environment variables or the platform secret manager.
19
- - Do not hardcode credentials in source files.
20
- - If the app has separate environments, mirror the key setup across development, preview, and production as needed.
@@ -1,17 +0,0 @@
1
- # SDK Installation
2
-
3
- Install the SDK that matches the project stack after `FIRECRAWL_API_KEY` is available.
4
-
5
- ## JavaScript / TypeScript
6
-
7
- ```bash
8
- npm install @mendable/firecrawl-js
9
- ```
10
-
11
- ## Python
12
-
13
- ```bash
14
- pip install firecrawl-py
15
- ```
16
-
17
- If the project already has a preferred HTTP client abstraction, direct REST calls are also fine.
@@ -1,69 +0,0 @@
1
- ---
2
- name: firecrawl-build-scrape
3
- description: Integrate Firecrawl `/scrape` into product code for single-page extraction. Use when an app already has a URL and needs markdown, HTML, links, screenshots, metadata, or structured page output. Prefer this skill over broader crawl patterns when the feature is page-level.
4
- category: library
5
- license: ISC
6
- metadata:
7
- author: firecrawl
8
- version: "0.1.0"
9
- homepage: https://www.firecrawl.dev
10
- source: https://github.com/firecrawl/skills
11
- inputs:
12
- - name: FIRECRAWL_API_KEY
13
- description: Firecrawl API key for hosted Firecrawl requests.
14
- required: true
15
- - name: FIRECRAWL_API_URL
16
- description: Optional base URL for self-hosted Firecrawl deployments.
17
- required: false
18
- ---
19
-
20
- # Firecrawl Build Scrape
21
-
22
- Use this when the application already has the URL and needs content from one page.
23
-
24
- ## Use This When
25
-
26
- - the feature starts from a known URL
27
- - you need page content for retrieval, summarization, enrichment, or monitoring
28
- - you want the default extraction primitive before considering `/interact`
29
-
30
- ## Default Recommendations
31
-
32
- - Return `markdown` unless the feature truly needs another format.
33
- - Use `onlyMainContent` for article-like pages where nav and chrome add noise.
34
- - Add waits or other rendering options only when the page needs them.
35
-
36
- ## Common Product Patterns
37
-
38
- - knowledge ingestion from known URLs
39
- - enrichment from a company, product, or docs page
40
- - pricing, changelog, and documentation extraction
41
- - page-level quality checks or monitoring
42
-
43
- ## Escalation Rules
44
-
45
- - If you do not have the URL yet, start with [firecrawl-build-search](../firecrawl-build-search/SKILL.md).
46
- - If content requires clicks, typing, or multi-step navigation, escalate to [firecrawl-build-interact](../firecrawl-build-interact/SKILL.md).
47
-
48
- ## Implementation Notes
49
-
50
- - Keep the integration narrow: one feature, one URL, one extraction contract.
51
- - Treat `/scrape` as the default primitive for downstream LLM or indexing pipelines.
52
- - Request richer formats only when the consumer needs them, such as links, screenshots, or branding data.
53
-
54
- ## Docs (Source of Truth)
55
-
56
- Read the source-of-truth page for your project language before writing integration code:
57
-
58
- - **Node / TypeScript**: [docs.firecrawl.dev/agent-source-of-truth/node](https://docs.firecrawl.dev/agent-source-of-truth/node)
59
- - **Python**: [docs.firecrawl.dev/agent-source-of-truth/python](https://docs.firecrawl.dev/agent-source-of-truth/python)
60
- - **Rust**: [docs.firecrawl.dev/agent-source-of-truth/rust](https://docs.firecrawl.dev/agent-source-of-truth/rust)
61
- - **Java**: [docs.firecrawl.dev/agent-source-of-truth/java](https://docs.firecrawl.dev/agent-source-of-truth/java)
62
- - **Elixir**: [docs.firecrawl.dev/agent-source-of-truth/elixir](https://docs.firecrawl.dev/agent-source-of-truth/elixir)
63
- - **cURL / REST**: [docs.firecrawl.dev/agent-source-of-truth/curl](https://docs.firecrawl.dev/agent-source-of-truth/curl)
64
-
65
- ## See Also
66
-
67
- - [firecrawl-build](../firecrawl-build/SKILL.md)
68
- - [firecrawl-build-search](../firecrawl-build-search/SKILL.md)
69
- - [firecrawl-build-interact](../firecrawl-build-interact/SKILL.md)
@@ -1,69 +0,0 @@
1
- ---
2
- name: firecrawl-build-search
3
- description: Integrate Firecrawl `/search` into product code and agent workflows. Use when an app needs discovery before extraction, when the feature starts with a query instead of a URL, or when the system should search the web and optionally hydrate result content.
4
- category: library
5
- license: ISC
6
- metadata:
7
- author: firecrawl
8
- version: "0.1.0"
9
- homepage: https://www.firecrawl.dev
10
- source: https://github.com/firecrawl/skills
11
- inputs:
12
- - name: FIRECRAWL_API_KEY
13
- description: Firecrawl API key for hosted Firecrawl requests.
14
- required: true
15
- - name: FIRECRAWL_API_URL
16
- description: Optional base URL for self-hosted Firecrawl deployments.
17
- required: false
18
- ---
19
-
20
- # Firecrawl Build Search
21
-
22
- Use this when the application starts with a query, not a URL.
23
-
24
- ## Use This When
25
-
26
- - the user asks a question and the product must discover sources first
27
- - the feature needs current web results
28
- - you want to turn a search query into a shortlist of pages for later scraping
29
-
30
- ## Default Recommendations
31
-
32
- - Use `/search` first when URL discovery is part of the product behavior.
33
- - Keep search and extraction conceptually separate unless scraping search results is clearly required.
34
- - Prefer selective follow-up extraction over broad hydration when cost or latency matters.
35
-
36
- ## Common Product Patterns
37
-
38
- - answer generation with cited sources
39
- - company, competitor, or topic discovery
40
- - research workflows that produce a shortlist before deeper extraction
41
- - query-to-URL pipelines for later `/scrape` or `/interact`
42
-
43
- ## Escalation Rules
44
-
45
- - If you already have the URL, use [firecrawl-build-scrape](../firecrawl-build-scrape/SKILL.md).
46
- - If the result page then requires clicks or form interaction, escalate to [firecrawl-build-interact](../firecrawl-build-interact/SKILL.md).
47
-
48
- ## Implementation Notes
49
-
50
- - Treat `/search` as discovery, ranking, and source selection.
51
- - Be explicit about whether the product needs snippets, URLs, or full result content.
52
- - Keep the query contract stable so downstream scraping logic stays predictable.
53
-
54
- ## Docs (Source of Truth)
55
-
56
- Read the source-of-truth page for your project language before writing integration code:
57
-
58
- - **Node / TypeScript**: [docs.firecrawl.dev/agent-source-of-truth/node](https://docs.firecrawl.dev/agent-source-of-truth/node)
59
- - **Python**: [docs.firecrawl.dev/agent-source-of-truth/python](https://docs.firecrawl.dev/agent-source-of-truth/python)
60
- - **Rust**: [docs.firecrawl.dev/agent-source-of-truth/rust](https://docs.firecrawl.dev/agent-source-of-truth/rust)
61
- - **Java**: [docs.firecrawl.dev/agent-source-of-truth/java](https://docs.firecrawl.dev/agent-source-of-truth/java)
62
- - **Elixir**: [docs.firecrawl.dev/agent-source-of-truth/elixir](https://docs.firecrawl.dev/agent-source-of-truth/elixir)
63
- - **cURL / REST**: [docs.firecrawl.dev/agent-source-of-truth/curl](https://docs.firecrawl.dev/agent-source-of-truth/curl)
64
-
65
- ## See Also
66
-
67
- - [firecrawl-build](../firecrawl-build/SKILL.md)
68
- - [firecrawl-build-scrape](../firecrawl-build-scrape/SKILL.md)
69
- - [firecrawl-build-interact](../firecrawl-build-interact/SKILL.md)
@@ -1,59 +0,0 @@
1
- ---
2
- name: firecrawl-crawl
3
- description: |
4
- Bulk extract content from an entire website or site section. Use this skill when the user wants to crawl a site, extract all pages from a docs section, bulk-scrape multiple pages following links, or says "crawl", "get all the pages", "extract everything under /docs", "bulk extract", or needs content from many pages on the same site. Handles depth limits, path filtering, and concurrent extraction.
5
- category: library
6
- allowed-tools:
7
- - Bash(firecrawl *)
8
- - Bash(npx firecrawl *)
9
- ---
10
-
11
- # firecrawl crawl
12
-
13
- Bulk extract content from a website. Crawls pages following links up to a depth/limit.
14
-
15
- ## When to use
16
-
17
- - You need content from many pages on a site (e.g., all `/docs/`)
18
- - You want to extract an entire site section
19
- - Step 4 in the [workflow escalation pattern](firecrawl-cli): search → scrape → map → **crawl** → interact
20
-
21
- ## Quick start
22
-
23
- ```bash
24
- # Crawl a docs section
25
- firecrawl crawl "<url>" --include-paths /docs --limit 50 --wait -o .firecrawl/crawl.json
26
-
27
- # Full crawl with depth limit
28
- firecrawl crawl "<url>" --max-depth 3 --wait --progress -o .firecrawl/crawl.json
29
-
30
- # Check status of a running crawl
31
- firecrawl crawl <job-id>
32
- ```
33
-
34
- ## Options
35
-
36
- | Option | Description |
37
- | ------------------------- | ------------------------------------------- |
38
- | `--wait` | Wait for crawl to complete before returning |
39
- | `--progress` | Show progress while waiting |
40
- | `--limit <n>` | Max pages to crawl |
41
- | `--max-depth <n>` | Max link depth to follow |
42
- | `--include-paths <paths>` | Only crawl URLs matching these paths |
43
- | `--exclude-paths <paths>` | Skip URLs matching these paths |
44
- | `--delay <ms>` | Delay between requests |
45
- | `--max-concurrency <n>` | Max parallel crawl workers |
46
- | `--pretty` | Pretty print JSON output |
47
- | `-o, --output <path>` | Output file path |
48
-
49
- ## Tips
50
-
51
- - Always use `--wait` when you need the results immediately. Without it, crawl returns a job ID for async polling.
52
- - Use `--include-paths` to scope the crawl — don't crawl an entire site when you only need one section.
53
- - Crawl consumes credits per page. Check `firecrawl credit-usage` before large crawls.
54
-
55
- ## See also
56
-
57
- - [firecrawl-scrape](../firecrawl-scrape/SKILL.md) — scrape individual pages
58
- - [firecrawl-map](../firecrawl-map/SKILL.md) — discover URLs before deciding to crawl
59
- - [firecrawl-download](../firecrawl-download/SKILL.md) — download site to local files (uses map + scrape)
@@ -1,70 +0,0 @@
1
- ---
2
- name: firecrawl-download
3
- description: |
4
- Download an entire website as local files — markdown, screenshots, or multiple formats per page. Use this skill when the user wants to save a site locally, download documentation for offline use, bulk-save pages as files, or says "download the site", "save as local files", "offline copy", "download all the docs", or "save for reference". Combines site mapping and scraping into organized local directories.
5
- category: library
6
- allowed-tools:
7
- - Bash(firecrawl *)
8
- - Bash(npx firecrawl *)
9
- ---
10
-
11
- # firecrawl download
12
-
13
- > **Experimental.** Convenience command that combines `map` + `scrape` to save an entire site as local files.
14
-
15
- Maps the site first to discover pages, then scrapes each one into nested directories under `.firecrawl/`. All scrape options work with download. Always pass `-y` to skip the confirmation prompt.
16
-
17
- ## When to use
18
-
19
- - You want to save an entire site (or section) to local files
20
- - You need offline access to documentation or content
21
- - Bulk content extraction with organized file structure
22
-
23
- ## Quick start
24
-
25
- ```bash
26
- # Interactive wizard (picks format, screenshots, paths for you)
27
- firecrawl download https://docs.example.com
28
-
29
- # With screenshots
30
- firecrawl download https://docs.example.com --screenshot --limit 20 -y
31
-
32
- # Multiple formats (each saved as its own file per page)
33
- firecrawl download https://docs.example.com --format markdown,links --screenshot --limit 20 -y
34
- # Creates per page: index.md + links.txt + screenshot.png
35
-
36
- # Filter to specific sections
37
- firecrawl download https://docs.example.com --include-paths "/features,/sdks"
38
-
39
- # Skip translations
40
- firecrawl download https://docs.example.com --exclude-paths "/zh,/ja,/fr,/es,/pt-BR"
41
-
42
- # Full combo
43
- firecrawl download https://docs.example.com \
44
- --include-paths "/features,/sdks" \
45
- --exclude-paths "/zh,/ja" \
46
- --only-main-content \
47
- --screenshot \
48
- -y
49
- ```
50
-
51
- ## Download options
52
-
53
- | Option | Description |
54
- | ------------------------- | -------------------------------------------------------- |
55
- | `--limit <n>` | Max pages to download |
56
- | `--search <query>` | Filter URLs by search query |
57
- | `--include-paths <paths>` | Only download matching paths |
58
- | `--exclude-paths <paths>` | Skip matching paths |
59
- | `--allow-subdomains` | Include subdomain pages |
60
- | `-y` | Skip confirmation prompt (always use in automated flows) |
61
-
62
- ## Scrape options (all work with download)
63
-
64
- `-f <formats>`, `-H`, `-S`, `--screenshot`, `--full-page-screenshot`, `--only-main-content`, `--include-tags`, `--exclude-tags`, `--wait-for`, `--max-age`, `--country`, `--languages`
65
-
66
- ## See also
67
-
68
- - [firecrawl-map](../firecrawl-map/SKILL.md) — just discover URLs without downloading
69
- - [firecrawl-scrape](../firecrawl-scrape/SKILL.md) — scrape individual pages
70
- - [firecrawl-crawl](../firecrawl-crawl/SKILL.md) — bulk extract as JSON (not local files)
@@ -1,84 +0,0 @@
1
- ---
2
- name: firecrawl-interact
3
- description: |
4
- Control and interact with a live browser session on any scraped page — click buttons, fill forms, navigate flows, and extract data using natural language prompts or code. Use when the user needs to interact with a webpage beyond simple scraping: logging into a site, submitting forms, clicking through pagination, handling infinite scroll, navigating multi-step checkout or wizard flows, or when a regular scrape failed because content is behind JavaScript interaction. Also useful for authenticated scraping via profiles. Triggers on "interact", "click", "fill out the form", "log in to", "sign in", "submit", "paginated", "next page", "infinite scroll", "interact with the page", "navigate to", "open a session", or "scrape failed".
5
- category: library
6
- allowed-tools:
7
- - Bash(firecrawl *)
8
- - Bash(npx firecrawl *)
9
- ---
10
-
11
- # firecrawl interact
12
-
13
- Interact with scraped pages in a live browser session. Scrape a page first, then use natural language prompts or code to click, fill forms, navigate, and extract data.
14
-
15
- ## When to use
16
-
17
- - Content requires interaction: clicks, form fills, pagination, login
18
- - `scrape` failed because content is behind JavaScript interaction
19
- - You need to navigate a multi-step flow
20
- - Last resort in the [workflow escalation pattern](firecrawl-cli): search → scrape → map → crawl → **interact**
21
- - **Never use interact for web searches** — use `search` instead
22
-
23
- ## Quick start
24
-
25
- ```bash
26
- # 1. Scrape a page (scrape ID is saved automatically)
27
- firecrawl scrape "<url>"
28
-
29
- # 2. Interact with the page using natural language
30
- firecrawl interact --prompt "Click the login button"
31
- firecrawl interact --prompt "Fill in the email field with test@example.com"
32
- firecrawl interact --prompt "Extract the pricing table"
33
-
34
- # 3. Or use code for precise control
35
- firecrawl interact --code "agent-browser click @e5" --language bash
36
- firecrawl interact --code "agent-browser snapshot -i" --language bash
37
-
38
- # 4. Stop the session when done
39
- firecrawl interact stop
40
- ```
41
-
42
- ## Options
43
-
44
- | Option | Description |
45
- | --------------------- | ------------------------------------------------- |
46
- | `--prompt <text>` | Natural language instruction (use this OR --code) |
47
- | `--code <code>` | Code to execute in the browser session |
48
- | `--language <lang>` | Language for code: bash, python, node |
49
- | `--timeout <seconds>` | Execution timeout (default: 30, max: 300) |
50
- | `--scrape-id <id>` | Target a specific scrape (default: last scrape) |
51
- | `-o, --output <path>` | Output file path |
52
-
53
- ## Profiles
54
-
55
- Use `--profile` on the scrape to persist browser state (cookies, localStorage) across scrapes:
56
-
57
- ```bash
58
- # Session 1: Login and save state
59
- firecrawl scrape "https://app.example.com/login" --profile my-app
60
- firecrawl interact --prompt "Fill in email with user@example.com and click login"
61
-
62
- # Session 2: Come back authenticated
63
- firecrawl scrape "https://app.example.com/dashboard" --profile my-app
64
- firecrawl interact --prompt "Extract the dashboard data"
65
- ```
66
-
67
- Read-only reconnect (no writes to profile state):
68
-
69
- ```bash
70
- firecrawl scrape "https://app.example.com" --profile my-app --no-save-changes
71
- ```
72
-
73
- ## Tips
74
-
75
- - Always scrape first — `interact` requires a scrape ID from a previous `firecrawl scrape` call
76
- - The scrape ID is saved automatically, so you don't need `--scrape-id` for subsequent interact calls
77
- - Use `firecrawl interact stop` to free resources when done
78
- - For parallel work, scrape multiple pages and interact with each using `--scrape-id`
79
-
80
- ## See also
81
-
82
- - [firecrawl-scrape](../firecrawl-scrape/SKILL.md) — try scrape first, escalate to interact only when needed
83
- - [firecrawl-search](../firecrawl-search/SKILL.md) — for web searches (never use interact for searching)
84
- - [firecrawl-agent](../firecrawl-agent/SKILL.md) — AI-powered extraction (less manual control)
@@ -1,51 +0,0 @@
1
- ---
2
- name: firecrawl-map
3
- description: |
4
- Discover and list all URLs on a website, with optional search filtering. Use this skill when the user wants to find a specific page on a large site, list all URLs, see the site structure, find where something is on a domain, or says "map the site", "find the URL for", "what pages are on", or "list all pages". Essential when the user knows which site but not which exact page.
5
- category: library
6
- allowed-tools:
7
- - Bash(firecrawl *)
8
- - Bash(npx firecrawl *)
9
- ---
10
-
11
- # firecrawl map
12
-
13
- Discover URLs on a site. Use `--search` to find a specific page within a large site.
14
-
15
- ## When to use
16
-
17
- - You need to find a specific subpage on a large site
18
- - You want a list of all URLs on a site before scraping or crawling
19
- - Step 3 in the [workflow escalation pattern](firecrawl-cli): search → scrape → **map** → crawl → interact
20
-
21
- ## Quick start
22
-
23
- ```bash
24
- # Find a specific page on a large site
25
- firecrawl map "<url>" --search "authentication" -o .firecrawl/filtered.txt
26
-
27
- # Get all URLs
28
- firecrawl map "<url>" --limit 500 --json -o .firecrawl/urls.json
29
- ```
30
-
31
- ## Options
32
-
33
- | Option | Description |
34
- | --------------------------------- | ---------------------------- |
35
- | `--limit <n>` | Max number of URLs to return |
36
- | `--search <query>` | Filter URLs by search query |
37
- | `--sitemap <include\|skip\|only>` | Sitemap handling strategy |
38
- | `--include-subdomains` | Include subdomain URLs |
39
- | `--json` | Output as JSON |
40
- | `-o, --output <path>` | Output file path |
41
-
42
- ## Tips
43
-
44
- - **Map + scrape is a common pattern**: use `map --search` to find the right URL, then `scrape` it.
45
- - Example: `map https://docs.example.com --search "auth"` → found `/docs/api/authentication` → `scrape` that URL.
46
-
47
- ## See also
48
-
49
- - [firecrawl-scrape](../firecrawl-scrape/SKILL.md) — scrape the URLs you discover
50
- - [firecrawl-crawl](../firecrawl-crawl/SKILL.md) — bulk extract instead of map + scrape
51
- - [firecrawl-download](../firecrawl-download/SKILL.md) — download entire site (uses map internally)
@@ -1,69 +0,0 @@
1
- ---
2
- name: firecrawl-scrape
3
- description: |
4
- Extract clean markdown from any URL, including JavaScript-rendered SPAs. Use this skill whenever the user provides a URL and wants its content, says "scrape", "grab", "fetch", "pull", "get the page", "extract from this URL", or "read this webpage". Handles JS-rendered pages, multiple concurrent URLs, and returns LLM-optimized markdown. Use this instead of WebFetch for any webpage content extraction.
5
- category: library
6
- allowed-tools:
7
- - Bash(firecrawl *)
8
- - Bash(npx firecrawl *)
9
- ---
10
-
11
- # firecrawl scrape
12
-
13
- Scrape one or more URLs. Returns clean, LLM-optimized markdown. Multiple URLs are scraped concurrently.
14
-
15
- ## When to use
16
-
17
- - You have a specific URL and want its content
18
- - The page is static or JS-rendered (SPA)
19
- - Step 2 in the [workflow escalation pattern](firecrawl-cli): search → **scrape** → map → crawl → interact
20
-
21
- ## Quick start
22
-
23
- ```bash
24
- # Basic markdown extraction
25
- firecrawl scrape "<url>" -o .firecrawl/page.md
26
-
27
- # Main content only, no nav/footer
28
- firecrawl scrape "<url>" --only-main-content -o .firecrawl/page.md
29
-
30
- # Wait for JS to render, then scrape
31
- firecrawl scrape "<url>" --wait-for 3000 -o .firecrawl/page.md
32
-
33
- # Multiple URLs (each saved to .firecrawl/)
34
- firecrawl scrape https://example.com https://example.com/blog https://example.com/docs
35
-
36
- # Get markdown and links together
37
- firecrawl scrape "<url>" --format markdown,links -o .firecrawl/page.json
38
-
39
- # Ask a question about the page
40
- firecrawl scrape "https://example.com/pricing" --query "What is the enterprise plan price?"
41
- ```
42
-
43
- ## Options
44
-
45
- | Option | Description |
46
- | ------------------------ | ---------------------------------------------------------------- |
47
- | `-f, --format <formats>` | Output formats: markdown, html, rawHtml, links, screenshot, json |
48
- | `-Q, --query <prompt>` | Ask a question about the page content (5 credits) |
49
- | `-H` | Include HTTP headers in output |
50
- | `--only-main-content` | Strip nav, footer, sidebar — main content only |
51
- | `--wait-for <ms>` | Wait for JS rendering before scraping |
52
- | `--include-tags <tags>` | Only include these HTML tags |
53
- | `--exclude-tags <tags>` | Exclude these HTML tags |
54
- | `-o, --output <path>` | Output file path |
55
-
56
- ## Tips
57
-
58
- - **Prefer plain scrape over `--query`.** Scrape to a file, then use `grep`, `head`, or read the markdown directly — you can search and reason over the full content yourself. Use `--query` only when you want a single targeted answer without saving the page (costs 5 extra credits).
59
- - **Try scrape before interact.** Scrape handles static pages and JS-rendered SPAs. Only escalate to `interact` when you need interaction (clicks, form fills, pagination).
60
- - Multiple URLs are scraped concurrently — check `firecrawl --status` for your concurrency limit.
61
- - Single format outputs raw content. Multiple formats (e.g., `--format markdown,links`) output JSON.
62
- - Always quote URLs — shell interprets `?` and `&` as special characters.
63
- - Naming convention: `.firecrawl/{site}-{path}.md`
64
-
65
- ## See also
66
-
67
- - [firecrawl-search](../firecrawl-search/SKILL.md) — find pages when you don't have a URL
68
- - [firecrawl-interact](../firecrawl-interact/SKILL.md) — when scrape can't get the content, use `interact` to click, fill forms, etc.
69
- - [firecrawl-download](../firecrawl-download/SKILL.md) — bulk download an entire site to local files