n8n-nodes-firecrawl-latest 1.0.0

package/LICENSE.md

@@ -0,0 +1,19 @@
+Copyright 2022 n8n
+
+Permission is hereby granted, free of charge, to any person obtaining a copy of
+this software and associated documentation files (the "Software"), to deal in
+the Software without restriction, including without limitation the rights to
+use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies
+of the Software, and to permit persons to whom the Software is furnished to do
+so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

package/README.md

@@ -0,0 +1,232 @@
+# FireCrawl Scraper Custom Nodes for n8n
+
+This package contains custom n8n nodes that integrate with the FireCrawl API for web scraping, crawling, extraction, and data analysis.
+
+## Features
+
+The FireCrawl Scraper node provides several powerful resources for web data extraction:
+
+- **Scrape**: Scrape a single URL with various output formats and data extraction capabilities
+- **Batch Scrape**: Process multiple URLs in a batch operation
+- **Crawler**: Crawl an entire website starting from a specific URL
+- **Extract**: Extract structured data from web pages using AI
+- **Map**: Map URLs and extract structured data
+- **LLMs.txt**: Generate LLMs.txt files from websites for LLM training and analysis
+- **Deep Research**: AI-powered deep research on any topic
+
+## Installation
+
+### Option 1: Using Docker Compose
+
+This package includes a Docker Compose configuration for easy setup with n8n:
+
+1. Clone this repository
+2. Create a `.env` file with your FireCrawl API key:
+   ```
+   FIRECRAWL_API_KEY=your_api_key_here
+   ```
+3. Run Docker Compose:
+   ```bash
+   docker-compose up -d
+   ```
+4. Access n8n at `http://localhost:5678`
+
+### Option 2: Installing in an existing n8n instance
+
+```bash
+npm install n8n-nodes-firecrawl-scraper-custom
+```
+
+## Configuration
+
+Before using the nodes, you need to set up the FireCrawl API credentials in n8n:
+
+1. Go to **Settings** > **Credentials**
+2. Click on **New Credential**
+3. Select **FireCrawl API**
+4. Enter your API key
+5. Save the credential
+
+## Usage
+
+### Scrape Resource
+
+The Scrape resource allows you to extract content from a single URL.
+
+**Key Features:**
+- Multiple output formats (Markdown, HTML, Screenshots, etc.)
+- Change tracking between scrapes
+- Structured data extraction
+- Page action support for dynamic content
+- FIRE-1 agent integration for advanced capabilities
+
+**Example Configuration:**
+1. Add the **FireCrawl Scraper** node
+2. Select **Scrape** as the resource
+3. Enter the URL to scrape
+4. Select output formats
+5. Enable additional options as needed
+
+### Batch Scrape Resource
+
+Process multiple URLs in a batch operation.
+
+**Key Features:**
+- Batch processing of multiple URLs
+- Synchronous or asynchronous operation modes
+- Data extraction across multiple pages
+
+### Crawler Resource
+
+Crawl an entire website starting from a specific URL.
+
+**Key Features:**
+- Configurable crawl depth and limits
+- Path inclusion and exclusion patterns
+- LLM extraction during crawling
+- Change tracking
+
+### Extract Resource
+
+Extract specific structured data from web pages using AI.
+
+**Key Features:**
+- Schema-based extraction
+- Simple prompt-based extraction
+- Multiple URL processing
+- V2 support with FIRE-1 agent
+
+### Deep Research Resource
+
+Perform AI-powered deep research on any topic.
+
+**Key Features:**
+- Multi-depth research capabilities
+- Customizable system and analysis prompts
+- JSON structured output
+- Activity tracking
+
+### LLMs.txt Resource
+
+Generate LLMs.txt files from websites.
+
+**Key Features:**
+- Create LLMs.txt files for LLM training
+- Configurable crawl limits
+- Full text generation option
+
+### Map Resource
+
+Map URLs and extract structured data.
+
+**Key Features:**
+- Site mapping capabilities
+- Structure discovery
+
+## Resource Details
+
+### Scrape Resource Options
+
+| Option | Description |
+|--------|-------------|
+| URL | The URL to scrape |
+| Output Formats | Formats to return (Markdown, HTML, Screenshots, etc.) |
+| Track Changes | Track differences between scrapes |
+| Include Extract | Extract structured data |
+| Include Page Actions | Perform actions before scraping |
+| Use FIRE-1 Agent | Enable advanced agent capabilities |
+| Location Settings | Specify geographic location |
+
+### Crawler Resource Options
+
+| Option | Description |
+|--------|-------------|
+| URL | The starting URL to crawl |
+| Limit | Maximum number of pages to crawl |
+| Maximum Depth | How deep to crawl (1-10) |
+| Include/Exclude Paths | Regular expressions for paths |
+| Operation Mode | Synchronous or asynchronous |
+| Enable LLM Extraction | Extract data during crawling |
+
+### Extract Resource Options
+
+| Option | Description |
+|--------|-------------|
+| URL(s) | URLs to extract data from |
+| Version | API version (V1 or V2 with FIRE-1) |
+| Extraction Method | Simple or schema-based |
+| Operation Mode | Single, batch, or URL-less |
+| Enable Web Search | Follow external links for context |
+| Track Changes | Track differences between extractions |
+
+## Examples
+
+### Example: Scraping a Website and Extracting Structured Data
+
+```
+[n8n Workflow]
+1. FireCrawl Scraper (Scrape)
+   - URL: https://example.com
+   - Output Formats: Markdown, HTML
+   - Include Extract: Yes
+   - Extraction Method: Schema Based
+   - Schema: JSON schema defining product information
+```
+
+### Example: Crawling a Website and Generating a Report
+
+```
+[n8n Workflow]
+1. FireCrawl Scraper (Crawler)
+   - URL: https://example.com
+   - Limit: 100
+   - Maximum Depth: 3
+   - Enable LLM Extraction: Yes
+2. Google Sheets
+   - Action: Append
+   - Sheet: Crawl Results
+```
+
+### Example: Performing Deep Research on a Topic
+
+```
+[n8n Workflow]
+1. FireCrawl Scraper (Deep Research)
+   - Query: "Latest advancements in renewable energy"
+   - Maximum Depth: 7
+   - Wait for Completion: Yes
+2. Text Formatter
+   - Format research results
+3. Email
+   - Send formatted research
+```
+
+## Error Handling
+
+The nodes implement error handling with the option to continue workflow execution on failures. Each response includes a `success` field indicating whether the operation succeeded, along with detailed error messages when applicable.
+
+## Development
+
+### Building the Package
+
+To build the package:
+
+```bash
+npm run build
+```
+
+### Testing
+
+```bash
+npm run test
+```
+
+## License
+
+[MIT](LICENSE)
+
+## Support
+
+For support with the FireCrawl API, visit [FireCrawl Documentation](https://docs.firecrawl.dev).
+
+For issues with these custom nodes, please open an issue on GitHub.

package/dist/credentials/FirecrawlApi.credentials.js

@@ -0,0 +1,22 @@
+"use strict";
+Object.defineProperty(exports, "__esModule", { value: true });
+exports.FirecrawlApi = void 0;
+class FirecrawlApi {
+    constructor() {
+        this.name = 'firecrawlApi';
+        this.displayName = 'Firecrawl API';
+        this.documentationUrl = 'https://firecrawl.dev/docs';
+        this.properties = [
+            {
+                displayName: 'API Key',
+                name: 'apiKey',
+                type: 'string',
+                typeOptions: { password: true },
+                default: '',
+                required: true,
+                description: 'The API key for authenticating with Firecrawl API. Get your API key from firecrawl.dev',
+            },
+        ];
+    }
+}
+exports.FirecrawlApi = FirecrawlApi;

package/dist/icons/flames-icon.svg

@@ -0,0 +1,144 @@
+<?xml version="1.0" encoding="UTF-8"?>
+<svg id="Layer_1" xmlns="http://www.w3.org/2000/svg" version="1.1" xmlns:xlink="http://www.w3.org/1999/xlink" viewBox="0 0 91.2 122.9">
+  <!-- Generator: Adobe Illustrator 29.3.1, SVG Export Plug-In . SVG Version: 2.1.0 Build 151)  -->
+  <defs>
+    <style>
+      .st0 {
+        fill: url(#linear-gradient2);
+      }
+
+      .st1 {
+        fill: url(#radial-gradient10);
+      }
+
+      .st2 {
+        fill: url(#linear-gradient1);
+      }
+
+      .st3 {
+        fill: url(#radial-gradient);
+      }
+
+      .st4 {
+        fill: url(#radial-gradient5);
+      }
+
+      .st5 {
+        fill: url(#radial-gradient1);
+      }
+
+      .st6 {
+        fill: url(#radial-gradient7);
+      }
+
+      .st7 {
+        fill: url(#radial-gradient8);
+      }
+
+      .st8 {
+        fill: url(#linear-gradient3);
+      }
+
+      .st9 {
+        fill: url(#radial-gradient6);
+      }
+
+      .st10 {
+        fill: url(#radial-gradient2);
+      }
+
+      .st11 {
+        fill: url(#radial-gradient4);
+      }
+
+      .st12 {
+        fill: url(#radial-gradient3);
+      }
+
+      .st13 {
+        fill: url(#radial-gradient9);
+      }
+
+      .st14 {
+        fill: url(#linear-gradient);
+      }
+    </style>
+    <radialGradient id="radial-gradient" cx="-18.7" cy="138" fx="-18.7" fy="138" r="4.3" gradientTransform="translate(-207.3 -3483.3) rotate(-179.5) scale(17.1 -25.8)" gradientUnits="userSpaceOnUse">
+      <stop offset="0" stop-color="#ff953d"/>
+      <stop offset="1" stop-color="#ff5141"/>
+    </radialGradient>
+    <radialGradient id="radial-gradient1" cx="-38.1" cy="136.8" fx="-38.1" fy="136.8" r="4.3" gradientTransform="translate(573.8 -2351.6) rotate(-157.9) scale(10.3 -17.8)" gradientUnits="userSpaceOnUse">
+      <stop offset="0" stop-color="#ce5327"/>
+      <stop offset="1" stop-color="#ce5327" stop-opacity="0"/>
+    </radialGradient>
+    <linearGradient id="linear-gradient" x1="306" y1="-333.4" x2="306" y2="-311.3" gradientTransform="translate(-260.4 -211.7) scale(1 -1)" gradientUnits="userSpaceOnUse">
+      <stop offset="0" stop-color="#ff7583"/>
+      <stop offset="1" stop-color="#ff7583" stop-opacity="0"/>
+    </linearGradient>
+    <radialGradient id="radial-gradient2" cx="123.6" cy="113.6" fx="123.6" fy="113.6" r="4.3" gradientTransform="translate(-1540.6 2564.4) rotate(24) scale(3.1 -25.7)" gradientUnits="userSpaceOnUse">
+      <stop offset="0" stop-color="#ffaa7b"/>
+      <stop offset="1" stop-color="#ffaa7b" stop-opacity="0"/>
+    </radialGradient>
+    <radialGradient id="radial-gradient3" cx="103.5" cy="161.5" fx="103.5" fy="161.5" r="4.3" gradientTransform="translate(-825.6 -199.1) rotate(77.3) scale(3.8 -4.8)" gradientUnits="userSpaceOnUse">
+      <stop offset="0" stop-color="#ff5e47"/>
+      <stop offset="1" stop-color="#ff5e47" stop-opacity="0"/>
+    </radialGradient>
+    <radialGradient id="radial-gradient4" cx="33.7" cy="152.6" fx="33.7" fy="152.6" r="4.3" gradientTransform="translate(-1396.2 -290.6) rotate(87.9) scale(10.1 -9.4)" gradientUnits="userSpaceOnUse">
+      <stop offset="0" stop-color="#ff2f3c"/>
+      <stop offset="1" stop-color="#ff2f3c" stop-opacity="0"/>
+    </radialGradient>
+    <radialGradient id="radial-gradient5" cx="175" cy="82.1" fx="175" fy="82.1" r="4.3" gradientTransform="translate(-489 182.7) rotate(25.3) scale(2.3 -4.6)" gradientUnits="userSpaceOnUse">
+      <stop offset="0" stop-color="#ff846c"/>
+      <stop offset="1" stop-color="#ff846c" stop-opacity="0"/>
+    </radialGradient>
+    <radialGradient id="radial-gradient6" cx="94.5" cy="879.8" fx="94.5" fy="879.8" r="4.3" gradientTransform="translate(-306.9 -351.6) rotate(113.2) scale(2.3 -.5)" gradientUnits="userSpaceOnUse">
+      <stop offset="0" stop-color="#ffa682"/>
+      <stop offset="1" stop-color="#ffa682" stop-opacity="0"/>
+    </radialGradient>
+    <radialGradient id="radial-gradient7" cx="-38.1" cy="150" fx="-38.1" fy="150" r="4.3" gradientTransform="translate(65.2 -1814.3) rotate(-168.6) scale(10 -12.5)" gradientUnits="userSpaceOnUse">
+      <stop offset="0" stop-color="#ffda2f"/>
+      <stop offset="1" stop-color="#ff8e41"/>
+    </radialGradient>
+    <radialGradient id="radial-gradient8" cx="30.5" cy="133.7" fx="30.5" fy="133.7" r="4.3" gradientTransform="translate(-1658.1 214.1) rotate(69) scale(14.1 -12.3)" gradientUnits="userSpaceOnUse">
+      <stop offset="0" stop-color="#fd5639"/>
+      <stop offset="1" stop-color="#fe5533" stop-opacity="0"/>
+    </radialGradient>
+    <radialGradient id="radial-gradient9" cx="-26.5" cy="140.5" fx="-26.5" fy="140.5" r="4.3" gradientTransform="translate(-537.1 -3247.1) rotate(174.2) scale(9.8 -24)" gradientUnits="userSpaceOnUse">
+      <stop offset=".6" stop-color="#d7812d" stop-opacity="0"/>
+      <stop offset="1" stop-color="#d7812d"/>
+    </radialGradient>
+    <linearGradient id="linear-gradient1" x1="308.3" y1="-249.5" x2="308.3" y2="-265.3" gradientTransform="translate(-260.4 -211.7) scale(1 -1)" gradientUnits="userSpaceOnUse">
+      <stop offset="0" stop-color="#f95131"/>
+      <stop offset="1" stop-color="#f95131" stop-opacity="0"/>
+    </linearGradient>
+    <radialGradient id="radial-gradient10" cx="-1" cy="165.9" fx="-1" fy="165.9" r="4.3" gradientTransform="translate(-1095.3 -1456.8) rotate(143.1) scale(16.1 -11.6)" gradientUnits="userSpaceOnUse">
+      <stop offset=".8" stop-color="#f18a52" stop-opacity="0"/>
+      <stop offset="1" stop-color="#f18a52"/>
+    </radialGradient>
+    <linearGradient id="linear-gradient2" x1="300.6" y1="-221.4" x2="268.7" y2="-301.6" gradientTransform="translate(-260.4 -211.7) scale(1 -1)" gradientUnits="userSpaceOnUse">
+      <stop offset="0" stop-color="#ff7558"/>
+      <stop offset="1" stop-color="#f38758"/>
+    </linearGradient>
+    <linearGradient id="linear-gradient3" x1="278.4" y1="-238.9" x2="261.2" y2="-288.1" gradientTransform="translate(-260.4 -211.7) scale(1 -1)" gradientUnits="userSpaceOnUse">
+      <stop offset="0" stop-color="#ff815b"/>
+      <stop offset="1" stop-color="#ff9c6d"/>
+    </linearGradient>
+  </defs>
+  <path class="st3" d="M30.7,30.5c6.7-10.4,10.6-20,12.7-26.8.8-2.6,4.1-3.7,6.1-1.8,29.8,28.1,39.6,49.6,41.5,74.5,1.4,24-10.4,45.4-42.1,45.4S-2.7,101,.3,68.1c1.8-19.7,9.4-34.6,15.5-43.6,1.9-2.8,5.9-2.8,8.1-.3l5.5,6.4c.4.4,1.1.4,1.4,0Z"/>
+  <path class="st5" d="M30.7,30.5c6.7-10.4,10.6-20,12.7-26.8.8-2.6,4.1-3.7,6.1-1.8,29.8,28.1,39.6,49.6,41.5,74.5,1.4,24-10.4,45.4-42.1,45.4S-2.7,101,.3,68.1c1.8-19.7,9.4-34.6,15.5-43.6,1.9-2.8,5.9-2.8,8.1-.3l5.5,6.4c.4.4,1.1.4,1.4,0Z"/>
+  <path class="st14" d="M30.7,30.5c6.7-10.4,10.6-20,12.7-26.8.8-2.6,4.1-3.7,6.1-1.8,29.8,28.1,39.6,49.6,41.5,74.5,1.4,24-10.4,45.4-42.1,45.4S-2.7,101,.3,68.1c1.8-19.7,9.4-34.6,15.5-43.6,1.9-2.8,5.9-2.8,8.1-.3l5.5,6.4c.4.4,1.1.4,1.4,0Z"/>
+  <path class="st10" d="M30.7,30.5c6.7-10.4,10.6-20,12.7-26.8.8-2.6,4.1-3.7,6.1-1.8,29.8,28.1,39.6,49.6,41.5,74.5,1.4,24-10.4,45.4-42.1,45.4S-2.7,101,.3,68.1c1.8-19.7,9.4-34.6,15.5-43.6,1.9-2.8,5.9-2.8,8.1-.3l5.5,6.4c.4.4,1.1.4,1.4,0Z"/>
+  <path class="st12" d="M30.7,30.5c6.7-10.4,10.6-20,12.7-26.8.8-2.6,4.1-3.7,6.1-1.8,29.8,28.1,39.6,49.6,41.5,74.5,1.4,24-10.4,45.4-42.1,45.4S-2.7,101,.3,68.1c1.8-19.7,9.4-34.6,15.5-43.6,1.9-2.8,5.9-2.8,8.1-.3l5.5,6.4c.4.4,1.1.4,1.4,0Z"/>
+  <path class="st11" d="M30.7,30.5c6.7-10.4,10.6-20,12.7-26.8.8-2.6,4.1-3.7,6.1-1.8,29.8,28.1,39.6,49.6,41.5,74.5,1.4,24-10.4,45.4-42.1,45.4S-2.7,101,.3,68.1c1.8-19.7,9.4-34.6,15.5-43.6,1.9-2.8,5.9-2.8,8.1-.3l5.5,6.4c.4.4,1.1.4,1.4,0Z"/>
+  <path class="st4" d="M30.7,30.5c6.7-10.4,10.6-20,12.7-26.8.8-2.6,4.1-3.7,6.1-1.8,29.8,28.1,39.6,49.6,41.5,74.5,1.4,24-10.4,45.4-42.1,45.4S-2.7,101,.3,68.1c1.8-19.7,9.4-34.6,15.5-43.6,1.9-2.8,5.9-2.8,8.1-.3l5.5,6.4c.4.4,1.1.4,1.4,0Z"/>
+  <path class="st9" d="M30.7,30.5c6.7-10.4,10.6-20,12.7-26.8.8-2.6,4.1-3.7,6.1-1.8,29.8,28.1,39.6,49.6,41.5,74.5,1.4,24-10.4,45.4-42.1,45.4S-2.7,101,.3,68.1c1.8-19.7,9.4-34.6,15.5-43.6,1.9-2.8,5.9-2.8,8.1-.3l5.5,6.4c.4.4,1.1.4,1.4,0Z"/>
+  <g>
+    <path class="st6" d="M20.4,78c5.7-13.5,17.3-28.3,25.1-36.4,2.2-2.3,5.8-2.3,8.1-.2,15,13.8,19.6,26.4,23.4,40.9,4,15.2,0,39.6-30.1,39.6s-34.8-24.2-26.6-43.9Z"/>
+    <path class="st7" d="M20.4,78c5.7-13.5,17.3-28.3,25.1-36.4,2.2-2.3,5.8-2.3,8.1-.2,15,13.8,19.6,26.4,23.4,40.9,4,15.2,0,39.6-30.1,39.6s-34.8-24.2-26.6-43.9Z"/>
+    <path class="st13" d="M20.4,78c5.7-13.5,17.3-28.3,25.1-36.4,2.2-2.3,5.8-2.3,8.1-.2,15,13.8,19.6,26.4,23.4,40.9,4,15.2,0,39.6-30.1,39.6s-34.8-24.2-26.6-43.9Z"/>
+  </g>
+  <path class="st2" d="M20.4,78c5.7-13.5,17.3-28.3,25.1-36.4,2.2-2.3,5.8-2.3,8.1-.2,15,13.8,19.6,26.4,23.4,40.9,4,15.2,0,39.6-30.1,39.6s-34.8-24.2-26.6-43.9Z"/>
+  <path class="st1" d="M20.4,78c5.7-13.5,17.3-28.3,25.1-36.4,2.2-2.3,5.8-2.3,8.1-.2,15,13.8,19.6,26.4,23.4,40.9,4,15.2,0,39.6-30.1,39.6s-34.8-24.2-26.6-43.9Z"/>
+  <path class="st0" d="M27.5,41.8c10.1-14.7,15.9-30.6,17.7-34.6-2.6,20.1-10.2,34.9-24.6,53.8-11.5,15.2-13.6,28.2-13.5,31.3-3.6-24.1,7.8-32.2,20.3-50.6Z"/>
+  <path class="st8" d="M18.8,25.9C13.2,32.9,2,52.3,2.2,74c5.6-22.2,18.6-29.3,16.6-48.1Z"/>
+</svg>

package/dist/nodes/Firecrawl/FireCrawlScraper.node.js

@@ -0,0 +1,156 @@
+"use strict";
+var __createBinding = (this && this.__createBinding) || (Object.create ? (function(o, m, k, k2) {
+    if (k2 === undefined) k2 = k;
+    var desc = Object.getOwnPropertyDescriptor(m, k);
+    if (!desc || ("get" in desc ? !m.__esModule : desc.writable || desc.configurable)) {
+      desc = { enumerable: true, get: function() { return m[k]; } };
+    }
+    Object.defineProperty(o, k2, desc);
+}) : (function(o, m, k, k2) {
+    if (k2 === undefined) k2 = k;
+    o[k2] = m[k];
+}));
+var __setModuleDefault = (this && this.__setModuleDefault) || (Object.create ? (function(o, v) {
+    Object.defineProperty(o, "default", { enumerable: true, value: v });
+}) : function(o, v) {
+    o["default"] = v;
+});
+var __importStar = (this && this.__importStar) || (function () {
+    var ownKeys = function(o) {
+        ownKeys = Object.getOwnPropertyNames || function (o) {
+            var ar = [];
+            for (var k in o) if (Object.prototype.hasOwnProperty.call(o, k)) ar[ar.length] = k;
+            return ar;
+        };
+        return ownKeys(o);
+    };
+    return function (mod) {
+        if (mod && mod.__esModule) return mod;
+        var result = {};
+        if (mod != null) for (var k = ownKeys(mod), i = 0; i < k.length; i++) if (k[i] !== "default") __createBinding(result, mod, k[i]);
+        __setModuleDefault(result, mod);
+        return result;
+    };
+})();
+Object.defineProperty(exports, "__esModule", { value: true });
+exports.FireCrawlScraper = void 0;
+// Import resource properties
+const crawlerProperties = __importStar(require("./resources/crawler/crawler.properties"));
+const extractProperties = __importStar(require("./resources/extract/extract.properties"));
+const mapProperties = __importStar(require("./resources/map/map.properties"));
+const scrapeProperties = __importStar(require("./resources/scrape/scrape.properties"));
+const llmsTextProperties = __importStar(require("./resources/llmsText/llmsText.properties"));
+const batchScrapeProperties = __importStar(require("./resources/batchScrape/batchScrape.properties"));
+const deepResearchProperties = __importStar(require("./resources/deepResearch/deepResearch.properties"));
+// Import resource methods
+const crawler_methods_1 = require("./resources/crawler/crawler.methods");
+const extract_methods_1 = require("./resources/extract/extract.methods");
+const map_methods_1 = require("./resources/map/map.methods");
+const scrape_methods_1 = require("./resources/scrape/scrape.methods");
+const llmsText_methods_1 = require("./resources/llmsText/llmsText.methods");
+const batchScrape_methods_1 = require("./resources/batchScrape/batchScrape.methods");
+const deepResearch_methods_1 = require("./resources/deepResearch/deepResearch.methods");
+class FireCrawlScraper {
+    constructor() {
+        this.description = {
+            displayName: 'FireCrawl Scraper',
+            name: 'fireCrawlScraper',
+            icon: 'file:../../icons/flames-icon.svg',
+            group: ['transform'],
+            version: 1,
+            subtitle: '={{$parameter["resource"]}}',
+            description: 'FireCrawl API for web scraping and crawling',
+            defaults: {
+                name: 'FireCrawl Scraper',
+            },
+            inputs: ['main'],
+            outputs: ['main'],
+            credentials: [
+                {
+                    name: 'firecrawlApi',
+                    required: true,
+                },
+            ],
+            // Define resources
+            properties: [
+                // Resource selection
+                {
+                    displayName: 'Resource',
+                    name: 'resource',
+                    type: 'options',
+                    noDataExpression: true,
+                    default: 'scrape',
+                    options: [
+                        {
+                            name: 'Batch Scrape',
+                            value: 'batchScrape',
+                            description: 'Scrape multiple URLs in a batch operation',
+                        },
+                        {
+                            name: 'Crawler',
+                            value: 'crawler',
+                            description: 'Crawl a website and extract data from multiple pages',
+                        },
+                        {
+                            name: 'Deep Research',
+                            value: 'deepResearch',
+                            description: 'AI-powered deep research and analysis on any topic',
+                        },
+                        {
+                            name: 'Extract',
+                            value: 'extract',
+                            description: 'Extract specific information from scraped content',
+                        },
+                        {
+                            name: 'LLMs.txt',
+                            value: 'llmsText',
+                            description: 'Generate LLMs.txt files from any website for LLM training and analysis',
+                        },
+                        {
+                            name: 'Map',
+                            value: 'map',
+                            description: 'Map scraped data to a structured format',
+                        },
+                        {
+                            name: 'Scrape',
+                            value: 'scrape',
+                            description: 'Scrape a single URL using FireCrawl',
+                        },
+                    ],
+                },
+                // Add resource-specific properties
+                ...scrapeProperties.scrapeProperties,
+                ...mapProperties.mapProperties,
+                ...crawlerProperties.crawlerProperties,
+                ...extractProperties.extractProperties,
+                ...llmsTextProperties.llmsTextProperties,
+                ...batchScrapeProperties.batchScrapeProperties,
+                ...deepResearchProperties.deepResearchProperties,
+            ],
+        };
+    }
+    // Execute method to handle all resources
+    async execute() {
+        const resource = this.getNodeParameter('resource', 0);
+        // Route execution to the appropriate resource handler
+        switch (resource) {
+            case 'scrape':
+                return scrape_methods_1.scrapeMethods.execute.call(this);
+            case 'batchScrape':
+                return batchScrape_methods_1.batchScrapeMethods.execute.call(this);
+            case 'map':
+                return map_methods_1.mapMethods.execute.call(this);
+            case 'crawler':
+                return crawler_methods_1.crawlerMethods.execute.call(this);
+            case 'extract':
+                return extract_methods_1.extractMethods.execute.call(this);
+            case 'llmsText':
+                return llmsText_methods_1.llmsTextMethods.execute.call(this);
+            case 'deepResearch':
+                return deepResearch_methods_1.deepResearchMethods.execute.call(this);
+            default:
+                throw new Error(`The resource "${resource}" is not known!`);
+        }
+    }
+}
+exports.FireCrawlScraper = FireCrawlScraper;