n8n-nodes-crawlbrulee 1.0.0 → 1.0.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/README.md
CHANGED
|
@@ -8,7 +8,7 @@
|
|
|
8
8
|
put crawlbrulee in your n8n workflows. this community node package turns any url into clean markdown, html, links, images, metadata or a screenshot, maps a site's urls, and starts a workflow when a background scrape finishes. it also works as an [AI Agent](https://docs.n8n.io/advanced-ai/) tool, so an agent in n8n can scrape a page on its own.
|
|
9
9
|
|
|
10
10
|
- **everything runs in the EU.** the fetch, the render, the cache and your result never leave EU servers. the proxy exit is the one hop you choose: pick an EU exit and nothing leaves at all. gdpr-aligned, with a data processing agreement.
|
|
11
|
-
- **output made for models.** markdown with
|
|
11
|
+
- **output made for models.** markdown with ads, popups and cookie banners removed and the links kept, ready for the prompt. full-page screenshots can come back as tiles sized for an image model.
|
|
12
12
|
- **the hard parts, handled.** headless Chrome when a page needs it, rotating proxies with country selection, automatic retries, ad and cookie-banner removal, caching, background jobs and signed webhooks.
|
|
13
13
|
- **start free.** 750 credits, no credit card.
|
|
14
14
|
|
|
@@ -3,7 +3,7 @@ Object.defineProperty(exports, "__esModule", { value: true });
|
|
|
3
3
|
exports.USER_AGENT = void 0;
|
|
4
4
|
exports.crawlbruleeRequest = crawlbruleeRequest;
|
|
5
5
|
const errors_1 = require("./errors");
|
|
6
|
-
exports.USER_AGENT = 'n8n-nodes-crawlbrulee/1.0.
|
|
6
|
+
exports.USER_AGENT = 'n8n-nodes-crawlbrulee/1.0.1';
|
|
7
7
|
function stripTrailingSlash(url) {
|
|
8
8
|
return url.replace(/\/+$/, '');
|
|
9
9
|
}
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "n8n-nodes-crawlbrulee",
|
|
3
|
-
"version": "1.0.
|
|
3
|
+
"version": "1.0.1",
|
|
4
4
|
"description": "crawlbrulee for n8n — EU-native web scraping for AI agents & developers. scrape any url to markdown, html, links, images, metadata or a screenshot, map a site's urls, and react to finished background scrapes.",
|
|
5
5
|
"license": "MIT",
|
|
6
6
|
"homepage": "https://crawlbrulee.com",
|