minifetch-api 1.3.3 → 1.3.4
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +18 -18
- package/package.json +9 -4
package/README.md
CHANGED
|
@@ -5,25 +5,25 @@
|
|
|
5
5
|
</a>
|
|
6
6
|
</div>
|
|
7
7
|
|
|
8
|
-
**[Minifetch](https://minifetch.com) is a hosted toolkit of SEO
|
|
8
|
+
**[Minifetch](https://minifetch.com) is a hosted toolkit of extraction primitives for SEO/ GEO/ AEO.** Run them as a full technical audit or call one at a time for a fraction of the price — and a fraction of the LLM tokens. No subscription.
|
|
9
9
|
|
|
10
10
|
- ✅ **Always pay-per-fetch at competitive prices.**
|
|
11
11
|
- ✅ [Sign up](https://minifetch.com/dashboard) for an account & get free starter credits. 🎉🎉
|
|
12
12
|
- ⛔ No charge for blocked pages (403 errors).
|
|
13
13
|
|
|
14
14
|
---
|
|
15
|
-
**👉 [
|
|
15
|
+
**👉 [Full API docs](https://minifetch.com/docs/api) | [LLMs.txt](https://minifetch.com/llms.txt) and [SKILL.md](https://minifetch.com/SKILL.md) for agents | Questions? Join our [Discord](https://discord.gg/EM6ET8Dshm)**
|
|
16
16
|
|
|
17
17
|
---
|
|
18
18
|
**Payments.** Two ways to pay:
|
|
19
|
-
1. Credit card + API key. Get started free - [visit our dashboard to Sign Up](https://minifetch.com/dashboard).
|
|
20
|
-
2. USDC on Base or Solana. Just load your wallet with USDC
|
|
19
|
+
1. Credit card + API key. Get started free - [visit our dashboard to Sign Up](https://minifetch.com/dashboard). Create a Minifetch account and it will be auto-loaded with 25 free technical SEO page audits. Top up with your credit card later.
|
|
20
|
+
2. USDC on Base or Solana. Just load your wallet with USDC, you're ready. No "gas token" (ETH or SOL) required. You don't need a Minifetch account either, just load your wallet and go!
|
|
21
21
|
|
|
22
22
|
## Prerequisites
|
|
23
23
|
|
|
24
24
|
- Node.js v18+ & NPM
|
|
25
25
|
- A valid API key from our [dashboard](https://minifetch.com/dashboard)
|
|
26
|
-
-
|
|
26
|
+
- ***Or*** an Ethereum or Solana private key for making USDC payments on Base or Solana networks.
|
|
27
27
|
|
|
28
28
|
## Install
|
|
29
29
|
|
|
@@ -68,7 +68,7 @@ After the Quick Start, you have the following methods to use.
|
|
|
68
68
|
|
|
69
69
|
**Wrap** these methods in a **try/catch** just like in the Quick Start example above. **Code examples** can be also found in the [Github repository](https://github.com/Niche-Networks/minifetch-api/) /example- directories.
|
|
70
70
|
|
|
71
|
-
The
|
|
71
|
+
The `checkAndExtract` methods check the target URL's `robots.txt` file to ensure its not blocked and tell us your preferred crawl delay (defaults to 1 second between requests to your domain). So fetching 10 URLs takes at least 10 seconds to complete by default. This is by design, so Minifetch never hammers your server or slows it down for your real users. If the URL is blocked, read [How To Unblock Minifetch](https://minifetch.com/tutorials/unblock-minifetch).
|
|
72
72
|
|
|
73
73
|
```js
|
|
74
74
|
await client.checkAndRunSeoPageAudit(url);
|
|
@@ -95,18 +95,18 @@ await client.checkAndExtractUrlMetadata(url, options);
|
|
|
95
95
|
|
|
96
96
|
await client.checkAndExtractUrlLinks(url);
|
|
97
97
|
// Price: $0.002
|
|
98
|
-
//
|
|
99
|
-
//
|
|
100
|
-
//
|
|
101
|
-
//
|
|
102
|
-
//
|
|
103
|
-
//
|
|
98
|
+
// Extracts all links from your URL categorized by type (internal/
|
|
99
|
+
// external/ anchor). Detects image links, `rel` attributes (nofollow,
|
|
100
|
+
// sponsored, ugc, etc), `title` and `target`, plus image detection.
|
|
101
|
+
// Summary stats include the most-linked-to internal pages (with
|
|
102
|
+
// anchor text variants used for each) and top external domains by
|
|
103
|
+
// link count.
|
|
104
104
|
|
|
105
105
|
await client.checkAndExtractUrlPreview(url);
|
|
106
|
-
// Price: $0.
|
|
107
|
-
// For checking how your page unfurls when shared: Extracts
|
|
108
|
-
//
|
|
109
|
-
//
|
|
106
|
+
// Price: $0.002
|
|
107
|
+
// For checking how your web page unfurls when shared: Extracts all
|
|
108
|
+
// fields for the lightweight cards that represent your page on social
|
|
109
|
+
// platforms, chat apps and AI.
|
|
110
110
|
|
|
111
111
|
await client.checkAndExtractUrlContent(url, options);
|
|
112
112
|
// Price: $0.002
|
|
@@ -116,7 +116,7 @@ await client.checkAndExtractUrlContent(url, options);
|
|
|
116
116
|
// Options: { includeMediaUrls: true } - defaults to false.
|
|
117
117
|
|
|
118
118
|
// For max control, you can also use the following methods directly.
|
|
119
|
-
// Free
|
|
119
|
+
// Free: check if `minfetch` user agent can access target via robots.txt:
|
|
120
120
|
await client.preflightCheck(url);
|
|
121
121
|
// Paid methods:
|
|
122
122
|
await client.runSeoPageAudit(url);
|
|
@@ -147,13 +147,13 @@ Minifetch only extracts publicly available metadata and content from pages acces
|
|
|
147
147
|
|
|
148
148
|
What Minifetch does *NOT* do:
|
|
149
149
|
- Ignore robots.txt directives
|
|
150
|
-
- Access authenticated or logged-in content
|
|
151
150
|
- Create accounts or log into user sessions
|
|
152
151
|
- Perform transactional actions (checkout, bidding, purchasing, form submissions)
|
|
153
152
|
- Bypass paywalls or access restricted content
|
|
154
153
|
|
|
155
154
|
What Minifetch does NOT do *currently* but may offer in the future as an add-on:
|
|
156
155
|
- Javascript execution
|
|
156
|
+
- Access authenticated or logged-in content
|
|
157
157
|
|
|
158
158
|
---
|
|
159
159
|
### USDC Best Practices
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "minifetch-api",
|
|
3
|
-
"version": "1.3.
|
|
3
|
+
"version": "1.3.4",
|
|
4
4
|
"description": "Minifetch.com API Client. Pay-per-URL SEO audits. Composable toolkit for AI agents and automation pipelines.",
|
|
5
5
|
"type": "module",
|
|
6
6
|
"main": "./dist/esm/index.js",
|
|
@@ -21,14 +21,18 @@
|
|
|
21
21
|
"SEO page audit",
|
|
22
22
|
"SEO research",
|
|
23
23
|
"SEO toolkit",
|
|
24
|
+
"SEO skill",
|
|
24
25
|
"technical SEO",
|
|
25
|
-
"pay-per-fetch
|
|
26
|
-
"pay-per-url
|
|
26
|
+
"pay-per-fetch",
|
|
27
|
+
"pay-per-url",
|
|
27
28
|
"GEO",
|
|
29
|
+
"Generative Engine Optimization",
|
|
28
30
|
"AEO",
|
|
29
|
-
"
|
|
31
|
+
"Answer Engine Optimization",
|
|
32
|
+
"hosted extraction",
|
|
30
33
|
"content extraction",
|
|
31
34
|
"content indexing",
|
|
35
|
+
"extract",
|
|
32
36
|
"html",
|
|
33
37
|
"html parser",
|
|
34
38
|
"json-ld",
|
|
@@ -47,6 +51,7 @@
|
|
|
47
51
|
"monitoring",
|
|
48
52
|
"LLM",
|
|
49
53
|
"previews",
|
|
54
|
+
"social cards",
|
|
50
55
|
"twitter cards",
|
|
51
56
|
"site monitoring",
|
|
52
57
|
"x402",
|