minifetch-api 1.3.2 → 1.3.4
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +28 -25
- package/package.json +9 -4
package/README.md
CHANGED
|
@@ -5,25 +5,25 @@
|
|
|
5
5
|
</a>
|
|
6
6
|
</div>
|
|
7
7
|
|
|
8
|
-
**[Minifetch](https://minifetch.com) is a hosted toolkit of SEO
|
|
8
|
+
**[Minifetch](https://minifetch.com) is a hosted toolkit of extraction primitives for SEO/ GEO/ AEO.** Run them as a full technical audit or call one at a time for a fraction of the price — and a fraction of the LLM tokens. No subscription.
|
|
9
9
|
|
|
10
10
|
- ✅ **Always pay-per-fetch at competitive prices.**
|
|
11
11
|
- ✅ [Sign up](https://minifetch.com/dashboard) for an account & get free starter credits. 🎉🎉
|
|
12
12
|
- ⛔ No charge for blocked pages (403 errors).
|
|
13
13
|
|
|
14
14
|
---
|
|
15
|
-
**👉 [
|
|
15
|
+
**👉 [Full API docs](https://minifetch.com/docs/api) | [LLMs.txt](https://minifetch.com/llms.txt) and [SKILL.md](https://minifetch.com/SKILL.md) for agents | Questions? Join our [Discord](https://discord.gg/EM6ET8Dshm)**
|
|
16
16
|
|
|
17
17
|
---
|
|
18
18
|
**Payments.** Two ways to pay:
|
|
19
|
-
1. Credit card + API key. Get started free - [visit our dashboard to Sign Up](https://minifetch.com/dashboard).
|
|
20
|
-
2. USDC on Base or Solana. Just load your wallet with USDC
|
|
19
|
+
1. Credit card + API key. Get started free - [visit our dashboard to Sign Up](https://minifetch.com/dashboard). Create a Minifetch account and it will be auto-loaded with 25 free technical SEO page audits. Top up with your credit card later.
|
|
20
|
+
2. USDC on Base or Solana. Just load your wallet with USDC, you're ready. No "gas token" (ETH or SOL) required. You don't need a Minifetch account either, just load your wallet and go!
|
|
21
21
|
|
|
22
22
|
## Prerequisites
|
|
23
23
|
|
|
24
24
|
- Node.js v18+ & NPM
|
|
25
25
|
- A valid API key from our [dashboard](https://minifetch.com/dashboard)
|
|
26
|
-
-
|
|
26
|
+
- ***Or*** an Ethereum or Solana private key for making USDC payments on Base or Solana networks.
|
|
27
27
|
|
|
28
28
|
## Install
|
|
29
29
|
|
|
@@ -68,42 +68,45 @@ After the Quick Start, you have the following methods to use.
|
|
|
68
68
|
|
|
69
69
|
**Wrap** these methods in a **try/catch** just like in the Quick Start example above. **Code examples** can be also found in the [Github repository](https://github.com/Niche-Networks/minifetch-api/) /example- directories.
|
|
70
70
|
|
|
71
|
-
The
|
|
71
|
+
The `checkAndExtract` methods check the target URL's `robots.txt` file to ensure its not blocked and tell us your preferred crawl delay (defaults to 1 second between requests to your domain). So fetching 10 URLs takes at least 10 seconds to complete by default. This is by design, so Minifetch never hammers your server or slows it down for your real users. If the URL is blocked, read [How To Unblock Minifetch](https://minifetch.com/tutorials/unblock-minifetch).
|
|
72
72
|
|
|
73
73
|
```js
|
|
74
74
|
await client.checkAndRunSeoPageAudit(url);
|
|
75
75
|
// Price: $0.01
|
|
76
|
-
// Runs a full technical SEO audit on your URL.
|
|
76
|
+
// Runs a full technical SEO audit on your URL. Combines data from
|
|
77
77
|
// the other API endpoints and runs checks that each return a PASS/
|
|
78
|
-
// WARN/ FAIL result with no black-box scoring
|
|
78
|
+
// WARN/ FAIL result with no black-box scoring. Just deterministic,
|
|
79
79
|
// composable signal you can act on or pipe into an agent.
|
|
80
|
-
// Audit rules are documented in the
|
|
80
|
+
// Audit rules are documented in the skill file:
|
|
81
81
|
// https://minifetch.com/skills/seo-page-audit/SKILL.md
|
|
82
82
|
|
|
83
83
|
await client.checkAndExtractUrlMetadata(url, options);
|
|
84
84
|
// Price: $0.002
|
|
85
|
-
//
|
|
86
|
-
//
|
|
87
|
-
//
|
|
88
|
-
//
|
|
85
|
+
// Extracts rich structured metadata from your URL: favicons, title,
|
|
86
|
+
// description, canonical, SEO-related meta tags, Open Graph and
|
|
87
|
+
// Twitter card tags, JSON-LD and more.
|
|
88
|
+
// Set verbosity option to full for more fields: redirect chain,
|
|
89
|
+
// relevant response headers, performance metrics, headings, images
|
|
90
|
+
// and every meta tag found on the page; verbosity "full" is the
|
|
91
|
+
// drop-in replacement for the npm `url-metadata` package.
|
|
89
92
|
// Options:
|
|
90
93
|
// { verbosity: "full" } - defaults to "standard"
|
|
91
94
|
// { includeResponseBody: true } - defaults to false
|
|
92
95
|
|
|
93
96
|
await client.checkAndExtractUrlLinks(url);
|
|
94
97
|
// Price: $0.002
|
|
95
|
-
//
|
|
96
|
-
//
|
|
97
|
-
//
|
|
98
|
-
//
|
|
99
|
-
//
|
|
100
|
-
//
|
|
98
|
+
// Extracts all links from your URL categorized by type (internal/
|
|
99
|
+
// external/ anchor). Detects image links, `rel` attributes (nofollow,
|
|
100
|
+
// sponsored, ugc, etc), `title` and `target`, plus image detection.
|
|
101
|
+
// Summary stats include the most-linked-to internal pages (with
|
|
102
|
+
// anchor text variants used for each) and top external domains by
|
|
103
|
+
// link count.
|
|
101
104
|
|
|
102
105
|
await client.checkAndExtractUrlPreview(url);
|
|
103
|
-
// Price: $0.
|
|
104
|
-
// For checking how your page unfurls when shared: Extracts
|
|
105
|
-
//
|
|
106
|
-
//
|
|
106
|
+
// Price: $0.002
|
|
107
|
+
// For checking how your web page unfurls when shared: Extracts all
|
|
108
|
+
// fields for the lightweight cards that represent your page on social
|
|
109
|
+
// platforms, chat apps and AI.
|
|
107
110
|
|
|
108
111
|
await client.checkAndExtractUrlContent(url, options);
|
|
109
112
|
// Price: $0.002
|
|
@@ -113,7 +116,7 @@ await client.checkAndExtractUrlContent(url, options);
|
|
|
113
116
|
// Options: { includeMediaUrls: true } - defaults to false.
|
|
114
117
|
|
|
115
118
|
// For max control, you can also use the following methods directly.
|
|
116
|
-
// Free
|
|
119
|
+
// Free: check if `minfetch` user agent can access target via robots.txt:
|
|
117
120
|
await client.preflightCheck(url);
|
|
118
121
|
// Paid methods:
|
|
119
122
|
await client.runSeoPageAudit(url);
|
|
@@ -144,13 +147,13 @@ Minifetch only extracts publicly available metadata and content from pages acces
|
|
|
144
147
|
|
|
145
148
|
What Minifetch does *NOT* do:
|
|
146
149
|
- Ignore robots.txt directives
|
|
147
|
-
- Access authenticated or logged-in content
|
|
148
150
|
- Create accounts or log into user sessions
|
|
149
151
|
- Perform transactional actions (checkout, bidding, purchasing, form submissions)
|
|
150
152
|
- Bypass paywalls or access restricted content
|
|
151
153
|
|
|
152
154
|
What Minifetch does NOT do *currently* but may offer in the future as an add-on:
|
|
153
155
|
- Javascript execution
|
|
156
|
+
- Access authenticated or logged-in content
|
|
154
157
|
|
|
155
158
|
---
|
|
156
159
|
### USDC Best Practices
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "minifetch-api",
|
|
3
|
-
"version": "1.3.
|
|
3
|
+
"version": "1.3.4",
|
|
4
4
|
"description": "Minifetch.com API Client. Pay-per-URL SEO audits. Composable toolkit for AI agents and automation pipelines.",
|
|
5
5
|
"type": "module",
|
|
6
6
|
"main": "./dist/esm/index.js",
|
|
@@ -21,14 +21,18 @@
|
|
|
21
21
|
"SEO page audit",
|
|
22
22
|
"SEO research",
|
|
23
23
|
"SEO toolkit",
|
|
24
|
+
"SEO skill",
|
|
24
25
|
"technical SEO",
|
|
25
|
-
"pay-per-fetch
|
|
26
|
-
"pay-per-url
|
|
26
|
+
"pay-per-fetch",
|
|
27
|
+
"pay-per-url",
|
|
27
28
|
"GEO",
|
|
29
|
+
"Generative Engine Optimization",
|
|
28
30
|
"AEO",
|
|
29
|
-
"
|
|
31
|
+
"Answer Engine Optimization",
|
|
32
|
+
"hosted extraction",
|
|
30
33
|
"content extraction",
|
|
31
34
|
"content indexing",
|
|
35
|
+
"extract",
|
|
32
36
|
"html",
|
|
33
37
|
"html parser",
|
|
34
38
|
"json-ld",
|
|
@@ -47,6 +51,7 @@
|
|
|
47
51
|
"monitoring",
|
|
48
52
|
"LLM",
|
|
49
53
|
"previews",
|
|
54
|
+
"social cards",
|
|
50
55
|
"twitter cards",
|
|
51
56
|
"site monitoring",
|
|
52
57
|
"x402",
|