minifetch-api 1.5.0 → 1.5.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +7 -10
- package/package.json +24 -24
package/README.md
CHANGED
|
@@ -24,7 +24,7 @@
|
|
|
24
24
|
- ***Or*** an Ethereum or Solana private key for making USDC payments on Base or Solana networks.
|
|
25
25
|
|
|
26
26
|
**Payments.** Two ways to pay:
|
|
27
|
-
1. Credit card + API key. Get started free - [visit our dashboard to Sign Up](https://minifetch.com/dashboard). Create a Minifetch account and it will be auto-loaded with 25 free technical SEO page audits. Top up with your credit card later.
|
|
27
|
+
1. Credit card + API key. Get started free - [visit our dashboard to Sign Up](https://minifetch.com/dashboard). Create a Minifetch account and it will be auto-loaded with credits worth up to 25 free technical SEO page audits. Top up with your credit card later.
|
|
28
28
|
2. USDC on Base or Solana. Just load your wallet with USDC, you're ready. No "gas token" (ETH or SOL) required. You don't need a Minifetch account either, just load your wallet and go!
|
|
29
29
|
|
|
30
30
|
## Install
|
|
@@ -152,18 +152,15 @@ When you wrap the functions above in a try/catch, here are some of the errors yo
|
|
|
152
152
|
|
|
153
153
|
---
|
|
154
154
|
|
|
155
|
-
###
|
|
156
|
-
Minifetch
|
|
155
|
+
### How We Fetch Web Pages
|
|
156
|
+
Minifetch extracts publicly available metadata and content from pages accessible without authentication or javascript execution.
|
|
157
157
|
|
|
158
|
-
|
|
159
|
-
- Ignore robots.txt directives
|
|
160
|
-
- Create accounts or log into user sessions
|
|
161
|
-
- Perform transactional actions (checkout, bidding, purchasing, form submissions)
|
|
162
|
-
- Bypass paywalls or access restricted content
|
|
158
|
+
Every response carries a `proxy` block: the `minifetch` user agent we sent and whether robots.txt was obeyed on the fetch. Proof of how the fetch happened, not just a promise, for regulated use-cases where provenance matters.
|
|
163
159
|
|
|
164
|
-
|
|
160
|
+
Future add-ons:
|
|
161
|
+
- Residential proxies for hard-to-reach pages
|
|
165
162
|
- Javascript execution
|
|
166
|
-
- Access authenticated or logged-in content
|
|
163
|
+
- Access to authenticated or logged-in content
|
|
167
164
|
|
|
168
165
|
---
|
|
169
166
|
|
package/package.json
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "minifetch-api",
|
|
3
|
-
"version": "1.5.
|
|
4
|
-
"description": "Minifetch.com API Client.
|
|
3
|
+
"version": "1.5.1",
|
|
4
|
+
"description": "Minifetch.com API Client. Scrape, extract and audit web pages. Pay per URL, no subscription.",
|
|
5
5
|
"type": "module",
|
|
6
6
|
"main": "./dist/esm/index.js",
|
|
7
7
|
"types": "./dist/types/index.d.ts",
|
|
@@ -17,43 +17,43 @@
|
|
|
17
17
|
"LICENSE"
|
|
18
18
|
],
|
|
19
19
|
"keywords": [
|
|
20
|
+
"html",
|
|
21
|
+
"web page",
|
|
22
|
+
"scraper",
|
|
23
|
+
"parser",
|
|
24
|
+
"metadata",
|
|
25
|
+
"metadata extraction",
|
|
26
|
+
"content extraction",
|
|
27
|
+
"link extraction",
|
|
28
|
+
"hosted",
|
|
29
|
+
"meta tags",
|
|
30
|
+
"open graph",
|
|
31
|
+
"og tags",
|
|
32
|
+
"previews",
|
|
33
|
+
"social cards",
|
|
34
|
+
"twitter cards",
|
|
35
|
+
"pay-per-fetch",
|
|
36
|
+
"pay-per-url",
|
|
37
|
+
"indexing",
|
|
38
|
+
"extract",
|
|
39
|
+
"json-ld",
|
|
40
|
+
"JSON LD",
|
|
41
|
+
"link analysis",
|
|
20
42
|
"SEO",
|
|
21
43
|
"SEO page audit",
|
|
22
44
|
"SEO research",
|
|
23
45
|
"SEO toolkit",
|
|
24
46
|
"SEO skill",
|
|
25
47
|
"technical SEO",
|
|
26
|
-
"pay-per-fetch",
|
|
27
|
-
"pay-per-url",
|
|
28
48
|
"GEO",
|
|
29
49
|
"Generative Engine Optimization",
|
|
30
50
|
"AEO",
|
|
31
51
|
"Answer Engine Optimization",
|
|
32
|
-
"hosted extraction",
|
|
33
|
-
"content extraction",
|
|
34
|
-
"content indexing",
|
|
35
|
-
"extract",
|
|
36
|
-
"html",
|
|
37
|
-
"html parser",
|
|
38
|
-
"json-ld",
|
|
39
|
-
"JSON LD",
|
|
40
|
-
"link analysis",
|
|
41
|
-
"link extraction",
|
|
42
|
-
"metadata",
|
|
43
|
-
"meta tags",
|
|
44
|
-
"open graph",
|
|
45
|
-
"og tags",
|
|
46
52
|
"AI",
|
|
47
53
|
"AI Agents",
|
|
48
54
|
"AI readability",
|
|
49
|
-
"agent skills",
|
|
50
55
|
"automation",
|
|
51
|
-
"monitoring",
|
|
52
56
|
"LLM",
|
|
53
|
-
"previews",
|
|
54
|
-
"social cards",
|
|
55
|
-
"twitter cards",
|
|
56
|
-
"site monitoring",
|
|
57
57
|
"x402",
|
|
58
58
|
"micropayments",
|
|
59
59
|
"usdc"
|