minifetch-api 1.3.2 → 1.3.4

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (2) hide show
  1. package/README.md +28 -25
  2. package/package.json +9 -4
package/README.md CHANGED
@@ -5,25 +5,25 @@
5
5
  </a>
6
6
  </div>
7
7
 
8
- **[Minifetch](https://minifetch.com) is a hosted toolkit of SEO extraction primitives.** Run them as a full technical audit or call one at a time for a fraction of the price — and a fraction of the LLM tokens. No subscription.
8
+ **[Minifetch](https://minifetch.com) is a hosted toolkit of extraction primitives for SEO/ GEO/ AEO.** Run them as a full technical audit or call one at a time for a fraction of the price — and a fraction of the LLM tokens. No subscription.
9
9
 
10
10
  - ✅ **Always pay-per-fetch at competitive prices.**
11
11
  - ✅ [Sign up](https://minifetch.com/dashboard) for an account & get free starter credits. 🎉🎉
12
12
  - ⛔ No charge for blocked pages (403 errors).
13
13
 
14
14
  ---
15
- **👉 [Dashboard](https://minifetch.com/dashboard) | [Full API docs](https://minifetch.com/docs/api) | [LLMs.txt](https://minifetch.com/llms.txt) | Questions? Join our [Discord](https://discord.gg/EM6ET8Dshm)**
15
+ **👉 [Full API docs](https://minifetch.com/docs/api) | [LLMs.txt](https://minifetch.com/llms.txt) and [SKILL.md](https://minifetch.com/SKILL.md) for agents | Questions? Join our [Discord](https://discord.gg/EM6ET8Dshm)**
16
16
 
17
17
  ---
18
18
  **Payments.** Two ways to pay:
19
- 1. Credit card + API key. Get started free - [visit our dashboard to Sign Up](https://minifetch.com/dashboard). Your account will be auto-loaded with 25 free technical SEO page audits. Top up with your credit card later.
20
- 2. USDC on Base or Solana. Just load your wallet with USDC and you're ready. No "gas token" (ETH or SOL) required.
19
+ 1. Credit card + API key. Get started free - [visit our dashboard to Sign Up](https://minifetch.com/dashboard). Create a Minifetch account and it will be auto-loaded with 25 free technical SEO page audits. Top up with your credit card later.
20
+ 2. USDC on Base or Solana. Just load your wallet with USDC, you're ready. No "gas token" (ETH or SOL) required. You don't need a Minifetch account either, just load your wallet and go!
21
21
 
22
22
  ## Prerequisites
23
23
 
24
24
  - Node.js v18+ & NPM
25
25
  - A valid API key from our [dashboard](https://minifetch.com/dashboard)
26
- - *Or* an Ethereum or Solana private key for making USDC payments on Base or Solana networks.
26
+ - ***Or*** an Ethereum or Solana private key for making USDC payments on Base or Solana networks.
27
27
 
28
28
  ## Install
29
29
 
@@ -68,42 +68,45 @@ After the Quick Start, you have the following methods to use.
68
68
 
69
69
  **Wrap** these methods in a **try/catch** just like in the Quick Start example above. **Code examples** can be also found in the [Github repository](https://github.com/Niche-Networks/minifetch-api/) /example- directories.
70
70
 
71
- The "checkAndExtract" methods check the target URL's `robots.txt` file to ensure its not blocked and tell us your preferred crawl delay (defaults to 1 second between requests to your domain). So fetching 10 URLs takes at least 10 seconds to complete. This is by design, so Minifetch never hammers your server or slows it down for your real users. [Full api docs here.](https://minifetch.com/docs/api)
71
+ The `checkAndExtract` methods check the target URL's `robots.txt` file to ensure its not blocked and tell us your preferred crawl delay (defaults to 1 second between requests to your domain). So fetching 10 URLs takes at least 10 seconds to complete by default. This is by design, so Minifetch never hammers your server or slows it down for your real users. If the URL is blocked, read [How To Unblock Minifetch](https://minifetch.com/tutorials/unblock-minifetch).
72
72
 
73
73
  ```js
74
74
  await client.checkAndRunSeoPageAudit(url);
75
75
  // Price: $0.01
76
- // Runs a full technical SEO audit on your URL. It combines data from
76
+ // Runs a full technical SEO audit on your URL. Combines data from
77
77
  // the other API endpoints and runs checks that each return a PASS/
78
- // WARN/ FAIL result with no black-box scoring just deterministic,
78
+ // WARN/ FAIL result with no black-box scoring. Just deterministic,
79
79
  // composable signal you can act on or pipe into an agent.
80
- // Audit rules are documented in the in the audit skill file:
80
+ // Audit rules are documented in the skill file:
81
81
  // https://minifetch.com/skills/seo-page-audit/SKILL.md
82
82
 
83
83
  await client.checkAndExtractUrlMetadata(url, options);
84
84
  // Price: $0.002
85
- // Fetches & extracts rich structured metadata from your URL: meta tags,
86
- // hreflang, json-ld, images, headings, response headers, + more.
87
- // Setting verbosity to "full" is the drop-in replacement for the npm
88
- // `url-metadata` package.
85
+ // Extracts rich structured metadata from your URL: favicons, title,
86
+ // description, canonical, SEO-related meta tags, Open Graph and
87
+ // Twitter card tags, JSON-LD and more.
88
+ // Set verbosity option to full for more fields: redirect chain,
89
+ // relevant response headers, performance metrics, headings, images
90
+ // and every meta tag found on the page; verbosity "full" is the
91
+ // drop-in replacement for the npm `url-metadata` package.
89
92
  // Options:
90
93
  // { verbosity: "full" } - defaults to "standard"
91
94
  // { includeResponseBody: true } - defaults to false
92
95
 
93
96
  await client.checkAndExtractUrlLinks(url);
94
97
  // Price: $0.002
95
- // Fetches & extracts all links from your URL categorized by type
96
- // (internal/ external/ anchor). Detects image links, `rel` attributes
97
- // (nofollow, sponsored, ugc, etc), `title` and `target`, plus image
98
- // detection. Summary stats include the most-linked-to internal pages
99
- // (with anchor text variants used for each) and top external domains
100
- // by link count.
98
+ // Extracts all links from your URL categorized by type (internal/
99
+ // external/ anchor). Detects image links, `rel` attributes (nofollow,
100
+ // sponsored, ugc, etc), `title` and `target`, plus image detection.
101
+ // Summary stats include the most-linked-to internal pages (with
102
+ // anchor text variants used for each) and top external domains by
103
+ // link count.
101
104
 
102
105
  await client.checkAndExtractUrlPreview(url);
103
- // Price: $0.001
104
- // For checking how your page unfurls when shared: Extracts the title,
105
- // meta description, and preview image (only) - the lightweight card
106
- // social platforms and chat apps render for a link.
106
+ // Price: $0.002
107
+ // For checking how your web page unfurls when shared: Extracts all
108
+ // fields for the lightweight cards that represent your page on social
109
+ // platforms, chat apps and AI.
107
110
 
108
111
  await client.checkAndExtractUrlContent(url, options);
109
112
  // Price: $0.002
@@ -113,7 +116,7 @@ await client.checkAndExtractUrlContent(url, options);
113
116
  // Options: { includeMediaUrls: true } - defaults to false.
114
117
 
115
118
  // For max control, you can also use the following methods directly.
116
- // Free - check robots.txt:
119
+ // Free: check if `minfetch` user agent can access target via robots.txt:
117
120
  await client.preflightCheck(url);
118
121
  // Paid methods:
119
122
  await client.runSeoPageAudit(url);
@@ -144,13 +147,13 @@ Minifetch only extracts publicly available metadata and content from pages acces
144
147
 
145
148
  What Minifetch does *NOT* do:
146
149
  - Ignore robots.txt directives
147
- - Access authenticated or logged-in content
148
150
  - Create accounts or log into user sessions
149
151
  - Perform transactional actions (checkout, bidding, purchasing, form submissions)
150
152
  - Bypass paywalls or access restricted content
151
153
 
152
154
  What Minifetch does NOT do *currently* but may offer in the future as an add-on:
153
155
  - Javascript execution
156
+ - Access authenticated or logged-in content
154
157
 
155
158
  ---
156
159
  ### USDC Best Practices
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "minifetch-api",
3
- "version": "1.3.2",
3
+ "version": "1.3.4",
4
4
  "description": "Minifetch.com API Client. Pay-per-URL SEO audits. Composable toolkit for AI agents and automation pipelines.",
5
5
  "type": "module",
6
6
  "main": "./dist/esm/index.js",
@@ -21,14 +21,18 @@
21
21
  "SEO page audit",
22
22
  "SEO research",
23
23
  "SEO toolkit",
24
+ "SEO skill",
24
25
  "technical SEO",
25
- "pay-per-fetch SEO",
26
- "pay-per-url SEO",
26
+ "pay-per-fetch",
27
+ "pay-per-url",
27
28
  "GEO",
29
+ "Generative Engine Optimization",
28
30
  "AEO",
29
- "extract",
31
+ "Answer Engine Optimization",
32
+ "hosted extraction",
30
33
  "content extraction",
31
34
  "content indexing",
35
+ "extract",
32
36
  "html",
33
37
  "html parser",
34
38
  "json-ld",
@@ -47,6 +51,7 @@
47
51
  "monitoring",
48
52
  "LLM",
49
53
  "previews",
54
+ "social cards",
50
55
  "twitter cards",
51
56
  "site monitoring",
52
57
  "x402",