@helia/verified-fetch 0.0.0-5c0c39c → 0.0.0-6c88ee1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +56 -43
- package/dist/index.min.js +6 -6
- package/dist/src/index.d.ts +59 -47
- package/dist/src/index.d.ts.map +1 -1
- package/dist/src/index.js +59 -47
- package/dist/src/index.js.map +1 -1
- package/dist/src/singleton.d.ts +3 -0
- package/dist/src/singleton.d.ts.map +1 -0
- package/dist/src/singleton.js +15 -0
- package/dist/src/singleton.js.map +1 -0
- package/package.json +11 -11
- package/src/index.ts +60 -47
- package/src/singleton.ts +20 -0
package/README.md
CHANGED
|
@@ -13,28 +13,28 @@
|
|
|
13
13
|
|
|
14
14
|
# About
|
|
15
15
|
|
|
16
|
-
`@helia/verified-fetch`
|
|
16
|
+
`@helia/verified-fetch` provides a [fetch](https://developer.mozilla.org/en-US/docs/Web/API/Fetch_API)-like API for retrieving content from the [IPFS](https://ipfs.tech/) network.
|
|
17
17
|
|
|
18
|
-
|
|
18
|
+
All content is retrieved in a [trustless manner](https://www.techopedia.com/definition/trustless), and the integrity of all bytes are verified by comparing hashes of the data.
|
|
19
19
|
|
|
20
|
-
|
|
20
|
+
This is a marked improvement over `fetch` which offers no such protections and is vulnerable to all sorts of attacks like [Content Spoofing](https://owasp.org/www-community/attacks/Content_Spoofing), [DNS Hijacking](https://en.wikipedia.org/wiki/DNS_hijacking), etc.
|
|
21
|
+
|
|
22
|
+
A `verifiedFetch` function is exported to get up and running quickly, and a `createVerifiedFetch` function is also available that allows customizing the underlying [Helia](https://helia.io/) node for complete control over how content is retrieved.
|
|
23
|
+
|
|
24
|
+
Browser-cache-friendly [Response](https://developer.mozilla.org/en-US/docs/Web/API/Response) objects are returned which should be instantly familiar to web developers.
|
|
21
25
|
|
|
22
26
|
You may use any supported resource argument to fetch content:
|
|
23
27
|
|
|
24
|
-
- CID instance
|
|
28
|
+
- [CID](https://multiformats.github.io/js-multiformats/classes/cid.CID.html) instance
|
|
25
29
|
- IPFS URL
|
|
26
30
|
- IPNS URL
|
|
27
31
|
|
|
28
|
-
## Example
|
|
32
|
+
## Example - Getting started
|
|
29
33
|
|
|
30
34
|
```typescript
|
|
31
|
-
import {
|
|
32
|
-
|
|
33
|
-
const fetch = await createVerifiedFetch({
|
|
34
|
-
gateways: ['https://mygateway.example.net', 'https://trustless-gateway.link']
|
|
35
|
-
})
|
|
35
|
+
import { verifiedFetch } from '@helia/verified-fetch'
|
|
36
36
|
|
|
37
|
-
const resp = await
|
|
37
|
+
const resp = await verifiedFetch('ipfs://bafy...')
|
|
38
38
|
|
|
39
39
|
const json = await resp.json()
|
|
40
40
|
```
|
|
@@ -42,27 +42,20 @@ const json = await resp.json()
|
|
|
42
42
|
## Example - Using a CID instance to fetch JSON
|
|
43
43
|
|
|
44
44
|
```typescript
|
|
45
|
-
import {
|
|
45
|
+
import { verifiedFetch } from '@helia/verified-fetch'
|
|
46
46
|
import { CID } from 'multiformats/cid'
|
|
47
47
|
|
|
48
|
-
const fetch = await createVerifiedFetch({
|
|
49
|
-
gateways: ['https://mygateway.example.net', 'https://trustless-gateway.link']
|
|
50
|
-
})
|
|
51
|
-
|
|
52
48
|
const cid = CID.parse('bafyFoo') // some image file
|
|
53
|
-
const response = await
|
|
49
|
+
const response = await verifiedFetch(cid)
|
|
54
50
|
const json = await response.json()
|
|
55
51
|
```
|
|
56
52
|
|
|
57
53
|
## Example - Using IPFS protocol to fetch an image
|
|
58
54
|
|
|
59
55
|
```typescript
|
|
60
|
-
import {
|
|
56
|
+
import { verifiedFetch } from '@helia/verified-fetch'
|
|
61
57
|
|
|
62
|
-
const
|
|
63
|
-
gateways: ['https://mygateway.example.net', 'https://trustless-gateway.link']
|
|
64
|
-
})
|
|
65
|
-
const response = await fetch('ipfs://bafyFoo') // CID for some image file
|
|
58
|
+
const response = await verifiedFetch('ipfs://bafyFoo') // CID for some image file
|
|
66
59
|
const blob = await response.blob()
|
|
67
60
|
const image = document.createElement('img')
|
|
68
61
|
image.src = URL.createObjectURL(blob)
|
|
@@ -71,23 +64,43 @@ document.body.appendChild(image)
|
|
|
71
64
|
|
|
72
65
|
## Example - Using IPNS protocol to stream a big file
|
|
73
66
|
|
|
67
|
+
```typescript
|
|
68
|
+
import { verifiedFetch } from '@helia/verified-fetch'
|
|
69
|
+
|
|
70
|
+
const response = await verifiedFetch('ipns://mydomain.com/path/to/very-long-file.log')
|
|
71
|
+
const bigFileStreamReader = await response.body.getReader()
|
|
72
|
+
```
|
|
73
|
+
|
|
74
|
+
## Configuration
|
|
75
|
+
|
|
76
|
+
### Custom HTTP gateways and routers
|
|
77
|
+
|
|
78
|
+
Out of the box `@helia/verified-fetch` uses a default set of [trustless gateways](https://specs.ipfs.tech/http-gateways/trustless-gateway/) for fetching blocks and [HTTP delegated routers](https://specs.ipfs.tech/routing/http-routing-v1/) for performing routing tasks - looking up peers, resolving/publishing [IPNS](https://docs.ipfs.tech/concepts/ipns/) names, etc.
|
|
79
|
+
|
|
80
|
+
It's possible to override these by passing `gateways` and `routers` keys to the `createVerifiedFetch` function:
|
|
81
|
+
|
|
82
|
+
## Example - Configuring gateways and routers
|
|
83
|
+
|
|
74
84
|
```typescript
|
|
75
85
|
import { createVerifiedFetch } from '@helia/verified-fetch'
|
|
76
86
|
|
|
77
87
|
const fetch = await createVerifiedFetch({
|
|
78
|
-
gateways: ['https://
|
|
88
|
+
gateways: ['https://trustless-gateway.link'],
|
|
89
|
+
routers: ['http://delegated-ipfs.dev']
|
|
79
90
|
})
|
|
80
|
-
|
|
81
|
-
const
|
|
91
|
+
|
|
92
|
+
const resp = await fetch('ipfs://bafy...')
|
|
93
|
+
|
|
94
|
+
const json = await resp.json()
|
|
82
95
|
```
|
|
83
96
|
|
|
84
|
-
###
|
|
97
|
+
### Usage with customized Helia
|
|
85
98
|
|
|
86
|
-
|
|
99
|
+
For full control of how `@helia/verified-fetch` fetches content from the distributed web you can pass a preconfigured Helia node to `createVerifiedFetch`.
|
|
87
100
|
|
|
88
|
-
|
|
101
|
+
The [helia](https://www.npmjs.com/package/helia) module is configured with a libp2p node that is suited for decentralized applications, alternatively [@helia/http](https://www.npmjs.com/package/@helia/http) is available which uses HTTP gateways for all network operations.
|
|
89
102
|
|
|
90
|
-
|
|
103
|
+
You can see variations of Helia and js-libp2p configuration options at <https://helia.io/interfaces/helia.index.HeliaInit.html>.
|
|
91
104
|
|
|
92
105
|
```typescript
|
|
93
106
|
import { trustlessGateway } from '@helia/block-brokers'
|
|
@@ -111,28 +124,28 @@ const resp = await fetch('ipfs://bafy...')
|
|
|
111
124
|
const json = await resp.json()
|
|
112
125
|
```
|
|
113
126
|
|
|
114
|
-
|
|
127
|
+
## Comparison to fetch
|
|
115
128
|
|
|
116
|
-
|
|
129
|
+
This module attempts to act as similarly to the `fetch()` API as possible.
|
|
117
130
|
|
|
118
131
|
[The `fetch()` API](https://developer.mozilla.org/en-US/docs/Web/API/fetch) takes two parameters:
|
|
119
132
|
|
|
120
133
|
1. A [resource](https://developer.mozilla.org/en-US/docs/Web/API/fetch#resource)
|
|
121
134
|
2. An [options object](https://developer.mozilla.org/en-US/docs/Web/API/fetch#options)
|
|
122
135
|
|
|
123
|
-
|
|
136
|
+
### Resource argument
|
|
124
137
|
|
|
125
|
-
This library
|
|
138
|
+
This library supports the following methods of fetching web3 content from IPFS:
|
|
126
139
|
|
|
127
140
|
1. IPFS protocol: `ipfs://<cidv0>` & `ipfs://<cidv0>`
|
|
128
141
|
2. IPNS protocol: `ipns://<peerId>` & `ipns://<publicKey>` & `ipns://<hostUri_Supporting_DnsLink_TxtRecords>`
|
|
129
142
|
3. CID instances: An actual CID instance `CID.parse('bafy...')`
|
|
130
143
|
|
|
131
|
-
As well as support for pathing & params for item 1&2 above according to [IPFS - Path Gateway Specification](https://specs.ipfs.tech/http-gateways/path-gateway) & [IPFS - Trustless Gateway Specification](https://specs.ipfs.tech/http-gateways/trustless-gateway/). Further refinement of those specifications specifically for web-based scenarios can be found in the [Web Pathing Specification IPIP](https://github.com/ipfs/specs/pull/453).
|
|
144
|
+
As well as support for pathing & params for item 1 & 2 above according to [IPFS - Path Gateway Specification](https://specs.ipfs.tech/http-gateways/path-gateway) & [IPFS - Trustless Gateway Specification](https://specs.ipfs.tech/http-gateways/trustless-gateway/). Further refinement of those specifications specifically for web-based scenarios can be found in the [Web Pathing Specification IPIP](https://github.com/ipfs/specs/pull/453).
|
|
132
145
|
|
|
133
|
-
If you pass a CID instance,
|
|
146
|
+
If you pass a CID instance, it assumes you want the content for that specific CID only, and does not support pathing or params for that CID.
|
|
134
147
|
|
|
135
|
-
|
|
148
|
+
### Options argument
|
|
136
149
|
|
|
137
150
|
This library does not plan to support the exact Fetch API options object, as some of the arguments don't make sense. Instead, it will only support options necessary to meet [IPFS specs](https://specs.ipfs.tech/) related to specifying the resultant shape of desired content.
|
|
138
151
|
|
|
@@ -177,7 +190,7 @@ Some in-flight specs (IPIPs) that will affect the options object this library su
|
|
|
177
190
|
4. [IPIP-0328: JSON and CBOR Response Formats on HTTP Gateways](https://specs.ipfs.tech/ipips/ipip-0328/)
|
|
178
191
|
5. [IPIP-0288: TAR Response Format on HTTP Gateways](https://specs.ipfs.tech/ipips/ipip-0288/)
|
|
179
192
|
|
|
180
|
-
|
|
193
|
+
### Response types
|
|
181
194
|
|
|
182
195
|
This library's purpose is to return reasonably representable content from IPFS. In other words, fetching content is intended for leaf-node content -- such as images/videos/audio & other assets, or other IPLD content (with link) -- that can be represented by <https://developer.mozilla.org/en-US/docs/Web/API/Response#instance_methods>. The content type you receive back will depend upon the CID you request as well as the `Accept` header value you provide.
|
|
183
196
|
|
|
@@ -185,7 +198,7 @@ All content we retrieve from the IPFS network is obtained via an AsyncIterable,
|
|
|
185
198
|
|
|
186
199
|
If your content doesn't have a mime-type or an [IPFS spec](https://specs.ipfs.tech), this library will not support it, but you can use the [`helia`](https://github.com/ipfs/helia) library directly for those use cases. See [Unsupported response types](#unsupported-response-types) for more information.
|
|
187
200
|
|
|
188
|
-
|
|
201
|
+
#### Handling response types
|
|
189
202
|
|
|
190
203
|
For handling responses we want to follow conventions/abstractions from Fetch API where possible:
|
|
191
204
|
|
|
@@ -194,12 +207,12 @@ For handling responses we want to follow conventions/abstractions from Fetch API
|
|
|
194
207
|
- For plain text in utf-8, you would call `.text()`
|
|
195
208
|
- For streaming response data, use something like `response.body.getReader()` to get a [`ReadableStream`](https://developer.mozilla.org/en-US/docs/Web/API/Streams_API/Using_readable_streams#consuming_a_fetch_as_a_stream).
|
|
196
209
|
|
|
197
|
-
|
|
210
|
+
#### Unsupported response types
|
|
198
211
|
|
|
199
212
|
- Returning IPLD nodes or DAGs as JS objects is not supported, as there is no currently well-defined structure for representing this data in an [HTTP Response](https://developer.mozilla.org/en-US/docs/Web/API/Response). Instead, users should request `aplication/vnd.ipld.car` or use the [`helia`](https://github.com/ipfs/helia) library directly for this use case.
|
|
200
213
|
- Others? Open an issue or PR!
|
|
201
214
|
|
|
202
|
-
|
|
215
|
+
### Response headers
|
|
203
216
|
|
|
204
217
|
This library will set the [HTTP Response](https://developer.mozilla.org/en-US/docs/Web/API/Response) headers to the appropriate values for the content type according to the appropriate [IPFS Specifications](https://specs.ipfs.tech/).
|
|
205
218
|
|
|
@@ -209,13 +222,13 @@ Some known header specifications:
|
|
|
209
222
|
- <https://specs.ipfs.tech/http-gateways/trustless-gateway/#response-headers>
|
|
210
223
|
- <https://specs.ipfs.tech/http-gateways/subdomain-gateway/#response-headers>
|
|
211
224
|
|
|
212
|
-
|
|
225
|
+
### Possible Scenarios that could cause confusion
|
|
213
226
|
|
|
214
|
-
|
|
227
|
+
#### Attempting to fetch the CID for content that does not make sense
|
|
215
228
|
|
|
216
229
|
If you request `bafybeiaysi4s6lnjev27ln5icwm6tueaw2vdykrtjkwiphwekaywqhcjze`, which points to the root of the en.wikipedia.org mirror, a response object does not make sense.
|
|
217
230
|
|
|
218
|
-
|
|
231
|
+
### Errors
|
|
219
232
|
|
|
220
233
|
Known Errors that can be thrown:
|
|
221
234
|
|