@isdk/web-fetcher 0.2.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.action.cn.md +469 -0
- package/README.action.md +452 -0
- package/README.cn.md +147 -0
- package/README.engine.cn.md +262 -0
- package/README.engine.md +262 -0
- package/README.md +147 -0
- package/dist/index.d.mts +1603 -0
- package/dist/index.d.ts +1603 -0
- package/dist/index.js +1 -0
- package/dist/index.mjs +1 -0
- package/docs/README.md +151 -0
- package/docs/_media/LICENSE-MIT +22 -0
- package/docs/_media/README.action.md +452 -0
- package/docs/_media/README.cn.md +147 -0
- package/docs/_media/README.engine.md +262 -0
- package/docs/classes/CheerioFetchEngine.md +1447 -0
- package/docs/classes/ClickAction.md +533 -0
- package/docs/classes/ExtractAction.md +533 -0
- package/docs/classes/FetchAction.md +444 -0
- package/docs/classes/FetchEngine.md +1230 -0
- package/docs/classes/FetchSession.md +111 -0
- package/docs/classes/FillAction.md +533 -0
- package/docs/classes/GetContentAction.md +533 -0
- package/docs/classes/GotoAction.md +537 -0
- package/docs/classes/PauseAction.md +533 -0
- package/docs/classes/PlaywrightFetchEngine.md +1437 -0
- package/docs/classes/SubmitAction.md +533 -0
- package/docs/classes/WaitForAction.md +533 -0
- package/docs/classes/WebFetcher.md +85 -0
- package/docs/enumerations/FetchActionResultStatus.md +40 -0
- package/docs/functions/fetchWeb.md +43 -0
- package/docs/globals.md +72 -0
- package/docs/interfaces/BaseFetchActionProperties.md +83 -0
- package/docs/interfaces/BaseFetchCollectorActionProperties.md +145 -0
- package/docs/interfaces/BaseFetcherProperties.md +206 -0
- package/docs/interfaces/Cookie.md +142 -0
- package/docs/interfaces/DispatchedEngineAction.md +60 -0
- package/docs/interfaces/ExtractActionProperties.md +113 -0
- package/docs/interfaces/FetchActionInContext.md +149 -0
- package/docs/interfaces/FetchActionProperties.md +125 -0
- package/docs/interfaces/FetchActionResult.md +55 -0
- package/docs/interfaces/FetchContext.md +424 -0
- package/docs/interfaces/FetchEngineContext.md +328 -0
- package/docs/interfaces/FetchMetadata.md +73 -0
- package/docs/interfaces/FetchResponse.md +105 -0
- package/docs/interfaces/FetchReturnTypeRegistry.md +57 -0
- package/docs/interfaces/FetchSite.md +320 -0
- package/docs/interfaces/FetcherOptions.md +300 -0
- package/docs/interfaces/GotoActionOptions.md +66 -0
- package/docs/interfaces/PendingEngineRequest.md +51 -0
- package/docs/interfaces/SubmitActionOptions.md +23 -0
- package/docs/interfaces/WaitForActionOptions.md +39 -0
- package/docs/type-aliases/BaseFetchActionOptions.md +11 -0
- package/docs/type-aliases/BaseFetchCollectorOptions.md +11 -0
- package/docs/type-aliases/BrowserEngine.md +11 -0
- package/docs/type-aliases/FetchActionCapabilities.md +11 -0
- package/docs/type-aliases/FetchActionCapabilityMode.md +11 -0
- package/docs/type-aliases/FetchActionOptions.md +11 -0
- package/docs/type-aliases/FetchEngineAction.md +18 -0
- package/docs/type-aliases/FetchEngineType.md +11 -0
- package/docs/type-aliases/FetchReturnType.md +11 -0
- package/docs/type-aliases/FetchReturnTypeFor.md +17 -0
- package/docs/type-aliases/OnFetchPauseCallback.md +23 -0
- package/docs/type-aliases/ResourceType.md +11 -0
- package/docs/variables/DefaultFetcherProperties.md +11 -0
- package/package.json +90 -0
package/docs/globals.md
ADDED
|
@@ -0,0 +1,72 @@
|
|
|
1
|
+
[**@isdk/web-fetcher**](README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
# @isdk/web-fetcher
|
|
6
|
+
|
|
7
|
+
## Enumerations
|
|
8
|
+
|
|
9
|
+
- [FetchActionResultStatus](enumerations/FetchActionResultStatus.md)
|
|
10
|
+
|
|
11
|
+
## Classes
|
|
12
|
+
|
|
13
|
+
- [CheerioFetchEngine](classes/CheerioFetchEngine.md)
|
|
14
|
+
- [ClickAction](classes/ClickAction.md)
|
|
15
|
+
- [ExtractAction](classes/ExtractAction.md)
|
|
16
|
+
- [FetchAction](classes/FetchAction.md)
|
|
17
|
+
- [FetchEngine](classes/FetchEngine.md)
|
|
18
|
+
- [FetchSession](classes/FetchSession.md)
|
|
19
|
+
- [FillAction](classes/FillAction.md)
|
|
20
|
+
- [GetContentAction](classes/GetContentAction.md)
|
|
21
|
+
- [GotoAction](classes/GotoAction.md)
|
|
22
|
+
- [PauseAction](classes/PauseAction.md)
|
|
23
|
+
- [PlaywrightFetchEngine](classes/PlaywrightFetchEngine.md)
|
|
24
|
+
- [SubmitAction](classes/SubmitAction.md)
|
|
25
|
+
- [WaitForAction](classes/WaitForAction.md)
|
|
26
|
+
- [WebFetcher](classes/WebFetcher.md)
|
|
27
|
+
|
|
28
|
+
## Interfaces
|
|
29
|
+
|
|
30
|
+
- [BaseFetchActionProperties](interfaces/BaseFetchActionProperties.md)
|
|
31
|
+
- [BaseFetchCollectorActionProperties](interfaces/BaseFetchCollectorActionProperties.md)
|
|
32
|
+
- [BaseFetcherProperties](interfaces/BaseFetcherProperties.md)
|
|
33
|
+
- [Cookie](interfaces/Cookie.md)
|
|
34
|
+
- [DispatchedEngineAction](interfaces/DispatchedEngineAction.md)
|
|
35
|
+
- [ExtractActionProperties](interfaces/ExtractActionProperties.md)
|
|
36
|
+
- [FetchActionInContext](interfaces/FetchActionInContext.md)
|
|
37
|
+
- [FetchActionProperties](interfaces/FetchActionProperties.md)
|
|
38
|
+
- [FetchActionResult](interfaces/FetchActionResult.md)
|
|
39
|
+
- [FetchContext](interfaces/FetchContext.md)
|
|
40
|
+
- [FetchEngineContext](interfaces/FetchEngineContext.md)
|
|
41
|
+
- [FetcherOptions](interfaces/FetcherOptions.md)
|
|
42
|
+
- [FetchMetadata](interfaces/FetchMetadata.md)
|
|
43
|
+
- [FetchResponse](interfaces/FetchResponse.md)
|
|
44
|
+
- [FetchReturnTypeRegistry](interfaces/FetchReturnTypeRegistry.md)
|
|
45
|
+
- [FetchSite](interfaces/FetchSite.md)
|
|
46
|
+
- [GotoActionOptions](interfaces/GotoActionOptions.md)
|
|
47
|
+
- [PendingEngineRequest](interfaces/PendingEngineRequest.md)
|
|
48
|
+
- [SubmitActionOptions](interfaces/SubmitActionOptions.md)
|
|
49
|
+
- [WaitForActionOptions](interfaces/WaitForActionOptions.md)
|
|
50
|
+
|
|
51
|
+
## Type Aliases
|
|
52
|
+
|
|
53
|
+
- [BaseFetchActionOptions](type-aliases/BaseFetchActionOptions.md)
|
|
54
|
+
- [BaseFetchCollectorOptions](type-aliases/BaseFetchCollectorOptions.md)
|
|
55
|
+
- [BrowserEngine](type-aliases/BrowserEngine.md)
|
|
56
|
+
- [FetchActionCapabilities](type-aliases/FetchActionCapabilities.md)
|
|
57
|
+
- [FetchActionCapabilityMode](type-aliases/FetchActionCapabilityMode.md)
|
|
58
|
+
- [FetchActionOptions](type-aliases/FetchActionOptions.md)
|
|
59
|
+
- [FetchEngineAction](type-aliases/FetchEngineAction.md)
|
|
60
|
+
- [FetchEngineType](type-aliases/FetchEngineType.md)
|
|
61
|
+
- [FetchReturnType](type-aliases/FetchReturnType.md)
|
|
62
|
+
- [FetchReturnTypeFor](type-aliases/FetchReturnTypeFor.md)
|
|
63
|
+
- [OnFetchPauseCallback](type-aliases/OnFetchPauseCallback.md)
|
|
64
|
+
- [ResourceType](type-aliases/ResourceType.md)
|
|
65
|
+
|
|
66
|
+
## Variables
|
|
67
|
+
|
|
68
|
+
- [DefaultFetcherProperties](variables/DefaultFetcherProperties.md)
|
|
69
|
+
|
|
70
|
+
## Functions
|
|
71
|
+
|
|
72
|
+
- [fetchWeb](functions/fetchWeb.md)
|
|
@@ -0,0 +1,83 @@
|
|
|
1
|
+
[**@isdk/web-fetcher**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/web-fetcher](../globals.md) / BaseFetchActionProperties
|
|
6
|
+
|
|
7
|
+
# Interface: BaseFetchActionProperties
|
|
8
|
+
|
|
9
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:44](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L44)
|
|
10
|
+
|
|
11
|
+
## Extended by
|
|
12
|
+
|
|
13
|
+
- [`BaseFetchCollectorActionProperties`](BaseFetchCollectorActionProperties.md)
|
|
14
|
+
- [`FetchActionProperties`](FetchActionProperties.md)
|
|
15
|
+
- [`ExtractActionProperties`](ExtractActionProperties.md)
|
|
16
|
+
|
|
17
|
+
## Indexable
|
|
18
|
+
|
|
19
|
+
\[`key`: `string`\]: `any`
|
|
20
|
+
|
|
21
|
+
## Properties
|
|
22
|
+
|
|
23
|
+
### failOnError?
|
|
24
|
+
|
|
25
|
+
> `optional` **failOnError**: `boolean`
|
|
26
|
+
|
|
27
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:52](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L52)
|
|
28
|
+
|
|
29
|
+
***
|
|
30
|
+
|
|
31
|
+
### failOnTimeout?
|
|
32
|
+
|
|
33
|
+
> `optional` **failOnTimeout**: `boolean`
|
|
34
|
+
|
|
35
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:54](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L54)
|
|
36
|
+
|
|
37
|
+
***
|
|
38
|
+
|
|
39
|
+
### id?
|
|
40
|
+
|
|
41
|
+
> `optional` **id**: `string`
|
|
42
|
+
|
|
43
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:45](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L45)
|
|
44
|
+
|
|
45
|
+
***
|
|
46
|
+
|
|
47
|
+
### maxRetries?
|
|
48
|
+
|
|
49
|
+
> `optional` **maxRetries**: `number`
|
|
50
|
+
|
|
51
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:56](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L56)
|
|
52
|
+
|
|
53
|
+
***
|
|
54
|
+
|
|
55
|
+
### name?
|
|
56
|
+
|
|
57
|
+
> `optional` **name**: `string`
|
|
58
|
+
|
|
59
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:46](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L46)
|
|
60
|
+
|
|
61
|
+
***
|
|
62
|
+
|
|
63
|
+
### params?
|
|
64
|
+
|
|
65
|
+
> `optional` **params**: `any`
|
|
66
|
+
|
|
67
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:47](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L47)
|
|
68
|
+
|
|
69
|
+
***
|
|
70
|
+
|
|
71
|
+
### storeAs?
|
|
72
|
+
|
|
73
|
+
> `optional` **storeAs**: `string`
|
|
74
|
+
|
|
75
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:49](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L49)
|
|
76
|
+
|
|
77
|
+
***
|
|
78
|
+
|
|
79
|
+
### timeoutMs?
|
|
80
|
+
|
|
81
|
+
> `optional` **timeoutMs**: `number`
|
|
82
|
+
|
|
83
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:55](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L55)
|
|
@@ -0,0 +1,145 @@
|
|
|
1
|
+
[**@isdk/web-fetcher**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/web-fetcher](../globals.md) / BaseFetchCollectorActionProperties
|
|
6
|
+
|
|
7
|
+
# Interface: BaseFetchCollectorActionProperties
|
|
8
|
+
|
|
9
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:61](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L61)
|
|
10
|
+
|
|
11
|
+
## Extends
|
|
12
|
+
|
|
13
|
+
- [`BaseFetchActionProperties`](BaseFetchActionProperties.md)
|
|
14
|
+
|
|
15
|
+
## Indexable
|
|
16
|
+
|
|
17
|
+
\[`key`: `string`\]: `any`
|
|
18
|
+
|
|
19
|
+
## Properties
|
|
20
|
+
|
|
21
|
+
### activateOn?
|
|
22
|
+
|
|
23
|
+
> `optional` **activateOn**: `string` \| `RegExp` \| (`string` \| `RegExp`)[]
|
|
24
|
+
|
|
25
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:63](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L63)
|
|
26
|
+
|
|
27
|
+
***
|
|
28
|
+
|
|
29
|
+
### background?
|
|
30
|
+
|
|
31
|
+
> `optional` **background**: `boolean`
|
|
32
|
+
|
|
33
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:69](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L69)
|
|
34
|
+
|
|
35
|
+
***
|
|
36
|
+
|
|
37
|
+
### collectOn?
|
|
38
|
+
|
|
39
|
+
> `optional` **collectOn**: `string` \| `RegExp` \| (`string` \| `RegExp`)[]
|
|
40
|
+
|
|
41
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:67](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L67)
|
|
42
|
+
|
|
43
|
+
***
|
|
44
|
+
|
|
45
|
+
### deactivateOn?
|
|
46
|
+
|
|
47
|
+
> `optional` **deactivateOn**: `string` \| `RegExp` \| (`string` \| `RegExp`)[]
|
|
48
|
+
|
|
49
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:65](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L65)
|
|
50
|
+
|
|
51
|
+
***
|
|
52
|
+
|
|
53
|
+
### failOnError?
|
|
54
|
+
|
|
55
|
+
> `optional` **failOnError**: `boolean`
|
|
56
|
+
|
|
57
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:52](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L52)
|
|
58
|
+
|
|
59
|
+
#### Inherited from
|
|
60
|
+
|
|
61
|
+
[`BaseFetchActionProperties`](BaseFetchActionProperties.md).[`failOnError`](BaseFetchActionProperties.md#failonerror)
|
|
62
|
+
|
|
63
|
+
***
|
|
64
|
+
|
|
65
|
+
### failOnTimeout?
|
|
66
|
+
|
|
67
|
+
> `optional` **failOnTimeout**: `boolean`
|
|
68
|
+
|
|
69
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:54](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L54)
|
|
70
|
+
|
|
71
|
+
#### Inherited from
|
|
72
|
+
|
|
73
|
+
[`BaseFetchActionProperties`](BaseFetchActionProperties.md).[`failOnTimeout`](BaseFetchActionProperties.md#failontimeout)
|
|
74
|
+
|
|
75
|
+
***
|
|
76
|
+
|
|
77
|
+
### id?
|
|
78
|
+
|
|
79
|
+
> `optional` **id**: `string`
|
|
80
|
+
|
|
81
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:45](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L45)
|
|
82
|
+
|
|
83
|
+
#### Inherited from
|
|
84
|
+
|
|
85
|
+
[`BaseFetchActionProperties`](BaseFetchActionProperties.md).[`id`](BaseFetchActionProperties.md#id)
|
|
86
|
+
|
|
87
|
+
***
|
|
88
|
+
|
|
89
|
+
### maxRetries?
|
|
90
|
+
|
|
91
|
+
> `optional` **maxRetries**: `number`
|
|
92
|
+
|
|
93
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:56](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L56)
|
|
94
|
+
|
|
95
|
+
#### Inherited from
|
|
96
|
+
|
|
97
|
+
[`BaseFetchActionProperties`](BaseFetchActionProperties.md).[`maxRetries`](BaseFetchActionProperties.md#maxretries)
|
|
98
|
+
|
|
99
|
+
***
|
|
100
|
+
|
|
101
|
+
### name?
|
|
102
|
+
|
|
103
|
+
> `optional` **name**: `string`
|
|
104
|
+
|
|
105
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:46](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L46)
|
|
106
|
+
|
|
107
|
+
#### Inherited from
|
|
108
|
+
|
|
109
|
+
[`BaseFetchActionProperties`](BaseFetchActionProperties.md).[`name`](BaseFetchActionProperties.md#name)
|
|
110
|
+
|
|
111
|
+
***
|
|
112
|
+
|
|
113
|
+
### params?
|
|
114
|
+
|
|
115
|
+
> `optional` **params**: `any`
|
|
116
|
+
|
|
117
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:47](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L47)
|
|
118
|
+
|
|
119
|
+
#### Inherited from
|
|
120
|
+
|
|
121
|
+
[`BaseFetchActionProperties`](BaseFetchActionProperties.md).[`params`](BaseFetchActionProperties.md#params)
|
|
122
|
+
|
|
123
|
+
***
|
|
124
|
+
|
|
125
|
+
### storeAs?
|
|
126
|
+
|
|
127
|
+
> `optional` **storeAs**: `string`
|
|
128
|
+
|
|
129
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:49](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L49)
|
|
130
|
+
|
|
131
|
+
#### Inherited from
|
|
132
|
+
|
|
133
|
+
[`BaseFetchActionProperties`](BaseFetchActionProperties.md).[`storeAs`](BaseFetchActionProperties.md#storeas)
|
|
134
|
+
|
|
135
|
+
***
|
|
136
|
+
|
|
137
|
+
### timeoutMs?
|
|
138
|
+
|
|
139
|
+
> `optional` **timeoutMs**: `number`
|
|
140
|
+
|
|
141
|
+
Defined in: [packages/web-fetcher/src/action/fetch-action.ts:55](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/action/fetch-action.ts#L55)
|
|
142
|
+
|
|
143
|
+
#### Inherited from
|
|
144
|
+
|
|
145
|
+
[`BaseFetchActionProperties`](BaseFetchActionProperties.md).[`timeoutMs`](BaseFetchActionProperties.md#timeoutms)
|
|
@@ -0,0 +1,206 @@
|
|
|
1
|
+
[**@isdk/web-fetcher**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/web-fetcher](../globals.md) / BaseFetcherProperties
|
|
6
|
+
|
|
7
|
+
# Interface: BaseFetcherProperties
|
|
8
|
+
|
|
9
|
+
Defined in: [packages/web-fetcher/src/core/types.ts:26](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/core/types.ts#L26)
|
|
10
|
+
|
|
11
|
+
## Extended by
|
|
12
|
+
|
|
13
|
+
- [`FetchSite`](FetchSite.md)
|
|
14
|
+
- [`FetcherOptions`](FetcherOptions.md)
|
|
15
|
+
- [`FetchEngineContext`](FetchEngineContext.md)
|
|
16
|
+
|
|
17
|
+
## Properties
|
|
18
|
+
|
|
19
|
+
### antibot?
|
|
20
|
+
|
|
21
|
+
> `optional` **antibot**: `boolean`
|
|
22
|
+
|
|
23
|
+
Defined in: [packages/web-fetcher/src/core/types.ts:37](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/core/types.ts#L37)
|
|
24
|
+
|
|
25
|
+
***
|
|
26
|
+
|
|
27
|
+
### blockResources?
|
|
28
|
+
|
|
29
|
+
> `optional` **blockResources**: `string`[]
|
|
30
|
+
|
|
31
|
+
Defined in: [packages/web-fetcher/src/core/types.ts:46](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/core/types.ts#L46)
|
|
32
|
+
|
|
33
|
+
***
|
|
34
|
+
|
|
35
|
+
### browser?
|
|
36
|
+
|
|
37
|
+
> `optional` **browser**: `object`
|
|
38
|
+
|
|
39
|
+
Defined in: [packages/web-fetcher/src/core/types.ts:52](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/core/types.ts#L52)
|
|
40
|
+
|
|
41
|
+
#### engine?
|
|
42
|
+
|
|
43
|
+
> `optional` **engine**: [`BrowserEngine`](../type-aliases/BrowserEngine.md)
|
|
44
|
+
|
|
45
|
+
浏览器引擎,默认为 playwright
|
|
46
|
+
|
|
47
|
+
- `playwright`: 使用 Playwright 引擎
|
|
48
|
+
- `puppeteer`: 使用 Puppeteer 引擎
|
|
49
|
+
|
|
50
|
+
#### headless?
|
|
51
|
+
|
|
52
|
+
> `optional` **headless**: `boolean`
|
|
53
|
+
|
|
54
|
+
#### waitUntil?
|
|
55
|
+
|
|
56
|
+
> `optional` **waitUntil**: `"load"` \| `"domcontentloaded"` \| `"networkidle"` \| `"commit"`
|
|
57
|
+
|
|
58
|
+
***
|
|
59
|
+
|
|
60
|
+
### cookies?
|
|
61
|
+
|
|
62
|
+
> `optional` **cookies**: [`Cookie`](Cookie.md)[]
|
|
63
|
+
|
|
64
|
+
Defined in: [packages/web-fetcher/src/core/types.ts:40](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/core/types.ts#L40)
|
|
65
|
+
|
|
66
|
+
***
|
|
67
|
+
|
|
68
|
+
### delayBetweenRequestsMs?
|
|
69
|
+
|
|
70
|
+
> `optional` **delayBetweenRequestsMs**: `number`
|
|
71
|
+
|
|
72
|
+
Defined in: [packages/web-fetcher/src/core/types.ts:72](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/core/types.ts#L72)
|
|
73
|
+
|
|
74
|
+
***
|
|
75
|
+
|
|
76
|
+
### enableSmart?
|
|
77
|
+
|
|
78
|
+
> `optional` **enableSmart**: `boolean`
|
|
79
|
+
|
|
80
|
+
Defined in: [packages/web-fetcher/src/core/types.ts:35](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/core/types.ts#L35)
|
|
81
|
+
|
|
82
|
+
***
|
|
83
|
+
|
|
84
|
+
### engine?
|
|
85
|
+
|
|
86
|
+
> `optional` **engine**: `string`
|
|
87
|
+
|
|
88
|
+
Defined in: [packages/web-fetcher/src/core/types.ts:34](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/core/types.ts#L34)
|
|
89
|
+
|
|
90
|
+
抓取模式
|
|
91
|
+
|
|
92
|
+
- `http`: 使用 HTTP 进行抓取
|
|
93
|
+
- `browser`: 使用浏览器进行抓取
|
|
94
|
+
- `auto`: auto 会走“智能探测”选择 http 或 browser, 但是如果没有启用 smart,并且在站点注册表中没有,那么则等价为 http.
|
|
95
|
+
|
|
96
|
+
***
|
|
97
|
+
|
|
98
|
+
### headers?
|
|
99
|
+
|
|
100
|
+
> `optional` **headers**: `Record`\<`string`, `string`\>
|
|
101
|
+
|
|
102
|
+
Defined in: [packages/web-fetcher/src/core/types.ts:39](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/core/types.ts#L39)
|
|
103
|
+
|
|
104
|
+
***
|
|
105
|
+
|
|
106
|
+
### http?
|
|
107
|
+
|
|
108
|
+
> `optional` **http**: `object`
|
|
109
|
+
|
|
110
|
+
Defined in: [packages/web-fetcher/src/core/types.ts:64](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/core/types.ts#L64)
|
|
111
|
+
|
|
112
|
+
#### body?
|
|
113
|
+
|
|
114
|
+
> `optional` **body**: `any`
|
|
115
|
+
|
|
116
|
+
#### method?
|
|
117
|
+
|
|
118
|
+
> `optional` **method**: `"GET"` \| `"POST"` \| `"PUT"` \| `"DELETE"` \| `"PATCH"`
|
|
119
|
+
|
|
120
|
+
***
|
|
121
|
+
|
|
122
|
+
### ignoreSslErrors?
|
|
123
|
+
|
|
124
|
+
> `optional` **ignoreSslErrors**: `boolean`
|
|
125
|
+
|
|
126
|
+
Defined in: [packages/web-fetcher/src/core/types.ts:50](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/core/types.ts#L50)
|
|
127
|
+
|
|
128
|
+
***
|
|
129
|
+
|
|
130
|
+
### maxConcurrency?
|
|
131
|
+
|
|
132
|
+
> `optional` **maxConcurrency**: `number`
|
|
133
|
+
|
|
134
|
+
Defined in: [packages/web-fetcher/src/core/types.ts:70](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/core/types.ts#L70)
|
|
135
|
+
|
|
136
|
+
***
|
|
137
|
+
|
|
138
|
+
### maxRequestsPerMinute?
|
|
139
|
+
|
|
140
|
+
> `optional` **maxRequestsPerMinute**: `number`
|
|
141
|
+
|
|
142
|
+
Defined in: [packages/web-fetcher/src/core/types.ts:71](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/core/types.ts#L71)
|
|
143
|
+
|
|
144
|
+
***
|
|
145
|
+
|
|
146
|
+
### proxy?
|
|
147
|
+
|
|
148
|
+
> `optional` **proxy**: `string` \| `string`[]
|
|
149
|
+
|
|
150
|
+
Defined in: [packages/web-fetcher/src/core/types.ts:44](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/core/types.ts#L44)
|
|
151
|
+
|
|
152
|
+
***
|
|
153
|
+
|
|
154
|
+
### retries?
|
|
155
|
+
|
|
156
|
+
> `optional` **retries**: `number`
|
|
157
|
+
|
|
158
|
+
Defined in: [packages/web-fetcher/src/core/types.ts:73](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/core/types.ts#L73)
|
|
159
|
+
|
|
160
|
+
***
|
|
161
|
+
|
|
162
|
+
### reuseCookies?
|
|
163
|
+
|
|
164
|
+
> `optional` **reuseCookies**: `boolean`
|
|
165
|
+
|
|
166
|
+
Defined in: [packages/web-fetcher/src/core/types.ts:41](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/core/types.ts#L41)
|
|
167
|
+
|
|
168
|
+
***
|
|
169
|
+
|
|
170
|
+
### sites?
|
|
171
|
+
|
|
172
|
+
> `optional` **sites**: [`FetchSite`](FetchSite.md)[]
|
|
173
|
+
|
|
174
|
+
Defined in: [packages/web-fetcher/src/core/types.ts:75](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/core/types.ts#L75)
|
|
175
|
+
|
|
176
|
+
***
|
|
177
|
+
|
|
178
|
+
### throwHttpErrors?
|
|
179
|
+
|
|
180
|
+
> `optional` **throwHttpErrors**: `boolean`
|
|
181
|
+
|
|
182
|
+
Defined in: [packages/web-fetcher/src/core/types.ts:42](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/core/types.ts#L42)
|
|
183
|
+
|
|
184
|
+
***
|
|
185
|
+
|
|
186
|
+
### timeoutMs?
|
|
187
|
+
|
|
188
|
+
> `optional` **timeoutMs**: `number`
|
|
189
|
+
|
|
190
|
+
Defined in: [packages/web-fetcher/src/core/types.ts:69](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/core/types.ts#L69)
|
|
191
|
+
|
|
192
|
+
***
|
|
193
|
+
|
|
194
|
+
### url?
|
|
195
|
+
|
|
196
|
+
> `optional` **url**: `string`
|
|
197
|
+
|
|
198
|
+
Defined in: [packages/web-fetcher/src/core/types.ts:76](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/core/types.ts#L76)
|
|
199
|
+
|
|
200
|
+
***
|
|
201
|
+
|
|
202
|
+
### useSiteRegistry?
|
|
203
|
+
|
|
204
|
+
> `optional` **useSiteRegistry**: `boolean`
|
|
205
|
+
|
|
206
|
+
Defined in: [packages/web-fetcher/src/core/types.ts:36](https://github.com/isdk/web-fetcher.js/blob/ef3a4e527bf3ca75213d55b02c017b9a30a036fd/src/core/types.ts#L36)
|
|
@@ -0,0 +1,142 @@
|
|
|
1
|
+
[**@isdk/web-fetcher**](../README.md)
|
|
2
|
+
|
|
3
|
+
***
|
|
4
|
+
|
|
5
|
+
[@isdk/web-fetcher](../globals.md) / Cookie
|
|
6
|
+
|
|
7
|
+
# Interface: Cookie
|
|
8
|
+
|
|
9
|
+
Defined in: node\_modules/.pnpm/@crawlee+types@3.15.1/node\_modules/@crawlee/types/browser.d.ts:2
|
|
10
|
+
|
|
11
|
+
## Properties
|
|
12
|
+
|
|
13
|
+
### domain?
|
|
14
|
+
|
|
15
|
+
> `optional` **domain**: `string`
|
|
16
|
+
|
|
17
|
+
Defined in: node\_modules/.pnpm/@crawlee+types@3.15.1/node\_modules/@crawlee/types/browser.d.ts:19
|
|
18
|
+
|
|
19
|
+
Cookie domain.
|
|
20
|
+
|
|
21
|
+
***
|
|
22
|
+
|
|
23
|
+
### expires?
|
|
24
|
+
|
|
25
|
+
> `optional` **expires**: `number`
|
|
26
|
+
|
|
27
|
+
Defined in: node\_modules/.pnpm/@crawlee+types@3.15.1/node\_modules/@crawlee/types/browser.d.ts:39
|
|
28
|
+
|
|
29
|
+
Cookie expiration date, session cookie if not set
|
|
30
|
+
|
|
31
|
+
***
|
|
32
|
+
|
|
33
|
+
### httpOnly?
|
|
34
|
+
|
|
35
|
+
> `optional` **httpOnly**: `boolean`
|
|
36
|
+
|
|
37
|
+
Defined in: node\_modules/.pnpm/@crawlee+types@3.15.1/node\_modules/@crawlee/types/browser.d.ts:31
|
|
38
|
+
|
|
39
|
+
True if cookie is http-only.
|
|
40
|
+
|
|
41
|
+
***
|
|
42
|
+
|
|
43
|
+
### name
|
|
44
|
+
|
|
45
|
+
> **name**: `string`
|
|
46
|
+
|
|
47
|
+
Defined in: node\_modules/.pnpm/@crawlee+types@3.15.1/node\_modules/@crawlee/types/browser.d.ts:6
|
|
48
|
+
|
|
49
|
+
Cookie name.
|
|
50
|
+
|
|
51
|
+
***
|
|
52
|
+
|
|
53
|
+
### path?
|
|
54
|
+
|
|
55
|
+
> `optional` **path**: `string`
|
|
56
|
+
|
|
57
|
+
Defined in: node\_modules/.pnpm/@crawlee+types@3.15.1/node\_modules/@crawlee/types/browser.d.ts:23
|
|
58
|
+
|
|
59
|
+
Cookie path.
|
|
60
|
+
|
|
61
|
+
***
|
|
62
|
+
|
|
63
|
+
### priority?
|
|
64
|
+
|
|
65
|
+
> `optional` **priority**: `"Low"` \| `"Medium"` \| `"High"`
|
|
66
|
+
|
|
67
|
+
Defined in: node\_modules/.pnpm/@crawlee+types@3.15.1/node\_modules/@crawlee/types/browser.d.ts:43
|
|
68
|
+
|
|
69
|
+
Cookie Priority.
|
|
70
|
+
|
|
71
|
+
***
|
|
72
|
+
|
|
73
|
+
### sameParty?
|
|
74
|
+
|
|
75
|
+
> `optional` **sameParty**: `boolean`
|
|
76
|
+
|
|
77
|
+
Defined in: node\_modules/.pnpm/@crawlee+types@3.15.1/node\_modules/@crawlee/types/browser.d.ts:47
|
|
78
|
+
|
|
79
|
+
True if cookie is SameParty.
|
|
80
|
+
|
|
81
|
+
***
|
|
82
|
+
|
|
83
|
+
### sameSite?
|
|
84
|
+
|
|
85
|
+
> `optional` **sameSite**: `"Strict"` \| `"Lax"` \| `"None"`
|
|
86
|
+
|
|
87
|
+
Defined in: node\_modules/.pnpm/@crawlee+types@3.15.1/node\_modules/@crawlee/types/browser.d.ts:35
|
|
88
|
+
|
|
89
|
+
Cookie SameSite type.
|
|
90
|
+
|
|
91
|
+
***
|
|
92
|
+
|
|
93
|
+
### secure?
|
|
94
|
+
|
|
95
|
+
> `optional` **secure**: `boolean`
|
|
96
|
+
|
|
97
|
+
Defined in: node\_modules/.pnpm/@crawlee+types@3.15.1/node\_modules/@crawlee/types/browser.d.ts:27
|
|
98
|
+
|
|
99
|
+
True if cookie is secure.
|
|
100
|
+
|
|
101
|
+
***
|
|
102
|
+
|
|
103
|
+
### sourcePort?
|
|
104
|
+
|
|
105
|
+
> `optional` **sourcePort**: `number`
|
|
106
|
+
|
|
107
|
+
Defined in: node\_modules/.pnpm/@crawlee+types@3.15.1/node\_modules/@crawlee/types/browser.d.ts:57
|
|
108
|
+
|
|
109
|
+
Cookie source port. Valid values are `-1` or `1-65535`, `-1` indicates an unspecified port.
|
|
110
|
+
An unspecified port value allows protocol clients to emulate legacy cookie scope for the port.
|
|
111
|
+
This is a temporary ability and it will be removed in the future.
|
|
112
|
+
|
|
113
|
+
***
|
|
114
|
+
|
|
115
|
+
### sourceScheme?
|
|
116
|
+
|
|
117
|
+
> `optional` **sourceScheme**: `"Unset"` \| `"NonSecure"` \| `"Secure"`
|
|
118
|
+
|
|
119
|
+
Defined in: node\_modules/.pnpm/@crawlee+types@3.15.1/node\_modules/@crawlee/types/browser.d.ts:51
|
|
120
|
+
|
|
121
|
+
Cookie source scheme type.
|
|
122
|
+
|
|
123
|
+
***
|
|
124
|
+
|
|
125
|
+
### url?
|
|
126
|
+
|
|
127
|
+
> `optional` **url**: `string`
|
|
128
|
+
|
|
129
|
+
Defined in: node\_modules/.pnpm/@crawlee+types@3.15.1/node\_modules/@crawlee/types/browser.d.ts:15
|
|
130
|
+
|
|
131
|
+
The request-URI to associate with the setting of the cookie. This value can affect the
|
|
132
|
+
default domain, path, source port, and source scheme values of the created cookie.
|
|
133
|
+
|
|
134
|
+
***
|
|
135
|
+
|
|
136
|
+
### value
|
|
137
|
+
|
|
138
|
+
> **value**: `string`
|
|
139
|
+
|
|
140
|
+
Defined in: node\_modules/.pnpm/@crawlee+types@3.15.1/node\_modules/@crawlee/types/browser.d.ts:10
|
|
141
|
+
|
|
142
|
+
Cookie value.
|