@isdk/web-searcher 0.1.1 → 0.1.3

package/docs/interfaces/CustomTimeRange.md

@@ -6,7 +6,7 @@
 
 # Interface: CustomTimeRange
 
-Defined in: [web-searcher/src/types.ts:78](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L78)
+Defined in: [web-searcher/src/types.ts:104](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L104)
 
 ## Properties
 
@@ -14,7 +14,7 @@ Defined in: [web-searcher/src/types.ts:78](https://github.com/isdk/web-searcher.
 
 > **from**: `string` \| `Date`
 
-Defined in: [web-searcher/src/types.ts:80](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L80)
+Defined in: [web-searcher/src/types.ts:106](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L106)
 
 Start date (Date object or string like 'YYYY-MM-DD').
 
@@ -24,6 +24,6 @@ Start date (Date object or string like 'YYYY-MM-DD').
 
 > `optional` **to**: `string` \| `Date`
 
-Defined in: [web-searcher/src/types.ts:82](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L82)
+Defined in: [web-searcher/src/types.ts:108](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L108)
 
 End date (Date object or string like 'YYYY-MM-DD'). Defaults to current date if omitted.

package/docs/interfaces/PaginationConfig.md

@@ -6,7 +6,7 @@
 
 # Interface: PaginationConfig
 
-Defined in: [web-searcher/src/types.ts:26](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L26)
+Defined in: [web-searcher/src/types.ts:41](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L41)
 
 Configuration for pagination strategies.
 Defines how the searcher should navigate to the next page of results.
@@ -17,7 +17,7 @@ Defines how the searcher should navigate to the next page of results.
 
 > `optional` **increment**: `number`
 
-Defined in: [web-searcher/src/types.ts:53](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L53)
+Defined in: [web-searcher/src/types.ts:68](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L68)
 
 The increment step for each page.
 - If the parameter represents an item offset (like Google's 'start'), this might be 10.
@@ -31,11 +31,31 @@ The increment step for each page.
 
 ***
 
+### maxPages?
+
+> `optional` **maxPages**: `number`
+
+Defined in: [web-searcher/src/types.ts:85](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L85)
+
+The safety threshold for the maximum number of pages to fetch automatically 
+in a single search call.
+
+Even if the requested `limit` of results hasn't been reached, the searcher 
+will stop after this many pages to prevent infinite loops or excessive API usage.
+
+#### Default
+
+```ts
+10
+```
+
+***
+
 ### nextButtonSelector?
 
 > `optional` **nextButtonSelector**: `string`
 
-Defined in: [web-searcher/src/types.ts:59](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L59)
+Defined in: [web-searcher/src/types.ts:74](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L74)
 
 The CSS selector for the "Next" page button.
 Required if type is 'click-next'.
@@ -46,7 +66,7 @@ Required if type is 'click-next'.
 
 > `optional` **paramName**: `string`
 
-Defined in: [web-searcher/src/types.ts:39](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L39)
+Defined in: [web-searcher/src/types.ts:54](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L54)
 
 The name of the URL parameter used for pagination.
 Required if type is 'url-param'.
@@ -63,7 +83,7 @@ Required if type is 'url-param'.
 
 > `optional` **startValue**: `number`
 
-Defined in: [web-searcher/src/types.ts:45](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L45)
+Defined in: [web-searcher/src/types.ts:60](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L60)
 
 The starting value for the pagination parameter.
 
@@ -79,7 +99,7 @@ The starting value for the pagination parameter.
 
 > **type**: `"url-param"` \| `"click-next"`
 
-Defined in: [web-searcher/src/types.ts:32](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L32)
+Defined in: [web-searcher/src/types.ts:47](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L47)
 
 The type of pagination mechanism:
 - 'url-param': Pagination is handled by modifying URL parameters (e.g., `?page=2` or `?start=10`).

package/docs/interfaces/SearchContext.md

@@ -6,7 +6,7 @@
 
 # Interface: SearchContext
 
-Defined in: [web-searcher/src/types.ts:65](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L65)
+Defined in: [web-searcher/src/types.ts:91](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L91)
 
 Context object passed to the transform function.
 
@@ -16,7 +16,7 @@ Context object passed to the transform function.
 
 > `optional` **limit**: `number`
 
-Defined in: [web-searcher/src/types.ts:73](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L73)
+Defined in: [web-searcher/src/types.ts:99](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L99)
 
 The requested limit of results.
 
@@ -26,7 +26,7 @@ The requested limit of results.
 
 > **page**: `number`
 
-Defined in: [web-searcher/src/types.ts:70](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L70)
+Defined in: [web-searcher/src/types.ts:96](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L96)
 
 The current page index (0-based).
 
@@ -36,6 +36,6 @@ The current page index (0-based).
 
 > **query**: `string`
 
-Defined in: [web-searcher/src/types.ts:67](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L67)
+Defined in: [web-searcher/src/types.ts:93](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L93)
 
 The original search query.

package/docs/interfaces/SearchOptions.md

@@ -6,7 +6,7 @@
 
 # Interface: SearchOptions
 
-Defined in: [web-searcher/src/types.ts:94](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L94)
+Defined in: [web-searcher/src/types.ts:120](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L120)
 
 Options provided when executing a search.
 
@@ -22,7 +22,7 @@ Any other custom variables to be injected into the template.
 
 > `optional` **category**: [`SearchCategory`](../type-aliases/SearchCategory.md)
 
-Defined in: [web-searcher/src/types.ts:108](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L108)
+Defined in: [web-searcher/src/types.ts:144](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L144)
 
 The category of results to return.
 Default: 'all' (web search)
@@ -33,7 +33,7 @@ Default: 'all' (web search)
 
 > `optional` **language**: `string`
 
-Defined in: [web-searcher/src/types.ts:118](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L118)
+Defined in: [web-searcher/src/types.ts:154](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L154)
 
 Language code (ISO 639-1) for the interface or results (e.g., 'en', 'zh-CN').
 
@@ -43,17 +43,32 @@ Language code (ISO 639-1) for the interface or results (e.g., 'en', 'zh-CN').
 
 > `optional` **limit**: `number`
 
-Defined in: [web-searcher/src/types.ts:96](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L96)
+Defined in: [web-searcher/src/types.ts:122](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L122)
 
 The maximum number of results to retrieve.
 
 ***
 
+### maxPages?
+
+> `optional` **maxPages**: `number`
+
+Defined in: [web-searcher/src/types.ts:132](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L132)
+
+The maximum number of pages (fetch cycles) allowed to reach the requested `limit`.
+
+This is a safety guard. If the `limit` is high but each page has few results, 
+the searcher will stop once this page count is reached.
+
+If not provided, it defaults to the value in `PaginationConfig` or 10.
+
+***
+
 ### region?
 
 > `optional` **region**: `string`
 
-Defined in: [web-searcher/src/types.ts:113](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L113)
+Defined in: [web-searcher/src/types.ts:149](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L149)
 
 Region code (ISO 3166-1 alpha-2) to bias results (e.g., 'US', 'CN', 'JP').
 
@@ -63,7 +78,7 @@ Region code (ISO 3166-1 alpha-2) to bias results (e.g., 'US', 'CN', 'JP').
 
 > `optional` **safeSearch**: [`SafeSearchLevel`](../type-aliases/SafeSearchLevel.md)
 
-Defined in: [web-searcher/src/types.ts:124](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L124)
+Defined in: [web-searcher/src/types.ts:160](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L160)
 
 Safe search filtering level.
 Default: engine dependent (usually 'moderate' or 'strict' by default).
@@ -74,7 +89,7 @@ Default: engine dependent (usually 'moderate' or 'strict' by default).
 
 > `optional` **timeRange**: [`SearchTimeRange`](../type-aliases/SearchTimeRange.md)
 
-Defined in: [web-searcher/src/types.ts:102](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L102)
+Defined in: [web-searcher/src/types.ts:138](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L138)
 
 Date range for the search results.
 Default: 'all'
@@ -85,7 +100,7 @@ Default: 'all'
 
 > `optional` **transform**: (`results`, `context`) => [`StandardSearchResult`](StandardSearchResult.md)[] \| `Promise`\<[`StandardSearchResult`](StandardSearchResult.md)[]\>
 
-Defined in: [web-searcher/src/types.ts:130](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L130)
+Defined in: [web-searcher/src/types.ts:166](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L166)
 
 A custom transform function to filter or modify results at runtime.
 This runs AFTER the engine-level transform.

package/docs/interfaces/StandardSearchResult.md

@@ -6,7 +6,7 @@
 
 # Interface: StandardSearchResult
 
-Defined in: [web-searcher/src/types.ts:5](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L5)
+Defined in: [web-searcher/src/types.ts:5](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L5)
 
 Interface representing a standardized search result item.
 This ensures consistency across different search engines.
@@ -15,35 +15,85 @@ This ensures consistency across different search engines.
 
 \[`key`: `string`\]: `any`
 
-Allows for engine-specific extra fields (e.g., rank, author, date).
+Allows for engine-specific extra fields (e.g., siteIcon, category).
 
 ## Properties
 
+### author?
+
+> `optional` **author**: `string`
+
+Defined in: [web-searcher/src/types.ts:22](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L22)
+
+The author or source name of the result.
+
+***
+
+### date?
+
+> `optional` **date**: `string` \| `Date`
+
+Defined in: [web-searcher/src/types.ts:19](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L19)
+
+The date the result was published or last updated.
+
+***
+
+### favicon?
+
+> `optional` **favicon**: `string`
+
+Defined in: [web-searcher/src/types.ts:25](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L25)
+
+The favicon URL of the source website.
+
+***
+
 ### image?
 
 > `optional` **image**: `string`
 
-Defined in: [web-searcher/src/types.ts:16](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L16)
+Defined in: [web-searcher/src/types.ts:16](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L16)
 
 An optional image URL associated with the result.
 
 ***
 
+### rank?
+
+> `optional` **rank**: `number`
+
+Defined in: [web-searcher/src/types.ts:28](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L28)
+
+The rank or position of the result (usually 1-indexed).
+
+***
+
 ### snippet?
 
 > `optional` **snippet**: `string`
 
-Defined in: [web-searcher/src/types.ts:13](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L13)
+Defined in: [web-searcher/src/types.ts:13](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L13)
 
 A brief snippet or description of the result.
 
 ***
 
+### source?
+
+> `optional` **source**: `string`
+
+Defined in: [web-searcher/src/types.ts:31](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L31)
+
+The source website name (e.g., 'GitHub', 'StackOverflow').
+
+***
+
 ### title
 
 > **title**: `string`
 
-Defined in: [web-searcher/src/types.ts:7](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L7)
+Defined in: [web-searcher/src/types.ts:7](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L7)
 
 The title of the search result.
 
@@ -53,6 +103,6 @@ The title of the search result.
 
 > **url**: `string`
 
-Defined in: [web-searcher/src/types.ts:10](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L10)
+Defined in: [web-searcher/src/types.ts:10](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L10)
 
 The URL of the search result.

package/docs/type-aliases/SafeSearchLevel.md

@@ -8,4 +8,4 @@
 
 > **SafeSearchLevel** = `"off"` \| `"moderate"` \| `"strict"`
 
-Defined in: [web-searcher/src/types.ts:89](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L89)
+Defined in: [web-searcher/src/types.ts:115](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L115)

package/docs/type-aliases/SearchCategory.md

@@ -8,4 +8,4 @@
 
 > **SearchCategory** = `"all"` \| `"images"` \| `"videos"` \| `"news"`
 
-Defined in: [web-searcher/src/types.ts:87](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L87)
+Defined in: [web-searcher/src/types.ts:113](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L113)

package/docs/type-aliases/SearchTimeRange.md

@@ -8,4 +8,4 @@
 
 > **SearchTimeRange** = [`SearchTimeRangePreset`](SearchTimeRangePreset.md) \| [`CustomTimeRange`](../interfaces/CustomTimeRange.md)
 
-Defined in: [web-searcher/src/types.ts:85](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L85)
+Defined in: [web-searcher/src/types.ts:111](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L111)

package/docs/type-aliases/SearchTimeRangePreset.md

@@ -8,4 +8,4 @@
 
 > **SearchTimeRangePreset** = `"all"` \| `"day"` \| `"week"` \| `"month"` \| `"year"`
 
-Defined in: [web-searcher/src/types.ts:76](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/types.ts#L76)
+Defined in: [web-searcher/src/types.ts:102](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/types.ts#L102)

package/docs/type-aliases/SearcherConstructor.md

@@ -8,7 +8,7 @@
 
 > **SearcherConstructor** = (`options?`) => [`WebSearcher`](../classes/WebSearcher.md)
 
-Defined in: [web-searcher/src/searcher.ts:10](https://github.com/isdk/web-searcher.js/blob/e9a6e5ec9526780489427743389b927a5c16db5c/src/searcher.ts#L10)
+Defined in: [web-searcher/src/searcher.ts:10](https://github.com/isdk/web-searcher.js/blob/e17f1bcb40984e389c2901da9e3b4886a969899a/src/searcher.ts#L10)
 
 Constructor definition for Searcher subclasses.
 

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@isdk/web-searcher",
-  "version": "0.1.1",
+  "version": "0.1.3",
   "description": "A high-level framework for building search engine scrapers, supporting multi-page navigation, session persistence, and result standardization.",
   "license": "MIT",
   "author": "Riceball LEE <snowyu.lee@gmail.com>",
@@ -54,11 +54,17 @@
   ],
   "keywords": [
     "web",
-    "fetch",
+    "search",
+    "searcher",
+    "scraper",
     "crawler",
     "spider",
-    "structure",
-    "data"
+    "google",
+    "automation",
+    "headless",
+    "pagination",
+    "data-mining",
+    "fetcher"
   ],
   "maintainers": [
     "Riceball LEE <snowyu.lee@gmail.com>"
@@ -66,6 +72,12 @@
   "engines": {
     "node": ">=20.11.1"
   },
+  "bugs": {
+    "url": "https://github.com/isdk/web-searcher.js/issues"
+  },
+  "publishConfig": {
+    "access": "public"
+  },
   "types": "./dist/index.d.ts",
   "scripts": {
     "build-fast": "tsup",