dsh-scrape 0.0.0-stage → 0.0.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +20 -2
- package/package.json +24 -4
package/README.md
CHANGED
|
@@ -1,3 +1,21 @@
|
|
|
1
|
-
#
|
|
1
|
+
# dsh-scrape · 抓取与清洗
|
|
2
2
|
|
|
3
|
-
|
|
3
|
+
> **定义**:把网页、RSS、仓库抓成干净的 Markdown/文本,带站点规则、重试与 JS 页面兜底,让 agent 引用的内容确实来自它抓到的东西。
|
|
4
|
+
>
|
|
5
|
+
> **English**: Turn any page, feed or repo into clean Markdown/text with per-site rules, retries and JS-page fallbacks, so an agent can cite what it actually fetched.
|
|
6
|
+
|
|
7
|
+
状态:**0.0.1 名称占位**(name reservation)。实现中;能力说明即本包目标范围,完成前请勿依赖。
|
|
8
|
+
|
|
9
|
+
## 它补上 DSH 的哪一块
|
|
10
|
+
|
|
11
|
+
把网页、RSS、仓库抓成干净的 Markdown/文本,带站点规则、重试与 JS 页面兜底,让 agent 引用的内容确实来自它抓到的东西。
|
|
12
|
+
|
|
13
|
+
## 安装(可用版本发布后)
|
|
14
|
+
|
|
15
|
+
```sh
|
|
16
|
+
dsh plugin --profile desktop add dsh-scrape
|
|
17
|
+
```
|
|
18
|
+
|
|
19
|
+
## 许可
|
|
20
|
+
|
|
21
|
+
MIT
|
package/package.json
CHANGED
|
@@ -1,6 +1,26 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "dsh-scrape",
|
|
3
|
-
"version": "0.0.
|
|
4
|
-
"
|
|
5
|
-
"
|
|
6
|
-
|
|
3
|
+
"version": "0.0.1",
|
|
4
|
+
"description": "Turn any page, feed or repo into clean Markdown/text with per-site rules, retries and JS-page fallbacks, so an agent can cite what it actually fetched. | 把网页、RSS、仓库抓成干净的 Markdown/文本,带站点规则、重试与 JS 页面兜底,让 agent 引用的内容确实来自它抓到的东西。",
|
|
5
|
+
"keywords": [
|
|
6
|
+
"dsh",
|
|
7
|
+
"dsh-plugin",
|
|
8
|
+
"deepseek-harness",
|
|
9
|
+
"scrape",
|
|
10
|
+
"crawl",
|
|
11
|
+
"fetch",
|
|
12
|
+
"markdown",
|
|
13
|
+
"browser",
|
|
14
|
+
"geo",
|
|
15
|
+
"抓取",
|
|
16
|
+
"爬虫"
|
|
17
|
+
],
|
|
18
|
+
"license": "MIT",
|
|
19
|
+
"type": "module",
|
|
20
|
+
"files": [
|
|
21
|
+
"README.md"
|
|
22
|
+
],
|
|
23
|
+
"engines": {
|
|
24
|
+
"node": ">=22"
|
|
25
|
+
}
|
|
26
|
+
}
|