venus-pit 1.1.7 → 2.0.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +26 -5
- package/TODO.md +1 -2
- package/dist/venus.bundle.js +28 -35
- package/dist/venus.bundle.js.map +1 -1
- package/docs/overview.md +4 -2
- package/docs/src/lib/tarpit/corpora.js.md +3 -0
- package/docs/src/lib/tarpit/markov.js.md +5 -0
- package/docs/{tar.md → src/lib/tarpit/tar.js.md} +5 -0
- package/docs/src/lib/tarpit/word2vec/graph.js.md +2 -0
- package/docs/src/lib/tarpit/word2vec/train.js.md +6 -0
- package/docs/src/lib/tarpit/words/randomWord.js.md +1 -0
- package/docs/src/lib/venusRoot.js.md +1 -0
- package/docs/src/venus.js.md +7 -0
- package/package.json +2 -3
- package/src/lib/tarpit/corpora.js +0 -10
- package/src/lib/tarpit/markov.js +78 -18
- package/src/lib/tarpit/tar.js +45 -31
- package/src/lib/tarpit/word2vec/graph.js +43 -0
- package/src/lib/tarpit/word2vec/train.js +93 -0
- package/src/lib/tarpit/words/randomWord.js +9 -4
- package/src/lib/venusRoot.js +8 -15
- package/src/venus.js +28 -16
- package/testing/index.js +3 -7
- package/testing/venus.js +28 -35
- package/src/lib/tarpit/pit.js +0 -68
- package/unit_tests/main.js +0 -20
- package/unit_tests/randomWord.test.js +0 -10
- package/unit_tests/tar.test.js +0 -24
- package/unit_tests/venusRoot.test.js +0 -13
package/README.md
CHANGED
|
@@ -1,16 +1,37 @@
|
|
|
1
|
+
# Venus
|
|
2
|
+
Venus is a low-overhead, easy to implement tarpit designed to protect against all crawlers, most notably AI ones. <br>
|
|
3
|
+
To have decent SEO and use venus at the same time, blacklist the venus prefix on robots.txt
|
|
4
|
+
|
|
1
5
|
# Installation
|
|
2
6
|
<p>From NPM</p>
|
|
3
7
|
<code>npm i venus-pit</code>
|
|
4
8
|
<br><br>
|
|
5
9
|
<p>From source</p>
|
|
6
|
-
<code>git clone https://github.com/
|
|
10
|
+
<code>git clone https://github.com/librenetwork-dev/Venus.git && cd Venus && npm i && npm run build</code>
|
|
7
11
|
<br>
|
|
8
12
|
<br>
|
|
9
13
|
|
|
10
|
-
# Usage
|
|
11
|
-
|
|
12
|
-
|
|
14
|
+
# Usage
|
|
15
|
+
By default, venus is set up to be ran directly inside of an express app. <br>
|
|
16
|
+
If you do not want to use express or do not want to use node.js, set up an ngnix proxy to serve Venus from the prefix. <br>
|
|
17
|
+
In order for venus to work properly, you must link the prefix somewhere on your site.
|
|
18
|
+
## With express.js
|
|
19
|
+
```js
|
|
20
|
+
import Venus from "./venus.js"
|
|
21
|
+
import express from 'express'
|
|
22
|
+
|
|
23
|
+
const app = express()
|
|
24
|
+
const venus = new Venus("/prefix/")
|
|
25
|
+
app.use(venus.prefix, venus.route())
|
|
26
|
+
|
|
27
|
+
app.listen(8080, () => {
|
|
28
|
+
console.log("Listening on port 8080")
|
|
29
|
+
})
|
|
30
|
+
```
|
|
13
31
|
# Building
|
|
14
32
|
<code>npm run build</code>
|
|
15
33
|
|
|
16
|
-
See /docs/
|
|
34
|
+
See /docs/ for a more in depth documentation
|
|
35
|
+
|
|
36
|
+
# Join Libre Network
|
|
37
|
+
https://discord.gg/CZ5EAaD8VD
|
package/TODO.md
CHANGED