rubyretriever 0.0.12 → 0.0.13
Sign up to get free protection for your applications and to get access to all the features.
- checksums.yaml +4 -4
- data/lib/retriever/version.rb +1 -1
- data/readme.md +3 -3
- metadata +1 -1
checksums.yaml
CHANGED
@@ -1,7 +1,7 @@
|
|
1
1
|
---
|
2
2
|
SHA1:
|
3
|
-
metadata.gz:
|
4
|
-
data.tar.gz:
|
3
|
+
metadata.gz: 9741c673d910c34e27092d8bc76d42a945979425
|
4
|
+
data.tar.gz: 4478c442e1523de1864519c67c7d0f9fd6c43d9f
|
5
5
|
SHA512:
|
6
|
-
metadata.gz:
|
7
|
-
data.tar.gz:
|
6
|
+
metadata.gz: ec5ecde4d038a130cc50a705b41b3c8595156bd7706d3170be7055baf6cc63d1b864ebe41de36dab61c69b1edf13a1a4ab8577a9dcf558d9ff804f2bfd4e860a
|
7
|
+
data.tar.gz: 0a22053d24a799a4273614ee1cae7522bda3771fa39f1a8c37ba6959e907f6a4b30bb9f8d85b8b0f4c9bdfac34c82f0b2ba7ae8d73017639d7783c841d8d2841
|
data/lib/retriever/version.rb
CHANGED
data/readme.md
CHANGED
@@ -19,14 +19,14 @@ gem install rubyretriever
|
|
19
19
|
|
20
20
|
**Example: Sitemap mode**
|
21
21
|
```sh
|
22
|
-
rr --sitemap --progress --limit
|
22
|
+
rr --sitemap --progress --limit 100 --output cnet http://www.cnet.com
|
23
23
|
```
|
24
24
|
OR -- SAME COMMAND
|
25
25
|
```sh
|
26
|
-
rr -s -p -l
|
26
|
+
rr -s -p -l 100 -o cnet http://www.cnet.com
|
27
27
|
```
|
28
28
|
|
29
|
-
This would go to http://www.cnet.com and map it until it crawled a max of
|
29
|
+
This would go to http://www.cnet.com and map it until it crawled a max of 100 pages, and then it would write it out to a csv named cnet.
|
30
30
|
|
31
31
|
**Example: File Harvesting mode**
|
32
32
|
```sh
|