rubyretriever 0.0.12 → 0.0.13
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- checksums.yaml +4 -4
- data/lib/retriever/version.rb +1 -1
- data/readme.md +3 -3
- metadata +1 -1
checksums.yaml
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
---
|
|
2
2
|
SHA1:
|
|
3
|
-
metadata.gz:
|
|
4
|
-
data.tar.gz:
|
|
3
|
+
metadata.gz: 9741c673d910c34e27092d8bc76d42a945979425
|
|
4
|
+
data.tar.gz: 4478c442e1523de1864519c67c7d0f9fd6c43d9f
|
|
5
5
|
SHA512:
|
|
6
|
-
metadata.gz:
|
|
7
|
-
data.tar.gz:
|
|
6
|
+
metadata.gz: ec5ecde4d038a130cc50a705b41b3c8595156bd7706d3170be7055baf6cc63d1b864ebe41de36dab61c69b1edf13a1a4ab8577a9dcf558d9ff804f2bfd4e860a
|
|
7
|
+
data.tar.gz: 0a22053d24a799a4273614ee1cae7522bda3771fa39f1a8c37ba6959e907f6a4b30bb9f8d85b8b0f4c9bdfac34c82f0b2ba7ae8d73017639d7783c841d8d2841
|
data/lib/retriever/version.rb
CHANGED
data/readme.md
CHANGED
|
@@ -19,14 +19,14 @@ gem install rubyretriever
|
|
|
19
19
|
|
|
20
20
|
**Example: Sitemap mode**
|
|
21
21
|
```sh
|
|
22
|
-
rr --sitemap --progress --limit
|
|
22
|
+
rr --sitemap --progress --limit 100 --output cnet http://www.cnet.com
|
|
23
23
|
```
|
|
24
24
|
OR -- SAME COMMAND
|
|
25
25
|
```sh
|
|
26
|
-
rr -s -p -l
|
|
26
|
+
rr -s -p -l 100 -o cnet http://www.cnet.com
|
|
27
27
|
```
|
|
28
28
|
|
|
29
|
-
This would go to http://www.cnet.com and map it until it crawled a max of
|
|
29
|
+
This would go to http://www.cnet.com and map it until it crawled a max of 100 pages, and then it would write it out to a csv named cnet.
|
|
30
30
|
|
|
31
31
|
**Example: File Harvesting mode**
|
|
32
32
|
```sh
|