arachnid 0.1.0 → 0.1.1
Sign up to get free protection for your applications and to get access to all the features.
metadata
CHANGED
|
@@ -2,7 +2,7 @@
|
|
|
2
2
|
name: arachnid
|
|
3
3
|
version: !ruby/object:Gem::Version
|
|
4
4
|
prerelease:
|
|
5
|
-
version: 0.1.
|
|
5
|
+
version: 0.1.1
|
|
6
6
|
platform: ruby
|
|
7
7
|
authors:
|
|
8
8
|
- dchuk
|
|
@@ -57,7 +57,7 @@ dependencies:
|
|
|
57
57
|
version: 0.0.10
|
|
58
58
|
type: :runtime
|
|
59
59
|
version_requirements: *id004
|
|
60
|
-
description: Arachnid relies on Bloom Filters to efficiently store visited urls and Typhoeus to avoid the overhead of Mechanize when crawling.
|
|
60
|
+
description: Arachnid is a web crawler that relies on Bloom Filters to efficiently store visited urls and Typhoeus to avoid the overhead of Mechanize when crawling every page on a domain.
|
|
61
61
|
email: me@dchuk.com
|
|
62
62
|
executables: []
|
|
63
63
|
|