omni_scrape 0.1.5 → 0.1.5.2

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (4) hide show
  1. checksums.yaml +8 -8
  2. data/README.md +13 -5
  3. data/lib/omni_scrape/version.rb +1 -1
  4. metadata +1 -1
checksums.yaml CHANGED
@@ -1,15 +1,15 @@
1
1
  ---
2
2
  !binary "U0hBMQ==":
3
3
  metadata.gz: !binary |-
4
- Zjc4YzI5MjUzNWI1MWUzZGQwMzc1YWI1NmQwN2I1YjIyZmVkY2QwZA==
4
+ NjQ5ZDBiODVkN2RkZDM0MWE1ZGQ2MGE1MmQ5ZTJlZDJjNjE2NWE3Yw==
5
5
  data.tar.gz: !binary |-
6
- YjdjZTY3MGVjMjY5ZmUzZjc0MDM2YjRlMzliNzUwODczMzdjMWIzYQ==
6
+ MmI4MmQ0M2QwYWY1OTUwOWE0ZGY5MzQzYzRjZTk3MTdlMjVjOGE4MQ==
7
7
  SHA512:
8
8
  metadata.gz: !binary |-
9
- MDA3ZmY2MTljMDVkNDQ1YTBhOTUxZTc3ZDM1NWI1OTA3OTZjNjUzNDRiNGI0
10
- OTE5MWExNzgyYzYxOTQ3ZWViYmQzNTdhM2JlNDlkOTgwNTkzYmIwODdmZDMy
11
- NzdmZGU3MGVjNDlmZDJmODg2MTJkZjRjOGRhZjdiNGMxODNhMGU=
9
+ YzViNThmMjk3OWQ2NTUzMDNiNWYwNTM5ZTMyZDk5MDM0M2EyZGI1NzY3MjA5
10
+ Y2QwYTM5MDgyNDVlNGU5MjFlMjBjYzMwYjU3MDM0NjM3NDhjZWViNjRlMDFl
11
+ MTRhODc1NjA5Yzc1MjQ0YmE2NDIyNDc4MTFiOTI2ODQ5Y2IxNDY=
12
12
  data.tar.gz: !binary |-
13
- NDgwOWRmM2JkNmZkYmNkZDQxNDhlNzJmYmI4ZGQxM2RiMzhmNGJiZTEzYjZl
14
- OTQ5YTdkYTEwNzJmMWIyZjQxZDY0ODVkODEwZDk0M2M0Y2NiZjM2MWU0YTVi
15
- NjhlYTk0ZmZjMmI1NjMxOTM2OTg2M2Y1OTE1YmQxZGYxZjg0Mzg=
13
+ NjAzM2Q0NmY5ZTYyZGU2ZDRiNjNlNDM3ZDNjYjM0MGMzMTVmZGFjYTllM2Q4
14
+ MDZhOGMzMjJmNTQ3YWJjNDg5MjkzOTQ4OTc3MTE0OGRlOWMxNmU2NzllMzAw
15
+ ZjU2YjMxYWY4NjBlOThiYmRmODQ2ZWM0M2E3YzVhZGQ2NjEzMDY=
data/README.md CHANGED
@@ -1,12 +1,10 @@
1
1
  # OmniScrape
2
2
 
3
- Welcome to your new gem! In this directory, you'll find the files you need to be able to package up your Ruby library into a gem. Put your Ruby code in the file `lib/omni_scrape`. To experiment with that code, run `bin/console` for an interactive prompt.
4
-
5
- TODO: Delete this and the text above, and describe your gem
3
+ This gem is an all-purpose web crawler and scraper in the works.
6
4
 
7
5
  ## Installation
8
6
 
9
- Add this line to your application's Gemfile:
7
+ Add these lines to your application's Gemfile:
10
8
 
11
9
  ```ruby
12
10
  gem 'omni_scrape'
@@ -21,8 +19,18 @@ Or install it yourself as:
21
19
  $ gem install omni_scrape
22
20
 
23
21
  ## Usage
22
+ Add the lines : require 'omni_scrape' and include OmniScrape to your script file.
23
+ Method : CrawlScrape
24
+ example : OmniScrape.CrawlScrape("http://en.wikipedia.org/wiki/List_of_massively_multiplayer_online_role-playing_games", 0, "http://en.wikipedia.org")
25
+
26
+ This method takes three parameters the first should be the url to start at.
27
+
28
+ The second parameter is currently unimplemented but will be the depth to crawl. (just pass it 0)
29
+
30
+ The third is a sub-url for internal links.
31
+
24
32
 
25
- TODO: Write usage instructions here
33
+ description: CrawlScrape will follow every link from the page provided and scrape the html from those pages, storing it as html files where the script is located.
26
34
 
27
35
  ## Development
28
36
 
@@ -1,3 +1,3 @@
1
1
  module OmniScrape
2
- VERSION = "0.1.5"
2
+ VERSION = "0.1.5.2"
3
3
  end
metadata CHANGED
@@ -1,7 +1,7 @@
1
1
  --- !ruby/object:Gem::Specification
2
2
  name: omni_scrape
3
3
  version: !ruby/object:Gem::Version
4
- version: 0.1.5
4
+ version: 0.1.5.2
5
5
  platform: ruby
6
6
  authors:
7
7
  - Bradley Maynard