colinramsay-robotstxt 1.0.2 → 1.0.3

Sign up to get free protection for your applications and to get access to all the features.
Files changed (2) hide show
  1. data/lib/robotstxtparser.rb +1 -0
  2. metadata +1 -1
@@ -12,6 +12,7 @@ class RobotsTxtParser
12
12
  raw_data = File.open(path)
13
13
  end
14
14
  rescue
15
+ raw_data = nil
15
16
  end
16
17
 
17
18
  @user_agents = Hash.new
metadata CHANGED
@@ -1,7 +1,7 @@
1
1
  --- !ruby/object:Gem::Specification
2
2
  name: colinramsay-robotstxt
3
3
  version: !ruby/object:Gem::Version
4
- version: 1.0.2
4
+ version: 1.0.3
5
5
  platform: ruby
6
6
  authors:
7
7
  - Colin Ramsay