robots 0.7.3 → 0.8.0

Sign up to get free protection for your applications and to get access to all the features.
data/CHANGELOG CHANGED
@@ -1,5 +1,7 @@
1
+ 0.8.0
2
+ - Add multiple values from robots.txt (via joost)
1
3
  0.7.3
2
- - Move to jeweler
4
+ - Move to jeweler, gemcutter
3
5
  0.7.2
4
6
  - Add Ruby 1.9 compatibility
5
7
  0.5-0.7.1
data/README CHANGED
@@ -9,7 +9,7 @@ Usage:
9
9
 
10
10
  If you want caching, you're on your own. I suggest marshalling an instance of the parser.
11
11
 
12
- Copyright (c) 2008 Kyle Maxwell
12
+ Copyright (c) 2008 Kyle Maxwell, contributors
13
13
 
14
14
  Permission is hereby granted, free of charge, to any person
15
15
  obtaining a copy of this software and associated documentation
data/VERSION CHANGED
@@ -1 +1 @@
1
- 0.7.3
1
+ 0.8.0
@@ -49,7 +49,8 @@ class Robots
49
49
  when "Crawl-delay"
50
50
  @delays[agent] = value.to_i
51
51
  else
52
- @other[key] = value
52
+ @other[key] ||= []
53
+ @other[key] << value
53
54
  end
54
55
  end
55
56
 
@@ -1,15 +1,15 @@
1
1
  # Generated by jeweler
2
- # DO NOT EDIT THIS FILE
3
- # Instead, edit Jeweler::Tasks in Rakefile, and run `rake gemspec`
2
+ # DO NOT EDIT THIS FILE DIRECTLY
3
+ # Instead, edit Jeweler::Tasks in Rakefile, and run the gemspec command
4
4
  # -*- encoding: utf-8 -*-
5
5
 
6
6
  Gem::Specification.new do |s|
7
7
  s.name = %q{robots}
8
- s.version = "0.7.3"
8
+ s.version = "0.8.0"
9
9
 
10
10
  s.required_rubygems_version = Gem::Requirement.new(">= 0") if s.respond_to? :required_rubygems_version=
11
11
  s.authors = ["Kyle Maxwell"]
12
- s.date = %q{2009-10-18}
12
+ s.date = %q{2010-02-08}
13
13
  s.description = %q{It parses robots.txt files}
14
14
  s.email = %q{kyle@kylemaxwell.com}
15
15
  s.extra_rdoc_files = [
@@ -29,7 +29,7 @@ Gem::Specification.new do |s|
29
29
  s.homepage = %q{http://github.com/fizx/robots}
30
30
  s.rdoc_options = ["--charset=UTF-8"]
31
31
  s.require_paths = ["lib"]
32
- s.rubygems_version = %q{1.3.4}
32
+ s.rubygems_version = %q{1.3.5}
33
33
  s.summary = %q{Simple robots.txt parser}
34
34
  s.test_files = [
35
35
  "test/test_robots.rb"
@@ -48,3 +48,4 @@ Gem::Specification.new do |s|
48
48
  s.add_dependency(%q<thoughtbot-shoulda>, [">= 0"])
49
49
  end
50
50
  end
51
+
@@ -39,7 +39,7 @@ class TestRobots < Test::Unit::TestCase
39
39
  end
40
40
 
41
41
  def test_other_values
42
- sitemap = {"Sitemap" => "http://www.eventbrite.com/sitemap_index.xml"}
42
+ sitemap = {"Sitemap" => ["http://www.eventbrite.com/sitemap_index.xml", "http://www.eventbrite.com/sitemap_index.xml"]}
43
43
  assert_equal(sitemap, @robots.other_values("http://eventbrite.com"))
44
44
  end
45
45
  end
metadata CHANGED
@@ -1,7 +1,7 @@
1
1
  --- !ruby/object:Gem::Specification
2
2
  name: robots
3
3
  version: !ruby/object:Gem::Version
4
- version: 0.7.3
4
+ version: 0.8.0
5
5
  platform: ruby
6
6
  authors:
7
7
  - Kyle Maxwell
@@ -9,7 +9,7 @@ autorequire:
9
9
  bindir: bin
10
10
  cert_chain: []
11
11
 
12
- date: 2009-10-18 00:00:00 -07:00
12
+ date: 2010-02-08 00:00:00 -08:00
13
13
  default_executable:
14
14
  dependencies:
15
15
  - !ruby/object:Gem::Dependency
@@ -64,7 +64,7 @@ required_rubygems_version: !ruby/object:Gem::Requirement
64
64
  requirements: []
65
65
 
66
66
  rubyforge_project:
67
- rubygems_version: 1.3.4
67
+ rubygems_version: 1.3.5
68
68
  signing_key:
69
69
  specification_version: 3
70
70
  summary: Simple robots.txt parser