gkellogg-reddy 0.2.1

data/.autotest

@@ -0,0 +1,2 @@
+require 'autotest/growl'
+require 'autotest/redgreen'

data/.gitignore

@@ -0,0 +1,9 @@
+.DS_Store
+.dotest/*
+.yardoc
+coverage/*
+doc/*
+rdoc/*
+rena_new_spec.html
+rena-*.gem
+/*.gemspec

data/.gitmodules

@@ -0,0 +1,3 @@
+[submodule "spec/rdfa-test-suite"]
+	path = spec/rdfa-test-suite
+	url = git://github.com/msporny/rdfa-test-suite.git

data/History.txt

@@ -0,0 +1,66 @@
+=== 0.2.1
+* Added MemoryStore, a context-aware store based on Python RDFLib IOMemory
+* Add ConjunctiveGraph, a conjunction of all graphs in a context-aware store
+* Triple(nil, nil, nil) is wildcard, plus variations. No support for regular expressions.
+* BNodes not graph/store specific, generated using milli-second time and sequence.
+* Graph(:store) may be one of :list_store or :memory_store, which will instanciate appropriate store
+* Graph#contains? iterates over triples if object is a literal to allow for fuzzy matching.
+* Change gem name to "gkellogg-reddy" to allow publishing to Github.
+* ConjunctiveGraph tests.
+
+=== 0.2.0
+* API and RDoc cleanup
+* Removed Graph#each_with_subject, Graph#get_resource, Graph#has_bnode_identifier?
+* Added Graph#predicates and Graph#objects
+* Changed Graph#triples to take optional subject predicate and object to match statements.
+* Renamed Graph#bind o Graph#merge!
+* Graph#triples yields triples if a block is provided
+* Changed Namespace#short to Namespace#prefix
+* Change BNode to require a graph. Most uses go from graph.bnode, rather than BNode.new. This is required because bnodes are only equivalent within the same graph
+* Added identifier to Graph, defaults to BNode. This from Python RDFlib based on TriX recommendation, see: http://www.w3.org/2004/03/trix/
+* Only add triple to graph if it does not already exist in graph.
+* Added Graph#contains? to look for existance of triple.
+* Added Graph#eql? (and ===) to do simple check for graph equality. This version ignores BNodes (like Python RDFlib)
+* Prepend "named" to named BNodes to ensure no overlap between generated and named BNodes.
+* Added Graph#clone and Triple#clone
+* Merge Graphs, replacing BNodes with new values from new graph.
+* Remove duplicate triples when adding or merging graphs
+* Added Abstract Store and List Store.
+* Delegate Graph methods to store. Currently only supports :list.
+* Reduce dependence on HTML namespace in RDFa parser.
+* Add RDFa tests for HTML4 and HTML5
+
+=== 0.1.5
+* Update RDFa tests to use Reddy RDF/XML parser.
+* All negative RDF/XML parser tests pass.
+* Add Reddy::Parser, super-class of other parsers and move common code.
+* Change N3Parser to use same new/parse logic as other parsers.
+* Remove debug array by default, and add in calls to tests.
+=== 0.1.4
+* Update N3 treetop parser to version 1.4.0 (no digits in parser rule names).
+* Fix N3 literal handling (still has bug with escaped double quote).
+* Handle N3 <#> prefix.
+* Don't output lang for typed literals in n3 format
+* Rewrite of RDF/XML parser based on spec; passes existing tests.
+* Update rdfcore tests based on rdfa test harness.
+* Move Literal string escape/unescape to string_hacks.
+* Fix literal n3_encoded parsing.
+* All positive RDF/XML parser tests pass.
+
+=== 0.1.3
+* Added rdfa-test-suite as sub-module and refactored RDFa tests to use them.
+* Fix but in white-space separated attributes
+* Downcase XHTML reserved words
+
+=== 0.1.2
+* Move most test-case logic into rdfa_helper.
+* Separate approved and unreviewed tests.
+* Allow for soft failure of unreviewed tests by catching Spec::Expectations::ExpectationNotMetError.
+* Integrate rdfa-test-suite and create test cases in the same manner. (Causing SPARQL problems with XMLLiterals)
+
+=== 0.1.1 / 2009-11-01
+* Changes from rdfa_parser project.
+
+=== 0.1.0 / 2008-12-02
+
+* First public alpha. RDF/XML parsing works but is not fully spec or test compliant. There is much work to be done.

data/README.rdoc

@@ -0,0 +1,107 @@
+= reddy
+
+A set of compliant RDF parsers:
+* N3-rdf
+* RDF/XML
+* RDFa
+
+== DESCRIPTION:
+
+Reddy is an RDF library for Ruby.
+
+== FEATURES:
+Reddy parses RDF/XML, RDFa and N3-rdf into a Graph object. It also serializes RDF/XML and N-Triples from the Graph.
+
+* Fully compliant RDF/XML parser.
+* Fully compliant XHTML/RDFa 1.0 parser.
+* N3-rdf parser
+* N-Triples and RDF/XML serializer
+* RDFa tests use SPARQL for most tests due to Rasqal limitations. Other tests compare directly against N-triples.
+* Graph serializes into RDF/XML and N-Triples.
+* ConjunctiveGraph, named Graphs and contextual storage modules.
+
+Install with 'gem install gkellogg-reddy'
+
+== SYNOPSIS:
+
+A simple RDF library for Ruby has been necessary for some time.
+
+Basic usage:
+
+  require 'reddy'
+  parser = Reddy::RdfXmlParser.new
+  parser.parse(stream, base_uri) do |triple|
+    puts triple.to_ntriple
+  end
+
+or
+
+  graph = parser.parse(stream, base_uri)
+  graph.to_rdfxml
+
+== REQUIREMENTS:
+
+* Addressable
+* Treetop
+* Whatlanguage
+* nokogiri
+* facets
+
+=== For testing
+* Redland/Rasqal
+
+== INSTALL:
+
+* (sudo gem install reddy)
+
+== TODO:
+* Testing
+  * Integrate ntriples tests in spec/ntriples/test.nt
+  * Turtle tests from http://www.w3.org/2000/10/swap/test/n3/turtle-manifest.n3 (if can find .ttl and .out files)
+  * N3-RDF tests from http://www.w3.org/2000/10/swap/test/n3/n3-rdf.tests
+  * N3-Full tests from http://www.w3.org/2000/10/swap/test/n3/n3-full.tests
+  * N3 grammar tests?
+  * RDFa updates for new tests and non XHTML representations.
+* Graphs
+  * Pluggable storage modules
+  * Contexts
+  * n3 serialization
+  * Graph operations from Redland
+* SPARQL
+* RDFS logic and RDF entailment tests
+* Ruby objects
+  * ActiveRDF-like class support
+  * Integrate with RDFObjects (http://github.com/rsinger/RDFObjects)
+
+== LICENSE:
+
+(The MIT License)
+
+Copyright (c) 2008 Tom Morris and contributors
+Copyright (c) 2009 Gregg Kellogg
+
+Permission is hereby granted, free of charge, to any person obtaining
+a copy of this software and associated documentation files (the
+'Software'), to deal in the Software without restriction, including
+without limitation the rights to use, copy, modify, merge, publish,
+distribute, sublicense, and/or sell copies of the Software, and to
+permit persons to whom the Software is furnished to do so, subject to
+the following conditions:
+
+The above copyright notice and this permission notice shall be
+included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED 'AS IS', WITHOUT WARRANTY OF ANY KIND,
+EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT.
+IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY
+CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT,
+TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE
+SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
+
+== FEEDBACK
+
+* tom@tommorris.org or gregg@kellogg-assoc.com
+* github.com/tommorris/reddy or github.com/gkellogg/reddy
+* tommorris.lighthouseapp.com for bug reports
+* public-rdf-ruby mailing list on w3.org

data/Rakefile

@@ -0,0 +1,96 @@
+require 'rubygems'
+begin
+  gem 'jeweler'
+  require 'jeweler'
+  Jeweler::Tasks.new do |gemspec|
+    gemspec.name = "gkellogg-reddy"
+    gemspec.summary = "Reddy is an RDF library for Ruby."
+    gemspec.description = <<-DESCRIPTION
+    Reddy parses RDF/XML, RDFa and N3-rdf into a Graph object. It also serializes RDF/XML and N-Triples from the Graph.
+
+      * Fully compliant RDF/XML parser.
+      * Fully compliant XHTML/RDFa 1.0 parser.
+      * N3-rdf parser
+      * N-Triples and RDF/XML serializer
+      * Graph serializes into RDF/XML and N-Triples.
+      * ConjunctiveGraph, named Graphs and contextual storage modules.
+    
+    Install with 'gem install gkellogg-reddy'
+    DESCRIPTION
+    gemspec.email = "gregg@kellogg-assoc.com"
+    gemspec.homepage = "http://github.com/gkellogg/reddy"
+    gemspec.authors = ["Gregg Kellogg", "Tom Morris"]
+    gemspec.add_dependency('addressable', '>= 2.0.0')
+    gemspec.add_dependency('treetop',  '>= 1.4.0')
+    gemspec.add_dependency('libxml-ruby',  '>= 0.8.3')
+    gemspec.add_dependency('whatlanguage', '>= 1.0.0')
+    gemspec.add_dependency('nokogiri', '>= 1.3.3')
+    gemspec.add_dependency('builder', '>= 2.1.2')
+    gemspec.add_development_dependency('rspec')
+    gemspec.add_development_dependency('active_support', '>= 2.3.0')
+    gemspec.extra_rdoc_files     = %w(README.rdoc History.txt)
+  end
+  Jeweler::GemcutterTasks.new
+rescue LoadError
+  puts "Jeweler not available. Install it with: sudo gem install technicalpickles-jeweler -s http://gems.github.com"
+end
+
+# TODO - want other tests/tasks run by default? Add them to the list
+#task :default => [:spec, :features]
+
+desc "Pushes to git"
+task :push do
+  sh "git push --all"
+  sh "growlnotify -m \"Updates pushed\" \"Git\""
+end
+
+require 'spec/rake/spectask'
+Spec::Rake::SpecTask.new(:spec) do |spec|
+  spec.libs << 'lib' << 'spec'
+  spec.spec_files = FileList['spec/**/*_spec.rb']
+end
+
+desc "Turns spec results into HTML and publish to web (Tom only!)"
+task :spec_html do
+  sh "spec --format html:reddy_new_spec.html spec"
+  sh "scp reddy_new_spec.html bbcityco@bbcity.co.uk:www/tom/files/rena_new_spec.html"
+  sh "rm reddy_new_spec.html"
+end
+
+desc "Turns spec results into local HTML"
+task :spec_local do
+  sh "spec --format html:reddy_new_spec.html spec/"
+#  sh "open reddy_new_spec.html"
+end
+
+desc "Run specs through RCov"
+Spec::Rake::SpecTask.new(:rcov) do |spec|
+  spec.libs << 'lib' << 'spec'
+  spec.pattern = 'spec/**/*_spec.rb'
+  spec.rcov = true
+end
+
+desc "Runs specs on JRuby"
+task :jspec do
+  sh "jruby -S `whereis spec` --colour spec"
+end
+
+task :spec => :check_dependencies
+
+task :default => :spec
+
+require 'rake/rdoctask'
+Rake::RDocTask.new do |rdoc|
+  if File.exist?('VERSION')
+    version = File.read('VERSION')
+  else
+    version = RdfaParser::VERSION
+  end
+
+  rdoc.rdoc_dir = 'rdoc'
+  rdoc.title = "rdfa_parser #{version}"
+  rdoc.rdoc_files.include('README*', "History.txt")
+  rdoc.rdoc_files.include('lib/**/*.rb')
+end
+
+# vim: syntax=Ruby

data/VERSION

@@ -0,0 +1 @@
+0.2.1

data/bin/reddy

@@ -0,0 +1,59 @@
+#!/usr/bin/env ruby -s
+require 'rubygems'
+require File.expand_path(File.dirname(__FILE__) + "/../lib/reddy")
+require 'getoptlong'
+class Parse
+  include Reddy
+  def parse(file, base_uri)
+    puts "Parse: #{file}" if $quiet
+    parser = case file
+    when /\.nt$/ then N3Parser.new
+    when /\.x?html/ then RdfaParser.new
+    else RdfXmlParser.new
+    end
+    parser.parse(File.read(file), base_uri, :strict => true)
+    output = case $format
+    when "xml"
+      parser.graph.to_rdfxml
+    else
+      parser.graph.to_ntriples
+    end
+    puts output unless $quiet
+
+    puts parser.debug.join("\n\t") if $verbose
+  rescue RdfException => e
+    puts "Parse failure: #{e.message}"
+    puts parser.debug if $verbose && parser
+    #raise
+  rescue Exception => e
+    puts "Parser fault: #{e.message}"
+    puts parser.debug if parser && !$quiet
+    raise
+  end
+end
+
+$verbose = false
+base_uri  = "http://example.com"
+
+opts = GetoptLong.new(
+  ["--verbose", GetoptLong::NO_ARGUMENT],
+  ["--quiet", GetoptLong::NO_ARGUMENT],
+  ["--debug", GetoptLong::NO_ARGUMENT],
+  ["--format", GetoptLong::REQUIRED_ARGUMENT],
+  ["--uri", GetoptLong::REQUIRED_ARGUMENT]
+)
+opts.each do |opt, arg|
+  case opt
+  when '--verbose' then $verbose = true
+  when '--quiet' then $quiet = true
+  when '--debug' then $DEBUG = true
+  when '--format' then $format = arg
+  when '--uri' then base_uri = arg
+  end
+end
+
+x = Parse.new
+ARGV.each do |test_file|
+  x.parse(test_file, base_uri)
+end
+

data/lib/reddy.rb

@@ -0,0 +1,62 @@
+#$:.unshift(File.dirname(__FILE__)) unless $:.include?(File.dirname(__FILE__)) || $:.include?(File.expand_path(File.dirname(__FILE__)))
+
+$:.unshift(File.dirname('reddy'))
+
+begin
+  require 'nokogiri'
+  require 'addressable/uri'
+  require 'builder'
+  require 'treetop'
+rescue LoadError
+  require 'rubygems' unless ENV['NO_RUBYGEMS']
+  gem 'nokogiri'
+  gem 'addressable'
+  require 'nokogiri'
+  require 'addressable/uri'
+  require 'builder'
+  require 'treetop'
+end
+
+Dir.glob(File.join(File.dirname(__FILE__), 'reddy/**.rb')).each { |f| require f }
+
+# Include Storage types, but be tollerant of failure to load as dependencies might not be available
+Dir.glob(File.join(File.dirname(__FILE__), "reddy/store/**.rb")).each do |f|
+  begin
+    require f
+  rescue LoadError
+    puts "Error loading #{f}: #{$!}"
+  end
+end
+
+module Reddy
+  VERSION = File.read(File.join(File.dirname(__FILE__), "..", "VERSION")).chop  # Version in parent directory
+  
+  LINK_TYPES = %w(
+    alternate appendix bookmark cite chapter contents copyright first glossary
+    help icon index last license meta next p3pv1 prev role section stylesheet subsection
+    start top up
+  )
+
+  NC_REGEXP = Regexp.new(
+    %{^
+      (?!\\\\u0301)             # ́ is a non-spacing acute accent.
+                                # It is legal within an XML Name, but not as the first character.
+      (  [a-zA-Z_]
+       | \\\\u[0-9a-fA-F]
+      )
+      (  [0-9a-zA-Z_\.-]
+       | \\\\u([0-9a-fA-F]{4})  # \u followed by a sequence of four hex digits
+      )*
+    $},
+    Regexp::EXTENDED)
+
+  RDF_TYPE    = URIRef.new("http://www.w3.org/1999/02/22-rdf-syntax-ns#type")
+  XML_LITERAL = Literal::Encoding.xmlliteral
+
+  RDF_NS      = Namespace.new("http://www.w3.org/1999/02/22-rdf-syntax-ns#", "rdf")
+  RDFS_NS     = Namespace.new("http://www.w3.org/2000/01/rdf-schema#", "rdfs")
+  XHV_NS      = Namespace.new("http://www.w3.org/1999/xhtml/vocab#", "xhv")
+  XML_NS      = Namespace.new("http://www.w3.org/XML/1998/namespace", "xml")
+
+  XH_MAPPING  = {"" => Namespace.new("http://www.w3.org/1999/xhtml/vocab\#", nil)}
+end

data/lib/reddy/bnode.rb

@@ -0,0 +1,101 @@
+module Reddy
+  # The BNode class creates RDF blank nodes.
+  class BNode
+    attr_reader :identifier
+    
+    # Create a new BNode, optionally accept a identifier for the BNode.
+    # Otherwise, generated sequentially.
+    #
+    # A BNode may have a bank (empty string) identifier, which will be equivalent to another
+    # blank identified BNode.
+    #
+    # Identifiers only have meaning within a particular parsing context, and are used
+    # to lookup previoiusly defined BNodes using the same identifier. Names are *not* preserved
+    # within the underlying storage model.
+    #
+    # @param [String] identifier:: Legal NCName or nil for a named BNode
+    # @param [Hash] context:: Context used to store named BNodes
+    #
+    # @author Gregg Kellogg
+    def initialize(identifier = nil, context = {})
+      if identifier != nil && self.valid_id?(identifier)
+        identifier = identifier.sub(/nbn\d+[a-z]+N/, '')  # creating a named BNode from a named BNode
+        # Generate a name if it's blank. Always prepend "named" to avoid generation overlap
+        @identifier = context[identifier] ||= generate_bn_identifier(identifier)
+      else
+        @identifier = generate_bn_identifier
+      end
+    end
+
+    # Return BNode identifier
+    def to_s
+      return self.identifier.to_s
+    end
+
+    ## 
+    # Exports the BNode in N-Triples form.
+    #
+    # ==== Example
+    #   b = BNode.new; b.to_n3  # => returns a string of the BNode in n3 form
+    #
+    # @return [String]:: The BNode in n3.
+    #
+    # @author Tom Morris
+    def to_n3
+      "_:#{self.identifier}"
+    end
+
+    ## 
+    # Exports the BNode in N-Triples form.
+    #
+    # Syonym for to_n3
+    def to_ntriples
+      self.to_n3
+    end
+
+    # Output URI as resource reference for RDF/XML
+    #
+    # ==== Example
+    #   b = BNode.new("foo"); b.xml_args  # => [{"rdf:nodeID" => "foo"}]
+    def xml_args
+      [{"rdf:nodeID" => self.identifier}]
+    end
+    
+    # The identifier used used for this BNode.
+    def identifier
+      @identifier
+    end
+    
+    # Compare BNodes. BNodes are equivalent if they have the same identifier
+    def eql?(other)
+      other.class == self.class &&
+      other.identifier == self.identifier
+    end
+    alias_method :==, :eql?
+    
+    # Needed for uniq
+    def hash; self.to_s.hash; end
+    
+    def inspect
+      "[bn:#{identifier}]"
+    end
+    
+    protected
+    def valid_id?(name)
+      NC_REGEXP.match(name) || name.empty?
+    end
+
+    # Generate a unique identifier (time with milliseconds plus generated increment)
+    def generate_bn_identifier(name = nil)
+      @@base ||= "bn#{(Time.now.to_f * 1000).to_i}"
+      @@next_generated ||= "a"
+      if name
+        bn = "n#{@@base}#{@@next_generated}N#{name}"
+      else
+        bn = "#{@@base}#{@@next_generated}"
+      end
+      @@next_generated = @@next_generated.succ
+      bn
+    end
+  end
+end