opener-s3-outlet 1.1.3 → 2.0.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA1:
-  metadata.gz: 6d2149619078c94eb07f0dcef96810f9fd40e15b
-  data.tar.gz: c0453fbf4284da2b6e19a8bc2faac19f8c94991e
+  metadata.gz: cfcdb5e05c9bd45c647de2ad0bd02b139a621aa8
+  data.tar.gz: 780fe19a0e15dbf9df35093361878fe595ffde15
 SHA512:
-  metadata.gz: f37b4352e4820c4960175b4f05eb3dc3d696403317f3c5d227cca92999700a3edf8b727dbd7d042ed7b90d5c0d1cc5b6be9683089bdb405fee32809a01fc1889
-  data.tar.gz: a882ff95426c177cd0e29d4efd7442f9cf46a385a003cd5a6c51e56bf9de906c576188b8f02843edeb2280f5e0f0513195223d5a10a9ae6f5974279b3300db0a
+  metadata.gz: eed2a58ef5ae8652bbeed1f66c0b57f4883e5909ce6186b2971a8d7f08ecf8c5e3d54d012c45debe0811ef261c59124719d0d70782e81dd70e9e4a9420c3bb85
+  data.tar.gz: 94cffc0ee2646f2924ba0da0badfae6f0ad24ca75e938c0c2bb025c353f11c96bf58037cfdd55e7aa796d499ee70d19d65cf8784419e85de0722ef95ead041dc

data/LICENSE.txt

@@ -0,0 +1,13 @@
+Copyright 2014 OpeNER Project Consortium
+
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+    http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.

data/README.md

@@ -1,21 +1,23 @@
-S3-Outlet
-------------
+# S3-Outlet
 
-Component that stores results from the Opener Web Services chain into a SQLite 
-Database and shows them into your browser.
+Component for storing KAF documents in Amazon S3.
 
-### Confused by some terminology?
+## Confused by some terminology?
 
-This software is part of a larger collection of natural language processing tools known as "the OpeNER project". You can find more information about the project at [the OpeNER portal](http://opener-project.github.io). There you can also find references to terms like KAF (an XML standard to represent linguistic annotations in texts), component, cores, scenario's and pipelines.
+This software is part of a larger collection of natural language processing
+tools known as "the OpeNER project". You can find more information about the
+project at [the OpeNER portal](http://opener-project.github.io). There you can
+also find references to terms like KAF (an XML standard to represent linguistic
+annotations in texts), component, cores, scenario's and pipelines.
 
-Quick Use Example
------------------
+## Quick Use Example
 
 Installing the s3-outlet can be done by executing:
 
     gem install opener-s3-outlet
 
-Please bare in mind that all components in OpeNER take KAF as an input and output KAF by default.
+Please keep in mind that all components in OpeNER take KAF as an input and
+output KAF by default.
 
 ### Webservices
 
@@ -23,28 +25,32 @@ You can launch a webservice by executing:
 
     s3-outlet-server
 
-This will launch a mini webserver with the webservice. It defaults to port 9292, so you can access it at <http://localhost:9292>.
+This will launch a mini webserver with the webservice. It defaults to port 9292,
+so you can access it at <http://localhost:9292>.
 
-To launch it on a different port provide the `-p [port-number]` option like this:
+To launch it on a different port provide the `-p [port-number]` option like
+this:
 
     s3-outlet-server -p 1234
 
 It then launches at <http://localhost:1234>
 
-Documentation on the Webservice is provided by surfing to the urls provided above. For more information on how to launch a webservice run the command with the ```-h``` option.
-
+Documentation on the Webservice is provided by surfing to the urls provided
+above. For more information on how to launch a webservice run the command with
+the `--help` option.
 
 ### Daemon
 
-Last but not least the s3-outlet comes shipped with a daemon that can read jobs (and write) jobs to and from Amazon SQS queues. For more information type:
+Last but not least the s3-outlet comes shipped with a daemon that can read jobs
+(and write) jobs to and from Amazon SQS queues. For more information type:
 
     s3-outlet-daemon -h
 
+## Description of dependencies
 
-Description of dependencies
----------------------------
-
-This component runs best if you run it in an environment suited for OpeNER components. You can find an installation guide and helper tools in the [OpeNER installer](https://github.com/opener-project/opener-installer) and an
+This component runs best if you run it in an environment suited for OpeNER
+components. You can find an installation guide and helper tools in the
+[OpeNER installer](https://github.com/opener-project/opener-installer) and an
 [installation guide on the Opener Website](http://opener-project.github.io/getting-started/how-to/local-installation.html)
 
 At least you need the following system setup:
@@ -54,28 +60,17 @@ At least you need the following system setup:
 * JRuby 1.7.9 or newer
 * Ruby 1.9.3 or newer
 
-The Core
---------
-
-The component is a fat wrapper around the actual language technology core. You can find the core technologies in the following repositories:
-
-* (link to) Related Core readmes
-
-Where to go from here
----------------------
+## Where to go from here
 
 * [Check the project website](http://opener-project.github.io)
 * [Checkout the webservice](http://opener.olery.com/s3-outlet)
 
-Report problem/Get help
------------------------
-
-If you encounter problems, please email support@opener-project.eu or leave an issue in the 
-[issue tracker](https://github.com/opener-project/s3-outlet/issues).
+## Report problem/Get help
 
+If you encounter problems, please email support@opener-project.eu or leave an
+issue in the [issue tracker](https://github.com/opener-project/s3-outlet/issues).
 
-Contributing
-------------
+## Contributing
 
 1. Fork it <http://github.com/opener-project/s3-outlet/fork>
 2. Create your feature branch (`git checkout -b my-new-feature`)

data/bin/s3-outlet-daemon

@@ -1,9 +1,10 @@
 #!/usr/bin/env ruby
-#
-require 'rubygems'
+
 require 'opener/daemons'
 
-exec_path = File.expand_path("../../exec/s3-outlet.rb", __FILE__)
-Opener::Daemons::Controller.new(:name=>"s3-outlet",
-                                :exec_path=>exec_path)
+controller = Opener::Daemons::Controller.new(
+  :name      => 'opener-s3-outlet',
+  :exec_path => File.expand_path('../../exec/s3-outlet.rb', __FILE__)
+)
 
+controller.run

data/bin/s3-outlet-server

@@ -1,8 +1,10 @@
 #!/usr/bin/env ruby
 
-require 'puma/cli'
+require 'opener/webservice'
 
-rack_config = File.expand_path('../../config.ru', __FILE__)
+parser = Opener::Webservice::OptionParser.new(
+  'opener-s3-outlet',
+  File.expand_path('../../config.ru', __FILE__)
+)
 
-cli = Puma::CLI.new([rack_config] + ARGV)
-cli.run
+parser.run

data/exec/s3-outlet.rb

@@ -1,33 +1,9 @@
 #!/usr/bin/env ruby
 
 require 'opener/daemons'
-require_relative '../lib/opener/s3_outlet'
-
-parser = Opener::Daemons::OptParser.new do |opts, options|
-  opts.on("-b", "--bucket NAME", "Bucket name") do |v|
-    options[:bucket] = v
-  end
-  opts.on("-d", "--directory NAME", "Directory name") do |v|
-    options[:directory] = v
-  end
-end
-
-class S3OutletFactory
-  attr_reader :dir, :bucket
 
-  def initialize(options)
-    @bucket = options.fetch(:bucket)
-    @dir    = options.fetch(:directory)
-  end
-
-  def new
-    Opener::S3Outlet.new(:directory=>dir, :bucket=>bucket)
-  end
-end
+require_relative '../lib/opener/s3_outlet'
 
-options = parser.parse!(ARGV)
-factory = S3OutletFactory.new(options)
+daemon = Opener::Daemons::Daemon.new(Opener::S3Outlet)
 
-daemon = Opener::Daemons::Daemon.new(factory, options)
 daemon.start
-

data/lib/opener/s3_outlet.rb

@@ -1,9 +1,13 @@
+require 'securerandom'
+require 'stringio'
+
 require 'aws-sdk'
+require 'nokogiri'
+require 'opener/kaf_to_json'
 
 require_relative 's3_outlet/s3_output'
 require_relative 's3_outlet/version'
 require_relative 's3_outlet/server'
-require 'opener/kaf_to_json'
 
 module Opener
   class S3Outlet
@@ -14,10 +18,11 @@ module Opener
     end
 
     def run(input)
-      options[:text] = input
-      S3Output.create(options)
+      S3Output.create(
+        options.merge(:text => input, :uuid => options[:request_id])
+      )
 
-      return input #Return original input so that we can keep on chaining.
+      return input
     end
 
     def self.s3

data/lib/opener/s3_outlet/s3_output.rb

@@ -1,5 +1,3 @@
-require 'uuidtools'
-
 module Opener
   class S3Outlet
     class S3Output
@@ -7,7 +5,7 @@ module Opener
        attr_reader :uuid, :text, :dir, :bucket, :params
 
        def initialize(params = {})
-         @uuid     = params.fetch(:uuid) { UUIDTools::UUID.random_create }
+         @uuid     = params[:uuid] || SecureRandom.hex
          @text     = params.fetch(:text)
          @dir      = params.fetch(:directory, S3Outlet.dir)
 

data/lib/opener/s3_outlet/server.rb

@@ -1,15 +1,10 @@
-require 'sinatra'
-require 'nokogiri'
-require 'stringio'
-require_relative './visualizer'
-
 module Opener
   class S3Outlet
-    class Server < Sinatra::Base
+    class Server < Webservice::Server
+      set :views, File.expand_path('../views', __FILE__)
 
-      post '/' do
-        output = S3Output.create(:uuid => params[:request_id], :text => params[:input])
-      end
+      self.text_processor  = S3Outlet
+      self.accepted_params = [:request_id]
 
       get '/' do
         if params[:request_id]
@@ -18,80 +13,53 @@ module Opener
           erb :index
         end
       end
-      
+
       get '/:request_id.json' do
         unless params[:request_id] == 'favicon.ico'
-          begin
-            output = S3Output.find(params[:request_id])
+          output = S3Output.find(params[:request_id])
 
-            if output
-              content_type('text/json')
-              kj = Opener::KafToJson.new
-              json = kj.run(output.text) rescue output.text
-              body(json)
-            else
-              halt(404, "No record found for ID #{params[:request_id]}")
-            end
-          rescue => error
-            error_callback = params[:error_callback]
-
-            submit_error(error_callback, error.message) if error_callback
-
-            raise(error)
+          if output
+            content_type('text/json')
+            kj = Opener::KafToJson.new
+            json = kj.run(output.text) rescue output.text
+            body(json)
+          else
+            halt(404, "No record found for ID #{params[:request_id]}")
           end
         end
       end
 
       get '/:request_id' do
         unless params[:request_id] == 'favicon.ico'
-          begin
-            output = S3Output.find(params[:request_id])
-
-            if output
-              content_type(:xml)
-              body(output)
-            else
-              halt(404, "No record found for ID #{params[:request_id]}")
-            end
-          rescue => error
-            error_callback = params[:error_callback]
+          output = S3Output.find(params[:request_id])
 
-            submit_error(error_callback, error.message) if error_callback
-
-            raise(error)
+          if output
+            content_type(:xml)
+            body(output)
+          else
+            halt(404, "No record found for ID #{params[:request_id]}")
           end
         end
       end
 
       get '/html/:request_id' do
         unless params[:request_id] == 'favicon.ico'
-          begin
-            output = S3Output.find(params[:request_id])
-            if output
-              output = StringIO.new(output)
-              parser = Opener::Kaf::Visualizer::Parser.new(output)
-              doc = parser.parse
-              html = Opener::Kaf::Visualizer::HTMLTextPresenter.new(doc)
-              @parsed = html.to_html
-              erb :show
-            else
-              halt(404, "No record found for ID #{params[:request_id]}")
-            end
-          rescue => error
-            error_callback = params[:error_callback]
+          output = S3Output.find(params[:request_id])
+
+          if output
+            output = StringIO.new(output)
+            parser = Opener::Kaf::Visualizer::Parser.new(output)
+            doc    = parser.parse
+            html   = Opener::Kaf::Visualizer::HTMLTextPresenter.new(doc)
 
-            submit_error(error_callback, error.message) if error_callback
+            @parsed = html.to_html
 
-            raise(error)
+            erb :show
+          else
+            halt(404, "No record found for ID #{params[:request_id]}")
           end
         end
       end
-
-      private
-
-      def submit_error(url, message)
-        HTTPClient.post(url, :body => {:error => message})
-      end
     end # Server
   end # S3Outlet
 end # Opener

data/lib/opener/s3_outlet/version.rb

@@ -1,5 +1,5 @@
 module Opener
   class S3Outlet
-    VERSION = "1.1.3"
+    VERSION = '2.0.0'
   end
 end

data/lib/opener/s3_outlet/visualizer.rb

@@ -1,6 +1,3 @@
-#require "opener/kaf/visualizer/version"
-require 'nokogiri'
-
 module Opener
   module Kaf
     module Visualizer

data/opener-s3-outlet.gemspec

@@ -1,13 +1,15 @@
 require File.expand_path('../lib/opener/s3_outlet/version', __FILE__)
 
 Gem::Specification.new do |gem|
-  gem.name                  = 'opener-s3-outlet'
-  gem.version               = Opener::S3Outlet::VERSION
-  gem.authors               = ['development@olery.com']
-  gem.summary               = 'S3 Bucket data storing for the web services output when using callbacks.'
-  gem.description           = gem.summary
-  gem.homepage              = "http://opener-project.github.com/"
-  gem.has_rdoc              = 'yard'
+  gem.name        = 'opener-s3-outlet'
+  gem.version     = Opener::S3Outlet::VERSION
+  gem.authors     = ['development@olery.com']
+  gem.summary     = 'S3 Bucket data storing for the web services output when using callbacks.'
+  gem.description = gem.summary
+  gem.homepage    = "http://opener-project.github.com/"
+  gem.has_rdoc    = 'yard'
+  gem.license     = 'Apache 2.0'
+
   gem.required_ruby_version = '>= 1.9.2'
 
   gem.files = Dir.glob([
@@ -16,24 +18,18 @@ Gem::Specification.new do |gem|
     'config.ru',
     '*.gemspec',
     'README.md',
-    'visualizer.rb'
+    'LICENSE.txt'
   ]).select { |file| File.file?(file) }
 
   gem.executables = Dir.glob('bin/*').map { |file| File.basename(file) }
 
+  gem.add_dependency 'opener-kaf2json'
+  gem.add_dependency 'opener-daemons', '~> 2.2'
+  gem.add_dependency 'opener-webservice', '~> 2.1'
+  gem.add_dependency 'opener-core', '~> 2.2'
+
   gem.add_dependency 'builder'
-  gem.add_dependency 'sinatra', '~>1.4.2'
   gem.add_dependency 'nokogiri'
-  gem.add_dependency 'httpclient'
-  gem.add_dependency 'uuidtools'
-  gem.add_dependency 'opener-webservice'
-  gem.add_dependency 'opener-daemons'
-  gem.add_dependency 'opener-kaf2json'
-  gem.add_dependency 'aws-sdk'
-  gem.add_dependency 'puma'
 
-  gem.add_development_dependency 'rspec'
-  gem.add_development_dependency 'cucumber'
-  gem.add_development_dependency 'pry'
   gem.add_development_dependency 'rake'
 end

metadata

@@ -1,17 +1,17 @@
 --- !ruby/object:Gem::Specification
 name: opener-s3-outlet
 version: !ruby/object:Gem::Version
-  version: 1.1.3
+  version: 2.0.0
 platform: ruby
 authors:
 - development@olery.com
 autorequire:
 bindir: bin
 cert_chain: []
-date: 2014-06-19 00:00:00.000000000 Z
+date: 2014-11-26 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
-  name: builder
+  name: opener-kaf2json
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
     - - '>='
@@ -25,105 +25,49 @@ dependencies:
   prerelease: false
   type: :runtime
 - !ruby/object:Gem::Dependency
-  name: sinatra
+  name: opener-daemons
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
     - - ~>
       - !ruby/object:Gem::Version
-        version: 1.4.2
+        version: '2.2'
   requirement: !ruby/object:Gem::Requirement
     requirements:
     - - ~>
       - !ruby/object:Gem::Version
-        version: 1.4.2
-  prerelease: false
-  type: :runtime
-- !ruby/object:Gem::Dependency
-  name: nokogiri
-  version_requirements: !ruby/object:Gem::Requirement
-    requirements:
-    - - '>='
-      - !ruby/object:Gem::Version
-        version: '0'
-  requirement: !ruby/object:Gem::Requirement
-    requirements:
-    - - '>='
-      - !ruby/object:Gem::Version
-        version: '0'
-  prerelease: false
-  type: :runtime
-- !ruby/object:Gem::Dependency
-  name: httpclient
-  version_requirements: !ruby/object:Gem::Requirement
-    requirements:
-    - - '>='
-      - !ruby/object:Gem::Version
-        version: '0'
-  requirement: !ruby/object:Gem::Requirement
-    requirements:
-    - - '>='
-      - !ruby/object:Gem::Version
-        version: '0'
-  prerelease: false
-  type: :runtime
-- !ruby/object:Gem::Dependency
-  name: uuidtools
-  version_requirements: !ruby/object:Gem::Requirement
-    requirements:
-    - - '>='
-      - !ruby/object:Gem::Version
-        version: '0'
-  requirement: !ruby/object:Gem::Requirement
-    requirements:
-    - - '>='
-      - !ruby/object:Gem::Version
-        version: '0'
+        version: '2.2'
   prerelease: false
   type: :runtime
 - !ruby/object:Gem::Dependency
   name: opener-webservice
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
-    - - '>='
-      - !ruby/object:Gem::Version
-        version: '0'
-  requirement: !ruby/object:Gem::Requirement
-    requirements:
-    - - '>='
-      - !ruby/object:Gem::Version
-        version: '0'
-  prerelease: false
-  type: :runtime
-- !ruby/object:Gem::Dependency
-  name: opener-daemons
-  version_requirements: !ruby/object:Gem::Requirement
-    requirements:
-    - - '>='
+    - - ~>
       - !ruby/object:Gem::Version
-        version: '0'
+        version: '2.1'
   requirement: !ruby/object:Gem::Requirement
     requirements:
-    - - '>='
+    - - ~>
       - !ruby/object:Gem::Version
-        version: '0'
+        version: '2.1'
   prerelease: false
   type: :runtime
 - !ruby/object:Gem::Dependency
-  name: opener-kaf2json
+  name: opener-core
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
-    - - '>='
+    - - ~>
       - !ruby/object:Gem::Version
-        version: '0'
+        version: '2.2'
   requirement: !ruby/object:Gem::Requirement
     requirements:
-    - - '>='
+    - - ~>
       - !ruby/object:Gem::Version
-        version: '0'
+        version: '2.2'
   prerelease: false
   type: :runtime
 - !ruby/object:Gem::Dependency
-  name: aws-sdk
+  name: builder
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
     - - '>='
@@ -137,7 +81,7 @@ dependencies:
   prerelease: false
   type: :runtime
 - !ruby/object:Gem::Dependency
-  name: puma
+  name: nokogiri
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
     - - '>='
@@ -150,48 +94,6 @@ dependencies:
         version: '0'
   prerelease: false
   type: :runtime
-- !ruby/object:Gem::Dependency
-  name: rspec
-  version_requirements: !ruby/object:Gem::Requirement
-    requirements:
-    - - '>='
-      - !ruby/object:Gem::Version
-        version: '0'
-  requirement: !ruby/object:Gem::Requirement
-    requirements:
-    - - '>='
-      - !ruby/object:Gem::Version
-        version: '0'
-  prerelease: false
-  type: :development
-- !ruby/object:Gem::Dependency
-  name: cucumber
-  version_requirements: !ruby/object:Gem::Requirement
-    requirements:
-    - - '>='
-      - !ruby/object:Gem::Version
-        version: '0'
-  requirement: !ruby/object:Gem::Requirement
-    requirements:
-    - - '>='
-      - !ruby/object:Gem::Version
-        version: '0'
-  prerelease: false
-  type: :development
-- !ruby/object:Gem::Dependency
-  name: pry
-  version_requirements: !ruby/object:Gem::Requirement
-    requirements:
-    - - '>='
-      - !ruby/object:Gem::Version
-        version: '0'
-  requirement: !ruby/object:Gem::Requirement
-    requirements:
-    - - '>='
-      - !ruby/object:Gem::Version
-        version: '0'
-  prerelease: false
-  type: :development
 - !ruby/object:Gem::Dependency
   name: rake
   version_requirements: !ruby/object:Gem::Requirement
@@ -214,24 +116,25 @@ executables:
 extensions: []
 extra_rdoc_files: []
 files:
-- README.md
-- bin/s3-outlet-daemon
-- bin/s3-outlet-server
-- config.ru
 - exec/s3-outlet.rb
 - lib/opener/s3_outlet.rb
-- lib/opener/s3_outlet/public/outlet.css
+- lib/opener/s3_outlet/visualizer.rb
+- lib/opener/s3_outlet/version.rb
 - lib/opener/s3_outlet/s3_output.rb
 - lib/opener/s3_outlet/server.rb
-- lib/opener/s3_outlet/version.rb
-- lib/opener/s3_outlet/views/index.erb
+- lib/opener/s3_outlet/public/outlet.css
 - lib/opener/s3_outlet/views/show.erb
+- lib/opener/s3_outlet/views/index.erb
 - lib/opener/s3_outlet/views/show.html.erb
-- lib/opener/s3_outlet/visualizer.rb
+- config.ru
 - opener-s3-outlet.gemspec
-- visualizer.rb
+- README.md
+- LICENSE.txt
+- bin/s3-outlet-daemon
+- bin/s3-outlet-server
 homepage: http://opener-project.github.com/
-licenses: []
+licenses:
+- Apache 2.0
 metadata: {}
 post_install_message:
 rdoc_options: []
@@ -249,8 +152,9 @@ required_rubygems_version: !ruby/object:Gem::Requirement
       version: '0'
 requirements: []
 rubyforge_project:
-rubygems_version: 2.2.2
+rubygems_version: 2.1.9
 signing_key:
 specification_version: 4
 summary: S3 Bucket data storing for the web services output when using callbacks.
 test_files: []
+has_rdoc: yard

data/visualizer.rb

@@ -1,278 +0,0 @@
-require 'nokogiri'
-
-module Opener
-  module Kaf
-    module Visualizer
-      class Parser
-        attr_reader :doc
-        attr_reader :words, :terms, :entities, :properties, :opinions, :document
-
-        def initialize(input_file_handler)
-          @doc = Nokogiri::XML(input_file_handler)
-        end
-
-        def parse
-          @words      = parse_words
-          @terms      = parse_terms
-          @entities   = parse_entities
-          @properties = parse_properties
-          @opinions   = parse_opinions
-          @document   = KAFDocument.new(
-            :words => words,
-            :terms => terms,
-            :entities => entities,
-            :properties => properties,
-            :opinions => opinions
-          )
-
-          return document
-        end
-
-        def parse_words
-          parse_elements("//wf", Word)
-        end
-
-        def parse_terms
-          # Of course terms should be words here.
-          # Dirty Hack, sufficient for now.
-          parse_elements("//term", Term, :terms=>words)
-        end
-
-        def parse_entities
-          parse_elements("//entity", Entity, :terms=>terms)
-        end
-
-        def parse_properties
-          parse_elements("//property", Property, :terms=>terms)
-        end
-
-        def parse_opinions
-          parse_elements("//opinion", Opinion, :terms=>terms)
-        end
-
-        def parse_elements(xpath, klass, opts={})
-          elements = doc.xpath(xpath)
-          lookup_table = Hash.new
-          elements.each do |element|
-            instance = klass.new(element, opts)
-            lookup_table[instance.id] = instance
-          end
-          lookup_table
-        end
-
-      end
-
-      class KAFNode
-        attr_reader :content, :targets, :tag, :references
-
-        def initialize(tag, references)
-          @references = references
-          @tag = tag
-
-          set_instance_variables
-          set_content
-          set_targets
-          process_subnodes
-        end
-
-        def set_content
-          @content = tag.content
-        end
-
-        def set_instance_variables
-          tag.keys.each do |key|
-            if respond_to?("#{key}=".to_sym)
-              send("#{key}=".to_sym, tag[key])
-            else
-              instance_variable_set("@#{key}", tag[key])
-            end
-          end
-        end
-
-        def set_targets
-          @targets = []
-          tag.css("span target").each do |target|
-            id = target["id"]
-            @targets << references[:terms][id]
-          end
-        end
-
-        def process_subnodes
-        end
-
-        def has_target?(*ids)
-          ids.flatten.each do |id|
-            return true if target_ids.include?(id)
-          end
-          return false
-        end
-
-        def to_s
-          if targets.size > 0
-            return targets.map(&:to_s).join(" ")
-          else
-            return content
-          end
-        end
-
-        def target_ids
-          @targets.map(&:id)
-        end
-
-      end
-
-      class Word < KAFNode
-        attr_reader :wid, :sent, :para, :offset
-
-        def id
-          wid
-        end
-
-        def offset=(offset)
-          @offset = offset.to_i
-        end
-
-        def length
-          content.nil? ? 0 : content.length
-        end
-
-      end
-
-      class Term < KAFNode
-        attr_reader :tid, :type, :lemma, :pos, :morphofeat
-
-        def id
-          tid
-        end
-      end
-
-      class Entity < KAFNode
-        attr_reader :eid, :type
-
-        def id
-          eid
-        end
-
-        def to_s
-          "#{type}: #{targets.map(&:to_s).join(", ")}"
-        end
-      end
-
-      class Property < KAFNode
-        attr_reader :pid, :lemma
-
-        def id
-          pid
-        end
-
-        def to_s
-          "#{lemma}: #{targets.map(&:to_s).join(", ")}"
-        end
-      end
-
-      class Opinion < KAFNode
-        attr_reader :oid, :expression
-
-        def id
-          oid
-        end
-
-        def process_subnodes
-          @expression = tag.xpath("//opinion_expression").first["polarity"].to_sym
-        end
-
-        def to_s
-          "#{expression}: #{targets.map(&:to_s).join(", ")}"
-        end
-
-      end
-
-      class KAFDocument
-        attr_reader :words, :terms, :entities, :properties, :opinions
-
-        def initialize(opts={})
-          @words = opts.fetch(:words)
-          @terms = opts.fetch(:terms)
-          @entities = opts.fetch(:entities)
-          @properties = opts.fetch(:properties)
-          @opinions = opts.fetch(:opinions)
-        end
-
-      end
-
-      class HTMLTextPresenter
-        attr_reader :document
-        def initialize(document)
-          @document = document
-        end
-
-        def to_html
-          offset = 0
-          prev = Struct.new(:offset).new(0)
-
-          builder = Nokogiri::HTML::Builder.new do |html|
-            html.div(:class=>"opener") do
-              html.p do
-                document.words.values.sort_by(&:offset).each do |word|
-                  if offset < word.offset
-                    spacer = word.offset - offset
-                    spacer = Array.new(spacer, " ").join
-                    html.span(spacer)
-                  end
-
-                  terms      = targets_for(:terms, word.id)
-                  entities   = targets_for(:entities, terms)
-                  opinions   = opinions_for(terms)
-                  properties = targets_for(:properties, terms)
-
-                  generics = []
-                  generics << "term"     if terms.size > 0
-                  generics << "entity"   if entities.size > 0
-                  generics << "opinion"  if opinions.size > 0
-                  generics << "property" if properties.size > 0
-
-                  classes = [terms, entities, opinions, properties, generics].flatten.uniq
-
-                  word_annotations = classes.join(" ")
-
-                  html.span(word.content, :class=>word_annotations, :id=>word.id)
-                  offset = word.offset + word.length
-                end
-              end
-
-              [:entities, :opinions, :properties].each do |sym|
-                html.div(:class=>sym) do
-                  document.public_send(sym).values.each do |entity|
-                    html.div(entity.to_s, :id=>entity.id, :class=>entity.target_ids.join(" "))
-                  end
-                end
-              end
-            end
-          end
-
-          builder.to_html
-        end
-
-        def targets_for(variable, *ids)
-          targets = document.public_send(variable.to_sym).values.select do |value|
-            value.has_target?(ids.flatten)
-          end
-
-          targets.map(&:id)
-        end
-
-        def opinions_for(*ids)
-          targets = document.opinions.values.select do |value|
-            value.has_target?(ids.flatten)
-          end
-
-          ids = targets.map(&:id)
-          sentiments = targets.map(&:expression)
-          return ids.concat(sentiments).uniq
-        end
-
-      end
-    end
-  end
-end
-