opener-pos-tagger 2.0.0

checksums.yaml

@@ -0,0 +1,7 @@
+---
+SHA1:
+  metadata.gz: ccc6c90ace4f3e79af9d820dd7b773ccffdd65fe
+  data.tar.gz: 3af96ef7ef65f6210ff076f3c8dc605e5394ec0f
+SHA512:
+  metadata.gz: 70f3208c340084a7fa7c5a7f1701c3aa4bdd39f7bbe43b47a652c6da09179eedf7d3a5ef1f5680f827c953e6063935af11ca343d10a38e7552f47b95a08773a6
+  data.tar.gz: a72e6d5d3cdd505179e9bac632ba9bd9cf125a34a2b579942c8a98b7d62f7ebb34cec01e50f90d4fd22a9257f6e44ccbe22798e35730f95fe381af0b15d2801a

data/README.md

@@ -0,0 +1,164 @@
+POS-tagger
+------------
+
+Component that wraps the different existing POS Taggers based on OpenNLP.
+
+### Confused by some terminology?
+
+This software is part of a larger collection of natural language processing
+tools known as "the OpeNER project". You can find more information about the
+project at (the OpeNER portal)[http://opener-project.github.io]. There you can
+also find references to terms like KAF (an XML standard to represent linguistic
+annotations in texts), component, cores, scenario's and pipelines.
+
+Quick Use Example
+-----------------
+
+Installing the pos-tagger can be done by executing:
+
+    gem install opener-pos-tagger
+
+Please bare in mind that all components in OpeNER take KAF as an input and
+output KAF by default.
+
+### Command line interface
+
+You should now be able to call the POS tagger as a regular shell
+command: by its name. Once installed the gem normalyl sits in your path so you can call it directly from anywhere.
+
+This aplication reads a text from standard input in order to identify the language.
+
+POS Tagging some text (assuming that the above text is in a file called *english.kaf*):
+
+    cat english.kaf | pos-tagger
+    
+Will result in
+
+    <?xml version='1.0' encoding='UTF-8'?>
+    <KAF version="v1.opener" xml:lang="en">
+      <kafHeader>
+        <linguisticProcessors layer="text">
+          <lp name="opennlp-en-tok" timestamp="2013-06-11T13:41:37Z" version="1.0"/>
+          <lp name="opennlp-en-sent" timestamp="2013-06-11T13:41:37Z" version="1.0"/>
+        </linguisticProcessors>
+        <linguisticProcessor layer="term">
+          <lp timestamp="2013-06-12T15:18:03CEST" version="1.0" name="Open nlp pos tagger"/>
+        </linguisticProcessor>
+      </kafHeader>
+      <text>
+        <wf length="4" offset="0" para="1" sent="1" wid="w1">this</wf>
+        <wf length="2" offset="5" para="1" sent="1" wid="w2">is</wf>
+        <wf length="2" offset="8" para="1" sent="1" wid="w3">an</wf>
+        <wf length="7" offset="11" para="1" sent="1" wid="w4">english</wf>
+        <wf length="4" offset="19" para="1" sent="1" wid="w5">text</wf>
+      </text>
+      <terms>
+        <term lemma="this" morphofeat="FM" pos="O" tid="t_1" type="open">
+          <span>
+            <target id="w1"/>
+          </span>
+        </term>
+        <term lemma="is" morphofeat="FM" pos="O" tid="t_2" type="open">
+          <span>
+            <target id="w2"/>
+          </span>
+        </term>
+        <term lemma="an" morphofeat="APPR" pos="P" tid="t_3" type="close">
+          <span>
+            <target id="w3"/>
+          </span>
+        </term>
+        <term lemma="english" morphofeat="FM" pos="O" tid="t_4" type="open">
+          <span>
+            <target id="w4"/>
+          </span>
+        </term>
+        <term lemma="text" morphofeat="FM" pos="O" tid="t_5" type="open">
+          <span>
+            <target id="w5"/>
+          </span>
+        </term>
+      </terms>
+    </KAF>
+
+### Webservices
+
+You can launch a language identification webservice by executing:
+
+    pos-tagger-server
+
+This will launch a mini webserver with the webservice. It defaults to port 9292,
+so you can access it at <http://localhost:9292>.
+
+To launch it on a different port provide the `-p [port-number]` option like
+this:
+
+    pos-tagger-server -p 1234
+
+It then launches at <http://localhost:1234>
+
+Documentation on the Webservice is provided by surfing to the urls provided
+above. For more information on how to launch a webservice run the command with
+the ```-h``` option.
+
+
+### Daemon
+
+Last but not least the POS tagger comes shipped with a daemon that
+can read jobs (and write) jobs to and from Amazon SQS queues. For more
+information type:
+
+    pos-tagger-daemon -h
+
+Description of dependencies
+---------------------------
+
+This component runs best if you run it in an environment suited for OpeNER
+components. You can find an installation guide and helper tools in the (OpeNER
+installer)[https://github.com/opener-project/opener-installer] and (an
+installation guide on the Opener
+Website)[http://opener-project.github.io/getting-started/how-to/local-installation.html]
+
+At least you need the following system setup:
+
+### Depenencies for normal use:
+
+* JRuby (1.7.9+)
+* Java 1.7 or newer (There are problems with encoding in older versions).
+
+### Dependencies if you want to modify the component:
+
+* Maven (for building the Gem)
+
+Language Extension
+------------------
+
+  TODO
+
+The Core
+--------
+
+The component is a fat wrapper around the actual language technology core. You
+can find the core technolies in the following repositories: (https://github.com/opener-project/?query=pos)[https://github.com/opener-project/?query=pos]
+
+Where to go from here
+---------------------
+
+* Check (the project websitere)[http://opener-project.github.io]
+* (Checkout the webservice)[http://opener.olery.com/pos-tagger]
+
+Report problem/Get help
+-----------------------
+
+If you encounter problems, please email support@opener-project.eu or leave an
+issue in the (issue tracker)[https://github.com/opener-project/pos-tagger/issues].
+
+
+Contributing
+------------
+
+1. Fork it ( http://github.com/opener-project/pos-tagger/fork )
+2. Create your feature branch (`git checkout -b my-new-feature`)
+3. Commit your changes (`git commit -am 'Add some feature'`)
+4. Push to the branch (`git push origin my-new-feature`)
+5. Create new Pull Request

data/bin/pos-tagger

@@ -0,0 +1,7 @@
+#!/usr/bin/env ruby
+
+require_relative '../lib/opener/pos_tagger'
+
+cli = Opener::POSTagger::CLI.new(:args => ARGV)
+
+cli.run(STDIN.tty? ? nil : STDIN.read)

data/bin/pos-tagger-server

@@ -0,0 +1,10 @@
+#!/usr/bin/env ruby
+
+require_relative '../lib/opener/pos_tagger/server'
+
+# Without calling `Rack::Server#options` manually the CLI arguments will never
+# be passed, thus the application can't be specified as a constructor argument.
+server                  = Rack::Server.new
+server.options[:config] = File.expand_path('../../config.ru', __FILE__)
+
+server.start

data/config.ru

@@ -0,0 +1,4 @@
+require File.expand_path('../lib/opener/pos_tagger', __FILE__)
+require File.expand_path('../lib/opener/pos_tagger/server', __FILE__)
+
+run Opener::POSTagger::Server

data/lib/opener/pos_tagger.rb

@@ -0,0 +1,90 @@
+require 'opener/pos_taggers/base'
+require 'opener/pos_taggers/en'
+require 'nokogiri'
+require 'open3'
+require 'optparse'
+
+require_relative 'pos_tagger/version'
+require_relative 'pos_tagger/cli'
+
+module Opener
+  ##
+  # Primary POS tagger class that delegates work the various POS tagging
+  # kernels.
+  #
+  # @!attribute [r] options
+  #  @return [Hash]
+  #
+  class POSTagger
+    attr_reader :options
+
+    ##
+    # Hash containing the default options to use.
+    #
+    # @return [Hash]
+    #
+    DEFAULT_OPTIONS = {
+      :args => []
+    }.freeze
+
+    ##
+    # @param [Hash] options
+    #
+    # @option options [Array] :args Arbitrary arguments to pass to the
+    #  underlying kernel.
+    #
+    def initialize(options = {})
+      @options = DEFAULT_OPTIONS.merge(options)
+    end
+
+    ##
+    # Processes the input and returns an Array containing the output of STDOUT,
+    # STDERR and an object containing process information.
+    #
+    # @param [String] input The input to process.
+    # @return [Array]
+    #
+    def run(input)
+      language = language_from_kaf(input)
+
+      unless valid_language?(language)
+        raise ArgumentError, "The specified language (#{language}) is invalid"
+      end
+
+      kernel = language_constant(language).new(:args => options[:args])
+
+      return kernel.run(input)
+    end
+
+    alias tag run
+
+    protected
+
+    ##
+    # Extracts the language from a KAF document.
+    #
+    # @param [String] input
+    # @return [String]
+    #
+    def language_from_kaf(input)
+      reader = Nokogiri::XML::Reader(input)
+
+      return reader.read.lang
+    end
+
+    ##
+    # @param [String] language
+    # @return [Class]
+    #
+    def language_constant(language)
+      return language && POSTaggers.const_get(language.upcase)
+    end
+
+    ##
+    # @return [TrueClass|FalseClass]
+    #
+    def valid_language?(language)
+      return Opener::POSTaggers.const_defined?(language.upcase)
+    end
+  end # POSTagger
+end # Opener

data/lib/opener/pos_tagger/cli.rb

@@ -0,0 +1,73 @@
+require 'optparse'
+
+module Opener
+  class POSTagger
+    ##
+    # CLI wrapper around {Opener::POSTagger} using OptionParser.
+    #
+    # @!attribute [r] options
+    #  @return [Hash]
+    # @!attribute [r] option_parser
+    #  @return [OptionParser]
+    #
+    class CLI
+      attr_reader :options, :option_parser
+
+      ##
+      # @param [Hash] options
+      #
+      def initialize(options = {})
+        @options = DEFAULT_OPTIONS.merge(options)
+
+        @option_parser = ::OptionParser.new do |opts|
+          opts.program_name   = 'pos-tagger'
+          opts.summary_indent = '  '
+
+          opts.on('-h', '--help', 'Shows this help message') do
+            show_help
+          end
+
+          opts.on('-v', '--version', 'Shows the current version') do
+            show_version
+          end
+
+          opts.separator <<-EOF
+
+Examples:
+
+  cat example.kaf | #{opts.program_name}
+          EOF
+        end
+      end
+
+      ##
+      # @param [String] input
+      #
+      def run(input)
+        option_parser.parse!(options[:args])
+
+        tagger = POSTagger.new(options)
+
+        stdout = tagger.run(input)
+
+        puts stdout
+      end
+
+      private
+
+      ##
+      # Shows the help message and exits the program.
+      #
+      def show_help
+        abort option_parser.to_s
+      end
+
+      ##
+      # Shows the version and exits the program.
+      #
+      def show_version
+        abort "#{option_parser.program_name} v#{VERSION} on #{RUBY_DESCRIPTION}"
+      end
+    end # CLI
+  end # POSTagger
+end # Opener

data/lib/opener/pos_tagger/public/markdown.css

@@ -0,0 +1,283 @@
+input[type="text"], textarea
+{
+  width: 500px;
+}
+
+body {
+  font-family: Helvetica, arial, sans-serif;
+  font-size: 14px;
+  line-height: 1.6;
+  padding-top: 10px;
+  padding-bottom: 10px;
+  background-color: white;
+  padding: 30px; }
+
+body > *:first-child {
+  margin-top: 0 !important; }
+body > *:last-child {
+  margin-bottom: 0 !important; }
+
+a {
+  color: #4183C4; }
+a.absent {
+  color: #cc0000; }
+a.anchor {
+  display: block;
+  padding-left: 30px;
+  margin-left: -30px;
+  cursor: pointer;
+  position: absolute;
+  top: 0;
+  left: 0;
+  bottom: 0; }
+
+h1, h2, h3, h4, h5, h6 {
+  margin: 20px 0 10px;
+  padding: 0;
+  font-weight: bold;
+  -webkit-font-smoothing: antialiased;
+  cursor: text;
+  position: relative; }
+
+h1:hover a.anchor, h2:hover a.anchor, h3:hover a.anchor, h4:hover a.anchor, h5:hover a.anchor, h6:hover a.anchor {
+  background: url("../../images/modules/styleguide/para.png") no-repeat 10px center;
+  text-decoration: none; }
+
+h1 tt, h1 code {
+  font-size: inherit; }
+
+h2 tt, h2 code {
+  font-size: inherit; }
+
+h3 tt, h3 code {
+  font-size: inherit; }
+
+h4 tt, h4 code {
+  font-size: inherit; }
+
+h5 tt, h5 code {
+  font-size: inherit; }
+
+h6 tt, h6 code {
+  font-size: inherit; }
+
+h1 {
+  font-size: 28px;
+  color: black; }
+
+h2 {
+  font-size: 24px;
+  border-bottom: 1px solid #cccccc;
+  color: black; }
+
+h3 {
+  font-size: 18px; }
+
+h4 {
+  font-size: 16px; }
+
+h5 {
+  font-size: 14px; }
+
+h6 {
+  color: #777777;
+  font-size: 14px; }
+
+p, blockquote, ul, ol, dl, li, table, pre {
+  margin: 15px 0; }
+
+hr {
+  background: transparent url("../../images/modules/pulls/dirty-shade.png") repeat-x 0 0;
+  border: 0 none;
+  color: #cccccc;
+  height: 4px;
+  padding: 0; }
+
+body > h2:first-child {
+  margin-top: 0;
+  padding-top: 0; }
+body > h1:first-child {
+  margin-top: 0;
+  padding-top: 0; }
+body > h1:first-child + h2 {
+  margin-top: 0;
+  padding-top: 0; }
+body > h3:first-child, body > h4:first-child, body > h5:first-child, body > h6:first-child {
+  margin-top: 0;
+  padding-top: 0; }
+
+a:first-child h1, a:first-child h2, a:first-child h3, a:first-child h4, a:first-child h5, a:first-child h6 {
+  margin-top: 0;
+  padding-top: 0; }
+
+h1 p, h2 p, h3 p, h4 p, h5 p, h6 p {
+  margin-top: 0; }
+
+li p.first {
+  display: inline-block; }
+
+ul, ol {
+  padding-left: 30px; }
+
+ul :first-child, ol :first-child {
+  margin-top: 0; }
+
+ul :last-child, ol :last-child {
+  margin-bottom: 0; }
+
+dl {
+  padding: 0; }
+dl dt {
+  font-size: 14px;
+  font-weight: bold;
+  font-style: italic;
+  padding: 0;
+  margin: 15px 0 5px; }
+dl dt:first-child {
+  padding: 0; }
+dl dt > :first-child {
+  margin-top: 0; }
+dl dt > :last-child {
+  margin-bottom: 0; }
+dl dd {
+  margin: 0 0 15px;
+  padding: 0 15px; }
+dl dd > :first-child {
+  margin-top: 0; }
+dl dd > :last-child {
+  margin-bottom: 0; }
+
+blockquote {
+  border-left: 4px solid #dddddd;
+  padding: 0 15px;
+  color: #777777; }
+blockquote > :first-child {
+  margin-top: 0; }
+blockquote > :last-child {
+  margin-bottom: 0; }
+
+table {
+  padding: 0; }
+table tr {
+  border-top: 1px solid #cccccc;
+  background-color: white;
+  margin: 0;
+  padding: 0; }
+table tr:nth-child(2n) {
+  background-color: #f8f8f8; }
+table tr th {
+  font-weight: bold;
+  border: 1px solid #cccccc;
+  text-align: left;
+  margin: 0;
+  padding: 6px 13px; }
+table tr td {
+  border: 1px solid #cccccc;
+  text-align: left;
+  margin: 0;
+  padding: 6px 13px; }
+table tr th :first-child, table tr td :first-child {
+  margin-top: 0; }
+table tr th :last-child, table tr td :last-child {
+  margin-bottom: 0; }
+
+img {
+  max-width: 100%; }
+
+span.frame {
+  display: block;
+  overflow: hidden; }
+span.frame > span {
+  border: 1px solid #dddddd;
+  display: block;
+  float: left;
+  overflow: hidden;
+  margin: 13px 0 0;
+  padding: 7px;
+  width: auto; }
+span.frame span img {
+  display: block;
+  float: left; }
+span.frame span span {
+  clear: both;
+  color: #333333;
+  display: block;
+  padding: 5px 0 0; }
+span.align-center {
+  display: block;
+  overflow: hidden;
+  clear: both; }
+span.align-center > span {
+  display: block;
+  overflow: hidden;
+  margin: 13px auto 0;
+  text-align: center; }
+span.align-center span img {
+  margin: 0 auto;
+  text-align: center; }
+span.align-right {
+  display: block;
+  overflow: hidden;
+  clear: both; }
+span.align-right > span {
+  display: block;
+  overflow: hidden;
+  margin: 13px 0 0;
+  text-align: right; }
+span.align-right span img {
+  margin: 0;
+  text-align: right; }
+span.float-left {
+  display: block;
+  margin-right: 13px;
+  overflow: hidden;
+  float: left; }
+span.float-left span {
+  margin: 13px 0 0; }
+span.float-right {
+  display: block;
+  margin-left: 13px;
+  overflow: hidden;
+  float: right; }
+span.float-right > span {
+  display: block;
+  overflow: hidden;
+  margin: 13px auto 0;
+  text-align: right; }
+
+code, tt {
+  margin: 0 2px;
+  padding: 0 5px;
+  white-space: nowrap;
+  border: 1px solid #eaeaea;
+  background-color: #f8f8f8;
+  border-radius: 3px; }
+
+pre code {
+  margin: 0;
+  padding: 0;
+  white-space: pre;
+  border: none;
+  background: transparent; }
+
+.highlight pre {
+  background-color: #f8f8f8;
+  border: 1px solid #cccccc;
+  font-size: 13px;
+  line-height: 19px;
+  overflow: auto;
+  padding: 6px 10px;
+  border-radius: 3px; }
+
+pre {
+  background-color: #f8f8f8;
+  border: 1px solid #cccccc;
+  font-size: 13px;
+  line-height: 19px;
+  overflow: auto;
+  padding: 6px 10px;
+  border-radius: 3px; }
+pre code, pre tt {
+  background-color: transparent;
+  border: none; }
+

data/lib/opener/pos_tagger/server.rb

@@ -0,0 +1,16 @@
+require 'sinatra/base'
+require 'httpclient'
+require 'opener/webservice'
+
+module Opener
+  class POSTagger
+    ##
+    # POS Tagger server powered by Sinatra.
+    #
+    class Server < Webservice
+      set :views, File.expand_path('../views', __FILE__)
+      text_processor POSTagger
+      accepted_params :input
+    end # Server
+  end # POSTagger
+end # Opener

data/lib/opener/pos_tagger/version.rb

@@ -0,0 +1,5 @@
+module Opener
+  class POSTagger
+    VERSION = "2.0.0"
+  end
+end

data/lib/opener/pos_tagger/views/index.erb

@@ -0,0 +1,163 @@
+<!DOCTYPE html>
+<html>
+  <head>
+    <link type="text/css" rel="stylesheet" charset="UTF-8" href="markdown.css"/>
+    <title>POS Tagger Webservice</title>
+  </head>
+  <body>
+    <h1>POS Tagger Web Service</h1>
+
+    <h2>Example Usage</h2>
+
+    <p>
+      <pre>pos-tagger-server start</pre>
+      <pre>curl -d &#39;input=&lt;?xml version=&quot;1.0&quot; encoding=&quot;UTF-8&quot; standalone=&quot;no&quot;?&gt;&lt;KAF version=&quot;v1.opener&quot; xml:lang=&quot;en&quot;&gt;&lt;kafHeader&gt;&lt;linguisticProcessors layer=&quot;text&quot;&gt;&lt;lp name=&quot;opennlp-en-tok&quot; timestamp=&quot;2013-06-11T13:41:37Z&quot; version=&quot;1.0&quot;/&gt;&lt;lp name=&quot;opennlp-en-sent&quot; timestamp=&quot;2013-06-11T13:41:37Z&quot; version=&quot;1.0&quot;/&gt;&lt;/linguisticProcessors&gt;&lt;/kafHeader&gt;&lt;text&gt;&lt;wf length=&quot;4&quot; offset=&quot;0&quot; para=&quot;1&quot; sent=&quot;1&quot; wid=&quot;w1&quot;&gt;this&lt;/wf&gt;&lt;wf length=&quot;2&quot; offset=&quot;5&quot; para=&quot;1&quot; sent=&quot;1&quot; wid=&quot;w2&quot;&gt;is&lt;/wf&gt;&lt;wf length=&quot;2&quot; offset=&quot;8&quot; para=&quot;1&quot; sent=&quot;1&quot; wid=&quot;w3&quot;&gt;an&lt;/wf&gt;&lt;wf length=&quot;7&quot; offset=&quot;11&quot; para=&quot;1&quot; sent=&quot;1&quot; wid=&quot;w4&quot;&gt;english&lt;/wf&gt;&lt;wf length=&quot;4&quot; offset=&quot;19&quot; para=&quot;1&quot; sent=&quot;1&quot; wid=&quot;w5&quot;&gt;text&lt;/wf&gt;&lt;/text&gt;&lt;/KAF&gt;&#39; http://localhost:9292 -XPOST</pre>
+
+      outputs:
+
+      <pre>
+&lt;?xml version=&#39;1.0&#39; encoding=&#39;UTF-8&#39;?&gt;
+&lt;KAF version=&quot;v1.opener&quot; xml:lang=&quot;en&quot;&gt;
+  &lt;kafHeader&gt;
+    &lt;linguisticProcessors layer=&quot;text&quot;&gt;
+      &lt;lp name=&quot;opennlp-en-tok&quot; timestamp=&quot;2013-06-11T13:41:37Z&quot; version=&quot;1.0&quot;/&gt;
+      &lt;lp name=&quot;opennlp-en-sent&quot; timestamp=&quot;2013-06-11T13:41:37Z&quot; version=&quot;1.0&quot;/&gt;
+    &lt;/linguisticProcessors&gt;
+    &lt;linguisticProcessor layer=&quot;term&quot;&gt;
+      &lt;lp timestamp=&quot;2013-06-12T15:18:03CEST&quot; version=&quot;1.0&quot; name=&quot;Open nlp pos tagger&quot;/&gt;
+    &lt;/linguisticProcessor&gt;
+  &lt;/kafHeader&gt;
+  &lt;text&gt;
+    &lt;wf length=&quot;4&quot; offset=&quot;0&quot; para=&quot;1&quot; sent=&quot;1&quot; wid=&quot;w1&quot;&gt;this&lt;/wf&gt;
+    &lt;wf length=&quot;2&quot; offset=&quot;5&quot; para=&quot;1&quot; sent=&quot;1&quot; wid=&quot;w2&quot;&gt;is&lt;/wf&gt;
+    &lt;wf length=&quot;2&quot; offset=&quot;8&quot; para=&quot;1&quot; sent=&quot;1&quot; wid=&quot;w3&quot;&gt;an&lt;/wf&gt;
+    &lt;wf length=&quot;7&quot; offset=&quot;11&quot; para=&quot;1&quot; sent=&quot;1&quot; wid=&quot;w4&quot;&gt;english&lt;/wf&gt;
+    &lt;wf length=&quot;4&quot; offset=&quot;19&quot; para=&quot;1&quot; sent=&quot;1&quot; wid=&quot;w5&quot;&gt;text&lt;/wf&gt;
+  &lt;/text&gt;
+  &lt;terms&gt;
+    &lt;term lemma=&quot;this&quot; morphofeat=&quot;FM&quot; pos=&quot;O&quot; tid=&quot;t_1&quot; type=&quot;open&quot;&gt;
+      &lt;span&gt;
+        &lt;target id=&quot;w1&quot;/&gt;
+      &lt;/span&gt;
+    &lt;/term&gt;
+    &lt;term lemma=&quot;is&quot; morphofeat=&quot;FM&quot; pos=&quot;O&quot; tid=&quot;t_2&quot; type=&quot;open&quot;&gt;
+      &lt;span&gt;
+        &lt;target id=&quot;w2&quot;/&gt;
+      &lt;/span&gt;
+    &lt;/term&gt;
+    &lt;term lemma=&quot;an&quot; morphofeat=&quot;APPR&quot; pos=&quot;P&quot; tid=&quot;t_3&quot; type=&quot;close&quot;&gt;
+      &lt;span&gt;
+        &lt;target id=&quot;w3&quot;/&gt;
+      &lt;/span&gt;
+    &lt;/term&gt;
+    &lt;term lemma=&quot;english&quot; morphofeat=&quot;FM&quot; pos=&quot;O&quot; tid=&quot;t_4&quot; type=&quot;open&quot;&gt;
+      &lt;span&gt;
+        &lt;target id=&quot;w4&quot;/&gt;
+      &lt;/span&gt;
+    &lt;/term&gt;
+    &lt;term lemma=&quot;text&quot; morphofeat=&quot;FM&quot; pos=&quot;O&quot; tid=&quot;t_5&quot; type=&quot;open&quot;&gt;
+      &lt;span&gt;
+        &lt;target id=&quot;w5&quot;/&gt;
+      &lt;/span&gt;
+    &lt;/term&gt;
+  &lt;/terms&gt;
+&lt;/KAF&gt;</pre>
+    </p>
+
+    <h2>Try the webservice</h2>
+
+    <p>* required</p>
+    <p>** When entering a value no response will be displayed in the browser.</p>
+
+    <form action="<%=url("/")%>" method="POST">
+      <div>
+        <label for="input"/>Type your text here*</label>
+        <br/>
+
+        <textarea name="input" id="text" rows="10" cols="50"/></textarea>
+      </div>
+
+      <% 10.times do |t| %>
+      <div>
+        <label for="callbacks">Callback URL <%=t+1%>(**)</label>
+        <br />
+
+        <input id="callbacks" type="text" name="callbacks[]" />
+      </div>
+      <% end %>
+
+
+      <div>
+        <label for="error_callback">Error Callback</label>
+        <br />
+
+        <input id="error_callback" type="text" name="error_callback" />
+      </div>
+      <input type="submit" value="Submit" />
+    </form>
+
+    <h2>Actions</h2>
+
+    <p>
+      <dl>
+        <dt>POST /</dt>
+        <dd>Tag the input tokenized text. See arguments listing for more options.</dd>
+        <dt>GET /</dt>
+        <dd>Show this page</dd>
+      </dl>
+    </p>
+
+    <h2>Arguments</h2>
+
+    <p> The webservice takes the following arguments: </p>
+    <p>* required</p>
+
+    <dl>
+      <dt>text*</dt>
+      <dd>The input text in KAF format. Sample KAF input:</dd>
+      <pre>
+&lt;?xml version=&quot;1.0&quot; encoding=&quot;UTF-8&quot; standalone=&quot;no&quot;?&gt;
+&lt;KAF version=&quot;v1.opener&quot; xml:lang=&quot;en&quot;&gt;
+  &lt;kafHeader&gt;
+    &lt;linguisticProcessors layer=&quot;text&quot;&gt;
+      &lt;lp name=&quot;opennlp-en-tok&quot; timestamp=&quot;2013-06-11T13:41:37Z&quot; version=&quot;1.0&quot;/&gt;
+      &lt;lp name=&quot;opennlp-en-sent&quot; timestamp=&quot;2013-06-11T13:41:37Z&quot; version=&quot;1.0&quot;/&gt;
+    &lt;/linguisticProcessors&gt;
+  &lt;/kafHeader&gt;
+  &lt;text&gt;
+    &lt;wf length=&quot;4&quot; offset=&quot;0&quot; para=&quot;1&quot; sent=&quot;1&quot; wid=&quot;w1&quot;&gt;this&lt;/wf&gt;
+    &lt;wf length=&quot;2&quot; offset=&quot;5&quot; para=&quot;1&quot; sent=&quot;1&quot; wid=&quot;w2&quot;&gt;is&lt;/wf&gt;
+    &lt;wf length=&quot;2&quot; offset=&quot;8&quot; para=&quot;1&quot; sent=&quot;1&quot; wid=&quot;w3&quot;&gt;an&lt;/wf&gt;
+    &lt;wf length=&quot;7&quot; offset=&quot;11&quot; para=&quot;1&quot; sent=&quot;1&quot; wid=&quot;w4&quot;&gt;english&lt;/wf&gt;
+    &lt;wf length=&quot;4&quot; offset=&quot;19&quot; para=&quot;1&quot; sent=&quot;1&quot; wid=&quot;w5&quot;&gt;text&lt;/wf&gt;
+  &lt;/text&gt;
+&lt;/KAF&gt;</pre>
+
+      <dt>callbacks</dt>
+      <dd>
+            You can provide a list of callback urls. If you provide callback urls
+            the POS tagger will run as a background job and a callback
+            with the results will be performed (POST) to the first url in the callback
+            list. The other urls in callback list will be provided in the "callbacks"
+            argument.<br/><br/>
+            Using callback you can chain together several OpeNER webservices in
+        one call. The first, will call the second, which will call the third, etc.
+        See for more information the <a href="http://opener-project.github.io">
+          webservice documentation online</a>.
+      </dd>
+      <dt>error_callback</dt>
+      <dd>URL to notify if errors occur in the background process. The error
+      callback will do a POST with the error message in the 'error' field.</dd>
+      </dt>
+
+
+
+    </dl>
+
+
+    <p>
+
+    </p>
+
+  </body>
+</html>

data/lib/opener/pos_tagger/views/result.erb

@@ -0,0 +1,15 @@
+<!DOCTYPE html>
+<html>
+  <head>
+    <link type="text/css" rel="stylesheet" charset="UTF-8" href="markdown.css"/>
+    <title>Language Detector Webservice</title>
+  </head>
+  <body>
+    <h1>Output URL</h1>
+    <p>
+      When ready, you can view the result
+      <a href=<%= output_url %>>here</a>
+    </p>
+
+  </body>
+</html>

data/opener-pos-tagger.gemspec

@@ -0,0 +1,35 @@
+require File.expand_path('../lib/opener/pos_tagger/version', __FILE__)
+
+Gem::Specification.new do |gem|
+  gem.name                  = 'opener-pos-tagger'
+  gem.version               = Opener::POSTagger::VERSION
+  gem.authors               = ['development@olery.com']
+  gem.summary               = 'Gem that wraps up the different existing pos-taggers'
+  gem.description           = gem.summary
+  gem.homepage              = 'http://opener-project.github.com/'
+  gem.has_rdoc              = "yard"
+  gem.required_ruby_version = ">= 1.9.2"
+
+  gem.files = Dir.glob([
+    'lib/**/*',
+    'config.ru',
+    '*.gemspec',
+    'README.md'
+  ]).select { |file| File.file?(file) }
+
+  gem.executables = Dir.glob('bin/*').map { |file| File.basename(file) }
+
+  gem.add_dependency 'opener-pos-tagger-base'
+  gem.add_dependency 'opener-pos-tagger-en-es'
+  gem.add_dependency 'opener-webservice'
+
+  gem.add_dependency 'nokogiri'
+  gem.add_dependency 'sinatra', '~>1.4.2'
+  gem.add_dependency 'httpclient'
+
+  gem.add_development_dependency 'rspec'
+  gem.add_development_dependency 'cucumber'
+  gem.add_development_dependency 'pry'
+  gem.add_development_dependency 'rake'
+end
+

metadata

@@ -0,0 +1,197 @@
+--- !ruby/object:Gem::Specification
+name: opener-pos-tagger
+version: !ruby/object:Gem::Version
+  version: 2.0.0
+platform: ruby
+authors:
+- development@olery.com
+autorequire: 
+bindir: bin
+cert_chain: []
+date: 2014-05-20 00:00:00.000000000 Z
+dependencies:
+- !ruby/object:Gem::Dependency
+  name: opener-pos-tagger-base
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+- !ruby/object:Gem::Dependency
+  name: opener-pos-tagger-en-es
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+- !ruby/object:Gem::Dependency
+  name: opener-webservice
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+- !ruby/object:Gem::Dependency
+  name: nokogiri
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+- !ruby/object:Gem::Dependency
+  name: sinatra
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 1.4.2
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 1.4.2
+- !ruby/object:Gem::Dependency
+  name: httpclient
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+- !ruby/object:Gem::Dependency
+  name: rspec
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+- !ruby/object:Gem::Dependency
+  name: cucumber
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+- !ruby/object:Gem::Dependency
+  name: pry
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+- !ruby/object:Gem::Dependency
+  name: rake
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+description: Gem that wraps up the different existing pos-taggers
+email: 
+executables:
+- pos-tagger-server
+- pos-tagger
+extensions: []
+extra_rdoc_files: []
+files:
+- README.md
+- bin/pos-tagger
+- bin/pos-tagger-server
+- config.ru
+- lib/opener/pos_tagger.rb
+- lib/opener/pos_tagger/cli.rb
+- lib/opener/pos_tagger/public/markdown.css
+- lib/opener/pos_tagger/server.rb
+- lib/opener/pos_tagger/version.rb
+- lib/opener/pos_tagger/views/index.erb
+- lib/opener/pos_tagger/views/result.erb
+- opener-pos-tagger.gemspec
+homepage: http://opener-project.github.com/
+licenses: []
+metadata: {}
+post_install_message: 
+rdoc_options: []
+require_paths:
+- lib
+required_ruby_version: !ruby/object:Gem::Requirement
+  requirements:
+  - - ">="
+    - !ruby/object:Gem::Version
+      version: 1.9.2
+required_rubygems_version: !ruby/object:Gem::Requirement
+  requirements:
+  - - ">="
+    - !ruby/object:Gem::Version
+      version: '0'
+requirements: []
+rubyforge_project: 
+rubygems_version: 2.2.2
+signing_key: 
+specification_version: 4
+summary: Gem that wraps up the different existing pos-taggers
+test_files: []
+has_rdoc: yard