opener-tree-tagger 2.0.2 → 3.0.1

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (7) hide show
  1. checksums.yaml +13 -5
  2. data/README.md +17 -44
  3. data/bin/{opener-tree-tagger-daemon → tree-tagger-daemon} +0 -0
  4. data/bin/{opener-tree-tagger-server → tree-tagger-server} +0 -0
  5. data/lib/opener/tree_tagger/version.rb +1 -1
  6. data/opener-tree-tagger.gemspec +0 -1
  7. metadata +31 -32
checksums.yaml CHANGED
@@ -1,7 +1,15 @@
1
1
  ---
2
- SHA1:
3
- metadata.gz: 0e0592434c89300d52ab34fd394c18e7a3e85709
4
- data.tar.gz: 8fe88f3028427e8847b9ec2fddcb180502436266
2
+ !binary "U0hBMQ==":
3
+ metadata.gz: !binary |-
4
+ MWI0Y2U0NjQzNjY4NTQ0ZGMxNGVhMDUwNTk2NjUwN2I4ZDRjNWY5Mw==
5
+ data.tar.gz: !binary |-
6
+ Y2UxNjJjNGRkYTk2NzgwYzdmYWU0NmIzMTI5MjEyYjA0YzY0N2MzOQ==
5
7
  SHA512:
6
- metadata.gz: 8693293f1d7afef28466f4090098d7c8e2051699614bf9f9cf292a673ebc695ba262537e34c581625f7422c758d9f7932ec925ad4b38cd82362969f856c42617
7
- data.tar.gz: 5b4a1e287469e6655e1ec00946bc1b13dfd2ff97f18441c67a15d7802fc9cacea209a41b88d0526773f69a1e33f47905504712a344d2a9e128a0ebfdc35362ac
8
+ metadata.gz: !binary |-
9
+ NWY3ZjcxZWI5ZGNkNzY3ZWRhYzQxZTY0MWM0YzE1OTBkZWE3Njk0ZWY5ZmZi
10
+ ZTdiMzkyZjFiMTgwNzZlYWEyNGE5ZWJiNjY5NTVlNmQ0Mjg2Mzg4ZDJkZTAz
11
+ ZjE5MDkwNGY0NDRkYWU4ODBlYmIyYzQ3MDY3ODkxYjRkMmQyZjc=
12
+ data.tar.gz: !binary |-
13
+ NDUzNDRmOWRjMzYxYWQxYjc3ZTdiZTEyMGVlZGFmZDFlZGQwYjUxNDMxNjU5
14
+ NDZiMDQ3ODA5YmRmN2Q2YjJhNmIyOGM5ODE3NWYwNjVkMGYyNGE4YjY3NTA5
15
+ M2MyNzBhYmU1M2E1NTliNWQzNTRjOTk0MWVmZDBkNDE5ZGE3NzE=
data/README.md CHANGED
@@ -3,21 +3,13 @@
3
3
  Introduction
4
4
  ------------
5
5
 
6
- This module implements a wrapper to process text with the PoS tagger TreeTagger. TreeTagger is a tool that assigns the lemmas and part-of-speech information to an input text.
7
- This module takes KAF as input, with the token layer created (for instance by one of our tokenizer modules) and outputs KAF with a new term layer. It is important to note
8
- that the token layer in the input is not modified in the output, so the program takes care of performing the correct matching between the term and the token layer.
6
+ This module implements a wrapper to process text with the PoS tagger TreeTagger. TreeTagger is a tool that assigns the lemmas and part-of-speech information to an input text. This module takes KAF as input, with the token layer created (for instance by one of our tokenizer modules) and outputs KAF with a new term layer. It is important to note that the token layer in the input is not modified in the output, so the program takes care of performing the correct matching between the term and the token layer.
9
7
 
10
- The language of the input KAF text has to be specified through the attribute xml:lang in the main KAF element. This module works for text in all the languages covered by the OpeNER project (English, Dutch,German,
11
- Italian, Spanish and French). It can be easily extended to other languages by downloading the specific TreeTagger
12
- models for that language and providing a mapping from the tagset used by these models to the tagset defined in KAF.
8
+ The language of the input KAF text has to be specified through the attribute xml:lang in the main KAF element. This module works for text in all the languages covered by the OpeNER project (English, Dutch,German, Italian, Spanish and French). It can be easily extended to other languages by downloading the specific TreeTagger models for that language and providing a mapping from the tagset used by these models to the tagset defined in KAF.
13
9
 
14
10
  ### Confused by some terminology?
15
11
 
16
- This software is part of a larger collection of natural language processing
17
- tools known as "the OpeNER project". You can find more information about the
18
- project at [the OpeNER portal](http://opener-project.github.io). There you can
19
- also find references to terms like KAF (an XML standard to represent linguistic
20
- annotations in texts), component, cores, scenario's and pipelines.
12
+ This software is part of a larger collection of natural language processing tools known as "the OpeNER project". You can find more information about the project at [the OpeNER portal](http://opener-project.github.io). There you can also find references to terms like KAF (an XML standard to represent linguistic annotations in texts), component, cores, scenario's and pipelines.
21
13
 
22
14
  Quick Use Example
23
15
  -----------------
@@ -26,24 +18,19 @@ Installing the tree-tagger can be done by executing:
26
18
 
27
19
  gem install opener-tree-tagger
28
20
 
29
- Also make sure you have tree-tagger and the proper language files installed AND
30
- that you set the path to the tree-tagger in the TREE_TAGGER_PATH environment
31
- variable.
21
+ Also make sure you have tree-tagger and the proper language files installed AND that you set the path to the tree-tagger in the TREE_TAGGER_PATH environment variable.
32
22
 
33
- Besides that, make sure you install lxml. You can probably achieve this by
34
- typing
23
+ Besides that, make sure you install lxml. You can probably achieve this by typing
35
24
 
36
25
  pip install lxml
37
26
 
38
27
  If that doesn't work, please check the [installation guide on the OpeNER portal](http://opener-project.github.io/getting-started/how-to/local-installation.html).
39
28
 
40
- Please bare in mind that all components in OpeNER take KAF as an input and
41
- output KAF by default.
29
+ Please bare in mind that all components in OpeNER take KAF as an input and output KAF by default.
42
30
 
43
31
  ### Command line interface
44
32
 
45
- You should now be able to call the tree-tagger as a regular shell
46
- command: by its name. Once installed the gem normalyl sits in your path so you can call it directly from anywhere.
33
+ You should now be able to call the tree-tagger as a regular shell command: by its name. Once installed the gem normalyl sits in your path so you can call it directly from anywhere.
47
34
 
48
35
  This aplication reads a text from standard input in order to identify the language.
49
36
 
@@ -58,26 +45,20 @@ You can launch a language identification webservice by executing:
58
45
 
59
46
  tree-tagger-server
60
47
 
61
- This will launch a mini webserver with the webservice. It defaults to port 9292,
62
- so you can access it at <http://localhost:9292>.
48
+ This will launch a mini webserver with the webservice. It defaults to port 9292, so you can access it at <http://localhost:9292>.
63
49
 
64
- To launch it on a different port provide the `-p [port-number]` option like
65
- this:
50
+ To launch it on a different port provide the `-p [port-number]` option like this:
66
51
 
67
52
  tree-tagger-server -p 1234
68
53
 
69
54
  It then launches at <http://localhost:1234>
70
55
 
71
- Documentation on the Webservice is provided by surfing to the urls provided
72
- above. For more information on how to launch a webservice run the command with
73
- the ```-h``` option.
56
+ Documentation on the Webservice is provided by surfing to the urls provided above. For more information on how to launch a webservice run the command with the ```-h``` option.
74
57
 
75
58
 
76
59
  ### Daemon
77
60
 
78
- Last but not least the tree-tagger comes shipped with a daemon that
79
- can read jobs (and write) jobs to and from Amazon SQS queues. For more
80
- information type:
61
+ Last but not least the tree-tagger comes shipped with a daemon that can read jobs (and write) jobs to and from Amazon SQS queues. For more information type:
81
62
 
82
63
  tree-tagger-daemon -h
83
64
 
@@ -85,9 +66,7 @@ information type:
85
66
  Description of dependencies
86
67
  ---------------------------
87
68
 
88
- This component runs best if you run it in an environment suited for OpeNER
89
- components. You can find an installation guide and helper tools in the [OpeNER installer](https://github.com/opener-project/opener-installer) and [an
90
- installation guide on the [Opener Website](http://opener-project.github.io/getting-started/how-to/local-installation.html)
69
+ This component runs best if you run it in an environment suited for OpeNER components. You can find an installation guide and helper tools in the [OpeNER installer](https://github.com/opener-project/opener-installer) and an [installation guide on the [Opener Website](http://opener-project.github.io/getting-started/how-to/local-installation.html)
91
70
 
92
71
  At least you need the following system setup:
93
72
 
@@ -100,10 +79,7 @@ At least you need the following system setup:
100
79
  * Tree tagger installed and it's path know in TREE_TAGGER_PATH environment
101
80
  variable.
102
81
 
103
- If TreeTagger is not installed in your machine
104
- you can download it from <http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/> and follow the installation instructions. To indicate to our scripts where
105
- TreeTagger is located, you have to set an environment variable with the
106
- location:
82
+ If TreeTagger is not installed in your machine you can download it from <http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/> and follow the installation instructions. To indicate to our scripts where TreeTagger is located, you have to set an environment variable with the location:
107
83
 
108
84
  ```shell
109
85
  export TREE_TAGGER_PATH=/usr/local/TreeTagger/
@@ -115,15 +91,12 @@ adding it to ```~/.bash_profile``` or ```~/.zshrc```
115
91
  Language Extension
116
92
  ------------------
117
93
 
118
- The tree-tagger depends on the availability of Tree Tagger models. Check
119
- out the tree tagger website for more languages. Also you'll have to update the
120
- py files in the core directory.
94
+ The tree-tagger depends on the availability of Tree Tagger models. Check out the tree tagger website for more languages. Also you'll have to update the py files in the core directory.
121
95
 
122
96
  The Core
123
97
  --------
124
98
 
125
- The component is a fat wrapper around the actual language technology core. You
126
- can find the core technolies in the core directory of this repository.
99
+ The component is a fat wrapper around the actual language technology core. You can find the core technolies in the core directory of this repository.
127
100
 
128
101
  Where to go from here
129
102
  ---------------------
@@ -134,8 +107,8 @@ Where to go from here
134
107
  Report problem/Get help
135
108
  -----------------------
136
109
 
137
- If you encounter problems, please email support@opener-project.eu or leave an
138
- issue in the (issue tracker)[https://github.com/opener-project/tree-tagger/issues].
110
+ If you encounter problems, please email support@opener-project.eu or leave an issue in the
111
+ (issue tracker)[https://github.com/opener-project/tree-tagger/issues].
139
112
 
140
113
 
141
114
  Contributing
data/lib/opener/tree_tagger/version.rb CHANGED
@@ -1,5 +1,5 @@
1
1
  module Opener
2
2
  class TreeTagger
3
- VERSION = "2.0.2"
3
+ VERSION = "3.0.1"
4
4
  end
5
5
  end
data/opener-tree-tagger.gemspec CHANGED
@@ -11,7 +11,6 @@ Gem::Specification.new do |gem|
11
11
  gem.extensions = ['ext/hack/Rakefile']
12
12
 
13
13
  gem.files = Dir.glob([
14
- 'core/site-packages/pre_build/**/*',
15
14
  'core/*',
16
15
  'exec/*',
17
16
  'ext/**/*',
metadata CHANGED
@@ -1,7 +1,7 @@
1
1
  --- !ruby/object:Gem::Specification
2
2
  name: opener-tree-tagger
3
3
  version: !ruby/object:Gem::Version
4
- version: 2.0.2
4
+ version: 3.0.1
5
5
  platform: ruby
6
6
  authors:
7
7
  - rubenIzquierdo
@@ -15,145 +15,140 @@ dependencies:
15
15
  name: opener-daemons
16
16
  requirement: !ruby/object:Gem::Requirement
17
17
  requirements:
18
- - - ">="
18
+ - - ! '>='
19
19
  - !ruby/object:Gem::Version
20
20
  version: '0'
21
21
  type: :runtime
22
22
  prerelease: false
23
23
  version_requirements: !ruby/object:Gem::Requirement
24
24
  requirements:
25
- - - ">="
25
+ - - ! '>='
26
26
  - !ruby/object:Gem::Version
27
27
  version: '0'
28
28
  - !ruby/object:Gem::Dependency
29
29
  name: opener-build-tools
30
30
  requirement: !ruby/object:Gem::Requirement
31
31
  requirements:
32
- - - ">="
32
+ - - ! '>='
33
33
  - !ruby/object:Gem::Version
34
34
  version: 0.2.7
35
35
  type: :runtime
36
36
  prerelease: false
37
37
  version_requirements: !ruby/object:Gem::Requirement
38
38
  requirements:
39
- - - ">="
39
+ - - ! '>='
40
40
  - !ruby/object:Gem::Version
41
41
  version: 0.2.7
42
42
  - !ruby/object:Gem::Dependency
43
43
  name: rake
44
44
  requirement: !ruby/object:Gem::Requirement
45
45
  requirements:
46
- - - ">="
46
+ - - ! '>='
47
47
  - !ruby/object:Gem::Version
48
48
  version: '0'
49
49
  type: :runtime
50
50
  prerelease: false
51
51
  version_requirements: !ruby/object:Gem::Requirement
52
52
  requirements:
53
- - - ">="
53
+ - - ! '>='
54
54
  - !ruby/object:Gem::Version
55
55
  version: '0'
56
56
  - !ruby/object:Gem::Dependency
57
57
  name: sinatra
58
58
  requirement: !ruby/object:Gem::Requirement
59
59
  requirements:
60
- - - ">="
60
+ - - ! '>='
61
61
  - !ruby/object:Gem::Version
62
62
  version: '0'
63
63
  type: :runtime
64
64
  prerelease: false
65
65
  version_requirements: !ruby/object:Gem::Requirement
66
66
  requirements:
67
- - - ">="
67
+ - - ! '>='
68
68
  - !ruby/object:Gem::Version
69
69
  version: '0'
70
70
  - !ruby/object:Gem::Dependency
71
71
  name: httpclient
72
72
  requirement: !ruby/object:Gem::Requirement
73
73
  requirements:
74
- - - ">="
74
+ - - ! '>='
75
75
  - !ruby/object:Gem::Version
76
76
  version: '0'
77
77
  type: :runtime
78
78
  prerelease: false
79
79
  version_requirements: !ruby/object:Gem::Requirement
80
80
  requirements:
81
- - - ">="
81
+ - - ! '>='
82
82
  - !ruby/object:Gem::Version
83
83
  version: '0'
84
84
  - !ruby/object:Gem::Dependency
85
85
  name: puma
86
86
  requirement: !ruby/object:Gem::Requirement
87
87
  requirements:
88
- - - ">="
88
+ - - ! '>='
89
89
  - !ruby/object:Gem::Version
90
90
  version: '0'
91
91
  type: :runtime
92
92
  prerelease: false
93
93
  version_requirements: !ruby/object:Gem::Requirement
94
94
  requirements:
95
- - - ">="
95
+ - - ! '>='
96
96
  - !ruby/object:Gem::Version
97
97
  version: '0'
98
98
  - !ruby/object:Gem::Dependency
99
99
  name: opener-webservice
100
100
  requirement: !ruby/object:Gem::Requirement
101
101
  requirements:
102
- - - ">="
102
+ - - ! '>='
103
103
  - !ruby/object:Gem::Version
104
104
  version: '0'
105
105
  type: :runtime
106
106
  prerelease: false
107
107
  version_requirements: !ruby/object:Gem::Requirement
108
108
  requirements:
109
- - - ">="
109
+ - - ! '>='
110
110
  - !ruby/object:Gem::Version
111
111
  version: '0'
112
112
  - !ruby/object:Gem::Dependency
113
113
  name: rspec
114
114
  requirement: !ruby/object:Gem::Requirement
115
115
  requirements:
116
- - - ">="
116
+ - - ! '>='
117
117
  - !ruby/object:Gem::Version
118
118
  version: '0'
119
119
  type: :development
120
120
  prerelease: false
121
121
  version_requirements: !ruby/object:Gem::Requirement
122
122
  requirements:
123
- - - ">="
123
+ - - ! '>='
124
124
  - !ruby/object:Gem::Version
125
125
  version: '0'
126
126
  - !ruby/object:Gem::Dependency
127
127
  name: cucumber
128
128
  requirement: !ruby/object:Gem::Requirement
129
129
  requirements:
130
- - - ">="
130
+ - - ! '>='
131
131
  - !ruby/object:Gem::Version
132
132
  version: '0'
133
133
  type: :development
134
134
  prerelease: false
135
135
  version_requirements: !ruby/object:Gem::Requirement
136
136
  requirements:
137
- - - ">="
137
+ - - ! '>='
138
138
  - !ruby/object:Gem::Version
139
139
  version: '0'
140
- description: 'Ruby wrapped KAF based Tree Tagger for 6 languages '
140
+ description: ! 'Ruby wrapped KAF based Tree Tagger for 6 languages '
141
141
  email:
142
142
  - ruben.izquierdobevia@vu.nl
143
143
  - wilco@olery.com
144
144
  executables:
145
145
  - tree-tagger
146
- - opener-tree-tagger-daemon
147
- - opener-tree-tagger-server
146
+ - tree-tagger-daemon
147
+ - tree-tagger-server
148
148
  extensions:
149
149
  - ext/hack/Rakefile
150
150
  extra_rdoc_files: []
151
151
  files:
152
- - README.md
153
- - bin/opener-tree-tagger-daemon
154
- - bin/opener-tree-tagger-server
155
- - bin/tree-tagger
156
- - config.ru
157
152
  - core/dutch.map.treetagger.kaf.csv
158
153
  - core/english.map.treetagger.kaf.csv
159
154
  - core/french.map.treetagger.kaf.csv
@@ -165,15 +160,20 @@ files:
165
160
  - exec/tree-tagger.rb
166
161
  - ext/hack/Rakefile
167
162
  - ext/hack/support.rb
168
- - lib/opener/tree_tagger.rb
169
163
  - lib/opener/tree_tagger/cli.rb
170
164
  - lib/opener/tree_tagger/public/markdown.css
171
165
  - lib/opener/tree_tagger/server.rb
172
166
  - lib/opener/tree_tagger/version.rb
173
167
  - lib/opener/tree_tagger/views/index.erb
174
168
  - lib/opener/tree_tagger/views/result.erb
169
+ - lib/opener/tree_tagger.rb
170
+ - config.ru
175
171
  - opener-tree-tagger.gemspec
176
172
  - pre_install_requirements.txt
173
+ - README.md
174
+ - bin/tree-tagger
175
+ - bin/tree-tagger-daemon
176
+ - bin/tree-tagger-server
177
177
  homepage: http://opener-project.github.com/
178
178
  licenses: []
179
179
  metadata: {}
@@ -183,19 +183,18 @@ require_paths:
183
183
  - lib
184
184
  required_ruby_version: !ruby/object:Gem::Requirement
185
185
  requirements:
186
- - - ">="
186
+ - - ! '>='
187
187
  - !ruby/object:Gem::Version
188
188
  version: '0'
189
189
  required_rubygems_version: !ruby/object:Gem::Requirement
190
190
  requirements:
191
- - - ">="
191
+ - - ! '>='
192
192
  - !ruby/object:Gem::Version
193
193
  version: '0'
194
194
  requirements: []
195
195
  rubyforge_project:
196
- rubygems_version: 2.2.2
196
+ rubygems_version: 2.1.11
197
197
  signing_key:
198
198
  specification_version: 4
199
199
  summary: Ruby wrapped KAF based Tree Tagger for 6 languages
200
200
  test_files: []
201
- has_rdoc: