opener-s3-outlet 1.1.1 → 1.1.2
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- checksums.yaml +4 -4
- data/README.md +15 -30
- data/lib/opener/s3_outlet/server.rb +23 -0
- data/lib/opener/s3_outlet/version.rb +1 -1
- data/lib/opener/s3_outlet.rb +1 -0
- data/opener-s3-outlet.gemspec +1 -0
- metadata +87 -74
checksums.yaml
CHANGED
@@ -1,7 +1,7 @@
|
|
1
1
|
---
|
2
2
|
SHA1:
|
3
|
-
metadata.gz:
|
4
|
-
data.tar.gz:
|
3
|
+
metadata.gz: 996182598f2173c062a335b5ca407fc53ff9f712
|
4
|
+
data.tar.gz: b9833d2559ca024f8b046382f07a9e52ccd56ff9
|
5
5
|
SHA512:
|
6
|
-
metadata.gz:
|
7
|
-
data.tar.gz:
|
6
|
+
metadata.gz: 1b51a14557155c616ee244ff65dc4645270baa698bc48b5c19671bcf5069290ea5bfb027be2b7b35eaed83494207fbdd8cfbf0a82e57a985cb9358e51e5ab814
|
7
|
+
data.tar.gz: 605a4c06fb874aeb4f51a344e8b08c71d1871e68a5fa98a280c5c0b528736c399a21eacf7c339446cf3557681caded6ecdbdcbe00647e4f814635e0a6e75a61e
|
data/README.md
CHANGED
@@ -6,11 +6,7 @@ Database and shows them into your browser.
|
|
6
6
|
|
7
7
|
### Confused by some terminology?
|
8
8
|
|
9
|
-
This software is part of a larger collection of natural language processing
|
10
|
-
tools known as "the OpeNER project". You can find more information about the
|
11
|
-
project at (the OpeNER portal)[http://opener-project.github.io]. There you can
|
12
|
-
also find references to terms like KAF (an XML standard to represent linguistic
|
13
|
-
annotations in texts), component, cores, scenario's and pipelines.
|
9
|
+
This software is part of a larger collection of natural language processing tools known as "the OpeNER project". You can find more information about the project at [the OpeNER portal](http://opener-project.github.io). There you can also find references to terms like KAF (an XML standard to represent linguistic annotations in texts), component, cores, scenario's and pipelines.
|
14
10
|
|
15
11
|
Quick Use Example
|
16
12
|
-----------------
|
@@ -19,8 +15,7 @@ Installing the s3-outlet can be done by executing:
|
|
19
15
|
|
20
16
|
gem install opener-s3-outlet
|
21
17
|
|
22
|
-
Please bare in mind that all components in OpeNER take KAF as an input and
|
23
|
-
output KAF by default.
|
18
|
+
Please bare in mind that all components in OpeNER take KAF as an input and output KAF by default.
|
24
19
|
|
25
20
|
### Webservices
|
26
21
|
|
@@ -28,26 +23,20 @@ You can launch a webservice by executing:
|
|
28
23
|
|
29
24
|
s3-outlet-server
|
30
25
|
|
31
|
-
This will launch a mini webserver with the webservice. It defaults to port 9292,
|
32
|
-
so you can access it at <http://localhost:9292>.
|
26
|
+
This will launch a mini webserver with the webservice. It defaults to port 9292, so you can access it at <http://localhost:9292>.
|
33
27
|
|
34
|
-
To launch it on a different port provide the `-p [port-number]` option like
|
35
|
-
this:
|
28
|
+
To launch it on a different port provide the `-p [port-number]` option like this:
|
36
29
|
|
37
30
|
s3-outlet-server -p 1234
|
38
31
|
|
39
32
|
It then launches at <http://localhost:1234>
|
40
33
|
|
41
|
-
Documentation on the Webservice is provided by surfing to the urls provided
|
42
|
-
above. For more information on how to launch a webservice run the command with
|
43
|
-
the ```-h``` option.
|
34
|
+
Documentation on the Webservice is provided by surfing to the urls provided above. For more information on how to launch a webservice run the command with the ```-h``` option.
|
44
35
|
|
45
36
|
|
46
37
|
### Daemon
|
47
38
|
|
48
|
-
Last but not least the s3-outlet comes shipped with a daemon that
|
49
|
-
can read jobs (and write) jobs to and from Amazon SQS queues. For more
|
50
|
-
information type:
|
39
|
+
Last but not least the s3-outlet comes shipped with a daemon that can read jobs (and write) jobs to and from Amazon SQS queues. For more information type:
|
51
40
|
|
52
41
|
s3-outlet-daemon -h
|
53
42
|
|
@@ -55,11 +44,8 @@ information type:
|
|
55
44
|
Description of dependencies
|
56
45
|
---------------------------
|
57
46
|
|
58
|
-
This component runs best if you run it in an environment suited for OpeNER
|
59
|
-
|
60
|
-
installer)[https://github.com/opener-project/opener-installer] and (an
|
61
|
-
installation guide on the Opener
|
62
|
-
Website)[http://opener-project.github.io/getting-started/how-to/local-installation.html]
|
47
|
+
This component runs best if you run it in an environment suited for OpeNER components. You can find an installation guide and helper tools in the [OpeNER installer](https://github.com/opener-project/opener-installer) and an
|
48
|
+
[installation guide on the Opener Website](http://opener-project.github.io/getting-started/how-to/local-installation.html)
|
63
49
|
|
64
50
|
At least you need the following system setup:
|
65
51
|
|
@@ -81,29 +67,28 @@ Language Extension
|
|
81
67
|
The Core
|
82
68
|
--------
|
83
69
|
|
84
|
-
The component is a fat wrapper around the actual language technology core. You
|
85
|
-
can find the core technolies in the following repositories:
|
70
|
+
The component is a fat wrapper around the actual language technology core. You can find the core technologies in the following repositories:
|
86
71
|
|
87
72
|
* (link to) Related Core readmes
|
88
73
|
|
89
74
|
Where to go from here
|
90
75
|
---------------------
|
91
76
|
|
92
|
-
* Check
|
93
|
-
*
|
77
|
+
* [Check the project websitere](http://opener-project.github.io)
|
78
|
+
* [Checkout the webservice](http://opener.olery.com/s3-outlet)
|
94
79
|
|
95
80
|
Report problem/Get help
|
96
81
|
-----------------------
|
97
82
|
|
98
|
-
If you encounter problems, please email support@opener-project.eu or leave an
|
99
|
-
issue
|
83
|
+
If you encounter problems, please email support@opener-project.eu or leave an issue in the
|
84
|
+
[issue tracker](https://github.com/opener-project/s3-outlet/issues).
|
100
85
|
|
101
86
|
|
102
87
|
Contributing
|
103
88
|
------------
|
104
89
|
|
105
|
-
1. Fork it
|
90
|
+
1. Fork it <http://github.com/opener-project/s3-outlet/fork>
|
106
91
|
2. Create your feature branch (`git checkout -b my-new-feature`)
|
107
92
|
3. Commit your changes (`git commit -am 'Add some feature'`)
|
108
93
|
4. Push to the branch (`git push origin my-new-feature`)
|
109
|
-
5. Create new Pull Request
|
94
|
+
5. Create new Pull Request
|
@@ -18,6 +18,29 @@ module Opener
|
|
18
18
|
erb :index
|
19
19
|
end
|
20
20
|
end
|
21
|
+
|
22
|
+
get '/:request_id.json' do
|
23
|
+
unless params[:request_id] == 'favicon.ico'
|
24
|
+
begin
|
25
|
+
output = S3Output.find(params[:request_id])
|
26
|
+
|
27
|
+
if output
|
28
|
+
content_type('text/json')
|
29
|
+
kj = Opener::KafToJson.new
|
30
|
+
json = kj.run(output.text) rescue output.text
|
31
|
+
body(json)
|
32
|
+
else
|
33
|
+
halt(404, "No record found for ID #{params[:request_id]}")
|
34
|
+
end
|
35
|
+
rescue => error
|
36
|
+
error_callback = params[:error_callback]
|
37
|
+
|
38
|
+
submit_error(error_callback, error.message) if error_callback
|
39
|
+
|
40
|
+
raise(error)
|
41
|
+
end
|
42
|
+
end
|
43
|
+
end
|
21
44
|
|
22
45
|
get '/:request_id' do
|
23
46
|
unless params[:request_id] == 'favicon.ico'
|
data/lib/opener/s3_outlet.rb
CHANGED
data/opener-s3-outlet.gemspec
CHANGED
metadata
CHANGED
@@ -1,199 +1,213 @@
|
|
1
1
|
--- !ruby/object:Gem::Specification
|
2
2
|
name: opener-s3-outlet
|
3
3
|
version: !ruby/object:Gem::Version
|
4
|
-
version: 1.1.
|
4
|
+
version: 1.1.2
|
5
5
|
platform: ruby
|
6
6
|
authors:
|
7
7
|
- development@olery.com
|
8
|
-
autorequire:
|
8
|
+
autorequire:
|
9
9
|
bindir: bin
|
10
10
|
cert_chain: []
|
11
11
|
date: 2014-05-23 00:00:00.000000000 Z
|
12
12
|
dependencies:
|
13
13
|
- !ruby/object:Gem::Dependency
|
14
14
|
name: builder
|
15
|
-
|
15
|
+
version_requirements: !ruby/object:Gem::Requirement
|
16
16
|
requirements:
|
17
|
-
- -
|
17
|
+
- - '>='
|
18
18
|
- !ruby/object:Gem::Version
|
19
19
|
version: '0'
|
20
|
-
|
21
|
-
prerelease: false
|
22
|
-
version_requirements: !ruby/object:Gem::Requirement
|
20
|
+
requirement: !ruby/object:Gem::Requirement
|
23
21
|
requirements:
|
24
|
-
- -
|
22
|
+
- - '>='
|
25
23
|
- !ruby/object:Gem::Version
|
26
24
|
version: '0'
|
25
|
+
prerelease: false
|
26
|
+
type: :runtime
|
27
27
|
- !ruby/object:Gem::Dependency
|
28
28
|
name: sinatra
|
29
|
-
|
29
|
+
version_requirements: !ruby/object:Gem::Requirement
|
30
30
|
requirements:
|
31
|
-
- -
|
31
|
+
- - ~>
|
32
32
|
- !ruby/object:Gem::Version
|
33
33
|
version: 1.4.2
|
34
|
-
|
35
|
-
prerelease: false
|
36
|
-
version_requirements: !ruby/object:Gem::Requirement
|
34
|
+
requirement: !ruby/object:Gem::Requirement
|
37
35
|
requirements:
|
38
|
-
- -
|
36
|
+
- - ~>
|
39
37
|
- !ruby/object:Gem::Version
|
40
38
|
version: 1.4.2
|
39
|
+
prerelease: false
|
40
|
+
type: :runtime
|
41
41
|
- !ruby/object:Gem::Dependency
|
42
42
|
name: nokogiri
|
43
|
+
version_requirements: !ruby/object:Gem::Requirement
|
44
|
+
requirements:
|
45
|
+
- - '>='
|
46
|
+
- !ruby/object:Gem::Version
|
47
|
+
version: '0'
|
43
48
|
requirement: !ruby/object:Gem::Requirement
|
44
49
|
requirements:
|
45
|
-
- -
|
50
|
+
- - '>='
|
46
51
|
- !ruby/object:Gem::Version
|
47
52
|
version: '0'
|
48
|
-
type: :runtime
|
49
53
|
prerelease: false
|
54
|
+
type: :runtime
|
55
|
+
- !ruby/object:Gem::Dependency
|
56
|
+
name: httpclient
|
50
57
|
version_requirements: !ruby/object:Gem::Requirement
|
51
58
|
requirements:
|
52
|
-
- -
|
59
|
+
- - '>='
|
53
60
|
- !ruby/object:Gem::Version
|
54
61
|
version: '0'
|
55
|
-
- !ruby/object:Gem::Dependency
|
56
|
-
name: httpclient
|
57
62
|
requirement: !ruby/object:Gem::Requirement
|
58
63
|
requirements:
|
59
|
-
- -
|
64
|
+
- - '>='
|
60
65
|
- !ruby/object:Gem::Version
|
61
66
|
version: '0'
|
62
|
-
type: :runtime
|
63
67
|
prerelease: false
|
68
|
+
type: :runtime
|
69
|
+
- !ruby/object:Gem::Dependency
|
70
|
+
name: uuidtools
|
64
71
|
version_requirements: !ruby/object:Gem::Requirement
|
65
72
|
requirements:
|
66
|
-
- -
|
73
|
+
- - '>='
|
67
74
|
- !ruby/object:Gem::Version
|
68
75
|
version: '0'
|
69
|
-
- !ruby/object:Gem::Dependency
|
70
|
-
name: uuidtools
|
71
76
|
requirement: !ruby/object:Gem::Requirement
|
72
77
|
requirements:
|
73
|
-
- -
|
78
|
+
- - '>='
|
74
79
|
- !ruby/object:Gem::Version
|
75
80
|
version: '0'
|
76
|
-
type: :runtime
|
77
81
|
prerelease: false
|
82
|
+
type: :runtime
|
83
|
+
- !ruby/object:Gem::Dependency
|
84
|
+
name: opener-webservice
|
78
85
|
version_requirements: !ruby/object:Gem::Requirement
|
79
86
|
requirements:
|
80
|
-
- -
|
87
|
+
- - '>='
|
81
88
|
- !ruby/object:Gem::Version
|
82
89
|
version: '0'
|
83
|
-
- !ruby/object:Gem::Dependency
|
84
|
-
name: opener-webservice
|
85
90
|
requirement: !ruby/object:Gem::Requirement
|
86
91
|
requirements:
|
87
|
-
- -
|
92
|
+
- - '>='
|
88
93
|
- !ruby/object:Gem::Version
|
89
94
|
version: '0'
|
90
|
-
type: :runtime
|
91
95
|
prerelease: false
|
96
|
+
type: :runtime
|
97
|
+
- !ruby/object:Gem::Dependency
|
98
|
+
name: opener-daemons
|
92
99
|
version_requirements: !ruby/object:Gem::Requirement
|
93
100
|
requirements:
|
94
|
-
- -
|
101
|
+
- - '>='
|
95
102
|
- !ruby/object:Gem::Version
|
96
103
|
version: '0'
|
97
|
-
- !ruby/object:Gem::Dependency
|
98
|
-
name: opener-daemons
|
99
104
|
requirement: !ruby/object:Gem::Requirement
|
100
105
|
requirements:
|
101
|
-
- -
|
106
|
+
- - '>='
|
102
107
|
- !ruby/object:Gem::Version
|
103
108
|
version: '0'
|
104
|
-
type: :runtime
|
105
109
|
prerelease: false
|
110
|
+
type: :runtime
|
111
|
+
- !ruby/object:Gem::Dependency
|
112
|
+
name: opener-kaf2json
|
106
113
|
version_requirements: !ruby/object:Gem::Requirement
|
107
114
|
requirements:
|
108
|
-
- -
|
115
|
+
- - '>='
|
109
116
|
- !ruby/object:Gem::Version
|
110
117
|
version: '0'
|
111
|
-
- !ruby/object:Gem::Dependency
|
112
|
-
name: aws-sdk
|
113
118
|
requirement: !ruby/object:Gem::Requirement
|
114
119
|
requirements:
|
115
|
-
- -
|
120
|
+
- - '>='
|
116
121
|
- !ruby/object:Gem::Version
|
117
122
|
version: '0'
|
118
|
-
type: :runtime
|
119
123
|
prerelease: false
|
124
|
+
type: :runtime
|
125
|
+
- !ruby/object:Gem::Dependency
|
126
|
+
name: aws-sdk
|
120
127
|
version_requirements: !ruby/object:Gem::Requirement
|
121
128
|
requirements:
|
122
|
-
- -
|
129
|
+
- - '>='
|
123
130
|
- !ruby/object:Gem::Version
|
124
131
|
version: '0'
|
125
|
-
- !ruby/object:Gem::Dependency
|
126
|
-
name: puma
|
127
132
|
requirement: !ruby/object:Gem::Requirement
|
128
133
|
requirements:
|
129
|
-
- -
|
134
|
+
- - '>='
|
130
135
|
- !ruby/object:Gem::Version
|
131
136
|
version: '0'
|
132
|
-
type: :runtime
|
133
137
|
prerelease: false
|
138
|
+
type: :runtime
|
139
|
+
- !ruby/object:Gem::Dependency
|
140
|
+
name: puma
|
134
141
|
version_requirements: !ruby/object:Gem::Requirement
|
135
142
|
requirements:
|
136
|
-
- -
|
143
|
+
- - '>='
|
137
144
|
- !ruby/object:Gem::Version
|
138
145
|
version: '0'
|
139
|
-
- !ruby/object:Gem::Dependency
|
140
|
-
name: rspec
|
141
146
|
requirement: !ruby/object:Gem::Requirement
|
142
147
|
requirements:
|
143
|
-
- -
|
148
|
+
- - '>='
|
144
149
|
- !ruby/object:Gem::Version
|
145
150
|
version: '0'
|
146
|
-
type: :development
|
147
151
|
prerelease: false
|
152
|
+
type: :runtime
|
153
|
+
- !ruby/object:Gem::Dependency
|
154
|
+
name: rspec
|
148
155
|
version_requirements: !ruby/object:Gem::Requirement
|
149
156
|
requirements:
|
150
|
-
- -
|
157
|
+
- - '>='
|
151
158
|
- !ruby/object:Gem::Version
|
152
159
|
version: '0'
|
153
|
-
- !ruby/object:Gem::Dependency
|
154
|
-
name: cucumber
|
155
160
|
requirement: !ruby/object:Gem::Requirement
|
156
161
|
requirements:
|
157
|
-
- -
|
162
|
+
- - '>='
|
158
163
|
- !ruby/object:Gem::Version
|
159
164
|
version: '0'
|
160
|
-
type: :development
|
161
165
|
prerelease: false
|
166
|
+
type: :development
|
167
|
+
- !ruby/object:Gem::Dependency
|
168
|
+
name: cucumber
|
162
169
|
version_requirements: !ruby/object:Gem::Requirement
|
163
170
|
requirements:
|
164
|
-
- -
|
171
|
+
- - '>='
|
165
172
|
- !ruby/object:Gem::Version
|
166
173
|
version: '0'
|
167
|
-
- !ruby/object:Gem::Dependency
|
168
|
-
name: pry
|
169
174
|
requirement: !ruby/object:Gem::Requirement
|
170
175
|
requirements:
|
171
|
-
- -
|
176
|
+
- - '>='
|
172
177
|
- !ruby/object:Gem::Version
|
173
178
|
version: '0'
|
174
|
-
type: :development
|
175
179
|
prerelease: false
|
180
|
+
type: :development
|
181
|
+
- !ruby/object:Gem::Dependency
|
182
|
+
name: pry
|
176
183
|
version_requirements: !ruby/object:Gem::Requirement
|
177
184
|
requirements:
|
178
|
-
- -
|
185
|
+
- - '>='
|
179
186
|
- !ruby/object:Gem::Version
|
180
187
|
version: '0'
|
181
|
-
- !ruby/object:Gem::Dependency
|
182
|
-
name: rake
|
183
188
|
requirement: !ruby/object:Gem::Requirement
|
184
189
|
requirements:
|
185
|
-
- -
|
190
|
+
- - '>='
|
186
191
|
- !ruby/object:Gem::Version
|
187
192
|
version: '0'
|
188
|
-
type: :development
|
189
193
|
prerelease: false
|
194
|
+
type: :development
|
195
|
+
- !ruby/object:Gem::Dependency
|
196
|
+
name: rake
|
190
197
|
version_requirements: !ruby/object:Gem::Requirement
|
191
198
|
requirements:
|
192
|
-
- -
|
199
|
+
- - '>='
|
193
200
|
- !ruby/object:Gem::Version
|
194
201
|
version: '0'
|
202
|
+
requirement: !ruby/object:Gem::Requirement
|
203
|
+
requirements:
|
204
|
+
- - '>='
|
205
|
+
- !ruby/object:Gem::Version
|
206
|
+
version: '0'
|
207
|
+
prerelease: false
|
208
|
+
type: :development
|
195
209
|
description: S3 Bucket data storing for the web services output when using callbacks.
|
196
|
-
email:
|
210
|
+
email:
|
197
211
|
executables:
|
198
212
|
- s3-outlet-daemon
|
199
213
|
- s3-outlet-server
|
@@ -219,25 +233,24 @@ files:
|
|
219
233
|
homepage: http://opener-project.github.com/
|
220
234
|
licenses: []
|
221
235
|
metadata: {}
|
222
|
-
post_install_message:
|
236
|
+
post_install_message:
|
223
237
|
rdoc_options: []
|
224
238
|
require_paths:
|
225
239
|
- lib
|
226
240
|
required_ruby_version: !ruby/object:Gem::Requirement
|
227
241
|
requirements:
|
228
|
-
- -
|
242
|
+
- - '>='
|
229
243
|
- !ruby/object:Gem::Version
|
230
244
|
version: 1.9.2
|
231
245
|
required_rubygems_version: !ruby/object:Gem::Requirement
|
232
246
|
requirements:
|
233
|
-
- -
|
247
|
+
- - '>='
|
234
248
|
- !ruby/object:Gem::Version
|
235
249
|
version: '0'
|
236
250
|
requirements: []
|
237
|
-
rubyforge_project:
|
251
|
+
rubyforge_project:
|
238
252
|
rubygems_version: 2.2.2
|
239
|
-
signing_key:
|
253
|
+
signing_key:
|
240
254
|
specification_version: 4
|
241
255
|
summary: S3 Bucket data storing for the web services output when using callbacks.
|
242
256
|
test_files: []
|
243
|
-
has_rdoc: yard
|