wukong-hadoop 0.1.0 → 0.1.1
Sign up to get free protection for your applications and to get access to all the features.
- data/README.md +5 -3
- data/lib/wukong-hadoop/version.rb +1 -2
- data/wukong-hadoop.gemspec +1 -1
- metadata +11 -5
data/README.md
CHANGED
@@ -1,19 +1,21 @@
|
|
1
1
|
# Wukong-Hadoop
|
2
2
|
|
3
3
|
The Hadoop plugin for Wukong lets you run <a
|
4
|
-
href="http://github.com/infochimps-labs/wukong">Wukong processors</a>
|
4
|
+
href="http://github.com/infochimps-labs/wukong/tree/3.0.0">Wukong processors</a>
|
5
5
|
through <a href="http://hadoop.apache.org/">Hadoop's</a> command-line
|
6
6
|
<a
|
7
7
|
href="http://hadoop.apache.org/docs/r0.15.2/streaming.html">streaming
|
8
8
|
interface</a>.
|
9
9
|
|
10
10
|
Before you use Wukong-Hadoop to develop, test, and write your Hadoop
|
11
|
-
jobs, you might want to read about <a href="http://github.com/infochimps-labs/wukong">Wukong</a>, write some
|
12
|
-
<a href="http://github.com/infochimps-labs/wukong#processors">simple processors</a>, and read about the structure of a <a href="http://en.wikipedia.org/wiki/MapReduce">map/reduce job</a>.
|
11
|
+
jobs, you might want to read about <a href="http://github.com/infochimps-labs/wukong/tree/3.0.0">Wukong</a>, write some
|
12
|
+
<a href="http://github.com/infochimps-labs/wukong/tree/3.0.0#writing-simple-processors">simple processors</a>, and read about the structure of a <a href="http://en.wikipedia.org/wiki/MapReduce">map/reduce job</a>.
|
13
13
|
|
14
14
|
You might also want to check out some other projects which enrich the
|
15
15
|
Wukong and Hadoop experience:
|
16
16
|
|
17
|
+
* <a href="http://github.com/infochimps-labs/wukong-storm">wukong-storm</a>: Run Wukong processors within the Storm framework. Model flows locally before you run them.
|
18
|
+
* <a href="http://github.com/infochimps-labs/wukong-load">wukong-load</a>: Load the output data from your local Wukong jobs and flows into a variety of different data stores.
|
17
19
|
* <a href="http://github.com/infochimps-labs/wonderdog">wonderdog</a>: Connect Wukong processors running within Hadoop to Elasticsearch as either a source or sink for data.
|
18
20
|
* <a href="http://github.com/infochimps-labs/wukong-deploy">wukong-deploy</a>: Orchestrate Wukong and other wu-tools together to support an application running on the Infochimps Platform.
|
19
21
|
|
data/wukong-hadoop.gemspec
CHANGED
metadata
CHANGED
@@ -1,7 +1,7 @@
|
|
1
1
|
--- !ruby/object:Gem::Specification
|
2
2
|
name: wukong-hadoop
|
3
3
|
version: !ruby/object:Gem::Version
|
4
|
-
version: 0.1.
|
4
|
+
version: 0.1.1
|
5
5
|
prerelease:
|
6
6
|
platform: ruby
|
7
7
|
authors:
|
@@ -11,7 +11,7 @@ authors:
|
|
11
11
|
autorequire:
|
12
12
|
bindir: bin
|
13
13
|
cert_chain: []
|
14
|
-
date: 2013-
|
14
|
+
date: 2013-03-07 00:00:00.000000000 Z
|
15
15
|
dependencies:
|
16
16
|
- !ruby/object:Gem::Dependency
|
17
17
|
name: wukong
|
@@ -20,7 +20,7 @@ dependencies:
|
|
20
20
|
requirements:
|
21
21
|
- - '='
|
22
22
|
- !ruby/object:Gem::Version
|
23
|
-
version: 3.0.
|
23
|
+
version: 3.0.1
|
24
24
|
type: :runtime
|
25
25
|
prerelease: false
|
26
26
|
version_requirements: !ruby/object:Gem::Requirement
|
@@ -28,7 +28,7 @@ dependencies:
|
|
28
28
|
requirements:
|
29
29
|
- - '='
|
30
30
|
- !ruby/object:Gem::Version
|
31
|
-
version: 3.0.
|
31
|
+
version: 3.0.1
|
32
32
|
description: ! " Treat your dataset like a:\n\n * stream of lines when it's
|
33
33
|
efficient to process by lines\n * stream of field arrays when it's efficient
|
34
34
|
to deal directly with fields\n * stream of lightweight objects when it's efficient
|
@@ -111,15 +111,21 @@ required_ruby_version: !ruby/object:Gem::Requirement
|
|
111
111
|
- - ! '>='
|
112
112
|
- !ruby/object:Gem::Version
|
113
113
|
version: '0'
|
114
|
+
segments:
|
115
|
+
- 0
|
116
|
+
hash: -3850081407008684305
|
114
117
|
required_rubygems_version: !ruby/object:Gem::Requirement
|
115
118
|
none: false
|
116
119
|
requirements:
|
117
120
|
- - ! '>='
|
118
121
|
- !ruby/object:Gem::Version
|
119
122
|
version: '0'
|
123
|
+
segments:
|
124
|
+
- 0
|
125
|
+
hash: -3850081407008684305
|
120
126
|
requirements: []
|
121
127
|
rubyforge_project:
|
122
|
-
rubygems_version: 1.8.
|
128
|
+
rubygems_version: 1.8.24
|
123
129
|
signing_key:
|
124
130
|
specification_version: 3
|
125
131
|
summary: Hadoop Streaming for Ruby. Wukong makes Hadoop so easy a chimpanzee can use
|