cascading.jruby 0.0.10 → 1.0.0
Sign up to get free protection for your applications and to get access to all the features.
- data/LICENSE.txt +13 -160
- data/README.md +35 -0
- data/lib/cascading.rb +8 -41
- data/lib/cascading/aggregations.rb +216 -71
- data/lib/cascading/assembly.rb +409 -606
- data/lib/cascading/base.rb +22 -0
- data/lib/cascading/cascade.rb +55 -18
- data/lib/cascading/cascading.rb +137 -47
- data/lib/cascading/expr_stub.rb +31 -17
- data/lib/cascading/ext/array.rb +17 -0
- data/lib/cascading/filter_operations.rb +101 -0
- data/lib/cascading/flow.rb +87 -23
- data/lib/cascading/identity_operations.rb +82 -0
- data/lib/cascading/mode.rb +14 -10
- data/lib/cascading/operations.rb +109 -174
- data/lib/cascading/regex_operations.rb +133 -0
- data/lib/cascading/scope.rb +32 -9
- data/lib/cascading/sub_assembly.rb +8 -5
- data/lib/cascading/tap.rb +41 -17
- data/lib/cascading/text_operations.rb +67 -0
- data/test/mock_assemblies.rb +55 -0
- data/test/test_assembly.rb +23 -25
- data/test/test_local_execution.rb +7 -7
- data/test/test_operations.rb +0 -10
- metadata +76 -74
- data/History.txt +0 -58
data/History.txt
DELETED
@@ -1,58 +0,0 @@
|
|
1
|
-
0.0.10 - Introduce Jading, cleanup, and library standardization
|
2
|
-
|
3
|
-
This release removes the code associated with running jobs on a Hadoop cluster
|
4
|
-
as that functionality is now moved to Jading. This separates the DSL library (a
|
5
|
-
gem) from the repository required to build and package job jars (Jading).
|
6
|
-
Additionally, this release removes a lot of the auto-generated Rake garbage
|
7
|
-
inherited from the original version and greatly streamlines the packaged gem.
|
8
|
-
Finally, it starts the precedent for making the contract of operations idiomatic
|
9
|
-
Ruby, removing the unnecessary Operations module, and eventually eliminating
|
10
|
-
global cascade and flow registries. A non-backwards compatible change was made
|
11
|
-
to the contract of complete and draw which allowed the mechnism for propagating
|
12
|
-
properties through a job to be righted and made more Hadoop-idiomatic.
|
13
|
-
|
14
|
-
This release removes all the cruft associated with running jobs
|
15
|
-
|
16
|
-
0.0.9 - Cascading local mode and upgrade to Cascading 2.0.0
|
17
|
-
|
18
|
-
This release upgrades to Cascading 2.0.0 (final) and introduces Cascading local
|
19
|
-
mode. Ambiguous node names are now prohibited and the insert helper correctly
|
20
|
-
supports constants.
|
21
|
-
|
22
|
-
0.0.8 - AggregateBy and upgrade to Cascading 2.0.0 wip-286
|
23
|
-
|
24
|
-
This release upgrades to Cascading 2.0.0 wip-286, but again does not implement
|
25
|
-
local mode. It does, however, replace group_by/union which contain only count,
|
26
|
-
sum, and average with the corresponding composite AggregateBy. Various
|
27
|
-
refactorings were required to support this, including the addition of limited
|
28
|
-
support for SubAssemblies.
|
29
|
-
|
30
|
-
0.0.7 - Upgrade to Cascading 2.0.0 wip-255
|
31
|
-
|
32
|
-
This release upgrades to Cascading 2.0.0 wip-255, but implements neither local
|
33
|
-
mode nor aggregations through AggregateBy. Local jobs continue to run in Hadoop
|
34
|
-
mode, but we intend to release local mode support soon.
|
35
|
-
|
36
|
-
0.0.6 - Removing primary key
|
37
|
-
|
38
|
-
The primary key feature was a source of great confusion at Etsy, so it's been
|
39
|
-
removed. This release also closes several issues, warns about potential node
|
40
|
-
name conflicts, and updates the tests to work under JRuby 1.6.5.
|
41
|
-
|
42
|
-
0.0.5 - Addressing Janino pain
|
43
|
-
|
44
|
-
This release expands upon the ExprStub class adding composition time compilation
|
45
|
-
and validation of Janino expressions. This causes faulty Janino expressions to
|
46
|
-
fail early rather than hours into a job.
|
47
|
-
|
48
|
-
0.0.4 - Cleanup
|
49
|
-
|
50
|
-
This release merges in a good deal of work from Etsy and addresses many internal
|
51
|
-
structural issues with cascading.jruby node hierarchies. Greatly expands unit
|
52
|
-
tests and makes samples easily executable as a form of functional testing.
|
53
|
-
|
54
|
-
0.0.3 - Etsy's first version of cascading.jruby
|
55
|
-
|
56
|
-
First major commit of work from Etsy that introduces scope propagation to
|
57
|
-
cascading.jruby scripts in support of field propagation and primary keys.
|
58
|
-
Mainly a cleanup and testing release.
|