cascading.jruby 0.0.10 → 1.0.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (26) hide show
  1. data/LICENSE.txt +13 -160
  2. data/README.md +35 -0
  3. data/lib/cascading.rb +8 -41
  4. data/lib/cascading/aggregations.rb +216 -71
  5. data/lib/cascading/assembly.rb +409 -606
  6. data/lib/cascading/base.rb +22 -0
  7. data/lib/cascading/cascade.rb +55 -18
  8. data/lib/cascading/cascading.rb +137 -47
  9. data/lib/cascading/expr_stub.rb +31 -17
  10. data/lib/cascading/ext/array.rb +17 -0
  11. data/lib/cascading/filter_operations.rb +101 -0
  12. data/lib/cascading/flow.rb +87 -23
  13. data/lib/cascading/identity_operations.rb +82 -0
  14. data/lib/cascading/mode.rb +14 -10
  15. data/lib/cascading/operations.rb +109 -174
  16. data/lib/cascading/regex_operations.rb +133 -0
  17. data/lib/cascading/scope.rb +32 -9
  18. data/lib/cascading/sub_assembly.rb +8 -5
  19. data/lib/cascading/tap.rb +41 -17
  20. data/lib/cascading/text_operations.rb +67 -0
  21. data/test/mock_assemblies.rb +55 -0
  22. data/test/test_assembly.rb +23 -25
  23. data/test/test_local_execution.rb +7 -7
  24. data/test/test_operations.rb +0 -10
  25. metadata +76 -74
  26. data/History.txt +0 -58
data/History.txt DELETED
@@ -1,58 +0,0 @@
1
- 0.0.10 - Introduce Jading, cleanup, and library standardization
2
-
3
- This release removes the code associated with running jobs on a Hadoop cluster
4
- as that functionality is now moved to Jading. This separates the DSL library (a
5
- gem) from the repository required to build and package job jars (Jading).
6
- Additionally, this release removes a lot of the auto-generated Rake garbage
7
- inherited from the original version and greatly streamlines the packaged gem.
8
- Finally, it starts the precedent for making the contract of operations idiomatic
9
- Ruby, removing the unnecessary Operations module, and eventually eliminating
10
- global cascade and flow registries. A non-backwards compatible change was made
11
- to the contract of complete and draw which allowed the mechnism for propagating
12
- properties through a job to be righted and made more Hadoop-idiomatic.
13
-
14
- This release removes all the cruft associated with running jobs
15
-
16
- 0.0.9 - Cascading local mode and upgrade to Cascading 2.0.0
17
-
18
- This release upgrades to Cascading 2.0.0 (final) and introduces Cascading local
19
- mode. Ambiguous node names are now prohibited and the insert helper correctly
20
- supports constants.
21
-
22
- 0.0.8 - AggregateBy and upgrade to Cascading 2.0.0 wip-286
23
-
24
- This release upgrades to Cascading 2.0.0 wip-286, but again does not implement
25
- local mode. It does, however, replace group_by/union which contain only count,
26
- sum, and average with the corresponding composite AggregateBy. Various
27
- refactorings were required to support this, including the addition of limited
28
- support for SubAssemblies.
29
-
30
- 0.0.7 - Upgrade to Cascading 2.0.0 wip-255
31
-
32
- This release upgrades to Cascading 2.0.0 wip-255, but implements neither local
33
- mode nor aggregations through AggregateBy. Local jobs continue to run in Hadoop
34
- mode, but we intend to release local mode support soon.
35
-
36
- 0.0.6 - Removing primary key
37
-
38
- The primary key feature was a source of great confusion at Etsy, so it's been
39
- removed. This release also closes several issues, warns about potential node
40
- name conflicts, and updates the tests to work under JRuby 1.6.5.
41
-
42
- 0.0.5 - Addressing Janino pain
43
-
44
- This release expands upon the ExprStub class adding composition time compilation
45
- and validation of Janino expressions. This causes faulty Janino expressions to
46
- fail early rather than hours into a job.
47
-
48
- 0.0.4 - Cleanup
49
-
50
- This release merges in a good deal of work from Etsy and addresses many internal
51
- structural issues with cascading.jruby node hierarchies. Greatly expands unit
52
- tests and makes samples easily executable as a form of functional testing.
53
-
54
- 0.0.3 - Etsy's first version of cascading.jruby
55
-
56
- First major commit of work from Etsy that introduces scope propagation to
57
- cascading.jruby scripts in support of field propagation and primary keys.
58
- Mainly a cleanup and testing release.