cascading.jruby 0.0.4

data/HACKING.md

@@ -0,0 +1,15 @@
+# Hacking
+
+Some hacking info on `cascading.jruby`:
+
+`cascading.jruby` can be packaged as a gem. To do so, you must generate the necessary packaging files:
+
+    ant build; jruby -S rake gem
+
+will produce the gem in the pkg/ sub-directory. After that, just cd to this directory and:
+
+    jruby -S rake install cascading.jruby-xxx.gem
+
+The `Cascading::Operations` module is mixed-in the `Cascading::Assembly` class to provide some shortcuts for common operations.
+
+The file cascading/cascading.rb defines global helper methods for cascading like tap creation, fields creation, etc. 

data/LICENSE.txt

@@ -0,0 +1,165 @@
+		   GNU LESSER GENERAL PUBLIC LICENSE
+                       Version 3, 29 June 2007
+
+ Copyright (C) 2007 Free Software Foundation, Inc. <http://fsf.org/>
+ Everyone is permitted to copy and distribute verbatim copies
+ of this license document, but changing it is not allowed.
+
+
+  This version of the GNU Lesser General Public License incorporates
+the terms and conditions of version 3 of the GNU General Public
+License, supplemented by the additional permissions listed below.
+
+  0. Additional Definitions. 
+
+  As used herein, "this License" refers to version 3 of the GNU Lesser
+General Public License, and the "GNU GPL" refers to version 3 of the GNU
+General Public License.
+
+  "The Library" refers to a covered work governed by this License,
+other than an Application or a Combined Work as defined below.
+
+  An "Application" is any work that makes use of an interface provided
+by the Library, but which is not otherwise based on the Library.
+Defining a subclass of a class defined by the Library is deemed a mode
+of using an interface provided by the Library.
+
+  A "Combined Work" is a work produced by combining or linking an
+Application with the Library.  The particular version of the Library
+with which the Combined Work was made is also called the "Linked
+Version".
+
+  The "Minimal Corresponding Source" for a Combined Work means the
+Corresponding Source for the Combined Work, excluding any source code
+for portions of the Combined Work that, considered in isolation, are
+based on the Application, and not on the Linked Version.
+
+  The "Corresponding Application Code" for a Combined Work means the
+object code and/or source code for the Application, including any data
+and utility programs needed for reproducing the Combined Work from the
+Application, but excluding the System Libraries of the Combined Work.
+
+  1. Exception to Section 3 of the GNU GPL.
+
+  You may convey a covered work under sections 3 and 4 of this License
+without being bound by section 3 of the GNU GPL.
+
+  2. Conveying Modified Versions.
+
+  If you modify a copy of the Library, and, in your modifications, a
+facility refers to a function or data to be supplied by an Application
+that uses the facility (other than as an argument passed when the
+facility is invoked), then you may convey a copy of the modified
+version:
+
+   a) under this License, provided that you make a good faith effort to
+   ensure that, in the event an Application does not supply the
+   function or data, the facility still operates, and performs
+   whatever part of its purpose remains meaningful, or
+
+   b) under the GNU GPL, with none of the additional permissions of
+   this License applicable to that copy.
+
+  3. Object Code Incorporating Material from Library Header Files.
+
+  The object code form of an Application may incorporate material from
+a header file that is part of the Library.  You may convey such object
+code under terms of your choice, provided that, if the incorporated
+material is not limited to numerical parameters, data structure
+layouts and accessors, or small macros, inline functions and templates
+(ten or fewer lines in length), you do both of the following:
+
+   a) Give prominent notice with each copy of the object code that the
+   Library is used in it and that the Library and its use are
+   covered by this License.
+
+   b) Accompany the object code with a copy of the GNU GPL and this license
+   document.
+
+  4. Combined Works.
+
+  You may convey a Combined Work under terms of your choice that,
+taken together, effectively do not restrict modification of the
+portions of the Library contained in the Combined Work and reverse
+engineering for debugging such modifications, if you also do each of
+the following:
+
+   a) Give prominent notice with each copy of the Combined Work that
+   the Library is used in it and that the Library and its use are
+   covered by this License.
+
+   b) Accompany the Combined Work with a copy of the GNU GPL and this license
+   document.
+
+   c) For a Combined Work that displays copyright notices during
+   execution, include the copyright notice for the Library among
+   these notices, as well as a reference directing the user to the
+   copies of the GNU GPL and this license document.
+
+   d) Do one of the following:
+
+       0) Convey the Minimal Corresponding Source under the terms of this
+       License, and the Corresponding Application Code in a form
+       suitable for, and under terms that permit, the user to
+       recombine or relink the Application with a modified version of
+       the Linked Version to produce a modified Combined Work, in the
+       manner specified by section 6 of the GNU GPL for conveying
+       Corresponding Source.
+
+       1) Use a suitable shared library mechanism for linking with the
+       Library.  A suitable mechanism is one that (a) uses at run time
+       a copy of the Library already present on the user's computer
+       system, and (b) will operate properly with a modified version
+       of the Library that is interface-compatible with the Linked
+       Version. 
+
+   e) Provide Installation Information, but only if you would otherwise
+   be required to provide such information under section 6 of the
+   GNU GPL, and only to the extent that such information is
+   necessary to install and execute a modified version of the
+   Combined Work produced by recombining or relinking the
+   Application with a modified version of the Linked Version. (If
+   you use option 4d0, the Installation Information must accompany
+   the Minimal Corresponding Source and Corresponding Application
+   Code. If you use option 4d1, you must provide the Installation
+   Information in the manner specified by section 6 of the GNU GPL
+   for conveying Corresponding Source.)
+
+  5. Combined Libraries.
+
+  You may place library facilities that are a work based on the
+Library side by side in a single library together with other library
+facilities that are not Applications and are not covered by this
+License, and convey such a combined library under terms of your
+choice, if you do both of the following:
+
+   a) Accompany the combined library with a copy of the same work based
+   on the Library, uncombined with any other library facilities,
+   conveyed under the terms of this License.
+
+   b) Give prominent notice with the combined library that part of it
+   is a work based on the Library, and explaining where to find the
+   accompanying uncombined form of the same work.
+
+  6. Revised Versions of the GNU Lesser General Public License.
+
+  The Free Software Foundation may publish revised and/or new versions
+of the GNU Lesser General Public License from time to time. Such new
+versions will be similar in spirit to the present version, but may
+differ in detail to address new problems or concerns.
+
+  Each version is given a distinguishing version number. If the
+Library as you received it specifies that a certain numbered version
+of the GNU Lesser General Public License "or any later version"
+applies to it, you have the option of following the terms and
+conditions either of that published version or of any later version
+published by the Free Software Foundation. If the Library as you
+received it does not specify a version number of the GNU Lesser
+General Public License, you may choose any version of the GNU Lesser
+General Public License ever published by the Free Software Foundation.
+
+  If the Library as you received it specifies that a proxy can decide
+whether future versions of the GNU Lesser General Public License shall
+apply, that proxy's public statement of acceptance of any version is
+permanent authorization for you to choose that version for the
+Library.

data/README.md

@@ -0,0 +1,7 @@
+# Cascading.JRuby
+
+`cascading.jruby` is a small DSL above [Cascading](http://www.cascading.org/).
+
+It requires Hadoop (>= 0.18.3) and Cascading (>=1.0.1) to be set via the environment variables: `HADOOP_HOME` and `CASCADING_HOME`
+
+Copyright 2009, Grégoire Marabout.

data/Rakefile

@@ -0,0 +1,45 @@
+#! /usr/bin/env jruby
+
+# Look in the tasks/setup.rb file for the various options that can be
+# configured in this Rakefile. The .rake files in the tasks directory
+# are where the options are used.
+
+begin
+  require 'bones'
+  Bones.setup
+rescue LoadError
+  begin
+    load 'tasks/setup.rb'
+  rescue LoadError
+    raise RuntimeError, '### please install the "bones" gem ###'
+  end
+end
+
+ensure_in_path 'lib'
+
+require 'cascading'
+
+task :default => 'test:run'
+
+task :run do
+  # ensure_in_path "samples"
+  puts "Running #{ARGS[0]}"
+  require "samples/#{ARGS[0]}"
+end
+
+desc 'Remove gem and Java build files'
+task :clean => ['ant:clean', 'gem:clean'] do
+  puts 'Build files removed'
+end
+
+PROJ.name = 'cascading.jruby'
+PROJ.authors = ['Matt Walker', 'Grégoire Marabout']
+PROJ.email = 'mwalker@etsy.com'
+PROJ.url = 'http://github.com/etsy/cascading.jruby'
+PROJ.version = Cascading::VERSION
+PROJ.summary = 'A JRuby DSL for Cascading'
+PROJ.description = 'cascading.jruby is a small DSL above Cascading, written in JRuby'
+PROJ.rubyforge.name = 'cascading.jruby'
+PROJ.spec.opts << '--color'
+
+# EOF

data/bin/make_job

@@ -0,0 +1,81 @@
+#!/usr/bin/env jruby
+
+require 'java'
+
+$LOAD_PATH.unshift(::File.expand_path(::File.join(::File.dirname(__FILE__), "..", "jruby")))
+$LOAD_PATH.unshift(::File.expand_path(::File.join(::File.dirname(__FILE__), "..", "jobs")))
+
+require 'rubygems'
+require 'cascading'
+require 'fileutils'
+require 'optparse'
+require 'ostruct'
+
+include FileUtils
+
+TEMP_DIR = "_temp_jars"
+TEMP_DIR_LIB = ::File.join(TEMP_DIR, "lib")
+CASCADING_JRUBY_HOME = Cascading::PATH
+CASCADING_HOME = ENV["CASCADING_HOME"]
+JRUBY_HOME = ENV["JRUBY_HOME"]
+
+options = OpenStruct.new
+options.input = ARGV[0]
+options.output = "job.jar"
+options.libs = []
+
+OptionParser.new do |opts|
+   opts.banner = "Usage: make_job [options]"
+
+   opts.on("-o", "--output", "Set the name of the output jar file (job.jar by default)") do |v|
+     options.output = v
+   end
+
+   opts.on("-l", "--lib LIBPATH", "Set the path where external libraries are stored") do |path|
+     options.libs << path
+   end
+ end.parse!
+ 
+p options
+
+# Create temp dir
+mkdir(TEMP_DIR) unless File.exists? TEMP_DIR
+mkdir(TEMP_DIR_LIB) unless File.exists? TEMP_DIR_LIB
+
+def copy(from, to, message=nil)
+  puts message if message 
+  Dir.glob(from).each do |f|
+    cp_r(f, to)
+  end
+end
+
+# Copy job files into TEMP_DIR:
+files = ::File.join(options.input, "**", "*.rb")
+copy(files, TEMP_DIR,  "Copying job files to temp dir...")
+
+# Copy external libs into TEMP_DIR:
+for lib in options.libs
+  files = ::File.join(lib, "**", "*.jar")
+  copy(files, TEMP_DIR_LIB,  "Copying external libs to temp dir...")
+end
+
+files = ::File.join(CASCADING_JRUBY_HOME, "lib", "**")
+copy(files, TEMP_DIR, "Copying cascading.jruby files to temp dir...")
+
+# Copy cascading.jruby.runner classes:
+files = ::File.join(CASCADING_JRUBY_HOME, "classes", "**")
+copy(files, TEMP_DIR, "Copying cascading.jruby files to temp dir...")
+
+# Copy cascading jars in _temp_jars/lib
+files = ::File.join(CASCADING_HOME, "**", "*.jar")
+copy(files, TEMP_DIR_LIB, "Copying Cascading jars to temp dir...")
+
+# Jar the whole thing:
+puts "Building final jar file (#{options.output})..."
+system("jar cvf #{options.output} -C #{TEMP_DIR}/ .")
+
+# Clean-up things
+puts "Cleaning temp dir..."
+rm_rf(TEMP_DIR)
+
+puts "Finished. Have Fun!"