wukong 0.1.4 → 1.4.0

data/docpages/wutils.textile

@@ -0,0 +1,263 @@
+---
+layout: default
+title:  mrflip.github.com/wukong - wu-utils utilities
+collapse: false
+---
+
+h1(gemheader). Wukong Utility Scripts
+
+** "Overview of wutils":#wutils -- command listing
+** "Stupid command-line tricks":#cmdlinetricks using the wutils
+** "wu-lign":#wulign -- present a tab-separated file as aligned columns
+** Dear Lazyweb, please build this for us: "tab-oriented version of the Textutils library":#wutilsinc
+
+<notextile><div class="toggle"></notextile>
+
+h2(#cmdlinetricks). Stupid command-line tricks
+
+Here are a few useful little snippets you can run from the command line:
+
+h3. Histogram
+
+Given data with a date column:
+
+    <pre>
+    message	235623	20090423012345	Now is the winter of our discontent Made glorious summer by this son of York
+    message	235623	20080101230900	These pretzels are making me THIRSTY!
+    ...
+    </pre>
+
+You can calculate number of messages sent by day with
+
+    <pre>
+    cat messages | cuttab 3 | cutc 8 | sort | uniq -c
+    </pre>
+
+(see the wuhist command, below.)
+
+h3. Simple intersection, union, etc
+
+For two datasets (batch_1 and batch_2) with unique entries (no repeated lines),
+
+* Their union is simple:
+
+    <pre>
+    cat batch_1 batch_2 | sort -u
+    </pre>
+
+* To find their intersection, concatenate the two sets and filters out everything that only occurred once.
+
+    <pre>
+    cat batch_1 batch_2 | sort | uniq -c | egrep -v '^ *1 '
+    </pre>
+
+* For the complement of the intersection, use @... | egrep '^ *1 '@
+  
+* In both cases, if the files are each internally sorted, the commandline sort takes a --merge flag:
+
+    <pre>
+    sort --merge -u batch_1 batch_2 
+    </pre>
+
+<notextile></div><div class="toggle"></notextile>
+    
+h2(#wutils). Wutils Command Listing
+
+h3. cutc
+
+@cutc [colnum]@
+
+Ex.
+
+    @echo -e 'foo\tbar\tbaz' | cutc 6@
+    @foo	ba@
+
+Cuts from beginning of line to given column (default 200). A tab is one character, so right margin can still be ragged.
+ 
+h3. cuttab
+
+    @cuttab [colspec]@
+
+Cuts given tab-separated columns. You can give a comma separated list of numbers
+or ranges 1-4. columns are numbered from 1.
+
+Ex.
+
+    <pre>
+    echo -e 'foo\tbar\tbaz' | cuttab 1,3
+    foo	baz
+    </pre>
+
+h3. hdp-*
+
+These perform the corresponding commands on the HDFS filesystem.  In general,
+where they accept command-line flags, they go with the GNU-style ones, not the
+hadoop-style: so, @hdp-du -s dir@ or @hdp-rm -r foo/@
+
+* @hdp-cat@
+* @hdp-catd@ -- cats the files that don't start with '_' in a directory. Use this for a pile of @.../part-00000@ files
+* @hdp-du@
+* @hdp-get@
+* @hdp-kill@
+* @hdp-ls@
+* @hdp-mkdir@
+* @hdp-mv@
+* @hdp-ps@
+* @hdp-put@
+* @hdp-rm@
+* @hdp-sync@
+
+h3. hdp-sort, hdp-stream, hdp-stream-flat
+
+* @hdp-sort@
+* @hdp-stream@
+* @hdp-stream-flat@
+
+    <code><pre>
+    hdp-stream input_filespec output_file map_cmd reduce_cmd num_key_fields
+    </pre></code>
+
+h3. tabchar
+
+Outputs a single tab character.
+ 
+h3. wuhist
+
+Occasionally useful to gather a lexical histogram of a single column:
+
+Ex.
+
+    <code><pre>
+    $ echo -e 'foo\nbar\nbar\nfoo\nfoo\nfoo\n7' | ./wuhist
+    4       foo
+    2       bar
+    1       7
+    </pre></code>
+
+(the output will have a tab between the first and second column, for futher processing.)
+
+h3. wulign
+
+Intelligently format a tab-separated file into aligned columns (while remaining tab-separated for further processing). See "below":#wulign.
+ 
+h3. hdp-parts_to_keys.rb
+
+A *very* clumsy script to rename reduced hadoop output files by their initial key.
+
+If your output file has an initial key in the first column and you pass it through hdp-sort, they will be distributed across reducers and thus output files. (Because of the way hadoop hashes the keys, there's no guarantee that each file will get a distinct key. You could have 2 keys with a million entries and they could land sequentially on the same reducer, always fun.)
+
+If you're willing to roll the dice, this script will rename files according to the first key in the first line.
+
+**Do you have or know of a native hadoop utility to do this?** If so, please get in touch!
+
+<notextile></div><div class="toggle"></notextile>
+
+h2(#wulign). wu-lign -- format a tab-separated file as aligned columns
+
+wu-lign will intelligently reformat a tab-separated file into a tab-separated, space aligned file that is still suitable for further processing. For example, given the log-file input
+
+    <pre><code>
+    2009-07-21T21:39:40 day     65536   3.15479 68750   1171316
+    2009-07-21T21:39:45 doing   65536   1.04533 26230   1053956
+    2009-07-21T21:41:53 hapaxlegomenon  65536   0.87574e-05     23707   10051141
+    2009-07-21T21:44:00 concert 500     0.29290 13367   9733414
+    2009-07-21T21:44:29 world   65536   1.09110 32850   200916
+    2009-07-21T21:44:39 world+series    65536   0.49380 9929    7972025
+    2009-07-21T21:44:54 iranelection    65536   2.91775 14592   136342
+    </code></pre>
+
+wu-lign will reformat it to read
+
+    <pre><code>
+    2009-07-21T21:39:40 day                   65536   3.154791234 68750    1171316
+    2009-07-21T21:39:45 doing                 65536   1.045330000 26230    1053956
+    2009-07-21T21:41:53 hapaxlegomenon        65536   0.000008757 23707   10051141
+    2009-07-21T21:44:00 concert                 500   0.292900000 13367    9733414
+    2009-07-21T21:44:29 world                 65536   1.091100000 32850     200916
+    2009-07-21T21:44:39 world+series          65536   0.493800000  9929    7972025
+    2009-07-21T21:44:54 iranelection          65536   2.917750000 14592     136342
+    </code></pre>
+
+The fields are still tab-delimited by exactly one tab -- only spaces are used to pad out fields. You can still use cuttab and friends to manipulate columns.
+
+wu-lign isn't intended to be smart, or correct, or reliable -- only to be useful for previewing and organizing tab-formatted files. In general @wu-lign(foo).split("\t").map(&:strip)@ *should* give output semantically equivalent to its input. (That is, the only changes should be insertion of spaces and re-formatting of numerics.) But still -- reserve its use for human inspection only.
+
+(Note: tab characters in this source code file have been converted to spaces; replace whitespace with tab in the first example if you'd like to play along at home.)
+
+h3. How it works 
+
+Wu-Lign takes the first 1000 lines, splits by TAB characters into fields, and tries to guess the format -- int, float, or string -- for each. It builds a consensus of the width and type for corresponding columns in the chunk.  If a column has mixed numeric and string formats it degrades to :mixed, which is basically treated as :string. If a column has mixed :float and :int elements all of them are formatted as float.
+
+h3. Command-line arguments
+
+You can give sprintf-style positional arguments on the command line that will be applied to the corresponding columns. (Blank args are used for placeholding and auto-formatting is still applied).  So with the example above,
+
+    @cat foo | wu-lign  '' '' '' '%8.4e'@
+
+will format the fourth column with "%8.4e", while the first three columns and fifth-and-higher columns are formatted as usual.
+
+    <pre><code>
+    ...
+    2009-07-21T21:39:45 doing           65536   1.0453e+00      26230    1053956
+    2009-07-21T21:41:53 hapaxlegomenon  65536   8.7574e-06      23707   10051141
+    2009-07-21T21:44:00 concert           500   2.9290e-01      13367    9733414
+    ....
+    </code></pre>
+
+h3. Notes
+
+* It has no knowledge of header rows. An all-text first line will screw everything up.
+* It also requires a unanimous vote. One screwy line can coerce the whole mess to :mixed; width formatting will still be applied, though.
+* It won't set columns wider than 70 chars -- this allows for the occasional super-wide column without completely breaking your screen.
+* For :float values, wu-lign tries to guess at the right number of significant digits to the left and right of the decimal point.
+* wu-lign does not parse 'TSV files' in their strict sense -- there is no quoting or escaping; every tab delimits a field, every newline a record.
+
+h2(#wutilsinc). Dear Lazyweb, please build this
+
+* uniq                  - report or filter out repeated lines in a file
+**  -c                    produces line<tab>count
+**  --ignore f1,f2,...    discards given fields from consideration. field syntax same as for cut, etc.
+
+* sort                  - sort lines of text files
+** columns indexed as tab-separated
+** can specify any column order, uses same field spec as cut
+* tsort                 - topological sort of a directed graph
+
+* cut                   - select portions of each line of a file
+** can reorder columns
+* nl                    - line numbering filter
+** takes prefix, suffix
+** count \t line -OR- line \t count 
+
+* wc                    - word, line, character, and byte count
+** field count (tab-separated fields)
+* paste                 - merge corresponding or subsequent lines of files
+* expand, unexpand      - expand tabs to spaces, and vice versa
+* seq
+* simple row, column sums
+* join                  - relational database operator
+* tac
+
+* cat                   - concatenate and print files
+* head                  - display first lines of a file
+* tail                  - display the last part of a file
+* shuf
+* split                 - split a file into pieces
+* csplit                - split files based on context
+* tee                   - pipe fitting
+
+* ls                    - list directory contents. 
+* df                    - display free disk space
+* du                    - display disk usage statistics
+** tab-delimited, space aligned
+
+* od                    - octal, decimal, hex, ASCII dump
+* printf                - formatted output
+* cksum, sum            - display file checksums and block counts
+* md5sum
+
+* diff
+* comm
+
+
+<notextile></div></notextile>

data/wukong.gemspec

@@ -5,11 +5,11 @@
 
 Gem::Specification.new do |s|
   s.name = %q{wukong}
-  s.version = "0.1.4"
+  s.version = "1.4.0"
 
   s.required_rubygems_version = Gem::Requirement.new(">= 0") if s.respond_to? :required_rubygems_version=
   s.authors = ["Philip (flip) Kromer"]
-  s.date = %q{2009-10-05}
+  s.date = %q{2009-10-12}
   s.description = %q{  Treat your dataset like a:
 
       * stream of lines when it’s efficient to process by lines
@@ -25,31 +25,74 @@ Gem::Specification.new do |s|
      "README.textile"
   ]
   s.files = [
-    "doc/INSTALL.textile",
-     "doc/LICENSE.textile",
-     "doc/README-tutorial.textile",
-     "doc/README-wulign.textile",
-     "doc/README-wutils.textile",
-     "doc/TODO.textile",
-     "doc/UsingWukong-part1-setup.textile",
-     "doc/UsingWukong-part2-scraping.textile",
-     "doc/UsingWukong-part3-parsing.textile",
-     "doc/code/api_response_example.txt",
-     "doc/code/parser_skeleton.rb",
-     "doc/hadoop-nfs.textile",
-     "doc/hadoop-setup.textile",
-     "doc/index.textile",
-     "doc/intro_to_map_reduce/MapReduceDiagram.graffle",
-     "doc/links.textile",
-     "doc/overview.textile",
-     "doc/pig/PigLatinExpressionsList.txt",
-     "doc/pig/PigLatinReferenceManual.html",
-     "doc/pig/PigLatinReferenceManual.txt",
-     "doc/tips.textile",
-     "doc/usage.textile",
-     "doc/utils.textile",
+    "INSTALL.textile",
+     "LICENSE.textile",
+     "README.textile",
+     "bin/cutc",
+     "bin/cuttab",
+     "bin/greptrue",
+     "bin/hdp-cat",
+     "bin/hdp-catd",
+     "bin/hdp-du",
+     "bin/hdp-get",
+     "bin/hdp-kill",
+     "bin/hdp-ls",
+     "bin/hdp-mkdir",
+     "bin/hdp-mv",
+     "bin/hdp-parts_to_keys.rb",
+     "bin/hdp-ps",
+     "bin/hdp-put",
+     "bin/hdp-rm",
+     "bin/hdp-sort",
+     "bin/hdp-stream",
+     "bin/hdp-stream-flat",
+     "bin/hdp-sync",
+     "bin/hdp-wc",
+     "bin/md5sort",
+     "bin/tabchar",
+     "bin/uniqc",
+     "bin/wu-hist",
+     "bin/wu-lign",
+     "bin/wu-sum",
+     "docpages/INSTALL.textile",
+     "docpages/INSTALL.textile",
+     "docpages/LICENSE.textile",
+     "docpages/LICENSE.textile",
+     "docpages/README-wulign.textile",
+     "docpages/README-wulign.textile",
+     "docpages/UsingWukong-part1-get_ready.textile",
+     "docpages/UsingWukong-part1-get_ready.textile",
+     "docpages/UsingWukong-part2-ThinkingBigData.textile",
+     "docpages/UsingWukong-part2-ThinkingBigData.textile",
+     "docpages/UsingWukong-part3-parsing.textile",
+     "docpages/UsingWukong-part3-parsing.textile",
+     "docpages/_config.yml",
+     "docpages/bigdata-tips.textile",
+     "docpages/bigdata-tips.textile",
+     "docpages/code/api_response_example.txt",
+     "docpages/code/parser_skeleton.rb",
+     "docpages/diagrams/MapReduceDiagram.graffle",
+     "docpages/favicon.ico",
+     "docpages/gem.css",
+     "docpages/hadoop-tips.textile",
+     "docpages/hadoop-tips.textile",
+     "docpages/index.textile",
+     "docpages/index.textile",
+     "docpages/intro.textile",
+     "docpages/intro.textile",
+     "docpages/moreinfo.textile",
+     "docpages/moreinfo.textile",
+     "docpages/news.html",
+     "docpages/pig/PigLatinExpressionsList.txt",
+     "docpages/pig/PigLatinReferenceManual.html",
+     "docpages/pig/PigLatinReferenceManual.txt",
+     "docpages/tutorial.textile",
+     "docpages/tutorial.textile",
+     "docpages/usage.textile",
+     "docpages/usage.textile",
+     "docpages/wutils.textile",
+     "docpages/wutils.textile",
      "examples/README.txt",
-     "examples/and_pig/sample_queries.rb",
      "examples/apache_log_parser.rb",
      "examples/count_keys.rb",
      "examples/count_keys_at_mapper.rb",
@@ -61,6 +104,7 @@ Gem::Specification.new do |s|
      "examples/package-local.rb",
      "examples/package.rb",
      "examples/pagerank/README.textile",
+     "examples/pagerank/README.textile",
      "examples/pagerank/gen_initial_pagerank_graph.pig",
      "examples/pagerank/pagerank.rb",
      "examples/pagerank/pagerank_initialize.rb",
@@ -71,28 +115,6 @@ Gem::Specification.new do |s|
      "examples/size.rb",
      "examples/word_count.rb",
      "lib/wukong.rb",
-     "lib/wukong/and_pig.rb",
-     "lib/wukong/and_pig/README.textile",
-     "lib/wukong/and_pig/as.rb",
-     "lib/wukong/and_pig/data_types.rb",
-     "lib/wukong/and_pig/functions.rb",
-     "lib/wukong/and_pig/generate.rb",
-     "lib/wukong/and_pig/generate/variable_inflections.rb",
-     "lib/wukong/and_pig/junk.rb",
-     "lib/wukong/and_pig/operators.rb",
-     "lib/wukong/and_pig/operators/compound.rb",
-     "lib/wukong/and_pig/operators/evaluators.rb",
-     "lib/wukong/and_pig/operators/execution.rb",
-     "lib/wukong/and_pig/operators/file_methods.rb",
-     "lib/wukong/and_pig/operators/foreach.rb",
-     "lib/wukong/and_pig/operators/groupies.rb",
-     "lib/wukong/and_pig/operators/load_store.rb",
-     "lib/wukong/and_pig/operators/meta.rb",
-     "lib/wukong/and_pig/operators/relational.rb",
-     "lib/wukong/and_pig/pig_struct.rb",
-     "lib/wukong/and_pig/pig_var.rb",
-     "lib/wukong/and_pig/symbol.rb",
-     "lib/wukong/and_pig/utils.rb",
      "lib/wukong/bad_record.rb",
      "lib/wukong/boot.rb",
      "lib/wukong/datatypes.rb",
@@ -141,7 +163,7 @@ Gem::Specification.new do |s|
      "spec/spec_helper.rb",
      "wukong.gemspec"
   ]
-  s.homepage = %q{http://github.com/mrflip/wukong}
+  s.homepage = %q{http://mrflip.github.com/wukong}
   s.rdoc_options = ["--charset=UTF-8"]
   s.require_paths = ["lib"]
   s.rubygems_version = %q{1.3.5}
@@ -149,7 +171,6 @@ Gem::Specification.new do |s|
   s.test_files = [
     "spec/bin/hdp-wc_spec.rb",
      "spec/spec_helper.rb",
-     "examples/and_pig/sample_queries.rb",
      "examples/apache_log_parser.rb",
      "examples/count_keys.rb",
      "examples/count_keys_at_mapper.rb",
@@ -173,8 +194,17 @@ Gem::Specification.new do |s|
     s.specification_version = 3
 
     if Gem::Version.new(Gem::RubyGemsVersion) >= Gem::Version.new('1.2.0') then
+      s.add_runtime_dependency(%q<addressable>, [">= 0"])
+      s.add_runtime_dependency(%q<extlib>, [">= 0"])
+      s.add_runtime_dependency(%q<htmlentities>, [">= 0"])
     else
+      s.add_dependency(%q<addressable>, [">= 0"])
+      s.add_dependency(%q<extlib>, [">= 0"])
+      s.add_dependency(%q<htmlentities>, [">= 0"])
     end
   else
+    s.add_dependency(%q<addressable>, [">= 0"])
+    s.add_dependency(%q<extlib>, [">= 0"])
+    s.add_dependency(%q<htmlentities>, [">= 0"])
   end
 end

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification 
 name: wukong
 version: !ruby/object:Gem::Version 
-  version: 0.1.4
+  version: 1.4.0
 platform: ruby
 authors: 
 - Philip (flip) Kromer
@@ -9,10 +9,39 @@ autorequire:
 bindir: bin
 cert_chain: []
 
-date: 2009-10-05 00:00:00 -05:00
+date: 2009-10-12 00:00:00 -05:00
 default_executable: 
-dependencies: []
-
+dependencies: 
+- !ruby/object:Gem::Dependency 
+  name: addressable
+  type: :runtime
+  version_requirement: 
+  version_requirements: !ruby/object:Gem::Requirement 
+    requirements: 
+    - - ">="
+      - !ruby/object:Gem::Version 
+        version: "0"
+    version: 
+- !ruby/object:Gem::Dependency 
+  name: extlib
+  type: :runtime
+  version_requirement: 
+  version_requirements: !ruby/object:Gem::Requirement 
+    requirements: 
+    - - ">="
+      - !ruby/object:Gem::Version 
+        version: "0"
+    version: 
+- !ruby/object:Gem::Dependency 
+  name: htmlentities
+  type: :runtime
+  version_requirement: 
+  version_requirements: !ruby/object:Gem::Requirement 
+    requirements: 
+    - - ">="
+      - !ruby/object:Gem::Version 
+        version: "0"
+    version: 
 description: "  Treat your dataset like a:\n\n      * stream of lines when it\xE2\x80\x99s efficient to process by lines\n      * stream of field arrays when it\xE2\x80\x99s efficient to deal directly with fields\n      * stream of lightweight objects when it\xE2\x80\x99s efficient to deal with objects\n\n  Wukong is friends with Hadoop the elephant, Pig the query language, and the cat on your command line.\n"
 email: flip@infochimps.org
 executables: 
@@ -48,31 +77,60 @@ extra_rdoc_files:
 - LICENSE.textile
 - README.textile
 files: 
-- doc/INSTALL.textile
-- doc/LICENSE.textile
-- doc/README-tutorial.textile
-- doc/README-wulign.textile
-- doc/README-wutils.textile
-- doc/TODO.textile
-- doc/UsingWukong-part1-setup.textile
-- doc/UsingWukong-part2-scraping.textile
-- doc/UsingWukong-part3-parsing.textile
-- doc/code/api_response_example.txt
-- doc/code/parser_skeleton.rb
-- doc/hadoop-nfs.textile
-- doc/hadoop-setup.textile
-- doc/index.textile
-- doc/intro_to_map_reduce/MapReduceDiagram.graffle
-- doc/links.textile
-- doc/overview.textile
-- doc/pig/PigLatinExpressionsList.txt
-- doc/pig/PigLatinReferenceManual.html
-- doc/pig/PigLatinReferenceManual.txt
-- doc/tips.textile
-- doc/usage.textile
-- doc/utils.textile
+- INSTALL.textile
+- LICENSE.textile
+- README.textile
+- bin/cutc
+- bin/cuttab
+- bin/greptrue
+- bin/hdp-cat
+- bin/hdp-catd
+- bin/hdp-du
+- bin/hdp-get
+- bin/hdp-kill
+- bin/hdp-ls
+- bin/hdp-mkdir
+- bin/hdp-mv
+- bin/hdp-parts_to_keys.rb
+- bin/hdp-ps
+- bin/hdp-put
+- bin/hdp-rm
+- bin/hdp-sort
+- bin/hdp-stream
+- bin/hdp-stream-flat
+- bin/hdp-sync
+- bin/hdp-wc
+- bin/md5sort
+- bin/tabchar
+- bin/uniqc
+- bin/wu-hist
+- bin/wu-lign
+- bin/wu-sum
+- docpages/INSTALL.textile
+- docpages/LICENSE.textile
+- docpages/README-wulign.textile
+- docpages/UsingWukong-part1-get_ready.textile
+- docpages/UsingWukong-part2-ThinkingBigData.textile
+- docpages/UsingWukong-part3-parsing.textile
+- docpages/_config.yml
+- docpages/bigdata-tips.textile
+- docpages/code/api_response_example.txt
+- docpages/code/parser_skeleton.rb
+- docpages/diagrams/MapReduceDiagram.graffle
+- docpages/favicon.ico
+- docpages/gem.css
+- docpages/hadoop-tips.textile
+- docpages/index.textile
+- docpages/intro.textile
+- docpages/moreinfo.textile
+- docpages/news.html
+- docpages/pig/PigLatinExpressionsList.txt
+- docpages/pig/PigLatinReferenceManual.html
+- docpages/pig/PigLatinReferenceManual.txt
+- docpages/tutorial.textile
+- docpages/usage.textile
+- docpages/wutils.textile
 - examples/README.txt
-- examples/and_pig/sample_queries.rb
 - examples/apache_log_parser.rb
 - examples/count_keys.rb
 - examples/count_keys_at_mapper.rb
@@ -94,28 +152,6 @@ files:
 - examples/size.rb
 - examples/word_count.rb
 - lib/wukong.rb
-- lib/wukong/and_pig.rb
-- lib/wukong/and_pig/README.textile
-- lib/wukong/and_pig/as.rb
-- lib/wukong/and_pig/data_types.rb
-- lib/wukong/and_pig/functions.rb
-- lib/wukong/and_pig/generate.rb
-- lib/wukong/and_pig/generate/variable_inflections.rb
-- lib/wukong/and_pig/junk.rb
-- lib/wukong/and_pig/operators.rb
-- lib/wukong/and_pig/operators/compound.rb
-- lib/wukong/and_pig/operators/evaluators.rb
-- lib/wukong/and_pig/operators/execution.rb
-- lib/wukong/and_pig/operators/file_methods.rb
-- lib/wukong/and_pig/operators/foreach.rb
-- lib/wukong/and_pig/operators/groupies.rb
-- lib/wukong/and_pig/operators/load_store.rb
-- lib/wukong/and_pig/operators/meta.rb
-- lib/wukong/and_pig/operators/relational.rb
-- lib/wukong/and_pig/pig_struct.rb
-- lib/wukong/and_pig/pig_var.rb
-- lib/wukong/and_pig/symbol.rb
-- lib/wukong/and_pig/utils.rb
 - lib/wukong/bad_record.rb
 - lib/wukong/boot.rb
 - lib/wukong/datatypes.rb
@@ -163,10 +199,8 @@ files:
 - spec/bin/hdp-wc_spec.rb
 - spec/spec_helper.rb
 - wukong.gemspec
-- LICENSE.textile
-- README.textile
 has_rdoc: true
-homepage: http://github.com/mrflip/wukong
+homepage: http://mrflip.github.com/wukong
 licenses: []
 
 post_install_message: 
@@ -196,7 +230,6 @@ summary: Wukong makes Hadoop so easy a chimpanzee can use it.
 test_files: 
 - spec/bin/hdp-wc_spec.rb
 - spec/spec_helper.rb
-- examples/and_pig/sample_queries.rb
 - examples/apache_log_parser.rb
 - examples/count_keys.rb
 - examples/count_keys_at_mapper.rb