lambda_map_reduce 0.0.0

checksums.yaml

@@ -0,0 +1,7 @@
+---
+SHA1:
+  metadata.gz: 40060acb9db9afddd390172b73baf410326a9be9
+  data.tar.gz: b9eb6707700128e0e8a76b47984391c8337d9818
+SHA512:
+  metadata.gz: 2278752f75071467ff6dfada0599d161992ed0a93294ea9bfd916db88a94eefef84ec7af0c5fa688bbb74e1f49a218fb80ca96b4b5fc599d9bcfcca0b2e0c6f9
+  data.tar.gz: 2fb0a2df70753ff1522d513bbff46ad6b71286d740814b9193d553539023af4b4873b43db97ecb421a1ae6367eed55ee5379944959290d7bed0364119438ef54

data/CONTRIBUTING.md

@@ -0,0 +1,15 @@
+## Welcome!
+
+We're so glad you're thinking about contributing to an 18F open source project! If you're unsure or afraid of anything, just ask or submit the issue or pull request anyways. The worst that can happen is that you'll be politely asked to change something. We appreciate any sort of contribution, and don't want a wall of rules to get in the way of that.
+
+Before contributing, we encourage you to read our CONTRIBUTING policy (you are here), our LICENSE, and our README, all of which should be in this repository. If you have any questions, or want to read more about our underlying policies, you can consult the 18F Open Source Policy GitHub repository at https://github.com/18f/open-source-policy, or just shoot us an email/official government letterhead note to [18f@gsa.gov](mailto:18f@gsa.gov).
+
+## Public domain
+
+This project is in the public domain within the United States, and
+copyright and related rights in the work worldwide are waived through
+the [CC0 1.0 Universal public domain dedication](https://creativecommons.org/publicdomain/zero/1.0/).
+
+All contributions to this project will be released under the CC0
+dedication. By submitting a pull request, you are agreeing to comply
+with this waiver of copyright interest.

data/LICENSE.md

@@ -0,0 +1,31 @@
+As a work of the United States Government, this project is in the
+public domain within the United States.
+
+Additionally, we waive copyright and related rights in the work
+worldwide through the CC0 1.0 Universal public domain dedication.
+
+## CC0 1.0 Universal Summary
+
+This is a human-readable summary of the [Legal Code (read the full text)](https://creativecommons.org/publicdomain/zero/1.0/legalcode).
+
+### No Copyright
+
+The person who associated a work with this deed has dedicated the work to
+the public domain by waiving all of his or her rights to the work worldwide
+under copyright law, including all related and neighboring rights, to the
+extent allowed by law.
+
+You can copy, modify, distribute and perform the work, even for commercial
+purposes, all without asking permission.
+
+### Other Information
+
+In no way are the patent or trademark rights of any person affected by CC0,
+nor are the rights that other persons may have in the work or in how the
+work is used, such as publicity or privacy rights.
+
+Unless expressly stated otherwise, the person who associated a work with
+this deed makes no warranties about the work, and disclaims liability for
+all uses of the work, to the fullest extent permitted by applicable law.
+When using or citing the work, you should not imply endorsement by the
+author or the affirmer.

data/README.md

@@ -0,0 +1,58 @@
+# `lambda_map_reduce` gem
+
+A [MapReduce](https://research.google.com/archive/mapreduce.html)
+implementation for use with
+[lambdas](http://rubymonk.com/learning/books/1-ruby-primer/chapters/34-lambdas-and-blocks-in-ruby/lessons/77-lambdas-in-ruby).
+
+## Installation
+
+Run `gem install lambda_map_reduce` on the command line or add `gem
+'lambda_map_reduce'` to your project's
+[`Gemfile`](http://bundler.io/gemfile.html).
+
+## Usage
+
+`LambdaMapReduce.map_reduce` takes an `Enumerable`, a `mapper` lambda, and a
+`reducer` lambda.
+
+The `mapper` lambda is called once for every item in the `Enumerable`. It
+should take a single item and return an `Array` of `[key, value]` pairs.
+
+The algorithm will shuffle all `value` items with the same `key` together, and
+pass the resulting `[key, Array of values] Arrays` to the `reducer`, which
+should return a single item.
+
+The `mapper` and `reducer` may return `nil`. The result of the algorithm is
+the `Array` of items produced from each `reducer` call.
+
+An example from [the `team_api` gem's `CrossReferencer`
+class](https://github.com/18F/team_api/blob/master/lib/team_api/cross_referencer.rb):
+
+```ruby
+require 'lambda_map_reduce'
+
+module TeamApi
+  class CrossReferencer
+    def self.create_tag_xrefs(site, items, category, xref_data)
+      items_to_tags = lambda do |item|
+        item_xref = xref_data.item_to_xref item
+        item[category].map { |tag| [tag, item_xref] } unless item[category].nil?
+      end
+      create_tag_xrefs = lambda do |tag, item_xrefs|
+        [tag, tag_xref(site, category, tag, item_xrefs)]
+      end
+      LambdaMapReduce.map_reduce(items, items_to_tags, create_tag_xrefs).to_h
+    end
+  end
+end
+```
+
+## Public domain
+
+This project is in the worldwide [public domain](LICENSE.md). As stated in [CONTRIBUTING](CONTRIBUTING.md):
+
+> This project is in the public domain within the United States, and copyright and related rights in the work worldwide are waived through the [CC0 1.0 Universal public domain dedication](https://creativecommons.org/publicdomain/zero/1.0/).
+>
+> All contributions to this project will be released under the CC0
+>dedication. By submitting a pull request, you are agreeing to comply
+>with this waiver of copyright interest.

data/lib/lambda_map_reduce.rb

@@ -0,0 +1,4 @@
+# @author Mike Bland (michael.bland@gsa.gov)
+
+require_relative 'lambda_map_reduce/map_reduce'
+require_relative 'lambda_map_reduce/version'

data/lib/lambda_map_reduce/map_reduce.rb

@@ -0,0 +1,12 @@
+# @author Mike Bland (michael.bland@gsa.gov)
+
+module LambdaMapReduce
+  # Returns an Array of objects after mapping and reducing items.
+  # mapper takes a single item and returns an Array of [key, value] pairs.
+  # reducer takes a [key, Array of values] pair and returns a single item.
+  def self.map_reduce(items, mapper, reducer)
+    items.flat_map { |item| mapper.call(item) }.compact
+      .each_with_object({}) { |kv, shuffle| (shuffle[kv[0]] ||= []) << kv[1] }
+      .map { |key, values| reducer.call(key, values) }.compact
+  end
+end

data/lib/lambda_map_reduce/version.rb

@@ -0,0 +1,5 @@
+# @author Mike Bland (michael.bland@gsa.gov)
+
+module LambdaMapReduce
+  VERSION = '0.0.0'
+end

metadata

@@ -0,0 +1,150 @@
+--- !ruby/object:Gem::Specification
+name: lambda_map_reduce
+version: !ruby/object:Gem::Version
+  version: 0.0.0
+platform: ruby
+authors:
+- Mike Bland
+autorequire: 
+bindir: bin
+cert_chain: []
+date: 2015-09-10 00:00:00.000000000 Z
+dependencies:
+- !ruby/object:Gem::Dependency
+  name: go_script
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '0.1'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '0.1'
+- !ruby/object:Gem::Dependency
+  name: about_yml
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+- !ruby/object:Gem::Dependency
+  name: rake
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '10.4'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '10.4'
+- !ruby/object:Gem::Dependency
+  name: minitest
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+- !ruby/object:Gem::Dependency
+  name: codeclimate-test-reporter
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+- !ruby/object:Gem::Dependency
+  name: coveralls
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+- !ruby/object:Gem::Dependency
+  name: rubocop
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+description: This is a full implementation of the MapReduce algorithm specifically
+  for use with lambdas. It is useful for problems that are a natural fit for the MapReduce
+  model (such as building cross-references) when the data set fits easily within memory.
+email:
+- michael.bland@gsa.gov
+executables: []
+extensions: []
+extra_rdoc_files: []
+files:
+- CONTRIBUTING.md
+- LICENSE.md
+- README.md
+- lib/lambda_map_reduce.rb
+- lib/lambda_map_reduce/map_reduce.rb
+- lib/lambda_map_reduce/version.rb
+homepage: https://github.com/18F/lambda_map_reduce
+licenses:
+- CC0
+metadata: {}
+post_install_message: 
+rdoc_options: []
+require_paths:
+- lib
+required_ruby_version: !ruby/object:Gem::Requirement
+  requirements:
+  - - ">="
+    - !ruby/object:Gem::Version
+      version: '0'
+required_rubygems_version: !ruby/object:Gem::Requirement
+  requirements:
+  - - ">="
+    - !ruby/object:Gem::Version
+      version: '0'
+requirements: []
+rubyforge_project: 
+rubygems_version: 2.4.5.1
+signing_key: 
+specification_version: 4
+summary: A MapReduce implementation for use with lambdas
+test_files: []