elasticity 3.0.2 → 3.0.3
Sign up to get free protection for your applications and to get access to all the features.
- checksums.yaml +8 -8
- data/HISTORY.md +4 -0
- data/README.md +7 -2
- data/lib/elasticity/script_step.rb +2 -1
- data/lib/elasticity/version.rb +1 -1
- data/spec/lib/elasticity/script_step_spec.rb +2 -1
- metadata +2 -2
checksums.yaml
CHANGED
@@ -1,15 +1,15 @@
|
|
1
1
|
---
|
2
2
|
!binary "U0hBMQ==":
|
3
3
|
metadata.gz: !binary |-
|
4
|
-
|
4
|
+
MWQ4ZmEwYWE4MjYwZGU4NTBkZmRmMGZmYWZiOWNkM2U4NmE0ODYzNA==
|
5
5
|
data.tar.gz: !binary |-
|
6
|
-
|
6
|
+
Y2VlNzE3NmI5YzAxZTI2NzFkMzg1Y2M0ZTgwZjEzMGY4NDRkZTg0NQ==
|
7
7
|
SHA512:
|
8
8
|
metadata.gz: !binary |-
|
9
|
-
|
10
|
-
|
11
|
-
|
9
|
+
NDE0NTc0NGNiZTljOTFlZDdlNjYzZjc0MjIzNmE3ZGNmOGNiNmY0NDFmMTA5
|
10
|
+
NTQxY2NkN2Q4NGI2YjhiOGQ5NGEyOTM5MTI4MGNkZmJmYzg3NjMzZDhhZTRj
|
11
|
+
ZWQ3Mzk3ODg1ZDM4MTIwYjZlZGNiYzBjNWVjMDBlZmE3MGY0N2U=
|
12
12
|
data.tar.gz: !binary |-
|
13
|
-
|
14
|
-
|
15
|
-
|
13
|
+
ZTE1OGNmNzQxMmJjNTgyMmIxNzdhYWIyYjQyY2RiMGRhYjE4YmY0NGRlMGE2
|
14
|
+
YTM2MDU4NGFmYTZlNjcyY2IwMDJkMGU5N2I5OTU2NDQ5YWFlODhiOWJiMGQx
|
15
|
+
NjhiZGExYTQ2ZGM3MTFkN2VhY2U3MTczN2U0ODc4OWU2ODU4MzI=
|
data/HISTORY.md
CHANGED
@@ -1,3 +1,7 @@
|
|
1
|
+
## 3.0.3 - April 10, 2014
|
2
|
+
|
3
|
+
- Fix for issues [#63](https://github.com/rslifka/elasticity/issues/63) and [#64](https://github.com/rslifka/elasticity/issues/64).
|
4
|
+
|
1
5
|
## 3.0.2 - March 26, 2014
|
2
6
|
|
3
7
|
- Second go at a fix for [Issue #60](https://github.com/rslifka/elasticity/issues/60), "Specifying a VPC subnet does not work" as placement and subnet cannot both be specified.
|
data/README.md
CHANGED
@@ -1,10 +1,10 @@
|
|
1
1
|
[![Gem Version](https://badge.fury.io/rb/elasticity.png)](http://badge.fury.io/rb/elasticity)
|
2
2
|
|
3
|
-
**(
|
3
|
+
**(April 10, 2014)** Taking requests! I have a few ideas for what might be cool features though I'd rather work on what the community wants. Go ahead and file an issue!
|
4
4
|
|
5
5
|
Elasticity provides programmatic access to Amazon's Elastic Map Reduce service. The aim is to conveniently abstract away the complex EMR REST API and make working with job flows more productive and more enjoyable.
|
6
6
|
|
7
|
-
[![Build Status](https://secure.travis-ci.org/rslifka/elasticity.png)](http://travis-ci.org/rslifka/elasticity) 1.9.3, 2.0.0
|
7
|
+
[![Build Status](https://secure.travis-ci.org/rslifka/elasticity.png)](http://travis-ci.org/rslifka/elasticity) 1.9.3, 2.0.0, 2.1.0, 2.1.1
|
8
8
|
|
9
9
|
Elasticity provides two ways to access EMR:
|
10
10
|
|
@@ -38,6 +38,11 @@ jobflow = Elasticity::JobFlow.new('AWS access key', 'AWS secret key')
|
|
38
38
|
# Omit credentials to use the AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY environment variables
|
39
39
|
# jobflow = Elasticity::JobFlow.new
|
40
40
|
|
41
|
+
# NOTE: Amazon requires that all new accounts specify a VPC subnet when launching jobs.
|
42
|
+
# If you're on an existing account, this is unnecessary however new AWS accounts require
|
43
|
+
# subnet IDs be specified when launching jobs.
|
44
|
+
# jobflow.ec2_subnet_id = 'YOUR_SUBNET_ID_HERE'
|
45
|
+
|
41
46
|
# This is the first step in the jobflow - running a custom jar
|
42
47
|
step = Elasticity::CustomJarStep.new('s3n://elasticmapreduce/samples/cloudburst/cloudburst.jar')
|
43
48
|
|
@@ -5,7 +5,8 @@ module Elasticity
|
|
5
5
|
def initialize(script_name, *script_args)
|
6
6
|
@name = 'Elasticity Script Step'
|
7
7
|
@jar = 's3://elasticmapreduce/libs/script-runner/script-runner.jar'
|
8
|
-
@arguments = [
|
8
|
+
@arguments = [script_name].concat(script_args)
|
9
|
+
@action_on_failure = 'TERMINATE_JOB_FLOW'
|
9
10
|
end
|
10
11
|
|
11
12
|
end
|
data/lib/elasticity/version.rb
CHANGED
@@ -6,6 +6,7 @@ describe Elasticity::ScriptStep do
|
|
6
6
|
|
7
7
|
its(:name) { should == 'Elasticity Script Step' }
|
8
8
|
its(:jar) { should == 's3://elasticmapreduce/libs/script-runner/script-runner.jar' }
|
9
|
-
its(:arguments) { should ==
|
9
|
+
its(:arguments) { should == %w(script_location arg1 arg2) }
|
10
|
+
its(:action_on_failure) { should == 'TERMINATE_JOB_FLOW' }
|
10
11
|
|
11
12
|
end
|
metadata
CHANGED
@@ -1,14 +1,14 @@
|
|
1
1
|
--- !ruby/object:Gem::Specification
|
2
2
|
name: elasticity
|
3
3
|
version: !ruby/object:Gem::Version
|
4
|
-
version: 3.0.
|
4
|
+
version: 3.0.3
|
5
5
|
platform: ruby
|
6
6
|
authors:
|
7
7
|
- Robert Slifka
|
8
8
|
autorequire:
|
9
9
|
bindir: bin
|
10
10
|
cert_chain: []
|
11
|
-
date: 2014-
|
11
|
+
date: 2014-04-10 00:00:00.000000000 Z
|
12
12
|
dependencies:
|
13
13
|
- !ruby/object:Gem::Dependency
|
14
14
|
name: rest-client
|