gd_bam 0.0.11 → 0.0.12

data/README.md

@@ -5,10 +5,13 @@ BAM is a tool that helps you be more productive while creating and maintaining p
 
 ##Installation
 
-make sure you have ruby (1.9 and 1.8.7 is currently supported) and that you have gem installed. On mac this is already on your machine.
+make sure you have ruby (1.9 and 1.8.7 is currently supported) and that you have gem installed. 
 
 `gem install gd_bam`
 
+Notes: Mac
+On mac ruby is already on your machine but you have to provide it with root access privileges. You can do it by running `sudo gem install gd_bam`. On top of that some C libraries are going to be installed your machine to make this work you need to install XCode on your computer (We are working on making this one easier).
+
 Done.
 
 ##Sample project -- GoodSales
@@ -40,7 +43,7 @@ If everything is ok go ahead and generate the downloaders.
 
 `bam generate_downloaders`
 
-We will talk in detail why we split etl for project into downloaders and rest of the ETL. Now just trust us. By default it is generated into downloader_project folder. You can go ahead and run it on platform.
+We will talk in detail why we split etl for project into downloaders and rest of the ETL. Now just trust us. By default it is generated into downloader-project folder. You can go ahead and run it on platform.
 
 `bam run downloader-project --email joe@example.com`
 
@@ -50,7 +53,7 @@ Now generate the etl.
 
 `bam generate`
 
-This works the same as with downloaders but its default target is clover_project
+This works the same as with downloaders but its default target is clover-project
 
 `bam run clover-project --email joe@example.com`
 
@@ -309,4 +312,4 @@ Bam is working with something that is called Incremental metadata. Metadata is n
 You have a conceptual picture of a simple transformation. You get a Tap that downloads FirstName and LastName somewhere. Obviously you would like to join them together to form a name. Exactly this happens in the second box the transformer. You would like to sink the only field and that is name. So on the next edge what you say is "I am adding Name and removing FirstName and LastName". So far so good. What is elegant about this approach is that how it copes with change. Imagine that the tap gets not only FirstName and LastName but also Age. Now what you need to change? If you would do it the old way You would have to change metadata on both edges, tap transformer and sink. With incremental metadata you need to change tap and sink nothing else. Since I claim that dealing with metadata was the biggest pain this is a lot of work (and errors) that you just saved.
 
 ###Types or not?
-Clover engine is built on Java and it shows. It is statically typed and CTL Clover transformation language resembles Java a lot. While it helps speed and many people claim it prevents errors it also causes more work and helps metadata explosion. Sometimes you need to translate an field into another field becuase you need to do something specific or the component needs it. It is not problem per se but it is important to see the tradeoffs and push the functionality into the components that should work for you and not against you. It is also important to do certain tasks at certain phases. If you do this you found out that certain parts are easier to automate or you can easily reuse work that you did somewhere else.
+Clover engine is built on Java and it shows. It is statically typed and CTL Clover transformation language resembles Java a lot. While it helps speed and many people claim it prevents errors it also causes more work and helps metadata explosion. Sometimes you need to translate an field into another field becuase you need to do something specific or the component needs it. It is not problem per se but it is important to see the tradeoffs and push the functionality into the components that should work for you and not against you. It is also important to do certain tasks at certain phases. If you do this you found out that certain parts are easier to automate or you can easily reuse work that you did somewhere else.

data/bin/bam

@@ -22,7 +22,7 @@ arg_name 'logger'
 switch [:l,:logger]
 
 
-desc 'Generates clover project based on information in current directory. The default ouptut is the directory ./clover_project'
+desc 'Generates clover project based on information in current directory. The default ouptut is the directory ./clover-project'
 # arg_name 'Describe arguments to new here'
 command :generate do |c|
   
@@ -32,7 +32,7 @@ command :generate do |c|
   
   c.action do |global_options,options,args|
     GoodData::CloverGenerator.clobber_clover_project
-    GoodData::CloverGenerator.run(options)
+    GoodData::CloverGenerator.generate(options)
   end
 end
 
@@ -70,8 +70,8 @@ command :taps_validate do |c|
     result.each_pair do |obj, fields|
       if fields.empty?
         puts HighLine::color("GOOD", :green) + " #{obj}" if verbose
-        error = true
       else
+        error = true
         puts HighLine::color("BAD", :red) + " #{obj} [" + fields.join(', ') + "]" if verbose
       end
     end

data/lib/bam/version.rb

@@ -1,3 +1,3 @@
 module Bam
-  VERSION = '0.0.11'
+  VERSION = '0.0.12'
 end

data/lib/nodes/clover_gen.rb

@@ -989,8 +989,9 @@ HEREDOC
             end
         
             stuff = mapping + add.join(",") + "]}}"
-                        
-            build_node2(builder, GoodData::CloverGenerator::Nodes.sfdc_reader2({:name => "#{file} SF Writer", :id => "#{file}_sf", :soql => generate_select(mod), :sfdcConnection => "SFDC", :fieldsMapping => stuff}))
+            mandatory_fields = fields.reject {|f| f[:is_mandatory] == false }.map {|f| f[:name] + ";"}.join
+
+            build_node2(builder, GoodData::CloverGenerator::Nodes.sfdc_reader2({:name => "#{file} SF Writer", :id => "#{file}_sf", :soql => generate_select(mod), :sfdcConnection => "SFDC", :fieldsMapping => stuff, :mandatoryFields => mandatory_fields}))
             build_node2(builder, GoodData::CloverGenerator::Nodes.edge2({:toNode => "#{file}_reformat:0", :fromNode => "#{file}_sf:0", :metadata => "#{file}_sf_metadata", :id => get_id()}))
             
             transformation_source = "function integer transform() {\n" + (transformation_acts_as(mod).map {|t| "$out.0.#{t.last} = $in.0.#{t.first};"}.join("\n")) + "\nreturn OK;\n}"
@@ -1206,8 +1207,9 @@ HEREDOC
             end
         
             stuff = mapping + add.join(",") + "]}}"
+            mandatory_fields = fields.reject {|f| f[:is_mandatory] == false }.map {|f| f[:name] + ";"}.join
 
-            build_node2(builder, GoodData::CloverGenerator::Nodes.sfdc_reader2({:name => "#{file} SF Writer", :id => "#{file}_sf", :soql => generate_incremental_select(mod), :sfdcConnection => "SFDC", :fieldsMapping => stuff, :mandatoryFields => fields.map {|f| f[:name] + ";"}.join}))
+            build_node2(builder, GoodData::CloverGenerator::Nodes.sfdc_reader2({:name => "#{file} SF Writer", :id => "#{file}_sf", :soql => generate_incremental_select(mod), :sfdcConnection => "SFDC", :fieldsMapping => stuff, :mandatoryFields => mandatory_fields}))
             build_node2(builder, GoodData::CloverGenerator::Nodes.edge2({:toNode => "#{file}_reformat:0", :fromNode => "#{file}_sf:0", :metadata => "#{file}_sf_metadata", :id => get_id()}))
             
             transformation_source = "function integer transform() {\n" + (transformation_acts_as(mod).map {|t| "$out.0.#{t.last} = $in.0.#{t.first};"}.join("\n")) + "\nreturn OK;\n}"

data/lib/runtime.rb

@@ -456,7 +456,7 @@ module GoodData
     end
 
 
-    def self.run(options)
+    def self.generate(options)
 
       only_flow = options[:only]
       setup_clover_project(CLOVER_PROJECT_ROOT, :name => "etl-#{PARAMS[:project_name]}")

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: gd_bam
 version: !ruby/object:Gem::Version
-  version: 0.0.11
+  version: 0.0.12
   prerelease: 
 platform: ruby
 authors:
@@ -9,7 +9,7 @@ authors:
 autorequire: 
 bindir: bin
 cert_chain: []
-date: 2013-05-09 00:00:00.000000000 Z
+date: 2013-05-13 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: rake
@@ -381,7 +381,7 @@ required_ruby_version: !ruby/object:Gem::Requirement
       version: '0'
       segments:
       - 0
-      hash: 3835130648573246660
+      hash: -1930903317867552914
 required_rubygems_version: !ruby/object:Gem::Requirement
   none: false
   requirements:
@@ -390,7 +390,7 @@ required_rubygems_version: !ruby/object:Gem::Requirement
       version: '0'
       segments:
       - 0
-      hash: 3835130648573246660
+      hash: -1930903317867552914
 requirements: []
 rubyforge_project: 
 rubygems_version: 1.8.25