gooddata 0.6.0.pre10 → 0.6.0.pre11

data/doc/pages/GET_STARTED.md

@@ -1,3 +1,5 @@
+# @title Get Started
+
 <div class="container-narrow">
 
 <h1>Get Started</h1>
@@ -240,11 +242,10 @@ report.save
     resolve to its first Label. If an attribute has more than one it will take the first.</p>
 
 <p>1) MD object. Metric, Attribute and Label
-    2) hash. If you do not have the object handy you can pass a hash structure like this {:type => :attribute, :title =>
-    'some title'}. It will perform the lookup for you. This currently works for :attribute and :metric. If you want to
-    perform the lookup through identifier you can do it as well. Since id is unique {:identifier => 'some id'}
+    2) hash. If you do not have the object handy you can pass a hash structure like this <pre>{:type => :attribute, :title => 'some title'}</pre>. It will perform the lookup for you. This currently works for :attribute and :metric. If you want to
+    perform the lookup through identifier you can do it as well. Since id is unique <pre>{:identifier => 'some id'}</pre>
     3) String. If you put there a string it is assumed it is a name of an attribute so 'some title' is equivalent with
-    typing {:type => :attribute, :title => 'some title'}</p>
+    typing <pre>{:type => :attribute, :title => 'some title'}</pre></p>
 
 <p>TODO
     Describe filtering</p>

data/doc/pages/HOMEPAGE.md

@@ -1,3 +1,5 @@
+# @title Homepage
+
 <div class="jumbotron">
     <!-- style="background: -webkit-gradient(linear, left bottom, right top, color-stop(0%,white), color-stop(100%,#6d3353));"> -->
 

data/doc/pages/TUTORIALS.md

@@ -1,7 +1,7 @@
+# @title Tutorials
+
 <div class="container-narrow">
     <ul class="posts">
-
-
         <div>
             <a href="/docs/file/doc/pages/tutorial/YOUR_FIRST_PROJECT.md"><h3>Your first project</h3></a>
 
@@ -39,7 +39,7 @@
 
 
         <div>
-            <a href="/docs/file/doc/pages/tutorial/ON_GOOD_DATA_PLATFORM.md"><h3>Executing ruby on GoodData plaform</h3>
+            <a href="/docs/file/doc/pages/tutorial/BRICKS.md"><h3>Executing ruby on GoodData plaform</h3>
             </a>
 
             <div>ETL is the back bone of every project. But project is not just about crunching numbers. What to do with

data/doc/pages/tutorial/BRICKS.md

@@ -1,3 +1,5 @@
+# @title Executing ruby on GoodData plaform
+
 You can run Ruby on GoodData platform. Let's have a look at the platform and walk step by step through doing the simplest possible deployment and then move to more advanced tasks.
 
 ## Not reinventing the wheel
@@ -9,6 +11,7 @@ The main idea is that only minority of people should be forced to write code. Th
 GoodData Ruby SDK stack is built so you can easily develop things locally and deploy them when you have tested them and are happy with how they work. You need to set up an environment first.
 
 ### Prerequisites
+
  * Git
  * Ruby (JRuby recommended)
  * Ruby Gems
@@ -44,7 +47,7 @@ Run this in console.
 
 It will take some time but after a while you should see green DONE on your console and a link for the log. Open it in your browser and you should see there something like this. On one of the lines there should be hello world. Great you just ran your first ruby brick.
 
-###Looking inside Hello World
+### Looking inside Hello World
 
 Let's see what is happening inside. Open the main.rb file in your favorite editor. You should see something like this.
 

data/doc/pages/tutorial/CREATING_A_MODEL.md

@@ -1,3 +1,5 @@
+# @title Creating A Model
+
 There are several ways how to express a model and create it in GoodData. The most prominent way to do it is the visual modeler that is part of the CloudConnect package. There are clear advantages like being visual but there are also drawbacks. It is not repeatable, it is not programmable and it is not text based. Let's have a look how to create a simple model using Ruby SDK.
 
 ## The model

data/doc/pages/tutorial/CRUNCHING_NUMBERS.md

@@ -1,6 +1,4 @@
-<div markdown="1">
-    This is *true* markdown text.
-</div>
+# @title Crunching Numbers
 
 MAQL is a language that is fairly similar to SQL but it is aimed towards getting the data from OLAP system. You are never forced to talk about columns and specify joins explicitly. This is great but there are some drawbacks. Same as SQL MAQL is aimed towards users more than machines which does not help for automation but there is one more caveat that make it hard to use even for humans. Probably to your surprise
 

data/doc/pages/tutorial/TEST_DRIVEN_DEVELOPMENT.md

@@ -1,3 +1,5 @@
+# @title Test Driven Development
+
 Test driven development is a holy grail for many developers. It gives you an additional sense of security and you can rely on the test suite to give you a safety net when you are refactoring and tweaking existing code. Testing reports was hard until now.
 
 ## The model

data/doc/pages/tutorial/YOUR_FIRST_PROJECT.md

@@ -1,15 +1,16 @@
+# @title Your First Project
 
 Ok welcome. Let's spin up an example project that we created so you can explore and see SDK in action. It is super simple. Since you are probably a developer we created simple project about developers.
 
-###What we want to measure
+### What we want to measure
 Imagine you have a small dev shop. You have couple of developers. They crank out code. You also have couple of repositories for products. You want to measure how many lines of code each of the devs create. you wanna be able to track it by time by repository and by person. You want to see how many lines of code they committed.
 
-###Model
+### Model
 This is how the model looks.
 
 ![Model](https://dl.dropboxusercontent.com/s/1y97ziv5anmpn9s/gooddata_devs_demo_model.png?token_hash=AAENC89d8XOfCr9AnyQCrd9vwfhb-bDuYcORQ0AIRP2RQQ)
 
-###Spinning it up
+### Spinning it up
 Let's do this. I assume you have gooddata SDK installed and working. Run
 
     gooddata scaffold project my_test_project

data/doc/templates/default/class/setup.rb

@@ -4,6 +4,7 @@ def init
   super
   sections.place(:subclasses).before(:children)
   sections.place(:constructor_details, [T('method_details')]).before(:methodmissing)
+  sections.place(:specs).before(:children)
 end
 
 def constructor_details

data/doc/templates/default/method_details/setup.rb

@@ -1,5 +1,6 @@
 def init
-  sections :header, [:method_signature, T('docstring'), :source]
+  super
+  sections :header, [:method_signature, T('docstring'), :source, :specs]
 end
 
 def source

data/doc/templates/default/module/setup.rb

@@ -1,7 +1,7 @@
 include Helpers::ModuleHelper
 
 def init
-  sections :header, :box_info, :pre_docstring, T('docstring'), :children,
+  sections :header, :box_info, :pre_docstring, T('docstring'), :specs, :children,
     :constant_summary, [T('docstring')], :inherited_constants,
     :attribute_summary, [:item_summary], :inherited_attributes,
     :method_summary, [:item_summary], :inherited_methods,

data/gooddata

@@ -0,0 +1,7 @@
+#!/usr/bin/env ruby
+
+require File.join(File.dirname(__FILE__), "lib/gooddata/cli/cli")
+
+res = GoodData::CLI.main(ARGV)
+
+exit(res)

data/gooddata.gemspec

@@ -33,6 +33,7 @@ Gem::Specification.new do |s|
   s.add_development_dependency "simplecov", "~> 0.8.2"
   s.add_development_dependency "yard", "~> 0.8.7.3"
   s.add_development_dependency "yard-rspec", "~> 0.1"
+  s.add_development_dependency "ZenTest", "~> 4.9.5"
 
   s.add_dependency "activesupport", "~> 4.0.3"
   s.add_dependency "bundler", "~> 1.5.3"

data/lib/gooddata.rb

@@ -1,7 +1,18 @@
 module GoodData; end
 
 require 'active_support/all'
-require 'gooddata/client'
-require 'gooddata/model'
-require 'gooddata/bricks/brick'
-require 'gooddata/exceptions'
+
+# Modules
+require File.join(File.dirname(__FILE__), 'gooddata/bricks/bricks')
+require File.join(File.dirname(__FILE__), 'gooddata/cli/cli')
+require File.join(File.dirname(__FILE__), 'gooddata/commands/commands')
+require File.join(File.dirname(__FILE__), 'gooddata/core/core')
+require File.join(File.dirname(__FILE__), 'gooddata/models/models')
+
+# Files
+require File.join(File.dirname(__FILE__), 'gooddata/client')
+require File.join(File.dirname(__FILE__), 'gooddata/connection')
+require File.join(File.dirname(__FILE__), 'gooddata/exceptions')
+require File.join(File.dirname(__FILE__), 'gooddata/extract')
+require File.join(File.dirname(__FILE__), 'gooddata/helpers')
+require File.join(File.dirname(__FILE__), 'gooddata/version')

data/lib/gooddata/bricks/base_downloader.rb

@@ -41,6 +41,7 @@ module GoodData::Bricks
       meta
     end
 
+    # Run downloader
     def run
       downloaded_data = download
       downloaded_data = pre_process(downloaded_data)

data/lib/gooddata/bricks/brick.rb

@@ -1,21 +1,26 @@
-require 'gooddata/bricks/utils'
-require 'gooddata/bricks/base_downloader'
-require 'gooddata/bricks/middleware/middleware'
-require 'gooddata/bricks/middleware/bench_middleware'
-require 'gooddata/bricks/middleware/gooddata_middleware'
-require 'gooddata/bricks/middleware/logger_middleware'
-require 'gooddata/bricks/middleware/stdout_middleware'
-require 'gooddata/bricks/middleware/restforce_middleware'
-require 'gooddata/bricks/middleware/bulk_salesforce_middleware.rb'
-require 'gooddata/bricks/middleware/twitter_middleware'
+require File.join(File.dirname(__FILE__), 'base_downloader')
+require File.join(File.dirname(__FILE__), 'utils')
+
+Dir[File.dirname(__FILE__) + '/commands/**/*_cmd.rb'].each do |file|
+  require file
+end
+
+require File.join(File.dirname(__FILE__), 'middleware/middleware')
 
 module GoodData::Bricks
   class Pipeline
     def self.prepare(pipeline)
-      pipeline.reverse.reduce(nil) {|memo, app| memo.nil? ? app.new : app.new(memo)}
+      pipeline.reverse.reduce(nil) do |memo, app|
+        if memo.nil?
+          app.respond_to?(:new) ? (app.new) : app
+        else
+          app.respond_to?(:new) ? (app.new(:app => memo)) : (app.app = memo; app)
+        end
+      end
     end
   end
-  
+
+  # Brick base class
   class Brick
 
     def log(message)

data/lib/gooddata/bricks/bricks.rb

@@ -0,0 +1,7 @@
+base = Pathname(__FILE__).dirname.expand_path
+Dir.glob(base + '*.rb').each do |file|
+  require file
+end
+
+# Require all middleware
+require File.join(File.dirname(__FILE__), "middleware/middleware")

data/lib/gooddata/bricks/middleware/base_middleware.rb

@@ -0,0 +1,13 @@
+module GoodData::Bricks
+
+  class Middleware
+    attr_accessor :app
+
+    include GoodData::Bricks::Utils
+
+    def initialize(options={})
+      @app = options[:app]
+    end
+
+  end
+end

data/lib/gooddata/bricks/middleware/bench_middleware.rb

@@ -1,4 +1,5 @@
 require 'benchmark'
+require File.join(File.dirname(__FILE__), "base_middleware")
 
 module GoodData::Bricks
 

data/lib/gooddata/bricks/middleware/bulk_salesforce_middleware.rb

@@ -1,6 +1,7 @@
-require 'gooddata'
 require 'salesforce_bulk'
 
+require File.join(File.dirname(__FILE__), "base_middleware")
+
 module GoodData::Bricks
   class BulkSalesforceMiddleware < GoodData::Bricks::Middleware
 

data/lib/gooddata/bricks/middleware/fs_upload_middleware.rb

@@ -0,0 +1,30 @@
+require 'uri'
+require 'net/http'
+require 'pathname'
+
+module GoodData::Bricks
+
+  class FsUploadMiddleware < GoodData::Bricks::Middleware
+
+    def initialize(options={})
+      super
+      @destination = options[:destination]
+    end
+
+    def call(params)
+      returning(@app.call(params)) do |result|
+        destination = @destination
+        (params["gdc_files_to_upload"] || []).each do |f|
+          path = f[:path]
+          case destination.to_s
+          when "staging"
+            url = GoodData.get_user_webdav_path(path)
+            GoodData.upload_to_user_webdav(path)
+            puts "Uploaded local file \"#{path}\" to url \"#{url + path}\""
+          end
+        end
+      end
+    end
+
+  end
+end

data/lib/gooddata/bricks/middleware/gooddata_middleware.rb

@@ -1,24 +1,26 @@
 require 'gooddata'
 
+require File.join(File.dirname(__FILE__), "base_middleware")
+
 module GoodData::Bricks
   class GoodDataMiddleware < GoodData::Bricks::Middleware
 
     def call(params)
-      logger = params[:gdc_logger]
-      token_name = :GDC_SST
-      protocol_name = :GDC_PROTOCOL
-      server_name = :GDC_HOSTNAME
-      project_id = params[:GDC_PROJECT_ID]
+      logger = params["GDC_LOGGER"]
+      token_name = "GDC_SST"
+      protocol_name = "GDC_PROTOCOL"
+      server_name = "GDC_HOSTNAME"
+      project_id = params["GDC_PROJECT_ID"]
 
       fail "SST (SuperSecureToken) not present in params" if params[token_name].nil?
       server = if !params[protocol_name].empty? && !params[server_name].empty?
         params[protocol_name] + "://" + params[server_name]
       end
 
-      fail "GoodData username is missing. Expected param :GDC_USERANME" if params[:GDC_USERNAME].nil?
-      fail "GoodData password is missing. Expected param :GDC_PASSWORD" if params[:GDC_PASSWORD].nil?
+      fail "GoodData username is missing. Expected param \"GDC_USERNAME\"" if params["GDC_USERNAME"].nil?
+      fail "GoodData password is missing. Expected param \"GDC_PASSWORD\"" if params["GDC_PASSWORD"].nil?
 
-      GoodData.connect(params[:GDC_USERNAME], params[:GDC_PASSWORD], {:server => server})
+      GoodData.connect(params["GDC_USERNAME"], params["GDC_PASSWORD"], {:server => server})
       GoodData.logger = logger
       GoodData.with_project(project_id) do |p|
         @app.call(params)

data/lib/gooddata/bricks/middleware/logger_middleware.rb

@@ -1,12 +1,13 @@
 require 'logger'
 
+require File.join(File.dirname(__FILE__), "base_middleware")
+
 module GoodData::Bricks
   class LoggerMiddleware < GoodData::Bricks::Middleware
 
     def call(params)
-      logger = params[:gdc_logger] = params[:GDC_LOGGER_FILE].nil? ? Logger.new(STDOUT) : Logger.new(params[:GDC_LOGGER_FILE])
+      logger = params["GDC_LOGGER"] = params[:GDC_LOGGER_FILE].nil? ? Logger.new(STDOUT) : Logger.new(params[:GDC_LOGGER_FILE])
       logger.info("Pipeline starts")
-
       returning(@app.call(params)) do |result|
         logger.info("Pipeline ending")
       end

data/lib/gooddata/bricks/middleware/middleware.rb

@@ -1,11 +1,4 @@
-module GoodData::Bricks
-
-  class Middleware
-    include GoodData::Bricks::Utils
-
-    def initialize(app)
-      @app = app
-    end
-    
-  end
-end
+base = Pathname(__FILE__).dirname.expand_path
+Dir.glob(base + '*_middleware.*').each do | file |
+  require file
+end

data/lib/gooddata/bricks/middleware/restforce_middleware.rb

@@ -1,5 +1,7 @@
 require 'gooddata'
 
+require File.join(File.dirname(__FILE__), "base_middleware")
+
 module GoodData::Bricks
   class RestForceMiddleware < GoodData::Bricks::Middleware
 

data/lib/gooddata/bricks/middleware/stdout_middleware.rb

@@ -1,3 +1,5 @@
+require File.join(File.dirname(__FILE__), "base_middleware")
+
 module GoodData::Bricks
   class STDOUTLoggingMiddleware < GoodData::Bricks::Middleware
 

data/lib/gooddata/bricks/middleware/twitter_middleware.rb

@@ -1,5 +1,7 @@
 # require 'twitter'
 
+require File.join(File.dirname(__FILE__), "base_middleware")
+
 module GoodData::Bricks
   
   class TwitterMiddleware < GoodData::Bricks::Middleware

data/lib/gooddata/cli/cli.rb

@@ -0,0 +1,28 @@
+require 'gli'
+require 'pp'
+
+# Define GoodData::CLI as GLI Wrapper
+module GoodData
+  module CLI
+    include GLI::App
+
+    # Require shared part of GLI::App - flags, meta, etc
+    require File.join(File.dirname(__FILE__), 'shared.rb')
+
+    # Require Hooks
+    require File.join(File.dirname(__FILE__), 'hooks.rb')
+
+    GLI::App.commands_from(File.join(File.dirname(__FILE__), 'commands'))
+
+    def self.init
+    end
+
+    def self.main(args = ARGV)
+      run(args)
+    end
+  end
+end
+
+if __FILE__ == $0
+  GoodData::CLI.main(ARGV)
+end

data/lib/gooddata/cli/commands/api_cmd.rb

@@ -0,0 +1,30 @@
+require 'pp'
+
+require File.join(File.dirname(__FILE__), "../shared")
+require File.join(File.dirname(__FILE__), "../../commands/api")
+
+GoodData::CLI.module_eval do
+  desc 'Some basic API stuff directly from CLI'
+  arg_name 'info|test|get|delete'
+  command :api do |c|
+
+    c.desc "Info about the API version etc"
+    c.command :info do |info|
+      info.action do |global_options, options, args|
+        opts = options.merge(global_options)
+        GoodData.connect(opts)
+        pp GoodData::Command::Api.info
+      end
+    end
+
+    c.desc "GET request on our API"
+    c.command :get do |get|
+      get.action do |global_options, options, args|
+        opts = options.merge(global_options)
+        GoodData.connect(opts)
+        pp GoodData::Command::Api.get(args[0])
+      end
+    end
+
+  end
+end