fanforce-factory 0.4.0

checksums.yaml

@@ -0,0 +1,15 @@
+---
+!binary "U0hBMQ==":
+  metadata.gz: !binary |-
+    ZDAzOWRiYWJjYjJiODE4MDg1OGQyOTBiMTYyOTU5ODA1YmRlYWE4ZQ==
+  data.tar.gz: !binary |-
+    Mzc5YTBkM2ZiMmIyYjgxZjVmMmUxZDdkOTE1M2Y5Y2E5NDQwODgzYg==
+!binary "U0hBNTEy":
+  metadata.gz: !binary |-
+    ZTgyODM0M2ZmZmQ3YjUwNDA4Y2VmZDBlMDdkOTU3MDg0ZjgyNWFkZDFmNTNm
+    ZmExODU4NGFmODVmYTM1YWVlNzRiMTZkZDA0ZTg5YzkyYzIyZDUxMzllYzg1
+    YWNlOWM4MWViMThiZmRhMjc4NDUzNjIwYmYwOGUwYWVjNjQ4YmQ=
+  data.tar.gz: !binary |-
+    YTVlMjQxYWY0MTJmNzgzZDQxMzkyMTk0ZjE2ZjE4OTY2YTkzYzY2YWIxYzM4
+    YmJhNDY2MjBjNjY3ZmUyMTg0NGVkMWYxNDc1MzIxMDM5NGIzZmI5NDMzYWUz
+    ZmRhZGMwOTQ0NzcxNWUzNzkzZjA3NmYxNzE3NmE2OTEyY2EyM2M=

data/.gitignore

@@ -0,0 +1,19 @@
+*.gem
+*.rbc
+.bundle
+.config
+coverage
+InstalledFiles
+lib/bundler/man
+pkg
+rdoc
+spec/reports
+test/tmp
+test/version_tmp
+tmp
+.idea/
+# YARD artifacts
+.yardoc
+_yardoc
+doc/
+.DS_Store

data/Gemfile

@@ -0,0 +1,3 @@
+source 'https://rubygems.org'
+gemspec
+

data/LICENSE.txt

@@ -0,0 +1,22 @@
+Copyright (c) 2013 Caleb Clark
+
+MIT License
+
+Permission is hereby granted, free of charge, to any person obtaining
+a copy of this software and associated documentation files (the
+"Software"), to deal in the Software without restriction, including
+without limitation the rights to use, copy, modify, merge, publish,
+distribute, sublicense, and/or sell copies of the Software, and to
+permit persons to whom the Software is furnished to do so, subject to
+the following conditions:
+
+The above copyright notice and this permission notice shall be
+included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
+EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
+NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
+LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
+OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
+WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

data/README.md

@@ -0,0 +1,177 @@
+# fanforce-factory
+The simplest way to create and manage a folder of Fanforce addons (plugins, widgets, and apps). This gem provides
+bulk commands that you can run against your entire list of addons.
+
+## Installation
+
+Run this command from your command line:
+
+    gem install fanforce-factory
+
+## Usage
+
+Run this command to view usage instructions
+
+    $ factory
+
+
+## Filtering Commands by Addon Type
+Filtering is supported in version 0.1.0 and higher for all bulk commands. To filter a command, just prefix it with a
+colon (:) and the filter you want to apply (:[FILTER]). Filter can be any addon_type (plugin, widget, or app), singular
+or plural. For example, the following command would only run bundle update on apps:
+
+```
+factory :apps bundle update
+```
+
+If you are using the addon type of "plugins", you can further filter by any of the plugin types (data_connector,
+data_processor, broadcaster, identifier, behavior):
+
+```
+factory :plugins:behaviors bundle update
+```
+
+If you want to get really specific, you can filter on a specific directory:
+
+```
+factory :plugin-watch-youtube bundle update
+```
+
+## Customizing Your Factory Setup with .factoryconfig
+You can add a .factoryconfig to any factory folder you've setup for your addons. It accepts any valid YAML markup.
+Below is a example file that sets a custom local path for plugin, app, and widget gems, plus a version for app gems.
+
+```yaml
+factory_gems:
+
+  plugin:
+    path: '../../fanforce-plugin-factory'
+
+  app:
+    path: '../../fanforce-app-factory'
+    version: '~> 0.1.3'
+
+  widget:
+    path: '../../fanforce-widget-factory'
+
+```
+For more options see BitBucket and Heroku below.
+
+
+## Run Factory Inside an Addon
+
+Sometimes you'll want to use factory commands inside a specific addon. You can as long as the folder contains a config.ru
+file, and the addon is a subdirectory of a factory folder containing a .factoryconfig file.
+
+
+## Supercharge Your Factory
+
+Fanforce-factory comes with a special application when you're running commands on a long list of addons and
+each command is taking a long time to run. It forks each command and runs them in parallel. Only a subset of the full
+factory commands are available with factory-supercharge. Run the following from your terminal to see your available
+options:
+
+```
+factory-supercharge
+```
+
+## BitBucket: Creating Repositories and Pushing
+A BitBucket repository will be automatically setup for each new addon if a bitbucket object is defined in your .factoryconfig file:
+
+```yaml
+bitbucket:
+    user: fanforce-factory
+    password: zE27fbitbucket
+```
+
+## Heroku Apps: Creating and Updating
+A heroku app will be automatically setup for each new addon if a heroku object is defined in your .factoryconfig file. You'll need
+ one for each environment (qa|production) you want apps setup for.
+
+```yaml
+heroku:
+    production:
+        user: technical@fanforce.com
+        git_ssh_domain: heroku_fanforce_factory
+        password: zE27fheroku
+        app_domain: ffapp.io
+        plugin_domain: ffplugin.io
+        widget_domain: ffwidget.io
+        smarturl_domain: fanforce.io
+```
+The git_ssh_domain variable listed above is needed if you're pushing to multiple Heroku accounts as you'll need to specify
+the SSH key that must be used (each Heroku account requires a unique ssh key). For example, the above git_ssh_domain variable
+references the following lines in ~/.ssh/config:
+
+```
+Host heroku_fanforce_factory
+  HostName heroku.com
+  User technical@fanforce.com
+  IdentityFile ~/.ssh/heroku_fanforce_factory
+```
+
+See http://www.springloops.com/blog/git-config-for-mutiply-ssh-keys/ for more info.
+
+## Environment Variables
+Fanforce-factory allows you to setup a list of env variables that can be loaded by your app it's running in your local
+ development environment, pushed to Heroku, or tasks setup on IronWorker.
+
+First, you need to setup a folder called ".env" in your factory folder with a series of YAML files inside. The only required
+file is _bind.yaml:
+
+```yaml
+constantcontact:
+  - app-constantcontact
+  - plugin-constantcontact-subscribers
+
+facebook:
+  - app-facebook
+  - plugin-facebook-friends
+  - plugin-facebook-posts
+
+iron: ALL
+```
+
+Each key is the filename (minus .yaml) of the YAML file holding a list of ENV variables. The array underneath is the folder names of addons
+that these ENV variables will be loaded into. Alternatively, you can specify the keyword ALL if those ENV variables should
+be loaded into all addons.
+
+Second, you'll need to setup the filenames references in _bind.yaml. Each file contains a hash of ENV key/values organized
+by RACK_ENV. Here's is an example of facebook.yaml (of course, you'll need to provide legit facebook api_keys and api_secrets):
+
+```yaml
+development:
+  api_key: 175620799120142
+  api_secret: b4e86cbf9db2ch5777609396b1d0a52f
+
+qa:
+  api_key: 362017347478160
+  api_secret: cf3605c0cnda02c95ddd1bb983a59e7a
+```
+
+## Using IronWorker
+
+Fanforce-factory comes with built in support for using IronWorker in your addons:
+
+```
+factory iron_workers upload:development
+```
+
+There are a couple things you'll want to setup first:
+
+#### 1. Env Variables
+
+- IRON_TOKEN
+- IRON_PROJECT_ID
+
+#### 2.
+
+
+
+## Contributing
+
+1. Fork it
+2. Create your feature branch (`git checkout -b my-new-feature`)
+3. Commit your changes (`git commit -am 'Add some feature'`)
+4. Push to the branch (`git push origin my-new-feature`)
+5. Create new Pull Request

data/Rakefile

@@ -0,0 +1 @@
+require "bundler/gem_tasks"

data/bin/factory

@@ -0,0 +1,18 @@
+#!/usr/bin/env ruby
+require 'fanforce/factory'
+
+factory = Fanforce::Factory.new('factory')
+
+if File.exists?("#{$HomeDir}/config.ru") and File.exists?("#{$HomeDir}/../.factoryconfig")
+  ARGV.unshift(":#{File.basename($HomeDir)}")
+  $HomeDir = File.expand_path('..', $HomeDir)
+  factory.start(
+      :runtype => :single,
+      :allowed => [:update, :restart, :push, :count, :bundle, :git, :iron, :version, :config],
+  )
+else
+  factory.start(
+      :runtype => :realtime,
+      :allowed => [:create, :delete, :update, :restart, :push, :count, :bundle, :git, :iron, :version, :config],
+  )
+end

data/bin/factory-supercharge

@@ -0,0 +1,7 @@
+#!/usr/bin/env ruby
+require 'fanforce/factory'
+
+Fanforce::Factory.new('factory-supercharge').start(
+    :runtype => :forked,
+    :allowed => [:update, :restart, :push, :bundle, :git, :iron, :version, :config],
+)

data/fanforce-factory.gemspec

@@ -0,0 +1,28 @@
+# -*- encoding: utf-8 -*-
+lib = File.expand_path('../lib', __FILE__)
+$LOAD_PATH.unshift(lib) unless $LOAD_PATH.include?(lib)
+require 'fanforce/factory/version'
+require 'rubygems'
+
+Gem::Specification.new do |gem|
+  gem.name          = 'fanforce-factory'
+  gem.version       = Fanforce::Factory::VERSION
+  gem.authors       = ['Caleb Clark']
+  gem.email         = ['cclark@mobilizationlabs.com']
+  gem.description   = %q{CLI for managing a folder of Fanforce addons}
+  gem.summary       = %q{Manage a folder of Fanforce addons}
+  gem.homepage      = ''
+
+  gem.files         = `git ls-files`.split($/)
+  gem.executables   = ['factory','factory-supercharge']
+  gem.test_files    = gem.files.grep(%r{^(test|spec|features)/})
+  gem.require_paths = ['lib']
+
+  gem.add_dependency 'rest-client'
+  gem.add_dependency 'iron_worker_ng'
+  gem.add_dependency 'activesupport'
+  gem.add_dependency 'heroku-api', '0.3.8'
+  gem.add_dependency 'multi_json'
+  gem.add_dependency 'bitbucket_rest_api'
+
+end

data/lib/fanforce/factory.rb

@@ -0,0 +1,12 @@
+require 'active_support/all'
+require 'optparse'
+require 'shell'
+require 'fanforce/factory/initializers/ff_globals'
+require 'rest-client'
+require 'multi_json'
+require 'bitbucket_rest_api'
+require 'heroku-api'
+require 'yaml'
+
+require_relative 'factory/version'
+require_relative 'factory/_base'

data/lib/fanforce/factory/_base.rb

@@ -0,0 +1,290 @@
+require 'fanforce/factory'
+
+class Fanforce::Factory
+  require 'fanforce/factory/utils'
+  require 'fanforce/factory/files'
+  require 'fanforce/factory/addons'
+  require 'fanforce/factory/run'
+  require 'fanforce/factory/developer_config'
+  require 'fanforce/factory/env'
+  require 'fanforce/factory/help'
+  require 'fanforce/factory/commands'
+  include Fanforce::Factory::Utils
+
+  def initialize(executable)
+    @executable = executable
+    $HomeDir = Shell.new.pwd
+  end
+
+  def start(options)
+    @allowed_commands = options[:allowed]
+    @runtype = options[:runtype]
+    setup_config
+    init_counter if @runtype == :forked
+    parse_addons_filter
+    parse_command
+    destroy_counter if @runtype == :forked
+  end
+
+  def setup_config
+    puts 'ERROR: Fanforce Factory could not find the required config file.'.format(:red) if !File.exists?("#{$HomeDir}/.factoryconfig")
+    $Config = format_config(YAML.load_file("#{$HomeDir}/.factoryconfig"))
+  end
+
+  def parse_addons_filter
+    if ARGV[0] =~ /^:(apps?|widgets?|plugins?)(:(data_connectors?|data_processors?|broadcasters?|identifiers?|behaviors?))?$/
+      $Filter = {type: $1.singularize.to_sym}
+      $Filter[:plugin_type] = $3.singularize.to_sym if $3.present? and $Filter[:type] == :plugin
+      ARGV.shift
+    elsif ARGV[0] =~ /^:((app|widget|plugin)-(.+))$/
+      $Filter = {dir_name: $1}
+      ARGV.shift
+    end
+  end
+
+  #################################################################################
+
+  def parse_command
+    if ARGV.length == 0 or !@allowed_commands.include?(ARGV[0].to_sym)
+      puts Fanforce::Factory::Help.intro(@executable, @runtype)
+      puts Fanforce::Factory::Help.commands(@allowed_commands)
+
+    elsif ARGV[0] == 'create'
+      ARGV[1] =~ /^(plugin|widget|app)-(.+)$/ || error('You supplied an invalid create command.', :create)
+
+      addon_type = $1
+      addon_id = $2
+
+      if addon_type =~ /app|widget/
+        create_addon(addon_type, addon_id)
+      else
+        if ARGV[2].nil?
+          error('You failed to supply a valid plugin type for create.', :create)
+        elsif ![:data_connector, :data_processor, :broadcaster, :identifier, :behavior].include?(ARGV[2].to_sym)
+          error('You supplied an invalid plugin type.', :create)
+        else
+          create_addon(addon_type, addon_id, ARGV[2])
+        end
+      end
+
+    #################################################################
+
+    elsif ARGV[0] == 'delete'
+      ARGV[1] =~ /^(plugin|widget|app)-(.+)$/ || error('You supplied an invalid delete command.', :delete)
+
+      confirm("Are you sure you want to delete all files, repositories, and other items for #{ARGV[1]}?")
+      delete_addon($1, $2)
+
+    #################################################################
+
+    elsif ARGV[0] == 'setup'
+      ARGV[1] =~ /^(all|files?|envs?(:all|:development|:qa|:production)?|pows?|bitbuckets?|herokus?(:all|:qa|:production)?)$/ || error('You supplied an invalid setup command.', :setup)
+
+      tmp_str = $1
+      if tmp_str =~ /^envs?|herokus?/
+        command, environment = tmp_str.split(':').map {|d| d.singularize.to_sym }
+        environment = :all if !environment
+        confirm('Are you wanting to setup all environments?') if environment == :all
+      else
+        command = tmp_str.singularize.to_sym
+        environment = command == :all ? :all : nil
+      end
+      confirm('Are you wanting to setup everything in all environments?') if command == :all
+      run(:setup, command, environment)
+
+    #################################################################
+
+    elsif ARGV[0] == 'update'
+      ARGV[1] =~ /^(all|files?|envs?(:all|:development|:qa|:production)?|pows?|bitbuckets?|herokus?(:all|:qa|:production)?)$/ || error('You supplied an invalid update command.', :update)
+
+      tmp_str = $1
+      if tmp_str =~ /^envs?|herokus?/
+        command, environment = tmp_str.split(':').map {|d| d.singularize.to_sym }
+        environment = :all if !environment
+        confirm('Are you sure you want to setup all environments?') if environment == :all
+      else
+        command = tmp_str.singularize.to_sym
+        environment = command == :all ? :all : nil
+      end
+
+      confirm('Are you sure you want to setup everything in all environments?') if command == :all
+      run(:update, command, environment)
+
+    #################################################################
+
+    elsif ARGV[0] == 'restart'
+      if ARGV[1].present?
+        ARGV[1] =~ /^(development|qa|production|all)?$/ || error('You supplied an invalid restart command.', :restart)
+        environment = $1.to_sym
+      else
+        environment = :development
+      end
+
+      confirm('Are you sure you want to restart all environments?') if environment == :all
+      run(:restart, environment)
+
+    #################################################################
+
+    elsif ARGV[0] == 'push'
+      ARGV[1] =~ /^(development|qa|production)(:all|:heroku|:irons?(:upload|:nuclear)?|bitbuckets?)?$/ || error('You supplied an invalid push command.', :push)
+
+      environment = $1.to_sym
+      tmp_str = $2 || 'all'
+
+      if tmp_str =~ /^irons?/
+        command, subcommand = tmp_str.split(':').map {|d| d.singularize.to_sym }
+        subcommand = :upload if !subcommand
+      else
+        command = tmp_str.gsub(':','').singularize.to_sym
+        subcommand = nil
+      end
+
+      confirm("Are you sure you want to push to all services on #{environment}") if command == :all
+      run(:push, environment, command, subcommand)
+
+    #################################################################
+
+    elsif ARGV[0] == 'count'
+      count
+
+    #################################################################
+
+    elsif ARGV[0] == 'bundle'
+      ARGV[1] =~ /^(install|update)$/ || error('You supplied an invalid bundle command.', :bundle)
+
+      run(:bundle, $1.to_sym, ARGV[3..-1] || [])
+
+    #################################################################
+
+    elsif ARGV[0] == 'git' and ARGV[1] == 'status:overview'
+      run(:git_overview)
+
+    elsif ARGV[0] == 'git'
+      run(:git, ARGV[1..-1] || [])
+
+    #################################################################
+
+    elsif ARGV[0] == 'iron'
+      ARGV[1] =~ /^(upload|reset|delete)(:all|:development|:qa|:production)?$/ || error('You supplied an invalid iron command.', :iron)
+
+      command = $1.to_sym
+      environment = ($2.present?) ? $2.gsub(':','').to_sym : :all
+
+      confirm("Are you sure you want to #{command} workers in all environments?") if environment == :all
+      if command == :delete
+        delete_all_iron_workers(environment)
+      else
+        run(:iron, command, environment)
+      end
+
+    #################################################################
+
+    elsif ARGV[0] == 'version'
+      puts '---------------------------------------------------------------------------------------------------------------'
+      puts "You are using version #{Fanforce::Factory::VERSION} of Fanforce Factory "
+      puts '---------------------------------------------------------------------------------------------------------------'
+
+    elsif ARGV[0] == 'config'
+      puts '---------------------------------------------------------------------------------------------------------------'
+      if !File.exists?("#{$HomeDir}/.factoryconfig")
+        puts 'Oops'.format(:red,:bold) + '... no ".factoryconfig" file was found in this directory.'.format(:red)
+      else
+        puts $Config
+      end
+      puts '---------------------------------------------------------------------------------------------------------------'
+
+    #elsif ARGV[0] == 'upgrade'
+    #  factory.upgrade
+
+    end
+
+  end
+
+  #################################################################################
+
+  def run(method, *args)
+    (@runtype == :forked) ? run_forked(method, *args) : run_realtime(method, *args)
+  end
+
+  def run_realtime(method, *args)
+    if (dirs = Addons.dirs).size == 0
+      puts "\n---------------------------------------------------------------------------------------------------------------"
+      puts "#{'Oops'.format(:bold)}... no factory addons #{$Filter.length > 0 ? 'matching your filter was' : 'were'} found in this directory."
+      puts "---------------------------------------------------------------------------------------------------------------\n"
+      return
+    end
+
+    if self.respond_to?(:"preprocess_#{method}")
+      args << self.method(:"preprocess_#{method}").call
+    end
+    Addons.each do |addon, processed_count, total_count|
+      self.method(:"run_#{method}").call(addon.dir, processed_count, total_count, *args)
+    end
+    if self.respond_to?(:"postprocess_#{method}")
+      self.method(:"postprocess_#{method}").call
+    else
+      puts "\n---------------------------------------------------------------------------------------------------------------"
+      puts 'DONE!'
+      puts '---------------------------------------------------------------------------------------------------------------'
+    end
+  end
+
+  def run_forked(method, *args)
+    processes = []
+    dirs = Addons.dirs
+    puts "\n---------------------------------------------------------------------------------------------------------------"
+    dirs.each_with_index do |addon_dir, i|
+      puts "#{'Forking'.format(:white,:bold)} #{addon_dir}"
+    end
+    dirs.each_with_index do |addon_dir, i|
+      processes << fork do
+        response = capture_stdout do
+          self.method(:"run_#{method}").call(addon_dir, 'PROCESSED_ADDONS_COUNT', dirs.size, *args)
+        end
+        puts response.gsub('PROCESSED_ADDONS_COUNT', incr_counter.to_s)
+      end
+      sleep(0.25)
+    end
+
+    processes.each { |pid| Process.waitpid(pid) }
+    puts "\n---------------------------------------------------------------------------------------------------------------"
+    puts 'DONE!'
+    puts '---------------------------------------------------------------------------------------------------------------'
+  end
+
+  require 'stringio'
+  def capture_stdout
+    previous_stdout, previous_stderr = $stdout, $stderr
+    io = StringIO.new
+    $stdout = io
+    $stderr = io
+    yield
+    io.string
+  ensure
+    $stdout = previous_stdout
+    $stderr = previous_stderr
+  end
+
+  def init_counter
+    File.open("#{$HomeDir}/.forked-counter", 'w') {|f| f.write('0') }
+  end
+
+  def incr_counter
+    new_count = nil
+    File.open("#{$HomeDir}/.forked-counter", File::RDWR|File::CREAT, 0644) do |f|
+      f.flock(File::LOCK_EX)
+      new_count = f.read.to_i + 1
+      f.rewind
+      f.write("#{new_count}\n")
+      f.flush
+      f.truncate(f.pos)
+    end
+    new_count
+  end
+
+  def destroy_counter
+    File.delete("#{$HomeDir}/.forked-counter")
+  end
+
+end
+