open-dock 0.0.12 → 0.0.13

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA1:
-  metadata.gz: b3cefa81ff88689e2b88ead2007ee092742f5d46
-  data.tar.gz: 3fd0a0a696267642a7986654dbe01174f1fa3504
+  metadata.gz: 5b03f5d376730bd6c896aad8c253abdc81790fe6
+  data.tar.gz: e80058519207416314e60e131765c4ba845b8275
 SHA512:
-  metadata.gz: 12ad80c138774601ff0215550827ffc516d0302e517f8c11fc96fc32ccdd57b88acc1141800671b421ca94f38c17f1ad9be9d1d82c0046883a41de5ed760637b
-  data.tar.gz: a94147e0c43f7b7b79ca7ff07a62d224907608af3de1f2c3ea64b5fd7a150041f34ad8313b9fba72476aafa35abd6072c243c5aa5ab5a2a70684d3ff6704f2d8
+  metadata.gz: f65cec8614aecb8341b9f49ab941ff82568785fe8dc0d066c30bb1c4aa1b07bf300b37e9103727e369d48b4447c23717f09fdb9a7124ff7de33629299c51ba13
+  data.tar.gz: 727348c3d59295e1bcf62df4503d2717f43c9d8c018afced798386b8111189cc9fc3f76fb5bc5851f32959c73f45462cf3d8ef6e872ca3ce3f427a5677c81113

data/README.md

@@ -23,56 +23,32 @@ Or install it yourself as:
     $ gem install open-dock
 
 
-## Usage: Provision with OPS command
 
-OPS command is focused to cover first Provision configurations for a the Operations of your infrastructure.
-
-You can create an infrastructure project (like me [/ops](https://github.com/jlebrijo/ops)) 
-
-```
-mkdir ops && cd ops
-rbenv local 2.1.2
-git init
-```
-
-Create a Gemfile:
 
-```
-source 'https://rubygems.org'
-
-gem 'open-dock'
+## Initialize project
 
-# OPTIONAL: Add next gems if you want to integrate with Chef as Configuration management tecnology
-gem 'knife-solo'
-gem 'librarian-chef'
-gem 'foodcritic'
-```
-
-And: `bundle install`
-
-To avoid `bundle exec` repfix: `bundle install --binstubs .bundle/bin`
-
-Or integrate it within your Chef infrastructure project. Just add the gem to your Gemfile.
-
-### Folder Structure
-
-TODO: `ops init` to create this structure
+TODO: `ops init` to create folder structure and example files
 
 Structure:
 
 ```
 providers
-  digitalocean.yml
+  digital_ocean.yml
+  google_cloud.yml
 hosts
   example.com.yml
 containers
   example.com.yml
 ```
 
-#### Provider file syntax
+## Configure PROVIDER
+
+`ops list` command will list all providers suported by this gem.
 
 TODO: Create more providers (aws, linode, gcloud, ...)
 
+### Digital Ocean
+
 For a Digital Ocean provider create a file (ops/providers/digitalocean.yml) with your account API key:
 
 ```yml
@@ -81,11 +57,28 @@ token: a206ae60dda6bxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxcf0cbf41
 
 Token can be activated in your DigitaOcean console > Apps & API > Generate new token. Be sure to give write premissions.
 
-#### Host file syntax
+### Google Cloud
+
+To configure Google Cloud provider create a file (ops/providers/digitalocean.yml) with these params:
+
+```yml
+google_client_email: "850xxxxxxxx-xxxxxxxxxxxxxxxxxxxxxxxxxxtauvbl@developer.gserviceaccount.com"
+google_project: "project_name"
+google_key_location: "path_to_your_p12_file"
+```
+
+You can see how to create ‘google_key_location’ and ‘google_client_email’ at https://developers.google.com/accounts/docs/OAuth2ServiceAccount#creatinganaccount
+
+## Configure HOST
+
+With these files you can configure your instances/servers/droplets/ships on every provider you have configured in the last point.
+
+### Digital Ocean Host
 
 For a Digital Ocean host we can make the following file (ops/hosts/example.com.yml):
 
 ```yml
+provider: digital_ocean
 user: core   # User to connect the host
 # Values to configure DigitalOcean machine
 size:     1gb
@@ -95,9 +88,32 @@ ssh_keys:
   - e7:51:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:88:57
 ```
 
-And create the host: `ops create host example.com`
+Helpful commands:
+
+* `ops list digital_ocean` list all possible parameter values to use in the yml file
+* `ops create example.com` will create your host
+
+### Google Cloud Host
+
+For a Google Cloud host we can make the following file (ops/hosts/example.com.yml):
+
+```yml
+provider: google_cloud
+user: core   # User to connect the host
+# Values to configure GoogleCloud machine
+machine_type: g1-small
+zone_name: europe-west1-b
+public_key_path: ~/.ssh/id_rsa.pub
+source_image: coreos-stable-444-5-0-v20141016
+disk_size_gb: 10
+```
+
+Helpful commands:
+
+* `ops list google_cloud` list all possible parameter values to use in the yml file
+* `ops create example.com` will create your host
 
-### Containers file syntax
+##Configure hosted CONTAINERS (Docker)
 
 In this file we can configure all containers to run in the host provided in the name:
 
@@ -125,27 +141,59 @@ www:
 #   image: ubuntu/postgresql
 ```
 
-Create containers at host: `ops ship host example.com`
+`ops ship example.com` will create all containers configured on 'containers/example.com.yml' file
 
-### TODO: Configuration with Chef
+## TODO: Configure Containers (are nodes, with  Chef)
 
 Configuration with chef commands
 
 * `ops configure CONTAINER_NAME HOST_NAME`: configure with chef a container in host. Here you need to install knife-solo gem.
     * knife solo cook [container_user]@[HOST_NAME] -p [container_ssh_port]
 
-### Commands
+## Commands
 
 Create/delete domain names, create/delete hosts and ship/unship hosts:
 
+* TODO: `ops init` initialize needed folders and example files
 * `ops create HOST_NAME` create the host defined by the name of the file in the 'ops/hosts' folder.
 * `ops delete HOST_NAME`
 * TODO: `ops recreate HOST_NAME` delete/create the host.
+* `ops exec HOST_NAME "COMMAND"` execute any command on a host remotely (i.e. ops exec example.com 'docker ps -a')
 * `ops ship HOST_NAME` run the containers in the host.
 * `ops unship HOST_NAME`
 * TODO: `ops reship HOST_NAME` unship/ship all containers from host.
 * TODO: `ops configure CONTAINER_NAME HOST_NAME` configure container with chef.
 
+## Create your infrastructure project (/ops)
+
+OPS command is focused to cover first Provision configurations for a the Operations of your infrastructure.
+
+You can create an infrastructure project (like me [/ops](https://github.com/jlebrijo/ops)) 
+
+```
+mkdir ops && cd ops
+rbenv local 2.1.2
+git init
+```
+
+Create a Gemfile:
+
+```
+source 'https://rubygems.org'
+
+gem 'open-dock'
+
+# OPTIONAL: Add next gems if you want to integrate with Chef as Configuration management tecnology
+gem 'knife-solo'
+gem 'librarian-chef'
+gem 'foodcritic'
+```
+
+And: `bundle install`
+
+To avoid `bundle exec` repfix: `bundle install --binstubs .bundle/bin`
+
+Or integrate it within your Chef infrastructure project. Just add the gem to your Gemfile.
 
 ## Contributing
 
@@ -169,4 +217,10 @@ Create/delete domain names, create/delete hosts and ship/unship hosts:
 
 * Remove create/delete domain commands
 * Remove "host" word from all commands
-* Remove /ops folder from providers, hosts and containers subfolders
+* Remove /ops folder from providers, hosts and containers subfolders
+
+### v0.0.13
+
+* Added Google Cloud as provider
+* Now providers files are called underscored: digital_ocean, google_cloud ....
+* In hosts YAML files we should include which provider will be built (i.e. provider: digital_ocean)

data/lib/open-dock/commands/create_host.rb

@@ -4,14 +4,7 @@ command :create do |c|
   c.description = "Creates the host described in the file #{Ops::HOSTS_DIR}/[DNS_name].yml"
   c.example "Create the host example.com in your DigitalOcean console. This is described in '#{Ops::HOSTS_DIR}/example.com.yml' like:\n    #      size:     512mb\n    #      region:   ams1\n    #      image:    coreos-stable\n    #      ssh_keys:\n    #        - e7:51:47:bc:7f:dc:2f:3c:56:65:28:e1:10:9c:88:57  xx:xx:xx:xx:xx:xx:xx", 'ops create example.com'
   c.action do |args, options|
-    droplet = DigitalOcean::build_droplet args[0]
-    cli = DigitalOcean::client
-    resp = cli.droplets.create droplet
-    if resp == droplet
-      ip = cli.find_droplet_by_name(args[0]).networks["v4"].first.ip_address
-      say "Droplet #{args[0]} (IP: #{ip}) succesfully created!"
-    else
-      raise resp
-    end
+    host = Host.new args[0]
+    host.create
   end
 end

data/lib/open-dock/commands/delete_host.rb

@@ -4,13 +4,7 @@ command :delete do |c|
   c.description = "Delete the host, based on DNS_name, which (not need but) should be described in its #{Ops::HOSTS_DIR}/[DNS_name].yml file  "
   c.example 'Delete the host example.com in your DigitalOcean console', 'ops delete example.com'
   c.action do |args, options|
-    cli = DigitalOcean::client
-    id = cli.find_droplet_by_name(args[0]).id
-    resp = cli.droplets.delete id: id
-    if resp.is_a?(TrueClass)
-      say "Droplet #{args[0]} succesfully deleted!"
-    else
-      raise resp
-    end
+    host = Host.new args[0]
+    host.delete
   end
 end

data/lib/open-dock/commands/list.rb

@@ -1,29 +1,16 @@
 command :list do |c|
   c.summary = 'List all droplet creation parameters'
-  c.syntax = 'ops list'
-  c.description = "This shows a list in the format '- [id] =>  [description]'. Use [id] values to create your host file in #{Ops::HOSTS_DIR}[dns_name].yml "
+  c.syntax = 'ops list |provider|'
+  c.description = "List all possible providers, and all possible params for a provider if |provider| is defined"
+  c.example "List all possible providers", "ops list"
+  c.example "List all possible arguments for DigitalOcean", "ops list digital_ocean"
   c.action do |args, options|
-    cli = DigitalOcean::client
-    say "\nDESCRIPTION: #{c.description}\n"
-
-    say "\nSizes:"
-    cli.sizes.all.each do |i|
-      say "   - #{i.slug.ljust(6)} =>   $#{i.price_monthly}/mo"
-    end
-
-    say "\nRegions:"
-    cli.regions.all.each do |i|
-      say "   - #{i.slug.ljust(6)} =>   #{i.name}"
+    if args[0]
+      say "\nDESCRIPTION: This shows a list in the format '- [id] =>  [description]'. Use [id] values to create your host file in #{Ops::HOSTS_DIR}/[dns_name].yml\n"
+      ProviderFactory.build(args[0]).list_params
+    else
+      ProviderFactory.list_providers
     end
 
-    say "\nImages:"
-    cli.images.all.each do |i|
-      say "   - #{i.slug.ljust(20)} =>   #{i.distribution} #{i.name}" unless i.slug.nil?
-    end
-
-    say "\nSSH Keys:"
-    cli.ssh_keys.all.each do |i|
-      say "   - #{i.fingerprint} =>   #{i.name}"
-    end
   end
 end

data/lib/open-dock/ops.rb

@@ -2,7 +2,7 @@ require 'rubygems'
 require 'commander/import'
 require 'net/ssh'
 require 'open-dock/base'
-require 'open-dock/digitalocean'
+require 'open-dock/providers'
 require 'open-dock/docker'
 require 'open-dock/version'
 
@@ -10,5 +10,6 @@ program :name, 'ops'
 program :version, OpenDock::VERSION
 program :description, 'Encapsulates Operations commands for complex server clouds: Provision and Configuration from all possible providers such as DigitalOcean, Google Cloud, Rackspace, Linode,...'
 program :help_formatter, :compact
+program :help, 'Author', 'Juan Lebrijo <juan@lebrijo.com>'
 
 Dir.glob("#{File.dirname(__FILE__)}/commands/*.rb").each { |r| load r }

data/lib/open-dock/providers.rb

@@ -0,0 +1,65 @@
+require 'yaml'
+require 'active_support/inflector'
+
+class Provider
+  def initialize
+    config_file = "#{Ops::PROVIDERS_DIR}/#{self.class.name.underscore}.yml"
+    begin
+      config = YAML.load_file config_file
+    rescue
+      raise "Please, create '#{config_file}' file following gem instrunctions"
+    end
+    create_connection config
+  end
+  def create(config)
+    raise "CREATE action not implemented"
+  end
+  def delete(host)
+    raise "DELETE action not implemented"
+  end
+  def list_params
+    raise "LIST PARAMS action not implemented"
+  end
+
+  private
+  def create_connection(config)
+    raise "PROVIDER connection should be created"
+  end
+end
+
+Dir.glob("#{File.dirname(__FILE__)}/providers/*.rb").each { |r| load r }
+
+class ProviderFactory
+  class << self
+    def build(provider_name)
+      provider_name.classify.constantize.new
+    end
+
+    def list_providers
+      say Dir.glob("#{File.dirname(__FILE__)}/providers/*.rb").
+          select{|f| f.include? ".rb"}.
+          map{|f| f.split("/").last.split(".")[0]}.
+          join ", "
+    end
+  end
+end
+
+class Host
+  def initialize(host_name)
+    @host = host_name
+    config_file = "#{Ops::HOSTS_DIR}/#{host_name}.yml"
+    begin
+      @config = YAML.load_file "#{config_file}"
+      @config["name"]= host_name
+    rescue
+      raise "Please, create '#{config_file}' file with token value"
+    end
+    @provider = ProviderFactory.build @config["provider"]
+  end
+  def create
+    @provider.create @config
+  end
+  def delete
+    @provider.delete @host
+  end
+end

data/lib/open-dock/providers/digital_ocean.rb

@@ -0,0 +1,67 @@
+require 'droplet_kit'
+
+class DigitalOcean < Provider
+
+  def create(config)
+    droplet = DropletKit::Droplet.new config
+    resp = @connection.droplets.create droplet
+    if resp == droplet
+      ip = @connection.find_droplet_by_name(config["name"]).networks["v4"].first.ip_address
+      say "Droplet #{config["name"]} (IP: #{ip}) successfully created!"
+    else
+      raise resp
+    end
+  end
+
+  def delete(host)
+    begin
+      id = @connection.find_droplet_by_name(host).id
+      resp = @connection.droplets.delete id: id
+    rescue NoMethodError
+      raise "#{host} does not exist"
+    rescue
+      raise resp
+    end
+
+    if resp.is_a?(TrueClass)
+      say "Droplet #{host} successfully deleted!"
+    else
+      raise resp
+    end
+  end
+
+  def list_params
+    say "\nSizes:"
+    @connection.sizes.all.each do |i|
+      say "   - #{i.slug.ljust(6)} =>   $#{i.price_monthly}/mo"
+    end
+
+    say "\nRegions:"
+    @connection.regions.all.each do |i|
+      say "   - #{i.slug.ljust(6)} =>   #{i.name}"
+    end
+
+    say "\nImages:"
+    @connection.images.all.each do |i|
+      say "   - #{i.slug.ljust(20)} =>   #{i.distribution} #{i.name}" unless i.slug.nil?
+    end
+
+    say "\nSSH Keys:"
+    @connection.ssh_keys.all.each do |i|
+      say "   - #{i.fingerprint} =>   #{i.name}"
+    end
+  end
+
+  private
+  def create_connection(config)
+    @connection = DropletKit::Client.new(access_token: config["token"])
+  end
+end
+
+module DropletKit
+  class Client
+    def find_droplet_by_name(host_name)
+      self.droplets.all.find{|d| d.name == host_name}
+    end
+  end
+end

data/lib/open-dock/providers/google_cloud.rb

@@ -0,0 +1,65 @@
+require "fog"
+require "google/api_client"
+Fog::VERSION=1
+I18n.enforce_available_locales = false
+
+class GoogleCloud < Provider
+
+  def create(config)
+    say "Creating Disk and Server instance, please wait ..."
+    disk = @connection.disks.create name: config["name"].parameterize,
+                                    size_gb: config["disk_size_gb"],
+                                    zone_name: config["zone_name"],
+                                    source_image: config["source_image"]
+
+    server = @connection.servers.bootstrap name: config["name"].parameterize,
+                                           machine_type: config["machine_type"],
+                                           zone_name: config["zone_name"],
+                                           disks: [disk.get_as_boot_disk(true)],
+                                           user: config["user"],
+                                           public_key_path: File.expand_path(config["public_key_path"])
+    server.set_disk_auto_delete true, server.disks[0]["deviceName"]
+
+    ip = server.network_interfaces[0]["accessConfigs"][0]["natIP"]
+    say "Instance #{config["name"]} (IP: #{ip}) successfully created!"
+  end
+
+  def delete(host)
+    server = @connection.servers.get(host.parameterize)
+    if server
+      server.destroy
+      say "Instance #{host} successfully deleted!"
+    else
+      raise "Instance #{host} does not exist in your Google account"
+    end
+  end
+
+  def list_params
+    say "\nZones"
+    @connection.zones.each do |i|
+      say "   - #{i.name}"
+    end
+
+    say "\nMachine types:"
+    @connection.flavors.group_by(&:zone).each do |zone, flavors|
+      say "    Zone #{zone}:"
+      flavors.each do |i|
+        say "       - #{i.name.ljust(16)} =>   #{i.description}"
+      end
+    end
+
+    say "\nImages:"
+    @connection.images.select{|z| z.deprecated.nil?}.each do |i|
+      say "   - #{i.name.ljust(40)} =>   #{i.description}\n"
+    end
+
+  end
+
+  private
+  def create_connection(config)
+    @connection = Fog::Compute.new provider: "Google",
+                                   google_client_email: config["google_client_email"],
+                                   google_project: config["google_project"],
+                                   google_key_location: config["google_key_location"]
+  end
+end

data/lib/open-dock/version.rb

@@ -1,3 +1,3 @@
 module OpenDock
-  VERSION = "0.0.12"
+  VERSION = "0.0.13"
 end

data/open-dock.gemspec

@@ -24,4 +24,6 @@ Gem::Specification.new do |spec|
 
   spec.add_runtime_dependency "commander"
   spec.add_runtime_dependency "droplet_kit"
+  spec.add_runtime_dependency "fog"
+  spec.add_runtime_dependency "google-api-client"
 end

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: open-dock
 version: !ruby/object:Gem::Version
-  version: 0.0.12
+  version: 0.0.13
 platform: ruby
 authors:
 - Juan Lebrijo
 autorequire: 
 bindir: bin
 cert_chain: []
-date: 2014-11-18 00:00:00.000000000 Z
+date: 2014-11-20 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: bundler
@@ -66,6 +66,34 @@ dependencies:
     - - ">="
       - !ruby/object:Gem::Version
         version: '0'
+- !ruby/object:Gem::Dependency
+  name: fog
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+- !ruby/object:Gem::Dependency
+  name: google-api-client
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
 description: 'Encapsulates Operations commands for complex server clouds: Provision
   and Configuration from all possible providers such as DigitalOcean, Google Cloud,
   Rackspace, Linode,...'
@@ -91,9 +119,11 @@ files:
 - lib/open-dock/commands/provision_host.rb
 - lib/open-dock/commands/ship_host.rb
 - lib/open-dock/commands/unship_host.rb
-- lib/open-dock/digitalocean.rb
 - lib/open-dock/docker.rb
 - lib/open-dock/ops.rb
+- lib/open-dock/providers.rb
+- lib/open-dock/providers/digital_ocean.rb
+- lib/open-dock/providers/google_cloud.rb
 - lib/open-dock/version.rb
 - lib/tasks/.gitkeep
 - open-dock.gemspec

data/lib/open-dock/digitalocean.rb

@@ -1,33 +0,0 @@
-require 'droplet_kit'
-require 'yaml'
-
-module DigitalOcean
-  CONFIG_FILE = "#{Ops::PROVIDERS_DIR}/digitalocean.yml"
-
-  def self.client
-    begin
-      config = YAML.load_file CONFIG_FILE
-    rescue
-      raise "Please, create '#{CONFIG_FILE}' file with token value"
-    end
-    DropletKit::Client.new(access_token: config["token"])
-  end
-
-  def self.build_droplet(host_name)
-    begin
-      params = YAML.load_file "#{Ops::HOSTS_DIR}/#{host_name}.yml"
-      params["name"]= host_name
-    rescue
-      raise "Please, create '#{CONFIG_FILE}' file with token value"
-    end
-    DropletKit::Droplet.new params
-  end
-end
-
-module DropletKit
-  class Client
-    def find_droplet_by_name(host_name)
-      self.droplets.all.find{|d| d.name == host_name}
-    end
-  end
-end