foreman_acd 0.0.4 → 0.4.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 52f1a7200ef20e354b5ca1225847b07f88dbc34eb143f4314bc21afa24067bd3
-  data.tar.gz: 6fc5e9c82b0869d008ebaf10a44367294ac64c72fb4d05c370b2645ccbdf918e
+  metadata.gz: 433f2c68da81192db3c98fc013ed2149490f2471e84d372db8241522a33b6630
+  data.tar.gz: aa46c833de3feb1cce0802de82dec78f1610331984e6df8df649fdadfffa2b2a
 SHA512:
-  metadata.gz: d50e3c9bf7ade7240f7c9482d9147b64727dcae514453c8f95c52205a00c8d46c5e3a21138ebdc9cc30b0b80ad2870fcc35a0ccf9cff5bfd32e0b38bbee64ff4
-  data.tar.gz: 26bdb492ce794f3a7c5a3afb0597e9a65f1a7230efe9b7a60a530f6dc41c5e4a051f2a6a33280123867c1945c3f405f5d9bec29a40c9ea148c53f7edf36c39a6
+  metadata.gz: 0accbf314dd5776a5b012507d97619be98beff2c11e523da4d27f69e9fdb1bf1d284c134dba6549719312a66ede8cb80c8a06e3851f01a14951b1752ef2e29e8
+  data.tar.gz: d003bc7a5de1c180b2e33ade4e85b2912776db564d59ff9d8eca4f9ccc00c38591fd061649df07bb89e76ad0b0ac5efe1c64dd506132148aaf087b758a18c078

data/README.md

@@ -4,67 +4,121 @@
 
 A plugin to bring an user self service portal and application centric deployment to Foreman.
 
+
 # Description
 
-The target of this plugin is, to deploy whole applications which include multiple hosts 
-and an Ansible Playbook / saltstack state to configure the application. 
+The target of this plugin is, to deploy whole applications which include multiple hosts and 
+configure them using an Ansible Playbook / saltstack state.
 
 This plugin follows the idea of different user types working together.
-The administrative user creates application definitions including multiple servers and
+The administrative user creates Application Definition including multiple servers and
 configuration management items (Ansible Playbook, saltstack state).
-The user can create and deploy new application instances with an easy to use self service portal. 
+The user can create and deploy new Application Instaces with an easy to use self service portal. 
 
-*Example Application Definition:*
-To run a complex web application, a loadbalancer is required.
+*Example Application Definition:* To run a complex web application, a loadbalancer is required.
 The loadbalancer routes the requests to 3 different web servers.
 The web servers are using a database which is in high availability mode on 2 hosts.
 => 6 hosts are required.
 
 This plugin aims to setup all 6 hosts and to deploy the application.
 
+
 # Current State
-In the current state the plugin can be used to provide an easy to use self service user portal 
-to deploy new servers. 
+
+## Application Definition
+
+- Configure a ansible playbook 
+- Use the configured ansible playbook in a Application Definition
+- Overwrite ansible playbook's group variables for the Application Definition
+- Set foreman parameters in the Application Definition
+- Setup various services like webservers, database-servers, etc.
+
+## Application Instance
+
+- Use an Application Definition for your Application Instance
+- Configure specific hosts which uses the Application Definitions services
+- Deploy these hosts
+- Configure the hosts using the configured ansible playbook
+
 
 # Road Map
-- Self service portal for single host deployments (current version)
-- Add application deployment with single host requirements 
-- Add application deployment with multi host requirements 
+- 
+- Add Application deployment with single host requirements 
+- Add Application deployment with multi host requirements 
 
 ## WARNING
 
 This plugin is in development. 
-In the current state, a self service portal to deploy single servers can be created.
 
 ## Installation
 
-See [How_to_Install_a_Plugin](http://projects.theforeman.org/projects/foreman/wiki/How_to_Install_a_Plugin)
-for how to install Foreman plugins
+See [How_to_Install_a_Plugin](https://theforeman.org/plugins/#2.Installation)
+for how to install Foreman plugins. 
+
+### TL;DR: 
+
+    yum install tfm-rubygem-foreman_acd
+    foreman-maintain service restart --only foreman
+
+In some cases you need to do manally
+
+    foreman-rake db:migrate
+    foreman-rake db:seed
+
+### Hints
 
-ATM, Katello plugin need to exist, too.
+Katello plugin need to exist, too.
+
+### Configuration
+
+To get ansible playbooks running, you need to:
+
+    cat /var/lib/foreman-proxy/ssh/id_rsa_foreman_proxy.pub >> /root/.ssh/authorized_keys
+    
+Make sure, that the job template 'Run ACD Ansible Playbook - SSH Default' is part of your organization / location.     
 
 ## Usage
 
-Application Definition (Admin)
+### Ansible Playbook
+
+* Copy (or checkout a git repository) to e.g. /opt/ansible-playbook
+* Add a new Ansible Playbook via Configure -> Ansible Playbook
+* Set the path to /opt/ansible-playbook and name the playbook file. (e.g. site.yml)
+* Save it and press "Import group variables" for this newly created ansible playbook.
+
+### Application Definition (Admin)
+
 * Create an Application Definition (Configure -> Application Definition) first
-* Select the Hostgroup you want to use. 
+* Select the Ansible Playbook you want to use. 
+* Add new services and specifiy the host group you want to use.
 * Specifiy the values, a user could overwrite.
   (you can set a default value, if you want)
 
-Application Instance (User)
-* Create an Application Instance (Configure -> Application Instrane) 
+### Application Instance (User)
+
+* Create an Application Instance (Configure -> Application Instance) 
 * Select the Application Definition which should be used
 * Set the values.
   Remember, all parameters need to have a value. 
 * Save the Application Instance
-* To Deploy the host, select "Deploy" in the Action selection dropdown field
-  on the Application Instance index site
+
+### Deploy & Configure the Application Instance (User)
+
+* To Deploy the host, select "Deploy" in the action selection dropdown field
+  on the Application Instance index site.
+* See if the hosts are deployed via action selection dropdown -> report.
+* After all hosts are deployed, run the ansible playbook via 
+  action selection dropdown -> Run ansible playbook
+
 
 ## TODO
 
-- Add ansible playbook / saltstack support to configure the application
-- Multi-host support
-- Add validation to the different parameter types
+- Add saltstack support to configure the application
+- "git" support for the ansible playbooks
+- Automatically run the ansible playbook after all hosts are deployed
+- More parameter / value validation
+- Deliver ansible playbooks to the connected foreman smart proxies
+
 
 ## Contributing
 
@@ -72,7 +126,7 @@ Fork and send a Pull Request. Thanks!
 
 ## Copyright
 
-Copyright (c) 2019 ATIX AG 
+Copyright (c) 2020 ATIX AG 
 
 This program is free software: you can redistribute it and/or modify
 it under the terms of the GNU General Public License as published by
@@ -86,4 +140,3 @@ GNU General Public License for more details.
 
 You should have received a copy of the GNU General Public License
 along with this program.  If not, see <http://www.gnu.org/licenses/>.
-

data/app/controllers/foreman_acd/ansible_playbooks_controller.rb

@@ -0,0 +1,122 @@
+# frozen_string_literal: true
+
+module ForemanAcd
+  # Ansible Playbook Controller
+  class AnsiblePlaybooksController < ::ForemanAcd::ApplicationController
+    include Foreman::Controller::AutoCompleteSearch
+    include ::ForemanAcd::Concerns::AnsiblePlaybookParameters
+
+    before_action :find_resource, :only => [:edit, :update, :destroy, :import_vars]
+
+    def index
+      @ansible_playbooks = resource_base.search_for(params[:search], :order => params[:order]).paginate(:page => params[:page])
+    end
+
+    def new
+      @ansible_playbook = AnsiblePlaybook.new
+    end
+
+    def create
+      @ansible_playbook = AnsiblePlaybook.new(ansible_playbook_params)
+      if @ansible_playbook.save
+        process_success
+      else
+        process_error
+      end
+    end
+
+    def edit
+    end
+
+    def update
+      if @ansible_playbook.update(ansible_playbook_params)
+        process_success
+      else
+        process_error
+      end
+    end
+
+    def destroy
+      if @ansible_playbook.destroy
+        process_success
+      else
+        process_error
+      end
+    end
+
+    def action_permission
+      case params[:action]
+      when 'import_vars'
+        :import_vars
+      else
+        super
+      end
+    end
+
+    # We need to move these to a smart_proxy_acd
+    def extract_variables(playbook_path)
+      errors = []
+      vars = {}
+
+      unless File.directory?(playbook_path) || File.directory?("#{playbook_path}/group_vars")
+        errors << "Playbook path '#{playbook_path}' or '#{playbook_path}/group_vars' doesn't exist"
+        return vars, errors
+      end
+
+      everything_empty = true
+
+      vars_files = Dir.glob("#{playbook_path}/group_vars/**/*")
+      vars_files.each do |vars_file|
+        loaded_yaml = {}
+        next if File.directory?(vars_file)
+
+        begin
+          loaded_yaml = YAML.load_file(vars_file)
+        rescue Psych::SyntaxError
+          err = "#{vars_file} is not YAML file"
+          logger.error(err)
+          errors << err
+        end
+        unless loaded_yaml.is_a? Hash
+          err = "Could not parse YAML file #{vars_file}"
+          logger.error(err)
+          errors << err
+        end
+        everything_empty = false unless loaded_yaml.empty?
+
+        # We need to support: group_vars/group_file and group_vars/group_dir/yaml_files
+        dir_and_file = File.split(vars_file)
+
+        if File.basename(dir_and_file[0]) == 'group_vars' # in case of group_vars/group_file
+          group_name = File.basename(dir_and_file[1], '.*')
+        else # in case of group_vars/group_dir/yaml_files
+          group_name = File.basename(dir_and_file[0])
+        end
+
+        logger.debug("Add ansible vars from file #{vars_file} to group #{group_name}")
+
+        if vars.has_key?(group_name)
+          vars[group_name].merge!(loaded_yaml)
+        else
+          vars[group_name] = loaded_yaml
+        end
+      end
+
+      errors << "No ansible group variable in #{playbook_path} defined." if everything_empty
+
+      return vars, errors
+    end
+
+    def import_vars
+      logger.debug("Load ansible group vars for #{@ansible_playbook} from #{@ansible_playbook.path}")
+      vars, errors = extract_variables(@ansible_playbook.path)
+      @ansible_playbook.vars = vars.to_json
+      @ansible_playbook.save
+      if errors.empty?
+        process_success :success_msg => _("Successfully loaded ansible group variables from %s") % @ansible_playbook.name, :redirect => ansible_playbooks_path
+      else
+        process_error :error_msg => _(errors.join(' ')), :redirect => ansible_playbooks_path
+      end
+    end
+  end
+end

data/app/controllers/foreman_acd/api/v2/ansible_playbooks_controller.rb

@@ -0,0 +1,54 @@
+# frozen_string_literal: true
+
+module ForemanAcd
+  module Api
+    module V2
+      # API controller for Ansible Playbooks
+      class AnsiblePlaybooksController < ::ForemanAcd::Api::V2::BaseController
+        include ::ForemanAcd::Concerns::AnsiblePlaybookParameters
+
+        before_action :find_resource, :except => [:index, :create]
+
+        api :GET, '/ansible_playbooks/:id', N_('Show ansible playbook')
+        param :id, :identifier, :required => true
+        def show; end
+
+        api :GET, '/ansible_playbooks', N_('List ansible playbooks')
+        param_group :search_and_pagination, ::Api::V2::BaseController
+        add_scoped_search_description_for(AnsiblePlaybook)
+        def index
+          @ansible_playbooks = resource_scope_for_index
+        end
+
+        def_param_group :ansible_playbook do
+          param :ansible_playbook, Hash, :required => true, :action_aware => true do
+            param :name, String, :required => true
+            param :description, String, :required => true
+            param :services, String, :required => true
+          end
+        end
+
+        api :POST, '/ansible_playbooks', N_('Create a ansible playbook')
+        param_group :ansible_playbook, :as => :create
+        def create
+          @ansible_playbook = AnsiblePlaybook.new(ansible_playbook_params)
+          process_response @ansible_playbook.save
+        end
+
+        api :DELETE, '/ansible_playbooks/:id', N_('Deletes ansible playbook')
+        param :id, :identifier, :required => true
+        def destroy
+          process_response @ansible_playbook.destroy
+        end
+
+        def controller_permission
+          'ansible_playbooks'
+        end
+
+        def resource_class
+          ForemanAcd::AnsiblePlaybook
+        end
+      end
+    end
+  end
+end

data/app/controllers/foreman_acd/api/v2/app_definitions_controller.rb

@@ -24,8 +24,7 @@ module ForemanAcd
           param :app_definition, Hash, :required => true, :action_aware => true do
             param :name, String, :required => true
             param :description, String, :required => true
-            param :hostgroup_id, :number, :required => true
-            param :parameters, String, :required => true
+            param :services, String, :required => true
           end
         end
 

data/app/controllers/foreman_acd/api/v2/app_instances_controller.rb

@@ -0,0 +1,54 @@
+# frozen_string_literal: true
+
+module ForemanAcd
+  module Api
+    module V2
+      # API controller for App Instances
+      class AppInstancesController < ::ForemanAcd::Api::V2::BaseController
+        include ::ForemanAcd::Concerns::AppInstanceParameters
+
+        before_action :find_resource, :except => [:index, :create]
+
+        api :GET, '/app_instances/:id', N_('Show application instance')
+        param :id, :identifier, :required => true
+        def show; end
+
+        api :GET, '/app_instances', N_('List application instances')
+        param_group :search_and_pagination, ::Api::V2::BaseController
+        add_scoped_search_description_for(AppInstance)
+        def index
+          @app_instances = resource_scope_for_index
+        end
+
+        def_param_group :app_instance do
+          param :app_instance, Hash, :required => true, :action_aware => true do
+            param :name, String, :required => true
+            param :description, String, :required => true
+            param :services, String, :required => true
+          end
+        end
+
+        api :POST, '/app_instances', N_('Create a application instance')
+        param_group :app_instance, :as => :create
+        def create
+          @app_instance = AppInstance.new(app_instance_params)
+          process_response @app_instance.save
+        end
+
+        api :DELETE, '/app_instances/:id', N_('Deletes application instance')
+        param :id, :identifier, :required => true
+        def destroy
+          process_response @app_instance.destroy
+        end
+
+        def controller_permission
+          'app_instances'
+        end
+
+        def resource_class
+          ForemanAcd::AppInstance
+        end
+      end
+    end
+  end
+end

data/app/controllers/foreman_acd/app_definitions_controller.rb

@@ -6,18 +6,25 @@ module ForemanAcd
     include Foreman::Controller::AutoCompleteSearch
     include ::ForemanAcd::Concerns::AppDefinitionParameters
 
-    before_action :find_resource, :only => [:edit, :update, :destroy]
+    before_action :find_resource, :only => [:edit, :update, :destroy, :export]
+    before_action :read_hostgroups, :only => [:edit, :new, :import]
+    before_action :read_ansible_playbooks, :only => [:edit, :new]
+    before_action :handle_file_upload, :only => [:create]
 
     def index
       @app_definitions = resource_base.search_for(params[:search], :order => params[:order]).paginate(:page => params[:page])
     end
 
+    def read_ansible_playbooks
+      # Only use ansible playbooks for which the user pressed import group vars once.
+      @ansible_playbooks = AnsiblePlaybook.where.not(vars: nil).map { |elem| { elem.id => elem.name } }.reduce({}) { |h, v| h.merge v }
+    end
+
     def read_hostgroups
       @hostgroups = Hostgroup.all.map { |elem| { elem.id => elem.name } }.reduce({}) { |h, v| h.merge v }
     end
 
     def new
-      read_hostgroups
       @app_definition = AppDefinition.new
     end
 
@@ -31,11 +38,10 @@ module ForemanAcd
     end
 
     def edit
-      read_hostgroups
     end
 
     def update
-      if @app_definition.update(app_definition_params)
+      if @app_definition.update_attributes(app_definition_params)
         process_success
       else
         process_error
@@ -49,5 +55,31 @@ module ForemanAcd
         process_error
       end
     end
+
+    def action_permission
+      case params[:action]
+      when 'export'
+        :export
+      else
+        super
+      end
+    end
+
+    def import
+      @app_definition = AppDefinition.new
+    end
+
+    def export
+      filename = "#{@app_definition.name}.yaml"
+      data = JSON.parse(@app_definition.services).to_yaml
+      send_data data, :type => 'text/yaml', :disposition => 'attachment', :filename => filename
+    end
+
+    private
+
+    def handle_file_upload
+      return unless params[:foreman_acd_app_definition] && raw_file = params[:foreman_acd_app_definition][:app_definition_file]
+      params[:foreman_acd_app_definition][:services] = YAML.load_file(raw_file.tempfile).to_json
+    end
   end
 end