kuby-core 0.2.0 → 0.6.1

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: ce4674de91f39049845cbcfd48b38c1b0555c888e31a3014d54de151445a0097
-  data.tar.gz: b16c0f671056c928698db27a58635fd2aa2449bd52f333f5a2eaadcbaf4504c4
+  metadata.gz: 9f538fa630fc43f4767cd6241a79dde985f09e8fe4ce6a08387eb1dcb21b2a51
+  data.tar.gz: 44da54f5d067a64896bbd23dff200ec56eaf2bbe9183acb8d22c4df906933e98
 SHA512:
-  metadata.gz: 648c72c35ca24938fedc50e5287a0dff2ace8ca067e1650626cce8e470ba6289152a43739384e837a23840b66fb155ac0255d307ee47ab4cdca83422ef83b962
-  data.tar.gz: 6a1bf52a1984c135e2171ce7e10eb7ecd70b5e42ffa688234c4f7a10741d84a541755bf36e39b77fa8c46dcbd3ed31b0c01f3288ac339a2213391a69e1be789b
+  metadata.gz: a589af5cea6a7b81e2b0a707f701e6b341b668e53303dce6288ec1c1ba28c6fca2e4cab835f52ad5a189753c8e82463092ec9dac3a08b9dbd7e0944690b7d50e
+  data.tar.gz: 1678ac5ccf413eb2778c0f9870554cab5b0b397cc98a5300f381940770389bb335abd0e2ddcad180b42040ea91a4d73688cc17065c8448bbcf907fdcd5c2821e

data/CHANGELOG.md

@@ -1,3 +1,61 @@
+## 0.6.1
+* Fix issue causing database.yml to not be rewritten to point at correct database host.
+
+## 0.6.0
+* Don't load the Rails environment when running Kuby's rake tasks.
+  - Kuby's gems are still part of the bundle, but config has been moved out of the initializer and into kuby.rb in the Rails root directory.
+  - Internal classes no longer retain a reference to `Rails.application`.
+  - Kuby config now requires `environment` blocks:
+      ```ruby
+      Kuby.define('my-app') do
+        environment(:production) do
+          ...
+        end
+
+        environment(:staging) do
+          ...
+        end
+      end
+      ```
+* Fix `MissingDistroError` caused by not setting a default distro.
+* Create a .dockerignore file when running the Rails generator.
+* Add ability to insert inline Docker layers without having to create a separate class, eg:
+    ```ruby
+    insert :hello, before: :bundler_phase do |dockerfile|
+      dockerfile.run('echo "hello, world"')
+    end
+    ```
+* Add Postgres database support.
+* Don't install sqlite libs by default.
+* Modify Rails generator
+  - Require kuby and load config safely.
+  - Provide manual access to credentials via `ActiveSupport::EncryptedConfiguration`, which is necessary now that our rake tasks don't load the Rails environment.
+* Add a convenience method for requesting the amount of block storage for the database.
+* Add the ability to entirely disable database management via `manage_database false`.
+* Avoid deploying nginx-ingress if it's already deployed.
+* Add rake task for running arbitrary `kubectl` commands.
+
+## 0.5.0
+* Fix Rails generators issue causing crash at startup.
+* Add rake task to run arbitrary kubectl commands.
+
+## 0.4.0
+* Introduce simple managed package.
+* Refactor deploy task into its own class.
+
+## 0.3.0
+* Fix Krane issue causing incorrect constant lookup and therefore deploy failures.
+  - See: https://github.com/Shopify/krane/pull/720
+  - Fixed via monkeypatch in lib/ext/krane/kubernetes_resource.rb
+* Move Docker timestamp tag logic into the `Tags` class.
+* Refactor Docker timestamp tag logic.
+* Change deployment names so they're more descriptive of the role (i.e. web, worker, etc)
+  - Rails app deployment changes from [app_name]-deployment to [app_name]-web.
+  - Database deployment changes from [app_name]-[environment]-[adapter] to [app-name]-web-[adapter].
+* Add shortcut for specifying number of Rails app replicas.
+* Move registry secret from the `rails_app` plugin to the Kubernetes spec.
+* Fix rollback functionality.
+
 ## 0.2.0
 * Move Kubernetes CLI error classes into kubernetes-cli gem.
 * Update README to indicate Kuby supports Rails 5.1 and up.

data/Gemfile

@@ -2,10 +2,6 @@ source 'https://rubygems.org'
 
 gemspec
 
-gem 'kube-dsl', path: '../kube-dsl'
-gem 'kuby-kube-db', path: '../kuby-kube-db'
-gem 'kuby-cert-manager', path: '../kuby-cert-manager'
-
 group :development, :test do
   gem 'pry-byebug'
   gem 'rake'

data/README.md

@@ -8,170 +8,13 @@ At its core, Kuby is a set of tools and smart defaults that encapsulate and codi
 
 Under the hood, Kuby leverages the power of Docker and Kubernetes. It tries to make these technologies accessible to the average Rails dev without requiring a devops black belt.
 
-## Raison d'etre
-
-One of Rails' most notorious mantras is "convention over configuration," i.e. sane defaults that limit the cognitive overhead of application development. Rails has survived for as long as it has precisely because it makes so many decisions for you, especially compared to other web application frameworks. It's easy to learn and easy to build with. The development experience is fantastic... right up until the point you want to deploy your app to production. It's at that point that the hand-holding stops. Like the Roadrunner, Rails stops right before the cliff and lets you, Wile E. Coyote, sail over the edge.
-
-![Wile E. Coytote](coyote.jpg)
-
-Perhaps [Stefan Wintermeyer](https://twitter.com/wintermeyer) said it best during his appearance on the Ruby Rogues podcast, [episode 403](https://devchat.tv/ruby-rogues/rr-403-rails-needs-active-deployment-with-stefan-wintermeyer/):
-
-> "In my experience, deployment is one of the major problems of normal Rails users. It is a big pain to set up a deployment system for a Rails application, and I don't see anything out there that makes it easier. [...] I believe that we lose quite a lot of companies and new developers on this step. Because everything else [is] so much easier with Rails. But that last step - and it's a super important step - is still super complicated."
-
-## Docker and Kubernetes
-
-Why bet the farm on Docker and Kubernetes?
-
-### Docker
-
-When Docker came on the scene in 2013 it was seen as a game-changer. Applications that used to be deployed onto hand-provisioned servers can now be bundled up into neat little packages and transferred between computers in their entirety. Since the whole application - dependencies, operating system components, assets, code, etc - can be passed around as a single artifact, Docker images curtail the need for manually provisioned servers and eliminate a whole class of "works on my machine" problems.
-
-### Kubernetes
-
-Kubernetes has taken the ops world by storm. It's resilient to failure, portable across a variety of cloud providers, and backed by industry-leading organizations like the CNCF. Kubernetes configuration is portable enough to be used, without modification, on just about any Kubernetes cluster, making migrations not only feasible, but easy. Many cloud providers like Google GCP, Amazon AWS, Microsoft Azure, DigitalOcean, and Linode support Kubernetes. Most of these providers will manage the Kubernetes cluster for you, and in some cases will even provide it free of charge (you pay only for the compute resources).
-
 ## Getting Started
 
-NOTE: Kuby is designed to work with Rails 5.1 and up.
-
-### Choosing a Provider
-
-The first step in deploying your app is to choose a hosting provider. At the time of this writing, Kuby supports DigitalOcean and Linode, but support for more providers is coming soon. Use your provider's dashboard to spin up a Kubernetes cluster. In most cases, this shouldn't involve more than a few button clicks.
-
-### The Container Registry
-
-Kuby uses Docker to package up your application into a Docker _image_. Images are then pushed (i.e. uploaded) to something called a "container registry." Container registries host Docker images so they can be pulled (i.e. downloaded) later.
-
-Although there are a number of container registries available (some free and some paid), consider using the Gitlab registry. Gitlab's registry is free and unlimited. You don't have to host your code on Gitlab to take advantage of the registry, but they're great for that too.
-
-### Integrating Kuby
-
-Kuby configuration is done via a [DSL](https://en.wikipedia.org/wiki/Domain-specific_language). There are two main sections, one for Docker and one for Kubernetes. Put the config into a Rails initializer, eg. config/initializers/kuby.rb.
-
-Here's what a complete config looks like:
-
-```ruby
-Kuby.define(:production) do
-  docker do
-    credentials do
-      username ENV['DOCKER_USERNAME']
-      password ENV['DOCKER_PASSWORD']
-      email ENV['DOCKER_EMAIL']
-    end
-
-    image_url 'registry.gitlab.com/username/repo'
-  end
-
-  kubernetes do
-    provider :digitalocean do
-      access_token ENV['DIGITALOCEAN_ACCESS_TOKEN']
-      cluster_id 'aaaaaaaa-bbbb-cccc-dddd-eeeeeeeeeeee'
-    end
-
-    add_plugin :rails_app do
-      hostname 'mywebsite.com'
-    end
-  end
-end
-```
-
-Let's go over this config in detail.
-
-### Deploy Environments
-
-The first line defines the _deploy environment_:
-
-```ruby
-Kuby.define(:production)
-```
-
-Deploy environments usually closely mirror your Rails environments. For example, you might create a new Rails environment called "staging" or "preprod" that's used to test production changes before they go live. You'll want to create a "staging" Kuby deploy environment as well.
-
-If you're a small shop or hobbyist though, chances are the "production" deploy environment is all you need.
-
-### Configuring Docker
-
-Kuby can automatically "dockerize" your application. You just need to tell it where to push images and provide some credentials:
-
-```ruby
-docker do
-  credentials do
-    username ENV['DOCKER_USERNAME']
-    password ENV['DOCKER_PASSWORD']
-    email ENV['DOCKER_EMAIL']
-  end
-
-  image_url 'registry.gitlab.com/username/repo'
-end
-```
-
-The username, password, and email fields are used to authenticate with the Docker registry that hosts your images. For Gitlab, you'll need to create a [personal access token](https://docs.gitlab.com/ee/user/profile/personal_access_tokens.html) instead of your password. The `image_url` field is the full URL to your image, including the registry's domain.
-
-In the example above, the username, password, and email are all provided as environment variables. **NEVER** hard-code sensitive information like this in your Kuby config or check it into source control (i.e. git). Consider using a tool like [dotenv](https://github.com/bkeepers/dotenv) to automatically load the variables from a file when your app starts (NOTE: don't check the .env file into git either!)
-
-### Configuring Kubernetes
-
-Now that your app can be packaged up into a Docker image, it's time to use Kubernetes to run it. There are two top-level concerns in the Kubernetes section of your Kuby config: providers and plugins.
-
-#### Providers
-
-Each Kubernetes definition must have a provider configured. Providers correspond to the hosting provider you chose earlier. For example, you'll need to add the `:digitalocean` provider to deploy to a managed DigitalOcean Kubernetes cluster.
-
-```ruby
-kubernetes do
-  provider :digitalocean do
-    access_token ENV['DIGITALOCEAN_ACCESS_TOKEN']
-    cluster_id 'aaaaaaaa-bbbb-cccc-dddd-eeeeeeeeeeee'
-  end
-end
-```
-
-Kuby providers are distributed as individual rubygems. Add the one you need to your Gemfile, for example:
-
-```ruby
-gem 'kuby-digitalocean', '~> 0.1'
-```
-
-Providers can have different config options, so make sure you consult the gem's README for the provider you've chosen.
-
-#### Plugins
-
-Nearly all Kuby's functionality is provided via plugins. For example, simply add the `:rails_app` plugin to get your Rails app ready to deploy:
-
-```ruby
-add_plugin :rails_app
-```
-
-To indicate your app exists behind a particular domain name, specify the `hostname` option:
-
-```ruby
-add_plugin :rails_app do
-  hostname 'mywebsite.com'
-end
-```
-
-Configuring DNS to point to your Kubernetes cluster is outside the scope of this README, but all the hosting providers should have tutorials. For example, [here's the one](https://www.digitalocean.com/community/tutorials/how-to-point-to-digitalocean-nameservers-from-common-domain-registrars) from DigitalOcean.
-
-## Deploying
-
-Now that Kuby is configured and your Kubernetes cluster is ready, it's time to deploy!
-
-1. Build the Docker image
-
-    ```sh
-    bundle exec rake kuby:build
-    ```
-1. Push the Docker image to the container registry
+See the [Quick Start Guide](https://github.com/getkuby/kuby-core/wiki/Quick-Start-Guide)
 
-    ```sh
-    bundle exec rake kuby:push
-    ```
-1. Deploy!
+## More Info
 
-    ```sh
-    bundle exec rake kuby:deploy
-    ```
-1. Rejoice
+See the [wiki](https://github.com/getkuby/kuby-core/wiki).
 
 ## Running Tests
 

data/kuby-core.gemspec

@@ -15,13 +15,14 @@ Gem::Specification.new do |s|
   s.add_dependency 'colorize', '~> 0.8'
   s.add_dependency 'docker-remote', '~> 0.1'
   s.add_dependency 'krane', '~> 1.0'
-  s.add_dependency 'kuby-cert-manager', '~> 0.1'
-  s.add_dependency 'kube-dsl', '~> 0.1'
-  s.add_dependency 'kuby-kube-db', '~> 0.1'
-  s.add_dependency 'kubernetes-cli', '~> 0.1'
+  s.add_dependency 'kuby-cert-manager', '~> 0.2'
+  s.add_dependency 'kube-dsl', '~> 0.3'
+  s.add_dependency 'kuby-kube-db', '~> 0.4'
+  s.add_dependency 'kubernetes-cli', '~> 0.2'
   s.add_dependency 'railties', '>= 5.1'
   s.add_dependency 'rouge', '~> 3.0'
 
   s.require_path = 'lib'
+
   s.files = Dir['{lib,spec}/**/*', 'Gemfile', 'LICENSE', 'CHANGELOG.md', 'README.md', 'Rakefile', 'kuby-core.gemspec']
 end

data/lib/ext/krane/kubernetes_resource.rb

@@ -0,0 +1,16 @@
+require 'krane/kubernetes_resource'
+
+# See: https://github.com/Shopify/krane/pull/720
+module Krane
+  class KubernetesResource
+    class << self
+      def class_for_kind(kind)
+        if Krane.const_defined?(kind, false)
+          Krane.const_get(kind, false)
+        end
+      rescue NameError
+        nil
+      end
+    end
+  end
+end

data/lib/kuby.rb

@@ -1,10 +1,16 @@
 require 'kuby/railtie'
 
+begin
+  require 'kuby/kubernetes/plugins/rails_app/generators/kuby'
+rescue NameError
+end
+
 module Kuby
   autoload :BasicLogger,  'kuby/basic_logger'
   autoload :CLIBase,      'kuby/cli_base'
   autoload :Definition,   'kuby/definition'
   autoload :Docker,       'kuby/docker'
+  autoload :Environment,  'kuby/environment'
   autoload :Kubernetes,   'kuby/kubernetes'
   autoload :Middleware,   'kuby/middleware'
   autoload :Tasks,        'kuby/tasks'
@@ -14,19 +20,25 @@ module Kuby
 
   class << self
     attr_reader :definition
-    attr_accessor :logger
+    attr_writer :logger
 
-    def define(environment, app = Rails.application, &block)
-      environment = environment.to_s
-      definitions[environment] ||= Definition.new(environment, app, &block)
+    def load!
+      require ENV['KUBY_CONFIG'] || File.join('.', 'kuby.rb')
     end
 
-    def definitions
-      @definitions ||= {}
+    def define(name, &block)
+      raise 'Kuby is already configured' if @definition
+
+      @definition = Definition.new(name.to_s)
+      @definition.instance_eval(&block)
+
+      @definition.environments.each do |_, env|
+        env.kubernetes.after_configuration
+      end
     end
 
-    def definition(environment = env)
-      definitions.fetch(environment.to_s) do
+    def environment(name = env)
+      definition.environment(name.to_s) do
         raise UndefinedEnvironmentError, "couldn't find a Kuby environment named "\
           "'#{environment}'"
       end
@@ -56,11 +68,19 @@ module Kuby
       @plugins ||= {}
     end
 
-    def register_package(package_name, package_def)
+    def logger
+      @logger ||= BasicLogger.new(STDERR)
+    end
+
+    def register_package(package_name, package_def = nil)
       packages[package_name] = case package_def
+        when NilClass
+          Kuby::Docker::Packages::SimpleManagedPackage.new(
+            package_name
+          )
         when String
-          Kuby::Docker::Packages::ManagedPackage.new(
-            package_name, debian: package_def, alpine: package_def
+          Kuby::Docker::Packages::SimpleManagedPackage.new(
+            package_def
           )
         when Hash
           Kuby::Docker::Packages::ManagedPackage.new(
@@ -77,7 +97,7 @@ module Kuby
 
     def env
       ENV.fetch('KUBY_ENV') do
-        (definitions.keys.first || Rails.env).to_s
+        (definition.environments.keys.first || Rails.env).to_s
       end
     end
   end
@@ -105,8 +125,3 @@ Kuby.register_package(:c_toolchain,
   debian: 'build-essential',
   alpine: 'build-base'
 )
-
-Kuby.register_package(:sqlite_dev,
-  debian: 'libsqlite3-dev',
-  alpine: 'sqlite-dev'
-)

data/lib/kuby/definition.rb

@@ -1,29 +1,35 @@
 module Kuby
   class Definition
-    attr_reader :environment, :app
+    attr_reader :app_name
 
-    def initialize(environment, app, &block)
-      @environment = environment
-      @app = app
+    def initialize(app_name, &block)
+      @app_name = app_name
+    end
+
+    def environment(name = Kuby.env, &block)
+      name = name.to_s
+
+      if name
+        environments[name] ||= Environment.new(name, self)
+      end
+
+      if block_given?
+        environments[name].instance_eval(&block)
+      end
 
-      instance_eval(&block) if block
-      kubernetes.after_configuration
+      environments[name]
     end
 
     def docker(&block)
-      @docker ||= Docker::Spec.new(self)
-      @docker.instance_eval(&block) if block
-      @docker
+      environment.docker(&block)
     end
 
     def kubernetes(&block)
-      @kubernetes ||= Kubernetes::Spec.new(self)
-      @kubernetes.instance_eval(&block) if block
-      @kubernetes
+      environment.kubernetes(&block)
     end
 
-    def app_name
-      @app_name ||= app.class.module_parent.name
+    def environments
+      @environments ||= {}
     end
   end
 end

data/lib/kuby/docker.rb

@@ -10,12 +10,13 @@ module Kuby
     autoload :Credentials,    'kuby/docker/credentials'
     autoload :Debian,         'kuby/docker/debian'
     autoload :Dockerfile,     'kuby/docker/dockerfile'
+    autoload :InlineLayer,    'kuby/docker/inline_layer'
+    autoload :Layer,          'kuby/docker/layer'
     autoload :LayerStack,     'kuby/docker/layer_stack'
     autoload :LocalTags,      'kuby/docker/local_tags'
     autoload :Metadata,       'kuby/docker/metadata'
     autoload :Packages,       'kuby/docker/packages'
     autoload :PackagePhase,   'kuby/docker/package_phase'
-    autoload :Phase,          'kuby/docker/phase'
     autoload :RemoteTags,     'kuby/docker/remote_tags'
     autoload :SetupPhase,     'kuby/docker/setup_phase'
     autoload :Spec,           'kuby/docker/spec'