git-deploy 0.2.0

data/README.markdown

@@ -0,0 +1,109 @@
+Capistrano strategy for smart git deployment
+============================================
+
+Let's set up a straightforward, [Heroku][]-style, push-based deployment, shall we? The goal is that our deployment looks like this:
+
+    $ git push origin production
+
+Assumptions are that you are using git for your Rails app and Passenger on the server. For now, we're going to deploy on a single host.
+
+To get started, install the "git-deploy" gem from Gemcutter.org.
+
+
+Considerations
+--------------
+
+This is not "yet another Capistrano strategy". Capistrano is only used for setup, after which it's all git hooks (see detailed description in "Deployment"). This actually replaces the default Capistrano recipe (which is not loaded) with only a basic set of tasks. If you have more advanced deployment (multiple hosts, many "after deploy" hooks) then this library cannot suit your needs at present.
+
+
+Setup steps
+-----------
+
+1.  Create a git remote for where you'll push the code on your server. The name of this remote in the examples is "origin", but it can be whatever you wish ("online", "website", or other).
+    
+        $ git remote add origin user@example.com:/path/to/myapp
+    
+    The "/path/to/myapp" is the directory where your code will reside. It doesn't have to exist; it will be created for you during this setup.
+
+2.  Create/overwrite the following files in your project:
+    
+    **config/deploy.rb** (entire file):
+    
+        # set to the name of git remote you intend to deploy to
+        set :remote, "origin"
+        # specify the deployment branch
+        set :branch, "master"
+        # sudo will only be used to create the deployment directory
+        set :use_sudo, true
+        # the remote host is read automatically from your git remote specification
+        server remote_host, :app, :web, :db, :primary => true
+    
+    **Capfile**:
+    
+        require 'git_deploy'
+        load 'config/deploy'
+    
+    Test it by running `cap -T`. You should see several deploy tasks listed.
+
+3.  Run the setup task:
+    
+        $ cap deploy:setup
+    
+    This will initialize a git repository in the target directory, install the push hook and push the branch you specified to the server.
+
+4.  Login to your server to perform necessary one-time administrative operations. This might include:
+    * set up the Apache/nginx virtual host for this application;
+    * check out the branch which you will push production code into (often this is "production");
+    * check your config/database.yml and create or import the production database.
+
+
+Deployment
+----------
+
+After you've set everything up, visiting "http://example.com" in your browser should show your app up and running. Subsequent deployments are done simply by pushing to the branch that is currently checked out on our server (see step 4.). The branch is by default "master", but it's suggested to have production code in another branch like "production" or other. This, of course, depends on your git workflow.
+
+We've reached our goal; our deployment now looks like:
+
+    $ git push origin production
+
+In fact, running "cap deploy" does exactly this. So what does it do?
+
+The "deploy:setup" task installed a couple of hooks in the remote git repository: "post-receive" and "post-reset". The former is a git hook which is invoked after every push to your server, while the latter is a *custom* hook that's called asynchronously by "post-receive" when we updated the deployment branch. This is how your working copy on the server is kept up-to-date.
+
+Thus, on first push your server automatically:
+
+1. creates the "log" and "tmp" directories;
+2. copies "config/database.example.yml" or "config/database.yml.example" to "config/database.yml".
+
+On every subsequent deploy, the "post-reset" script analyzes changes and:
+
+1. clears cached css and javascript assets if any versioned files under "public/stylesheets" and "public/javascripts" have changed, respectively;
+2. runs "rake db:migrate" if new migrations have been added;
+3. sync submodule urls if ".gitmodules" file has changed;
+4. initialize and update submodules;
+5. touches "tmp/restart.txt" if app restart is needed.
+
+Finally, these are the conditions that dictate an app restart:
+
+1. css/javascript assets have been cleared;
+2. the database has migrated;
+3. one or more files/submodules under "app", "config", "lib", "public", or "vendor" changed.
+
+The output of "post-reset" is logged to "log/deploy.log" in your application.
+
+It's worth remembering that "post-reset" is done asynchronously from your push operation. This is because migrating the database and updating submodules might take a long time and we don't want to wait for all that while we're doing a git push. But, this means that when the push is done, the server has not yet restarted. You might need to wait a few seconds or a minute, depending on what you pushed.
+
+
+In the future
+-------------
+
+Next steps for this library are:
+
+* Support for deployment on multiple hosts. This is a slightly different strategy based on git pull instead of push; something in-between regular "remote cache" strategy and the aforementioned
+* Better configurability
+* Steps forward to supporting more existing 3rd-party Capistrano tasks, like that of the EngineYard gem
+* Support for multiple environments on the same server (production, staging, continuous integration, etc.) sharing the same git repo, so you don't have to push same objects twice
+* Automatic submodule conflict resolving
+
+
+[heroku]: http://heroku.com/

data/Rakefile

@@ -0,0 +1,34 @@
+desc "generates .gemspec file"
+task :gemspec do
+  spec = Gem::Specification.new do |p|
+    p.name = 'git-deploy'
+    p.version = '0.2.0'
+
+    p.summary     = "Simple git push-based application deployment"
+    p.description = "git-deploy is a tool to install useful git hooks on your remote repository to enable git push-based, Heroku-like deployment on your host."
+
+    p.author = 'Mislav Marohnić'
+    p.email  = 'mislav.marohnic@gmail.com'
+    p.homepage = 'http://github.com/mislav/git-deploy'
+
+    p.add_dependency 'capistrano', '~> 2.5.9'
+    
+    p.files = FileList.new('Rakefile', '{bin,lib,sample,test,spec,rails}/**/*', 'README*', 'LICENSE*', 'CHANGELOG*')
+    p.files &= `git ls-files -z`.split("\0")
+                
+    p.executables = Dir['bin/*'].map { |f| File.basename(f) }
+
+    p.rubyforge_project = nil
+    p.has_rdoc = false
+  end
+  
+  spec_string = spec.to_ruby
+  
+  begin
+    Thread.new { eval("$SAFE = 3\n#{spec_string}", binding) }.join 
+  rescue
+    abort "unsafe gemspec: #{$!}"
+  else
+    File.open("#{spec.name}.gemspec", 'w') { |file| file.write spec_string }
+  end
+end

data/lib/git_deploy.rb

@@ -0,0 +1,133 @@
+require 'capistrano/recipes/deploy/scm/git'
+require 'capistrano/recipes/deploy/strategy/checkout'
+
+Capistrano::Configuration.instance(true).load do
+  def _cset(name, *args, &block)
+    unless exists?(name)
+      set(name, *args, &block)
+    end
+  end
+
+  _cset(:application) { abort "Please specify the name of your application, set :application, 'foo'" }
+  _cset :remote, "origin"
+  _cset :branch, "master"
+
+  _cset(:multiple_hosts) { roles.values.map{ |v| v.servers}.flatten.uniq.size > 1 }
+  _cset(:repository)  { `#{ source.local.scm('config', "remote.#{remote}.url") }`.chomp }
+  _cset(:remote_host) { repository.split(':', 2).first }
+  _cset(:deploy_to)   { repository.split(':', 2).last } # "/u/apps/#{application}"
+  _cset(:run_method)  { fetch(:use_sudo, true) ? :sudo : :run }
+  _cset :group_writeable, false
+
+  _cset(:current_branch) { File.read('.git/HEAD').chomp.split(' refs/heads/').last }
+  _cset(:revision) { branch }
+  _cset(:source)   { Capistrano::Deploy::SCM::Git.new(self) }
+  _cset(:strategy) { Capistrano::Deploy::Strategy::Checkout.new(self) }
+
+  # Helper for the `deploy:check' task
+  def depend(location, type, *args)
+    deps = fetch(:dependencies, {})
+    deps[location] ||= {}
+    deps[location][type] ||= []
+    deps[location][type] << args
+    set :dependencies, deps
+  end
+
+  # If :run_method is :sudo (or :use_sudo is true), this executes the given command
+  # via +sudo+. Otherwise is uses +run+. If :as is given as a key, it will be
+  # passed as the user to sudo as, if using sudo. If the :as key is not given,
+  # it will default to whatever the value of the :admin_runner variable is,
+  # which (by default) is unset.
+  def try_sudo(*args)
+    options = args.last.is_a?(Hash) ? args.pop : {}
+    command = args.shift
+    raise ArgumentError, "too many arguments" if args.any?
+
+    as = options.fetch(:as, fetch(:admin_runner, nil))
+    via = fetch(:run_method, :sudo)
+    if command
+      invoke_command(command, :via => via, :as => as)
+    elsif via == :sudo
+      sudo(:as => as)
+    else
+      ""
+    end
+  end
+
+  namespace :deploy do
+    desc "Deploys your project."
+    task :default do
+      push
+    end
+
+    task :push do
+      system source.local.scm('push', remote, "#{revision}:#{branch}")
+    end
+
+    desc "Prepares servers for deployment."
+    task :setup do
+      command = ["#{try_sudo} mkdir -p #{deploy_to}"]
+      command << "#{try_sudo} chown $USER #{deploy_to}" if fetch(:run_method, :sudo) == :sudo
+      command << "cd #{deploy_to}"
+      command << "chmod g+w ."
+      command << "git init #{fetch(:group_writeable) ? '--shared' : ''}"
+      command << "sed -i'' -e 's/master/#{branch}/' .git/HEAD" unless branch == 'master'
+      command << "git config --bool receive.denyNonFastForwards false" if fetch(:group_writeable)
+      command << "git config receive.denyCurrentBranch ignore"
+      run command.join(' && ')
+
+      install_hooks
+      push
+    end
+
+    task :install_hooks do
+      dir = File.dirname(__FILE__) + '/hooks'
+      remote_dir = "#{deploy_to}/.git/hooks"
+
+      top.upload "#{dir}/post-receive.rb", "#{remote_dir}/post-receive"
+      top.upload "#{dir}/post-reset.rb", "#{remote_dir}/post-reset"
+      run "chmod +x #{remote_dir}/post-receive #{remote_dir}/post-reset"
+    end
+
+    desc "Restarts your Passenger application."
+    task :restart, :roles => :app do
+      run "touch #{deploy_to}/tmp/restart.txt"
+    end
+
+    desc <<-DESC
+      Test deployment dependencies.
+
+      You can define your own dependencies, as well, using the `depend' method:
+
+        depend :remote, :gem, "tzinfo", ">=0.3.3"
+        depend :local, :command, "svn"
+        depend :remote, :directory, "/u/depot/files"
+    DESC
+    task :check do
+      dependencies = strategy.check!
+
+      other = fetch(:dependencies, {})
+      other.each do |location, types|
+        types.each do |type, calls|
+          if type == :gem
+            dependencies.send(location).command(fetch(:gem_command, "gem")).or("`gem' command could not be found. Try setting :gem_command")
+          end
+
+          calls.each do |args|
+            dependencies.send(location).send(type, *args)
+          end
+        end
+      end
+
+      if dependencies.pass?
+        puts "You appear to have all necessary dependencies installed"
+      else
+        puts "The following dependencies failed. Please check them and try again:"
+        dependencies.reject { |d| d.pass? }.each do |d|
+          puts "--> #{d.message}"
+        end
+        abort
+      end
+    end
+  end
+end

data/lib/hooks/post-receive.rb

@@ -0,0 +1,48 @@
+#!/usr/bin/ruby
+if ENV['GIT_DIR'] == '.'
+  # this means the script has been called as a hook, not manually.
+  # get the proper GIT_DIR so we can descend into the working copy dir;
+  # if we don't then `git reset --hard` doesn't affect the working tree.
+  Dir.chdir('..')
+  ENV['GIT_DIR'] = '.git'
+end
+
+# find out the current branch
+head = File.read('.git/HEAD').chomp
+# abort if we're on a detached head
+exit unless head.sub!('ref: ', '')
+
+oldrev = newrev = nil
+null_ref = '0' * 40
+
+# read the STDIN to detect if this push changed the current branch
+while newrev.nil? and gets
+  # each line of input is in form of "<oldrev> <newrev> <refname>"
+  revs = $_.split
+  oldrev, newrev = revs if head == revs.pop
+end
+
+# abort if there's no update, or in case the branch is deleted
+exit if newrev.nil? or newrev == null_ref
+
+# update the working copy
+`git reset --hard`
+
+if oldrev == null_ref
+  # this is the first push; this branch was just created
+  require 'fileutils'
+  FileUtils.mkdir_p %w(log tmp)
+  config = 'config/database.yml'
+  
+  unless File.exists?(config)
+    # install the database config from the example file
+    example = ['config/database.example.yml', config + '.example'].find { |f| File.exists? f }
+    FileUtils.cp example, config if example
+  end
+else
+  logfile = 'log/deploy.log'
+  # log timestamp
+  File.open(logfile, 'a') { |log| log.puts "==== #{Time.now} ====" }
+  # start the post-reset hook in background
+  system %(nohup .git/hooks/post-reset #{oldrev} #{newrev} 1>>#{logfile} 2>>#{logfile} &)
+end

data/lib/hooks/post-reset.rb

@@ -0,0 +1,73 @@
+#!/usr/bin/ruby
+RAILS_ENV = 'production'
+oldrev, newrev = ARGV
+$stdout.sync = true
+
+# get a list of files that changed
+changes = `git diff #{oldrev} #{newrev} --diff-filter=ACDMR --name-status`.split("\n")
+
+# make a hash of files that changed and how they changed
+changes_hash = changes.inject(Hash.new { |h, k| h[k] = [] }) do |hash, line|
+  modifier, filename = line.split("\t", 2)
+  hash[modifier] << filename
+  hash
+end
+
+# create an array of files added, copied, modified or renamed
+modified_files = %w(A C M R).inject([]) { |files, bit| files.concat changes_hash[bit] }
+added_files = changes_hash['A'] # added
+deleted_files = changes_hash['D'] # deleted
+changed_files = modified_files + deleted_files # all
+puts "files changed: #{changed_files.size}"
+
+class Array
+  # scans the list of files to see if any of them are under the given path
+  def any_in_dir?(dir)
+    if Array === dir
+      exp = %r{^(?:#{dir.join('|')})/}
+      any? { |file| file =~ exp }
+    else
+      dir += '/'
+      any? { |file| file.index(dir) == 0 }
+    end
+  end
+end
+
+cached_assets_cleared = false
+
+# detect modified asset dirs
+asset_dirs = %w(public/stylesheets public/javascripts).select do |dir|
+  # did any on the assets under this dir change?
+  changed_files.any_in_dir?(dir)
+end
+
+unless asset_dirs.empty?
+  # clear cached assets (unversioned/ignored files)
+  deleted_assets = `git ls-files -z --other -- #{asset_dirs.join(' ')} | xargs -0 rm -v`.split("\n")
+  unless deleted_assets.empty?
+    puts "cleared: #{deleted_assets.join(', ')}"
+    cached_assets_cleared = true
+  end
+end
+
+# run migrations when new ones added
+if new_migrations = added_files.any_in_dir?('db/migrate')
+  system %(rake db:migrate RAILS_ENV=#{RAILS_ENV})
+end
+
+if modified_files.include?('.gitmodules')
+  # sync submodule remote urls in case of changes
+  system %(git submodule sync)
+  # initialize new submodules
+  system %(git submodule init)
+end
+# update existing submodules
+system %(git submodule update)
+
+# determine if app restart is needed
+if cached_assets_cleared or new_migrations or changed_files.any_in_dir?(%w(app config lib public vendor))
+  require 'fileutils'
+  # tell Passenger to restart this app
+  FileUtils.touch 'tmp/restart.txt'
+  puts "restarting Passenger app"
+end

metadata

@@ -0,0 +1,68 @@
+--- !ruby/object:Gem::Specification 
+name: git-deploy
+version: !ruby/object:Gem::Version 
+  version: 0.2.0
+platform: ruby
+authors: 
+- "Mislav Marohni\xC4\x87"
+autorequire: 
+bindir: bin
+cert_chain: []
+
+date: 2009-10-04 00:00:00 +02:00
+default_executable: 
+dependencies: 
+- !ruby/object:Gem::Dependency 
+  name: capistrano
+  type: :runtime
+  version_requirement: 
+  version_requirements: !ruby/object:Gem::Requirement 
+    requirements: 
+    - - ~>
+      - !ruby/object:Gem::Version 
+        version: 2.5.9
+    version: 
+description: git-deploy is a tool to install useful git hooks on your remote repository to enable git push-based, Heroku-like deployment on your host.
+email: mislav.marohnic@gmail.com
+executables: []
+
+extensions: []
+
+extra_rdoc_files: []
+
+files: 
+- Rakefile
+- lib/git_deploy.rb
+- lib/hooks/post-receive.rb
+- lib/hooks/post-reset.rb
+- README.markdown
+has_rdoc: true
+homepage: http://github.com/mislav/git-deploy
+licenses: []
+
+post_install_message: 
+rdoc_options: []
+
+require_paths: 
+- lib
+required_ruby_version: !ruby/object:Gem::Requirement 
+  requirements: 
+  - - ">="
+    - !ruby/object:Gem::Version 
+      version: "0"
+  version: 
+required_rubygems_version: !ruby/object:Gem::Requirement 
+  requirements: 
+  - - ">="
+    - !ruby/object:Gem::Version 
+      version: "0"
+  version: 
+requirements: []
+
+rubyforge_project: 
+rubygems_version: 1.3.5
+signing_key: 
+specification_version: 3
+summary: Simple git push-based application deployment
+test_files: []
+