pkgr 1.3.2 → 1.4.0

checksums.yaml

@@ -0,0 +1,7 @@
+---
+SHA1:
+  metadata.gz: cc9860507ebe18fd497f6cd0c2eafb4b43fa3e84
+  data.tar.gz: d1bc91d07dcab8e62cf382dd6b1317cbe6866065
+SHA512:
+  metadata.gz: 34286f726b3d4dc61931239d8ffd3570ea524ceddcf3b0d5a06635123904b6fc31af1be63b8a5e9a937766da79c888748f4b9eec49b51235905a863ec0cf9700
+  data.tar.gz: 56ea0451c22d005d56852efeb0c87ff231de587e4d833b6658fc10a102372c53098e23b9f0aa89a02af9be14453846d46307ef953537bff3a9d1803d02e05c5d

data/README.md

@@ -2,21 +2,29 @@
 
 ## Goal
 
-Make debian packages out of any Ruby or NodeJS app that can run on Heroku. Hosted service available at <https://pkgr.io/>.
+Make debian or rpm packages out of any app, including init script, logrotate, etc. Excellent way to distribute apps or command line tools without complicated installation instructions.
 
-More languages and target distributions will be added after thorough testing, though nothing prevents you from specifying a specific buildpack (see Usage).
+Hosted service available at <https://packager.io/>.
+
+## Officially supported languages
+
+* Ruby
+* NodeJS
+* Go
+
+You can also point to other buildpacks ([doc](https://packager.io/documentation/reference/the-pkgryml-file.html#buildpack)). They may just work.
 
 ## Supported distributions (64bits only)
 
-* Ubuntu 14.04 ("Trusty")
-* Ubuntu 12.04 ("Precise")
-* Debian 7.4 ("Wheezy")
-* Ubuntu 10.04 ("Lucid")
-* Debian 6 ("Squeeze")
+* Ubuntu 14.04 ("trusty")
+* Ubuntu 12.04 ("precise")
+* Debian 7 ("wheezy")
+* Centos 6
+* Fedora 20
 
 ## Examples
 
-See <https://pkgr.io/showcase> for examples of apps packaged with `pkgr` (Gitlab, Redmine, Discourse, Ghost, etc.).
+See <https://packager.io/> for examples of apps packaged with `pkgr` (Gitlab, OpenProject, Discourse, etc.).
 
 ## Installation
 
@@ -32,17 +40,13 @@ To package your app, you can either execute `pkgr` locally if your app repositor
 
     pkgr package path/to/app/repo
 
-Or, assuming your build machine is accessible via SSH by doing `ssh pkgr-build-machine` (set this in your `~/.ssh/config` file), you can do as follows:
-
-    pkgr package path/to/app/repo --host pkgr-build-machine
-
 The resulting .deb package will be in your current working directory.
 
 Full command line options are given below:
 
     $ pkgr help package
     Usage:
-      pkgr package TARBALL
+      pkgr package TARBALL|DIRECTORY
 
     Options:
       [--buildpack=BUILDPACK]                        # Custom buildpack to use
@@ -56,7 +60,7 @@ Full command line options are given below:
       [--description=DESCRIPTION]                    # Project description
       [--version=VERSION]                            # Package version (if git directory given, it will use the latest git tag available)
       [--iteration=ITERATION]                        # Package iteration (you should keep the default here)
-                                                     # Default: 20140502095614
+                                                     # Default: 20141015024539
       [--license=LICENSE]                            # The license of your package (see <https://www.debian.org/doc/packaging-manuals/copyright-format/1.0/#license-short-name>)
       [--user=USER]                                  # User to run the app under (defaults to your app name)
       [--group=GROUP]                                # Group to run the app under (defaults to your app name)
@@ -75,13 +79,13 @@ Full command line options are given below:
                                                      # Default: true
       [--env=one two three]                          # Specify environment variables for buildpack (--env "CURL_TIMEOUT=2" "BUNDLE_WITHOUT=development test")
       [--force-os=FORCE_OS]                          # Force a specific distribution to build for (e.g. --force-os "ubuntu-12.04"). This may result in a broken package.
+      [--store-cache], [--no-store-cache]            # Output a tarball of the cache in the current directory (name: cache.tar.gz)
       [--verbose], [--no-verbose]                    # Run verbosely
       [--debug], [--no-debug]                        # Run very verbosely
       [--name=NAME]                                  # Application name (if directory given, it will default to the directory name)
       [--buildpacks-cache-dir=BUILDPACKS_CACHE_DIR]  # Directory where to store the buildpacks
                                                      # Default: /home/vagrant/.pkgr/buildpacks
 
-
 ## Why?
 
 Tools such as [Capistrano](http://capify.org/) are great for deploying
@@ -101,7 +105,7 @@ Finally, it's a great way to share your open source software with your users and
 
 * Uses Heroku buildpacks to embed all the dependencies related to your application runtime within the debian package. For a Rails app for instance, this means that `pkgr` will embed the specific ruby runtime you asked for, along with all the gems specified in your Gemfile. However, all other dependencies you may need must be specified as additional system dependencies (see Usage). This avoids the 'packaging-the-world' approach used by other tools such as omnibus (with the pros and cons that come with it), but it still allows you to use the latest and greatest libraries for your language of choice. See this [blog post][background-pkgr] for more background.
 
-[background-pkgr]: http://blog.pkgr.io/post/81988994454/why-i-made-pkgr-io-digressions-on-software-packaging
+[background-pkgr]: http://blog.packager.io/post/81988994454/why-i-made-pkgr-io-digressions-on-software-packaging
 
 * Gives you a nice executable, which closely replicates the Heroku toolbelt utility. For instance, assuming you're packaging an app called `my-app`, you can do the following:
 
@@ -110,6 +114,7 @@ Finally, it's a great way to share your open source software with your users and
         my-app run [procfile process] # e.g. my-app run rake db:migrate; my-app run console; etc.
         my-app run [arbitrary process] # e.g. my-app run ruby -v; my-app run bundle install; etc.
         my-app scale web=1 worker=1
+        my-app logs [--tail]
         ...
 
 * Your app will reside in `/opt/app-name`.
@@ -126,7 +131,7 @@ Finally, it's a great way to share your open source software with your users and
 
 * You must have a Procfile.
 
-* Your application must be Heroku compatible, meaning you should be able to set your main app's configuration via environment variables.
+* Your application should be Heroku compatible, meaning you should be able to set your main app's configuration via environment variables.
 
 ## Troubleshooting
 
@@ -143,7 +148,7 @@ If you get the following error `ERROR:  While executing gem ... (ArgumentError)
 
 ## Authors
 
-* Cyril Rohr <cyril.rohr@gmail.com> - <http://crohr.me>
+* Cyril Rohr <cyril.rohr@gmail.com> - <http://crohr.me>, <https://packager.io>
 
 ## Copyright
 

data/data/build_dependencies/fedora.yml

@@ -0,0 +1,13 @@
+default:
+  - curl
+  - gcc
+  - gcc-c++
+  - kernel-devel
+  - openssl-devel
+  - readline-devel
+  - libxml2-devel
+  - libxslt-devel
+  - libevent-devel
+  - postgresql-devel
+  - mariadb-devel
+  - sqlite-devel

data/data/buildpacks/centos-6

@@ -1,2 +1,3 @@
-https://github.com/pkgr/heroku-buildpack-ruby.git#487c79e8cc3ab038ac13fef82d1e59a9c6ac39e6,BUILDPACK_VENDOR_URL="https://s3-external-1.amazonaws.com/pkgr-buildpack-ruby/20140408175240-centos-6.4",BUILDPACK_NODE_VERSION="0.6.8",CURL_CONNECT_TIMEOUT=60,CURL_TIMEOUT=300
-https://github.com/heroku/heroku-buildpack-nodejs.git#v58
+https://github.com/pkgr/heroku-buildpack-ruby.git#universal,BUILDPACK_NODE_VERSION="0.6.8",CURL_CONNECT_TIMEOUT=60,CURL_TIMEOUT=300
+https://github.com/heroku/heroku-buildpack-nodejs.git#v58
+https://github.com/kr/heroku-buildpack-go.git

data/data/buildpacks/debian-7

@@ -1,2 +1,3 @@
-https://github.com/pkgr/heroku-buildpack-ruby.git#487c79e8cc3ab038ac13fef82d1e59a9c6ac39e6,BUILDPACK_VENDOR_URL="https://s3-external-1.amazonaws.com/pkgr-buildpack-ruby/20140408175240-debian-7.4",BUILDPACK_NODE_VERSION="0.6.8",CURL_CONNECT_TIMEOUT=60,CURL_TIMEOUT=300
-https://github.com/heroku/heroku-buildpack-nodejs.git#v58
+https://github.com/pkgr/heroku-buildpack-ruby.git#universal,BUILDPACK_NODE_VERSION="0.6.8",CURL_CONNECT_TIMEOUT=60,CURL_TIMEOUT=300
+https://github.com/heroku/heroku-buildpack-nodejs.git#v58
+https://github.com/kr/heroku-buildpack-go.git

data/data/buildpacks/fedora-20

@@ -0,0 +1,2 @@
+https://github.com/pkgr/heroku-buildpack-ruby.git#universal,BUILDPACK_NODE_VERSION="0.6.8",CURL_CONNECT_TIMEOUT=60,CURL_TIMEOUT=300
+https://github.com/heroku/heroku-buildpack-nodejs.git#v58

data/data/buildpacks/ubuntu-12.04

@@ -1,2 +1,3 @@
-https://github.com/pkgr/heroku-buildpack-ruby.git#487c79e8cc3ab038ac13fef82d1e59a9c6ac39e6,BUILDPACK_VENDOR_URL="https://s3-external-1.amazonaws.com/pkgr-buildpack-ruby/20140408175240-ubuntu-12.04",BUILDPACK_NODE_VERSION="0.6.8",CURL_CONNECT_TIMEOUT=60,CURL_TIMEOUT=300
-https://github.com/heroku/heroku-buildpack-nodejs.git#v58
+https://github.com/pkgr/heroku-buildpack-ruby.git#universal,BUILDPACK_NODE_VERSION="0.6.8",CURL_CONNECT_TIMEOUT=60,CURL_TIMEOUT=300
+https://github.com/heroku/heroku-buildpack-nodejs.git#v58
+https://github.com/kr/heroku-buildpack-go.git

data/data/buildpacks/ubuntu-14.04

@@ -1,2 +1,3 @@
-https://github.com/pkgr/heroku-buildpack-ruby.git#487c79e8cc3ab038ac13fef82d1e59a9c6ac39e6,BUILDPACK_VENDOR_URL="https://s3-external-1.amazonaws.com/pkgr-buildpack-ruby/20140408175240-ubuntu-14.04",BUILDPACK_NODE_VERSION="0.6.8",CURL_CONNECT_TIMEOUT=60,CURL_TIMEOUT=300
-https://github.com/heroku/heroku-buildpack-nodejs.git#v58
+https://github.com/pkgr/heroku-buildpack-ruby.git#universal,BUILDPACK_NODE_VERSION="0.6.8",CURL_CONNECT_TIMEOUT=60,CURL_TIMEOUT=300
+https://github.com/heroku/heroku-buildpack-nodejs.git#v58
+https://github.com/kr/heroku-buildpack-go.git

data/data/cli/cli.sh.erb

@@ -7,6 +7,10 @@ set -o pipefail
 APP_NAME=$(basename $0)
 # useful for testing
 ROOT_PATH=${ROOT_PATH:="/"}
+# store original pwd
+export ORIGINAL_PWD=$(pwd)
+# required for chroot on fedora
+PATH="$PATH:/usr/sbin"
 
 # Helper function that returns the real path, based on the given ROOT_PATH
 _p() {
@@ -20,22 +24,32 @@ usage() {
   echo "  $APP_NAME logs [--tail|-n NUMBER]"
   echo "  $APP_NAME config:get VAR"
   echo "  $APP_NAME config:set VAR=VALUE"
+  echo "  $APP_NAME reconfigure"
 }
 
 
 # Returns the type of process manager supported by the current distribution.
-runner() {
+setup_runner() {
   if [ -f $(_p /etc/debian_version) ]; then
     case "$(cat $(_p /etc/debian_version))" in
       wheezy*|squeeze*|jessie*)
-        echo "upstart"
+        APP_RUNNER="upstart"
         ;;
       *)
-        echo "sysv"
+        APP_RUNNER="sysv"
+        SYSV_MANAGER="update-rc.d"
         ;;
     esac
   elif [ -f $(_p /etc/redhat-release) ]; then
-    echo "upstart"
+    case "$(cat $(_p /etc/redhat-release))" in
+      CentOS*)
+        APP_RUNNER="upstart"
+        ;;
+      *)
+        APP_RUNNER="sysv"
+        SYSV_MANAGER="chkconfig"
+        ;;
+    esac
   fi
 }
 
@@ -45,6 +59,7 @@ if [ ! 0 -eq ${EUID} ]; then
   exit 1
 fi
 
+setup_runner
 DEFAULT_FILE=$(_p "/etc/default/${APP_NAME}")
 
 # Source all environment variables for the app. This must be done as
@@ -60,10 +75,6 @@ for file in $(_p "${APP_HOME}/.profile.d")/*.sh; do
   if [ -f $file ]; then HOME=${APP_HOME} . $file; fi
 done
 
-# You can force a specific process manager by setting the PROCESS_MANAGER
-# environment variable.
-PROCESS_MANAGER=${PROCESS_MANAGER:=$(runner)}
-
 # Return all the environment variables accessible to the app.
 show_env() {
   env -i ROOT_PATH=${ROOT_PATH} ${0} run env | sort
@@ -86,7 +97,7 @@ tail_logs() {
 
 current_number_of_processes() {
   PROCESS_NAME="$1"
-  if [ "${PROCESS_MANAGER}" = "upstart" ]; then
+  if [ "${APP_RUNNER}" = "upstart" ]; then
     echo $(ls -rv1 $(_p /etc/init/)${APP_NAME}-${PROCESS_NAME}-*.conf 2>/dev/null | head -1 | sed -r 's/.*\-([0-9]+)\.conf/\1/g')
   else
     echo $(ls -rv1 $(_p /etc/init.d/)${APP_NAME}-${PROCESS_NAME}-* 2>/dev/null | head -1 | sed -r 's/.*\-([0-9]+)/\1/g')
@@ -110,6 +121,24 @@ update_port() {
   fi
 }
 
+sysv_enable() {
+  local name="$1"
+  if [ "$SYSV_MANAGER" = "chkconfig" ] ; then
+    $SYSV_MANAGER "$name" on
+  elif [ "$SYSV_MANAGER" = "update-rc.d" ] ; then
+    $SYSV_MANAGER "$name" defaults
+  fi
+}
+
+sysv_disable() {
+  local name="$1"
+  if [ "$SYSV_MANAGER" = "chkconfig" ] ; then
+    $SYSV_MANAGER "$name" off
+  elif [ "$SYSV_MANAGER" = "update-rc.d" ] ; then
+    $SYSV_MANAGER -f "$name" remove
+  fi
+}
+
 scale_up() {
   PROCESS_NAME="${1}"
   CURRENT_SCALE=${2}
@@ -118,7 +147,10 @@ scale_up() {
 
   echo "Scaling up..."
 
-  if [ "${PROCESS_MANAGER}" = "upstart" ]; then
+  if [ "${APP_RUNNER}" = "upstart" ]; then
+    # copy initd
+    cp $(_p "${APP_HOME}/vendor/pkgr/scaling/upstart/${APP_NAME}") $(_p "/etc/init.d/")
+    chmod 0755 $(_p "/etc/init.d/${APP_NAME}")
     # copy master
     cp $(_p "${APP_HOME}/vendor/pkgr/scaling/upstart/${APP_NAME}.conf") $(_p "/etc/init/")
     # copy master process
@@ -132,18 +164,19 @@ scale_up() {
 
       update_port $(_p "/etc/init/${PROCESS_ID}.conf") "${PROCESS_NAME}" $port $index
 
-      service "${PROCESS_ID}" start
+      # directly call initctl instead of service, otherwise CentOS 6.x does not understand.
+      initctl start "${PROCESS_ID}"
     done
 
-    service ${APP_NAME}-${PROCESS_NAME} start || true
-    service ${APP_NAME} start || true
+    initctl start ${APP_NAME}-${PROCESS_NAME} || true
+    initctl start ${APP_NAME} || true
   else
     cp $(_p "${APP_HOME}/vendor/pkgr/scaling/sysv/${APP_NAME}") $(_p /etc/init.d/)
     chmod a+x $(_p "/etc/init.d/${APP_NAME}")
-    update-rc.d ${APP_NAME} defaults
+    sysv_enable ${APP_NAME}
     cp $(_p "${APP_HOME}/vendor/pkgr/scaling/sysv/${APP_NAME}-${PROCESS_NAME}") $(_p /etc/init.d/)
     chmod a+x $(_p "/etc/init.d/${APP_NAME}-${PROCESS_NAME}")
-    update-rc.d ${APP_NAME}-${PROCESS_NAME} defaults
+    sysv_enable ${APP_NAME}-${PROCESS_NAME}
     for i in $(seq ${SCALE_DELTA}); do
       index=$((${i} + ${CURRENT_SCALE}))
       PROCESS_ID="${APP_NAME}-${PROCESS_NAME}-${index}"
@@ -153,7 +186,7 @@ scale_up() {
       update_port $(_p "/etc/init.d/${PROCESS_ID}") "${PROCESS_NAME}" $port $index
 
       chmod a+x $(_p "/etc/init.d/${PROCESS_ID}")
-      update-rc.d ${PROCESS_ID} defaults
+      sysv_enable ${PROCESS_ID}
       $(_p "/etc/init.d/${PROCESS_ID}") start
     done
   fi
@@ -171,12 +204,12 @@ scale_down() {
     index=$((${i} + ${NEW_SCALE}))
     PROCESS_ID="${APP_NAME}-${PROCESS_NAME}-${index}"
 
-    if [ "${PROCESS_MANAGER}" = "upstart" ]; then
-      service "${PROCESS_ID}" stop
+    if [ "${APP_RUNNER}" = "upstart" ]; then
+      initctl stop "${PROCESS_ID}"
       rm -f $(_p "/etc/init/${PROCESS_ID}.conf")
     else
       $(_p "/etc/init.d/${PROCESS_ID}") stop
-      update-rc.d -f ${PROCESS_ID} remove
+      sysv_disable ${PROCESS_ID}
       rm -f $(_p "/etc/init.d/${PROCESS_ID}")
     fi
   done
@@ -201,6 +234,29 @@ scale() {
   fi
 }
 
+configure() {
+  local installer_dir="$(_p "/usr/share/${APP_NAME}/installer")"
+  if [ -d "$installer_dir" ] ; then
+    ${installer_dir}/bin/run $@
+  else
+    echo "No installer has been configured for ${APP_NAME}"
+  fi
+}
+
+reconfigure() {
+  if [ "$APP_ADDONS" = "" ] ; then
+    configure --reconfigure
+  else
+    # only available for debian for now
+    if which dpkg-reconfigure &>/dev/null ; then
+      for addon in ${APP_ADDONS}; do
+        dpkg-reconfigure "${APP_NAME}-${addon}"
+      done
+      # always reconfigure main package as well
+      dpkg-reconfigure "${APP_NAME}"
+    fi
+  fi
+}
 
 while : ; do
   case "$1" in
@@ -278,6 +334,14 @@ while : ; do
       show_env | grep -e "^${2}=" | sed -r "s/^${2}=//"
       break;;
 
+    configure)
+      configure $@
+      break;;
+
+    reconfigure)
+      reconfigure $@
+      break;;
+
     *)
       usage
       break ;;

data/data/dependencies/fedora.yml

@@ -0,0 +1,9 @@
+default:
+  - openssl
+  - readline
+  - libxml2
+  - libxslt
+  - libevent
+  - postgresql-libs
+  - mysql-libs
+  - sqlite

data/data/environment/default.erb

@@ -1,9 +1,14 @@
 # Generated by pkgr
 export APP_HOME="<%= home %>"
 export APP_NAME="<%= name %>"
+export APP_SAFE_NAME="<%= safe_name %>"
 export APP_GROUP="<%= group %>"
 export APP_USER="<%= user %>"
+export APP_WIZARDS="<%= wizards.map{|wizard_group| wizard_group.map{|w| w.name}.join("|")}.join(",") %>"
+# Legacy addons
+export APP_ADDONS="<%= addons.map{|addon| addon.name}.join(" ") %>"
 export HOME="/home/<%= user %>"
+export PORT=${PORT:=6000}
 <% if runner %>
 export PROCESS_MANAGER="<%= runner.split("-").first %>"
 <% end %>

data/data/hooks/postinstall.sh

@@ -18,18 +18,27 @@ ln -fs ${LOGS} ${HOME_LOGS}
 chown -R ${APP_USER}.${APP_GROUP} ${LOGS}
 
 # Add default conf.d file
-[ -f /etc/${APP_NAME}/conf.d/other ] || cat  > /etc/${APP_NAME}/conf.d/other <<CONF
-# This file contains variables set via \`${APP_NAME} config:set\`
-# Database URL. E.g. : mysql2://root:pass@127.0.0.1/my-app-db
-export DATABASE_URL=db_adapter://db_user:db_password@db_host/db_name
-export PORT=\${PORT:=6000}
-CONF
+[ -f /etc/${APP_NAME}/conf.d/other ] || touch /etc/${APP_NAME}/conf.d/other
 
 chown -R ${APP_USER}.${APP_GROUP} /etc/${APP_NAME}
+chown ${APP_USER}.${APP_GROUP} /var/db/${APP_NAME}
 
 chmod 0750 /etc/${APP_NAME} /etc/${APP_NAME}/conf.d
 find /etc/${APP_NAME} -type f -exec chmod 0640 {} +
 
+<% crons.each do |cron| %>
+rm -f <%= cron.destination %>
+cp <%= cron.source %> <%= cron.destination %>
+chmod 0640 <%= cron.destination %>
+<% end %>
+
+<% if installer %>
+echo "=============="
+echo "The ${APP_NAME} package provides an installer. Please run the following command to finish the installation:"
+echo "sudo ${APP_NAME} configure"
+echo "=============="
+<% end %>
+
 <% if after_install && File.readable?(after_install) %>
 # Call custom postinstall script.
 CUSTOM_POSTINSTALL_SCRIPT="<%= Base64.encode64 File.read(after_install) %>"

data/data/hooks/postuninstall.sh

@@ -0,0 +1,26 @@
+#!/usr/bin/env bash
+
+set -e
+
+export APP_NAME="<%= name %>"
+export APP_USER="<%= user %>"
+export APP_GROUP="<%= group %>"
+export APP_HOME="<%= home %>"
+
+<% crons.each do |cron| %>
+# delete cron if original file no longer exists
+if [ ! -f <%= cron.source %> ] ; then
+  rm -f <%= cron.destination %>
+fi
+<% end %>
+
+<% if after_remove && File.readable?(after_remove) %>
+# Call custom postuninstall script.
+CUSTOM_POSTUNINSTALL_SCRIPT="<%= Base64.encode64 File.read(after_remove) %>"
+
+tmpfile=$(mktemp)
+chmod a+x "${tmpfile}"
+echo "${CUSTOM_POSTUNINSTALL_SCRIPT}" | base64 -d - > ${tmpfile}
+
+"${tmpfile}" "$@"
+<% end %>