webtranslateit-safe 0.4.5 → 0.4.7

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 63bd94e905a8a424ce2b408fa3d0d2898fc5d22c3be9739a95ff73668cd612ad
-  data.tar.gz: 2f33a476839a38aa403e89a3f0e35ad5c78a9c403756c0472f15c45337a0b575
+  metadata.gz: 620a90f70005e6406e8a1d355a90e287ffb38893c1e1ab39ffca0e82707d4122
+  data.tar.gz: 52eb2a49cf8aa91cc03c0ee471282e097628487d99ee9f91203b3ed72518f22d
 SHA512:
-  metadata.gz: b50f77cc5ee6b609ad05e85fa5fc106ed21af49e014397427aa9a77de4bba9e5d6e3cff8773d78e14314e44388d6f0cf6cbf258d0e3ffd9db0ddeedc063a525d
-  data.tar.gz: e21c75b914bf576842f22893098c872659ba5d7dd27b84d4f087226e7aa80a43f32a133f668a20c09492762f2459707ae1c3e7f9e074db4a8b9fc7c933b4f885
+  metadata.gz: 2121d992be6eccad69dcede5b04a7c83a78f156d129d118f49a713d433e0736ead3d8e0185ea5ca9f5650f843e9e7981a619a89cbe1a1f726a84fc1ea0755ab4
+  data.tar.gz: 6df61f68e23d994300b155880425f8316744545bba20d13eac1bd1268e97dd0be2a81e7119b935db9a647daafb177398835d081241d10edcb80832ec8ce54a32

data/CHANGELOG

@@ -1,3 +1,10 @@
+## 0.4.7 - 2023-06-30
+
+* Hotfix.
+## 0.4.6 - 2023-06-30
+
+* Code refactoring.
+
 ## 0.4.5 - 2023-06-30
 
 * Add SCP backup strategy.

data/README.markdown

@@ -1,39 +1,14 @@
 # webtranslateit-safe
 
-Simple database and filesystem backups with S3 and Rackspace Cloud Files support (with optional encryption)
+Simple database and filesystem backups with S3 and Rackspace Cloud Files support (with optional encryption).
 
-* Code: [http://github.com/webtranslateit/safe](http://github.com/webtranslateit/safe)
+This is a fork of now abandonned [astrails-safe](https://github.com/astrails/safe) that we’ve been using since 2010. It is now unmaintained and not compatible with ruby 3.2, so we forked it.
 
-## Motivation
+We’ve added:
 
-We needed a backup solution that will satisfy the following requirements:
-
-* opensource
-* simple to install and configure
-* support for simple ‘tar’ backups of directories (with includes/excludes)
-* support for simple mysqldump of mysql databases
-* support for symmetric or public key encryption
-* support for local filesystem, Amazon S3, and Rackspace Cloud Files for storage
-* support for backup rotation. we don’t want backups filling all the diskspace or cost a fortune on S3 or Cloud Files
-
-And since we didn't find any, we wrote our own :)
-
-## Contributions
-
-The following functionality was contributed by webtranslateit-safe users:
-
-* PostgreSQL dump using `pg_dump` (by Mark Mansour <mark@stateofflux.com>)
-* Subversion dump using svndump (by Richard Luther <richard.luther@gmail.com>)
-* SFTP remote storage (by Adam <adam@mediadrive.ca>)
-* benchmarking output (By Neer)
-* README fixes (by Bobby Wilson)
-* improved config file parsing (by Fedor Kocherga <fkocherga@gmail.com>)
-* mysql password file quoting (by Jonathan Sutherland <jonathan.sutherland@gmail.com>)
-* Rackspace Cloud Files support (by H. Wade Minter <minter@lunenburg.org>)
-* Plan FTP support (by seroy <seroy@bk.ru>)
-* mongodump support (by Matt Berther <matt@mattberther.com>)
-
-Thanks to all :)
+- Support for ruby 3.2
+- Standardized code with rubocop
+- Added support for SCP transfers — On some conditions with servers with higher latency, transfering large files (> 18GB) with SFTP can take a very long time.
 
 ## Installation
 
@@ -83,7 +58,7 @@ We recommend also pringing the hard paper copy of your GPG key 'just in case'.
 
 The procedure to create and transfer the key is as follows:
 
-1. run 'gpg --gen-key' on your local machine and follow onscreen instructions to create the key
+1. run `gpg --gen-key` on your local machine and follow onscreen instructions to create the key
    (you can accept all the defaults).
 
 2. extract your public key into a file (assuming you used test@example.com as your key email):
@@ -94,151 +69,148 @@ The procedure to create and transfer the key is as follows:
 
 4. import public key on the remote system:
 
-    $ gpg --import test@example.com.pub
-    gpg: key 45CA9403: public key "Test Backup <test@example.com>" imported
-    gpg: Total number processed: 1
-    gpg:               imported: 1
+``` bash
+$ gpg --import test@example.com.pub
+gpg: key 45CA9403: public key "Test Backup <test@example.com>" imported
+gpg: Total number processed: 1
+gpg:               imported: 1
+```
 
 5. since we don't keep the secret part of the key on the remote server, gpg has
    no way to know its yours and can be trusted.
    To fix that we can sign it with other trusted key, or just directly modify its
    trust level in gpg (use level 5):
 
-     $ gpg --edit-key test@example.com
-     ...
-     Command> trust
-     ...
-     1 = I don't know or won't say
-     2 = I do NOT trust
-     3 = I trust marginally
-     4 = I trust fully
-     5 = I trust ultimately
-     m = back to the main menu
-
-     Your decision? 5
-     ...
-     Command> quit
+``` bash
+$ gpg --edit-key test@example.com
+...
+Command> trust
+...
+1 = I don't know or won't say
+2 = I do NOT trust
+3 = I trust marginally
+4 = I trust fully
+5 = I trust ultimately
+m = back to the main menu
+
+Your decision? 5
+...
+Command> quit
+```
 
 6. export your secret key for backup
    (we recommend to print it on paper and burn to a CD/DVD and store in a safe place):
 
-    $ gpg -a --export-secret-key test@example.com > test@example.com.key
-
+``` bash
+$ gpg -a --export-secret-key test@example.com > test@example.com.key
+```
+## Example configuration
 
+``` ruby
+safe do
+  verbose true
+
+  local path: "/backup/:kind/:id"
+
+  s3 do
+    key "...................."
+    secret "........................................"
+    bucket "backup.astrails.com"
+    path "servers/alpha/:kind/:id"
+  end
+
+  cloudfiles do
+    user "..........."
+    api_key "................................."
+    container "safe_backup"
+    path ":kind/" # this is default
+    service_net false
+  end
+
+  sftp do
+    host "sftp.astrails.com"
+    user "astrails"
+    # port 8023
+    password "ssh password for sftp"
+  end
+
+  sftp do
+    host "sftp.astrails.com"
+    user "astrails"
+    # port 8023
+    password "ssh password for scp"
+  end
+
+  gpg do
+    command "/usr/local/bin/gpg"
+    options  "--no-use-agent"
+    # symmetric encryption key
+    # password "qwe"
+
+    # public GPG key (must be known to GPG, i.e. be on the keyring)
+    key "backup@astrails.com"
+  end
+
+  keep do
+    local 20
+    s3 100
+    cloudfiles 100
+    sftp 100
+    scp 100
+  end
+
+  mysqldump do
+    options "-ceKq --single-transaction --create-options"
+
+    user "root"
+    password "............"
+    socket "/var/run/mysqld/mysqld.sock"
+
+    database :blog
+    database :servershape
+    database :astrails_com
+    database :secret_project_com do
+      skip_tables "foo"
+      skip_tables ["bar", "baz"]
+    end
 
-## Example configuration
+  end
 
-    safe do
-      verbose true
-
-      local :path => "/backup/:kind/:id"
-
-      s3 do
-        key "...................."
-        secret "........................................"
-        bucket "backup.astrails.com"
-        path "servers/alpha/:kind/:id"
-      end
-
-      cloudfiles do
-        user "..........."
-        api_key "................................."
-        container "safe_backup"
-        path ":kind/" # this is default
-        service_net false
-      end
-
-      sftp do
-        host "sftp.astrails.com"
-        user "astrails"
-        # port 8023
-        password "ssh password for sftp"
-      end
-
-      sftp do
-        host "sftp.astrails.com"
-        user "astrails"
-        # port 8023
-        password "ssh password for scp"
-      end
-
-      gpg do
-        command "/usr/local/bin/gpg"
-        options  "--no-use-agent"
-        # symmetric encryption key
-        # password "qwe"
-
-        # public GPG key (must be known to GPG, i.e. be on the keyring)
-        key "backup@astrails.com"
-      end
-
-      keep do
-        local 20
-        s3 100
-        cloudfiles 100
-        sftp 100
-        scp 100
-      end
-
-      mysqldump do
-        options "-ceKq --single-transaction --create-options"
-
-        user "root"
-        password "............"
-        socket "/var/run/mysqld/mysqld.sock"
-
-        database :blog
-        database :servershape
-        database :astrails_com
-        database :secret_project_com do
-          skip_tables "foo"
-          skip_tables ["bar", "baz"]
-        end
-
-      end
-
-      svndump do
-        repo :my_repo do
-          repo_path "/home/svn/my_repo"
-        end
-      end
-
-      pgdump do
-        options "-i -x -O"   # -i => ignore version, -x => do not dump privileges (grant/revoke), -O => skip restoration of object ownership in plain text format
-
-        user "username"
-        password "............"  # shouldn't be used, instead setup ident.  Current functionality exports a password env to the shell which pg_dump uses - untested!
-
-        database :blog
-        database :stateofflux_com
-      end
-
-      tar do
-        options "-h" # dereference symlinks
-        archive "git-repositories", :files => "/home/git/repositories"
-        archive "dot-configs",      :files => "/home/*/.[^.]*"
-        archive "etc",              :files => "/etc", :exclude => "/etc/puppet/other"
-
-        archive "blog-astrails-com" do
-          files "/var/www/blog.astrails.com/"
-          exclude "/var/www/blog.astrails.com/log"
-          exclude "/var/www/blog.astrails.com/tmp"
-        end
-
-        archive "astrails-com" do
-          files "/var/www/astrails.com/"
-          exclude ["/var/www/astrails.com/log", "/var/www/astrails.com/tmp"]
-        end
-      end
+  svndump do
+    repo :my_repo do
+      repo_path "/home/svn/my_repo"
     end
+  end
+
+  pgdump do
+    options "-i -x -O"   # -i => ignore version, -x => do not dump privileges (grant/revoke), -O => skip restoration of object ownership in plain text format
+
+    user "username"
+    password "............"  # shouldn't be used, instead setup ident.  Current functionality exports a password env to the shell which pg_dump uses - untested!
 
-## Contributing
+    database :blog
+    database :stateofflux_com
+  end
 
-1. Fork it
-2. Create your feature branch (`git checkout -b my-new-feature`)
-3. Commit your changes (`git commit -am 'Add some feature'`)
-4. Push to the branch (`git push origin my-new-feature`)
-5. Create new Pull Request
+  tar do
+    options "-h" # dereference symlinks
+    archive "git-repositories", files: "/home/git/repositories"
+    archive "dot-configs",      files: "/home/*/.[^.]*"
+    archive "etc",              files: "/etc", exclude: "/etc/puppet/other"
+
+    archive "blog-astrails-com" do
+      files "/var/www/blog.astrails.com/"
+      exclude "/var/www/blog.astrails.com/log"
+      exclude "/var/www/blog.astrails.com/tmp"
+    end
+
+    archive "astrails-com" do
+      files "/var/www/astrails.com/"
+      exclude ["/var/www/astrails.com/log", "/var/www/astrails.com/tmp"]
+    end
+  end
+end
+```
 
 ## Copyright
 

data/bin/webtranslateit-safe

@@ -1,8 +1,6 @@
 #!/usr/bin/env ruby
 
-require 'rubygems'
-
-require 'webtranslateit/safe'
+require 'web_translate_it/safe'
 
 include WebTranslateIt::Safe
 
@@ -31,7 +29,7 @@ OPTS = [
   '-n', '--dry-run', '--not-dry-run',
   '-L', '--local', '--not-local'
 ].freeze
-def main
+def main # rubocop:todo Metrics/CyclomaticComplexity, Metrics/AbcSize, Metrics/MethodLength, Metrics/PerceivedComplexity
   opts = ARGV & OPTS
   args = ARGV - OPTS
 

data/lib/{webtranslateit → web_translate_it}/safe/cloudfiles.rb

@@ -23,7 +23,7 @@ module WebTranslateIt
         File.stat(path).size
       end
 
-      def save
+      def save # rubocop:todo Metrics/CyclomaticComplexity, Metrics/AbcSize, Metrics/MethodLength, Metrics/PerceivedComplexity
         raise 'pipe-streaming not supported for S3.' unless @backup.path
 
         # needed in cleanup even on dry run
@@ -44,7 +44,7 @@ module WebTranslateIt
         puts("Upload took #{format('%.2f', benchmark)} second(s).") if verbose?
       end
 
-      def cleanup
+      def cleanup # rubocop:todo Metrics/CyclomaticComplexity, Metrics/AbcSize, Metrics/PerceivedComplexity
         return if local_only?
 
         return unless keep = config[:keep, :cloudfiles]

data/lib/{webtranslateit → web_translate_it}/safe/config/builder.rb

@@ -42,7 +42,7 @@ module WebTranslateIt
             end
           end
 
-          def mixed_value(*names)
+          def mixed_value(*names) # rubocop:todo Metrics/MethodLength
             names.each do |m|
               define_method(m) do |data = {}, &block|
                 ensure_uniq(m)

data/lib/{webtranslateit → web_translate_it}/safe/config/node.rb

@@ -1,4 +1,3 @@
-require 'webtranslateit/safe/config/builder'
 module WebTranslateIt
 
   module Safe
@@ -9,10 +8,10 @@ module WebTranslateIt
 
         attr_reader :parent, :data
 
-        def initialize(parent = nil, data = {}, &block)
+        def initialize(parent = nil, data = {}, &)
           @parent = parent
           @data = {}
-          merge data, &block
+          merge(data, &)
         end
 
         def merge(data = {}, &block)
@@ -47,8 +46,8 @@ module WebTranslateIt
         end
         alias []= set
 
-        def each(&block)
-          @data.each(&block)
+        def each(&)
+          @data.each(&)
         end
         include Enumerable
 

data/lib/{webtranslateit → web_translate_it}/safe/ftp.rb

@@ -14,7 +14,7 @@ module WebTranslateIt
         @path ||= expand(config[:ftp, :path] || config[:local, :path] || ':kind/:id')
       end
 
-      def save
+      def save # rubocop:todo Metrics/CyclomaticComplexity, Metrics/AbcSize, Metrics/MethodLength, Metrics/PerceivedComplexity
         raise 'pipe-streaming not supported for FTP.' unless @backup.path
 
         puts "Uploading #{host}:#{full_path} via FTP" if verbose? || dry_run?
@@ -35,7 +35,8 @@ module WebTranslateIt
         puts '...done' if verbose?
       end
 
-      def cleanup
+      # rubocop:todo Metrics/PerceivedComplexity
+      def cleanup # rubocop:todo Metrics/CyclomaticComplexity, Metrics/PerceivedComplexity, Metrics/AbcSize, Metrics/MethodLength
         return if local_only? || dry_run?
 
         return unless keep = config[:keep, :ftp]
@@ -48,7 +49,7 @@ module WebTranslateIt
           files = ftp.nlst(path)
           pattern = File.basename(base.to_s)
           files = files.select { |x| x.start_with?(pattern) }
-          puts files.collect { |x| x } if verbose?
+          puts(files.collect { |x| x }) if verbose?
 
           files = files
                   .collect { |x| x }
@@ -61,6 +62,7 @@ module WebTranslateIt
           end
         end
       end
+      # rubocop:enable Metrics/PerceivedComplexity
 
       def host
         config[:ftp, :host]

data/lib/{webtranslateit → web_translate_it}/safe/local.rb

@@ -16,7 +16,7 @@ module WebTranslateIt
         @path ||= File.expand_path(expand(config[:local, :path] || raise('missing :local/:path')))
       end
 
-      def save
+      def save # rubocop:todo Metrics/AbcSize
         puts "command: #{@backup.command}" if verbose?
 
         # FIXME: probably need to change this to smth like @backup.finalize!
@@ -31,7 +31,7 @@ module WebTranslateIt
         puts("command took #{format('%.2f', benchmark)} second(s).") if verbose?
       end
 
-      def cleanup
+      def cleanup # rubocop:todo Metrics/CyclomaticComplexity, Metrics/AbcSize
         return unless keep = config[:keep, :local]
 
         puts "listing files #{base}" if verbose?

data/lib/{webtranslateit → web_translate_it}/safe/mongodump.rb

@@ -4,7 +4,7 @@ module WebTranslateIt
 
     class Mongodump < Source
 
-      def command
+      def command # rubocop:todo Metrics/AbcSize
         opts = []
         opts << "--host #{config[:host]}" if config[:host]
         opts << "-u #{config[:user]}" if config[:user]

data/lib/{webtranslateit → web_translate_it}/safe/s3.rb

@@ -16,7 +16,7 @@ module WebTranslateIt
         @path ||= expand(config[:s3, :path] || config[:local, :path] || ':kind/:id')
       end
 
-      def save
+      def save # rubocop:todo Metrics/CyclomaticComplexity, Metrics/AbcSize, Metrics/MethodLength, Metrics/PerceivedComplexity
         # FIXME: user friendly error here :)
         raise 'pipe-streaming not supported for S3.' unless @backup.path
 
@@ -40,7 +40,8 @@ module WebTranslateIt
         puts("Upload took #{format('%.2f', benchmark)} second(s).") if verbose?
       end
 
-      def cleanup
+      # rubocop:todo Metrics/PerceivedComplexity
+      def cleanup # rubocop:todo Metrics/CyclomaticComplexity, Metrics/PerceivedComplexity, Metrics/AbcSize, Metrics/MethodLength
         return if local_only?
 
         return unless keep = config[:keep, :s3]
@@ -58,6 +59,7 @@ module WebTranslateIt
           AWS::S3::Bucket.objects(bucket, prefix: f)[0].delete unless dry_run? || local_only?
         end
       end
+      # rubocop:enable Metrics/PerceivedComplexity
 
       def bucket
         config[:s3, :bucket]

data/lib/{webtranslateit → web_translate_it}/safe/scp.rb

@@ -18,7 +18,7 @@ module WebTranslateIt
         @path ||= expand(config[:scp, :path] || config[:local, :path] || ':kind/:id')
       end
 
-      def save # rubocop:todo Metrics/AbcSize, Metrics/CyclomaticComplexity, Metrics/PerceivedComplexity
+      def save # rubocop:todo Metrics/AbcSize, Metrics/CyclomaticComplexity, Metrics/PerceivedComplexity, Metrics/MethodLength
         raise 'pipe-streaming not supported for SCP.' unless @backup.path
 
         puts "Uploading #{host}:#{full_path} via SCP" if verbose? || dry_run?
@@ -60,7 +60,8 @@ module WebTranslateIt
         puts '...done' if verbose?
       end
 
-      def cleanup
+      # rubocop:todo Metrics/PerceivedComplexity
+      def cleanup # rubocop:todo Metrics/CyclomaticComplexity, Metrics/PerceivedComplexity, Metrics/AbcSize, Metrics/MethodLength
         return if local_only? || dry_run?
 
         return unless (keep = config[:keep, :scp])
@@ -83,6 +84,7 @@ module WebTranslateIt
           end
         end
       end
+      # rubocop:enable Metrics/PerceivedComplexity
 
       def host
         config[:scp, :host]

data/lib/{webtranslateit → web_translate_it}/safe/sftp.rb

@@ -16,7 +16,7 @@ module WebTranslateIt
         @path ||= expand(config[:sftp, :path] || config[:local, :path] || ':kind/:id')
       end
 
-      def save # rubocop:todo Metrics/AbcSize, Metrics/CyclomaticComplexity, Metrics/PerceivedComplexity
+      def save # rubocop:todo Metrics/AbcSize, Metrics/CyclomaticComplexity, Metrics/PerceivedComplexity, Metrics/MethodLength
         raise 'pipe-streaming not supported for SFTP.' unless @backup.path
 
         puts "Uploading #{host}:#{full_path} via SFTP" if verbose? || dry_run?
@@ -58,7 +58,8 @@ module WebTranslateIt
         puts '...done' if verbose?
       end
 
-      def cleanup
+      # rubocop:todo Metrics/PerceivedComplexity
+      def cleanup # rubocop:todo Metrics/CyclomaticComplexity, Metrics/PerceivedComplexity, Metrics/AbcSize, Metrics/MethodLength
         return if local_only? || dry_run?
 
         return unless keep = config[:keep, :sftp]
@@ -81,6 +82,7 @@ module WebTranslateIt
           end
         end
       end
+      # rubocop:enable Metrics/PerceivedComplexity
 
       def host
         config[:sftp, :host]

data/lib/{webtranslateit → web_translate_it}/safe/sink.rb

@@ -25,12 +25,12 @@ module WebTranslateIt
       end
 
       # call block on files to be removed (all except for the LAST 'limit' files
-      def cleanup_with_limit(files, limit, &block)
+      def cleanup_with_limit(files, limit, &)
         return unless files.size > limit
 
         to_remove = files[0..(files.size - limit - 1)]
         # TODO: validate here
-        to_remove.each(&block)
+        to_remove.each(&)
       end
 
     end

data/lib/{webtranslateit → web_translate_it}/safe/tmp_file.rb

@@ -1,4 +1,3 @@
-require 'tmpdir'
 module WebTranslateIt
 
   module Safe

data/lib/web_translate_it/safe.rb

@@ -0,0 +1,69 @@
+require 'aws/s3'
+require 'cloudfiles'
+require 'net/sftp'
+require 'net/scp'
+require 'tmpdir'
+require 'fileutils'
+require 'benchmark'
+
+require 'tempfile'
+
+require 'web_translate_it/safe/tmp_file'
+
+require 'web_translate_it/safe/config/node'
+require 'web_translate_it/safe/config/builder'
+
+require 'web_translate_it/safe/stream'
+
+require 'web_translate_it/safe/backup'
+
+require 'web_translate_it/safe/source'
+require 'web_translate_it/safe/mysqldump'
+require 'web_translate_it/safe/pgdump'
+require 'web_translate_it/safe/archive'
+require 'web_translate_it/safe/svndump'
+require 'web_translate_it/safe/mongodump'
+
+require 'web_translate_it/safe/pipe'
+require 'web_translate_it/safe/gpg'
+require 'web_translate_it/safe/gzip'
+
+require 'web_translate_it/safe/sink'
+require 'web_translate_it/safe/local'
+require 'web_translate_it/safe/s3'
+require 'web_translate_it/safe/cloudfiles'
+require 'web_translate_it/safe/scp'
+require 'web_translate_it/safe/sftp'
+require 'web_translate_it/safe/ftp'
+
+module WebTranslateIt
+
+  module Safe
+
+    ROOT = File.join(File.dirname(__FILE__), '..', '..')
+
+    def safe(&)
+      Config::Node.new(&)
+    end
+
+    def process(config)
+      [[Mysqldump, %i[mysqldump databases]],
+       [Pgdump,    %i[pgdump databases]],
+       [Mongodump, %i[mongodump databases]],
+       [Archive,   %i[tar archives]],
+       [Svndump,   %i[svndump repos]]].each do |klass, path|
+        next unless collection = config[*path]
+
+        collection.each do |name, c|
+          klass.new(name, c).backup.run(c, :gpg, :gzip, :local, :s3, :cloudfiles, :scp, :sftp, :ftp)
+        end
+      end
+
+      WebTranslateIt::Safe::TmpFile.cleanup
+    end
+    module_function :safe
+    module_function :process
+
+  end
+
+end

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: webtranslateit-safe
 version: !ruby/object:Gem::Version
-  version: 0.4.5
+  version: 0.4.7
 platform: ruby
 authors:
 - Edouard Briere
@@ -81,28 +81,28 @@ files:
 - CHANGELOG
 - README.markdown
 - bin/webtranslateit-safe
-- lib/webtranslateit/safe.rb
-- lib/webtranslateit/safe/archive.rb
-- lib/webtranslateit/safe/backup.rb
-- lib/webtranslateit/safe/cloudfiles.rb
-- lib/webtranslateit/safe/config/builder.rb
-- lib/webtranslateit/safe/config/node.rb
-- lib/webtranslateit/safe/ftp.rb
-- lib/webtranslateit/safe/gpg.rb
-- lib/webtranslateit/safe/gzip.rb
-- lib/webtranslateit/safe/local.rb
-- lib/webtranslateit/safe/mongodump.rb
-- lib/webtranslateit/safe/mysqldump.rb
-- lib/webtranslateit/safe/pgdump.rb
-- lib/webtranslateit/safe/pipe.rb
-- lib/webtranslateit/safe/s3.rb
-- lib/webtranslateit/safe/scp.rb
-- lib/webtranslateit/safe/sftp.rb
-- lib/webtranslateit/safe/sink.rb
-- lib/webtranslateit/safe/source.rb
-- lib/webtranslateit/safe/stream.rb
-- lib/webtranslateit/safe/svndump.rb
-- lib/webtranslateit/safe/tmp_file.rb
+- lib/web_translate_it/safe.rb
+- lib/web_translate_it/safe/archive.rb
+- lib/web_translate_it/safe/backup.rb
+- lib/web_translate_it/safe/cloudfiles.rb
+- lib/web_translate_it/safe/config/builder.rb
+- lib/web_translate_it/safe/config/node.rb
+- lib/web_translate_it/safe/ftp.rb
+- lib/web_translate_it/safe/gpg.rb
+- lib/web_translate_it/safe/gzip.rb
+- lib/web_translate_it/safe/local.rb
+- lib/web_translate_it/safe/mongodump.rb
+- lib/web_translate_it/safe/mysqldump.rb
+- lib/web_translate_it/safe/pgdump.rb
+- lib/web_translate_it/safe/pipe.rb
+- lib/web_translate_it/safe/s3.rb
+- lib/web_translate_it/safe/scp.rb
+- lib/web_translate_it/safe/sftp.rb
+- lib/web_translate_it/safe/sink.rb
+- lib/web_translate_it/safe/source.rb
+- lib/web_translate_it/safe/stream.rb
+- lib/web_translate_it/safe/svndump.rb
+- lib/web_translate_it/safe/tmp_file.rb
 homepage: http://github.com/webtranslateit/safe
 licenses:
 - MIT

data/lib/webtranslateit/safe.rb

@@ -1,69 +0,0 @@
-require 'aws/s3'
-require 'cloudfiles'
-require 'net/sftp'
-require 'net/scp'
-# require 'net/ftp'
-require 'fileutils'
-require 'benchmark'
-
-require 'tempfile'
-
-require 'webtranslateit/safe/tmp_file'
-
-require 'webtranslateit/safe/config/node'
-require 'webtranslateit/safe/config/builder'
-
-require 'webtranslateit/safe/stream'
-
-require 'webtranslateit/safe/backup'
-
-require 'webtranslateit/safe/source'
-require 'webtranslateit/safe/mysqldump'
-require 'webtranslateit/safe/pgdump'
-require 'webtranslateit/safe/archive'
-require 'webtranslateit/safe/svndump'
-require 'webtranslateit/safe/mongodump'
-
-require 'webtranslateit/safe/pipe'
-require 'webtranslateit/safe/gpg'
-require 'webtranslateit/safe/gzip'
-
-require 'webtranslateit/safe/sink'
-require 'webtranslateit/safe/local'
-require 'webtranslateit/safe/s3'
-require 'webtranslateit/safe/cloudfiles'
-require 'webtranslateit/safe/scp'
-require 'webtranslateit/safe/sftp'
-require 'webtranslateit/safe/ftp'
-
-module WebTranslateIt
-
-  module Safe
-
-    ROOT = File.join(File.dirname(__FILE__), '..', '..')
-
-    def safe(&block)
-      Config::Node.new(&block)
-    end
-
-    def process(config)
-      [[Mysqldump, %i[mysqldump databases]],
-       [Pgdump,    %i[pgdump databases]],
-       [Mongodump, %i[mongodump databases]],
-       [Archive,   %i[tar archives]],
-       [Svndump,   %i[svndump repos]]].each do |klass, path|
-        next unless collection = config[*path]
-
-        collection.each do |name, c|
-          klass.new(name, c).backup.run(c, :gpg, :gzip, :local, :s3, :cloudfiles, :scp, :sftp, :ftp)
-        end
-      end
-
-      WebTranslateIt::Safe::TmpFile.cleanup
-    end
-    module_function :safe
-    module_function :process
-
-  end
-
-end