ferry 1.0.1 → 1.1.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA1:
-  metadata.gz: 9d989398f2fb5ec29a7c7adb8eaa41d4a3ad73ed
-  data.tar.gz: 64824ff7f371375b3d6c95bcedfd710679c3e5a0
+  metadata.gz: 3f65ccb6129a5a31a15a726e2424f438b9482e3f
+  data.tar.gz: 75f2cd24f3a7ea2f382c194fe4fecd983082879d
 SHA512:
-  metadata.gz: e723f0054f7226ff6c9409743991214a718ed04e3fd9ae0dbdfff394838ec53d949b4bc7e42ac1f3f55d07334ca9281191e3737f5b576528110cf47f7e6ed211
-  data.tar.gz: 534e64b15930ed77f2279abf0e156fd20f2178e0d8327eb0332a8fd81572d570f0d3ad97181e1796571cc299541385685ad3f26ab7cef59b22b076736388bbe3
+  metadata.gz: 060a53ed43bbed7094f6967d05979b7ddc51aa73dbb68fddf0f3e0c5258d567baabeacfba94cbfb163830496d86623475f32554ae56153f02c2adbd1134081d7
+  data.tar.gz: 425d84ab59ebf43283db4b3eec9a916d7dbf485e2ead0e6198c9f8ebc8ed5480e30915d97cae2f053fbce6108f213b5919254abdd7d50782cb69413bc3630e20

data/.travis.yml

@@ -5,10 +5,19 @@ rvm:
   - 2.1.0
   - 2.1.2
 before_install:
+  - sudo apt-get autoremove sqlite3
+  - sudo apt-get install python-software-properties
+  - sudo apt-add-repository -y ppa:travis-ci/sqlite3
+  - sudo apt-get -y update
+  - sudo apt-cache show sqlite3
+  - sudo apt-get install sqlite3=3.7.15.1-1~travis1
+  - sudo sqlite3 -version
   - gem update bundler
 script:
+  - mysql -e 'create database ferry_test;'
+  - psql -c 'create database ferry_test;' -U postgres
   - bundle exec rspec
 branches:
   only:
     - master
-    - production
+    - production

data/README.md

@@ -1,12 +1,13 @@
 ![ferry](doc/ferry_readme_icon_2.png)
 
-<!-- ![Build Status](https://travis-ci.org/cmu-is-projects/ferry.png)(https://travis-ci.org/cmu-is-projects/ferry) -->
+[![Build Status](https://travis-ci.org/cmu-is-projects/ferry.svg?branch=master)](https://travis-ci.org/cmu-is-projects/ferry)
+[![Gem Version](https://badge.fury.io/rb/ferry.svg)](http://badge.fury.io/rb/ferry)
 
 ## What is Ferry?
-Ferry is a command-line tool rubygem designed for Rails data migrations and manipulation, maintained as an open-source project by the students of [Carnegie Mellon's Information Systems department](http://www.cmu.edu/information-systems/) currently [Anthony Corletti](http://github.com/anthcor) and [Logan Watanabe](http://github.com/loganwatanabe). The inspiration for ferry was brought from collective internship experiences and from the growing prevalence of big data migration and manipulation challenges that companies, corporations, universities, and organizations face in today's information age.
+Ferry is a command-line tool rubygem designed for Rails data migrations and manipulation, primarily maintained as an open-source project by the students of [Carnegie Mellon's Information Systems department](http://www.cmu.edu/information-systems/) since August 2014. The inspiration for ferry was brought from collective internship experiences and from the growing prevalence of big data migration and manipulation challenges that companies, corporations, universities, and organizations face in today's information age. A large thanks in part to [CustomInk's Technology Team](https://github.com/customink) and their [blog articles](http://technology.customink.com) for advice and guidance during the first semester (Fall 2014) of development.
 
 ## What can I use Ferry for?
-See the [ferry_demo](http://github.com/cmu-is-projects/ferry_demo) app or our [GitHub pages site](http://cmu-is-projects.github.com/ferry) for guidance on using Ferry!
+See the [ferry_demo](http://github.com/cmu-is-projects/ferry_demo) app or our [GitHub pages site](http://cmu-is-projects.github.com/ferry) for further documentation on using Ferry!
 
 Rails Migration and Manipulation use cases
   - Exporting data to various file formats (.csv, .yml, .sql)
@@ -14,6 +15,22 @@ Rails Migration and Manipulation use cases
   - Migrating data to third party hosts (Amazon S3, Oracle)
   - Migrating data to a different database
 
+Coming soon ...
+  - Configurable Migration Scripting
+    - The idea behind this feature is for developers to provide options for arguments in an executable script that contains the configuration and necessary tasks/ actions for the operations of whatever data migration or manipulation they are seeking to carry out.
+    - Similar to how [capistrano's](https://github.com/capistrano/capistrano) configures deploy.rb.
+  - Data Visualization
+    - With inspiration from [d3](http://d3js.org), we are hoping to create functionality that allows developers to deploy informative and visually appealing graphs and documents that can be shared over an internal network to be broadcasted to servers for display either on internal office displays or to URL's ... all from executing a simple command-line statement.
+    - We will be making use of [d3](http://d3js.org) for visualizations and are looking for current solutions to this business need and if there are any successful or not-so-successful solutions out there to compete with.
+
+## Some current development items
+#### Please feel free to open an issue or pull request with your suggestions
+- Database-switcher guide tool
+- 3rd party connections
+- Configurability
+  - Allowing user to write own rake tasks (e.g. importing and exporting data to S3 or related services)
+- Rolling back on errors or mishaps during migrations and manipulations
+
 ## Installation
 Add this line to your Rails application's Gemfile:
 ``` ruby
@@ -65,13 +82,6 @@ $ ferry --import development users db/csv/import_data.csv
 ```
 Running the above command will import the import_data.csv to the "users" table in the "development" environment.
 
-## Some current development items
-#### Please feel free to open an issue or pull request with your suggestions
-- Database-switcher guide tool
-- 3rd party connections
-- Allowing user to write own rake tasks (e.g. importing and exporting data to S3 or related services)
-- Rolling back on errors or mishaps during migrations and manipulations
-- Host API and docs via GitHub pages
 
 ## Contributing
 
@@ -80,3 +90,7 @@ Running the above command will import the import_data.csv to the "users" table i
 3. Commit your changes (`git commit -am 'Add some feature'`)
 4. Push to the branch (`git push origin my-new-feature`)
 5. Create a new Pull Request
+
+If you wish to open a pull request or issue for anything at all please feel free to do so!
+
+A large driving factor in the development of Ferry is contributing something meaningful to the open-source community and the developer community at large. Being college students who have access to such an unbelievable amount of developement resources for creating cool projects, we felt a need to give back - we wanted to start a project that would face unique challenges such that others who face similar challenges could turn to us for help and guidance. We hope that Ferry continues to be a project that both provides benefit to businesses and developers along with giving back to the open-source and greater developer community.

data/lib/ferry/importer.rb

@@ -16,7 +16,7 @@ module Ferry
     def insert_sql(model, columns, values)
       col_names_sql = "(#{columns.join(",")})"
       model_sql = model.downcase
-      sql_insert_beg = "INSERT INTO #{model_sql} #{col_names_sql} VALUES " 
+      sql_insert_beg = "INSERT INTO #{model_sql} #{col_names_sql} VALUES "
       ActiveRecord::Base.transaction do
         values.each_slice(500) do |records|
           sql_statement = sql_insert_beg + records.join(",") + ";"

data/lib/ferry/version.rb

@@ -1,3 +1,3 @@
 module Ferry
-  VERSION = "1.0.1"
+  VERSION = "1.1.0"
 end

data/spec/config/database.yml

@@ -15,6 +15,13 @@ postgresql: &postgresql
   adapter: postgresql
   min_messages: warning
 
+postgresql_system_user_name: &postgresql_system_user_name
+  <<: *default
+  username: postgres
+  password: ' '
+  adapter: postgresql
+  min_messages: warning
+
 sqlite3: &sqlite3
   adapter: sqlite3
   database: test.db
@@ -23,4 +30,4 @@ oracle: &oracle
   adapter: oracle
   database: ferry_test
   user: root
-  password: 
+  password:

data/spec/models/cart.rb

@@ -1,10 +1,5 @@
 class Cart < ActiveRecord::Base
-
   has_many :orders
-
-
   validates_presence_of :email
   validates_uniqueness_of :email
-
-  
-end
+end

data/spec/models/category.rb

@@ -1,7 +1,4 @@
 class Category < ActiveRecord::Base
-
   has_many :products
-  
   validates_presence_of :name
-  
-end
+end

data/spec/models/order.rb

@@ -1,7 +1,4 @@
 class Order < ActiveRecord::Base
-
   belongs_to :cart
   belongs_to :product
-
-  
-end
+end

data/spec/models/product.rb

@@ -1,9 +1,5 @@
 class Product < ActiveRecord::Base
-
   has_many :orders
   belongs_to :category
-
-
   validates_presence_of :name
-  
-end
+end

data/spec/sets/category_context.rb

@@ -1,5 +1,4 @@
 def create_categories
-  # assumes create_curriculums prior
   @food = FactoryGirl.create(:category)
   @cleaning = FactoryGirl.create(:category, name: "Cleaning Supplies", description: "Household cleaning products.")
   @antiques = FactoryGirl.create(:category, name: "Antiques", active: false, description:"No longer carried.")

data/spec/support/categories_import.csv

@@ -1 +1 @@
-id,name,description,float_score,active
+id,name,description,float_score,active

data/spec/tests/importer_tests.rb

@@ -61,7 +61,7 @@ describe "#import" do
       Cart.delete_all
     end
 
-    it "should be able to import >500 records" do
+    it "should be able to import > 500 records" do
       import_path = File.expand_path("..",Dir.pwd) + "/spec/support/emails_import.csv" #2100 records
       importer.import("sqlite3", "carts", import_path)
       expect(Cart.find_by(id: 42).email).to eql("Albert@example.com")

data/spec/tests/utilities_tests.rb

@@ -15,6 +15,11 @@ describe("utility functions") do
         expect(ActiveRecord::Base.connection.adapter_name).to eql('PostgreSQL')
       end
 
+      it "#postgresql fails if system user name is not role in PostgreSQL" do
+        expect{utils.db_connect("postgresql_system_user_name")}.not_to raise_error
+        expect{ActiveRecord::Base.connection.adapter_name}.not_to raise_error
+      end
+
       it "#mysql2" do
         expect{utils.db_connect("mysql2")}.not_to raise_error
         expect(ActiveRecord::Base.connection.adapter_name).to eql('Mysql2')

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: ferry
 version: !ruby/object:Gem::Version
-  version: 1.0.1
+  version: 1.1.0
 platform: ruby
 authors:
 - Anthony Corletti
@@ -10,160 +10,160 @@ authors:
 autorequire: 
 bindir: bin
 cert_chain: []
-date: 2014-12-12 00:00:00.000000000 Z
+date: 2015-01-29 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: activerecord
   requirement: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: 4.1.7
   type: :development
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: 4.1.7
 - !ruby/object:Gem::Dependency
   name: bundler
   requirement: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: '1.6'
   type: :development
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: '1.6'
 - !ruby/object:Gem::Dependency
   name: rake
   requirement: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: 10.3.2
   type: :development
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: 10.3.2
 - !ruby/object:Gem::Dependency
   name: minitest
   requirement: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: 5.4.1
   type: :development
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: 5.4.1
 - !ruby/object:Gem::Dependency
   name: rspec
   requirement: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: 3.1.0
   type: :development
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: 3.1.0
 - !ruby/object:Gem::Dependency
   name: pg
   requirement: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: 0.17.1
   type: :development
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: 0.17.1
 - !ruby/object:Gem::Dependency
   name: sqlite3
   requirement: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: 1.3.10
   type: :development
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: 1.3.10
 - !ruby/object:Gem::Dependency
   name: mysql2
   requirement: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: 0.3.16
   type: :development
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: 0.3.16
 - !ruby/object:Gem::Dependency
   name: factory_girl
   requirement: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: 4.5.0
   type: :development
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: 4.5.0
 - !ruby/object:Gem::Dependency
   name: progressbar
   requirement: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: 0.21.0
   type: :runtime
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: 0.21.0
 - !ruby/object:Gem::Dependency
   name: highline
   requirement: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: 1.6.21
   type: :runtime
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
-    - - "~>"
+    - - ~>
       - !ruby/object:Gem::Version
         version: 1.6.21
 description: Ferry is a data migration and data manipulation tool that seeks to simplify
@@ -177,9 +177,9 @@ executables:
 extensions: []
 extra_rdoc_files: []
 files:
-- ".gitignore"
-- ".rspec"
-- ".travis.yml"
+- .gitignore
+- .rspec
+- .travis.yml
 - Gemfile
 - LICENSE.txt
 - README.md
@@ -230,17 +230,17 @@ require_paths:
 - lib
 required_ruby_version: !ruby/object:Gem::Requirement
   requirements:
-  - - ">="
+  - - '>='
     - !ruby/object:Gem::Version
       version: '0'
 required_rubygems_version: !ruby/object:Gem::Requirement
   requirements:
-  - - ">="
+  - - '>='
     - !ruby/object:Gem::Version
       version: '0'
 requirements: []
 rubyforge_project: 
-rubygems_version: 2.2.2
+rubygems_version: 2.0.14
 signing_key: 
 specification_version: 4
 summary: Ferry is a data migration and data manipulation tool