mongify 0.0.4

data/.gitignore

@@ -0,0 +1,20 @@
+pkg
+doc
+coverage
+.yardoc
+
+vendor/gems/gems
+vendor/gems/specifications
+vendor/gems/doc
+vendor/gems/environment.rb
+
+coverage.data
+
+spec/tmp/*
+
+.idea/*
+.bundle/*
+
+.rvmrc
+
+spec/support/database.yml

data/CHANGELOG.rdoc

@@ -0,0 +1,22 @@
+== 0.0.4 / 15 Jan 2011
+* Switched the way connection files are written out.
+* Fixed issue with Configuration File reader
+* Added a Rake task to setup a mysql database for testing (for development only)
+* Added a way to create a translation file from a sql configuration
+* Added a printer ability for translation and command
+* Added MongoDB connection
+* Improved test coverage
+* Added the first version of processing command (very basic)
+* Indexed columns in table class to speedup lookup time
+* Added ability to update references once database is populated
+== 0.0.3 / 28 Dec 2010
+* Switched gemspec generation to raw gemspec and added Bundler for easier development
+* Added LICENSE
+* Cleaned up the require statements through out the app
+== 0.0.2 / 09 Jun 2010
+* Rewrote the whole CLI interface
+* Removed datamapper and added active_record
+* Improved tests to cover most of the code 
+* Changed overall commands for Mongify
+== 0.0.1 / 22 Mar 2010 
+* Initial Setup

data/Gemfile

@@ -0,0 +1,4 @@
+source "http://rubygems.org"
+
+# Specify your gem's dependencies in template_del.gemspec
+gemspec

data/Gemfile.lock

@@ -0,0 +1,68 @@
+PATH
+  remote: .
+  specs:
+    mongify (0.0.4)
+      activerecord (>= 2.3.10)
+      activesupport (>= 2.3.10)
+      bson_ext (>= 1.1.5)
+      mongo (>= 1.1.5)
+      net-ssh (>= 2.0)
+
+GEM
+  remote: http://rubygems.org/
+  specs:
+    activerecord (2.3.10)
+      activesupport (= 2.3.10)
+    activesupport (2.3.10)
+    bson (1.1.5)
+    bson_ext (1.1.5)
+    builder (3.0.0)
+    cucumber (0.10.0)
+      builder (>= 2.1.2)
+      diff-lcs (~> 1.1.2)
+      gherkin (~> 2.3.2)
+      json (~> 1.4.6)
+      term-ansicolor (~> 1.0.5)
+    diff-lcs (1.1.2)
+    gherkin (2.3.3)
+      json (~> 1.4.6)
+    json (1.4.6)
+    mocha (0.9.10)
+      rake
+    mongo (1.1.5)
+      bson (>= 1.1.5)
+    mysql (2.8.1)
+    net-ssh (2.0.24)
+    rake (0.8.7)
+    rcov (0.9.9)
+    rspec (2.4.0)
+      rspec-core (~> 2.4.0)
+      rspec-expectations (~> 2.4.0)
+      rspec-mocks (~> 2.4.0)
+    rspec-core (2.4.0)
+    rspec-expectations (2.4.0)
+      diff-lcs (~> 1.1.2)
+    rspec-mocks (2.4.0)
+    sqlite3-ruby (1.3.2)
+    term-ansicolor (1.0.5)
+    watchr (0.7)
+    yard (0.6.4)
+
+PLATFORMS
+  ruby
+
+DEPENDENCIES
+  activerecord (>= 2.3.10)
+  activesupport (>= 2.3.10)
+  bson_ext (>= 1.1.5)
+  cucumber (>= 0.10)
+  mocha (>= 0.9.8)
+  mongify!
+  mongo (>= 1.1.5)
+  mysql (>= 2.8.1)
+  net-ssh (>= 2.0)
+  rcov (>= 0.9.9)
+  rspec (>= 2.0)
+  sqlite3-ruby (>= 1.3)
+  watchr (>= 0.6)
+  yard (>= 0.5.3)

data/LICENSE

@@ -0,0 +1,20 @@
+Copyright (c) 2011 Andrew Kalek, Anlek Consulting
+
+Permission is hereby granted, free of charge, to any person obtaining
+a copy of this software and associated documentation files (the
+"Software"), to deal in the Software without restriction, including
+without limitation the rights to use, copy, modify, merge, publish,
+distribute, sublicense, and/or sell copies of the Software, and to
+permit persons to whom the Software is furnished to do so, subject to
+the following conditions:
+
+The above copyright notice and this permission notice shall be
+included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
+EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
+NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
+LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
+OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
+WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

data/README.rdoc

@@ -0,0 +1,86 @@
+= Mongify
+
+A data translator from sql database to mongoDB.
+
+Learn more about mongoDB at: http://www.mongodb.org
+
+== Install
+
+=== WARNING: This gem is still in very very early alpha
+
+  gem install mongify
+
+== Usage
+
+=== WARNING: Mongify is still a work in progress, so much so, that the code below will currently _NOT_ work and is likely to significantly change!
+
+Build a config file such as:
+
+  sql_connection do
+    adaptor "mysql"
+    host "localhost"
+    database "my_database"
+  end
+
+  mongodb_connection do
+    host 'localhost'
+    database 'my_collection'
+  end
+
+Build a translation file such as:
+
+  table "accounts"
+
+  table "users" 
+
+  table "user_accounts", :embed_in => :users, :on => :user_id do |t|
+    t.column  "account_id", :references => :account
+  end
+
+Save the file as <tt>"my_database_translation.rb"</tt> and run the command:
+
+  mongify check -c datbase.config
+  mongify process database_translation.rb -c database.config
+  
+**this is subject to change at any time**
+  
+== Development
+=== Requirements
+You just need bundler 1.0
+  
+  gem install bundler
+  bundle install
+  copy over spec/support/database.example to spec/support/database.yml and fill in required info
+  rake test:mysql:setup
+
+=== Setup
+Before you can run the specs, you need to make sure to setup the spec/support/database.yml file with your database info
+(you can copy database.example within the same folder).
+
+== Special Thanks
+Just want to thank my wife (Alessia) who not only puts up with me working on my free time but sometimes helps out listening to my craziness or helping me name classes or functions.
+=== More Special Thanks
+I'd like to thank Mon_Ouie on the Ruby IRC channel for helping me figure out how to setup the internal configuration file reading.
+
+== License
+
+Copyright (c) 2011 Andrew Kalek, Anlek Consulting
+ 
+Permission is hereby granted, free of charge, to any person obtaining
+a copy of this software and associated documentation files (the
+"Software"), to deal in the Software without restriction, including
+without limitation the rights to use, copy, modify, merge, publish,
+distribute, sublicense, and/or sell copies of the Software, and to
+permit persons to whom the Software is furnished to do so, subject to
+the following conditions:
+ 
+The above copyright notice and this permission notice shall be
+included in all copies or substantial portions of the Software.
+ 
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
+EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
+NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
+LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
+OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
+WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

data/Rakefile

@@ -0,0 +1,73 @@
+require 'bundler'
+Bundler::GemHelper.install_tasks
+
+require 'cucumber/rake/task'
+require 'rspec/core/rake_task'
+
+
+task :cleanup_rcov_files do
+  rm_rf 'coverage.data'
+end
+
+desc 'clobber generated files'
+task :clobber do
+  rm_rf "pkg"
+  rm_rf "tmp"
+  rm "Gemfile.lock" if File.exist?("Gemfile.lock")
+end
+
+namespace :rcov do
+  Cucumber::Rake::Task.new(:cucumber) do |t|    
+    t.rcov = true
+    t.rcov_opts = %w{--exclude osx\/objc,gems\/,spec\/,features\/ --aggregate coverage.data}
+    t.rcov_opts << %[-o "coverage"]
+  end
+ 
+  RSpec::Core::RakeTask.new(:rspec) do |t|
+    t.rcov = true
+    t.rcov_opts = %w{--exclude osx\/objc,gems\/,spec\/,features\/}
+  end
+ 
+  desc "Run both specs and features to generate aggregated coverage"
+  task :all do |t|
+    rm "coverage.data" if File.exist?("coverage.data")
+    Rake::Task["rcov:cucumber"].invoke
+    Rake::Task["rcov:rspec"].invoke
+  end
+end
+
+namespace :test do
+  namespace :mysql do
+    desc "Setup a mysql database based on the spec/support/database.yml settings"
+    task :setup do
+      require 'spec/support/config_reader'
+      require 'active_record'
+      ::CONNECTION_CONFIG = ConfigReader.new('spec/support/database.yml')
+      ActiveRecord::Base.establish_connection(CONNECTION_CONFIG.mysql)
+      conn = ActiveRecord::Base.connection
+      conn.create_table(:users, :force => true) do |t|
+        t.string :first_name, :last_name
+        t.timestamps
+      end
+
+      conn.create_table(:posts, :force => true) do |t|
+        t.string :title
+        t.integer :owner_id
+        t.text :body
+        t.datetime :published_at
+        t.timestamps
+      end
+
+      conn.create_table(:comments, :force => true) do |t|
+        t.text :body
+        t.integer :post_id
+        t.integer :user_id
+        t.timestamps
+      end
+      puts "Finished"
+    end
+  end
+end
+
+
+task :default => ['rcov:all']

data/bin/mongify

@@ -0,0 +1,14 @@
+#!/usr/bin/env ruby
+#
+# Mongify converts a sql database to a no_sql_database (by default to mongodb)
+# Visit http://github.com/anlek/mongify for more information.
+#
+# Author: Andrew Kalek
+#
+
+$:.unshift  File.join(File.dirname(File.dirname(File.expand_path(__FILE__))), 'lib')
+require 'mongify/cli'
+
+Mongify.root = Dir.pwd
+
+exit Mongify::CLI::Application.new(ARGV).execute!

data/features/options.feature

@@ -0,0 +1,46 @@
+Feature: Mongify can be controlled using command-line options
+  In order to change Mongify's default behaviour
+  As a user
+  I want to supply options on the command line
+
+  Scenario: returns non-zero status on bad options
+    When I run mongify --no-such-option
+    Then the exit status indicates an error
+    And it reports the error "Error: invalid option: --no-such-option"
+    And stdout equals ""
+
+  Scenario: display the current version number
+    When I run mongify --version
+    Then it succeeds
+    And it reports the current version
+
+  Scenario: display the help information
+    When I run mongify --help
+    Then it succeeds
+    And it reports:
+      """
+      Usage: mongify command [database_translation.rb] [-c database.config]
+			
+			Commands:
+			"check" or "ck"           >> Checks connection for sql and no_sql databases [configuration_file]
+			"process" or "pr"         >> Takes a translation and process it to mongodb [configuration_file, translation_file]
+			"translate" or "tr"       >> Spits out translation from a sql connection [configuration_file]
+			
+      Examples:
+			
+			mongify translate -c datbase.config
+			mongify tr -c database.config
+		 	mongify check -c database.config
+		 	mongify process database_translation.rb -c database.config
+      
+      See http://github.com/anlek/mongify for more details
+
+      Common options:
+          -h, --help                       Show this message
+          -v, --version                    Show version
+          -c, --config FILE                Configuration File to use
+
+      Report formatting:
+          -q, --[no-]quiet                 Suppress extra output
+
+      """

data/features/print.feature

@@ -0,0 +1,10 @@
+Feature: Database Translation Output
+  In order to translate sql database to a no-sql database
+  As a developer / database admin
+  Needs to be able to generate a translation file
+  
+  Scenario: Translation Output request
+    Given a database exists
+    When I run mongify translate -c spec/files/base_configuration.rb
+    Then it succeeds
+    And it should print out the database schema

data/features/process.feature

@@ -0,0 +1,19 @@
+Feature: Processing a translation
+  In order for Mongify to be useful
+  As a user
+  I want to be able to process a translation and move my data to mongodb!
+
+	@wip
+	Scenario: Process
+	Given a database exists
+	And a blank mongodb
+  When I run mongify process spec/files/simple_translation.rb -c spec/files/base_configuration.rb
+  Then it succeeds
+	And there should be 3 users in mongodb
+	And there should be 3 posts in mongodb
+	And there should be 3 comments in mongodb
+	
+	
+	
+
+  

data/features/step_definitions/mongify_steps.rb

@@ -0,0 +1,42 @@
+When /^I run mongify (.*)$/ do |args|
+  mongify(args)
+end
+
+Then /^stdout equals "([^\"]*)"$/ do |report|
+  @last_stdout.should == report
+end
+
+Then /^it reports:$/ do |report|
+  @last_stdout.should == report
+end
+
+Then /^stderr reports:$/ do |report|
+  @last_stderr.should == report
+end
+
+Then /^it succeeds$/ do
+  puts @last_stderr if @last_stderr
+  @last_exit_status.should == Mongify::CLI::Application::STATUS_SUCCESS
+end
+
+Then /^it reports the current version$/ do
+  @last_stdout.should == "mongify #{Mongify::VERSION}\n"
+end
+
+Then /^the exit status indicates an error$/ do
+  @last_exit_status.should == Mongify::CLI::Application::STATUS_ERROR
+end
+
+Then /^it reports the error ['"](.*)['"]$/ do |string|
+  @last_stderr.chomp.should == string
+end
+
+
+
+Given /^a database exists$/ do
+  GenerateDatabase.sqlite
+end
+
+Then /^it should print out the database schema$/ do
+  @last_stdout.should == DATABASE_PRINT
+end

data/features/step_definitions/mongo_steps.rb

@@ -0,0 +1,7 @@
+Given /^a blank mongodb$/ do
+  GenerateDatabase.clear_mongodb
+end
+
+Then /^there should be (\d+) (.*) in mongodb$/ do |count, collection|
+  GenerateDatabase.mongo_connection.db[collection].count.should == count.to_i
+end