vertica 0.11.0 → 0.11.1

checksums.yaml

@@ -0,0 +1,15 @@
+---
+!binary "U0hBMQ==":
+  metadata.gz: !binary |-
+    NTFhOTJlZWQ4NjE2NTNjMzk5YzQ5YzgxNzRmZTZkYjg0Mjg2NzBkZg==
+  data.tar.gz: !binary |-
+    YzdlZWQ5ZDYxNzU5YTVmYzUzM2EzZWM3OWUxYWMxOGY5ZDBiNjBhYw==
+SHA512:
+  metadata.gz: !binary |-
+    MDdlZTgzMGU3NDExZTQ5ZTgxYmJjMmViMDYzODM4ZjI0YWZjODQ0MzYwZDJl
+    YmQ3NTBjNGQ5MDQxY2FmZjA0MTQxZTU0NDBkZjI2YjQwYmQzMjZmOThhMTAz
+    MzYwM2FiYTRmNWY3NjdiMDhmZTVjYWJiM2ZjYTVmNTU0ZjhhYzg=
+  data.tar.gz: !binary |-
+    ODQ4NzNlZWVhMDAwODNiNmNlNzdiY2I5ZjBiNGM5ODM2MmYxMjM2Yjg4ZDM2
+    NmNmMzBlYTI4MDRlM2Q0NzU2MzQ0ZThlMTZmMjNmZWJiMjk5NTMxNDljZmI0
+    YTNhZjU3YmYzNTJkNjlhNzQwNjUyNGQzZTUyY2YyMWZlYjkxNzY=

data/.gitignore

@@ -0,0 +1,7 @@
+pkg
+.DS_Store
+Gemfile.lock
+test/connection.yml
+*.rbc
+.yardoc/
+doc/

data/.infinity_test

@@ -0,0 +1,8 @@
+infinity_test do
+  
+  use :rubies => %w(1.8.6 1.8.7 1.9.2 ree)
+  
+  before(:each_ruby) do |environment|
+    environment.system('bundle install')
+  end
+end

data/Gemfile

@@ -1,4 +1,2 @@
-source :rubygems
-
-gem 'rake'
-gem 'jeweler'
+source 'https://rubygems.org'
+gemspec

data/README.md

@@ -3,27 +3,34 @@
 Vertica is a pure Ruby library for connecting to Vertica databases. You can learn more
 about Vertica at http://www.vertica.com.
 
-This library currently supports connecting, executing SQL queries, and transferring data
-for a "COPY table FROM STDIN" statement. The gem is tested against Vertica version 4.1, 
-5.0, 5.1, and 6.1, and Ruby version 1.8 and 1.9.
+- Connecting, including over SSL
+- Executing queries, with results as streaming rows or buffered resultsets.
+- "COPY table FROM STDIN" statement to load data. 
+- Tested against Ruby 1.9 and 2.0, and Vertica version 6.0 and 6.1.
+- The library is thread-safe as of version 0.11. However, you can only run one 
+  statement at the time per connection, because the protocol is stateful.
 
-# Install
+
+## Installation
 
     $ gem install vertica
 
-# Source
+Or add it to your Gemfile:
 
-Vertica's git repo is available on GitHub, which can be browsed at:
+    gem 'vertica'
+    # gem 'vertica', git: 'git://github.com/sprsquish/vertica.git' # HEAD version
 
-    http://github.com/sprsquish/vertica
+### Compatiblity
 
-and cloned from:
+- Ruby 1.8 is no longer supported, but version 0.9.x should still support it.
+- Vertica versions 4.1, 5.0, and 5.1 worked with at some point with this gem, but
+  compatibility is no longer tested. It probably still works as the protocol hasn't 
+  changed.
 
-    git://github.com/sprsquish/vertica.git
 
-# Usage
+## Usage
 
-## Connecting
+### Connecting
 
 The <code>Vertica.connect</code> methods takes a connection parameter hash and returns a 
 connection object. For most options, the gem will use a default value if no value is provided.
@@ -42,28 +49,22 @@ connection object. For most options, the gem will use a default value if no valu
     
 To close the connection when you're done with it, run <code>connection.close</code>.
 
-## Querying
+### Querying with unbuffered result as streaming rows
 
 You can run simple queries using the <code>query</code> method, either in buffered and 
 unbuffered mode. For large result sets, you probably do not want to use buffered results.
 
-### Unbuffered result
-
 Get all the result rows without buffering by providing a block:
 
     connection.query("SELECT id, name FROM my_table") do |row|
       puts row # => {:id => 123, :name => "Jim Bob"}
     end
-    
-    connection.close
 
 Note: you can only use the connection for one query at the time. If you try to run another 
 query when the connection is still busy delivering the results of a previous query, a
 `Vertica::Error::SynchronizeError` will be raised. Use buffered resultsets to prevent this
 problem.
 
-### Buffered result
-
 Store the result of the query method as a variable to get a buffered resultset:
 
     result = connection.query("SELECT id, name FROM my_table")
@@ -88,11 +89,29 @@ be returned as arrays by providing a row_style:
 By adding <code>:row_style => :array</code> to the connection hash, all results will be 
 returned as array.
 
-# About
+### Loading data using COPY
+
+Using the COPY statement, you can load arbitrary data from your ruby script.
+
+    connection.copy("COPY table FROM STDIN ...") do |stdin|
+      File.open('data.tsv', 'r') do |f|
+        begin 
+          stdin << f.gets
+        end until f.eof?
+      end
+    end
+
+You can also provide a filename or an IO object:
+
+    connection.copy("COPY table FROM STDIN ...", "data.csv")
+    connection.copy("COPY table FROM STDIN ...", io)
+
+
+## About
 
 This package is MIT licensed. See the LICENSE file for more information.
 
-## Development
+### Development
 
 This project comes with a test suite. The unit tests in <tt>/test/unit</tt> do not need a database
 connection to run, the functional tests in <tt>/test/functional</tt> do need a working
@@ -108,9 +127,16 @@ prefixed with <tt>test_ruby_vertica_</tt>.
 
  * Asynchronous / EventMachine version
 
-## Authors
+### Authors
+
+ * [Matt Bauer](https://github.com/mattbauer) all the hard work
+ * [Jeff Smick](https://github.com/sprsquish) current maintainer
+ * [Willem van Bergen](https://github.com/wvanbergen) contributor
+ * [Camilo Lopez](https://github.com/camilo) contributor
+ * [Erik Selin](https://github.com/tyro89) contributor
+
+### See also
 
- * [Matt Bauer](http://github.com/mattbauer) all the hard work
- * [Jeff Smick](http://github.com/sprsquish) current maintainer
- * [Willem van Bergen](http://github.com/wvanbergen) contributor
- * [Camilo Lopez](http://github.com/camilo) contributor
+* [Documentation](http://www.rubydoc.info/gems/vertica/frames) API documentation.
+* [sequel-vertica](https://github.com/camilo/sequel-vertica) Sequel integration.
+* [newrelic-vertica](https://github.com/wvanbergen/newrelic-vertica) NewRelic monitoring of queries.

data/Rakefile

@@ -1,47 +1,15 @@
-require 'rubygems'
-require 'rake'
+require "bundler/gem_tasks"
+require "rake/testtask"
+require "yard"
 
-begin
-  require 'jeweler'
-  Jeweler::Tasks.new do |gem|
-    gem.name = 'vertica'
-    gem.summary = 'Pure ruby library for interacting with Vertica'
-    gem.description = 'Query Vertica with ruby'
-
-    gem.email = 'sprsquish@gmail.com'
-    gem.homepage = 'http://github.com/sprsquish/vertica'
-    gem.authors = ['Jeff Smick', 'Matt Bauer', 'Willem van Bergen']
-
-    gem.files = FileList["[A-Z]*", 'lib/**/*.rb'].to_a
-
-    gem.test_files = FileList['test/**/*.rb']
-    
-    # gem is a Gem::Specification... see http://www.rubygems.org/read/chapter/20 for additional settings
-  end
-
-  Jeweler::GemcutterTasks.new
-rescue LoadError
-  puts "Jeweler (or a dependency) not available. Install it with: sudo gem install jeweler"
-end
-
-require 'rake/testtask'
 Rake::TestTask.new(:test) do |test|
   test.libs << 'test' << 'lib'
   test.pattern = 'test/**/*_test.rb'
   test.verbose = true
 end
 
-begin
-  require 'yard'
-  YARD::Rake::YardocTask.new do |t|
-    t.options = ['--no-private', '-m', 'markdown', '-o', './doc']
-  end
-rescue LoadError
-  task :yardoc do
-    abort "YARD is not available. In order to run yardoc, you must: sudo gem install yard"
-  end
+YARD::Rake::YardocTask.new(:doc) do |t|
+  t.options = ['--no-private', '-m', 'markdown', '-o', './doc']
 end
 
-desc 'Generate documentation'
-task :doc => :yard
 task :default => :test

data/lib/vertica.rb

@@ -7,9 +7,6 @@ require 'bigdecimal'
 # prevent SQL injection.
 module Vertica
   
-  # The version number of this library.
-  VERSION = File.read(File.join(File.dirname(__FILE__), *%w[.. VERSION])).strip
-
   # The protocol version (3.0.0) implemented in this library.
   PROTOCOL_VERSION = 3 << 16
 
@@ -51,5 +48,6 @@ module Vertica
   end
 end
 
+require 'vertica/version'
 require 'vertica/error'
 require 'vertica/connection'

data/lib/vertica/column.rb

@@ -6,7 +6,7 @@ module Vertica
     attr_reader :size
     attr_reader :data_type
 
-    STRING_CONVERTER = String.new.respond_to?(:force_encoding) ? lambda { |s| s.force_encoding('utf-8') } : nil
+    STRING_CONVERTER = lambda { |s| s.force_encoding('utf-8') }
 
     DATA_TYPE_CONVERSIONS = [
       [:unspecified,  nil],

data/lib/vertica/connection.rb

@@ -70,7 +70,6 @@ class Vertica::Connection
   end
 
   def write_message(message)
-    raise ArgumentError, "invalid message: (#{message.inspect})" unless message.respond_to?(:to_bytes)
     puts "=> #{message.inspect}" if @debug
     write_bytes message.to_bytes
   rescue SystemCallError, IOError => e
@@ -180,7 +179,12 @@ class Vertica::Connection
   def run_with_mutex(job)
     boot_connection if closed?
     if @mutex.try_lock
-      job.run
+      begin
+        job.run
+      rescue StandardError
+        @mutex.unlock if @mutex.locked?
+        raise
+      end
     else
       raise Vertica::Error::SynchronizeError.new(job)
     end

data/lib/vertica/error.rb

@@ -44,6 +44,7 @@ class Vertica::Error < StandardError
     '42V01' => (MissingRelation       = Class.new(Vertica::Error::QueryError)),
     '42703' => (MissingColumn         = Class.new(Vertica::Error::QueryError)),
     '22V04' => (CopyRejected          = Class.new(Vertica::Error::QueryError)),
+    '08000' => (CopyFromStdinFailed   = Class.new(Vertica::Error::QueryError)),
     '42501' => (PermissionDenied      = Class.new(Vertica::Error::QueryError))
   }
 end

data/lib/vertica/messages/message.rb

@@ -8,8 +8,7 @@ module Vertica
 
       def message_string(msg)
         msg = msg.join if msg.is_a?(Array)
-        bytesize = msg.respond_to?(:bytesize) ? 4 + msg.bytesize : 4 + msg.size
-        message_size = [bytesize].pack('N')
+        message_size = [4 + msg.bytesize].pack('N')
         message_id ? "#{message_id}#{message_size}#{msg}" : "#{message_size}#{msg}"
       end
     end

data/lib/vertica/query.rb

@@ -69,7 +69,6 @@ class Vertica::Query
         end
       rescue => e
         @connection.write_message Vertica::Messages::CopyFail.new(e.message)
-        raise
       end
     end
   end

data/lib/vertica/version.rb

@@ -0,0 +1,3 @@
+module Vertica
+  VERSION = "0.11.1"
+end

data/test/connection.yml.example

@@ -0,0 +1,8 @@
+user: 
+password: 
+host: 
+port: 5433
+database: 
+# ssl: true
+# search_path:
+# role:

data/test/functional/connection_test.rb

@@ -1,6 +1,6 @@
 require 'test_helper'
 
-class ConnectionTest < Test::Unit::TestCase
+class ConnectionTest < Minitest::Test
   
   def teardown
     @connection.close if @connection
@@ -57,8 +57,8 @@ class ConnectionTest < Test::Unit::TestCase
     connection.reset_connection
 
     assert_valid_open_connection(connection)
-    assert_not_equal original_backend_pid, connection.backend_pid
-    assert_not_equal original_backend_key, connection.backend_key
+    assert original_backend_pid != connection.backend_pid
+    assert original_backend_key != connection.backend_key
     assert_equal :no_transaction, connection.transaction_status
   end
   
@@ -76,7 +76,7 @@ class ConnectionTest < Test::Unit::TestCase
   def test_connection_inspect_should_not_print_password
     connection = Vertica::Connection.new(TEST_CONNECTION_HASH)
     inspected_string = connection.inspect
-    assert_no_match /:password=>#{TEST_CONNECTION_HASH[:password]}/, inspected_string
+    assert inspected_string !~ /:password=>#{TEST_CONNECTION_HASH[:password]}/
   end
 
   def test_connection_timed_out_error

data/test/functional/query_test.rb

@@ -1,7 +1,8 @@
 require 'test_helper'
 require 'zlib'
+class TestError < StandardError; end
 
-class QueryTest < Test::Unit::TestCase
+class QueryTest < Minitest::Test
   
   def setup
     @connection = Vertica::Connection.new(TEST_CONNECTION_HASH)
@@ -161,6 +162,35 @@ class QueryTest < Test::Unit::TestCase
     assert_equal [[1, "matt"], [11, "Stuff"], [12, "More stuff"], [13, "Final stuff"]], result.rows
   end  
   
+  def test_copy_with_ruby_exception
+    2.times do
+      begin
+        @connection.copy "COPY test_ruby_vertica_table FROM STDIN" do |data|
+          data.write "11|#{"a" * 10}\n"
+          raise TestError
+        end
+      rescue Vertica::Error::CopyFromStdinFailed
+      end
+
+      result = @connection.query("SELECT id FROM test_ruby_vertica_table ORDER BY id", :row_style => :array)
+      assert_equal 1, result.length
+    end
+  end
+ 
+  def test_copy_with_backend_exception
+    2.times do
+      begin
+        @connection.copy "COPY test_ruby_vertica_table FROM STDIN ABORT ON ERROR" do |data|
+          data.write "11|#{"a" * 10}|11\n" # write invalid data
+        end
+      rescue Vertica::Error::CopyRejected
+      end
+
+      result = @connection.query("SELECT id FROM test_ruby_vertica_table ORDER BY id", :row_style => :array)
+      assert_equal 1, result.length
+    end
+  end
+
   def test_copy_in_with_file
     filename = File.expand_path('../../resources/test_ruby_vertica_table.csv', __FILE__)
     @connection.copy "COPY test_ruby_vertica_table FROM STDIN", filename
@@ -211,7 +241,7 @@ class QueryTest < Test::Unit::TestCase
   end
   
   def test_raise_when_connection_is_in_use
-    assert_raise(Vertica::Error::SynchronizeError) do
+    assert_raises(Vertica::Error::SynchronizeError) do
       @connection.query("SELECT 1 UNION SELECT 2") do |record|
         @connection.query("SELECT 3")
       end

data/test/functional/value_conversion_test.rb

@@ -1,7 +1,7 @@
 # encoding : UTF-8
 require 'test_helper'
 
-class ValueConversionTest < Test::Unit::TestCase
+class ValueConversionTest < Minitest::Test
   
   def setup
     @connection = Vertica::Connection.new(TEST_CONNECTION_HASH.merge(:row_style => :array))

data/test/resources/test_ruby_vertica_table.csv

@@ -0,0 +1,3 @@
+11|Stuff
+12|More stuff
+13|Final stuff

data/test/test_helper.rb

@@ -2,7 +2,8 @@ require 'rubygems'
 require 'bundler/setup'
 
 require 'yaml'
-require 'test/unit'
+require 'minitest/autorun'
+require 'minitest/pride'
 
 require 'vertica'
 

data/test/unit/backend_message_test.rb

@@ -1,6 +1,6 @@
 require 'test_helper'
 
-class BackendMessageTest < Test::Unit::TestCase
+class BackendMessageTest < Minitest::Test
   
   def test_cleartext_authentication_message
     msg = Vertica::Messages::Authentication.new("\x00\x00\x00\x03")

data/test/unit/frontend_message_test.rb

@@ -1,6 +1,6 @@
 require 'test_helper'
 
-class FrontendMessageTest < Test::Unit::TestCase
+class FrontendMessageTest < Minitest::Test
 
   def test_copy_done_message
     message = Vertica::Messages::CopyDone.new

data/test/unit/quoting_test.rb

@@ -1,6 +1,6 @@
 require 'test_helper'
 
-class QuotingTest < Test::Unit::TestCase
+class QuotingTest < Minitest::Test
 
   def test_quote_identifier
     assert_equal '"test"', Vertica.quote_identifier(:test)

data/vertica.gemspec

@@ -0,0 +1,27 @@
+# -*- encoding: utf-8 -*-
+
+lib = File.expand_path('../lib', __FILE__)
+$LOAD_PATH.unshift(lib) unless $LOAD_PATH.include?(lib)
+require 'vertica/version'
+
+Gem::Specification.new do |s|
+  s.name        = "vertica"
+  s.summary     = "Pure Ruby library for interacting with Vertica"
+  s.description = "Query Vertica with ruby"
+  s.homepage    = "https://github.com/sprsquish/vertica"
+  s.license     = "MIT"
+  s.version     = Vertica::VERSION
+
+  s.authors = ["Jeff Smick", "Matt Bauer", "Willem van Bergen"]
+  s.email   = ["sprsquish@gmail.com", "matt@ciderapps.com", "willem@railsdoctors.com"]
+
+  s.extra_rdoc_files = ["README.md"]
+  s.require_paths = ["lib"]
+
+  s.files = `git ls-files`.split($/)
+  s.test_files = s.files.grep(%r{^(test|spec|features)/})
+
+  s.add_development_dependency 'rake'
+  s.add_development_dependency 'yard'
+  s.add_development_dependency 'minitest', '~> 5'
+end

metadata

@@ -1,8 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: vertica
 version: !ruby/object:Gem::Version
-  version: 0.11.0
-  prerelease: 
+  version: 0.11.1
 platform: ruby
 authors:
 - Jeff Smick
@@ -11,54 +10,66 @@ authors:
 autorequire: 
 bindir: bin
 cert_chain: []
-date: 2013-08-28 00:00:00.000000000 Z
+date: 2013-10-31 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: rake
   requirement: !ruby/object:Gem::Requirement
-    none: false
     requirements:
     - - ! '>='
       - !ruby/object:Gem::Version
         version: '0'
-  type: :runtime
+  type: :development
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
-    none: false
     requirements:
     - - ! '>='
       - !ruby/object:Gem::Version
         version: '0'
 - !ruby/object:Gem::Dependency
-  name: jeweler
+  name: yard
   requirement: !ruby/object:Gem::Requirement
-    none: false
     requirements:
     - - ! '>='
       - !ruby/object:Gem::Version
         version: '0'
-  type: :runtime
+  type: :development
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
-    none: false
     requirements:
     - - ! '>='
       - !ruby/object:Gem::Version
         version: '0'
+- !ruby/object:Gem::Dependency
+  name: minitest
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: '5'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: '5'
 description: Query Vertica with ruby
-email: sprsquish@gmail.com
+email:
+- sprsquish@gmail.com
+- matt@ciderapps.com
+- willem@railsdoctors.com
 executables: []
 extensions: []
 extra_rdoc_files:
-- LICENSE
 - README.md
 files:
+- .gitignore
+- .infinity_test
 - Gemfile
-- Gemfile.lock
 - LICENSE
 - README.md
 - Rakefile
-- VERSION
 - lib/vertica.rb
 - lib/vertica/column.rb
 - lib/vertica/connection.rb
@@ -100,42 +111,49 @@ files:
 - lib/vertica/messages/message.rb
 - lib/vertica/query.rb
 - lib/vertica/result.rb
+- lib/vertica/version.rb
+- test/connection.yml.example
 - test/functional/connection_test.rb
 - test/functional/query_test.rb
 - test/functional/value_conversion_test.rb
+- test/resources/test_ruby_vertica_table.csv
 - test/test_helper.rb
 - test/unit/backend_message_test.rb
 - test/unit/frontend_message_test.rb
 - test/unit/quoting_test.rb
-homepage: http://github.com/sprsquish/vertica
-licenses: []
+- vertica.gemspec
+homepage: https://github.com/sprsquish/vertica
+licenses:
+- MIT
+metadata: {}
 post_install_message: 
 rdoc_options: []
 require_paths:
 - lib
 required_ruby_version: !ruby/object:Gem::Requirement
-  none: false
   requirements:
   - - ! '>='
     - !ruby/object:Gem::Version
       version: '0'
 required_rubygems_version: !ruby/object:Gem::Requirement
-  none: false
   requirements:
   - - ! '>='
     - !ruby/object:Gem::Version
       version: '0'
 requirements: []
 rubyforge_project: 
-rubygems_version: 1.8.23
+rubygems_version: 2.1.4
 signing_key: 
-specification_version: 3
-summary: Pure ruby library for interacting with Vertica
+specification_version: 4
+summary: Pure Ruby library for interacting with Vertica
 test_files:
+- test/connection.yml.example
 - test/functional/connection_test.rb
 - test/functional/query_test.rb
 - test/functional/value_conversion_test.rb
+- test/resources/test_ruby_vertica_table.csv
 - test/test_helper.rb
 - test/unit/backend_message_test.rb
 - test/unit/frontend_message_test.rb
 - test/unit/quoting_test.rb
+has_rdoc: 

data/Gemfile.lock

@@ -1,20 +0,0 @@
-GEM
-  remote: http://rubygems.org/
-  specs:
-    git (1.2.5)
-    jeweler (1.8.4)
-      bundler (~> 1.0)
-      git (>= 1.2.5)
-      rake
-      rdoc
-    json (1.7.7)
-    rake (10.0.4)
-    rdoc (3.12.2)
-      json (~> 1.4)
-
-PLATFORMS
-  ruby
-
-DEPENDENCIES
-  jeweler
-  rake

data/VERSION

@@ -1 +0,0 @@
-0.11.0