kiba 0.6.1 → 1.0.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA1:
-  metadata.gz: b46106e516df027f47b160c8a015ef86379c3994
-  data.tar.gz: da5ecf0dd661b1dc4960bf4bfc149df9be4c3a89
+  metadata.gz: 622b10fe7f524f66152c10ab8618d6a661831776
+  data.tar.gz: 7410d79e2dec5bb48e9f1079e94c87260226d66c
 SHA512:
-  metadata.gz: 04d98ac5c1b9d2bed003930cbf1f70230b9639758b09562f0e4cdb69a5fb566bb2fcae7f392617f3dae44d929d405eb915db0982ba7a5388c505ce1295c91f40
-  data.tar.gz: a561008267ef7b2b436095187592aaa811aaec788453d7f6edfb129950a9e9e058862ea22b812dd7caecffc10a257cbf4c069f6f7e524ef74541257ff637bb9b
+  metadata.gz: 5fe1c537d31ccc49446316f40c76630f724774431a3914019b870ce4cbdc3d34ed7eda4b66b622855d7d6972f435a0b8f831567f9b53b159e2836257b766671c
+  data.tar.gz: 60c2e8929bdd350308c5f377b0a6c989c3473f147903a90dab7ab9b4b58f6ec06cdc038094c5bca2ebd593defe2f0e7994752bdef325bd4ccbd7e04ef27f86a9

data/.travis.yml

@@ -1,7 +1,10 @@
 language: ruby
+before_install:
+  - gem update bundler
 rvm:
+  - 2.3.0 # 2.3 won't work here (RVM issue afaik)
   - 2.2
   - 2.1
   - 2.0
-  - jruby
-  - rbx-2.5.7
+  - jruby-1.7
+  - jruby-9

data/Changes.md

@@ -1,5 +1,8 @@
-Unreleased
-----------
+1.0.0
+-----
+
+- `close` becomes optional in destinations.
+- Bumping to 1.0.0 since Kiba is in wide production use.
 
 0.6.1
 -----

data/README.md

@@ -1,13 +1,22 @@
+**Foreword - if you need help**: please [ask your question with tag kiba-etl on StackOverflow](http://stackoverflow.com/questions/ask?tags=kiba-etl) so that other can benefit from your contribution! I monitor this specific tag and will reply to you.
+
 Writing reliable, concise, well-tested & maintainable data-processing code is tricky.
 
 Kiba lets you define and run such high-quality ETL ([Extract-Transform-Load](http://en.wikipedia.org/wiki/Extract,_transform,_load)) jobs, using Ruby (see [supported versions](#supported-ruby-versions)).
 
-Learn more on the [Kiba blog](http://thibautbarrere.com):
+Learn more on the [Kiba blog](http://thibautbarrere.com) and on [StackOverflow](http://stackoverflow.com/questions/tagged/kiba-etl):
 
+* [Live Coding Session - Processing data with Kiba ETL](http://thibautbarrere.com/2015/11/09/video-processing-data-with-kiba-etl/)
 * [Rubyists - are you doing ETL unknowningly?](http://thibautbarrere.com/2015/03/25/rubyists-are-you-doing-etl-unknowingly/)
 * [How to write solid data processing code](http://thibautbarrere.com/2015/04/05/how-to-write-solid-data-processing-code/)
 * [How to reformat CSV files with Kiba](http://thibautbarrere.com/2015/06/04/how-to-reformat-csv-files-with-kiba/) (in-depth, hands-on tutorial)
 * [How to explode multivalued attributes with Kiba ETL?](http://thibautbarrere.com/2015/06/25/how-to-explode-multivalued-attributes-with-kiba/)
+* [Common techniques to compute aggregates with Kiba](https://stackoverflow.com/questions/31145715/how-to-do-a-aggregation-transformation-in-a-kiba-etl-script-kiba-gem)
+* [How to run Kiba in a Rails environment?](http://thibautbarrere.com/2015/09/26/how-to-run-kiba-in-a-rails-environment/)
+
+**Consulting services**: if your organization needs to leverage data processing to solve a given business problem, I'm available to help you out via consulting sessions. [More information](http://thibautbarrere.com/hire-me/).
+
+**Kiba Pro**: I'm working on a Pro version ([read more here](https://github.com/thbar/kiba/issues/20)) which will provide more advanced features and built-in goodies in exchange for a yearly subscription. This will also make sure I can support Kiba for the many years to come. [Chime in](https://github.com/thbar/kiba/issues/20) if your company is interested!
 
 [![Gem Version](https://badge.fury.io/rb/kiba.svg)](http://badge.fury.io/rb/kiba)
 [![Build Status](https://travis-ci.org/thbar/kiba.svg?branch=master)](https://travis-ci.org/thbar/kiba) [![Code Climate](https://codeclimate.com/github/thbar/kiba/badges/gpa.svg)](https://codeclimate.com/github/thbar/kiba) [![Dependency Status](https://gemnasium.com/thbar/kiba.svg)](https://gemnasium.com/thbar/kiba)
@@ -175,7 +184,7 @@ Like the block form, it can return `nil` to dismiss the row. The class form allo
 Like sources, destinations are classes that you are providing. Destinations must implement:
 - a constructor (to which Kiba will pass the provided arguments in the DSL)
 - a `write(row)` method that will be called for each non-dismissed row
-- a `close` method that will be called at the end of the processing
+- an optional `close` method that will be called, if present, at the end of the processing (useful to tear down resources such as connections)
 
 Here is an example destination:
 
@@ -256,7 +265,7 @@ Make sure to subscribe to my [Ruby ETL blog](http://thibautbarrere.com) where I'
 
 ## Supported Ruby versions
 
-Kiba currently supports Ruby 2.0+, JRuby (with its default 1.9 syntax) and Rubinius (see [test matrix](https://travis-ci.org/thbar/kiba)).
+Kiba currently supports Ruby 2.0+ and JRuby (with its default 1.9 syntax). See [test matrix](https://travis-ci.org/thbar/kiba).
 
 ## History & Credits
 

data/appveyor.yml

@@ -0,0 +1,18 @@
+version: '{build}'
+
+skip_tags: true
+
+environment:
+  matrix:
+    - ruby_version: "21"
+    - ruby_version: "21-x64"
+
+install:
+  - SET PATH=C:\Ruby%ruby_version%\bin;%PATH%
+  - gem install bundler --no-document -v 1.10.5
+  - bundle install --retry=3
+
+test_script:
+  - bundle exec rake
+
+build: off

data/lib/kiba/runner.rb

@@ -41,7 +41,7 @@ module Kiba
           end
         end
       end
-      destinations.each(&:close)
+      destinations.find_all { |d| d.respond_to?(:close) }.each(&:close)
     end
 
     # not using keyword args because JRuby defaults to 1.9 syntax currently

data/lib/kiba/version.rb

@@ -1,3 +1,3 @@
 module Kiba
-  VERSION = '0.6.1'
+  VERSION = '1.0.0'
 end

data/test/test_runner.rb

@@ -72,4 +72,16 @@ class TestRunner < Kiba::Test
 
     assert_equal [:pre_processor_executed, :source_instantiated], calls
   end
+  
+  def test_no_error_raised_if_destination_close_not_implemented
+    # NOTE: this fake destination does not implement `close`
+    destination_instance = MiniTest::Mock.new
+
+    mock_destination_class = MiniTest::Mock.new
+    mock_destination_class.expect(:new, destination_instance)
+    
+    control = Kiba::Control.new
+    control.destinations << { klass: mock_destination_class }
+    Kiba.run(control)
+  end
 end

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: kiba
 version: !ruby/object:Gem::Version
-  version: 0.6.1
+  version: 1.0.0
 platform: ruby
 authors:
 - Thibaut Barrère
 autorequire: 
 bindir: bin
 cert_chain: []
-date: 2015-06-28 00:00:00.000000000 Z
+date: 2016-12-01 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: rake
@@ -66,6 +66,7 @@ files:
 - Gemfile
 - README.md
 - Rakefile
+- appveyor.yml
 - bin/kiba
 - kiba.gemspec
 - lib/kiba.rb
@@ -108,7 +109,7 @@ required_rubygems_version: !ruby/object:Gem::Requirement
       version: '0'
 requirements: []
 rubyforge_project: 
-rubygems_version: 2.4.3
+rubygems_version: 2.4.8
 signing_key: 
 specification_version: 4
 summary: Lightweight ETL for Ruby