stockboy 1.0.0 → 1.0.1

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA1:
-  metadata.gz: 887af38181777e9ac5c5bd9dc2d72c964be88e19
-  data.tar.gz: 9db5d875d0d77a3baa99ba7d2589f3257daf2e65
+  metadata.gz: db81b34ead77c1f6fffbb45024f491c55629fcbc
+  data.tar.gz: a9550b87a91852566538b53b093a15b4e947848a
 SHA512:
-  metadata.gz: be4fcd3c97be1a1ca55942d486c1cc6c13c328f06bed609347b907e135fe7bcb53790e4e88b4867b96c281d2ad6dcd8ab3668a62de6865528b7271a8c25a58ae
-  data.tar.gz: 248d7903b7de6fa4debd7a0b0f6d8d1dab83761e1efafda1d0a928c6cba20a2ce2c905298bcc3194ed72d9125c200e658ae29c6442777cc2b7ded71a3f939e84
+  metadata.gz: ff71d14c0227d969fca699b2a40439855600d4176174073ba4d2679b790d77694ae740489622a791989fb04e92215c0bb49e21ba5c524a156f780d6b234cbe8c
+  data.tar.gz: a8a4c0b192d096253b5e68ae1ac3e58dc69a66dc2dbad3f44cfacffb9d886f5d2a2899ff252ec3dbe8e12ddd338f8da76938819a701d88df5f28ad5b968ccbd9

data/.travis.yml

@@ -4,7 +4,9 @@ env:
   - CI=true
 rvm:
   - "1.9.3"
-  - "2.1.1"
+  - "2.0.0"
+  - "2.1"
+  - "2.2"
   - "rbx"
   - "jruby-head"
 before_install:
@@ -13,6 +15,8 @@ script: bundle exec rspec spec
 matrix:
   fast_finish: true
   allow_failures:
+    - rvm: "1.9.3"
+    - rvm: "2.0.0"
     - rvm: "rbx"
     - rvm: "jruby-head"
 addons:

data/CHANGELOG.md

@@ -1,5 +1,10 @@
 # Changelog
 
+## 1.0.1 / 2015-12-16
+
+* [ENHANCEMENT] Add `:json` as a standard registered reader
+* [ENHANCEMENT] Allow `ignore: true` to always remove virtual attributes
+
 ## 1.0.0 / 2015-06-30
 
 We've been running this happily in production for many months. I think it's
@@ -8,19 +13,19 @@ about time to give it a version number to reflect that.
 ## 0.11.1 / 2015-04-13
 
 * [BUGFIX]      Option to set POST body works correctly
- 
+
 ## 0.11.0 / 2015-04-13
 
 * [FEATURE]     Options to set POST body and headers
- 
+
 ## 0.10.0 / 2015-01-23
 
 * [FEATURE]     Option to ignore unwanted attributes from output
- 
+
 ## 0.9.0 / 2014-05-19
 
-* [FEATURE]     Add JSON reader 
- 
+* [FEATURE]     Add JSON reader
+
 ## 0.8.1 / 2014-04-24
 
 * [BUGFIX]      Support `data_size` for non-string providers
@@ -107,4 +112,3 @@ about time to give it a version number to reflect that.
 ## 0.4.1 / 2013-11-19
 
 First post!
-

data/README.md

@@ -8,7 +8,7 @@
 Stockboy helps you receive and unpack data onto your shelves. It provides a DSL
 for configuring data processing pipelines. You might consider using it to
 synchronize data exported from external sources, as part of an [ETL][etl]
-workflow, or migrating your own data from legacy systems. 
+workflow, or migrating your own data from legacy systems.
 
 Full documentation available at [rdoc.info/gems/stockboy][rdoc]
 
@@ -21,14 +21,14 @@ ways. Each data source might vary orthogonally on:
 * __Where the data resides:__
   whether a SOAP service, sent to an IMAP mailbox, an FTP server, or simply a
   local file.
-* __How the data is formatted:__ 
+* __How the data is formatted:__
   whether CSV, Excel, XML, JSON, or some other obscure format.
-* __How the records are structured:__ 
+* __How the records are structured:__
   what fields are included, and how they are named.
-* __What format the fields are:__ 
+* __What format the fields are:__
   such as different date formats (DMY vs. MDY), whether names are "first,
   last", or what do do with missing values.
-* __Which records to process:__ 
+* __Which records to process:__
   selecting whether records are incomplete, or valid and needing to be added,
   updated or deleted.
 
@@ -117,7 +117,7 @@ Writing a job template requires you to declare three parts:
     filter(:invalid_email) do |input, _|
       not(input.email.include?('@') or input['EmailAddress'] == '')
     end
-    
+
     filter(:missing_code) do |_, output|
       output.product_code.nil?
     end
@@ -145,7 +145,7 @@ data set.
       loop do
         inputs << http_provider
         break if http_provider.data.split("\n").size < 100
-        http_provider.query["page"] += 1 
+        http_provider.query["page"] += 1
       end
     end
 
@@ -215,13 +215,15 @@ If a field needs to be omitted when exporting to hash (to avoid downstream
 clients clobbering existing values with nil), specify the option with a
 callable object or a symbol that can be called against the output field value:
 
+    title ignore: true
     email ignore: ->(r) { not r.email.include?("@") }
     score ignore: :zero?
 
+
 The callable object receives the whole record context like when translating
 with the "as" option.
 
-#### Built-in attribute translators: 
+#### Built-in attribute translators:
 
 * [`:boolean`][bool]
   Common true/false strings to `True` or `False` (e.g. '1'/'0' or 't'/'f')
@@ -231,7 +233,7 @@ with the "as" option.
   Date strings from UK format to `Date` (e.g. "DD/MM/YY")
 * [`:us_date`][usda]
   Date strings from US format to `Date` (e.g. "MM/DD/YY")
-* [`:decimal`][deci] 
+* [`:decimal`][deci]
   Numeric strings to `BigDecimal` (e.g. prices)
 * [`:integer`][intg]
   Numeric strings to `Fixnum` integers
@@ -265,7 +267,7 @@ individually as `attribute :name`.
 Filters are optional, but they are very helpful for funneling the data into
 your workflow. For example, you may need to partition records for different
 handling based on a status field.
-    
+
 Filters are applied in the order that they are declared. The first filter that
 returns `true` when traversing a record will capture it. Records that fall
 through all the filters without matching anything are considered "unfiltered".
@@ -304,9 +306,9 @@ called via `job.trigger(:cleanup, Time.now)` or simply `job.cleanup(Time.now)`.
 
 ---
 
-## Installation 
+## Installation
 
-Add `gem 'stockboy'` to your Gemfile and run `bundle install`. 
+Add `gem 'stockboy'` to your Gemfile and run `bundle install`.
 
 Supported on Ruby 1.9+.
 
@@ -352,7 +354,7 @@ Contributions and pull requests are welcome.
     bundle exec rake # runs tests
 
 [gf]:  http://guestfolio.com/
-[etl]: https://en.wikipedia.org/wiki/Extract,_transform,_load 
+[etl]: https://en.wikipedia.org/wiki/Extract,_transform,_load
 [dsl]: https://en.wikipedia.org/wiki/Domain-specific_language
 [travis]: https://travis-ci.org/avit/stockboy
 [gemnasium]: https://gemnasium.com/avit/stockboy

data/lib/stockboy.rb

@@ -36,6 +36,7 @@ require 'stockboy/providers/file'
 
 # Readers
 require 'stockboy/readers/csv'
+require 'stockboy/readers/json'
 require 'stockboy/readers/xml'
 require 'stockboy/readers/fixed_width'
 require 'stockboy/readers/spreadsheet'
@@ -56,6 +57,7 @@ module Stockboy
 
   module Readers
     register :csv, CSV
+    register :json, JSON
     register :xml, XML
     register :fixed_width, FixedWidth
     register :spreadsheet, Spreadsheet

data/lib/stockboy/attribute.rb

@@ -10,7 +10,7 @@ module Stockboy
       elsif ignore_condition.respond_to?(:call)
         ignore_condition.call(context)
       else
-        false
+        !!(ignore_condition)
       end
     end
 

data/lib/stockboy/version.rb

@@ -1,3 +1,3 @@
 module Stockboy
-  VERSION = "1.0.0"
+  VERSION = "1.0.1"
 end

data/spec/stockboy/attribute_spec.rb

@@ -20,6 +20,11 @@ module Stockboy
         attr.ignore?(double email: "@").should be false
       end
 
+      it "is true with a truthy value" do
+        attr = Attribute.new :email, "email", [], 1
+        attr.ignore?(double email: "").should be true
+      end
+
       it "yields records to a proc" do
         attr = Attribute.new :email, "email", [], ->(r) { not r.email.include? "@" }
         attr.ignore?(double email: "").should be true

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: stockboy
 version: !ruby/object:Gem::Version
-  version: 1.0.0
+  version: 1.0.1
 platform: ruby
 authors:
 - Andrew Vit
 autorequire: 
 bindir: bin
 cert_chain: []
-date: 2015-06-30 00:00:00.000000000 Z
+date: 2015-12-16 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: rake