squealer 2.1.1 → 2.2.0

data/.rvmrc

@@ -1,6 +1,6 @@
 # These are the rubies that squealer has been tested on. Uncomment the one you want to use right now.
-#rvm use 1.9.1@squealer
-#rvm use 1.8.7@squealer
-rvm use 1.9.2
-#rvm use 1.9.1
-#rvm use 1.8.7
+# 1.8.7-p249 segfaults postgres.
+#
+# rvm use 1.8.7-p174@squealer
+rvm use 1.9.1@squealer #-p378
+# rvm use 1.9.2@squealer #-preview3

data/LICENSE

@@ -0,0 +1,20 @@
+Copyright (c) 2010 Joshua A. Graham and authors
+
+Permission is hereby granted, free of charge, to any person obtaining
+a copy of this software and associated documentation files (the
+"Software"), to deal in the Software without restriction, including
+without limitation the rights to use, copy, modify, merge, publish,
+distribute, sublicense, and/or sell copies of the Software, and to
+permit persons to whom the Software is furnished to do so, subject to
+the following conditions:
+
+The above copyright notice and this permission notice shall be
+included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
+EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
+NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
+LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
+OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
+WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

data/README.md

@@ -9,10 +9,29 @@ To run standalone, simply make your data squeal thusly:
 
 where the squeal script includes a `require 'squealer'`.
 
+## Rationale
+* For some reason cranky old data guys think there exists no other than the relational theory for modelling data
+* Josh Graham is crankier and in many cases older (although much better looking) than your cranky old DBA, so he remembers when RDBMS were not prolific, and one had to construct queries that explicitly traversed the network or hierarchical databases of the time (or even the indexed file systems). CODASYL, can you spell it?
+* Although many business problems are best expressed in terms of a spreadsheet (a tuple space), and despite the somewhat disturbing fact that the majority of the world's critical commercial systems hinge on Excel spreadsheets, not every problem is best modelled this way
+* MongoDB (along with a growing number of other noSQL == "not only SQL" databases) provides an alternate mechanism to store data in a way that naturally reflects the real-world problem. Simpler application code, higher performance and straight-forward scalabiltity are natural benefits of modelling in a way that most closely reflects reality
+* At the inaugural QCon San Francisco in a discussion with Martin Fowler and Ola Bini, Josh postulated that ORMs had it the wrong way around: that the application should be persisting its data in a manner natural to it, and that external systems (like reporting and decision support systems - or even numbskull integration at the persistence layer) should bear the cost of mapping. With the huge efforts put into noSQL engines like MongoDB, neo4j, Redis, Hadoop, CouchDB, Memcached, et cetera, has come a rise in popularity. With this increased and broader usage comes people who are looking for tools to make these data stores more accessible. The application is no longer bearing the cost of mapping - it's now time for the ancillary and external systems to pick up the bill!
+* squealer provides a simple, declarative language for mapping values from trees into relations. It is inherently flexibile by being an internal Ruby DSL, so any imperative traversal or mapping logic can be expressed
+* It can be used both in bulk operations on many documents (e.g. a periodic batch job) or executed for one document asynchronously as part of an after_save method (e.g. via a Resque job). It is possible that more work may done on this event-driven approach, perhaps in the form of a squealerd, to reduce latency.
+
 ## Release Notes
+### v2.2
+* Adds support for PostgreSQL database as an export target
+* Uses EXPORT_DBMS environment variable to specify database adapter
+** EXPORT_DMBS=mysql
+** EXPORT_DBMS=postgres
+** MySQL is default if not specified
+* Switched to using DataMapper's DataObjects SQL wrapper
+* Removed the need for some typecasting and export schema restrictions (e.g. true/false maps to whatever is idiomatic for the specified DBMS)
+* NB: The pg gem for PostgreSQL segfaults on Ruby 1.8.7-p249 so we've reverted to supporting up to 1.8.7-p174
+
 ### v2.1
 * Ruby 1.8.6 back-compatibility added. Using `eval "", binding, __FILE__, __LINE__` instead of `binding.eval`
-* Target SQL script using backtick-quoted (mySQL) identifiers to avoid column-name / keyword conflict
+* Target SQL script using backtick-quoted (MySQL) identifiers to avoid column-name / keyword conflict
 * Automatically typecast Ruby `Boolean` (to integer), `Symbol` (to string), `Array` (to comma-seperated string)
 * Improved handling and reporting of Target SQL errors
 * Schaefer's Special "skewer" Script to reflect on Mongoid models and generate an initial squeal script and SQL schema DDL script. This tool is intended to build the _initial_ scripts only. It is extremely useful to get you going, but do think about the needs of the consumer of the export database, and adjust the scripts to suit. [How do you make something squeal? You skewer it!]
@@ -32,30 +51,35 @@ where the squeal script includes a `require 'squealer'`.
 ## Warning
 Squealer is for _standalone_ operation. DO NOT use it directly from within your Ruby application. To make the DSL easy to use, we alter some core types:
 
-* `FalseClass#to_i` - You'll be storing booleans as a `tinyint(1)`, or similar. `false` is `0`.
 * `Hash#method_missing` - You prefer dot notation. JSON uses dot notation. You are importing from a data store which represents collections as arrays of hashmaps. Dot notation for navigating those collections is convenient. If you use a field name that happens to be a method on Hash you will have to use index notation. (e.g. `kitten.toys` is good, however `kitten.freeze` is not good. Use `kitten['freeze']` instead.)
 * `NilClass#each` - As you are importing from schemaless repositories and you may be trying to iterate on fields that contain embedded collections, if a specific parent does not contain one of those child collections, the driver will be returning `nil` as the value for that field. Having `NilClass#each` return a `[]` for a nil is convenient, semantically correct in this context, and removes the need for many `nil` checks in the block you provide to `Object#assign`
 * `Object` - `#import`, `#export`, `#target`, and `#assign` "keywords" are provided for convenience
-* `Time#to_s` - As you are exporting to a SQL database, we represent your timestamp in a format that it will parse unequivocally (MongoDB stores all temporal data as a timestamp)
-* `TrueClass#to_i` - You'll be storing booleans as a `tinyint(1)`, or similar. `true` is `1`.
+* You need to remember that all temporal data (date, time, datetime, timestamp, whatever) are all converted to a full UTC date and time. This means that if you want to use the simple assign expression (with no block), the target column must be defined as a SQL type that can automatically accept a full date and time. If you just want to store the date or time portion, or do any other manipulation, you must use a block to convert the source value. 
 
 ## It is a data mapper, it doesn't use one.
-Squealer doesn't use your application classes. It doesn't use your ActiveRecord models. It doesn't use mongoid (as awesome as that is), or mongomapper. It's an ETL tool. It could even be called a HRM (Hashmap-Relational-Mapper), but only in hushed tones in the corner boothes of dark pubs. It directly uses the Ruby driver for MongoDB and the Ruby driver for mySQL.
+Squealer doesn't use your application classes. It doesn't use your ActiveRecord models. It doesn't use mongoid (as awesome as that is), mongodoc, or mongomapper. It's an ETL tool. It could even be called a HRM (Hashmap-Relational-Mapper), but only in hushed tones in the corner boothes of dark pubs. It directly uses the Ruby driver for MongoDB and the Ruby driver for MySQL.
 
 ## Databases supported
-For now, this is specifically for _MongoDB_ exporting to _mySQL_.
-
-## Deprecation Warning
-Since version 1.1, the primary key value is inferred from the source document `_id` field based on the `Object#target` `table_name` argument matching the name of a variable holding the source document, `row_id` is no longer a parameter on `Object#target`. It will be invalid in version 1.3 and above.
+For now, this is specifically for importing _MongoDB_ documents and exporting to either _MySQL_ or _PostgreSQL_.
 
 ## Notes
+Tested on Ruby 1.8.7(-p174) and Ruby 1.9.1(-p378)
+
 The target SQL database _must_ have no foreign keys (because it can't rely on the primary key values and referential integrity is the responsibility of the source data store or the application that uses it).
 
-The target SQL database must use a primary key of `char(24)`. For now, we've assumed that column name is `id`. Each record's `id` value will get the source document `_id` value.
+The target SQL database must use a primary key of `CHAR(24)`. For now, we've assumed that column name is `id`. Each record's `id` value will get the source document `_id` value. There are some plans to make this more flexible. If you are actively requiring this, let Josh know.
 
 It is assumed the target data will be quite denormalized - particularly that the hierarchy keys for embedded documents are flattened. This means that a document from `office.room.box` will be exported to a record containing the `id` for `office`, the `id` for `room` and the `id` for `box`.
 
-It is assumed no indexes are present in the target database table (performance drag). You may want to create indexes for pulling data out of the database Squealer exports to. Run a SQL DDL script on your mySQL database after squealing to add the indexes. You should drop the indexes before squealing again.
+It is assumed no indexes are present in the target database table (performance drag). You may want to create indexes for pulling data out of the database Squealer exports to. Run a SQL DDL script on your MySQL database after squealing to add the indexes. You should drop the indexes before squealing again.
+
+The target row is inserted, or updated if present. When MySQL is the export DBMS, we are using it's non-standard `INSERT ... UPDATE ON DUPLICATE KEY` extended syntax to achieve this. For PostgreSQL, we use an UPDATE followed by an INSERT. Doing update-or-insert allows an idempotent event-driven update of exported data (e.g. through redis queues) as well as a bulk batch process.
+
+## Copyright
+
+Copyright © 2010 Joshua A Graham and authors.
+
+## License
 
-The target row is inserted, or updated if present. We are using MySQL `INSERT ... UPDATE ON DUPLICATE KEY` extended syntax to achieve this for now. This allows an event-driven update of exported data (e.g. through redis queues) as well as a bulk batch process.
+See [LICENSE](blob/master/LICENSE "License").
 

data/Rakefile

@@ -18,9 +18,18 @@ begin
     gemspec.default_executable = "skewer"
     gemspec.executables = ["skewer"]
 
-    gemspec.add_dependency('mysql', '>= 2.8.1')
+    # import DBMS
     gemspec.add_dependency('mongo', '>= 0.18.3')
     gemspec.add_dependency('bson_ext', '>= 1.0.1')
+
+    # export DBMS
+    gemspec.add_dependency('data_objects', '>= 0.10.2')
+    gemspec.add_dependency('mysql', '>= 2.8.1')
+    gemspec.add_dependency('do_mysql', '>= 0.10.2')
+    gemspec.add_dependency('pg', '>= 0.9.0')
+    gemspec.add_dependency('do_postgres', '>= 0.10.2')
+
+    gemspec.add_development_dependency('rspec', '>= 1.3.0')
   end
   Jeweler::GemcutterTasks.new
 rescue LoadError

data/VERSION

@@ -1 +1 @@
-2.1.1
+2.2.0

data/bin/skewer

@@ -1,19 +1,15 @@
 #!/usr/bin/env ruby
 
 model = ARGV[0]
-unless model
-  $stderr.puts "usage: skewer ModelName"
-  exit 1
-end
+abort "usage: skewer ModelName" unless model
 
 require 'config/boot'
 require 'config/environment'
 
 model = Object.const_get(model)
 
-unless defined?(Mongoid) and Mongoid::Document > model
-  $stderr.puts "#{model} must be a Mongoid::Document"
-  exit 1
+unless defined?(Mongoid) && Mongoid::Document > model
+  abort "#{model} must be a Mongoid::Document"
 end
 
 write_schema = true
@@ -150,8 +146,8 @@ if write_squeal
     file.write <<-EOS
 require 'squealer'
 
-import('localhost', 27017, 'development') # <--- Change this as needed
-export('localhost', 'root', '', 'export') # <--- Change this as needed
+import('mysql', 'localhost', 27017, 'development') # <--- Change this as needed
+export('mysql', 'localhost', 'root', '', 'export') # <--- Change this as needed
 
 EOS
     file.write(squeal)

data/lib/example_squeal.rb

@@ -3,8 +3,9 @@ require 'squealer'
 # connect to the source mongodb database
 import('localhost', 27017, 'development')
 
+
 # connect to the target mysql database
-export('localhost', 'root', '', 'reporting_export')
+export('mysql', 'localhost', 'root', '', 'reporting_export')
 
 # Here we extract, transform and load all documents in a collection...
 
@@ -17,6 +18,12 @@ export('localhost', 'root', '', 'reporting_export')
 #
 # Defaults to find all...
 import.source('users').each do |user|
+
+  # TODO: Allow specification of import row_id (export still uses "id" column as primary key):
+  # import_row_id { user['_id'] }
+  # import_row_id :_id
+  # import_row_id :name, :dob # Digest::SHA1.hexdigest(concatenated keys)[0,24]
+
   # Insert or Update on table 'user' where 'id' is the column name of the primary key.
   #
   # The primary key value is taken from the '_id' field of the source document,
@@ -41,7 +48,7 @@ import.source('users').each do |user|
     # You can normalize the export...
     # home_address and work_address are a formatted string like: "661 W Lake St, Suite 3NE, Chicago IL, 60611, USA"
     addresses = []
-    addresses << atomize_address(user.home_address)
+    addresses << atomize_address(user.home_address) # atomize_address is some custom method of yours
     addresses << atomize_address(user.work_address)
     addresses.each do |address|
       target(:address) do
@@ -55,7 +62,7 @@ import.source('users').each do |user|
     #
     # You can denormalize the export...
     # user.home_address = { street: '661 W Lake St', city: 'Chicago', state: 'IL' }
-    assign(:home_address) { flatten_address(user.home_address) }
+    assign(:home_address) { flatten_address(user.home_address) } # flatten_address is some custom method of yours
     assign(:work_address) { flatten_address(user.work_address) }
 
     user.activities.each do |activity|

data/lib/squealer/database.rb

@@ -1,5 +1,9 @@
-require 'mysql'
 require 'mongo'
+require 'data_objects'
+require 'mysql'
+require 'do_mysql'
+require 'do_postgres'
+
 require 'singleton'
 
 module Squealer
@@ -11,8 +15,12 @@ module Squealer
       @import_connection = Connection.new(@import_dbc)
     end
 
-    def export_to(host, username, password, name)
-      @export_dbc = Mysql.connect(host, username, password, name)
+    def export_to(adapter, host, username, password, name)
+      @@all_export_connections ||= []
+      @export_do.dispose if @export_do
+
+      @export_do = DataObjects::Connection.new("#{adapter}://#{username}:#{password}@#{host}/#{name}")
+      @@all_export_connections << @export_do
     end
 
     def import
@@ -20,7 +28,11 @@ module Squealer
     end
 
     def export
-      @export_dbc
+      @export_do
+    end
+
+    def upsertable?
+      @export_do.is_a? DataObjects::Mysql::Connection
     end
 
     class Connection
@@ -68,5 +80,11 @@ module Squealer
         @progress_bar.finish if @progress_bar
       end
     end
+
+    private
+
+    def dispose_all_connections
+      @@all_export_connections.each {|c| c.dispose if c} if defined?(@@all_export_connections)
+    end
   end
 end

data/lib/squealer/hash.rb

@@ -1,6 +1,7 @@
 class Hash
   def method_missing(name, *args, &block)
     super if args.size > 0 || block_given?
+    #TODO: Warn if key doesn't exist - it's probably a typo in their squealer script
     self[name.to_s]
   end
 end

data/lib/squealer/object.rb

@@ -1,7 +1,7 @@
 class Object
 
-  def target(table_name, row_id=nil, &block)
-    Squealer::Target.new(Squealer::Database.instance.export, table_name, row_id, &block)
+  def target(table_name, &block)
+    Squealer::Target.new(Squealer::Database.instance.export, table_name, &block)
   end
 
   def assign(column_name, &block)

data/lib/squealer/target.rb

@@ -2,7 +2,6 @@ require 'delegate'
 require 'singleton'
 
 #TODO: Use logger and log throughout
-#TODO: Counters and timers
 
 module Squealer
   class Target
@@ -11,16 +10,16 @@ module Squealer
       Queue.instance.current
     end
 
-    def initialize(database_connection, table_name, row_id=nil, &block)
+    def initialize(database_connection, table_name, &block)
       raise BlockRequired, "Block must be given to target (otherwise, there's no work to do)" unless block_given?
       raise ArgumentError, "Table name must be supplied" if table_name.to_s.strip.empty?
 
+      @dbc = database_connection
       @table_name = table_name.to_s
       @binding = block.binding
 
       verify_table_name_in_scope
-
-      @row_id = obtain_row_id(row_id)
+      @row_id = infer_row_id
       @column_names = []
       @column_values = []
       @sql = ''
@@ -44,24 +43,17 @@ module Squealer
 
     private
 
-    def obtain_row_id(row_id)
-      #TODO: Remove in version 1.3 - just call infer_row_id in initialize
-      if row_id != nil
-        puts "\033[33mWARNING - squealer:\033[0m the 'target' row_id parameter is deprecated and will be invalid in version 1.3 and above. Remove it, and ensure the table_name matches a variable containing a hashmap with an _id key"
-        row_id
-      else
-        infer_row_id
-      end
-    end
-
     def infer_row_id
-      eval "#{@table_name}._id", @binding, __FILE__, __LINE__
+      (
+        (eval "#{@table_name}[:_id]", @binding, __FILE__, __LINE__) ||
+        (eval "#{@table_name}['_id']", @binding, __FILE__, __LINE__)
+      ).to_s
     end
-
+3
     def verify_table_name_in_scope
       table = eval "#{@table_name}", @binding, __FILE__, __LINE__
       raise ArgumentError, "The variable '#{@table_name}' is not a hashmap" unless table.is_a? Hash
-      raise ArgumentError, "The hashmap '#{@table_name}' must have an '_id' key" unless table.has_key? '_id'
+      raise ArgumentError, "The hashmap '#{@table_name}' must have an '_id' key" unless table.has_key?('_id') || table.has_key?(:_id)
     rescue NameError
       raise NameError, "A variable named '#{@table_name}' must be in scope, and reference a hashmap with at least an '_id' key."
     end
@@ -84,11 +76,18 @@ module Squealer
 
       yield self
 
-      @sql = "INSERT #{@table_name}"
-      @sql << " (#{pk_name}#{column_names}) VALUES (?#{column_value_markers})"
-      @sql << " ON DUPLICATE KEY UPDATE #{column_markers}"
+      insert_statement = %{INSERT INTO "#{@table_name}"}
+      insert_statement << %{ (#{pk_name}#{column_names}) VALUES ('#{@row_id}'#{column_value_markers})}
+      if Database.instance.upsertable?
+        insert_statement << %{ ON DUPLICATE KEY UPDATE #{column_markers}}
+        @sql = insert_statement
+      else
+        update_statement = %{UPDATE "#{@table_name}" SET #{column_markers} WHERE #{pk_name}='#{@row_id}'}
+        process_sql(update_statement)
+        @sql = update_statement + "; " + insert_statement
+      end
 
-      execute_sql(@sql)
+      process_sql(insert_statement)
 
       Queue.instance.pop
     end
@@ -101,12 +100,16 @@ module Squealer
       @@targets
     end
 
-    def execute_sql(sql)
-      statement = Database.instance.export.prepare(sql)
-      values = typecast_values * 2
+    def process_sql(sql)
+      values = Database.instance.upsertable? ? typecast_values * 2 : typecast_values
+      execute_sql(sql, values)
+    end
 
-      statement.send(:execute, @row_id, *values) #expand values into distinct arguments
-    rescue Mysql::Error, TypeError
+    def execute_sql(sql, values)
+      @dbc.create_command(sql).execute_non_query(*values)
+    rescue DataObjects::IntegrityError
+      raise "Failed to execute statement: #{sql} with #{values.inspect}.\nOriginal Exception was: #{$!.to_s}" if Database.instance.upsertable?
+    rescue
       raise "Failed to execute statement: #{sql} with #{values.inspect}.\nOriginal Exception was: #{$!.to_s}"
     end
 
@@ -140,14 +143,10 @@ module Squealer
     def typecast_values
       column_values.map do |value|
         case value
-        when true
-          1
-        when false
-          0
-        when Symbol
-          value.to_s
         when Array
           value.join(",")
+        when BSON::ObjectID
+          value.to_s
         else
           value
         end
@@ -155,7 +154,7 @@ module Squealer
     end
 
     def quote_identifier(name)
-      "`#{name}`"
+      %{"#{name}"}
     end
 
     class Queue < DelegateClass(Array)

data/lib/squealer.rb

@@ -1,6 +1,5 @@
 require 'squealer/hash'
 require 'squealer/object'
-require 'squealer/time'
 
 require 'squealer/database'
 require 'squealer/progress_bar'

data/spec/integration/export_a_record_spec.rb

@@ -0,0 +1,148 @@
+require 'spec_helper'
+
+describe "Exporting" do
+  before do
+    truncate_export_tables
+  end
+
+  let(:databases) { Squealer::Database.instance }
+  let(:today) { Date.today }
+
+  def prepare_export_database
+    databases.export_to($db_adapter, 'localhost', $db_user, '', $db_name)
+  end
+
+  def squeal_basic_users_document(user=users_document)
+    target(:user) do
+      assign(:name)
+      assign(:organization_id)
+      assign(:dob)
+      assign(:gender)
+      assign(:foreign)
+      assign(:dull)
+      assign(:symbolic)
+      assign(:interests)
+    end
+  end
+
+  def squeal_users_document_with_activities(user=users_document)
+    target(:user) do
+      assign(:name)
+      assign(:organization_id)
+      assign(:dob)
+      assign(:gender)
+      assign(:foreign)
+      assign(:dull)
+      assign(:symbolic)
+      assign(:interests)
+
+      user.activities.each do |activity|
+        target(:activity) do
+          assign(:name)
+          assign(:due_date)
+        end
+      end
+    end
+  end
+
+  let :users_document do
+    { :_id => 'ABCDEFGHIJKLMNOPQRSTUVWX',
+      'name' => 'Test User', 'dob' => as_time(Date.parse('04-Jul-1776')), 'gender' => 'M',
+      'foreign' => true,
+      'dull' => false,
+      'symbolic' => :of_course,
+      'interests' => ['health', 'education'],
+      'organization_id' => '123456789012345678901234',
+      'activities' => [
+        { :_id => 'a1', 'name' => 'Be independent', 'due_date' => as_time(today + 1) },
+        { :_id => 'a2', 'name' => 'Fight each other', 'due_date' => as_time(today + 7) }
+      ]
+    }
+  end
+
+  let :first_users_record do
+    dbc = databases.instance_variable_get('@export_do')
+    reader = dbc.create_command(%{SELECT * FROM "user"}).execute_reader
+    result = reader.each { |x| break x }
+    reader.close
+    result
+  end
+
+  let :first_activity_record do
+    dbc = databases.instance_variable_get('@export_do')
+    reader = dbc.create_command(%{SELECT * FROM "activity"}).execute_reader
+    result = reader.each { |x| break x }
+    reader.close
+    result
+  end
+
+  context "a new record" do
+    it "saves the data correctly" do
+      prepare_export_database
+      squeal_basic_users_document
+      result = first_users_record
+
+      result['name'].should == 'Test User'
+
+      result['dob'].mday.should == 4
+      result['dob'].mon.should == 7
+      result['dob'].year.should == 1776
+
+      result['gender'].should == 'M'
+
+      result['foreign'].should be_true
+      result['dull'].should be_false
+
+      result['symbolic'].should == :of_course.to_s
+
+      result['interests'].should == 'health,education'
+    end
+
+    it "saves embedded documents correctly" do
+      prepare_export_database
+      squeal_users_document_with_activities
+      result = first_activity_record
+
+      result['name'].should == 'Be independent'
+      result['due_date'].mday.should == (today + 1).mday
+      result['due_date'].mon.should == (today + 1).mon
+      result['due_date'].year.should == (today + 1).year
+    end
+  end
+
+  context "an existing record" do
+    it "updates the data correctly" do
+      prepare_export_database
+      squeal_basic_users_document
+      squeal_basic_users_document(users_document.merge('foreign' => false, 'gender' => 'F'))
+
+      result = first_users_record
+
+      result['name'].should == 'Test User'
+
+      result['dob'].mday.should == 4
+      result['dob'].mon.should == 7
+      result['dob'].year.should == 1776
+
+      result['gender'].should == 'F'
+
+      result['foreign'].should be_false
+      result['dull'].should be_false
+
+      result['symbolic'].should == :of_course.to_s
+
+      result['interests'].should == 'health,education'
+    end
+
+    it "updates the child record correctly" do
+      prepare_export_database
+      squeal_users_document_with_activities(users_document.merge('activities' => [{ :_id => 'a1', 'name' => 'Be expansionist', 'due_date' => as_time(today + 1) }]))
+      result = first_activity_record
+
+      result['name'].should == 'Be expansionist'
+      result['due_date'].mday.should == (today + 1).mday
+      result['due_date'].mon.should == (today + 1).mon
+      result['due_date'].year.should == (today + 1).year
+    end
+  end
+end