datashift 0.1.0 → 0.2.1

data/lib/java/poi-3.7/NOTICE

@@ -1,21 +1,21 @@
-Apache POI
-Copyright 2009 The Apache Software Foundation
-
-This product includes software developed by
-The Apache Software Foundation (http://www.apache.org/).
-
-This product contains the DOM4J library (http://www.dom4j.org).
-Copyright 2001-2005 (C) MetaStuff, Ltd. All Rights Reserved.
-
-This product contains parts that were originally based on software from BEA.
-Copyright (c) 2000-2003, BEA Systems, <http://www.bea.com/>.
-
-This product contains W3C XML Schema documents. Copyright 2001-2003 (c)
-World Wide Web Consortium (Massachusetts Institute of Technology, European
-Research Consortium for Informatics and Mathematics, Keio University)
-
-This product contains the Piccolo XML Parser for Java
-(http://piccolo.sourceforge.net/). Copyright 2002 Yuval Oren.
-
-This product contains the chunks_parse_cmds.tbl file from the vsdump program.
-Copyright (C) 2006-2007 Valek Filippov (frob@df.ru)
+Apache POI
+Copyright 2009 The Apache Software Foundation
+
+This product includes software developed by
+The Apache Software Foundation (http://www.apache.org/).
+
+This product contains the DOM4J library (http://www.dom4j.org).
+Copyright 2001-2005 (C) MetaStuff, Ltd. All Rights Reserved.
+
+This product contains parts that were originally based on software from BEA.
+Copyright (c) 2000-2003, BEA Systems, <http://www.bea.com/>.
+
+This product contains W3C XML Schema documents. Copyright 2001-2003 (c)
+World Wide Web Consortium (Massachusetts Institute of Technology, European
+Research Consortium for Informatics and Mathematics, Keio University)
+
+This product contains the Piccolo XML Parser for Java
+(http://piccolo.sourceforge.net/). Copyright 2002 Yuval Oren.
+
+This product contains the chunks_parse_cmds.tbl file from the vsdump program.
+Copyright (C) 2006-2007 Valek Filippov (frob@df.ru)

data/lib/java/poi-3.7/RELEASE_NOTES.txt

@@ -1,115 +1,115 @@
-The Apache POI is pleased to announce the release of POI 3.7.
-
-See the downloads page for binary and source distributions: http://poi.apache.org/download.html
-
-
-Release Notes -- Apache POI -- Version 3.7
-
-Apache POI is an open source Java library for working with Microsoft Office documents. 
-POI 3.7 is an incremental feature release based on the earlier 3.6 release. 
-
-The most notable changes since POI 3.6 are:
--------------------------------------------
-OOXML
- * support for reading aes-encrypted/write-protected ooxml files
- * support Java 1.5 in auto-generated xmlbeans for ooxml schemas
-
-Spreadsheet (Excel)
- * initial support for autofilters
- * support for data validation for ooxml format
- * initial support for themes for ooxml format
- * added implementation for new functions: RANDBETWEEN, POISSON, SUBTOTAL, TEXT, TRUNC
- * support evaluation of indirect defined names in INDIRECT
- * numerous fixes and performance optimizations in the Formula Evaluation module
- * ability to add, modify and remove series from HSSF Charts
- * numerous improvements in the cell data formatter (handling more formatting rules, better color detection,  allow overriding of default locale)
- * more examples including a rich "spreadsheet to  HTML" converter 
-
-Document (Word)
- * initial support for the HWPF revision marks authors list
- * support for border codes in HWPF
- * support for processing of symbols in HWPF
- * support sections in Word 6 and Word 95 files
- * improved reading of auto-saved ("complex") documents in HWPF
- * improved support for manipulation of tables and paragraphs in XWPF
- 
-SlideShow (PowerPoint)
- * allow editing workbooks embedded into HSLF slide shows
-
-Text Extraction
- * support for text extraction from XSLF tables
- * add PublisherTextExtractor support to extractorfactory
- * support attachments as embedded documents within the new OutlookTextExtactor
- * new event based XSSF text extractor (XSSFEventBasedExcelExtractor)
- * make it easier to tell which content types each POIXMLTextExtractor handles
- * paragraph level as well as whole-file text extraction for word 6/95 files
-
-
- * ...and much much more: code cleanup, many bug fixes and performance improvements
-
-Contributors
-------------
-
-The following people have contributed to this release by submitting bug
-reports or by participating in the issue resolution process (in strict alphabetical order).
-
-Alexey Butchik        Jeff Lavezzo              Philippe Laflamme
-Andrew Shirley        Jens Gatze                Raiko Eckstein
-Andrzej Bialecki      Jerry Soung               Rainer Schwarze
-Antoni Mylka          Jonathan Holloway         Ranvijay Singh
-Antony Bowesman       Josh Micich               Rick Cameron
-Antti Koskimaki       Jukka Zitting             Robert Kish
-Attila Kiraily        Kai Zimmermann            Robin Salkeld
-Bob Smith             Kalpesh Parmar            Ryan Lauck
-Brendan Nolan         Kamil Soltys              Ryan Skow
-Charlie Chang         Karl Eilebrecht           Samuel Yung
-Chris Barlock         Ken Arnold                Simon Kelly
-Chris Lott            Liu Yan                   Stefan Stern
-Christiaan Fluit      Lon Binder                Steve Wolke
-Dave Fisher           Martin Studer             TK Gospodinov
-Dave Syer             Martin W. Kirst           Tao Jiang
-David Agnew           Maxim Valyanskiy          Ted Schrader
-David Lewis           Michael Vilensky          Thomas Herre
-Dmitry Sviridov       Michel Boudinot           Tomas Prochazka
-Domenico Napoletano   Nick Burch                Tony Harvey
-Ed Beaty              Paul Spencer              Trejkaz (pen name)
-Fabio Ebner           Payam Hekmat              Tsutomu YANO
-Fred Ross             Peter Kutak               Viveck Shastri
-Grzegorz Bloch        Petr Udalau               Vladimir Korenev
-Henry Huang           Phil Dunlea               William J. Coleda
-Immad Naseer          Phil Varner               Yegor Kozlov
-Jan Stette            Philipp Epp               Zhang Zhang
-
-
-Thank you all very much! Contributions are always welcome, come join the project.
-
-Release Contents
-----------------
-
-This release comes in two forms:
- - pre-built binaries containing compiled versions of all Apache POI components and documentation
-   (poi-bin-3.7-20101029.zip or poi-bin-3.7-20101029.tar.gz)
- - source archive you can build POI from (poi-src-3.7-20101029.zip or poi-src-3.7-20101029.tar.gz)
-
- Pre-built versions of all POI components are also available in the central Maven repository
- under Group ID "org.apache.poi" and Version "3.7"
-
-All release artifacts are accompanied by MD5 checksums and a PGP signatures
-that you can use to verify the authenticity of your download.
-The public key used for the PGP signature can be found at
-http://svn.apache.org/repos/asf/poi/tags/REL_3_7/KEYS
-
-
-About Apache POI
------------------------
-
-Apache POI is well-known in the Java field as a library for reading and
-writing Microsoft Office file formats, such as Excel, PowerPoint, Visio and
-Word. Since POI 3.5, the new OOXML (Office Open XML) formats introduced in Office 2007 have been supported.
-
-For more information, visit http://poi.apache.org/
-
-
-For the Apache POI Team
-Yegor Kozlov
-
+The Apache POI is pleased to announce the release of POI 3.7.
+
+See the downloads page for binary and source distributions: http://poi.apache.org/download.html
+
+
+Release Notes -- Apache POI -- Version 3.7
+
+Apache POI is an open source Java library for working with Microsoft Office documents. 
+POI 3.7 is an incremental feature release based on the earlier 3.6 release. 
+
+The most notable changes since POI 3.6 are:
+-------------------------------------------
+OOXML
+ * support for reading aes-encrypted/write-protected ooxml files
+ * support Java 1.5 in auto-generated xmlbeans for ooxml schemas
+
+Spreadsheet (Excel)
+ * initial support for autofilters
+ * support for data validation for ooxml format
+ * initial support for themes for ooxml format
+ * added implementation for new functions: RANDBETWEEN, POISSON, SUBTOTAL, TEXT, TRUNC
+ * support evaluation of indirect defined names in INDIRECT
+ * numerous fixes and performance optimizations in the Formula Evaluation module
+ * ability to add, modify and remove series from HSSF Charts
+ * numerous improvements in the cell data formatter (handling more formatting rules, better color detection,  allow overriding of default locale)
+ * more examples including a rich "spreadsheet to  HTML" converter 
+
+Document (Word)
+ * initial support for the HWPF revision marks authors list
+ * support for border codes in HWPF
+ * support for processing of symbols in HWPF
+ * support sections in Word 6 and Word 95 files
+ * improved reading of auto-saved ("complex") documents in HWPF
+ * improved support for manipulation of tables and paragraphs in XWPF
+ 
+SlideShow (PowerPoint)
+ * allow editing workbooks embedded into HSLF slide shows
+
+Text Extraction
+ * support for text extraction from XSLF tables
+ * add PublisherTextExtractor support to extractorfactory
+ * support attachments as embedded documents within the new OutlookTextExtactor
+ * new event based XSSF text extractor (XSSFEventBasedExcelExtractor)
+ * make it easier to tell which content types each POIXMLTextExtractor handles
+ * paragraph level as well as whole-file text extraction for word 6/95 files
+
+
+ * ...and much much more: code cleanup, many bug fixes and performance improvements
+
+Contributors
+------------
+
+The following people have contributed to this release by submitting bug
+reports or by participating in the issue resolution process (in strict alphabetical order).
+
+Alexey Butchik        Jeff Lavezzo              Philippe Laflamme
+Andrew Shirley        Jens Gatze                Raiko Eckstein
+Andrzej Bialecki      Jerry Soung               Rainer Schwarze
+Antoni Mylka          Jonathan Holloway         Ranvijay Singh
+Antony Bowesman       Josh Micich               Rick Cameron
+Antti Koskimaki       Jukka Zitting             Robert Kish
+Attila Kiraily        Kai Zimmermann            Robin Salkeld
+Bob Smith             Kalpesh Parmar            Ryan Lauck
+Brendan Nolan         Kamil Soltys              Ryan Skow
+Charlie Chang         Karl Eilebrecht           Samuel Yung
+Chris Barlock         Ken Arnold                Simon Kelly
+Chris Lott            Liu Yan                   Stefan Stern
+Christiaan Fluit      Lon Binder                Steve Wolke
+Dave Fisher           Martin Studer             TK Gospodinov
+Dave Syer             Martin W. Kirst           Tao Jiang
+David Agnew           Maxim Valyanskiy          Ted Schrader
+David Lewis           Michael Vilensky          Thomas Herre
+Dmitry Sviridov       Michel Boudinot           Tomas Prochazka
+Domenico Napoletano   Nick Burch                Tony Harvey
+Ed Beaty              Paul Spencer              Trejkaz (pen name)
+Fabio Ebner           Payam Hekmat              Tsutomu YANO
+Fred Ross             Peter Kutak               Viveck Shastri
+Grzegorz Bloch        Petr Udalau               Vladimir Korenev
+Henry Huang           Phil Dunlea               William J. Coleda
+Immad Naseer          Phil Varner               Yegor Kozlov
+Jan Stette            Philipp Epp               Zhang Zhang
+
+
+Thank you all very much! Contributions are always welcome, come join the project.
+
+Release Contents
+----------------
+
+This release comes in two forms:
+ - pre-built binaries containing compiled versions of all Apache POI components and documentation
+   (poi-bin-3.7-20101029.zip or poi-bin-3.7-20101029.tar.gz)
+ - source archive you can build POI from (poi-src-3.7-20101029.zip or poi-src-3.7-20101029.tar.gz)
+
+ Pre-built versions of all POI components are also available in the central Maven repository
+ under Group ID "org.apache.poi" and Version "3.7"
+
+All release artifacts are accompanied by MD5 checksums and a PGP signatures
+that you can use to verify the authenticity of your download.
+The public key used for the PGP signature can be found at
+http://svn.apache.org/repos/asf/poi/tags/REL_3_7/KEYS
+
+
+About Apache POI
+-----------------------
+
+Apache POI is well-known in the Java field as a library for reading and
+writing Microsoft Office file formats, such as Excel, PowerPoint, Visio and
+Word. Since POI 3.5, the new OOXML (Office Open XML) formats introduced in Office 2007 have been supported.
+
+For more information, visit http://poi.apache.org/
+
+
+For the Apache POI Team
+Yegor Kozlov
+

data/lib/loaders/csv_loader.rb

@@ -1,99 +1,99 @@
-# Copyright:: (c) Autotelik Media Ltd 2011
-# Author ::   Tom Statter
-# Date ::     Aug 2011
-# License::   MIT
-#
-# Details::   Specific loader to support CSV files.
-# 
-#
-require 'loaders/loader_base'
-require 'datashift/exceptions'
-require 'datashift/method_mapper'
-
-module DataShift
-     
-  module CsvLoading
-    
-    def perform_csv_load(file_name, options = {})
-
-      require "csv"
-
-      # TODO - can we abstract out what a 'parsed file' is - so a common object can represent excel,csv etc
-      # then  we can make load() more generic
-
-      @parsed_file = CSV.read(file_name)
-
-
-      @method_mapper = DataShift::MethodMapper.new
-
-      @mandatory = options[:mandatory] || []
-
-      # Create a method_mapper which maps list of headers into suitable calls on the Active Record class
-      map_headers_to_operators( @parsed_file.shift, options[:strict] , @mandatory )
-
-      unless(@method_mapper.missing_methods.empty?)
-        puts "WARNING: Following column headings could not be mapped : #{@method_mapper.missing_methods.inspect}"
-        raise MappingDefinitionError, "ERROR: Missing mappings for #{@method_mapper.missing_methods.size} column headings"
-      end
-
-      #if(options[:verbose])
-      puts "\n\n\nLoading from CSV file: #{file_name}"
-      puts "Processing #{@parsed_file.size} rows"
-      # end
-
-      load_object_class.transaction do
-        @loaded_objects =  []
-
-        @parsed_file.each do |row|
-
-          # TODO - Smart sorting of column processing order ....
-          # Does not currently ensure mandatory columns (for valid?) processed first but model needs saving
-          # before associations can be processed so user should ensure mandatory columns are prior to associations
-
-          # as part of this we also attempt to save early, for example before assigning to
-          # has_and_belongs_to associations which require the load_object has an id for the join table
-
-          # Iterate over the columns method_mapper found in Excel,
-          # pulling data out of associated column
-          @method_mapper.method_details.each_with_index do |method_detail, col|
-
-            value = row[col]
-
-            prepare_data(method_detail, value)
-            
-            process()
-          end
-
-          # TODO - handle when it's not valid ?
-          # Process rest and dump out an exception list of Products ??
-
-          puts "SAVING ROW #{row} : #{load_object.inspect}" #if options[:verbose]
-
-          save
-
-          # don't forget to reset the object or we'll update rather than create
-          new_load_object
-
-        end
-      end
-    end
-  end
-  
-  class CsvLoader < LoaderBase
-
-    include DataShift::CsvLoading
-
-    def initialize(klass, object = nil, options = {})
-      super( klass, object, options )
-      raise "Cannot load - failed to create a #{klass}" unless @load_object
-    end
-
-    def perform_load( file_name, options = {} )
-      perform_csv_load( file_name, options )
-
-      puts "CSV loading stage complete - #{loaded_objects.size} rows added."
-    end
-
-  end
-    
+# Copyright:: (c) Autotelik Media Ltd 2011
+# Author ::   Tom Statter
+# Date ::     Aug 2011
+# License::   MIT
+#
+# Details::   Specific loader to support CSV files.
+# 
+#
+require 'loaders/loader_base'
+require 'datashift/exceptions'
+require 'datashift/method_mapper'
+
+module DataShift
+     
+  module CsvLoading
+    
+    def perform_csv_load(file_name, options = {})
+
+      require "csv"
+
+      # TODO - can we abstract out what a 'parsed file' is - so a common object can represent excel,csv etc
+      # then  we can make load() more generic
+
+      @parsed_file = CSV.read(file_name)
+
+
+      @method_mapper = DataShift::MethodMapper.new
+
+      @mandatory = options[:mandatory] || []
+
+      # Create a method_mapper which maps list of headers into suitable calls on the Active Record class
+      map_headers_to_operators( @parsed_file.shift, options[:strict] , @mandatory )
+
+      unless(@method_mapper.missing_methods.empty?)
+        puts "WARNING: Following column headings could not be mapped : #{@method_mapper.missing_methods.inspect}"
+        raise MappingDefinitionError, "ERROR: Missing mappings for #{@method_mapper.missing_methods.size} column headings"
+      end
+
+      #if(options[:verbose])
+      puts "\n\n\nLoading from CSV file: #{file_name}"
+      puts "Processing #{@parsed_file.size} rows"
+      # end
+
+      load_object_class.transaction do
+        @loaded_objects =  []
+
+        @parsed_file.each do |row|
+
+          # TODO - Smart sorting of column processing order ....
+          # Does not currently ensure mandatory columns (for valid?) processed first but model needs saving
+          # before associations can be processed so user should ensure mandatory columns are prior to associations
+
+          # as part of this we also attempt to save early, for example before assigning to
+          # has_and_belongs_to associations which require the load_object has an id for the join table
+
+          # Iterate over the columns method_mapper found in Excel,
+          # pulling data out of associated column
+          @method_mapper.method_details.each_with_index do |method_detail, col|
+
+            value = row[col]
+
+            prepare_data(method_detail, value)
+            
+            process()
+          end
+
+          # TODO - handle when it's not valid ?
+          # Process rest and dump out an exception list of Products ??
+
+          puts "SAVING ROW #{row} : #{load_object.inspect}" #if options[:verbose]
+
+          save
+
+          # don't forget to reset the object or we'll update rather than create
+          new_load_object
+
+        end
+      end
+    end
+  end
+  
+  class CsvLoader < LoaderBase
+
+    include DataShift::CsvLoading
+
+    def initialize(klass, object = nil, options = {})
+      super( klass, object, options )
+      raise "Cannot load - failed to create a #{klass}" unless @load_object
+    end
+
+    def perform_load( file_name, options = {} )
+      perform_csv_load( file_name, options )
+
+      puts "CSV loading stage complete - #{loaded_objects.size} rows added."
+    end
+
+  end
+    
 end