embulk 0.7.0-java

data/embulk-docs/src/release/release-0.6.1.rst

@@ -0,0 +1,11 @@
+Release 0.6.1
+==================================
+
+Built-in plugins
+------------------
+
+* ``guess-csv`` fixed guessing (@bwtakacy++)
+
+Release Date
+------------------
+2015-04-08

data/embulk-docs/src/release/release-0.6.10.rst

@@ -0,0 +1,15 @@
+Release 0.6.10
+==================================
+
+General Changes
+------------------
+
+* PluginRegistry shows loaded plugin name and version to stdout
+* Fixed a problem where ``embulk gem install`` command can't install gems which include a native extension
+* Added ``embulk irb`` subcommand
+* Fixed ``spi.ProcessTask`` serialization to preserve ``timestamp_format`` of a column. This fixes compatibility with embulk-executor-mapreduce.
+
+
+Release Date
+------------------
+2015-05-21

data/embulk-docs/src/release/release-0.6.11.rst

@@ -0,0 +1,19 @@
+Release 0.6.11
+==================================
+
+Built-in plugins
+------------------
+
+* ``input-file`` plugin sets ``last_path`` when there are no input files.
+* ``parser-csv`` supports **comment_line_marker** option to skip lines starting with comment characters such as '#'.
+* Fixed a bug where ``guess-csv`` guesses timestamp wrongly if order of date is month-day-year.
+
+General Changes
+------------------
+
+* Command line execution supports ``-J``, ``-R``, ``-J+O``, and ``-J-O`` arguments on Windows (@hito4++)
+
+
+Release Date
+------------------
+2015-05-30

data/embulk-docs/src/release/release-0.6.12.rst

@@ -0,0 +1,31 @@
+Release 0.6.12
+==================================
+
+Plugin API
+------------------
+
+* Plugins can use both ``config[:key]`` (``task[:key]``) and ``config['key']`` (``task['key']``).
+* Added ``Embulk.logger`` for Ruby plugins
+
+
+Built-in plugins
+------------------
+
+* ``guess-csv`` plugin does not raise exceptions when a file has only 1 line
+* ``parser-csv`` shows number of lines using 1-origin indexing rather than 0-origin
+
+
+General Changes
+------------------
+
+* Guessing skips files smaller than 40 bytes so that guessing works when there is an empty file at the beginning.
+* Uses ANSI color for log messages
+* Uses logback instead of log4j for logging backend
+* Added ``spi.Exec.isPreview()`` as an alias of ``spi.Exec.session().isPreview()``
+* Plugin template for Ruby uses Xxx instead of XxxInputPlugin for the class name so that class name matches with file name.
+* When parsing timestamp fails, exception message includes the original text (@yyamano++)
+
+
+Release Date
+------------------
+2015-06-22

data/embulk-docs/src/release/release-0.6.13.rst

@@ -0,0 +1,23 @@
+Release 0.6.13
+==================================
+
+Plugin API
+------------------
+
+* Aded spi.util.DynamicPageBuilder utility class. This is a wrapper of PageBuilder which converts types automatically.
+* ``page_builder`` used by Ruby plugins are now backed by DynamicPageBuilder. This means that Ruby plugins don't need type conversion code such as to_i or to_s any more.
+
+Built-in plugins
+------------------
+
+* ``guess-csv`` plugin guesses ``trim_if_not_quoted`` option. This works well if a CSV file includes integers with extra spaces (such as CSV files exported by Excel).
+* Fixed a problem where ``guess-csv`` plugin guessed type of a column as "string" if it includes non-empty null_string.
+
+General Changes
+------------------
+
+* "-b" option installs bundler automatically if it is not installed rather shows "no such file to load -- bundler" error message.
+
+Release Date
+------------------
+2015-06-25

data/embulk-docs/src/release/release-0.6.14.rst

@@ -0,0 +1,47 @@
+Release 0.6.14
+==================================
+
+Built-in plugins
+------------------
+
+* ``formatter-csv`` plugin supports ``default_timezone`` and ``column_options`` parameters so that we can set timestamp format for each columns individually.
+* **IMPORTANT**: ``formatter-csv`` does not use the same timestamp format with input timestamp columns. If you're using ``formatter: type: csv`` with ``parser: type: csv-``, you need to set ``format`` option for each columns to keep using current behavior. See ``column_options`` option of CSV formatter plugin described at :doc:`../built-in`.
+* ``guess-csv`` plugin keeps using ``delimiter`` option if already set rather than to overwrite it everytime.
+
+
+Plugin API
+------------------
+
+* Added ``config.DataSource#remove(String)`` method.
+* Added ``spi.ColumnConfig.getOption().``
+
+  * ``spi.type.TimestampType.getFormat()`` is deprecated.
+  * ``spi.ColumnConfig.getFormat()`` is deprecated.
+  * ``spi.ProcessTask`` does not serialize ``TimestampType.format`` any more.
+
+* Added utility methods for ``spi.Schema`` and ``spi.SchemaConfig``.
+
+  * Added ``Schema.Builder`` class and ``Schema.builder()`` method.
+  * Added ``Schema#lookupColumn(String)``.
+  * Added utility methods to ``SchemaConfig``.
+
+* Added ``spi.time.TimestampFormatter.Task`` and TimestampColumnOption
+
+  * ``TimestampFormatter.FormatterTask`` is deprecated
+
+* Added ``spi.time.TimestampParser.Task`` and TimestampColumnOption
+
+  * ``TimestampParser.ParserTask`` is deprecated
+
+* ``spi.time.TimestampFormat`` is deprecated
+
+
+General Changes
+------------------
+
+* Fixed a problem where embulk shows input plugin name and version twice to log.
+
+
+Release Date
+------------------
+2015-06-29

data/embulk-docs/src/release/release-0.6.15.rst

@@ -0,0 +1,26 @@
+Release 0.6.15
+==================================
+
+Plugin API
+------------------
+
+* PageBuilder sets null to a column if setXxx method is not called to the column.
+
+
+Built-in plugins
+------------------
+
+* **IMPORTANT**: Because of default value of ``sequence_format`` option, ``formatter-csv`` adds ``.`` (dot) before ``file_ext`` rather than after ``path_prefix``. If you're using ``out: type: file``, see the document of file output plugin at :doc:`../built-in`.
+
+
+General Changes
+------------------
+
+* ``preview`` reads next file (task) when the first file (task) is empty.
+* Fixed serialize/deserialization bug of ColumnConfig.
+* Fixed NullPointerException caused when ``PageBuilder#setRubyObject(IRubyObject)`` is called with ``nil``.
+
+
+Release Date
+------------------
+2015-06-29

data/embulk-docs/src/release/release-0.6.16.rst

@@ -0,0 +1,26 @@
+Release 0.6.16
+==================================
+
+General Changes
+------------------
+
+* Class loader of plugins lookup classes from plugin's class loader first. This change solves the problem where a plugin uses newer (or older) version of jar library which conflicts with a jar library used by applications embedding embulk.
+* Added ``ExecSession#cleanup()`` method. Applications embedding embulk as a library needs to call this method at the end of bulk load transaction.
+
+
+Plugin API
+------------------
+
+* Added ``spi.util.TempFileSpace`` and ``spi.Exec.getTempFileSpace``. This utility allows plugins to create temporary files. Because the behavior of cleaning files up is not completely defined yet, it is recommended to test the behavior before deploying code using this API to production.
+* Added ``spi.unit.LocalFile`` class. Plugins can use this class as a mapped value of configuration file when it needs a path to a local file. This class solves a problem that plugins don't work with distributed executor plugins (such as embulk-executor-mapreduce) if the plugins use ``String`` to get a local file path. Using this class, users can also embed contents of the file in the configuration file instead of setting path to a file.
+
+
+Note
+------------------
+
+* This release includes changes around ClassLoader. Most of plugins should work without modification but it's still highly recommended to test your plugins localy before deploying this version to production systems.
+
+
+Release Date
+------------------
+2015-07-01

data/embulk-docs/src/release/release-0.6.17.rst

@@ -0,0 +1,39 @@
+Release 0.6.17
+==================================
+
+General Changes
+------------------
+
+* '-' in generated plugin name is replaed to '_'.
+
+* Package name of generated java plugins changed from org.embulk.<category> to org.embulk.<category>.<plugin name>.
+
+* Generated plugin templates use recommended utility classes by default.
+
+  * java-decode template generator uses InputStreamFileInput.
+
+  * java-encoder template generator uses FileOutputOutputStream.
+
+  * java-file-input template generator uses InputStreamTransactionalFileInput.
+
+  * guess method of generated java-input plugin returns empty config diff rather throwing an exception.
+
+
+Java Plugin API
+------------------
+
+* Added ``spi.Exec.getTransactionTime()``.
+* Added ``spi.util.Timestamps`` utility class. This method is useful to create ``TimestampParser`` and ``TimestampFormatter`` which are configurable by users.
+* Added ``spi.util.InputStreamFileInput.Opener`` interface to open single file.
+* Added ``spi.util.InputStreamFileInput()`` with ``InputStream`` to use a pre-opend stream.
+* Added ``spi.util.InputStreamTransactionalFileInput`` for convenience of ``FileInputPlugin``.
+
+Ruby Plugin API
+------------------
+
+* Added ``FileInput#to_java`` and ``FileOutput#to_java``.
+
+
+Release Date
+------------------
+2015-07-17

data/embulk-docs/src/release/release-0.6.18.rst

@@ -0,0 +1,14 @@
+Release 0.6.18
+==================================
+
+General Changes
+------------------
+
+* Upgraded slf4j-api from 1.7.10 to 1.7.12
+* Upgraded joda-time from 2.7 to 2.8.1
+* Fixed broken plugin template generation of java-filter and ruby (@sakama++)
+* Fixed stacking order of filter plugins. This fixes broken behavior when we use multiple filter plugins.
+
+Release Date
+------------------
+2015-07-22

data/embulk-docs/src/release/release-0.6.19.rst

@@ -0,0 +1,18 @@
+Release 0.6.19
+==================================
+
+Java Plugin API
+------------------
+
+* Added spi.unit.ToStringMap utility class which can be used as a field type of a Task class. ToStringMap is a ``Map<String,String>`` but also accepts non-string values and converts it to string. This fuzzy behavior is useful for options such as ``options``.
+
+
+Embulk Embed API
+------------------
+
+* EmbulkService supports ``overrideModules`` method so that applications can use ``Modules.override`` to override specific injections.
+
+
+Release Date
+------------------
+2015-07-23

data/embulk-docs/src/release/release-0.6.2.rst

@@ -0,0 +1,17 @@
+Release 0.6.2
+==================================
+
+Built-in plugins
+------------------
+
+* ``guess-csv`` guesses charset as ``"MS932"`` instead of ``"Shift_JIS"`` because practically almost all of documents encoded by ``Shift_JIS`` are created by Windows and ``Shift_JIS`` implemented by Microsoft means ``MS932`` in Java. (@kosaki55tea++, @nalsh++)
+* ``parser-csv`` recovers errors by invalid number formats and skips the row rather than making entire transaction failed (@hito4t++)
+
+General Changes
+------------------
+
+* Changed download URL. We can use the consitent URL to download the latest jar.
+
+Release Date
+------------------
+2015-04-13

data/embulk-docs/src/release/release-0.6.20.rst

@@ -0,0 +1,19 @@
+Release 0.6.20
+==================================
+
+Command line interface
+------------------
+
+* Added ``-X key=value`` argument to set system config. This argument is intended to overwrite performance parameters such as number of threads (``max_threads``) or page buffer size (``page_size``).
+
+
+General Changes
+------------------
+
+* Change default size of page buffer from 8KB to 32KB.
+* Size of a page buffer is configurable by system config (@sonots++). On command line, ``embulk`` command accepts ``-X page_size=N[unit]`` argument (e.g. ``-X page_size=512KB``).
+
+
+Release Date
+------------------
+2015-08-03

data/embulk-docs/src/release/release-0.6.21.rst

@@ -0,0 +1,20 @@
+Release 0.6.21
+==================================
+
+Built-in plugins
+------------------
+
+* Added ``filter-rename`` plugin. We can rename name of columns. This plugin has no impact on performance.
+* ``parser-csv`` plugin accepts ``null`` to ``quote`` and ``escape`` options to disable quoting or escaping. This is useful if a file includes ``"`` in a non-quoted value.
+* ``parser-csv`` shows warning if empty string is set to ``quote`` or ``escape`` options. Behavior is kept backward-compatible but it will be rejected in the future.
+
+
+Java Plugin API
+------------------
+
+* Added ``config.DataSource.has`` method to check whether it contains a key or not.
+
+
+Release Date
+------------------
+2015-08-05

data/embulk-docs/src/release/release-0.6.22.rst

@@ -0,0 +1,26 @@
+Release 0.6.22
+==================================
+
+General Changes
+------------------
+
+* Added experimental support for Liquid template engine of configuration files. If configuration file name ends with ``.yml.liquid``, embulk runs embeds variables using Liquid template engine.
+
+Ruby Plugin API
+------------------
+
+* Added ``Embulk.require_classpath`` method to initialize plugin test environment (@cosmo0920++)
+* ``Embulk::ConfigError`` extends ``org.embulk.config.ConfigException``.
+* ``Embulk::DataSource`` raises ``Embulk::ConfigError`` instead of StandardError.
+
+Java Plugin API
+------------------
+
+* Added ``org.embulk.EmbulkEmbed`` to embed Embulk in an applications as a library.
+* Added ``ConfigLoader.newConfigSource`` to create an empty ConfigSource.
+* ``TempFileSpace.cleanup`` deletes files and directories recursively (@cosmo0920++)
+
+
+Release Date
+------------------
+2015-08-11

data/embulk-docs/src/release/release-0.6.23.rst

@@ -0,0 +1,17 @@
+Release 0.6.23
+==================================
+
+General Changes
+------------------
+
+* Fixed ``LoadError: no such file to load -- liquid`` which happens when embulk is loaded by bundler.
+
+Ruby Plugin API
+------------------
+
+* ``Embulk::ConfigError`` extending ``org.embulk.config.ConfigException`` is reverted because of ``exception class/object expected`` error.
+
+
+Release Date
+------------------
+2015-08-13

data/embulk-docs/src/release/release-0.6.24.rst

@@ -0,0 +1,13 @@
+Release 0.6.24
+==================================
+
+General Changes
+------------------
+
+* Fixed error at ``TempFileSpace`` by replacing ``:`` in directory name to ``-`` (@hito4t++)
+* Run test with '-Xmx1024m' to run test on AppVeyor (@cosmo0920++)
+
+
+Release Date
+------------------
+2015-08-15

data/embulk-docs/src/release/release-0.6.25.rst

@@ -0,0 +1,12 @@
+Release 0.6.25
+==================================
+
+General Changes
+------------------
+
+* Disabled liquid template engine because -L option stopped working. Liquid will be reenamed after v0.7.0 which includes major packaging improvements.
+
+
+Release Date
+------------------
+2015-08-16

data/embulk-docs/src/release/release-0.6.3.rst

@@ -0,0 +1,23 @@
+Release 0.6.3
+==================================
+
+Plugin API
+------------------
+
+* Added ``org.embulk.spi.unit.ByteSize`` utility class. Plugins can use this class to allow units such as 'KB' or 'MB' in the configuration file.
+
+Command-line
+------------------
+
+* Added '-L, --load PATH' argument to load a plugin form a local directory.
+
+General Changes
+------------------
+
+* Updated template generator for Java so that generated build.gradle file has ``package`` task to create gemspec file.
+* PreviewExecutor and GuessExecutor unwrap ExecutionException. Error stacktrace becomes simple.
+* EmbulkService creates JRuby runtime and its execution environment for each Injector instances.
+
+Release Date
+------------------
+2015-04-21