embulk 0.8.39-java → 0.10.24-java

data/embulk-docs/src/release/release-0.7.3.rst

@@ -1,21 +0,0 @@
-Release 0.7.3
-==================================
-
-General Changes
-------------------
-
-* ``embulk selfupdate`` command gets optoinal ``<version>`` argument to upgrade or downgrade to specific version (@cosmo0920++).
-* ``embulk migrate`` command assumes that source code file encoding is UTF-8. This fixes encoding exception on Windows environment.
-
-
-Java Plugin API
-------------------
-
-* Fixed ``Embulk::Exec.preview?``.
-* Fixed ``raise ConfigException``.
-* added missing ``PluginLoadError`` class.
-
-
-Release Date
-------------------
-2015-08-23

data/embulk-docs/src/release/release-0.7.4.rst

@@ -1,14 +0,0 @@
-Release 0.7.4
-==================================
-
-General Changes
-------------------
-
-* Added ``--log PATH`` command line option to output log messages to a file.
-* Fixed ``-R`` command line option handling to pass it to JRuby.
-* Fixed gem installation failure when a gem includes native extension.
-
-
-Release Date
-------------------
-2015-08-29

data/embulk-docs/src/release/release-0.7.5.rst

@@ -1,22 +0,0 @@
-Release 0.7.5
-==================================
-
-General Changes
-------------------
-
-* ``guess`` uses guess plugins configured at ``guess_plugins: [string]`` in ``exec:`` section in addition to ``-g, --guess NAMES`` command line argument.
-* ``guess`` doesn't create unnecessary ``exec:`` section.
-* Fixed timestamp deserialization error happens when a bulkload fails and cleanup runs.
-* Fixed permissions of files generated by ``new`` command.
-
-
-Built-in plugins
-------------------
-
-* ``guess-csv``: Guesses header line as much as possible when all column types are string or boolean
-* ``parser-csv``: Fixed line number shown in 'Skipped line' warning message
-
-
-Release Date
-------------------
-2015-10-01

data/embulk-docs/src/release/release-0.7.6.rst

@@ -1,18 +0,0 @@
-Release 0.7.6
-==================================
-
-General Changes
-------------------
-
-* On Cygwin/Windows environment, embulk command returns exit code 1 correctly if a transaction fails (@hishidama++)
-
-
-Built-in plugins
-------------------
-
-* ``formatter-csv``: fixed a problem where a ``"`` character is escaped when ``quote_plicy: NONE`` is set. The fixed behavior is that, if ``quote_plicy: NONE`` is set, ``quote`` option (which means ``"`` character) is completely ignored, and only newline and delimiter are escaped ([#327] @sonots++).
-
-
-Release Date
-------------------
-2015-10-27

data/embulk-docs/src/release/release-0.7.7.rst

@@ -1,13 +0,0 @@
-Release 0.7.7
-==================================
-
-General Changes
-------------------
-
-* Configuration file can use ``{% include 'path' %}`` tag to include another file. This is very useful to organize a complex configuration from multiple files. See documents for details.
-* Fixed compatibility with mapreduce executor. Failure message includes appropriate cause instead of IllegalStateException.
-
-
-Release Date
-------------------
-2015-10-28

data/embulk-docs/src/release/release-0.7.8.rst

@@ -1,14 +0,0 @@
-Release 0.7.8
-==================================
-
-General Changes
-------------------
-
-* Added "mkbundle" subcommand. Its help message shows how to use plugin bundles with examples.
-* When a transaction throws an exception and cleanup code (close() method) also throws an exception, the exception of transaction was hidden. Now the exception of transaction is the primary error and exception of cleanup code is also included as a suppressed exception.
-* CSV parser plugin doesn't show lines twice with "Unexpected extra character" error.
-
-
-Release Date
-------------------
-2015-11-08

data/embulk-docs/src/release/release-0.7.9.rst

@@ -1,14 +0,0 @@
-Release 0.7.9
-==================================
-
-General Changes
-------------------
-
-* Liquid template engine uses strict validation. When a liquid template file includes an error (e.g. included file does not exist), embulk command fails rather than including an error message in the config file (@notpeter++).
-* Fixed liquid template engine processing.
-* Fixed ``embulk bundle --help`` and ``embulk bundle help <command>`` to work.
-
-
-Release Date
-------------------
-2015-11-11

data/embulk-docs/src/release/release-0.8.0.rst

@@ -1,74 +0,0 @@
-Release 0.8.0
-==================================
-
-JSON type
-------------------
-
-Embulk v0.8.0 added JSON type support.
-
-* A column with ``json`` type can represent nested values such as maps or arrays. This is useful when both input and output support dynamically-typed values.
-
-* **IMPORTANT**: If input plugin uses JSON type but output plugin is compiled with an old embulk (< 0.8.0), a bulk load transaction fails with a confusing error message. To avoid this issue, please run ``embulk migrate /path/to/embulk-plugin-directory`` to upgrade plugin code, and use the latest plugin. This problem doesn't happen if input plugin doesn't use json type.
-
-* Filter plugins to process JSON types are not ready yet. Expected plugins are for example, flatten a json column into statically-typed columns with guess plugin, extracting a value from a json column using an expression (such as JSONPath) and set it to another column, or building a json column by copying values from other columns.
-
-Page scattering
-------------------
-
-Local executor plugin (the default executor) runs multiple tasks even if there is only 1 input task. This improves performance a lot especially if input is a single huge file.
-
-* Its mechanism is that the executor creates 2, 3, 4, or more number of output tasks for each input task. Page chunks from a input task is scattered to output tasks. All of the tasks run in parallel using threads. This feature is called "page scattering".
-
-* Added ``min_output_tasks`` option at ``exec:`` section. Default is 1x of available CPU cores. Page scattering is enabled if number of input tasks is less than this ``min_output_tasks`` option. Setting larger number here is useful if embulk doesn't use multi-threading with enough concurrency due to too few number of input tasks.
-
-* Added ``max_threads`` option at ``exec:`` section. Default is 2x of availalbe CPU cores. This option controls maximum concurrency. Setting smaller number here is useful if too many threads make the destination or source storage overloaded. Setting larger number here is useful if CPU utilization is too low due to high latency.
-
-* The results of output transaction will be deterministic. There're no randomness that depends on timing. However, task assignment changes if ``min_output_tasks`` changes. If you need deterministic results regardless of machines that may have different number of CPU cores, please add ``min_output_tasks`` option to ``exec:`` section. Setting 1 there will disable page scattering completely.
-
-General Changes
-------------------
-
-* YAML configuration parser uses stricter rules when it converts type of a non-quoted strings.
-
-  * Strings starting with 0 such as 019 or 0819 will be a string instead of float.
-
-  * Strings looks like a timestamp such as 2015-01-01 will be a string instead of UNIX timestamp.
-
-  * On, Off, Yes, and No (case-insensitive) will be a string instead of boolean. Only true, True, false, False are recognized as a boolean.
-
-* Upraded JRuby version to 9.0.4.0.
-
-Java Plugin API
-------------------
-
-* Added ``org.embulk.spi.json.JsonParser`` class to parse a String into an internal representation of a JSON value (org.msgpack.value.Value). Usage of this class is similar to TimestampParser.
-
-* Added ``jsonColumn`` method to ``org.embulk.spi.ColumnVisitor``. At an input plugin or parser plugin, please implement this method using above JsonParser class and ``PageBuilder#stJson`` method. At an output plugin or formatter plugin, you can use ``org.msgpack.value.Value#toJson`` method to convert it to a JSON string.
-
-* Upgraded gradle version to 2.10. ``embulk migrate`` upgrades gradle version of your plugins.
-
-* ``embulk new`` and ``embulk migrate`` adds checkstyle configuration for Java plugins. ``./gradlew checkstyle`` checks code styles.
-
-
-Run Plugin API
-------------------
-
-* ``PageBuilder#add`` accepts a nested object (Hash or Array) when the column type is json.
-
-  * Internally, the value is serialized using MessagePack and passed to Java components through JRuby interface.
-
-* ``page.each`` method will give an nested object (Hash or Array) if the column type is json.
-
-
-Built-in plugins
-------------------
-
-* ``parser-cvs`` and ``guess-csv`` plugins support JSON type. JSON type will be automatically guessed.
-
-* ``formatter-csv`` supports JSON type. JSON column is serialized into a string using JSON format (``Value#toJson()``).
-
-* ``formatter-stdout`` supports JSON type. JSON column is serialized into a string using string representation of Value (``Value#toString()``). This is slightly different from JSON but can represent some superset of json such as non-string keys of objects.
-
-Release Date
-------------------
-2016-01-13

data/embulk-docs/src/release/release-0.8.1.rst

@@ -1,18 +0,0 @@
-Release 0.8.1
-==================================
-
-General Changes
-------------------
-
-* Ruby-based plugins use ``>=`` instead of ``~>`` to depend on bundler and embulk so that users can use both older plugins and newer plugins together. This assumes major versions of those dependencies most likely don't break backward compatibility.
-
-* Added bulit-in dependency to msgpack.gem v0.7.4 which is used to support json types at ruby plugins.
-
-* Fixed json value creation using ruby-based parser and input plugins.
-
-* Fixed preview of json types.
-
-
-Release Date
-------------------
-2016-01-13

data/embulk-docs/src/release/release-0.8.10.rst

@@ -1,35 +0,0 @@
-Release 0.8.10
-==================================
-
-General Changes
-------------------
-
-* Fixed 'IllegalArgumentException: Self-suppression not permitted' error (@hata++) [#446]
-
-* Fixed preview not to read the entire file when the parser doesn't produce records. Now preview reads first 32KB.
-
-* Updated JRuby from 9.0.4.0 to 9.1.2.0. Release notes:
-
-  * http://jruby.org/2016/01/26/jruby-9-0-5-0.html
-
-  * http://jruby.org/2016/05/03/jruby-9-1-0-0.html
-
-  * http://jruby.org/2016/05/19/jruby-9-1-1-0.html
-
-  * http://jruby.org/2016/05/27/jruby-9-1-2-0.html
-
-* Updated msgpack-java from 0.8.7 to 0.8.8. Release notes
-
-  * https://github.com/msgpack/msgpack-java/blob/0.8.8/RELEASE_NOTES.md
-
-Built-in plugins
-------------------
-
-* ``csv`` parser plugin supports delimiters longer than 1 character.
-
-* ``csv`` parser doesn't convert non-quoted empty string into NULL any more when null_string is set. Default behavior is not changed (convert non-quoted empty string into NULL).
-
-
-Release Date
-------------------
-2016-07-21

data/embulk-docs/src/release/release-0.8.11.rst

@@ -1,12 +0,0 @@
-Release 0.8.11
-==================================
-
-General Changes
-------------------
-
-* Fixed ``undefined method `jar_path' for Gem:Module`` that may happen when ``embulk gem`` command installs dependent gem libraries recursively.
-
-
-Release Date
-------------------
-2016-07-25

data/embulk-docs/src/release/release-0.8.12.rst

@@ -1,12 +0,0 @@
-Release 0.8.12
-==================================
-
-General Changes
-------------------
-
-* Improved guessing so that type of a column to long if the column includes integers and timestmap-looking integers. It was guessed as string before.
-
-
-Release Date
-------------------
-2016-08-03

data/embulk-docs/src/release/release-0.8.13.rst

@@ -1,12 +0,0 @@
-Release 0.8.13
-==================================
-
-CLI Changes
-------------------
-
-* Fixed -L option that became incompatible with JRuby 9.1.2.
-
-
-Release Date
-------------------
-2016-08-12

data/embulk-docs/src/release/release-0.8.14.rst

@@ -1,31 +0,0 @@
-Release 0.8.14
-==================================
-
-General Changes
-------------------
-
-* Improved IOException handling within ResumableInputStream#reopen method. [#470]
-
-* Added "rules" config option to rename filter plugin. It allows users to specify rule based policy to rename columns. [#483]
-
-* Added "csv_all_strings" guess plugin, which suggests columns in csv files as string typed columns. [#489]
-
-* Updated JRuby from 9.1.2.0 to 9.1.5.0. Release notes:
-
-  * http://jruby.org/2016/08/30/jruby-9-1-3-0.html
-
-  * http://jruby.org/2016/09/01/jruby-9-1-4-0.html
-
-  * http://jruby.org/2016/09/06/jruby-9-1-5-0.html
-
-* Updated msgpack-java from 0.8.8 to 0.8.11. Release notes
-
-  * https://github.com/msgpack/msgpack-java/blob/0.8.9/RELEASE_NOTES.md
-
-  * https://github.com/msgpack/msgpack-java/blob/0.8.10/RELEASE_NOTES.md
-
-  * https://github.com/msgpack/msgpack-java/blob/0.8.11/RELEASE_NOTES.md
-
-Release Date
-------------------
-2016-10-21

data/embulk-docs/src/release/release-0.8.15.rst

@@ -1,17 +0,0 @@
-Release 0.8.15
-==================================
-
-General Changes
-------------------
-
-* Added several rules option to rename filter plugin. [#494]
-
-  * http://www.embulk.org/docs/built-in.html#rename-filter-plugin
-
-* Introduced SkipTransactionException to stop Embulk before the transaction starts. [#498]
-
-* Added embulk-test package, which is an utility library to be used from the test cases of Java-based input plugins. [#503]
-
-Release Date
-------------------
-2016-11-04

data/embulk-docs/src/release/release-0.8.16.rst

@@ -1,43 +0,0 @@
-Release 0.8.16
-==================================
-
-General Changes
-------------------
-
-* Added remove_columns filter plugin [#530]
-
-  * http://www.embulk.org/docs/built-in.html#remove_columns-filter-plugin
-
-* Supported timestamp format "%Q". (@hiroyuki-sato) [#468, #531]
-
-* Improved csv guess plugin:
-
-  * Added semicolon as delimiter suggest candidate in csv guess plugin. [#527]
-
-  * Enabled suggesting for a few rows [#533]
-
-  * Enabled suggesting for a single column [#540]
-
-* Changed and removed limitation of minimum 40 bytes size limit of guessing. [#518]
-
-* Refactored and introduced TestingEmbulk#{Input,Parser,Output}Builder to embulk-test. [#513, #514, #526]
-
-* Fixed PageBuilder to avoid NullPointerException. [#535]
-
-* Fixed ResumableInputStream to avoid NullPointerException. [#472]
-
-* Fixed TaskValidationException to inherit ConfigException. [#520]
-
-* Fixed build.gradle to use Task.doLast instead of Task.leftShift. [#536]
-
-* Fixed build failure on AppVeyor by FileNotFoundException. [#537]
-
-* Added updateJRuby task to make it easy to upgrade version of JRuby. [#538]
-
-* Upgraded gradle v3.2.1. [#528]
-
-  * Release notes: https://docs.gradle.org/3.2.1/release-notes
-
-Release Date
-------------------
-2017-01-27

data/embulk-docs/src/release/release-0.8.17.rst

@@ -1,11 +0,0 @@
-Release 0.8.17
-==================================
-
-General Changes
-------------------
-
-* Fix how to change Java type for mapping Json numbers within JsonParser. [#547]
-
-Release Date
-------------------
-2017-02-17

data/embulk-docs/src/release/release-0.8.18.rst

@@ -1,27 +0,0 @@
-Release 0.8.18
-==================================
-
-General Changes
-------------------
-
-* Fixed schema guess plugin and changed a condition to guess double type. [#554]
-
-* Fixed guess plugin that doesn't not use last line in sample_lines for schema guess. [#551]
-
-* Fixed Json parser plugin that enables to parse non numeric numbers as floating number values. [#548]
-
-* Updated msgpack-ruby v1.1.0 (@hiroyuki-sato) [#539, #553]
-
-  * ChangeLog: https://github.com/msgpack/msgpack-ruby/blob/master/ChangeLog
-
-* Downgraded netty-buffer 4.0.x for Embulk instead of 5.x. [#549]
-
-* Minor fix:
-
-  * Fixed typos in v0.7.8 release note. (@yoshihara) [#552]
-
-  * Updated download link to be https. (@cosmok) [#544]
-
-Release Date
-------------------
-2017-03-06

data/embulk-docs/src/release/release-0.8.19.rst

@@ -1,43 +0,0 @@
-Release 0.8.19
-==================================
-
-General Changes
-------------------
-
-* Fixed LocalFileInputPlugin to follow link if path prefix is symlink. (@hiroyuki-sato) [#585]
-
-* Fixed CsvParserPlugin to refresh the number of skipped header lines for each file. [#567]
-
-* Fixed embulk/guess/csv.rb to finish immidiately if CSV parser could not parse sample_lines. [#556]
-
-* Fixed PageBuilder to avoid saving unexpected string values saving to stringReferences. [#598]
-
-* Fixed PreviewExecutor to avoid to call SamplingPageOutput#finish twice. [#571]
-
-* Fixed TempFileSpace to change temporary filename format for Windows safe. (@hiroyuki-sato) [#589]
-
-* Added 'preview_sample_buffer_bytes' option for 'preview' command to make sampling buffer bytes configurable. [#572]
-
-* Added 'guess_sample_buffer_bytes' option for 'guess' command to make sampling buffer bytes configurable. [#594]
-
-* Updated snakeyaml from 1.14 to 1.18. (@hiroyuki-sato) [#575]
-
-* Updated liquid from 3.0.6 to 4.0.0. (@hiroyuki-sato)  [#587]
-
-* Minor fix:
-
-  * Removed lib/embulk/command/embulk_generate_bin.rb that is not called anywhere. [#578]
-
-  * Deprecated lib/embulk/version.rb 'Embulk::VERSION', and used the jar manifest (META-INF/MANIFEST.MF) to provide the Embulk version at runtime [#596, #597]
-
-  * Rewrote the "example" subcommand in Java. [#558]
-
-  * Rewrote the "selfupdate" subcommand in Java. [#563]
-
-  * Rewrote the "migrate" subcommand in Java. [#568]
-
-  * Rewrote the "new" subcommand in Java. [#569]
-
-Release Date
-------------------
-2017-05-12