embulk 0.8.39-java → 0.10.24-java

data/embulk-docs/src/index.rst

@@ -1,102 +0,0 @@
-.. Embulk documentation master file, created by
-   sphinx-quickstart on Fri Feb 13 14:52:36 2015.
-   You can adapt this file completely to your liking, but it should at least
-   contain the root `toctree` directive.
-
-Embulk
-==================================
-
-.. image:: _static/embulk-logo-v2/embulk-logo-v2-sq-tr-small.png
-   :width: 128px
-   :target: https://github.com/embulk/embulk
-
-Highlights
------------
-
-* Embulk's announcement mailing list (read-only) is ready. Please feel free to subscribe! Embulk core members post important updates such as **key releases**, **compatibility information**, and **feedback requests to users**.
-
-  * `Embulk-announce <https://groups.google.com/forum/#!forum/embulk-announce>`_
-
-
-What's Embulk?
-------------------
-
-Embulk is a open-source bulk data loader that helps data transfer between various databases, storages, file formats, and cloud services.
-
-Embulk supports:
-
-* Automatic guessing of input file formats
-* Parallel & distributed execution to deal with big data sets
-* Transaction control to guarantee All-or-Nothing
-* Resuming
-* Plugins released on RubyGems.org
-
-You can define a bulk data loading using combination of input and output plugins:
-
-.. image:: _static/embulk-architecture.png
-   :width: 640px
-   :target: https://github.com/embulk/embulk#quick-start
-
-For example, `this tutorial <recipe/scheduled-csv-load-to-elasticsearch-kibana5.html>`_ describes how to use **file** input plugin with **csv** parser plugin and **gzip** decoder plugin to read CSV files, and **elasticsearch** output plugin to load the records to Elasticsearch.
-
-Documents
-------------------
-
-* `Quick Start <https://github.com/embulk/embulk#quick-start>`_
-
-  * `Linux <https://github.com/embulk/embulk#linux--mac--bsd>`_
-
-  * `Mac OS X <https://github.com/embulk/embulk#linux--mac--bsd>`_
-
-  * `Windows <https://github.com/embulk/embulk#windows>`_
-
-.. toctree::
-   :maxdepth: 2
-
-   recipe
-
-* `List of Plugins by Category <http://www.embulk.org/plugins/>`_
-
-  * `Input plugins <http://www.embulk.org/plugins/#input>`_
-
-  * `Output plugins <http://www.embulk.org/plugins/#output>`_
-
-  * `File parser plugins <http://www.embulk.org/plugins/#file-parser>`_
-
-  * `File decoder plugins <http://www.embulk.org/plugins/#file-decoder>`_
-
-  * `File formatter plugins <http://www.embulk.org/plugins/#file-formatter>`_
-
-  * `Filter plugins <http://www.embulk.org/plugins/#filter>`_
-
-  * `File encoder plugins <http://www.embulk.org/plugins/#file-encoder>`_
-
-  * `Executor plugins <http://www.embulk.org/plugins/#executor>`_
-
-.. toctree::
-   :maxdepth: 3
-
-   built-in
-
-.. toctree::
-   :maxdepth: 2
-
-   release
-
-   logo
-
-For developers
----------------
-
-* `Github <https://github.com/embulk/embulk>`_
-
-* `JavaDoc <javadoc/index.html>`_
-
-* `RDoc <rdoc/_index.html>`_
-
-* `Other resources for developers <developers/index.html>`_
-
-.. toctree::
-   :maxdepth: 3
-
-   customization

data/embulk-docs/src/logo.rst

@@ -1,27 +0,0 @@
-Logo
-===========================
-
-Feel free to use these logos on your slides, blog posts, etc!
-
-Square
-------------------
-
-.. image:: _static/embulk-logo-v2/embulk-logo-v2-sq-tr.png
-   :scale: 30 %
-
-Horizontal
-------------------
-
-.. image:: _static/embulk-logo-v2/embulk-logo-v2-oneline-tr.png
-   :scale: 30 %
-
-Icon
-------------------
-
-.. image:: _static/embulk-logo-v2/embulk-logo-v2-symbol-tr.png
-   :scale: 30 %
-
-Links
-------------------
-
-* `Full list of files <https://github.com/embulk/embulk/tree/master/embulk-docs/src/_static/embulk-logo-v2/>`_

data/embulk-docs/src/recipe.rst

@@ -1,8 +0,0 @@
-Recipes
-==================================
-
-.. toctree::
-    :maxdepth: 1
-
-    recipe/scheduled-csv-load-to-elasticsearch-kibana5
-

data/embulk-docs/src/recipe/scheduled-csv-load-to-elasticsearch-kibana5.rst

@@ -1,163 +0,0 @@
-Scheduled bulk data loading to Elasticsearch + Kibana 5 from CSV files
-======================================================================
-
-.. contents::
-   :local:
-   :depth: 2
-
-This article shows how to:
-
-* Bulk load CSV files to Elasticsearch.
-* Visualize the data with Kibana interactively.
-* Schedule the data loading every hour using cron.
-
-This guide assumes you are using Ubuntu 16.10 Precise or macOS.
-
-Setup Elasticsearch and Kibana 5
---------------------------------
-
-Step 1. Download and start Elasticsearch.
-~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
-
-You can find releases from the `Elasticsearch website <https://www.elastic.co/downloads/elasticsearch>`_.
-For the smallest setup, you can unzip the package and run `./bin/elasticsearch` command:
-
-.. code-block:: console
-
-    $ wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-5.3.0.zip
-    $ unzip elasticsearch-5.3.0.zip
-    $ cd elasticsearch-5.3.0
-    $ ./bin/elasticsearch
-
-Step 2. Download and unzip Kibana:
-~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
-
-You can find releases from the `Kibana website <https://www.elastic.co/downloads/kibana>`_. Open a new console and run following commands:
-
-.. code-block:: console
-
-    $ wget https://artifacts.elastic.co/downloads/kibana/kibana-5.3.0-linux-x86_64.tar.gz
-    $ tar zxvf kibana-5.3.0-linux-x86_64.tar.gz
-    $ cd kibana-5.3.0-linux-x86_64
-    $ ./bin/kibana
-
-Note: If you're using macOS, https://artifacts.elastic.co/downloads/kibana/kibana-5.3.0-darwin-x86_64.tar.gz is the URL to download.
-
-Now Elasticsearch and Kibana started. Open http://localhost:5601/ using your browser to see the Kibana's graphical interface.
-
-
-Setup Embulk
-------------
-
-Step 1. Download Embulk binary:
-~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
-
-You can find the latest embulk binary from the `releases <https://bintray.com/embulk/maven/embulk/view#files>`_. Because Embulk is a single executable binary, you can simply download it to ~/.embulk/bin directory and set executable flag as following:
-
-.. code-block:: console
-
-    $ curl --create-dirs -o ~/.embulk/bin/embulk -L "https://dl.embulk.org/embulk-latest.jar"
-    $ chmod +x ~/.embulk/bin/embulk
-    $ echo 'export PATH="$HOME/.embulk/bin:$PATH"' >> ~/.bashrc
-    $ source ~/.bashrc
-
-Step 2. Install Elasticsearch plugin
-~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
-
-You also need Elasticsearch plugin for Embulk. You can install the plugin with this command:
-
-.. code-block:: console
-
-    $ embulk gem install embulk-output-elasticsearch
-
-Embulk includes CSV file reader in itself. Now everything is ready to use.
-
-Loading a CSV file
-------------------
-
-Assuming you have a CSV files at ``./mydata/csv/`` directory. If you don't have CSV files, you can create ones using ``embulk example ./mydata`` command.
-
-Create this configuration file and save as ``seed.yml``:
-
-.. code-block:: yaml
-
-    in:
-      type: file
-      path_prefix: ./mydata/csv/
-    out:
-      type: elasticsearch
-      index: embulk
-      index_type: embulk
-      nodes:
-        - host: localhost
-
-In fact, this configuration lacks some important information. However, embulk guesses the other information. So, next step is to order embulk to guess them:
-
-.. code-block:: console
-
-    $ embulk guess ./mydata/seed.yml -o config.yml
-
-The generated config.yml file should include complete information as following:
-
-.. code-block:: yaml
-
-    in:
-      type: file
-      path_prefix: ./mydata/csv/
-      decoders:
-      - {type: gzip}
-      parser:
-        charset: UTF-8
-        newline: CRLF
-        type: csv
-        delimiter: ','
-        quote: '"'
-        escape: ''
-        null_string: 'NULL'
-        skip_header_lines: 1
-        columns:
-        - {name: id, type: long}
-        - {name: account, type: long}
-        - {name: time, type: timestamp, format: '%Y-%m-%d %H:%M:%S'}
-        - {name: purchase, type: timestamp, format: '%Y%m%d'}
-        - {name: comment, type: string}
-    out:
-      type: elasticsearch
-      index: embulk
-      index_type: embulk
-      nodes:
-      - {host: localhost}
-
-Note: If the CSV file contains timestamp in local time zone, set default_timezone parameter to parser config as following (since time zone is assumed as UTC by default).
-
-.. code-block:: yaml
-
-      parser:
-        default_timezone: 'Asia/Tokyo'
-
-Now, you can run the bulk loading:
-
-.. code-block:: console
-
-    $ embulk run config.yml -c diff.yml
-
-Scheduling loading by cron
---------------------------
-
-At the last step, you ran embulk command with ``-c diff.yml`` file. The ``diff.yml`` file should include a parameter named ``last_path``:
-
-.. code-block:: yaml
-
-    in: {last_path: mydata/csv/sample_01.csv.gz}
-    out: {}
-
-With this configuration, embulk loads the files newer than this file in alphabetical order.
-
-For example, if you create ``./mydata/csv/sample_02.csv.gz`` file, embulk skips ``sample_01.csv.gz`` file and loads ``sample_02.csv.gz`` only next time. And the next ``diff.yml`` file has ``last_path: mydata/csv/sample_02.csv.gz`` for the next next execution.
-
-So, if you want to loads newly created files every day, you can setup this cron schedule:
-
-.. code-block:: text
-
-    0 * * * * embulk run /path/to/config.yml -c /path/to/diff.yml
-

data/embulk-docs/src/release.rst

@@ -1,109 +0,0 @@
-Release Notes
-==================================
-
-.. toctree::
-    :maxdepth: 1
-
-    release/release-0.8.39
-    release/release-0.8.38
-    release/release-0.8.37
-    release/release-0.8.36
-    release/release-0.8.35
-    release/release-0.8.34
-    release/release-0.8.33
-    release/release-0.8.32
-    release/release-0.8.31
-    release/release-0.8.30
-    release/release-0.8.29
-    release/release-0.8.28
-    release/release-0.8.27
-    release/release-0.8.26
-    release/release-0.8.25
-    release/release-0.8.24
-    release/release-0.8.23
-    release/release-0.8.22
-    release/release-0.8.21
-    release/release-0.8.20
-    release/release-0.8.19
-    release/release-0.8.18
-    release/release-0.8.17
-    release/release-0.8.16
-    release/release-0.8.15
-    release/release-0.8.14
-    release/release-0.8.13
-    release/release-0.8.12
-    release/release-0.8.11
-    release/release-0.8.10
-    release/release-0.8.9
-    release/release-0.8.8
-    release/release-0.8.7
-    release/release-0.8.6
-    release/release-0.8.5
-    release/release-0.8.4
-    release/release-0.8.3
-    release/release-0.8.2
-    release/release-0.8.1
-    release/release-0.8.0
-    release/release-0.7.11
-    release/release-0.7.10
-    release/release-0.7.9
-    release/release-0.7.8
-    release/release-0.7.7
-    release/release-0.7.6
-    release/release-0.7.5
-    release/release-0.7.4
-    release/release-0.7.3
-    release/release-0.7.2
-    release/release-0.7.1
-    release/release-0.7.0
-    release/release-0.6.27
-    release/release-0.6.26
-    release/release-0.6.25
-    release/release-0.6.24
-    release/release-0.6.23
-    release/release-0.6.22
-    release/release-0.6.21
-    release/release-0.6.20
-    release/release-0.6.19
-    release/release-0.6.18
-    release/release-0.6.17
-    release/release-0.6.16
-    release/release-0.6.15
-    release/release-0.6.14
-    release/release-0.6.13
-    release/release-0.6.12
-    release/release-0.6.11
-    release/release-0.6.10
-    release/release-0.6.9
-    release/release-0.6.8
-    release/release-0.6.7
-    release/release-0.6.6
-    release/release-0.6.5
-    release/release-0.6.4
-    release/release-0.6.3
-    release/release-0.6.2
-    release/release-0.6.1
-    release/release-0.6.0
-    release/release-0.5.5
-    release/release-0.5.4
-    release/release-0.5.3
-    release/release-0.5.2
-    release/release-0.5.1
-    release/release-0.5.0
-    release/release-0.4.10
-    release/release-0.4.9
-    release/release-0.4.8
-    release/release-0.4.7
-    release/release-0.4.6
-    release/release-0.4.5
-    release/release-0.4.4
-    release/release-0.4.3
-    release/release-0.4.2
-    release/release-0.4.1
-    release/release-0.4.0
-    release/release-0.3.2
-    release/release-0.3.1
-    release/release-0.3.0
-    release/release-0.2.1
-    release/release-0.2.0
-    release/release-0.1.0

data/embulk-docs/src/release/release-0.1.0.rst

@@ -1,8 +0,0 @@
-Release 0.1.0
-==================================
-
-The first release.
-
-Release Date
----------------
-2015-01-26

data/embulk-docs/src/release/release-0.2.0.rst

@@ -1,16 +0,0 @@
-Release 0.2.0
-==================================
-
-Plugin API
-------------------
-
-* Changed JRuby InputPlugin API to use #run instead of .run
-
-CLI
-------------------
-
-* Fixed ``example`` subcommand to quote file path for Windows environment
-
-Release Date
-------------------
-2015-01-26

data/embulk-docs/src/release/release-0.2.1.rst

@@ -1,19 +0,0 @@
-Release 0.2.1
-==================================
-
-Plugin Utility
-------------------
-
-* Fixed ``spi.util.LineEncoder#finish`` to flush all remaining buffer (reported by @aibou)
-* ``Embulk::PageBuilder#add`` accepts nil value
-
-General Changes
-------------------
-
-* Fixed NextConfig to be merged to in: or out: rather than the top-level
-  (reported by enukane) [#41]
-* ./bin/embulk shows warns to run `rake` if ./classpath doesn't exist
-
-Release Date
-------------------
-2015-01-29