embulk 0.6.0 → 0.6.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- checksums.yaml +4 -4
 - data/README.md +24 -9
 - data/build.gradle +1 -1
 - data/embulk-docs/src/conf.py +2 -2
 - data/embulk-docs/src/recipe/scheduled-csv-load-to-elasticsearch-kibana4.rst +1 -1
 - data/embulk-docs/src/release.rst +1 -0
 - data/embulk-docs/src/release/release-0.6.1.rst +11 -0
 - data/lib/embulk/guess/csv.rb +1 -1
 - data/lib/embulk/version.rb +1 -1
 - metadata +5 -4
 
    
        checksums.yaml
    CHANGED
    
    | 
         @@ -1,7 +1,7 @@ 
     | 
|
| 
       1 
1 
     | 
    
         
             
            ---
         
     | 
| 
       2 
2 
     | 
    
         
             
            SHA1:
         
     | 
| 
       3 
     | 
    
         
            -
              metadata.gz:  
     | 
| 
       4 
     | 
    
         
            -
              data.tar.gz:  
     | 
| 
      
 3 
     | 
    
         
            +
              metadata.gz: 6de3d95e030e043dd82676af00373a34a2e50e47
         
     | 
| 
      
 4 
     | 
    
         
            +
              data.tar.gz: 554e7b89b160fe65d540eeffd1dd03403b08fdaf
         
     | 
| 
       5 
5 
     | 
    
         
             
            SHA512:
         
     | 
| 
       6 
     | 
    
         
            -
              metadata.gz:  
     | 
| 
       7 
     | 
    
         
            -
              data.tar.gz:  
     | 
| 
      
 6 
     | 
    
         
            +
              metadata.gz: ad8d669c190e0d468c44803fbf5b4614302e19e582a1f66cf99540a4a00ae1baf9261ad568cd6116c8c22fbefe3a7d1d13585ab25e8cbc38ec79837ce823fd40
         
     | 
| 
      
 7 
     | 
    
         
            +
              data.tar.gz: 562d3cff28a2ba94de942a36e768e20f3205cf44a8b95551223702fce8fe1cfe974eb9ce6c6a8cb4b5416189f9b5dadf0b4c5e2657282c90b0932bf4d9cf955c
         
     | 
    
        data/README.md
    CHANGED
    
    | 
         @@ -30,13 +30,13 @@ Embulk is a Java application. Please make sure that you installed [Java](http:// 
     | 
|
| 
       30 
30 
     | 
    
         
             
            Following 4 commands install embulk to your home directory:
         
     | 
| 
       31 
31 
     | 
    
         | 
| 
       32 
32 
     | 
    
         
             
            ```
         
     | 
| 
       33 
     | 
    
         
            -
            curl --create-dirs -o ~/.embulk/bin/embulk -L https://bintray.com/artifact/download/embulk/maven/embulk-0.6. 
     | 
| 
      
 33 
     | 
    
         
            +
            curl --create-dirs -o ~/.embulk/bin/embulk -L https://bintray.com/artifact/download/embulk/maven/embulk-0.6.1.jar
         
     | 
| 
       34 
34 
     | 
    
         
             
            chmod +x ~/.embulk/bin/embulk
         
     | 
| 
       35 
35 
     | 
    
         
             
            echo 'export PATH="$HOME/.embulk/bin:$PATH"' >> ~/.bashrc
         
     | 
| 
       36 
36 
     | 
    
         
             
            source ~/.bashrc
         
     | 
| 
       37 
37 
     | 
    
         
             
            ```
         
     | 
| 
       38 
38 
     | 
    
         | 
| 
       39 
     | 
    
         
            -
            Next step: [Trying  
     | 
| 
      
 39 
     | 
    
         
            +
            Next step: [Trying the example](#trying-the-example)
         
     | 
| 
       40 
40 
     | 
    
         | 
| 
       41 
41 
     | 
    
         
             
            ### Windows
         
     | 
| 
       42 
42 
     | 
    
         | 
| 
         @@ -45,12 +45,12 @@ Embulk is a Java application. Please make sure that you installed [Java](http:// 
     | 
|
| 
       45 
45 
     | 
    
         
             
            You can assume the jar file is a .bat file.
         
     | 
| 
       46 
46 
     | 
    
         | 
| 
       47 
47 
     | 
    
         
             
            ```
         
     | 
| 
       48 
     | 
    
         
            -
            PowerShell -Command "& {Invoke-WebRequest https://bintray.com/artifact/download/embulk/maven/embulk-0.6. 
     | 
| 
      
 48 
     | 
    
         
            +
            PowerShell -Command "& {Invoke-WebRequest https://bintray.com/artifact/download/embulk/maven/embulk-0.6.1.jar -OutFile embulk.bat}"
         
     | 
| 
       49 
49 
     | 
    
         
             
            ```
         
     | 
| 
       50 
50 
     | 
    
         | 
| 
       51 
     | 
    
         
            -
            Next step: [Trying  
     | 
| 
      
 51 
     | 
    
         
            +
            Next step: [Trying the example](#trying-the-example)
         
     | 
| 
       52 
52 
     | 
    
         | 
| 
       53 
     | 
    
         
            -
            ### Trying  
     | 
| 
      
 53 
     | 
    
         
            +
            ### Trying the example
         
     | 
| 
       54 
54 
     | 
    
         | 
| 
       55 
55 
     | 
    
         
             
            Let's load a CSV file, for example. `embulk example` subcommand generates a csv file and config file for you.
         
     | 
| 
       56 
56 
     | 
    
         | 
| 
         @@ -65,15 +65,30 @@ Next step: [Using plugins](#using-plugins) 
     | 
|
| 
       65 
65 
     | 
    
         | 
| 
       66 
66 
     | 
    
         
             
            ### Using plugins
         
     | 
| 
       67 
67 
     | 
    
         | 
| 
       68 
     | 
    
         
            -
            You can use plugins to load data from/to various systems and file formats.
         
     | 
| 
       69 
     | 
    
         
            -
             
     | 
| 
      
 68 
     | 
    
         
            +
            You can use plugins to load data from/to various systems and file formats. Here is the list of publicly released plugins: [list of plugins by category](http://www.embulk.org/plugins/).
         
     | 
| 
      
 69 
     | 
    
         
            +
             
     | 
| 
      
 70 
     | 
    
         
            +
            An example is [embulk-output-command](https://github.com/embulk/embulk-output-command) plugin. It executes an external command to output the records.
         
     | 
| 
      
 71 
     | 
    
         
            +
             
     | 
| 
      
 72 
     | 
    
         
            +
            To install plugins, you can use `embulk gem install <name>` command:
         
     | 
| 
       70 
73 
     | 
    
         | 
| 
       71 
74 
     | 
    
         
             
            ```
         
     | 
| 
       72 
     | 
    
         
            -
            embulk gem install embulk-output- 
     | 
| 
      
 75 
     | 
    
         
            +
            embulk gem install embulk-output-command
         
     | 
| 
       73 
76 
     | 
    
         
             
            embulk gem list
         
     | 
| 
       74 
77 
     | 
    
         
             
            ```
         
     | 
| 
       75 
78 
     | 
    
         | 
| 
       76 
     | 
    
         
            -
             
     | 
| 
      
 79 
     | 
    
         
            +
            Embulk bundles some built-in plugins such as `embulk-encoder-gzip` or `embulk-formatter-csv`. You can use those plugins with following configuration file:
         
     | 
| 
      
 80 
     | 
    
         
            +
             
     | 
| 
      
 81 
     | 
    
         
            +
            ```
         
     | 
| 
      
 82 
     | 
    
         
            +
            in:
         
     | 
| 
      
 83 
     | 
    
         
            +
              # ...
         
     | 
| 
      
 84 
     | 
    
         
            +
            out:
         
     | 
| 
      
 85 
     | 
    
         
            +
              type: command
         
     | 
| 
      
 86 
     | 
    
         
            +
              command: "cat - > task.$INDEX.$SEQID.csv.gz"
         
     | 
| 
      
 87 
     | 
    
         
            +
              encoders:
         
     | 
| 
      
 88 
     | 
    
         
            +
                - {type: gzip}
         
     | 
| 
      
 89 
     | 
    
         
            +
              formatter:
         
     | 
| 
      
 90 
     | 
    
         
            +
                type: csv
         
     | 
| 
      
 91 
     | 
    
         
            +
            ```
         
     | 
| 
       77 
92 
     | 
    
         | 
| 
       78 
93 
     | 
    
         
             
            ### Using plugin bundle
         
     | 
| 
       79 
94 
     | 
    
         | 
    
        data/build.gradle
    CHANGED
    
    
    
        data/embulk-docs/src/conf.py
    CHANGED
    
    | 
         @@ -53,9 +53,9 @@ copyright = u'2015, Embulk Project' 
     | 
|
| 
       53 
53 
     | 
    
         
             
            # built documents.
         
     | 
| 
       54 
54 
     | 
    
         
             
            #
         
     | 
| 
       55 
55 
     | 
    
         
             
            # The short X.Y version.
         
     | 
| 
       56 
     | 
    
         
            -
            version = '0. 
     | 
| 
      
 56 
     | 
    
         
            +
            version = '0.6'
         
     | 
| 
       57 
57 
     | 
    
         
             
            # The full version, including alpha/beta/rc tags.
         
     | 
| 
       58 
     | 
    
         
            -
            release = '0. 
     | 
| 
      
 58 
     | 
    
         
            +
            release = '0.6'
         
     | 
| 
       59 
59 
     | 
    
         | 
| 
       60 
60 
     | 
    
         
             
            # The language for content autogenerated by Sphinx. Refer to documentation
         
     | 
| 
       61 
61 
     | 
    
         
             
            # for a list of supported languages.
         
     | 
| 
         @@ -56,7 +56,7 @@ You can find the latest embulk binary from the `releases <https://bintray.com/em 
     | 
|
| 
       56 
56 
     | 
    
         | 
| 
       57 
57 
     | 
    
         
             
            .. code-block:: console
         
     | 
| 
       58 
58 
     | 
    
         | 
| 
       59 
     | 
    
         
            -
                $ sudo wget https://bintray.com/artifact/download/embulk/maven/embulk-0.6. 
     | 
| 
      
 59 
     | 
    
         
            +
                $ sudo wget https://bintray.com/artifact/download/embulk/maven/embulk-0.6.1.jar -O /usr/local/bin/embulk
         
     | 
| 
       60 
60 
     | 
    
         
             
                $ sudo chmod +x /usr/local/bin/embulk
         
     | 
| 
       61 
61 
     | 
    
         | 
| 
       62 
62 
     | 
    
         
             
            Step 2. Install Elasticsearch plugin
         
     | 
    
        data/embulk-docs/src/release.rst
    CHANGED
    
    
    
        data/lib/embulk/guess/csv.rb
    CHANGED
    
    | 
         @@ -28,7 +28,7 @@ module Embulk 
     | 
|
| 
       28 
28 
     | 
    
         
             
                  NO_SKIP_DETECT_LINES = 10
         
     | 
| 
       29 
29 
     | 
    
         | 
| 
       30 
30 
     | 
    
         
             
                  def guess_lines(config, sample_lines)
         
     | 
| 
       31 
     | 
    
         
            -
                    return {} unless config.fetch("type", "csv") == "csv"
         
     | 
| 
      
 31 
     | 
    
         
            +
                    return {} unless config.fetch("parser", {}).fetch("type", "csv") == "csv"
         
     | 
| 
       32 
32 
     | 
    
         | 
| 
       33 
33 
     | 
    
         
             
                    delim = guess_delimiter(sample_lines)
         
     | 
| 
       34 
34 
     | 
    
         
             
                    unless delim
         
     | 
    
        data/lib/embulk/version.rb
    CHANGED
    
    
    
        metadata
    CHANGED
    
    | 
         @@ -1,14 +1,14 @@ 
     | 
|
| 
       1 
1 
     | 
    
         
             
            --- !ruby/object:Gem::Specification
         
     | 
| 
       2 
2 
     | 
    
         
             
            name: embulk
         
     | 
| 
       3 
3 
     | 
    
         
             
            version: !ruby/object:Gem::Version
         
     | 
| 
       4 
     | 
    
         
            -
              version: 0.6. 
     | 
| 
      
 4 
     | 
    
         
            +
              version: 0.6.1
         
     | 
| 
       5 
5 
     | 
    
         
             
            platform: ruby
         
     | 
| 
       6 
6 
     | 
    
         
             
            authors:
         
     | 
| 
       7 
7 
     | 
    
         
             
            - Sadayuki Furuhashi
         
     | 
| 
       8 
8 
     | 
    
         
             
            autorequire:
         
     | 
| 
       9 
9 
     | 
    
         
             
            bindir: bin
         
     | 
| 
       10 
10 
     | 
    
         
             
            cert_chain: []
         
     | 
| 
       11 
     | 
    
         
            -
            date: 2015-04- 
     | 
| 
      
 11 
     | 
    
         
            +
            date: 2015-04-09 00:00:00.000000000 Z
         
     | 
| 
       12 
12 
     | 
    
         
             
            dependencies:
         
     | 
| 
       13 
13 
     | 
    
         
             
            - !ruby/object:Gem::Dependency
         
     | 
| 
       14 
14 
     | 
    
         
             
              name: bundler
         
     | 
| 
         @@ -289,6 +289,7 @@ files: 
     | 
|
| 
       289 
289 
     | 
    
         
             
            - embulk-docs/src/release/release-0.5.4.rst
         
     | 
| 
       290 
290 
     | 
    
         
             
            - embulk-docs/src/release/release-0.5.5.rst
         
     | 
| 
       291 
291 
     | 
    
         
             
            - embulk-docs/src/release/release-0.6.0.rst
         
     | 
| 
      
 292 
     | 
    
         
            +
            - embulk-docs/src/release/release-0.6.1.rst
         
     | 
| 
       292 
293 
     | 
    
         
             
            - embulk-standards/build.gradle
         
     | 
| 
       293 
294 
     | 
    
         
             
            - embulk-standards/src/main/java/org/embulk/standards/CsvFormatterPlugin.java
         
     | 
| 
       294 
295 
     | 
    
         
             
            - embulk-standards/src/main/java/org/embulk/standards/CsvParserPlugin.java
         
     | 
| 
         @@ -394,8 +395,8 @@ files: 
     | 
|
| 
       394 
395 
     | 
    
         
             
            - classpath/bval-jsr303-0.5.jar
         
     | 
| 
       395 
396 
     | 
    
         
             
            - classpath/commons-beanutils-core-1.8.3.jar
         
     | 
| 
       396 
397 
     | 
    
         
             
            - classpath/commons-lang3-3.1.jar
         
     | 
| 
       397 
     | 
    
         
            -
            - classpath/embulk-core-0.6. 
     | 
| 
       398 
     | 
    
         
            -
            - classpath/embulk-standards-0.6. 
     | 
| 
      
 398 
     | 
    
         
            +
            - classpath/embulk-core-0.6.1.jar
         
     | 
| 
      
 399 
     | 
    
         
            +
            - classpath/embulk-standards-0.6.1.jar
         
     | 
| 
       399 
400 
     | 
    
         
             
            - classpath/guava-18.0.jar
         
     | 
| 
       400 
401 
     | 
    
         
             
            - classpath/guice-3.0.jar
         
     | 
| 
       401 
402 
     | 
    
         
             
            - classpath/guice-multibindings-3.0.jar
         
     |