fluent-plugin-elasticsearch 3.5.4 → 3.5.5

Sign up to get free protection for your applications and to get access to all the features.
Files changed (34) hide show
  1. checksums.yaml +4 -4
  2. data/.coveralls.yml +2 -2
  3. data/.editorconfig +9 -9
  4. data/.gitignore +18 -18
  5. data/.travis.yml +18 -18
  6. data/CONTRIBUTING.md +24 -0
  7. data/Gemfile +9 -9
  8. data/History.md +402 -390
  9. data/ISSUE_TEMPLATE.md +30 -27
  10. data/LICENSE.txt +201 -201
  11. data/PULL_REQUEST_TEMPLATE.md +10 -10
  12. data/README.md +1539 -1515
  13. data/Rakefile +11 -11
  14. data/appveyor.yml +30 -30
  15. data/fluent-plugin-elasticsearch.gemspec +31 -31
  16. data/lib/fluent/log-ext.rb +38 -38
  17. data/lib/fluent/plugin/elasticsearch_constants.rb +13 -13
  18. data/lib/fluent/plugin/elasticsearch_error.rb +5 -5
  19. data/lib/fluent/plugin/elasticsearch_error_handler.rb +127 -122
  20. data/lib/fluent/plugin/elasticsearch_index_template.rb +112 -112
  21. data/lib/fluent/plugin/elasticsearch_simple_sniffer.rb +10 -10
  22. data/lib/fluent/plugin/filter_elasticsearch_genid.rb +25 -25
  23. data/lib/fluent/plugin/oj_serializer.rb +22 -22
  24. data/lib/fluent/plugin/out_elasticsearch.rb +778 -777
  25. data/lib/fluent/plugin/out_elasticsearch_dynamic.rb +262 -262
  26. data/test/helper.rb +24 -24
  27. data/test/plugin/test_alias_template.json +8 -8
  28. data/test/plugin/test_elasticsearch_error_handler.rb +525 -503
  29. data/test/plugin/test_filter_elasticsearch_genid.rb +44 -44
  30. data/test/plugin/test_out_elasticsearch.rb +2744 -2720
  31. data/test/plugin/test_out_elasticsearch_dynamic.rb +1001 -1001
  32. data/test/plugin/test_template.json +23 -23
  33. data/test/test_log-ext.rb +35 -35
  34. metadata +4 -4
checksums.yaml CHANGED
@@ -1,7 +1,7 @@
1
1
  ---
2
2
  SHA256:
3
- metadata.gz: ed19ef5787d0bc17e067bbfdb9986b51e4e80f18b9cdce5409329502ae43442f
4
- data.tar.gz: 992c701bf05aec15e10627c0bfd3fd3cc6b4919408b71a7219db2fb756cdbd5e
3
+ metadata.gz: 15eef0c037d870e4d2aed6f8be745c091c2ee2afbb0f43b65f1de5950fd5d2f6
4
+ data.tar.gz: 46b5d7cfd290ff1a8ef538b508f657a82eab00ec56efdad2367fc3edddff022f
5
5
  SHA512:
6
- metadata.gz: 8ff1a3deca33be0d6226b895dcd27823006e7cf8492ad1ee247f29140b5d5206b7f0440dbdadadb16b4b01de7872d7935e1c69f8d3d909528dcc2b8eaf97bf7c
7
- data.tar.gz: f09d12778f99b082f2d38b614b8e01fd1dca913dab2429af576433a9ca78d03eb26266712aeed596e4889622d3a52a4a36dd2fb2987289c43ce6cc4006b85ad0
6
+ metadata.gz: 8b25f7061cf50d0eb7bc9cf0f157de35c528726c356decbd633ad65b58a8494eaeb15c2ab61476d85231e947d85c2e3a738c94cd10ba5d30196882d8c00f5591
7
+ data.tar.gz: d0a82495ab8ed69725bb9581bf04983db8359fe5c5fbc401e5e8be9b16773942f2f6b58167ed051ec65624ac2daa28344ff1319f97d42d3a8c7c2ae68a944c9d
data/.coveralls.yml CHANGED
@@ -1,2 +1,2 @@
1
- service_name: travis-ci
2
-
1
+ service_name: travis-ci
2
+
data/.editorconfig CHANGED
@@ -1,9 +1,9 @@
1
- # EditorConfig: http://EditorConfig.org
2
-
3
- root = true
4
-
5
- [*]
6
- end_of_line = lf
7
- insert_final_newline = true
8
- indent_style = space
9
- indent_size = 2
1
+ # EditorConfig: http://EditorConfig.org
2
+
3
+ root = true
4
+
5
+ [*]
6
+ end_of_line = lf
7
+ insert_final_newline = true
8
+ indent_style = space
9
+ indent_size = 2
data/.gitignore CHANGED
@@ -1,18 +1,18 @@
1
- *.gem
2
- *.rbc
3
- .bundle
4
- .config
5
- .yardoc
6
- Gemfile.lock
7
- InstalledFiles
8
- _yardoc
9
- coverage
10
- doc/
11
- lib/bundler/man
12
- pkg
13
- rdoc
14
- spec/reports
15
- test/tmp
16
- test/version_tmp
17
- tmp
18
- .DS_Store
1
+ *.gem
2
+ *.rbc
3
+ .bundle
4
+ .config
5
+ .yardoc
6
+ Gemfile.lock
7
+ InstalledFiles
8
+ _yardoc
9
+ coverage
10
+ doc/
11
+ lib/bundler/man
12
+ pkg
13
+ rdoc
14
+ spec/reports
15
+ test/tmp
16
+ test/version_tmp
17
+ tmp
18
+ .DS_Store
data/.travis.yml CHANGED
@@ -1,18 +1,18 @@
1
- language: ruby
2
-
3
- rvm:
4
- - 2.1
5
- - 2.2
6
- - 2.3
7
- - 2.4.5
8
- - 2.5.3
9
- - 2.6.0
10
-
11
- gemfile:
12
- - Gemfile
13
-
14
- before_install:
15
- - gem update --system=2.7.8
16
-
17
- script: bundle exec rake test
18
- sudo: false
1
+ language: ruby
2
+
3
+ rvm:
4
+ - 2.1
5
+ - 2.2
6
+ - 2.3
7
+ - 2.4.5
8
+ - 2.5.3
9
+ - 2.6.0
10
+
11
+ gemfile:
12
+ - Gemfile
13
+
14
+ before_install:
15
+ - gem update --system=2.7.8
16
+
17
+ script: bundle exec rake test
18
+ sudo: false
data/CONTRIBUTING.md ADDED
@@ -0,0 +1,24 @@
1
+ Contributing to fluent-plugin-elasticsearch
2
+ ===
3
+
4
+ We'd love your contribution. Here are the guidelines!
5
+
6
+ ## Got a question or problem?
7
+
8
+ RESOURCES of [Official site's documentation](https://docs.fluentd.org/output/elasticsearch) and [ES plugin documentation](https://github.com/uken/fluent-plugin-elasticsearch/blob/master/README.md) may help you.
9
+
10
+ If you have further questions about ES plugin, feel free to [open an Issue](https://github.com/uken/fluent-plugin-elasticsearch/issues).
11
+
12
+ ## Found a bug?
13
+
14
+ If you find a bug of ES plugin or a mistake in the documentation, you can help us by submitting an issue to ES plugin. Even better you can submit a pull request with a fix.
15
+
16
+ Note: Please follow the issue template/pull request template when sending your issue. Otherwise, your issue _might going to be closed with no response_.
17
+
18
+ ## Patch Guidelines
19
+
20
+ Here are some things that would increase a chance that your patch is accepted:
21
+
22
+ * Write tests
23
+ * Run tests before sending pull request with `bundle exec rake test`
24
+ * Write [a good commit message](https://tbaggery.com/2008/04/19/a-note-about-git-commit-messages.html)
data/Gemfile CHANGED
@@ -1,9 +1,9 @@
1
- source 'https://rubygems.org'
2
-
3
- # Specify your gem's dependencies in fluent-plugin-elasticsearch.gemspec
4
- gemspec
5
-
6
- gem 'simplecov', require: false
7
- gem 'coveralls', require: false
8
- gem 'strptime', require: false if RUBY_ENGINE == "ruby" && RUBY_VERSION =~ /^2/
9
- gem "irb" if RUBY_ENGINE == "ruby" && RUBY_VERSION >= "2.6"
1
+ source 'https://rubygems.org'
2
+
3
+ # Specify your gem's dependencies in fluent-plugin-elasticsearch.gemspec
4
+ gemspec
5
+
6
+ gem 'simplecov', require: false
7
+ gem 'coveralls', require: false
8
+ gem 'strptime', require: false if RUBY_ENGINE == "ruby" && RUBY_VERSION =~ /^2/
9
+ gem "irb" if RUBY_ENGINE == "ruby" && RUBY_VERSION >= "2.6"
data/History.md CHANGED
@@ -1,390 +1,402 @@
1
- ## Changelog [[tags]](https://github.com/uken/fluent-plugin-elasticsearch/tags)
2
-
3
- ### [Unreleased]
4
-
5
- ### 3.5.4
6
- - Add FAQ for Fluentd seems to hang if it unable to connect Elasticsearch (#617)
7
- - Check bulk_message size before appending (#616)
8
- - Add FAQ for Elasticsearch index mapping glitch (#614)
9
- - Display retry counts and interval (#613)
10
-
11
- ### 3.5.3
12
- - Handle nil items response (#611)
13
-
14
- ### 3.5.2
15
- - Fix `@meta_config_map` creation timing (#592)
16
-
17
- ### 3.5.1
18
- - Configurable split request size threshold (#586)
19
-
20
- ### 3.5.0
21
- - Adopt Elasticsearch ruby client v7 loggable class (#583)
22
-
23
- ### 3.4.3
24
- - Add fail_on_putting_template_retry_exceed config (#579)
25
-
26
- ### 3.4.2
27
- - Comparing DEFAULT_TYPE_NAME_ES_7x to target_type instead of type_name (#573)
28
-
29
- ### 3.4.1
30
- - Handle non-String value on parse_time (#570)
31
-
32
- ### 3.4.0
33
- - Check exclusive feature on #configure (#569)
34
- - Modify FAQ for highly load k8s EFK stack (#566)
35
- - Add FAQ for high load k8s EFK stack (#564)
36
-
37
- ### 3.3.3
38
- - Add unit test for exception message (#563)
39
- - Add ignore_exceptions config (#562)
40
-
41
- ### 3.3.2
42
- - Fix support for host, hosts placeholders (#560)
43
- - typo fixes in README.md (#559)
44
-
45
- ### 3.3.1
46
- - add new option to suppress doc wrapping (#557)
47
- - Include 2 (#555)
48
-
49
- ### 3.3.0
50
- - Support builtin placeholders for host and hosts parameter (#554)
51
-
52
- ### 3.2.4
53
- - Pass chunk for built in placeholders (#553)
54
-
55
- ### 3.2.3
56
- - Expose exception backtrace for typhoeus gem loading error (#550)
57
-
58
- ### 3.2.2
59
- - Don't validate ES cliuent version under dry-run mode (#547)
60
-
61
- ### 3.2.1
62
- - Don't attempt to connect to Elasticsearch in dry run mode (#543)
63
- - Add FAQ for typhoeus gem installation (#544)
64
-
65
- ### 3.2.0
66
- - Split huge record requests (#539)
67
-
68
- ### 3.1.1
69
- - Add document for custom_headers (#538)
70
- - out_elasticsearch: Add custom_headers parameter (#529)
71
- - Bundle irb on Ruby 2.6 or later (#537)
72
-
73
- ### 3.1.0
74
- - Retry obtaining Elasticsearch version (#532)
75
- - Fix broken id links (#530)
76
-
77
- ### 3.0.2
78
- - appveyor: Remove Ruby 2.1 CI targets on AppVeyor (#524)
79
- - Follow removal of _routing field change on recent Elasticsearch (#523)
80
- - Travis: Tweak to use Ruby versions (#522)
81
-
82
- ### 3.0.1
83
- - Remove needless Elasticsearch version detection (#520)
84
-
85
- ### 3.0.0
86
- - Use fluentd core retry mechanism (#519)
87
- - Depends on builtin retrying mechanism (#518)
88
- - Loosen ConnectionRetryFailure condition when flush_thread_count > 1 and depends on Fluentd core retrying mechanism (#516)
89
-
90
- ### 2.12.5
91
- - Ensure sniffer class constants definition before calling #client (#515)
92
-
93
- ### 2.12.4
94
- - #506 Rollover index will be in effect in case of template overwrite also. (#513)
95
-
96
- ### 2.12.3
97
- - Added log_es_400_reason configuration item (#511)
98
- - Allow a user to specify the rollover index date pattern (#510)
99
-
100
- ### 2.12.2
101
- - Verify connection at startup (#504)
102
- - Add faq for glob pattern tag routing (#502)
103
-
104
- ### 2.12.1
105
- - Make configurable unrecoverable types (#501)
106
- - Add FAQ for TLS enabled nginx proxy TLS version incompatibility trouble (#496)
107
- - Add FAQs (#492)
108
- - Remove issuestats.com badges (#489)
109
-
110
- ### 2.12.0
111
- - Decoupling the custom template and rollover index creation #485 (#486)
112
-
113
- ### 2.11.11
114
- - Handle error not to acquire version information (#479)
115
-
116
- ### 2.11.10
117
- - Verbose error reason output (#469)
118
-
119
- ### 2.11.9
120
- - Use ConnectionRetryFailure in plugin specific retrying for consistency (#468)
121
- - Remove outdated generating hash_id_key code (#466)
122
- - Tweak behavior for UnrecoverableError and #detect_es_major_version (#465)
123
-
124
- ### 2.11.8
125
- - Serialize requests with Oj (#464)
126
-
127
- ### 2.11.7
128
- - Add mechanism to detect ES and its client version mismatch (#463)
129
-
130
- ### 2.11.6
131
- - 355 customize template (#431)
132
-
133
- ### 2.11.5
134
- - Uplift Merge pull request #459 from richm/v0.12-simple-sniffer (#461)
135
-
136
- ### 2.11.4
137
- - Persistent backend (#456)
138
-
139
- ### 2.11.3
140
- - Implement the `include_index_in_url` option for out_elasticsearch (#451)
141
- - Add an option `include_index_in_url` to allow URL-based conrtrols (#450)
142
-
143
- ### 2.11.2
144
- - Strictness scheme (#445)
145
-
146
- ### 2.11.0
147
- - Uplift Merge pull request #437 from jcantrill/fix_bulk_count (#438)
148
-
149
- ### 2.10.5
150
- - Uplift Merge pull request #435 from jcantrill/add_trace_logging (#436)
151
-
152
- ### 2.10.4
153
- - Use Fluent::UnrecoverableError as unrecoverable error class ancestors (#433)
154
- - Add parameter validation for retrying template installation (#429)
155
-
156
- ### 2.10.3
157
- - Add retry mechanism for template installation (#428)
158
-
159
- ### 2.10.2
160
- - Use logstash_prefix_separator on elasticsearch_dynamic (#427)
161
-
162
- ### 2.10.1
163
- - Uplift Merge pull request #419 from jcantrill/retry_prefix (#421)
164
- - Uplift Merge pull request #418 from jcantrill/emit_exception (#420)
165
-
166
- ### 2.10.0
167
- - Uplift Merge pull request #405 from jcantrill/sanitize_bulk (#414)
168
-
169
- ### 2.9.2
170
- - Uplift Merge pull request #410 from richm/v0.12-consistent-errors-and-tests (#411)
171
- - Add correct link for include_timestamp (#408)
172
-
173
- ### 2.9.1
174
- - Uplift Merge pull request #406 from richm/v0.12-successes-duplicates-no-retry (#407)
175
-
176
- ### 2.9.0
177
- - DLQ revisited v1 uplifted #398, #402 (#404)
178
-
179
- ### 2.8.6
180
- - auth: Fix missing auth tokens after reloading connections (#394)
181
-
182
- ### 2.8.5
183
- - Add deprecated option into content_type parameter (#391)
184
-
185
- ### 2.8.4
186
- - Use nanosecond precision in elasticsearch_dynamic (#387)
187
-
188
- ### 2.8.3
189
- - Specify SSL/TLS version in out_elasticsearch_dynamic (#385)
190
-
191
- ### 2.8.2
192
- - Revert content type header default value (#383)
193
-
194
- ### 2.8.1
195
- - Restore default value of type name #(377)
196
-
197
- ### 2.8.0
198
- - Remove outdated generating hash id support module (#373)
199
- - Check Elasticsearch major version (#371)
200
-
201
- ### 2.7.0
202
- - Configureable content type (#367)
203
-
204
- ### 2.6.1
205
- - Prevent error when using template in elasticsearch_dynamic for elementally use case (#363)
206
-
207
- ### 2.6.0
208
- - Handle high precision time format when using custom time_key (#360)
209
-
210
- ### 2.5.0
211
- - Using nested record in `id_key`, `parent_key`, and `routing_key` (#351)
212
- - Fix inverted case of a proper noun "Elasticsearch" (#349)
213
-
214
- ### 2.4.1
215
- - Add config parameter to enable elasticsearch-ruby's transporter logging (#342)
216
-
217
- ### 2.4.0
218
- - Add built-in placeholders support against type_name parameter (#338)
219
-
220
- ### 2.3.0
221
- - Allow overwriting existing index template (#239)
222
-
223
- ### 2.2.0
224
- - GA release 2.2.0.
225
-
226
- ### 2.2.0.rc.1
227
- - Separate generate hash id module and bundled new plugin for generating unique hash id (#331)
228
-
229
- ### 2.1.1
230
- - Raise ConfigError when specifying different @hash_config.hash_id_key and id_key configration (#327)
231
- - Small typo fix in README.md (#325)
232
-
233
- ### 2.1.0
234
- - Retry on certain errors from Elasticsearch (#322)
235
-
236
- ### 2.0.1
237
- - Releasing generating hash id mechanism to avoid records duplication feature.
238
-
239
- ### 2.0.1.rc.1
240
- - Add generating hash id mechanism to avoid records duplication (#318)
241
-
242
- ### 2.0.0
243
- - Release for Fluentd v0.14 stable.
244
-
245
- ### 2.0.0.rc.7
246
- - Add `include_timestamp` option (#310)
247
-
248
- ### 2.0.0.rc.6
249
- - Improve documentation (#304)
250
- - Handle dynamic_config misconfigurations (#305)
251
- - Escape basic authentication user information placeholders (#306)
252
-
253
- ### 2.0.0.rc.5
254
- - make configurable with `ssl_version` parameter (#299)
255
- - add `logstash_prefix_separator` config parameter (#297)
256
-
257
- ### 2.0.0.rc.4
258
- - fix license identifier in gemspec (#294)
259
-
260
- ### 2.0.0.rc.3
261
- - add built-in placeholders support (#288, #293)
262
- - permit multi workers feature (#291)
263
-
264
- ### 2.0.0.rc.2
265
- - add pipeline parameter (#290)
266
-
267
- ### 2.0.0.rc.1
268
- - Use v0.14 API to support nanosecond precision (#223)
269
-
270
- ### 1.9.5
271
- - sub-second time precision [(#249)](https://github.com/uken/fluent-plugin-elasticsearch/pull/249)
272
-
273
- ### 1.9.4
274
- - Include 'Content-Type' header in `transport_options`
275
-
276
- ### 1.9.3
277
- - Use latest elasticsearch-ruby (#240)
278
- - Log ES response errors (#230)
279
-
280
- ### 1.9.2
281
- - Fix elasticsearch_dynamic for v0.14 (#224)
282
-
283
- ### 1.9.1
284
- - Cast `reload_*` configs in out_elasticsearch_dynamic to bool (#220)
285
-
286
- ### 1.9.0
287
- - add `time_parse_error_tag` (#211)
288
- - add `reconnect_on_error` (#214)
289
-
290
- ### 1.9.0.rc.1
291
- - Optimize output plugins (#203)
292
-
293
- ### 1.8.0
294
- - fix typo in defaults for ssl_verify on elasticsearch_dynamic (#202)
295
- - add support for `templates` (#196)
296
- - rename `send` method to `send_bulk` (#206)
297
-
298
- ### 1.7.0
299
- - add support for `template_name` and `template_file` (#194)
300
-
301
- ### 1.6.0
302
- - add support for dot separated `target_index_key` and `target_type_key` (#175)
303
- - add `remove_keys_on_update` and `remove_keys_on_update_key` (#189)
304
- - fix support for fluentd v0.14 (#191)
305
- - remove support for elasticsearch v2 for now (#177)
306
-
307
- ### 1.5.0
308
- - add `routing_key` (#158)
309
- - add `time_key_exclude_timestamp` to exclude `@timestamp` (#161)
310
- - convert index names to lowercase (#163)
311
- - add `remove_keys` (#164)
312
- - add `flatten_hashes` (#168)
313
- - add `target_type_key` (#169)
314
-
315
- ### 1.4.0
316
- - add `target_index_key` to specify target index (#153)
317
- - add `time_key_format` for faster time format parsing (#154)
318
-
319
- ### 1.3.0
320
- - add `write_operation`
321
-
322
- ### 1.2.1
323
- - fix `resurrect_after` in out_elasticsearch_dynamic
324
-
325
- ### 1.2.0
326
- - out_elasticsearch_dynamic get memory improvement and fix for race condition (#133)
327
- - Add `resurrect_after` option (#136)
328
-
329
- ### 1.1.0
330
- - Support SSL client verification and custom CA file (#123)
331
- - Release experimental `type elasticsearch_dynamic` (#127)
332
-
333
- ### 1.0.0
334
- - password config param is now marked as secret and won't be displayed in logs.
335
-
336
- ### 0.9.0
337
- - Add `ssl_verify` option (#108)
338
-
339
- ### 0.8.0
340
- - Replace Patron with Excon HTTP client (#93)
341
-
342
- ### 0.7.0
343
- - Add new option `time_key` (#85)
344
-
345
- ### 0.6.1
346
- - 0.10.43 is minimum version required of fluentd (#79)
347
-
348
- ### 0.6.0
349
- - added `reload_on_failure` and `reload_connections` flags (#78)
350
-
351
- ### 0.5.1
352
- - fix legacy hosts option, port should be optional (#75)
353
-
354
- ### 0.5.0
355
- - add full connection URI support (#65)
356
- - use `@timestamp` for index (#41)
357
- - add support for elasticsearch gem version 1 (#71)
358
- - fix connection reset & retry when connection is lost (#67)
359
-
360
- ### 0.4.0
361
- - add `request_timeout` config (#59)
362
- - fix lockup when non-hash values are sent (#52)
363
-
364
- ### 0.3.1
365
- - force using patron (#46)
366
- - do not generate @timestamp if already part of message (#35)
367
-
368
- ### 0.3.0
369
- - add `parent_key` option (#28)
370
- - have travis-ci build on multiple rubies (#30)
371
- - add `utc_index` and `hosts` options, switch to using `elasticsearch` gem (#26, #29)
372
-
373
- ### 0.2.0
374
- - fix encoding issues with JSON conversion and again when sending to elasticsearch (#19, #21)
375
- - add logstash_dateformat option (#20)
376
-
377
- ### 0.1.4
378
- - add logstash_prefix option
379
-
380
- ### 0.1.3
381
- - raising an exception on non-success response from elasticsearch
382
-
383
- ### 0.1.2
384
- - add id_key option
385
-
386
- ### 0.1.1
387
- - fix timezone in logstash key
388
-
389
- ### 0.1.0
390
- - Initial gem release.
1
+ ## Changelog [[tags]](https://github.com/uken/fluent-plugin-elasticsearch/tags)
2
+
3
+ ### [Unreleased]
4
+
5
+ ### 3.5.5
6
+ - Fix arguments order of `assert_equal` (#635)
7
+ - Add description for `port` option (#634)
8
+ - Fix description position and add examples for `hosts` option (#633)
9
+ - Use upper-case to compare before and after conversion (#630)
10
+ - Validate `max_retry_get_es_version` (#629)
11
+ - Remove unused getting plugin instance (#628)
12
+ - Fix error message for `max_retry_putting_template` (#627)
13
+ - Fix DST-breaking unit test (#623)
14
+ - Handle ClusterBlockException (#621)
15
+ - Add contribution guideline document (#618)
16
+
17
+ ### 3.5.4
18
+ - Add FAQ for Fluentd seems to hang if it unable to connect Elasticsearch (#617)
19
+ - Check bulk_message size before appending (#616)
20
+ - Add FAQ for Elasticsearch index mapping glitch (#614)
21
+ - Display retry counts and interval (#613)
22
+
23
+ ### 3.5.3
24
+ - Handle nil items response (#611)
25
+
26
+ ### 3.5.2
27
+ - Fix `@meta_config_map` creation timing (#592)
28
+
29
+ ### 3.5.1
30
+ - Configurable split request size threshold (#586)
31
+
32
+ ### 3.5.0
33
+ - Adopt Elasticsearch ruby client v7 loggable class (#583)
34
+
35
+ ### 3.4.3
36
+ - Add fail_on_putting_template_retry_exceed config (#579)
37
+
38
+ ### 3.4.2
39
+ - Comparing DEFAULT_TYPE_NAME_ES_7x to target_type instead of type_name (#573)
40
+
41
+ ### 3.4.1
42
+ - Handle non-String value on parse_time (#570)
43
+
44
+ ### 3.4.0
45
+ - Check exclusive feature on #configure (#569)
46
+ - Modify FAQ for highly load k8s EFK stack (#566)
47
+ - Add FAQ for high load k8s EFK stack (#564)
48
+
49
+ ### 3.3.3
50
+ - Add unit test for exception message (#563)
51
+ - Add ignore_exceptions config (#562)
52
+
53
+ ### 3.3.2
54
+ - Fix support for host, hosts placeholders (#560)
55
+ - typo fixes in README.md (#559)
56
+
57
+ ### 3.3.1
58
+ - add new option to suppress doc wrapping (#557)
59
+ - Include 2 (#555)
60
+
61
+ ### 3.3.0
62
+ - Support builtin placeholders for host and hosts parameter (#554)
63
+
64
+ ### 3.2.4
65
+ - Pass chunk for built in placeholders (#553)
66
+
67
+ ### 3.2.3
68
+ - Expose exception backtrace for typhoeus gem loading error (#550)
69
+
70
+ ### 3.2.2
71
+ - Don't validate ES cliuent version under dry-run mode (#547)
72
+
73
+ ### 3.2.1
74
+ - Don't attempt to connect to Elasticsearch in dry run mode (#543)
75
+ - Add FAQ for typhoeus gem installation (#544)
76
+
77
+ ### 3.2.0
78
+ - Split huge record requests (#539)
79
+
80
+ ### 3.1.1
81
+ - Add document for custom_headers (#538)
82
+ - out_elasticsearch: Add custom_headers parameter (#529)
83
+ - Bundle irb on Ruby 2.6 or later (#537)
84
+
85
+ ### 3.1.0
86
+ - Retry obtaining Elasticsearch version (#532)
87
+ - Fix broken id links (#530)
88
+
89
+ ### 3.0.2
90
+ - appveyor: Remove Ruby 2.1 CI targets on AppVeyor (#524)
91
+ - Follow removal of _routing field change on recent Elasticsearch (#523)
92
+ - Travis: Tweak to use Ruby versions (#522)
93
+
94
+ ### 3.0.1
95
+ - Remove needless Elasticsearch version detection (#520)
96
+
97
+ ### 3.0.0
98
+ - Use fluentd core retry mechanism (#519)
99
+ - Depends on builtin retrying mechanism (#518)
100
+ - Loosen ConnectionRetryFailure condition when flush_thread_count > 1 and depends on Fluentd core retrying mechanism (#516)
101
+
102
+ ### 2.12.5
103
+ - Ensure sniffer class constants definition before calling #client (#515)
104
+
105
+ ### 2.12.4
106
+ - #506 Rollover index will be in effect in case of template overwrite also. (#513)
107
+
108
+ ### 2.12.3
109
+ - Added log_es_400_reason configuration item (#511)
110
+ - Allow a user to specify the rollover index date pattern (#510)
111
+
112
+ ### 2.12.2
113
+ - Verify connection at startup (#504)
114
+ - Add faq for glob pattern tag routing (#502)
115
+
116
+ ### 2.12.1
117
+ - Make configurable unrecoverable types (#501)
118
+ - Add FAQ for TLS enabled nginx proxy TLS version incompatibility trouble (#496)
119
+ - Add FAQs (#492)
120
+ - Remove issuestats.com badges (#489)
121
+
122
+ ### 2.12.0
123
+ - Decoupling the custom template and rollover index creation #485 (#486)
124
+
125
+ ### 2.11.11
126
+ - Handle error not to acquire version information (#479)
127
+
128
+ ### 2.11.10
129
+ - Verbose error reason output (#469)
130
+
131
+ ### 2.11.9
132
+ - Use ConnectionRetryFailure in plugin specific retrying for consistency (#468)
133
+ - Remove outdated generating hash_id_key code (#466)
134
+ - Tweak behavior for UnrecoverableError and #detect_es_major_version (#465)
135
+
136
+ ### 2.11.8
137
+ - Serialize requests with Oj (#464)
138
+
139
+ ### 2.11.7
140
+ - Add mechanism to detect ES and its client version mismatch (#463)
141
+
142
+ ### 2.11.6
143
+ - 355 customize template (#431)
144
+
145
+ ### 2.11.5
146
+ - Uplift Merge pull request #459 from richm/v0.12-simple-sniffer (#461)
147
+
148
+ ### 2.11.4
149
+ - Persistent backend (#456)
150
+
151
+ ### 2.11.3
152
+ - Implement the `include_index_in_url` option for out_elasticsearch (#451)
153
+ - Add an option `include_index_in_url` to allow URL-based conrtrols (#450)
154
+
155
+ ### 2.11.2
156
+ - Strictness scheme (#445)
157
+
158
+ ### 2.11.0
159
+ - Uplift Merge pull request #437 from jcantrill/fix_bulk_count (#438)
160
+
161
+ ### 2.10.5
162
+ - Uplift Merge pull request #435 from jcantrill/add_trace_logging (#436)
163
+
164
+ ### 2.10.4
165
+ - Use Fluent::UnrecoverableError as unrecoverable error class ancestors (#433)
166
+ - Add parameter validation for retrying template installation (#429)
167
+
168
+ ### 2.10.3
169
+ - Add retry mechanism for template installation (#428)
170
+
171
+ ### 2.10.2
172
+ - Use logstash_prefix_separator on elasticsearch_dynamic (#427)
173
+
174
+ ### 2.10.1
175
+ - Uplift Merge pull request #419 from jcantrill/retry_prefix (#421)
176
+ - Uplift Merge pull request #418 from jcantrill/emit_exception (#420)
177
+
178
+ ### 2.10.0
179
+ - Uplift Merge pull request #405 from jcantrill/sanitize_bulk (#414)
180
+
181
+ ### 2.9.2
182
+ - Uplift Merge pull request #410 from richm/v0.12-consistent-errors-and-tests (#411)
183
+ - Add correct link for include_timestamp (#408)
184
+
185
+ ### 2.9.1
186
+ - Uplift Merge pull request #406 from richm/v0.12-successes-duplicates-no-retry (#407)
187
+
188
+ ### 2.9.0
189
+ - DLQ revisited v1 uplifted #398, #402 (#404)
190
+
191
+ ### 2.8.6
192
+ - auth: Fix missing auth tokens after reloading connections (#394)
193
+
194
+ ### 2.8.5
195
+ - Add deprecated option into content_type parameter (#391)
196
+
197
+ ### 2.8.4
198
+ - Use nanosecond precision in elasticsearch_dynamic (#387)
199
+
200
+ ### 2.8.3
201
+ - Specify SSL/TLS version in out_elasticsearch_dynamic (#385)
202
+
203
+ ### 2.8.2
204
+ - Revert content type header default value (#383)
205
+
206
+ ### 2.8.1
207
+ - Restore default value of type name #(377)
208
+
209
+ ### 2.8.0
210
+ - Remove outdated generating hash id support module (#373)
211
+ - Check Elasticsearch major version (#371)
212
+
213
+ ### 2.7.0
214
+ - Configureable content type (#367)
215
+
216
+ ### 2.6.1
217
+ - Prevent error when using template in elasticsearch_dynamic for elementally use case (#363)
218
+
219
+ ### 2.6.0
220
+ - Handle high precision time format when using custom time_key (#360)
221
+
222
+ ### 2.5.0
223
+ - Using nested record in `id_key`, `parent_key`, and `routing_key` (#351)
224
+ - Fix inverted case of a proper noun "Elasticsearch" (#349)
225
+
226
+ ### 2.4.1
227
+ - Add config parameter to enable elasticsearch-ruby's transporter logging (#342)
228
+
229
+ ### 2.4.0
230
+ - Add built-in placeholders support against type_name parameter (#338)
231
+
232
+ ### 2.3.0
233
+ - Allow overwriting existing index template (#239)
234
+
235
+ ### 2.2.0
236
+ - GA release 2.2.0.
237
+
238
+ ### 2.2.0.rc.1
239
+ - Separate generate hash id module and bundled new plugin for generating unique hash id (#331)
240
+
241
+ ### 2.1.1
242
+ - Raise ConfigError when specifying different @hash_config.hash_id_key and id_key configration (#327)
243
+ - Small typo fix in README.md (#325)
244
+
245
+ ### 2.1.0
246
+ - Retry on certain errors from Elasticsearch (#322)
247
+
248
+ ### 2.0.1
249
+ - Releasing generating hash id mechanism to avoid records duplication feature.
250
+
251
+ ### 2.0.1.rc.1
252
+ - Add generating hash id mechanism to avoid records duplication (#318)
253
+
254
+ ### 2.0.0
255
+ - Release for Fluentd v0.14 stable.
256
+
257
+ ### 2.0.0.rc.7
258
+ - Add `include_timestamp` option (#310)
259
+
260
+ ### 2.0.0.rc.6
261
+ - Improve documentation (#304)
262
+ - Handle dynamic_config misconfigurations (#305)
263
+ - Escape basic authentication user information placeholders (#306)
264
+
265
+ ### 2.0.0.rc.5
266
+ - make configurable with `ssl_version` parameter (#299)
267
+ - add `logstash_prefix_separator` config parameter (#297)
268
+
269
+ ### 2.0.0.rc.4
270
+ - fix license identifier in gemspec (#294)
271
+
272
+ ### 2.0.0.rc.3
273
+ - add built-in placeholders support (#288, #293)
274
+ - permit multi workers feature (#291)
275
+
276
+ ### 2.0.0.rc.2
277
+ - add pipeline parameter (#290)
278
+
279
+ ### 2.0.0.rc.1
280
+ - Use v0.14 API to support nanosecond precision (#223)
281
+
282
+ ### 1.9.5
283
+ - sub-second time precision [(#249)](https://github.com/uken/fluent-plugin-elasticsearch/pull/249)
284
+
285
+ ### 1.9.4
286
+ - Include 'Content-Type' header in `transport_options`
287
+
288
+ ### 1.9.3
289
+ - Use latest elasticsearch-ruby (#240)
290
+ - Log ES response errors (#230)
291
+
292
+ ### 1.9.2
293
+ - Fix elasticsearch_dynamic for v0.14 (#224)
294
+
295
+ ### 1.9.1
296
+ - Cast `reload_*` configs in out_elasticsearch_dynamic to bool (#220)
297
+
298
+ ### 1.9.0
299
+ - add `time_parse_error_tag` (#211)
300
+ - add `reconnect_on_error` (#214)
301
+
302
+ ### 1.9.0.rc.1
303
+ - Optimize output plugins (#203)
304
+
305
+ ### 1.8.0
306
+ - fix typo in defaults for ssl_verify on elasticsearch_dynamic (#202)
307
+ - add support for `templates` (#196)
308
+ - rename `send` method to `send_bulk` (#206)
309
+
310
+ ### 1.7.0
311
+ - add support for `template_name` and `template_file` (#194)
312
+
313
+ ### 1.6.0
314
+ - add support for dot separated `target_index_key` and `target_type_key` (#175)
315
+ - add `remove_keys_on_update` and `remove_keys_on_update_key` (#189)
316
+ - fix support for fluentd v0.14 (#191)
317
+ - remove support for elasticsearch v2 for now (#177)
318
+
319
+ ### 1.5.0
320
+ - add `routing_key` (#158)
321
+ - add `time_key_exclude_timestamp` to exclude `@timestamp` (#161)
322
+ - convert index names to lowercase (#163)
323
+ - add `remove_keys` (#164)
324
+ - add `flatten_hashes` (#168)
325
+ - add `target_type_key` (#169)
326
+
327
+ ### 1.4.0
328
+ - add `target_index_key` to specify target index (#153)
329
+ - add `time_key_format` for faster time format parsing (#154)
330
+
331
+ ### 1.3.0
332
+ - add `write_operation`
333
+
334
+ ### 1.2.1
335
+ - fix `resurrect_after` in out_elasticsearch_dynamic
336
+
337
+ ### 1.2.0
338
+ - out_elasticsearch_dynamic get memory improvement and fix for race condition (#133)
339
+ - Add `resurrect_after` option (#136)
340
+
341
+ ### 1.1.0
342
+ - Support SSL client verification and custom CA file (#123)
343
+ - Release experimental `type elasticsearch_dynamic` (#127)
344
+
345
+ ### 1.0.0
346
+ - password config param is now marked as secret and won't be displayed in logs.
347
+
348
+ ### 0.9.0
349
+ - Add `ssl_verify` option (#108)
350
+
351
+ ### 0.8.0
352
+ - Replace Patron with Excon HTTP client (#93)
353
+
354
+ ### 0.7.0
355
+ - Add new option `time_key` (#85)
356
+
357
+ ### 0.6.1
358
+ - 0.10.43 is minimum version required of fluentd (#79)
359
+
360
+ ### 0.6.0
361
+ - added `reload_on_failure` and `reload_connections` flags (#78)
362
+
363
+ ### 0.5.1
364
+ - fix legacy hosts option, port should be optional (#75)
365
+
366
+ ### 0.5.0
367
+ - add full connection URI support (#65)
368
+ - use `@timestamp` for index (#41)
369
+ - add support for elasticsearch gem version 1 (#71)
370
+ - fix connection reset & retry when connection is lost (#67)
371
+
372
+ ### 0.4.0
373
+ - add `request_timeout` config (#59)
374
+ - fix lockup when non-hash values are sent (#52)
375
+
376
+ ### 0.3.1
377
+ - force using patron (#46)
378
+ - do not generate @timestamp if already part of message (#35)
379
+
380
+ ### 0.3.0
381
+ - add `parent_key` option (#28)
382
+ - have travis-ci build on multiple rubies (#30)
383
+ - add `utc_index` and `hosts` options, switch to using `elasticsearch` gem (#26, #29)
384
+
385
+ ### 0.2.0
386
+ - fix encoding issues with JSON conversion and again when sending to elasticsearch (#19, #21)
387
+ - add logstash_dateformat option (#20)
388
+
389
+ ### 0.1.4
390
+ - add logstash_prefix option
391
+
392
+ ### 0.1.3
393
+ - raising an exception on non-success response from elasticsearch
394
+
395
+ ### 0.1.2
396
+ - add id_key option
397
+
398
+ ### 0.1.1
399
+ - fix timezone in logstash key
400
+
401
+ ### 0.1.0
402
+ - Initial gem release.