fluent-plugin-elasticsearch2 3.5.5

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
checksums.yaml ADDED
@@ -0,0 +1,7 @@
1
+ ---
2
+ SHA256:
3
+ metadata.gz: a7747f010dd032ee39868624f713098b8e0967161739cbf93332e6a856738956
4
+ data.tar.gz: '06186f6d0e36c07bf3c2ed63d3a2af323cc60fdf6bdfe56b0f972f9e0e81d326'
5
+ SHA512:
6
+ metadata.gz: b973f0bb2eeda137506d08ed933cf7e70becb73c6d36b5d7fa875303f61e4eebdf4bf94119ae62edd34a41cc88feda436e52a3d5d0d6d0247b27acaa98035d7d
7
+ data.tar.gz: 0deafbf61898d02eb635712ee9ff24bda0cc477754f8cc0e088446bd5a0b41756916bed84065a0db2a36b65cff9b08dd5b192421307f64ecd6d247510c4c58e9
data/.coveralls.yml ADDED
@@ -0,0 +1,2 @@
1
+ service_name: travis-ci
2
+
data/.editorconfig ADDED
@@ -0,0 +1,9 @@
1
+ # EditorConfig: http://EditorConfig.org
2
+
3
+ root = true
4
+
5
+ [*]
6
+ end_of_line = lf
7
+ insert_final_newline = true
8
+ indent_style = space
9
+ indent_size = 2
data/.gitignore ADDED
@@ -0,0 +1,18 @@
1
+ *.gem
2
+ *.rbc
3
+ .bundle
4
+ .config
5
+ .yardoc
6
+ Gemfile.lock
7
+ InstalledFiles
8
+ _yardoc
9
+ coverage
10
+ doc/
11
+ lib/bundler/man
12
+ pkg
13
+ rdoc
14
+ spec/reports
15
+ test/tmp
16
+ test/version_tmp
17
+ tmp
18
+ .DS_Store
data/.travis.yml ADDED
@@ -0,0 +1,18 @@
1
+ language: ruby
2
+
3
+ rvm:
4
+ - 2.1
5
+ - 2.2
6
+ - 2.3
7
+ - 2.4.5
8
+ - 2.5.3
9
+ - 2.6.0
10
+
11
+ gemfile:
12
+ - Gemfile
13
+
14
+ before_install:
15
+ - gem update --system=2.7.8
16
+
17
+ script: bundle exec rake test
18
+ sudo: false
data/CONTRIBUTING.md ADDED
@@ -0,0 +1,24 @@
1
+ Contributing to fluent-plugin-elasticsearch
2
+ ===
3
+
4
+ We'd love your contribution. Here are the guidelines!
5
+
6
+ ## Got a question or problem?
7
+
8
+ RESOURCES of [Official site's documentation](https://docs.fluentd.org/output/elasticsearch) and [ES plugin documentation](https://github.com/uken/fluent-plugin-elasticsearch/blob/master/README.md) may help you.
9
+
10
+ If you have further questions about ES plugin, feel free to [open an Issue](https://github.com/uken/fluent-plugin-elasticsearch/issues).
11
+
12
+ ## Found a bug?
13
+
14
+ If you find a bug of ES plugin or a mistake in the documentation, you can help us by submitting an issue to ES plugin. Even better you can submit a pull request with a fix.
15
+
16
+ Note: Please follow the issue template/pull request template when sending your issue. Otherwise, your issue _might going to be closed with no response_.
17
+
18
+ ## Patch Guidelines
19
+
20
+ Here are some things that would increase a chance that your patch is accepted:
21
+
22
+ * Write tests
23
+ * Run tests before sending pull request with `bundle exec rake test`
24
+ * Write [a good commit message](https://tbaggery.com/2008/04/19/a-note-about-git-commit-messages.html)
data/Gemfile ADDED
@@ -0,0 +1,9 @@
1
+ source 'https://rubygems.org'
2
+
3
+ # Specify your gem's dependencies in fluent-plugin-elasticsearch.gemspec
4
+ gemspec
5
+
6
+ gem 'simplecov', require: false
7
+ gem 'coveralls', require: false
8
+ gem 'strptime', require: false if RUBY_ENGINE == "ruby" && RUBY_VERSION =~ /^2/
9
+ gem "irb" if RUBY_ENGINE == "ruby" && RUBY_VERSION >= "2.6"
data/History.md ADDED
@@ -0,0 +1,402 @@
1
+ ## Changelog [[tags]](https://github.com/uken/fluent-plugin-elasticsearch/tags)
2
+
3
+ ### [Unreleased]
4
+
5
+ ### 3.5.5
6
+ - Fix arguments order of `assert_equal` (#635)
7
+ - Add description for `port` option (#634)
8
+ - Fix description position and add examples for `hosts` option (#633)
9
+ - Use upper-case to compare before and after conversion (#630)
10
+ - Validate `max_retry_get_es_version` (#629)
11
+ - Remove unused getting plugin instance (#628)
12
+ - Fix error message for `max_retry_putting_template` (#627)
13
+ - Fix DST-breaking unit test (#623)
14
+ - Handle ClusterBlockException (#621)
15
+ - Add contribution guideline document (#618)
16
+
17
+ ### 3.5.4
18
+ - Add FAQ for Fluentd seems to hang if it unable to connect Elasticsearch (#617)
19
+ - Check bulk_message size before appending (#616)
20
+ - Add FAQ for Elasticsearch index mapping glitch (#614)
21
+ - Display retry counts and interval (#613)
22
+
23
+ ### 3.5.3
24
+ - Handle nil items response (#611)
25
+
26
+ ### 3.5.2
27
+ - Fix `@meta_config_map` creation timing (#592)
28
+
29
+ ### 3.5.1
30
+ - Configurable split request size threshold (#586)
31
+
32
+ ### 3.5.0
33
+ - Adopt Elasticsearch ruby client v7 loggable class (#583)
34
+
35
+ ### 3.4.3
36
+ - Add fail_on_putting_template_retry_exceed config (#579)
37
+
38
+ ### 3.4.2
39
+ - Comparing DEFAULT_TYPE_NAME_ES_7x to target_type instead of type_name (#573)
40
+
41
+ ### 3.4.1
42
+ - Handle non-String value on parse_time (#570)
43
+
44
+ ### 3.4.0
45
+ - Check exclusive feature on #configure (#569)
46
+ - Modify FAQ for highly load k8s EFK stack (#566)
47
+ - Add FAQ for high load k8s EFK stack (#564)
48
+
49
+ ### 3.3.3
50
+ - Add unit test for exception message (#563)
51
+ - Add ignore_exceptions config (#562)
52
+
53
+ ### 3.3.2
54
+ - Fix support for host, hosts placeholders (#560)
55
+ - typo fixes in README.md (#559)
56
+
57
+ ### 3.3.1
58
+ - add new option to suppress doc wrapping (#557)
59
+ - Include 2 (#555)
60
+
61
+ ### 3.3.0
62
+ - Support builtin placeholders for host and hosts parameter (#554)
63
+
64
+ ### 3.2.4
65
+ - Pass chunk for built in placeholders (#553)
66
+
67
+ ### 3.2.3
68
+ - Expose exception backtrace for typhoeus gem loading error (#550)
69
+
70
+ ### 3.2.2
71
+ - Don't validate ES cliuent version under dry-run mode (#547)
72
+
73
+ ### 3.2.1
74
+ - Don't attempt to connect to Elasticsearch in dry run mode (#543)
75
+ - Add FAQ for typhoeus gem installation (#544)
76
+
77
+ ### 3.2.0
78
+ - Split huge record requests (#539)
79
+
80
+ ### 3.1.1
81
+ - Add document for custom_headers (#538)
82
+ - out_elasticsearch: Add custom_headers parameter (#529)
83
+ - Bundle irb on Ruby 2.6 or later (#537)
84
+
85
+ ### 3.1.0
86
+ - Retry obtaining Elasticsearch version (#532)
87
+ - Fix broken id links (#530)
88
+
89
+ ### 3.0.2
90
+ - appveyor: Remove Ruby 2.1 CI targets on AppVeyor (#524)
91
+ - Follow removal of _routing field change on recent Elasticsearch (#523)
92
+ - Travis: Tweak to use Ruby versions (#522)
93
+
94
+ ### 3.0.1
95
+ - Remove needless Elasticsearch version detection (#520)
96
+
97
+ ### 3.0.0
98
+ - Use fluentd core retry mechanism (#519)
99
+ - Depends on builtin retrying mechanism (#518)
100
+ - Loosen ConnectionRetryFailure condition when flush_thread_count > 1 and depends on Fluentd core retrying mechanism (#516)
101
+
102
+ ### 2.12.5
103
+ - Ensure sniffer class constants definition before calling #client (#515)
104
+
105
+ ### 2.12.4
106
+ - #506 Rollover index will be in effect in case of template overwrite also. (#513)
107
+
108
+ ### 2.12.3
109
+ - Added log_es_400_reason configuration item (#511)
110
+ - Allow a user to specify the rollover index date pattern (#510)
111
+
112
+ ### 2.12.2
113
+ - Verify connection at startup (#504)
114
+ - Add faq for glob pattern tag routing (#502)
115
+
116
+ ### 2.12.1
117
+ - Make configurable unrecoverable types (#501)
118
+ - Add FAQ for TLS enabled nginx proxy TLS version incompatibility trouble (#496)
119
+ - Add FAQs (#492)
120
+ - Remove issuestats.com badges (#489)
121
+
122
+ ### 2.12.0
123
+ - Decoupling the custom template and rollover index creation #485 (#486)
124
+
125
+ ### 2.11.11
126
+ - Handle error not to acquire version information (#479)
127
+
128
+ ### 2.11.10
129
+ - Verbose error reason output (#469)
130
+
131
+ ### 2.11.9
132
+ - Use ConnectionRetryFailure in plugin specific retrying for consistency (#468)
133
+ - Remove outdated generating hash_id_key code (#466)
134
+ - Tweak behavior for UnrecoverableError and #detect_es_major_version (#465)
135
+
136
+ ### 2.11.8
137
+ - Serialize requests with Oj (#464)
138
+
139
+ ### 2.11.7
140
+ - Add mechanism to detect ES and its client version mismatch (#463)
141
+
142
+ ### 2.11.6
143
+ - 355 customize template (#431)
144
+
145
+ ### 2.11.5
146
+ - Uplift Merge pull request #459 from richm/v0.12-simple-sniffer (#461)
147
+
148
+ ### 2.11.4
149
+ - Persistent backend (#456)
150
+
151
+ ### 2.11.3
152
+ - Implement the `include_index_in_url` option for out_elasticsearch (#451)
153
+ - Add an option `include_index_in_url` to allow URL-based conrtrols (#450)
154
+
155
+ ### 2.11.2
156
+ - Strictness scheme (#445)
157
+
158
+ ### 2.11.0
159
+ - Uplift Merge pull request #437 from jcantrill/fix_bulk_count (#438)
160
+
161
+ ### 2.10.5
162
+ - Uplift Merge pull request #435 from jcantrill/add_trace_logging (#436)
163
+
164
+ ### 2.10.4
165
+ - Use Fluent::UnrecoverableError as unrecoverable error class ancestors (#433)
166
+ - Add parameter validation for retrying template installation (#429)
167
+
168
+ ### 2.10.3
169
+ - Add retry mechanism for template installation (#428)
170
+
171
+ ### 2.10.2
172
+ - Use logstash_prefix_separator on elasticsearch_dynamic (#427)
173
+
174
+ ### 2.10.1
175
+ - Uplift Merge pull request #419 from jcantrill/retry_prefix (#421)
176
+ - Uplift Merge pull request #418 from jcantrill/emit_exception (#420)
177
+
178
+ ### 2.10.0
179
+ - Uplift Merge pull request #405 from jcantrill/sanitize_bulk (#414)
180
+
181
+ ### 2.9.2
182
+ - Uplift Merge pull request #410 from richm/v0.12-consistent-errors-and-tests (#411)
183
+ - Add correct link for include_timestamp (#408)
184
+
185
+ ### 2.9.1
186
+ - Uplift Merge pull request #406 from richm/v0.12-successes-duplicates-no-retry (#407)
187
+
188
+ ### 2.9.0
189
+ - DLQ revisited v1 uplifted #398, #402 (#404)
190
+
191
+ ### 2.8.6
192
+ - auth: Fix missing auth tokens after reloading connections (#394)
193
+
194
+ ### 2.8.5
195
+ - Add deprecated option into content_type parameter (#391)
196
+
197
+ ### 2.8.4
198
+ - Use nanosecond precision in elasticsearch_dynamic (#387)
199
+
200
+ ### 2.8.3
201
+ - Specify SSL/TLS version in out_elasticsearch_dynamic (#385)
202
+
203
+ ### 2.8.2
204
+ - Revert content type header default value (#383)
205
+
206
+ ### 2.8.1
207
+ - Restore default value of type name #(377)
208
+
209
+ ### 2.8.0
210
+ - Remove outdated generating hash id support module (#373)
211
+ - Check Elasticsearch major version (#371)
212
+
213
+ ### 2.7.0
214
+ - Configureable content type (#367)
215
+
216
+ ### 2.6.1
217
+ - Prevent error when using template in elasticsearch_dynamic for elementally use case (#363)
218
+
219
+ ### 2.6.0
220
+ - Handle high precision time format when using custom time_key (#360)
221
+
222
+ ### 2.5.0
223
+ - Using nested record in `id_key`, `parent_key`, and `routing_key` (#351)
224
+ - Fix inverted case of a proper noun "Elasticsearch" (#349)
225
+
226
+ ### 2.4.1
227
+ - Add config parameter to enable elasticsearch-ruby's transporter logging (#342)
228
+
229
+ ### 2.4.0
230
+ - Add built-in placeholders support against type_name parameter (#338)
231
+
232
+ ### 2.3.0
233
+ - Allow overwriting existing index template (#239)
234
+
235
+ ### 2.2.0
236
+ - GA release 2.2.0.
237
+
238
+ ### 2.2.0.rc.1
239
+ - Separate generate hash id module and bundled new plugin for generating unique hash id (#331)
240
+
241
+ ### 2.1.1
242
+ - Raise ConfigError when specifying different @hash_config.hash_id_key and id_key configration (#327)
243
+ - Small typo fix in README.md (#325)
244
+
245
+ ### 2.1.0
246
+ - Retry on certain errors from Elasticsearch (#322)
247
+
248
+ ### 2.0.1
249
+ - Releasing generating hash id mechanism to avoid records duplication feature.
250
+
251
+ ### 2.0.1.rc.1
252
+ - Add generating hash id mechanism to avoid records duplication (#318)
253
+
254
+ ### 2.0.0
255
+ - Release for Fluentd v0.14 stable.
256
+
257
+ ### 2.0.0.rc.7
258
+ - Add `include_timestamp` option (#310)
259
+
260
+ ### 2.0.0.rc.6
261
+ - Improve documentation (#304)
262
+ - Handle dynamic_config misconfigurations (#305)
263
+ - Escape basic authentication user information placeholders (#306)
264
+
265
+ ### 2.0.0.rc.5
266
+ - make configurable with `ssl_version` parameter (#299)
267
+ - add `logstash_prefix_separator` config parameter (#297)
268
+
269
+ ### 2.0.0.rc.4
270
+ - fix license identifier in gemspec (#294)
271
+
272
+ ### 2.0.0.rc.3
273
+ - add built-in placeholders support (#288, #293)
274
+ - permit multi workers feature (#291)
275
+
276
+ ### 2.0.0.rc.2
277
+ - add pipeline parameter (#290)
278
+
279
+ ### 2.0.0.rc.1
280
+ - Use v0.14 API to support nanosecond precision (#223)
281
+
282
+ ### 1.9.5
283
+ - sub-second time precision [(#249)](https://github.com/uken/fluent-plugin-elasticsearch/pull/249)
284
+
285
+ ### 1.9.4
286
+ - Include 'Content-Type' header in `transport_options`
287
+
288
+ ### 1.9.3
289
+ - Use latest elasticsearch-ruby (#240)
290
+ - Log ES response errors (#230)
291
+
292
+ ### 1.9.2
293
+ - Fix elasticsearch_dynamic for v0.14 (#224)
294
+
295
+ ### 1.9.1
296
+ - Cast `reload_*` configs in out_elasticsearch_dynamic to bool (#220)
297
+
298
+ ### 1.9.0
299
+ - add `time_parse_error_tag` (#211)
300
+ - add `reconnect_on_error` (#214)
301
+
302
+ ### 1.9.0.rc.1
303
+ - Optimize output plugins (#203)
304
+
305
+ ### 1.8.0
306
+ - fix typo in defaults for ssl_verify on elasticsearch_dynamic (#202)
307
+ - add support for `templates` (#196)
308
+ - rename `send` method to `send_bulk` (#206)
309
+
310
+ ### 1.7.0
311
+ - add support for `template_name` and `template_file` (#194)
312
+
313
+ ### 1.6.0
314
+ - add support for dot separated `target_index_key` and `target_type_key` (#175)
315
+ - add `remove_keys_on_update` and `remove_keys_on_update_key` (#189)
316
+ - fix support for fluentd v0.14 (#191)
317
+ - remove support for elasticsearch v2 for now (#177)
318
+
319
+ ### 1.5.0
320
+ - add `routing_key` (#158)
321
+ - add `time_key_exclude_timestamp` to exclude `@timestamp` (#161)
322
+ - convert index names to lowercase (#163)
323
+ - add `remove_keys` (#164)
324
+ - add `flatten_hashes` (#168)
325
+ - add `target_type_key` (#169)
326
+
327
+ ### 1.4.0
328
+ - add `target_index_key` to specify target index (#153)
329
+ - add `time_key_format` for faster time format parsing (#154)
330
+
331
+ ### 1.3.0
332
+ - add `write_operation`
333
+
334
+ ### 1.2.1
335
+ - fix `resurrect_after` in out_elasticsearch_dynamic
336
+
337
+ ### 1.2.0
338
+ - out_elasticsearch_dynamic get memory improvement and fix for race condition (#133)
339
+ - Add `resurrect_after` option (#136)
340
+
341
+ ### 1.1.0
342
+ - Support SSL client verification and custom CA file (#123)
343
+ - Release experimental `type elasticsearch_dynamic` (#127)
344
+
345
+ ### 1.0.0
346
+ - password config param is now marked as secret and won't be displayed in logs.
347
+
348
+ ### 0.9.0
349
+ - Add `ssl_verify` option (#108)
350
+
351
+ ### 0.8.0
352
+ - Replace Patron with Excon HTTP client (#93)
353
+
354
+ ### 0.7.0
355
+ - Add new option `time_key` (#85)
356
+
357
+ ### 0.6.1
358
+ - 0.10.43 is minimum version required of fluentd (#79)
359
+
360
+ ### 0.6.0
361
+ - added `reload_on_failure` and `reload_connections` flags (#78)
362
+
363
+ ### 0.5.1
364
+ - fix legacy hosts option, port should be optional (#75)
365
+
366
+ ### 0.5.0
367
+ - add full connection URI support (#65)
368
+ - use `@timestamp` for index (#41)
369
+ - add support for elasticsearch gem version 1 (#71)
370
+ - fix connection reset & retry when connection is lost (#67)
371
+
372
+ ### 0.4.0
373
+ - add `request_timeout` config (#59)
374
+ - fix lockup when non-hash values are sent (#52)
375
+
376
+ ### 0.3.1
377
+ - force using patron (#46)
378
+ - do not generate @timestamp if already part of message (#35)
379
+
380
+ ### 0.3.0
381
+ - add `parent_key` option (#28)
382
+ - have travis-ci build on multiple rubies (#30)
383
+ - add `utc_index` and `hosts` options, switch to using `elasticsearch` gem (#26, #29)
384
+
385
+ ### 0.2.0
386
+ - fix encoding issues with JSON conversion and again when sending to elasticsearch (#19, #21)
387
+ - add logstash_dateformat option (#20)
388
+
389
+ ### 0.1.4
390
+ - add logstash_prefix option
391
+
392
+ ### 0.1.3
393
+ - raising an exception on non-success response from elasticsearch
394
+
395
+ ### 0.1.2
396
+ - add id_key option
397
+
398
+ ### 0.1.1
399
+ - fix timezone in logstash key
400
+
401
+ ### 0.1.0
402
+ - Initial gem release.