fluent-plugin-elasticsearch-dext 5.0.2
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- checksums.yaml +7 -0
- data/.coveralls.yml +2 -0
- data/.editorconfig +9 -0
- data/.github/ISSUE_TEMPLATE/bug_report.md +37 -0
- data/.github/ISSUE_TEMPLATE/feature_request.md +24 -0
- data/.github/workflows/issue-auto-closer.yml +12 -0
- data/.github/workflows/linux.yml +26 -0
- data/.github/workflows/macos.yml +26 -0
- data/.github/workflows/windows.yml +26 -0
- data/.gitignore +18 -0
- data/.travis.yml +40 -0
- data/CONTRIBUTING.md +24 -0
- data/Gemfile +11 -0
- data/History.md +553 -0
- data/ISSUE_TEMPLATE.md +30 -0
- data/LICENSE.txt +201 -0
- data/PULL_REQUEST_TEMPLATE.md +10 -0
- data/README.ElasticsearchGenID.md +116 -0
- data/README.ElasticsearchInput.md +293 -0
- data/README.Troubleshooting.md +601 -0
- data/README.md +1467 -0
- data/Rakefile +11 -0
- data/appveyor.yml +20 -0
- data/fluent-plugin-elasticsearch.gemspec +35 -0
- data/gemfiles/Gemfile.elasticsearch.v6 +12 -0
- data/lib/fluent/log-ext.rb +38 -0
- data/lib/fluent/plugin/default-ilm-policy.json +14 -0
- data/lib/fluent/plugin/elasticsearch_constants.rb +13 -0
- data/lib/fluent/plugin/elasticsearch_error.rb +5 -0
- data/lib/fluent/plugin/elasticsearch_error_handler.rb +129 -0
- data/lib/fluent/plugin/elasticsearch_fallback_selector.rb +9 -0
- data/lib/fluent/plugin/elasticsearch_index_lifecycle_management.rb +67 -0
- data/lib/fluent/plugin/elasticsearch_index_template.rb +211 -0
- data/lib/fluent/plugin/elasticsearch_simple_sniffer.rb +10 -0
- data/lib/fluent/plugin/elasticsearch_tls.rb +70 -0
- data/lib/fluent/plugin/filter_elasticsearch_genid.rb +77 -0
- data/lib/fluent/plugin/in_elasticsearch.rb +325 -0
- data/lib/fluent/plugin/oj_serializer.rb +22 -0
- data/lib/fluent/plugin/out_elasticsearch.rb +1108 -0
- data/lib/fluent/plugin/out_elasticsearch_data_stream.rb +218 -0
- data/lib/fluent/plugin/out_elasticsearch_dynamic.rb +282 -0
- data/test/helper.rb +24 -0
- data/test/plugin/test_alias_template.json +9 -0
- data/test/plugin/test_elasticsearch_error_handler.rb +646 -0
- data/test/plugin/test_elasticsearch_fallback_selector.rb +74 -0
- data/test/plugin/test_elasticsearch_index_lifecycle_management.rb +66 -0
- data/test/plugin/test_elasticsearch_tls.rb +145 -0
- data/test/plugin/test_filter_elasticsearch_genid.rb +215 -0
- data/test/plugin/test_in_elasticsearch.rb +459 -0
- data/test/plugin/test_index_alias_template.json +11 -0
- data/test/plugin/test_index_template.json +25 -0
- data/test/plugin/test_oj_serializer.rb +19 -0
- data/test/plugin/test_out_elasticsearch.rb +5688 -0
- data/test/plugin/test_out_elasticsearch_data_stream.rb +337 -0
- data/test/plugin/test_out_elasticsearch_dynamic.rb +1134 -0
- data/test/plugin/test_template.json +23 -0
- data/test/test_log-ext.rb +35 -0
- metadata +236 -0
checksums.yaml
ADDED
@@ -0,0 +1,7 @@
|
|
1
|
+
---
|
2
|
+
SHA256:
|
3
|
+
metadata.gz: c74941c01afec4650824402b6ce4ac56240c98d9d9de1b59297c98c05feabbef
|
4
|
+
data.tar.gz: '02387f67defa1064b98607dd52bebaddfae3bf96ce5266532887593d42b53499'
|
5
|
+
SHA512:
|
6
|
+
metadata.gz: 986621286e073ce8476de2f21e6edd0a0ded7eb61209cc88bf305fd5b96ef995674f0fcab47b452e022700fd63b250519243463dc0dae9a7f149d48d7fe2ae3e
|
7
|
+
data.tar.gz: 1d1e3c081abf91b4528d0affd9d278a227bc018cc3ea44106bebd379aacaa5fd2cdf35c79459c5a20197e3ec9cad500b7d1bc595d89e4cc079bf71d74550a752
|
data/.coveralls.yml
ADDED
data/.editorconfig
ADDED
@@ -0,0 +1,37 @@
|
|
1
|
+
---
|
2
|
+
name: Bug Report
|
3
|
+
about: Create a report to help us improve. If you have questions about ES plugin on kubernetes, please direct these to https://discuss.kubernetes.io/ before sumbit kubernetes related issue.
|
4
|
+
|
5
|
+
---
|
6
|
+
|
7
|
+
(check apply)
|
8
|
+
- [ ] read [the contribution guideline](https://github.com/uken/fluent-plugin-elasticsearch/blob/master/CONTRIBUTING.md)
|
9
|
+
- [ ] (optional) already reported 3rd party upstream repository or mailing list if you use k8s addon or helm charts.
|
10
|
+
|
11
|
+
#### Problem
|
12
|
+
|
13
|
+
...
|
14
|
+
|
15
|
+
#### Steps to replicate
|
16
|
+
|
17
|
+
Either clone and modify https://gist.github.com/pitr/9a518e840db58f435911
|
18
|
+
|
19
|
+
**OR**
|
20
|
+
|
21
|
+
Provide example config and message
|
22
|
+
|
23
|
+
#### Expected Behavior or What you need to ask
|
24
|
+
|
25
|
+
...
|
26
|
+
|
27
|
+
#### Using Fluentd and ES plugin versions
|
28
|
+
|
29
|
+
* OS version
|
30
|
+
* Bare Metal or within Docker or Kubernetes or others?
|
31
|
+
* Fluentd v0.12 or v0.14/v1.0
|
32
|
+
* paste result of ``fluentd --version`` or ``td-agent --version``
|
33
|
+
* ES plugin 3.x.y/2.x.y or 1.x.y
|
34
|
+
* paste boot log of fluentd or td-agent
|
35
|
+
* paste result of ``fluent-gem list``, ``td-agent-gem list`` or your Gemfile.lock
|
36
|
+
* ES version (optional)
|
37
|
+
* ES template(s) (optional)
|
@@ -0,0 +1,24 @@
|
|
1
|
+
---
|
2
|
+
name: Feature request
|
3
|
+
about: Suggest an idea for this project
|
4
|
+
|
5
|
+
---
|
6
|
+
|
7
|
+
(check apply)
|
8
|
+
- [ ] read [the contribution guideline](https://github.com/uken/fluent-plugin-elasticsearch/blob/master/CONTRIBUTING.md)
|
9
|
+
|
10
|
+
**Is your feature request related to a problem? Please describe.**
|
11
|
+
|
12
|
+
<!-- A clear and concise description of what the problem is. Ex. I'm always frustrated when [...] -->
|
13
|
+
|
14
|
+
**Describe the solution you'd like**
|
15
|
+
|
16
|
+
<!-- A clear and concise description of what you want to happen. -->
|
17
|
+
|
18
|
+
**Describe alternatives you've considered**
|
19
|
+
|
20
|
+
<!-- A clear and concise description of any alternative solutions or features you've considered. -->
|
21
|
+
|
22
|
+
**Additional context**
|
23
|
+
|
24
|
+
<!-- Add any other context or screenshots about the feature request here. -->
|
@@ -0,0 +1,12 @@
|
|
1
|
+
name: Autocloser
|
2
|
+
on: [issues]
|
3
|
+
jobs:
|
4
|
+
autoclose:
|
5
|
+
runs-on: ubuntu-latest
|
6
|
+
steps:
|
7
|
+
- name: Autoclose issues that did not follow issue template
|
8
|
+
uses: roots/issue-closer-action@v1.1
|
9
|
+
with:
|
10
|
+
repo-token: ${{ secrets.GITHUB_TOKEN }}
|
11
|
+
issue-close-message: "@${issue.user.login} this issue was automatically closed because it did not follow the issue template."
|
12
|
+
issue-pattern: "(.*Problem.*)|(.*Expected Behavior or What you need to ask.*)|(.*Using Fluentd and ES plugin versions.*)|(.*Is your feature request related to a problem? Please describe.*)|(.*Describe the solution you'd like.*)|(.*Describe alternatives you've considered.*)"
|
@@ -0,0 +1,26 @@
|
|
1
|
+
name: Testing on Ubuntu
|
2
|
+
on:
|
3
|
+
- push
|
4
|
+
- pull_request
|
5
|
+
jobs:
|
6
|
+
build:
|
7
|
+
runs-on: ${{ matrix.os }}
|
8
|
+
strategy:
|
9
|
+
fail-fast: false
|
10
|
+
matrix:
|
11
|
+
ruby: [ '2.4', '2.5', '2.6', '2.7' ]
|
12
|
+
os:
|
13
|
+
- ubuntu-latest
|
14
|
+
name: Ruby ${{ matrix.ruby }} unit testing on ${{ matrix.os }}
|
15
|
+
steps:
|
16
|
+
- uses: actions/checkout@v2
|
17
|
+
- uses: ruby/setup-ruby@v1
|
18
|
+
with:
|
19
|
+
ruby-version: ${{ matrix.ruby }}
|
20
|
+
- name: unit testing
|
21
|
+
env:
|
22
|
+
CI: true
|
23
|
+
run: |
|
24
|
+
gem install bundler rake
|
25
|
+
bundle install --jobs 4 --retry 3
|
26
|
+
bundle exec rake test
|
@@ -0,0 +1,26 @@
|
|
1
|
+
name: Testing on macOS
|
2
|
+
on:
|
3
|
+
- push
|
4
|
+
- pull_request
|
5
|
+
jobs:
|
6
|
+
build:
|
7
|
+
runs-on: ${{ matrix.os }}
|
8
|
+
strategy:
|
9
|
+
fail-fast: false
|
10
|
+
matrix:
|
11
|
+
ruby: [ '2.4', '2.5', '2.6', '2.7' ]
|
12
|
+
os:
|
13
|
+
- macOS-latest
|
14
|
+
name: Ruby ${{ matrix.ruby }} unit testing on ${{ matrix.os }}
|
15
|
+
steps:
|
16
|
+
- uses: actions/checkout@v2
|
17
|
+
- uses: ruby/setup-ruby@v1
|
18
|
+
with:
|
19
|
+
ruby-version: ${{ matrix.ruby }}
|
20
|
+
- name: unit testing
|
21
|
+
env:
|
22
|
+
CI: true
|
23
|
+
run: |
|
24
|
+
gem install bundler rake
|
25
|
+
bundle install --jobs 4 --retry 3
|
26
|
+
bundle exec rake test
|
@@ -0,0 +1,26 @@
|
|
1
|
+
name: Testing on Windows
|
2
|
+
on:
|
3
|
+
- push
|
4
|
+
- pull_request
|
5
|
+
jobs:
|
6
|
+
build:
|
7
|
+
runs-on: ${{ matrix.os }}
|
8
|
+
strategy:
|
9
|
+
fail-fast: false
|
10
|
+
matrix:
|
11
|
+
ruby: [ '2.4', '2.5', '2.6', '2.7' ]
|
12
|
+
os:
|
13
|
+
- windows-latest
|
14
|
+
name: Ruby ${{ matrix.ruby }} unit testing on ${{ matrix.os }}
|
15
|
+
steps:
|
16
|
+
- uses: actions/checkout@v2
|
17
|
+
- uses: ruby/setup-ruby@v1
|
18
|
+
with:
|
19
|
+
ruby-version: ${{ matrix.ruby }}
|
20
|
+
- name: unit testing
|
21
|
+
env:
|
22
|
+
CI: true
|
23
|
+
run: |
|
24
|
+
gem install bundler rake
|
25
|
+
bundle install --jobs 4 --retry 3
|
26
|
+
bundle exec rake test
|
data/.gitignore
ADDED
data/.travis.yml
ADDED
@@ -0,0 +1,40 @@
|
|
1
|
+
language: ruby
|
2
|
+
|
3
|
+
jobs:
|
4
|
+
include:
|
5
|
+
- rvm: 2.4.6
|
6
|
+
gemfile: Gemfile
|
7
|
+
os: linux
|
8
|
+
arch: amd64
|
9
|
+
- rvm: 2.5.5
|
10
|
+
gemfile: Gemfile
|
11
|
+
os: linux
|
12
|
+
arch: amd64
|
13
|
+
- rvm: 2.6.3
|
14
|
+
gemfile: gemfiles/Gemfile.elasticsearch.v6
|
15
|
+
os: linux
|
16
|
+
arch: amd64
|
17
|
+
- rvm: 2.6.3
|
18
|
+
gemfile: Gemfile
|
19
|
+
os: linux
|
20
|
+
arch: amd64
|
21
|
+
- rvm: 2.6.3
|
22
|
+
gemfile: Gemfile
|
23
|
+
os: linux
|
24
|
+
arch: arm64
|
25
|
+
- rvm: 2.6.3
|
26
|
+
gemfile: Gemfile
|
27
|
+
os: osx
|
28
|
+
osx_image: xcode11.3
|
29
|
+
- rvm: 2.7.0
|
30
|
+
gemfile: Gemfile
|
31
|
+
os: linux
|
32
|
+
arch: amd64
|
33
|
+
|
34
|
+
gemfile:
|
35
|
+
- Gemfile
|
36
|
+
|
37
|
+
before_install:
|
38
|
+
- gem update --system=2.7.8
|
39
|
+
|
40
|
+
script: bundle exec rake test
|
data/CONTRIBUTING.md
ADDED
@@ -0,0 +1,24 @@
|
|
1
|
+
Contributing to fluent-plugin-elasticsearch
|
2
|
+
===
|
3
|
+
|
4
|
+
We'd love your contribution. Here are the guidelines!
|
5
|
+
|
6
|
+
## Got a question or problem?
|
7
|
+
|
8
|
+
RESOURCES of [Official site's documentation](https://docs.fluentd.org/output/elasticsearch) and [ES plugin documentation](https://github.com/uken/fluent-plugin-elasticsearch/blob/master/README.md) may help you.
|
9
|
+
|
10
|
+
If you have further questions about ES plugin, feel free to [open an Issue](https://github.com/uken/fluent-plugin-elasticsearch/issues).
|
11
|
+
|
12
|
+
## Found a bug?
|
13
|
+
|
14
|
+
If you find a bug of ES plugin or a mistake in the documentation, you can help us by submitting an issue to ES plugin. Even better you can submit a pull request with a fix.
|
15
|
+
|
16
|
+
Note: Please follow the issue template/pull request template when sending your issue. Otherwise, your issue _might going to be closed with no response_.
|
17
|
+
|
18
|
+
## Patch Guidelines
|
19
|
+
|
20
|
+
Here are some things that would increase a chance that your patch is accepted:
|
21
|
+
|
22
|
+
* Write tests
|
23
|
+
* Run tests before sending pull request with `bundle exec rake test`
|
24
|
+
* Write [a good commit message](https://tbaggery.com/2008/04/19/a-note-about-git-commit-messages.html)
|
data/Gemfile
ADDED
@@ -0,0 +1,11 @@
|
|
1
|
+
source 'https://rubygems.org'
|
2
|
+
|
3
|
+
# Specify your gem's dependencies in fluent-plugin-elasticsearch.gemspec
|
4
|
+
gemspec
|
5
|
+
|
6
|
+
gem 'simplecov', require: false
|
7
|
+
gem 'coveralls', ">= 0.8.0", require: false
|
8
|
+
gem 'strptime', require: false if RUBY_ENGINE == "ruby" && RUBY_VERSION =~ /^2/
|
9
|
+
gem "irb" if RUBY_ENGINE == "ruby" && RUBY_VERSION >= "2.6"
|
10
|
+
gem "elasticsearch-xpack"
|
11
|
+
gem "oj"
|
data/History.md
ADDED
@@ -0,0 +1,553 @@
|
|
1
|
+
## Changelog [[tags]](https://github.com/uken/fluent-plugin-elasticsearch/tags)
|
2
|
+
|
3
|
+
### [Unreleased]
|
4
|
+
|
5
|
+
### 5.0.1
|
6
|
+
- Use elasticsearch/api instead of elasticsearch/xpack (#870)
|
7
|
+
|
8
|
+
### 5.0.0
|
9
|
+
- Support #retry_operate on data stream (#863)
|
10
|
+
- Support placeholder in @data\_stream\_name for @type elasticsearch\_data\_stream (#862)
|
11
|
+
- Extract troubleshooting section (#861)
|
12
|
+
- Fix unmatched `<source>` close tag (#860)
|
13
|
+
- Initial support for Elasticsearch Data Stream (#859)
|
14
|
+
|
15
|
+
### 4.3.3
|
16
|
+
- Handle invalid Elasticsearch::Client#info response (#855)
|
17
|
+
|
18
|
+
### 4.3.2
|
19
|
+
- Use log.debug to dump ES 8.x _type information (#852)
|
20
|
+
|
21
|
+
### 4.3.1
|
22
|
+
- Unsplit huge records by default (#851)
|
23
|
+
|
24
|
+
### 4.3.0
|
25
|
+
- Add cloud_id & cloud_auth settings (#850)
|
26
|
+
- Fix failing tests on es6 client (#848)
|
27
|
+
- feat: retry on transport errors (#846)
|
28
|
+
- fix typo (#838)
|
29
|
+
- Remove unnecessary nil check (#826)
|
30
|
+
|
31
|
+
### 4.2.2
|
32
|
+
- Remove unnecessary nil check (#826)
|
33
|
+
- Fix ILM rollover index template pattern to apply index_separator (#825)
|
34
|
+
- Fix ILM rollover alias creation when a placeholder is used in index_name (#823)
|
35
|
+
- Add a note about the pitfalls of per-date indexes used with ILM (#822)
|
36
|
+
|
37
|
+
### 4.2.1
|
38
|
+
- Update a broken link (#821)
|
39
|
+
- Include chunk_id in records (#820)
|
40
|
+
- Fix a failing testcase (#818)
|
41
|
+
|
42
|
+
### 4.2.0
|
43
|
+
- ci: Add Ruby 2.7 jobs (#812)
|
44
|
+
- Support Elasticsearch new style template (#810)
|
45
|
+
|
46
|
+
### 4.1.4
|
47
|
+
- ElasticsearchGenID update docs for hash_type (#809)
|
48
|
+
- Handle api key header (#808)
|
49
|
+
- index_template: Handle error object entirely on index creation failure (#807)
|
50
|
+
|
51
|
+
### 4.1.3
|
52
|
+
- Load multiple templates even if template_name and template_file given (#799)
|
53
|
+
- Handle elasticsearch-ruby 7.9.0 using HTTP method changes (#795)
|
54
|
+
|
55
|
+
### 4.1.2
|
56
|
+
- Use Hash#dig instead of Hash#[] on retrieving version information from Elasticsearch info API (#793)
|
57
|
+
|
58
|
+
### 4.1.1
|
59
|
+
- Correct ILM explain on logstash_format case (#786)
|
60
|
+
|
61
|
+
### 4.1.0
|
62
|
+
- Implement Fallback selector and configurable selector class (#782)
|
63
|
+
|
64
|
+
### 4.0.11
|
65
|
+
- Add custom and time placeholders combination testcase for ILM (#781)
|
66
|
+
- Really support ILM on `logstash_format` enabled environment (#779)
|
67
|
+
|
68
|
+
### 4.0.10
|
69
|
+
- filter_elasticsearch_genid: Use entire record as hash seed (#777)
|
70
|
+
- Suppress type in meta with suppress_type_name parameter (#774)
|
71
|
+
- filter\_elasticsearch\_genid: Add hash generation mechanism from events (#773)
|
72
|
+
- Clean up error text (#772)
|
73
|
+
- Use GitHub Actions badges instead of Travis' (#760)
|
74
|
+
- Add issue auto closer workflow (#759)
|
75
|
+
- Document required permissions (#757)
|
76
|
+
|
77
|
+
### 4.0.9
|
78
|
+
- Add possibility to configure multiple ILM policies (#753)
|
79
|
+
- Document required permissions (#757)
|
80
|
+
|
81
|
+
### 4.0.8
|
82
|
+
- Handle compressable connection usable state (#743)
|
83
|
+
- Use newer tls protocol versions (#739)
|
84
|
+
- Add GitHub Actions file (#740)
|
85
|
+
|
86
|
+
### 4.0.7
|
87
|
+
- Added http_backend_excon_nonblock config in out_elasticsearch (#733)
|
88
|
+
|
89
|
+
### 4.0.6
|
90
|
+
- Add fallback mechanism for handling to detect es version (#730)
|
91
|
+
- Remove needless section (#728)
|
92
|
+
- Handle exception if index already exists (#727)
|
93
|
+
- Tweak test cases (#726)
|
94
|
+
|
95
|
+
### 4.0.5
|
96
|
+
- add logstash_dateformat as placeholder (#718)
|
97
|
+
- Tweak travis.yml for suppressing validator warnings and add CI for Linux Arm64 architecture and macOS 10.14 (#724)
|
98
|
+
- Elasticsearch ruby v7.5 (#723)
|
99
|
+
- Add Oj serializer testcases for all job (#722)
|
100
|
+
- Update documentation for ILM (#721)
|
101
|
+
|
102
|
+
### 4.0.4
|
103
|
+
- Provide clearing caches timer (#719)
|
104
|
+
|
105
|
+
### 4.0.3
|
106
|
+
- Use http.scheme settings for persisent scheme setup (#713)
|
107
|
+
|
108
|
+
### 4.0.2
|
109
|
+
- Support TLSv1.3 (#710)
|
110
|
+
|
111
|
+
### 4.0.1
|
112
|
+
- Placeholders for template name and customize template (#708)
|
113
|
+
- Add overwriting ilm policy config parameter (#707)
|
114
|
+
- Fix a failing ILM config testcase (#706)
|
115
|
+
|
116
|
+
### 4.0.0
|
117
|
+
- Restructuring ILM related features (#701)
|
118
|
+
- Extract placeholders in pipeline parameter (#695)
|
119
|
+
- fix typo in `README.md` (#698)
|
120
|
+
- Reduce log noise when not using rollover_index (#692)
|
121
|
+
|
122
|
+
### 3.8.0
|
123
|
+
- Add FAQ for specifying index.codec (#679)
|
124
|
+
- Add FAQ for connect_write timeout reached error (#687)
|
125
|
+
- Unblocking buffer overflow with block action (#688)
|
126
|
+
|
127
|
+
### 3.7.1
|
128
|
+
- Make conpatible for Fluentd v1.8 (#677)
|
129
|
+
- Handle flatten_hashes in elasticsearch_dynamic (#675)
|
130
|
+
- Handle empty index_date_pattern parameter (#674)
|
131
|
+
|
132
|
+
### 3.7.0
|
133
|
+
- Tweak for cosmetic change (#671)
|
134
|
+
- Fix access to Elasticsearch::Transport::VERSION with explicit top level class path (#670)
|
135
|
+
- Implement Elasticsearch Input plugin (#669)
|
136
|
+
|
137
|
+
### 3.6.1
|
138
|
+
- retry upsert on recoverable error. (#667)
|
139
|
+
- Allow `_index` in chunk_keys (#665)
|
140
|
+
- Support compression feature (#664)
|
141
|
+
|
142
|
+
### 3.6.0
|
143
|
+
- Set order in newly created templates (#660)
|
144
|
+
- Merge Support index lifecycle management into master (#659)
|
145
|
+
- Support template installation with host placeholder (#654)
|
146
|
+
- Support index lifecycle management (#651)
|
147
|
+
|
148
|
+
### 3.5.6
|
149
|
+
- Support elasticsearch8 removal of mapping types (#656)
|
150
|
+
- Upgrade webmock to 3 (#652)
|
151
|
+
- Suppress `ruby -c` warnings (#649)
|
152
|
+
- Add tips for sniffer class (#644)
|
153
|
+
- Make `client_key_pass` secret (#637)
|
154
|
+
- Validate `user` and `password` early (#636)
|
155
|
+
|
156
|
+
### 3.5.5
|
157
|
+
- Fix arguments order of `assert_equal` (#635)
|
158
|
+
- Add description for `port` option (#634)
|
159
|
+
- Fix description position and add examples for `hosts` option (#633)
|
160
|
+
- Use upper-case to compare before and after conversion (#630)
|
161
|
+
- Validate `max_retry_get_es_version` (#629)
|
162
|
+
- Remove unused getting plugin instance (#628)
|
163
|
+
- Fix error message for `max_retry_putting_template` (#627)
|
164
|
+
- Fix DST-breaking unit test (#623)
|
165
|
+
- Handle ClusterBlockException (#621)
|
166
|
+
- Add contribution guideline document (#618)
|
167
|
+
|
168
|
+
### 3.5.4
|
169
|
+
- Add FAQ for Fluentd seems to hang if it unable to connect Elasticsearch (#617)
|
170
|
+
- Check bulk_message size before appending (#616)
|
171
|
+
- Add FAQ for Elasticsearch index mapping glitch (#614)
|
172
|
+
- Display retry counts and interval (#613)
|
173
|
+
|
174
|
+
### 3.5.3
|
175
|
+
- Handle nil items response (#611)
|
176
|
+
|
177
|
+
### 3.5.2
|
178
|
+
- Fix `@meta_config_map` creation timing (#592)
|
179
|
+
|
180
|
+
### 3.5.1
|
181
|
+
- Configurable split request size threshold (#586)
|
182
|
+
|
183
|
+
### 3.5.0
|
184
|
+
- Adopt Elasticsearch ruby client v7 loggable class (#583)
|
185
|
+
|
186
|
+
### 3.4.3
|
187
|
+
- Add fail_on_putting_template_retry_exceed config (#579)
|
188
|
+
|
189
|
+
### 3.4.2
|
190
|
+
- Comparing DEFAULT_TYPE_NAME_ES_7x to target_type instead of type_name (#573)
|
191
|
+
|
192
|
+
### 3.4.1
|
193
|
+
- Handle non-String value on parse_time (#570)
|
194
|
+
|
195
|
+
### 3.4.0
|
196
|
+
- Check exclusive feature on #configure (#569)
|
197
|
+
- Modify FAQ for highly load k8s EFK stack (#566)
|
198
|
+
- Add FAQ for high load k8s EFK stack (#564)
|
199
|
+
|
200
|
+
### 3.3.3
|
201
|
+
- Add unit test for exception message (#563)
|
202
|
+
- Add ignore_exceptions config (#562)
|
203
|
+
|
204
|
+
### 3.3.2
|
205
|
+
- Fix support for host, hosts placeholders (#560)
|
206
|
+
- typo fixes in README.md (#559)
|
207
|
+
|
208
|
+
### 3.3.1
|
209
|
+
- add new option to suppress doc wrapping (#557)
|
210
|
+
- Include 2 (#555)
|
211
|
+
|
212
|
+
### 3.3.0
|
213
|
+
- Support builtin placeholders for host and hosts parameter (#554)
|
214
|
+
|
215
|
+
### 3.2.4
|
216
|
+
- Pass chunk for built in placeholders (#553)
|
217
|
+
|
218
|
+
### 3.2.3
|
219
|
+
- Expose exception backtrace for typhoeus gem loading error (#550)
|
220
|
+
|
221
|
+
### 3.2.2
|
222
|
+
- Don't validate ES cliuent version under dry-run mode (#547)
|
223
|
+
|
224
|
+
### 3.2.1
|
225
|
+
- Don't attempt to connect to Elasticsearch in dry run mode (#543)
|
226
|
+
- Add FAQ for typhoeus gem installation (#544)
|
227
|
+
|
228
|
+
### 3.2.0
|
229
|
+
- Split huge record requests (#539)
|
230
|
+
|
231
|
+
### 3.1.1
|
232
|
+
- Add document for custom_headers (#538)
|
233
|
+
- out_elasticsearch: Add custom_headers parameter (#529)
|
234
|
+
- Bundle irb on Ruby 2.6 or later (#537)
|
235
|
+
|
236
|
+
### 3.1.0
|
237
|
+
- Retry obtaining Elasticsearch version (#532)
|
238
|
+
- Fix broken id links (#530)
|
239
|
+
|
240
|
+
### 3.0.2
|
241
|
+
- appveyor: Remove Ruby 2.1 CI targets on AppVeyor (#524)
|
242
|
+
- Follow removal of _routing field change on recent Elasticsearch (#523)
|
243
|
+
- Travis: Tweak to use Ruby versions (#522)
|
244
|
+
|
245
|
+
### 3.0.1
|
246
|
+
- Remove needless Elasticsearch version detection (#520)
|
247
|
+
|
248
|
+
### 3.0.0
|
249
|
+
- Use fluentd core retry mechanism (#519)
|
250
|
+
- Depends on builtin retrying mechanism (#518)
|
251
|
+
- Loosen ConnectionRetryFailure condition when flush_thread_count > 1 and depends on Fluentd core retrying mechanism (#516)
|
252
|
+
|
253
|
+
### 2.12.5
|
254
|
+
- Ensure sniffer class constants definition before calling #client (#515)
|
255
|
+
|
256
|
+
### 2.12.4
|
257
|
+
- #506 Rollover index will be in effect in case of template overwrite also. (#513)
|
258
|
+
|
259
|
+
### 2.12.3
|
260
|
+
- Added log_es_400_reason configuration item (#511)
|
261
|
+
- Allow a user to specify the rollover index date pattern (#510)
|
262
|
+
|
263
|
+
### 2.12.2
|
264
|
+
- Verify connection at startup (#504)
|
265
|
+
- Add faq for glob pattern tag routing (#502)
|
266
|
+
|
267
|
+
### 2.12.1
|
268
|
+
- Make configurable unrecoverable types (#501)
|
269
|
+
- Add FAQ for TLS enabled nginx proxy TLS version incompatibility trouble (#496)
|
270
|
+
- Add FAQs (#492)
|
271
|
+
- Remove issuestats.com badges (#489)
|
272
|
+
|
273
|
+
### 2.12.0
|
274
|
+
- Decoupling the custom template and rollover index creation #485 (#486)
|
275
|
+
|
276
|
+
### 2.11.11
|
277
|
+
- Handle error not to acquire version information (#479)
|
278
|
+
|
279
|
+
### 2.11.10
|
280
|
+
- Verbose error reason output (#469)
|
281
|
+
|
282
|
+
### 2.11.9
|
283
|
+
- Use ConnectionRetryFailure in plugin specific retrying for consistency (#468)
|
284
|
+
- Remove outdated generating hash_id_key code (#466)
|
285
|
+
- Tweak behavior for UnrecoverableError and #detect_es_major_version (#465)
|
286
|
+
|
287
|
+
### 2.11.8
|
288
|
+
- Serialize requests with Oj (#464)
|
289
|
+
|
290
|
+
### 2.11.7
|
291
|
+
- Add mechanism to detect ES and its client version mismatch (#463)
|
292
|
+
|
293
|
+
### 2.11.6
|
294
|
+
- 355 customize template (#431)
|
295
|
+
|
296
|
+
### 2.11.5
|
297
|
+
- Uplift Merge pull request #459 from richm/v0.12-simple-sniffer (#461)
|
298
|
+
|
299
|
+
### 2.11.4
|
300
|
+
- Persistent backend (#456)
|
301
|
+
|
302
|
+
### 2.11.3
|
303
|
+
- Implement the `include_index_in_url` option for out_elasticsearch (#451)
|
304
|
+
- Add an option `include_index_in_url` to allow URL-based conrtrols (#450)
|
305
|
+
|
306
|
+
### 2.11.2
|
307
|
+
- Strictness scheme (#445)
|
308
|
+
|
309
|
+
### 2.11.0
|
310
|
+
- Uplift Merge pull request #437 from jcantrill/fix_bulk_count (#438)
|
311
|
+
|
312
|
+
### 2.10.5
|
313
|
+
- Uplift Merge pull request #435 from jcantrill/add_trace_logging (#436)
|
314
|
+
|
315
|
+
### 2.10.4
|
316
|
+
- Use Fluent::UnrecoverableError as unrecoverable error class ancestors (#433)
|
317
|
+
- Add parameter validation for retrying template installation (#429)
|
318
|
+
|
319
|
+
### 2.10.3
|
320
|
+
- Add retry mechanism for template installation (#428)
|
321
|
+
|
322
|
+
### 2.10.2
|
323
|
+
- Use logstash_prefix_separator on elasticsearch_dynamic (#427)
|
324
|
+
|
325
|
+
### 2.10.1
|
326
|
+
- Uplift Merge pull request #419 from jcantrill/retry_prefix (#421)
|
327
|
+
- Uplift Merge pull request #418 from jcantrill/emit_exception (#420)
|
328
|
+
|
329
|
+
### 2.10.0
|
330
|
+
- Uplift Merge pull request #405 from jcantrill/sanitize_bulk (#414)
|
331
|
+
|
332
|
+
### 2.9.2
|
333
|
+
- Uplift Merge pull request #410 from richm/v0.12-consistent-errors-and-tests (#411)
|
334
|
+
- Add correct link for include_timestamp (#408)
|
335
|
+
|
336
|
+
### 2.9.1
|
337
|
+
- Uplift Merge pull request #406 from richm/v0.12-successes-duplicates-no-retry (#407)
|
338
|
+
|
339
|
+
### 2.9.0
|
340
|
+
- DLQ revisited v1 uplifted #398, #402 (#404)
|
341
|
+
|
342
|
+
### 2.8.6
|
343
|
+
- auth: Fix missing auth tokens after reloading connections (#394)
|
344
|
+
|
345
|
+
### 2.8.5
|
346
|
+
- Add deprecated option into content_type parameter (#391)
|
347
|
+
|
348
|
+
### 2.8.4
|
349
|
+
- Use nanosecond precision in elasticsearch_dynamic (#387)
|
350
|
+
|
351
|
+
### 2.8.3
|
352
|
+
- Specify SSL/TLS version in out_elasticsearch_dynamic (#385)
|
353
|
+
|
354
|
+
### 2.8.2
|
355
|
+
- Revert content type header default value (#383)
|
356
|
+
|
357
|
+
### 2.8.1
|
358
|
+
- Restore default value of type name #(377)
|
359
|
+
|
360
|
+
### 2.8.0
|
361
|
+
- Remove outdated generating hash id support module (#373)
|
362
|
+
- Check Elasticsearch major version (#371)
|
363
|
+
|
364
|
+
### 2.7.0
|
365
|
+
- Configureable content type (#367)
|
366
|
+
|
367
|
+
### 2.6.1
|
368
|
+
- Prevent error when using template in elasticsearch_dynamic for elementally use case (#363)
|
369
|
+
|
370
|
+
### 2.6.0
|
371
|
+
- Handle high precision time format when using custom time_key (#360)
|
372
|
+
|
373
|
+
### 2.5.0
|
374
|
+
- Using nested record in `id_key`, `parent_key`, and `routing_key` (#351)
|
375
|
+
- Fix inverted case of a proper noun "Elasticsearch" (#349)
|
376
|
+
|
377
|
+
### 2.4.1
|
378
|
+
- Add config parameter to enable elasticsearch-ruby's transporter logging (#342)
|
379
|
+
|
380
|
+
### 2.4.0
|
381
|
+
- Add built-in placeholders support against type_name parameter (#338)
|
382
|
+
|
383
|
+
### 2.3.0
|
384
|
+
- Allow overwriting existing index template (#239)
|
385
|
+
|
386
|
+
### 2.2.0
|
387
|
+
- GA release 2.2.0.
|
388
|
+
|
389
|
+
### 2.2.0.rc.1
|
390
|
+
- Separate generate hash id module and bundled new plugin for generating unique hash id (#331)
|
391
|
+
|
392
|
+
### 2.1.1
|
393
|
+
- Raise ConfigError when specifying different @hash_config.hash_id_key and id_key configration (#327)
|
394
|
+
- Small typo fix in README.md (#325)
|
395
|
+
|
396
|
+
### 2.1.0
|
397
|
+
- Retry on certain errors from Elasticsearch (#322)
|
398
|
+
|
399
|
+
### 2.0.1
|
400
|
+
- Releasing generating hash id mechanism to avoid records duplication feature.
|
401
|
+
|
402
|
+
### 2.0.1.rc.1
|
403
|
+
- Add generating hash id mechanism to avoid records duplication (#318)
|
404
|
+
|
405
|
+
### 2.0.0
|
406
|
+
- Release for Fluentd v0.14 stable.
|
407
|
+
|
408
|
+
### 2.0.0.rc.7
|
409
|
+
- Add `include_timestamp` option (#310)
|
410
|
+
|
411
|
+
### 2.0.0.rc.6
|
412
|
+
- Improve documentation (#304)
|
413
|
+
- Handle dynamic_config misconfigurations (#305)
|
414
|
+
- Escape basic authentication user information placeholders (#306)
|
415
|
+
|
416
|
+
### 2.0.0.rc.5
|
417
|
+
- make configurable with `ssl_version` parameter (#299)
|
418
|
+
- add `logstash_prefix_separator` config parameter (#297)
|
419
|
+
|
420
|
+
### 2.0.0.rc.4
|
421
|
+
- fix license identifier in gemspec (#294)
|
422
|
+
|
423
|
+
### 2.0.0.rc.3
|
424
|
+
- add built-in placeholders support (#288, #293)
|
425
|
+
- permit multi workers feature (#291)
|
426
|
+
|
427
|
+
### 2.0.0.rc.2
|
428
|
+
- add pipeline parameter (#290)
|
429
|
+
|
430
|
+
### 2.0.0.rc.1
|
431
|
+
- Use v0.14 API to support nanosecond precision (#223)
|
432
|
+
|
433
|
+
### 1.9.5
|
434
|
+
- sub-second time precision [(#249)](https://github.com/uken/fluent-plugin-elasticsearch/pull/249)
|
435
|
+
|
436
|
+
### 1.9.4
|
437
|
+
- Include 'Content-Type' header in `transport_options`
|
438
|
+
|
439
|
+
### 1.9.3
|
440
|
+
- Use latest elasticsearch-ruby (#240)
|
441
|
+
- Log ES response errors (#230)
|
442
|
+
|
443
|
+
### 1.9.2
|
444
|
+
- Fix elasticsearch_dynamic for v0.14 (#224)
|
445
|
+
|
446
|
+
### 1.9.1
|
447
|
+
- Cast `reload_*` configs in out_elasticsearch_dynamic to bool (#220)
|
448
|
+
|
449
|
+
### 1.9.0
|
450
|
+
- add `time_parse_error_tag` (#211)
|
451
|
+
- add `reconnect_on_error` (#214)
|
452
|
+
|
453
|
+
### 1.9.0.rc.1
|
454
|
+
- Optimize output plugins (#203)
|
455
|
+
|
456
|
+
### 1.8.0
|
457
|
+
- fix typo in defaults for ssl_verify on elasticsearch_dynamic (#202)
|
458
|
+
- add support for `templates` (#196)
|
459
|
+
- rename `send` method to `send_bulk` (#206)
|
460
|
+
|
461
|
+
### 1.7.0
|
462
|
+
- add support for `template_name` and `template_file` (#194)
|
463
|
+
|
464
|
+
### 1.6.0
|
465
|
+
- add support for dot separated `target_index_key` and `target_type_key` (#175)
|
466
|
+
- add `remove_keys_on_update` and `remove_keys_on_update_key` (#189)
|
467
|
+
- fix support for fluentd v0.14 (#191)
|
468
|
+
- remove support for elasticsearch v2 for now (#177)
|
469
|
+
|
470
|
+
### 1.5.0
|
471
|
+
- add `routing_key` (#158)
|
472
|
+
- add `time_key_exclude_timestamp` to exclude `@timestamp` (#161)
|
473
|
+
- convert index names to lowercase (#163)
|
474
|
+
- add `remove_keys` (#164)
|
475
|
+
- add `flatten_hashes` (#168)
|
476
|
+
- add `target_type_key` (#169)
|
477
|
+
|
478
|
+
### 1.4.0
|
479
|
+
- add `target_index_key` to specify target index (#153)
|
480
|
+
- add `time_key_format` for faster time format parsing (#154)
|
481
|
+
|
482
|
+
### 1.3.0
|
483
|
+
- add `write_operation`
|
484
|
+
|
485
|
+
### 1.2.1
|
486
|
+
- fix `resurrect_after` in out_elasticsearch_dynamic
|
487
|
+
|
488
|
+
### 1.2.0
|
489
|
+
- out_elasticsearch_dynamic get memory improvement and fix for race condition (#133)
|
490
|
+
- Add `resurrect_after` option (#136)
|
491
|
+
|
492
|
+
### 1.1.0
|
493
|
+
- Support SSL client verification and custom CA file (#123)
|
494
|
+
- Release experimental `type elasticsearch_dynamic` (#127)
|
495
|
+
|
496
|
+
### 1.0.0
|
497
|
+
- password config param is now marked as secret and won't be displayed in logs.
|
498
|
+
|
499
|
+
### 0.9.0
|
500
|
+
- Add `ssl_verify` option (#108)
|
501
|
+
|
502
|
+
### 0.8.0
|
503
|
+
- Replace Patron with Excon HTTP client (#93)
|
504
|
+
|
505
|
+
### 0.7.0
|
506
|
+
- Add new option `time_key` (#85)
|
507
|
+
|
508
|
+
### 0.6.1
|
509
|
+
- 0.10.43 is minimum version required of fluentd (#79)
|
510
|
+
|
511
|
+
### 0.6.0
|
512
|
+
- added `reload_on_failure` and `reload_connections` flags (#78)
|
513
|
+
|
514
|
+
### 0.5.1
|
515
|
+
- fix legacy hosts option, port should be optional (#75)
|
516
|
+
|
517
|
+
### 0.5.0
|
518
|
+
- add full connection URI support (#65)
|
519
|
+
- use `@timestamp` for index (#41)
|
520
|
+
- add support for elasticsearch gem version 1 (#71)
|
521
|
+
- fix connection reset & retry when connection is lost (#67)
|
522
|
+
|
523
|
+
### 0.4.0
|
524
|
+
- add `request_timeout` config (#59)
|
525
|
+
- fix lockup when non-hash values are sent (#52)
|
526
|
+
|
527
|
+
### 0.3.1
|
528
|
+
- force using patron (#46)
|
529
|
+
- do not generate @timestamp if already part of message (#35)
|
530
|
+
|
531
|
+
### 0.3.0
|
532
|
+
- add `parent_key` option (#28)
|
533
|
+
- have travis-ci build on multiple rubies (#30)
|
534
|
+
- add `utc_index` and `hosts` options, switch to using `elasticsearch` gem (#26, #29)
|
535
|
+
|
536
|
+
### 0.2.0
|
537
|
+
- fix encoding issues with JSON conversion and again when sending to elasticsearch (#19, #21)
|
538
|
+
- add logstash_dateformat option (#20)
|
539
|
+
|
540
|
+
### 0.1.4
|
541
|
+
- add logstash_prefix option
|
542
|
+
|
543
|
+
### 0.1.3
|
544
|
+
- raising an exception on non-success response from elasticsearch
|
545
|
+
|
546
|
+
### 0.1.2
|
547
|
+
- add id_key option
|
548
|
+
|
549
|
+
### 0.1.1
|
550
|
+
- fix timezone in logstash key
|
551
|
+
|
552
|
+
### 0.1.0
|
553
|
+
- Initial gem release.
|