logstash-output-kafka 4.0.4 → 5.0.0
Sign up to get free protection for your applications and to get access to all the features.
- checksums.yaml +4 -4
- data/CHANGELOG.md +9 -16
- data/README.md +1 -1
- data/lib/logstash/outputs/kafka.rb +2 -3
- data/logstash-output-kafka.gemspec +3 -3
- data/vendor/jar-dependencies/runtime-jars/kafka-clients-0.10.0.0.jar +0 -0
- data/vendor/jar-dependencies/runtime-jars/lz4-1.3.0.jar +0 -0
- data/vendor/jar-dependencies/runtime-jars/slf4j-api-1.7.21.jar +0 -0
- data/{lib/org/xerial/snappy/snappy-java/1.1.1.7/snappy-java-1.1.1.7.jar → vendor/jar-dependencies/runtime-jars/snappy-java-1.1.2.4.jar} +0 -0
- metadata +11 -23
- data/lib/log4j/log4j/1.2.17/log4j-1.2.17.jar +0 -0
- data/lib/net/jpountz/lz4/lz4/1.2.0/lz4-1.2.0.jar +0 -0
- data/lib/org/apache/kafka/kafka-clients/0.9.0.1/kafka-clients-0.9.0.1.jar +0 -0
- data/lib/org/slf4j/slf4j-api/1.7.6/slf4j-api-1.7.6.jar +0 -0
- data/lib/org/slf4j/slf4j-log4j12/1.7.13/slf4j-log4j12-1.7.13.jar +0 -0
- data/vendor/jar-dependencies/runtime-jars/kafka-clients-0.9.0.1.jar +0 -0
- data/vendor/jar-dependencies/runtime-jars/lz4-1.2.0.jar +0 -0
- data/vendor/jar-dependencies/runtime-jars/slf4j-api-1.7.6.jar +0 -0
- data/vendor/jar-dependencies/runtime-jars/snappy-java-1.1.1.7.jar +0 -0
checksums.yaml
CHANGED
@@ -1,7 +1,7 @@
|
|
1
1
|
---
|
2
2
|
SHA1:
|
3
|
-
metadata.gz:
|
4
|
-
data.tar.gz:
|
3
|
+
metadata.gz: d722271348917865062b469a337a312e57a84d0b
|
4
|
+
data.tar.gz: 5fcc3124c93483beb6e570d54dd7ac85d2ddc05d
|
5
5
|
SHA512:
|
6
|
-
metadata.gz:
|
7
|
-
data.tar.gz:
|
6
|
+
metadata.gz: a047922cccf54b0bce0454b77b44109684d8d0abd97b68202a0914689b052efc6f160b27af0959816c4ad69a9a17bb2c428073c7c9116e447d0607e482126c64
|
7
|
+
data.tar.gz: 025535119df68c09d805a5a29bca9f8ad4a3a888f04035c1f478a05e75c38ef712d4738c513f2c18f94fca74e641f358f52d9f9807c80bfb45712ebe1bc05cde
|
data/CHANGELOG.md
CHANGED
@@ -1,16 +1,9 @@
|
|
1
|
-
##
|
2
|
-
-
|
3
|
-
|
4
|
-
## 4.0.3
|
5
|
-
- Internal: vendoring issue when bundling gem
|
6
|
-
|
7
|
-
## 4.0.2
|
8
|
-
- Internal: fixed LS's logger log4j comatibility for LS 5.0
|
9
|
-
|
10
|
-
## 4.0.0/4.0.1
|
1
|
+
## 5.0.0
|
2
|
+
- Kafka 0.10 broker producer
|
3
|
+
## 4.0.0
|
11
4
|
- Republish all the gems under jruby.
|
12
5
|
- Update the plugin to the version 2.0 of the plugin api, this change is required for Logstash 5.0 compatibility. See https://github.com/elastic/logstash/issues/5141
|
13
|
-
|
6
|
+
|
14
7
|
## 3.0.0
|
15
8
|
- GA release of Kafka Output to support 0.9 broker
|
16
9
|
|
@@ -27,16 +20,16 @@
|
|
27
20
|
## 2.0.4
|
28
21
|
- Depend on logstash-core-plugin-api instead of logstash-core, removing the need to mass update plugins on major releases of logstash
|
29
22
|
- [Internal] Pin jruby-kafka to v1.6 to match input
|
30
|
-
|
23
|
+
|
31
24
|
## 2.0.3
|
32
25
|
- New dependency requirements for logstash-core for the 5.0 release
|
33
26
|
|
34
27
|
## 3.0.0.beta1
|
35
|
-
- Note: breaking changes in this version, and not backward compatible with Kafka 0.8 broker.
|
28
|
+
- Note: breaking changes in this version, and not backward compatible with Kafka 0.8 broker.
|
36
29
|
Please read carefully before installing
|
37
|
-
- Breaking: Changed default codec from json to plain. Json codec is really slow when used
|
30
|
+
- Breaking: Changed default codec from json to plain. Json codec is really slow when used
|
38
31
|
with inputs because inputs by default are single threaded. This makes it a bad
|
39
|
-
first user experience. Plain codec is a much better default.
|
32
|
+
first user experience. Plain codec is a much better default.
|
40
33
|
- Moved internal APIs to use Kafka's Java API directly instead of jruby-kafka. This
|
41
34
|
makes it consistent with logstash-input-kafka
|
42
35
|
- Breaking: Change in configuration options
|
@@ -46,7 +39,7 @@
|
|
46
39
|
- [Internal] Pin jruby-kafka to v1.5
|
47
40
|
|
48
41
|
## 2.0.0
|
49
|
-
- Plugins were updated to follow the new shutdown semantic, this mainly allows Logstash to instruct input plugins to terminate gracefully,
|
42
|
+
- Plugins were updated to follow the new shutdown semantic, this mainly allows Logstash to instruct input plugins to terminate gracefully,
|
50
43
|
instead of using Thread.raise on the plugins' threads. Ref: https://github.com/elastic/logstash/pull/3895
|
51
44
|
- Dependency on logstash-core update to 2.0
|
52
45
|
|
data/README.md
CHANGED
@@ -8,7 +8,7 @@ It is fully free and fully open source. The license is Apache 2.0, meaning you a
|
|
8
8
|
|
9
9
|
## Documentation
|
10
10
|
|
11
|
-
### Note:
|
11
|
+
### Note: 3.0.0 version of this plugin will only work with Kafka version 0.9 and is not backward compatible. Older versions (< 3.0.0) will work with Kafka 0.8.x and will be continued to be maintained
|
12
12
|
|
13
13
|
Logstash provides infrastructure to automatically generate documentation for this plugin. We use the asciidoc format to write documentation so any comments in the source code will be first converted into asciidoc and then into html. All plugin documentation are placed under one [central location](http://www.elastic.co/guide/en/logstash/current/).
|
14
14
|
|
@@ -93,8 +93,7 @@ class LogStash::Outputs::Kafka < LogStash::Outputs::Base
|
|
93
93
|
config :retry_backoff_ms, :validate => :number, :default => 100
|
94
94
|
# The size of the TCP send buffer to use when sending data.
|
95
95
|
config :send_buffer_bytes, :validate => :number, :default => 131072
|
96
|
-
# Enable SSL/TLS secured communication to Kafka broker.
|
97
|
-
# is only available with a broker running v0.9 of Kafka.
|
96
|
+
# Enable SSL/TLS secured communication to Kafka broker.
|
98
97
|
config :ssl, :validate => :boolean, :default => false
|
99
98
|
# The JKS truststore path to validate the Kafka broker's certificate.
|
100
99
|
config :ssl_truststore_location, :validate => :path
|
@@ -168,7 +167,7 @@ class LogStash::Outputs::Kafka < LogStash::Outputs::Base
|
|
168
167
|
props.put(kafka::RETRY_BACKOFF_MS_CONFIG, retry_backoff_ms.to_s)
|
169
168
|
props.put(kafka::SEND_BUFFER_CONFIG, send_buffer_bytes.to_s)
|
170
169
|
props.put(kafka::VALUE_SERIALIZER_CLASS_CONFIG, value_serializer)
|
171
|
-
|
170
|
+
|
172
171
|
if ssl
|
173
172
|
if ssl_truststore_location.nil?
|
174
173
|
raise LogStash::ConfigurationError, "ssl_truststore_location must be set when SSL is enabled"
|
@@ -1,7 +1,7 @@
|
|
1
1
|
Gem::Specification.new do |s|
|
2
2
|
|
3
3
|
s.name = 'logstash-output-kafka'
|
4
|
-
s.version = '
|
4
|
+
s.version = '5.0.0'
|
5
5
|
s.licenses = ['Apache License (2.0)']
|
6
6
|
s.summary = 'Output events to a Kafka topic. This uses the Kafka Producer API to write messages to a topic on the broker'
|
7
7
|
s.description = "This gem is a Logstash plugin required to be installed on top of the Logstash core pipeline using $LS_HOME/bin/logstash-plugin install gemname. This gem is not a stand-alone program"
|
@@ -19,13 +19,13 @@ Gem::Specification.new do |s|
|
|
19
19
|
# Special flag to let us know this is actually a logstash plugin
|
20
20
|
s.metadata = { 'logstash_plugin' => 'true', 'group' => 'output'}
|
21
21
|
|
22
|
-
s.requirements << "jar 'org.apache.kafka:kafka-clients', '0.
|
22
|
+
s.requirements << "jar 'org.apache.kafka:kafka-clients', '0.10.0.0'"
|
23
23
|
s.requirements << "jar 'org.slf4j:slf4j-log4j12', '1.7.13'"
|
24
24
|
|
25
25
|
s.add_development_dependency 'jar-dependencies', '~> 0.3.2'
|
26
26
|
|
27
27
|
# Gem dependencies
|
28
|
-
s.add_runtime_dependency "logstash-core-plugin-api", "
|
28
|
+
s.add_runtime_dependency "logstash-core-plugin-api", "~> 2.0"
|
29
29
|
s.add_runtime_dependency 'logstash-codec-plain'
|
30
30
|
s.add_runtime_dependency 'logstash-codec-json'
|
31
31
|
|
Binary file
|
Binary file
|
Binary file
|
Binary file
|
metadata
CHANGED
@@ -1,14 +1,14 @@
|
|
1
1
|
--- !ruby/object:Gem::Specification
|
2
2
|
name: logstash-output-kafka
|
3
3
|
version: !ruby/object:Gem::Version
|
4
|
-
version:
|
4
|
+
version: 5.0.0
|
5
5
|
platform: ruby
|
6
6
|
authors:
|
7
7
|
- Elasticsearch
|
8
8
|
autorequire:
|
9
9
|
bindir: bin
|
10
10
|
cert_chain: []
|
11
|
-
date: 2016-
|
11
|
+
date: 2016-06-24 00:00:00.000000000 Z
|
12
12
|
dependencies:
|
13
13
|
- !ruby/object:Gem::Dependency
|
14
14
|
requirement: !ruby/object:Gem::Requirement
|
@@ -27,23 +27,17 @@ dependencies:
|
|
27
27
|
- !ruby/object:Gem::Dependency
|
28
28
|
requirement: !ruby/object:Gem::Requirement
|
29
29
|
requirements:
|
30
|
-
- - "
|
31
|
-
- !ruby/object:Gem::Version
|
32
|
-
version: '1.60'
|
33
|
-
- - "<="
|
30
|
+
- - "~>"
|
34
31
|
- !ruby/object:Gem::Version
|
35
|
-
version: '2.
|
32
|
+
version: '2.0'
|
36
33
|
name: logstash-core-plugin-api
|
37
34
|
prerelease: false
|
38
35
|
type: :runtime
|
39
36
|
version_requirements: !ruby/object:Gem::Requirement
|
40
37
|
requirements:
|
41
|
-
- - "
|
42
|
-
- !ruby/object:Gem::Version
|
43
|
-
version: '1.60'
|
44
|
-
- - "<="
|
38
|
+
- - "~>"
|
45
39
|
- !ruby/object:Gem::Version
|
46
|
-
version: '2.
|
40
|
+
version: '2.0'
|
47
41
|
- !ruby/object:Gem::Dependency
|
48
42
|
requirement: !ruby/object:Gem::Requirement
|
49
43
|
requirements:
|
@@ -127,23 +121,17 @@ files:
|
|
127
121
|
- LICENSE
|
128
122
|
- NOTICE.TXT
|
129
123
|
- README.md
|
130
|
-
- lib/log4j/log4j/1.2.17/log4j-1.2.17.jar
|
131
124
|
- lib/logstash-output-kafka_jars.rb
|
132
125
|
- lib/logstash/outputs/kafka.rb
|
133
|
-
- lib/net/jpountz/lz4/lz4/1.2.0/lz4-1.2.0.jar
|
134
|
-
- lib/org/apache/kafka/kafka-clients/0.9.0.1/kafka-clients-0.9.0.1.jar
|
135
|
-
- lib/org/slf4j/slf4j-api/1.7.6/slf4j-api-1.7.6.jar
|
136
|
-
- lib/org/slf4j/slf4j-log4j12/1.7.13/slf4j-log4j12-1.7.13.jar
|
137
|
-
- lib/org/xerial/snappy/snappy-java/1.1.1.7/snappy-java-1.1.1.7.jar
|
138
126
|
- logstash-output-kafka.gemspec
|
139
127
|
- spec/integration/outputs/kafka_spec.rb
|
140
128
|
- spec/unit/outputs/kafka_spec.rb
|
141
|
-
- vendor/jar-dependencies/runtime-jars/kafka-clients-0.
|
129
|
+
- vendor/jar-dependencies/runtime-jars/kafka-clients-0.10.0.0.jar
|
142
130
|
- vendor/jar-dependencies/runtime-jars/log4j-1.2.17.jar
|
143
|
-
- vendor/jar-dependencies/runtime-jars/lz4-1.
|
144
|
-
- vendor/jar-dependencies/runtime-jars/slf4j-api-1.7.
|
131
|
+
- vendor/jar-dependencies/runtime-jars/lz4-1.3.0.jar
|
132
|
+
- vendor/jar-dependencies/runtime-jars/slf4j-api-1.7.21.jar
|
145
133
|
- vendor/jar-dependencies/runtime-jars/slf4j-log4j12-1.7.13.jar
|
146
|
-
- vendor/jar-dependencies/runtime-jars/snappy-java-1.1.
|
134
|
+
- vendor/jar-dependencies/runtime-jars/snappy-java-1.1.2.4.jar
|
147
135
|
homepage: http://www.elastic.co/guide/en/logstash/current/index.html
|
148
136
|
licenses:
|
149
137
|
- Apache License (2.0)
|
@@ -165,7 +153,7 @@ required_rubygems_version: !ruby/object:Gem::Requirement
|
|
165
153
|
- !ruby/object:Gem::Version
|
166
154
|
version: '0'
|
167
155
|
requirements:
|
168
|
-
- jar 'org.apache.kafka:kafka-clients', '0.
|
156
|
+
- jar 'org.apache.kafka:kafka-clients', '0.10.0.0'
|
169
157
|
- jar 'org.slf4j:slf4j-log4j12', '1.7.13'
|
170
158
|
rubyforge_project:
|
171
159
|
rubygems_version: 2.4.8
|
Binary file
|
Binary file
|
Binary file
|
Binary file
|
Binary file
|
Binary file
|
Binary file
|
Binary file
|
Binary file
|