logstash-integration-kafka 12.0.5-java → 12.0.6-java
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- checksums.yaml +4 -4
- data/CHANGELOG.md +3 -0
- data/docs/output-kafka.asciidoc +18 -0
- data/logstash-integration-kafka.gemspec +1 -1
- metadata +2 -2
checksums.yaml
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
---
|
|
2
2
|
SHA256:
|
|
3
|
-
metadata.gz:
|
|
4
|
-
data.tar.gz:
|
|
3
|
+
metadata.gz: afb32084af8da2c0d6fc1742cedff29093a8d55c2a4908afc636728e3cbdee2f
|
|
4
|
+
data.tar.gz: 289f441a9b23b6a5843b7e45bceafbc487301f9f44902ef8d5476e1f2c488a82
|
|
5
5
|
SHA512:
|
|
6
|
-
metadata.gz:
|
|
7
|
-
data.tar.gz:
|
|
6
|
+
metadata.gz: 12bf222b6766785f64ee6a6aa988505dfee1e90eed131aeb7b2d8432d7c996d3b53f5fcbbe00ef0e1e483576afc0592b0057ff0438b921bc57230b767d22c600
|
|
7
|
+
data.tar.gz: 0cdf0beda8aaadd10cff0f5c2921189feafdf70aeaf2f45bc6a8737832162a650ec2e546a44d7afb5f27ec83e755f5f96928d46439b33b8d83a01a11e3592530
|
data/CHANGELOG.md
CHANGED
|
@@ -1,3 +1,6 @@
|
|
|
1
|
+
## 12.0.6
|
|
2
|
+
- [DOC] Add info about Kafka timestamp behavior [#240](https://github.com/logstash-plugins/logstash-integration-kafka/pull/240)
|
|
3
|
+
|
|
1
4
|
## 12.0.5
|
|
2
5
|
- Redact `sasl_jaas_config` to prevent credentials from appearing in debug logs. [#232](https://github.com/logstash-plugins/logstash-integration-kafka/pull/232)
|
|
3
6
|
|
data/docs/output-kafka.asciidoc
CHANGED
|
@@ -66,6 +66,24 @@ https://kafka.apache.org/{kafka_client_doc}/documentation.html#producerconfigs
|
|
|
66
66
|
|
|
67
67
|
NOTE: This plugin does not support using a proxy when communicating to the Kafka broker.
|
|
68
68
|
|
|
69
|
+
.Kafka timestamps and Logstash
|
|
70
|
+
****
|
|
71
|
+
* Kafka 3.6+ introduces stricter timestamp validation with the introduction of two new broker/topic-level properties: https://docs.confluent.io/platform/current/installation/configuration/topic-configs.html#message-timestamp-before-max-ms[log.message.timestamp.before.max.ms] and
|
|
72
|
+
https://docs.confluent.io/platform/current/installation/configuration/topic-configs.html#message-timestamp-after-max-ms[log.message.timestamp.after.max.ms].
|
|
73
|
+
+
|
|
74
|
+
These properties limit the time difference between the message timestamp (from Logstash) and the Kafka broker receive time.
|
|
75
|
+
Messages can be rejected if the values are exceeded and `log.message.timestamp.type=CreateTime` is set.
|
|
76
|
+
+
|
|
77
|
+
These checks are ignored if `log.message.timestamp.type=LogAppendTime` is set.
|
|
78
|
+
|
|
79
|
+
* For Kafka version 0.10.0.0+ the message creation timestamp is set by Logstash and equals the initial timestamp of the event.
|
|
80
|
+
This behavior affects Kafka’s retention policy.
|
|
81
|
+
For example, if a Logstash event was created two weeks ago and Kafka retention is set to seven days, then when the message arrives in Kafka today it may be discarded immediately, because its timestamp is older than seven days.
|
|
82
|
+
+
|
|
83
|
+
You can change this behavior by setting timestamps on message arrival instead.
|
|
84
|
+
The message is not discarded but kept for 7 more days. Set `log.message.timestamp.type` to `LogAppendTime` (default `CreateTime`) in your Kafka configuration.
|
|
85
|
+
****
|
|
86
|
+
|
|
69
87
|
[id="plugins-{type}s-{plugin}-aws_msk_iam_auth"]
|
|
70
88
|
==== AWS MSK IAM authentication
|
|
71
89
|
If you use AWS MSK, the AWS MSK IAM access control enables you to handle both authentication and authorization for your MSK cluster with AWS IAM.
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
Gem::Specification.new do |s|
|
|
2
2
|
s.name = 'logstash-integration-kafka'
|
|
3
|
-
s.version = '12.0.
|
|
3
|
+
s.version = '12.0.6'
|
|
4
4
|
s.licenses = ['Apache-2.0']
|
|
5
5
|
s.summary = "Integration with Kafka - input and output plugins"
|
|
6
6
|
s.description = "This gem is a Logstash plugin required to be installed on top of the Logstash core pipeline "+
|
metadata
CHANGED
|
@@ -1,13 +1,13 @@
|
|
|
1
1
|
--- !ruby/object:Gem::Specification
|
|
2
2
|
name: logstash-integration-kafka
|
|
3
3
|
version: !ruby/object:Gem::Version
|
|
4
|
-
version: 12.0.
|
|
4
|
+
version: 12.0.6
|
|
5
5
|
platform: java
|
|
6
6
|
authors:
|
|
7
7
|
- Elastic
|
|
8
8
|
bindir: bin
|
|
9
9
|
cert_chain: []
|
|
10
|
-
date: 2026-03-
|
|
10
|
+
date: 2026-03-16 00:00:00.000000000 Z
|
|
11
11
|
dependencies:
|
|
12
12
|
- !ruby/object:Gem::Dependency
|
|
13
13
|
name: logstash-core-plugin-api
|