logstash-filter-kafka_time_machine 2.0.0 → 3.0.0.pre
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- checksums.yaml +4 -4
- data/README.md +63 -10
- data/lib/logstash/filters/kafka_time_machine.rb +71 -42
- data/logstash-filter-kafka_time_machine.gemspec +1 -2
- metadata +5 -19
checksums.yaml
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
---
|
|
2
2
|
SHA256:
|
|
3
|
-
metadata.gz:
|
|
4
|
-
data.tar.gz:
|
|
3
|
+
metadata.gz: 051f813a378da7788b0731000d62645d1475d70672c1845244504f55a0d4b7a9
|
|
4
|
+
data.tar.gz: c0259a2da821f3da532e97db28a14d7f5e02da5afc21448adb4e50683ff9c305
|
|
5
5
|
SHA512:
|
|
6
|
-
metadata.gz:
|
|
7
|
-
data.tar.gz:
|
|
6
|
+
metadata.gz: 32a0b27107ac983b22cc863d555ce9076f065d5faa01fbf64c83cf30083009cb613c8dfe989d2338863f4d52d83851b747ab76d745e768f322ffdab88258d0f4
|
|
7
|
+
data.tar.gz: 21ce90deb6265a9af0d33dfdb630f3562a2840d097a1d62b4b414b9fd6298ec943fabaa91f66a847fa681ea47bc3b64b19607aaf109ed482611761e2faee9339
|
data/README.md
CHANGED
|
@@ -1,4 +1,5 @@
|
|
|
1
1
|
[](https://badge.fury.io/rb/logstash-filter-kafka_time_machine)
|
|
2
|
+
[](https://drone.lma.wbx2.com/post-deployment/logstash-filter-kafka_time_machine)
|
|
2
3
|
|
|
3
4
|
# Logstash Plugin: logstash-filter-kafka_time_machine
|
|
4
5
|
|
|
@@ -23,20 +24,20 @@ The filter leverages metadata inserted into the log event on both `logstash_ship
|
|
|
23
24
|
When the `kafka_time_machine` executes it will return a [InfluxDB Line Protocol](https://docs.influxdata.com/influxdb/v1.8/write_protocols/line_protocol_tutorial/) formatted metric, i.e.:
|
|
24
25
|
|
|
25
26
|
```
|
|
26
|
-
ktm,datacenter=kafka_datacenter_shipper-test,lag_type=total,owner=ktm_test@cisco.com lag_ms=300i,payload_size_bytes=40i 1634662795000000000
|
|
27
|
+
ktm,datacenter=kafka_datacenter_shipper-test,es_cluster=some_cluster_name,es_cluster_index=some_cluster_index_name,lag_type=total,owner=ktm_test@cisco.com lag_ms=300i,payload_size_bytes=40i 1634662795000000000
|
|
27
28
|
```
|
|
28
29
|
|
|
29
30
|
The plugin will also emit a metric if an error was encountered, i.e.:
|
|
30
31
|
|
|
31
32
|
```
|
|
32
|
-
ktm_error,datacenter=kafka_datacenter_shipper-test,owner=ktm_test@cisco.com,source=shipper count=1i 1634662795000000000
|
|
33
|
+
ktm_error,datacenter=kafka_datacenter_shipper-test,es_cluster=some_cluster_name,es_cluster_index=some_cluster_index_name,owner=ktm_test@cisco.com,source=shipper count=1i 1634662795000000000
|
|
33
34
|
```
|
|
34
35
|
|
|
35
36
|
To ensure a logstash `output{}` block can properly route this metric, the new event are tagged with a `[@metadata][ktm_tag][ktm_metric]` field, i.e.:
|
|
36
37
|
|
|
37
38
|
```
|
|
38
39
|
{
|
|
39
|
-
"ktm_metric" => "ktm,datacenter=kafka_datacenter_shipper-test,lag_type=total,owner=ktm_test@cisco.com lag_ms=300i,payload_size_bytes=40i 1634662795000000000",
|
|
40
|
+
"ktm_metric" => "ktm,datacenter=kafka_datacenter_shipper-test,lag_type=total,es_cluster=some_cluster_name,es_cluster_index=some_cluster_index_name,owner=ktm_test@cisco.com lag_ms=300i,payload_size_bytes=40i 1634662795000000000",
|
|
40
41
|
"@timestamp" => 2021-10-20T23:46:24.704Z,
|
|
41
42
|
"@metadata" => {
|
|
42
43
|
"ktm_tags" => {
|
|
@@ -59,6 +60,8 @@ In the case of `ktm` the metric breakdown is:
|
|
|
59
60
|
| Line Protocol Element | Line Protocol Type | Description |
|
|
60
61
|
| --------------------- | ------------------ | ------------------------------------------- |
|
|
61
62
|
| datacenter | tag | Echo of `kafka_datacenter_shipper` |
|
|
63
|
+
| es_cluster | tag | Echo of `elasticsearch_cluster` |
|
|
64
|
+
| es_cluster_index | tag | Echo of `elasticsearch_cluster_index` |
|
|
62
65
|
| lag_type | tag | Calculated lag type |
|
|
63
66
|
| owner | tag | Echo of `event_owner` |
|
|
64
67
|
| lag_ms | field | Calculated lag in milliseconds |
|
|
@@ -72,12 +75,14 @@ Meaning of `lag_type`:
|
|
|
72
75
|
|
|
73
76
|
In the case of `ktm_error` the metric breakdown is:
|
|
74
77
|
|
|
75
|
-
| Line Protocol Element | Line Protocol Type | Description
|
|
76
|
-
| --------------------- | ------------------ |
|
|
77
|
-
| datacenter | tag | Echo of `kafka_datacenter_shipper`
|
|
78
|
-
|
|
|
79
|
-
|
|
|
80
|
-
|
|
|
78
|
+
| Line Protocol Element | Line Protocol Type | Description |
|
|
79
|
+
| --------------------- | ------------------ | ------------------------------------- |
|
|
80
|
+
| datacenter | tag | Echo of `kafka_datacenter_shipper` |
|
|
81
|
+
| es_cluster | tag | Echo of `elasticsearch_cluster` |
|
|
82
|
+
| es_cluster_index | tag | Echo of `elasticsearch_cluster_index` |
|
|
83
|
+
| source | tag | Source of the error metric |
|
|
84
|
+
| owner | tag | Echo of `event_owner` |
|
|
85
|
+
| count | field | Count to track error; not cumulative |
|
|
81
86
|
|
|
82
87
|
Meaning of `source`:
|
|
83
88
|
|
|
@@ -113,6 +118,8 @@ This plugin requires the following configurations:
|
|
|
113
118
|
| [logstash_kafka_read_time_indexer](#logstash_kafka_read_time_indexer) | string | Yes |
|
|
114
119
|
| [event_owner](#event_owner) | string | Yes |
|
|
115
120
|
| [event_time_ms](#event_time_ms) | string | Yes |
|
|
121
|
+
| [elasticsearch_cluster](#elasticsearch_cluster) | string | Yes |
|
|
122
|
+
| [elasticsearch_cluster_index](#elasticsearch_cluster_index) | string | Yes |
|
|
116
123
|
|
|
117
124
|
> Why are all settings required?
|
|
118
125
|
>
|
|
@@ -371,4 +378,50 @@ filter {
|
|
|
371
378
|
event_time_ms => "%{[dynamic_field]}"
|
|
372
379
|
}
|
|
373
380
|
}
|
|
374
|
-
```
|
|
381
|
+
```
|
|
382
|
+
|
|
383
|
+
### elasticsearch_cluster
|
|
384
|
+
|
|
385
|
+
- Value type is [string](https://www.elastic.co/guide/en/logstash/7.13/configuration-file-structure.html#string)
|
|
386
|
+
- There is no default value for this setting.
|
|
387
|
+
|
|
388
|
+
Provide identifier for ElasticSearch cluster log was sent to; represents the owner of the log. Field values can be static or dynamic:
|
|
389
|
+
|
|
390
|
+
```
|
|
391
|
+
filter {
|
|
392
|
+
kafka_time_machine {
|
|
393
|
+
elasticsearch_cluster => "static_field"
|
|
394
|
+
}
|
|
395
|
+
}
|
|
396
|
+
```
|
|
397
|
+
|
|
398
|
+
```
|
|
399
|
+
filter {
|
|
400
|
+
kafka_time_machine {
|
|
401
|
+
elasticsearch_cluster => "%{[dynamic_field]}"
|
|
402
|
+
}
|
|
403
|
+
}
|
|
404
|
+
```
|
|
405
|
+
|
|
406
|
+
### elasticsearch_cluster_index
|
|
407
|
+
|
|
408
|
+
- Value type is [string](https://www.elastic.co/guide/en/logstash/7.13/configuration-file-structure.html#string)
|
|
409
|
+
- There is no default value for this setting.
|
|
410
|
+
|
|
411
|
+
Provide identifier for ElasticSearch cluster index log will be indexed in; represents the owner of the log. Field values can be static or dynamic:
|
|
412
|
+
|
|
413
|
+
```
|
|
414
|
+
filter {
|
|
415
|
+
kafka_time_machine {
|
|
416
|
+
elasticsearch_cluster_index => "static_field"
|
|
417
|
+
}
|
|
418
|
+
}
|
|
419
|
+
```
|
|
420
|
+
|
|
421
|
+
```
|
|
422
|
+
filter {
|
|
423
|
+
kafka_time_machine {
|
|
424
|
+
elasticsearch_cluster_index => "%{[dynamic_field]}"
|
|
425
|
+
}
|
|
426
|
+
}
|
|
427
|
+
```
|
|
@@ -2,7 +2,7 @@
|
|
|
2
2
|
require "logstash/filters/base"
|
|
3
3
|
require "logstash/namespace"
|
|
4
4
|
require "logstash/event"
|
|
5
|
-
require "
|
|
5
|
+
require "json"
|
|
6
6
|
|
|
7
7
|
class LogStash::Filters::KafkaTimeMachine < LogStash::Filters::Base
|
|
8
8
|
|
|
@@ -38,9 +38,15 @@ class LogStash::Filters::KafkaTimeMachine < LogStash::Filters::Base
|
|
|
38
38
|
# Owner of the event currenty being process.
|
|
39
39
|
config :event_owner, :validate => :string, :required => true
|
|
40
40
|
|
|
41
|
-
# Current time since EPOCH in ms that should be set in the
|
|
41
|
+
# Current time since EPOCH in ms that should be set in the generated metric
|
|
42
42
|
config :event_time_ms, :validate => :string, :required => true
|
|
43
43
|
|
|
44
|
+
# Current time since EPOCH in ms that should be set in the generated metric
|
|
45
|
+
config :elasticsearch_cluster, :validate => :string, :required => true
|
|
46
|
+
|
|
47
|
+
# Current time since EPOCH in ms that should be set in the generated metric
|
|
48
|
+
config :elasticsearch_cluster_index, :validate => :string, :required => true
|
|
49
|
+
|
|
44
50
|
public
|
|
45
51
|
def register
|
|
46
52
|
|
|
@@ -61,6 +67,8 @@ class LogStash::Filters::KafkaTimeMachine < LogStash::Filters::Base
|
|
|
61
67
|
shipper_kafka_consumer_group = event.sprintf(@kafka_consumer_group_shipper)
|
|
62
68
|
indexer_kafka_topic = event.sprintf(@kafka_topic_indexer)
|
|
63
69
|
indexer_kafka_consumer_group = event.sprintf(@kafka_consumer_group_indexer)
|
|
70
|
+
elasticsearch_cluster = event.sprintf(@elasticsearch_cluster)
|
|
71
|
+
elasticsearch_cluster_index = event.sprintf(@elasticsearch_cluster_index)
|
|
64
72
|
|
|
65
73
|
# Extract all the "time" related values to local variables. This need special handling due to the Float() operation.
|
|
66
74
|
#
|
|
@@ -72,10 +80,11 @@ class LogStash::Filters::KafkaTimeMachine < LogStash::Filters::Base
|
|
|
72
80
|
indexer_logstash_kafka_read_time = get_numeric(event.sprintf(@logstash_kafka_read_time_indexer))
|
|
73
81
|
|
|
74
82
|
# Validate the shipper data
|
|
75
|
-
shipper_kafka_array = Array[shipper_kafka_datacenter, shipper_kafka_topic, shipper_kafka_consumer_group, shipper_kafka_append_time, shipper_logstash_kafka_read_time, event_owner, event_time_ms]
|
|
83
|
+
shipper_kafka_array = Array[shipper_kafka_datacenter, shipper_kafka_topic, shipper_kafka_consumer_group, shipper_kafka_append_time, shipper_logstash_kafka_read_time, event_owner, event_time_ms, elasticsearch_cluster, elasticsearch_cluster_index]
|
|
76
84
|
if (shipper_kafka_array.any? { |text| text.nil? || text.to_s.empty? })
|
|
77
85
|
@logger.debug("shipper_kafka_array invalid: Found null")
|
|
78
86
|
error_string_shipper = sprintf("Error in shipper data: %s", shipper_kafka_array)
|
|
87
|
+
@logger.debug(error_string_shipper)
|
|
79
88
|
shipper_valid = false
|
|
80
89
|
else
|
|
81
90
|
@logger.debug("shipper_kafka_array valid")
|
|
@@ -86,10 +95,11 @@ class LogStash::Filters::KafkaTimeMachine < LogStash::Filters::Base
|
|
|
86
95
|
end
|
|
87
96
|
|
|
88
97
|
# Validate the indexer data
|
|
89
|
-
indexer_kafka_array = Array[shipper_kafka_datacenter, indexer_kafka_topic, indexer_kafka_consumer_group, indexer_kafka_append_time, indexer_logstash_kafka_read_time, event_owner, event_time_ms]
|
|
98
|
+
indexer_kafka_array = Array[shipper_kafka_datacenter, indexer_kafka_topic, indexer_kafka_consumer_group, indexer_kafka_append_time, indexer_logstash_kafka_read_time, event_owner, event_time_ms, elasticsearch_cluster, elasticsearch_cluster_index]
|
|
90
99
|
if (indexer_kafka_array.any? { |text| text.nil? || text.to_s.empty? })
|
|
91
100
|
@logger.debug("indexer_kafka_array invalid: Found null")
|
|
92
101
|
error_string_indexer = sprintf("Error in indexer data: %s", indexer_kafka_array)
|
|
102
|
+
@logger.debug(error_string_indexer)
|
|
93
103
|
indexer_valid = false
|
|
94
104
|
else
|
|
95
105
|
@logger.debug("indexer_kafka_array valid")
|
|
@@ -100,12 +110,12 @@ class LogStash::Filters::KafkaTimeMachine < LogStash::Filters::Base
|
|
|
100
110
|
end
|
|
101
111
|
|
|
102
112
|
# Add in the size of the payload field
|
|
103
|
-
|
|
113
|
+
payload_size_bytes = 0
|
|
104
114
|
if event.get("[payload]")
|
|
105
|
-
|
|
115
|
+
payload_size_bytes = event.get("[payload]").bytesize
|
|
106
116
|
end
|
|
107
117
|
|
|
108
|
-
# Set time (nanoseconds) for
|
|
118
|
+
# Set time (nanoseconds) for event that is generated
|
|
109
119
|
epoch_time_ns = nil
|
|
110
120
|
if (event_time_ms != nil )
|
|
111
121
|
epoch_time_ns = event_time_ms * 1000000
|
|
@@ -118,35 +128,35 @@ class LogStash::Filters::KafkaTimeMachine < LogStash::Filters::Base
|
|
|
118
128
|
if (shipper_valid == true && indexer_valid == true && epoch_time_ns != nil)
|
|
119
129
|
total_kafka_lag_ms = indexer_logstash_kafka_read_time - shipper_kafka_append_time
|
|
120
130
|
|
|
121
|
-
|
|
122
|
-
ktm_metric_event_array.push
|
|
131
|
+
point_ktm = create_point_ktm(shipper_kafka_datacenter, event_owner, payload_size_bytes, "total", total_kafka_lag_ms, epoch_time_ns, elasticsearch_cluster, elasticsearch_cluster_index)
|
|
132
|
+
ktm_metric_event_array.push point_ktm
|
|
123
133
|
|
|
124
134
|
elsif (shipper_valid == true && indexer_valid == false && epoch_time_ns != nil)
|
|
125
|
-
|
|
126
|
-
ktm_metric_event_array.push
|
|
135
|
+
point_ktm = create_point_ktm(shipper_kafka_datacenter, event_owner, payload_size_bytes, "shipper", shipper_kafka_lag_ms, epoch_time_ns, elasticsearch_cluster, elasticsearch_cluster_index)
|
|
136
|
+
ktm_metric_event_array.push point_ktm
|
|
127
137
|
|
|
128
|
-
|
|
129
|
-
ktm_metric_event_array.push
|
|
138
|
+
point_ktm = create_point_ktm_error(shipper_kafka_datacenter, event_owner, epoch_time_ns, "indexer", elasticsearch_cluster, elasticsearch_cluster_index)
|
|
139
|
+
ktm_metric_event_array.push point_ktm
|
|
130
140
|
|
|
131
141
|
elsif (indexer_valid == true && shipper_valid == false && epoch_time_ns != nil)
|
|
132
|
-
|
|
133
|
-
ktm_metric_event_array.push
|
|
142
|
+
point_ktm = create_point_ktm(shipper_kafka_datacenter, event_owner, payload_size_bytes, "indexer", indexer_kafka_lag_ms, epoch_time_ns, elasticsearch_cluster, elasticsearch_cluster_index)
|
|
143
|
+
ktm_metric_event_array.push point_ktm
|
|
134
144
|
|
|
135
|
-
|
|
136
|
-
ktm_metric_event_array.push
|
|
145
|
+
point_ktm = create_point_ktm_error(shipper_kafka_datacenter, event_owner, epoch_time_ns, "shipper", elasticsearch_cluster, elasticsearch_cluster_index)
|
|
146
|
+
ktm_metric_event_array.push point_ktm
|
|
137
147
|
|
|
138
148
|
elsif (indexer_valid == false && shipper_valid == false)
|
|
139
149
|
|
|
140
|
-
|
|
141
|
-
ktm_metric_event_array.push
|
|
150
|
+
point_ktm = create_point_ktm_error(shipper_kafka_datacenter, event_owner, epoch_time_ns, "insufficient_data", elasticsearch_cluster, elasticsearch_cluster_index)
|
|
151
|
+
ktm_metric_event_array.push point_ktm
|
|
142
152
|
|
|
143
153
|
error_string = sprintf("Error kafka_time_machine: Could not build valid response --> %s, %s", error_string_shipper, error_string_indexer)
|
|
144
154
|
@logger.debug(error_string)
|
|
145
155
|
|
|
146
156
|
else
|
|
147
157
|
|
|
148
|
-
|
|
149
|
-
ktm_metric_event_array.push
|
|
158
|
+
point_ktm = create_point_ktm_error(shipper_kafka_datacenter, event_owner, epoch_time_ns, "unknown", elasticsearch_cluster, elasticsearch_cluster_index)
|
|
159
|
+
ktm_metric_event_array.push point_ktm
|
|
150
160
|
|
|
151
161
|
error_string = "Unknown error encountered"
|
|
152
162
|
@logger.debug(error_string)
|
|
@@ -157,9 +167,7 @@ class LogStash::Filters::KafkaTimeMachine < LogStash::Filters::Base
|
|
|
157
167
|
ktm_metric_event_array.each do |metric_event|
|
|
158
168
|
|
|
159
169
|
# Create new event for KTM metric
|
|
160
|
-
event_ktm = LogStash::Event.new
|
|
161
|
-
|
|
162
|
-
event_ktm.set("ktm_metric", metric_event)
|
|
170
|
+
event_ktm = LogStash::Event.new(metric_event)
|
|
163
171
|
event_ktm.set("[@metadata][ktm_tags][ktm_metric]", "true")
|
|
164
172
|
|
|
165
173
|
filter_matched(event_ktm)
|
|
@@ -169,23 +177,34 @@ class LogStash::Filters::KafkaTimeMachine < LogStash::Filters::Base
|
|
|
169
177
|
|
|
170
178
|
end # def filter
|
|
171
179
|
|
|
172
|
-
# Creates
|
|
180
|
+
# Creates hash with ktm data point to return
|
|
173
181
|
public
|
|
174
|
-
def
|
|
182
|
+
def create_point_ktm(datacenter, event_owner, payload_size_bytes, lag_type, lag_ms, epoch_time_ns, elasticsearch_cluster, elasticsearch_cluster_index)
|
|
183
|
+
|
|
184
|
+
point = Hash.new
|
|
185
|
+
|
|
186
|
+
# Name of point and time created
|
|
187
|
+
point["name"] = "ktm"
|
|
188
|
+
point["epotch_time_ns"] = epoch_time_ns
|
|
175
189
|
|
|
176
|
-
|
|
177
|
-
|
|
178
|
-
|
|
179
|
-
|
|
190
|
+
# tags
|
|
191
|
+
point["datacenter"] = datacenter
|
|
192
|
+
point["owner"] = event_owner
|
|
193
|
+
point["lag_type"] = lag_type
|
|
194
|
+
point["es_cluster"] = elasticsearch_cluster
|
|
195
|
+
point["es_cluster_index"] = elasticsearch_cluster_index
|
|
180
196
|
|
|
181
|
-
|
|
182
|
-
|
|
197
|
+
# fields
|
|
198
|
+
point["payload_size_bytes"] = payload_size_bytes
|
|
199
|
+
point["lag_ms"] = lag_ms
|
|
183
200
|
|
|
184
|
-
|
|
201
|
+
return point
|
|
185
202
|
|
|
186
|
-
#
|
|
203
|
+
end # def create_point_ktm
|
|
204
|
+
|
|
205
|
+
# Creates hash with ktm data point to return
|
|
187
206
|
public
|
|
188
|
-
def
|
|
207
|
+
def create_point_ktm_error(datacenter, event_owner, epoch_time_ns, type, elasticsearch_cluster, elasticsearch_cluster_index)
|
|
189
208
|
|
|
190
209
|
# Check for nil values
|
|
191
210
|
if (nil == datacenter)
|
|
@@ -201,15 +220,25 @@ class LogStash::Filters::KafkaTimeMachine < LogStash::Filters::Base
|
|
|
201
220
|
epoch_time_ns = ((Time.now.to_f * 1000).to_i)*1000000
|
|
202
221
|
end
|
|
203
222
|
|
|
204
|
-
point =
|
|
205
|
-
tags: {datacenter: datacenter, owner: event_owner, source: type},
|
|
206
|
-
fields: {count: 1},
|
|
207
|
-
time: epoch_time_ns)
|
|
223
|
+
point = Hash.new
|
|
208
224
|
|
|
209
|
-
|
|
210
|
-
|
|
225
|
+
# Name of point and time created
|
|
226
|
+
point["name"] = "ktm_error"
|
|
227
|
+
point["epotch_time_ns"] = epoch_time_ns
|
|
228
|
+
|
|
229
|
+
# tags
|
|
230
|
+
point["datacenter"] = datacenter
|
|
231
|
+
point["owner"] = event_owner
|
|
232
|
+
point["source"] = type
|
|
233
|
+
point["es_cluster"] = elasticsearch_cluster
|
|
234
|
+
point["es_cluster_index"] = elasticsearch_cluster_index
|
|
235
|
+
|
|
236
|
+
# fields
|
|
237
|
+
point["count"] = 1
|
|
238
|
+
|
|
239
|
+
return point
|
|
211
240
|
|
|
212
|
-
end # def
|
|
241
|
+
end # def create_point_ktm_error
|
|
213
242
|
|
|
214
243
|
# Ensures the provided value is numeric; if not returns 'nil'
|
|
215
244
|
public
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
Gem::Specification.new do |s|
|
|
2
2
|
s.name = 'logstash-filter-kafka_time_machine'
|
|
3
|
-
s.version = '
|
|
3
|
+
s.version = '3.0.0.pre'
|
|
4
4
|
s.licenses = ['Apache-2.0']
|
|
5
5
|
s.summary = "Calculate total time of logstash event that traversed 2 Kafka queues from a shipper site to an indexer site"
|
|
6
6
|
s.description = "This gem is a logstash plugin required to be installed on top of the Logstash core pipeline using $LS_HOME/bin/logstash-plugin install gemname. This gem is not a stand-alone program"
|
|
@@ -20,6 +20,5 @@ Gem::Specification.new do |s|
|
|
|
20
20
|
|
|
21
21
|
# Gem dependencies
|
|
22
22
|
s.add_runtime_dependency "logstash-core-plugin-api", ">= 1.60", "<= 2.99"
|
|
23
|
-
s.add_runtime_dependency "influxdb-client", "~> 2.0.0"
|
|
24
23
|
s.add_development_dependency 'logstash-devutils', '~> 0'
|
|
25
24
|
end
|
metadata
CHANGED
|
@@ -1,14 +1,14 @@
|
|
|
1
1
|
--- !ruby/object:Gem::Specification
|
|
2
2
|
name: logstash-filter-kafka_time_machine
|
|
3
3
|
version: !ruby/object:Gem::Version
|
|
4
|
-
version:
|
|
4
|
+
version: 3.0.0.pre
|
|
5
5
|
platform: ruby
|
|
6
6
|
authors:
|
|
7
7
|
- Chris Foster
|
|
8
8
|
autorequire:
|
|
9
9
|
bindir: bin
|
|
10
10
|
cert_chain: []
|
|
11
|
-
date:
|
|
11
|
+
date: 2022-11-10 00:00:00.000000000 Z
|
|
12
12
|
dependencies:
|
|
13
13
|
- !ruby/object:Gem::Dependency
|
|
14
14
|
name: logstash-core-plugin-api
|
|
@@ -30,20 +30,6 @@ dependencies:
|
|
|
30
30
|
- - "<="
|
|
31
31
|
- !ruby/object:Gem::Version
|
|
32
32
|
version: '2.99'
|
|
33
|
-
- !ruby/object:Gem::Dependency
|
|
34
|
-
name: influxdb-client
|
|
35
|
-
requirement: !ruby/object:Gem::Requirement
|
|
36
|
-
requirements:
|
|
37
|
-
- - "~>"
|
|
38
|
-
- !ruby/object:Gem::Version
|
|
39
|
-
version: 2.0.0
|
|
40
|
-
type: :runtime
|
|
41
|
-
prerelease: false
|
|
42
|
-
version_requirements: !ruby/object:Gem::Requirement
|
|
43
|
-
requirements:
|
|
44
|
-
- - "~>"
|
|
45
|
-
- !ruby/object:Gem::Version
|
|
46
|
-
version: 2.0.0
|
|
47
33
|
- !ruby/object:Gem::Dependency
|
|
48
34
|
name: logstash-devutils
|
|
49
35
|
requirement: !ruby/object:Gem::Requirement
|
|
@@ -87,11 +73,11 @@ required_ruby_version: !ruby/object:Gem::Requirement
|
|
|
87
73
|
version: '0'
|
|
88
74
|
required_rubygems_version: !ruby/object:Gem::Requirement
|
|
89
75
|
requirements:
|
|
90
|
-
- - "
|
|
76
|
+
- - ">"
|
|
91
77
|
- !ruby/object:Gem::Version
|
|
92
|
-
version:
|
|
78
|
+
version: 1.3.1
|
|
93
79
|
requirements: []
|
|
94
|
-
rubygems_version: 3.0.3
|
|
80
|
+
rubygems_version: 3.0.3.1
|
|
95
81
|
signing_key:
|
|
96
82
|
specification_version: 4
|
|
97
83
|
summary: Calculate total time of logstash event that traversed 2 Kafka queues from
|