rdkafka 0.14.0.rc1 → 0.14.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- checksums.yaml +4 -4
- checksums.yaml.gz.sig +0 -0
- data/CHANGELOG.md +93 -92
- data/lib/rdkafka/abstract_handle.rb +3 -2
- data/lib/rdkafka/version.rb +1 -1
- data.tar.gz.sig +0 -0
- metadata +4 -4
- metadata.gz.sig +0 -0
checksums.yaml
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
---
|
|
2
2
|
SHA256:
|
|
3
|
-
metadata.gz:
|
|
4
|
-
data.tar.gz:
|
|
3
|
+
metadata.gz: 59f5b664693b87cd66340f821027e45a86c70c0f652c91a0ec6826ba69e02969
|
|
4
|
+
data.tar.gz: 79e734db66b41d1618a581686df428de75912d06d1e41fe9e2340e63ace3d0da
|
|
5
5
|
SHA512:
|
|
6
|
-
metadata.gz:
|
|
7
|
-
data.tar.gz:
|
|
6
|
+
metadata.gz: cf9821c62c9f958196d78cbe2d8f50b860d06084017cfc3fbf3ffd6c289278d8a8b54f3b40d16d3d3e6c1d71f1112de897cce67cfc09071cb8fa5a0895bd5ed7
|
|
7
|
+
data.tar.gz: a8e9fab48d749ca62fcdfeda7c2a3d2f85cff7849338cedbe43bbcb8d9300979c0ec44c59a49de8f4efd2ee9a3d7feb3a1fa718f2311c89c6b5aedd99c6d870c
|
checksums.yaml.gz.sig
CHANGED
|
Binary file
|
data/CHANGELOG.md
CHANGED
|
@@ -1,140 +1,141 @@
|
|
|
1
1
|
# Rdkafka Changelog
|
|
2
2
|
|
|
3
|
-
## 0.14.0 (
|
|
3
|
+
## 0.14.0 (2023-11-21)
|
|
4
|
+
- [Enhancement] Add `raise_response_error` flag to the `Rdkafka::AbstractHandle`.
|
|
4
5
|
- [Enhancement] Allow for setting `statistics_callback` as nil to reset predefined settings configured by a different gem (mensfeld)
|
|
5
|
-
|
|
6
|
-
|
|
7
|
-
|
|
8
|
-
|
|
9
|
-
|
|
10
|
-
|
|
11
|
-
|
|
12
|
-
|
|
13
|
-
|
|
14
|
-
|
|
15
|
-
|
|
16
|
-
|
|
17
|
-
|
|
6
|
+
- [Enhancement] Get consumer position (thijsc & mensfeld)
|
|
7
|
+
- [Enhancement] Provide `#purge` to remove any outstanding requests from the producer (mensfeld)
|
|
8
|
+
- [Enhancement] Update `librdkafka` to `2.2.0` (mensfeld)
|
|
9
|
+
- [Enhancement] Introduce producer partitions count metadata cache (mensfeld)
|
|
10
|
+
- [Enhancement] Increase metadata timeout request from `250 ms` to `2000 ms` default to allow for remote cluster operations via `rdkafka-ruby` (mensfeld)
|
|
11
|
+
- [Enhancement] Introduce `#name` for producers and consumers (mensfeld)
|
|
12
|
+
- [Enhancement] Include backtrace in non-raised binded errors (mensfeld)
|
|
13
|
+
- [Fix] Reference to Opaque is not released when Admin, Consumer or Producer is closed (mensfeld)
|
|
14
|
+
- [Fix] Trigger `#poll` on native kafka creation to handle oauthbearer cb (mensfeld)
|
|
15
|
+
- [Fix] `#flush` does not handle the timeouts errors by making it return `true` if all flushed or `false` if failed. We do **not** raise an exception here to keep it backwards compatible (mensfeld)
|
|
16
|
+
- [Change] Remove support for Ruby 2.6 due to it being EOL and WeakMap incompatibilities (mensfeld)
|
|
17
|
+
- [Change] Update Kafka Docker with Confluent KRaft (mensfeld)
|
|
18
|
+
- [Change] Update librdkafka repo reference from edenhill to confluentinc (mensfeld)
|
|
18
19
|
|
|
19
20
|
## 0.13.0 (2023-07-24)
|
|
20
|
-
|
|
21
|
-
|
|
22
|
-
|
|
23
|
-
|
|
24
|
-
|
|
25
|
-
|
|
26
|
-
|
|
27
|
-
|
|
28
|
-
|
|
29
|
-
|
|
30
|
-
|
|
31
|
-
|
|
32
|
-
|
|
33
|
-
|
|
21
|
+
- Support cooperative sticky partition assignment in the rebalance callback (methodmissing)
|
|
22
|
+
- Support both string and symbol header keys (ColinDKelley)
|
|
23
|
+
- Handle tombstone messages properly (kgalieva)
|
|
24
|
+
- Add topic name to delivery report (maeve)
|
|
25
|
+
- Allow string partitioner config (mollyegibson)
|
|
26
|
+
- Fix documented type for DeliveryReport#error (jimmydo)
|
|
27
|
+
- Bump librdkafka to 2.0.2 (lmaia)
|
|
28
|
+
- Use finalizers to cleanly exit producer and admin (thijsc)
|
|
29
|
+
- Lock access to the native kafka client (thijsc)
|
|
30
|
+
- Fix potential race condition in multi-threaded producer (mensfeld)
|
|
31
|
+
- Fix leaking FFI resources in specs (mensfeld)
|
|
32
|
+
- Improve specs stability (mensfeld)
|
|
33
|
+
- Make metadata request timeout configurable (mensfeld)
|
|
34
|
+
- call_on_partitions_assigned and call_on_partitions_revoked only get a tpl passed in (thijsc)
|
|
34
35
|
|
|
35
36
|
## 0.12.0 (2022-06-17)
|
|
36
|
-
|
|
37
|
-
|
|
38
|
-
|
|
37
|
+
- Bumps librdkafka to 1.9.0
|
|
38
|
+
- Fix crash on empty partition key (mensfeld)
|
|
39
|
+
- Pass the delivery handle to the callback (gvisokinskas)
|
|
39
40
|
|
|
40
41
|
## 0.11.0 (2021-11-17)
|
|
41
|
-
|
|
42
|
-
|
|
43
|
-
|
|
42
|
+
- Upgrade librdkafka to 1.8.2
|
|
43
|
+
- Bump supported minimum Ruby version to 2.6
|
|
44
|
+
- Better homebrew path detection
|
|
44
45
|
|
|
45
46
|
## 0.10.0 (2021-09-07)
|
|
46
|
-
|
|
47
|
-
|
|
47
|
+
- Upgrade librdkafka to 1.5.0
|
|
48
|
+
- Add error callback config
|
|
48
49
|
|
|
49
50
|
## 0.9.0 (2021-06-23)
|
|
50
|
-
|
|
51
|
-
|
|
52
|
-
|
|
53
|
-
|
|
54
|
-
|
|
55
|
-
|
|
51
|
+
- Fixes for Ruby 3.0
|
|
52
|
+
- Allow any callable object for callbacks (gremerritt)
|
|
53
|
+
- Reduce memory allocations in Rdkafka::Producer#produce (jturkel)
|
|
54
|
+
- Use queue as log callback to avoid unsafe calls from trap context (breunigs)
|
|
55
|
+
- Allow passing in topic configuration on create_topic (dezka)
|
|
56
|
+
- Add each_batch method to consumer (mgrosso)
|
|
56
57
|
|
|
57
58
|
## 0.8.1 (2020-12-07)
|
|
58
|
-
|
|
59
|
-
|
|
60
|
-
|
|
61
|
-
|
|
59
|
+
- Fix topic_flag behaviour and add tests for Metadata (geoff2k)
|
|
60
|
+
- Add topic admin interface (geoff2k)
|
|
61
|
+
- Raise an exception if @native_kafka is nil (geoff2k)
|
|
62
|
+
- Option to use zstd compression (jasonmartens)
|
|
62
63
|
|
|
63
64
|
## 0.8.0 (2020-06-02)
|
|
64
|
-
|
|
65
|
-
|
|
66
|
-
|
|
67
|
-
|
|
68
|
-
|
|
69
|
-
|
|
65
|
+
- Upgrade librdkafka to 1.4.0
|
|
66
|
+
- Integrate librdkafka metadata API and add partition_key (by Adithya-copart)
|
|
67
|
+
- Ruby 2.7 compatibility fix (by Geoff Thé)A
|
|
68
|
+
- Add error to delivery report (by Alex Stanovsky)
|
|
69
|
+
- Don't override CPPFLAGS and LDFLAGS if already set on Mac (by Hiroshi Hatake)
|
|
70
|
+
- Allow use of Rake 13.x and up (by Tomasz Pajor)
|
|
70
71
|
|
|
71
72
|
## 0.7.0 (2019-09-21)
|
|
72
|
-
|
|
73
|
-
|
|
73
|
+
- Bump librdkafka to 1.2.0 (by rob-as)
|
|
74
|
+
- Allow customizing the wait time for delivery report availability (by mensfeld)
|
|
74
75
|
|
|
75
76
|
## 0.6.0 (2019-07-23)
|
|
76
|
-
|
|
77
|
-
|
|
77
|
+
- Bump librdkafka to 1.1.0 (by Chris Gaffney)
|
|
78
|
+
- Implement seek (by breunigs)
|
|
78
79
|
|
|
79
80
|
## 0.5.0 (2019-04-11)
|
|
80
|
-
|
|
81
|
-
|
|
82
|
-
|
|
83
|
-
|
|
84
|
-
|
|
81
|
+
- Bump librdkafka to 1.0.0 (by breunigs)
|
|
82
|
+
- Add cluster and member information (by dmexe)
|
|
83
|
+
- Support message headers for consumer & producer (by dmexe)
|
|
84
|
+
- Add consumer rebalance listener (by dmexe)
|
|
85
|
+
- Implement pause/resume partitions (by dmexe)
|
|
85
86
|
|
|
86
87
|
## 0.4.2 (2019-01-12)
|
|
87
|
-
|
|
88
|
-
|
|
89
|
-
|
|
90
|
-
|
|
91
|
-
|
|
92
|
-
|
|
93
|
-
|
|
88
|
+
- Delivery callback for producer
|
|
89
|
+
- Document list param of commit method
|
|
90
|
+
- Use default Homebrew openssl location if present
|
|
91
|
+
- Consumer lag handles empty topics
|
|
92
|
+
- End iteration in consumer when it is closed
|
|
93
|
+
- Add support for storing message offsets
|
|
94
|
+
- Add missing runtime dependency to rake
|
|
94
95
|
|
|
95
96
|
## 0.4.1 (2018-10-19)
|
|
96
|
-
|
|
97
|
+
- Bump librdkafka to 0.11.6
|
|
97
98
|
|
|
98
99
|
## 0.4.0 (2018-09-24)
|
|
99
|
-
|
|
100
|
-
|
|
101
|
-
|
|
100
|
+
- Improvements in librdkafka archive download
|
|
101
|
+
- Add global statistics callback
|
|
102
|
+
- Use Time for timestamps, potentially breaking change if you
|
|
102
103
|
rely on the previous behavior where it returns an integer with
|
|
103
104
|
the number of milliseconds.
|
|
104
|
-
|
|
105
|
-
|
|
105
|
+
- Bump librdkafka to 0.11.5
|
|
106
|
+
- Implement TopicPartitionList in Ruby so we don't have to keep
|
|
106
107
|
track of native objects.
|
|
107
|
-
|
|
108
|
-
|
|
108
|
+
- Support committing a topic partition list
|
|
109
|
+
- Add consumer assignment method
|
|
109
110
|
|
|
110
111
|
## 0.3.5 (2018-01-17)
|
|
111
|
-
|
|
112
|
-
|
|
112
|
+
- Fix crash when not waiting for delivery handles
|
|
113
|
+
- Run specs on Ruby 2.5
|
|
113
114
|
|
|
114
115
|
## 0.3.4 (2017-12-05)
|
|
115
|
-
|
|
116
|
+
- Bump librdkafka to 0.11.3
|
|
116
117
|
|
|
117
118
|
## 0.3.3 (2017-10-27)
|
|
118
|
-
|
|
119
|
+
- Fix bug that prevent display of `RdkafkaError` message
|
|
119
120
|
|
|
120
121
|
## 0.3.2 (2017-10-25)
|
|
121
|
-
|
|
122
|
-
|
|
123
|
-
|
|
124
|
-
|
|
122
|
+
- `add_topic` now supports using a partition count
|
|
123
|
+
- Add way to make errors clearer with an extra message
|
|
124
|
+
- Show topics in subscribe error message
|
|
125
|
+
- Show partition and topic in query watermark offsets error message
|
|
125
126
|
|
|
126
127
|
## 0.3.1 (2017-10-23)
|
|
127
|
-
|
|
128
|
-
|
|
129
|
-
|
|
128
|
+
- Bump librdkafka to 0.11.1
|
|
129
|
+
- Officially support ranges in `add_topic` for topic partition list.
|
|
130
|
+
- Add consumer lag calculator
|
|
130
131
|
|
|
131
132
|
## 0.3.0 (2017-10-17)
|
|
132
|
-
|
|
133
|
-
|
|
134
|
-
|
|
133
|
+
- Move both add topic methods to one `add_topic` in `TopicPartitionList`
|
|
134
|
+
- Add committed offsets to consumer
|
|
135
|
+
- Add query watermark offset to consumer
|
|
135
136
|
|
|
136
137
|
## 0.2.0 (2017-10-13)
|
|
137
|
-
|
|
138
|
+
- Some refactoring and add inline documentation
|
|
138
139
|
|
|
139
140
|
## 0.1.x (2017-09-10)
|
|
140
|
-
|
|
141
|
+
- Initial working version including producing and consuming
|
|
@@ -48,12 +48,13 @@ module Rdkafka
|
|
|
48
48
|
# If this is nil it does not time out.
|
|
49
49
|
# @param wait_timeout [Numeric] Amount of time we should wait before we recheck if the
|
|
50
50
|
# operation has completed
|
|
51
|
+
# @param raise_response_error [Boolean] should we raise error when waiting finishes
|
|
51
52
|
#
|
|
52
53
|
# @return [Object] Operation-specific result
|
|
53
54
|
#
|
|
54
55
|
# @raise [RdkafkaError] When the operation failed
|
|
55
56
|
# @raise [WaitTimeoutError] When the timeout has been reached and the handle is still pending
|
|
56
|
-
def wait(max_wait_timeout: 60, wait_timeout: 0.1)
|
|
57
|
+
def wait(max_wait_timeout: 60, wait_timeout: 0.1, raise_response_error: true)
|
|
57
58
|
timeout = if max_wait_timeout
|
|
58
59
|
monotonic_now + max_wait_timeout
|
|
59
60
|
else
|
|
@@ -67,7 +68,7 @@ module Rdkafka
|
|
|
67
68
|
)
|
|
68
69
|
end
|
|
69
70
|
sleep wait_timeout
|
|
70
|
-
elsif self[:response] != 0
|
|
71
|
+
elsif self[:response] != 0 && raise_response_error
|
|
71
72
|
raise_error
|
|
72
73
|
else
|
|
73
74
|
return create_result
|
data/lib/rdkafka/version.rb
CHANGED
data.tar.gz.sig
CHANGED
|
Binary file
|
metadata
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
--- !ruby/object:Gem::Specification
|
|
2
2
|
name: rdkafka
|
|
3
3
|
version: !ruby/object:Gem::Version
|
|
4
|
-
version: 0.14.0
|
|
4
|
+
version: 0.14.0
|
|
5
5
|
platform: ruby
|
|
6
6
|
authors:
|
|
7
7
|
- Thijs Cadier
|
|
@@ -35,7 +35,7 @@ cert_chain:
|
|
|
35
35
|
AnG1dJU+yL2BK7vaVytLTstJME5mepSZ46qqIJXMuWob/YPDmVaBF39TDSG9e34s
|
|
36
36
|
msG3BiCqgOgHAnL23+CN3Rt8MsuRfEtoTKpJVcCfoEoNHOkc
|
|
37
37
|
-----END CERTIFICATE-----
|
|
38
|
-
date: 2023-11-
|
|
38
|
+
date: 2023-11-21 00:00:00.000000000 Z
|
|
39
39
|
dependencies:
|
|
40
40
|
- !ruby/object:Gem::Dependency
|
|
41
41
|
name: ffi
|
|
@@ -255,9 +255,9 @@ required_ruby_version: !ruby/object:Gem::Requirement
|
|
|
255
255
|
version: '2.7'
|
|
256
256
|
required_rubygems_version: !ruby/object:Gem::Requirement
|
|
257
257
|
requirements:
|
|
258
|
-
- - "
|
|
258
|
+
- - ">="
|
|
259
259
|
- !ruby/object:Gem::Version
|
|
260
|
-
version:
|
|
260
|
+
version: '0'
|
|
261
261
|
requirements: []
|
|
262
262
|
rubygems_version: 3.4.19
|
|
263
263
|
signing_key:
|
metadata.gz.sig
CHANGED
|
Binary file
|