redis 4.6.0 → 5.0.0.beta3

Sign up to get free protection for your applications and to get access to all the features.
Files changed (43) hide show
  1. checksums.yaml +4 -4
  2. data/CHANGELOG.md +35 -1
  3. data/README.md +77 -146
  4. data/lib/redis/client.rb +78 -615
  5. data/lib/redis/commands/bitmaps.rb +4 -1
  6. data/lib/redis/commands/cluster.rb +1 -18
  7. data/lib/redis/commands/connection.rb +5 -10
  8. data/lib/redis/commands/hashes.rb +6 -3
  9. data/lib/redis/commands/hyper_log_log.rb +1 -1
  10. data/lib/redis/commands/keys.rb +52 -26
  11. data/lib/redis/commands/lists.rb +10 -14
  12. data/lib/redis/commands/pubsub.rb +7 -9
  13. data/lib/redis/commands/server.rb +14 -14
  14. data/lib/redis/commands/sets.rb +42 -35
  15. data/lib/redis/commands/sorted_sets.rb +13 -3
  16. data/lib/redis/commands/streams.rb +12 -10
  17. data/lib/redis/commands/strings.rb +1 -0
  18. data/lib/redis/commands/transactions.rb +26 -3
  19. data/lib/redis/commands.rb +1 -8
  20. data/lib/redis/distributed.rb +99 -66
  21. data/lib/redis/errors.rb +10 -43
  22. data/lib/redis/hash_ring.rb +26 -26
  23. data/lib/redis/pipeline.rb +56 -203
  24. data/lib/redis/subscribe.rb +15 -9
  25. data/lib/redis/version.rb +1 -1
  26. data/lib/redis.rb +69 -175
  27. metadata +13 -57
  28. data/lib/redis/cluster/command.rb +0 -79
  29. data/lib/redis/cluster/command_loader.rb +0 -33
  30. data/lib/redis/cluster/key_slot_converter.rb +0 -72
  31. data/lib/redis/cluster/node.rb +0 -120
  32. data/lib/redis/cluster/node_key.rb +0 -31
  33. data/lib/redis/cluster/node_loader.rb +0 -37
  34. data/lib/redis/cluster/option.rb +0 -93
  35. data/lib/redis/cluster/slot.rb +0 -86
  36. data/lib/redis/cluster/slot_loader.rb +0 -49
  37. data/lib/redis/cluster.rb +0 -315
  38. data/lib/redis/connection/command_helper.rb +0 -41
  39. data/lib/redis/connection/hiredis.rb +0 -68
  40. data/lib/redis/connection/registry.rb +0 -13
  41. data/lib/redis/connection/ruby.rb +0 -431
  42. data/lib/redis/connection/synchrony.rb +0 -148
  43. data/lib/redis/connection.rb +0 -11
checksums.yaml CHANGED
@@ -1,7 +1,7 @@
1
1
  ---
2
2
  SHA256:
3
- metadata.gz: 7e99f4e628112a227719d2000dc5b081893273cfbd51ae25bf00a8f6b6594061
4
- data.tar.gz: 42a8e0cf75aebbc14cdf680b4bc1f7bbdec9e20b53f150c6443c01126960a959
3
+ metadata.gz: a8bcabf5f725061ad3fba18ed42eed7ce26788cf41b78f2091e6033530e124e0
4
+ data.tar.gz: 6b22ffde2abc13f944641c17972013cb4084dd91989127d6a3f9232b1b21ec5d
5
5
  SHA512:
6
- metadata.gz: 8bc57fe306c601f27d32df4940d5632e9e7d75529f6ac5d42732b21fe04452a4a1ab89567492c6fb7249ef4d69ebb2c0b7c985e18b0ef4f9ee6fb816c31bcbda
7
- data.tar.gz: 42b2f8c584d6f96d0fc783d0b36af0fd9415d1dbd43ad8fe7a980688e52fbdb51645a07960d9cb3faacf6696c460cf38a013e290d0b58d4bbbb07626f18f15c7
6
+ metadata.gz: 21141ffa7c06d44599ba93097ec2000abd6325afe2e7175a15f0c0dddfae7b2a120b8acd5f14937f1c58fb971e2fd04603721388a53f6ea42b66031f8b1f9058
7
+ data.tar.gz: 1b0996205f973aba8c7db27726eacbe2a03e4339d0444eee80e68958a5226b70349437a518a5f8d0a7b419106e9c9ae546d349dbf7c639ca9a51a721ca96a51c
data/CHANGELOG.md CHANGED
@@ -1,5 +1,39 @@
1
1
  # Unreleased
2
2
 
3
+ # 5.0.0.beta3
4
+
5
+ - Use `MD5` for hashing server nodes in `Redis::Distributed`. This should improve keys distribution among servers. See #1089.
6
+ - Changed `sadd` and `srem` to now always return an Integer.
7
+ - Added `sadd?` and `srem?` which always return a Boolean.
8
+ - Added support for `IDLE` paramter in `xpending`.
9
+ - Cluster support has been moved to a `rediscluster` companion gem.
10
+ - `select` no longer record the current database. If the client has to reconnect after `select` was used, it will reconnect to the original database.
11
+ - Better support Float timeout in blocking commands. See #977.
12
+ - Removed positional timeout in blocking commands (`BLPOP`, etc). Timeout now must be passed as an option: `r.blpop("key", timeout: 2.5)`
13
+ - Removed `logger` option.
14
+ - Removed `reconnect_delay_max` and `reconnect_delay`, you can pass precise sleep durations to `reconnect_attempts` instead.
15
+ - Require Ruby 2.5+.
16
+ - Removed the deprecated `queue` and `commit` methods. Use `pipelined` instead.
17
+ - Removed the deprecated `Redis::Future#==`.
18
+ - Removed the deprecated `pipelined` and `multi` signature. Commands now MUST be called on the block argument, not the original redis instance.
19
+ - Removed `Redis.current`. You shouldn't assume there is a single global Redis connection, use a connection pool instead,
20
+ and libaries using Redis should accept a Redis instance (or connection pool) as a config. E.g. `MyLibrary.redis = Redis.new(...)`.
21
+ - Removed the `synchrony` driver.
22
+ - Removed `Redis.exists_returns_integer`, it's now always enabled.
23
+
24
+ # 4.7.1
25
+
26
+ * Gracefully handle OpenSSL 3.0 EOF Errors (`OpenSSL::SSL::SSLError: SSL_read: unexpected eof while reading`). See #1106
27
+ This happens frequently on heroku-22.
28
+
29
+ # 4.7.0
30
+
31
+ * Support single endpoint architecture with SSL/TLS in cluster mode. See #1086.
32
+ * `zrem` and `zadd` act as noop when provided an empty list of keys. See #1097.
33
+ * Support IPv6 URLs.
34
+ * Add `Redis#with` for better compatibility with `connection_pool` usage.
35
+ * Fix the block form of `multi` called inside `pipelined`. Previously the `MUTLI/EXEC` wouldn't be sent. See #1073.
36
+
3
37
  # 4.6.0
4
38
 
5
39
  * Deprecate `Redis.current`.
@@ -37,7 +71,7 @@
37
71
  * `Redis#synchronize` is now private like it should always have been.
38
72
 
39
73
  * Add `Redis.silence_deprecations=` to turn off deprecation warnings.
40
- If you don't wish to see warnings yet, you can set `Redis.silence_deprecations = false`.
74
+ If you don't wish to see warnings yet, you can set `Redis.silence_deprecations = true`.
41
75
  It is however heavily recommended to fix them instead when possible.
42
76
  * Add `Redis.raise_deprecations=` to turn deprecation warnings into errors.
43
77
  This makes it easier to identitify the source of deprecated APIs usage.
data/README.md CHANGED
@@ -1,7 +1,6 @@
1
1
  # redis-rb [![Build Status][gh-actions-image]][gh-actions-link] [![Inline docs][inchpages-image]][inchpages-link]
2
2
 
3
- A Ruby client that tries to match [Redis][redis-home]' API one-to-one, while still
4
- providing an idiomatic interface.
3
+ A Ruby client that tries to match [Redis][redis-home]' API one-to-one, while still providing an idiomatic interface.
5
4
 
6
5
  See [RubyDoc.info][rubydoc] for the API docs of the latest published gem.
7
6
 
@@ -38,10 +37,6 @@ redis = Redis.new(url: "redis://:p4ssw0rd@10.0.1.1:6380/15")
38
37
  The client expects passwords with special chracters to be URL-encoded (i.e.
39
38
  `CGI.escape(password)`).
40
39
 
41
- By default, the client will try to read the `REDIS_URL` environment variable
42
- and use that as URL to connect to. The above statement is therefore equivalent
43
- to setting this environment variable and calling `Redis.new` without arguments.
44
-
45
40
  To connect to Redis listening on a Unix socket, try:
46
41
 
47
42
  ```ruby
@@ -76,6 +71,28 @@ redis.get("mykey")
76
71
  All commands, their arguments, and return values are documented and
77
72
  available on [RubyDoc.info][rubydoc].
78
73
 
74
+ ## Connection Pooling and Thread safety
75
+
76
+ The client does not provide connection pooling. Each `Redis` instance
77
+ has one and only one connection to the server, and use of this connection
78
+ is protected by a mutex.
79
+
80
+ As such it is heavilly recommended to use the [`connection_pool` gem], e.g.:
81
+
82
+ ```ruby
83
+ module MyApp
84
+ def self.redis
85
+ @redis ||= ConnectionPool.new do
86
+ Redis.new(url: ENV["REDIS_URL"])
87
+ end
88
+ end
89
+ end
90
+
91
+ MyApp.redis.incr("some-counter")
92
+ ```
93
+
94
+ [`connection_pool` gem](https://github.com/mperham/connection_pool)
95
+
79
96
  ## Sentinel support
80
97
 
81
98
  The client is able to perform automatic failover by using [Redis
@@ -111,64 +128,12 @@ If you want to [authenticate](https://redis.io/topics/sentinel#configuring-senti
111
128
  SENTINELS = [{ host: '127.0.0.1', port: 26380, password: 'mysecret' },
112
129
  { host: '127.0.0.1', port: 26381, password: 'mysecret' }]
113
130
 
114
- redis = Redis.new(host: 'mymaster', sentinels: SENTINELS, role: :master)
131
+ redis = Redis.new(name: 'mymaster', sentinels: SENTINELS, role: :master)
115
132
  ```
116
133
 
117
134
  ## Cluster support
118
135
 
119
- `redis-rb` supports [clustering](https://redis.io/topics/cluster-spec).
120
-
121
- ```ruby
122
- # Nodes can be passed to the client as an array of connection URLs.
123
- nodes = (7000..7005).map { |port| "redis://127.0.0.1:#{port}" }
124
- redis = Redis.new(cluster: nodes)
125
-
126
- # You can also specify the options as a Hash. The options are the same as for a single server connection.
127
- (7000..7005).map { |port| { host: '127.0.0.1', port: port } }
128
- ```
129
-
130
- You can also specify only a subset of the nodes, and the client will discover the missing ones using the [CLUSTER NODES](https://redis.io/commands/cluster-nodes) command.
131
-
132
- ```ruby
133
- Redis.new(cluster: %w[redis://127.0.0.1:7000])
134
- ```
135
-
136
- If you want [the connection to be able to read from any replica](https://redis.io/commands/readonly), you must pass the `replica: true`. Note that this connection won't be usable to write keys.
137
-
138
- ```ruby
139
- Redis.new(cluster: nodes, replica: true)
140
- ```
141
-
142
- The calling code is responsible for [avoiding cross slot commands](https://redis.io/topics/cluster-spec#keys-distribution-model).
143
-
144
- ```ruby
145
- redis = Redis.new(cluster: %w[redis://127.0.0.1:7000])
146
-
147
- redis.mget('key1', 'key2')
148
- #=> Redis::CommandError (CROSSSLOT Keys in request don't hash to the same slot)
149
-
150
- redis.mget('{key}1', '{key}2')
151
- #=> [nil, nil]
152
- ```
153
-
154
- * The client automatically reconnects after a failover occurred, but the caller is responsible for handling errors while it is happening.
155
- * The client support permanent node failures, and will reroute requests to promoted slaves.
156
- * The client supports `MOVED` and `ASK` redirections transparently.
157
-
158
- ## Storing objects
159
-
160
- Redis "string" types can be used to store serialized Ruby objects, for
161
- example with JSON:
162
-
163
- ```ruby
164
- require "json"
165
-
166
- redis.set "foo", [1, 2, 3].to_json
167
- # => OK
168
-
169
- JSON.parse(redis.get("foo"))
170
- # => [1, 2, 3]
171
- ```
136
+ [Clustering](https://redis.io/topics/cluster-spec). is supported via the [`redis-clustering` gem](cluster/).
172
137
 
173
138
  ## Pipelining
174
139
 
@@ -191,6 +156,17 @@ end
191
156
  # => ["OK", 1]
192
157
  ```
193
158
 
159
+ Commands must be called on the yielded objects. If you call methods
160
+ on the original client objects from inside a pipeline, they willb e sent immediately:
161
+
162
+ ```ruby
163
+ redis.pipelined do |pipeline|
164
+ pipeline.set "foo", "bar"
165
+ redis.incr "baz" # => 1
166
+ end
167
+ # => ["OK"]
168
+ ```
169
+
194
170
  ### Executing commands atomically
195
171
 
196
172
  You can use `MULTI/EXEC` to run a number of commands in an atomic
@@ -210,21 +186,22 @@ end
210
186
  ### Futures
211
187
 
212
188
  Replies to commands in a pipeline can be accessed via the *futures* they
213
- emit (since redis-rb 3.0). All calls on the pipeline object return a
189
+ emit. All calls on the pipeline object return a
214
190
  `Future` object, which responds to the `#value` method. When the
215
191
  pipeline has successfully executed, all futures are assigned their
216
192
  respective replies and can be used.
217
193
 
218
194
  ```ruby
195
+ set = incr = nil
219
196
  redis.pipelined do |pipeline|
220
- @set = pipeline.set "foo", "bar"
221
- @incr = pipeline.incr "baz"
197
+ set = pipeline.set "foo", "bar"
198
+ incr = pipeline.incr "baz"
222
199
  end
223
200
 
224
- @set.value
201
+ set.value
225
202
  # => "OK"
226
203
 
227
- @incr.value
204
+ incr.value
228
205
  # => 1
229
206
  ```
230
207
 
@@ -236,7 +213,7 @@ it can't connect to the server a `Redis::CannotConnectError` error will be raise
236
213
  ```ruby
237
214
  begin
238
215
  redis.ping
239
- rescue StandardError => e
216
+ rescue Redis::BaseError => e
240
217
  e.inspect
241
218
  # => #<Redis::CannotConnectError: Timed out connecting to Redis on 10.0.1.1:6380>
242
219
 
@@ -283,55 +260,37 @@ If no message is received after 5 seconds, the client will unsubscribe.
283
260
 
284
261
  ## Reconnections
285
262
 
286
- The client allows you to configure how many `reconnect_attempts` it should
287
- complete before declaring a connection as failed. Furthermore, you may want
288
- to control the maximum duration between reconnection attempts with
289
- `reconnect_delay` and `reconnect_delay_max`.
263
+ **By default**, this gem will only **retry a connection once** and then fail, but
264
+ the client allows you to configure how many `reconnect_attempts` it should
265
+ complete before declaring a connection as failed.
290
266
 
291
267
  ```ruby
292
- Redis.new(
293
- :reconnect_attempts => 10,
294
- :reconnect_delay => 1.5,
295
- :reconnect_delay_max => 10.0,
296
- )
268
+ Redis.new(reconnect_attempts: 0)
269
+ Redis.new(reconnect_attempts: 3)
297
270
  ```
298
271
 
299
- The delay values are specified in seconds. With the above configuration, the
300
- client would attempt 10 reconnections, exponentially increasing the duration
301
- between each attempt but it never waits longer than `reconnect_delay_max`.
302
-
303
- This is the retry algorithm:
272
+ If you wish to wait between reconnection attempts, you can instead pass a list
273
+ of durations:
304
274
 
305
275
  ```ruby
306
- attempt_wait_time = [(reconnect_delay * 2**(attempt-1)), reconnect_delay_max].min
276
+ Redis.new(reconnect_attempts: [
277
+ 0, # retry immediately
278
+ 0.25 # retry a second time after 250ms
279
+ 1 # retry a third and final time after another 1s
280
+ ])
307
281
  ```
308
282
 
309
- **By default**, this gem will only **retry a connection once** and then fail, but with the
310
- above configuration the reconnection attempt would look like this:
311
-
312
- #|Attempt wait time|Total wait time
313
- :-:|:-:|:-:
314
- 1|1.5s|1.5s
315
- 2|3.0s|4.5s
316
- 3|6.0s|10.5s
317
- 4|10.0s|20.5s
318
- 5|10.0s|30.5s
319
- 6|10.0s|40.5s
320
- 7|10.0s|50.5s
321
- 8|10.0s|60.5s
322
- 9|10.0s|70.5s
323
- 10|10.0s|80.5s
324
-
325
- So if the reconnection attempt #10 succeeds 70 seconds have elapsed trying
326
- to reconnect, this is likely fine in long-running background processes, but if
327
- you use Redis to drive your website you might want to have a lower
328
- `reconnect_delay_max` or have less `reconnect_attempts`.
283
+ If you wish to disable reconnection only for some commands, you can use
284
+ `disable_reconnection`:
329
285
 
330
- ## SSL/TLS Support
286
+ ```ruby
287
+ redis.get("some-key") # this may be retried
288
+ redis.disable_reconnection do
289
+ redis.incr("some-counter") # this won't be retried.
290
+ end
291
+ ```
331
292
 
332
- This library supports natively terminating client side SSL/TLS connections
333
- when talking to Redis via a server-side proxy such as [stunnel], [hitch],
334
- or [ghostunnel].
293
+ ## SSL/TLS Support
335
294
 
336
295
  To enable SSL support, pass the `:ssl => true` option when configuring the
337
296
  Redis client, or pass in `:url => "rediss://..."` (like HTTPS for Redis).
@@ -366,13 +325,7 @@ redis = Redis.new(
366
325
  )
367
326
  ```
368
327
 
369
- [stunnel]: https://www.stunnel.org/
370
- [hitch]: https://hitch-tls.org/
371
- [ghostunnel]: https://github.com/square/ghostunnel
372
- [OpenSSL::SSL::SSLContext documentation]: http://ruby-doc.org/stdlib-2.3.0/libdoc/openssl/rdoc/OpenSSL/SSL/SSLContext.html
373
-
374
- *NOTE:* SSL is only supported by the default "Ruby" driver
375
-
328
+ [OpenSSL::SSL::SSLContext documentation]: http://ruby-doc.org/stdlib-2.5.0/libdoc/openssl/rdoc/OpenSSL/SSL/SSLContext.html
376
329
 
377
330
  ## Expert-Mode Options
378
331
 
@@ -386,17 +339,9 @@ redis = Redis.new(
386
339
  Improper use of `inherit_socket` will result in corrupted and/or incorrect
387
340
  responses.
388
341
 
389
- ## Alternate drivers
342
+ ## hiredis binding
390
343
 
391
344
  By default, redis-rb uses Ruby's socket library to talk with Redis.
392
- To use an alternative connection driver it should be specified as option
393
- when instantiating the client object. These instructions are only valid
394
- for **redis-rb 3.0**. For instructions on how to use alternate drivers from
395
- **redis-rb 2.2**, please refer to an [older README][readme-2.2.2].
396
-
397
- [readme-2.2.2]: https://github.com/redis/redis-rb/blob/v2.2.2/README.md
398
-
399
- ### hiredis
400
345
 
401
346
  The hiredis driver uses the connection facility of hiredis-rb. In turn,
402
347
  hiredis-rb is a binding to the official hiredis client library. It
@@ -406,41 +351,27 @@ extension, JRuby is not supported (by default).
406
351
  It is best to use hiredis when you have large replies (for example:
407
352
  `LRANGE`, `SMEMBERS`, `ZRANGE`, etc.) and/or use big pipelines.
408
353
 
409
- In your Gemfile, include hiredis:
354
+ In your Gemfile, include `hiredis-client`:
410
355
 
411
356
  ```ruby
412
- gem "redis", "~> 3.0.1"
413
- gem "hiredis", "~> 0.4.5"
357
+ gem "redis"
358
+ gem "hiredis-client"
414
359
  ```
415
360
 
416
- When instantiating the client object, specify hiredis:
361
+ If your application doesn't call `Bundler.require`, you may have
362
+ to require it explictly:
417
363
 
418
364
  ```ruby
419
- redis = Redis.new(:driver => :hiredis)
420
- ```
421
-
422
- ### synchrony
423
-
424
- The synchrony driver adds support for [em-synchrony][em-synchrony].
425
- This makes redis-rb work with EventMachine's asynchronous I/O, while not
426
- changing the exposed API. The hiredis gem needs to be available as
427
- well, because the synchrony driver uses hiredis for parsing the Redis
428
- protocol.
429
-
430
- [em-synchrony]: https://github.com/igrigorik/em-synchrony
365
+ require "hiredis-client"
366
+ ````
431
367
 
432
- In your Gemfile, include em-synchrony and hiredis:
433
-
434
- ```ruby
435
- gem "redis", "~> 3.0.1"
436
- gem "hiredis", "~> 0.4.5"
437
- gem "em-synchrony"
438
- ```
368
+ This makes the hiredis driver the default.
439
369
 
440
- When instantiating the client object, specify synchrony:
370
+ If you want to be certain hiredis is being used, when instantiating
371
+ the client object, specify hiredis:
441
372
 
442
373
  ```ruby
443
- redis = Redis.new(:driver => :synchrony)
374
+ redis = Redis.new(driver: :hiredis)
444
375
  ```
445
376
 
446
377
  ## Testing