dalli 2.7.8 → 3.0.0
Sign up to get free protection for your applications and to get access to all the features.
Potentially problematic release.
This version of dalli might be problematic. Click here for more details.
- checksums.yaml +4 -4
- data/Gemfile +7 -2
- data/History.md +50 -0
- data/README.md +20 -102
- data/lib/dalli/cas/client.rb +1 -59
- data/lib/dalli/client.rb +179 -109
- data/lib/dalli/compressor.rb +4 -3
- data/lib/dalli/options.rb +3 -4
- data/lib/dalli/protocol/binary.rb +753 -0
- data/lib/dalli/protocol.rb +9 -0
- data/lib/dalli/ring.rb +12 -63
- data/lib/dalli/server.rb +2 -745
- data/lib/dalli/socket.rb +59 -134
- data/lib/dalli/version.rb +2 -1
- data/lib/dalli.rb +15 -17
- data/lib/rack/session/dalli.rb +21 -40
- metadata +11 -84
- data/lib/action_dispatch/middleware/session/dalli_store.rb +0 -82
- data/lib/active_support/cache/dalli_store.rb +0 -429
- data/lib/dalli/railtie.rb +0 -8
checksums.yaml
CHANGED
@@ -1,7 +1,7 @@
|
|
1
1
|
---
|
2
2
|
SHA256:
|
3
|
-
metadata.gz:
|
4
|
-
data.tar.gz:
|
3
|
+
metadata.gz: 48a2e02ec2d89d9304b68d36ed3827f4677398043a875f10c78a47f0517f579b
|
4
|
+
data.tar.gz: f2f365d5bc6d353fed61fd72866460c2e2929de9097018639f78687d96dae320
|
5
5
|
SHA512:
|
6
|
-
metadata.gz:
|
7
|
-
data.tar.gz:
|
6
|
+
metadata.gz: 732930e9654c116fbf3769bac8091126f831eb22d795ed8f7d70479ab3a15591576b9e88d150fc5a79590dbec309249d144de909698c010284bbb30b585c5180
|
7
|
+
data.tar.gz: 54aa18fc3808423e74507f1a3934afbbc60b78c080fc3e5bf790a1daf7832af9a8481f77c5dc8fcb428ca9743ec3f5eb3cb0258517d7cb126e5dd3c749e8f56f
|
data/Gemfile
CHANGED
data/History.md
CHANGED
@@ -1,6 +1,56 @@
|
|
1
1
|
Dalli Changelog
|
2
2
|
=====================
|
3
3
|
|
4
|
+
3.0.0
|
5
|
+
==========
|
6
|
+
- BREAKING CHANGES:
|
7
|
+
|
8
|
+
- Removes :dalli_store.
|
9
|
+
Use Rails' official :mem_cache_store instead.
|
10
|
+
https://guides.rubyonrails.org/caching_with_rails.html
|
11
|
+
- Attempting to store a larger value than allowed by memcached used to
|
12
|
+
print a warning and truncate the value. This now raises an error to
|
13
|
+
prevent silent data corruption.
|
14
|
+
- Compression now defaults to `true` for large values (greater than 4KB).
|
15
|
+
This is intended to minimize errors due to the previous note.
|
16
|
+
- Errors marshalling values now raise rather than just printing an error.
|
17
|
+
- The Rack session adapter has been refactored to remove support for thread-unsafe
|
18
|
+
configurations. You will need to include the `connection_pool` gem in
|
19
|
+
your Gemfile to ensure session operations are thread-safe.
|
20
|
+
|
21
|
+
- Raise NetworkError when multi response gets into corrupt state (mervync, #783)
|
22
|
+
- Validate servers argument (semaperepelitsa, petergoldstein, #776)
|
23
|
+
- Enable SSL support (bdunne, #775)
|
24
|
+
- Add gat operation (tbeauvais, #769)
|
25
|
+
- Removes inline native code, use Ruby 2.3+ support for bsearch instead. (mperham)
|
26
|
+
- Switch repo to Github Actions and upgrade Ruby versions (petergoldstein, bdunne, Fryguy)
|
27
|
+
- Update benchmark test for Rubyprof changes (nateberkopec)
|
28
|
+
- Remove support for the `kgio` gem, it is not relevant in Ruby 2.3+. (mperham)
|
29
|
+
- Remove inline native code, use Ruby 2.3+ support for bsearch instead. (mperham)
|
30
|
+
|
31
|
+
|
32
|
+
2.7.11
|
33
|
+
==========
|
34
|
+
- DEPRECATION: :dalli_store will be removed in Dalli 3.0.
|
35
|
+
Use Rails' official :mem_cache_store instead.
|
36
|
+
https://guides.rubyonrails.org/caching_with_rails.html
|
37
|
+
- Add new `digest_class` option to Dalli::Client [#724]
|
38
|
+
- Don't treat NameError as a network error [#728]
|
39
|
+
- Handle nested comma separated server strings (sambostock)
|
40
|
+
|
41
|
+
2.7.10
|
42
|
+
==========
|
43
|
+
- Revert frozen string change (schneems)
|
44
|
+
- Advertise supports_cached_versioning? in DalliStore (schneems)
|
45
|
+
- Better detection of fork support, to allow specs to run under Truffle Ruby (deepj)
|
46
|
+
- Update logging for over max size to log as error (aeroastro)
|
47
|
+
|
48
|
+
2.7.9
|
49
|
+
==========
|
50
|
+
- Fix behavior for Rails 5.2+ cache_versioning (GriwMF)
|
51
|
+
- Ensure fetch provides the key to the fallback block as an argument (0exp)
|
52
|
+
- Assorted performance improvements (schneems)
|
53
|
+
|
4
54
|
2.7.8
|
5
55
|
==========
|
6
56
|
- Rails 5.2 compatibility (pbougie)
|
data/README.md
CHANGED
@@ -1,4 +1,4 @@
|
|
1
|
-
Dalli [![
|
1
|
+
Dalli [![Tests](https://github.com/petergoldstein/dalli/actions/workflows/tests.yml/badge.svg)](https://github.com/petergoldstein/dalli/actions/workflows/tests.yml)
|
2
2
|
=====
|
3
3
|
|
4
4
|
Dalli is a high performance pure Ruby client for accessing memcached servers. It works with memcached 1.4+ only as it uses the newer binary protocol. It should be considered a replacement for the memcache-client gem.
|
@@ -9,26 +9,6 @@ The name is a variant of Salvador Dali for his famous painting [The Persistence
|
|
9
9
|
|
10
10
|
Dalli's initial development was sponsored by [CouchBase](http://www.couchbase.com/). Many thanks to them!
|
11
11
|
|
12
|
-
|
13
|
-
Design
|
14
|
-
------------
|
15
|
-
|
16
|
-
Mike Perham decided to write Dalli after maintaining memcache-client for two years for a few specific reasons:
|
17
|
-
|
18
|
-
0. The code is mostly old and gross. The bulk of the code is a single 1000 line .rb file.
|
19
|
-
1. It has a lot of options that are infrequently used which complicate the codebase.
|
20
|
-
2. The implementation has no single point to attach monitoring hooks.
|
21
|
-
3. Uses the old text protocol, which hurts raw performance.
|
22
|
-
|
23
|
-
So a few notes. Dalli:
|
24
|
-
|
25
|
-
0. uses the exact same algorithm to choose a server so existing memcached clusters with TBs of data will work identically to memcache-client.
|
26
|
-
1. is approximately 20% faster than memcache-client (which itself was heavily optimized) in Ruby 1.9.2.
|
27
|
-
2. contains explicit "chokepoint" methods which handle all requests; these can be hooked into by monitoring tools (NewRelic, Rack::Bug, etc) to track memcached usage.
|
28
|
-
3. supports SASL for use in managed environments, e.g. Heroku.
|
29
|
-
4. provides proper failover with recovery and adjustable timeouts
|
30
|
-
|
31
|
-
|
32
12
|
Supported Ruby versions and implementations
|
33
13
|
------------------------------------------------
|
34
14
|
|
@@ -66,85 +46,23 @@ dc.set('abc', 123)
|
|
66
46
|
value = dc.get('abc')
|
67
47
|
```
|
68
48
|
|
69
|
-
|
70
|
-
|
71
|
-
Dalli has no runtime dependencies and never will. You can optionally install the 'kgio' gem to
|
72
|
-
give Dalli a 20-30% performance boost.
|
73
|
-
|
74
|
-
|
75
|
-
Usage with Rails 3.x and 4.x
|
76
|
-
---------------------------
|
77
|
-
|
78
|
-
In your Gemfile:
|
79
|
-
|
80
|
-
```ruby
|
81
|
-
gem 'dalli'
|
82
|
-
```
|
83
|
-
|
84
|
-
In `config/environments/production.rb`:
|
85
|
-
|
86
|
-
```ruby
|
87
|
-
config.cache_store = :dalli_store
|
88
|
-
```
|
89
|
-
|
90
|
-
Here's a more comprehensive example that sets a reasonable default for maximum cache entry lifetime (one day), enables compression for large values and namespaces all entries for this rails app. Remove the namespace if you have multiple apps which share cached values.
|
91
|
-
|
92
|
-
```ruby
|
93
|
-
config.cache_store = :dalli_store, 'cache-1.example.com', 'cache-2.example.com:11211:2',
|
94
|
-
{ :namespace => NAME_OF_RAILS_APP, :expires_in => 1.day, :compress => true }
|
95
|
-
```
|
96
|
-
|
97
|
-
You can specify a port and a weight by appending to the server name. You may wish to increase the weight of a server with more memory configured. (e.g. to specify port 11211 and a weight of 2, append `:11211:2` )
|
98
|
-
|
99
|
-
If your servers are specified in `ENV["MEMCACHE_SERVERS"]` (e.g. on Heroku when using a third-party hosted addon), simply provide `nil` for the servers:
|
100
|
-
|
101
|
-
```ruby
|
102
|
-
config.cache_store = :dalli_store, nil, { :namespace => NAME_OF_RAILS_APP, :expires_in => 1.day, :compress => true }
|
103
|
-
```
|
104
|
-
|
105
|
-
To use Dalli for Rails session storage that times out after 20 minutes, in `config/initializers/session_store.rb`:
|
106
|
-
|
107
|
-
For Rails >= 3.2.4:
|
108
|
-
|
109
|
-
```ruby
|
110
|
-
Rails.application.config.session_store ActionDispatch::Session::CacheStore, :expire_after => 20.minutes
|
111
|
-
```
|
112
|
-
|
113
|
-
For Rails 3.x:
|
114
|
-
|
49
|
+
With SSL enabled:
|
115
50
|
```ruby
|
116
|
-
require '
|
117
|
-
|
118
|
-
|
119
|
-
|
120
|
-
|
121
|
-
|
122
|
-
|
123
|
-
|
124
|
-
|
125
|
-
|
126
|
-
If you use Puma or another threaded app server, as of Dalli 2.7, you can use a pool
|
127
|
-
of Dalli clients with Rails to ensure the `Rails.cache` singleton does not become a
|
128
|
-
source of thread contention. You must add `gem 'connection_pool'` to your Gemfile and
|
129
|
-
add :pool\_size to your `dalli_store` config:
|
130
|
-
|
131
|
-
```ruby
|
132
|
-
config.cache_store = :dalli_store, 'cache-1.example.com', { :pool_size => 5 }
|
51
|
+
require 'dalli'
|
52
|
+
ssl_context = OpenSSL::SSL::SSLContext.new
|
53
|
+
ssl_context.ca_file = "./myCA.pem"
|
54
|
+
ssl_context.ssl_version = :SSLv23
|
55
|
+
ssl_context.verify_hostname = true
|
56
|
+
ssl_context.verify_mode = OpenSSL::SSL::VERIFY_PEER
|
57
|
+
|
58
|
+
dc = Dalli::Client.new("memcached:11212", :ssl_context => ssl_context)
|
59
|
+
dc.set("abc", 123)
|
60
|
+
value = dc.get("abc")
|
133
61
|
```
|
134
62
|
|
135
|
-
|
136
|
-
|
137
|
-
```ruby
|
138
|
-
Rails.cache.fetch('foo', :expires_in => 300) do
|
139
|
-
'bar'
|
140
|
-
end
|
141
|
-
|
142
|
-
Rails.cache.dalli.with do |client|
|
143
|
-
# client is a Dalli::Client instance which you can
|
144
|
-
# use ONLY within this block
|
145
|
-
end
|
146
|
-
```
|
63
|
+
The test suite requires memcached 1.4.3+ with SASL enabled (`brew install memcached --enable-sasl ; mv /usr/bin/memcached /usr/bin/memcached.old`). Currently only supports the PLAIN mechanism.
|
147
64
|
|
65
|
+
Dalli has no runtime dependencies.
|
148
66
|
|
149
67
|
Configuration
|
150
68
|
------------------------
|
@@ -159,7 +77,7 @@ Dalli::Client accepts the following options. All times are in seconds.
|
|
159
77
|
|
160
78
|
**failover**: Boolean, if true Dalli will failover to another server if the main server for a key is down. Default is true.
|
161
79
|
|
162
|
-
**threadsafe**: Boolean. If true Dalli ensures that only one thread is using a socket at a given time.
|
80
|
+
**threadsafe**: Boolean. If true Dalli ensures that only one thread is using a socket at a given time. Default is true. You can set to false if you are using the Client within a thread-safe connection pool.
|
163
81
|
|
164
82
|
**serializer**: The serializer to use for objects being stored (ex. JSON).
|
165
83
|
Default is Marshal.
|
@@ -176,13 +94,13 @@ If serving compressed data using nginx's HttpMemcachedModule, set `memcached_gzi
|
|
176
94
|
|
177
95
|
**keepalive**: Boolean. If true, Dalli will enable keep-alive for socket connections. Default is true.
|
178
96
|
|
179
|
-
**socket_timeout**: Timeout for all socket operations (connect, read, write). Default is
|
97
|
+
**socket_timeout**: Timeout for all socket operations (connect, read, write). Default is 1.
|
180
98
|
|
181
99
|
**socket_max_failures**: When a socket operation fails after socket_timeout, the same operation is retried. This is to not immediately mark a server down when there's a very slight network problem. Default is 2.
|
182
100
|
|
183
|
-
**socket_failure_delay**: Before retrying a socket operation, the process sleeps for this amount of time. Default is 0.
|
101
|
+
**socket_failure_delay**: Before retrying a socket operation, the process sleeps for this amount of time. Default is 0.1. Set to nil for no delay.
|
184
102
|
|
185
|
-
**down_retry_delay**: When a server has been marked down due to many failures, the server will be checked again for being alive only after this amount of time. Don't set this value too low, otherwise each request which tries the failed server might hang for the maximum **socket_timeout**. Default is
|
103
|
+
**down_retry_delay**: When a server has been marked down due to many failures, the server will be checked again for being alive only after this amount of time. Don't set this value too low, otherwise each request which tries the failed server might hang for the maximum **socket_timeout**. Default is 30 seconds.
|
186
104
|
|
187
105
|
**value_max_bytes**: The maximum size of a value in memcached. Defaults to 1MB, this can be increased with memcached's -I parameter. You must also configure Dalli to allow the larger size here.
|
188
106
|
|
@@ -205,7 +123,7 @@ If serving compressed data using nginx's HttpMemcachedModule, set `memcached_gzi
|
|
205
123
|
Features and Changes
|
206
124
|
------------------------
|
207
125
|
|
208
|
-
By default, Dalli is thread-safe.
|
126
|
+
By default, Dalli is thread-safe. Disable thread-safety at your own peril.
|
209
127
|
|
210
128
|
Dalli does not need anything special in Unicorn/Passenger since 2.0.4.
|
211
129
|
It will detect sockets shared with child processes and gracefully reopen the
|
@@ -218,7 +136,7 @@ Note that Dalli does not require ActiveSupport or Rails. You can safely use it
|
|
218
136
|
Helping Out
|
219
137
|
-------------
|
220
138
|
|
221
|
-
If you have a fix you wish to provide, please fork the code, fix in your local project and then send a pull request on github. Please ensure that you include a test which verifies your fix and update History.md with a one sentence description of your fix so you get credit as a contributor.
|
139
|
+
If you have a fix you wish to provide, please fork the code, fix in your local project and then send a pull request on github. Please ensure that you include a test which verifies your fix and update `History.md` with a one sentence description of your fix so you get credit as a contributor.
|
222
140
|
|
223
141
|
We're not accepting new compressors. They are trivial to add in an initializer. See #385 (LZ4), #406 (Snappy)
|
224
142
|
|
data/lib/dalli/cas/client.rb
CHANGED
@@ -1,59 +1 @@
|
|
1
|
-
|
2
|
-
require 'dalli/client'
|
3
|
-
|
4
|
-
module Dalli
|
5
|
-
class Client
|
6
|
-
##
|
7
|
-
# Get the value and CAS ID associated with the key. If a block is provided,
|
8
|
-
# value and CAS will be passed to the block.
|
9
|
-
def get_cas(key)
|
10
|
-
(value, cas) = perform(:cas, key)
|
11
|
-
value = (!value || value == 'Not found') ? nil : value
|
12
|
-
if block_given?
|
13
|
-
yield value, cas
|
14
|
-
else
|
15
|
-
[value, cas]
|
16
|
-
end
|
17
|
-
end
|
18
|
-
|
19
|
-
##
|
20
|
-
# Fetch multiple keys efficiently, including available metadata such as CAS.
|
21
|
-
# If a block is given, yields key/data pairs one a time. Data is an array:
|
22
|
-
# [value, cas_id]
|
23
|
-
# If no block is given, returns a hash of
|
24
|
-
# { 'key' => [value, cas_id] }
|
25
|
-
def get_multi_cas(*keys)
|
26
|
-
if block_given?
|
27
|
-
get_multi_yielder(keys) {|*args| yield(*args)}
|
28
|
-
else
|
29
|
-
Hash.new.tap do |hash|
|
30
|
-
get_multi_yielder(keys) {|k, data| hash[k] = data}
|
31
|
-
end
|
32
|
-
end
|
33
|
-
end
|
34
|
-
|
35
|
-
##
|
36
|
-
# Set the key-value pair, verifying existing CAS.
|
37
|
-
# Returns the resulting CAS value if succeeded, and falsy otherwise.
|
38
|
-
def set_cas(key, value, cas, ttl=nil, options=nil)
|
39
|
-
ttl ||= @options[:expires_in].to_i
|
40
|
-
perform(:set, key, value, ttl, cas, options)
|
41
|
-
end
|
42
|
-
|
43
|
-
##
|
44
|
-
# Conditionally add a key/value pair, verifying existing CAS, only if the
|
45
|
-
# key already exists on the server. Returns the new CAS value if the
|
46
|
-
# operation succeeded, or falsy otherwise.
|
47
|
-
def replace_cas(key, value, cas, ttl=nil, options=nil)
|
48
|
-
ttl ||= @options[:expires_in].to_i
|
49
|
-
perform(:replace, key, value, ttl, cas, options)
|
50
|
-
end
|
51
|
-
|
52
|
-
# Delete a key/value pair, verifying existing CAS.
|
53
|
-
# Returns true if succeeded, and falsy otherwise.
|
54
|
-
def delete_cas(key, cas=0)
|
55
|
-
perform(:delete, key, cas)
|
56
|
-
end
|
57
|
-
|
58
|
-
end
|
59
|
-
end
|
1
|
+
puts "You can remove `require 'dalli/cas/client'` as this code has been rolled into the standard 'dalli/client'.
|