mudis 0.7.0 → 0.7.1

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
data/README.md CHANGED
@@ -1,695 +1,861 @@
1
- ![mudis_signet](design/mudis.png "Mudis")
2
-
3
- [![Gem Version](https://badge.fury.io/rb/mudis.svg?icon=si%3Arubygems&refresh=1&cachebust=0)](https://badge.fury.io/rb/mudis)
4
- [![License: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](LICENSE)
5
-
6
- **Mudis** is a fast, thread-safe, in-memory, sharded LRU (Least Recently Used) cache for Ruby applications. Inspired by Redis, it provides value serialization, optional compression, per-key expiry, and metric tracking in a lightweight, dependency-free package that lives inside your Ruby process.
7
-
8
- It’s ideal for scenarios where performance and process-local caching are critical, and where a full Redis setup is overkill or otherwise not possible/desirable.
9
-
10
- Alternatively, Mudis can be upscaled with higher sharding and resources in a dedicated Rails app to provide a [Mudis server](#create-a-mudis-server).
11
-
12
- ### Why another Caching Gem?
13
-
14
- There are plenty out there, in various states of maintenance and in many shapes and sizes. So why on earth do we need another? I needed a drop-in replacement for Kredis, and the reason I was interested in using Kredis was for the simplified API and keyed management it gave me in extension to Redis. But what I didn't really need was Redis. I needed an observable, fast, simple, easy to use, flexible and highly configurable, thread-safe and high performant caching system which didn't require too many dependencies or standing up additional services. So, Mudis was born. In its most rudimentary state it was extremely useful in my project, which was an API gateway connecting into mutliple micro-services and a wide selection of APIs. The majority of the data was cold and produced by repeat expensive queries across several domains. Mudis allowed for me to minimize the footprint of the gateway, and improve end user experience, and increase performance. So, yeah, there's a lot of these gems out there, but none which really met all my needs. I decided to provide Mudis for anyone else. If you use it, I'd be interested to know how and whether you got any benefit.
15
-
16
- #### Similar Gems
17
-
18
- - [FastCache](https://github.com/swoop-inc/fast_cache)
19
- - [EasyCache](https://github.com/malvads/easycache)
20
- - [MiniCache](https://github.com/derrickreimer/mini_cache)
21
- - [Zache](https://github.com/yegor256/zache)
22
-
23
- #### Feature / Function Comparison
24
-
25
- | **Feature** | **Mudis** | **MemoryStore** (`Rails.cache`) | **FastCache** | **Zache** | **EasyCache** | **MiniCache** |
26
- | -------------------------------------- | ---------------- | ------------------------------- | -------------- | ------------- | ------------- | -------------- |
27
- | **LRU eviction strategy** | ✅ Per-bucket | ✅ Global | ✅ Global | ❌ | ❌ | ✅ Simplistic |
28
- | **TTL expiry support** | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
29
- | **Background expiry cleanup thread** | ✅ | ❌ (only on access) | ❌ | ✅ | ❌ | ❌ |
30
- | **Thread safety** | ✅ Bucketed | ⚠️ Global lock | ✅ Fine-grained | ✅ | ⚠️ | ⚠️ |
31
- | **Sharding (buckets)** | ✅ | ❌ | ✅ | ❌ | ❌ | ❌ |
32
- | **Custom serializers** | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ |
33
- | **Compression (Zlib)** | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ |
34
- | **Hard memory cap** | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ |
35
- | **Max value size enforcement** | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ |
36
- | **Metrics (hits, misses, evictions)** | ✅ | ⚠️ Partial | ❌ | ❌ | ❌ | ❌ |
37
- | **Fetch/update pattern** | ✅ Full | ✅ Standard | ⚠️ Partial | ✅ Basic | ✅ Basic | ✅ Basic |
38
- | **Namespacing** | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ |
39
- | **Replace (if exists)** | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ |
40
- | **Clear/delete method** | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
41
- | **Key inspection with metadata** | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ |
42
- | **Concurrency model** | ✅ | ❌ | ✅ | ❌ | ❌ | ❌ |
43
- | **Maintenance level** | ✅ | ✅ | ✅ | ⚠️ | ⚠️ | ⚠️ |
44
- | **Suitable for APIs or microservices** | ✅ | ⚠️ Limited | ✅ | ⚠️ Small apps | ⚠️ Small apps | ❌ |
45
-
46
- ---
47
-
48
- ## Design
49
-
50
- #### Internal Structure and Behaviour
51
-
52
- ![mudis_flow](design/mudis_obj.png "Mudis Internals")
53
-
54
- #### Write - Read - Eviction
55
-
56
- ![mudis_flow](design/mudis_flow.png "Write - Read - Eviction")
57
-
58
- #### Cache Key Lifecycle
59
-
60
- ![mudis_lru](design/mudis_lru.png "Mudis Cache Key Lifecycle")
61
-
62
- ---
63
-
64
- ## Features
65
-
66
- - **Thread-safe**: Uses per-bucket mutexes for high concurrency.
67
- - **Sharded**: Buckets data across multiple internal stores to minimize lock contention.
68
- - **LRU Eviction**: Automatically evicts least recently used items as memory fills up.
69
- - **Expiry Support**: Optional TTL per key with background cleanup thread.
70
- - **Compression**: Optional Zlib compression for large values.
71
- - **Metrics**: Tracks hits, misses, and evictions.
72
-
73
- ---
74
-
75
- ## Installation
76
-
77
- Add this line to your Gemfile:
78
-
79
- ```ruby
80
- gem 'mudis'
81
- ```
82
-
83
- Or install it manually:
84
-
85
- ```bash
86
- gem install mudis
87
- ```
88
-
89
- ---
90
-
91
- ## Configuration (Rails)
92
-
93
- In your Rails app, create an initializer:
94
-
95
- ```ruby
96
- # config/initializers/mudis.rb
97
- Mudis.configure do |c|
98
- c.serializer = JSON # or Marshal | Oj
99
- c.compress = true # Compress values using Zlib
100
- c.max_value_bytes = 2_000_000 # Reject values > 2MB
101
- c.hard_memory_limit = true # enforce hard memory limits
102
- c.max_bytes = 1_073_741_824 # set maximum cache size
103
- end
104
-
105
- Mudis.start_expiry_thread(interval: 60) # Cleanup every 60s
106
-
107
- at_exit do
108
- Mudis.stop_expiry_thread
109
- end
110
- ```
111
-
112
- Or with direct setters:
113
-
114
- ```ruby
115
- Mudis.serializer = JSON # or Marshal | Oj
116
- Mudis.compress = true # Compress values using Zlib
117
- Mudis.max_value_bytes = 2_000_000 # Reject values > 2MB
118
- Mudis.hard_memory_limit = true # enforce hard memory limits
119
- Mudis.max_bytes = 1_073_741_824 # set maximum cache size
120
-
121
- Mudis.start_expiry_thread(interval: 60) # Cleanup every 60s
122
-
123
- ## set at exit hook
124
- ```
125
-
126
- ---
127
-
128
- ## Basic Usage
129
-
130
- ```ruby
131
- require 'mudis'
132
-
133
- # Write a value with optional TTL
134
- Mudis.write('user:123', { name: 'Alice' }, expires_in: 600)
135
-
136
- # Read it back
137
- Mudis.read('user:123') # => { "name" => "Alice" }
138
-
139
- # Check if it exists
140
- Mudis.exists?('user:123') # => true
141
-
142
- # Atomically update
143
- Mudis.update('user:123') { |data| data.merge(age: 30) }
144
-
145
- # Delete a key
146
- Mudis.delete('user:123')
147
- ```
148
-
149
- ### Developer Utilities
150
-
151
- Mudis provides utility methods to help with test environments, console debugging, and dev tool resets.
152
-
153
- #### `Mudis.reset!`
154
- Clears the internal cache state. Including all keys, memory tracking, and metrics. Also stops the expiry thread.
155
-
156
- ```ruby
157
- Mudis.write("foo", "bar")
158
- Mudis.reset!
159
- Mudis.read("foo") # => nil
160
- ```
161
-
162
- - Wipe all buckets (@stores, @lru_nodes, @current_bytes)
163
- - Reset all metrics (:hits, :misses, :evictions, :rejected)
164
- - Stop any running background expiry thread
165
-
166
- #### `Mudis.reset_metrics!`
167
-
168
- Clears only the metric counters and preserves all cached values.
169
-
170
- ```ruby
171
- Mudis.write("key", "value")
172
- Mudis.read("key") # => "value"
173
- Mudis.metrics # => { hits: 1, misses: 0, ... }
174
-
175
- Mudis.reset_metrics!
176
- Mudis.metrics # => { hits: 0, misses: 0, ... }
177
- Mudis.read("key") # => "value" (still cached)
178
- ```
179
-
180
- #### `Mudis.least_touched`
181
-
182
- Returns the top `n` (or all) keys that have been read the fewest number of times, across all buckets. This is useful for identifying low-value cache entries that may be safe to remove or exclude from caching altogether.
183
-
184
- Each result includes the full key and its access count.
185
-
186
- ```ruby
187
- Mudis.least_touched
188
- # => [["foo", 0], ["user:42", 1], ["product:123", 2], ...]
189
-
190
- Mudis.least_touched(5)
191
- # => returns top 5 least accessed keys
192
- ```
193
-
194
- #### `Mudis.keys(namespace:)`
195
-
196
- Returns all keys for a given namespace.
197
-
198
- ```ruby
199
- Mudis.write("u1", "alpha", namespace: "users")
200
- Mudis.write("u2", "beta", namespace: "users")
201
-
202
- Mudis.keys(namespace: "users")
203
- # => ["u1", "u2"]
204
-
205
- ```
206
-
207
- #### `Mudis.clear_namespace(namespace:)`
208
-
209
- Deletes all keys within a namespace.
210
-
211
- ```ruby
212
- Mudis.clear_namespace("users")
213
- Mudis.read("u1", namespace: "users") # => nil
214
- ```
215
-
216
- ---
217
-
218
- ## Rails Service Integration
219
-
220
- For simplified or transient use in a controller, you can wrap your cache logic in a reusable thin class:
221
-
222
- ```ruby
223
- class MudisService
224
- attr_reader :cache_key, :namespace
225
-
226
- # Initialize the service with a cache key and optional namespace
227
- #
228
- # @param cache_key [String] the base key to use
229
- # @param namespace [String, nil] optional logical namespace
230
- def initialize(cache_key, namespace: nil)
231
- @cache_key = cache_key
232
- @namespace = namespace
233
- end
234
-
235
- # Write a value to the cache
236
- #
237
- # @param data [Object] the value to cache
238
- # @param expires_in [Integer, nil] optional TTL in seconds
239
- def write(data, expires_in: nil)
240
- Mudis.write(cache_key, data, expires_in: expires_in, namespace: namespace)
241
- end
242
-
243
- # Read the cached value or return default
244
- #
245
- # @param default [Object] fallback value if key is not present
246
- def read(default: nil)
247
- Mudis.read(cache_key, namespace: namespace) || default
248
- end
249
-
250
- # Update the cached value using a block
251
- #
252
- # @yieldparam current [Object] the current value
253
- # @yieldreturn [Object] the updated value
254
- def update
255
- Mudis.update(cache_key, namespace: namespace) { |current| yield(current) }
256
- end
257
-
258
- # Delete the key from cache
259
- def delete
260
- Mudis.delete(cache_key, namespace: namespace)
261
- end
262
-
263
- # Return true if the key exists in cache
264
- def exists?
265
- Mudis.exists?(cache_key, namespace: namespace)
266
- end
267
-
268
- # Fetch from cache or compute and store it
269
- #
270
- # @param expires_in [Integer, nil] optional TTL
271
- # @param force [Boolean] force recomputation
272
- # @yield return value if key is missing
273
- def fetch(expires_in: nil, force: false)
274
- Mudis.fetch(cache_key, expires_in: expires_in, force: force, namespace: namespace) do
275
- yield
276
- end
277
- end
278
-
279
- # Inspect metadata for the current key
280
- #
281
- # @return [Hash, nil] metadata including :expires_at, :created_at, :size_bytes, etc.
282
- def inspect_meta
283
- Mudis.inspect(cache_key, namespace: namespace)
284
- end
285
- end
286
-
287
- ```
288
-
289
- Use it like:
290
-
291
- ```ruby
292
- cache = MudisService.new("user:42:profile", namespace: "users")
293
-
294
- cache.write({ name: "Alice" }, expires_in: 300)
295
- cache.read # => { "name" => "Alice" }
296
- cache.exists? # => true
297
-
298
- cache.update { |data| data.merge(age: 30) }
299
- cache.fetch(expires_in: 60) { expensive_query }
300
- cache.inspect_meta # => { key: "users:user:42:profile", ... }
301
- ```
302
-
303
- ---
304
-
305
- ## Metrics
306
-
307
- Track cache effectiveness and performance:
308
-
309
- ```ruby
310
- Mudis.metrics
311
- # => {
312
- # hits: 15,
313
- # misses: 5,
314
- # evictions: 3,
315
- # rejected: 0,
316
- # total_memory: 45678,
317
- # least_touched: [
318
- # ["user:1", 0],
319
- # ["post:5", 1],
320
- # ...
321
- # ],
322
- # buckets: [
323
- # { index: 0, keys: 12, memory_bytes: 12345, lru_size: 12 },
324
- # ...
325
- # ]
326
- # }
327
-
328
- ```
329
-
330
- Optionally, return these metrics from a controller for remote analysis and monitoring if using Rails.
331
-
332
- ```ruby
333
- class MudisController < ApplicationController
334
- def metrics
335
- render json: { mudis: Mudis.metrics }
336
- end
337
-
338
- end
339
- ```
340
-
341
- ---
342
-
343
- ## Advanced Configuration
344
-
345
- | Setting | Description | Default |
346
- |--------------------------|---------------------------------------------|--------------------|
347
- | `Mudis.serializer` | JSON, Marshal, or Oj | `JSON` |
348
- | `Mudis.compress` | Enable Zlib compression | `false` |
349
- | `Mudis.max_value_bytes` | Max allowed size in bytes for a value | `nil` (no limit) |
350
- | `Mudis.buckets` | Number of cache shards | `32` |
351
- | `Mudis.start_expiry_thread` | Background TTL cleanup loop (every N sec) | Disabled by default|
352
- | `Mudis.hard_memory_limit` | Enforce hard memory limits on key size and reject if exceeded | `false`|
353
- | `Mudis.max_bytes` | Maximum allowed cache size | `1GB`|
354
- | `Mudis.max_ttl` | Set the maximum permitted TTL | `nil` (no limit) |
355
- | `Mudis.default_ttl` | Set the default TTL for fallback when none is provided | `nil` |
356
-
357
- Buckets can also be set using a `MUDIS_BUCKETS` environment variable.
358
-
359
- When setting `serializer`, be mindful of the below
360
-
361
- | Serializer | Recommended for |
362
- | ---------- | ------------------------------------- |
363
- | `Marshal` | Ruby-only apps, speed-sensitive logic |
364
- | `JSON` | Cross-language interoperability |
365
- | `Oj` | API-heavy apps using JSON at scale |
366
-
367
- ---
368
-
369
- ## Benchmarks
370
-
371
- #### Serializer(s)
372
-
373
- _100000 iterations_
374
-
375
- | Serializer | Total Time (s) | Ops/sec |
376
- |----------------|------------|----------------|
377
- | oj | 0.1342 | 745320 |
378
- | marshal | 0.3228 | 309824 |
379
- | json | 0.9035 | 110682 |
380
- | oj + zlib | 1.8050 | 55401 |
381
- | marshal + zlib | 1.8057 | 55381 |
382
- | json + zlib | 2.7949 | 35780 |
383
-
384
- > If opting for OJ, you will need to install the dependency in your project and configure as needed.
385
-
386
- #### Mudis vs Rails.cache
387
-
388
- Mudis is marginally slower than `Rails.cache` by design; it trades raw speed for control, observability, and safety.
389
-
390
- _10000 iterations of 1MB, Marshal (to match MemoryStore default), compression ON_
391
-
392
- | Operation | `Rails.cache` | `Mudis` | Delta |
393
- | --------- | ------------- | ----------- | --------- |
394
- | Write | 2.139 ms/op | 2.417 ms/op | +0.278 ms |
395
- | Read | 0.007 ms/op | 0.810 ms/op | +0.803 ms |
396
-
397
- > For context: a typical database query or HTTP call takes 10–50ms. A difference of less than 1ms per operation is negligible for most apps.
398
-
399
- #### **Why this overhead exists**
400
-
401
- Mudis includes features that MemoryStore doesn’t:
402
-
403
- | Feature | Mudis | Rails.cache (MemoryStore) |
404
- | ------------------ | ---------------------- | --------------------------- |
405
- | Per-key TTL expiry | ✅ | ⚠️ on access |
406
- | True LRU eviction | ✅ | ❌ |
407
- | Hard memory limits | ✅ | ❌ |
408
- | Value compression | ✅ | ❌ |
409
- | Thread safety | Bucket-level mutexes | ✅ Global mutex |
410
- | Observability | ✅ | ❌ |
411
- | Namespacing | ✅ | ❌ Manual scoping |
412
-
413
- It will be down to the developer to decide if a fraction of a millisecond is worth
414
-
415
- - Predictable eviction
416
- - Configurable expiry
417
- - Memory protection
418
- - Namespace scoping
419
- - Real-time metrics for hits, misses, evictions, memory usage
420
-
421
- _10000 iterations of 1MB, Marshal (to match MemoryStore default), compression OFF (to match MemoryStore default)_
422
-
423
- | Operation | `Rails.cache` | `Mudis` | Delta |
424
- | --------- | ------------- | ----------- | ------------- |
425
- | Write | 2.342 ms/op | 0.501 ms/op | **−1.841 ms** |
426
- | Read | 0.007 ms/op | 0.011 ms/op | +0.004 ms |
427
-
428
- With compression disabled, Mudis writes significanty faster and reads are virtually identical. Optimisation and configuration of Mudis will be determined by your individual needs.
429
-
430
- #### Other Benchmarks
431
-
432
- _10000 iterations of 512KB, JSON, compression OFF (to match MemoryStore default)_
433
-
434
- | Operation | `Rails.cache` | `Mudis` | Delta |
435
- | --------- | ------------- | ----------- | ------------- |
436
- | Write | 1.291 ms/op | 0.32 ms/op | **−0.971 ms** |
437
- | Read | 0.011 ms/op | 0.048 ms/op | +0.037 ms |
438
-
439
- _10000 iterations of 512KB, JSON, compression ON_
440
-
441
- | Operation | `Rails.cache` | `Mudis` | Delta |
442
- | --------- | ------------- | ----------- | ------------- |
443
- | Write | 1.11 ms/op | 1.16 ms/op | +0.05 ms |
444
- | Read | 0.07 ms/op | 0.563 ms/op | +0.493 ms |
445
-
446
- ---
447
-
448
- ## Graceful Shutdown
449
-
450
- Don’t forget to stop the expiry thread when your app exits:
451
-
452
- ```ruby
453
- at_exit { Mudis.stop_expiry_thread }
454
- ```
455
-
456
- ---
457
-
458
- ## Known Limitations
459
-
460
- - Data is **non-persistent**.
461
- - Compression introduces CPU overhead.
462
-
463
- ---
464
-
465
- ## Inter-Process Caching (IPC Mode)
466
-
467
- While Mudis was originally designed as an in-process cache, it can also operate as a shared inter-process cache when running in environments that use concurrent processes (such as Puma in cluster mode). This is achieved through a local UNIX socket server that allows all workers to access a single, centralized Mudis instance.
468
-
469
- ### Overview
470
-
471
- In IPC mode, Mudis runs as a singleton server within the master process.
472
-
473
- Each worker connects to that server through a lightweight client (`MudisClient`) using a local UNIX domain socket (default: `/tmp/mudis.sock`).
474
- All cache operations, e.g., read, write, delete, fetch, etc., are transparently proxied to the master process, which holds the authoritative cache state.
475
-
476
- This design allows multiple workers to share the same cache without duplicating memory or losing synchronization, while retaining Mudis’ performance, configurability, and thread safety.
477
-
478
- | **Benefit** | **Description** |
479
- | --------------------------------- | ---------------------------------------------------------------------------------------- |
480
- | **Shared Cache Across Processes** | All Puma workers share one Mudis instance via IPC. |
481
- | **Zero External Dependencies** | No Redis, Memcached, or separate daemon required. |
482
- | **Memory Efficient** | Cache data stored only once, not duplicated per worker. |
483
- | **Full Feature Support** | All Mudis features (TTL, compression, metrics, etc.) work transparently. |
484
- | **Safe & Local** | Communication is limited to the host system’s UNIX socket, ensuring isolation and speed. |
485
-
486
- ![mudis_ipc](design/mudis_ipc.png "Mudis IPC")
487
-
488
- ### Setup (Puma / Rails)
489
-
490
- Enable IPC mode by adding the following to your Puma configuration:
491
-
492
- ```ruby
493
- # config/puma.rb
494
- preload_app!
495
-
496
- before_fork do
497
- require "mudis"
498
- require "mudis_server"
499
-
500
- # Your typical Mudis configuration (previously in a Rails initializer)
501
- Mudis.configure do |c|
502
- c.serializer = JSON
503
- c.compress = true
504
- c.max_value_bytes = 2_000_000
505
- c.hard_memory_limit = true
506
- c.max_bytes = 1_073_741_824
507
- end
508
-
509
- Mudis.start_expiry_thread(interval: 60)
510
- MudisServer.start!
511
-
512
- at_exit { Mudis.stop_expiry_thread }
513
- end
514
-
515
- on_worker_boot do
516
- require "mudis_client"
517
- $mudis = MudisClient.new
518
- end
519
- ```
520
-
521
- Adding this Proxy to initializers allows seamless use of the API as documented.
522
-
523
- ```ruby
524
- # config/initializers/mudis_proxy.rb
525
- unless defined?(MudisServer)
526
- class Mudis
527
- def self.read(*a, **k) = $mudis.read(*a, **k)
528
- def self.write(*a, **k) = $mudis.write(*a, **k)
529
- def self.delete(*a, **k) = $mudis.delete(*a, **k)
530
- def self.fetch(*a, **k, &b) = $mudis.fetch(*a, **k, &b)
531
- def self.metrics = $mudis.metrics
532
- def self.reset_metrics! = $mudis.reset_metrics!
533
- def self.reset! = $mudis.reset!
534
- end
535
-
536
- end
537
- ```
538
-
539
- **Use IPC mode when:**
540
-
541
- - Running Rails or Rack apps under Puma cluster or multi-process background job workers.
542
- - You need cache consistency and memory efficiency without standing up Redis.
543
- - You want to preserve Mudis’s observability, configurability, and in-process simplicity at a larger scale.
544
-
545
- ---
546
-
547
- ## Create a Mudis Server
548
-
549
- ### Minimal Setup
550
-
551
- - Create a new Rails API app:
552
-
553
- ```bash
554
- rails new mudis-server --api
555
- cd mudis-server
556
- ```
557
-
558
- - Add mudis to your Gemfile
559
- - Create Initializer: `config/initializers/mudis.rb`
560
- - Define routes
561
-
562
- ```ruby
563
- Rails.application.routes.draw do
564
- get "/cache/:key", to: "cache#show"
565
- post "/cache/:key", to: "cache#write"
566
- delete "/cache/:key", to: "cache#delete"
567
- get "/metrics", to: "cache#metrics"
568
- end
569
- ```
570
-
571
- - Create a `cache_controller` (with optional per caller/consumer namespace)
572
-
573
- ```ruby
574
- class CacheController < ApplicationController
575
-
576
- def show
577
- key = params[:key]
578
- ns = params[:namespace]
579
-
580
- value = Mudis.read(key, namespace: ns)
581
- if value.nil?
582
- render json: { error: "not found" }, status: :not_found
583
- else
584
- render json: { value: value }
585
- end
586
- end
587
-
588
- def write
589
- key = params[:key]
590
- ns = params[:namespace]
591
- val = params[:value]
592
- ttl = params[:expires_in]&.to_i
593
-
594
- Mudis.write(key, val, expires_in: ttl, namespace: ns)
595
- render json: { status: "written", key: key }
596
- end
597
-
598
- def delete
599
- key = params[:key]
600
- ns = params[:namespace]
601
-
602
- Mudis.delete(key, namespace: ns)
603
- render json: { status: "deleted" }
604
- end
605
-
606
- def metrics
607
- render json: Mudis.metrics
608
- end
609
- end
610
- ```
611
-
612
- - Test it
613
-
614
- ```bash
615
- curl http://localhost:3000/cache/foo
616
- curl -X POST http://localhost:3000/cache/foo -d 'value=bar&expires_in=60'
617
- curl http://localhost:3000/metrics
618
-
619
- # Write with namespace
620
- curl -X POST "http://localhost:3000/cache/foo?namespace=orders" \
621
- -d "value=123&expires_in=60"
622
-
623
- # Read from namespace
624
- curl "http://localhost:3000/cache/foo?namespace=orders"
625
-
626
- # Delete from namespace
627
- curl -X DELETE "http://localhost:3000/cache/foo?namespace=orders"
628
-
629
- ```
630
-
631
- ---
632
-
633
- ## Project Philosophy
634
-
635
- Mudis is intended to be a minimal, thread-safe, in-memory cache designed specifically for Ruby applications. It focuses on:
636
-
637
- - In-process caching
638
- - Fine-grained memory and namespace control
639
- - Observability and testing friendliness
640
- - Minimal external dependencies
641
- - Configurability without complexity
642
-
643
- The primary use cases are:
644
-
645
- - Per-service application caches
646
- - Short-lived local caching inside background jobs or API layers
647
-
648
- Mudis is not intended to be a general-purpose, distributed caching platform. You are, however, welcome to build on top of Mudis if you want its functionality in such projects. E.g.,
649
-
650
- - mudis-server – expose Mudis via HTTP, web sockets, hooks, etc
651
- - mudis-broker – distributed key routing layer for coordinating multiple Mudis nodes
652
- - mudis-activejob-store – adapter for using Mudis in job queues or retry buffers
653
-
654
- ---
655
-
656
- ## Roadmap
657
-
658
- #### API Enhancements
659
-
660
- - [x] bulk_read(keys, namespace:): Batch retrieval of multiple keys with a single method call
661
-
662
- #### Safety & Policy Controls
663
-
664
- - [x] max_ttl: Enforce a global upper bound on expires_in to prevent excessively long-lived keys
665
- - [x] default_ttl: Provide a fallback TTL when one is not specified
666
-
667
- #### Debugging
668
-
669
- - [x] clear_namespace(namespace): Remove all keys in a namespace in one call
670
-
671
- #### Refactor Mudis
672
-
673
- - [ ] Review Mudis for improved readability and reduce complexity in top-level functions
674
- - [ ] Enhanced guards
675
- - [ ] Review for functionality gaps and enhance as needed
676
-
677
- ---
678
-
679
- ## License
680
-
681
- MIT License © kiebor81
682
-
683
- ---
684
-
685
- ## Contributing
686
-
687
- See [contributor's guide](CONTRIBUTING.md)
688
-
689
- ---
690
-
691
- ## Contact
692
-
693
- For issues, suggestions, or feedback, please open a GitHub issue
694
-
695
- ---
1
+ ![mudis_signet](design/mudis.png "Mudis")
2
+
3
+ [![Gem Version](https://badge.fury.io/rb/mudis.svg?icon=si%3Arubygems&refresh=1&cachebust=0)](https://badge.fury.io/rb/mudis)
4
+ [![License: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](LICENSE)
5
+
6
+ **Mudis** is a fast, thread-safe, in-memory, sharded LRU (Least Recently Used) cache for Ruby applications. Inspired by Redis, it provides value serialization, optional compression, per-key expiry, and metric tracking in a lightweight, dependency-free package that lives inside your Ruby process.
7
+
8
+ It’s ideal for scenarios where performance and process-local caching are critical, and where a full Redis setup is overkill or otherwise not possible/desirable.
9
+
10
+ Alternatively, Mudis can be upscaled with higher sharding and resources in a dedicated Rails app to provide a [Mudis Web Cache Server](#create-a-mudis-web-cache-server).
11
+
12
+ Mudis also works naturally in Hanami because it’s a pure Ruby in-memory cache. Whether used as a singleton within a process or via IPC in cluster mode, it preserves Hanami’s lightweight and modular architecture.
13
+
14
+ ---
15
+
16
+ ## Table of Contents
17
+
18
+ - [Why Another Caching Gem?](#why-another-caching-gem)
19
+ - [Similar Gems](#similar-gems)
20
+ - [Feature / Function Comparison](#feature--function-comparison)
21
+ - [Design](#design)
22
+ - [Internal Structure and Behaviour](#internal-structure-and-behaviour)
23
+ - [Write - Read - Eviction](#write---read---eviction)
24
+ - [Cache Key Lifecycle](#cache-key-lifecycle)
25
+ - [Features](#features)
26
+ - [Installation](#installation)
27
+ - [Configuration (Rails)](#configuration-rails)
28
+ - [Configuration (Hanami)](#configuration-hanami)
29
+ - [Basic Usage](#basic-usage)
30
+ - [Developer Utilities](#developer-utilities)
31
+ - [`Mudis.reset!`](#mudisreset)
32
+ - [`Mudis.reset_metrics!`](#mudisreset_metrics)
33
+ - [`Mudis.least_touched`](#mudisleast_touched)
34
+ - [`Mudis.keys(namespace:)`](#mudiskeysnamespace)
35
+ - [`Mudis.clear_namespace(namespace:)`](#mudisclear_namespacenamespace)
36
+ - [Rails Service Integration](#rails-service-integration)
37
+ - [Metrics](#metrics)
38
+ - [Advanced Configuration](#advanced-configuration)
39
+ - [Benchmarks](#benchmarks)
40
+ - [Graceful Shutdown](#graceful-shutdown)
41
+ - [Known Limitations](#known-limitations)
42
+ - [Inter-Process Caching (IPC Mode)](#inter-process-caching-ipc-mode)
43
+ - [Overview](#overview)
44
+ - [Setup (Puma)](#setup-puma)
45
+ - [Create a Mudis Web Cache Server](#create-a-mudis-web-cache-server)
46
+ - [Minimal Setup](#minimal-setup)
47
+ - [Project Philosophy](#project-philosophy)
48
+ - [Roadmap](#roadmap)
49
+
50
+ ---
51
+
52
+ ### Why another Caching Gem?
53
+
54
+ There are plenty out there, in various states of maintenance and in many shapes and sizes. So why on earth do we need another? I needed a drop-in replacement for Kredis, and the reason I was interested in using Kredis was for the simplified API and keyed management it gave me in extension to Redis. But what I didn't really need was Redis. I needed an observable, fast, simple, easy to use, flexible and highly configurable, thread-safe and high performant caching system which didn't require too many dependencies or standing up additional services. So, Mudis was born. In its most rudimentary state it was extremely useful in my project, which was an API gateway connecting into mutliple micro-services and a wide selection of APIs. The majority of the data was cold and produced by repeat expensive queries across several domains. Mudis allowed for me to minimize the footprint of the gateway, and improve end user experience, and increase performance. So, yeah, there's a lot of these gems out there, but none which really met all my needs. I decided to provide Mudis for anyone else. If you use it, I'd be interested to know how and whether you got any benefit.
55
+
56
+ #### Similar Gems
57
+
58
+ - [FastCache](https://github.com/swoop-inc/fast_cache)
59
+ - [EasyCache](https://github.com/malvads/easycache)
60
+ - [MiniCache](https://github.com/derrickreimer/mini_cache)
61
+ - [Zache](https://github.com/yegor256/zache)
62
+
63
+ #### Feature / Function Comparison
64
+
65
+ | **Feature** | **Mudis** | **MemoryStore** (`Rails.cache`) | **FastCache** | **Zache** | **EasyCache** | **MiniCache** |
66
+ | -------------------------------------- | ---------------- | ------------------------------- | -------------- | ------------- | ------------- | -------------- |
67
+ | **LRU eviction strategy** | Per-bucket | Global | Global | ❌ | ❌ | ✅ Simplistic |
68
+ | **TTL expiry support** | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
69
+ | **Background expiry cleanup thread** | ✅ | (only on access) | ❌ | ✅ | ❌ | ❌ |
70
+ | **Thread safety** | Bucketed | ⚠️ Global lock | ✅ Fine-grained | ✅ | ⚠️ | ⚠️ |
71
+ | **Sharding (buckets)** | ✅ | ❌ | ✅ | ❌ | ❌ | ❌ |
72
+ | **Custom serializers** | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ |
73
+ | **Compression (Zlib)** | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ |
74
+ | **Hard memory cap** | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ |
75
+ | **Max value size enforcement** | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ |
76
+ | **Metrics (hits, misses, evictions)** | ✅ | ⚠️ Partial | ❌ | ❌ | ❌ | ❌ |
77
+ | **Fetch/update pattern** | Full | ✅ Standard | ⚠️ Partial | ✅ Basic | ✅ Basic | ✅ Basic |
78
+ | **Namespacing** | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ |
79
+ | **Replace (if exists)** | ✅ | ✅ | ❌ | ❌ | ❌ | ❌ |
80
+ | **Clear/delete method** | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
81
+ | **Key inspection with metadata** | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ |
82
+ | **Concurrency model** | ✅ | ❌ | ✅ | ❌ | ❌ | ❌ |
83
+ | **Maintenance level** | ✅ | ✅ | ✅ | ⚠️ | ⚠️ | ⚠️ |
84
+ | **Suitable for APIs or microservices** | ✅ | ⚠️ Limited | ✅ | ⚠️ Small apps | ⚠️ Small apps | ❌ |
85
+ | **Inter-process Caching** | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ |
86
+
87
+ ---
88
+
89
+ ## Design
90
+
91
+ #### Internal Structure and Behaviour
92
+
93
+ ![mudis_flow](design/mudis_obj.png "Mudis Internals")
94
+
95
+ #### Write - Read - Eviction
96
+
97
+ ![mudis_flow](design/mudis_flow.png "Write - Read - Eviction")
98
+
99
+ #### Cache Key Lifecycle
100
+
101
+ ![mudis_lru](design/mudis_lru.png "Mudis Cache Key Lifecycle")
102
+
103
+ ---
104
+
105
+ ## Features
106
+
107
+ - **Thread-safe**: Uses per-bucket mutexes for high concurrency.
108
+ - **Sharded**: Buckets data across multiple internal stores to minimize lock contention.
109
+ - **LRU Eviction**: Automatically evicts least recently used items as memory fills up.
110
+ - **Expiry Support**: Optional TTL per key with background cleanup thread.
111
+ - **Compression**: Optional Zlib compression for large values.
112
+ - **Metrics**: Tracks hits, misses, and evictions.
113
+ - **IPC Mode**: Shared cross-process caching for multi-process aplications.
114
+
115
+ ---
116
+
117
+ ## Installation
118
+
119
+ Add this line to your Gemfile:
120
+
121
+ ```ruby
122
+ gem 'mudis'
123
+ ```
124
+
125
+ Or install it manually:
126
+
127
+ ```bash
128
+ gem install mudis
129
+ ```
130
+
131
+ ---
132
+
133
+ ## Configuration (Rails)
134
+
135
+ In your Rails app, create an initializer:
136
+
137
+ ```ruby
138
+ # config/initializers/mudis.rb
139
+ Mudis.configure do |c|
140
+ c.serializer = JSON # or Marshal | Oj
141
+ c.compress = true # Compress values using Zlib
142
+ c.max_value_bytes = 2_000_000 # Reject values > 2MB
143
+ c.hard_memory_limit = true # enforce hard memory limits
144
+ c.max_bytes = 1_073_741_824 # set maximum cache size
145
+ end
146
+
147
+ Mudis.start_expiry_thread(interval: 60) # Cleanup every 60s
148
+
149
+ at_exit do
150
+ Mudis.stop_expiry_thread
151
+ end
152
+ ```
153
+
154
+ Or with direct setters:
155
+
156
+ ```ruby
157
+ Mudis.serializer = JSON # or Marshal | Oj
158
+ Mudis.compress = true # Compress values using Zlib
159
+ Mudis.max_value_bytes = 2_000_000 # Reject values > 2MB
160
+ Mudis.hard_memory_limit = true # enforce hard memory limits
161
+ Mudis.max_bytes = 1_073_741_824 # set maximum cache size
162
+
163
+ Mudis.start_expiry_thread(interval: 60) # Cleanup every 60s
164
+
165
+ ## set at exit hook
166
+ ```
167
+
168
+ ---
169
+
170
+ ## Configuration (Hanami)
171
+
172
+ Mudis integrates seamlessly with [Hanami](https://hanamirb.org) applications. It provides the same configuration flexibility and thread-safe caching capabilities as in Rails, with minimal setup differences.
173
+
174
+ Create a boot file:
175
+
176
+ ```ruby
177
+ # config/boot/mudis.rb
178
+ require "mudis"
179
+
180
+ Mudis.configure do |c|
181
+ c.serializer = JSON
182
+ c.compress = true
183
+ c.max_value_bytes = 2_000_000
184
+ c.hard_memory_limit = true
185
+ c.max_bytes = 1_073_741_824
186
+ end
187
+
188
+ Mudis.start_expiry_thread(interval: 60)
189
+
190
+ at_exit { Mudis.stop_expiry_thread }
191
+ ```
192
+
193
+ Then require it from `config/app.rb`:
194
+
195
+ ```ruby
196
+ # config/app.rb
197
+ require_relative "./boot/mudis"
198
+
199
+ module MyApp
200
+ class App < Hanami::App
201
+ end
202
+ end
203
+ ```
204
+
205
+ This ensures Mudis is initialized and available globally throughout your Hanami application in the same as it would in Rails.
206
+
207
+ ---
208
+
209
+ ### Using Mudis with Hanami’s Dependency Container
210
+
211
+ You can register Mudis as a dependency in the Hanami container to access it via dependency injection:
212
+
213
+ ```ruby
214
+ # config/container.rb
215
+ require "mudis"
216
+
217
+ MyApp::Container.register(:cache, Mudis)
218
+ ```
219
+
220
+ Then use it inside your actions, repositories, or services:
221
+
222
+ ```ruby
223
+ # apps/main/actions/users/show.rb
224
+ module Main
225
+ module Actions
226
+ module Users
227
+ class Show < Main::Action
228
+ include Deps[cache: "cache"]
229
+
230
+ def handle(req, res)
231
+ res[:user] = cache.fetch("user:#{req.params[:id]}", expires_in: 60) do
232
+ UserRepo.new.find(req.params[:id])
233
+ end
234
+ end
235
+ end
236
+ end
237
+ end
238
+ end
239
+ ```
240
+
241
+ ---
242
+
243
+ ## Basic Usage
244
+
245
+ ```ruby
246
+ require 'mudis'
247
+
248
+ # Write a value with optional TTL
249
+ Mudis.write('user:123', { name: 'Alice' }, expires_in: 600)
250
+
251
+ # Read it back
252
+ Mudis.read('user:123') # => { "name" => "Alice" }
253
+
254
+ # Check if it exists
255
+ Mudis.exists?('user:123') # => true
256
+
257
+ # Atomically update
258
+ Mudis.update('user:123') { |data| data.merge(age: 30) }
259
+
260
+ # Delete a key
261
+ Mudis.delete('user:123')
262
+ ```
263
+
264
+ ### Developer Utilities
265
+
266
+ Mudis provides utility methods to help with test environments, console debugging, and dev tool resets.
267
+
268
+ #### `Mudis.reset!`
269
+ Clears the internal cache state. Including all keys, memory tracking, and metrics. Also stops the expiry thread.
270
+
271
+ ```ruby
272
+ Mudis.write("foo", "bar")
273
+ Mudis.reset!
274
+ Mudis.read("foo") # => nil
275
+ ```
276
+
277
+ - Wipe all buckets (@stores, @lru_nodes, @current_bytes)
278
+ - Reset all metrics (:hits, :misses, :evictions, :rejected)
279
+ - Stop any running background expiry thread
280
+
281
+ #### `Mudis.reset_metrics!`
282
+
283
+ Clears only the metric counters and preserves all cached values.
284
+
285
+ ```ruby
286
+ Mudis.write("key", "value")
287
+ Mudis.read("key") # => "value"
288
+ Mudis.metrics # => { hits: 1, misses: 0, ... }
289
+
290
+ Mudis.reset_metrics!
291
+ Mudis.metrics # => { hits: 0, misses: 0, ... }
292
+ Mudis.read("key") # => "value" (still cached)
293
+ ```
294
+
295
+ #### `Mudis.least_touched`
296
+
297
+ Returns the top `n` (or all) keys that have been read the fewest number of times, across all buckets. This is useful for identifying low-value cache entries that may be safe to remove or exclude from caching altogether.
298
+
299
+ Each result includes the full key and its access count.
300
+
301
+ ```ruby
302
+ Mudis.least_touched
303
+ # => [["foo", 0], ["user:42", 1], ["product:123", 2], ...]
304
+
305
+ Mudis.least_touched(5)
306
+ # => returns top 5 least accessed keys
307
+ ```
308
+
309
+ #### `Mudis.keys(namespace:)`
310
+
311
+ Returns all keys for a given namespace.
312
+
313
+ ```ruby
314
+ Mudis.write("u1", "alpha", namespace: "users")
315
+ Mudis.write("u2", "beta", namespace: "users")
316
+
317
+ Mudis.keys(namespace: "users")
318
+ # => ["u1", "u2"]
319
+
320
+ ```
321
+
322
+ #### `Mudis.clear_namespace(namespace:)`
323
+
324
+ Deletes all keys within a namespace.
325
+
326
+ ```ruby
327
+ Mudis.clear_namespace("users")
328
+ Mudis.read("u1", namespace: "users") # => nil
329
+ ```
330
+
331
+ ---
332
+
333
+ ## Rails Service Integration
334
+
335
+ For simplified or transient use in a controller, you can wrap your cache logic in a reusable thin class:
336
+
337
+ ```ruby
338
+ class MudisService
339
+ attr_reader :cache_key, :namespace
340
+
341
+ # Initialize the service with a cache key and optional namespace
342
+ #
343
+ # @param cache_key [String] the base key to use
344
+ # @param namespace [String, nil] optional logical namespace
345
+ def initialize(cache_key, namespace: nil)
346
+ @cache_key = cache_key
347
+ @namespace = namespace
348
+ end
349
+
350
+ # Write a value to the cache
351
+ #
352
+ # @param data [Object] the value to cache
353
+ # @param expires_in [Integer, nil] optional TTL in seconds
354
+ def write(data, expires_in: nil)
355
+ Mudis.write(cache_key, data, expires_in: expires_in, namespace: namespace)
356
+ end
357
+
358
+ # Read the cached value or return default
359
+ #
360
+ # @param default [Object] fallback value if key is not present
361
+ def read(default: nil)
362
+ Mudis.read(cache_key, namespace: namespace) || default
363
+ end
364
+
365
+ # Update the cached value using a block
366
+ #
367
+ # @yieldparam current [Object] the current value
368
+ # @yieldreturn [Object] the updated value
369
+ def update
370
+ Mudis.update(cache_key, namespace: namespace) { |current| yield(current) }
371
+ end
372
+
373
+ # Delete the key from cache
374
+ def delete
375
+ Mudis.delete(cache_key, namespace: namespace)
376
+ end
377
+
378
+ # Return true if the key exists in cache
379
+ def exists?
380
+ Mudis.exists?(cache_key, namespace: namespace)
381
+ end
382
+
383
+ # Fetch from cache or compute and store it
384
+ #
385
+ # @param expires_in [Integer, nil] optional TTL
386
+ # @param force [Boolean] force recomputation
387
+ # @yield return value if key is missing
388
+ def fetch(expires_in: nil, force: false)
389
+ Mudis.fetch(cache_key, expires_in: expires_in, force: force, namespace: namespace) do
390
+ yield
391
+ end
392
+ end
393
+
394
+ # Inspect metadata for the current key
395
+ #
396
+ # @return [Hash, nil] metadata including :expires_at, :created_at, :size_bytes, etc.
397
+ def inspect_meta
398
+ Mudis.inspect(cache_key, namespace: namespace)
399
+ end
400
+ end
401
+
402
+ ```
403
+
404
+ Use it like:
405
+
406
+ ```ruby
407
+ cache = MudisService.new("user:42:profile", namespace: "users")
408
+
409
+ cache.write({ name: "Alice" }, expires_in: 300)
410
+ cache.read # => { "name" => "Alice" }
411
+ cache.exists? # => true
412
+
413
+ cache.update { |data| data.merge(age: 30) }
414
+ cache.fetch(expires_in: 60) { expensive_query }
415
+ cache.inspect_meta # => { key: "users:user:42:profile", ... }
416
+ ```
417
+
418
+ *This pattern can also be applied in Hanami services using the registered Mudis dependency*
419
+
420
+ ---
421
+
422
+ ## Metrics
423
+
424
+ Track cache effectiveness and performance:
425
+
426
+ ```ruby
427
+ Mudis.metrics
428
+ # => {
429
+ # hits: 15,
430
+ # misses: 5,
431
+ # evictions: 3,
432
+ # rejected: 0,
433
+ # total_memory: 45678,
434
+ # least_touched: [
435
+ # ["user:1", 0],
436
+ # ["post:5", 1],
437
+ # ...
438
+ # ],
439
+ # buckets: [
440
+ # { index: 0, keys: 12, memory_bytes: 12345, lru_size: 12 },
441
+ # ...
442
+ # ]
443
+ # }
444
+
445
+ ```
446
+
447
+ Optionally, expose Mudis metrics from a controller or action for remote analysis and monitoring.
448
+
449
+ **Rails:**
450
+
451
+ ```ruby
452
+ class MudisController < ApplicationController
453
+ def metrics
454
+ render json: { mudis: Mudis.metrics }
455
+ end
456
+
457
+ end
458
+ ```
459
+
460
+ **Hanami:**
461
+
462
+ *Mudis Registered in the container*
463
+
464
+ ```ruby
465
+ # apps/main/actions/metrics/show.rb
466
+ module Main::Actions::Metrics
467
+ class Show < Main::Action
468
+ include Deps[cache: "cache"]
469
+
470
+ def handle(*, res)
471
+ res.format = :json
472
+ res.body = { mudis: cache.metrics }.to_json
473
+ end
474
+ end
475
+ end
476
+ ```
477
+
478
+ *Mudis not registered in the container*
479
+
480
+ ```ruby
481
+ # apps/main/actions/metrics/show.rb
482
+ module Main::Actions::Metrics
483
+ class Show < Main::Action
484
+ def handle(*, res)
485
+ res.format = :json
486
+ res.body = { mudis: Mudis.metrics }.to_json
487
+ end
488
+ end
489
+ end
490
+ ```
491
+
492
+ ```ruby
493
+ # config/routes.rb
494
+ module Main
495
+ class Routes < Hanami::Routes
496
+ root { "OK" }
497
+
498
+ get "/metrics", to: "metrics.show"
499
+ end
500
+ end
501
+ ```
502
+
503
+ ---
504
+
505
+ ## Advanced Configuration
506
+
507
+ | Setting | Description | Default |
508
+ |--------------------------|---------------------------------------------|--------------------|
509
+ | `Mudis.serializer` | JSON, Marshal, or Oj | `JSON` |
510
+ | `Mudis.compress` | Enable Zlib compression | `false` |
511
+ | `Mudis.max_value_bytes` | Max allowed size in bytes for a value | `nil` (no limit) |
512
+ | `Mudis.buckets` | Number of cache shards | `32` |
513
+ | `Mudis.start_expiry_thread` | Background TTL cleanup loop (every N sec) | Disabled by default|
514
+ | `Mudis.hard_memory_limit` | Enforce hard memory limits on key size and reject if exceeded | `false`|
515
+ | `Mudis.max_bytes` | Maximum allowed cache size | `1GB`|
516
+ | `Mudis.max_ttl` | Set the maximum permitted TTL | `nil` (no limit) |
517
+ | `Mudis.default_ttl` | Set the default TTL for fallback when none is provided | `nil` |
518
+
519
+ Buckets can also be set using a `MUDIS_BUCKETS` environment variable.
520
+
521
+ When setting `serializer`, be mindful of the below
522
+
523
+ | Serializer | Recommended for |
524
+ | ---------- | ------------------------------------- |
525
+ | `Marshal` | Ruby-only apps, speed-sensitive logic |
526
+ | `JSON` | Cross-language interoperability |
527
+ | `Oj` | API-heavy apps using JSON at scale |
528
+
529
+ ---
530
+
531
+ ## Benchmarks
532
+
533
+ #### Serializer(s)
534
+
535
+ _100000 iterations_
536
+
537
+ | Serializer | Total Time (s) | Ops/sec |
538
+ |----------------|------------|----------------|
539
+ | oj | 0.1342 | 745320 |
540
+ | marshal | 0.3228 | 309824 |
541
+ | json | 0.9035 | 110682 |
542
+ | oj + zlib | 1.8050 | 55401 |
543
+ | marshal + zlib | 1.8057 | 55381 |
544
+ | json + zlib | 2.7949 | 35780 |
545
+
546
+ > If opting for OJ, you will need to install the dependency in your project and configure as needed.
547
+
548
+ #### Mudis vs Rails.cache
549
+
550
+ Mudis is marginally slower than `Rails.cache` by design; it trades raw speed for control, observability, and safety.
551
+
552
+ _10000 iterations of 1MB, Marshal (to match MemoryStore default), compression ON_
553
+
554
+ | Operation | `Rails.cache` | `Mudis` | Delta |
555
+ | --------- | ------------- | ----------- | --------- |
556
+ | Write | 2.139 ms/op | 2.417 ms/op | +0.278 ms |
557
+ | Read | 0.007 ms/op | 0.810 ms/op | +0.803 ms |
558
+
559
+ > For context: a typical database query or HTTP call takes 10–50ms. A difference of less than 1ms per operation is negligible for most apps.
560
+
561
+ #### **Why this overhead exists**
562
+
563
+ Mudis includes features that MemoryStore doesn’t:
564
+
565
+ | Feature | Mudis | Rails.cache (MemoryStore) |
566
+ | ------------------ | ---------------------- | --------------------------- |
567
+ | Per-key TTL expiry | ✅ | ⚠️ on access |
568
+ | True LRU eviction | ✅ | ❌ |
569
+ | Hard memory limits | ✅ | ❌ |
570
+ | Value compression | ✅ | ❌ |
571
+ | Thread safety | Bucket-level mutexes | Global mutex |
572
+ | Observability | ✅ | ❌ |
573
+ | Namespacing | ✅ | ❌ Manual scoping |
574
+ | IPC Aware | ✅ (if enabled) | ❌ Requires manual configuration and additional gems |
575
+
576
+ It will be down to the developer to decide if a fraction of a millisecond is worth
577
+
578
+ - Predictable eviction
579
+ - Configurable expiry
580
+ - Memory protection
581
+ - Namespace scoping
582
+ - Real-time metrics for hits, misses, evictions, memory usage
583
+
584
+ _10000 iterations of 1MB, Marshal (to match MemoryStore default), compression OFF (to match MemoryStore default)_
585
+
586
+ | Operation | `Rails.cache` | `Mudis` | Delta |
587
+ | --------- | ------------- | ----------- | ------------- |
588
+ | Write | 2.342 ms/op | 0.501 ms/op | **−1.841 ms** |
589
+ | Read | 0.007 ms/op | 0.011 ms/op | +0.004 ms |
590
+
591
+ With compression disabled, Mudis writes significanty faster and reads are virtually identical. Optimisation and configuration of Mudis will be determined by your individual needs.
592
+
593
+ #### Other Benchmarks
594
+
595
+ _10000 iterations of 512KB, JSON, compression OFF (to match MemoryStore default)_
596
+
597
+ | Operation | `Rails.cache` | `Mudis` | Delta |
598
+ | --------- | ------------- | ----------- | ------------- |
599
+ | Write | 1.291 ms/op | 0.32 ms/op | **−0.971 ms** |
600
+ | Read | 0.011 ms/op | 0.048 ms/op | +0.037 ms |
601
+
602
+ _10000 iterations of 512KB, JSON, compression ON_
603
+
604
+ | Operation | `Rails.cache` | `Mudis` | Delta |
605
+ | --------- | ------------- | ----------- | ------------- |
606
+ | Write | 1.11 ms/op | 1.16 ms/op | +0.05 ms |
607
+ | Read | 0.07 ms/op | 0.563 ms/op | +0.493 ms |
608
+
609
+ ---
610
+
611
+ ## Graceful Shutdown
612
+
613
+ Don’t forget to stop the expiry thread when your app exits:
614
+
615
+ ```ruby
616
+ at_exit { Mudis.stop_expiry_thread }
617
+ ```
618
+
619
+ ---
620
+
621
+ ## Known Limitations
622
+
623
+ - Data is **non-persistent**.
624
+ - Compression introduces CPU overhead.
625
+
626
+ ---
627
+
628
+ ## Inter-Process Caching (IPC Mode)
629
+
630
+ While Mudis was originally designed as an in-process cache, it can also operate as a shared inter-process cache when running in environments that use concurrent processes (such as Puma in cluster mode). This is achieved through a local UNIX socket server that allows all workers to access a single, centralized Mudis instance.
631
+
632
+ ### Overview
633
+
634
+ In IPC mode, Mudis runs as a singleton server within the master process.
635
+
636
+ Each worker connects to that server through a lightweight client (`MudisClient`) using a local UNIX domain socket (default: `/tmp/mudis.sock`).
637
+ All cache operations, e.g., read, write, delete, fetch, etc., are transparently proxied to the master process, which holds the authoritative cache state.
638
+
639
+ This design allows multiple workers to share the same cache without duplicating memory or losing synchronization, while retaining Mudis’ performance, configurability, and thread safety.
640
+
641
+ | **Benefit** | **Description** |
642
+ | --------------------------------- | ---------------------------------------------------------------------------------------- |
643
+ | **Shared Cache Across Processes** | All Puma workers share one Mudis instance via IPC. |
644
+ | **Zero External Dependencies** | No Redis, Memcached, or separate daemon required. |
645
+ | **Memory Efficient** | Cache data stored only once, not duplicated per worker. |
646
+ | **Full Feature Support** | All Mudis features (TTL, compression, metrics, etc.) work transparently. |
647
+ | **Safe & Local** | Communication is limited to the host system’s UNIX socket, ensuring isolation and speed. |
648
+
649
+ ![mudis_ipc](design/mudis_ipc.png "Mudis IPC")
650
+
651
+ ### Setup (Puma)
652
+
653
+ Enable IPC mode by adding the following to your Puma configuration:
654
+
655
+ ```ruby
656
+ # config/puma.rb
657
+ preload_app!
658
+
659
+ before_fork do
660
+ require "mudis"
661
+ require "mudis_server"
662
+
663
+ # typical Mudis configuration
664
+ Mudis.configure do |c|
665
+ c.serializer = JSON
666
+ c.compress = true
667
+ c.max_value_bytes = 2_000_000
668
+ c.hard_memory_limit = true
669
+ c.max_bytes = 1_073_741_824
670
+ end
671
+
672
+ Mudis.start_expiry_thread(interval: 60)
673
+ MudisServer.start!
674
+
675
+ at_exit { Mudis.stop_expiry_thread }
676
+ end
677
+
678
+ on_worker_boot do
679
+ require "mudis_client"
680
+ $mudis = MudisClient.new
681
+ require "mudis_proxy" # optionally require the default mudis proxy to invisibly patch Mudis
682
+ end
683
+ ```
684
+
685
+ For more granular control over Mudis, adding the Proxy manually to `initializers` (Rails) or `boot` (Hanami) allows seamless use of the API as documented.
686
+
687
+ **Do not require `mudis_proxy` if following this method**
688
+
689
+ ```ruby
690
+ # config/<<initializers|boot>>/mudis_proxy.rb
691
+ unless defined?(MudisServer)
692
+ class Mudis
693
+ def self.read(*a, **k) = $mudis.read(*a, **k)
694
+ def self.write(*a, **k) = $mudis.write(*a, **k)
695
+ def self.delete(*a, **k) = $mudis.delete(*a, **k)
696
+ def self.fetch(*a, **k, &b) = $mudis.fetch(*a, **k, &b)
697
+ def self.metrics = $mudis.metrics
698
+ def self.reset_metrics! = $mudis.reset_metrics!
699
+ def self.reset! = $mudis.reset!
700
+ end
701
+
702
+ end
703
+ ```
704
+
705
+ **Use IPC mode when:**
706
+
707
+ - Running Rails or Rack apps under Puma cluster or multi-process background job workers.
708
+ - You need cache consistency and memory efficiency without standing up Redis.
709
+ - You want to preserve Mudis’s observability, configurability, and in-process simplicity at a larger scale.
710
+
711
+ ---
712
+
713
+ ## Create a Mudis Web Cache Server
714
+
715
+ ### Minimal Setup
716
+
717
+ - Create a new Rails API app:
718
+
719
+ ```bash
720
+ rails new mudis-server --api
721
+ cd mudis-server
722
+ ```
723
+
724
+ - Add mudis to your Gemfile
725
+ - Create Initializer: `config/initializers/mudis.rb`
726
+ - Define routes
727
+
728
+ ```ruby
729
+ Rails.application.routes.draw do
730
+ get "/cache/:key", to: "cache#show"
731
+ post "/cache/:key", to: "cache#write"
732
+ delete "/cache/:key", to: "cache#delete"
733
+ get "/metrics", to: "cache#metrics"
734
+ end
735
+ ```
736
+
737
+ - Create a `cache_controller` (with optional per caller/consumer namespace)
738
+
739
+ ```ruby
740
+ class CacheController < ApplicationController
741
+
742
+ def show
743
+ key = params[:key]
744
+ ns = params[:namespace]
745
+
746
+ value = Mudis.read(key, namespace: ns)
747
+ if value.nil?
748
+ render json: { error: "not found" }, status: :not_found
749
+ else
750
+ render json: { value: value }
751
+ end
752
+ end
753
+
754
+ def write
755
+ key = params[:key]
756
+ ns = params[:namespace]
757
+ val = params[:value]
758
+ ttl = params[:expires_in]&.to_i
759
+
760
+ Mudis.write(key, val, expires_in: ttl, namespace: ns)
761
+ render json: { status: "written", key: key }
762
+ end
763
+
764
+ def delete
765
+ key = params[:key]
766
+ ns = params[:namespace]
767
+
768
+ Mudis.delete(key, namespace: ns)
769
+ render json: { status: "deleted" }
770
+ end
771
+
772
+ def metrics
773
+ render json: Mudis.metrics
774
+ end
775
+ end
776
+ ```
777
+
778
+ - Test it
779
+
780
+ ```bash
781
+ curl http://localhost:3000/cache/foo
782
+ curl -X POST http://localhost:3000/cache/foo -d 'value=bar&expires_in=60'
783
+ curl http://localhost:3000/metrics
784
+
785
+ # Write with namespace
786
+ curl -X POST "http://localhost:3000/cache/foo?namespace=orders" \
787
+ -d "value=123&expires_in=60"
788
+
789
+ # Read from namespace
790
+ curl "http://localhost:3000/cache/foo?namespace=orders"
791
+
792
+ # Delete from namespace
793
+ curl -X DELETE "http://localhost:3000/cache/foo?namespace=orders"
794
+
795
+ ```
796
+
797
+ ---
798
+
799
+ ## Project Philosophy
800
+
801
+ Mudis is intended to be a minimal, thread-safe, in-memory cache designed specifically for Ruby applications. It focuses on:
802
+
803
+ - In-process caching
804
+ - Fine-grained memory and namespace control
805
+ - Observability and testing friendliness
806
+ - Minimal external dependencies
807
+ - Configurability without complexity
808
+
809
+ The primary use cases are:
810
+
811
+ - Per-service application caches
812
+ - Short-lived local caching inside background jobs or API layers
813
+
814
+ Mudis is not intended to be a general-purpose, distributed caching platform. You are, however, welcome to build on top of Mudis if you want its functionality in such projects. E.g.,
815
+
816
+ - mudis-web-cache-server – expose Mudis via HTTP, web sockets, hooks, etc
817
+ - mudis-broker – distributed key routing layer for coordinating multiple Mudis nodes
818
+ - mudis-activejob-store – adapter for using Mudis in job queues or retry buffers
819
+
820
+ ---
821
+
822
+ ## Roadmap
823
+
824
+ #### API Enhancements
825
+
826
+ - [x] bulk_read(keys, namespace:): Batch retrieval of multiple keys with a single method call
827
+
828
+ #### Safety & Policy Controls
829
+
830
+ - [x] max_ttl: Enforce a global upper bound on expires_in to prevent excessively long-lived keys
831
+ - [x] default_ttl: Provide a fallback TTL when one is not specified
832
+
833
+ #### Debugging
834
+
835
+ - [x] clear_namespace(namespace): Remove all keys in a namespace in one call
836
+
837
+ #### Refactor Mudis
838
+
839
+ - [x] Review Mudis for improved readability and reduce complexity in top-level functions
840
+ - [x] Enhanced guards
841
+ - [ ] Review for functionality gaps and enhance as needed
842
+
843
+ ---
844
+
845
+ ## License
846
+
847
+ MIT License © kiebor81
848
+
849
+ ---
850
+
851
+ ## Contributing
852
+
853
+ See [contributor's guide](CONTRIBUTING.md)
854
+
855
+ ---
856
+
857
+ ## Contact
858
+
859
+ For issues, suggestions, or feedback, please open a GitHub issue
860
+
861
+ ---