raptor 0.11.0 → 0.13.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: be4ff0cf1729c188fab8261b749c2a279616bd565dbad81d18f5a3e75311b734
-  data.tar.gz: 0acc2ece57f69207a34696df792e45bf52bfce22bb7617c5ceb3113223c175f5
+  metadata.gz: b7a531c4a4d9cfe93de0c4e8d255d9eac6a09d59f9af6d3884231cd0a383aca5
+  data.tar.gz: 3155fd5b27d53b5a65a9be9cc36d139da801ad3ce33a188ea9a46c77289ee97e
 SHA512:
-  metadata.gz: 787fabc9128f3c4e16a394dc5634ff8435916b60b68ff3f6d569b0db561f07af0c61ab5d17e7440301c850d87fbbe1f0dc3691274b1c060d1cbbd6f7bc84bfbf
-  data.tar.gz: 26d154b6c0abbc63986262e1212e526bd9e4e492d06f9a86e723e73fd85afd142550a15324b55ad91b575633db2d0231f262aebb818f198e2de4c96c9afa8666
+  metadata.gz: 53bfe180b9db4a6d9f7fdb3ea2f11bf2f19b5fa81c54beb09e74caa189381a52587756c6acae9b18ce16a5500a278a0b737934bc9b5e129fe3002605ee2ac5c1
+  data.tar.gz: a235a90619e1a8c1935208d1c516280bf911335e075bc6e91d5be78d134c5cc385381dba899328ebc2f8da213753d31618f5328e5eec8d609a06cfb1c30b5cb8

data/.buildkite/pipeline.yml

@@ -18,6 +18,25 @@ steps:
           - bundle install
           - bundle exec rake ci
 
+      - label: ":ruby: Ruby 4.0 +GC.stress"
+        image: "ruby:4.0"
+        env:
+          RUBY_GC_STRESS: "1"
+        commands:
+          - ruby -v
+          - bundle install
+          - bundle exec rake ci
+
+      - label: ":ruby: Ruby 4.0 +YJIT +GC.stress"
+        image: "ruby:4.0"
+        env:
+          RUBY_YJIT_ENABLE: "1"
+          RUBY_GC_STRESS: "1"
+        commands:
+          - ruby -v
+          - bundle install
+          - bundle exec rake ci
+
       - label: ":ruby: Ruby head"
         soft_fail: true
         image: "rubylang/ruby:master-dev"
@@ -38,6 +57,29 @@ steps:
           - bundle install
           - bundle exec rake ci
 
+      - label: ":ruby: Ruby head +GC.stress"
+        soft_fail: true
+        image: "rubylang/ruby:master-dev"
+        env:
+          RUBY_GC_STRESS: "1"
+        commands:
+          - apt-get update && apt-get install -y libyaml-dev
+          - ruby -v
+          - bundle install
+          - bundle exec rake ci
+
+      - label: ":ruby: Ruby head +YJIT +GC.stress"
+        soft_fail: true
+        image: "rubylang/ruby:master-dev"
+        env:
+          RUBY_YJIT_ENABLE: "1"
+          RUBY_GC_STRESS: "1"
+        commands:
+          - apt-get update && apt-get install -y libyaml-dev
+          - ruby -v
+          - bundle install
+          - bundle exec rake ci
+
   - group: ":mac: macOS"
     key: macos
     steps:
@@ -65,6 +107,33 @@ steps:
           - bundle install
           - bundle exec rake ci
 
+      - label: ":ruby: Ruby 4.0 +GC.stress"
+        agents:
+          queue: macos
+        env:
+          RUBY_GC_STRESS: "1"
+        commands:
+          - brew install --quiet ruby@4.0
+          - export PATH="$(brew --prefix ruby@4.0)/bin:$PATH"
+          - bundle config set --local path .bundle
+          - ruby -v
+          - bundle install
+          - bundle exec rake ci
+
+      - label: ":ruby: Ruby 4.0 +YJIT +GC.stress"
+        agents:
+          queue: macos
+        env:
+          RUBY_YJIT_ENABLE: "1"
+          RUBY_GC_STRESS: "1"
+        commands:
+          - brew install --quiet ruby@4.0
+          - export PATH="$(brew --prefix ruby@4.0)/bin:$PATH"
+          - bundle config set --local path .bundle
+          - ruby -v
+          - bundle install
+          - bundle exec rake ci
+
       - label: ":ruby: Ruby head"
         soft_fail: true
         agents:
@@ -92,3 +161,34 @@ steps:
           - ruby -v
           - bundle install
           - bundle exec rake ci
+
+      - label: ":ruby: Ruby head +GC.stress"
+        soft_fail: true
+        agents:
+          queue: macos
+        env:
+          RUBY_GC_STRESS: "1"
+        commands:
+          - brew unlink ruby
+          - brew install --HEAD --quiet ruby
+          - export PATH="$(brew --prefix ruby)/bin:$PATH"
+          - bundle config set --local path .bundle
+          - ruby -v
+          - bundle install
+          - bundle exec rake ci
+
+      - label: ":ruby: Ruby head +YJIT +GC.stress"
+        soft_fail: true
+        agents:
+          queue: macos
+        env:
+          RUBY_YJIT_ENABLE: "1"
+          RUBY_GC_STRESS: "1"
+        commands:
+          - brew unlink ruby
+          - brew install --HEAD --quiet ruby
+          - export PATH="$(brew --prefix ruby)/bin:$PATH"
+          - bundle config set --local path .bundle
+          - ruby -v
+          - bundle install
+          - bundle exec rake ci

data/CHANGELOG.md

@@ -1,5 +1,16 @@
 ## [Unreleased]
 
+## [0.13.0] - 2026-07-21
+
+- Tune BPF reuseport routing to spread bursts across near-idle workers
+
+## [0.12.0] - 2026-07-19
+
+- Add `refork_after` and `before_refork` for reforking workers off a warmed source
+- Add `before_fork`, `before_worker_boot`, and `before_worker_shutdown` hooks
+- Sync `$stdout` and `$stderr` writes so info-level logs flush immediately
+- Break reuseport routing ties by 4-tuple hash instead of a random draw
+
 ## [0.11.0] - 2026-07-12
 
 - Yield subsequent HTTP/1.1 keep-alive requests to the thread pool only under saturation

data/README.md

@@ -36,23 +36,23 @@ run proc { |_env| [200, { "content-type" => "text/plain" }, ["Hello, World!"]] }
 
 ```
 > bundle exec raptor -w 4 -t 3 hello_world.ru
-[Raptor 76577|Main|Main] Cluster initializing:
-[Raptor 76577|Main|Main] ├─ Version: 0.11.0
-[Raptor 76577|Main|Main] ├─ Ruby Version: ruby 4.0.5 (2026-05-20 revision 64336ffd0e) +YJIT +PRISM [arm64-darwin23]
-[Raptor 76577|Main|Main] ├─ Environment: development
-[Raptor 76577|Main|Main] ├─ Master PID: 76577
-[Raptor 76577|Main|Main] │  └─ 4 worker processes
-[Raptor 76577|Main|Main] │     ├─ 1 server thread
-[Raptor 76577|Main|Main] │     ├─ 1 reactor thread
-[Raptor 76577|Main|Main] │     ├─ 1 pipeline ractor
-[Raptor 76577|Main|Main] │     ├─ 1 pipeline collector thread
-[Raptor 76577|Main|Main] │     ├─ 3 worker threads
-[Raptor 76577|Main|Main] │     └─ 1 stats thread
-[Raptor 76577|Main|Main] └─ Listening on 0.0.0.0:9292
-[Raptor 76579|Main|Main] Worker 0 booted
-[Raptor 76580|Main|Main] Worker 1 booted
-[Raptor 76581|Main|Main] Worker 2 booted
-[Raptor 76582|Main|Main] Worker 3 booted
+[Raptor 59013|Main|Main] Cluster initializing:
+[Raptor 59013|Main|Main] ├─ Version: 0.13.0
+[Raptor 59013|Main|Main] ├─ Ruby Version: ruby 4.0.5 (2026-05-20 revision 64336ffd0e) +YJIT +PRISM [arm64-darwin23]
+[Raptor 59013|Main|Main] ├─ Environment: development
+[Raptor 59013|Main|Main] ├─ Master PID: 59013
+[Raptor 59013|Main|Main] │  └─ 4 worker processes
+[Raptor 59013|Main|Main] │     ├─ 1 server thread
+[Raptor 59013|Main|Main] │     ├─ 1 reactor thread
+[Raptor 59013|Main|Main] │     ├─ 1 pipeline ractor
+[Raptor 59013|Main|Main] │     ├─ 1 pipeline collector thread
+[Raptor 59013|Main|Main] │     ├─ 3 worker threads
+[Raptor 59013|Main|Main] │     └─ 1 stats thread
+[Raptor 59013|Main|Main] └─ Listening on 0.0.0.0:9292
+[Raptor 59023|Main|Main] Worker 0 booted
+[Raptor 59024|Main|Main] Worker 1 booted
+[Raptor 59025|Main|Main] Worker 2 booted
+[Raptor 59026|Main|Main] Worker 3 booted
 ```
 
 ```
@@ -79,15 +79,16 @@ The config file is a Ruby file that evaluates to a hash of options. By default R
 ```ruby
 # raptor.rb
 
+# Every key below is set to its default value; only include the ones you want to override.
 {
   binds: ["tcp://0.0.0.0:9292"],
   socket_backlog: 1024,
   drain_accept_queue: false,
-  workers: 4,
+  workers: 4, # `Etc.nprocessors`
   ractors: 1,
   threads: 3,
   chdir: nil,
-  environment: nil,
+  environment: nil, # falls back to `RAILS_ENV`, then `RACK_ENV`, then `"development"`
   connection: {
     first_data_timeout: 30,
     chunk_data_timeout: 10,
@@ -106,6 +107,11 @@ The config file is a Ruby file that evaluates to a hash of options. By default R
   worker_timeout: 60,
   worker_drain_timeout: 25,
   worker_shutdown_timeout: 30,
+  refork_after: 1000, # `nil` on non-Linux
+  before_fork: [],
+  before_worker_boot: [],
+  before_worker_shutdown: [],
+  before_refork: [],
   stats_file: "tmp/raptor.json",
   pid_file: nil,
   stdout_file: nil,
@@ -187,20 +193,30 @@ Worker 1 (phase 0): pid=91351, requests=1199, busy=1/3, backlog=0, booted, last_
 
 ## (Micro) Benchmarks
 
-Raptor 0.11.0 vs Puma 8.0.2, median of 3 runs across two workload profiles: IO-bound (sleep for a random 1-10ms then
-return small JSON) and CPU-bound (serialise a JSON array of 20-200 items).
-
-| Protocol              | Workload | Raptor       | Puma         | +/- vs Puma |
-| --------------------- | -------- | ------------ | ------------ | ----------- |
-| HTTP/1.1              | IO       | 2.05k req/s  | 1.94k req/s  | +5.7%       |
-| HTTP/1.1              | CPU      | 13.66k req/s | 9.21k req/s  | +48.3%      |
-| HTTP/1.1 (keep-alive) | IO       | 2.08k req/s  | 1.95k req/s  | +6.6%       |
-| HTTP/1.1 (keep-alive) | CPU      | 27.85k req/s | 27.47k req/s | +1.4%       |
-| HTTP/2                | IO       | 0.96k req/s  | N/A          | -           |
-| HTTP/2                | CPU      | 28.92k req/s | N/A          | -           |
+Raptor 0.13.0 vs Puma 8.0.2 vs Falcon 0.55.5 across two workload profiles. **IO-bound** is a GET endpoint that
+interleaves 5-10 short sleeps (total 2.5-15ms) with small CPU work, simulating a read path that makes several DB or
+cache calls. **CPU-bound** is a POST endpoint that accepts a small JSON body, interleaves 3-5 chunks of JSON item
+building (total 450-1500 items) with sub-100µs sleeps, and returns the built array, simulating a write path that does
+most of its work in Ruby with a few near-zero-cost cache hits.
+
+Each cell reports the median throughput and median p95 latency independently across 5 runs, so the two numbers in a row
+may come from different runs. Every run starts a fresh server process so the samples are independent of each other;
+state accumulated in a previous run cannot bias the next. Across the whole table, the widest spread
+((max - min) / 2 / median) between runs of a single cell was ±30.0% for throughput
+and ±22.8% for p95.
+
+| Protocol              | Workload | Raptor req/s | Raptor p95 | Puma req/s  | Puma p95 | vs Puma req/s | vs Puma p95 | Falcon req/s | Falcon p95 | vs Falcon req/s | vs Falcon p95 |
+| --------------------- | -------- | ------------ | ---------- | ----------- | -------- | ------------- | ----------- | ------------ | ---------- | --------------- | ------------- |
+| HTTP/1.1              | IO       | 1.39k req/s  | 50.20 ms   | 0.96k req/s | 66.20 ms | 44.1% higher  | 24.2% lower | 4.54k req/s  | 15.00 ms   | 69.4% lower     | 234.7% higher |
+| HTTP/1.1              | CPU      | 4.55k req/s  | 18.10 ms   | 3.64k req/s | 16.50 ms | 24.9% higher  | 9.7% higher | 3.87k req/s  | 15.00 ms   | 17.5% higher    | 20.7% higher  |
+| HTTP/1.1 (keep-alive) | IO       | 1.42k req/s  | 30.00 ms   | 0.92k req/s | 65.80 ms | 54.8% higher  | 54.4% lower | 4.08k req/s  | 16.70 ms   | 65.3% lower     | 79.6% higher  |
+| HTTP/1.1 (keep-alive) | CPU      | 4.51k req/s  | 11.20 ms   | 3.77k req/s | 17.50 ms | 19.8% higher  | 36.0% lower | 4.00k req/s  | 16.50 ms   | 12.9% higher    | 32.1% lower   |
+| HTTP/2                | IO       | 0.71k req/s  | 85.84 ms   | N/A         | N/A      | -             | -           | 3.88k req/s  | 17.43 ms   | 81.7% lower     | 392.3% higher |
+| HTTP/2                | CPU      | 4.07k req/s  | 21.85 ms   | N/A         | N/A      | -             | -           | 4.33k req/s  | 30.84 ms   | 6.0% lower      | 29.2% lower   |
 
 > ruby 4.0.5 (2026-05-20 revision 64336ffd0e) +YJIT +PRISM [aarch64-linux]
-> 4 workers, 3 threads, 48 concurrent connections
+> 4 worker processes; Raptor and Puma run 3 threads per worker, Falcon runs unbounded fibers per worker;
+> 48 concurrent HTTP/1.1 client connections; 16 concurrent HTTP/2 client connections × 3 streams each
 
 See [bin/benchmark](bin/benchmark) for more details.