evt 0.3.6 → 0.4.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: d7c2d7880e0a6e8232a91b2aa154adcc7705c87d3907b33beb27f3f7b10dcbac
-  data.tar.gz: 7d882336538396f34a3c54bb8ccc3dd34b9431f60709d9527c87e3136d0c646b
+  metadata.gz: 3275dc2e231b57c3e740671f2d431ede41ca23339ba799b280edeed1c7be8d2c
+  data.tar.gz: 4107ecb57ec3ff7e566187013348a056773ac654eb2b369b7fa8bb057675750e
 SHA512:
-  metadata.gz: 28f8fb3d3ed2b0c1ee797ba1a36974392e5e7d8c00b38c4f7b25f95c0bf759e2d7f20402f6cb7dc1399187cc4c03e7c0e8d80d641551cc815e20db992d014843
-  data.tar.gz: 90e7cb4395e297761462376990b5faef42598d517dcbc3d5b0001e08d5e39582d158739ba5461eb3700651166fb1041ab15b551dd50f1af002116abc3698cea9
+  metadata.gz: db3172fe0ee6776480a64ee036aedb03b09ee5d5c8a5088fe68e4a969d7058964e8c55b004bb69962f61bffdb13a1c6c28ce49d339f8194e616ae44d877a9616
+  data.tar.gz: 94e287ddb35ae5f99e15ebf27ef76ce54ce3272008fe7c535483706111a8a39ff3168d2289135a027934d45c4382b51527c240fc9d7fbf6b9ce13f2ca7b016e3

data/README.md

@@ -19,30 +19,59 @@ The Event Library that designed for Ruby 3.0 Fiber Scheduler.
 | epoll           | ✅  (See 2) | ❌          | ❌          | ❌          |
 | kqueue          | ❌          | ❌          | ✅ (⚠️ See 5) | ✅          |
 | IOCP            | ❌          | ❌ (⚠️See 3) | ❌          | ❌          |
-| Ruby (`IO.select`) | ✅ Fallback | ✅ (⚠️See 4) | ✅ Fallback | ✅ Fallback |
+| Ruby (`IO.select`) | ✅ (See 6) | ✅ (⚠️See 4) | ✅ (See 6) | ✅ (See 6) |
 
 1. when liburing is installed. (Currently fixing)
 2. when kernel version >= 2.6.9
 3. WOULD NOT WORK until `FILE_FLAG_OVERLAPPED` is included in I/O initialization process.
-4. Some I/Os are not able to be nonblock under Windows. See [Scheduler Docs](https://docs.ruby-lang.org/en/master/doc/scheduler_md.html#label-IO).
+4. Some I/Os are not able to be nonblock under Windows. Using POSIX select, **SLOW**. See [Scheduler Docs](https://docs.ruby-lang.org/en/master/doc/scheduler_md.html#label-IO).
 5. `kqueue` performance in Darwin is very poor. **MAY BE DISABLED IN THE FUTURE.**
+6. Using poll
 
 ### Benchmark
 
-The benchmark is running under `v0.3.1` version. See `example.rb` in [midori](https://github.com/midori-rb/midori.rb) for test code, the test is running under a single-thread server.
+The benchmark is running under `v0.3.6` version. See `example.rb` in [midori](https://github.com/midori-rb/midori.rb) for test code, the test is running under a single-thread server.
 
-The test command is `wrk -t4 -c8192 -d30s http://localhost:3001`.
+The test command is `wrk -t4 -c8192 -d30s http://localhost:8080`.
 
 All of the systems have set their file descriptor limit to maximum.
 On systems raising "Fiber unable to allocate memory", `sudo sysctl -w vm.max_map_count=1000000` is set.
 
 | OS    | CPU         | Memory | Backend                | req/s         |
-| ----- | ----------- | ------ | ---------------------- | --------------|
-| Linux | Ryzen 2700x | 64GB   | epoll                  | 1853259.47    |
+| ----- | ----------- | ------ | ---------------------- | ------------- |
+| Linux | Ryzen 2700x | 64GB   | epoll                  | 2035742.59    |
 | Linux | Ryzen 2700x | 64GB   | io_uring               | require fixes |
-| Linux | Ryzen 2700x | 64GB   | IO.select (using poll) | 1636849.15    |
-| macOS | i7-6820HQ   | 16GB   | kqueue                 | 247370.37     |
-| macOS | i7-6820HQ   | 16GB   | IO.select (using poll) | 323391.38     |
+| Linux | Ryzen 2700x | 64GB   | IO.select (using poll) | 1837640.54    |
+| macOS | i7-6820HQ   | 16GB   | kqueue                 | 257821.78     |
+| macOS | i7-6820HQ   | 16GB   | IO.select (using poll) | 338392.12     |
+
+We also test the server with Redis request, with a [monkey-patched redis library](https://github.com/midori-rb/midori-contrib/blob/master/lib/midori-contrib/redic.rb). The example code is following:
+
+```ruby
+require 'evt'
+require 'midori'
+require 'midori-contrib/redic'
+
+Fiber.set_scheduler Evt::Scheduler.new
+REDIS = Redic.new
+
+class HelloWorldAPI < Midori::API
+  get '/' do
+    REDIS.call 'GET', 'foo'
+  end
+end
+
+Fiber.schedule do
+  Midori::Runner.new(HelloWorldAPI).start
+end
+```
+
+The benckmark result is as following:
+
+| OS    | CPU         | Memory | Backend | req/s     |
+| ----- | ----------- | ------ | ------- | --------- |
+| Linux | Ryzen 2700x | 64GB   | epoll   | 378060.30 |
+| macOS | i7-6820HQ   | 16GB   | kqueue  | 204460.32 |
 
 ## Install
 
@@ -74,6 +103,15 @@ end
 # "Hello World"
 ```
 
+|                | Windows `WaitFor...` | Windows `select` | Windows IOCP | `io_uring` | `epoll` | `kqueue` | `poll` | *NIX `select` |
+| -------------- | -------------------- | ---------------- | ------------ | ---------- | ------- | -------- | ------ | ------------- |
+| Anonymous Pipe | ❌                    | ❌                | ❌            | ✅          | ✅       | ✅        | ✅      | ✅             |
+| Named Pipe     | ❌                    | ❌                | ✅            | ✅          | ✅       | ✅        | ✅      | ✅             |
+| Socket         | ✅                    | ✅                | ✅            | ✅          | ✅       | ✅        | ✅      | ✅             |
+| File           | ✅                    | ✅                | ✅            | ✅          | ✅       | ✅        | ✅      | ✅             |
+
+
+
 ## Roadmap
 
 - [x] Support epoll/kqueue/select

data/evt.gemspec

@@ -10,7 +10,7 @@ Gem::Specification.new do |spec|
   spec.description   = "A low-level Event Handler designed for Ruby 3 Scheduler for better performance"
   spec.homepage      = "https://github.com/dsh0416/evt"
   spec.license       = 'BSD-3-Clause'
-  spec.required_ruby_version = '>= 3.0.0.rc1'
+  spec.required_ruby_version = '>= 3.0.0'
 
   spec.metadata["homepage_uri"] = spec.homepage
   spec.metadata["source_code_uri"] = "https://github.com/dsh0416/evt"

data/ext/evt/epoll.h

@@ -26,6 +26,8 @@ VALUE method_scheduler_epoll_register(VALUE self, VALUE io, VALUE interest) {
         event.events |= EPOLLOUT;
     }
 
+    event.events |= EPOLLRDHUP;
+
     event.data.ptr = (void*) io;
 
     epoll_ctl(epfd, EPOLL_CTL_ADD, fd, &event);
@@ -34,14 +36,13 @@ VALUE method_scheduler_epoll_register(VALUE self, VALUE io, VALUE interest) {
 
 VALUE method_scheduler_epoll_wait(VALUE self) {
     int n, epfd, i, event_flag, timeout;
-    VALUE next_timeout, obj_io, readables, writables, result;
+    VALUE next_timeout, obj_io, iovs, result;
     ID id_next_timeout = rb_intern("next_timeout");
     ID id_push = rb_intern("push");
     
     epfd = NUM2INT(rb_iv_get(self, "@epfd"));
     next_timeout = rb_funcall(self, id_next_timeout, 0);
-    readables = rb_ary_new();
-    writables = rb_ary_new();
+    iovs = rb_ary_new();
 
     if (next_timeout == Qnil) {
         timeout = -1;
@@ -58,20 +59,17 @@ VALUE method_scheduler_epoll_wait(VALUE self) {
 
     for (i = 0; i < n; i++) {
         event_flag = events[i].events;
-        if (event_flag & EPOLLIN) {
-            obj_io = (VALUE) events[i].data.ptr;
-            rb_funcall(readables, id_push, 1, obj_io);
-        }
-
-        if (event_flag & EPOLLOUT) {
-            obj_io = (VALUE) events[i].data.ptr;
-            rb_funcall(writables, id_push, 1, obj_io);
-        }
+        obj_io = (VALUE) events[i].data.ptr;
+        VALUE e = rb_ary_new2(2);
+        rb_ary_store(e, 0, obj_io);
+        rb_ary_store(e, 1, INT2NUM(event_flag));
+        rb_funcall(iovs, id_push, 1, e);
     }
 
-    result = rb_ary_new2(2);
-    rb_ary_store(result, 0, readables);
-    rb_ary_store(result, 1, writables);
+    result = rb_ary_new2(3);
+    rb_ary_store(result, 0, rb_ary_new());
+    rb_ary_store(result, 1, rb_ary_new());
+    rb_ary_store(result, 2, iovs);
     return result;
 }
 

data/lib/evt/backends/epoll.rb

@@ -21,6 +21,56 @@ class Evt::Epoll < Evt::Bundled
     epoll_deregister(io)
   end
 
+  def io_wait(io, events, duration)
+    @iovs[io] = Fiber.current
+    self.register(io, events)
+    Fiber.yield
+    self.deregister(io)
+    true
+  end
+
+  # def io_read(io, buffer, offset, length)
+  #   result = +('')
+    
+  #   self.register(io, IO::READABLE)
+  #   direct_read = io.read_nonblock(length, exception: false)
+  
+  #   unless direct_read == :wait_readable
+  #     result << direct_read
+  #   end
+
+  #   until result.length >= length or io.closed? or io.eof?
+  #     @iovs[io] = Fiber.current
+  #     Fiber.yield
+  #     todo = length - result.length
+  #     result << io.read_nonblock(todo)
+  #   end
+
+  #   self.deregister(io)
+  #   buffer[offset...offset+result.length] = result
+  #   result.length
+  # end
+
+  # def io_write(io, buffer, offset, length)
+  #   finished = 0
+
+  #   self.register(io, IO::WRITABLE)
+  #   direct_write = io.write_nonblock(buffer.byteslice(offset+finished..-1), exception: false)
+  #   unless direct_write == :wait_writable
+  #     finished += direct_write
+  #   end
+
+  #   until finished >= length or io.closed?
+  #     @iovs[io] = Fiber.current
+  #     Fiber.yield
+  #     finished += io.write_nonblock(buffer.byteslice(offset+finished..-1))
+  #   end
+
+  #   self.deregister(io)
+
+  #   finished
+  # end
+
   def wait
     epoll_wait
   end

data/lib/evt/backends/select.rb

@@ -22,6 +22,9 @@ class Evt::Select < Evt::Bundled
 
   def wait
     select_wait
+  rescue IOError => _
+    collect(true)
+    return [], []
   rescue Errno::EBADF => _
     collect(true)
     return [], []

data/lib/evt/backends/uring.rb

@@ -20,13 +20,14 @@ class Evt::Uring < Evt::Bundled
   def deregister(io)
   end
 
-  def io_read(io, buffer, offset, length)
-    uring_io_read(io, buffer, offset, length)
-  end
-
-  def io_write(io, buffer, offset, length)
-    uring_io_write(io, buffer, offset, length)
-  end
+  # Disable direct I/Os for now
+  # def io_read(io, buffer, offset, length)
+  #   uring_io_read(io, buffer, offset, length)
+  # end
+
+  # def io_write(io, buffer, offset, length)
+  #   uring_io_write(io, buffer, offset, length)
+  # end
 
   def wait
     uring_wait

data/lib/evt/version.rb

@@ -1,5 +1,5 @@
 # frozen_string_literal: true
 
 module Evt
-  VERSION = "0.3.6"
+  VERSION = "0.4.0"
 end

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: evt
 version: !ruby/object:Gem::Version
-  version: 0.3.6
+  version: 0.4.0
 platform: ruby
 authors:
 - Delton Ding
 autorequire:
 bindir: bin
 cert_chain: []
-date: 2020-12-23 00:00:00.000000000 Z
+date: 2020-12-25 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: rake-compiler
@@ -100,14 +100,14 @@ required_ruby_version: !ruby/object:Gem::Requirement
   requirements:
   - - ">="
     - !ruby/object:Gem::Version
-      version: 3.0.0.rc1
+      version: 3.0.0
 required_rubygems_version: !ruby/object:Gem::Requirement
   requirements:
   - - ">="
     - !ruby/object:Gem::Version
       version: '0'
 requirements: []
-rubygems_version: 3.2.2
+rubygems_version: 3.2.3
 signing_key:
 specification_version: 4
 summary: The Event Library that designed for Ruby 3.0 Fiber Scheluer.