ruby-next-core 0.6.0 → 0.9.1

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 5447b309915122d9f6dc9a366c34a566891c9f9cc569722c0999e020ef891d6b
-  data.tar.gz: 9c2da837b1c9e4d2d36ea8665a90f7d3c004d6175b1d0e82262396846ac00f6a
+  metadata.gz: 5689b631e2b8dd6e9222a60b25434fcb323d008458342c395ff891015d9f651d
+  data.tar.gz: 6178612f34fbbe59ea3f3042fc62ea23cc3bede62a944e187791a7304164d819
 SHA512:
-  metadata.gz: 7644e4703b233a730a3af183efaae78ea53cf5915ea70cc297ab8ebc8ff9346aad233c642cbf1d38ec82dc49deeab266e20ed35667e6c4069a7bb2f16b6c4e16
-  data.tar.gz: 42fe6bf61bfd0cc97c1107455b873d97065eeb3f8c0c6ae3d7921b1fa208c155114e0e6012045d335fa31f1591093fabb58a3a2f1828c9fe668c2e798335ee80
+  metadata.gz: f24eef8dc28b0ad4e8f9d5073d1254f31111354291b9bfb60cb8c688fbf312f153ba8fe17886183798b9413280bac554f9012e2ec2b63d250f0bf3c34a3362eb
+  data.tar.gz: d9ab4a36680864b81cd545d438e001a51e4c6dfbca56336a971b557af50786b70c7b7f9eee37698fc0373480e56f51c153080b9e06ec218dc8d08e0da2dc79d6

data/CHANGELOG.md

@@ -2,6 +2,59 @@
 
 ## master
 
+## 0.9.1 (2020-06-05)
+
+- Keep `ruby-next` version in sync with `ruby-next-core`. ([@palkan][])
+
+Require `ruby-next-core` of the same version as `ruby-next`.
+
+## 0.9.0 (2020-06-04)
+
+- Add Ruby 2.3 support. ([@palkan][])
+
+- Remove stale transpiled files when running `ruby-next nextify`. ([@palkan][])
+
+- Add Ruby 2.4 support. ([@palkan][])
+
+APIs for <2.5 must be backported via [backports][] gem. Refinements are not supported.
+
+## 0.8.0 (2020-05-01) 🚩
+
+- Add right-hand assignment support. ([@palkan][])
+
+It is real: `13.divmod(5) => a, b`.
+
+- Add endless methods support. ([@palkan][])
+
+Now you can write `def foo() = :bar`.
+
+## 0.7.0 (2020-04-29)
+
+- Try to auto-transpile the source code on load in `.setup_gem_load_path` if transpiled files are missing. ([@palkan][])
+
+This would make it possible to install gems from source if transpiled files do not exist in the repository.
+
+- Use`./.rbnextrc` to define CLI args. ([@palkan][])
+
+You can define CLI options in the configuration file to re-use them between environments or
+simply avoid typing every time:
+
+```yml
+# .rbnextrc
+nextify: |
+  --transpiler-mode=rewrite
+  --edge
+```
+
+- Add `--dry-run` option to CLI. ([@palkan][])
+
+- Raise `SyntaxError` when parsing fails. ([@palkan][])
+
+Previously, we let Parser to raise its `Parser::SyntaxError` but some exceptions
+are not reported by Parser and should be handled by transpiler (and we raised `SyntaxError` in that case, as MRI does).
+
+This change unifies the exceptions raised during transpiling.
+
 ## 0.6.0 (2020-04-23)
 
 - Changed the way edge/proposed features are activated. ([@palkan][])
@@ -141,3 +194,4 @@ p a #=> 1
 - Add `Kernel#then`. ([@palkan][])
 
 [@palkan]: https://github.com/palkan
+[backports]: https://github.com/marcandre/backports

data/README.md

@@ -1,5 +1,6 @@
 [![Gem Version](https://badge.fury.io/rb/ruby-next.svg)](https://rubygems.org/gems/ruby-next) [![Build](https://github.com/ruby-next/ruby-next/workflows/Build/badge.svg)](https://github.com/ruby-next/ruby-next/actions)
-[![JRuby Build](https://github.com/ruby-next/ruby-next/workflows/JRuby%20Build/badge.svg)](https://github.com/ruby-next/ruby-next/actions)
+[![JRuby Build](https://github.com/ruby-next/ruby-next/workflows/JRuby%20Build/badge.svg)](https://github.com/ruby-next/ruby-next/actions?query=workflow%3A%22TruffleRuby+Build%22)
+[![TruffleRuby Build](https://github.com/ruby-next/ruby-next/workflows/TruffleRuby%20Build/badge.svg)](https://github.com/ruby-next/ruby-next/actions?query=workflow%3A%22TruffleRuby+Build%22)
 
 # Ruby Next
 
@@ -17,13 +18,29 @@ Who might be interested in Ruby Next?
 Ruby Next also aims to help the community to assess new, _experimental_, MRI features by making it easier to play with them.
 That's why Ruby Next implements the `master` features as fast as possible.
 
+Read more about the motivation behind the Ruby Next in this post: [Ruby Next: Make all Rubies quack alike](https://evilmartians.com/chronicles/ruby-next-make-all-rubies-quack-alike).
+
 <a href="https://evilmartians.com/?utm_source=ruby-next">
 <img src="https://evilmartians.com/badges/sponsored-by-evil-martians.svg" alt="Sponsored by Evil Martians" width="236" height="54"></a>
 
-## Links
+## Posts
+
+- [Ruby Next: Make all Rubies quack alike](https://evilmartians.com/chronicles/ruby-next-make-all-rubies-quack-alike)
+
+## Talks
 
 - [Ruby Next: Make old Rubies quack like a new one](https://noti.st/palkan/j3i2Dr/ruby-next-make-old-rubies-quack-like-a-new-one) (RubyConf 2019)
 
+## Examples
+
+- Ruby gems
+  - [anyway_config](https://github.com/palkan/anyway_config)
+  - [graphql-fragment_cache](https://github.com/DmitryTsepelev/graphql-ruby-fragment_cache)
+- mruby
+  - [ACLI](https://github.com/palkan/acli)
+
+_Please, submit a PR to add your project to the list!_
+
 ## Table of contents
 
 - [Overview](#overview)
@@ -38,6 +55,7 @@ That's why Ruby Next implements the `master` features as fast as possible.
   - [`ruby -ruby-next`](#uby-next)
   - [Logging & Debugging](#logging-and-debugging)
 - [RuboCop](#rubocop)
+- [Using with EOL Rubies](#using-with-eol-rubies)
 - [Proposed & edge features](#proposed-and-edge-features)
 
 ## Overview
@@ -49,8 +67,9 @@ Core provides **polyfills** for Ruby core classes APIs via Refinements (default
 Language is responsible for **transpiling** edge Ruby syntax into older versions. It could be done
 programmatically or via CLI. It also could be done in runtime.
 
-Currently, Ruby Next supports Ruby versions 2.5+ (including JRuby 9.2.8+).
-Please, [open an issue](https://github.com/ruby-next/ruby-next/issues/new/choose) if you would like us to support older Ruby versions.
+Currently, Ruby Next supports Ruby versions 2.3+, including JRuby 9.2.8+ and TruffleRuby 20.1+ (with some limitations). Support for EOL versions (<2.5) slightly differs though ([see below](#using-with-eol-rubies)).
+
+Please, [open an issue](https://github.com/ruby-next/ruby-next/issues/new/choose) or join the discussion in the existing ones if you would like us to support older Ruby versions.
 
 ## Quick start
 
@@ -62,12 +81,16 @@ $ gem install ruby-next
 
 # Call ruby with -ruby-next flag
 $ ruby -ruby-next -e "
- case {hello: 'martian'}
- in hello: hello if hello =~ /human/
-   puts '🙂'
- in hello: 'martian'
-   puts '👽'
- end
+def greet(val) =
+  case val
+    in hello: hello if hello =~ /human/i
+      '🙂'
+    in hello: 'martian'
+      '👽'
+    end
+
+greet(hello: 'martian') => greeting
+puts greeting
 "
 
 => 👽
@@ -115,6 +138,8 @@ The following _rule of thumb_ is recommended when choosing between refinements a
 - Using core extensions could be considered for application development (no need to think about `using RubyNext`); this approach could potentially lead to conflicts with dependencies (if these dependencies are not using refinements 🙂)
 - Use core extensions if refinements are not supported by your platform
 
+**NOTE:** TruffleRuby doesn't fully support refinements (refining modules is not supported as of v20.1.0).
+
 [**The list of supported APIs.**][features_core]
 
 ## Transpiling
@@ -160,6 +185,8 @@ You can change the transpiler mode:
 - Via environmental variable `RUBY_NEXT_TRANSPILE_MODE=rewrite`.
 - Via CLI option ([see below](#cli)).
 
+**NOTE:** For the time being, Unparser [doesn't support](https://github.com/mbj/unparser/pull/142) new Ruby 2.7 AST nodes, so we always use rewrite mode in Ruby 2.7+.
+
 ## CLI
 
 Ruby Next ships with the command-line interface (`ruby-next`) which provides the following functionality:
@@ -181,6 +208,7 @@ Usage: ruby-next nextify DIRECTORY_OR_FILE [options]
         --[no-]refine                Do not inject `using RubyNext`
     -h, --help                       Print help
     -V                               Turn on verbose mode
+        --dry-run                    Print verbose output without generating files
 ```
 
 The behaviour depends on whether you transpile a single file or a directory:
@@ -212,6 +240,7 @@ Usage: ruby-next core_ext [options]
     -n, --name=NAME                  Filter extensions by name
     -h, --help                       Print help
     -V                               Turn on verbose mode
+        --dry-run                    Print verbose output without generating files
 ```
 
 The most common use-case is to backport the APIs required by pattern matching. You can do this, for example,
@@ -238,7 +267,21 @@ $ ruby-next core_ext -l --name=filter --name=deconstruct
   - StructDeconstruct
 ```
 
-### Integrating into a gem development
+### CLI configuration file
+
+You can define CLI options in the `.rbnextrc` file located in the root of your project to avoid adding them every time you run `ruby-next`.
+
+Configuration file is a YAML with commands as keys and options as multiline strings:
+
+```yml
+# ./.rbnextrc
+
+nextify: |
+  --transpiler-mode=rewrite
+  --edge
+```
+
+## Integrating into a gem development
 
 We recommend _pre-transpiling_ source code to work with older versions before releasing it.
 
@@ -275,6 +318,24 @@ If you're using [runtime mode](#runtime-usage) a long with `setup_gem_load_path`
 
 \* Ruby Next avoids storing duplicates; instead, only the code for the earlier version is created and is assumed to be used with other versions. For example, if the transpiled code is the same for Ruby 2.5 and Ruby 2.6, only the `.rbnext/2.7/path/to/file.rb` is kept. That's why multiple entries are added to the `$LOAD_PATH` (`.rbnext/2.6` and `.rbnext/2.7` in the specified order for Ruby 2.5 and only `.rbnext/2.7` for Ruby 2.6).
 
+### Transpiled files vs. VCS vs. installing from source
+
+It's a best practice to not keep generated files in repositories. In case of Ruby Next, it's a `lib/.rbnext` folder.
+
+We recommend adding this folder only to the gem package (i.e., it should be added to your `spec.files`) and ignore it in your VCS (e.g., `echo ".rbnext/" >> .gitignore`). That would make transpiled files available in releases without polluting your repository.
+
+What if someone decides to install your gem from the VCS source? They would likely face some syntax errors due to the missing transpiled files.
+
+To solve this problem, Ruby Next _tries_ to transpile the source code when you call `#setup_gem_load_path`. It does this by calling `bundle exec ruby-next nextify <lib_dir> -o <next_dir>`. We make the following assumptions:
+
+- We are in the Bundler context (since that's the most common way of installing gems from source).
+- Our Gemfile contains `ruby-next` gem.
+- We use [`.rbnextrc`](#CLI-configuration-file) for transpiling options.
+
+If the command fails we warn the end user.
+
+This feature, _auto-transpiling_, is **disabled** by default (will likely be enabled in future versions). You can enable it by calling `RubyNext::Language.setup_gem_load_path(transpile: true)`.
+
 ## Runtime usage
 
 It is also possible to transpile Ruby source code in run-time via Ruby Next.
@@ -332,6 +393,12 @@ RUBYOPT="-ruby-next" ruby my_ruby_script.rb
 ruby -ruby-next -e "puts [2, 4, 5].tally"
 ```
 
+**NOTE:** running Ruby scripts directly or executing code via `-e` option is not supported in TruffleRuby. You can still use `-ruby-next` to transpile required files, e.g.:
+
+```sh
+ruby -ruby-next -r my_ruby_script.rb -e "puts my_method"
+```
+
 ## Logging and debugging
 
 Ruby Next prints some debugging information when fails to load a file in the runtime mode (and fallbacks to the built-in loading mechanism).
@@ -364,6 +431,40 @@ AllCops:
     - 'lib/.rbnext/**/*'
 ```
 
+**NOTE:** you need `ruby-next` gem available in the environment where you run RuboCop (having `ruby-next-core` is not enough).
+
+## Using with EOL Rubies
+
+We currently provide support for Ruby 2.3 and 2.4. Work on 2.2 is in progress.
+
+Ruby Next itself relies on 2.5 features and contains polyfills only for version 2.5+ (and that won't change).
+Thus, to make it work with <2.5 we need to backport some APIs ourselves.
+
+The recommended way of doing this is to use [backports][] gem. You need to load backports **before Ruby Next**.
+
+When using runtime features, you should do the following:
+
+```ruby
+# first, require backports upto 2.5
+require "backports/2.5"
+# then, load Ruby Next
+require "ruby-next"
+# if you need 2.6+ APIs, add Ruby Next core_ext
+require "ruby-next/core_ext"
+# then, load runtime transpiling
+require "ruby-next/language/runtime"
+# or
+require "ruby-next/language/bootsnap"
+```
+
+To load backports while using `ruby-next nextify` command, you must configure the environment variable:
+
+```sh
+RUBY_NEXT_CORE_STRATEGY=backports ruby-next nextify lib/
+```
+
+**NOTE:** Make sure you have `backports` gem installed globally or added to your bundle (if you're using `bundle exec ruby-next ...`).
+
 ## Proposed and edge features
 
 Ruby Next aims to bring edge and proposed features to Ruby community before they (hopefully) reach an official Ruby release.
@@ -395,11 +496,13 @@ require "ruby-next/language/runtime"
 
 ### Supported edge features
 
-Not yet.
+- "Endless" method definition (`def foo() = 42`) ([#16746](https://bugs.ruby-lang.org/issues/16746)).
+
+- Right-hand assignment (`13.divmod(5) => a,b`) ([#15921](https://bugs.ruby-lang.org/issues/15921))
 
 ### Supported proposed features
 
-- _Method reference_ operator (`.:`) ([link](https://bugs.ruby-lang.org/issues/13581)).
+- _Method reference_ operator (`.:`) ([#13581](https://bugs.ruby-lang.org/issues/13581)).
 
 ## Contributing
 
@@ -426,3 +529,4 @@ The gem is available as open source under the terms of the [MIT License](https:/
 [next_parser]: https://github.com/ruby-next/parser
 [Bootsnap]: https://github.com/Shopify/bootsnap
 [rubocop]: https://github.com/rubocop-hq/rubocop
+[backports]: https://github.com/marcandre/backports

data/bin/transform

@@ -5,11 +5,11 @@ $LOAD_PATH.unshift(lib) unless $LOAD_PATH.include?(lib)
 
 require "bundler/setup"
 
-require "ruby-next/language"
+ENV["RUBY_NEXT_EDGE"] = "1"
+ENV["RUBY_NEXT_PROPOSED"] = "1"
 
-# optional parsers
-require "ruby-next/language/rewriters/method_reference"
-RubyNext::Language.rewriters << RubyNext::Language::Rewriters::MethodReference
+require "ruby-next/language"
+require "ruby-next/language/rewriters/runtime"
 
 contents =
   if File.exist?(ARGV[0])
@@ -18,4 +18,11 @@ contents =
     ARGV[0]
   end
 
-puts RubyNext::Language.transform(contents)
+opts =
+  if ARGV[1] && ARGV[1] == "--current"
+    {rewriters: RubyNext::Language.current_rewriters}
+  else
+    {}
+  end
+
+puts RubyNext::Language.transform(contents, **opts)

data/lib/ruby-next.rb

@@ -11,10 +11,10 @@ module RubyNext
 
   # Defines last minor version for every major version
   LAST_MINOR_VERSIONS = {
-    2 => 7
+    2 => 8
   }.freeze
 
-  LATEST_VERSION = [2, 7].freeze
+  LATEST_VERSION = [2, 8].freeze
 
   class << self
     def next_version(version = RUBY_VERSION)
@@ -34,5 +34,6 @@ module RubyNext
   end
 
   require_relative "ruby-next/core"
+  require_relative "ruby-next/core_ext" if RubyNext::Core.core_ext?
   require_relative "ruby-next/logging"
 end

data/lib/ruby-next/cli.rb

@@ -10,10 +10,14 @@ module RubyNext
   # Command line interface for RubyNext
   class CLI
     class << self
-      attr_accessor :verbose
+      attr_accessor :verbose, :dry_run
+
+      alias verbose? verbose
+      alias dry_run? dry_run
     end
 
     self.verbose = false
+    self.dry_run = false
 
     COMMANDS = {
       "nextify" => Commands::Nextify,
@@ -36,6 +40,8 @@ module RubyNext
 
       args.delete(command)
 
+      args.unshift(*load_args_from_rc(command))
+
       COMMANDS.fetch(command) do
         raise "Unknown command: #{command}. Available commands: #{COMMANDS.keys.join(",")}"
       end.run(args)
@@ -89,5 +95,15 @@ module RubyNext
         end
       end
     end
+
+    def load_args_from_rc(command)
+      return [] unless File.file?(".rbnextrc")
+
+      require "yaml"
+      command_args = YAML.load_file(".rbnextrc")[command]
+      return [] unless command_args
+
+      command_args.lines.flat_map { |line| line.chomp.split(/\s+/) }
+    end
   end
 end

data/lib/ruby-next/commands/base.rb

@@ -11,6 +11,9 @@ module RubyNext
         end
       end
 
+      attr_reader :dry_run
+      alias dry_run? dry_run
+
       def initialize(args)
         parse! args
       end
@@ -24,8 +27,13 @@ module RubyNext
       end
 
       def log(msg)
-        return unless CLI.verbose
-        $stdout.puts msg
+        return unless CLI.verbose?
+
+        if CLI.dry_run?
+          $stdout.puts "[DRY RUN] #{msg}"
+        else
+          $stdout.puts msg
+        end
       end
 
       def base_parser
@@ -35,6 +43,11 @@ module RubyNext
           opts.on("-V", "Turn on verbose mode") do
             CLI.verbose = true
           end
+
+          opts.on("--dry-run", "Print verbose output without generating files") do
+            CLI.dry_run = true
+            CLI.verbose = true
+          end
         end
       end
     end

data/lib/ruby-next/commands/core_ext.rb

@@ -69,7 +69,7 @@ module RubyNext
         RubyNext::Core.patches.extensions
           .values
           .flatten
-          .filter do |patch|
+          .select do |patch|
           next if min_version && Gem::Version.new(patch.version) <= min_version
           next if filter && !filter.match?(patch.name)
           true
@@ -136,8 +136,10 @@ module RubyNext
 
         return $stdout.puts(contents) if out_path == "stdout"
 
-        FileUtils.mkdir_p File.dirname(out_path)
-        File.write(out_path, contents)
+        unless CLI.dry_run?
+          FileUtils.mkdir_p File.dirname(out_path)
+          File.write(out_path, contents)
+        end
 
         log "Generated: #{out_path}"
       end

data/lib/ruby-next/commands/nextify.rb

@@ -14,6 +14,10 @@ module RubyNext
 
       def run
         log "RubyNext core strategy: #{RubyNext::Core.strategy}"
+        log "RubyNext transpile mode: #{RubyNext::Language.mode}"
+
+        remove_rbnext!
+
         paths.each do |path|
           contents = File.read(path)
           transpile path, contents
@@ -64,6 +68,8 @@ module RubyNext
           end
         end
 
+        optparser.parse!(args)
+
         @lib_path = args[0]
 
         if print_help
@@ -72,12 +78,11 @@ module RubyNext
         end
 
         unless lib_path&.then(&File.method(:exist?))
+          $stdout.puts "Path not found: #{lib_path}"
           $stdout.puts optparser.help
           exit 2
         end
 
-        optparser.parse!(args)
-
         @paths =
           if File.directory?(lib_path)
             Dir[File.join(lib_path, "**/*.rb")]
@@ -94,7 +99,13 @@ module RubyNext
         rewriters = Language.rewriters.select { |rw| rw.unsupported_version?(version) }
 
         context = Language::TransformContext.new
-        new_contents = Language.transform contents, context: context, rewriters: rewriters
+
+        new_contents =
+          if Gem::Version.new(version) >= Gem::Version.new("2.7.0") && !defined?(Unparser::Emitter::CaseMatch)
+            Language.rewrite contents, context: context, rewriters: rewriters
+          else
+            Language.transform contents, context: context, rewriters: rewriters
+          end
 
         return unless context.dirty?
 
@@ -111,34 +122,45 @@ module RubyNext
       end
 
       def save(contents, path, version)
-        return $stdout.puts(contents) if out_path == "stdout"
+        return $stdout.puts(contents) if stdout?
 
         paths = [Pathname.new(path).relative_path_from(Pathname.new(lib_path))]
 
         paths.unshift(version.segments[0..1].join(".")) unless single_version?
 
         next_path =
-          if out_path
-            if out_path.end_with?(".rb")
-              out_path
-            else
-              File.join(out_path, *paths)
-            end
+          if next_dir_path.end_with?(".rb")
+            out_path
           else
-            File.join(
-              lib_path,
-              RUBY_NEXT_DIR,
-              *paths
-            )
+            File.join(next_dir_path, *paths)
           end
 
-        FileUtils.mkdir_p File.dirname(next_path)
+        unless CLI.dry_run?
+          FileUtils.mkdir_p File.dirname(next_path)
 
-        File.write(next_path, contents)
+          File.write(next_path, contents)
+        end
 
         log "Generated: #{next_path}"
       end
 
+      def remove_rbnext!
+        return if CLI.dry_run? || stdout?
+
+        return unless File.directory?(next_dir_path)
+
+        log "Remove old files: #{next_dir_path}"
+        FileUtils.rm_r(next_dir_path)
+      end
+
+      def next_dir_path
+        @next_dir_path ||= (out_path || File.join(lib_path, RUBY_NEXT_DIR))
+      end
+
+      def stdout?
+        out_path == "stdout"
+      end
+
       alias single_version? single_version
     end
   end

data/lib/ruby-next/core.rb

@@ -2,6 +2,8 @@
 
 require "set"
 
+require_relative "utils"
+
 module RubyNext
   module Core
     # Patch contains the extension implementation
@@ -95,7 +97,7 @@ module RubyNext
     end
 
     class << self
-      STRATEGIES = %i[refine core_ext].freeze
+      STRATEGIES = %i[refine core_ext backports].freeze
 
       attr_reader :strategy
 
@@ -109,7 +111,11 @@ module RubyNext
       end
 
       def core_ext?
-        strategy == :core_ext
+        strategy == :core_ext || strategy == :backports
+      end
+
+      def backports?
+        strategy == :backports
       end
 
       def patch(*args, **kwargs, &block)
@@ -136,6 +142,8 @@ module RubyNext
   end
 end
 
+require "backports/2.5" if RubyNext::Core.backports?
+
 require_relative "core/kernel/then"
 
 require_relative "core/proc/compose"
@@ -176,6 +184,9 @@ require_relative "core/struct/deconstruct_keys"
 # Generate refinements
 RubyNext.module_eval do
   RubyNext::Core.patches.refined.each do |mod, patches|
+    # Only refine modules when supported
+    next unless mod.is_a?(Class) || RubyNext::Utils.refine_modules?
+
     refine mod do
       patches.each do |patch|
         module_eval(patch.body, *patch.location)

data/lib/ruby-next/core/time/ceil.rb

@@ -3,7 +3,8 @@
 RubyNext::Core.patch Time, method: :ceil, version: "2.7" do
   <<~'RUBY'
     def ceil(den = 0)
-      change = subsec.ceil(den) - subsec
+      sceil = (subsec * 10**den).ceil.to_r / 10**den
+      change = sceil - subsec
       self + change
     end
   RUBY

data/lib/ruby-next/core_ext.rb

@@ -15,4 +15,4 @@ RubyNext::Core.patches.extensions.each do |mod, patches|
   end
 end
 
-RubyNext::Core.strategy = :core_ext
+RubyNext::Core.strategy = :core_ext unless RubyNext::Core.core_ext?

data/lib/ruby-next/language.rb

@@ -1,6 +1,6 @@
 # frozen_string_literal: true
 
-gem "ruby-next-parser", ">= 2.8.0.0"
+gem "ruby-next-parser", ">= 2.8.0.3"
 gem "unparser", ">= 0.4.7"
 
 require "set"
@@ -83,6 +83,14 @@ module RubyNext
       end
 
       def runtime!
+        require "ruby-next/language/rewriters/runtime"
+
+        if Gem::Version.new(RUBY_VERSION) >= Gem::Version.new("2.7.0") && !defined?(Unparser::Emitter::CaseMatch)
+          RubyNext.warn "Ruby Next fallbacks to \"rewrite\" transpiling mode since Unparser doesn't support 2.7 AST yet.\n" \
+            "See https://github.com/mbj/unparser/pull/142"
+          self.mode = :rewrite
+        end
+
         @runtime = true
       end
 

data/lib/ruby-next/language/edge.rb

@@ -1,3 +1,9 @@
 # frozen_string_literal: true
 
 # Load edge Ruby features
+
+require "ruby-next/language/rewriters/endless_method"
+RubyNext::Language.rewriters << RubyNext::Language::Rewriters::EndlessMethod
+
+require "ruby-next/language/rewriters/right_hand_assignment"
+RubyNext::Language.rewriters << RubyNext::Language::Rewriters::RightHandAssignment

data/lib/ruby-next/language/eval.rb

@@ -3,14 +3,16 @@
 module RubyNext
   module Language
     module KernelEval
-      refine Kernel do
-        def eval(source, bind = nil, *args)
-          new_source = ::RubyNext::Language::Runtime.transform(
-            source,
-            using: bind&.receiver == TOPLEVEL_BINDING.receiver || bind&.receiver&.is_a?(Module)
-          )
-          RubyNext.debug_source(new_source, "(#{caller_locations(1, 1).first})")
-          super new_source, bind, *args
+      if Utils.refine_modules?
+        refine Kernel do
+          def eval(source, bind = nil, *args)
+            new_source = ::RubyNext::Language::Runtime.transform(
+              source,
+              using: bind&.receiver == TOPLEVEL_BINDING.receiver || bind&.receiver&.is_a?(Module)
+            )
+            RubyNext.debug_source(new_source, "(#{caller_locations(1, 1).first})")
+            super new_source, bind, *args
+          end
         end
       end
     end

data/lib/ruby-next/language/parser.rb

@@ -23,6 +23,8 @@ module RubyNext
         end
 
         parser.parse(buffer)
+      rescue ::Parser::SyntaxError => e
+        raise ::SyntaxError, e.message
       end
 
       def parse_with_comments(source, file = "(string)")
@@ -31,6 +33,8 @@ module RubyNext
         end
 
         parser.parse_with_comments(buffer)
+      rescue ::Parser::SyntaxError => e
+        raise ::SyntaxError, e.message
       end
     end
   end

data/lib/ruby-next/language/rewriters/args_forward.rb

@@ -25,21 +25,23 @@ module RubyNext
         end
 
         def on_send(node)
-          return unless node.children[2]&.type == :forwarded_args
+          return super(node) unless node.children[2]&.type == :forwarded_args
 
           replace(node.children[2].loc.expression, "*#{REST}, &#{BLOCK}")
 
-          node.updated(
-            nil,
-            [
-              *node.children[0..1],
-              *forwarded_args
-            ]
+          process(
+            node.updated(
+              nil,
+              [
+                *node.children[0..1],
+                *forwarded_args
+              ]
+            )
           )
         end
 
         def on_super(node)
-          return unless node.children[0]&.type == :forwarded_args
+          return super(node) unless node.children[0]&.type == :forwarded_args
 
           replace(node.children[0].loc.expression, "*#{REST}, &#{BLOCK}")
 

data/lib/ruby-next/language/rewriters/base.rb

@@ -59,7 +59,7 @@ module RubyNext
           def unsupported_syntax?
             save_verbose, $VERBOSE = $VERBOSE, nil
             eval_mid = Kernel.respond_to?(:eval_without_ruby_next) ? :eval_without_ruby_next : :eval
-            Kernel.send eval_mid, self::SYNTAX_PROBE
+            Kernel.send eval_mid, self::SYNTAX_PROBE, nil, __FILE__, __LINE__
             false
           rescue SyntaxError, NameError
             true
@@ -78,10 +78,6 @@ module RubyNext
           def transform(source)
             Language.transform(source, rewriters: [self], using: false)
           end
-
-          def warn_custom_parser_required_for(feature)
-            RubyNext.warn(CUSTOM_PARSER_REQUIRED % feature)
-          end
         end
 
         attr_reader :locals

data/lib/ruby-next/language/rewriters/endless_method.rb

@@ -0,0 +1,40 @@
+# frozen_string_literal: true
+
+module RubyNext
+  module Language
+    module Rewriters
+      class EndlessMethod < Base
+        SYNTAX_PROBE = "obj = Object.new; def obj.foo() = 42"
+        MIN_SUPPORTED_VERSION = Gem::Version.new("2.8.0")
+
+        def on_def_e(node)
+          context.track! self
+
+          replace(node.loc.assignment, "; ")
+          insert_after(node.loc.expression, "; end")
+
+          process(
+            node.updated(
+              :def,
+              node.children
+            )
+          )
+        end
+
+        def on_defs_e(node)
+          context.track! self
+
+          replace(node.loc.assignment, "; ")
+          insert_after(node.loc.expression, "; end")
+
+          process(
+            node.updated(
+              :defs,
+              node.children
+            )
+          )
+        end
+      end
+    end
+  end
+end

data/lib/ruby-next/language/rewriters/method_reference.rb

@@ -28,12 +28,6 @@ module RubyNext
             ]
           )
         end
-
-        begin
-          transform(SYNTAX_PROBE)
-        rescue ::Parser::SyntaxError
-          warn_custom_parser_required_for("method reference")
-        end
       end
     end
   end

data/lib/ruby-next/language/rewriters/pattern_matching.rb

@@ -816,11 +816,12 @@ module RubyNext
         end
 
         def respond_to_missing?(mid, *)
-          return true if mid.match?(/_(clause|array_element)/)
+          return true if mid.to_s.match?(/_(clause|array_element)/)
           super
         end
 
         def method_missing(mid, *args, &block)
+          mid = mid.to_s
           return case_eq_clause(*args) if mid.match?(/_clause$/)
           return case_eq_array_element(*args) if mid.match?(/_array_element$/)
           return case_eq_hash_element(*args) if mid.match?(/_hash_element$/)

data/lib/ruby-next/language/rewriters/right_hand_assignment.rb

@@ -0,0 +1,44 @@
+# frozen_string_literal: true
+
+module RubyNext
+  module Language
+    module Rewriters
+      class RightHandAssignment < Base
+        SYNTAX_PROBE = "1 + 2 => a"
+        MIN_SUPPORTED_VERSION = Gem::Version.new("2.8.0")
+
+        def on_rasgn(node)
+          context.track! self
+
+          val_node, asgn_node = *node
+
+          remove(val_node.loc.expression.end.join(asgn_node.loc.expression))
+          insert_before(val_node.loc.expression, "#{asgn_node.loc.expression.source} = ")
+
+          process(
+            asgn_node.updated(
+              nil,
+              asgn_node.children + [val_node]
+            )
+          )
+        end
+
+        def on_mrasgn(node)
+          context.track! self
+
+          lhs, rhs = *node
+
+          replace(lhs.loc.expression.end.join(rhs.loc.expression), ")")
+          insert_before(lhs.loc.expression, "#{rhs.loc.expression.source} = (")
+
+          process(
+            node.updated(
+              :masgn,
+              [rhs, lhs]
+            )
+          )
+        end
+      end
+    end
+  end
+end

data/lib/ruby-next/language/rewriters/runtime.rb

@@ -0,0 +1,6 @@
+# frozen_string_literal: true
+
+# Load rewriters only required for runtime transpiling
+
+require "ruby-next/language/rewriters/runtime/dir"
+RubyNext::Language.rewriters << RubyNext::Language::Rewriters::Dir

data/lib/ruby-next/language/rewriters/runtime/dir.rb

@@ -0,0 +1,32 @@
+# frozen_string_literal: true
+
+module RubyNext
+  module Language
+    module Rewriters
+      # Special rewriter for Ruby <=2.3, which doesn't support __dir__ in iseq.eval
+      class Dir < Base
+        SYNTAX_PROBE = "defined?(RubyVM::InstructionSequence) && RubyVM::InstructionSequence.compile('raise SyntaxError if __dir__.nil?', 'test.rb').eval"
+        MIN_SUPPORTED_VERSION = Gem::Version.new("2.4.0")
+
+        def on_send(node)
+          return super(node) unless node.children[1] == :__dir__
+
+          context.track! self
+
+          replace(node.loc.expression, "File.dirname(__FILE__)")
+
+          process(
+            node.updated(
+              nil,
+              [
+                s(:const, nil, :File),
+                :dirname,
+                s(:send, nil, "__FILE__")
+              ]
+            )
+          )
+        end
+      end
+    end
+  end
+end

data/lib/ruby-next/language/runtime.rb

@@ -42,7 +42,7 @@ module RubyNext
           path
         end
 
-        if defined?(JRUBY_VERSION)
+        if defined?(JRUBY_VERSION) || defined?(TruffleRuby)
           def evaluate(code, filepath)
             new_toplevel.eval(code, filepath)
           end
@@ -89,7 +89,8 @@ module Kernel
 
   alias_method :require_relative_without_ruby_next, :require_relative
   def require_relative(path)
-    from = caller_locations(1..1).first.absolute_path || File.join(Dir.pwd, "main")
+    loc = caller_locations(1..1).first
+    from = loc.absolute_path || loc.path || File.join(Dir.pwd, "main")
     realpath = File.absolute_path(
       File.join(
         File.dirname(File.absolute_path(from)),

data/lib/ruby-next/language/setup.rb

@@ -5,6 +5,21 @@ require "ruby-next"
 
 module RubyNext
   module Language
+    # Module responsible for transpiling a library at load time
+    module GemTranspiler
+      def self.maybe_transpile(root_dir, lib_dir, target_dir)
+        return if File.directory?(target_dir)
+
+        Dir.chdir(root_dir) do
+          unless system("bundle exec ruby-next nextify ./#{lib_dir} -o #{target_dir} > /dev/null 2>&1")
+            RubyNext.warn "Traspiled files are missing in: #{target_dir}. \n" \
+              "Make sure you have gem 'ruby-next' in your Gemfile to auto-transpile the required files from source on load. " \
+              "Otherwise the code from #{root_dir} may not work correctly."
+          end
+        end
+      end
+    end
+
     class << self
       unless method_defined?(:runtime?)
         def runtime?
@@ -12,7 +27,7 @@ module RubyNext
         end
       end
 
-      def setup_gem_load_path(lib_dir = "lib", rbnext_dir: RUBY_NEXT_DIR)
+      def setup_gem_load_path(lib_dir = "lib", rbnext_dir: RUBY_NEXT_DIR, transpile: false)
         called_from = caller_locations(1, 1).first.path
         dirname = File.dirname(called_from)
 
@@ -29,6 +44,10 @@ module RubyNext
 
         return if Language.runtime? && Language.watch_dirs.include?(dirname)
 
+        next_dirname = File.join(dirname, rbnext_dir)
+
+        GemTranspiler.maybe_transpile(File.dirname(dirname), lib_dir, next_dirname) if transpile
+
         current_index = $LOAD_PATH.index(dirname)
 
         raise "Gem's lib is not in the $LOAD_PATH: #{dirname}" if current_index.nil?
@@ -38,7 +57,7 @@ module RubyNext
         loop do
           break unless version
 
-          version_dir = File.join(dirname, rbnext_dir, version.segments[0..1].join("."))
+          version_dir = File.join(next_dirname, version.segments[0..1].join("."))
 
           if File.exist?(version_dir)
             $LOAD_PATH.insert current_index, version_dir

data/lib/ruby-next/logging.rb

@@ -38,6 +38,6 @@ module RubyNext
     attr_reader :debug_filter
   end
 
-  self.silence_warnings = ENV["RUBY_NEXT_WARN"] != "false"
+  self.silence_warnings = ENV["RUBY_NEXT_WARN"] == "false"
   self.debug_enabled = ENV["RUBY_NEXT_DEBUG"]
 end

data/lib/ruby-next/rubocop.rb

@@ -84,6 +84,32 @@ module RuboCop
           send(:"on_#{child.type}", child)
         end
       end
+
+      unless method_defined?(:on_def_e)
+        def on_def_e(node)
+          _name, _args_node, body_node = *node
+          send(:"on_#{body_node.type}", body_node)
+        end
+
+        def on_defs_e(node)
+          _definee_node, _name, _args_node, body_node = *node
+          send(:"on_#{body_node.type}", body_node)
+        end
+      end
+
+      unless method_defined?(:on_rasgn)
+        def on_rasgn(node)
+          val_node, asgn_node = *node
+          send(:"on_#{asgn_node.type}", asgn_node)
+          send(:"on_#{val_node.type}", val_node)
+        end
+
+        def on_mrasgn(node)
+          lhs, rhs = *node
+          send(:"on_#{lhs.type}", lhs)
+          send(:"on_#{rhs.type}", rhs)
+        end
+      end
     end
   end
 end

data/lib/ruby-next/utils.rb

@@ -33,5 +33,35 @@ module RubyNext
         lines.unshift "   0:  # source: #{path}"
       end
     end
+
+    # Returns true if modules refinement is supported in current version
+    def refine_modules?
+      @refine_modules ||=
+        begin
+          # Make sure that including modules within refinements works
+          # See https://github.com/oracle/truffleruby/issues/2026
+          eval <<~RUBY, TOPLEVEL_BINDING, __FILE__, __LINE__ + 1
+            module RubyNext::Utils::A; end
+            class RubyNext::Utils::B
+              include RubyNext::Utils::A
+            end
+
+            using(Module.new do
+              refine RubyNext::Utils::A do
+                include(Module.new do
+                  def i_am_refinement
+                    "yes, you are!"
+                  end
+                end)
+              end
+            end)
+
+            RubyNext::Utils::B.new.i_am_refinement
+          RUBY
+          true
+        rescue TypeError, NoMethodError
+          false
+        end
+    end
   end
 end

data/lib/ruby-next/version.rb

@@ -1,5 +1,5 @@
 # frozen_string_literal: true
 
 module RubyNext
-  VERSION = "0.6.0"
+  VERSION = "0.9.1"
 end

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: ruby-next-core
 version: !ruby/object:Gem::Version
-  version: 0.6.0
+  version: 0.9.1
 platform: ruby
 authors:
 - Vladimir Dementyev
 autorequire: 
 bindir: bin
 cert_chain: []
-date: 2020-04-23 00:00:00.000000000 Z
+date: 2020-06-05 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: ruby-next-parser
@@ -16,14 +16,14 @@ dependencies:
     requirements:
     - - ">="
       - !ruby/object:Gem::Version
-        version: 2.8.0.0
+        version: 2.8.0.6
   type: :development
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
     - - ">="
       - !ruby/object:Gem::Version
-        version: 2.8.0.0
+        version: 2.8.0.6
 - !ruby/object:Gem::Dependency
   name: unparser
   requirement: !ruby/object:Gem::Requirement
@@ -90,10 +90,14 @@ files:
 - lib/ruby-next/language/proposed.rb
 - lib/ruby-next/language/rewriters/args_forward.rb
 - lib/ruby-next/language/rewriters/base.rb
+- lib/ruby-next/language/rewriters/endless_method.rb
 - lib/ruby-next/language/rewriters/endless_range.rb
 - lib/ruby-next/language/rewriters/method_reference.rb
 - lib/ruby-next/language/rewriters/numbered_params.rb
 - lib/ruby-next/language/rewriters/pattern_matching.rb
+- lib/ruby-next/language/rewriters/right_hand_assignment.rb
+- lib/ruby-next/language/rewriters/runtime.rb
+- lib/ruby-next/language/rewriters/runtime/dir.rb
 - lib/ruby-next/language/runtime.rb
 - lib/ruby-next/language/setup.rb
 - lib/ruby-next/language/unparser.rb
@@ -119,7 +123,7 @@ required_ruby_version: !ruby/object:Gem::Requirement
   requirements:
   - - ">="
     - !ruby/object:Gem::Version
-      version: 2.5.0
+      version: 2.3.0
 required_rubygems_version: !ruby/object:Gem::Requirement
   requirements:
   - - ">="