parser 2.7.1.5 → 3.0.2.0

data/CONTRIBUTING.md

@@ -1,17 +0,0 @@
-Contributing to Parser
-----------------------
-
-Parser employs a script to extract information from VCS (git) log and form a Changelog file. Thus, each commit which affects the public API in any way must be marked with one of the following sigils, or characters at the beginning of line:
-
- * `-` for bugfixes. For example: `- lexer.rl: fixed lexing of "alias $foo $bar".`
- * `+` for features. For example: `+ Implemented Parser::Rewriter, a module for non-intrusive rewriting of source code.`
- * `*` for miscellaneous changes. For example: `* Converted measurement units from metric to imperial.`
-
-Versioning
-----------
-
-Parser is versioned as follows:
- * The version starts with the most recent Ruby version that Parser supports (which should be also the most recent released Ruby version).
- * After that, a `.x` is appended, where `x` is incremented for every change.
-
-No breaking changes to API will be ever made, except for changes that correct behavior which did not match documentation or Ruby MRI behavior.

data/Gemfile

@@ -1,10 +0,0 @@
-# frozen_string_literal: true
-
-source 'https://rubygems.org'
-
-# Specify your gem's dependencies in parser.gemspec
-gemspec
-
-# Workaround for bug in Bundler on JRuby
-# See https://github.com/bundler/bundler/issues/4157
-gem 'ast', '>= 1.1', '< 3.0'

data/README.md

@@ -1,309 +0,0 @@
-# Parser
-
-[![Gem Version](https://badge.fury.io/rb/parser.svg)](https://badge.fury.io/rb/parser)
-[![Build Status](https://travis-ci.org/whitequark/parser.svg?branch=master)](https://travis-ci.org/whitequark/parser)
-
-_Parser_ is a production-ready Ruby parser written in pure Ruby. It recognizes as
-much or more code than Ripper, Melbourne, JRubyParser or ruby\_parser, and
-is vastly more convenient to use.
-
-You can also use [unparser](https://github.com/mbj/unparser) to produce
-equivalent source code from Parser's ASTs.
-
-Sponsored by [Evil Martians](http://evilmartians.com).
-MacRuby and RubyMotion support sponsored by [CodeClimate](http://codeclimate.com).
-
-## Installation
-
-    $ gem install parser
-
-## Usage
-
-Load Parser (see the [backwards compatibility](#backwards-compatibility) section
-below for explanation of `emit_*` calls):
-
-    require 'parser/current'
-    # opt-in to most recent AST format:
-    Parser::Builders::Default.emit_lambda              = true
-    Parser::Builders::Default.emit_procarg0            = true
-    Parser::Builders::Default.emit_encoding            = true
-    Parser::Builders::Default.emit_index               = true
-    Parser::Builders::Default.emit_arg_inside_procarg0 = true
-    Parser::Builders::Default.emit_forward_arg         = true
-
-Parse a chunk of code:
-
-    p Parser::CurrentRuby.parse("2 + 2")
-    # (send
-    #   (int 2) :+
-    #   (int 2))
-
-Access the AST's source map:
-
-    p Parser::CurrentRuby.parse("2 + 2").loc
-    # #<Parser::Source::Map::Send:0x007fe5a1ac2388
-    #   @dot=nil,
-    #   @begin=nil,
-    #   @end=nil,
-    #   @selector=#<Source::Range (string) 2...3>,
-    #   @expression=#<Source::Range (string) 0...5>>
-
-    p Parser::CurrentRuby.parse("2 + 2").loc.selector.source
-    # "+"
-
-Traverse the AST: see the documentation for [gem ast](https://whitequark.github.io/ast/).
-
-Parse a chunk of code and display all diagnostics:
-
-    parser = Parser::CurrentRuby.new
-    parser.diagnostics.consumer = lambda do |diag|
-      puts diag.render
-    end
-
-    buffer = Parser::Source::Buffer.new('(string)', source: "foo *bar")
-
-    p parser.parse(buffer)
-    # (string):1:5: warning: `*' interpreted as argument prefix
-    # foo *bar
-    #     ^
-    # (send nil :foo
-    #   (splat
-    #     (send nil :bar)))
-
-If you reuse the same parser object for multiple `#parse` runs, you need to
-`#reset` it.
-
-You can also use the `ruby-parse` utility (it's bundled with the gem) to play
-with Parser:
-
-    $ ruby-parse -L -e "2+2"
-    (send
-      (int 2) :+
-      (int 2))
-    2+2
-     ~ selector
-    ~~~ expression
-    (int 2)
-    2+2
-    ~ expression
-    (int 2)
-    2+2
-
-    $ ruby-parse -E -e "2+2"
-    2+2
-    ^ tINTEGER 2                                    expr_end     [0 <= cond] [0 <= cmdarg]
-    2+2
-     ^ tPLUS "+"                                    expr_beg     [0 <= cond] [0 <= cmdarg]
-    2+2
-      ^ tINTEGER 2                                  expr_end     [0 <= cond] [0 <= cmdarg]
-    2+2
-      ^ false "$eof"                                expr_end     [0 <= cond] [0 <= cmdarg]
-    (send
-      (int 2) :+
-      (int 2))
-
-## Features
-
-* Precise source location reporting.
-* [Documented](doc/AST_FORMAT.md) AST format which is convenient to work with.
-* A simple interface and a powerful, tweakable one.
-* Parses 1.8, 1.9, 2.0, 2.1, 2.2 and 2.3 syntax with backwards-compatible
-  AST formats.
-* Parses MacRuby and RubyMotion syntax extensions.
-* [Rewriting][rewriting] support.
-* Parsing error recovery.
-* Improved [clang-like][] diagnostic messages with location information.
-* Written in pure Ruby, runs on MRI >=2.0.0, JRuby and Rubinius (and historically, all versions of Ruby since 1.8)
-* Only one runtime dependency: the [ast][] gem.
-* [Insane][insane-lexer] Ruby lexer rewritten from scratch in Ragel.
-* 100% test coverage for Bison grammars (except error recovery).
-* Readable, commented source code.
-
-[clang-like]: http://clang.llvm.org/diagnostics.html
-[ast]: https://rubygems.org/gems/ast
-[insane-lexer]: http://whitequark.org/blog/2013/04/01/ruby-hacking-guide-ch-11-finite-state-lexer/
-[rewriting]: http://whitequark.org/blog/2013/04/26/lets-play-with-ruby-code/
-
-## Documentation
-
-Documentation for Parser is available [online](https://whitequark.github.io/parser/).
-
-### Node names
-
-Several Parser nodes seem to be confusing enough to warrant a dedicated README section.
-
-#### (block)
-
-The `(block)` node passes a Ruby block, that is, a closure, to a method call represented by its first child, a `(send)`, `(super)` or `(zsuper)` node. To demonstrate:
-
-```
-$ ruby-parse -e 'foo { |x| x + 2 }'
-(block
-  (send nil :foo)
-  (args
-    (arg :x))
-  (send
-    (lvar :x) :+
-    (int 2)))
-```
-
-#### (begin) and (kwbegin)
-
-**TL;DR: Unless you perform rewriting, treat `(begin)` and `(kwbegin)` as the same node type.**
-
-Both `(begin)` and `(kwbegin)` nodes represent compound statements, that is, several expressions which are executed sequentally and the value of the last one is the value of entire compound statement. They may take several forms in the source code:
-
-  * `foo; bar`: without delimiters
-  * `(foo; bar)`: parenthesized
-  * `begin foo; bar; end`: grouped with `begin` keyword
-  * `def x; foo; bar; end`: grouped inside a method definition
-
-and so on.
-
-```
-$ ruby-parse -e '(foo; bar)'
-(begin
-  (send nil :foo)
-  (send nil :bar))
-$ ruby-parse -e 'def x; foo; bar end'
-(def :x
-  (args)
-  (begin
-    (send nil :foo)
-    (send nil :bar)))
-```
-
-Note that, despite its name, `kwbegin` node only has tangential relation to the `begin` keyword. Normally, Parser AST is semantic, that is, if two constructs look differently but behave identically, they get parsed to the same node. However, there exists a peculiar construct called post-loop in Ruby:
-
-```
-begin
-  body
-end while condition
-```
-
-This specific syntactic construct, that is, keyword `begin..end` block followed by a postfix `while`, [behaves][postloop] very unlike other similar constructs, e.g. `(body) while condition`. While the body itself is wrapped into a `while-post` node, Parser also supports rewriting, and in that context it is important to not accidentally convert one kind of loop into another.
-
-  [postloop]: http://rosettacode.org/wiki/Loops/Do-while#Ruby
-
-```
-$ ruby-parse -e 'begin foo end while cond'
-(while-post
-  (send nil :cond)
-  (kwbegin
-    (send nil :foo)))
-$ ruby-parse -e 'foo while cond'
-(while
-  (send nil :cond)
-  (send nil :foo))
-$ ruby-parse -e '(foo) while cond'
-(while
-  (send nil :cond)
-  (begin
-    (send nil :foo)))
-```
-
-(Parser also needs the `(kwbegin)` node type internally, and it is highly problematic to map it back to `(begin)`.)
-
-## Backwards compatibility
-
-Parser does _not_ use semantic versioning. Parser versions are structured as `x.y.z.t`,
-where `x.y.z` indicates the most recent supported Ruby release (support for every
-Ruby release that is chronologically earlier is implied), and `t` is a monotonically
-increasing number.
-
-The public API of Parser as well as the AST format (as listed in the documentation)
-are considered stable forever, although support for old Ruby versions may be removed
-at some point.
-
-Sometimes it is necessary to modify the format of AST nodes that are already being emitted
-in a way that would break existing applications. To avoid such breakage, applications
-must opt-in to these modifications; without explicit opt-in, Parser will continue to emit
-the old AST node format. The most recent set of opt-ins is specified in
-the [usage section](#usage) of this README.
-
-## Compatibility with Ruby MRI
-
-Unfortunately, Ruby MRI often changes syntax in patchlevel versions. This has happened, at least, for every release since 1.9; for example, commits [c5013452](https://github.com/ruby/ruby/commit/c501345218dc5fb0fae90d56a0c6fd19d38df5bb) and [04bb9d6b](https://github.com/ruby/ruby/commit/04bb9d6b75a55d4000700769eead5a5cb942c25b) were backported all the way from HEAD to 1.9. Moreover, there is no simple way to track these changes.
-
-This policy makes it all but impossible to make Parser precisely compatible with the Ruby MRI parser. Indeed, at September 2014, it would be necessary to maintain and update ten different parsers together with their lexer quirks in order to be able to emulate any given released Ruby MRI version.
-
-As a result, Parser chooses a different path: the `parser/rubyXY` parsers recognize the syntax of the latest minor version of Ruby MRI X.Y at the time of the gem release.
-
-## Compatibility with MacRuby and RubyMotion
-
-Parser implements the MacRuby 0.12 and RubyMotion mid-2015 parsers precisely. However, the lexers of these have been forked off Ruby MRI and independently maintained for some time, and because of that, Parser may accept some code that these upstream implementations are unable to parse.
-
-## Known issues
-
-Adding support for the following Ruby MRI features in Parser would needlessly complicate it, and as they all are very specific and rarely occurring corner cases, this is not done.
-
-Parser has been extensively tested; in particular, it parses almost entire [Rubygems][rg] corpus. For every issue, a breakdown of affected gems is offered.
-
- [rg]: https://rubygems.org
-
-### Void value expressions
-
-Ruby MRI prohibits so-called "void value expressions". For a description
-of what a void value expression is, see [this
-gist](https://gist.github.com/JoshCheek/5625007) and [this Parser
-issue](https://github.com/whitequark/parser/issues/72).
-
-It is unknown whether any gems are affected by this issue.
-
-### Invalid characters inside comments and literals
-
-Ruby MRI permits arbitrary non-7-bit byte sequences to appear in comments, as well as in string or symbol literals in form of escape sequences, regardless of source encoding. Parser requires all source code, including the expanded escape sequences, to consist of valid byte sequences in the source encoding that are convertible to UTF-8.
-
-As of 2013-07-25, there are about 180 affected gems.
-
-### \u escape in 1.8 mode
-
-Ruby MRI 1.8 permits to specify a bare `\u` escape sequence in a string; it treats it like `u`. Ruby MRI 1.9 and later treat `\u` as a prefix for Unicode escape sequence and do not allow it to appear bare. Parser follows 1.9+ behavior.
-
-As of 2013-07-25, affected gems are: activerdf, activerdf_net7, fastreader, gkellog-reddy.
-
-### Dollar-dash
-
-(This one is so obscure I couldn't even think of a saner name for this issue.) Pre-2.1 Ruby allows
-to specify a global variable named `$-`. Ruby 2.1 and later treat it as a syntax error. Parser
-follows 2.1 behavior.
-
-No known code is affected by this issue.
-
-### EOF characters after embedded documents before 2.7
-
-Code like `"=begin\n""=end\0"` is invalid for all versions of Ruby before 2.7. Ruby 2.7 and later parses it
-normally. Parser follows 2.7 behavior.
-
-It is unknown whether any gems are affected by this issue.
-
-## Contributors
-
-* [whitequark][]
-* Markus Schirp ([mbj][])
-* Yorick Peterse ([yorickpeterse][])
-* Magnus Holm ([judofyr][])
-* Bozhidar Batsov ([bbatsov][])
-
-[whitequark]:     https://github.com/whitequark
-[mbj]:            https://github.com/mbj
-[yorickpeterse]:  https://github.com/yorickpeterse
-[judofyr]:        https://github.com/judofyr
-[bbatsov]:        https://github.com/bbatsov
-
-## Acknowledgements
-
-The lexer testsuite is derived from
-[ruby\_parser](https://github.com/seattlerb/ruby_parser).
-
-The Bison parser rules are derived from [Ruby MRI](https://github.com/ruby/ruby)
-parse.y.
-
-## Contributing
-
-1. Make sure you have [Ragel ~> 6.7](http://www.complang.org/ragel/) installed
-2. Fork it
-3. Create your feature branch (`git checkout -b my-new-feature`)
-4. Commit your changes (`git commit -am 'Add some feature'`)
-5. Push to the branch (`git push origin my-new-feature`)
-6. Create new Pull Request

data/Rakefile

@@ -1,167 +0,0 @@
-# encoding: utf-8
-# frozen_string_literal: true
-
-require 'bundler/gem_tasks'
-require 'rake/testtask'
-require 'rake/clean'
-require 'date'
-
-task :default => [:test]
-
-Rake::TestTask.new do |t|
-  t.libs       = %w(test/ lib/)
-  t.test_files = FileList["test/**/test_*.rb"]
-  t.warning    = true
-end
-
-task :test_cov do
-  ENV['COVERAGE'] = '1'
-  Rake::Task['test'].invoke
-end
-
-task :build => [:generate_release, :changelog]
-
-GENERATED_FILES = %w(lib/parser/lexer.rb
-                     lib/parser/ruby18.rb
-                     lib/parser/ruby19.rb
-                     lib/parser/ruby20.rb
-                     lib/parser/ruby21.rb
-                     lib/parser/ruby22.rb
-                     lib/parser/ruby23.rb
-                     lib/parser/ruby24.rb
-                     lib/parser/ruby25.rb
-                     lib/parser/ruby26.rb
-                     lib/parser/ruby27.rb
-                     lib/parser/ruby30.rb
-                     lib/parser/macruby.rb
-                     lib/parser/rubymotion.rb)
-
-CLEAN.include(GENERATED_FILES)
-
-ENCODING_COMMENT = "# -*- encoding:utf-8; warn-indent:false; frozen_string_literal: true  -*-\n"
-
-desc 'Generate the Ragel lexer and Racc parser.'
-task :generate => GENERATED_FILES do
-  Rake::Task[:ragel_check].invoke
-  GENERATED_FILES.each do |filename|
-    content = File.read(filename)
-    content = ENCODING_COMMENT + content unless content.start_with?(ENCODING_COMMENT)
-
-    File.open(filename, 'w') do |io|
-      io.write content
-    end
-  end
-end
-
-task :regenerate => [:clean, :generate]
-
-desc 'Generate the Ragel lexer and Racc parser in release mode.'
-task :generate_release => [:clean_env, :regenerate]
-
-task :clean_env do
-  ENV.delete 'RACC_DEBUG'
-end
-
-task :ragel_check do
-  require 'cliver'
-  Cliver.assert('ragel', '~> 6.7')
-end
-
-desc 'Generate YARD documentation'
-task :yard => :generate do
-  sh('yard doc')
-end
-
-PAGES_REPO = 'git@github.com:whitequark/parser'
-
-desc "Build and deploy documentation to GitHub pages"
-task :pages do
-  system "git clone #{PAGES_REPO} gh-temp/ -b gh-pages; rm gh-temp/* -rf; touch gh-temp/.nojekyll" or abort
-  system "yardoc -o gh-temp/;" or abort
-  system "cd gh-temp/; git add -A; git commit -m 'Updated pages.'; git push -f origin gh-pages" or abort
-  FileUtils.rm_rf 'gh-temp'
-end
-
-desc 'Generate Changelog'
-task :changelog do
-  fs     = "\u{fffd}"
-  format = "%d#{fs}%s#{fs}%an#{fs}%ai"
-
-  # Format: version => { commit-class => changes }
-  changelog = Hash.new do |hash, version|
-    hash[version] = Hash.new do |hash, klass|
-      hash[klass] = []
-    end
-  end
-
-  branch = `git describe HEAD --all`.strip.gsub(/.+\/([^\/]+)$/, '\1')
-
-  IO.popen("git log --pretty='#{format}' " \
-           "remotes/origin/2.0 remotes/origin/2.1 remotes/origin/2.2 #{branch}", 'r') do |io|
-    current_version = nil
-
-    io.each_line do |line|
-      version, message, author, date = line.
-            match(/^(?: \((.*)\))?#{fs}(.*)#{fs}(.*)#{fs}(.*)$/o).captures
-      date = Date.parse(date)
-
-      current_version = "#{$1} (#{date})" if version =~ /(v[\d\w.]+)/
-      current_version = "Not released (#{date})" \
-        if version =~ /(^| |\/)#{Regexp.escape branch}$/ && !branch.start_with?('v')
-
-      next if current_version.nil?
-      changelog[current_version] # add a hash
-
-      next if message !~ /^[+*-]/
-      changelog[current_version][message[0]] << "#{message[1..-1]} (#{author})"
-    end
-  end
-
-  commit_classes = {
-    '*' => 'API modifications:',
-    '+' => 'Features implemented:',
-    '-' => 'Bugs fixed:',
-  }
-
-  File.open('CHANGELOG.md', 'w') do |io|
-    io.puts 'Changelog'
-    io.puts '========='
-    io.puts
-
-    changelog.each do |version, commits|
-      next if commits.empty?
-      io.puts version
-      io.puts '-' * version.length
-      io.puts
-
-      commit_classes.each do |sigil, description|
-        next unless commits[sigil].any?
-
-        io.puts description
-        commits[sigil].uniq.each do |commit|
-          io.puts " * #{commit.gsub('<', '\<').lstrip}"
-        end
-        io.puts
-      end
-    end
-  end
-
-  sh('git commit CHANGELOG.md -m "Update changelog." || true')
-end
-
-rule '.rb' => '.rl' do |t|
-  sh "ragel -F1 -R #{t.source} -o #{t.name}"
-end
-
-rule '.rb' => '.y' do |t|
-  opts = [ "--superclass=Parser::Base",
-           t.source,
-           "-o", t.name
-         ]
-  opts << "--no-line-convert" unless ENV['RACC_DEBUG']
-  opts << "--debug" if ENV['RACC_DEBUG']
-
-  sh "racc", *opts
-end
-
-task :test => [:generate]