prism 0.23.0 → 0.25.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 21ba5f26f72f4d44a749e9afa3988a7844ae7b13bf9258bd6e9b907aa8a4941c
-  data.tar.gz: 469d952df74bbd51262e5c7945ddee1d9766eafe2091527c4a952e6de2eaba0c
+  metadata.gz: 15343c4f2d796d38ab23791193ad8e7caad9c1f53632fc6a6de0b1f842a09202
+  data.tar.gz: 0ef3cf6a5ed5853439e2854c4142e3f00e2a56b8e77e15c8b77bb759572745ff
 SHA512:
-  metadata.gz: f0a7686666636ac8a379a40415e6e8ce85d292afc8cc6e223d7157bc502ce24cfc635215f1e89623fac857056e399eaa5e8153337f31c2ecf3a770aa8c1db4e2
-  data.tar.gz: d5db770e2d47bbf85f044c461256f6c87eaf234e4c5bb8f11a848ca5a15e55654551879fa8db5a6e655ec506755a1f7cfdda1cfaafa2db0d9977886661e0b1a9
+  metadata.gz: 6d6e43bb22ed673caed7fb74e59f027a7781bfa55ff9b9d4fc386a547c615288e9d83b0e35482fa5cb8989365a6cf65b69d9d7b5e98bc42bf1603f557c80f859
+  data.tar.gz: 174c82145e87749e11e7bdbf99185f8383e51321556158b4a2379c315eee86c1c5de36ab843ef3e2ac153224c6a251bd40fdf613d928aded37b31cc05995d65e

data/BSDmakefile

@@ -0,0 +1,58 @@
+# GNU makefile proxy script for BSD make
+#
+# Written and maintained by Mahmoud Al-Qudsi <mqudsi@neosmart.net>
+# Copyright NeoSmart Technologies <https://neosmart.net/> 2014-2019
+# Obtain updates from <https://github.com/neosmart/gmake-proxy>
+#
+# Redistribution and use in source and binary forms, with or without
+# modification, are permitted provided that the following conditions are met:
+#
+# 1. Redistributions of source code must retain the above copyright notice, this
+# list of conditions and the following disclaimer.
+#
+# 2. Redistributions in binary form must reproduce the above copyright notice,
+# this list of conditions and the following disclaimer in the documentation
+# and/or other materials provided with the distribution.
+#
+# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
+# AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
+# IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+# DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE
+# FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
+# DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR
+# SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER
+# CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,
+# OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
+# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+
+JARG =
+GMAKE = "gmake"
+# When gmake is called from another make instance, -w is automatically added
+# which causes extraneous messages about directory changes to be emitted.
+# Running with --no-print-directory silences these messages.
+GARGS = "--no-print-directory"
+
+.if "$(.MAKE.JOBS)" != ""
+    JARG = -j$(.MAKE.JOBS)
+.endif
+
+# bmake prefers out-of-source builds and tries to cd into ./obj (among others)
+# where possible. GNU Make doesn't, so override that value.
+.OBJDIR: ./
+
+# The GNU convention is to use the lowercased `prefix` variable/macro to
+# specify the installation directory. Humor them.
+GPREFIX = ""
+.if defined(PREFIX) && ! defined(prefix)
+    GPREFIX = 'prefix = "$(PREFIX)"'
+.endif
+
+.BEGIN: .SILENT
+	which $(GMAKE) || printf "Error: GNU Make is required!\n\n" 1>&2 && false
+
+.PHONY: FRC
+$(.TARGETS): FRC
+	$(GMAKE) $(GPREFIX) $(GARGS) $(.TARGETS:S,.DONE,,) $(JARG)
+
+.DONE .DEFAULT: .SILENT
+	$(GMAKE) $(GPREFIX) $(GARGS) $(.TARGETS:S,.DONE,,) $(JARG)

data/CHANGELOG.md

@@ -6,6 +6,68 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/) a
 
 ## [Unreleased]
 
+## [0.25.0] - 2024-04-05
+
+### Added
+
+- `Prism::Translation::Ripper` is now able to mirror all of the Ripper APIs.
+- `Prism::Location#leading_comments` and `Prism::Location#trailing_comments` is added.
+- `Prism::Comment#slice` is added.
+- Warn for writing literal values in conditional predicates.
+- Check for `_POSIX_MAPPED_FILES` before using `mmap`.
+- `Prism::ItParametersNode` is added, to support `-> { it }`.
+- Parse integer and float literal values onto the tree.
+- Warn on duplicated hash keys and duplicated when clauses.
+- Ship much improved `RBI` and `RBS` types.
+- Support for the `-p`, `-n`, `-a`, and `-l` command line switches.
+- Warn on integer literals in flip-flops.
+- Support BSD make.
+- Add `Prism::WhenNode#then_keyword_loc`.
+- Support custom allocation functions through the `PRISM_XALLOCATOR` define.
+- Warn for certain keywrods at the end of the line.
+- Provide `pm_visit_node`, a C visitor API.
+- `Prism::parse_stream` is added, which works for any Ruby `IO` object.
+- Provide flags for regular expression literals for their derived encoding.
+- Provide flags for whether or not an interpolated string literal is frozen.
+- Add `Prism::StringNode.mutable?` for when a string is explicitly mutable, to support delineating chilled strings.
+- Warn for incorrect character literal syntax.
+- Warn for chained comparison operators.
+- Warn for `**` interpreted as an argument prefix.
+- Warn for `&` interpreted as an argument prefix.
+- `Prism::ShareableConstantNode` added to support ractors.
+- Warn for frozen string literals found after tokens.
+- Support `PRISM_BUILD_MINIMAL` to provide only the minimal necessary functionality to reduce the binary size.
+- Handle CLRF inside heredocs, strings, and regular expressions.
+- Mark inner strings in interpolated strings as frozen.
+- Support the `-x` command line switch.
+- Error messages now much more closely mirror CRuby.
+- Provide syntax errors for invalid block exits (`break`, `next`, `retry`, and `yield`).
+- Warn on unused local variables.
+- Do not syntax error on default parameter values that only write to the parameter.
+
+### Changed
+
+- Many improvements to the compatibility with the `whitequark/parser` translation.
+- Accept newlines before pattern terminators `)` or `]`.
+- `Prism::Node#start_offset` and `Prism::Node#end_offset` are now much more efficient.
+- Read files using `fread` instead of `mmap` when we're going to keep around the source through the Ruby API.
+- Fix `Sexp#line_max` setting in the `seattlerb/ruby_parser` translation layer.
+- Allow spaces before the encoding comment.
+
+## [0.24.0] - 2024-02-15
+
+### Added
+
+- More support for `Prism::Translation::Ripper` is added.
+- Support multiple versions for `Prism::Translation::Parser`.
+- Improved memory usage in the FFI backend.
+- Very large speed and memory improvements for creating the Ruby AST.
+
+### Changed
+
+- Fix location for empty symbol in hash key.
+- Fix parsing a rescue modifier on the value of an assignment when the LHS is a method call with arguments and no parentheses.
+
 ## [0.23.0] - 2024-02-14
 
 ### Added
@@ -378,7 +440,9 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/) a
 
 - 🎉 Initial release! 🎉
 
-[unreleased]: https://github.com/ruby/prism/compare/v0.23.0...HEAD
+[unreleased]: https://github.com/ruby/prism/compare/v0.25.0...HEAD
+[0.25.0]: https://github.com/ruby/prism/compare/v0.24.0...v0.25.0
+[0.24.0]: https://github.com/ruby/prism/compare/v0.23.0...v0.24.0
 [0.23.0]: https://github.com/ruby/prism/compare/v0.22.0...v0.23.0
 [0.22.0]: https://github.com/ruby/prism/compare/v0.21.0...v0.22.0
 [0.21.0]: https://github.com/ruby/prism/compare/v0.20.0...v0.21.0

data/Makefile

@@ -10,8 +10,8 @@ FUZZ_OUTPUT_DIR = $(shell pwd)/fuzz/output
 
 SOEXT := $(shell ruby -e 'puts RbConfig::CONFIG["SOEXT"]')
 
-CPPFLAGS := -Iinclude
-CFLAGS := -g -O2 -std=c99 -Wall -Werror -Wextra -Wpedantic -Wundef -Wconversion -Wno-missing-braces -fPIC -fvisibility=hidden
+CPPFLAGS := -Iinclude $(CPPFLAGS)
+CFLAGS := -g -O2 -std=c99 -Wall -Werror -Wextra -Wpedantic -Wundef -Wconversion -Wno-missing-braces -fPIC -fvisibility=hidden $(CFLAGS)
 CC := cc
 WASI_SDK_PATH := /opt/wasi-sdk
 
@@ -94,6 +94,9 @@ all-no-debug: DEBUG_FLAGS := -DNDEBUG=1
 all-no-debug: OPTFLAGS := -O3
 all-no-debug: all
 
+minimal: CFLAGS := $(CFLAGS) -DPRISM_BUILD_MINIMAL
+minimal: all
+
 run: Makefile $(STATIC_OBJECTS) $(HEADERS) test.c
 	$(ECHO) "compiling test.c"
 	$(Q) $(CC) $(CPPFLAGS) $(CFLAGS) $(STATIC_OBJECTS) test.c

data/README.md

@@ -3,7 +3,7 @@
   <img alt="Prism Ruby parser" height="256px" src="https://github.com/ruby/prism/blob/main/doc/images/prism.png?raw=true">
 </div>
 
-This is a parser for the Ruby programming language. It is designed to be portable, error tolerant, and maintainable. It is written in C99 and has no dependencies. It is currently being integrated into [CRuby](https://github.com/ruby/ruby), [JRuby](https://github.com/jruby/jruby), [TruffleRuby](https://github.com/oracle/truffleruby), [Sorbet](https://github.com/sorbet/sorbet), and [Syntax Tree](https://github.com/ruby-syntax-tree/syntax_tree).
+This is a parser for the Ruby programming language. It is designed to be portable, error tolerant, and maintainable. It is written in C99 and has no dependencies.
 
 ## Overview
 
@@ -15,27 +15,33 @@ The repository contains the infrastructure for both a shared library (libprism)
 ├── Rakefile              configuration to compile the native extension and run the Ruby tests
 ├── bin
 │   ├── lex               runs the lexer on a file or string, prints the tokens, and compares to ripper
-│   └── parse             runs the parser on a file or string and prints the syntax tree
+│   ├── parse             runs the parse on a file or string and prints the AST
+│   └── prism             a CLI for development and debugging
 ├── config.yml            specification for tokens and nodes in the tree
-├── docs                  documentation about the project
+├── doc                   documentation website
+├── docs                  markdown documentation about the project
 ├── ext
 │   └── prism
 │       ├── extconf.rb    configuration to generate the Makefile for the native extension
 │       └── extension.c   the native extension that interacts with libprism
 ├── fuzz                  files related to fuzz testing
+├── gemfiles              gemfiles used by different Ruby versions in CI
 ├── include
 │   ├── prism             header files for the shared library
 │   └── prism.h           main header file for the shared library
 ├── java                  Java bindings for the shared library
+├── java-wasm             Java WASM bindings for the shared library
+├── javascript            JavaScript WASM bindings for the shared library
 ├── lib
 │   ├── prism             Ruby library files
 │   └── prism.rb          main entrypoint for the Ruby library
 ├── rakelib               various Rake tasks for the project
+├── rbi                   RBI type signatures for the Ruby library
 ├── rust
 │   ├── ruby-prism        Rustified crate for the shared library
 │   └── ruby-prism-sys    FFI binding for Rust
+├── sig                   RBS type signatures for the Ruby library
 ├── src
-│   ├── enc               various encoding files
 │   ├── util              various utility files
 │   └── prism.c           main entrypoint for the shared library
 ├── templates             contains ERB templates generated by templates/template.rb
@@ -51,7 +57,7 @@ The repository contains the infrastructure for both a shared library (libprism)
 To compile the shared library, you will need:
 
 * C99 compiler
-* make
+* GNU make
 * Ruby 2.7.0 or later
 
 Once you have these dependencies, run:
@@ -91,8 +97,41 @@ See the [CONTRIBUTING.md](CONTRIBUTING.md) file for more information. We additio
 * [Parser translation](docs/parser_translation.md)
 * [Parsing rules](docs/parsing_rules.md)
 * [Releasing](docs/releasing.md)
-* [Ripper](docs/ripper.md)
+* [Ripper translation](docs/ripper_translation.md)
 * [Ruby API](docs/ruby_api.md)
 * [RubyParser translation](docs/ruby_parser_translation.md)
 * [Serialization](docs/serialization.md)
 * [Testing](docs/testing.md)
+
+## Examples
+
+Prism has been integrated into the majority of Ruby runtimes, many libraries, and some applications. Below is a list of some of the projects that use Prism:
+
+### Runtimes
+
+* [CRuby](https://github.com/ruby/ruby/pull/7964) (via C)
+* [Garnet](https://github.com/camertron/garnet-js) (via WASM)
+* [JRuby](https://github.com/jruby/jruby/pull/8103) (via Java)
+* [Natalie](https://github.com/natalie-lang/natalie/pull/1213) (via C++ and Ruby)
+* [Opal](https://github.com/opal/opal/pull/2642) (via Ruby and WASM)
+* [TruffleRuby](https://github.com/oracle/truffleruby/issues/3117) (via Java)
+
+### Libraries
+
+* [dispersion](https://github.com/joeldrapper/dispersion)
+* [packwerk](https://github.com/Shopify/packwerk/pull/388) (via parser translator)
+* [rbi](https://github.com/Shopify/rbi)
+* [rails](https://github.com/rails/rails)
+  * [parsing renders](https://github.com/rails/rails/pull/49438)
+  * [parsing rdoc](https://github.com/rails/rails/pull/50870)
+  * [parsing tests](https://github.com/rails/rails/pull/51006)
+* [repl_type_completor](https://github.com/ruby/repl_type_completor)
+* [rubocop](https://docs.rubocop.org/rubocop/configuration.html#setting-the-parser-engine) (via parser translator)
+* [ruby-lsp](https://github.com/Shopify/ruby-lsp)
+* [smart_todo](https://github.com/Shopify/smart_todo/pull/69)
+* [sorbet-eraser](https://github.com/kddnewton/sorbet-eraser/pull/25)
+* [synvert](https://github.com/xinminlabs/synvert-core-ruby)
+
+### Applications
+
+* [gem.sh](https://github.com/marcoroth/gem.sh/pull/96)