rapydscript-ns 0.9.3 → 0.9.4

package/.agignore

@@ -1 +1 @@
-lib/*
+lib/*

package/.github/workflows/ci.yml

@@ -1,38 +1,38 @@
-name: CI
-on: [push, pull_request]
-env:
-    CI: 'true'
-
-jobs:
-    test:
-        name: Test on ${{ matrix.os }} LANG ${{ matrix.lang }}
-        runs-on: ${{ matrix.os }}
-        env:
-          LANG: ${{ matrix.lang }}
-          LC_ALL: ${{ matrix.lang }}
-        strategy:
-            matrix:
-                include:
-                    - { os: ubuntu-latest, lang: en_US.UTF-8 }
-                    - { os: ubuntu-latest, lang: de_DE.UTF-8}
-                    - { os: ubuntu-latest, lang: hi_IN.UTF-8 }
-
-                    - { os: macos-latest, lang: en_US.UTF-8 }
-                    - { os: windows-latest, lang: en_US.UTF-8 }
-
-        steps:
-            - name: Checkout source code
-              uses: actions/checkout@master
-              with:
-                fetch-depth: 10
-
-            - name: Set up Node ${{ matrix.node }}
-              uses: actions/setup-node@master
-
-            - name: Install deps
-              run:
-                npm install --no-optional
-
-            - name: Test
-              run:
-                npm test
+name: CI
+on: [push, pull_request]
+env:
+    CI: 'true'
+
+jobs:
+    test:
+        name: Test on ${{ matrix.os }} LANG ${{ matrix.lang }}
+        runs-on: ${{ matrix.os }}
+        env:
+          LANG: ${{ matrix.lang }}
+          LC_ALL: ${{ matrix.lang }}
+        strategy:
+            matrix:
+                include:
+                    - { os: ubuntu-latest, lang: en_US.UTF-8 }
+                    - { os: ubuntu-latest, lang: de_DE.UTF-8}
+                    - { os: ubuntu-latest, lang: hi_IN.UTF-8 }
+
+                    - { os: macos-latest, lang: en_US.UTF-8 }
+                    - { os: windows-latest, lang: en_US.UTF-8 }
+
+        steps:
+            - name: Checkout source code
+              uses: actions/checkout@master
+              with:
+                fetch-depth: 10
+
+            - name: Set up Node ${{ matrix.node }}
+              uses: actions/setup-node@master
+
+            - name: Install deps
+              run:
+                npm install --no-optional
+
+            - name: Test
+              run:
+                npm test

package/=template.pyj

@@ -1,5 +1,5 @@
-# vim:fileencoding=utf-8
-# License: BSD Copyright: %YEAR%, %USER% <%MAIL%>
-from __python__ import hash_literals
-
-%HERE%
+# vim:fileencoding=utf-8
+# License: BSD Copyright: %YEAR%, %USER% <%MAIL%>
+from __python__ import hash_literals
+
+%HERE%

package/CHANGELOG.md

@@ -1,3 +1,12 @@
+version 0.9.4
+=======================
+* Added the `statistics` standard library module (`mean`, `fmean`, `median`, `median_low`, `median_high`, `median_grouped`, `mode`, `multimode`, `stdev`, `pstdev`, `variance`, `pvariance`, `harmonic_mean`, `geometric_mean`, `quantiles`, `covariance`, `correlation`, `linear_regression`, `NormalDist`)
+* Added the `pprint` standard library module (`pprint`, `pformat`, `PrettyPrinter`, `isreadable`, `isrecursive`, `saferepr`)
+* Added `ChainMap` to the `collections` standard library module
+* Added support for `bigint` literals and the `bigint()` builtin
+* Fix: Added the `type` builtin to global scope
+* Fix: Performance problem during long editor sessions in the language service
+
 version 0.9.3
 =======================
 * Added the `bisect` standard library module (`bisect_left`, `bisect_right`, `bisect`, `insort_left`, `insort_right`, `insort`, optional `key` parameter)

package/HACKING.md

@@ -1,103 +1,103 @@
-Hacking the RapydScript compiler
-=================================
-
-The RapydScript compiler is written in RapydScript itself and uses the
-RapydScript import system to modularize its code. The compiler source code is
-in the `src` directory. The compiled compiler is by default in the `release`
-directory. 
-
-In order to start hacking on the compiler, run the command
-
-```
-bin/rapydscript self --complete --test
-```
-
-This will generate a build of the compiler in the `dev` directory. Now, the
-rapydscript command will automatically use this build, rather than the one in
-release. If you want to go back to the release build, simply delete the `dev`
-directory.
-
-
-Code organization
--------------------
-
-The way the compiler works, given some RapydScript source code:
-
-* The source code is lexed into a stream of tokens (`src/tokenzier.pyj`)
-
-* The tokens are parsed into a Abstract Syntax Tree (`src/parse.pyj and src/ast.pyj`)
-
-* During parsing any import statement are resolved (this is different from
-  python, where imports happen at run-time, not compile time).
-
-* The Abstract Syntax Tree is transformed into the output JavaScript (`src/output/*.pyj`)
-
-* Various bits of functionality in RapydScript depend upon the *Base Library*
-  (`src/baselib*.pyj`). This includes things like the basic container types
-  (list/set/dict) string functions such as `str.format()`, etc. The baselib
-  is automatically inserted into the start of the output JavaScript.
-
-The RapydScript standard library can be found in `src/lib`. The various tools,
-such as the linter, gettext support, the REPL, etc. are in the `tools`
-directory.
-
-Tests
---------
-
-The tests are in the test directory and can be run using the command:
-```
-rapydscript test
-```
-
-You can run individual test files by providing the name of the file, as
-
-```
-rapydscript test classes
-```
-
-Modifying the compiler
--------------------------
-
-Edit the files in the `src` directory to make your changes, then use the
-`./try` script to test them.  This script will compile an updated version of
-the compiler with your changes, if any, and use it to run the snippet of code
-you pass to it.
-
-For example:
-
-```
-./try 'print("Hello world")'
-```
-
-will compile `print ("Hello world")` and show you the output on stdout. You can
-tell it to omit the baselib, so you can focus on the output, with the `-m`
-switch, like this:
-
-```
-./try -m 'print("Hello world")'
-```
-
-You can also have it not print out the JavaScript, instead directly executing the output
-JavaScript with the `-x` switch, like this
-
-```
-./try -x 'print("Hello world")'
-```
-
-If you want to test longer sections of code, you can use the `-f` switch to
-pass in the path to a RapydScript file to compile, like this:
-
-```
-./try -f myfile.pyj
-```
-
-Once you are happy with your changes, you can build the compiler and run the
-test suite, all with a single command:
-
-```
-./build
-```
-
-This will build the compiler with the updated version of itself and then run
-the test suite. If all test pass you can commit your changes and send a pull
-request :)
+Hacking the RapydScript compiler
+=================================
+
+The RapydScript compiler is written in RapydScript itself and uses the
+RapydScript import system to modularize its code. The compiler source code is
+in the `src` directory. The compiled compiler is by default in the `release`
+directory. 
+
+In order to start hacking on the compiler, run the command
+
+```
+bin/rapydscript self --complete --test
+```
+
+This will generate a build of the compiler in the `dev` directory. Now, the
+rapydscript command will automatically use this build, rather than the one in
+release. If you want to go back to the release build, simply delete the `dev`
+directory.
+
+
+Code organization
+-------------------
+
+The way the compiler works, given some RapydScript source code:
+
+* The source code is lexed into a stream of tokens (`src/tokenzier.pyj`)
+
+* The tokens are parsed into a Abstract Syntax Tree (`src/parse.pyj and src/ast.pyj`)
+
+* During parsing any import statement are resolved (this is different from
+  python, where imports happen at run-time, not compile time).
+
+* The Abstract Syntax Tree is transformed into the output JavaScript (`src/output/*.pyj`)
+
+* Various bits of functionality in RapydScript depend upon the *Base Library*
+  (`src/baselib*.pyj`). This includes things like the basic container types
+  (list/set/dict) string functions such as `str.format()`, etc. The baselib
+  is automatically inserted into the start of the output JavaScript.
+
+The RapydScript standard library can be found in `src/lib`. The various tools,
+such as the linter, gettext support, the REPL, etc. are in the `tools`
+directory.
+
+Tests
+--------
+
+The tests are in the test directory and can be run using the command:
+```
+rapydscript test
+```
+
+You can run individual test files by providing the name of the file, as
+
+```
+rapydscript test classes
+```
+
+Modifying the compiler
+-------------------------
+
+Edit the files in the `src` directory to make your changes, then use the
+`./try` script to test them.  This script will compile an updated version of
+the compiler with your changes, if any, and use it to run the snippet of code
+you pass to it.
+
+For example:
+
+```
+./try 'print("Hello world")'
+```
+
+will compile `print ("Hello world")` and show you the output on stdout. You can
+tell it to omit the baselib, so you can focus on the output, with the `-m`
+switch, like this:
+
+```
+./try -m 'print("Hello world")'
+```
+
+You can also have it not print out the JavaScript, instead directly executing the output
+JavaScript with the `-x` switch, like this
+
+```
+./try -x 'print("Hello world")'
+```
+
+If you want to test longer sections of code, you can use the `-f` switch to
+pass in the path to a RapydScript file to compile, like this:
+
+```
+./try -f myfile.pyj
+```
+
+Once you are happy with your changes, you can build the compiler and run the
+test suite, all with a single command:
+
+```
+./build
+```
+
+This will build the compiler with the updated version of itself and then run
+the test suite. If all test pass you can commit your changes and send a pull
+request :)

package/LICENSE

@@ -1,24 +1,24 @@
-Copyright (c) 2015-, Kovid Goyal <kovid@kovidgoyal.net>
-Copyright (c) 2013-2014, Alexander Tsepkov <atsepkov@pyjeon.com>
-All rights reserved.
-
-Redistribution and use in source and binary forms, with or without
-modification, are permitted provided that the following conditions are met:
-
-* Redistributions of source code must retain the above copyright notice, this
-  list of conditions and the following disclaimer.
-
-* Redistributions in binary form must reproduce the above copyright notice,
-  this list of conditions and the following disclaimer in the documentation
-  and/or other materials provided with the distribution.
-
-THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
-AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
-IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
-DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE
-FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
-DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR
-SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER
-CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,
-OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
-OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+Copyright (c) 2015-, Kovid Goyal <kovid@kovidgoyal.net>
+Copyright (c) 2013-2014, Alexander Tsepkov <atsepkov@pyjeon.com>
+All rights reserved.
+
+Redistribution and use in source and binary forms, with or without
+modification, are permitted provided that the following conditions are met:
+
+* Redistributions of source code must retain the above copyright notice, this
+  list of conditions and the following disclaimer.
+
+* Redistributions in binary form must reproduce the above copyright notice,
+  this list of conditions and the following disclaimer in the documentation
+  and/or other materials provided with the distribution.
+
+THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
+AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
+IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE
+FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
+DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR
+SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER
+CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,
+OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
+OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

package/PYTHON_GAPS.md

@@ -5,6 +5,9 @@ or behave differently in RapydScript-NS, with a focus on what is relevant and us
 browser context. Server-side features (file I/O, subprocesses, sockets, threading, etc.)
 are excluded as they do not apply.
 
+Items that are fully supported — even if only behind a flag — are not listed here. See the
+README for the full feature and module support tables.
+
 ---
 
 ## 1. Silent Behavioral Differences (Gotchas)
@@ -12,23 +15,7 @@ are excluded as they do not apply.
 These features exist but behave differently from Python in ways that will silently produce
 wrong results — no error is raised.
 
-### 1.1 `%` Modulo on Negative Numbers *(partially resolved)*
-
-**Python:** `%` always returns a non-negative result (true modulo).
-```python
--7 % 3   # → 2  (Python)
--7 % 3   # → -1 (RapydScript default — JS remainder semantics)
-```
-**Status:** Fixed when using `from __python__ import overload_operators` or
-`from __python__ import python_modulo`. In bare mode (no flags) the JS remainder semantics
-still apply.
-
-**Impact:** Any algorithm relying on modular arithmetic (wrapping, circular indexing) may
-produce wrong results in code that does not use the Python operator flags.
-
----
-
-### 1.2 `is` / `is not` — Identity vs. Equality
+### 1.1 `is` / `is not` — Identity vs. Equality
 
 **Python:** `is` tests object identity (pointer comparison).
 **RapydScript:** `is` compiles to `===` (strict equality), so `x is y` is true whenever
@@ -48,43 +35,7 @@ The recommended pattern — using a unique sentinel object — works correctly.
 
 ---
 
-### 1.3 Function Arguments: `TypeError` on Wrong Count *(opt-in, not default)*
-
-**Python:** Too few or too many positional arguments raises `TypeError` at call time.
-**RapydScript default:** Extra args are silently discarded; missing args become `undefined`.
-
-```python
-def f(a, b):
-    return a + b
-
-f(1, 2, 3)   # Python: TypeError. RapydScript default: silently returns 3
-f(1)         # Python: TypeError. RapydScript default: returns NaN (1 + undefined)
-```
-**Status:** Argument count and type-annotation enforcement is now available via the
-`type_enforce` flag on function definitions (emits runtime checks). Not enabled by default
-because it adds overhead to every call. Developers writing library code with strict APIs
-should opt in.
-
----
-
-### 1.4 Positional-Only and Keyword-Only Parameters Not Enforced
-
-**Python:** Positional-only params (`/`) cannot be passed by keyword; keyword-only params
-(`*`) cannot be passed positionally. Both raise `TypeError` on violations.
-**RapydScript:** Violations are silently discarded — the param gets `undefined` with no error.
-
-```python
-def f(a, b, /, *, c):
-    return a + b + c
-
-f(1, b=2, c=3)   # Python: TypeError (b is positional-only)
-                  # RapydScript: b silently becomes undefined, a=1, c=3
-```
-**Impact:** API design contracts expressed via param ordering are not enforced.
-
----
-
-### 1.5 String Encoding — UTF-16 Surrogate Pairs
+### 1.2 String Encoding — UTF-16 Surrogate Pairs
 
 **Python:** Strings are sequences of Unicode code points (full 21-bit range).
 **RapydScript:** Strings are JS strings — UTF-16. Emoji and other non-BMP characters
@@ -103,7 +54,7 @@ produce wrong lengths or corrupt characters when sliced.
 
 ---
 
-### 1.6 `global` Scoping in Nested Functions
+### 1.3 `global` Scoping in Nested Functions
 
 **Python:** `global x` inside a nested function forces `x` to refer to the module-level
 variable, bypassing any intermediate closure scopes.
@@ -115,7 +66,7 @@ scope silently.
 
 ---
 
-### 1.7 Numeric Dict Keys Are Coerced to Strings
+### 1.4 Numeric Dict Keys Are Coerced to Strings
 
 **Python:** `d = {}; d[1] = 'a'; d['1'] = 'b'; len(d) == 2` (integer and string keys distinct).
 **RapydScript:** The Python `dict` type (backed by ES6 `Map`) stores them distinctly, but
@@ -126,7 +77,7 @@ when interoperating with JS APIs that return plain objects.
 
 ---
 
-### 1.8 `Exception.args` vs `.message`
+### 1.5 `Exception.args` vs `.message`
 
 **Python:** `Exception('msg').args == ('msg',)` and `.message` is not a standard attribute.
 **RapydScript:** `.message` is the primary attribute (JS `Error` convention). `.args` is
@@ -136,7 +87,7 @@ not populated as a tuple with the message.
 
 ---
 
-### 1.9 Multiple Inheritance MRO
+### 1.6 Multiple Inheritance MRO
 
 **Python:** C3 linearization guarantees a deterministic and consistent method resolution order.
 **RapydScript:** Built on the JS prototype chain. In diamond inheritance or complex hierarchies
@@ -175,8 +126,10 @@ that timing is not guaranteed.
 
 ### 2.3 `locals()` Always Returns Empty Dict
 
-JavaScript provides no mechanism to introspect local variables at runtime. `locals()` always
-returns an empty dict. Python code that uses `locals()` for string template substitution
+`vars()`, `locals()`, and `globals()` all exist as builtins. JavaScript provides no mechanism
+to introspect local variables at runtime, so `locals()` always returns an empty dict.
+`globals()` works on module-level/global state, and `vars(obj)` introspects the passed object.
+Python code that uses `locals()` for string template substitution
 (e.g., `'{x}'.format(**locals())`) will break silently.
 
 ---
@@ -193,6 +146,8 @@ who rely on them (e.g., `from math import *`) must enumerate imports explicitly.
 ### 2.5 `asynccontextmanager` Not Available
 
 `contextlib.asynccontextmanager` is absent. Only synchronous `@contextmanager` is implemented.
+`async with` itself is also not supported — async context managers need `.acquire()`/`.release()`
+calls instead.
 
 ---
 
@@ -219,26 +174,35 @@ Python's `Ellipsis` singleton object. Code that stores `...` in containers or ch
 
 These are absent from `src/lib/` and have no substitute.
 
-### 3.1 `decimal` — Decimal Arithmetic
+### 3.1 `enum.IntEnum`, `IntFlag`, and `Flag`
 
-`Decimal` arithmetic avoids floating-point rounding errors. Essential for financial
-calculations in browser apps (e-commerce, budgeting tools). JS does not have a built-in
-equivalent; a pure-JS implementation would need to be compiled in.
+The `enum` module provides `Enum` but not `IntEnum` (auto-comparable with integers),
+`StrEnum` (Python 3.11+), `IntFlag`, or `Flag` (bitfield enums). These are common in protocol
+implementations, permission systems, and state machines.
+
+```python
+from enum import IntEnum
+class Color(IntEnum):
+    RED = 1
+    GREEN = 2
+Color.RED < Color.GREEN   # True — comparison with int semantics
+```
 
 ---
 
-### 3.2 `fractions` — Rational Arithmetic
+### 3.2 `hashlib` — Cryptographic Hashing
 
-`Fraction(numerator, denominator)` with full arithmetic. Useful for music theory apps,
-math tutoring tools, and any domain requiring exact rational computation.
+`hashlib.sha256`, `hashlib.md5`, etc. The Web Crypto API provides `crypto.subtle.digest`
+but its async/buffer-based interface is awkward. A thin `hashlib`-compatible wrapper over
+`crypto.subtle` with a synchronous-friendly API (using the sync `crypto.getRandomValues`)
+for non-cryptographic hashes would be valuable.
 
 ---
 
-### 3.3 `statistics` — Statistical Functions
+### 3.3 `fractions` — Rational Arithmetic
 
-`mean`, `median`, `mode`, `stdev`, `variance`, `quantiles`. Very commonly needed in
-data-visualization browser apps. Currently `numpy` covers much of this but `statistics`
-is lighter-weight and doesn't require the full numpy import.
+`Fraction(numerator, denominator)` with full arithmetic. Useful for music theory apps,
+math tutoring tools, and any domain requiring exact rational computation.
 
 ---
 
@@ -249,42 +213,11 @@ for browser-based code editors, version comparison tools, and fuzzy matching UIs
 
 ---
 
-### 3.5 `pprint` — Pretty Printing
-
-`pprint.pformat` / `pprint.pprint`. Primarily a debugging/REPL aid. Given the in-browser
-REPL in this project, implementing `pprint` would make output more readable.
-
----
-
-### 3.6 `hashlib` — Cryptographic Hashing
-
-`hashlib.sha256`, `hashlib.md5`, etc. The Web Crypto API provides `crypto.subtle.digest`
-but its async/buffer-based interface is awkward. A thin `hashlib`-compatible wrapper over
-`crypto.subtle` with a synchronous-friendly API (using the sync `crypto.getRandomValues`)
-for non-cryptographic hashes would be valuable.
-
----
-
-### 3.7 `enum.IntEnum` and `enum.Flag`
-
-The `enum` module provides `Enum` but not `IntEnum` (auto-comparable with integers),
-`StrEnum` (Python 3.11+), or `Flag` (bitfield enums). These are common in protocol
-implementations, permission systems, and state machines.
-
-```python
-from enum import IntEnum
-class Color(IntEnum):
-    RED = 1
-    GREEN = 2
-Color.RED < Color.GREEN   # True — comparison with int semantics
-```
-
----
-
-### 3.8 `collections.ChainMap`
+### 3.5 `decimal` — Decimal Arithmetic
 
-`ChainMap` provides a multi-level dict lookup (like layered config or scope chains) without
-copying. Not currently in `collections.pyj`.
+`Decimal` arithmetic avoids floating-point rounding errors. Essential for financial
+calculations in browser apps (e-commerce, budgeting tools). JS does not have a built-in
+equivalent; a pure-JS implementation would need to be compiled in.
 
 ---
 
@@ -404,17 +337,16 @@ The `jstype()` builtin is the RS equivalent of JS's `typeof`.
 
 ## 5. Summary Priority Table
 
+Priority weighs frequency-of-need, effort-to-implement, and whether a workaround exists.
+
 | Priority | Feature | Effort | Impact |
 |---|---|---|---|
-| High | `enum.IntEnum`, `Flag` | Medium | Protocol and permission modeling |
-| High | `statistics` module | Low | Data analysis without full numpy import |
-| Medium | `pprint` module | Low | REPL output quality |
-| Medium | `collections.ChainMap` | Low | Multi-level scope/config dicts |
-| Medium | f-string `f'{x=}'` debugging format | Low | Developer experience |
-| Medium | `__slots__` enforcement via `Proxy` | Medium | Memory + API documentation |
+| High | `enum.IntEnum`, `IntFlag`, `Flag` | Medium | Protocol and permission modeling; bitfield enums |
+| Medium | `__slots__` enforcement via `Proxy` | Medium | Memory and API documentation |
+| Medium | `hashlib` shim over Web Crypto | Medium | Avoids verbatim Web Crypto calls in user code |
 | Medium | `fractions` module | Medium | Exact rational arithmetic |
-| Medium | `hashlib` shim over Web Crypto | Medium | Hashing without verbatim JS |
-| Low | `decimal` module | High | Financial calculations |
-| Low | `difflib` module | High | Text diff, fuzzy matching |
-| Low | `asynccontextmanager` | Medium | Async resource management |
+| Medium | f-string `f'{x=}'` debugging format | Low | Developer experience |
+| Low | `asynccontextmanager` + `async with` | Medium | Async resource management |
 | Low | `__del__` via `FinalizationRegistry` | Medium | Resource cleanup (best-effort) |
+| Low | `difflib` module | High | Text diff, fuzzy matching |
+| Low | `decimal` module | High | Financial calculations |