porffor 0.2.0-c7b7423 → 0.2.0-c908b46

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (55) hide show
  1. package/CONTRIBUTING.md +256 -0
  2. package/LICENSE +20 -20
  3. package/README.md +157 -77
  4. package/asur/README.md +2 -0
  5. package/asur/index.js +1262 -0
  6. package/byg/index.js +237 -0
  7. package/compiler/2c.js +322 -72
  8. package/compiler/{sections.js → assemble.js} +64 -16
  9. package/compiler/builtins/annexb_string.js +72 -0
  10. package/compiler/builtins/annexb_string.ts +18 -0
  11. package/compiler/builtins/array.ts +145 -0
  12. package/compiler/builtins/base64.ts +76 -0
  13. package/compiler/builtins/boolean.ts +21 -0
  14. package/compiler/builtins/crypto.ts +120 -0
  15. package/compiler/builtins/date.ts +2070 -0
  16. package/compiler/builtins/escape.ts +141 -0
  17. package/compiler/builtins/int.ts +147 -0
  18. package/compiler/builtins/number.ts +534 -0
  19. package/compiler/builtins/porffor.d.ts +59 -0
  20. package/compiler/builtins/string.ts +1070 -0
  21. package/compiler/builtins/tostring.ts +37 -0
  22. package/compiler/builtins.js +580 -272
  23. package/compiler/{codeGen.js → codegen.js} +1390 -553
  24. package/compiler/decompile.js +3 -4
  25. package/compiler/embedding.js +22 -22
  26. package/compiler/encoding.js +98 -114
  27. package/compiler/generated_builtins.js +1517 -0
  28. package/compiler/index.js +36 -34
  29. package/compiler/log.js +6 -3
  30. package/compiler/opt.js +65 -29
  31. package/compiler/parse.js +38 -29
  32. package/compiler/precompile.js +128 -0
  33. package/compiler/prefs.js +27 -0
  34. package/compiler/prototype.js +182 -42
  35. package/compiler/types.js +37 -0
  36. package/compiler/wasmSpec.js +31 -7
  37. package/compiler/wrap.js +141 -43
  38. package/package.json +9 -5
  39. package/porf +4 -0
  40. package/rhemyn/compile.js +46 -27
  41. package/rhemyn/parse.js +322 -320
  42. package/rhemyn/test/parse.js +58 -58
  43. package/runner/compare.js +34 -34
  44. package/runner/debug.js +122 -0
  45. package/runner/index.js +91 -11
  46. package/runner/profiler.js +102 -0
  47. package/runner/repl.js +44 -11
  48. package/runner/sizes.js +37 -37
  49. package/compiler/builtins/base64.js +0 -92
  50. package/runner/info.js +0 -89
  51. package/runner/profile.js +0 -46
  52. package/runner/results.json +0 -1
  53. package/runner/transform.js +0 -15
  54. package/tmp.c +0 -69
  55. package/util/enum.js +0 -20
@@ -0,0 +1,256 @@
1
+ # Contributing to Porffor
2
+
3
+ Hello! Thanks for your potential interest in contributing to Porffor :)
4
+
5
+ This document hopes to help you understand Porffor-specific TS, specifically for writing built-ins (inside `compiler/builtins/*.ts` eg `btoa`, `String.prototype.trim`, ...). This guide isn't really meant for modifying the compiler itself yet (eg `compiler/codegen.js`), as built-ins are ~easier to implement and more useful at the moment.
6
+
7
+ I mostly presume decent JS knowledge, with some basic TS too but nothing complicated. Knowing low-level stuff generally (pointers, etc) and/or Wasm (bytecode) is also a plus but hopefully not required.
8
+
9
+ If you have any questions you can ask in [the Porffor Discord](https://discord.gg/6crs9Znx9R), please feel free to ask anything if you get stuck :)
10
+
11
+ Please read this entire document before beginning as there are important things throughout.
12
+
13
+ <br>
14
+
15
+ ## Setup
16
+
17
+ 1. Clone the repo and enter the repo (`git clone https://github.com/CanadaHonk/porffor.git`)
18
+ 2. `npm install`
19
+
20
+ The repo comes with easy alias scripts for Unix and Windows, which you can use like so:
21
+ - Unix: `./porf path/to/script.js`
22
+ - Windows: `.\porf path/to/script.js`
23
+
24
+ You can also swap out `node` in the alias to use another runtime like Deno (`deno run -A ...`) or Bun (`bun ...`), or just use it yourself (eg `node runner/index.js ...`, `bun runner/index.js ...`). Node, Deno, Bun should work.
25
+
26
+
27
+ ### Precompile
28
+
29
+ **If you update any file inside `compiler/builtins` you will need to do this for it to update inside Porffor otherwise your changes will have no effect.** Run `node compiler/precompile.js` to precompile. It may error during this, if so, you might have an error in your code or there could be a compiler error with Porffor (feel free to ask for help as soon as you encounter any errors with it).
30
+
31
+ <br>
32
+
33
+ ## Types
34
+
35
+ Porffor has usual JS types (or at least the ones it supports), but also internal types for various reasons.
36
+
37
+ ### ByteString
38
+
39
+ The most important and widely used internal type is ByteString. Regular strings in Porffor are UTF-16 encoded, so each character uses 2 bytes. ByteStrings are special strings which are used when the characters in a string only use ASCII/LATIN-1 characters, so the lower byte of the UTF-16 characters are unused. Instead of wasting memory with all the unused memory, ByteStrings instead use 1 byte per character. This halves memory usage of such strings and also makes operating on them faster. The downside is that many Porffor built-ins have to be written twice, slightly different, for both `String` and `ByteString` types.
40
+
41
+ ### i32
42
+
43
+ This is complicated internally but essentially, only use it for pointers. (This is not signed or unsigned, instead it is the Wasm valtype `i32` so the signage is ~instruction dependant).
44
+
45
+ <br>
46
+
47
+ ## Pointers
48
+
49
+ Pointers are the main (and most difficult) unique feature you ~need to understand when dealing with objects (arrays, strings, ...).
50
+
51
+ We'll explain things per common usage you will likely need to know:
52
+
53
+ ## Commonly used Wasm code
54
+
55
+ ### Get a pointer
56
+
57
+ ```js
58
+ Porffor.wasm`local.get ${foobar}`
59
+ ```
60
+
61
+ Gets the pointer to the variable `foobar`. You don't really need to worry about how it works in detail, but essentially it gets the pointer as a number (type) instead of as the object it is.
62
+
63
+ ### Store a character in a ByteString
64
+
65
+ ```js
66
+ Porffor.wasm.i32.store8(pointer, characterCode, 0, 4)
67
+ ```
68
+
69
+ Stores the character code `characterCode` at the pointer `pointer` **for a ByteString**.[^1]
70
+
71
+ ### Store a character in a String
72
+
73
+ ```js
74
+ Porffor.wasm.i32.store16(pointer, characterCode, 0, 4)
75
+ ```
76
+
77
+ Stores the character code `characterCode` at the pointer `pointer` **for a String**.[^1]
78
+
79
+ ### Load a character from a ByteString
80
+
81
+ ```js
82
+ Porffor.wasm.i32.load8_u(pointer, 0, 4)
83
+ ```
84
+
85
+ Loads the character code at the pointer `pointer` **for a ByteString**.[^1]
86
+
87
+ ### Load a character from a String
88
+
89
+ ```js
90
+ Porffor.wasm.i32.load16_u(pointer, 0, 4)
91
+ ```
92
+
93
+ Loads the character code at the pointer `pointer` **for a String**.[^1]
94
+
95
+ ### Manually store the length of an object
96
+
97
+ ```js
98
+ Porffor.wasm.i32.store(pointer, length, 0, 0)
99
+ ```
100
+
101
+ Stores the length `length` at pointer `pointer`, setting the length of an object. This is mostly unneeded today as you can just do `obj.length = length`. [^2]
102
+
103
+ <br>
104
+
105
+ ## Example
106
+
107
+ Here is the code for `ByteString.prototype.toUpperCase()`:
108
+
109
+ ```ts
110
+ export const __ByteString_prototype_toUpperCase = (_this: bytestring) => {
111
+ const len: i32 = _this.length;
112
+
113
+ let out: bytestring = '';
114
+ Porffor.wasm.i32.store(out, len, 0, 0);
115
+
116
+ let i: i32 = Porffor.wasm`local.get ${_this}`,
117
+ j: i32 = Porffor.wasm`local.get ${out}`;
118
+
119
+ const endPtr: i32 = i + len;
120
+ while (i < endPtr) {
121
+ let chr: i32 = Porffor.wasm.i32.load8_u(i++, 0, 4);
122
+
123
+ if (chr >= 97) if (chr <= 122) chr -= 32;
124
+
125
+ Porffor.wasm.i32.store8(j++, chr, 0, 4);
126
+ }
127
+
128
+ return out;
129
+ };
130
+ ```
131
+
132
+ Now let's go through it section by section:
133
+
134
+ ```ts
135
+ export const __ByteString_prototype_toUpperCase = (_this: bytestring) => {
136
+ ```
137
+
138
+ Here we define a built-in for Porffor. Notably:
139
+ - We do not use `a.b.c`, instead we use `__a_b_c`
140
+ - We use a `_this` argument, as `this` does not exist in Porffor yet
141
+ - We use an arrow function
142
+ - We do not set a return type as prototype methods cannot use them currently or errors can happen.
143
+
144
+ ---
145
+
146
+ ```ts
147
+ const len: i32 = _this.length;
148
+
149
+ let out: bytestring = '';
150
+ Porffor.wasm.i32.store(out, len, 0, 0);
151
+ ```
152
+
153
+ This sets up the `out` variable we are going to write to for the output of this function. We set the length in advance to be the same as `_this`, as `foo.length == foo.toLowerCase().length`, because we will later be manually writing to it using Wasm intrinsics, which will not update the length themselves.
154
+
155
+ ---
156
+
157
+ ```ts
158
+ let i: i32 = Porffor.wasm`local.get ${_this}`,
159
+ j: i32 = Porffor.wasm`local.get ${out}`;
160
+ ```
161
+
162
+ Get the pointers for `_this` and `out` as `i32`s (~`number`s).
163
+
164
+ ---
165
+
166
+ ```ts
167
+ const endPtr: i32 = i + len;
168
+ while (i < endPtr) {
169
+ ```
170
+
171
+ Set up an end target pointer as the pointer variable for `_this` plus the length of it. Loop below until that pointer reaches the end target, so we iterate through the entire string.
172
+
173
+ ---
174
+
175
+ ```ts
176
+ let chr: i32 = Porffor.wasm.i32.load8_u(i++, 0, 4);
177
+ ```
178
+
179
+ Read the character (code) from the current `_this` pointer variable, and increment it so next iteration it reads the next character, etc.
180
+
181
+ ---
182
+
183
+ ```ts
184
+ if (chr >= 97) if (chr <= 122) chr -= 32;
185
+ ```
186
+
187
+ If the character code is >= 97 (`a`) and <= 122 (`z`), decrease it by 32, making it an upper case character. eg: 97 (`a`) - 32 = 65 (`A`).
188
+
189
+ ---
190
+
191
+ ```ts
192
+ Porffor.wasm.i32.store8(j++, chr, 0, 4);
193
+ ```
194
+
195
+ Store the character code into the `out` pointer variable, and increment it.
196
+
197
+ <br>
198
+
199
+ ## Porffor-specific TS notes
200
+
201
+ - For declaring variables, you must use explicit type annotations currently (eg `let a: number = 1`, not `let a = 1`)
202
+ - You might spot `Porffor.fastOr`/`Porffor.fastAnd`, these are non-short circuiting versions of `||`/`&&`, taking any number of conditions as arguments. You shouldn't don't need to use or worry about these.
203
+ - **There are ~no objects, you cannot use them/literals.**
204
+ - Attempt to avoid string/array-heavy code and use more variables instead if possible, easier on memory and CPU/perf.
205
+ - Do not set a return type for prototype methods, it can cause errors/unexpected results.
206
+
207
+ <br>
208
+
209
+ ## Formatting/linting
210
+
211
+ There is 0 setup for this (right now). You can try looking through the other built-ins files but do not worry about it a lot, I honestly do not mind going through and cleaning up after a PR as long as the code itself is good :^)
212
+
213
+ <br>
214
+
215
+ ## Commit (message) style
216
+
217
+ You should ideally have one commit per notable change (using amend/force push). Commit messages should be like `${file}: ${description}`. Don't be afraid to use long titles if needed, but try and be short if possible. Bonus points for detail in commit description. ~~Gold star for jokes in description too.~~
218
+
219
+ Examples:
220
+ ```
221
+ builtins/date: impl toJSON
222
+ builtins/date: fix ToIntegerOrInfinity returning -0
223
+ codegen: fix inline wasm for unreachable
224
+ builtins/array: wip toReversed
225
+ builtins/tostring_number: impl radix
226
+ ```
227
+
228
+ <br>
229
+
230
+ ## Test262
231
+
232
+ Make sure you have Test262 cloned already **inside of `test262/`** (`git clone https://github.com/tc39/test262.git test262/test262`).
233
+
234
+ Run `node test262` to run all the tests and get an output of total overall test results. The main thing you want to pay attention to is the emoji summary (lol):
235
+ ```
236
+ 🧪 50005 | 🤠 7007 (-89) | ❌ 1914 (-32) | 💀 13904 (-61) | 📝 23477 (-120) | ⏰ 2 | 🏗 2073 (+302) | 💥 1628
237
+ ```
238
+
239
+ To break this down:
240
+ 🧪 total 🤠 pass ❌ fail 💀 runtime error 📝 todo (error) ⏰ timeout 🏗️ wasm compile error 💥 compile error
241
+
242
+ The diff compared to the last commit (with test262 data) is shown in brackets. Basically, you can passes 🤠 up, and errors 💀📝🏗💥 down. It is fine if some errors change balance/etc, as long as they are not new failures.
243
+
244
+ It will also log new passes/fails. Be careful as sometimes the overall passes can increase, but other files have also regressed into failures which you might miss. Also keep in mind some tests may have been false positives before, but we can investigate the diff together :)
245
+
246
+ ### Debugging tips
247
+
248
+ - Use `node test262 path/to/tests` to run specific test262 dirs/files (eg `node test262 built-ins/Date`).
249
+ - Use `--log-errors` to log the errors of individual tests.
250
+ - Use `--debug-asserts` to log expected/actual of assertion failures (experimental).
251
+
252
+ <br>
253
+
254
+ [^1]: The `0, 4` args are necessary for the Wasm instruction, but you don't need to worry about them (`0` alignment, `4` byte offset for length).
255
+
256
+ [^2]: The `0, 4` args are necessary for the Wasm instruction, but you don't need to worry about them (`0` alignment, `0` byte offset).
package/LICENSE CHANGED
@@ -1,21 +1,21 @@
1
- MIT License
2
-
3
- Copyright (c) 2023 CanadaHonk
4
-
5
- Permission is hereby granted, free of charge, to any person obtaining a copy
6
- of this software and associated documentation files (the "Software"), to deal
7
- in the Software without restriction, including without limitation the rights
8
- to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9
- copies of the Software, and to permit persons to whom the Software is
10
- furnished to do so, subject to the following conditions:
11
-
12
- The above copyright notice and this permission notice shall be included in all
13
- copies or substantial portions of the Software.
14
-
15
- THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16
- IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17
- FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18
- AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
- LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
- OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
1
+ MIT License
2
+
3
+ Copyright (c) 2023 CanadaHonk
4
+
5
+ Permission is hereby granted, free of charge, to any person obtaining a copy
6
+ of this software and associated documentation files (the "Software"), to deal
7
+ in the Software without restriction, including without limitation the rights
8
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9
+ copies of the Software, and to permit persons to whom the Software is
10
+ furnished to do so, subject to the following conditions:
11
+
12
+ The above copyright notice and this permission notice shall be included in all
13
+ copies or substantial portions of the Software.
14
+
15
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
21
21
  SOFTWARE.
package/README.md CHANGED
@@ -1,5 +1,5 @@
1
1
  # Porffor &nbsp;<sup><sub>/ˈpɔrfɔr/ &nbsp;*(poor-for)*</sup></sub>
2
- A from-scratch experimental **AOT** optimizing JS -> Wasm/C engine/compiler/runtime in JS. Not serious/intended for (real) use. (this is a straight forward, honest readme)<br>
2
+ A from-scratch experimental **AOT** optimizing JS/TS -> Wasm/C engine/compiler/runtime in JS. Not serious/intended for (real) use. (this is a straight forward, honest readme)<br>
3
3
  Age: ~6 months (very on and off)
4
4
 
5
5
  ## Design
@@ -10,6 +10,73 @@ Porffor is a very unique JS engine, due many wildly different approaches. It is
10
10
 
11
11
  Porffor is primarily built from scratch, the only thing that is not is the parser (using [Acorn](https://github.com/acornjs/acorn)). Binaryen/etc is not used, we make final wasm binaries ourself. You could imagine it as compiling a language which is a sub (some things unsupported) and super (new/custom apis) set of javascript. Not based on any particular spec version, focusing on function/working over spec compliance.
12
12
 
13
+ ## Usage
14
+ Expect nothing to work! Only very limited JS is currently supported. See files in `bench` for examples.
15
+
16
+ ### Setup
17
+ **`npm install -g porffor`**. It's that easy (hopefully) :)
18
+
19
+ ### Trying a REPL
20
+ **`porf`**. Just run it with no script file argument.
21
+
22
+ ### Running a JS file
23
+ **`porf path/to/script.js`**
24
+
25
+ ### Compiling to Wasm
26
+ **`porf wasm path/to/script.js out.wasm`**. Currently it does not use an import standard like WASI, so it is mostly unusable on its own.
27
+
28
+ ### Compiling to native binaries
29
+ > [!WARNING]
30
+ > Compiling to native binaries uses [2c](#2c), Porffor's own Wasm -> C compiler, which is experimental.
31
+
32
+ **`porf native path/to/script.js out(.exe)`**. You can specify the compiler with `--compiler=clang/zig/gcc`, and which opt level to use with `--cO=O3` (`Ofast` by default). Output binaries are also stripped by default.
33
+
34
+ ### Compiling to C
35
+ > [!WARNING]
36
+ > Compiling to C uses [2c](#2c), Porffor's own Wasm -> C compiler, which is experimental.
37
+
38
+ **`porf c path/to/script.js (out.c)`**. When not including an output file, it will be printed to stdout instead.
39
+
40
+ ### Profiling a JS file
41
+ > [!WARNING]
42
+ > Very experimental WIP feature!
43
+
44
+ **`porf profile path/to/script.js`**
45
+
46
+ ### Debugging a JS file
47
+ > [!WARNING]
48
+ > Very experimental WIP feature!
49
+
50
+ **`porf debug path/to/script.js`**
51
+
52
+ ### Profiling the generated Wasm of a JS file
53
+ > [!WARNING]
54
+ > Very experimental WIP feature!
55
+
56
+ **`porf debug-wasm path/to/script.js`**
57
+
58
+
59
+ ### Options
60
+ - `--parser=acorn|@babel/parser|meriyah|hermes-parser` (default: `acorn`) to set which parser to use
61
+ - `--parse-types` to enable parsing type annotations/typescript. if `-parser` is unset, changes default to `@babel/parser`. does not type check
62
+ - `--opt-types` to perform optimizations using type annotations as compiler hints. does not type check
63
+ - `--valtype=i32|i64|f64` (default: `f64`) to set valtype
64
+ - `-O0` to disable opt
65
+ - `-O1` (default) to enable basic opt (simplify insts, treeshake wasm imports)
66
+ - `-O2` to enable advanced opt (inlining). unstable
67
+ - `-O3` to enable advanceder opt (precompute const math). unstable
68
+ - `--no-run` to not run wasm output, just compile
69
+ - `--opt-log` to log some opts
70
+ - `--code-log` to log some codegen (you probably want `-funcs`)
71
+ - `--regex-log` to log some regex
72
+ - `--funcs` to log funcs
73
+ - `--ast-log` to log AST
74
+ - `--opt-funcs` to log funcs after opt
75
+ - `--sections` to log sections as hex
76
+ - `--opt-no-inline` to not inline any funcs
77
+ - `--tail-call` to enable tail calls (experimental + not widely implemented)
78
+ - `--compile-hints` to enable V8 compilation hints (experimental + doesn't seem to do much?)
79
+
13
80
  ## Limitations
14
81
  - No full object support yet
15
82
  - Little built-ins/prototype
@@ -18,10 +85,15 @@ Porffor is primarily built from scratch, the only thing that is not is the parse
18
85
  - Literal callees only in calls (eg `print()` works, `a = print; a()` does not)
19
86
  - No `eval()` etc (since it is AOT)
20
87
 
21
- ## Rhemyn
88
+ ## Sub-engines
89
+
90
+ ### Asur
91
+ Asur is Porffor's own Wasm engine; it is an intentionally simple interpreter written in JS. It is very WIP. See [its readme](asur/README.md) for more details.
92
+
93
+ ### Rhemyn
22
94
  Rhemyn is Porffor's own regex engine; it compiles literal regex to Wasm bytecode AOT (remind you of anything?). It is quite basic and WIP. See [its readme](rhemyn/README.md) for more details.
23
95
 
24
- ## 2c
96
+ ### 2c
25
97
  2c is Porffor's own Wasm -> C compiler, using generated Wasm bytecode and internal info to generate specific and efficient/fast C code. Little boilerplate/preluded code or required external files, just for CLI binaries (not like wasm2c very much).
26
98
 
27
99
  ## Supported
@@ -86,20 +158,29 @@ These include some early (stage 1/0) and/or dead (last commit years ago) proposa
86
158
  - `for...of` (arrays and strings)
87
159
  - Array member setting (`arr[0] = 2`, `arr[0] += 2`, etc)
88
160
  - Array constructor (`Array(5)`, `new Array(1, 2, 3)`)
161
+ - Labelled statements (`foo: while (...)`)
162
+ - `do...while` loops
89
163
 
90
164
  ### Built-ins
91
165
 
92
- - `NaN` and `Infinity` (f64 only)
93
- - `isNaN()` and `isFinite()` (f64 only)
94
- - Most of `Number` (`MAX_VALUE`, `MIN_VALUE`, `MAX_SAFE_INTEGER`, `MIN_SAFE_INTEGER`, `POSITIVE_INFINITY`, `NEGATIVE_INFINITY`, `EPSILON`, `NaN`, `isNaN`, `isFinite`, `isInteger`, `isSafeInteger`) (some f64 only)
95
- - Some `Math` funcs (`Math.sqrt`, `Math.abs`, `Math.floor`, `Math.sign`, `Math.round`, `Math.trunc`, `Math.clz32`, `Math.fround`, `Math.random`) (f64 only)
166
+ - `NaN` and `Infinity`
167
+ - `isNaN()` and `isFinite()`
168
+ - Most of `Number` (`MAX_VALUE`, `MIN_VALUE`, `MAX_SAFE_INTEGER`, `MIN_SAFE_INTEGER`, `POSITIVE_INFINITY`, `NEGATIVE_INFINITY`, `EPSILON`, `NaN`, `isNaN`, `isFinite`, `isInteger`, `isSafeInteger`)
169
+ - Some `Math` funcs (`sqrt`, `abs`, `floor`, `sign`, `round`, `trunc`, `clz32`, `fround`, `random`)
96
170
  - Basic `globalThis` support
97
171
  - Basic `Boolean` and `Number`
98
172
  - Basic `eval` for literals
99
173
  - `Math.random()` using self-made xorshift128+ PRNG
100
- - Some of `performance` (`now()`)
101
- - Some of `Array.prototype` (`at`, `push`, `pop`, `shift`, `fill`)
102
- - Some of `String.prototype` (`at`, `charAt`, `charCodeAt`)
174
+ - Some of `performance` (`now()`, `timeOrigin`)
175
+ - Some of `Array.prototype` (`at`, `push`, `pop`, `shift`, `fill`, `slice`, `indexOf`, `lastIndexOf`, `includes`, `with`, `reverse`, `toReversed`)
176
+ - Some of `Array` (`of`, `isArray`)
177
+ - Most of `String.prototype` (`at`, `charAt`, `charCodeAt`, `toUpperCase`, `toLowerCase`, `startsWith`, `endsWith`, `indexOf`, `lastIndexOf`, `includes`, `padStart`, `padEnd`, `substring`, `substr`, `slice`, `trimStart`, `trimEnd`, `trim`, `toString`, `big`, `blink`, `bold`, `fixed`, `italics`, `small`, `strike`, `sub`, `sup`, `trimLeft`, `trimRight`, )
178
+ - Some of `crypto` (`randomUUID`)
179
+ - `escape`
180
+ - `btoa`
181
+ - Most of `Number.prototype` (`toString`, `toFixed`, `toExponential`)
182
+ - `parseInt`
183
+ - Spec-compliant `Date`
103
184
 
104
185
  ### Custom
105
186
 
@@ -108,34 +189,8 @@ These include some early (stage 1/0) and/or dead (last commit years ago) proposa
108
189
  - Intrinsic functions (see below)
109
190
  - Inlining wasm via ``asm`...``\` "macro"
110
191
 
111
- ## Todo
112
- No particular order and no guarentees, just what could happen soon™
113
-
114
- - Arrays
115
- - More of `Array` prototype
116
- - Arrays/strings inside arrays
117
- - Destructuring
118
- - Objects
119
- - Basic object expressions (eg `{}`, `{ a: 0 }`)
120
- - Wasm
121
- - *Basic* Wasm engine (interpreter) in js
122
- - More math operators (`**`, etc)
123
- - `do { ... } while (...)`
124
- - Rewrite `console.log` to work with strings/arrays
125
- - Exceptions
126
- - Rewrite to use actual strings (optional?)
127
- - `try { } finally { }`
128
- - Rethrowing inside catch
129
- - Optimizations
130
- - Rewrite local indexes per func for smallest local header and remove unused idxs
131
- - Smarter inline selection (snapshots?)
132
- - Remove const ifs (`if (true)`, etc)
133
- - Use type(script) information to remove unneeded typechecker code
134
-
135
192
  ## Performance
136
- *For the things it supports most of the time*, Porffor is blazingly fast compared to most interpreters, and common engines running without JIT. For those with JIT, it is not that much slower like a traditional interpreter would be; mostly the same or a bit faster/slower depending on what.
137
-
138
- ![Screenshot of comparison chart](https://github.com/CanadaHonk/porffor/assets/19228318/76c75264-cc68-4be1-8891-c06dc389d97a)
193
+ *For the features it supports most of the time*, Porffor is *blazingly fast* compared to most interpreters and common engines running without JIT. For those with JIT, it is usually slower by default, but can catch up with compiler arguments and typed input, even more so when compiling to native binaries.
139
194
 
140
195
  ## Optimizations
141
196
  Mostly for reducing size. I do not really care about compiler perf/time as long as it is reasonable. We do not use/rely on external opt tools (`wasm-opt`, etc), instead doing optimization inside the compiler itself creating even smaller code sizes than `wasm-opt` itself can produce as we have more internal information.
@@ -143,7 +198,7 @@ Mostly for reducing size. I do not really care about compiler perf/time as long
143
198
  ### Traditional opts
144
199
  - Inlining functions (WIP, limited)
145
200
  - Inline const math ops
146
- - Tail calls (behind flag `-tail-call`)
201
+ - Tail calls (behind flag `--tail-call`)
147
202
 
148
203
  ### Wasm transforms
149
204
  - `local.set`, `local.get` -> `local.tee`
@@ -157,10 +212,12 @@ Mostly for reducing size. I do not really care about compiler perf/time as long
157
212
  - Remove unneeded blocks (no `br`s inside)
158
213
  - Remove unused imports
159
214
  - Use data segments for initing arrays/strings
215
+ - (Likely more not documented yet, todo)
160
216
 
161
217
  ### Wasm module
162
218
  - Type cache/index (no repeated types)
163
219
  - No main func if empty (and other exports)
220
+ - No tags if unused/optimized out
164
221
 
165
222
  ## Test262
166
223
  Porffor can run Test262 via some hacks/transforms which remove unsupported features whilst still doing the same asserts (eg simpler error messages using literals only). It currently passes >10% (see latest commit desc for latest and details). Use `node test262` to test, it will also show a difference of overall results between the last commit and current results.
@@ -168,7 +225,7 @@ Porffor can run Test262 via some hacks/transforms which remove unsupported featu
168
225
  ## Codebase
169
226
  - `compiler`: contains the compiler itself
170
227
  - `builtins.js`: all built-ins of the engine (spec, custom. vars, funcs)
171
- - `codeGen.js`: code (wasm) generation, ast -> wasm. The bulk of the effort
228
+ - `codegen.js`: code (wasm) generation, ast -> wasm. The bulk of the effort
172
229
  - `decompile.js`: basic wasm decompiler for debug info
173
230
  - `embedding.js`: utils for embedding consts
174
231
  - `encoding.js`: utils for encoding things as bytes as wasm expects
@@ -176,11 +233,11 @@ Porffor can run Test262 via some hacks/transforms which remove unsupported featu
176
233
  - `index.js`: doing all the compiler steps, takes code in, wasm out
177
234
  - `opt.js`: self-made wasm bytecode optimizer
178
235
  - `parse.js`: parser simply wrapping acorn
179
- - `sections.js`: assembles wasm ops and metadata into a wasm module/file
236
+ - `assemble.js`: assembles wasm ops and metadata into a wasm module/file
180
237
  - `wasmSpec.js`: "enums"/info from wasm spec
181
238
  - `wrap.js`: wrapper for compiler which instantiates and produces nice exports
182
239
 
183
- - `runner`: contains utils for running js with the compiler
240
+ - `runner`: contains utils for running JS with the compiler
184
241
  - `index.js`: the main file, you probably want to use this
185
242
  - `info.js`: runs with extra info printed
186
243
  - `repl.js`: basic repl (uses `node:repl`)
@@ -193,57 +250,80 @@ Porffor can run Test262 via some hacks/transforms which remove unsupported featu
193
250
  - `test262`: test262 runner and utils
194
251
 
195
252
  ## Usecases
196
- Basically none (other than giving people headaches). Potential ideas to come?
253
+ Basically none right now (other than giving people headaches). Potential ideas:
254
+ - Safety. As Porffor is written in JS, a memory-safe language\*, and compiles JS to Wasm, a fully sandboxed environment\*, it is quite safe. (\* These rely on the underlying implementations being secure. You could also run Wasm, or even Porffor itself, with an interpreter instead of a JIT for bonus security points too.)
255
+ - Compiling JS to native binaries. This is still very early!
256
+ - More in future probably?
197
257
 
198
- ## Usage
199
- Basically nothing will work :). See files in `test` for examples.
258
+ ## Todo
259
+ No particular order and no guarentees, just what could happen soon™
200
260
 
201
- 1. Clone repo
202
- 2. `npm install`
203
- 3. `node test` to run tests (some will fail)
204
- 4. `node runner path/to/code.js` to run a file (or `node runner` to use wip repl)
261
+ - Arrays
262
+ - More of `Array` prototype
263
+ - Arrays/strings inside arrays
264
+ - Destructuring
265
+ - Objects
266
+ - Basic object expressions (eg `{}`, `{ a: 0 }`)
267
+ - Asur
268
+ - Support memory
269
+ - Support exceptions
270
+ - More math operators (`**`, etc)
271
+ - Typed export inputs (array)
272
+ - Exceptions
273
+ - Rewrite to use actual strings (optional?)
274
+ - `try { } finally { }`
275
+ - Rethrowing inside catch
276
+ - Optimizations
277
+ - Rewrite local indexes per func for smallest local header and remove unused idxs
278
+ - Smarter inline selection (snapshots?)
279
+ - Remove const ifs (`if (true)`, etc)
280
+ - Memory alignment
281
+ - Add general pref for always using "fast" (non-short circuiting) or/and
282
+ - Runtime
283
+ - WASI target
284
+ - Run precompiled Wasm file if given
285
+ - Docs
286
+ - Update codebase readme section
287
+ - Cool proposals
288
+ - [Optional Chaining Assignment](https://github.com/tc39/proposal-optional-chaining-assignment)
289
+ - [Modulus and Additional Integer Math](https://github.com/tc39/proposal-integer-and-modulus-math)
290
+ - [Array Equality](https://github.com/tc39/proposal-array-equality)
291
+ - [Declarations in Conditionals](https://github.com/tc39/proposal-Declarations-in-Conditionals)
292
+ - [Seeded Pseudo-Random Numbers](https://github.com/tc39/proposal-seeded-random)
293
+ - [`do` expressions](https://github.com/tc39/proposal-do-expressions)
294
+ - [String Trim Characters](https://github.com/Kingwl/proposal-string-trim-characters)
295
+ - Posts
296
+ - Inlining investigation
297
+ - JS -> Native
298
+ - Precompiled TS built-ins
299
+ - Asur
300
+ - `escape()` optimization
301
+ - Self hosted testing?
205
302
 
206
- You can also use Deno (`deno run -A ...` instead of `node ...`), or Bun (`bun ...` instead of `node ...`).
303
+ ## VSCode extension
304
+ There is a vscode extension in `vscode-ext` which tweaks JS syntax highlighting to be nicer with porffor features (eg highlighting wasm inside of inline asm).
207
305
 
208
- ### Options
209
- - `-target=wasm|c|native` (default: `wasm`) to set target output (native compiles c output to binary, see args below)
210
- - `-target=c|native` only:
211
- - `-o=out.c|out.exe|out` to set file to output c or binary
212
- - `-target=native` only:
213
- - `-compiler=clang` to set compiler binary (path/name) to use to compile
214
- - `-cO=O3` to set compiler opt argument
215
- - `-valtype=i32|i64|f64` (default: `f64`) to set valtype
216
- - `-O0` to disable opt
217
- - `-O1` (default) to enable basic opt (simplify insts, treeshake wasm imports)
218
- - `-O2` to enable advanced opt (inlining)
219
- - `-O3` to enable advanceder opt (precompute const math)
220
- - `-no-run` to not run wasm output, just compile
221
- - `-opt-log` to log some opts
222
- - `-code-log` to log some codegen (you probably want `-funcs`)
223
- - `-regex-log` to log some regex
224
- - `-funcs` to log funcs
225
- - `-ast-log` to log AST
226
- - `-opt-funcs` to log funcs after opt
227
- - `-sections` to log sections as hex
228
- - `-opt-no-inline` to not inline any funcs
229
- - `-tail-call` to enable tail calls (experimental + not widely implemented)
230
- - `-compile-hints` to enable V8 compilation hints (experimental + doesn't seem to do much?)
306
+ ## Wasm proposals used
307
+ Porffor intentionally does not use Wasm proposals which are not commonly implemented yet (eg GC) so it can be used in as many places as possible.
231
308
 
232
- ## VSCode extension
233
- There is a vscode extension in `porffor-for-vscode` which tweaks js syntax highlighting to be nicer with porffor features (eg highlighting wasm inside of inline asm).
309
+ - Multi-value **(required)**
310
+ - Non-trapping float-to-int conversions **(required)**
311
+ - Bulk memory operations (required, but uncommonly used)
312
+ - Exception handling (optional, for errors)
313
+ - Tail calls (opt-in, off by default)
234
314
 
235
315
  ## Isn't this the same as AssemblyScript/other Wasm langs?
236
316
  No. they are not alike at all internally and have very different goals/ideals:
237
317
  - Porffor is made as a generic JS engine, not for Wasm stuff specifically
238
- - Porffor takes in JS, not a different language or typescript
239
- - Porffor is made in pure JS and compiles itself, not using Binaryen/etc
318
+ - Porffor primarily consumes JS
319
+ - Porffor is written in pure JS and compiles itself, not using Binaryen/etc
240
320
  - (Also I didn't know it existed when I started this, lol)
241
321
 
242
322
  ## FAQ
243
323
 
244
324
  ### 1. Why the name?
245
325
  `purple` in Welsh is `porffor`. Why purple?
246
- - No other js engine is purple colored
326
+ - No other JS engine is purple colored
247
327
  - Purple is pretty cool
248
328
  - Purple apparently represents "ambition", which is.. one word to describe this project
249
329
  - The hard to speak name is also the noise your brain makes in reaction to this idea!
package/asur/README.md ADDED
@@ -0,0 +1,2 @@
1
+ # asur
2
+ a basic experimental wip wasm engine/interpreter in js. wasm engine for porffor. not serious/intended for (real) use