goscript 0.0.84 → 0.1.1

package/README.md

@@ -1,101 +1,154 @@
-# GoScript
-
-[![GoDoc Widget]][GoDoc] [![Go Report Card Widget]][Go Report Card] [![Ask DeepWiki](https://deepwiki.com/badge.svg)](https://deepwiki.com/aperturerobotics/goscript)
-
-[GoDoc]: https://godoc.org/github.com/aperturerobotics/goscript
-[GoDoc Widget]: https://godoc.org/github.com/aperturerobotics/goscript?status.svg
-[Go Report Card Widget]: https://goreportcard.com/badge/github.com/aperturerobotics/goscript
-[Go Report Card]: https://goreportcard.com/report/github.com/aperturerobotics/goscript
-
-## What is GoScript?
-
-GoScript is an experimental **Go to TypeScript compiler** that translates Go code to TypeScript at the AST level. The goal is to enable sharing algorithms and business logic between Go backends and TypeScript frontends.
-
-> Right now goscript looks pretty cool if you problem is "I want this self-sufficient algorithm be available in Go and JS runtimes". gopherjs's ambition, however, has always been "any valid Go program can run in a browser". There is a lot that goes on in gopherjs that is necessary for supporting the standard library, which goes beyond cross-language translation.
+<div align="center">
+  <h1>GoScript</h1>
+
+  <h3>Readable TypeScript output for Go packages</h3>
+
+  <p>
+    Compile Go packages into TypeScript modules for shared application logic.<br/>
+    Built for Bun, modern bundlers, browser demos, and package-level workflows.<br/>
+  </p>
+
+  <p>
+    <a href="https://godoc.org/github.com/aperturerobotics/goscript">
+      <img src="https://godoc.org/github.com/aperturerobotics/goscript?status.svg" alt="GoDoc" />
+    </a>
+    <a href="https://goreportcard.com/report/github.com/aperturerobotics/goscript">
+      <img src="https://goreportcard.com/badge/github.com/aperturerobotics/goscript" alt="Go Report Card" />
+    </a>
+    <a href="https://deepwiki.com/aperturerobotics/goscript">
+      <img src="https://deepwiki.com/badge.svg" alt="Ask DeepWiki" />
+    </a>
+  </p>
+</div>
+
+## Overview
+
+**GoScript** is an experimental Go-to-TypeScript compiler.
+
+GoScript compiles Go packages from inside a Go module and writes deterministic
+TypeScript packages under `@goscript/<go-package>/`. The compiler keeps package
+loading, semantic modeling, lowering, TypeScript emission, runtime helpers, and
+handwritten override packages as explicit pipeline stages so generated output is
+readable and semantic decisions have one owner.
+
+> "Right now goscript looks pretty cool if [your] problem is 'I want this
+> self-sufficient algorithm [to] be available in Go and JS runtimes.'"
 >
-> &mdash; [nevkontakte](https://gophers.slack.com/archives/C039C0R2T/p1745870396945719), developer of [GopherJS](https://github.com/gopherjs/gopherjs)
-
-### 🎯 Why GoScript?
-
-Write once, run everywhere. Share your Go algorithms, business logic, and data structures seamlessly between your backend and frontend without maintaining two codebases.
-
-**Use cases:**
-
-- Sharing business logic between Go services and web apps
-- Porting Go algorithms to run in browsers
-- Building TypeScript libraries from existing Go code
-
-Go has powerful concurrency support and an excellent standard library. GoScript brings these capabilities to TypeScript with as simple and readable of a translation as possible.
-
-**✅ What works:**
-
-- Structs, interfaces, methods, and functions with full value semantics
-- Channels and goroutines (translated to async/await with function coloring)
-- Pointers and addressability (via VarRef system)
-- Slices, maps, and built-in types
-- Control flow (if, for, switch, select, range, defer, etc.)
-- Type assertions and interface implementations
-- Closures and anonymous functions
-- Generics
-- Reflection
-- Encoding: encoding/json
-- Most of the standard library
-
-**🚧 In progress:**
-
-- Reflection edge cases
-- Full standard library coverage
-- Various other edge cases (see GitHub issues)
-
-**Important Notes**
-
-- Uses JavaScript `number` type (64-bit float, not Go's int types)
-- No pointer arithmetic (`uintptr`) or `unsafe` package
-- No complex numbers
-
-📖 **Learn more:** [Design document](./design/DESIGN.md) | [Architecture explainer](./docs/explainer.md) | [Compliance tests](./tests/README.md)
-
-🐛 **Found an issue?** Please [open an issue](https://github.com/aperturerobotics/goscript/issues).
-
-## 🚀 Try It
-
-### Prerequisites
-
-GoScript requires [Bun](https://bun.sh) to be installed for running compliance tests:
+> - [nevkontakte](https://gophers.slack.com/archives/C039C0R2T/p1745870396945719),
+>   developer of [GopherJS](https://github.com/gopherjs/gopherjs)
+
+That contrast is the project shape. GopherJS aims to make any valid Go program
+run in a browser. GoScript starts from the narrower but common product need:
+move self-contained Go logic into TypeScript projects without maintaining a
+second implementation.
+
+### Why GoScript?
+
+Use GoScript when you want to share Go algorithms, data structures, validation
+logic, or selected runtime code with TypeScript and browser environments without
+maintaining a second implementation by hand. The first supported target is a
+useful, well-defined subset of Go that produces readable TypeScript and avoids
+unsafe-heavy runtime behavior. The long-term goal is to expand that subset until
+ordinary Go programs can run through GoScript, but that is not the first
+compatibility bar.
+
+Good fits today include:
+
+- Sharing validation, formatting, parsing, and business rules between Go services and TypeScript applications
+- Publishing TypeScript packages from Go data structures and algorithms
+- Running selected Go runtime code in Bun, browser demos, and modern bundlers
+- Building package-level test workflows that exercise generated TypeScript instead of handwritten ports
+
+GoScript is not currently a drop-in browser runtime for every valid Go program.
+The project prioritizes clear generated TypeScript, explicit runtime contracts,
+and focused support for Go language features that can be modeled cleanly in
+TypeScript.
+
+Useful docs:
+
+- [Architecture explainer](./docs/explainer.md)
+- [Compiler design](./design/DESIGN.md)
+- [Compliance tests](./tests/README.md)
+- [Runtime packages](./gs/README.md)
+
+## Current Surface
+
+### Works Today
+
+The package compiler currently supports:
+
+- Go package loading through `go/packages` with `GOOS=js` and `GOARCH=wasm`
+- Go build tags through CLI build flags, including `goscript`-selected code paths
+- Structs, methods, interfaces, type assertions, typed nils, and value copying
+- Pointers and address-taken variables through the `VarRef` runtime model
+- Arrays, slices, maps, strings, named types, complex values, and selected builtins
+- Generics through generated type-argument dictionaries for supported call,
+  method, and descriptor shapes
+- Goroutines, channels, `select`, `defer`, async calls, async function values,
+  async callbacks, async interfaces, and async package tests
+- Package initialization, cross-file imports, package indexes, dependency
+  output, and package-scoped test graph variants
+- Handwritten `gs/` runtime and standard-library override packages for the
+  browser/WASM-oriented subset
+- `goscript test`, which compiles selected Go package tests to TypeScript,
+  typechecks the generated workspace, runs it with Bun, and reports package
+  failures with owner classifications
+- Browser/WASM compilation for import-free single-file demos
+
+### Intentional Limits
+
+- CLI, Go API, and Node API inputs are package patterns, not direct `main.go` files.
+- Browser source compilation is import-free only. Imported code should use the package workflow.
+- `unsafe`, pointer arithmetic, cgo, and arbitrary Go runtime behavior are not
+  part of the first supported target.
+- JavaScript `number` is used for numeric output, so it does not preserve every Go integer edge case.
+- Standard-library coverage is practical and override-driven, not complete.
+- Package-test execution intentionally supports a growing GoScript-compatible
+  subset of `testing`, not the complete `go test` flag surface.
+
+## Getting Started
+
+Install Bun for TypeScript tests, examples, and website builds:
 
 ```bash
-# Install Bun
 curl -fsSL https://bun.sh/install | bash
 ```
 
-### Installation
-
-**Option 1: Go Install**
+Install the CLI:
 
 ```bash
 go install github.com/aperturerobotics/goscript/cmd/goscript@latest
 ```
 
-**Option 2: NPM** (if available)
+Compile a Go package from a module directory:
 
 ```bash
-npm install -g goscript
+goscript compile --package . --output ./output
 ```
 
-### Compilation
+The output tree looks like this:
 
-```bash
-# Try compiling your Go package to TypeScript
-goscript compile --package . --output ./dist
+```text
+output/
+└── @goscript/
+    ├── builtin/
+    └── example.com/my/module/
+        ├── index.ts
+        └── main.gs.ts
 ```
 
-## 📦 Using Generated Code in Your Project
+For a generated `package main`, GoScript emits a main-script guard so the module
+can run directly in Bun or a bundler that resolves `@goscript/*` imports. See
+[example/simple](./example/simple) for the smallest compile-and-run workflow.
 
-After compiling your Go code to TypeScript, you'll need to set up your project appropriately.
+## TypeScript Projects
 
-### TypeScript Configuration
+Generated package indexes re-export generated files such as `./main.gs.ts`, and
+some package-local imports also use explicit `.ts` specifiers. Your TypeScript
+project needs to allow those imports and map `@goscript/*` to the generated
+output root.
 
-Create or update your `tsconfig.json` with these settings:
+Use this shape as the starting point:
 
 ```json
 {
@@ -103,11 +156,13 @@ Create or update your `tsconfig.json` with these settings:
     "target": "ES2022",
     "module": "ESNext",
     "moduleResolution": "bundler",
-    "lib": ["ES2022", "esnext.disposable", "dom"],
-    "baseUrl": "./",
+    "lib": ["ES2022", "esnext.disposable", "DOM"],
+    "baseUrl": ".",
     "paths": {
-      "@goscript/*": ["./path/to/generated/output/@goscript/*"]
+      "@goscript/*": ["./output/@goscript/*"]
     },
+    "allowImportingTsExtensions": true,
+    "rewriteRelativeImportExtensions": true,
     "allowSyntheticDefaultImports": true,
     "esModuleInterop": true,
     "skipLibCheck": true,
@@ -116,230 +171,199 @@ Create or update your `tsconfig.json` with these settings:
 }
 ```
 
-**Important requirements:**
-
-- **`target: "ES2022"` or newer** - Required for `Disposable` and other features
-- **`lib: ["esnext.disposable"]`** - Enables TypeScript's disposable types for resource management
-- **`baseUrl` and `paths`** - Allows TypeScript to resolve `@goscript/*` imports
-- **`moduleResolution: "bundler"`** - Recommended for modern bundlers
+The important settings are:
 
-You should be able to use any TypeScript bundler to compile the generated TypeScript.
+- `moduleResolution: "bundler"` so `@goscript/*` package imports resolve like a modern app build.
+- `allowImportingTsExtensions: true` because generated indexes and same-package imports can reference `.ts` files directly.
+- `rewriteRelativeImportExtensions: true` if TypeScript is emitting JavaScript instead of only typechecking.
+- `paths` pointing at the generated `@goscript/` tree.
 
-## 🛠️ Integration & Usage
+If your bundler owns JavaScript emission and TypeScript only typechecks, adding
+`"noEmit": true` is also a good fit.
 
-### Command Line
+## Command Line
 
 ```bash
-goscript compile --package ./my-go-code --output ./dist
+goscript compile \
+  --package ./my-go-package \
+  --output ./output
 ```
 
-**Options:**
+Common options:
 
-- `--package <path>` - Go package to compile (default: ".")
-- `--output <dir>` - Output directory for TypeScript files
+- `--package <pattern>`: Go package pattern to compile. Repeat for multiple packages.
+- `--output <dir>`: output directory for the generated TypeScript tree.
+- `--dir <dir>`: working directory for module/package loading.
+- `--build-flags <flag>`: Go build flag, repeatable.
+- `--all-dependencies`: compile dependency packages instead of only requested packages.
+- `--disable-emit-builtin`: skip copying handwritten `gs/` runtime packages.
 
-### Programmatic API
+Run Go package tests through GoScript:
 
-**Go:**
-
-```go
-import "github.com/aperturerobotics/goscript/compiler"
-
-conf := &compiler.Config{OutputPath: "./dist"}
-comp, err := compiler.NewCompiler(conf, logger, nil)
-_, err = comp.CompilePackages(ctx, "your/package/path")
+```bash
+goscript test --tags goscript ./...
 ```
 
-**Node.js:**
+`goscript test` loads package test variants, compiles each selected package
+through the normal GoScript pipeline, writes a TypeScript test runner, typechecks
+the generated workspace, and runs it with Bun. Useful options:
 
-```typescript
-import { compile } from 'goscript'
-
-await compile({
-  pkg: './my-go-package',
-  output: './dist',
-})
-```
+- `--tags <tags>`: comma-separated Go build tags.
+- `--run <regexp>`: run only matching Go test names.
+- `--count <n>`: run selected tests multiple times.
+- `--timeout <duration>`: maximum package-test runtime.
+- `--workdir <dir>`: generated test workspace directory.
+- `--output <dir>`: generated TypeScript output root.
 
-### Frontend Frameworks
+The output is shaped like `go test` where possible and adds an `owner=...`
+classification for failures that occur before the generated tests run.
 
-**React + GoScript:**
+## APIs
 
-```typescript
-import { NewCalculator } from '@goscript/myapp/calculator'
+Go API:
 
-function CalculatorApp() {
-  const [calc] = useState(() => NewCalculator())
-
-  const handleAdd = () => {
-    const result = calc.Add(5, 3)
-    setResult(result)
-  }
+```go
+package main
 
-  return <button onClick={handleAdd}>Add 5 + 3</button>
+import (
+	"context"
+
+	"github.com/aperturerobotics/goscript/compiler"
+)
+
+func main() {
+	comp, err := compiler.NewCompiler(&compiler.Config{
+		Dir:        ".",
+		OutputPath: "./output",
+	}, nil, nil)
+	if err != nil {
+		panic(err)
+	}
+	if _, err := comp.CompilePackages(context.Background(), "."); err != nil {
+		panic(err)
+	}
 }
 ```
 
-**Vue + GoScript:**
+Node/Bun API:
 
-```vue
-<script setup lang="ts">
-import { NewUser, FindUserByEmail } from '@goscript/myapp/user'
-
-const users = ref([NewUser(1, 'Alice', 'alice@example.com')])
+```ts
+import { compile } from 'goscript'
 
-const searchUser = (email: string) => {
-  return FindUserByEmail(users.value, email)
-}
-</script>
+await compile({
+  pkg: '.',
+  output: './output',
+  dir: process.cwd(),
+})
 ```
 
-## 💡 See It In Action
-
-See the [example/app](./example/app) for a full todo list application using GoScript with tRPC, Drizzle ORM, and React, or [example/simple](./example/simple) for a comprehensive demo of language features.
-
-### Example: User Management
-
-**Go Code** (`user.go`):
+WASM adapter package:
 
 ```go
 package main
 
-type User struct {
-    ID    int    `json:"id"`
-    Name  string `json:"name"`
-    Email string `json:"email"`
-}
+import "github.com/aperturerobotics/goscript/compiler/wasm"
 
-func (u *User) IsValid() bool {
-    return u.Name != "" && u.Email != ""
-}
+func main() {
+	ts, err := wasm.CompileSource(`
+package main
 
-func NewUser(id int, name, email string) *User {
-    return &User{ID: id, Name: name, Email: email}
+func main() {
+	println("hello from GoScript")
 }
-
-func FindUserByEmail(users []*User, email string) *User {
-    for _, user := range users {
-        if user.Email == email {
-            return user
-        }
-    }
-    return nil
+`, "main")
+	if err != nil {
+		panic(err)
+	}
+	_ = ts
 }
 ```
 
-**Compile it:**
+The website compiles this package into the browser build. Browser source
+compilation accepts import-free single-file demos. Package imports return a
+structured diagnostic; compile imported code with the package workflow.
 
-```bash
-goscript compile --package . --output ./dist
+## Architecture
+
+GoScript v2 uses a linear compiler pipeline:
+
+```text
+public adapter
+  -> compile request
+  -> package graph
+  -> semantic model
+  -> lowered program
+  -> TypeScript emitter
+  -> runtime/override package copy
 ```
 
-**Generated TypeScript** (`user.gs.ts`):
+Each step owns one durable rule boundary:
 
-```typescript
-export class User {
-  public ID: number = 0
-  public Name: string = ''
-  public Email: string = ''
+- `CompileRequestOwner` validates adapter input, module roots, output paths, and build flags.
+- `PackageGraphOwner` loads Go packages and records dependency edges.
+- `SemanticModelOwner` computes type, value, import, addressability, interface, and async facts.
+- `LoweringOwner` turns Go syntax plus semantic facts into compiler-owned IR.
+- `TypeScriptEmitOwner` renders deterministic, semicolon-free TypeScript from IR only.
+- `RuntimeContractOwner` owns generated helper names and `@goscript/builtin` import policy.
+- `OverrideRegistryOwner` discovers and copies handwritten runtime and standard-library packages.
 
-  public IsValid(): boolean {
-    const u = this
-    return u.Name !== '' && u.Email !== ''
-  }
+This keeps semantic decisions out of the text emitter and makes generated output
+changes easier to trace back to the owner that made the decision.
 
-  constructor(init?: Partial<User>) {
-    if (init) Object.assign(this, init)
-  }
-}
+## Running from Source
 
-export function NewUser(id: number, name: string, email: string): User {
-  return new User({ ID: id, Name: name, Email: email })
-}
+Install dependencies:
 
-export function FindUserByEmail(users: User[], email: string): User | null {
-  for (let user of users) {
-    if (user.Email === email) {
-      return user
-    }
-  }
-  return null
-}
+```bash
+bun install
 ```
 
-**Use in your frontend:**
+Run the core checks:
 
-```typescript
-import { NewUser, FindUserByEmail } from '@goscript/myapp/user'
+```bash
+bun run test
+bun run lint
+bun run build
+```
 
-// Same logic, now in TypeScript!
-const users = [
-  NewUser(1, 'Alice', 'alice@example.com'),
-  NewUser(2, 'Bob', 'bob@example.com'),
-]
+Run the simple package example:
 
-const alice = FindUserByEmail(users, 'alice@example.com')
-console.log(alice?.IsValid()) // true
+```bash
+bun run example
 ```
 
-### Example: Async Processing with Channels
-
-**Go Code:**
+Build the static website and browser demo assets:
 
-```go
-func ProcessMessages(messages []string) chan string {
-    results := make(chan string, len(messages))
-
-    for _, msg := range messages {
-        go func(m string) {
-            // Simulate processing
-            processed := "✓ " + m
-            results <- processed
-        }(msg)
-    }
-
-    return results
-}
+```bash
+bun run website:build
 ```
 
-**Generated TypeScript:**
-
-```typescript
-export function ProcessMessages(messages: string[]): $.Channel<string> {
-  let results = $.makeChannel<string>(messages.length, '')
+The website playground can compile and run import-free single-file demos in the
+browser. Compliance examples and imported-package examples are precompiled by the
+website build.
 
-  for (let msg of messages) {
-    queueMicrotask(async (m: string) => {
-      let processed = '✓ ' + m
-      await results.send(processed)
-    })(msg)
-  }
+## Examples
 
-  return results
-}
-```
+- [example/simple](./example/simple): smallest package compile-and-run workflow.
+- [example/app](./example/app): full-stack application example using generated TypeScript.
+- [tests/tests](./tests/tests): inherited compliance fixtures and generated output snapshots.
 
-**Use with async/await:**
+## Contributing
 
-```typescript
-import { ProcessMessages } from '@goscript/myapp/processor'
+GoScript is experimental. Small compatibility shims are usually the wrong fix;
+prefer adding focused compiler or compliance tests that name the missing semantic
+owner, then implement the owner-level behavior.
 
-async function handleMessages() {
-  const channel = ProcessMessages(['hello', 'world', 'goscript'])
+Use the repo scripts rather than direct package-manager commands:
 
-  // Receive processed messages
-  for (let i = 0; i < 3; i++) {
-    const result = await channel.receive()
-    console.log(result) // "✓ hello", "✓ world", "✓ goscript"
-  }
-}
+```bash
+bun run test
+bun run lint
+bun run build
 ```
 
-## 🤝 How You Can Help
-
-- Try GoScript on your code and [report issues](https://github.com/aperturerobotics/goscript/issues)
-- Check the [compliance tests](./tests/README.md) for current progress
-- Contribute test cases for edge cases you discover
+Please open issues for unsupported Go shapes, runtime gaps, and standard-library
+override gaps.
 
 ## License