@ai-ecoverse/wasix-python 3.14.2-15 → 3.14.2-18

package/README.md

@@ -4,7 +4,7 @@ CPython 3.14 for slicc WASIX (`commands` `python` / `python3`).
 
 ## Features
 
-- PIE dynamic-main (`dylink.0`) on wasix-sysroot 2025.9.30-18's `sysroot-ehpic` (legacy wasm EH), SOABI `cpython-314-wasm32-wasix`; native side modules (py-numpy, py-scipy, py-pandas, …) load by `dlopen`
+- PIE dynamic-main (`dylink.0`) on wasix-sysroot 2025.9.30-27's `sysroot-ehpic` (legacy wasm EH), SOABI `cpython-314-wasm32-wasix`; native side modules (py-numpy, py-scipy, py-pandas, …) load by `dlopen`
 - **File modes** (3.14.2-12, on slicc-kernel ≥ 1.35.1; older kernels keep the no-op modes): `os.umask`, `open()`/`os.mkdir` create modes, `os.chmod`, `tempfile.mkstemp` 600 / `mkdtemp` 700, pip console scripts 755
 - Built in: `ssl`/`hashlib` (OpenSSL 3.5.9, `@ai-ecoverse/wasix-openssl`), `zlib` 1.3.1, `bz2`, `lzma` (xz 5.8.4), `sqlite3` (3.53.4; FTS5, JSON, math, R*Tree; no WAL, no extensions), `readline` 8.3 (ncurses 6.5 terminfo compiled in: xterm, screen, tmux, vt100, linux), `ctypes` / `_ctypes` (wasix-org/libffi; needs slicc-kernel#306 step 1 for `call_dynamic` + `closure_{allocate,free}`), `mmap`, `fcntl`, `termios`, `resource`, `pwd`, `grp`, `select`
 - No `fork`/`vfork`; `subprocess` via `os.posix_spawn` (`proc_spawn2`/`3`)
@@ -18,6 +18,58 @@ CPython 3.14 for slicc WASIX (`commands` `python` / `python3`).
 
 Since 3.14.2-12 the package is cross-built from source in CI (`build.sh`); see `THIRD-PARTY-NOTICES.md` for the statically linked libraries.
 
+Since 3.14.2-18:
+- `ctypes.CDLL(None)` has no `fork` (nor `_Fork`, `__wasi_proc_fork`, …):
+  python.wasm no longer exports them (homescoop#296). In 3.14.2-17 calling
+  `ctypes.CDLL(None).fork()` crashed the interpreter (a wasm trap): fork needs
+  Asyncify on every frame between it and `main`, and ctypes' frames have none.
+  `os.fork` stays absent; `subprocess`, `os.posix_spawn` and `os.system` work
+  as before.
+
+Since 3.14.2-17 (wasix-sysroot -27):
+- `os.utime(path)`, `pathlib.Path.touch()` and everything else that sets a
+  file's times to "now" set them to now; up to 3.14.2-16 they set them to
+  0 (1970) (wasix-sysroot's broken `utimensat(NULL)`, homescoop#294).
+- `os.times()`, `resource.getrusage(RUSAGE_SELF)` and `time.clock`-style
+  callers report the process CPU time slicc-kernel keeps; system and
+  children's times are 0. Up to -16 they held wall-clock values.
+- An empty path is `FileNotFoundError` (`os.stat("")`, `open("")`), as on
+  Linux; files have owners on slicc-kernel ≥ 1.59.0 with users on
+  (`os.chown`, `os.stat().st_uid`), and `os.access` asks the kernel
+  (≥ 1.63.0).
+- **A system site directory every user shares:**
+  `/usr/local/lib/python3.14/site-packages` is added (with `site.addsitedir`,
+  so its `.pth` files run) after python's own site-packages and the py-*
+  packages it finds, when it exists. An embedder can drop a `.pth` there once
+  for every user. A virtual environment sees it only with
+  `--system-site-packages`, as on Linux.
+- The py-* discovery cache is per user:
+  `${XDG_CACHE_HOME:-~/.cache}/slicc-site/`, never in the package directory
+  (which other users cannot write); without a home or a writable cache
+  directory there is no cache.
+- `pip` and `pip3` are commands (`python3 -m pip`); `pip install --user`
+  installs into the user's own site-packages.
+- `python -m venv` takes about half as long: ensurepip runs the package's own
+  compiled pip instead of pip from the zipped wheel.
+
+Since 3.14.2-16 (wasix-sysroot -22: the `slicc.libc` marker, no exported
+itimer helper):
+- ctypes calls variadic C functions (`printf`, `snprintf`, `sscanf`,
+  `open(path, flags, mode)`, `fcntl`, `ioctl`, …): our libffi passes the
+  variadic arguments the way the wasm32 C ABI does
+  (`patches/libffi-wasix-varargs.patch`). As on Apple arm64, set `argtypes` to
+  the **fixed** parameters (e.g. `[c_char_p]` for `printf`) and pass the rest
+  as typed ctypes values (`c_int`, `c_double`, …); without `argtypes` every
+  argument is taken as fixed, which is wrong for a variadic function on wasm32.
+  Pass `c_double` for `%f`: ctypes does not promote, and a variadic `c_float`
+  raises `RuntimeError: ffi_prep_cif_var failed` (libffi rejects it, as on
+  every platform).
+  3.14.2-15 could not call them at all ("ffi_prep_cif_var failed").
+- Signals during blocking calls follow PEP 475 on slicc-kernel ≥ 1.53.3, which
+  answers -22-marked programs with EINTR: a signal whose handler returns does
+  not shorten `time.sleep`/`select`/`poll`, and ^C raises `KeyboardInterrupt`
+  at once (`cert/signals.mjs`).
+
 Since 3.14.2-15:
 - `ctypes` / `_ctypes` (wasix-org/libffi) — needs slicc-kernel ≥ 1.51.0 (#306 /
   #316: `call_dynamic`, `closure_{allocate,prepare,free}`, POSIX `dlopen(NULL)` /
@@ -35,8 +87,8 @@ Since 3.14.2-15:
   and if the `wasix-python` it resolves to (Node's lookup from its real
   directory) is this python's exact version, so side modules never mix
   interpreter builds; the first package of a name wins. `python -v` reports
-  what was skipped and why. The scan is cached in `.slicc-site-cache` in
-  python's directory (keyed on the package directories and their
+  what was skipped and why. The scan is cached per user in
+  `${XDG_CACHE_HOME:-~/.cache}/slicc-site/` (since 3.14.2-17; keyed on the package directories and their
   `package.json` stamps; `-v` always rescans); with the cache, a start costs
   about 2 ms more than with discovery off, and less than the same directories
   on `PYTHONPATH`. As with `PYTHONPATH`, `.pth` files in those directories are

package/THIRD-PARTY-NOTICES.md

@@ -12,8 +12,8 @@ bin/python.wasm statically links:
 | SQLite | 3.53.4 | public domain | sqlite.org |
 | GNU Readline | 8.3 | GPL-3.0-or-later | gnu.org/software/readline |
 | ncurses (tinfo) | 6.5 | X11 | invisible-island.net/ncurses |
-| libffi | 3.5.1 | MIT | github.com/wasix-org/libffi |
-| wasix-libc | wasix-sysroot 2025.9.30-21 | Apache-2.0 WITH LLVM-exception, MIT | @ai-ecoverse/wasix-sysroot |
+| libffi | 3.5.1 (wasix-org 09cbf7d + patches/libffi-wasix-varargs.patch) | MIT | github.com/wasix-org/libffi |
+| wasix-libc | wasix-sysroot 2025.9.30-27 | Apache-2.0 WITH LLVM-exception, MIT | @ai-ecoverse/wasix-sysroot |
 | libc++, libc++abi, libunwind | wasix-libc v2026-07-03.1 sysroot-ehpic | Apache-2.0 WITH LLVM-exception | github.com/wasix-org/wasix-libc |
 
 lib/python3.14/site-packages/pip is pip (MIT), from CPython's ensurepip bundle.

package/lib/libpython3.14.a

@@ -1,4 +1,4 @@
 [diffend] Oversized file quarantined before diffing.
 name: package/lib/libpython3.14.a
-size: 59362746 bytes
-sha256: b5320f13b4636974f7dcf92f662e9e9f488a051d092d7bff059ad787522bb0b1
+size: 59362794 bytes
+sha256: 778c4e87cac3d76368fc786d6112159cfd27802c16ad6870f2a3fa664fa3e5f9

package/lib/python3.14/_slicc_site.py

@@ -24,9 +24,17 @@ resolves to (Node-style lookup from its real directory), if any, has the
 same exact version as this python: the same version is the same build, so
 native side modules never mix interpreter builds. The first package of a
 name wins; others are skipped (reported under -v).
-The result is cached in <python>/.slicc-site-cache, keyed on the package
-directories and their package.json stamps, plus the stamps of the
-wasix-python copies they resolved to; -v always rescans.
+The result is cached per user in ${XDG_CACHE_HOME:-~/.cache}/slicc-site/
+(3.14.2-17; before, <python>/.slicc-site-cache, which other users could not
+write), keyed on the package directories and their package.json stamps, plus
+the stamps of the wasix-python copies they resolved to; -v always rescans.
+Without a home or a writable cache directory there is no cache.
+
+system_site() (3.14.2-17): /usr/local/lib/python3.X/site-packages, when it
+exists, goes on sys.path through site.addsitedir (so its .pth files run),
+after python's own site-packages and the py-* directories: one place an
+embedder can put a .pth for every user. Like discover(), it runs from the
+base .pth only, so a venv sees it with --system-site-packages.
 """
 import os
 import sys
@@ -212,8 +220,8 @@ def discover():
     # slicc's OPFS; directory mtimes are not). A hit costs one stat per
     # package instead of realpath + read + parse + lookup.
     key = "\n".join(filter(None, [base, _stamp(real), *map(_stamp, found)]))
-    cache = os.path.join(real, ".slicc-site-cache")
-    if not sys.flags.verbose:
+    cache = _cache_path(real)
+    if cache and not sys.flags.verbose:
         try:
             with open(cache, encoding="utf-8") as f:
                 head, _, rest = f.read().partition("\n\n")
@@ -231,15 +239,37 @@ def discover():
     for d in dirs:
         if d not in sys.path:  # as PYTHONPATH would: .pth files there are not run
             sys.path.append(d)
+    if not cache:
+        return
     try:
+        os.makedirs(os.path.dirname(cache), exist_ok=True)
         tmp = f"{cache}.{os.getpid()}"
         with open(tmp, "w", encoding="utf-8") as f:
             f.write(key + "\n\n" + "\n".join(filter(None, map(_stamp, sorted(used)))) + "\n\n" + "\n".join(dirs))
         os.replace(tmp, cache)
-    except OSError:  # read-only install: no cache, scan every start
+    except OSError:  # no writable cache directory: scan every start
         pass
 
 
+def _cache_path(real):
+    base = os.environ.get("XDG_CACHE_HOME")
+    if not base:
+        home = os.environ.get("HOME")
+        if not home:
+            return None
+        base = os.path.join(home, ".cache")
+    return os.path.join(base, "slicc-site", real.strip("/").replace("/", "%") or "%")
+
+
+def system_site():
+    d = f"/usr/local/lib/python{sys.version_info[0]}.{sys.version_info[1]}/site-packages"
+    if d in sys.path or not os.path.isdir(d):
+        return
+    import site
+
+    site.addsitedir(d)
+
+
 def _scan(real, found):
     me = _manifest(real)
     if not me or me.get("name") != _PY_PKG:

package/lib/python3.14/ensurepip/__init__.py

@@ -169,7 +169,13 @@ def _bootstrap(*, root=None, upgrade=False, user=False,
         if verbosity:
             args += ["-" + "v" * verbosity]
 
-        return _run_pip([*args, "pip"], [os.fsdecode(tmp_wheel_path)])
+        pip_path = [os.fsdecode(tmp_wheel_path)]
+        installed = sysconfig.get_path("purelib", vars={"base": sys.base_prefix, "platbase": sys.base_prefix})
+        if (sys.platform == "wasi" and sys.prefix != sys.base_prefix and not root and not user
+                and os.path.isdir(os.path.join(installed, f"pip-{_PIP_VERSION}.dist-info"))):
+            pip_path = [installed]
+            args += ["--ignore-installed"]
+        return _run_pip([*args, "pip"], pip_path)
 
 
 def _uninstall_helper(*, verbosity=0):

package/lib/python3.14/site-packages/slicc-executable.pth

@@ -1 +1 @@
-import _slicc_site; _slicc_site.fix(); _slicc_site.discover()
+import _slicc_site; _slicc_site.fix(); _slicc_site.discover(); _slicc_site.system_site()

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@ai-ecoverse/wasix-python",
-  "version": "3.14.2-15",
+  "version": "3.14.2-18",
   "description": "CPython 3.14 for slicc WASIX (commands python, python3; cross-built in CI on wasix-sysroot)",
   "license": "PSF-2.0 AND GPL-3.0-or-later",
   "engines": {
@@ -55,6 +55,32 @@
           "PYTHONHOME": "./",
           "PYTHONDONTWRITEBYTECODE": "1"
         }
+      },
+      "pip": {
+        "wasm": "bin/python.wasm",
+        "argv0Path": true,
+        "env": {
+          "PYTHONHOME": "./",
+          "PYTHONDONTWRITEBYTECODE": "1"
+        },
+        "argv0": "python3",
+        "args": [
+          "-m",
+          "pip"
+        ]
+      },
+      "pip3": {
+        "wasm": "bin/python.wasm",
+        "argv0Path": true,
+        "env": {
+          "PYTHONHOME": "./",
+          "PYTHONDONTWRITEBYTECODE": "1"
+        },
+        "argv0": "python3",
+        "args": [
+          "-m",
+          "pip"
+        ]
       }
     },
     "python": {