locale-ai 0.3.0 → 0.3.1

package/README.md

@@ -135,6 +135,7 @@ Measured on a sample app (see `test/fixtures`):
 - **Sentence splitting**: OPUS-MT drops sentences from multi-sentence inputs, so each sentence is translated separately.
 - **Placeholder masking** with three marker styles tried in order (`{0}` / `<0>…</0>`, then numbers `900`, then `_P0_`), validating every marker; numbers survive models that mangle braces (en-zh, en-ru). A last-resort fallback translates around placeholders, and anything that needed it is listed for review.
 - **Speed** (20-core CPU, ~1 GB RAM): sample app (43 strings) in ~3 s per language with beam search, ~2 s with `--fast`; full sentences at ~18/s (built-in, beam 4), ~12/s (tc-big, beam 4), ~33/s (tc-big, `--fast`).
+- **Install size**: `onnxruntime-node` bundles binaries for every platform, and on linux/x64 downloads a ~260 MB CUDA provider by default — locale-ai only ever runs on CPU (`executionProviders: ["cpu"]`), so a `postinstall` script ([`scripts/trim-onnxruntime.cjs`](scripts/trim-onnxruntime.cjs)) removes the unused platforms and GPU providers after install, cutting it from ~550 MB to ~45 MB on your current platform.
 
 ## Development
 
@@ -149,7 +150,5 @@ npm run build       # → dist/
 
 ## Next steps
 
-1. **Host the tc-big models** (converted ONNX) on Hugging Face so they can become the built-in defaults instead of a manual conversion. `en-fr` is done ([khabouss/opus-mt-tc-big-en-fr-onnx](https://huggingface.co/khabouss/opus-mt-tc-big-en-fr-onnx)); es, it, pt, ar, ru/uk, tr remain.
-2. **Smaller install.** `onnxruntime-node` is ~550 MB unpacked: it ships binaries for every platform plus a 260 MB CUDA provider we never use.
-3. **More languages**: ja, ko, pl have no usable OPUS-MT model yet; a different model family would be needed.
-4. **More formats**: YAML, `.po`, ARB, Apple `.strings`.
+1. **More languages**: ja, ko, pl have no usable OPUS-MT model yet; a different model family would be needed.
+2. **More formats**: YAML, `.po`, ARB, Apple `.strings`.

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "locale-ai",
-  "version": "0.3.0",
+  "version": "0.3.1",
   "description": "Translate your i18n locale files locally on CPU. Free, offline, no API keys.",
   "author": "Taha KHABOUSS",
   "repository": {
@@ -17,7 +17,8 @@
   },
   "files": [
     "dist",
-    "scripts/convert-marian.py"
+    "scripts/convert-marian.py",
+    "scripts/trim-onnxruntime.cjs"
   ],
   "engines": {
     "node": ">=22.18"
@@ -28,7 +29,8 @@
     "dev": "node src/cli.ts",
     "test": "node --test test/*.test.ts",
     "test:e2e": "LOCALE_AI_E2E=1 node --test test/e2e.test.ts",
-    "prepublishOnly": "npm run build && npm test"
+    "prepublishOnly": "npm run build && npm test",
+    "postinstall": "node scripts/trim-onnxruntime.cjs"
   },
   "keywords": [
     "i18n",
@@ -48,5 +50,8 @@
   "devDependencies": {
     "@types/node": "^26.6.6",
     "typescript": "^7.0.2"
+  },
+  "allowScripts": {
+    "onnxruntime-node@1.30.0": true
   }
 }

package/scripts/trim-onnxruntime.cjs

@@ -0,0 +1,54 @@
+#!/usr/bin/env node
+'use strict';
+
+// locale-ai only ever runs onnxruntime-node with executionProviders: ["cpu"]
+// (see src/marian.ts) and only ever runs on one platform/arch per install.
+// onnxruntime-node still bundles binaries for every platform, and on
+// linux/x64 its own postinstall downloads a 260 MB CUDA provider we never
+// use (see its script/install-metadata.js). This trims all of that after
+// onnxruntime-node has finished installing, shrinking a ~550 MB unpacked
+// dependency down to the one binary locale-ai actually loads.
+//
+// Best-effort: never fails the install, even if onnxruntime-node changes
+// its layout in a future version.
+
+const fs = require('fs');
+const path = require('path');
+
+function rm(p) {
+  try {
+    fs.rmSync(p, { recursive: true, force: true });
+  } catch {
+    // ignore — best-effort cleanup only
+  }
+}
+
+try {
+  const pkgJson = require.resolve('onnxruntime-node/package.json');
+  const binRoot = path.join(path.dirname(pkgJson), 'bin', 'napi-v6');
+  if (!fs.existsSync(binRoot)) process.exit(0);
+
+  const platform = process.platform;
+  const arch = process.arch;
+
+  for (const entry of fs.readdirSync(binRoot)) {
+    const platformDir = path.join(binRoot, entry);
+    if (entry !== platform) {
+      rm(platformDir);
+      continue;
+    }
+    // Same platform: drop every other architecture.
+    for (const archEntry of fs.readdirSync(platformDir)) {
+      if (archEntry !== arch) rm(path.join(platformDir, archEntry));
+    }
+    // Drop GPU execution providers locale-ai never requests.
+    const archDir = path.join(platformDir, arch);
+    for (const name of fs.readdirSync(archDir)) {
+      if (/^libonnxruntime_providers_(cuda|tensorrt|rocm|dml)\./.test(name)) {
+        rm(path.join(archDir, name));
+      }
+    }
+  }
+} catch {
+  // onnxruntime-node not installed, or its layout changed — nothing to do.
+}