lino-i18n 0.3.0 → 0.4.0

package/CHANGELOG.md

@@ -1,5 +1,39 @@
 # lino-i18n Changelog
 
+## 0.4.0
+
+### Minor Changes
+
+- Add source-message and ICU translation, rich React content and branches,
+  request-isolated server helpers, locale utilities, lazy catalog caching,
+  AST extraction, catalog validation, provider-based translation candidates,
+  and a Vite/Rollup extraction plugin over Links Notation.
+  Add finite static derivation, ICU dictionaries and source-change review checks.
+  Add typed dictionary schemas, canonical/custom locale configuration, scoped Node
+  request access, automatic JSX/attribute compilation and an optional GT SDK bridge.
+  Round-trip quoted source keys without interpreting prototype property names.
+  Preserve complete ICU semantics when converting compiled FormatJS catalogs.
+
+  Add an optional Next 16 App Router adapter for request-scoped server access, hydration, locale proxy/cookies, localized navigation, static params and SEO, verified with a production build and browser tests.
+
+  Resolve shared translator factories, imported finite derivation and dictionary schemas through bounded static module graphs in the CLI and Vite/Rollup plugin.
+
+  Add optional Vue 3.5 reactive source components, formatting, lazy initialization and SSR snapshots, plus SFC/module-aware extraction and CLI integration with compiler and browser regression coverage.
+
+  Add bounded Python AST extraction into shared manifests, optional upstream Markdown helpers with safe entity serialization, and a GT service locale registry bridge.
+
+  Add an injected React Native Text adapter with rich content, native formatter wrappers, headless selectors, serialized locale persistence and matching JSX extraction.
+
+  Add optional TanStack Start request middleware and Router hydration/navigation adapters, verified with actual server functions, a production build and browser tests.
+
+  Add optional rrweb recording/replay over `.lino` catalogs using the published GT player/recorder, bounded ICU harvesting, stable variable leaves and protected source values, with an actual browser privacy/playback regression.
+
+  Add an optional ESLint flat-config plugin sharing the static extractor, with source/JSX/headless-Branch diagnostics, explicit named-variable suggestions and bounded analysis.
+
+  Repair release verification and CI change detection, audit dependencies, and preserve translation behavior while resolving lint warnings.
+
+  Update all JavaScript dependencies to their latest releases (`links-notation` 0.23, `lino-objects-codec` 0.9, ESLint 10.12, Prettier 3.9, Playwright 1.64, React 19.3 typings) and raise the supported Node.js floor to 22.11, which `lino-objects-codec` 0.9 requires; Node.js 20 reached end of life on 2026-04-30.
+
 ## 0.3.0
 
 ### Minor Changes

package/README.md

@@ -7,12 +7,45 @@
 Universal internationalization for JavaScript with translations stored in
 [Links Notation](https://github.com/linksplatform/Protocols.Lino) (`.lino`).
 
-Runs on Node.js (≥ 20), Bun, Deno, and bundlers like Vite/Webpack/esbuild.
+Runs on Node.js (≥ 22.11), Bun, Deno, and bundlers like Vite/Webpack/esbuild.
 
 ```bash
 npm install lino-i18n
 ```
 
+## Source messages and tooling
+
+```js
+import { createTranslator, msg } from 'lino-i18n/messages';
+const i18n = createTranslator({
+  locales: { fr: { greeting: 'Bonjour {name}' } },
+  defaultLocale: 'fr',
+});
+i18n.gt(msg('Hello {name}', { id: 'greeting' }), { name: 'Ada' });
+i18n.gt('{n, plural, one {# file} other {# files}}', { n: 2 });
+```
+
+`lino-i18n/react` provides source `T`, `Var`, `Derive`, `Branch`, `Plural` and
+formatting components alongside the existing keyed adapter. Optional exports
+include `messages`, `intl`, `server`, `react-server`, `tooling` and `compiler`.
+[Optional Vue components and SFC extraction](../docs/vue.md) provide reactive
+source messages, SSR/hydration and template-scope diagnostics.
+[TanStack Start integration](../docs/tanstack-start.md) adds request middleware,
+server functions, loader snapshots and localized Router navigation.
+The native browser entry retains its dependency-free keyed runtime; source ICU
+and React browser applications use a bundler.
+
+```bash
+lino-i18n extract --in src --out locales --locale en
+lino-i18n check --dir locales --manifest locales/messages.json
+```
+
+The complete [source-message guide](../docs/source-messages.md)
+covers dictionaries, static derivation, provider candidates, versioned loading,
+request isolation and snapshot hydration. The
+[GT capability study](../docs/case-studies/issue-25/README.md)
+records supported workflows and remaining ecosystem integrations.
+
 ## Usage
 
 ```js
@@ -258,3 +291,14 @@ npm run test:browser # real browser catalog loading and runtime language switchi
 
 Released into the public domain under the
 [Unlicense](https://unlicense.org/).
+
+See [Python extraction, Markdown helpers and GT locale data](../docs/ecosystem-tools.md) for optional source and content tools.
+
+See [React Native source messages](../docs/react-native.md) for native text,
+formatters, selectors and persisted locale choices.
+
+See [session recording and replay](../docs/rrweb.md) for the optional published GT recorder/player, `.lino` overlays and protected recorded variables.
+
+See [source-message lint rules](../docs/eslint.md) for optional ESLint diagnostics.
+The [Sanity investigation](../docs/sanity.md) records a deferred integration and
+the upstream dependency-review blocker.

package/bin/lino-i18n.js

@@ -2,9 +2,7 @@
 
 // `lino-i18n` command-line entry point.
 //
-// Built on top of `lino-arguments` so configuration follows the same
-// priority chain as the rest of the Link Foundation stack: CLI flags
-// > environment variables > config file > defaults.
+// Configuration priority: CLI flags > JSON `--config` file > defaults.
 
 import { promises as fs } from 'node:fs';
 import path from 'node:path';
@@ -32,12 +30,20 @@ function usage() {
     '  convert    Convert i18next / i18n-js / react-intl JSON files to .lino',
     '  check      Compare locales against a reference locale and report missing keys',
     '  t          Translate a key from the CLI for quick debugging',
+    '  extract    Extract source messages and JSX to .lino and a manifest',
+    '  translate-catalog  Generate validated candidates with a provider module',
     '',
     'Run `lino-i18n <command> --help` for command-specific options.',
   ].join('\n');
 }
 
 function commandHelp(command) {
+  if (command === 'extract') {
+    return 'Usage: lino-i18n extract --in <source file or directory> --out <directory> [--locale en] [--syntax js|vue|python] [--max-files 1000] [--max-bytes 10485760]';
+  }
+  if (command === 'translate-catalog') {
+    return 'Usage: lino-i18n translate-catalog --manifest <messages.json> --dir <catalogs> --locale <locale> --provider <module.mjs> --out <locale.lino>';
+  }
   if (command === 'convert') {
     return [
       'Usage: lino-i18n convert --in <path> --out <dir> [options]',
@@ -60,6 +66,8 @@ function commandHelp(command) {
       '  --dir <dir>            Directory containing .lino files',
       '  --reference <locale>   Reference locale to diff against (default: en)',
       '  --config <path>        Read command defaults from a JSON config file',
+      '  --manifest <path>      Validate ICU syntax and variables against extraction',
+      '  --previous-manifest <path> Flag stable ids whose source changed for review',
     ].join('\n');
   }
   if (command === 't') {
@@ -175,6 +183,27 @@ async function readJsonInput(inputPath) {
   return out;
 }
 
+function convertInputs(inputs, requestedFormat, flags, err) {
+  const aggregated = {};
+  for (const { data, baseName } of inputs) {
+    const format = requestedFormat || detectFormat(data);
+    const convert = pickConverter(format);
+    if (!convert) {
+      err(`lino-i18n convert: no converter for format '${format}'`);
+      return null;
+    }
+    const result = convert(data, {
+      locale: flags.locale || baseName,
+      defaultLocale: flags.default || 'en',
+    });
+    for (const [locale, table] of Object.entries(result)) {
+      aggregated[locale] = { ...(aggregated[locale] || {}), ...table };
+    }
+  }
+
+  return aggregated;
+}
+
 async function commandConvert(flags, log = console.log, err = console.error) {
   if (!flags.in || !flags.out) {
     err('lino-i18n convert: --in and --out are required');
@@ -196,21 +225,9 @@ async function commandConvert(flags, log = console.log, err = console.error) {
     return 1;
   }
 
-  const aggregated = {};
-  for (const { data, baseName } of inputs) {
-    const format = requestedFormat || detectFormat(data);
-    const convert = pickConverter(format);
-    if (!convert) {
-      err(`lino-i18n convert: no converter for format '${format}'`);
-      return 1;
-    }
-    const result = convert(data, {
-      locale: flags.locale || baseName,
-      defaultLocale: flags.default || 'en',
-    });
-    for (const [locale, table] of Object.entries(result)) {
-      aggregated[locale] = { ...(aggregated[locale] || {}), ...table };
-    }
+  const aggregated = convertInputs(inputs, requestedFormat, flags, err);
+  if (!aggregated) {
+    return 1;
   }
 
   const singleFile = flagValue(flags, 'single-file', 'singleFile');
@@ -241,6 +258,15 @@ async function commandCheck(flags, log = console.log, err = console.error) {
   }
   const reference = flags.reference || 'en';
   const catalogues = await loadLocalesFromDirectory(flags.dir);
+  if (flags.manifest) {
+    const { checkManifest } = await import('../src/tooling-files.js');
+    return checkManifest(
+      flags.manifest,
+      catalogues,
+      log,
+      flags['previous-manifest']
+    );
+  }
   if (!catalogues[reference]) {
     err(
       `lino-i18n check: reference locale '${reference}' not found in ${flags.dir}`
@@ -253,18 +279,10 @@ async function commandCheck(flags, log = console.log, err = console.error) {
     if (locale === reference) {
       continue;
     }
-    const missing = [];
-    const unknown = [];
-    for (const key of referenceKeys) {
-      if (!Object.prototype.hasOwnProperty.call(table, key)) {
-        missing.push(key);
-      }
-    }
-    for (const key of Object.keys(table)) {
-      if (!referenceKeys.has(key)) {
-        unknown.push(key);
-      }
-    }
+    const missing = [...referenceKeys].filter(
+      (key) => !Object.prototype.hasOwnProperty.call(table, key)
+    );
+    const unknown = Object.keys(table).filter((key) => !referenceKeys.has(key));
     if (missing.length === 0 && unknown.length === 0) {
       continue;
     }
@@ -339,18 +357,33 @@ export async function runCli(argv, io = {}) {
   }
   const configuredFlags = await withConfig(command, flags);
   switch (command) {
+    case 'extract': {
+      const { commandExtract } = await import('../src/tooling-files.js');
+      return commandExtract(configuredFlags, log, err);
+    }
+    case 'translate-catalog': {
+      const { commandTranslateCatalog } =
+        await import('../src/tooling-files.js');
+      return commandTranslateCatalog(configuredFlags, log, err);
+    }
     case 'convert':
       return commandConvert(configuredFlags, log, err);
     case 'check':
       return commandCheck(configuredFlags, log, err);
     case 't':
-    case 'translate':
       return commandTranslate(configuredFlags, positional, log, err);
     default:
-      err(`Unknown command: ${command}`);
-      err(usage());
-      return 1;
+      return unknownCommand(command, configuredFlags, positional, log, err);
+  }
+}
+
+function unknownCommand(command, flags, rest, log, err) {
+  if (command === 'translate') {
+    return commandTranslate(flags, rest, log, err);
   }
+  err(`Unknown command: ${command}`);
+  err(usage());
+  return 1;
 }
 
 function isCliEntryPoint() {

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "lino-i18n",
-  "version": "0.3.0",
+  "version": "0.4.0",
   "description": "Universal i18n library that stores translations in Links Notation (.lino) instead of JSON.",
   "type": "module",
   "sideEffects": false,
@@ -30,22 +30,123 @@
     "./react": {
       "types": "./src/react.d.ts",
       "import": "./src/react.js"
+    },
+    "./messages": {
+      "types": "./src/messages.d.ts",
+      "import": "./src/messages.js"
+    },
+    "./intl": {
+      "types": "./src/intl.d.ts",
+      "import": "./src/intl.js"
+    },
+    "./server": {
+      "types": "./src/server.d.ts",
+      "import": "./src/server.js"
+    },
+    "./react-server": {
+      "types": "./src/react-server.d.ts",
+      "import": "./src/react-server.js"
+    },
+    "./node": {
+      "types": "./src/node.d.ts",
+      "import": "./src/node.js"
+    },
+    "./tooling": {
+      "types": "./src/tooling.d.ts",
+      "import": "./src/tooling.js"
+    },
+    "./compiler": {
+      "types": "./src/compiler.d.ts",
+      "import": "./src/compiler.js"
+    },
+    "./providers/gt": {
+      "types": "./src/providers/gt.d.ts",
+      "import": "./src/providers/gt.js"
+    },
+    "./next/server": {
+      "types": "./src/next/server.d.ts",
+      "import": "./src/next/server.js"
+    },
+    "./next/client": {
+      "types": "./src/next/client.d.ts",
+      "import": "./src/next/client.js"
+    },
+    "./next/proxy": {
+      "types": "./src/next/proxy.d.ts",
+      "import": "./src/next/proxy.js"
+    },
+    "./vue": {
+      "types": "./src/vue.d.ts",
+      "import": "./src/vue.js"
+    },
+    "./vue/extract": {
+      "types": "./src/vue-extract.d.ts",
+      "import": "./src/vue-extract.js"
+    },
+    "./python/extract": {
+      "types": "./src/python-extract.d.ts",
+      "import": "./src/python-extract.js"
+    },
+    "./remark": {
+      "types": "./src/remark.d.ts",
+      "import": "./src/remark.js"
+    },
+    "./providers/gt-locales": {
+      "types": "./src/providers/gt-locales.d.ts",
+      "import": "./src/providers/gt-locales.js"
+    },
+    "./react-native": {
+      "types": "./src/react-native.d.ts",
+      "import": "./src/react-native.js"
+    },
+    "./tanstack-start/server": {
+      "types": "./src/tanstack-start/server.d.ts",
+      "import": "./src/tanstack-start/server.js"
+    },
+    "./tanstack-start/client": {
+      "types": "./src/tanstack-start/client.d.ts",
+      "import": "./src/tanstack-start/client.js"
+    },
+    "./rrweb": {
+      "types": "./src/rrweb/index.d.ts",
+      "import": "./src/rrweb/index.js"
+    },
+    "./rrweb/catalog": {
+      "types": "./src/rrweb/catalog.d.ts",
+      "import": "./src/rrweb/catalog.js"
+    },
+    "./rrweb/harvest": {
+      "types": "./src/rrweb/harvest.d.ts",
+      "import": "./src/rrweb/harvest.js"
+    },
+    "./rrweb/replay": {
+      "types": "./src/rrweb/replay.d.ts",
+      "import": "./src/rrweb/replay.js"
+    },
+    "./eslint": {
+      "types": "./src/eslint.d.ts",
+      "import": "./src/eslint.js"
     }
   },
   "scripts": {
-    "test": "node --test --test-timeout=30000 tests/*.test.js",
+    "test": "node --throw-deprecation --test --test-timeout=30000 tests/*.test.js",
     "test:browser": "playwright test",
-    "test:types": "tsc --project tests/types/tsconfig.json",
-    "lint": "eslint .",
+    "test:types": "tsc --project tests/types/tsconfig.json && tsc --project tests/types/tsconfig.next.json && tsc --project tests/types/tsconfig.native.json && tsc --project tests/types/tsconfig.tanstack.json && tsc --project tests/types/tsconfig.rrweb.json",
+    "lint": "eslint . --max-warnings 0",
     "lint:fix": "eslint . --fix",
     "format": "prettier --write .",
     "format:check": "prettier --check .",
-    "check:duplication": "jscpd .",
+    "check:duplication": "jscpd --fail-on-empty .",
     "check": "npm run lint && npm run format:check && npm run check:duplication",
     "changeset": "changeset",
-    "changeset:version": "changeset version",
+    "changeset:version": "node scripts/changeset-version.mjs",
     "changeset:publish": "changeset publish",
-    "pack:dry-run": "npm pack --dry-run"
+    "pack:dry-run": "npm pack --dry-run",
+    "lint:secrets": "secretlint \"bin/**\" \"src/**\" \"scripts/**\" \"tests/**\" \"../scripts/**\" \"../rust/scripts/**\" \"../rust/lino-i18n/src/**\" \"../rust/lino-i18n/tests/**\" \"../rust/lino-i18n-macros/src/**\" \"../.github/**\" \"../.githooks/**\"",
+    "test:next": "playwright test --config playwright-next.config.js",
+    "build:next": "next build examples/next-usage --webpack",
+    "build:tanstack": "vite build --config examples/tanstack-usage/vite.config.js",
+    "test:tanstack": "playwright test --config playwright-tanstack.config.js"
   },
   "keywords": [
     "i18n",
@@ -70,36 +171,131 @@
     "provenance": true
   },
   "engines": {
-    "node": ">=20.0.0"
+    "node": ">=22.11.0"
   },
   "dependencies": {
-    "links-notation": "^0.13.0",
+    "@babel/generator": "^7.29.8",
+    "@babel/parser": "^7.29.9",
+    "@babel/traverse": "^7.29.10",
+    "@babel/types": "^7.29.8",
+    "@formatjs/icu-messageformat-parser": "^3.5.21",
+    "intl-messageformat": "^12.1.3",
+    "links-notation": "^0.23.0",
     "lino-arguments": "^0.3.0",
-    "lino-objects-codec": "^0.4.0"
+    "lino-objects-codec": "^0.9.0"
   },
   "devDependencies": {
-    "@changesets/cli": "^2.31.0",
+    "@babel/core": "^8.0.7",
+    "@babel/eslint-parser": "^8.0.7",
+    "@changesets/cli": "^3.0.3",
     "@eslint/js": "^10.0.1",
-    "@playwright/test": "^1.63.0",
-    "@types/node": "^26.1.1",
-    "@types/react": "^19.2.17",
+    "@generaltranslation/supported-locales": "2.1.41",
+    "@playwright/test": "^1.64.0",
+    "@rrweb/record": "2.1.7",
+    "@rrweb/replay": "2.1.7",
+    "@rrweb/types": "2.1.7",
+    "@secretlint/secretlint-rule-preset-recommend": "^13.0.7",
+    "@tanstack/react-router": "1.170.41",
+    "@tanstack/react-start": "1.168.60",
+    "@testing-library/react": "^16.3.3",
+    "@types/eslint": "^9.6.1",
+    "@types/node": "^26.6.4",
+    "@types/react": "^19.3.0",
+    "@vitejs/plugin-react": "6.1.2",
+    "@vue/compiler-sfc": "3.5.43",
+    "@vue/server-renderer": "3.5.43",
     "esbuild": "^0.28.2",
-    "eslint": "^10.4.0",
+    "eslint": "^10.12.0",
     "eslint-config-prettier": "^10.1.8",
-    "eslint-plugin-prettier": "^5.5.5",
-    "jscpd": "^4.2.2",
-    "prettier": "^3.8.3",
-    "react": "^19.1.1",
-    "react-test-renderer": "^19.1.1",
+    "eslint-plugin-prettier": "^5.5.6",
+    "eslint9": "npm:eslint@^9.39.5",
+    "generaltranslation": "9.5.5",
+    "gt-remark": "1.0.12",
+    "gt-rrweb": "0.2.0",
+    "jscpd": "^5.4.0",
+    "jsdom": "^30.1.2",
+    "next": "16.4.0",
+    "prettier": "^3.9.9",
+    "react": "^19.3.0",
+    "react-dom": "^19.3.0",
+    "react-native-web": "0.21.4",
+    "remark-mdx": "3.1.1",
+    "remark-parse": "11.0.0",
+    "remark-stringify": "11.0.0",
+    "rollup": "^4.64.2",
+    "secretlint": "^13.0.7",
+    "srvx": "0.11.22",
     "test-anywhere": "^0.9.1",
-    "typescript": "^7.0.2"
+    "typescript": "^7.0.2",
+    "unified": "11.0.5",
+    "vite": "8.3.4",
+    "vue": "3.5.43"
   },
   "peerDependencies": {
-    "react": ">=18.0.0"
+    "@generaltranslation/supported-locales": ">=2.1.41 <3",
+    "@rrweb/record": ">=2.1 <3",
+    "@rrweb/replay": ">=2.1 <3",
+    "@rrweb/types": ">=2.1 <3",
+    "@tanstack/react-router": ">=1.170 <2",
+    "@tanstack/react-start": ">=1.168 <2",
+    "@vue/compiler-sfc": ">=3.5 <4",
+    "eslint": ">=9 <11",
+    "generaltranslation": ">=9.5.5 <10",
+    "gt-remark": ">=1.0.12 <2",
+    "gt-rrweb": ">=0.2 <0.3",
+    "next": ">=16 <17",
+    "react": ">=18.0.0",
+    "react-dom": ">=18",
+    "vue": ">=3.5 <4"
   },
   "peerDependenciesMeta": {
+    "next": {
+      "optional": true
+    },
+    "generaltranslation": {
+      "optional": true
+    },
     "react": {
       "optional": true
+    },
+    "vue": {
+      "optional": true
+    },
+    "@vue/compiler-sfc": {
+      "optional": true
+    },
+    "gt-remark": {
+      "optional": true
+    },
+    "@generaltranslation/supported-locales": {
+      "optional": true
+    },
+    "@tanstack/react-start": {
+      "optional": true
+    },
+    "@tanstack/react-router": {
+      "optional": true
+    },
+    "gt-rrweb": {
+      "optional": true
+    },
+    "@rrweb/record": {
+      "optional": true
+    },
+    "@rrweb/replay": {
+      "optional": true
+    },
+    "@rrweb/types": {
+      "optional": true
+    },
+    "react-dom": {
+      "optional": true
+    },
+    "eslint": {
+      "optional": true
     }
+  },
+  "allowScripts": {
+    "esbuild@0.28.2": true
   }
 }

package/src/browser.d.ts

@@ -55,3 +55,4 @@ export declare function detectLanguage(
   preference?: string | null,
   options?: LanguageOptions
 ): string;
+export * from './intl.js';

package/src/browser.js

@@ -12,6 +12,7 @@ export {
 } from './catalogs.js';
 export { expandCompatibilityAliases } from './compatibility.js';
 export { detectLanguage, resolveLanguage } from './language.js';
+export * from './intl.js';
 
 // Fetch concurrently, then merge in input order. Generate aliases only after
 // merging so a later explicit key always wins over an earlier generated alias.