@colixsystems/widget-sdk 0.90.0 → 0.91.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +13 -0
- package/dist/contract.cjs +38 -5
- package/dist/contract.js +38 -5
- package/dist/hooks.js +228 -0
- package/dist/index.d.ts +77 -1
- package/dist/index.js +2 -0
- package/dist/index.native.js +2 -0
- package/package.json +2 -2
package/README.md
CHANGED
|
@@ -35,6 +35,7 @@ The data layer lives in **four separate domain-client packages**, each instantia
|
|
|
35
35
|
| **CORE** | `useClipboard()` | `{ copy, paste, hasContent }` | platform clipboard (web `navigator.clipboard` / native `expo-clipboard`); rejects with `ClipboardError` — no scope |
|
|
36
36
|
| **CORE** | `useToast()` | `{ showToast }` | `ctx.toast.showToast` — wired by the Player and the Expo export; an authoring preview omits it and the call is a no-op — no scope |
|
|
37
37
|
| **CORE** | `useGeolocation(options?)` | `{ latitude, longitude, accuracy, loading, error, getCurrentPosition }` | `ctx.device.geolocation` — no scope. Capture is IMPERATIVE: call `getCurrentPosition()` from a user gesture (a tap), never on mount. Resolves to `{ latitude, longitude, accuracy }`; rejects with `GeolocationError` (`.code` in `PERMISSION_DENIED \| UNAVAILABLE \| TIMEOUT \| UNSUPPORTED \| INTERNAL`). Identical on web (`navigator.geolocation`) and the Expo export (`expo-location`). |
|
|
38
|
+
| **CORE** | `useSpeechToText(options?)` | `{ transcript, partial, listening, supported, error, start, stop, abort, reset }` | `ctx.device.speech` — no scope. Dictation with the device's **on-device** recogniser: no audio is uploaded and no AI credit is spent. Capture is IMPERATIVE: call `start()` from a user gesture (a tap), never on mount. `transcript` accumulates finalised speech, `partial` holds the uncommitted guess (needs `options.interimResults`); `stop()` keeps it, `abort()` discards it. Rejects with `SpeechToTextError` (`.code` in `PERMISSION_DENIED \| NO_SPEECH \| LANGUAGE_UNSUPPORTED \| NETWORK \| ABORTED \| UNSUPPORTED \| INTERNAL`). **Gate your mic button on `supported`** — Firefox ships no `SpeechRecognition`. Identical on web (`SpeechRecognition`) and the Expo export (`expo-speech-recognition`). |
|
|
38
39
|
| **CORE** | `useI18n()` | `{ t, locale }` | `ctx.i18n` — no scope. `t(key)` resolves the widget-namespaced key (`widget.<id>.<key>`, declared in `manifest.translations`) first, then a **predefined shared key** (`shared.<key>`) when `key` is one of the standard strings (`submit`, `cancel`, `save`, `loading`, …), then the raw key. Use a shared key for an identical default string so it translates once and any per-instance `widget.<id>.<key>` override still wins. |
|
|
39
40
|
| **CORE** | `useTranslate()` | `{ translate, translating, error, language, available }` | `ctx.i18n.translate` — no scope. Machine-translates **user-generated content** (record text, file names, API payloads) into the app user's language; `useI18n().t()` is still the answer for your own copy. `translate(str)` → `Promise<string>`, `translate(str[])` → `Promise<string[]>` in ONE request. Target defaults to the app user's language. Cached per session, per pod, and durably per workspace, so repeat text is free. Limits: 50 segments / 5 000 chars each / 20 000 total. Rejects with `TranslateError`; `available` is false where the host cannot translate. |
|
|
40
41
|
| **DATASTORE** (`ctx.datastore`) | `useDatastoreQuery(table, options?)` | `{ data, loading, error, refetch }` | `records(table).list` (unwraps `{ data, meta }` to `data: []`) — `datastore.read:*` |
|
|
@@ -61,6 +62,18 @@ See the design reference for the full architecture: [`docs/architecture/widget-m
|
|
|
61
62
|
|
|
62
63
|
## Status
|
|
63
64
|
|
|
65
|
+
`v0.91.0` — pre-publish. The package surface (types, function names, export paths) is the v1 contract; runtime behaviour for some hooks is stubbed (each hook documents what's wired and what isn't). It is **not yet published to npm**.
|
|
66
|
+
|
|
67
|
+
### What's new in 0.91.0 (contract 1.64.0)
|
|
68
|
+
|
|
69
|
+
**New `useSpeechToText()` hook — dictate into text with the device's on-device recogniser.** A new CORE hook reading a new `speech` capability on the existing `ctx.device` slice. Returns `{ transcript, partial, listening, supported, error, start, stop, abort, reset }`. Capture is **imperative** — call `start()` from a user gesture (a `Pressable.onPress`); the browser and the mobile OS gate the microphone prompt on a gesture, so it NEVER listens on mount. `transcript` accumulates finalised speech across utterances; `partial` holds the guess the recogniser has not committed yet (empty unless `options.interimResults`). `stop()` finalises and keeps what was heard, `abort()` discards the current utterance, `reset()` clears both. `options` (`{ lang, continuous, interimResults }`) pass through to the host. Rejections surface as a structured `SpeechToTextError` (new named export) with a stable `.code` (`PERMISSION_DENIED` / `NO_SPEECH` / `LANGUAGE_UNSUPPORTED` / `NETWORK` / `ABORTED` / `UNSUPPORTED` / `INTERNAL`). It needs **no manifest scope** and **no `requestedScopes` entry**.
|
|
70
|
+
|
|
71
|
+
Recognition runs **on device**: no audio is uploaded, nothing reaches our servers, and no AI credit is spent — so the hook is available to every workspace regardless of its AI data-residency policy. The web Player brokers it via the browser's `SpeechRecognition`; the Expo export via `expo-speech-recognition`, whose config plugin declares the microphone and speech permissions the runtime needs. Both hosts emit the same Web Speech error vocabulary, so one mapping serves both.
|
|
72
|
+
|
|
73
|
+
**Always gate your mic affordance on `supported`.** Firefox ships no `SpeechRecognition` at all, so `supported` is `false` there and `start()` rejects with `UNSUPPORTED` — render the plain text field instead of a dead button. The `speech` capability is optional and forwarded independently of `geolocation`, so a host that brokers one still brokers the other.
|
|
74
|
+
|
|
75
|
+
Additive — one new hook, one new optional device capability, one new error class; no existing export changed signature.
|
|
76
|
+
|
|
64
77
|
`v0.90.0` — pre-publish. The package surface (types, function names, export paths) is the v1 contract; runtime behaviour for some hooks is stubbed (each hook documents what's wired and what isn't). It is **not yet published to npm**.
|
|
65
78
|
|
|
66
79
|
### What's new in 0.89.0 (contract unchanged)
|
package/dist/contract.cjs
CHANGED
|
@@ -1194,6 +1194,35 @@ const HOOKS = [
|
|
|
1194
1194
|
requiredContextSlice: [],
|
|
1195
1195
|
scopes: null,
|
|
1196
1196
|
},
|
|
1197
|
+
// Host-brokered on-device speech recognition. Optional slice; the hook
|
|
1198
|
+
// reports supported:false rather than throwing at render.
|
|
1199
|
+
{
|
|
1200
|
+
name: "useSpeechToText",
|
|
1201
|
+
signature: "useSpeechToText(options?)",
|
|
1202
|
+
description:
|
|
1203
|
+
"Dictate into text with the device's ON-DEVICE speech recogniser. Returns { transcript, partial, listening, supported, " +
|
|
1204
|
+
"error, start, stop, abort, reset }. Capture is IMPERATIVE — call start() from a user gesture (a tap on a mic button); " +
|
|
1205
|
+
"the browser and the mobile OS gate the microphone prompt on a gesture, so it NEVER listens on mount. `transcript` " +
|
|
1206
|
+
"accumulates finalised speech; `partial` holds the uncommitted guess (empty unless options.interimResults). stop() " +
|
|
1207
|
+
"finalises and keeps what was heard, abort() discards it, reset() clears both. Recognition runs ON DEVICE — no audio is " +
|
|
1208
|
+
"uploaded and no AI credit is spent. start() rejects with a SpeechToTextError whose .code is one of PERMISSION_DENIED | " +
|
|
1209
|
+
"NO_SPEECH | LANGUAGE_UNSUPPORTED | NETWORK | ABORTED | UNSUPPORTED | INTERNAL. options: { lang, continuous, " +
|
|
1210
|
+
"interimResults }. Check `supported` before rendering a mic button — a browser without SpeechRecognition (Firefox) " +
|
|
1211
|
+
"reports false. Identical on web (SpeechRecognition) and the Expo export (expo-speech-recognition).",
|
|
1212
|
+
returnShape: {
|
|
1213
|
+
transcript: "string // finalised speech, accumulated",
|
|
1214
|
+
partial: "string // uncommitted guess; '' unless interimResults",
|
|
1215
|
+
listening: "boolean",
|
|
1216
|
+
supported: "boolean // false when the host brokers no recogniser",
|
|
1217
|
+
error: "SpeechToTextError | null",
|
|
1218
|
+
start: "() => Promise<void> // rejects with SpeechToTextError",
|
|
1219
|
+
stop: "() => Promise<void> // finalise, keep the transcript",
|
|
1220
|
+
abort: "() => void // cancel, discard the utterance",
|
|
1221
|
+
reset: "() => void // clear transcript + partial + error",
|
|
1222
|
+
},
|
|
1223
|
+
requiredContextSlice: [],
|
|
1224
|
+
scopes: null,
|
|
1225
|
+
},
|
|
1197
1226
|
];
|
|
1198
1227
|
|
|
1199
1228
|
// REQ-WSDK-RN-WEB: the SDK exposes the React Native primitive API
|
|
@@ -1769,11 +1798,15 @@ const WIDGET_CONTEXT_SHAPE = {
|
|
|
1769
1798
|
device: {
|
|
1770
1799
|
description:
|
|
1771
1800
|
"Optional host-brokered device capabilities. " +
|
|
1772
|
-
"{ geolocation: { getCurrentPosition(options?) -> Promise<{ latitude, longitude, accuracy }> }
|
|
1773
|
-
"
|
|
1774
|
-
"
|
|
1801
|
+
"{ geolocation: { getCurrentPosition(options?) -> Promise<{ latitude, longitude, accuracy }> }, " +
|
|
1802
|
+
"speech: { isSupported() -> boolean, start(options, { onResult, onError, onEnd }) -> Promise<{ stop(), abort() }> } }. " +
|
|
1803
|
+
"Backs useGeolocation() and useSpeechToText(). The web Player brokers them via navigator.geolocation and " +
|
|
1804
|
+
"window.SpeechRecognition; the Expo export via expo-location and expo-speech-recognition. " +
|
|
1805
|
+
"getCurrentPosition rejects with a GeolocationError (.code PERMISSION_DENIED | UNAVAILABLE | TIMEOUT | UNSUPPORTED | INTERNAL). " +
|
|
1806
|
+
"speech.start streams { transcript, isFinal } to onResult and runs ON DEVICE — it uploads no audio and spends no AI credit; " +
|
|
1807
|
+
"its onError carries the Web Speech error vocabulary (not-allowed | no-speech | language-not-supported | network | aborted).",
|
|
1775
1808
|
required: false,
|
|
1776
|
-
fields: { geolocation: "object" },
|
|
1809
|
+
fields: { geolocation: "object", speech: "object" },
|
|
1777
1810
|
},
|
|
1778
1811
|
};
|
|
1779
1812
|
|
|
@@ -2822,7 +2855,7 @@ const CONTRACT = deepFreeze({
|
|
|
2822
2855
|
// published widget keeps validating. The script's `triggerType` global
|
|
2823
2856
|
// now names the trigger that actually FIRED the run ('manual' and 'app'
|
|
2824
2857
|
// included), which is what makes a multi-trigger script able to branch.
|
|
2825
|
-
version: "1.
|
|
2858
|
+
version: "1.64.0",
|
|
2826
2859
|
sharedTranslationKeys: SHARED_TRANSLATION_KEYS,
|
|
2827
2860
|
hooks: HOOKS,
|
|
2828
2861
|
primitives: PRIMITIVES,
|
package/dist/contract.js
CHANGED
|
@@ -1194,6 +1194,35 @@ const HOOKS = [
|
|
|
1194
1194
|
requiredContextSlice: [],
|
|
1195
1195
|
scopes: null,
|
|
1196
1196
|
},
|
|
1197
|
+
// Host-brokered on-device speech recognition. Optional slice; the hook
|
|
1198
|
+
// reports supported:false rather than throwing at render.
|
|
1199
|
+
{
|
|
1200
|
+
name: "useSpeechToText",
|
|
1201
|
+
signature: "useSpeechToText(options?)",
|
|
1202
|
+
description:
|
|
1203
|
+
"Dictate into text with the device's ON-DEVICE speech recogniser. Returns { transcript, partial, listening, supported, " +
|
|
1204
|
+
"error, start, stop, abort, reset }. Capture is IMPERATIVE — call start() from a user gesture (a tap on a mic button); " +
|
|
1205
|
+
"the browser and the mobile OS gate the microphone prompt on a gesture, so it NEVER listens on mount. `transcript` " +
|
|
1206
|
+
"accumulates finalised speech; `partial` holds the uncommitted guess (empty unless options.interimResults). stop() " +
|
|
1207
|
+
"finalises and keeps what was heard, abort() discards it, reset() clears both. Recognition runs ON DEVICE — no audio is " +
|
|
1208
|
+
"uploaded and no AI credit is spent. start() rejects with a SpeechToTextError whose .code is one of PERMISSION_DENIED | " +
|
|
1209
|
+
"NO_SPEECH | LANGUAGE_UNSUPPORTED | NETWORK | ABORTED | UNSUPPORTED | INTERNAL. options: { lang, continuous, " +
|
|
1210
|
+
"interimResults }. Check `supported` before rendering a mic button — a browser without SpeechRecognition (Firefox) " +
|
|
1211
|
+
"reports false. Identical on web (SpeechRecognition) and the Expo export (expo-speech-recognition).",
|
|
1212
|
+
returnShape: {
|
|
1213
|
+
transcript: "string // finalised speech, accumulated",
|
|
1214
|
+
partial: "string // uncommitted guess; '' unless interimResults",
|
|
1215
|
+
listening: "boolean",
|
|
1216
|
+
supported: "boolean // false when the host brokers no recogniser",
|
|
1217
|
+
error: "SpeechToTextError | null",
|
|
1218
|
+
start: "() => Promise<void> // rejects with SpeechToTextError",
|
|
1219
|
+
stop: "() => Promise<void> // finalise, keep the transcript",
|
|
1220
|
+
abort: "() => void // cancel, discard the utterance",
|
|
1221
|
+
reset: "() => void // clear transcript + partial + error",
|
|
1222
|
+
},
|
|
1223
|
+
requiredContextSlice: [],
|
|
1224
|
+
scopes: null,
|
|
1225
|
+
},
|
|
1197
1226
|
];
|
|
1198
1227
|
|
|
1199
1228
|
// REQ-WSDK-RN-WEB: the SDK exposes the React Native primitive API
|
|
@@ -1769,11 +1798,15 @@ const WIDGET_CONTEXT_SHAPE = {
|
|
|
1769
1798
|
device: {
|
|
1770
1799
|
description:
|
|
1771
1800
|
"Optional host-brokered device capabilities. " +
|
|
1772
|
-
"{ geolocation: { getCurrentPosition(options?) -> Promise<{ latitude, longitude, accuracy }> }
|
|
1773
|
-
"
|
|
1774
|
-
"
|
|
1801
|
+
"{ geolocation: { getCurrentPosition(options?) -> Promise<{ latitude, longitude, accuracy }> }, " +
|
|
1802
|
+
"speech: { isSupported() -> boolean, start(options, { onResult, onError, onEnd }) -> Promise<{ stop(), abort() }> } }. " +
|
|
1803
|
+
"Backs useGeolocation() and useSpeechToText(). The web Player brokers them via navigator.geolocation and " +
|
|
1804
|
+
"window.SpeechRecognition; the Expo export via expo-location and expo-speech-recognition. " +
|
|
1805
|
+
"getCurrentPosition rejects with a GeolocationError (.code PERMISSION_DENIED | UNAVAILABLE | TIMEOUT | UNSUPPORTED | INTERNAL). " +
|
|
1806
|
+
"speech.start streams { transcript, isFinal } to onResult and runs ON DEVICE — it uploads no audio and spends no AI credit; " +
|
|
1807
|
+
"its onError carries the Web Speech error vocabulary (not-allowed | no-speech | language-not-supported | network | aborted).",
|
|
1775
1808
|
required: false,
|
|
1776
|
-
fields: { geolocation: "object" },
|
|
1809
|
+
fields: { geolocation: "object", speech: "object" },
|
|
1777
1810
|
},
|
|
1778
1811
|
};
|
|
1779
1812
|
|
|
@@ -2822,7 +2855,7 @@ const CONTRACT = deepFreeze({
|
|
|
2822
2855
|
// published widget keeps validating. The script's `triggerType` global
|
|
2823
2856
|
// now names the trigger that actually FIRED the run ('manual' and 'app'
|
|
2824
2857
|
// included), which is what makes a multi-trigger script able to branch.
|
|
2825
|
-
version: "1.
|
|
2858
|
+
version: "1.64.0",
|
|
2826
2859
|
sharedTranslationKeys: SHARED_TRANSLATION_KEYS,
|
|
2827
2860
|
hooks: HOOKS,
|
|
2828
2861
|
primitives: PRIMITIVES,
|
package/dist/hooks.js
CHANGED
|
@@ -916,6 +916,234 @@ export function useGeolocation(options) {
|
|
|
916
916
|
};
|
|
917
917
|
}
|
|
918
918
|
|
|
919
|
+
/**
|
|
920
|
+
* Error surfaced by `useSpeechToText()` (thrown by `start()` and stored in the
|
|
921
|
+
* hook's `error` slot). Carries a stable `code` so widgets branch on the error
|
|
922
|
+
* class without parsing message strings.
|
|
923
|
+
*
|
|
924
|
+
* `code` is one of:
|
|
925
|
+
* - "PERMISSION_DENIED" — the user or OS refused microphone access.
|
|
926
|
+
* - "NO_SPEECH" — capture ended without any speech detected.
|
|
927
|
+
* - "LANGUAGE_UNSUPPORTED" — no recogniser exists for the requested language.
|
|
928
|
+
* - "NETWORK" — the recogniser needed the network and failed.
|
|
929
|
+
* - "ABORTED" — capture was cancelled (abort(), or a new start()).
|
|
930
|
+
* - "UNSUPPORTED" — this host does not broker speech recognition.
|
|
931
|
+
* - "INTERNAL" — anything else.
|
|
932
|
+
*/
|
|
933
|
+
export class SpeechToTextError extends Error {
|
|
934
|
+
constructor(code, message, opts) {
|
|
935
|
+
super(message);
|
|
936
|
+
this.name = "SpeechToTextError";
|
|
937
|
+
this.code = code;
|
|
938
|
+
if (opts && opts.cause) this.cause = opts.cause;
|
|
939
|
+
}
|
|
940
|
+
}
|
|
941
|
+
|
|
942
|
+
// Both hosts emit the Web Speech API's error vocabulary (the Expo export's
|
|
943
|
+
// recogniser mirrors it deliberately), so one map serves web and native.
|
|
944
|
+
const SPEECH_ERROR_CODES = {
|
|
945
|
+
"not-allowed": "PERMISSION_DENIED",
|
|
946
|
+
"service-not-allowed": "PERMISSION_DENIED",
|
|
947
|
+
PERMISSION_DENIED: "PERMISSION_DENIED",
|
|
948
|
+
"no-speech": "NO_SPEECH",
|
|
949
|
+
NO_SPEECH: "NO_SPEECH",
|
|
950
|
+
// Android's recogniser reports a silence timeout instead of "no-speech".
|
|
951
|
+
"speech-timeout": "NO_SPEECH",
|
|
952
|
+
"language-not-supported": "LANGUAGE_UNSUPPORTED",
|
|
953
|
+
LANGUAGE_UNSUPPORTED: "LANGUAGE_UNSUPPORTED",
|
|
954
|
+
network: "NETWORK",
|
|
955
|
+
NETWORK: "NETWORK",
|
|
956
|
+
aborted: "ABORTED",
|
|
957
|
+
ABORTED: "ABORTED",
|
|
958
|
+
UNSUPPORTED: "UNSUPPORTED",
|
|
959
|
+
};
|
|
960
|
+
|
|
961
|
+
/** Coerce a thrown/emitted value into a SpeechToTextError with a stable code. */
|
|
962
|
+
function toSpeechToTextError(err) {
|
|
963
|
+
if (err instanceof SpeechToTextError) return err;
|
|
964
|
+
const raw =
|
|
965
|
+
err && err.code !== undefined && err.code !== null ? err.code : null;
|
|
966
|
+
const code = (raw !== null && SPEECH_ERROR_CODES[raw]) || "INTERNAL";
|
|
967
|
+
const message =
|
|
968
|
+
(err && typeof err.message === "string" && err.message) ||
|
|
969
|
+
"Speech recognition failed";
|
|
970
|
+
return new SpeechToTextError(code, message, { cause: err });
|
|
971
|
+
}
|
|
972
|
+
|
|
973
|
+
/**
|
|
974
|
+
* Dictate into text with the device's on-device speech recogniser. Returns
|
|
975
|
+
* `{ transcript, partial, listening, supported, error, start, stop, abort,
|
|
976
|
+
* reset }`.
|
|
977
|
+
*
|
|
978
|
+
* Capture is IMPERATIVE — call `start()` from a user gesture (a tap on a mic
|
|
979
|
+
* button). Both the browser and the mobile OS gate the microphone prompt on a
|
|
980
|
+
* user gesture, so the hook never listens on mount.
|
|
981
|
+
*
|
|
982
|
+
* `transcript` accumulates finalised speech; `partial` holds the in-flight
|
|
983
|
+
* guess the recogniser has not committed yet (empty unless
|
|
984
|
+
* `options.interimResults`). `stop()` finalises and keeps what was heard;
|
|
985
|
+
* `abort()` discards it. `reset()` clears both back to empty.
|
|
986
|
+
*
|
|
987
|
+
* Recognition runs ON DEVICE — no audio is uploaded and no AI credit is spent.
|
|
988
|
+
* The SAME hook drives both platforms: the web Player brokers it through the
|
|
989
|
+
* browser's SpeechRecognition, the Expo export through
|
|
990
|
+
* expo-speech-recognition.
|
|
991
|
+
*
|
|
992
|
+
* Safe-by-default: on a host that does not inject `ctx.device.speech` (or a
|
|
993
|
+
* browser without SpeechRecognition), `supported` is false and `start()`
|
|
994
|
+
* rejects with `code: "UNSUPPORTED"` rather than throwing at render, so a
|
|
995
|
+
* widget can call the hook unconditionally and hide its mic button.
|
|
996
|
+
*/
|
|
997
|
+
export function useSpeechToText(options) {
|
|
998
|
+
const ctx = useWidgetContextOrThrow("useSpeechToText");
|
|
999
|
+
const [transcript, setTranscript] = useState("");
|
|
1000
|
+
const [partial, setPartial] = useState("");
|
|
1001
|
+
const [listening, setListening] = useState(false);
|
|
1002
|
+
const [error, setError] = useState(null);
|
|
1003
|
+
|
|
1004
|
+
// `ctx` is a fresh identity every host render — hold the live client and
|
|
1005
|
+
// options in refs so the returned callbacks stay stable.
|
|
1006
|
+
const clientRef = useRef(ctx.device && ctx.device.speech);
|
|
1007
|
+
clientRef.current = ctx.device && ctx.device.speech;
|
|
1008
|
+
const optionsRef = useRef(options);
|
|
1009
|
+
optionsRef.current = options;
|
|
1010
|
+
// The live capture session, so stop/abort/unmount can reach it.
|
|
1011
|
+
const sessionRef = useRef(null);
|
|
1012
|
+
const runRef = useRef(0);
|
|
1013
|
+
|
|
1014
|
+
const supported = Boolean(
|
|
1015
|
+
clientRef.current &&
|
|
1016
|
+
typeof clientRef.current.start === "function" &&
|
|
1017
|
+
(typeof clientRef.current.isSupported !== "function" ||
|
|
1018
|
+
clientRef.current.isSupported()),
|
|
1019
|
+
);
|
|
1020
|
+
|
|
1021
|
+
// Abandoning a mounted recogniser leaves the mic hot on both hosts, so
|
|
1022
|
+
// release it when the widget unmounts.
|
|
1023
|
+
useEffect(
|
|
1024
|
+
() => () => {
|
|
1025
|
+
runRef.current += 1;
|
|
1026
|
+
const session = sessionRef.current;
|
|
1027
|
+
sessionRef.current = null;
|
|
1028
|
+
if (session && typeof session.abort === "function") {
|
|
1029
|
+
try {
|
|
1030
|
+
session.abort();
|
|
1031
|
+
} catch {
|
|
1032
|
+
/* the host is already tearing the session down */
|
|
1033
|
+
}
|
|
1034
|
+
}
|
|
1035
|
+
},
|
|
1036
|
+
[],
|
|
1037
|
+
);
|
|
1038
|
+
|
|
1039
|
+
const reset = useCallback(() => {
|
|
1040
|
+
setTranscript("");
|
|
1041
|
+
setPartial("");
|
|
1042
|
+
setError(null);
|
|
1043
|
+
}, []);
|
|
1044
|
+
|
|
1045
|
+
const stop = useCallback(async () => {
|
|
1046
|
+
const session = sessionRef.current;
|
|
1047
|
+
sessionRef.current = null;
|
|
1048
|
+
setListening(false);
|
|
1049
|
+
setPartial("");
|
|
1050
|
+
if (session && typeof session.stop === "function") await session.stop();
|
|
1051
|
+
}, []);
|
|
1052
|
+
|
|
1053
|
+
const abort = useCallback(() => {
|
|
1054
|
+
runRef.current += 1;
|
|
1055
|
+
const session = sessionRef.current;
|
|
1056
|
+
sessionRef.current = null;
|
|
1057
|
+
setListening(false);
|
|
1058
|
+
setPartial("");
|
|
1059
|
+
if (session && typeof session.abort === "function") session.abort();
|
|
1060
|
+
}, []);
|
|
1061
|
+
|
|
1062
|
+
const start = useCallback(async () => {
|
|
1063
|
+
const client = clientRef.current;
|
|
1064
|
+
if (
|
|
1065
|
+
!client ||
|
|
1066
|
+
typeof client.start !== "function" ||
|
|
1067
|
+
(typeof client.isSupported === "function" && !client.isSupported())
|
|
1068
|
+
) {
|
|
1069
|
+
const e = new SpeechToTextError(
|
|
1070
|
+
"UNSUPPORTED",
|
|
1071
|
+
"This host does not provide speech recognition.",
|
|
1072
|
+
);
|
|
1073
|
+
setError(e);
|
|
1074
|
+
setListening(false);
|
|
1075
|
+
throw e;
|
|
1076
|
+
}
|
|
1077
|
+
// A second start() supersedes the first: drop the old session's events.
|
|
1078
|
+
const myRun = ++runRef.current;
|
|
1079
|
+
const previous = sessionRef.current;
|
|
1080
|
+
sessionRef.current = null;
|
|
1081
|
+
if (previous && typeof previous.abort === "function") previous.abort();
|
|
1082
|
+
|
|
1083
|
+
setError(null);
|
|
1084
|
+
setPartial("");
|
|
1085
|
+
setListening(true);
|
|
1086
|
+
try {
|
|
1087
|
+
const session = await client.start(optionsRef.current || {}, {
|
|
1088
|
+
onResult: (result) => {
|
|
1089
|
+
if (runRef.current !== myRun) return;
|
|
1090
|
+
const text =
|
|
1091
|
+
result && typeof result.transcript === "string"
|
|
1092
|
+
? result.transcript
|
|
1093
|
+
: "";
|
|
1094
|
+
if (result && result.isFinal) {
|
|
1095
|
+
setPartial("");
|
|
1096
|
+
// Append rather than replace: a continuous session emits one final
|
|
1097
|
+
// result per utterance, not a growing whole.
|
|
1098
|
+
setTranscript((prev) => (prev ? `${prev} ${text}`.trim() : text));
|
|
1099
|
+
} else {
|
|
1100
|
+
setPartial(text);
|
|
1101
|
+
}
|
|
1102
|
+
},
|
|
1103
|
+
onError: (err) => {
|
|
1104
|
+
if (runRef.current !== myRun) return;
|
|
1105
|
+
sessionRef.current = null;
|
|
1106
|
+
setError(toSpeechToTextError(err));
|
|
1107
|
+
setPartial("");
|
|
1108
|
+
setListening(false);
|
|
1109
|
+
},
|
|
1110
|
+
onEnd: () => {
|
|
1111
|
+
if (runRef.current !== myRun) return;
|
|
1112
|
+
sessionRef.current = null;
|
|
1113
|
+
setPartial("");
|
|
1114
|
+
setListening(false);
|
|
1115
|
+
},
|
|
1116
|
+
});
|
|
1117
|
+
if (runRef.current !== myRun) {
|
|
1118
|
+
// Superseded while the host was still opening the mic.
|
|
1119
|
+
if (session && typeof session.abort === "function") session.abort();
|
|
1120
|
+
return;
|
|
1121
|
+
}
|
|
1122
|
+
sessionRef.current = session || null;
|
|
1123
|
+
} catch (err) {
|
|
1124
|
+
const se = toSpeechToTextError(err);
|
|
1125
|
+
if (runRef.current === myRun) {
|
|
1126
|
+
sessionRef.current = null;
|
|
1127
|
+
setError(se);
|
|
1128
|
+
setListening(false);
|
|
1129
|
+
}
|
|
1130
|
+
throw se;
|
|
1131
|
+
}
|
|
1132
|
+
}, []);
|
|
1133
|
+
|
|
1134
|
+
return {
|
|
1135
|
+
transcript,
|
|
1136
|
+
partial,
|
|
1137
|
+
listening,
|
|
1138
|
+
supported,
|
|
1139
|
+
error,
|
|
1140
|
+
start,
|
|
1141
|
+
stop,
|
|
1142
|
+
abort,
|
|
1143
|
+
reset,
|
|
1144
|
+
};
|
|
1145
|
+
}
|
|
1146
|
+
|
|
919
1147
|
/* ============================================================================
|
|
920
1148
|
* DATASTORE CLIENT — ctx.datastore (@colixsystems/datastore-client)
|
|
921
1149
|
*
|
package/dist/index.d.ts
CHANGED
|
@@ -590,8 +590,22 @@ export interface WidgetContext<TProps = unknown> {
|
|
|
590
590
|
toast?: {
|
|
591
591
|
showToast(args: { kind?: string; message: string }): void;
|
|
592
592
|
};
|
|
593
|
-
/**
|
|
593
|
+
/**
|
|
594
|
+
* Optional host-brokered device capabilities; backs useGeolocation and
|
|
595
|
+
* useSpeechToText.
|
|
596
|
+
*/
|
|
594
597
|
device?: {
|
|
598
|
+
speech?: {
|
|
599
|
+
isSupported?(): boolean;
|
|
600
|
+
start(
|
|
601
|
+
options: SpeechToTextOptions,
|
|
602
|
+
handlers: {
|
|
603
|
+
onResult(result: { transcript: string; isFinal: boolean }): void;
|
|
604
|
+
onError(error: unknown): void;
|
|
605
|
+
onEnd(): void;
|
|
606
|
+
},
|
|
607
|
+
): Promise<{ stop(): void | Promise<void>; abort(): void }>;
|
|
608
|
+
};
|
|
595
609
|
geolocation?: {
|
|
596
610
|
getCurrentPosition(options?: GeolocationOptions): Promise<{
|
|
597
611
|
latitude: number;
|
|
@@ -1267,6 +1281,68 @@ export class GeolocationError extends Error {
|
|
|
1267
1281
|
);
|
|
1268
1282
|
}
|
|
1269
1283
|
|
|
1284
|
+
/** Pass-through options for `useSpeechToText(...)`. */
|
|
1285
|
+
export interface SpeechToTextOptions {
|
|
1286
|
+
/** BCP-47 tag, e.g. "sv-SE". Defaults to the host's UI language. */
|
|
1287
|
+
lang?: string;
|
|
1288
|
+
/** Keep listening across pauses instead of stopping at the first result. */
|
|
1289
|
+
continuous?: boolean;
|
|
1290
|
+
/** Emit uncommitted guesses to `partial` while the user is still speaking. */
|
|
1291
|
+
interimResults?: boolean;
|
|
1292
|
+
}
|
|
1293
|
+
|
|
1294
|
+
export interface SpeechToTextResult {
|
|
1295
|
+
/** Finalised speech, accumulated across utterances in this session. */
|
|
1296
|
+
transcript: string;
|
|
1297
|
+
/** The uncommitted guess; `""` unless `interimResults` was requested. */
|
|
1298
|
+
partial: string;
|
|
1299
|
+
listening: boolean;
|
|
1300
|
+
/** False when the host brokers no recogniser (e.g. Firefox). */
|
|
1301
|
+
supported: boolean;
|
|
1302
|
+
error: SpeechToTextError | null;
|
|
1303
|
+
/** Begin listening — call from a user gesture. Rejects with SpeechToTextError. */
|
|
1304
|
+
start(): Promise<void>;
|
|
1305
|
+
/** Stop listening and keep what was heard. */
|
|
1306
|
+
stop(): Promise<void>;
|
|
1307
|
+
/** Cancel listening and discard the current utterance. */
|
|
1308
|
+
abort(): void;
|
|
1309
|
+
/** Clear `transcript`, `partial`, and `error`. */
|
|
1310
|
+
reset(): void;
|
|
1311
|
+
}
|
|
1312
|
+
|
|
1313
|
+
/**
|
|
1314
|
+
* Dictate into text with the device's ON-DEVICE speech recogniser. Capture is
|
|
1315
|
+
* imperative (call `start()` from a user gesture; it never listens on mount).
|
|
1316
|
+
* The same hook drives both platforms — the web Player brokers it via
|
|
1317
|
+
* `window.SpeechRecognition`, the Expo export via `expo-speech-recognition`.
|
|
1318
|
+
* No audio is uploaded and no AI credit is spent. Safe to call on a host that
|
|
1319
|
+
* brokers no recogniser: `supported` is then false and `start()` rejects with
|
|
1320
|
+
* `code: "UNSUPPORTED"`, so gate the mic button on `supported`.
|
|
1321
|
+
*/
|
|
1322
|
+
export function useSpeechToText(
|
|
1323
|
+
options?: SpeechToTextOptions,
|
|
1324
|
+
): SpeechToTextResult;
|
|
1325
|
+
|
|
1326
|
+
/**
|
|
1327
|
+
* Error surfaced by `useSpeechToText()` — thrown by `start()` and stored in the
|
|
1328
|
+
* hook's `error` slot. `code` is a stable categorisation.
|
|
1329
|
+
*/
|
|
1330
|
+
export class SpeechToTextError extends Error {
|
|
1331
|
+
code:
|
|
1332
|
+
| "PERMISSION_DENIED"
|
|
1333
|
+
| "NO_SPEECH"
|
|
1334
|
+
| "LANGUAGE_UNSUPPORTED"
|
|
1335
|
+
| "NETWORK"
|
|
1336
|
+
| "ABORTED"
|
|
1337
|
+
| "UNSUPPORTED"
|
|
1338
|
+
| "INTERNAL";
|
|
1339
|
+
constructor(
|
|
1340
|
+
code: SpeechToTextError["code"],
|
|
1341
|
+
message: string,
|
|
1342
|
+
opts?: { cause?: unknown },
|
|
1343
|
+
);
|
|
1344
|
+
}
|
|
1345
|
+
|
|
1270
1346
|
/**
|
|
1271
1347
|
* Error class thrown by useDatastoreMutation callbacks (and surfaced by
|
|
1272
1348
|
* useDatastoreQuery in its `error` slot). The `code` is a stable
|
package/dist/index.js
CHANGED
package/dist/index.native.js
CHANGED
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "@colixsystems/widget-sdk",
|
|
3
|
-
"version": "0.
|
|
3
|
+
"version": "0.91.0",
|
|
4
4
|
"description": "Common widget interface for AppStudio. Implements WidgetManifest, WidgetContext, property schema, and helper hooks.",
|
|
5
5
|
"type": "module",
|
|
6
6
|
"main": "./dist/index.js",
|
|
@@ -48,7 +48,7 @@
|
|
|
48
48
|
],
|
|
49
49
|
"scripts": {
|
|
50
50
|
"build": "node scripts/build.js",
|
|
51
|
-
"test": "node --test src/__tests__/contract.test.js src/__tests__/hooks-users.test.js src/__tests__/hooks-groups.test.js src/__tests__/hooks-schema.test.js src/__tests__/hooks-assets-by-tag.test.js src/__tests__/hooks-filestore-upload.test.js src/__tests__/hooks-filestore-file.test.js src/__tests__/hooks-mutation.test.js src/__tests__/hooks-payments.test.js src/__tests__/hooks-record-permissions.test.js src/__tests__/hooks-geolocation.test.js src/__tests__/hooks-section-empty.test.js src/__tests__/hooks-widget-event.test.js src/__tests__/hooks-widget-input.test.js src/__tests__/hooks-identification.test.js src/__tests__/hooks-subscription.test.js src/__tests__/hooks-volatile-query-key.test.js src/__tests__/linter-users-scope.test.js src/__tests__/linter-comments.test.js src/__tests__/linter-translation-api.test.js src/__tests__/linter-image-height.test.js src/__tests__/linter-measured-padding.test.js src/__tests__/linter-payment-error.test.js src/__tests__/linter-platform.test.js src/__tests__/linter-react-import.test.js src/__tests__/lucide-icon-names.test.js src/__tests__/lucideIconName.test.js src/__tests__/manifest-actions.test.js src/__tests__/widget-translations.test.js src/__tests__/hooks-translate.test.js src/__tests__/devserver.test.js src/__tests__/host-externals.test.js src/__tests__/datetimepicker.test.js src/__tests__/property-schema-resolve.test.js src/__tests__/theme-components-parity.test.js src/__tests__/theme-depth-tokens.test.js src/__tests__/toast-host.test.js src/__tests__/hooks-domain-error-mapping.test.js src/__tests__/linter-datastore-error.test.js src/__tests__/linter-write-gating.test.js"
|
|
51
|
+
"test": "node --test src/__tests__/contract.test.js src/__tests__/hooks-users.test.js src/__tests__/hooks-groups.test.js src/__tests__/hooks-schema.test.js src/__tests__/hooks-assets-by-tag.test.js src/__tests__/hooks-filestore-upload.test.js src/__tests__/hooks-filestore-file.test.js src/__tests__/hooks-mutation.test.js src/__tests__/hooks-payments.test.js src/__tests__/hooks-record-permissions.test.js src/__tests__/hooks-geolocation.test.js src/__tests__/hooks-section-empty.test.js src/__tests__/hooks-widget-event.test.js src/__tests__/hooks-widget-input.test.js src/__tests__/hooks-identification.test.js src/__tests__/hooks-subscription.test.js src/__tests__/hooks-volatile-query-key.test.js src/__tests__/linter-users-scope.test.js src/__tests__/linter-comments.test.js src/__tests__/linter-translation-api.test.js src/__tests__/linter-image-height.test.js src/__tests__/linter-measured-padding.test.js src/__tests__/linter-payment-error.test.js src/__tests__/linter-platform.test.js src/__tests__/linter-react-import.test.js src/__tests__/lucide-icon-names.test.js src/__tests__/lucideIconName.test.js src/__tests__/manifest-actions.test.js src/__tests__/widget-translations.test.js src/__tests__/hooks-translate.test.js src/__tests__/devserver.test.js src/__tests__/host-externals.test.js src/__tests__/datetimepicker.test.js src/__tests__/property-schema-resolve.test.js src/__tests__/theme-components-parity.test.js src/__tests__/theme-depth-tokens.test.js src/__tests__/toast-host.test.js src/__tests__/hooks-domain-error-mapping.test.js src/__tests__/linter-datastore-error.test.js src/__tests__/linter-write-gating.test.js src/__tests__/hooks-speech-to-text.test.js"
|
|
52
52
|
},
|
|
53
53
|
"engines": {
|
|
54
54
|
"node": ">=18"
|