assemblyai 4.5.0-beta.0 → 4.5.0

package/CHANGELOG.md

@@ -1,7 +1,41 @@
 # Changelog
+
 ## [4.5.0]
 
+- You can now retrieve previous LeMUR responses using `client.lemur.getResponse<LemurTask>("YOUR_REQUEST_ID")`.
+- LeMUR functions now return `usage` with the number of `input_tokens` and `output_tokens`.
+
+## [4.4.7]
+
+- Rename `TranscriptService.redactions` function to `TranscriptService.redactedAudio`.
+- Add `TranscriptService.redactedAudioFile` function.
+- Add `workerd` export to fix `cache` issue with `fetch` on Cloudflare Workers.
+
+## [4.4.6]
+
+- Fix Rollup exports so \_\_SDK_VERSION\_\_ is properly replaced with the version of the SDK.
+
+## [4.4.5]
+
+- Add new `PiiPolicy` enum values
+
+## [4.4.4]
+
+- Add an export that only includes the Streaming STT code. You can use the export
+  - by importing `assemblyai/streaming`,
+  - or by loading the `assemblyai.streaming.umd.js` file, or `assemblyai.streaming.umd.min.js` file in a script-tag.
+- Add new `EntityType` enum values
+
+## [4.4.3] - 2024-05-09
+
+- Add react-native exports that resolve to the browser version of the library.
+
+## [4.4.2] - 2024-05-03
+
 ### Changed
+
+- Caching is disabled for all HTTP request made by the SDK
+- Accept data-URIs in `client.files.upload(dataUri)`, `client.transcripts.submit(audio: dataUri)`, `client.transcripts.transcribe(audio: dataUri)`.
 - Change how the WebSocket libraries are imported for better compatibility across frameworks and runtimes.
   The library no longer relies on a internal `#ws` import, and instead compiles the imports into the dist bundles.
   Browser builds will use the native `WebSocket`, other builds will use the `ws` package.

package/README.md

@@ -53,6 +53,38 @@ const client = new AssemblyAI({
 
 You can now use the `client` object to interact with the AssemblyAI API.
 
+### Using a CDN
+
+You can use automatic CDNs like [UNPKG](https://unpkg.com/) to load the library from a script tag.
+
+- Replace `:version` with the desired version or `latest`.
+- Remove `.min` to load the non-minified version.
+- Remove `.streaming` to load the entire SDK. Keep `.streaming` to load the Streaming STT specific version.
+
+```html
+<!-- Unminified full SDK -->
+<script src="https://www.unpkg.com/assemblyai@:version/dist/assemblyai.umd.js"></script>
+<!-- Minified full SDK -->
+<script src="https://www.unpkg.com/assemblyai@:version/dist/assemblyai.umd.min.js"></script>
+<!-- Unminified Streaming STT only -->
+<script src="https://www.unpkg.com/assemblyai@:version/dist/assemblyai.streaming.umd.js"></script>
+<!-- Minified Streaming STT only -->
+<script src="https://www.unpkg.com/assemblyai@:version/dist/assemblyai.streaming.umd.min.js"></script>
+```
+
+The script creates a global `assemblyai` variable containing all the services.
+Here's how you create a `RealtimeTranscriber` object.
+
+```js
+const { RealtimeTranscriber } = assemblyai;
+const transcriber = new RealtimeTranscriber({
+  token: "[GENERATE TEMPORARY AUTH TOKEN IN YOUR API]",
+  ...
+});
+```
+
+For type support in your IDE, see [Reference types from JavaScript](./docs/reference-types-from-js.md).
+
 ## Speech-To-Text
 
 ### Transcribe audio and video files
@@ -227,18 +259,26 @@ const rt = client.realtime.transcriber({
 });
 ```
 
-You can also generate a temporary auth token for real-time.
-
-```typescript
-const token = await client.realtime.createTemporaryToken({ expires_in = 60 });
-const rt = client.realtime.transcriber({
-  token: token,
-});
-```
-
 > [!WARNING]
 > Storing your API key in client-facing applications exposes your API key.
 > Generate a temporary auth token on the server and pass it to your client.
+> _Server code_:
+>
+> ```typescript
+> const token = await client.realtime.createTemporaryToken({ expires_in = 60 });
+> // TODO: return token to client
+> ```
+>
+> _Client code_:
+>
+> ```typescript
+> import { RealtimeTranscriber } from "assemblyai"; // or "assemblyai/streaming"
+> // TODO: implement getToken to retrieve token from server
+> const token = await getToken();
+> const rt = new RealtimeTranscriber({
+>   token,
+> });
+> ```
 
 You can configure the following events.
 
@@ -344,3 +384,7 @@ const response = await client.lemur.purgeRequestData(lemurResponse.request_id);
 ```
 
 </details>
+
+## Contributing
+
+If you want to contribute to the JavaScript SDK, follow the guidelines in [CONTRIBUTING.md](./CONTRIBUTING.md).

package/dist/assemblyai.streaming.umd.js

@@ -0,0 +1,288 @@
+(function (global, factory) {
+    typeof exports === 'object' && typeof module !== 'undefined' ? factory(exports) :
+    typeof define === 'function' && define.amd ? define(['exports'], factory) :
+    (global = typeof globalThis !== 'undefined' ? globalThis : global || self, factory(global.assemblyai = {}));
+})(this, (function (exports) { 'use strict';
+
+    /******************************************************************************
+    Copyright (c) Microsoft Corporation.
+
+    Permission to use, copy, modify, and/or distribute this software for any
+    purpose with or without fee is hereby granted.
+
+    THE SOFTWARE IS PROVIDED "AS IS" AND THE AUTHOR DISCLAIMS ALL WARRANTIES WITH
+    REGARD TO THIS SOFTWARE INCLUDING ALL IMPLIED WARRANTIES OF MERCHANTABILITY
+    AND FITNESS. IN NO EVENT SHALL THE AUTHOR BE LIABLE FOR ANY SPECIAL, DIRECT,
+    INDIRECT, OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES WHATSOEVER RESULTING FROM
+    LOSS OF USE, DATA OR PROFITS, WHETHER IN AN ACTION OF CONTRACT, NEGLIGENCE OR
+    OTHER TORTIOUS ACTION, ARISING OUT OF OR IN CONNECTION WITH THE USE OR
+    PERFORMANCE OF THIS SOFTWARE.
+    ***************************************************************************** */
+    /* global Reflect, Promise, SuppressedError, Symbol */
+
+
+    function __awaiter(thisArg, _arguments, P, generator) {
+        function adopt(value) { return value instanceof P ? value : new P(function (resolve) { resolve(value); }); }
+        return new (P || (P = Promise))(function (resolve, reject) {
+            function fulfilled(value) { try { step(generator.next(value)); } catch (e) { reject(e); } }
+            function rejected(value) { try { step(generator["throw"](value)); } catch (e) { reject(e); } }
+            function step(result) { result.done ? resolve(result.value) : adopt(result.value).then(fulfilled, rejected); }
+            step((generator = generator.apply(thisArg, _arguments || [])).next());
+        });
+    }
+
+    typeof SuppressedError === "function" ? SuppressedError : function (error, suppressed, message) {
+        var e = new Error(message);
+        return e.name = "SuppressedError", e.error = error, e.suppressed = suppressed, e;
+    };
+
+    const { WritableStream } = typeof window !== "undefined"
+        ? window
+        : typeof global !== "undefined"
+            ? global
+            : globalThis;
+
+    var _a, _b;
+    const PolyfillWebSocket = (_b = (_a = WebSocket !== null && WebSocket !== void 0 ? WebSocket : global === null || global === void 0 ? void 0 : global.WebSocket) !== null && _a !== void 0 ? _a : window === null || window === void 0 ? void 0 : window.WebSocket) !== null && _b !== void 0 ? _b : self === null || self === void 0 ? void 0 : self.WebSocket;
+    const factory = (url, params) => {
+        if (params) {
+            return new PolyfillWebSocket(url, params);
+        }
+        return new PolyfillWebSocket(url);
+    };
+
+    var RealtimeErrorType;
+    (function (RealtimeErrorType) {
+        RealtimeErrorType[RealtimeErrorType["BadSampleRate"] = 4000] = "BadSampleRate";
+        RealtimeErrorType[RealtimeErrorType["AuthFailed"] = 4001] = "AuthFailed";
+        // Both InsufficientFunds and FreeAccount error use 4002
+        RealtimeErrorType[RealtimeErrorType["InsufficientFundsOrFreeAccount"] = 4002] = "InsufficientFundsOrFreeAccount";
+        RealtimeErrorType[RealtimeErrorType["NonexistentSessionId"] = 4004] = "NonexistentSessionId";
+        RealtimeErrorType[RealtimeErrorType["SessionExpired"] = 4008] = "SessionExpired";
+        RealtimeErrorType[RealtimeErrorType["ClosedSession"] = 4010] = "ClosedSession";
+        RealtimeErrorType[RealtimeErrorType["RateLimited"] = 4029] = "RateLimited";
+        RealtimeErrorType[RealtimeErrorType["UniqueSessionViolation"] = 4030] = "UniqueSessionViolation";
+        RealtimeErrorType[RealtimeErrorType["SessionTimeout"] = 4031] = "SessionTimeout";
+        RealtimeErrorType[RealtimeErrorType["AudioTooShort"] = 4032] = "AudioTooShort";
+        RealtimeErrorType[RealtimeErrorType["AudioTooLong"] = 4033] = "AudioTooLong";
+        RealtimeErrorType[RealtimeErrorType["BadJson"] = 4100] = "BadJson";
+        RealtimeErrorType[RealtimeErrorType["BadSchema"] = 4101] = "BadSchema";
+        RealtimeErrorType[RealtimeErrorType["TooManyStreams"] = 4102] = "TooManyStreams";
+        RealtimeErrorType[RealtimeErrorType["Reconnected"] = 4103] = "Reconnected";
+        RealtimeErrorType[RealtimeErrorType["ReconnectAttemptsExhausted"] = 1013] = "ReconnectAttemptsExhausted";
+    })(RealtimeErrorType || (RealtimeErrorType = {}));
+    const RealtimeErrorMessages = {
+        [RealtimeErrorType.BadSampleRate]: "Sample rate must be a positive integer",
+        [RealtimeErrorType.AuthFailed]: "Not Authorized",
+        [RealtimeErrorType.InsufficientFundsOrFreeAccount]: "Insufficient funds or you are using a free account. This feature is paid-only and requires you to add a credit card. Please visit https://assemblyai.com/dashboard/ to add a credit card to your account.",
+        [RealtimeErrorType.NonexistentSessionId]: "Session ID does not exist",
+        [RealtimeErrorType.SessionExpired]: "Session has expired",
+        [RealtimeErrorType.ClosedSession]: "Session is closed",
+        [RealtimeErrorType.RateLimited]: "Rate limited",
+        [RealtimeErrorType.UniqueSessionViolation]: "Unique session violation",
+        [RealtimeErrorType.SessionTimeout]: "Session Timeout",
+        [RealtimeErrorType.AudioTooShort]: "Audio too short",
+        [RealtimeErrorType.AudioTooLong]: "Audio too long",
+        [RealtimeErrorType.BadJson]: "Bad JSON",
+        [RealtimeErrorType.BadSchema]: "Bad schema",
+        [RealtimeErrorType.TooManyStreams]: "Too many streams",
+        [RealtimeErrorType.Reconnected]: "Reconnected",
+        [RealtimeErrorType.ReconnectAttemptsExhausted]: "Reconnect attempts exhausted",
+    };
+    class RealtimeError extends Error {
+    }
+
+    const defaultRealtimeUrl = "wss://api.assemblyai.com/v2/realtime/ws";
+    const forceEndOfUtteranceMessage = `{"force_end_utterance":true}`;
+    const terminateSessionMessage = `{"terminate_session":true}`;
+    class RealtimeTranscriber {
+        constructor(params) {
+            var _a, _b;
+            this.listeners = {};
+            this.realtimeUrl = (_a = params.realtimeUrl) !== null && _a !== void 0 ? _a : defaultRealtimeUrl;
+            this.sampleRate = (_b = params.sampleRate) !== null && _b !== void 0 ? _b : 16000;
+            this.wordBoost = params.wordBoost;
+            this.encoding = params.encoding;
+            this.endUtteranceSilenceThreshold = params.endUtteranceSilenceThreshold;
+            this.disablePartialTranscripts = params.disablePartialTranscripts;
+            if ("token" in params && params.token)
+                this.token = params.token;
+            if ("apiKey" in params && params.apiKey)
+                this.apiKey = params.apiKey;
+            if (!(this.token || this.apiKey)) {
+                throw new Error("API key or temporary token is required.");
+            }
+        }
+        connectionUrl() {
+            const url = new URL(this.realtimeUrl);
+            if (url.protocol !== "wss:") {
+                throw new Error("Invalid protocol, must be wss");
+            }
+            const searchParams = new URLSearchParams();
+            if (this.token) {
+                searchParams.set("token", this.token);
+            }
+            searchParams.set("sample_rate", this.sampleRate.toString());
+            if (this.wordBoost && this.wordBoost.length > 0) {
+                searchParams.set("word_boost", JSON.stringify(this.wordBoost));
+            }
+            if (this.encoding) {
+                searchParams.set("encoding", this.encoding);
+            }
+            searchParams.set("enable_extra_session_information", "true");
+            if (this.disablePartialTranscripts) {
+                searchParams.set("disable_partial_transcripts", this.disablePartialTranscripts.toString());
+            }
+            url.search = searchParams.toString();
+            return url;
+        }
+        // eslint-disable-next-line @typescript-eslint/no-explicit-any
+        on(event, listener) {
+            this.listeners[event] = listener;
+        }
+        connect() {
+            return new Promise((resolve) => {
+                if (this.socket) {
+                    throw new Error("Already connected");
+                }
+                const url = this.connectionUrl();
+                if (this.token) {
+                    this.socket = factory(url.toString());
+                }
+                else {
+                    this.socket = factory(url.toString(), {
+                        headers: { Authorization: this.apiKey },
+                    });
+                }
+                this.socket.binaryType = "arraybuffer";
+                this.socket.onopen = () => {
+                    if (this.endUtteranceSilenceThreshold === undefined ||
+                        this.endUtteranceSilenceThreshold === null) {
+                        return;
+                    }
+                    this.configureEndUtteranceSilenceThreshold(this.endUtteranceSilenceThreshold);
+                };
+                this.socket.onclose = ({ code, reason }) => {
+                    var _a, _b;
+                    if (!reason) {
+                        if (code in RealtimeErrorType) {
+                            reason = RealtimeErrorMessages[code];
+                        }
+                    }
+                    (_b = (_a = this.listeners).close) === null || _b === void 0 ? void 0 : _b.call(_a, code, reason);
+                };
+                this.socket.onerror = (event) => {
+                    var _a, _b, _c, _d;
+                    if (event.error)
+                        (_b = (_a = this.listeners).error) === null || _b === void 0 ? void 0 : _b.call(_a, event.error);
+                    else
+                        (_d = (_c = this.listeners).error) === null || _d === void 0 ? void 0 : _d.call(_c, new Error(event.message));
+                };
+                this.socket.onmessage = ({ data }) => {
+                    var _a, _b, _c, _d, _e, _f, _g, _h, _j, _k, _l, _m, _o, _p, _q;
+                    const message = JSON.parse(data.toString());
+                    if ("error" in message) {
+                        (_b = (_a = this.listeners).error) === null || _b === void 0 ? void 0 : _b.call(_a, new RealtimeError(message.error));
+                        return;
+                    }
+                    switch (message.message_type) {
+                        case "SessionBegins": {
+                            const openObject = {
+                                sessionId: message.session_id,
+                                expiresAt: new Date(message.expires_at),
+                            };
+                            resolve(openObject);
+                            (_d = (_c = this.listeners).open) === null || _d === void 0 ? void 0 : _d.call(_c, openObject);
+                            break;
+                        }
+                        case "PartialTranscript": {
+                            // message.created is actually a string when coming from the socket
+                            message.created = new Date(message.created);
+                            (_f = (_e = this.listeners).transcript) === null || _f === void 0 ? void 0 : _f.call(_e, message);
+                            (_h = (_g = this.listeners)["transcript.partial"]) === null || _h === void 0 ? void 0 : _h.call(_g, message);
+                            break;
+                        }
+                        case "FinalTranscript": {
+                            // message.created is actually a string when coming from the socket
+                            message.created = new Date(message.created);
+                            (_k = (_j = this.listeners).transcript) === null || _k === void 0 ? void 0 : _k.call(_j, message);
+                            (_m = (_l = this.listeners)["transcript.final"]) === null || _m === void 0 ? void 0 : _m.call(_l, message);
+                            break;
+                        }
+                        case "SessionInformation": {
+                            (_p = (_o = this.listeners).session_information) === null || _p === void 0 ? void 0 : _p.call(_o, message);
+                            break;
+                        }
+                        case "SessionTerminated": {
+                            (_q = this.sessionTerminatedResolve) === null || _q === void 0 ? void 0 : _q.call(this);
+                            break;
+                        }
+                    }
+                };
+            });
+        }
+        sendAudio(audio) {
+            this.send(audio);
+        }
+        stream() {
+            return new WritableStream({
+                write: (chunk) => {
+                    this.sendAudio(chunk);
+                },
+            });
+        }
+        /**
+         * Manually end an utterance
+         */
+        forceEndUtterance() {
+            this.send(forceEndOfUtteranceMessage);
+        }
+        /**
+         * Configure the threshold for how long to wait before ending an utterance. Default is 700ms.
+         * @param threshold - The duration of the end utterance silence threshold in milliseconds.
+         * This value must be an integer between 0 and 20_000.
+         */
+        configureEndUtteranceSilenceThreshold(threshold) {
+            this.send(`{"end_utterance_silence_threshold":${threshold}}`);
+        }
+        send(data) {
+            if (!this.socket || this.socket.readyState !== this.socket.OPEN) {
+                throw new Error("Socket is not open for communication");
+            }
+            this.socket.send(data);
+        }
+        close() {
+            return __awaiter(this, arguments, void 0, function* (waitForSessionTermination = true) {
+                var _a;
+                if (this.socket) {
+                    if (this.socket.readyState === this.socket.OPEN) {
+                        if (waitForSessionTermination) {
+                            const sessionTerminatedPromise = new Promise((resolve) => {
+                                this.sessionTerminatedResolve = resolve;
+                            });
+                            this.socket.send(terminateSessionMessage);
+                            yield sessionTerminatedPromise;
+                        }
+                        else {
+                            this.socket.send(terminateSessionMessage);
+                        }
+                    }
+                    if ((_a = this.socket) === null || _a === void 0 ? void 0 : _a.removeAllListeners)
+                        this.socket.removeAllListeners();
+                    this.socket.close();
+                }
+                this.listeners = {};
+                this.socket = undefined;
+            });
+        }
+    }
+    /**
+     * @deprecated Use RealtimeTranscriber instead
+     */
+    class RealtimeService extends RealtimeTranscriber {
+    }
+
+    exports.RealtimeService = RealtimeService;
+    exports.RealtimeTranscriber = RealtimeTranscriber;
+
+}));

package/dist/assemblyai.streaming.umd.min.js

@@ -0,0 +1 @@
+!function(e,t){"object"==typeof exports&&"undefined"!=typeof module?t(exports):"function"==typeof define&&define.amd?define(["exports"],t):t((e="undefined"!=typeof globalThis?globalThis:e||self).assemblyai={})}(this,(function(e){"use strict";function t(e,t,s,i){return new(s||(s=Promise))((function(o,n){function r(e){try{l(i.next(e))}catch(e){n(e)}}function a(e){try{l(i.throw(e))}catch(e){n(e)}}function l(e){var t;e.done?o(e.value):(t=e.value,t instanceof s?t:new s((function(e){e(t)}))).then(r,a)}l((i=i.apply(e,t||[])).next())}))}"function"==typeof SuppressedError&&SuppressedError;const{WritableStream:s}="undefined"!=typeof window?window:"undefined"!=typeof global?global:globalThis;var i,o;const n=null!==(o=null!==(i=null!==WebSocket&&void 0!==WebSocket?WebSocket:null===global||void 0===global?void 0:global.WebSocket)&&void 0!==i?i:null===window||void 0===window?void 0:window.WebSocket)&&void 0!==o?o:null===self||void 0===self?void 0:self.WebSocket,r=(e,t)=>t?new n(e,t):new n(e);var a;!function(e){e[e.BadSampleRate=4e3]="BadSampleRate",e[e.AuthFailed=4001]="AuthFailed",e[e.InsufficientFundsOrFreeAccount=4002]="InsufficientFundsOrFreeAccount",e[e.NonexistentSessionId=4004]="NonexistentSessionId",e[e.SessionExpired=4008]="SessionExpired",e[e.ClosedSession=4010]="ClosedSession",e[e.RateLimited=4029]="RateLimited",e[e.UniqueSessionViolation=4030]="UniqueSessionViolation",e[e.SessionTimeout=4031]="SessionTimeout",e[e.AudioTooShort=4032]="AudioTooShort",e[e.AudioTooLong=4033]="AudioTooLong",e[e.BadJson=4100]="BadJson",e[e.BadSchema=4101]="BadSchema",e[e.TooManyStreams=4102]="TooManyStreams",e[e.Reconnected=4103]="Reconnected",e[e.ReconnectAttemptsExhausted=1013]="ReconnectAttemptsExhausted"}(a||(a={}));const l={[a.BadSampleRate]:"Sample rate must be a positive integer",[a.AuthFailed]:"Not Authorized",[a.InsufficientFundsOrFreeAccount]:"Insufficient funds or you are using a free account. This feature is paid-only and requires you to add a credit card. Please visit https://assemblyai.com/dashboard/ to add a credit card to your account.",[a.NonexistentSessionId]:"Session ID does not exist",[a.SessionExpired]:"Session has expired",[a.ClosedSession]:"Session is closed",[a.RateLimited]:"Rate limited",[a.UniqueSessionViolation]:"Unique session violation",[a.SessionTimeout]:"Session Timeout",[a.AudioTooShort]:"Audio too short",[a.AudioTooLong]:"Audio too long",[a.BadJson]:"Bad JSON",[a.BadSchema]:"Bad schema",[a.TooManyStreams]:"Too many streams",[a.Reconnected]:"Reconnected",[a.ReconnectAttemptsExhausted]:"Reconnect attempts exhausted"};class c extends Error{}const d='{"terminate_session":true}';class h{constructor(e){var t,s;if(this.listeners={},this.realtimeUrl=null!==(t=e.realtimeUrl)&&void 0!==t?t:"wss://api.assemblyai.com/v2/realtime/ws",this.sampleRate=null!==(s=e.sampleRate)&&void 0!==s?s:16e3,this.wordBoost=e.wordBoost,this.encoding=e.encoding,this.endUtteranceSilenceThreshold=e.endUtteranceSilenceThreshold,this.disablePartialTranscripts=e.disablePartialTranscripts,"token"in e&&e.token&&(this.token=e.token),"apiKey"in e&&e.apiKey&&(this.apiKey=e.apiKey),!this.token&&!this.apiKey)throw new Error("API key or temporary token is required.")}connectionUrl(){const e=new URL(this.realtimeUrl);if("wss:"!==e.protocol)throw new Error("Invalid protocol, must be wss");const t=new URLSearchParams;return this.token&&t.set("token",this.token),t.set("sample_rate",this.sampleRate.toString()),this.wordBoost&&this.wordBoost.length>0&&t.set("word_boost",JSON.stringify(this.wordBoost)),this.encoding&&t.set("encoding",this.encoding),t.set("enable_extra_session_information","true"),this.disablePartialTranscripts&&t.set("disable_partial_transcripts",this.disablePartialTranscripts.toString()),e.search=t.toString(),e}on(e,t){this.listeners[e]=t}connect(){return new Promise((e=>{if(this.socket)throw new Error("Already connected");const t=this.connectionUrl();this.token?this.socket=r(t.toString()):this.socket=r(t.toString(),{headers:{Authorization:this.apiKey}}),this.socket.binaryType="arraybuffer",this.socket.onopen=()=>{void 0!==this.endUtteranceSilenceThreshold&&null!==this.endUtteranceSilenceThreshold&&this.configureEndUtteranceSilenceThreshold(this.endUtteranceSilenceThreshold)},this.socket.onclose=({code:e,reason:t})=>{var s,i;t||e in a&&(t=l[e]),null===(i=(s=this.listeners).close)||void 0===i||i.call(s,e,t)},this.socket.onerror=e=>{var t,s,i,o;e.error?null===(s=(t=this.listeners).error)||void 0===s||s.call(t,e.error):null===(o=(i=this.listeners).error)||void 0===o||o.call(i,new Error(e.message))},this.socket.onmessage=({data:t})=>{var s,i,o,n,r,a,l,d,h,u,p,m,S,f,v;const w=JSON.parse(t.toString());if("error"in w)null===(i=(s=this.listeners).error)||void 0===i||i.call(s,new c(w.error));else switch(w.message_type){case"SessionBegins":{const t={sessionId:w.session_id,expiresAt:new Date(w.expires_at)};e(t),null===(n=(o=this.listeners).open)||void 0===n||n.call(o,t);break}case"PartialTranscript":w.created=new Date(w.created),null===(a=(r=this.listeners).transcript)||void 0===a||a.call(r,w),null===(d=(l=this.listeners)["transcript.partial"])||void 0===d||d.call(l,w);break;case"FinalTranscript":w.created=new Date(w.created),null===(u=(h=this.listeners).transcript)||void 0===u||u.call(h,w),null===(m=(p=this.listeners)["transcript.final"])||void 0===m||m.call(p,w);break;case"SessionInformation":null===(f=(S=this.listeners).session_information)||void 0===f||f.call(S,w);break;case"SessionTerminated":null===(v=this.sessionTerminatedResolve)||void 0===v||v.call(this)}}}))}sendAudio(e){this.send(e)}stream(){return new s({write:e=>{this.sendAudio(e)}})}forceEndUtterance(){this.send('{"force_end_utterance":true}')}configureEndUtteranceSilenceThreshold(e){this.send(`{"end_utterance_silence_threshold":${e}}`)}send(e){if(!this.socket||this.socket.readyState!==this.socket.OPEN)throw new Error("Socket is not open for communication");this.socket.send(e)}close(){return t(this,arguments,void 0,(function*(e=!0){var t;if(this.socket){if(this.socket.readyState===this.socket.OPEN)if(e){const e=new Promise((e=>{this.sessionTerminatedResolve=e}));this.socket.send(d),yield e}else this.socket.send(d);(null===(t=this.socket)||void 0===t?void 0:t.removeAllListeners)&&this.socket.removeAllListeners(),this.socket.close()}this.listeners={},this.socket=void 0}))}}e.RealtimeService=class extends h{},e.RealtimeTranscriber=h}));

package/dist/assemblyai.umd.js

@@ -48,6 +48,45 @@
         return e.name = "SuppressedError", e.error = error, e.suppressed = suppressed, e;
     };
 
+    const DEFAULT_FETCH_INIT = {
+        cache: "no-store",
+    };
+
+    const buildUserAgent = (userAgent) => defaultUserAgentString +
+        (userAgent === false
+            ? ""
+            : " AssemblyAI/1.0 (" +
+                Object.entries(Object.assign(Object.assign({}, defaultUserAgent), userAgent))
+                    .map(([key, item]) => item ? `${key}=${item.name}/${item.version}` : "")
+                    .join(" ") +
+                ")");
+    let defaultUserAgentString = "";
+    if (typeof navigator !== "undefined" && navigator.userAgent) {
+        defaultUserAgentString += navigator.userAgent;
+    }
+    const defaultUserAgent = {
+        sdk: { name: "JavaScript", version: "4.5.0" },
+    };
+    if (typeof process !== "undefined") {
+        if (process.versions.node && defaultUserAgentString.indexOf("Node") === -1) {
+            defaultUserAgent.runtime_env = {
+                name: "Node",
+                version: process.versions.node,
+            };
+        }
+        if (process.versions.bun && defaultUserAgentString.indexOf("Bun") === -1) {
+            defaultUserAgent.runtime_env = {
+                name: "Bun",
+                version: process.versions.bun,
+            };
+        }
+    }
+    if (typeof Deno !== "undefined") {
+        if (process.versions.bun && defaultUserAgentString.indexOf("Deno") === -1) {
+            defaultUserAgent.runtime_env = { name: "Deno", version: Deno.version.deno };
+        }
+    }
+
     /**
      * Base class for services that communicate with the API.
      */
@@ -58,13 +97,33 @@
          */
         constructor(params) {
             this.params = params;
+            if (params.userAgent === false) {
+                this.userAgent = undefined;
+            }
+            else {
+                this.userAgent = buildUserAgent(params.userAgent || {});
+            }
         }
         fetch(input, init) {
             return __awaiter(this, void 0, void 0, function* () {
-                var _a;
-                init = init !== null && init !== void 0 ? init : {};
-                init.headers = (_a = init.headers) !== null && _a !== void 0 ? _a : {};
-                init.headers = Object.assign({ Authorization: this.params.apiKey, "Content-Type": "application/json" }, init.headers);
+                init = Object.assign(Object.assign({}, DEFAULT_FETCH_INIT), init);
+                let headers = {
+                    Authorization: this.params.apiKey,
+                    "Content-Type": "application/json",
+                };
+                if (DEFAULT_FETCH_INIT === null || DEFAULT_FETCH_INIT === void 0 ? void 0 : DEFAULT_FETCH_INIT.headers)
+                    headers = Object.assign(Object.assign({}, headers), DEFAULT_FETCH_INIT.headers);
+                if (init === null || init === void 0 ? void 0 : init.headers)
+                    headers = Object.assign(Object.assign({}, headers), init.headers);
+                if (this.userAgent) {
+                    headers["User-Agent"] = this.userAgent;
+                    // chromium browsers have a bug where the user agent can't be modified
+                    if (typeof window !== "undefined" && "chrome" in window) {
+                        headers["AssemblyAI-Agent"] =
+                            this.userAgent;
+                    }
+                }
+                init.headers = headers;
                 if (!input.startsWith("http"))
                     input = this.params.baseUrl + input;
                 const response = yield fetch(input, init);
@@ -75,7 +134,7 @@
                         try {
                             json = JSON.parse(text);
                         }
-                        catch (_b) {
+                        catch (_a) {
                             /* empty */
                         }
                         if (json === null || json === void 0 ? void 0 : json.error)
@@ -120,6 +179,9 @@
                 body: JSON.stringify(params),
             });
         }
+        getResponse(id) {
+            return this.fetchJson(`/lemur/v3/${id}`);
+        }
         /**
          * Delete the data for a previously submitted LeMUR request.
          * @param id - ID of the LeMUR request
@@ -416,6 +478,8 @@
             return null;
         if (path.startsWith("https"))
             return null;
+        if (path.startsWith("data:"))
+            return null;
         if (path.startsWith("file://"))
             return path.substring(7);
         if (path.startsWith("file:"))
@@ -460,8 +524,13 @@
                             audioUrl = yield this.files.upload(path);
                         }
                         else {
-                            // audio is not a local path, assume it's a URL
-                            audioUrl = audio;
+                            if (audio.startsWith("data:")) {
+                                audioUrl = yield this.files.upload(audio);
+                            }
+                            else {
+                                // audio is not a local path, and not a data-URI, assume it's a normal URL
+                                audioUrl = audio;
+                            }
                         }
                     }
                     else {
@@ -626,13 +695,45 @@
             });
         }
         /**
-         * Retrieve redactions of a transcript.
+         * Retrieve the redacted audio URL of a transcript.
          * @param id - The identifier of the transcript.
-         * @returns A promise that resolves to the subtitles text.
+         * @returns A promise that resolves to the details of the redacted audio.
+         * @deprecated Use `redactedAudio` instead.
          */
         redactions(id) {
+            return this.redactedAudio(id);
+        }
+        /**
+         * Retrieve the redacted audio URL of a transcript.
+         * @param id - The identifier of the transcript.
+         * @returns A promise that resolves to the details of the redacted audio.
+         */
+        redactedAudio(id) {
             return this.fetchJson(`/v2/transcript/${id}/redacted-audio`);
         }
+        /**
+         * Retrieve the redacted audio file of a transcript.
+         * @param id - The identifier of the transcript.
+         * @returns A promise that resolves to the fetch HTTP response of the redacted audio file.
+         */
+        redactedAudioFile(id) {
+            return __awaiter(this, void 0, void 0, function* () {
+                const { redacted_audio_url, status } = yield this.redactedAudio(id);
+                if (status !== "redacted_audio_ready") {
+                    throw new Error(`Redacted audio status is ${status}`);
+                }
+                const response = yield fetch(redacted_audio_url);
+                if (!response.ok) {
+                    throw new Error(`Failed to fetch redacted audio: ${response.statusText}`);
+                }
+                return {
+                    arrayBuffer: response.arrayBuffer.bind(response),
+                    blob: response.blob.bind(response),
+                    body: response.body,
+                    bodyUsed: response.bodyUsed,
+                };
+            });
+        }
     }
     function deprecateConformer2(params) {
         if (!params)
@@ -659,8 +760,14 @@
         upload(input) {
             return __awaiter(this, void 0, void 0, function* () {
                 let fileData;
-                if (typeof input === "string")
-                    fileData = yield readFile();
+                if (typeof input === "string") {
+                    if (input.startsWith("data:")) {
+                        fileData = dataUrlToBlob(input);
+                    }
+                    else {
+                        fileData = yield readFile();
+                    }
+                }
                 else
                     fileData = input;
                 const data = yield this.fetchJson("/v2/upload", {
@@ -675,6 +782,17 @@
             });
         }
     }
+    function dataUrlToBlob(dataUrl) {
+        const arr = dataUrl.split(",");
+        const mime = arr[0].match(/:(.*?);/)[1];
+        const bstr = atob(arr[1]);
+        let n = bstr.length;
+        const u8arr = new Uint8Array(n);
+        while (n--) {
+            u8arr[n] = bstr.charCodeAt(n);
+        }
+        return new Blob([u8arr], { type: mime });
+    }
 
     const defaultBaseUrl = "https://api.assemblyai.com";
     class AssemblyAI {
@@ -684,8 +802,9 @@
          */
         constructor(params) {
             params.baseUrl = params.baseUrl || defaultBaseUrl;
-            if (params.baseUrl && params.baseUrl.endsWith("/"))
+            if (params.baseUrl && params.baseUrl.endsWith("/")) {
                 params.baseUrl = params.baseUrl.slice(0, -1);
+            }
             this.files = new FileService(params);
             this.transcripts = new TranscriptService(params, this.files);
             this.lemur = new LemurService(params);