modelfusion 0.128.0 → 0.129.0

package/CHANGELOG.md

@@ -1,5 +1,32 @@
 # Changelog
 
+## v0.129.0 - 2024-01-20
+
+### Changed
+
+- **breaking change**: Usage of Node `async_hooks` has been renamed from `node:async_hooks` to `async_hooks` for easier Webpack configuration. To exclude the `async_hooks` from client-side bundling, you can use the following config for Next.js (`next.config.mjs` or `next.config.js`):
+
+  ```js
+  /**
+   * @type {import('next').NextConfig}
+   */
+  const nextConfig = {
+    webpack: (config, { isServer }) => {
+      if (isServer) {
+        return config;
+      }
+
+      config.resolve = config.resolve ?? {};
+      config.resolve.fallback = config.resolve.fallback ?? {};
+
+      // async hooks is not available in the browser:
+      config.resolve.fallback.async_hooks = false;
+
+      return config;
+    },
+  };
+  ```
+
 ## v0.128.0 - 2024-01-20
 
 ### Changed
@@ -8,9 +35,7 @@
 - **breaking change**: Image content in multi-modal instruction and chat inputs (e.g. for GPT Vision) is passed in the `image` property (instead of `base64Image`) and supports both base64 strings and `Uint8Array` inputs:
 
   ```ts
-  const image = fs.readFileSync(path.join("data", "example-image.png"), {
-    encoding: "base64",
-  });
+  const image = fs.readFileSync(path.join("data", "example-image.png"));
 
   const textStream = await streamText({
     model: openai.ChatTextGenerator({

package/README.md

@@ -86,7 +86,7 @@ Multi-modal vision models such as GPT 4 Vision can process images as part of the
 import { streamText, openai } from "modelfusion";
 import { readFileSync } from "fs";
 
-const image = readFileSync("./image.png").toString("base64");
+const image = readFileSync("./image.png");
 
 const textStream = await streamText({
   model: openai.ChatTextGenerator({ model: "gpt-4-vision-preview" }),
@@ -219,7 +219,7 @@ Synthesize speech (audio) from text. Also called TTS (text-to-speech).
 ```ts
 import { generateSpeech, lmnt } from "modelfusion";
 
-// `speech` is a Buffer with MP3 audio data
+// `speech` is a Uint8Array with MP3 audio data
 const speech = await generateSpeech({
   model: lmnt.SpeechGenerator({
     voice: "034b632b-df71-46c8-b440-86a42ffc3cf3", // Henry
@@ -257,7 +257,7 @@ const speechStream = await streamSpeech({
 });
 
 for await (const part of speechStream) {
-  // each part is a Buffer with MP3 audio data
+  // each part is a Uint8Array with MP3 audio data
 }
 ```
 
@@ -635,17 +635,11 @@ A web chat with an AI assistant, implemented as a Next.js app.
 
 Ask questions about a PDF document and get answers from the document.
 
-### [Image generator (Next.js)](https://github.com/lgrammel/modelfusion/tree/main/examples/image-generator-next-js)
+### [Next.js / ModelFusion Demos](https://github.com/lgrammel/modelfusion/tree/main/examples/nextjs)
 
-> _Next.js app_, _Stability AI image generation_
+> _Next.js app_, _image generation_
 
-Create an 19th century painting image for your input.
-
-### [Voice recording and transcription (Next.js)](https://github.com/lgrammel/modelfusion/tree/main/examples/voice-recording-next-js)
-
-> _Next.js app_, _OpenAI Whisper_
-
-Record audio with push-to-talk and transcribe it using Whisper, implemented as a Next.js app. The app shows a list of the transcriptions.
+Various examples of using ModelFusion with Next.js: Image generation, voice recording & transcription.
 
 ### [Duplex Speech Streaming (using Vite/React & ModelFusion Server/Fastify)](https://github.com/lgrammel/modelfusion/tree/main/examples/speech-streaming-vite-react-fastify)
 

package/core/getRun.cjs

@@ -34,7 +34,8 @@ async function ensureLoaded() {
     if (!isNode)
         return Promise.resolve();
     if (!runStorage) {
-        const { AsyncLocalStorage } = await Promise.resolve().then(() => __importStar(require("node:async_hooks")));
+        // Note: using "async_hooks" instead of "node:async_hooks" to avoid webpack fallback problems.
+        const { AsyncLocalStorage } = await Promise.resolve().then(() => __importStar(require("async_hooks")));
         runStorage = new AsyncLocalStorage();
     }
     return Promise.resolve();

package/core/getRun.js

@@ -8,7 +8,8 @@ async function ensureLoaded() {
     if (!isNode)
         return Promise.resolve();
     if (!runStorage) {
-        const { AsyncLocalStorage } = await import("node:async_hooks");
+        // Note: using "async_hooks" instead of "node:async_hooks" to avoid webpack fallback problems.
+        const { AsyncLocalStorage } = await import("async_hooks");
         runStorage = new AsyncLocalStorage();
     }
     return Promise.resolve();

package/package.json

@@ -1,7 +1,7 @@
 {
   "name": "modelfusion",
   "description": "The TypeScript library for building AI applications.",
-  "version": "0.128.0",
+  "version": "0.129.0",
   "author": "Lars Grammel",
   "license": "MIT",
   "keywords": [
@@ -80,7 +80,7 @@
     "@vitest/ui": "1.1.0",
     "eslint": "^8.45.0",
     "eslint-config-prettier": "9.1.0",
-    "msw": "2.0.11",
+    "msw": "2.1.2",
     "type-fest": "4.9.0"
   }
 }