@promptbook/openai 0.72.0-9 → 0.73.0

package/README.md

@@ -2,7 +2,7 @@
 
 # ![Promptbook logo - cube with letters P and B](./other/design/logo-h1.png) Promptbook
 
-Supercharge your use of large language models
+Build responsible, controlled and transparent applications on top of LLM models!
 
 
 
@@ -18,12 +18,10 @@ Supercharge your use of large language models
 
 ## ✨ New Features
 
+-   💙 Working on [the **Book** language v1](https://github.com/webgptorg/book)
+-   📚 Support of `.docx`, `.doc` and `.pdf` documents
 -   ✨ **Support of [OpenAI o1 model](https://openai.com/o1/)**
 
-<blockquote style="color: #ff8811">
-<b>⚠ Warning:</b> This is a pre-release version of the library. It is not yet ready for production use. Please look at <a href="https://www.npmjs.com/package/@promptbook/core?activeTab=versions">latest stable release</a>.
-</blockquote>
-
 
 
 ## 📦 Package `@promptbook/openai`
@@ -64,10 +62,11 @@ const llm = new OpenAiExecutionTools(
         apiKey: process.env.OPENAI_API_KEY,
     },
 );
+const executables = await $provideExecutablesForNode();
 const tools = {
     llm,
     fs,
-    scrapers: await $provideScrapersForNode({ fs, llm }),
+    scrapers: await $provideScrapersForNode({ fs, llm, executables }),
     script: [new JavascriptExecutionTools()],
 };
 
@@ -96,8 +95,9 @@ console.info(outputParameters);
 
 ## 🤺 Usage with OpenAI`s Assistants (GPTs)
 
-!!!!!!
-OpenAiExecutionTools.createAssistantSubtools
+> TODO: Write a guide how to use OpenAI's Assistants with Promptbook
+
+
 
 ## 🧙‍♂️ Connect to LLM providers automatically
 
@@ -177,10 +177,11 @@ const llm = [
         },
     ),
 ];
+const executables = await $provideExecutablesForNode();
 const tools = {
     llm,
     fs,
-    scrapers: await $provideScrapersForNode({ fs, llm }),
+    scrapers: await $provideScrapersForNode({ fs, llm, executables }),
     script: [new JavascriptExecutionTools()],
 };
 
@@ -223,260 +224,48 @@ Rest of the documentation is common for **entire promptbook ecosystem**:
 
 ## 🤍 The Promptbook Whitepaper
 
+If you have a simple, single prompt for ChatGPT, GPT-4, Anthropic Claude, Google Gemini, Llama 3, or whatever, it doesn't matter how you integrate it. Whether it's calling a REST API directly, using the SDK, hardcoding the prompt into the source code, or importing a text file, the process remains the same.
 
-
-If you have a simple, single prompt for ChatGPT, GPT-4, Anthropic Claude, Google Gemini, Llama 2, or whatever, it doesn't matter how you integrate it. Whether it's calling a REST API directly, using the SDK, hardcoding the prompt into the source code, or importing a text file, the process remains the same.
-
-But often you will struggle with the limitations of LLMs, such as hallucinations, off-topic responses, poor quality output, language drift, word repetition repetition repetition repetition or misuse, lack of context, or just plain w𝒆𝐢rd responses. When this happens, you generally have three options:
+But often you will struggle with the **limitations of LLMs**, such as **hallucinations, off-topic responses, poor quality output, language and prompt drift, word repetition repetition repetition repetition or misuse, lack of context, or just plain w𝒆𝐢rd resp0nses**. When this happens, you generally have three options:
 
 1. **Fine-tune** the model to your specifications or even train your own.
 2. **Prompt-engineer** the prompt to the best shape you can achieve.
 3. Orchestrate **multiple prompts** in a [pipeline](https://github.com/webgptorg/promptbook/discussions/64) to get the best result.
 
-In all of these situations, but especially in 3., the Promptbook library can make your life easier.
+In all of these situations, but especially in 3., the **✨ Promptbook can make your life waaaaaaaaaay easier**.
 
--   [**Separates concerns**](https://github.com/webgptorg/promptbook/discussions/32) between prompt-engineer and programmer, between code files and prompt files, and between prompts and their execution logic.
--   Establishes a [**common format `.ptbk.md`**](https://github.com/webgptorg/promptbook/discussions/85) that can be used to describe your prompt business logic without having to write code or deal with the technicalities of LLMs.
--   **Forget** about **low-level details** like choosing the right model, tokens, context size, temperature, top-k, top-p, or kernel sampling. **Just write your intent** and [**persona**](https://github.com/webgptorg/promptbook/discussions/22) who should be responsible for the task and let the library do the rest.
--   Has built-in **orchestration** of [pipeline](https://github.com/webgptorg/promptbook/discussions/64) execution and many tools to make the process easier, more reliable, and more efficient, such as caching, [compilation+preparation](https://github.com/webgptorg/promptbook/discussions/78), [just-in-time fine-tuning](https://github.com/webgptorg/promptbook/discussions/33), [expectation-aware generation](https://github.com/webgptorg/promptbook/discussions/37), [agent adversary expectations](https://github.com/webgptorg/promptbook/discussions/39), and more.
+-   [**Separates concerns**](https://github.com/webgptorg/promptbook/discussions/32) between prompt-engineer and programmer, between code files and prompt files, and between prompts and their execution logic. For this purpose, it introduces a new language called [the **💙 Book**](https://github.com/webgptorg/book).
+-   Book allows you to **focus on the business** logic without having to write code or deal with the technicalities of LLMs.
+-   **Forget** about **low-level details** like choosing the right model, tokens, context size, `temperature`, `top-k`, `top-p`, or kernel sampling. **Just write your intent** and [**persona**](https://github.com/webgptorg/promptbook/discussions/22) who should be responsible for the task and let the library do the rest.
+-   We have built-in **orchestration** of [pipeline](https://github.com/webgptorg/promptbook/discussions/64) execution and many tools to make the process easier, more reliable, and more efficient, such as caching, [compilation+preparation](https://github.com/webgptorg/promptbook/discussions/78), [just-in-time fine-tuning](https://github.com/webgptorg/promptbook/discussions/33), [expectation-aware generation](https://github.com/webgptorg/promptbook/discussions/37), [agent adversary expectations](https://github.com/webgptorg/promptbook/discussions/39), and more.
 -   Sometimes even the best prompts with the best framework like Promptbook `:)` can't avoid the problems. In this case, the library has built-in **[anomaly detection](https://github.com/webgptorg/promptbook/discussions/40) and logging** to help you find and fix the problems.
--   Promptbook has built in versioning. You can test multiple **A/B versions** of pipelines and see which one works best.
--   Promptbook is designed to do [**RAG** (Retrieval-Augmented Generation)](https://github.com/webgptorg/promptbook/discussions/41) and other advanced techniques. You can use **knowledge** to improve the quality of the output.
-
-
-
-## 🧔 Pipeline _(for prompt-engeneers)_
-
-**P**romp**t** **b**oo**k** markdown file (or `.ptbk.md` file) is document that describes a **pipeline** - a series of prompts that are chained together to form somewhat reciepe for transforming natural language input.
-
--   Multiple pipelines forms a **collection** which will handle core **know-how of your LLM application**.
--   Theese pipelines are designed such as they **can be written by non-programmers**.
-
-
-
-### Sample:
-
-File `write-website-content.ptbk.md`:
-
-
-
-
-
-> # 🌍 Create website content
->
-> Instructions for creating web page content.
->
-> -   PIPELINE URL https://promptbook.studio/webgpt/write-website-content.ptbk.md
-> -   INPUT  PARAM `{rawTitle}` Automatically suggested a site name or empty text
-> -   INPUT  PARAM `{rawAssigment}` Automatically generated site entry from image recognition
-> -   OUTPUT PARAM `{websiteContent}` Web content
-> -   OUTPUT PARAM `{keywords}` Keywords
->
-> ## 👤 Specifying the assigment
->
-> What is your web about?
->
-> -   DIALOG TEMPLATE
->
-> ```
-> {rawAssigment}
-> ```
->
-> `-> {assigment}` Website assignment and specification
->
-> ## ✨ Improving the title
->
-> -   PERSONA Jane, Copywriter and Marketing Specialist.
->
-> ```
-> As an experienced marketing specialist, you have been entrusted with improving the name of your client's business.
->
-> A suggested name from a client:
-> "{rawTitle}"
->
-> Assignment from customer:
->
-> > {assigment}
->
-> ## Instructions:
->
-> -   Write only one name suggestion
-> -   The name will be used on the website, business cards, visuals, etc.
-> ```
->
-> `-> {enhancedTitle}` Enhanced title
->
-> ## 👤 Website title approval
->
-> Is the title for your website okay?
->
-> -   DIALOG TEMPLATE
->
-> ```
-> {enhancedTitle}
-> ```
->
-> `-> {title}` Title for the website
->
-> ## 🐰 Cunning subtitle
->
-> -   PERSONA Josh, a copywriter, tasked with creating a claim for the website.
->
-> ```
-> As an experienced copywriter, you have been entrusted with creating a claim for the "{title}" web page.
->
-> A website assignment from a customer:
->
-> > {assigment}
->
-> ## Instructions:
->
-> -   Write only one name suggestion
-> -   Claim will be used on website, business cards, visuals, etc.
-> -   Claim should be punchy, funny, original
-> ```
->
-> `-> {claim}` Claim for the web
->
-> ## 🚦 Keyword analysis
->
-> -   PERSONA Paul, extremely creative SEO specialist.
->
-> ```
-> As an experienced SEO specialist, you have been entrusted with creating keywords for the website "{title}".
->
-> Website assignment from the customer:
->
-> > {assigment}
->
-> ## Instructions:
->
-> -   Write a list of keywords
-> -   Keywords are in basic form
->
-> ## Example:
->
-> -   Ice cream
-> -   Olomouc
-> -   Quality
-> -   Family
-> -   Tradition
-> -   Italy
-> -   Craft
->
-> ```
->
-> `-> {keywords}` Keywords
->
-> ## 🔗 Combine the beginning
->
-> -   SIMPLE TEMPLATE
->
-> ```
->
-> # {title}
->
-> > {claim}
->
-> ```
->
-> `-> {contentBeginning}` Beginning of web content
->
-> ## 🖋 Write the content
->
-> -   PERSONA Jane
->
-> ```
-> As an experienced copywriter and web designer, you have been entrusted with creating text for a new website {title}.
->
-> A website assignment from a customer:
->
-> > {assigment}
->
-> ## Instructions:
->
-> -   Text formatting is in Markdown
-> -   Be concise and to the point
-> -   Use keywords, but they should be naturally in the text
-> -   This is the complete content of the page, so don't forget all the important information and elements the page should contain
-> -   Use headings, bullets, text formatting
->
-> ## Keywords:
->
-> {keywords}
->
-> ## Web Content:
->
-> {contentBeginning}
-> ```
->
-> `-> {contentBody}` Middle of the web content
->
-> ## 🔗 Combine the content
->
-> -   SIMPLE TEMPLATE
->
-> ```markdown
-> {contentBeginning}
->
-> {contentBody}
-> ```
->
-> `-> {websiteContent}`
-
-
-
-Following is the scheme how the promptbook above is executed:
-
-```mermaid
-%% 🔮 Tip: Open this on GitHub or in the VSCode website to see the Mermaid graph visually
-
-flowchart LR
-  subgraph "🌍 Create website content"
-
-      direction TB
-
-      input((Input)):::input
-      templateSpecifyingTheAssigment(👤 Specifying the assigment)
-      input--"{rawAssigment}"-->templateSpecifyingTheAssigment
-      templateImprovingTheTitle(✨ Improving the title)
-      input--"{rawTitle}"-->templateImprovingTheTitle
-      templateSpecifyingTheAssigment--"{assigment}"-->templateImprovingTheTitle
-      templateWebsiteTitleApproval(👤 Website title approval)
-      templateImprovingTheTitle--"{enhancedTitle}"-->templateWebsiteTitleApproval
-      templateCunningSubtitle(🐰 Cunning subtitle)
-      templateWebsiteTitleApproval--"{title}"-->templateCunningSubtitle
-      templateSpecifyingTheAssigment--"{assigment}"-->templateCunningSubtitle
-      templateKeywordAnalysis(🚦 Keyword analysis)
-      templateWebsiteTitleApproval--"{title}"-->templateKeywordAnalysis
-      templateSpecifyingTheAssigment--"{assigment}"-->templateKeywordAnalysis
-      templateCombineTheBeginning(🔗 Combine the beginning)
-      templateWebsiteTitleApproval--"{title}"-->templateCombineTheBeginning
-      templateCunningSubtitle--"{claim}"-->templateCombineTheBeginning
-      templateWriteTheContent(🖋 Write the content)
-      templateWebsiteTitleApproval--"{title}"-->templateWriteTheContent
-      templateSpecifyingTheAssigment--"{assigment}"-->templateWriteTheContent
-      templateKeywordAnalysis--"{keywords}"-->templateWriteTheContent
-      templateCombineTheBeginning--"{contentBeginning}"-->templateWriteTheContent
-      templateCombineTheContent(🔗 Combine the content)
-      templateCombineTheBeginning--"{contentBeginning}"-->templateCombineTheContent
-      templateWriteTheContent--"{contentBody}"-->templateCombineTheContent
-
-      templateCombineTheContent--"{websiteContent}"-->output
-      output((Output)):::output
-
-      classDef input color: grey;
-      classDef output color: grey;
-
-  end;
-```
+-   Versioning is build in. You can test multiple **A/B versions** of pipelines and see which one works best.
+-   Promptbook is designed to use [**RAG** (Retrieval-Augmented Generation)](https://github.com/webgptorg/promptbook/discussions/41) and other advanced techniques to bring the context of your business to generic LLM. You can use **knowledge** to improve the quality of the output.
+
+
+
+## 💙 Book language _(for prompt-engineer)_
 
--   [More template samples](./samples/pipelines/)
--   [Read more about `.ptbk.md` file format here](https://github.com/webgptorg/promptbook/discussions/categories/concepts?discussions_q=is%3Aopen+label%3A.ptbk.md+category%3AConcepts)
+Promptbook [pipelines](https://github.com/webgptorg/promptbook/discussions/64) are written in markdown-like language called [Book](https://github.com/webgptorg/book). It is designed to be understandable by non-programmers and non-technical people.
 
-_Note: We are using [postprocessing functions](#postprocessing-functions) like `unwrapResult` that can be used to postprocess the result._
 
-## 📦 Packages
+
+```markdown
+# 🌟 My first Book
+
+-   PERSONA Jane, marketing specialist with prior experience in writing articles about technology and artificial intelligence
+-   KNOWLEDGE https://ptbk.io
+-   KNOWLEDGE ./promptbook.pdf
+-   EXPECT MIN 1 Sentence
+-   EXPECT MAX 1 Paragraph
+
+> Write an article about the future of artificial intelligence in the next 10 years and how metalanguages will change the way AI is used in the world.
+> Look specifically at the impact of Promptbook on the AI industry.
+
+-> {article}
+```
+
+## 📦 Packages _(for developers)_
 
 This library is divided into several packages, all are published from [single monorepo](https://github.com/webgptorg/promptbook).
 You can install all of them at once:
@@ -518,8 +307,6 @@ Or you can install them separately:
 
 The following glossary is used to clarify certain concepts:
 
-
-
 ### Core concepts
 
 -   [📚 Collection of pipelines](https://github.com/webgptorg/promptbook/discussions/65)
@@ -550,8 +337,8 @@ The following glossary is used to clarify certain concepts:
 
 ## 🔌 Usage in Typescript / Javascript
 
--   [Simple usage](./samples/usage/simple-script)
--   [Usage with client and remote server](./samples/usage/remote)
+-   [Simple usage](./examples/usage/simple-script)
+-   [Usage with client and remote server](./examples/usage/remote)
 
 ## ➕➖ When to use Promptbook?
 

package/esm/index.es.js

@@ -6,7 +6,7 @@ import OpenAI from 'openai';
 /**
  * The version of the Promptbook library
  */
-var PROMPTBOOK_VERSION = '0.72.0-8';
+var PROMPTBOOK_VERSION = '0.72.0';
 // TODO: [main] !!!! List here all the versions and annotate + put into script
 
 /*! *****************************************************************************
@@ -455,10 +455,10 @@ $asDeeplyFrozenSerializableJson('RESERVED_PARAMETER_NAMES', [
     'content',
     'context',
     'knowledge',
-    'samples',
+    'examples',
     'modelName',
     'currentDate',
-    // <- TODO: !!!!! list here all command names
+    // <- TODO: list here all command names
     // <- TODO: Add more like 'date', 'modelName',...
     // <- TODO: Add [emoji] + instructions ACRY when adding new reserved parameter
 ]);
@@ -1413,7 +1413,6 @@ var OpenAiExecutionTools = /** @class */ (function () {
      * @param options which are relevant are directly passed to the OpenAI client
      */
     function OpenAiExecutionTools(options) {
-        if (options === void 0) { options = {}; }
         this.options = options;
         /**
          * OpenAI API client.
@@ -1441,8 +1440,8 @@ var OpenAiExecutionTools = /** @class */ (function () {
                 if (this.client === null) {
                     openAiOptions = __assign({}, this.options);
                     delete openAiOptions.isVerbose;
-                    delete openAiOptions.user;
-                    this.client = new OpenAI(__assign({}, openAiOptions));
+                    delete openAiOptions.userId;
+                    this.client = new OpenAI(openAiOptions);
                 }
                 return [2 /*return*/, this.client];
             });
@@ -1489,11 +1488,12 @@ var OpenAiExecutionTools = /** @class */ (function () {
      * Calls OpenAI API to use a chat model.
      */
     OpenAiExecutionTools.prototype.callChatModel = function (prompt) {
+        var _a;
         return __awaiter(this, void 0, void 0, function () {
             var content, parameters, modelRequirements, format, client, modelName, modelSettings, rawPromptContent, rawRequest, start, complete, rawResponse, resultContent, usage;
             var _this = this;
-            return __generator(this, function (_a) {
-                switch (_a.label) {
+            return __generator(this, function (_b) {
+                switch (_b.label) {
                     case 0:
                         if (this.options.isVerbose) {
                             console.info('💬 OpenAI callChatModel call', { prompt: prompt });
@@ -1501,7 +1501,7 @@ var OpenAiExecutionTools = /** @class */ (function () {
                         content = prompt.content, parameters = prompt.parameters, modelRequirements = prompt.modelRequirements, format = prompt.format;
                         return [4 /*yield*/, this.getClient()];
                     case 1:
-                        client = _a.sent();
+                        client = _b.sent();
                         // TODO: [☂] Use here more modelRequirements
                         if (modelRequirements.modelVariant !== 'CHAT') {
                             throw new PipelineExecutionError('Use callChatModel only for CHAT variant');
@@ -1533,7 +1533,7 @@ var OpenAiExecutionTools = /** @class */ (function () {
                                     role: 'user',
                                     content: rawPromptContent,
                                 },
-                            ], false), user: this.options.user });
+                            ], false), user: (_a = this.options.userId) === null || _a === void 0 ? void 0 : _a.toString() });
                         start = getCurrentIsoDate();
                         if (this.options.isVerbose) {
                             console.info(colors.bgWhite('rawRequest'), JSON.stringify(rawRequest, null, 4));
@@ -1545,7 +1545,7 @@ var OpenAiExecutionTools = /** @class */ (function () {
                                 throw error;
                             })];
                     case 2:
-                        rawResponse = _a.sent();
+                        rawResponse = _b.sent();
                         if (this.options.isVerbose) {
                             console.info(colors.bgWhite('rawResponse'), JSON.stringify(rawResponse, null, 4));
                         }
@@ -1584,11 +1584,12 @@ var OpenAiExecutionTools = /** @class */ (function () {
      * Calls OpenAI API to use a complete model.
      */
     OpenAiExecutionTools.prototype.callCompletionModel = function (prompt) {
+        var _a;
         return __awaiter(this, void 0, void 0, function () {
             var content, parameters, modelRequirements, client, modelName, modelSettings, rawPromptContent, rawRequest, start, complete, rawResponse, resultContent, usage;
             var _this = this;
-            return __generator(this, function (_a) {
-                switch (_a.label) {
+            return __generator(this, function (_b) {
+                switch (_b.label) {
                     case 0:
                         if (this.options.isVerbose) {
                             console.info('🖋 OpenAI callCompletionModel call', { prompt: prompt });
@@ -1596,7 +1597,7 @@ var OpenAiExecutionTools = /** @class */ (function () {
                         content = prompt.content, parameters = prompt.parameters, modelRequirements = prompt.modelRequirements;
                         return [4 /*yield*/, this.getClient()];
                     case 1:
-                        client = _a.sent();
+                        client = _b.sent();
                         // TODO: [☂] Use here more modelRequirements
                         if (modelRequirements.modelVariant !== 'COMPLETION') {
                             throw new PipelineExecutionError('Use callCompletionModel only for COMPLETION variant');
@@ -1611,7 +1612,7 @@ var OpenAiExecutionTools = /** @class */ (function () {
                             // <- Note: [🧆]
                         };
                         rawPromptContent = replaceParameters(content, __assign(__assign({}, parameters), { modelName: modelName }));
-                        rawRequest = __assign(__assign({}, modelSettings), { prompt: rawPromptContent, user: this.options.user });
+                        rawRequest = __assign(__assign({}, modelSettings), { prompt: rawPromptContent, user: (_a = this.options.userId) === null || _a === void 0 ? void 0 : _a.toString() });
                         start = getCurrentIsoDate();
                         if (this.options.isVerbose) {
                             console.info(colors.bgWhite('rawRequest'), JSON.stringify(rawRequest, null, 4));
@@ -1623,7 +1624,7 @@ var OpenAiExecutionTools = /** @class */ (function () {
                                 throw error;
                             })];
                     case 2:
-                        rawResponse = _a.sent();
+                        rawResponse = _b.sent();
                         if (this.options.isVerbose) {
                             console.info(colors.bgWhite('rawResponse'), JSON.stringify(rawResponse, null, 4));
                         }
@@ -1849,17 +1850,16 @@ var OpenAiAssistantExecutionTools = /** @class */ (function (_super) {
                             assistant_id: this.assistantId,
                             thread: {
                                 messages: [
-                                    // TODO: !!!!!! Allow threads to be passed
+                                    // TODO:  [🗯] !! Allow threads to be passed
                                     { role: 'user', content: rawPromptContent },
                                 ],
                             },
-                            // !!!!!! user: this.options.user,
+                            // <- TODO: Add user identification here> user: this.options.user,
                         };
                         start = getCurrentIsoDate();
                         if (this.options.isVerbose) {
                             console.info(colors.bgWhite('rawRequest'), JSON.stringify(rawRequest, null, 4));
                         }
-                        console.log('!!!!!! OpenAI client', client);
                         return [4 /*yield*/, client.beta.threads.createAndRunStream(rawRequest)];
                     case 2:
                         stream = _g.sent();
@@ -1877,7 +1877,7 @@ var OpenAiAssistantExecutionTools = /** @class */ (function (_super) {
                                 messageDelta.content[0].type === 'text') {
                                 console.info('messageDelta', (_a = messageDelta.content[0].text) === null || _a === void 0 ? void 0 : _a.value);
                             }
-                            // TODO: !!!!!! report progress
+                            // <- TODO: [🐚] Make streaming and running tasks working
                         });
                         stream.on('messageCreated', function (message) {
                             if (_this.options.isVerbose) {
@@ -1905,18 +1905,20 @@ var OpenAiAssistantExecutionTools = /** @class */ (function (_super) {
                             throw new PipelineExecutionError("There is NOT 'text' BUT ".concat((_b = rawResponse[0].content[0]) === null || _b === void 0 ? void 0 : _b.type, " finalMessages content type from OpenAI"));
                         }
                         resultContent = (_c = rawResponse[0].content[0]) === null || _c === void 0 ? void 0 : _c.text.value;
-                        //                                                     <- TODO: !!!!!! There are also annotations, maybe use them
+                        //                                                     <- TODO: [🧠] There are also annotations, maybe use them
                         // eslint-disable-next-line prefer-const
                         complete = getCurrentIsoDate();
                         usage = UNCERTAIN_USAGE;
-                        // TODO: !!!!!!> = computeOpenAiUsage(content, resultContent || '', rawResponse);
+                        // <- TODO: [🥘] Compute real usage for assistant
+                        //       ?> const usage = computeOpenAiUsage(content, resultContent || '', rawResponse);
                         if (resultContent === null) {
                             throw new PipelineExecutionError('No response message from OpenAI');
                         }
                         return [2 /*return*/, $asDeeplyFrozenSerializableJson('OpenAiAssistantExecutionTools ChatPromptResult', {
                                 content: resultContent,
                                 modelName: 'assistant',
-                                //          <- TODO: !!!!!! Can we detect really used model: rawResponse.model || modelName,
+                                // <- TODO: [🥘] Detect used model in assistant
+                                //       ?> model: rawResponse.model || modelName,
                                 timing: {
                                     start: start,
                                     complete: complete,
@@ -1934,7 +1936,6 @@ var OpenAiAssistantExecutionTools = /** @class */ (function (_super) {
     return OpenAiAssistantExecutionTools;
 }(OpenAiExecutionTools));
 /**
- * TODO: !!!!!! DO not use colors - can be used in browser
  * TODO: [🧠][🧙‍♂️] Maybe there can be some wizzard for thoose who want to use just OpenAI
  * TODO: Maybe make custom OpenAiError
  * TODO: [🧠][🈁] Maybe use `isDeterministic` from options
@@ -2092,7 +2093,7 @@ var $Register = /** @class */ (function () {
         this.storage = globalScope[storageName];
     }
     $Register.prototype.list = function () {
-        // <- TODO: ReadonlyDeep<Array<TRegistered>>
+        // <- TODO: ReadonlyDeep<ReadonlyArray<TRegistered>>
         return this.storage;
     };
     $Register.prototype.register = function (registered) {