@promptbook/node 0.63.0-8 → 0.63.0

package/README.md

@@ -76,12 +76,23 @@ In any of these situations, but especially in (3), the Promptbook library can ma
 
 
 
+## 🧔 Promptbook _(for prompt-engeneers)_
+
+**P**romp**t** **b**oo**k** markdown file (or `.ptbk.md` file) is document that describes a **pipeline** - a series of prompts that are chained together to form somewhat reciepe for transforming natural language input.
+
+-   Multiple pipelines forms a **collection** which will handle core **know-how of your LLM application**.
+-   Theese pipelines are designed such as they **can be written by non-programmers**.
+
+
+
 ### Sample:
 
 File `write-website-content.ptbk.md`:
 
 
 
+
+
 > # 🌍 Create website content
 >
 > Instructions for creating web page content.
@@ -298,7 +309,8 @@ flowchart LR
   end;
 ```
 
-[More template samples](./samples/templates/)
+-   [More template samples](./samples/templates/)
+-   [Read more about `.ptbk.md` file format here](https://github.com/webgptorg/promptbook/discussions/categories/concepts?discussions_q=is%3Aopen+label%3A.ptbk.md+category%3AConcepts)
 
 _Note: We are using [postprocessing functions](#postprocessing-functions) like `unwrapResult` that can be used to postprocess the result._
 
@@ -315,7 +327,6 @@ Or you can install them separately:
 
 > ⭐ Marked packages are worth to try first
 
-
 -   ⭐ **[ptbk](https://www.npmjs.com/package/ptbk)** - Bundle of all packages, when you want to install everything and you don't care about the size
 -   **[promptbook](https://www.npmjs.com/package/promptbook)** - Same as `ptbk`
 -   **[@promptbook/core](https://www.npmjs.com/package/@promptbook/core)** - Core of the library, it contains the main logic for promptbooks
@@ -339,263 +350,39 @@ Or you can install them separately:
 
 ## 📚 Dictionary
 
-The following glossary is used to clarify certain basic concepts:
-
-### Prompt
-
-Prompt in a text along with model requirements, but without any execution or templating logic.
-
-For example:
-
-```json
-{
-    "request": "Which sound does a cat make?",
-    "modelRequirements": {
-        "variant": "CHAT"
-    }
-}
-```
-
-```json
-{
-    "request": "I am a cat.\nI like to eat fish.\nI like to sleep.\nI like to play with a ball.\nI l",
-    "modelRequirements": {
-        "variant": "COMPLETION"
-    }
-}
-```
-
-### Prompt Template
-
-Similar concept to Prompt, but with templating logic.
-
-For example:
-
-```json
-{
-    "request": "Which sound does a {animalName} make?",
-    "modelRequirements": {
-        "variant": "CHAT"
-    }
-}
-```
-
-### Model Requirements
-
-Abstract way to specify the LLM.
-It does not specify the LLM with concrete version itself, only the requirements for the LLM.
-_NOT chatgpt-3.5-turbo BUT CHAT variant of GPT-3.5._
-
-For example:
-
-```json
-{
-    "variant": "CHAT",
-    "version": "GPT-3.5",
-    "temperature": 0.7
-}
-```
-
-### Block type
-
-Each block of promptbook can have a different execution type.
-It is specified in list of requirements for the block.
-By default, it is `Prompt template`
-
--   _(default)_ `Prompt template` The block is a prompt template and is executed by LLM (OpenAI, Azure,...)
--   `SIMPLE TEMPLATE` The block is a simple text template which is just filled with parameters
--   `Script` The block is a script that is executed by some script runtime, the runtime is determined by block type, currently only `javascript` is supported but we plan to add `python` and `typescript` in the future.
--   `PROMPT DIALOG` Ask user for input
-
-### Parameters
-
-Parameters that are placed in the prompt template and replaced to create the prompt.
-It is a simple key-value object.
-
-```json
-{
-    "animalName": "cat",
-    "animalSound": "Meow!"
-}
-```
-
-There are three types of template parameters, depending on how they are used in the promptbook:
-
--   **INPUT PARAMETER**s are required to execute the promptbook.
--   **Intermediate parameters** are used internally in the promptbook.
--   **OUTPUT PARAMETER**s are explicitelly marked and they are returned as the result of the promptbook execution.
-
-_Note: Parameter can be both intermedite and output at the same time._
-
-### Promptbook
-
-Promptbook is **core concept of this library**.
-It represents a series of prompt templates chained together to form a **pipeline** / one big prompt template with input and result parameters.
-
-Internally it can have multiple formats:
-
--   **.ptbk.md file** in custom markdown format described above
--   _(concept)_ **.ptbk** format, custom fileextension based on markdown
--   _(internal)_ **JSON** format, parsed from the .ptbk.md file
-
-### Promptbook **Library**
-
-Library of all promptbooks used in your application.
-Each promptbook is a separate `.ptbk.md` file with unique `PIPELINE URL`. Theese urls are used to reference promptbooks in other promptbooks or in the application code.
-
-### Prompt Result
-
-Prompt result is the simplest concept of execution.
-It is the result of executing one prompt _(NOT a template)_.
-
-For example:
-
-```json
-{
-    "response": "Meow!",
-    "model": "chatgpt-3.5-turbo"
-}
-```
-
-### Execution Tools
-
-
-
-`ExecutionTools` is an interface which contains all the tools needed to execute prompts.
-It contais 3 subtools:
-
--   `LlmExecutionTools`
--   `ScriptExecutionTools`
--   `UserInterfaceTools`
-
-Which are described below:
+The following glossary is used to clarify certain concepts:
 
-#### LLM Execution Tools
 
-`LlmExecutionTools` is a container for all the tools needed to execute prompts to large language models like GPT-4.
-On its interface it exposes common methods for prompt execution.
-Internally it calls OpenAI, Azure, GPU, proxy, cache, logging,...
 
-`LlmExecutionTools` an abstract interface that is implemented by concrete execution tools:
+### Core concepts
 
--   `OpenAiExecutionTools`
--   `AnthropicClaudeExecutionTools`
--   `AzureOpenAiExecutionTools`
--   `LangtailExecutionTools`
--   _(Not implemented yet)_ `BardExecutionTools`
--   _(Not implemented yet)_ `LamaExecutionTools`
--   _(Not implemented yet)_ `GpuExecutionTools`
--   Special case are `RemoteLlmExecutionTools` that connect to a remote server and run one of the above execution tools on that server.
--   Another special case is `MockedEchoLlmExecutionTools` that is used for testing and mocking.
--   The another special case is `LogLlmExecutionToolsWrapper` that is technically also an execution tools but it is more proxy wrapper around other execution tools that logs all calls to execution tools.
+-   [📚 Collection of pipelines](https://github.com/webgptorg/promptbook/discussions/65)
+-   [📯 Pipeline](https://github.com/webgptorg/promptbook/discussions/64)
+-   [🎺 Pipeline templates](https://github.com/webgptorg/promptbook/discussions/88)
+-   [🤼 Personas](https://github.com/webgptorg/promptbook/discussions/22)
+-   [⭕ Parameters](https://github.com/webgptorg/promptbook/discussions/83)
+-   [🚀 Pipeline execution](https://github.com/webgptorg/promptbook/discussions/84)
+-   [🧪 Expectations](https://github.com/webgptorg/promptbook/discussions/30)
+-   [✂️ Postprocessing](https://github.com/webgptorg/promptbook/discussions/31)
+-   [🔣 Words not tokens](https://github.com/webgptorg/promptbook/discussions/29)
+-   [☯ Separation of concerns](https://github.com/webgptorg/promptbook/discussions/32)
 
-#### Script Execution Tools
+### Advanced concepts
 
-`ScriptExecutionTools` is an abstract container that represents all the tools needed to EXECUTE SCRIPTs. It is implemented by concrete execution tools:
+-   [📚 Knowledge (Retrieval-augmented generation)](https://github.com/webgptorg/promptbook/discussions/41)
+-   [🌏 Remote server](https://github.com/webgptorg/promptbook/discussions/89)
+-   [🃏 Jokers (conditions)](https://github.com/webgptorg/promptbook/discussions/66)
+-   [🔳 Metaprompting](https://github.com/webgptorg/promptbook/discussions/35)
+-   [🌏 Linguistically typed languages](https://github.com/webgptorg/promptbook/discussions/53)
+-   [🌍 Auto-Translations](https://github.com/webgptorg/promptbook/discussions/42)
+-   [📽 Images, audio, video, spreadsheets](https://github.com/webgptorg/promptbook/discussions/54)
+-   [🔙 Expectation-aware generation](https://github.com/webgptorg/promptbook/discussions/37)
+-   [⏳ Just-in-time fine-tuning](https://github.com/webgptorg/promptbook/discussions/33)
+-   [🔴 Anomaly detection](https://github.com/webgptorg/promptbook/discussions/40)
+-   [👮 Agent adversary expectations](https://github.com/webgptorg/promptbook/discussions/39)
+-   [view more](https://github.com/webgptorg/promptbook/discussions/categories/concepts)
 
--   `JavascriptExecutionTools` is a wrapper around `vm2` module that executes javascript code in a sandbox.
--   `JavascriptEvalExecutionTools` is wrapper around `eval` function that executes javascript. It is used for testing and mocking **NOT intended to use in the production** due to its unsafe nature, use `JavascriptExecutionTools` instead.
--   _(Not implemented yet)_ `TypescriptExecutionTools` executes typescript code in a sandbox.
--   _(Not implemented yet)_ `PythonExecutionTools` executes python code in a sandbox.
-
-There are [postprocessing functions](#postprocessing-functions) that can be used to postprocess the result.
-
-#### User Interface Tools
-
-`UserInterfaceTools` is an abstract container that represents all the tools needed to interact with the user. It is implemented by concrete execution tools:
-
--   _(Not implemented yet)_ `ConsoleInterfaceTools` is a wrapper around `readline` module that interacts with the user via console.
--   `SimplePromptInterfaceTools` is a wrapper around `window.prompt` synchronous function that interacts with the user via browser prompt. It is used for testing and mocking **NOT intended to use in the production** due to its synchronous nature.
--   `CallbackInterfaceTools` delagates the user interaction to a async callback function. You need to provide your own implementation of this callback function and its bind to UI. 
-
-### Executor
-
-Executor is a simple async function that takes **input parameters** and returns **output parameters**.
-It is constructed by combining execution tools and promptbook to execute together.
-
-### 🃏 Jokers (conditions)
-
-Joker is a previously defined parameter that is used to bypass some parts of the pipeline.
-If the joker is present in the template, it is checked to see if it meets the requirements (without postprocessing), and if so, it is used instead of executing that prompt template. There can be multiple wildcards in a prompt template, if so they are checked in order and the first one that meets the requirements is used.
-
-If none of the jokers meet the requirements, the prompt template is executed as usual.
-
-This can be useful, for example, if you want to use some predefined data, or if you want to use some data from the user, but you are not sure if it is suitable form.
-
-When using wildcards, you must have at least one minimum expectation. If you do not have a minimum expectation, the joker will always fulfil the expectation because it has none, so it makes no logical sense.
-
-Look at [jokers.ptbk.md](samples/templates/41-jokers.ptbk.md) sample.
-
-### Postprocessing functions
-
-You can define postprocessing functions when creating `JavascriptEvalExecutionTools`:
-
-```
-
-```
-
-Additionally there are some usefull string-manipulation build-in functions, which are [listed here](src/scripting/javascript/JavascriptEvalExecutionTools.ts).
-
-### Expectations
-
-`Expect` command describes the desired output of the prompt template (after post-processing)
-It can set limits for the maximum/minimum length of the output, measured in characters, words, sentences, paragraphs,...
-
-_Note: LLMs work with tokens, not characters, but in Promptbooks we want to use some human-recognisable and cross-model interoperable units._
-
-```markdown
-# ✨ Sample: Expectations
-
--   INPUT  PARAMETER {yourName} Name of the hero
-
-## 💬 Question
-
--   EXPECT MAX 30 CHARACTERS
--   EXPECT MIN 2 CHARACTERS
--   EXPECT MAX 3 WORDS
--   EXPECT EXACTLY 1 SENTENCE
--   EXPECT EXACTLY 1 LINE
-
-...
-```
-
-There are two types of expectations which are not strictly symmetrical:
-
-#### Minimal expectations
-
--   `EXPECT MIN 0 ...` is not valid minimal expectation. It makes no sense.
--   `EXPECT JSON` is both minimal and maximal expectation
--   When you are using `JOKER` in same prompt template, you need to have at least one minimal expectation
-
-#### Maximal expectations
-
--   `EXPECT MAX 0 ...` is valid maximal expectation. For example, you can expect 0 pages and 2 sentences.
--   `EXPECT JSON` is both minimal and maximal expectation
-
-Look at [expectations.ptbk.md](samples/templates/45-expectations.ptbk.md) and [expect-json.ptbk.md](samples/templates/45-expect-json.ptbk.md) samples for more.
-
-### Execution report
-
-Execution report is a simple object or markdown that contains information about the execution of the pipeline.
-
-[See the example of such a report](/samples/templates/50-advanced.report.md)
-
-
-
-
-
-### Remote server
-
-Remote server is a proxy server that uses its execution tools internally and exposes the executor interface externally.
-
-You can simply use `RemoteExecutionTools` on client-side javascript and connect to your remote server.
-This is useful to make all logic on browser side but not expose your API keys or no need to use customer's GPU.
-
-## 👨‍💻 Usage and integration _(for developers)_
-
-
-
-### 🔌 Usage in Typescript / Javascript
+## 🔌 Usage in Typescript / Javascript
 
 -   [Simple usage](./samples/usage/simple-script)
 -   [Usage with client and remote server](./samples/usage/remote)
@@ -618,14 +405,19 @@ This is useful to make all logic on browser side but not expose your API keys or
 
 ## 🐜 Known issues
 
-
+-   [🤸‍♂️ Iterations not working yet](https://github.com/webgptorg/promptbook/discussions/55)
+-   [⤵️ Imports not working yet](https://github.com/webgptorg/promptbook/discussions/34)
 
 ## 🧼 Intentionally not implemented features
 
 
+-   [➿ No recursion](https://github.com/webgptorg/promptbook/discussions/38)
+-   [🏳 There are no types, just strings](https://github.com/webgptorg/promptbook/discussions/52)
 
 ## ❔ FAQ
 
+
+
 If you have a question [start a discussion](https://github.com/webgptorg/promptbook/discussions/), [open an issue](https://github.com/webgptorg/promptbook/issues) or [write me an email](https://www.pavolhejny.com/contact).
 
 ### Why not just use the OpenAI SDK / Anthropic Claude SDK / ...?

package/esm/index.es.js

@@ -15,7 +15,7 @@ import sha256 from 'crypto-js/sha256';
 /**
  * The version of the Promptbook library
  */
-var PROMPTBOOK_VERSION = '0.63.0-7';
+var PROMPTBOOK_VERSION = '0.63.0-10';
 // TODO: !!!! List here all the versions and annotate + put into script
 
 /*! *****************************************************************************
@@ -365,7 +365,7 @@ function pipelineJsonToString(pipelineJson) {
             var contentLanguage = 'text';
             if (blockType === 'PROMPT_TEMPLATE') {
                 var modelRequirements = promptTemplate.modelRequirements;
-                var modelName = modelRequirements.modelName, modelVariant = modelRequirements.modelVariant;
+                var _l = modelRequirements || {}, modelName = _l.modelName, modelVariant = _l.modelVariant;
                 commands_1.push("EXECUTE PROMPT TEMPLATE");
                 if (modelVariant) {
                     commands_1.push("MODEL VARIANT ".concat(capitalize(modelVariant)));
@@ -423,8 +423,8 @@ function pipelineJsonToString(pipelineJson) {
             } /* not else */
             if (expectations) {
                 try {
-                    for (var _l = (e_6 = void 0, __values(Object.entries(expectations))), _m = _l.next(); !_m.done; _m = _l.next()) {
-                        var _o = __read(_m.value, 2), unit = _o[0], _p = _o[1], min = _p.min, max = _p.max;
+                    for (var _m = (e_6 = void 0, __values(Object.entries(expectations))), _o = _m.next(); !_o.done; _o = _m.next()) {
+                        var _p = __read(_o.value, 2), unit = _p[0], _q = _p[1], min = _q.min, max = _q.max;
                         if (min === max) {
                             commands_1.push("EXPECT EXACTLY ".concat(min, " ").concat(capitalize(unit + (min > 1 ? 's' : ''))));
                         }
@@ -441,7 +441,7 @@ function pipelineJsonToString(pipelineJson) {
                 catch (e_6_1) { e_6 = { error: e_6_1 }; }
                 finally {
                     try {
-                        if (_m && !_m.done && (_f = _l.return)) _f.call(_l);
+                        if (_o && !_o.done && (_f = _m.return)) _f.call(_m);
                     }
                     finally { if (e_6) throw e_6.error; }
                 }
@@ -690,7 +690,7 @@ function forEachAsync(array, options, callbackfunction) {
     });
 }
 
-var PipelineCollection = [{title:"Prepare Knowledge from Markdown",pipelineUrl:"https://promptbook.studio/promptbook/prepare-knowledge-from-markdown.ptbk.md",promptbookVersion:"0.63.0-7",parameters:[{name:"knowledgeContent",description:"Markdown document content",isInput:true,isOutput:false},{name:"knowledgePieces",description:"The knowledge JSON object",isInput:false,isOutput:true}],promptTemplates:[{blockType:"PROMPT_TEMPLATE",name:"knowledge",title:"Knowledge",modelRequirements:{modelVariant:"CHAT",modelName:"claude-3-opus-20240229"},content:"You are experienced data researcher, extract the important knowledge from the document.\n\n# Rules\n\n-   Make pieces of information concise, clear, and easy to understand\n-   One piece of information should be approximately 1 paragraph\n-   Divide the paragraphs by markdown horizontal lines ---\n-   Omit irrelevant information\n-   Group redundant information\n-   Write just extracted information, nothing else\n\n# The document\n\nTake information from this document:\n\n> {knowledgeContent}",dependentParameterNames:["knowledgeContent"],resultingParameterName:"knowledgePieces"}],knowledgeSources:[],knowledgePieces:[],personas:[],preparations:[{id:1,promptbookVersion:"0.63.0-7",usage:{price:{value:0},input:{tokensCount:{value:0},charactersCount:{value:0},wordsCount:{value:0},sentencesCount:{value:0},linesCount:{value:0},paragraphsCount:{value:0},pagesCount:{value:0}},output:{tokensCount:{value:0},charactersCount:{value:0},wordsCount:{value:0},sentencesCount:{value:0},linesCount:{value:0},paragraphsCount:{value:0},pagesCount:{value:0}}}}],sourceFile:"./promptbook-collection/prepare-knowledge-from-markdown.ptbk.md"},{title:"Prepare Keywords",pipelineUrl:"https://promptbook.studio/promptbook/prepare-knowledge-keywords.ptbk.md",promptbookVersion:"0.63.0-7",parameters:[{name:"knowledgePieceContent",description:"The content",isInput:true,isOutput:false},{name:"keywords",description:"Keywords separated by comma",isInput:false,isOutput:true}],promptTemplates:[{blockType:"PROMPT_TEMPLATE",name:"knowledge",title:"Knowledge",modelRequirements:{modelVariant:"CHAT",modelName:"claude-3-opus-20240229"},content:"You are experienced data researcher, detect the important keywords in the document.\n\n# Rules\n\n-   Write just keywords separated by comma\n\n# The document\n\nTake information from this document:\n\n> {knowledgePieceContent}",dependentParameterNames:["knowledgePieceContent"],resultingParameterName:"keywords"}],knowledgeSources:[],knowledgePieces:[],personas:[],preparations:[{id:1,promptbookVersion:"0.63.0-7",usage:{price:{value:0},input:{tokensCount:{value:0},charactersCount:{value:0},wordsCount:{value:0},sentencesCount:{value:0},linesCount:{value:0},paragraphsCount:{value:0},pagesCount:{value:0}},output:{tokensCount:{value:0},charactersCount:{value:0},wordsCount:{value:0},sentencesCount:{value:0},linesCount:{value:0},paragraphsCount:{value:0},pagesCount:{value:0}}}}],sourceFile:"./promptbook-collection/prepare-knowledge-keywords.ptbk.md"},{title:"Prepare Title",pipelineUrl:"https://promptbook.studio/promptbook/prepare-knowledge-title.ptbk.md",promptbookVersion:"0.63.0-7",parameters:[{name:"knowledgePieceContent",description:"The content",isInput:true,isOutput:false},{name:"title",description:"The title of the document",isInput:false,isOutput:true}],promptTemplates:[{blockType:"PROMPT_TEMPLATE",name:"knowledge",title:"Knowledge",modelRequirements:{modelVariant:"CHAT",modelName:"claude-3-opus-20240229"},content:"You are experienced content creator, write best title for the document.\n\n# Rules\n\n-   Write just title, nothing else\n-   Title should be concise and clear\n-   Write maximum 5 words for the title\n\n# The document\n\n> {knowledgePieceContent}",expectations:{words:{min:1,max:8}},dependentParameterNames:["knowledgePieceContent"],resultingParameterName:"title"}],knowledgeSources:[],knowledgePieces:[],personas:[],preparations:[{id:1,promptbookVersion:"0.63.0-7",usage:{price:{value:0},input:{tokensCount:{value:0},charactersCount:{value:0},wordsCount:{value:0},sentencesCount:{value:0},linesCount:{value:0},paragraphsCount:{value:0},pagesCount:{value:0}},output:{tokensCount:{value:0},charactersCount:{value:0},wordsCount:{value:0},sentencesCount:{value:0},linesCount:{value:0},paragraphsCount:{value:0},pagesCount:{value:0}}}}],sourceFile:"./promptbook-collection/prepare-knowledge-title.ptbk.md"},{title:"Prepare Keywords",pipelineUrl:"https://promptbook.studio/promptbook/prepare-persona.ptbk.md",promptbookVersion:"0.63.0-7",parameters:[{name:"availableModelNames",description:"List of available model names separated by comma (,)",isInput:true,isOutput:false},{name:"personaDescription",description:"Description of the persona",isInput:true,isOutput:false},{name:"modelRequirements",description:"Specific requirements for the model",isInput:false,isOutput:true}],promptTemplates:[{blockType:"PROMPT_TEMPLATE",name:"make-model-requirements",title:"Make modelRequirements",modelRequirements:{modelVariant:"CHAT",modelName:"gpt-4-turbo"},content:"You are experienced AI engineer, you need to create virtual assistant.\nWrite\n\n## Sample\n\n```json\n{\n\"modelName\": \"gpt-4o\",\n\"systemMessage\": \"You are experienced AI engineer and helpfull assistant.\",\n\"temperature\": 0.7\n}\n```\n\n## Instructions\n\n### Option `modelName`\n\nPick from the following models:\n\n-   {availableModelNames}\n\n### Option `systemMessage`\n\nThe system message is used to communicate instructions or provide context to the model at the beginning of a conversation. It is displayed in a different format compared to user messages, helping the model understand its role in the conversation. The system message typically guides the model's behavior, sets the tone, or specifies desired output from the model. By utilizing the system message effectively, users can steer the model towards generating more accurate and relevant responses.\n\nFor example:\n\n> You are an experienced AI engineer and helpful assistant.\n\n> You are a friendly and knowledgeable chatbot.\n\n### Option `temperature`\n\nThe sampling temperature, between 0 and 1. Higher values like 0.8 will make the output more random, while lower values like 0.2 will make it more focused and deterministic. If set to 0, the model will use log probability to automatically increase the temperature until certain thresholds are hit.\n\nYou can pick a value between 0 and 2. For example:\n\n-   `0.1`: Low temperature, extremely conservative and deterministic\n-   `0.5`: Medium temperature, balanced between conservative and creative\n-   `1.0`: High temperature, creative and bit random\n-   `1.5`: Very high temperature, extremely creative and often chaotic and unpredictable\n-   `2.0`: Maximum temperature, completely random and unpredictable, for some extreme creative use cases\n\n# The assistant\n\nTake this description of the persona:\n\n> {personaDescription}",expectFormat:"JSON",dependentParameterNames:["availableModelNames","personaDescription"],resultingParameterName:"modelRequirements"}],knowledgeSources:[],knowledgePieces:[],personas:[],preparations:[{id:1,promptbookVersion:"0.63.0-7",usage:{price:{value:0},input:{tokensCount:{value:0},charactersCount:{value:0},wordsCount:{value:0},sentencesCount:{value:0},linesCount:{value:0},paragraphsCount:{value:0},pagesCount:{value:0}},output:{tokensCount:{value:0},charactersCount:{value:0},wordsCount:{value:0},sentencesCount:{value:0},linesCount:{value:0},paragraphsCount:{value:0},pagesCount:{value:0}}}}],sourceFile:"./promptbook-collection/prepare-persona.ptbk.md"}];
+var PipelineCollection = [{title:"Prepare Knowledge from Markdown",pipelineUrl:"https://promptbook.studio/promptbook/prepare-knowledge-from-markdown.ptbk.md",promptbookVersion:"0.63.0-10",parameters:[{name:"knowledgeContent",description:"Markdown document content",isInput:true,isOutput:false},{name:"knowledgePieces",description:"The knowledge JSON object",isInput:false,isOutput:true}],promptTemplates:[{blockType:"PROMPT_TEMPLATE",name:"knowledge",title:"Knowledge",modelRequirements:{modelVariant:"CHAT",modelName:"claude-3-opus-20240229"},content:"You are experienced data researcher, extract the important knowledge from the document.\n\n# Rules\n\n-   Make pieces of information concise, clear, and easy to understand\n-   One piece of information should be approximately 1 paragraph\n-   Divide the paragraphs by markdown horizontal lines ---\n-   Omit irrelevant information\n-   Group redundant information\n-   Write just extracted information, nothing else\n\n# The document\n\nTake information from this document:\n\n> {knowledgeContent}",dependentParameterNames:["knowledgeContent"],resultingParameterName:"knowledgePieces"}],knowledgeSources:[],knowledgePieces:[],personas:[],preparations:[{id:1,promptbookVersion:"0.63.0-10",usage:{price:{value:0},input:{tokensCount:{value:0},charactersCount:{value:0},wordsCount:{value:0},sentencesCount:{value:0},linesCount:{value:0},paragraphsCount:{value:0},pagesCount:{value:0}},output:{tokensCount:{value:0},charactersCount:{value:0},wordsCount:{value:0},sentencesCount:{value:0},linesCount:{value:0},paragraphsCount:{value:0},pagesCount:{value:0}}}}],sourceFile:"./promptbook-collection/prepare-knowledge-from-markdown.ptbk.md"},{title:"Prepare Keywords",pipelineUrl:"https://promptbook.studio/promptbook/prepare-knowledge-keywords.ptbk.md",promptbookVersion:"0.63.0-10",parameters:[{name:"knowledgePieceContent",description:"The content",isInput:true,isOutput:false},{name:"keywords",description:"Keywords separated by comma",isInput:false,isOutput:true}],promptTemplates:[{blockType:"PROMPT_TEMPLATE",name:"knowledge",title:"Knowledge",modelRequirements:{modelVariant:"CHAT",modelName:"claude-3-opus-20240229"},content:"You are experienced data researcher, detect the important keywords in the document.\n\n# Rules\n\n-   Write just keywords separated by comma\n\n# The document\n\nTake information from this document:\n\n> {knowledgePieceContent}",dependentParameterNames:["knowledgePieceContent"],resultingParameterName:"keywords"}],knowledgeSources:[],knowledgePieces:[],personas:[],preparations:[{id:1,promptbookVersion:"0.63.0-10",usage:{price:{value:0},input:{tokensCount:{value:0},charactersCount:{value:0},wordsCount:{value:0},sentencesCount:{value:0},linesCount:{value:0},paragraphsCount:{value:0},pagesCount:{value:0}},output:{tokensCount:{value:0},charactersCount:{value:0},wordsCount:{value:0},sentencesCount:{value:0},linesCount:{value:0},paragraphsCount:{value:0},pagesCount:{value:0}}}}],sourceFile:"./promptbook-collection/prepare-knowledge-keywords.ptbk.md"},{title:"Prepare Title",pipelineUrl:"https://promptbook.studio/promptbook/prepare-knowledge-title.ptbk.md",promptbookVersion:"0.63.0-10",parameters:[{name:"knowledgePieceContent",description:"The content",isInput:true,isOutput:false},{name:"title",description:"The title of the document",isInput:false,isOutput:true}],promptTemplates:[{blockType:"PROMPT_TEMPLATE",name:"knowledge",title:"Knowledge",modelRequirements:{modelVariant:"CHAT",modelName:"claude-3-opus-20240229"},content:"You are experienced content creator, write best title for the document.\n\n# Rules\n\n-   Write just title, nothing else\n-   Title should be concise and clear\n-   Write maximum 5 words for the title\n\n# The document\n\n> {knowledgePieceContent}",expectations:{words:{min:1,max:8}},dependentParameterNames:["knowledgePieceContent"],resultingParameterName:"title"}],knowledgeSources:[],knowledgePieces:[],personas:[],preparations:[{id:1,promptbookVersion:"0.63.0-10",usage:{price:{value:0},input:{tokensCount:{value:0},charactersCount:{value:0},wordsCount:{value:0},sentencesCount:{value:0},linesCount:{value:0},paragraphsCount:{value:0},pagesCount:{value:0}},output:{tokensCount:{value:0},charactersCount:{value:0},wordsCount:{value:0},sentencesCount:{value:0},linesCount:{value:0},paragraphsCount:{value:0},pagesCount:{value:0}}}}],sourceFile:"./promptbook-collection/prepare-knowledge-title.ptbk.md"},{title:"Prepare Keywords",pipelineUrl:"https://promptbook.studio/promptbook/prepare-persona.ptbk.md",promptbookVersion:"0.63.0-10",parameters:[{name:"availableModelNames",description:"List of available model names separated by comma (,)",isInput:true,isOutput:false},{name:"personaDescription",description:"Description of the persona",isInput:true,isOutput:false},{name:"modelRequirements",description:"Specific requirements for the model",isInput:false,isOutput:true}],promptTemplates:[{blockType:"PROMPT_TEMPLATE",name:"make-model-requirements",title:"Make modelRequirements",modelRequirements:{modelVariant:"CHAT",modelName:"gpt-4-turbo"},content:"You are experienced AI engineer, you need to create virtual assistant.\nWrite\n\n## Sample\n\n```json\n{\n\"modelName\": \"gpt-4o\",\n\"systemMessage\": \"You are experienced AI engineer and helpfull assistant.\",\n\"temperature\": 0.7\n}\n```\n\n## Instructions\n\n### Option `modelName`\n\nPick from the following models:\n\n-   {availableModelNames}\n\n### Option `systemMessage`\n\nThe system message is used to communicate instructions or provide context to the model at the beginning of a conversation. It is displayed in a different format compared to user messages, helping the model understand its role in the conversation. The system message typically guides the model's behavior, sets the tone, or specifies desired output from the model. By utilizing the system message effectively, users can steer the model towards generating more accurate and relevant responses.\n\nFor example:\n\n> You are an experienced AI engineer and helpful assistant.\n\n> You are a friendly and knowledgeable chatbot.\n\n### Option `temperature`\n\nThe sampling temperature, between 0 and 1. Higher values like 0.8 will make the output more random, while lower values like 0.2 will make it more focused and deterministic. If set to 0, the model will use log probability to automatically increase the temperature until certain thresholds are hit.\n\nYou can pick a value between 0 and 2. For example:\n\n-   `0.1`: Low temperature, extremely conservative and deterministic\n-   `0.5`: Medium temperature, balanced between conservative and creative\n-   `1.0`: High temperature, creative and bit random\n-   `1.5`: Very high temperature, extremely creative and often chaotic and unpredictable\n-   `2.0`: Maximum temperature, completely random and unpredictable, for some extreme creative use cases\n\n# The assistant\n\nTake this description of the persona:\n\n> {personaDescription}",expectFormat:"JSON",dependentParameterNames:["availableModelNames","personaDescription"],resultingParameterName:"modelRequirements"}],knowledgeSources:[],knowledgePieces:[],personas:[],preparations:[{id:1,promptbookVersion:"0.63.0-10",usage:{price:{value:0},input:{tokensCount:{value:0},charactersCount:{value:0},wordsCount:{value:0},sentencesCount:{value:0},linesCount:{value:0},paragraphsCount:{value:0},pagesCount:{value:0}},output:{tokensCount:{value:0},charactersCount:{value:0},wordsCount:{value:0},sentencesCount:{value:0},linesCount:{value:0},paragraphsCount:{value:0},pagesCount:{value:0}}}}],sourceFile:"./promptbook-collection/prepare-persona.ptbk.md"}];
 
 /**
  * This error indicates that the promptbook in a markdown format cannot be parsed into a valid promptbook object
@@ -988,9 +988,6 @@ function validatePipeline(pipeline) {
             throw new PipelineLogicError(spaceTrim$1(function (block) { return "\n                        Parameter name {".concat(template.resultingParameterName, "} is reserved, please use different name\n\n                        ").concat(block(pipelineIdentification), "\n                    "); }));
         }
         definedParameters.add(template.resultingParameterName);
-        if (template.blockType === 'PROMPT_TEMPLATE' && template.modelRequirements.modelVariant === undefined) {
-            throw new PipelineLogicError(spaceTrim$1(function (block) { return "\n\n                        You must specify MODEL VARIANT in the prompt template \"".concat(template.title, "\"\n\n                        For example:\n                        - MODEL VARIANT Chat\n                        - MODEL NAME `gpt-4-1106-preview`").concat(/* <- TODO: Dynamic listing of command examples */ '', "\n\n                        ").concat(block(pipelineIdentification), "\n                    "); }));
-        }
         if (template.jokerParameterNames && template.jokerParameterNames.length > 0) {
             if (!template.expectFormat &&
                 !template.expectations /* <- TODO: Require at least 1 -> min <- expectation to use jokers */) {
@@ -4150,7 +4147,7 @@ var blockCommandParser = {
  * Units of text measurement
  *
  * @see https://github.com/webgptorg/promptbook/discussions/30
- * @private internal base for `ExpectationUnit`
+ * @public exported from `@promptbook/core`
  */
 var EXPECTATION_UNITS = ['CHARACTERS', 'WORDS', 'SENTENCES', 'LINES', 'PARAGRAPHS', 'PAGES'];
 /**
@@ -4390,7 +4387,7 @@ var jokerCommandParser = {
 /**
  * @@@
  *
- * @private internal base for `ModelVariant` and `modelCommandParser`
+ * @public exported from `@promptbook/core`
  */
 var MODEL_VARIANTS = ['COMPLETION', 'CHAT', 'EMBEDDING' /* <- TODO [🏳] */ /* <- [🤖] */];
 
@@ -7330,6 +7327,7 @@ function createLlmToolsFromEnv(options) {
  * TODO: [🧠] Maybe pass env as argument
  * Note: [🟢] This code should never be published outside of `@promptbook/node` and `@promptbook/cli` and `@promptbook/cli`
  * TODO: [👷‍♂️] @@@ Manual about construction of llmTools
+ * TODO: [🥃] Allow `ptbk make` without llm tools
  */
 
 /**