@promptbook/core 0.88.0-9 → 0.89.0-1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +35 -14
- package/esm/index.es.js +50 -14
- package/esm/index.es.js.map +1 -1
- package/esm/typings/src/_packages/core.index.d.ts +2 -2
- package/esm/typings/src/_packages/types.index.d.ts +10 -0
- package/esm/typings/src/config.d.ts +1 -1
- package/esm/typings/src/errors/PipelineExecutionError.d.ts +5 -0
- package/esm/typings/src/errors/utils/ErrorJson.d.ts +5 -0
- package/esm/typings/src/llm-providers/_common/utils/count-total-usage/LlmExecutionToolsWithTotalUsage.d.ts +7 -0
- package/esm/typings/src/llm-providers/_common/utils/count-total-usage/{countTotalUsage.d.ts → countUsage.d.ts} +1 -1
- package/esm/typings/src/playground/BrjappConnector.d.ts +64 -0
- package/esm/typings/src/playground/brjapp-api-schema.d.ts +12879 -0
- package/esm/typings/src/playground/playground.d.ts +5 -0
- package/esm/typings/src/remote-server/socket-types/_subtypes/PromptbookServer_Identification.d.ts +2 -1
- package/esm/typings/src/remote-server/types/RemoteServerOptions.d.ts +15 -3
- package/esm/typings/src/types/typeAliases.d.ts +2 -2
- package/esm/typings/src/utils/expectation-counters/countCharacters.d.ts +3 -0
- package/esm/typings/src/utils/expectation-counters/countLines.d.ts +3 -0
- package/esm/typings/src/utils/expectation-counters/countPages.d.ts +3 -0
- package/esm/typings/src/utils/expectation-counters/countParagraphs.d.ts +3 -0
- package/esm/typings/src/utils/expectation-counters/countSentences.d.ts +3 -0
- package/esm/typings/src/utils/expectation-counters/countWords.d.ts +3 -0
- package/package.json +1 -1
- package/umd/index.umd.js +50 -14
- package/umd/index.umd.js.map +1 -1
package/README.md
CHANGED
|
@@ -62,6 +62,8 @@ Rest of the documentation is common for **entire promptbook ecosystem**:
|
|
|
62
62
|
|
|
63
63
|
During the computer revolution, we have seen [multiple generations of computer languages](https://github.com/webgptorg/promptbook/discussions/180), from the physical rewiring of the vacuum tubes through low-level machine code to the high-level languages like Python or JavaScript. And now, we're on the edge of the **next revolution**!
|
|
64
64
|
|
|
65
|
+
|
|
66
|
+
|
|
65
67
|
It's a revolution of writing software in **plain human language** that is understandable and executable by both humans and machines – and it's going to change everything!
|
|
66
68
|
|
|
67
69
|
The incredible growth in power of microprocessors and the Moore's Law have been the driving force behind the ever-more powerful languages, and it's been an amazing journey! Similarly, the large language models (like GPT or Claude) are the next big thing in language technology, and they're set to transform the way we interact with computers.
|
|
@@ -72,6 +74,9 @@ This shift is going to happen, whether we are ready for it or not. Our mission i
|
|
|
72
74
|
|
|
73
75
|
|
|
74
76
|
|
|
77
|
+
|
|
78
|
+
|
|
79
|
+
|
|
75
80
|
## 🚀 Get started
|
|
76
81
|
|
|
77
82
|
Take a look at the simple starter kit with books integrated into the **Hello World** sample applications:
|
|
@@ -83,6 +88,8 @@ Take a look at the simple starter kit with books integrated into the **Hello Wor
|
|
|
83
88
|
|
|
84
89
|
|
|
85
90
|
|
|
91
|
+
|
|
92
|
+
|
|
86
93
|
## 💜 The Promptbook Project
|
|
87
94
|
|
|
88
95
|
Promptbook project is ecosystem of multiple projects and tools, following is a list of most important pieces of the project:
|
|
@@ -118,22 +125,35 @@ Promptbook project is ecosystem of multiple projects and tools, following is a l
|
|
|
118
125
|
</tbody>
|
|
119
126
|
</table>
|
|
120
127
|
|
|
128
|
+
Hello world examples:
|
|
129
|
+
|
|
130
|
+
- [Hello world](https://github.com/webgptorg/hello-world)
|
|
131
|
+
- [Hello world in Node.js](https://github.com/webgptorg/hello-world-node-js)
|
|
132
|
+
- [Hello world in Next.js](https://github.com/webgptorg/hello-world-next-js)
|
|
133
|
+
|
|
134
|
+
|
|
135
|
+
|
|
121
136
|
We also have a community of developers and users of **Promptbook**:
|
|
122
137
|
|
|
123
138
|
- [Discord community](https://discord.gg/x3QWNaa89N)
|
|
124
139
|
- [Landing page `ptbk.io`](https://ptbk.io)
|
|
125
140
|
- [Github discussions](https://github.com/webgptorg/promptbook/discussions)
|
|
126
141
|
- [LinkedIn `Promptbook`](https://linkedin.com/company/promptbook)
|
|
127
|
-
- [Facebook `Promptbook`](https://www.facebook.com/61560776453536)
|
|
142
|
+
- [Facebook `Promptbook`](https://www.facebook.com/61560776453536)
|
|
128
143
|
|
|
129
144
|
And **Promptbook.studio** branded socials:
|
|
130
145
|
|
|
146
|
+
|
|
147
|
+
|
|
131
148
|
- [Instagram `@promptbook.studio`](https://www.instagram.com/promptbook.studio/)
|
|
132
149
|
|
|
133
150
|
And **Promptujeme** sub-brand:
|
|
134
151
|
|
|
135
152
|
_/Subbrand for Czech clients/_
|
|
136
153
|
|
|
154
|
+
|
|
155
|
+
|
|
156
|
+
|
|
137
157
|
- [Promptujeme.cz](https://www.promptujeme.cz/)
|
|
138
158
|
- [Facebook `Promptujeme`](https://www.facebook.com/promptujeme/)
|
|
139
159
|
|
|
@@ -151,6 +171,8 @@ _/Sub-brand for images and graphics generated via Promptbook prompting/_
|
|
|
151
171
|
|
|
152
172
|
## 💙 The Book language
|
|
153
173
|
|
|
174
|
+
|
|
175
|
+
|
|
154
176
|
Following is the documentation and blueprint of the [Book language](https://github.com/webgptorg/book).
|
|
155
177
|
|
|
156
178
|
Book is a language that can be used to write AI applications, agents, workflows, automations, knowledgebases, translators, sheet processors, email automations and more. It allows you to harness the power of AI models in human-like terms, without the need to know the specifics and technicalities of the models.
|
|
@@ -200,6 +222,8 @@ Personas can have access to different knowledge, tools and actions. They can als
|
|
|
200
222
|
|
|
201
223
|
- [PERSONA](https://github.com/webgptorg/promptbook/blob/main/documents/commands/PERSONA.md)
|
|
202
224
|
|
|
225
|
+
|
|
226
|
+
|
|
203
227
|
### **How:** Knowledge, Instruments and Actions
|
|
204
228
|
|
|
205
229
|
The resources used by the personas are used to do the work.
|
|
@@ -275,11 +299,9 @@ Or you can install them separately:
|
|
|
275
299
|
|
|
276
300
|
## 📚 Dictionary
|
|
277
301
|
|
|
278
|
-
### 📚 Dictionary
|
|
279
|
-
|
|
280
302
|
The following glossary is used to clarify certain concepts:
|
|
281
303
|
|
|
282
|
-
|
|
304
|
+
### General LLM / AI terms
|
|
283
305
|
|
|
284
306
|
- **Prompt drift** is a phenomenon where the AI model starts to generate outputs that are not aligned with the original prompt. This can happen due to the model's training data, the prompt's wording, or the model's architecture.
|
|
285
307
|
- **Pipeline, workflow or chain** is a sequence of tasks that are executed in a specific order. In the context of AI, a pipeline can refer to a sequence of AI models that are used to process data.
|
|
@@ -290,9 +312,13 @@ The following glossary is used to clarify certain concepts:
|
|
|
290
312
|
- **Retrieval-augmented generation** is a machine learning paradigm where a model generates text by retrieving relevant information from a large database of text. This approach combines the benefits of generative models and retrieval models.
|
|
291
313
|
- **Longtail** refers to non-common or rare events, items, or entities that are not well-represented in the training data of machine learning models. Longtail items are often challenging for models to predict accurately.
|
|
292
314
|
|
|
293
|
-
_Note: Thos section is not complete dictionary, more list of general AI / LLM terms that has connection with Promptbook_
|
|
294
315
|
|
|
295
|
-
|
|
316
|
+
|
|
317
|
+
_Note: This section is not complete dictionary, more list of general AI / LLM terms that has connection with Promptbook_
|
|
318
|
+
|
|
319
|
+
|
|
320
|
+
|
|
321
|
+
### 💯 Core concepts
|
|
296
322
|
|
|
297
323
|
- [📚 Collection of pipelines](https://github.com/webgptorg/promptbook/discussions/65)
|
|
298
324
|
- [📯 Pipeline](https://github.com/webgptorg/promptbook/discussions/64)
|
|
@@ -305,7 +331,7 @@ _Note: Thos section is not complete dictionary, more list of general AI / LLM te
|
|
|
305
331
|
- [🔣 Words not tokens](https://github.com/webgptorg/promptbook/discussions/29)
|
|
306
332
|
- [☯ Separation of concerns](https://github.com/webgptorg/promptbook/discussions/32)
|
|
307
333
|
|
|
308
|
-
|
|
334
|
+
#### Advanced concepts
|
|
309
335
|
|
|
310
336
|
- [📚 Knowledge (Retrieval-augmented generation)](https://github.com/webgptorg/promptbook/discussions/41)
|
|
311
337
|
- [🌏 Remote server](https://github.com/webgptorg/promptbook/discussions/89)
|
|
@@ -320,11 +346,6 @@ _Note: Thos section is not complete dictionary, more list of general AI / LLM te
|
|
|
320
346
|
- [👮 Agent adversary expectations](https://github.com/webgptorg/promptbook/discussions/39)
|
|
321
347
|
- [view more](https://github.com/webgptorg/promptbook/discussions/categories/concepts)
|
|
322
348
|
|
|
323
|
-
### Terms specific to Promptbook TypeScript implementation
|
|
324
|
-
|
|
325
|
-
- Anonymous mode
|
|
326
|
-
- Application mode
|
|
327
|
-
|
|
328
349
|
|
|
329
350
|
|
|
330
351
|
## 🚂 Promptbook Engine
|
|
@@ -395,11 +416,11 @@ See [TODO.md](./TODO.md)
|
|
|
395
416
|
<div style="display: flex; align-items: center; gap: 20px;">
|
|
396
417
|
|
|
397
418
|
<a href="https://promptbook.studio/">
|
|
398
|
-
<img src="./design/promptbook-studio-logo.png" alt="Partner 3" height="
|
|
419
|
+
<img src="./design/promptbook-studio-logo.png" alt="Partner 3" height="70">
|
|
399
420
|
</a>
|
|
400
421
|
|
|
401
422
|
<a href="https://technologickainkubace.org/en/about-technology-incubation/about-the-project/">
|
|
402
|
-
<img src="./other/partners/CI-Technology-Incubation.png" alt="Technology Incubation" height="
|
|
423
|
+
<img src="./other/partners/CI-Technology-Incubation.png" alt="Technology Incubation" height="70">
|
|
403
424
|
</a>
|
|
404
425
|
|
|
405
426
|
</div>
|
package/esm/index.es.js
CHANGED
|
@@ -27,7 +27,7 @@ const BOOK_LANGUAGE_VERSION = '1.0.0';
|
|
|
27
27
|
* @generated
|
|
28
28
|
* @see https://github.com/webgptorg/promptbook
|
|
29
29
|
*/
|
|
30
|
-
const PROMPTBOOK_ENGINE_VERSION = '0.
|
|
30
|
+
const PROMPTBOOK_ENGINE_VERSION = '0.89.0-1';
|
|
31
31
|
/**
|
|
32
32
|
* TODO: string_promptbook_version should be constrained to the all versions of Promptbook engine
|
|
33
33
|
* Note: [💞] Ignore a discrepancy between file name and entity name
|
|
@@ -453,7 +453,7 @@ const CLAIM = `It's time for a paradigm shift. The future of software in plain E
|
|
|
453
453
|
*
|
|
454
454
|
* @public exported from `@promptbook/core`
|
|
455
455
|
*/
|
|
456
|
-
const LOGO_LIGHT_SRC = `https://promptbook.studio/_next/static/media/promptbook-logo.b21f0c70.png`;
|
|
456
|
+
const LOGO_LIGHT_SRC = `https://promptbook.studio/_next/static/media/promptbook-logo.b21f0c70.png`; // <- TODO: !!! Auto-update or remove
|
|
457
457
|
/**
|
|
458
458
|
* Logo for the dark theme
|
|
459
459
|
*
|
|
@@ -461,7 +461,7 @@ const LOGO_LIGHT_SRC = `https://promptbook.studio/_next/static/media/promptbook-
|
|
|
461
461
|
*
|
|
462
462
|
* @public exported from `@promptbook/core`
|
|
463
463
|
*/
|
|
464
|
-
const LOGO_DARK_SRC = `https://promptbook.studio/_next/static/media/promptbook-logo-white.09887cbc.png`;
|
|
464
|
+
const LOGO_DARK_SRC = `https://promptbook.studio/_next/static/media/promptbook-logo-white.09887cbc.png`; // <- TODO: !!! Auto-update or remove
|
|
465
465
|
/**
|
|
466
466
|
* When the title is not provided, the default title is used
|
|
467
467
|
*
|
|
@@ -549,7 +549,7 @@ const DEFAULT_MAX_PARALLEL_COUNT = 5; // <- TODO: [🤹♂️]
|
|
|
549
549
|
*
|
|
550
550
|
* @public exported from `@promptbook/core`
|
|
551
551
|
*/
|
|
552
|
-
const DEFAULT_MAX_EXECUTION_ATTEMPTS =
|
|
552
|
+
const DEFAULT_MAX_EXECUTION_ATTEMPTS = 10; // <- TODO: [🤹♂️]
|
|
553
553
|
/**
|
|
554
554
|
* @@@
|
|
555
555
|
* TODO: [🐝][main] !!3 Use
|
|
@@ -1851,11 +1851,17 @@ function jsonStringsToJsons(object) {
|
|
|
1851
1851
|
*/
|
|
1852
1852
|
class PipelineExecutionError extends Error {
|
|
1853
1853
|
constructor(message) {
|
|
1854
|
+
// Added id parameter
|
|
1854
1855
|
super(message);
|
|
1855
1856
|
this.name = 'PipelineExecutionError';
|
|
1857
|
+
// TODO: [🐙] DRY - Maybe $randomId
|
|
1858
|
+
this.id = `error-${$randomToken(8 /* <- TODO: To global config + Use Base58 to avoid simmilar char conflicts */)}`;
|
|
1856
1859
|
Object.setPrototypeOf(this, PipelineExecutionError.prototype);
|
|
1857
1860
|
}
|
|
1858
1861
|
}
|
|
1862
|
+
/**
|
|
1863
|
+
* TODO: !!!!!! Add id to all errors
|
|
1864
|
+
*/
|
|
1859
1865
|
|
|
1860
1866
|
/**
|
|
1861
1867
|
* This error indicates problems parsing the format value
|
|
@@ -2043,7 +2049,7 @@ const ALL_ERRORS = {
|
|
|
2043
2049
|
* @public exported from `@promptbook/utils`
|
|
2044
2050
|
*/
|
|
2045
2051
|
function deserializeError(error) {
|
|
2046
|
-
const { name, stack } = error;
|
|
2052
|
+
const { name, stack, id } = error; // Added id
|
|
2047
2053
|
let { message } = error;
|
|
2048
2054
|
let ErrorClass = ALL_ERRORS[error.name];
|
|
2049
2055
|
if (ErrorClass === undefined) {
|
|
@@ -2058,7 +2064,9 @@ function deserializeError(error) {
|
|
|
2058
2064
|
${block(stack || '')}
|
|
2059
2065
|
`);
|
|
2060
2066
|
}
|
|
2061
|
-
|
|
2067
|
+
const deserializedError = new ErrorClass(message);
|
|
2068
|
+
deserializedError.id = id; // Assign id to the error object
|
|
2069
|
+
return deserializedError;
|
|
2062
2070
|
}
|
|
2063
2071
|
|
|
2064
2072
|
/**
|
|
@@ -2108,6 +2116,7 @@ function assertsTaskSuccessful(executionResult) {
|
|
|
2108
2116
|
*/
|
|
2109
2117
|
function createTask(options) {
|
|
2110
2118
|
const { taskType, taskProcessCallback } = options;
|
|
2119
|
+
// TODO: [🐙] DRY
|
|
2111
2120
|
const taskId = `${taskType.toLowerCase().substring(0, 4)}-${$randomToken(8 /* <- TODO: To global config + Use Base58 to avoid simmilar char conflicts */)}`;
|
|
2112
2121
|
let status = 'RUNNING';
|
|
2113
2122
|
const createdAt = new Date();
|
|
@@ -2140,7 +2149,7 @@ function createTask(options) {
|
|
|
2140
2149
|
assertsTaskSuccessful(executionResult);
|
|
2141
2150
|
status = 'FINISHED';
|
|
2142
2151
|
currentValue = jsonStringsToJsons(executionResult);
|
|
2143
|
-
// <- TODO:
|
|
2152
|
+
// <- TODO: [🧠] Is this a good idea to convert JSON strins to JSONs?
|
|
2144
2153
|
partialResultSubject.next(executionResult);
|
|
2145
2154
|
}
|
|
2146
2155
|
catch (error) {
|
|
@@ -2204,19 +2213,21 @@ function createTask(options) {
|
|
|
2204
2213
|
*/
|
|
2205
2214
|
function serializeError(error) {
|
|
2206
2215
|
const { name, message, stack } = error;
|
|
2216
|
+
const { id } = error;
|
|
2207
2217
|
if (!Object.keys(ALL_ERRORS).includes(name)) {
|
|
2208
2218
|
console.error(spaceTrim((block) => `
|
|
2209
|
-
|
|
2219
|
+
|
|
2210
2220
|
Cannot serialize error with name "${name}"
|
|
2211
2221
|
|
|
2212
2222
|
${block(stack || message)}
|
|
2213
|
-
|
|
2223
|
+
|
|
2214
2224
|
`));
|
|
2215
2225
|
}
|
|
2216
2226
|
return {
|
|
2217
2227
|
name: name,
|
|
2218
2228
|
message,
|
|
2219
2229
|
stack,
|
|
2230
|
+
id, // Include id in the serialized object
|
|
2220
2231
|
};
|
|
2221
2232
|
}
|
|
2222
2233
|
|
|
@@ -3259,6 +3270,9 @@ function countCharacters(text) {
|
|
|
3259
3270
|
text = text.replace(/\p{Extended_Pictographic}(\u{200D}\p{Extended_Pictographic})*/gu, '-');
|
|
3260
3271
|
return text.length;
|
|
3261
3272
|
}
|
|
3273
|
+
/**
|
|
3274
|
+
* TODO: [🥴] Implement counting in formats - like JSON, CSV, XML,...
|
|
3275
|
+
*/
|
|
3262
3276
|
|
|
3263
3277
|
/**
|
|
3264
3278
|
* Number of characters per standard line with 11pt Arial font size.
|
|
@@ -3290,6 +3304,9 @@ function countLines(text) {
|
|
|
3290
3304
|
const lines = text.split('\n');
|
|
3291
3305
|
return lines.reduce((count, line) => count + Math.ceil(line.length / CHARACTERS_PER_STANDARD_LINE), 0);
|
|
3292
3306
|
}
|
|
3307
|
+
/**
|
|
3308
|
+
* TODO: [🥴] Implement counting in formats - like JSON, CSV, XML,...
|
|
3309
|
+
*/
|
|
3293
3310
|
|
|
3294
3311
|
/**
|
|
3295
3312
|
* Counts number of pages in the text
|
|
@@ -3301,6 +3318,9 @@ function countLines(text) {
|
|
|
3301
3318
|
function countPages(text) {
|
|
3302
3319
|
return Math.ceil(countLines(text) / LINES_PER_STANDARD_PAGE);
|
|
3303
3320
|
}
|
|
3321
|
+
/**
|
|
3322
|
+
* TODO: [🥴] Implement counting in formats - like JSON, CSV, XML,...
|
|
3323
|
+
*/
|
|
3304
3324
|
|
|
3305
3325
|
/**
|
|
3306
3326
|
* Counts number of paragraphs in the text
|
|
@@ -3310,6 +3330,9 @@ function countPages(text) {
|
|
|
3310
3330
|
function countParagraphs(text) {
|
|
3311
3331
|
return text.split(/\n\s*\n/).filter((paragraph) => paragraph.trim() !== '').length;
|
|
3312
3332
|
}
|
|
3333
|
+
/**
|
|
3334
|
+
* TODO: [🥴] Implement counting in formats - like JSON, CSV, XML,...
|
|
3335
|
+
*/
|
|
3313
3336
|
|
|
3314
3337
|
/**
|
|
3315
3338
|
* Split text into sentences
|
|
@@ -3327,6 +3350,9 @@ function splitIntoSentences(text) {
|
|
|
3327
3350
|
function countSentences(text) {
|
|
3328
3351
|
return splitIntoSentences(text).length;
|
|
3329
3352
|
}
|
|
3353
|
+
/**
|
|
3354
|
+
* TODO: [🥴] Implement counting in formats - like JSON, CSV, XML,...
|
|
3355
|
+
*/
|
|
3330
3356
|
|
|
3331
3357
|
const defaultDiacriticsRemovalMap = [
|
|
3332
3358
|
{
|
|
@@ -3601,6 +3627,9 @@ function countWords(text) {
|
|
|
3601
3627
|
text = text.replace(/([a-z])([A-Z])/g, '$1 $2');
|
|
3602
3628
|
return text.split(/[^a-zа-я0-9]+/i).filter((word) => word.length > 0).length;
|
|
3603
3629
|
}
|
|
3630
|
+
/**
|
|
3631
|
+
* TODO: [🥴] Implement counting in formats - like JSON, CSV, XML,...
|
|
3632
|
+
*/
|
|
3604
3633
|
|
|
3605
3634
|
/**
|
|
3606
3635
|
* Index of all counter functions
|
|
@@ -4678,8 +4707,9 @@ async function forEachAsync(array, options, callbackfunction) {
|
|
|
4678
4707
|
* @returns LLM tools with same functionality with added total cost counting
|
|
4679
4708
|
* @public exported from `@promptbook/core`
|
|
4680
4709
|
*/
|
|
4681
|
-
function
|
|
4710
|
+
function countUsage(llmTools) {
|
|
4682
4711
|
let totalUsage = ZERO_USAGE;
|
|
4712
|
+
const spending = new Subject();
|
|
4683
4713
|
const proxyTools = {
|
|
4684
4714
|
get title() {
|
|
4685
4715
|
// TODO: [🧠] Maybe put here some suffix
|
|
@@ -4689,12 +4719,15 @@ function countTotalUsage(llmTools) {
|
|
|
4689
4719
|
// TODO: [🧠] Maybe put here some suffix
|
|
4690
4720
|
return llmTools.description;
|
|
4691
4721
|
},
|
|
4692
|
-
|
|
4722
|
+
checkConfiguration() {
|
|
4693
4723
|
return /* not await */ llmTools.checkConfiguration();
|
|
4694
4724
|
},
|
|
4695
4725
|
listModels() {
|
|
4696
4726
|
return /* not await */ llmTools.listModels();
|
|
4697
4727
|
},
|
|
4728
|
+
spending() {
|
|
4729
|
+
return spending.asObservable();
|
|
4730
|
+
},
|
|
4698
4731
|
getTotalUsage() {
|
|
4699
4732
|
// <- Note: [🥫] Not using getter `get totalUsage` but `getTotalUsage` to allow this object to be proxied
|
|
4700
4733
|
return totalUsage;
|
|
@@ -4705,6 +4738,7 @@ function countTotalUsage(llmTools) {
|
|
|
4705
4738
|
// console.info('[🚕] callChatModel through countTotalUsage');
|
|
4706
4739
|
const promptResult = await llmTools.callChatModel(prompt);
|
|
4707
4740
|
totalUsage = addUsage(totalUsage, promptResult.usage);
|
|
4741
|
+
spending.next(promptResult.usage);
|
|
4708
4742
|
return promptResult;
|
|
4709
4743
|
};
|
|
4710
4744
|
}
|
|
@@ -4713,6 +4747,7 @@ function countTotalUsage(llmTools) {
|
|
|
4713
4747
|
// console.info('[🚕] callCompletionModel through countTotalUsage');
|
|
4714
4748
|
const promptResult = await llmTools.callCompletionModel(prompt);
|
|
4715
4749
|
totalUsage = addUsage(totalUsage, promptResult.usage);
|
|
4750
|
+
spending.next(promptResult.usage);
|
|
4716
4751
|
return promptResult;
|
|
4717
4752
|
};
|
|
4718
4753
|
}
|
|
@@ -4721,6 +4756,7 @@ function countTotalUsage(llmTools) {
|
|
|
4721
4756
|
// console.info('[🚕] callEmbeddingModel through countTotalUsage');
|
|
4722
4757
|
const promptResult = await llmTools.callEmbeddingModel(prompt);
|
|
4723
4758
|
totalUsage = addUsage(totalUsage, promptResult.usage);
|
|
4759
|
+
spending.next(promptResult.usage);
|
|
4724
4760
|
return promptResult;
|
|
4725
4761
|
};
|
|
4726
4762
|
}
|
|
@@ -5539,7 +5575,7 @@ async function preparePipeline(pipeline, tools, options) {
|
|
|
5539
5575
|
// TODO: [🚐] Make arrayable LLMs -> single LLM DRY
|
|
5540
5576
|
const _llms = arrayableToArray(tools.llm);
|
|
5541
5577
|
const llmTools = _llms.length === 1 ? _llms[0] : joinLlmExecutionTools(..._llms);
|
|
5542
|
-
const llmToolsWithUsage =
|
|
5578
|
+
const llmToolsWithUsage = countUsage(llmTools);
|
|
5543
5579
|
// <- TODO: [🌯]
|
|
5544
5580
|
/*
|
|
5545
5581
|
TODO: [🧠][🪑][🔃] Should this be done or not
|
|
@@ -10050,7 +10086,7 @@ function cacheLlmTools(llmTools, options = {}) {
|
|
|
10050
10086
|
*/
|
|
10051
10087
|
function limitTotalUsage(llmTools, options = {}) {
|
|
10052
10088
|
const { maxTotalUsage = ZERO_USAGE, storage = new MemoryStorage() } = options;
|
|
10053
|
-
const proxyTools =
|
|
10089
|
+
const proxyTools = countUsage(llmTools);
|
|
10054
10090
|
if (maxTotalUsage.price.value !== 0) {
|
|
10055
10091
|
throw new NotYetImplementedError('`limitTotalUsage` is not yet implemented for non-zero price');
|
|
10056
10092
|
// TODO: "Cannot call `callChatModel` because the total cost limit is reached"
|
|
@@ -10799,5 +10835,5 @@ class PrefixStorage {
|
|
|
10799
10835
|
}
|
|
10800
10836
|
}
|
|
10801
10837
|
|
|
10802
|
-
export { $llmToolsMetadataRegister, $llmToolsRegister, $scrapersMetadataRegister, $scrapersRegister, ADMIN_EMAIL, ADMIN_GITHUB_NAME, AbstractFormatError, BOOK_LANGUAGE_VERSION, BlackholeStorage, BoilerplateError, BoilerplateFormfactorDefinition, CLAIM, CallbackInterfaceTools, ChatbotFormfactorDefinition, CollectionError, CsvFormatDefinition, CsvFormatError, DEFAULT_BOOKS_DIRNAME, DEFAULT_BOOK_OUTPUT_PARAMETER_NAME, DEFAULT_BOOK_TITLE, DEFAULT_CSV_SETTINGS, DEFAULT_DOWNLOAD_CACHE_DIRNAME, DEFAULT_EXECUTION_CACHE_DIRNAME, DEFAULT_GET_PIPELINE_COLLECTION_FUNCTION_NAME, DEFAULT_INTERMEDIATE_FILES_STRATEGY, DEFAULT_IS_AUTO_INSTALLED, DEFAULT_IS_VERBOSE, DEFAULT_MAX_EXECUTION_ATTEMPTS, DEFAULT_MAX_FILE_SIZE, DEFAULT_MAX_KNOWLEDGE_SOURCES_SCRAPING_DEPTH, DEFAULT_MAX_KNOWLEDGE_SOURCES_SCRAPING_TOTAL, DEFAULT_MAX_PARALLEL_COUNT, DEFAULT_PIPELINE_COLLECTION_BASE_FILENAME, DEFAULT_PROMPT_TASK_TITLE, DEFAULT_REMOTE_URL, DEFAULT_REMOTE_URL_PATH, DEFAULT_SCRAPE_CACHE_DIRNAME, DEFAULT_TASK_TITLE, EXPECTATION_UNITS, EnvironmentMismatchError, ExecutionReportStringOptionsDefaults, ExpectError, FORMFACTOR_DEFINITIONS, GENERIC_PIPELINE_INTERFACE, GeneratorFormfactorDefinition, GenericFormfactorDefinition, ImageGeneratorFormfactorDefinition, KnowledgeScrapeError, LOGO_DARK_SRC, LOGO_LIGHT_SRC, LimitReachedError, MANDATORY_CSV_SETTINGS, MAX_FILENAME_LENGTH, MODEL_VARIANTS, MatcherFormfactorDefinition, MemoryStorage, MissingToolsError, MultipleLlmExecutionTools, NAME, NonTaskSectionTypes, NotFoundError, NotYetImplementedError, ORDER_OF_PIPELINE_JSON, PROMPTBOOK_ENGINE_VERSION, PROMPTBOOK_ERRORS, ParseError, PipelineExecutionError, PipelineLogicError, PipelineUrlError, PrefixStorage, RESERVED_PARAMETER_NAMES, SET_IS_VERBOSE, SectionTypes, SheetsFormfactorDefinition, TaskTypes, TextFormatDefinition, TranslatorFormfactorDefinition, UNCERTAIN_USAGE, UnexpectedError, ZERO_USAGE, _AnthropicClaudeMetadataRegistration, _AzureOpenAiMetadataRegistration, _BoilerplateScraperMetadataRegistration, _DeepseekMetadataRegistration, _DocumentScraperMetadataRegistration, _GoogleMetadataRegistration, _LegacyDocumentScraperMetadataRegistration, _MarkdownScraperMetadataRegistration, _MarkitdownScraperMetadataRegistration, _OpenAiAssistantMetadataRegistration, _OpenAiMetadataRegistration, _PdfScraperMetadataRegistration, _WebsiteScraperMetadataRegistration, addUsage, book, cacheLlmTools, collectionToJson, compilePipeline,
|
|
10838
|
+
export { $llmToolsMetadataRegister, $llmToolsRegister, $scrapersMetadataRegister, $scrapersRegister, ADMIN_EMAIL, ADMIN_GITHUB_NAME, AbstractFormatError, BOOK_LANGUAGE_VERSION, BlackholeStorage, BoilerplateError, BoilerplateFormfactorDefinition, CLAIM, CallbackInterfaceTools, ChatbotFormfactorDefinition, CollectionError, CsvFormatDefinition, CsvFormatError, DEFAULT_BOOKS_DIRNAME, DEFAULT_BOOK_OUTPUT_PARAMETER_NAME, DEFAULT_BOOK_TITLE, DEFAULT_CSV_SETTINGS, DEFAULT_DOWNLOAD_CACHE_DIRNAME, DEFAULT_EXECUTION_CACHE_DIRNAME, DEFAULT_GET_PIPELINE_COLLECTION_FUNCTION_NAME, DEFAULT_INTERMEDIATE_FILES_STRATEGY, DEFAULT_IS_AUTO_INSTALLED, DEFAULT_IS_VERBOSE, DEFAULT_MAX_EXECUTION_ATTEMPTS, DEFAULT_MAX_FILE_SIZE, DEFAULT_MAX_KNOWLEDGE_SOURCES_SCRAPING_DEPTH, DEFAULT_MAX_KNOWLEDGE_SOURCES_SCRAPING_TOTAL, DEFAULT_MAX_PARALLEL_COUNT, DEFAULT_PIPELINE_COLLECTION_BASE_FILENAME, DEFAULT_PROMPT_TASK_TITLE, DEFAULT_REMOTE_URL, DEFAULT_REMOTE_URL_PATH, DEFAULT_SCRAPE_CACHE_DIRNAME, DEFAULT_TASK_TITLE, EXPECTATION_UNITS, EnvironmentMismatchError, ExecutionReportStringOptionsDefaults, ExpectError, FORMFACTOR_DEFINITIONS, GENERIC_PIPELINE_INTERFACE, GeneratorFormfactorDefinition, GenericFormfactorDefinition, ImageGeneratorFormfactorDefinition, KnowledgeScrapeError, LOGO_DARK_SRC, LOGO_LIGHT_SRC, LimitReachedError, MANDATORY_CSV_SETTINGS, MAX_FILENAME_LENGTH, MODEL_VARIANTS, MatcherFormfactorDefinition, MemoryStorage, MissingToolsError, MultipleLlmExecutionTools, NAME, NonTaskSectionTypes, NotFoundError, NotYetImplementedError, ORDER_OF_PIPELINE_JSON, PROMPTBOOK_ENGINE_VERSION, PROMPTBOOK_ERRORS, ParseError, PipelineExecutionError, PipelineLogicError, PipelineUrlError, PrefixStorage, RESERVED_PARAMETER_NAMES, SET_IS_VERBOSE, SectionTypes, SheetsFormfactorDefinition, TaskTypes, TextFormatDefinition, TranslatorFormfactorDefinition, UNCERTAIN_USAGE, UnexpectedError, ZERO_USAGE, _AnthropicClaudeMetadataRegistration, _AzureOpenAiMetadataRegistration, _BoilerplateScraperMetadataRegistration, _DeepseekMetadataRegistration, _DocumentScraperMetadataRegistration, _GoogleMetadataRegistration, _LegacyDocumentScraperMetadataRegistration, _MarkdownScraperMetadataRegistration, _MarkitdownScraperMetadataRegistration, _OpenAiAssistantMetadataRegistration, _OpenAiMetadataRegistration, _PdfScraperMetadataRegistration, _WebsiteScraperMetadataRegistration, addUsage, book, cacheLlmTools, collectionToJson, compilePipeline, countUsage, createCollectionFromJson, createCollectionFromPromise, createCollectionFromUrl, createLlmToolsFromConfiguration, createPipelineExecutor, createSubcollection, embeddingVectorToString, executionReportJsonToString, extractParameterNamesFromTask, getPipelineInterface, isPassingExpectations, isPipelineImplementingInterface, isPipelineInterfacesEqual, isPipelinePrepared, isValidPipelineString, joinLlmExecutionTools, limitTotalUsage, makeKnowledgeSourceHandler, parsePipeline, pipelineJsonToString, prepareKnowledgePieces, preparePersona, preparePipeline, prepareTasks, prettifyPipelineString, unpreparePipeline, usageToHuman, usageToWorktime, validatePipeline, validatePipelineString };
|
|
10803
10839
|
//# sourceMappingURL=index.es.js.map
|