@promptbook/documents 0.88.0-11 → 0.88.0-12
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +7 -19
- package/esm/index.es.js +51 -22
- package/esm/index.es.js.map +1 -1
- package/esm/typings/src/config.d.ts +1 -1
- package/esm/typings/src/errors/PipelineExecutionError.d.ts +5 -0
- package/esm/typings/src/errors/utils/ErrorJson.d.ts +5 -0
- package/esm/typings/src/utils/expectation-counters/countCharacters.d.ts +3 -0
- package/esm/typings/src/utils/expectation-counters/countLines.d.ts +3 -0
- package/esm/typings/src/utils/expectation-counters/countPages.d.ts +3 -0
- package/esm/typings/src/utils/expectation-counters/countParagraphs.d.ts +3 -0
- package/esm/typings/src/utils/expectation-counters/countSentences.d.ts +3 -0
- package/esm/typings/src/utils/expectation-counters/countWords.d.ts +3 -0
- package/package.json +2 -2
- package/umd/index.umd.js +54 -25
- package/umd/index.umd.js.map +1 -1
package/README.md
CHANGED
|
@@ -61,8 +61,6 @@ Rest of the documentation is common for **entire promptbook ecosystem**:
|
|
|
61
61
|
|
|
62
62
|
During the computer revolution, we have seen [multiple generations of computer languages](https://github.com/webgptorg/promptbook/discussions/180), from the physical rewiring of the vacuum tubes through low-level machine code to the high-level languages like Python or JavaScript. And now, we're on the edge of the **next revolution**!
|
|
63
63
|
|
|
64
|
-
|
|
65
|
-
|
|
66
64
|
It's a revolution of writing software in **plain human language** that is understandable and executable by both humans and machines – and it's going to change everything!
|
|
67
65
|
|
|
68
66
|
The incredible growth in power of microprocessors and the Moore's Law have been the driving force behind the ever-more powerful languages, and it's been an amazing journey! Similarly, the large language models (like GPT or Claude) are the next big thing in language technology, and they're set to transform the way we interact with computers.
|
|
@@ -73,6 +71,9 @@ This shift is going to happen, whether we are ready for it or not. Our mission i
|
|
|
73
71
|
|
|
74
72
|
|
|
75
73
|
|
|
74
|
+
|
|
75
|
+
|
|
76
|
+
|
|
76
77
|
## 🚀 Get started
|
|
77
78
|
|
|
78
79
|
Take a look at the simple starter kit with books integrated into the **Hello World** sample applications:
|
|
@@ -84,6 +85,8 @@ Take a look at the simple starter kit with books integrated into the **Hello Wor
|
|
|
84
85
|
|
|
85
86
|
|
|
86
87
|
|
|
88
|
+
|
|
89
|
+
|
|
87
90
|
## 💜 The Promptbook Project
|
|
88
91
|
|
|
89
92
|
Promptbook project is ecosystem of multiple projects and tools, following is a list of most important pieces of the project:
|
|
@@ -125,29 +128,22 @@ Hello world examples:
|
|
|
125
128
|
- [Hello world in Node.js](https://github.com/webgptorg/hello-world-node-js)
|
|
126
129
|
- [Hello world in Next.js](https://github.com/webgptorg/hello-world-next-js)
|
|
127
130
|
|
|
128
|
-
|
|
129
|
-
|
|
130
131
|
We also have a community of developers and users of **Promptbook**:
|
|
131
132
|
|
|
132
133
|
- [Discord community](https://discord.gg/x3QWNaa89N)
|
|
133
134
|
- [Landing page `ptbk.io`](https://ptbk.io)
|
|
134
135
|
- [Github discussions](https://github.com/webgptorg/promptbook/discussions)
|
|
135
136
|
- [LinkedIn `Promptbook`](https://linkedin.com/company/promptbook)
|
|
136
|
-
- [Facebook `Promptbook`](https://www.facebook.com/61560776453536)
|
|
137
|
+
- [Facebook `Promptbook`](https://www.facebook.com/61560776453536)
|
|
137
138
|
|
|
138
139
|
And **Promptbook.studio** branded socials:
|
|
139
140
|
|
|
140
|
-
|
|
141
|
-
|
|
142
141
|
- [Instagram `@promptbook.studio`](https://www.instagram.com/promptbook.studio/)
|
|
143
142
|
|
|
144
143
|
And **Promptujeme** sub-brand:
|
|
145
144
|
|
|
146
145
|
_/Subbrand for Czech clients/_
|
|
147
146
|
|
|
148
|
-
|
|
149
|
-
|
|
150
|
-
|
|
151
147
|
- [Promptujeme.cz](https://www.promptujeme.cz/)
|
|
152
148
|
- [Facebook `Promptujeme`](https://www.facebook.com/promptujeme/)
|
|
153
149
|
|
|
@@ -165,8 +161,6 @@ _/Sub-brand for images and graphics generated via Promptbook prompting/_
|
|
|
165
161
|
|
|
166
162
|
## 💙 The Book language
|
|
167
163
|
|
|
168
|
-
|
|
169
|
-
|
|
170
164
|
Following is the documentation and blueprint of the [Book language](https://github.com/webgptorg/book).
|
|
171
165
|
|
|
172
166
|
Book is a language that can be used to write AI applications, agents, workflows, automations, knowledgebases, translators, sheet processors, email automations and more. It allows you to harness the power of AI models in human-like terms, without the need to know the specifics and technicalities of the models.
|
|
@@ -216,8 +210,6 @@ Personas can have access to different knowledge, tools and actions. They can als
|
|
|
216
210
|
|
|
217
211
|
- [PERSONA](https://github.com/webgptorg/promptbook/blob/main/documents/commands/PERSONA.md)
|
|
218
212
|
|
|
219
|
-
|
|
220
|
-
|
|
221
213
|
### **How:** Knowledge, Instruments and Actions
|
|
222
214
|
|
|
223
215
|
The resources used by the personas are used to do the work.
|
|
@@ -306,12 +298,8 @@ The following glossary is used to clarify certain concepts:
|
|
|
306
298
|
- **Retrieval-augmented generation** is a machine learning paradigm where a model generates text by retrieving relevant information from a large database of text. This approach combines the benefits of generative models and retrieval models.
|
|
307
299
|
- **Longtail** refers to non-common or rare events, items, or entities that are not well-represented in the training data of machine learning models. Longtail items are often challenging for models to predict accurately.
|
|
308
300
|
|
|
309
|
-
|
|
310
|
-
|
|
311
301
|
_Note: This section is not complete dictionary, more list of general AI / LLM terms that has connection with Promptbook_
|
|
312
302
|
|
|
313
|
-
|
|
314
|
-
|
|
315
303
|
### 💯 Core concepts
|
|
316
304
|
|
|
317
305
|
- [📚 Collection of pipelines](https://github.com/webgptorg/promptbook/discussions/65)
|
|
@@ -416,7 +404,7 @@ See [TODO.md](./TODO.md)
|
|
|
416
404
|
<a href="https://technologickainkubace.org/en/about-technology-incubation/about-the-project/">
|
|
417
405
|
<img src="./other/partners/CI-Technology-Incubation.png" alt="Technology Incubation" height="70">
|
|
418
406
|
</a>
|
|
419
|
-
|
|
407
|
+
|
|
420
408
|
</div>
|
|
421
409
|
|
|
422
410
|
## 🖋️ Contributing
|
package/esm/index.es.js
CHANGED
|
@@ -8,8 +8,8 @@ import hexEncoder from 'crypto-js/enc-hex';
|
|
|
8
8
|
import { basename, join, dirname } from 'path';
|
|
9
9
|
import { format } from 'prettier';
|
|
10
10
|
import parserHtml from 'prettier/parser-html';
|
|
11
|
-
import { Subject } from 'rxjs';
|
|
12
11
|
import { randomBytes } from 'crypto';
|
|
12
|
+
import { Subject } from 'rxjs';
|
|
13
13
|
import sha256 from 'crypto-js/sha256';
|
|
14
14
|
import { lookup, extension } from 'mime-types';
|
|
15
15
|
import { parse, unparse } from 'papaparse';
|
|
@@ -28,7 +28,7 @@ const BOOK_LANGUAGE_VERSION = '1.0.0';
|
|
|
28
28
|
* @generated
|
|
29
29
|
* @see https://github.com/webgptorg/promptbook
|
|
30
30
|
*/
|
|
31
|
-
const PROMPTBOOK_ENGINE_VERSION = '0.88.0-
|
|
31
|
+
const PROMPTBOOK_ENGINE_VERSION = '0.88.0-12';
|
|
32
32
|
/**
|
|
33
33
|
* TODO: string_promptbook_version should be constrained to the all versions of Promptbook engine
|
|
34
34
|
* Note: [💞] Ignore a discrepancy between file name and entity name
|
|
@@ -160,7 +160,7 @@ const DEFAULT_MAX_PARALLEL_COUNT = 5; // <- TODO: [🤹♂️]
|
|
|
160
160
|
*
|
|
161
161
|
* @public exported from `@promptbook/core`
|
|
162
162
|
*/
|
|
163
|
-
const DEFAULT_MAX_EXECUTION_ATTEMPTS =
|
|
163
|
+
const DEFAULT_MAX_EXECUTION_ATTEMPTS = 10; // <- TODO: [🤹♂️]
|
|
164
164
|
// <- TODO: [🕝] Make also `BOOKS_DIRNAME_ALTERNATIVES`
|
|
165
165
|
/**
|
|
166
166
|
* Where to store the temporary downloads
|
|
@@ -2173,6 +2173,21 @@ function createCollectionFromJson(...promptbooks) {
|
|
|
2173
2173
|
return new SimplePipelineCollection(...promptbooks);
|
|
2174
2174
|
}
|
|
2175
2175
|
|
|
2176
|
+
/**
|
|
2177
|
+
* Generates random token
|
|
2178
|
+
*
|
|
2179
|
+
* Note: This function is cryptographically secure (it uses crypto.randomBytes internally)
|
|
2180
|
+
*
|
|
2181
|
+
* @private internal helper function
|
|
2182
|
+
* @returns secure random token
|
|
2183
|
+
*/
|
|
2184
|
+
function $randomToken(randomness) {
|
|
2185
|
+
return randomBytes(randomness).toString('hex');
|
|
2186
|
+
}
|
|
2187
|
+
/**
|
|
2188
|
+
* TODO: Maybe use nanoid instead https://github.com/ai/nanoid
|
|
2189
|
+
*/
|
|
2190
|
+
|
|
2176
2191
|
/**
|
|
2177
2192
|
* This error indicates errors during the execution of the pipeline
|
|
2178
2193
|
*
|
|
@@ -2180,11 +2195,17 @@ function createCollectionFromJson(...promptbooks) {
|
|
|
2180
2195
|
*/
|
|
2181
2196
|
class PipelineExecutionError extends Error {
|
|
2182
2197
|
constructor(message) {
|
|
2198
|
+
// Added id parameter
|
|
2183
2199
|
super(message);
|
|
2184
2200
|
this.name = 'PipelineExecutionError';
|
|
2201
|
+
// TODO: [🐙] DRY - Maybe $randomId
|
|
2202
|
+
this.id = `error-${$randomToken(8 /* <- TODO: To global config + Use Base58 to avoid simmilar char conflicts */)}`;
|
|
2185
2203
|
Object.setPrototypeOf(this, PipelineExecutionError.prototype);
|
|
2186
2204
|
}
|
|
2187
2205
|
}
|
|
2206
|
+
/**
|
|
2207
|
+
* TODO: !!!!!! Add id to all errors
|
|
2208
|
+
*/
|
|
2188
2209
|
|
|
2189
2210
|
/**
|
|
2190
2211
|
* Determine if the pipeline is fully prepared
|
|
@@ -2223,21 +2244,6 @@ function isPipelinePrepared(pipeline) {
|
|
|
2223
2244
|
* - [♨] Are tasks prepared
|
|
2224
2245
|
*/
|
|
2225
2246
|
|
|
2226
|
-
/**
|
|
2227
|
-
* Generates random token
|
|
2228
|
-
*
|
|
2229
|
-
* Note: This function is cryptographically secure (it uses crypto.randomBytes internally)
|
|
2230
|
-
*
|
|
2231
|
-
* @private internal helper function
|
|
2232
|
-
* @returns secure random token
|
|
2233
|
-
*/
|
|
2234
|
-
function $randomToken(randomness) {
|
|
2235
|
-
return randomBytes(randomness).toString('hex');
|
|
2236
|
-
}
|
|
2237
|
-
/**
|
|
2238
|
-
* TODO: Maybe use nanoid instead https://github.com/ai/nanoid
|
|
2239
|
-
*/
|
|
2240
|
-
|
|
2241
2247
|
/**
|
|
2242
2248
|
* Recursively converts JSON strings to JSON objects
|
|
2243
2249
|
|
|
@@ -2428,7 +2434,7 @@ const ALL_ERRORS = {
|
|
|
2428
2434
|
* @public exported from `@promptbook/utils`
|
|
2429
2435
|
*/
|
|
2430
2436
|
function deserializeError(error) {
|
|
2431
|
-
const { name, stack } = error;
|
|
2437
|
+
const { name, stack, id } = error; // Added id
|
|
2432
2438
|
let { message } = error;
|
|
2433
2439
|
let ErrorClass = ALL_ERRORS[error.name];
|
|
2434
2440
|
if (ErrorClass === undefined) {
|
|
@@ -2443,7 +2449,9 @@ function deserializeError(error) {
|
|
|
2443
2449
|
${block(stack || '')}
|
|
2444
2450
|
`);
|
|
2445
2451
|
}
|
|
2446
|
-
|
|
2452
|
+
const deserializedError = new ErrorClass(message);
|
|
2453
|
+
deserializedError.id = id; // Assign id to the error object
|
|
2454
|
+
return deserializedError;
|
|
2447
2455
|
}
|
|
2448
2456
|
|
|
2449
2457
|
/**
|
|
@@ -2493,6 +2501,7 @@ function assertsTaskSuccessful(executionResult) {
|
|
|
2493
2501
|
*/
|
|
2494
2502
|
function createTask(options) {
|
|
2495
2503
|
const { taskType, taskProcessCallback } = options;
|
|
2504
|
+
// TODO: [🐙] DRY
|
|
2496
2505
|
const taskId = `${taskType.toLowerCase().substring(0, 4)}-${$randomToken(8 /* <- TODO: To global config + Use Base58 to avoid simmilar char conflicts */)}`;
|
|
2497
2506
|
let status = 'RUNNING';
|
|
2498
2507
|
const createdAt = new Date();
|
|
@@ -2589,19 +2598,21 @@ function createTask(options) {
|
|
|
2589
2598
|
*/
|
|
2590
2599
|
function serializeError(error) {
|
|
2591
2600
|
const { name, message, stack } = error;
|
|
2601
|
+
const { id } = error;
|
|
2592
2602
|
if (!Object.keys(ALL_ERRORS).includes(name)) {
|
|
2593
2603
|
console.error(spaceTrim$1((block) => `
|
|
2594
|
-
|
|
2604
|
+
|
|
2595
2605
|
Cannot serialize error with name "${name}"
|
|
2596
2606
|
|
|
2597
2607
|
${block(stack || message)}
|
|
2598
|
-
|
|
2608
|
+
|
|
2599
2609
|
`));
|
|
2600
2610
|
}
|
|
2601
2611
|
return {
|
|
2602
2612
|
name: name,
|
|
2603
2613
|
message,
|
|
2604
2614
|
stack,
|
|
2615
|
+
id, // Include id in the serialized object
|
|
2605
2616
|
};
|
|
2606
2617
|
}
|
|
2607
2618
|
|
|
@@ -4503,6 +4514,9 @@ function countCharacters(text) {
|
|
|
4503
4514
|
text = text.replace(/\p{Extended_Pictographic}(\u{200D}\p{Extended_Pictographic})*/gu, '-');
|
|
4504
4515
|
return text.length;
|
|
4505
4516
|
}
|
|
4517
|
+
/**
|
|
4518
|
+
* TODO: [🥴] Implement counting in formats - like JSON, CSV, XML,...
|
|
4519
|
+
*/
|
|
4506
4520
|
|
|
4507
4521
|
/**
|
|
4508
4522
|
* Number of characters per standard line with 11pt Arial font size.
|
|
@@ -4534,6 +4548,9 @@ function countLines(text) {
|
|
|
4534
4548
|
const lines = text.split('\n');
|
|
4535
4549
|
return lines.reduce((count, line) => count + Math.ceil(line.length / CHARACTERS_PER_STANDARD_LINE), 0);
|
|
4536
4550
|
}
|
|
4551
|
+
/**
|
|
4552
|
+
* TODO: [🥴] Implement counting in formats - like JSON, CSV, XML,...
|
|
4553
|
+
*/
|
|
4537
4554
|
|
|
4538
4555
|
/**
|
|
4539
4556
|
* Counts number of pages in the text
|
|
@@ -4545,6 +4562,9 @@ function countLines(text) {
|
|
|
4545
4562
|
function countPages(text) {
|
|
4546
4563
|
return Math.ceil(countLines(text) / LINES_PER_STANDARD_PAGE);
|
|
4547
4564
|
}
|
|
4565
|
+
/**
|
|
4566
|
+
* TODO: [🥴] Implement counting in formats - like JSON, CSV, XML,...
|
|
4567
|
+
*/
|
|
4548
4568
|
|
|
4549
4569
|
/**
|
|
4550
4570
|
* Counts number of paragraphs in the text
|
|
@@ -4554,6 +4574,9 @@ function countPages(text) {
|
|
|
4554
4574
|
function countParagraphs(text) {
|
|
4555
4575
|
return text.split(/\n\s*\n/).filter((paragraph) => paragraph.trim() !== '').length;
|
|
4556
4576
|
}
|
|
4577
|
+
/**
|
|
4578
|
+
* TODO: [🥴] Implement counting in formats - like JSON, CSV, XML,...
|
|
4579
|
+
*/
|
|
4557
4580
|
|
|
4558
4581
|
/**
|
|
4559
4582
|
* Split text into sentences
|
|
@@ -4571,6 +4594,9 @@ function splitIntoSentences(text) {
|
|
|
4571
4594
|
function countSentences(text) {
|
|
4572
4595
|
return splitIntoSentences(text).length;
|
|
4573
4596
|
}
|
|
4597
|
+
/**
|
|
4598
|
+
* TODO: [🥴] Implement counting in formats - like JSON, CSV, XML,...
|
|
4599
|
+
*/
|
|
4574
4600
|
|
|
4575
4601
|
/**
|
|
4576
4602
|
* Counts number of words in the text
|
|
@@ -4584,6 +4610,9 @@ function countWords(text) {
|
|
|
4584
4610
|
text = text.replace(/([a-z])([A-Z])/g, '$1 $2');
|
|
4585
4611
|
return text.split(/[^a-zа-я0-9]+/i).filter((word) => word.length > 0).length;
|
|
4586
4612
|
}
|
|
4613
|
+
/**
|
|
4614
|
+
* TODO: [🥴] Implement counting in formats - like JSON, CSV, XML,...
|
|
4615
|
+
*/
|
|
4587
4616
|
|
|
4588
4617
|
/**
|
|
4589
4618
|
* Index of all counter functions
|