@promptbook/remote-server 0.88.0-9 → 0.88.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +35 -18
- package/esm/index.es.js +52 -23
- package/esm/index.es.js.map +1 -1
- package/esm/typings/src/config.d.ts +1 -1
- package/esm/typings/src/errors/PipelineExecutionError.d.ts +5 -0
- package/esm/typings/src/errors/utils/ErrorJson.d.ts +5 -0
- package/esm/typings/src/utils/expectation-counters/countCharacters.d.ts +3 -0
- package/esm/typings/src/utils/expectation-counters/countLines.d.ts +3 -0
- package/esm/typings/src/utils/expectation-counters/countPages.d.ts +3 -0
- package/esm/typings/src/utils/expectation-counters/countParagraphs.d.ts +3 -0
- package/esm/typings/src/utils/expectation-counters/countSentences.d.ts +3 -0
- package/esm/typings/src/utils/expectation-counters/countWords.d.ts +3 -0
- package/package.json +2 -2
- package/umd/index.umd.js +55 -26
- package/umd/index.umd.js.map +1 -1
package/README.md
CHANGED
|
@@ -23,10 +23,6 @@
|
|
|
23
23
|
|
|
24
24
|
|
|
25
25
|
|
|
26
|
-
<blockquote style="color: #ff8811">
|
|
27
|
-
<b>⚠ Warning:</b> This is a pre-release version of the library. It is not yet ready for production use. Please look at <a href="https://www.npmjs.com/package/@promptbook/core?activeTab=versions">latest stable release</a>.
|
|
28
|
-
</blockquote>
|
|
29
|
-
|
|
30
26
|
## 📦 Package `@promptbook/remote-server`
|
|
31
27
|
|
|
32
28
|
- Promptbooks are [divided into several](#-packages) packages, all are published from [single monorepo](https://github.com/webgptorg/promptbook).
|
|
@@ -58,6 +54,8 @@ Rest of the documentation is common for **entire promptbook ecosystem**:
|
|
|
58
54
|
|
|
59
55
|
During the computer revolution, we have seen [multiple generations of computer languages](https://github.com/webgptorg/promptbook/discussions/180), from the physical rewiring of the vacuum tubes through low-level machine code to the high-level languages like Python or JavaScript. And now, we're on the edge of the **next revolution**!
|
|
60
56
|
|
|
57
|
+
|
|
58
|
+
|
|
61
59
|
It's a revolution of writing software in **plain human language** that is understandable and executable by both humans and machines – and it's going to change everything!
|
|
62
60
|
|
|
63
61
|
The incredible growth in power of microprocessors and the Moore's Law have been the driving force behind the ever-more powerful languages, and it's been an amazing journey! Similarly, the large language models (like GPT or Claude) are the next big thing in language technology, and they're set to transform the way we interact with computers.
|
|
@@ -68,6 +66,9 @@ This shift is going to happen, whether we are ready for it or not. Our mission i
|
|
|
68
66
|
|
|
69
67
|
|
|
70
68
|
|
|
69
|
+
|
|
70
|
+
|
|
71
|
+
|
|
71
72
|
## 🚀 Get started
|
|
72
73
|
|
|
73
74
|
Take a look at the simple starter kit with books integrated into the **Hello World** sample applications:
|
|
@@ -79,6 +80,8 @@ Take a look at the simple starter kit with books integrated into the **Hello Wor
|
|
|
79
80
|
|
|
80
81
|
|
|
81
82
|
|
|
83
|
+
|
|
84
|
+
|
|
82
85
|
## 💜 The Promptbook Project
|
|
83
86
|
|
|
84
87
|
Promptbook project is ecosystem of multiple projects and tools, following is a list of most important pieces of the project:
|
|
@@ -114,22 +117,35 @@ Promptbook project is ecosystem of multiple projects and tools, following is a l
|
|
|
114
117
|
</tbody>
|
|
115
118
|
</table>
|
|
116
119
|
|
|
120
|
+
Hello world examples:
|
|
121
|
+
|
|
122
|
+
- [Hello world](https://github.com/webgptorg/hello-world)
|
|
123
|
+
- [Hello world in Node.js](https://github.com/webgptorg/hello-world-node-js)
|
|
124
|
+
- [Hello world in Next.js](https://github.com/webgptorg/hello-world-next-js)
|
|
125
|
+
|
|
126
|
+
|
|
127
|
+
|
|
117
128
|
We also have a community of developers and users of **Promptbook**:
|
|
118
129
|
|
|
119
130
|
- [Discord community](https://discord.gg/x3QWNaa89N)
|
|
120
131
|
- [Landing page `ptbk.io`](https://ptbk.io)
|
|
121
132
|
- [Github discussions](https://github.com/webgptorg/promptbook/discussions)
|
|
122
133
|
- [LinkedIn `Promptbook`](https://linkedin.com/company/promptbook)
|
|
123
|
-
- [Facebook `Promptbook`](https://www.facebook.com/61560776453536)
|
|
134
|
+
- [Facebook `Promptbook`](https://www.facebook.com/61560776453536)
|
|
124
135
|
|
|
125
136
|
And **Promptbook.studio** branded socials:
|
|
126
137
|
|
|
138
|
+
|
|
139
|
+
|
|
127
140
|
- [Instagram `@promptbook.studio`](https://www.instagram.com/promptbook.studio/)
|
|
128
141
|
|
|
129
142
|
And **Promptujeme** sub-brand:
|
|
130
143
|
|
|
131
144
|
_/Subbrand for Czech clients/_
|
|
132
145
|
|
|
146
|
+
|
|
147
|
+
|
|
148
|
+
|
|
133
149
|
- [Promptujeme.cz](https://www.promptujeme.cz/)
|
|
134
150
|
- [Facebook `Promptujeme`](https://www.facebook.com/promptujeme/)
|
|
135
151
|
|
|
@@ -147,6 +163,8 @@ _/Sub-brand for images and graphics generated via Promptbook prompting/_
|
|
|
147
163
|
|
|
148
164
|
## 💙 The Book language
|
|
149
165
|
|
|
166
|
+
|
|
167
|
+
|
|
150
168
|
Following is the documentation and blueprint of the [Book language](https://github.com/webgptorg/book).
|
|
151
169
|
|
|
152
170
|
Book is a language that can be used to write AI applications, agents, workflows, automations, knowledgebases, translators, sheet processors, email automations and more. It allows you to harness the power of AI models in human-like terms, without the need to know the specifics and technicalities of the models.
|
|
@@ -196,6 +214,8 @@ Personas can have access to different knowledge, tools and actions. They can als
|
|
|
196
214
|
|
|
197
215
|
- [PERSONA](https://github.com/webgptorg/promptbook/blob/main/documents/commands/PERSONA.md)
|
|
198
216
|
|
|
217
|
+
|
|
218
|
+
|
|
199
219
|
### **How:** Knowledge, Instruments and Actions
|
|
200
220
|
|
|
201
221
|
The resources used by the personas are used to do the work.
|
|
@@ -271,11 +291,9 @@ Or you can install them separately:
|
|
|
271
291
|
|
|
272
292
|
## 📚 Dictionary
|
|
273
293
|
|
|
274
|
-
### 📚 Dictionary
|
|
275
|
-
|
|
276
294
|
The following glossary is used to clarify certain concepts:
|
|
277
295
|
|
|
278
|
-
|
|
296
|
+
### General LLM / AI terms
|
|
279
297
|
|
|
280
298
|
- **Prompt drift** is a phenomenon where the AI model starts to generate outputs that are not aligned with the original prompt. This can happen due to the model's training data, the prompt's wording, or the model's architecture.
|
|
281
299
|
- **Pipeline, workflow or chain** is a sequence of tasks that are executed in a specific order. In the context of AI, a pipeline can refer to a sequence of AI models that are used to process data.
|
|
@@ -286,9 +304,13 @@ The following glossary is used to clarify certain concepts:
|
|
|
286
304
|
- **Retrieval-augmented generation** is a machine learning paradigm where a model generates text by retrieving relevant information from a large database of text. This approach combines the benefits of generative models and retrieval models.
|
|
287
305
|
- **Longtail** refers to non-common or rare events, items, or entities that are not well-represented in the training data of machine learning models. Longtail items are often challenging for models to predict accurately.
|
|
288
306
|
|
|
289
|
-
_Note: Thos section is not complete dictionary, more list of general AI / LLM terms that has connection with Promptbook_
|
|
290
307
|
|
|
291
|
-
|
|
308
|
+
|
|
309
|
+
_Note: This section is not complete dictionary, more list of general AI / LLM terms that has connection with Promptbook_
|
|
310
|
+
|
|
311
|
+
|
|
312
|
+
|
|
313
|
+
### 💯 Core concepts
|
|
292
314
|
|
|
293
315
|
- [📚 Collection of pipelines](https://github.com/webgptorg/promptbook/discussions/65)
|
|
294
316
|
- [📯 Pipeline](https://github.com/webgptorg/promptbook/discussions/64)
|
|
@@ -301,7 +323,7 @@ _Note: Thos section is not complete dictionary, more list of general AI / LLM te
|
|
|
301
323
|
- [🔣 Words not tokens](https://github.com/webgptorg/promptbook/discussions/29)
|
|
302
324
|
- [☯ Separation of concerns](https://github.com/webgptorg/promptbook/discussions/32)
|
|
303
325
|
|
|
304
|
-
|
|
326
|
+
#### Advanced concepts
|
|
305
327
|
|
|
306
328
|
- [📚 Knowledge (Retrieval-augmented generation)](https://github.com/webgptorg/promptbook/discussions/41)
|
|
307
329
|
- [🌏 Remote server](https://github.com/webgptorg/promptbook/discussions/89)
|
|
@@ -316,11 +338,6 @@ _Note: Thos section is not complete dictionary, more list of general AI / LLM te
|
|
|
316
338
|
- [👮 Agent adversary expectations](https://github.com/webgptorg/promptbook/discussions/39)
|
|
317
339
|
- [view more](https://github.com/webgptorg/promptbook/discussions/categories/concepts)
|
|
318
340
|
|
|
319
|
-
### Terms specific to Promptbook TypeScript implementation
|
|
320
|
-
|
|
321
|
-
- Anonymous mode
|
|
322
|
-
- Application mode
|
|
323
|
-
|
|
324
341
|
|
|
325
342
|
|
|
326
343
|
## 🚂 Promptbook Engine
|
|
@@ -391,11 +408,11 @@ See [TODO.md](./TODO.md)
|
|
|
391
408
|
<div style="display: flex; align-items: center; gap: 20px;">
|
|
392
409
|
|
|
393
410
|
<a href="https://promptbook.studio/">
|
|
394
|
-
<img src="./design/promptbook-studio-logo.png" alt="Partner 3" height="
|
|
411
|
+
<img src="./design/promptbook-studio-logo.png" alt="Partner 3" height="70">
|
|
395
412
|
</a>
|
|
396
413
|
|
|
397
414
|
<a href="https://technologickainkubace.org/en/about-technology-incubation/about-the-project/">
|
|
398
|
-
<img src="./other/partners/CI-Technology-Incubation.png" alt="Technology Incubation" height="
|
|
415
|
+
<img src="./other/partners/CI-Technology-Incubation.png" alt="Technology Incubation" height="70">
|
|
399
416
|
</a>
|
|
400
417
|
|
|
401
418
|
</div>
|
package/esm/index.es.js
CHANGED
|
@@ -4,11 +4,11 @@ import http from 'http';
|
|
|
4
4
|
import { Server } from 'socket.io';
|
|
5
5
|
import spaceTrim$1, { spaceTrim } from 'spacetrim';
|
|
6
6
|
import { forTime } from 'waitasecond';
|
|
7
|
+
import { randomBytes } from 'crypto';
|
|
7
8
|
import { spawn } from 'child_process';
|
|
8
9
|
import { stat, access, constants, readFile, writeFile, readdir, mkdir } from 'fs/promises';
|
|
9
10
|
import { join, basename, dirname } from 'path';
|
|
10
11
|
import { Subject } from 'rxjs';
|
|
11
|
-
import { randomBytes } from 'crypto';
|
|
12
12
|
import { format } from 'prettier';
|
|
13
13
|
import parserHtml from 'prettier/parser-html';
|
|
14
14
|
import hexEncoder from 'crypto-js/enc-hex';
|
|
@@ -31,7 +31,7 @@ const BOOK_LANGUAGE_VERSION = '1.0.0';
|
|
|
31
31
|
* @generated
|
|
32
32
|
* @see https://github.com/webgptorg/promptbook
|
|
33
33
|
*/
|
|
34
|
-
const PROMPTBOOK_ENGINE_VERSION = '0.88.0
|
|
34
|
+
const PROMPTBOOK_ENGINE_VERSION = '0.88.0';
|
|
35
35
|
/**
|
|
36
36
|
* TODO: string_promptbook_version should be constrained to the all versions of Promptbook engine
|
|
37
37
|
* Note: [💞] Ignore a discrepancy between file name and entity name
|
|
@@ -154,7 +154,7 @@ const DEFAULT_MAX_PARALLEL_COUNT = 5; // <- TODO: [🤹♂️]
|
|
|
154
154
|
*
|
|
155
155
|
* @public exported from `@promptbook/core`
|
|
156
156
|
*/
|
|
157
|
-
const DEFAULT_MAX_EXECUTION_ATTEMPTS =
|
|
157
|
+
const DEFAULT_MAX_EXECUTION_ATTEMPTS = 10; // <- TODO: [🤹♂️]
|
|
158
158
|
// <- TODO: [🕝] Make also `BOOKS_DIRNAME_ALTERNATIVES`
|
|
159
159
|
/**
|
|
160
160
|
* Where to store the temporary downloads
|
|
@@ -210,6 +210,21 @@ true);
|
|
|
210
210
|
* TODO: [🧠][🧜♂️] Maybe join remoteUrl and path into single value
|
|
211
211
|
*/
|
|
212
212
|
|
|
213
|
+
/**
|
|
214
|
+
* Generates random token
|
|
215
|
+
*
|
|
216
|
+
* Note: This function is cryptographically secure (it uses crypto.randomBytes internally)
|
|
217
|
+
*
|
|
218
|
+
* @private internal helper function
|
|
219
|
+
* @returns secure random token
|
|
220
|
+
*/
|
|
221
|
+
function $randomToken(randomness) {
|
|
222
|
+
return randomBytes(randomness).toString('hex');
|
|
223
|
+
}
|
|
224
|
+
/**
|
|
225
|
+
* TODO: Maybe use nanoid instead https://github.com/ai/nanoid
|
|
226
|
+
*/
|
|
227
|
+
|
|
213
228
|
/**
|
|
214
229
|
* This error indicates errors during the execution of the pipeline
|
|
215
230
|
*
|
|
@@ -217,11 +232,17 @@ true);
|
|
|
217
232
|
*/
|
|
218
233
|
class PipelineExecutionError extends Error {
|
|
219
234
|
constructor(message) {
|
|
235
|
+
// Added id parameter
|
|
220
236
|
super(message);
|
|
221
237
|
this.name = 'PipelineExecutionError';
|
|
238
|
+
// TODO: [🐙] DRY - Maybe $randomId
|
|
239
|
+
this.id = `error-${$randomToken(8 /* <- TODO: To global config + Use Base58 to avoid simmilar char conflicts */)}`;
|
|
222
240
|
Object.setPrototypeOf(this, PipelineExecutionError.prototype);
|
|
223
241
|
}
|
|
224
242
|
}
|
|
243
|
+
/**
|
|
244
|
+
* TODO: !!!!!! Add id to all errors
|
|
245
|
+
*/
|
|
225
246
|
|
|
226
247
|
/**
|
|
227
248
|
* This error indicates problems parsing the format value
|
|
@@ -551,19 +572,21 @@ const ALL_ERRORS = {
|
|
|
551
572
|
*/
|
|
552
573
|
function serializeError(error) {
|
|
553
574
|
const { name, message, stack } = error;
|
|
575
|
+
const { id } = error;
|
|
554
576
|
if (!Object.keys(ALL_ERRORS).includes(name)) {
|
|
555
577
|
console.error(spaceTrim$1((block) => `
|
|
556
|
-
|
|
578
|
+
|
|
557
579
|
Cannot serialize error with name "${name}"
|
|
558
580
|
|
|
559
581
|
${block(stack || message)}
|
|
560
|
-
|
|
582
|
+
|
|
561
583
|
`));
|
|
562
584
|
}
|
|
563
585
|
return {
|
|
564
586
|
name: name,
|
|
565
587
|
message,
|
|
566
588
|
stack,
|
|
589
|
+
id, // Include id in the serialized object
|
|
567
590
|
};
|
|
568
591
|
}
|
|
569
592
|
|
|
@@ -1706,21 +1729,6 @@ function isPipelinePrepared(pipeline) {
|
|
|
1706
1729
|
* - [♨] Are tasks prepared
|
|
1707
1730
|
*/
|
|
1708
1731
|
|
|
1709
|
-
/**
|
|
1710
|
-
* Generates random token
|
|
1711
|
-
*
|
|
1712
|
-
* Note: This function is cryptographically secure (it uses crypto.randomBytes internally)
|
|
1713
|
-
*
|
|
1714
|
-
* @private internal helper function
|
|
1715
|
-
* @returns secure random token
|
|
1716
|
-
*/
|
|
1717
|
-
function $randomToken(randomness) {
|
|
1718
|
-
return randomBytes(randomness).toString('hex');
|
|
1719
|
-
}
|
|
1720
|
-
/**
|
|
1721
|
-
* TODO: Maybe use nanoid instead https://github.com/ai/nanoid
|
|
1722
|
-
*/
|
|
1723
|
-
|
|
1724
1732
|
/**
|
|
1725
1733
|
* Function isValidJsonString will tell you if the string is valid JSON or not
|
|
1726
1734
|
*
|
|
@@ -1778,7 +1786,7 @@ function jsonStringsToJsons(object) {
|
|
|
1778
1786
|
* @public exported from `@promptbook/utils`
|
|
1779
1787
|
*/
|
|
1780
1788
|
function deserializeError(error) {
|
|
1781
|
-
const { name, stack } = error;
|
|
1789
|
+
const { name, stack, id } = error; // Added id
|
|
1782
1790
|
let { message } = error;
|
|
1783
1791
|
let ErrorClass = ALL_ERRORS[error.name];
|
|
1784
1792
|
if (ErrorClass === undefined) {
|
|
@@ -1793,7 +1801,9 @@ function deserializeError(error) {
|
|
|
1793
1801
|
${block(stack || '')}
|
|
1794
1802
|
`);
|
|
1795
1803
|
}
|
|
1796
|
-
|
|
1804
|
+
const deserializedError = new ErrorClass(message);
|
|
1805
|
+
deserializedError.id = id; // Assign id to the error object
|
|
1806
|
+
return deserializedError;
|
|
1797
1807
|
}
|
|
1798
1808
|
|
|
1799
1809
|
/**
|
|
@@ -1843,6 +1853,7 @@ function assertsTaskSuccessful(executionResult) {
|
|
|
1843
1853
|
*/
|
|
1844
1854
|
function createTask(options) {
|
|
1845
1855
|
const { taskType, taskProcessCallback } = options;
|
|
1856
|
+
// TODO: [🐙] DRY
|
|
1846
1857
|
const taskId = `${taskType.toLowerCase().substring(0, 4)}-${$randomToken(8 /* <- TODO: To global config + Use Base58 to avoid simmilar char conflicts */)}`;
|
|
1847
1858
|
let status = 'RUNNING';
|
|
1848
1859
|
const createdAt = new Date();
|
|
@@ -1875,7 +1886,7 @@ function createTask(options) {
|
|
|
1875
1886
|
assertsTaskSuccessful(executionResult);
|
|
1876
1887
|
status = 'FINISHED';
|
|
1877
1888
|
currentValue = jsonStringsToJsons(executionResult);
|
|
1878
|
-
// <- TODO:
|
|
1889
|
+
// <- TODO: [🧠] Is this a good idea to convert JSON strins to JSONs?
|
|
1879
1890
|
partialResultSubject.next(executionResult);
|
|
1880
1891
|
}
|
|
1881
1892
|
catch (error) {
|
|
@@ -4691,6 +4702,9 @@ function countCharacters(text) {
|
|
|
4691
4702
|
text = text.replace(/\p{Extended_Pictographic}(\u{200D}\p{Extended_Pictographic})*/gu, '-');
|
|
4692
4703
|
return text.length;
|
|
4693
4704
|
}
|
|
4705
|
+
/**
|
|
4706
|
+
* TODO: [🥴] Implement counting in formats - like JSON, CSV, XML,...
|
|
4707
|
+
*/
|
|
4694
4708
|
|
|
4695
4709
|
/**
|
|
4696
4710
|
* Number of characters per standard line with 11pt Arial font size.
|
|
@@ -4722,6 +4736,9 @@ function countLines(text) {
|
|
|
4722
4736
|
const lines = text.split('\n');
|
|
4723
4737
|
return lines.reduce((count, line) => count + Math.ceil(line.length / CHARACTERS_PER_STANDARD_LINE), 0);
|
|
4724
4738
|
}
|
|
4739
|
+
/**
|
|
4740
|
+
* TODO: [🥴] Implement counting in formats - like JSON, CSV, XML,...
|
|
4741
|
+
*/
|
|
4725
4742
|
|
|
4726
4743
|
/**
|
|
4727
4744
|
* Counts number of pages in the text
|
|
@@ -4733,6 +4750,9 @@ function countLines(text) {
|
|
|
4733
4750
|
function countPages(text) {
|
|
4734
4751
|
return Math.ceil(countLines(text) / LINES_PER_STANDARD_PAGE);
|
|
4735
4752
|
}
|
|
4753
|
+
/**
|
|
4754
|
+
* TODO: [🥴] Implement counting in formats - like JSON, CSV, XML,...
|
|
4755
|
+
*/
|
|
4736
4756
|
|
|
4737
4757
|
/**
|
|
4738
4758
|
* Counts number of paragraphs in the text
|
|
@@ -4742,6 +4762,9 @@ function countPages(text) {
|
|
|
4742
4762
|
function countParagraphs(text) {
|
|
4743
4763
|
return text.split(/\n\s*\n/).filter((paragraph) => paragraph.trim() !== '').length;
|
|
4744
4764
|
}
|
|
4765
|
+
/**
|
|
4766
|
+
* TODO: [🥴] Implement counting in formats - like JSON, CSV, XML,...
|
|
4767
|
+
*/
|
|
4745
4768
|
|
|
4746
4769
|
/**
|
|
4747
4770
|
* Split text into sentences
|
|
@@ -4759,6 +4782,9 @@ function splitIntoSentences(text) {
|
|
|
4759
4782
|
function countSentences(text) {
|
|
4760
4783
|
return splitIntoSentences(text).length;
|
|
4761
4784
|
}
|
|
4785
|
+
/**
|
|
4786
|
+
* TODO: [🥴] Implement counting in formats - like JSON, CSV, XML,...
|
|
4787
|
+
*/
|
|
4762
4788
|
|
|
4763
4789
|
/**
|
|
4764
4790
|
* Counts number of words in the text
|
|
@@ -4772,6 +4798,9 @@ function countWords(text) {
|
|
|
4772
4798
|
text = text.replace(/([a-z])([A-Z])/g, '$1 $2');
|
|
4773
4799
|
return text.split(/[^a-zа-я0-9]+/i).filter((word) => word.length > 0).length;
|
|
4774
4800
|
}
|
|
4801
|
+
/**
|
|
4802
|
+
* TODO: [🥴] Implement counting in formats - like JSON, CSV, XML,...
|
|
4803
|
+
*/
|
|
4775
4804
|
|
|
4776
4805
|
/**
|
|
4777
4806
|
* Index of all counter functions
|