@promptbook/pdf 0.86.31 → 0.88.0-10
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +21 -43
- package/esm/index.es.js +83 -10
- package/esm/index.es.js.map +1 -1
- package/esm/typings/src/_packages/node.index.d.ts +2 -0
- package/esm/typings/src/_packages/types.index.d.ts +2 -0
- package/esm/typings/src/_packages/utils.index.d.ts +2 -0
- package/esm/typings/src/cli/cli-commands/common/handleActionErrors.d.ts +11 -0
- package/esm/typings/src/execution/ExecutionTask.d.ts +24 -0
- package/esm/typings/src/scrapers/_common/register/$provideScriptingForNode.d.ts +11 -0
- package/esm/typings/src/scripting/javascript/JavascriptEvalExecutionTools.d.ts +1 -1
- package/esm/typings/src/scripting/javascript/JavascriptExecutionTools.d.ts +1 -1
- package/esm/typings/src/scripting/javascript/postprocessing-functions.d.ts +1 -1
- package/esm/typings/src/scripting/javascript/utils/extractVariablesFromJavascript.d.ts +1 -1
- package/esm/typings/src/utils/serialization/jsonStringsToJsons.d.ts +9 -0
- package/esm/typings/src/utils/serialization/jsonStringsToJsons.test.d.ts +1 -0
- package/package.json +2 -2
- package/umd/index.umd.js +82 -9
- package/umd/index.umd.js.map +1 -1
- /package/esm/typings/src/_packages/{execute-javascript.index.d.ts → javascript.index.d.ts} +0 -0
package/README.md
CHANGED
|
@@ -23,6 +23,10 @@
|
|
|
23
23
|
|
|
24
24
|
|
|
25
25
|
|
|
26
|
+
<blockquote style="color: #ff8811">
|
|
27
|
+
<b>⚠ Warning:</b> This is a pre-release version of the library. It is not yet ready for production use. Please look at <a href="https://www.npmjs.com/package/@promptbook/core?activeTab=versions">latest stable release</a>.
|
|
28
|
+
</blockquote>
|
|
29
|
+
|
|
26
30
|
## 📦 Package `@promptbook/pdf`
|
|
27
31
|
|
|
28
32
|
- Promptbooks are [divided into several](#-packages) packages, all are published from [single monorepo](https://github.com/webgptorg/promptbook).
|
|
@@ -56,8 +60,6 @@ Rest of the documentation is common for **entire promptbook ecosystem**:
|
|
|
56
60
|
|
|
57
61
|
During the computer revolution, we have seen [multiple generations of computer languages](https://github.com/webgptorg/promptbook/discussions/180), from the physical rewiring of the vacuum tubes through low-level machine code to the high-level languages like Python or JavaScript. And now, we're on the edge of the **next revolution**!
|
|
58
62
|
|
|
59
|
-
|
|
60
|
-
|
|
61
63
|
It's a revolution of writing software in **plain human language** that is understandable and executable by both humans and machines – and it's going to change everything!
|
|
62
64
|
|
|
63
65
|
The incredible growth in power of microprocessors and the Moore's Law have been the driving force behind the ever-more powerful languages, and it's been an amazing journey! Similarly, the large language models (like GPT or Claude) are the next big thing in language technology, and they're set to transform the way we interact with computers.
|
|
@@ -114,27 +116,28 @@ Promptbook project is ecosystem of multiple projects and tools, following is a l
|
|
|
114
116
|
</tbody>
|
|
115
117
|
</table>
|
|
116
118
|
|
|
119
|
+
Hello world examples:
|
|
120
|
+
|
|
121
|
+
- [Hello world](https://github.com/webgptorg/hello-world)
|
|
122
|
+
- [Hello world in Node.js](https://github.com/webgptorg/hello-world-node-js)
|
|
123
|
+
- [Hello world in Next.js](https://github.com/webgptorg/hello-world-next-js)
|
|
124
|
+
|
|
117
125
|
We also have a community of developers and users of **Promptbook**:
|
|
118
126
|
|
|
119
127
|
- [Discord community](https://discord.gg/x3QWNaa89N)
|
|
120
128
|
- [Landing page `ptbk.io`](https://ptbk.io)
|
|
121
129
|
- [Github discussions](https://github.com/webgptorg/promptbook/discussions)
|
|
122
130
|
- [LinkedIn `Promptbook`](https://linkedin.com/company/promptbook)
|
|
123
|
-
- [Facebook `Promptbook`](https://www.facebook.com/61560776453536)
|
|
131
|
+
- [Facebook `Promptbook`](https://www.facebook.com/61560776453536)
|
|
124
132
|
|
|
125
133
|
And **Promptbook.studio** branded socials:
|
|
126
134
|
|
|
127
|
-
|
|
128
|
-
|
|
129
135
|
- [Instagram `@promptbook.studio`](https://www.instagram.com/promptbook.studio/)
|
|
130
136
|
|
|
131
137
|
And **Promptujeme** sub-brand:
|
|
132
138
|
|
|
133
139
|
_/Subbrand for Czech clients/_
|
|
134
140
|
|
|
135
|
-
|
|
136
|
-
|
|
137
|
-
|
|
138
141
|
- [Promptujeme.cz](https://www.promptujeme.cz/)
|
|
139
142
|
- [Facebook `Promptujeme`](https://www.facebook.com/promptujeme/)
|
|
140
143
|
|
|
@@ -152,8 +155,6 @@ _/Sub-brand for images and graphics generated via Promptbook prompting/_
|
|
|
152
155
|
|
|
153
156
|
## 💙 The Book language
|
|
154
157
|
|
|
155
|
-
|
|
156
|
-
|
|
157
158
|
Following is the documentation and blueprint of the [Book language](https://github.com/webgptorg/book).
|
|
158
159
|
|
|
159
160
|
Book is a language that can be used to write AI applications, agents, workflows, automations, knowledgebases, translators, sheet processors, email automations and more. It allows you to harness the power of AI models in human-like terms, without the need to know the specifics and technicalities of the models.
|
|
@@ -203,8 +204,6 @@ Personas can have access to different knowledge, tools and actions. They can als
|
|
|
203
204
|
|
|
204
205
|
- [PERSONA](https://github.com/webgptorg/promptbook/blob/main/documents/commands/PERSONA.md)
|
|
205
206
|
|
|
206
|
-
|
|
207
|
-
|
|
208
207
|
### **How:** Knowledge, Instruments and Actions
|
|
209
208
|
|
|
210
209
|
The resources used by the personas are used to do the work.
|
|
@@ -251,7 +250,7 @@ Or you can install them separately:
|
|
|
251
250
|
- ⭐ **[@promptbook/utils](https://www.npmjs.com/package/@promptbook/utils)** - Utility functions used in the library but also useful for individual use in preprocessing and postprocessing LLM inputs and outputs
|
|
252
251
|
- **[@promptbook/markdown-utils](https://www.npmjs.com/package/@promptbook/markdown-utils)** - Utility functions used for processing markdown
|
|
253
252
|
- _(Not finished)_ **[@promptbook/wizzard](https://www.npmjs.com/package/@promptbook/wizzard)** - Wizard for creating+running promptbooks in single line
|
|
254
|
-
- **[@promptbook/
|
|
253
|
+
- **[@promptbook/javascript](https://www.npmjs.com/package/@promptbook/javascript)** - Execution tools for javascript inside promptbooks
|
|
255
254
|
- **[@promptbook/openai](https://www.npmjs.com/package/@promptbook/openai)** - Execution tools for OpenAI API, wrapper around OpenAI SDK
|
|
256
255
|
- **[@promptbook/anthropic-claude](https://www.npmjs.com/package/@promptbook/anthropic-claude)** - Execution tools for Anthropic Claude API, wrapper around Anthropic Claude SDK
|
|
257
256
|
- **[@promptbook/vercel](https://www.npmjs.com/package/@promptbook/vercel)** - Adapter for Vercel functionalities
|
|
@@ -280,16 +279,9 @@ Or you can install them separately:
|
|
|
280
279
|
|
|
281
280
|
## 📚 Dictionary
|
|
282
281
|
|
|
283
|
-
|
|
284
|
-
|
|
285
|
-
|
|
286
|
-
|
|
287
|
-
|
|
288
|
-
### 📚 Dictionary
|
|
289
|
-
|
|
290
282
|
The following glossary is used to clarify certain concepts:
|
|
291
283
|
|
|
292
|
-
|
|
284
|
+
### General LLM / AI terms
|
|
293
285
|
|
|
294
286
|
- **Prompt drift** is a phenomenon where the AI model starts to generate outputs that are not aligned with the original prompt. This can happen due to the model's training data, the prompt's wording, or the model's architecture.
|
|
295
287
|
- **Pipeline, workflow or chain** is a sequence of tasks that are executed in a specific order. In the context of AI, a pipeline can refer to a sequence of AI models that are used to process data.
|
|
@@ -300,13 +292,9 @@ The following glossary is used to clarify certain concepts:
|
|
|
300
292
|
- **Retrieval-augmented generation** is a machine learning paradigm where a model generates text by retrieving relevant information from a large database of text. This approach combines the benefits of generative models and retrieval models.
|
|
301
293
|
- **Longtail** refers to non-common or rare events, items, or entities that are not well-represented in the training data of machine learning models. Longtail items are often challenging for models to predict accurately.
|
|
302
294
|
|
|
295
|
+
_Note: This section is not complete dictionary, more list of general AI / LLM terms that has connection with Promptbook_
|
|
303
296
|
|
|
304
|
-
|
|
305
|
-
_Note: Thos section is not complete dictionary, more list of general AI / LLM terms that has connection with Promptbook_
|
|
306
|
-
|
|
307
|
-
|
|
308
|
-
|
|
309
|
-
#### 💯 Core concepts
|
|
297
|
+
### 💯 Core concepts
|
|
310
298
|
|
|
311
299
|
- [📚 Collection of pipelines](https://github.com/webgptorg/promptbook/discussions/65)
|
|
312
300
|
- [📯 Pipeline](https://github.com/webgptorg/promptbook/discussions/64)
|
|
@@ -319,7 +307,7 @@ _Note: Thos section is not complete dictionary, more list of general AI / LLM te
|
|
|
319
307
|
- [🔣 Words not tokens](https://github.com/webgptorg/promptbook/discussions/29)
|
|
320
308
|
- [☯ Separation of concerns](https://github.com/webgptorg/promptbook/discussions/32)
|
|
321
309
|
|
|
322
|
-
|
|
310
|
+
#### Advanced concepts
|
|
323
311
|
|
|
324
312
|
- [📚 Knowledge (Retrieval-augmented generation)](https://github.com/webgptorg/promptbook/discussions/41)
|
|
325
313
|
- [🌏 Remote server](https://github.com/webgptorg/promptbook/discussions/89)
|
|
@@ -336,17 +324,9 @@ _Note: Thos section is not complete dictionary, more list of general AI / LLM te
|
|
|
336
324
|
|
|
337
325
|
|
|
338
326
|
|
|
339
|
-
|
|
327
|
+
## 🚂 Promptbook Engine
|
|
340
328
|
|
|
341
|
-
-
|
|
342
|
-
- Application mode
|
|
343
|
-
|
|
344
|
-
|
|
345
|
-
|
|
346
|
-
## 🔌 Usage in Typescript / Javascript
|
|
347
|
-
|
|
348
|
-
- [Simple usage](./examples/usage/simple-script)
|
|
349
|
-
- [Usage with client and remote server](./examples/usage/remote)
|
|
329
|
+

|
|
350
330
|
|
|
351
331
|
## ➕➖ When to use Promptbook?
|
|
352
332
|
|
|
@@ -407,20 +387,18 @@ Promptbook project is under [BUSL 1.1 is an SPDX license](https://spdx.org/licen
|
|
|
407
387
|
|
|
408
388
|
See [TODO.md](./TODO.md)
|
|
409
389
|
|
|
410
|
-
|
|
411
|
-
|
|
412
390
|
## 🤝 Partners
|
|
413
391
|
|
|
414
392
|
<div style="display: flex; align-items: center; gap: 20px;">
|
|
415
393
|
|
|
416
394
|
<a href="https://promptbook.studio/">
|
|
417
|
-
<img src="./design/promptbook-studio-logo.png" alt="Partner 3" height="
|
|
395
|
+
<img src="./design/promptbook-studio-logo.png" alt="Partner 3" height="70">
|
|
418
396
|
</a>
|
|
419
397
|
|
|
420
398
|
<a href="https://technologickainkubace.org/en/about-technology-incubation/about-the-project/">
|
|
421
|
-
<img src="./other/partners/CI-Technology-Incubation.png" alt="Technology Incubation" height="
|
|
399
|
+
<img src="./other/partners/CI-Technology-Incubation.png" alt="Technology Incubation" height="70">
|
|
422
400
|
</a>
|
|
423
|
-
|
|
401
|
+
|
|
424
402
|
</div>
|
|
425
403
|
|
|
426
404
|
## 🖋️ Contributing
|
package/esm/index.es.js
CHANGED
|
@@ -5,7 +5,7 @@ import hexEncoder from 'crypto-js/enc-hex';
|
|
|
5
5
|
import { basename, join, dirname } from 'path';
|
|
6
6
|
import { format } from 'prettier';
|
|
7
7
|
import parserHtml from 'prettier/parser-html';
|
|
8
|
-
import {
|
|
8
|
+
import { Subject } from 'rxjs';
|
|
9
9
|
import { randomBytes } from 'crypto';
|
|
10
10
|
import { forTime } from 'waitasecond';
|
|
11
11
|
import sha256 from 'crypto-js/sha256';
|
|
@@ -26,7 +26,7 @@ const BOOK_LANGUAGE_VERSION = '1.0.0';
|
|
|
26
26
|
* @generated
|
|
27
27
|
* @see https://github.com/webgptorg/promptbook
|
|
28
28
|
*/
|
|
29
|
-
const PROMPTBOOK_ENGINE_VERSION = '0.
|
|
29
|
+
const PROMPTBOOK_ENGINE_VERSION = '0.88.0-10';
|
|
30
30
|
/**
|
|
31
31
|
* TODO: string_promptbook_version should be constrained to the all versions of Promptbook engine
|
|
32
32
|
* Note: [💞] Ignore a discrepancy between file name and entity name
|
|
@@ -2081,6 +2081,36 @@ function $randomToken(randomness) {
|
|
|
2081
2081
|
* TODO: Maybe use nanoid instead https://github.com/ai/nanoid
|
|
2082
2082
|
*/
|
|
2083
2083
|
|
|
2084
|
+
/**
|
|
2085
|
+
* Recursively converts JSON strings to JSON objects
|
|
2086
|
+
|
|
2087
|
+
* @public exported from `@promptbook/utils`
|
|
2088
|
+
*/
|
|
2089
|
+
function jsonStringsToJsons(object) {
|
|
2090
|
+
if (object === null) {
|
|
2091
|
+
return object;
|
|
2092
|
+
}
|
|
2093
|
+
if (Array.isArray(object)) {
|
|
2094
|
+
return object.map(jsonStringsToJsons);
|
|
2095
|
+
}
|
|
2096
|
+
if (typeof object !== 'object') {
|
|
2097
|
+
return object;
|
|
2098
|
+
}
|
|
2099
|
+
const newObject = { ...object };
|
|
2100
|
+
for (const [key, value] of Object.entries(object)) {
|
|
2101
|
+
if (typeof value === 'string' && isValidJsonString(value)) {
|
|
2102
|
+
newObject[key] = JSON.parse(value);
|
|
2103
|
+
}
|
|
2104
|
+
else {
|
|
2105
|
+
newObject[key] = jsonStringsToJsons(value);
|
|
2106
|
+
}
|
|
2107
|
+
}
|
|
2108
|
+
return newObject;
|
|
2109
|
+
}
|
|
2110
|
+
/**
|
|
2111
|
+
* TODO: Type the return type correctly
|
|
2112
|
+
*/
|
|
2113
|
+
|
|
2084
2114
|
/**
|
|
2085
2115
|
* This error indicates problems parsing the format value
|
|
2086
2116
|
*
|
|
@@ -2307,21 +2337,43 @@ function assertsTaskSuccessful(executionResult) {
|
|
|
2307
2337
|
function createTask(options) {
|
|
2308
2338
|
const { taskType, taskProcessCallback } = options;
|
|
2309
2339
|
const taskId = `${taskType.toLowerCase().substring(0, 4)}-${$randomToken(8 /* <- TODO: To global config + Use Base58 to avoid simmilar char conflicts */)}`;
|
|
2310
|
-
|
|
2340
|
+
let status = 'RUNNING';
|
|
2341
|
+
const createdAt = new Date();
|
|
2342
|
+
let updatedAt = createdAt;
|
|
2343
|
+
const errors = [];
|
|
2344
|
+
const warnings = [];
|
|
2345
|
+
let currentValue = {};
|
|
2346
|
+
const partialResultSubject = new Subject();
|
|
2347
|
+
// <- Note: Not using `BehaviorSubject` because on error we can't access the last value
|
|
2311
2348
|
const finalResultPromise = /* not await */ taskProcessCallback((newOngoingResult) => {
|
|
2349
|
+
Object.assign(currentValue, newOngoingResult);
|
|
2350
|
+
// <- TODO: assign deep
|
|
2312
2351
|
partialResultSubject.next(newOngoingResult);
|
|
2313
2352
|
});
|
|
2314
2353
|
finalResultPromise
|
|
2315
2354
|
.catch((error) => {
|
|
2355
|
+
errors.push(error);
|
|
2316
2356
|
partialResultSubject.error(error);
|
|
2317
2357
|
})
|
|
2318
|
-
.then((
|
|
2319
|
-
if (
|
|
2358
|
+
.then((executionResult) => {
|
|
2359
|
+
if (executionResult) {
|
|
2320
2360
|
try {
|
|
2321
|
-
|
|
2322
|
-
|
|
2361
|
+
updatedAt = new Date();
|
|
2362
|
+
errors.push(...executionResult.errors);
|
|
2363
|
+
warnings.push(...executionResult.warnings);
|
|
2364
|
+
// <- TODO: !!! Only unique errors and warnings should be added (or filtered)
|
|
2365
|
+
// TODO: [🧠] !!! errors, warning, isSuccessful are redundant both in `ExecutionTask` and `ExecutionTask.currentValue`
|
|
2366
|
+
// Also maybe move `ExecutionTask.currentValue.usage` -> `ExecutionTask.usage`
|
|
2367
|
+
// And delete `ExecutionTask.currentValue.preparedPipeline`
|
|
2368
|
+
assertsTaskSuccessful(executionResult);
|
|
2369
|
+
status = 'FINISHED';
|
|
2370
|
+
currentValue = jsonStringsToJsons(executionResult);
|
|
2371
|
+
// <- TODO: [🧠] Is this a good idea to convert JSON strins to JSONs?
|
|
2372
|
+
partialResultSubject.next(executionResult);
|
|
2323
2373
|
}
|
|
2324
2374
|
catch (error) {
|
|
2375
|
+
status = 'ERROR';
|
|
2376
|
+
errors.push(error);
|
|
2325
2377
|
partialResultSubject.error(error);
|
|
2326
2378
|
}
|
|
2327
2379
|
}
|
|
@@ -2338,12 +2390,33 @@ function createTask(options) {
|
|
|
2338
2390
|
return {
|
|
2339
2391
|
taskType,
|
|
2340
2392
|
taskId,
|
|
2393
|
+
get status() {
|
|
2394
|
+
return status;
|
|
2395
|
+
// <- Note: [1] Theese must be getters to allow changing the value in the future
|
|
2396
|
+
},
|
|
2397
|
+
get createdAt() {
|
|
2398
|
+
return createdAt;
|
|
2399
|
+
// <- Note: [1]
|
|
2400
|
+
},
|
|
2401
|
+
get updatedAt() {
|
|
2402
|
+
return updatedAt;
|
|
2403
|
+
// <- Note: [1]
|
|
2404
|
+
},
|
|
2341
2405
|
asPromise,
|
|
2342
2406
|
asObservable() {
|
|
2343
2407
|
return partialResultSubject.asObservable();
|
|
2344
2408
|
},
|
|
2409
|
+
get errors() {
|
|
2410
|
+
return errors;
|
|
2411
|
+
// <- Note: [1]
|
|
2412
|
+
},
|
|
2413
|
+
get warnings() {
|
|
2414
|
+
return warnings;
|
|
2415
|
+
// <- Note: [1]
|
|
2416
|
+
},
|
|
2345
2417
|
get currentValue() {
|
|
2346
|
-
return
|
|
2418
|
+
return currentValue;
|
|
2419
|
+
// <- Note: [1]
|
|
2347
2420
|
},
|
|
2348
2421
|
};
|
|
2349
2422
|
}
|
|
@@ -3654,7 +3727,7 @@ function valueToString(value) {
|
|
|
3654
3727
|
* @param script from which to extract the variables
|
|
3655
3728
|
* @returns the list of variable names
|
|
3656
3729
|
* @throws {ParseError} if the script is invalid
|
|
3657
|
-
* @public exported from `@promptbook/
|
|
3730
|
+
* @public exported from `@promptbook/javascript`
|
|
3658
3731
|
*/
|
|
3659
3732
|
function extractVariablesFromJavascript(script) {
|
|
3660
3733
|
const variables = new Set();
|
|
@@ -4718,7 +4791,7 @@ async function executeAttempts(options) {
|
|
|
4718
4791
|
Last result:
|
|
4719
4792
|
${block($ongoingTaskResult.$resultString === null
|
|
4720
4793
|
? 'null'
|
|
4721
|
-
: $ongoingTaskResult.$resultString
|
|
4794
|
+
: spaceTrim$1($ongoingTaskResult.$resultString)
|
|
4722
4795
|
.split('\n')
|
|
4723
4796
|
.map((line) => `> ${line}`)
|
|
4724
4797
|
.join('\n'))}
|