@workglow/ai 0.2.15 → 0.2.17
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +11 -15
- package/dist/browser.js +544 -1033
- package/dist/browser.js.map +17 -20
- package/dist/bun.js +544 -1033
- package/dist/bun.js.map +17 -20
- package/dist/node.js +544 -1033
- package/dist/node.js.map +17 -20
- package/dist/provider/AiProvider.d.ts +8 -8
- package/dist/provider/AiProvider.d.ts.map +1 -1
- package/dist/provider/AiProviderRegistry.d.ts +16 -16
- package/dist/provider/AiProviderRegistry.d.ts.map +1 -1
- package/dist/task/ChunkRetrievalTask.d.ts +32 -49
- package/dist/task/ChunkRetrievalTask.d.ts.map +1 -1
- package/dist/task/ChunkVectorUpsertTask.d.ts +107 -24
- package/dist/task/ChunkVectorUpsertTask.d.ts.map +1 -1
- package/dist/task/ContextBuilderTask.d.ts +3 -2
- package/dist/task/ContextBuilderTask.d.ts.map +1 -1
- package/dist/task/HierarchyJoinTask.d.ts +44 -42
- package/dist/task/HierarchyJoinTask.d.ts.map +1 -1
- package/dist/task/QueryExpanderTask.d.ts +5 -31
- package/dist/task/QueryExpanderTask.d.ts.map +1 -1
- package/dist/task/RerankerTask.d.ts +7 -89
- package/dist/task/RerankerTask.d.ts.map +1 -1
- package/dist/task/TextChunkerTask.d.ts +139 -37
- package/dist/task/TextChunkerTask.d.ts.map +1 -1
- package/dist/task/VectorQuantizeTask.d.ts +2 -1
- package/dist/task/VectorQuantizeTask.d.ts.map +1 -1
- package/dist/task/VectorSimilarityTask.d.ts +2 -4
- package/dist/task/VectorSimilarityTask.d.ts.map +1 -1
- package/dist/task/base/AiTask.d.ts +4 -4
- package/dist/task/base/AiTask.d.ts.map +1 -1
- package/dist/task/index.d.ts +1 -7
- package/dist/task/index.d.ts.map +1 -1
- package/dist/worker.js +25 -26
- package/dist/worker.js.map +4 -4
- package/package.json +11 -11
- package/dist/task/ChunkToVectorTask.d.ts +0 -210
- package/dist/task/ChunkToVectorTask.d.ts.map +0 -1
- package/dist/task/ChunkVectorHybridSearchTask.d.ts +0 -167
- package/dist/task/ChunkVectorHybridSearchTask.d.ts.map +0 -1
- package/dist/task/ChunkVectorSearchTask.d.ts +0 -139
- package/dist/task/ChunkVectorSearchTask.d.ts.map +0 -1
package/README.md
CHANGED
|
@@ -516,23 +516,20 @@ The AI package provides a comprehensive set of tasks for building RAG pipelines.
|
|
|
516
516
|
|
|
517
517
|
### Vector and Storage Tasks
|
|
518
518
|
|
|
519
|
-
| Task | Description
|
|
520
|
-
| ----------------------- |
|
|
521
|
-
| `
|
|
522
|
-
| `
|
|
523
|
-
| `ChunkVectorSearchTask` | Searches vectors by similarity |
|
|
524
|
-
| `VectorQuantizeTask` | Quantizes vectors for storage efficiency |
|
|
519
|
+
| Task | Description |
|
|
520
|
+
| ----------------------- | --------------------------------------------------------------------------------- |
|
|
521
|
+
| `ChunkVectorUpsertTask` | Stores chunks + their embeddings in a KnowledgeBase (input: `chunks` + `vector`) |
|
|
522
|
+
| `VectorQuantizeTask` | Quantizes vectors for storage efficiency |
|
|
525
523
|
|
|
526
524
|
### Retrieval and Generation Tasks
|
|
527
525
|
|
|
528
|
-
| Task
|
|
529
|
-
|
|
|
530
|
-
| `
|
|
531
|
-
| `
|
|
532
|
-
| `RerankerTask`
|
|
533
|
-
| `HierarchyJoinTask`
|
|
534
|
-
| `ContextBuilderTask`
|
|
535
|
-
| `ChunkRetrievalTask` | Orchestrates end-to-end retrieval |
|
|
526
|
+
| Task | Description |
|
|
527
|
+
| -------------------- | ------------------------------------------------------------------------ |
|
|
528
|
+
| `ChunkRetrievalTask` | End-to-end retrieval: embeds the query, runs similarity or hybrid search |
|
|
529
|
+
| `QueryExpanderTask` | Expands queries (multi-query / synonyms) for better retrieval coverage |
|
|
530
|
+
| `RerankerTask` | Reranks search results (simple heuristic or reciprocal-rank-fusion) |
|
|
531
|
+
| `HierarchyJoinTask` | Enriches retrieved metadata with parent summaries, section titles, entities |
|
|
532
|
+
| `ContextBuilderTask` | Builds formatted context for LLM prompts |
|
|
536
533
|
|
|
537
534
|
### Complete RAG Workflow Example
|
|
538
535
|
|
|
@@ -600,7 +597,6 @@ await new Workflow()
|
|
|
600
597
|
.textEmbedding({
|
|
601
598
|
model: "onnx:Xenova/all-MiniLM-L6-v2:q8",
|
|
602
599
|
})
|
|
603
|
-
.chunkToVector()
|
|
604
600
|
.chunkVectorUpsert({
|
|
605
601
|
knowledgeBase: "my-kb",
|
|
606
602
|
})
|