@mindstudio-ai/agent 0.1.85 → 0.1.86
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/dist/cli.js +149 -10
- package/dist/index.d.ts +224 -1
- package/dist/index.js +140 -3
- package/dist/index.js.map +1 -1
- package/dist/postinstall.js +149 -10
- package/llms.txt +27 -0
- package/package.json +1 -1
package/llms.txt
CHANGED
|
@@ -1840,3 +1840,30 @@ return token;
|
|
|
1840
1840
|
import { platform } from '@mindstudio-ai/interface';
|
|
1841
1841
|
const { url } = await platform.upload(token, file, { onProgress });
|
|
1842
1842
|
```
|
|
1843
|
+
|
|
1844
|
+
#### `dataSources` — searchable document corpora (RAG)
|
|
1845
|
+
|
|
1846
|
+
Declare a data source at module scope and import the handle. The platform owns parsing, chunking, embedding, storage and tenant isolation; every hit returns a citation.
|
|
1847
|
+
```typescript
|
|
1848
|
+
import { dataSources } from '@mindstudio-ai/agent';
|
|
1849
|
+
export const Policies = dataSources.defineDataSource('policies');
|
|
1850
|
+
|
|
1851
|
+
// search
|
|
1852
|
+
const { results } = await Policies.search('what are the payment terms?', { topK: 5 });
|
|
1853
|
+
// options: topK (default 5, max 50), scoreThreshold, rerank, hybrid — the last two default on
|
|
1854
|
+
const context = results.map((r) => r.text).join(String.fromCharCode(10, 10));
|
|
1855
|
+
|
|
1856
|
+
// add a document (background — poll documents() for status)
|
|
1857
|
+
await Policies.add(buffer, { filename: 'policy.pdf', contentType: 'application/pdf' });
|
|
1858
|
+
const docs = await Policies.documents();
|
|
1859
|
+
```
|
|
1860
|
+
|
|
1861
|
+
`SearchHit`: `{ score, text, citation: { documentId, filename, pageNumber, headingPath, boundingBox?, url } }`. `citation.url` is a stable on-domain link to the source document — drop it in an `<a href>`.
|
|
1862
|
+
|
|
1863
|
+
Supported: pdf, docx, pptx, xlsx, odt, rtf, epub, images, txt, md, json, csv, html.
|
|
1864
|
+
|
|
1865
|
+
Adding the same bytes twice is free — documents are content-addressed, so a re-add is a no-op when this source has already processed those exact bytes under its current configuration. Only reconfiguring the source makes a re-add do work again, and that is an explicit owner-triggered migration, never a side effect of a deploy.
|
|
1866
|
+
|
|
1867
|
+
`rerank` and `hybrid` are free to change and take effect on the next search. How documents are chunked and embedded is configured on the corpus itself with `mindstudio-prod datasources config` — not in code — and changing it on a populated source is rejected rather than silently rebuilding.
|
|
1868
|
+
|
|
1869
|
+
**A data source is live and shared.** Unlike database tables there is no dev copy and no per-release isolation: adding or removing a document changes what the deployed app retrieves, immediately. Scenarios never reset a data source, and re-ingesting a large corpus costs real money.
|