@pyxmate/memory 0.6.2 → 0.7.0

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@pyxmate/memory",
-  "version": "0.6.2",
+  "version": "0.7.0",
   "type": "module",
   "description": "SDK for pyx-memory — Memory as a Service for AI agents",
   "license": "MIT",

package/skills/pyx-memory/SKILL.md

@@ -91,7 +91,9 @@ curl -s -X POST {{ENDPOINT}}/api/memory/ingest/file \
   -F "description=What this file contains or shows"
 ```
 
-Supported formats: txt, md, csv, pdf, docx, json, jsonl, html, png, jpg, jpeg, webp, gif, bmp, tiff, svg (50MB limit).
+Supported formats: txt, md, csv, tsv, log, pdf, docx, xlsx, json, jsonl, html, htm, png, jpg, jpeg, webp, gif, bmp, tiff, svg (50MB limit).
+
+Ingestion streams from disk — parsers read row-by-row (csv/xlsx), line-by-line (txt/jsonl), or page-by-page (pdf) so peak memory is bounded regardless of file size. The only exception is `.docx`, which is hard-capped at 10MB because the underlying library (mammoth) loads the whole document into memory; above 10MB the server returns an error asking you to pre-extract the text upstream and re-upload as `.txt` or `.md`.
 
 **Images require a `description`** — this is how the content gets embedded and becomes searchable. Without it, the image is stored but not findable. Use your vision capabilities to generate the description when the user doesn't provide one.
 

package/skills/pyx-memory/reference/http-api.md

@@ -69,14 +69,16 @@ const client = new MemoryClient('http://localhost:7822', process.env.MEMORY_API_
 | `file` | File | Yes | The file to ingest (max 50MB) |
 | `description` | string | No | Agent-provided description (e.g., from LLM vision). Used instead of parser output for images. |
 
-**Supported formats**: `.txt`, `.md`, `.csv`, `.pdf`, `.docx`, `.json`, `.jsonl`, `.html`, `.htm`, `.log`, `.tsv`, `.png`, `.jpg`, `.jpeg`, `.webp`, `.gif`, `.bmp`, `.tiff`, `.svg`
+**Supported formats**: `.txt`, `.md`, `.csv`, `.tsv`, `.log`, `.pdf`, `.docx`, `.xlsx`, `.json`, `.jsonl`, `.html`, `.htm`, `.png`, `.jpg`, `.jpeg`, `.webp`, `.gif`, `.bmp`, `.tiff`, `.svg`
+
+**Memory behavior**: All text parsers (csv, tsv, txt, log, pdf, json, jsonl, html, xlsx) stream from disk during ingestion — peak server memory is bounded to a few MB regardless of file size, up to the 50MB file limit. `.docx` is the exception: mammoth (the parser) has no streaming API, so `.docx` is hard-capped at 10MB on the server. Above 10MB the server returns a `MemoryError` asking you to pre-extract the text upstream and re-upload as `.txt` or `.md`.
 
 **What happens on upload**:
 1. Original file is saved to `{DATA_DIR}/files/{filename}` (persistent across restarts)
 2. Text is extracted (documents) or description is used (images)
 3. Content is chunked and stored in SQLite + vector for semantic search
 4. Source-aware dedup: re-uploading the same filename replaces the previous version
-5. **PDFs with images**: Images are extracted via pdfjs-dist, saved to a temp directory, and an `enrichment` block is returned with HMAC-signed tokens for two-phase enrichment
+5. **PDFs with images**: Images are extracted via poppler (`pdfimages` for embedded objects, `pdftoppm` for page renders on scanned PDFs), saved to a temp directory, and an `enrichment` block is returned with HMAC-signed tokens for two-phase enrichment. `pdf-parse` is used only as a dev fallback for small files (<5MB) when poppler isn't installed.
 
 **Image ingestion**: Images cannot have text extracted. Pass a `description` field with a natural-language description (e.g., from an LLM with vision). Without a description, images get a minimal placeholder (`[Image] filename (size KB)`).
 
@@ -240,8 +242,8 @@ curl -s -X POST {{ENDPOINT}}/api/memory/ingest \
       {"name":"JavaScript","type":"TOOL"}
     ],
     "relationships":[
-      {"from":"Alice","to":"TypeScript","type":"USES"},
-      {"from":"TypeScript","to":"JavaScript","type":"RELATED_TO"}
+      {"source":"Alice","target":"TypeScript","type":"USES"},
+      {"source":"TypeScript","target":"JavaScript","type":"RELATED_TO"}
     ]
   }'
 ```
@@ -249,7 +251,7 @@ curl -s -X POST {{ENDPOINT}}/api/memory/ingest \
 **When to extract**: Always extract when content mentions specific people, tools, technologies, organizations, locations, or events by name. Skip only for abstract observations with no named subjects (e.g., "prefer tabs over spaces").
 
 **Entity fields**: `name` (required), `type` (required), `metadata` (optional properties object)
-**Relationship fields**: `from` (source entity name), `to` (target entity name), `type` (required)
+**Relationship fields**: `source` (source entity name), `target` (target entity name), `type` (required). Legacy `{from, to}` aliases are also accepted by the pyx-cloud hosted wrapper at `memory.api.pyxmate.com` for backward compatibility, but `{source, target}` is canonical.
 
 ---