aifbin-lite 1.0.0__tar.gz

aifbin_lite-1.0.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Terronex.dev
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

aifbin_lite-1.0.0/NOTICE

@@ -0,0 +1,58 @@
+AIF-BIN Lite
+Copyright (c) 2026 Terronex.dev
+
+This product includes software developed by Terronex.dev.
+
+================================================================================
+PATENT NOTICE
+================================================================================
+
+The AIF-BIN file format and associated methods for semantic document memory
+are the subject of a pending patent application.
+
+This open-source implementation (AIF-BIN Lite) is provided under the MIT
+License, granting you full rights to use, modify, and distribute this
+software for reading and writing AIF-BIN format files.
+
+================================================================================
+TRADEMARK NOTICE
+================================================================================
+
+"AIF-BIN" is a trademark of Terronex.dev.
+
+You may use the AIF-BIN name to describe compatibility or interoperability
+with the AIF-BIN format, but you may not use it in a way that suggests
+endorsement by or affiliation with Terronex.dev without permission.
+
+================================================================================
+FORMAT SPECIFICATION
+================================================================================
+
+The AIF-BIN file format specification is provided under the MIT License.
+You are free to implement compatible readers and writers.
+
+================================================================================
+AIF-BIN LITE vs AIF-BIN PRO
+================================================================================
+
+AIF-BIN Lite (this repository):
+  - Free and open source (MIT License)
+  - Format conversion tools (Markdown → AIMF/AIF-BIN)
+  - Chunking, metadata, and file management
+  - No AI or embedding functionality
+
+AIF-BIN Pro (github.com/Terronex-dev/aifbin-pro):
+  - Commercial product
+  - Full semantic search with AI embeddings
+  - Integration plugins (LangChain, Obsidian, VS Code, etc.)
+  - Priority support
+
+Lite handles the format. Pro adds the intelligence.
+
+================================================================================
+CONTACT
+================================================================================
+
+For licensing inquiries: legal@terronex.dev
+For general support: support@terronex.dev
+Website: https://terronex.dev

aifbin_lite-1.0.0/PKG-INFO

@@ -0,0 +1,362 @@
+Metadata-Version: 2.4
+Name: aifbin-lite
+Version: 1.0.0
+Summary: Free & open source CLI for AIF-BIN files. Convert documents to semantic memory format.
+Author-email: Terronex <terronex.dev@gmail.com>
+License: MIT
+Project-URL: Homepage, https://github.com/Terronex-dev/aifbin-lite
+Project-URL: Documentation, https://github.com/Terronex-dev/aifbin-lite#readme
+Project-URL: Repository, https://github.com/Terronex-dev/aifbin-lite.git
+Project-URL: Issues, https://github.com/Terronex-dev/aifbin-lite/issues
+Keywords: ai,memory,semantic-search,aif-bin,document-processing,cli
+Classifier: Development Status :: 4 - Beta
+Classifier: Environment :: Console
+Classifier: Intended Audience :: Developers
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.9
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Classifier: Topic :: Text Processing
+Requires-Python: >=3.9
+Description-Content-Type: text/markdown
+License-File: LICENSE
+License-File: NOTICE
+Requires-Dist: msgpack>=1.0.0
+Dynamic: license-file
+
+# AIF-BIN Lite
+
+**Free & Open Source** CLI for AI memory files.
+[![CI](https://github.com/terronex-dev/aifbin-lite/actions/workflows/ci.yml/badge.svg)](https://github.com/terronex-dev/aifbin-lite/actions/workflows/ci.yml)
+
+[![Patent Pending](https://img.shields.io/badge/Patent-Pending-blue.svg)](https://www.terronex.dev)
+
+| Version | Extension | Full Name | Format |
+|---------|-----------|-----------|--------|
+| v1 | `.aimf` | AI Memory Format | JSON |
+| v2 | `.aif-bin` | AI Formatted - Binary | Binary (MessagePack) |
+
+[![License: MIT](https://img.shields.io/badge/License-MIT-green.svg)](LICENSE)
+[![Python 3.8+](https://img.shields.io/badge/python-3.8+-blue.svg)](https://www.python.org/downloads/)
+
+---
+
+## Documentation
+
+- [Technical Whitepaper](docs/whitepaper.html) - Full specification and theory
+
+## What is AIF-BIN?
+
+A file format specification with two versions:
+- **AIMF** (.aimf) - AI Memory Format, v1 JSON encoding for simplicity
+- **AIF-BIN** (.aif-bin) - AI Formatted - Binary, v2 binary encoding for performance
+
+A single `.aimf` or `.aif-bin` file contains:
+
+- **Original document** — The source file preserved
+- **Extracted content** — Text parsed into searchable chunks
+- **Metadata** — Title, timestamps, checksums
+
+This is the **free, open source** implementation. For semantic search, batch processing, see [AIF-BIN Pro](https://github.com/Terronex-dev/aifbin-pro).
+
+---
+
+## Format Versions
+
+This repository contains both format versions:
+
+| Version | Extension | File | Full Name | Format |
+|---------|-----------|------|-----------|--------|
+| **v1** | `.aimf` | `aifbin_v1.py` | AI Memory Format | JSON |
+| **v2** | `.aif-bin` | `aifbin_v2.py` | AI Formatted - Binary | Binary (MessagePack) |
+
+### AIMF - AI Memory Format (v1)
+
+Simple, human-readable JSON. Uses `.aimf` extension. Great for learning and debugging.
+
+```json
+{
+  "version": "1.0.0-lite",
+  "format": "json",
+  "metadata": {
+    "source_file": "sample.md",
+    "created_at": "2026-01-30T10:00:00"
+  },
+  "chunks": [
+    {"id": 0, "content": "...", "type": "text"}
+  ],
+  "original_raw": "# Original content..."
+}
+```
+
+### AIF-BIN - AI Formatted - Binary (v2)
+
+Compact binary format with MessagePack encoding. Uses `.aif-bin` extension. Used by AIF-BIN Pro.
+
+```
+[Header: 64 bytes]
+  Magic: "AIFBIN\x00\x01"
+  Version, Offsets, Size
+
+[Metadata Section]
+  MessagePack blob
+
+[Original Raw Section]
+  Preserved source file
+
+[Content Chunks]
+  Typed chunks with optional embeddings
+
+[Footer]
+  Index + CRC64 Checksum
+```
+
+---
+
+## Installation
+
+```bash
+# Clone the repo
+git clone https://github.com/Terronex-dev/aifbin-lite.git
+cd aifbin-lite
+```
+
+### Windows (PowerShell/CMD)
+
+```powershell
+# Install dependencies
+pip install -r requirements.txt
+
+# v1 - No external dependencies needed, but included in requirements for simplicity
+python aifbin_v1.py --help
+
+# v2
+python aifbin_v2.py --help
+```
+
+### Linux / macOS / WSL
+
+```bash
+# Install dependencies
+pip3 install -r requirements.txt
+
+# v1 - No external dependencies needed, but included in requirements for simplicity
+python3 aifbin_v1.py --help
+
+# v2
+python3 aifbin_v2.py --help
+```
+
+---
+
+## Usage
+
+### AIMF Commands (aifbin_v1.py)
+
+**Windows:**
+```powershell
+python aifbin_v1.py migrate sample.md      # Convert to AIMF (JSON)
+python aifbin_v1.py info sample.aimf       # View file info
+python aifbin_v1.py chunks sample.aimf     # List chunks
+python aifbin_v1.py extract sample.aimf    # Extract original content
+```
+
+**Linux / macOS / WSL:**
+```bash
+python3 aifbin_v1.py migrate sample.md      # Convert to AIMF (JSON)
+python3 aifbin_v1.py info sample.aimf       # View file info
+python3 aifbin_v1.py chunks sample.aimf     # List chunks
+python3 aifbin_v1.py extract sample.aimf    # Extract original content
+```
+
+### AIF-BIN Commands (aifbin_v2.py)
+
+**Windows:**
+```powershell
+python aifbin_v2.py migrate sample.md              # Convert to AIF-BIN (binary)
+python aifbin_v2.py info sample.aif-bin            # View file info
+python aifbin_v2.py chunks sample.aif-bin          # List chunks
+python aifbin_v2.py extract sample.aif-bin         # Extract original content
+python aifbin_v2.py upgrade sample.aimf            # Upgrade v1 to v2
+```
+
+**Linux / macOS / WSL:**
+```bash
+python3 aifbin_v2.py migrate sample.md              # Convert to AIF-BIN (binary)
+python3 aifbin_v2.py info sample.aif-bin            # View file info
+python3 aifbin_v2.py chunks sample.aif-bin          # List chunks
+python3 aifbin_v2.py extract sample.aif-bin         # Extract original content
+python3 aifbin_v2.py upgrade sample.aimf            # Upgrade v1 to v2
+```
+
+---
+
+## Troubleshooting
+
+### `error: externally-managed-environment` (Debian/Ubuntu/WSL)
+
+This error occurs when `pip` tries to install packages system-wide in environments where Python packages are managed by the OS.
+
+**Solution 1:** Use the `--break-system-packages` flag:
+```bash
+pip3 install -r requirements.txt --break-system-packages
+```
+
+**Solution 2 (Recommended):** Use a Python virtual environment:
+```bash
+python3 -m venv .venv
+source .venv/bin/activate
+pip install -r requirements.txt
+python3 aifbin_v2.py --help
+# Deactivate when done:
+deactivate
+```
+
+### `python3` not found on Windows
+
+On Windows, use `python` instead of `python3`:
+```powershell
+python aifbin_v1.py --help
+```
+
+---
+
+## Migrating from AIMF to AIF-BIN
+
+### Why Migrate?
+
+- **50% smaller files** — Binary format is more compact
+- **Faster parsing** — Fixed-offset headers enable direct seeks
+- **Checksums** — CRC64 verification for data integrity
+- **Embeddings** — AIF-BIN supports vector embeddings for semantic search
+- **Typed chunks** — TEXT, TABLE, IMAGE, AUDIO, VIDEO, CODE
+
+### How to Migrate
+
+**Option 1: Using the CLI (Recommended)**
+
+```bash
+# Windows
+python aifbin_v2.py upgrade sample.aimf -o sample.aif-bin
+
+# Linux / macOS / WSL
+python3 aifbin_v2.py upgrade sample.aimf -o sample.aif-bin
+```
+
+**Option 2: Programmatically**
+
+```python
+from aifbin_v2 import migrate_from_v1
+
+migrate_from_v1('sample.aimf', 'sample.aif-bin')
+```
+
+See `examples/migrate_v1_to_v2.py` for a complete migration script.
+
+---
+
+## Examples
+
+| File | Description |
+|------|-------------|
+| `examples/quickstart_v1.py` | Basic v1 usage |
+| `examples/quickstart_v2.py` | Basic v2 usage |
+| `examples/migrate_v1_to_v2.py` | Migration script |
+
+---
+
+## Related Projects
+
+| Project | Description |
+|---------|-------------|
+| [AIF-BIN Lite](https://github.com/Terronex-dev/aifbin-lite) | Free CLI (this repo) |
+| [AIF-BIN Pro](https://github.com/Terronex-dev/aifbin-pro) | Pro CLI + Inspector |
+
+---
+
+## Lite vs Pro
+
+**AIF-BIN Lite** (this repo) handles the **format** — converting your documents into portable, structured files.
+
+**AIF-BIN Pro** adds the **intelligence** — AI-powered semantic search that lets you query your documents by meaning, not just keywords.
+
+```
+┌─────────────────────────────────────────────────────────────┐
+│                        Your Documents                        │
+│                    (Markdown, notes, docs)                   │
+└─────────────────────────────────────────────────────────────┘
+                              │
+                              ▼
+┌─────────────────────────────────────────────────────────────┐
+│                      AIF-BIN Lite (Free)                     │
+│                                                              │
+│   ✓ Convert to .aimf (JSON) or .aif-bin (binary)            │
+│   ✓ Chunking and metadata extraction                         │
+│   ✓ Portable files you own                                   │
+│   ✗ No search — just format conversion                       │
+└─────────────────────────────────────────────────────────────┘
+                              │
+                              ▼
+┌─────────────────────────────────────────────────────────────┐
+│                      AIF-BIN Pro (Paid)                      │
+│                                                              │
+│   ✓ Everything in Lite, plus:                                │
+│   ✓ AI embeddings (text → vectors)                           │
+│   ✓ Semantic search ("What did I decide about X?")           │
+│   ✓ Plugins (LangChain, Obsidian, VS Code, etc.)             │
+└─────────────────────────────────────────────────────────────┘
+```
+
+### Why This Architecture?
+
+- **Your data stays portable.** Lite files work anywhere, with or without Pro.
+- **No vendor lock-in.** The format spec is open (MIT). Build your own tools if you want.
+- **Pay for intelligence, not storage.** Lite is free forever. Pro adds the AI layer.
+
+### Ready to Upgrade?
+
+[AIF-BIN Pro](https://github.com/Terronex-dev/aifbin-pro) includes:
+
+- **Semantic search** — Find by meaning, not keywords
+- **Batch processing** — Convert entire directories
+- **Watch mode** — Auto-sync on file changes
+- **Web Inspector** — Visual file analyzer
+- **5 embedding models** — OpenAI, Cohere, local options
+
+---
+
+## Legal
+
+| Document | Description |
+|----------|-------------|
+| [LICENSE](LICENSE) | MIT License — free to use, modify, distribute |
+| [NOTICE](NOTICE) | Patent, trademark, and Lite vs Pro details |
+| [TERMS](legal/TERMS.md) | Terms of use |
+| [PRIVACY](legal/PRIVACY.md) | Privacy policy (TL;DR: no data collection) |
+| [SECURITY](SECURITY.md) | Security policy and vulnerability reporting |
+
+**Patent Pending:** The AIF-BIN format and methods are subject to a pending patent application. This open-source implementation is provided under the MIT License.
+
+**Trademark:** "AIF-BIN" is a trademark of Terronex.dev. You may use it to describe format compatibility.
+
+---
+
+## Links
+
+- Website: [terronex.dev/aifbin](https://terronex.dev/aifbin/)
+- Pro: [github.com/Terronex-dev/aifbin-pro](https://github.com/Terronex-dev/aifbin-pro)
+- Support: support@terronex.dev
+
+---
+
+## Contributing
+
+Contributions welcome! See [CONTRIBUTING.md](CONTRIBUTING.md).
+
+---
+
+(c) 2026 Terronex.dev. All rights reserved.