knowledge-master 0.1.0__tar.gz

knowledge_master-0.1.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Milenko Mitrovic
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

knowledge_master-0.1.0/PKG-INFO

@@ -0,0 +1,275 @@
+Metadata-Version: 2.4
+Name: knowledge-master
+Version: 0.1.0
+Summary: Local-first knowledge graph for developers. Your AI agent's permanent memory.
+Author: Milenko Mitrovic
+License: MIT
+Project-URL: Homepage, https://github.com/subzone/knowledge-master
+Project-URL: Repository, https://github.com/subzone/knowledge-master
+Project-URL: Issues, https://github.com/subzone/knowledge-master/issues
+Keywords: rag,knowledge-graph,mcp,ai,developer-tools,vector-search
+Classifier: Development Status :: 3 - Alpha
+Classifier: Intended Audience :: Developers
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Topic :: Software Development :: Libraries
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Requires-Python: >=3.11
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: falkordb<2.0,>=1.6.0
+Requires-Dist: ollama<1.0,>=0.4.0
+Requires-Dist: mcp<2.0,>=1.9.0
+Requires-Dist: typer<1.0,>=0.15.0
+Requires-Dist: gitpython<4.0,>=3.1.0
+Requires-Dist: rich<15.0,>=14.0.0
+Requires-Dist: fastapi<1.0,>=0.115.0
+Requires-Dist: uvicorn<1.0,>=0.34.0
+Provides-Extra: office
+Requires-Dist: python-docx<2.0,>=1.1.0; extra == "office"
+Requires-Dist: openpyxl<4.0,>=3.1.0; extra == "office"
+Requires-Dist: pypdf<6.0,>=5.0; extra == "office"
+Provides-Extra: dev
+Requires-Dist: pytest>=8.0; extra == "dev"
+Requires-Dist: ruff>=0.11; extra == "dev"
+Dynamic: license-file
+
+# ⚡ Knowledge Master
+
+**Your codebase's memory.** A local knowledge graph that gives AI agents real understanding of your architecture — not just text search.
+
+[![License: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](LICENSE)
+
+---
+
+## Why
+
+Every time you start a new AI chat, it forgets everything. You re-explain your architecture, conventions, dependencies. Knowledge Master gives your AI **permanent, structured memory** about your entire system.
+
+Unlike flat RAG tools that return "chunks about X", Knowledge Master builds a **graph** — so it can answer "what breaks if I change X?" by traversing actual relationships.
+
+## What it does
+
+- 🔍 **Semantic search** across all your code, docs, and configs
+- 🕸️ **Knowledge graph** — relationships between services, people, repos, technologies
+- 💥 **Blast radius** — "what depends on this service/file/technology?"
+- 📏 **Convention enforcement** — detects and enforces your team's patterns
+- 🤖 **MCP server** — plugs directly into AI agents (Kiro, Claude, Cursor)
+- 🖥️ **Web UI** — search, browse, visualize your knowledge graph
+- 🔒 **Local-first** — nothing leaves your machine
+
+## Prerequisites
+
+| Dependency | macOS | Ubuntu/Debian | Windows |
+|---|---|---|---|
+| **Docker** | `brew install colima && colima start` or Docker Desktop | `sudo apt install docker.io docker-compose-plugin` | [Docker Desktop](https://docker.com/products/docker-desktop/) |
+| **Ollama** | `brew install ollama && ollama serve` | `curl -fsSL https://ollama.com/install.sh \| sh` | [Ollama installer](https://ollama.com/download) |
+| **Python 3.11+** | `brew install python@3.12` | `sudo apt install python3.12 python3.12-venv` | [python.org](https://python.org/downloads/) |
+
+## Quick Start
+
+```bash
+# Install (pick one)
+pip install knowledge-master          # from PyPI
+pipx install knowledge-master         # isolated install (recommended)
+
+# Or from source
+git clone https://github.com/subzone/knowledge-master.git
+cd knowledge-master
+python3 -m venv .venv && source .venv/bin/activate
+pip install -e .
+
+# One command setup
+km start
+
+# Index your first repo
+km index ~/path/to/your/project
+
+# Search
+km search "authentication flow"
+
+# Check blast radius
+km blast-radius postgres
+
+# Start web UI with graph visualization
+km serve
+```
+
+**Requirements:** Docker, Ollama, Python 3.11+
+
+## Features
+
+### Semantic Search with Graph Context
+```bash
+$ km search "how does auth work"
+┌────────┬──────────────────────┬─────────────────────┬──────────────────────┐
+│ Score  │ Source               │ Context             │ Preview              │
+├────────┼──────────────────────┼─────────────────────┼──────────────────────┤
+│ 0.847  │ src/auth/service.py  │ repo:myapp, by:Alex │ JWT token validat... │
+│ 0.791  │ docs/auth.md         │ repo:myapp          │ Authentication f...  │
+└────────┴──────────────────────┴─────────────────────┴──────────────────────┘
+```
+
+### Blast Radius Analysis
+```bash
+$ km blast-radius auth-service
+💥 Blast radius: auth-service
+├── ⚙️ user-service (Service, via DEPENDS_ON)
+├── ⚙️ payment-service (Service, via DEPENDS_ON)
+├── 📦 frontend (Repo, via USES_SERVICE)
+└── 👤 Alex (Person, via AUTHORED)
+
+4 entities affected
+```
+
+### Convention Enforcement
+```bash
+$ km check-conventions ~/my-project
+  ✓ src/ directory (structure)
+  ✓ separate test directory (testing)
+  ✗ snake_case files (file-naming)
+  ✓ Repository pattern (design-pattern)
+
+1 convention(s) violated
+```
+
+### Web UI & Graph Visualization
+
+```bash
+$ km serve
+Knowledge Master UI → http://127.0.0.1:9999
+```
+
+Interactive force-directed graph showing your entire knowledge topology:
+- 📦 Repos (blue) → 🔧 Technologies (red)
+- ⚙️ Services (orange) → Dependencies
+- 👤 People → Authorship
+- 📏 Conventions (purple)
+
+### MCP Integration (AI Agents)
+
+Add to your Kiro/Claude agent config:
+
+```json
+{
+  "mcpServers": {
+    "knowledge": {
+      "command": "km-server"
+    }
+  }
+}
+```
+
+Your AI agent gets these tools:
+- `search` — semantic search with graph context
+- `blast_radius` — dependency analysis
+- `check_conventions` — verify code follows team patterns
+- `index_repo` — add new repos to the knowledge base
+
+## Architecture
+
+```
+┌─────────────────────────────────────────────────┐
+│                  Your AI Agent                    │
+│              (Kiro / Claude / Cursor)             │
+└────────────────────┬────────────────────────────┘
+                     │ MCP Protocol
+┌────────────────────▼────────────────────────────┐
+│              Knowledge Master                    │
+│                                                  │
+│  ┌──────────┐  ┌────────────┐  ┌────────────┐  │
+│  │  Search  │  │Blast Radius│  │ Conventions│  │
+│  └────┬─────┘  └─────┬──────┘  └─────┬──────┘  │
+│       │               │               │         │
+│  ┌────▼───────────────▼───────────────▼──────┐  │
+│  │            FalkorDB (Graph + Vector)       │  │
+│  │                                           │  │
+│  │  [Repo]──USES_TECH──▶[Tech]              │  │
+│  │    │                                      │  │
+│  │    ├──DEFINES_SERVICE──▶[Service]         │  │
+│  │    │                      │               │  │
+│  │    ├──FOLLOWS──▶[Convention]              │  │
+│  │    │                                      │  │
+│  │  [Person]──AUTHORED──▶[Document]          │  │
+│  │                          │                │  │
+│  │                    [Chunk + Embedding]     │  │
+│  └───────────────────────────────────────────┘  │
+│                                                  │
+│  ┌───────────────────────────────────────────┐  │
+│  │         Ollama (nomic-embed-text)          │  │
+│  └───────────────────────────────────────────┘  │
+└──────────────────────────────────────────────────┘
+```
+
+## Commands
+
+| Command | Description |
+|---|---|
+| `km start` | Boot Docker containers + pull embedding model |
+| `km stop` | Stop containers |
+| `km index <path>` | Index a git repo or docs directory |
+| `km search <query>` | Semantic search with graph context |
+| `km blast-radius <target>` | Show dependencies and affected entities |
+| `km check-conventions <path>` | Verify code follows detected patterns |
+| `km list` | Show indexed repos, techs, stats |
+| `km remove <name>` | Remove a source from the knowledge base |
+| `km serve` | Start web UI at http://127.0.0.1:9999 |
+| `km status` | Check system health |
+
+## What gets extracted automatically
+
+When you index a repo, Knowledge Master detects:
+
+| Category | Examples |
+|---|---|
+| **Tech stack** | Languages, frameworks, packages from dependency files |
+| **Services** | From docker-compose.yml and K8s manifests |
+| **Dependencies** | Service-to-service relationships |
+| **Conventions** | File naming (snake_case/kebab-case), folder structure, design patterns |
+| **People** | Git commit authors and file ownership |
+| **Code structure** | Functions, classes, chunked by AST-aware boundaries |
+
+## Comparison
+
+| Feature | Knowledge Master | Generic RAG | GitHub Copilot | Glean |
+|---|---|---|---|---|
+| Graph relationships | ✅ | ❌ | ❌ | Partial |
+| Blast radius analysis | ✅ | ❌ | ❌ | ❌ |
+| Convention enforcement | ✅ | ❌ | ❌ | ❌ |
+| Local-first (no cloud) | ✅ | ✅ | ❌ | ❌ |
+| MCP integration | ✅ | ❌ | ❌ | ❌ |
+| Multi-repo intelligence | ✅ | Partial | ❌ | ✅ |
+| Cost | Free | Free | $19/mo | $15-30/mo |
+
+## Development
+
+```bash
+# Run tests
+pytest
+
+# Lint
+ruff check knowledge_master/
+
+# Run MCP server directly
+python -m knowledge_master.server
+
+# Run CLI directly
+python -m knowledge_master.cli status
+```
+
+## Troubleshooting
+
+| Issue | Fix |
+|---|---|
+| `km start` fails with "Docker not running" | Start Docker: `colima start` (macOS) or `sudo systemctl start docker` (Linux) |
+| `km start` fails with "Ollama not found" | Install Ollama from https://ollama.com and run `ollama serve` |
+| `km index` is slow | First run downloads the embedding model (~274MB). Subsequent runs are fast. |
+| Web UI shows "Connection refused" | Make sure containers are running: `km start` |
+| Search returns poor results | Index more content. Quality improves with more context in the graph. |
+| Port 9999 already in use | Use `km serve --port 8888` |
+
+## License
+
+MIT

knowledge_master-0.1.0/README.md

@@ -0,0 +1,237 @@
+# ⚡ Knowledge Master
+
+**Your codebase's memory.** A local knowledge graph that gives AI agents real understanding of your architecture — not just text search.
+
+[![License: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](LICENSE)
+
+---
+
+## Why
+
+Every time you start a new AI chat, it forgets everything. You re-explain your architecture, conventions, dependencies. Knowledge Master gives your AI **permanent, structured memory** about your entire system.
+
+Unlike flat RAG tools that return "chunks about X", Knowledge Master builds a **graph** — so it can answer "what breaks if I change X?" by traversing actual relationships.
+
+## What it does
+
+- 🔍 **Semantic search** across all your code, docs, and configs
+- 🕸️ **Knowledge graph** — relationships between services, people, repos, technologies
+- 💥 **Blast radius** — "what depends on this service/file/technology?"
+- 📏 **Convention enforcement** — detects and enforces your team's patterns
+- 🤖 **MCP server** — plugs directly into AI agents (Kiro, Claude, Cursor)
+- 🖥️ **Web UI** — search, browse, visualize your knowledge graph
+- 🔒 **Local-first** — nothing leaves your machine
+
+## Prerequisites
+
+| Dependency | macOS | Ubuntu/Debian | Windows |
+|---|---|---|---|
+| **Docker** | `brew install colima && colima start` or Docker Desktop | `sudo apt install docker.io docker-compose-plugin` | [Docker Desktop](https://docker.com/products/docker-desktop/) |
+| **Ollama** | `brew install ollama && ollama serve` | `curl -fsSL https://ollama.com/install.sh \| sh` | [Ollama installer](https://ollama.com/download) |
+| **Python 3.11+** | `brew install python@3.12` | `sudo apt install python3.12 python3.12-venv` | [python.org](https://python.org/downloads/) |
+
+## Quick Start
+
+```bash
+# Install (pick one)
+pip install knowledge-master          # from PyPI
+pipx install knowledge-master         # isolated install (recommended)
+
+# Or from source
+git clone https://github.com/subzone/knowledge-master.git
+cd knowledge-master
+python3 -m venv .venv && source .venv/bin/activate
+pip install -e .
+
+# One command setup
+km start
+
+# Index your first repo
+km index ~/path/to/your/project
+
+# Search
+km search "authentication flow"
+
+# Check blast radius
+km blast-radius postgres
+
+# Start web UI with graph visualization
+km serve
+```
+
+**Requirements:** Docker, Ollama, Python 3.11+
+
+## Features
+
+### Semantic Search with Graph Context
+```bash
+$ km search "how does auth work"
+┌────────┬──────────────────────┬─────────────────────┬──────────────────────┐
+│ Score  │ Source               │ Context             │ Preview              │
+├────────┼──────────────────────┼─────────────────────┼──────────────────────┤
+│ 0.847  │ src/auth/service.py  │ repo:myapp, by:Alex │ JWT token validat... │
+│ 0.791  │ docs/auth.md         │ repo:myapp          │ Authentication f...  │
+└────────┴──────────────────────┴─────────────────────┴──────────────────────┘
+```
+
+### Blast Radius Analysis
+```bash
+$ km blast-radius auth-service
+💥 Blast radius: auth-service
+├── ⚙️ user-service (Service, via DEPENDS_ON)
+├── ⚙️ payment-service (Service, via DEPENDS_ON)
+├── 📦 frontend (Repo, via USES_SERVICE)
+└── 👤 Alex (Person, via AUTHORED)
+
+4 entities affected
+```
+
+### Convention Enforcement
+```bash
+$ km check-conventions ~/my-project
+  ✓ src/ directory (structure)
+  ✓ separate test directory (testing)
+  ✗ snake_case files (file-naming)
+  ✓ Repository pattern (design-pattern)
+
+1 convention(s) violated
+```
+
+### Web UI & Graph Visualization
+
+```bash
+$ km serve
+Knowledge Master UI → http://127.0.0.1:9999
+```
+
+Interactive force-directed graph showing your entire knowledge topology:
+- 📦 Repos (blue) → 🔧 Technologies (red)
+- ⚙️ Services (orange) → Dependencies
+- 👤 People → Authorship
+- 📏 Conventions (purple)
+
+### MCP Integration (AI Agents)
+
+Add to your Kiro/Claude agent config:
+
+```json
+{
+  "mcpServers": {
+    "knowledge": {
+      "command": "km-server"
+    }
+  }
+}
+```
+
+Your AI agent gets these tools:
+- `search` — semantic search with graph context
+- `blast_radius` — dependency analysis
+- `check_conventions` — verify code follows team patterns
+- `index_repo` — add new repos to the knowledge base
+
+## Architecture
+
+```
+┌─────────────────────────────────────────────────┐
+│                  Your AI Agent                    │
+│              (Kiro / Claude / Cursor)             │
+└────────────────────┬────────────────────────────┘
+                     │ MCP Protocol
+┌────────────────────▼────────────────────────────┐
+│              Knowledge Master                    │
+│                                                  │
+│  ┌──────────┐  ┌────────────┐  ┌────────────┐  │
+│  │  Search  │  │Blast Radius│  │ Conventions│  │
+│  └────┬─────┘  └─────┬──────┘  └─────┬──────┘  │
+│       │               │               │         │
+│  ┌────▼───────────────▼───────────────▼──────┐  │
+│  │            FalkorDB (Graph + Vector)       │  │
+│  │                                           │  │
+│  │  [Repo]──USES_TECH──▶[Tech]              │  │
+│  │    │                                      │  │
+│  │    ├──DEFINES_SERVICE──▶[Service]         │  │
+│  │    │                      │               │  │
+│  │    ├──FOLLOWS──▶[Convention]              │  │
+│  │    │                                      │  │
+│  │  [Person]──AUTHORED──▶[Document]          │  │
+│  │                          │                │  │
+│  │                    [Chunk + Embedding]     │  │
+│  └───────────────────────────────────────────┘  │
+│                                                  │
+│  ┌───────────────────────────────────────────┐  │
+│  │         Ollama (nomic-embed-text)          │  │
+│  └───────────────────────────────────────────┘  │
+└──────────────────────────────────────────────────┘
+```
+
+## Commands
+
+| Command | Description |
+|---|---|
+| `km start` | Boot Docker containers + pull embedding model |
+| `km stop` | Stop containers |
+| `km index <path>` | Index a git repo or docs directory |
+| `km search <query>` | Semantic search with graph context |
+| `km blast-radius <target>` | Show dependencies and affected entities |
+| `km check-conventions <path>` | Verify code follows detected patterns |
+| `km list` | Show indexed repos, techs, stats |
+| `km remove <name>` | Remove a source from the knowledge base |
+| `km serve` | Start web UI at http://127.0.0.1:9999 |
+| `km status` | Check system health |
+
+## What gets extracted automatically
+
+When you index a repo, Knowledge Master detects:
+
+| Category | Examples |
+|---|---|
+| **Tech stack** | Languages, frameworks, packages from dependency files |
+| **Services** | From docker-compose.yml and K8s manifests |
+| **Dependencies** | Service-to-service relationships |
+| **Conventions** | File naming (snake_case/kebab-case), folder structure, design patterns |
+| **People** | Git commit authors and file ownership |
+| **Code structure** | Functions, classes, chunked by AST-aware boundaries |
+
+## Comparison
+
+| Feature | Knowledge Master | Generic RAG | GitHub Copilot | Glean |
+|---|---|---|---|---|
+| Graph relationships | ✅ | ❌ | ❌ | Partial |
+| Blast radius analysis | ✅ | ❌ | ❌ | ❌ |
+| Convention enforcement | ✅ | ❌ | ❌ | ❌ |
+| Local-first (no cloud) | ✅ | ✅ | ❌ | ❌ |
+| MCP integration | ✅ | ❌ | ❌ | ❌ |
+| Multi-repo intelligence | ✅ | Partial | ❌ | ✅ |
+| Cost | Free | Free | $19/mo | $15-30/mo |
+
+## Development
+
+```bash
+# Run tests
+pytest
+
+# Lint
+ruff check knowledge_master/
+
+# Run MCP server directly
+python -m knowledge_master.server
+
+# Run CLI directly
+python -m knowledge_master.cli status
+```
+
+## Troubleshooting
+
+| Issue | Fix |
+|---|---|
+| `km start` fails with "Docker not running" | Start Docker: `colima start` (macOS) or `sudo systemctl start docker` (Linux) |
+| `km start` fails with "Ollama not found" | Install Ollama from https://ollama.com and run `ollama serve` |
+| `km index` is slow | First run downloads the embedding model (~274MB). Subsequent runs are fast. |
+| Web UI shows "Connection refused" | Make sure containers are running: `km start` |
+| Search returns poor results | Index more content. Quality improves with more context in the graph. |
+| Port 9999 already in use | Use `km serve --port 8888` |
+
+## License
+
+MIT

knowledge_master-0.1.0/knowledge_master/__main__.py

@@ -0,0 +1,4 @@
+"""Allow running as: python -m knowledge_master"""
+from .cli import app
+
+app()

knowledge_master-0.1.0/knowledge_master/chunking.py

@@ -0,0 +1,106 @@
+"""Smart chunking engine - splits text by structure (headings, functions, paragraphs)."""
+
+import hashlib
+import re
+
+
+def chunk_id(source: str, index: int) -> str:
+    """Deterministic chunk ID from source path and position."""
+    return hashlib.md5(f"{source}:{index}".encode()).hexdigest()
+
+
+def chunk_markdown(text: str, max_tokens: int = 512) -> list[dict]:
+    """Split markdown by headings, keeping sections together."""
+    sections = re.split(r"(?=^#{1,3}\s)", text, flags=re.MULTILINE)
+    chunks = []
+    for section in sections:
+        section = section.strip()
+        if not section:
+            continue
+        # If section is too long, split by paragraphs
+        if len(section.split()) > max_tokens:
+            paragraphs = section.split("\n\n")
+            buffer = ""
+            for para in paragraphs:
+                if len((buffer + para).split()) > max_tokens and buffer:
+                    chunks.append(buffer.strip())
+                    buffer = para
+                else:
+                    buffer = buffer + "\n\n" + para if buffer else para
+            if buffer.strip():
+                chunks.append(buffer.strip())
+        else:
+            chunks.append(section)
+    return chunks
+
+
+def chunk_code(text: str, language: str = "", max_tokens: int = 400) -> list[dict]:
+    """Split code by function/class boundaries or fixed blocks."""
+    # Try to split by top-level definitions
+    patterns = {
+        "python": r"(?=^(?:def |class |async def ))",
+        "typescript": r"(?=^(?:export |function |class |const \w+ = ))",
+        "rust": r"(?=^(?:fn |pub fn |impl |struct |enum ))",
+        "go": r"(?=^(?:func ))",
+    }
+    pattern = patterns.get(language)
+    if pattern:
+        parts = re.split(pattern, text, flags=re.MULTILINE)
+    else:
+        # Fall back to splitting by blank lines / large gaps
+        parts = re.split(r"\n{3,}", text)
+
+    chunks = []
+    buffer = ""
+    for part in parts:
+        part = part.strip()
+        if not part:
+            continue
+        if len((buffer + part).split()) > max_tokens and buffer:
+            chunks.append(buffer.strip())
+            buffer = part
+        else:
+            buffer = buffer + "\n\n" + part if buffer else part
+    if buffer.strip():
+        chunks.append(buffer.strip())
+    return chunks
+
+
+def chunk_text(text: str, max_tokens: int = 512) -> list[str]:
+    """Generic text chunking by paragraphs."""
+    paragraphs = text.split("\n\n")
+    chunks = []
+    buffer = ""
+    for para in paragraphs:
+        if len((buffer + para).split()) > max_tokens and buffer:
+            chunks.append(buffer.strip())
+            buffer = para
+        else:
+            buffer = buffer + "\n\n" + para if buffer else para
+    if buffer.strip():
+        chunks.append(buffer.strip())
+    return chunks
+
+
+LANGUAGE_MAP = {
+    ".py": "python",
+    ".ts": "typescript",
+    ".tsx": "typescript",
+    ".js": "javascript",
+    ".rs": "rust",
+    ".go": "go",
+    ".java": "java",
+    ".md": "markdown",
+    ".markdown": "markdown",
+}
+
+
+def chunk_file(text: str, extension: str, max_tokens: int = 512) -> list[str]:
+    """Route to appropriate chunker based on file extension."""
+    lang = LANGUAGE_MAP.get(extension, "")
+    if lang == "markdown":
+        return chunk_markdown(text, max_tokens)
+    elif lang:
+        return chunk_code(text, lang, max_tokens)
+    else:
+        return chunk_text(text, max_tokens)