@tecet/ollm 0.1.4 → 0.1.5
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/dist/cli.js +20 -14
- package/dist/cli.js.map +3 -3
- package/dist/services/documentService.d.ts.map +1 -1
- package/dist/services/documentService.js +12 -2
- package/dist/services/documentService.js.map +1 -1
- package/dist/ui/components/docs/DocsPanel.d.ts.map +1 -1
- package/dist/ui/components/docs/DocsPanel.js +1 -1
- package/dist/ui/components/docs/DocsPanel.js.map +1 -1
- package/dist/ui/components/launch/VersionBanner.js +1 -1
- package/dist/ui/components/launch/VersionBanner.js.map +1 -1
- package/dist/ui/components/layout/KeybindsLegend.d.ts.map +1 -1
- package/dist/ui/components/layout/KeybindsLegend.js +1 -1
- package/dist/ui/components/layout/KeybindsLegend.js.map +1 -1
- package/dist/ui/components/tabs/BugReportTab.js +1 -1
- package/dist/ui/components/tabs/BugReportTab.js.map +1 -1
- package/dist/ui/services/docsService.d.ts +12 -27
- package/dist/ui/services/docsService.d.ts.map +1 -1
- package/dist/ui/services/docsService.js +40 -67
- package/dist/ui/services/docsService.js.map +1 -1
- package/docs/README.md +3 -410
- package/package.json +10 -7
- package/scripts/copy-docs-to-user.cjs +34 -0
- package/docs/Context/CheckpointFlowDiagram.md +0 -673
- package/docs/Context/ContextArchitecture.md +0 -898
- package/docs/Context/ContextCompression.md +0 -1102
- package/docs/Context/ContextManagment.md +0 -750
- package/docs/Context/Index.md +0 -209
- package/docs/Context/README.md +0 -390
- package/docs/DevelopmentRoadmap/Index.md +0 -238
- package/docs/DevelopmentRoadmap/OLLM-CLI_Releases.md +0 -419
- package/docs/DevelopmentRoadmap/PlanedFeatures.md +0 -448
- package/docs/DevelopmentRoadmap/README.md +0 -174
- package/docs/DevelopmentRoadmap/Roadmap.md +0 -572
- package/docs/DevelopmentRoadmap/RoadmapVisual.md +0 -372
- package/docs/Hooks/Architecture.md +0 -885
- package/docs/Hooks/Index.md +0 -244
- package/docs/Hooks/KeyboardShortcuts.md +0 -248
- package/docs/Hooks/Protocol.md +0 -817
- package/docs/Hooks/README.md +0 -403
- package/docs/Hooks/UserGuide.md +0 -1483
- package/docs/Hooks/VisualGuide.md +0 -598
- package/docs/Index.md +0 -506
- package/docs/Installation.md +0 -586
- package/docs/Introduction.md +0 -367
- package/docs/LLM Models/Index.md +0 -239
- package/docs/LLM Models/LLM_GettingStarted.md +0 -748
- package/docs/LLM Models/LLM_Index.md +0 -701
- package/docs/LLM Models/LLM_MemorySystem.md +0 -337
- package/docs/LLM Models/LLM_ModelCompatibility.md +0 -499
- package/docs/LLM Models/LLM_ModelsArchitecture.md +0 -933
- package/docs/LLM Models/LLM_ModelsCommands.md +0 -839
- package/docs/LLM Models/LLM_ModelsConfiguration.md +0 -1094
- package/docs/LLM Models/LLM_ModelsList.md +0 -1071
- package/docs/LLM Models/LLM_ModelsList.md.backup +0 -400
- package/docs/LLM Models/README.md +0 -355
- package/docs/MCP/MCP_Architecture.md +0 -1086
- package/docs/MCP/MCP_Commands.md +0 -1111
- package/docs/MCP/MCP_GettingStarted.md +0 -590
- package/docs/MCP/MCP_Index.md +0 -524
- package/docs/MCP/MCP_Integration.md +0 -866
- package/docs/MCP/MCP_Marketplace.md +0 -160
- package/docs/MCP/README.md +0 -415
- package/docs/Prompts System/Architecture.md +0 -760
- package/docs/Prompts System/Index.md +0 -223
- package/docs/Prompts System/PromptsRouting.md +0 -1047
- package/docs/Prompts System/PromptsTemplates.md +0 -1102
- package/docs/Prompts System/README.md +0 -389
- package/docs/Prompts System/SystemPrompts.md +0 -856
- package/docs/Quickstart.md +0 -535
- package/docs/Tools/Architecture.md +0 -884
- package/docs/Tools/GettingStarted.md +0 -624
- package/docs/Tools/Index.md +0 -216
- package/docs/Tools/ManifestReference.md +0 -141
- package/docs/Tools/README.md +0 -440
- package/docs/Tools/UserGuide.md +0 -773
- package/docs/Troubleshooting.md +0 -1265
- package/docs/UI&Settings/Architecture.md +0 -729
- package/docs/UI&Settings/ColorASCII.md +0 -34
- package/docs/UI&Settings/Commands.md +0 -755
- package/docs/UI&Settings/Configuration.md +0 -872
- package/docs/UI&Settings/Index.md +0 -293
- package/docs/UI&Settings/Keybinds.md +0 -372
- package/docs/UI&Settings/README.md +0 -278
- package/docs/UI&Settings/Terminal.md +0 -637
- package/docs/UI&Settings/Themes.md +0 -604
- package/docs/UI&Settings/UIGuide.md +0 -550
package/docs/Context/Index.md
DELETED
|
@@ -1,209 +0,0 @@
|
|
|
1
|
-
# Context Management Documentation Index
|
|
2
|
-
|
|
3
|
-
**Quick Reference with Links**
|
|
4
|
-
|
|
5
|
-
This index provides quick navigation to all Context Management documentation with brief descriptions.
|
|
6
|
-
|
|
7
|
-
---
|
|
8
|
-
|
|
9
|
-
## 📚 Core Documentation
|
|
10
|
-
|
|
11
|
-
### [README.md](README.md)
|
|
12
|
-
|
|
13
|
-
**Overview and Navigation Guide**
|
|
14
|
-
|
|
15
|
-
Main entry point for Context Management documentation. Provides overview of all features, quick links, learning paths, and common use cases.
|
|
16
|
-
|
|
17
|
-
**Topics:** Overview, Features, Configuration, Troubleshooting
|
|
18
|
-
**Audience:** All users
|
|
19
|
-
|
|
20
|
-
---
|
|
21
|
-
|
|
22
|
-
### [Context Architecture](ContextArchitecture.md)
|
|
23
|
-
|
|
24
|
-
**System Architecture and Design**
|
|
25
|
-
|
|
26
|
-
Complete technical documentation of the Context Management system architecture. Covers VRAM monitoring, context sizing, compression service, checkpoint system, and all component interactions.
|
|
27
|
-
|
|
28
|
-
**Topics:** Architecture, VRAM Detection, Context Tiers, Components, Data Flow
|
|
29
|
-
**Audience:** Developers, architects
|
|
30
|
-
|
|
31
|
-
**Key Sections:**
|
|
32
|
-
|
|
33
|
-
- System overview and architecture
|
|
34
|
-
- VRAM monitoring (NVIDIA, AMD, Apple Silicon)
|
|
35
|
-
- Context sizing and tier selection
|
|
36
|
-
- Compression service architecture
|
|
37
|
-
- Checkpoint system design
|
|
38
|
-
- Component interactions and data flow
|
|
39
|
-
|
|
40
|
-
---
|
|
41
|
-
|
|
42
|
-
### [Context Management](ContextManagment.md)
|
|
43
|
-
|
|
44
|
-
**Context Sizing and VRAM Monitoring**
|
|
45
|
-
|
|
46
|
-
Comprehensive guide to context sizing, VRAM monitoring, and context tier selection. Explains how context size is determined at startup and remains fixed for the session.
|
|
47
|
-
|
|
48
|
-
**Topics:** Context Tiers, VRAM Detection, Context Sizing, Memory Management
|
|
49
|
-
**Audience:** All users
|
|
50
|
-
|
|
51
|
-
**Key Sections:**
|
|
52
|
-
|
|
53
|
-
- Context tiers (Minimal, Basic, Standard, Premium, Ultra)
|
|
54
|
-
- VRAM detection methods
|
|
55
|
-
- Context size calculation (85% utilization)
|
|
56
|
-
- Fixed context sizing approach
|
|
57
|
-
- Memory safety guards
|
|
58
|
-
- Context usage monitoring
|
|
59
|
-
|
|
60
|
-
---
|
|
61
|
-
|
|
62
|
-
### [Context Compression](ContextCompression.md)
|
|
63
|
-
|
|
64
|
-
**Compression Strategies and Implementation**
|
|
65
|
-
|
|
66
|
-
Detailed guide to the context compression system. Explains how LLM-based summarization works, compression strategies, and when compression triggers.
|
|
67
|
-
|
|
68
|
-
**Topics:** Compression, Summarization, Strategies, Triggers
|
|
69
|
-
**Audience:** All users
|
|
70
|
-
|
|
71
|
-
**Key Sections:**
|
|
72
|
-
|
|
73
|
-
- LLM-based summarization (LLM does the work)
|
|
74
|
-
- Compression strategies (aggressive, balanced, conservative)
|
|
75
|
-
- Compression triggers and thresholds
|
|
76
|
-
- What gets compressed vs preserved
|
|
77
|
-
- Compression quality and effectiveness
|
|
78
|
-
- Manual compression commands
|
|
79
|
-
|
|
80
|
-
---
|
|
81
|
-
|
|
82
|
-
### [Checkpoint Flow Diagram](CheckpointFlowDiagram.md)
|
|
83
|
-
|
|
84
|
-
**Checkpoint System and Rollover Flow**
|
|
85
|
-
|
|
86
|
-
Visual guide to the checkpoint system with flow diagrams. Explains checkpoint types, creation, restoration, and session rollover process.
|
|
87
|
-
|
|
88
|
-
**Topics:** Checkpoints, Rollover, Session Management, Recovery
|
|
89
|
-
**Audience:** All users
|
|
90
|
-
|
|
91
|
-
**Key Sections:**
|
|
92
|
-
|
|
93
|
-
- Checkpoint types (manual, automatic, rollover)
|
|
94
|
-
- Checkpoint creation flow
|
|
95
|
-
- Checkpoint restoration process
|
|
96
|
-
- Session rollover workflow
|
|
97
|
-
- Checkpoint storage and management
|
|
98
|
-
- Recovery scenarios
|
|
99
|
-
|
|
100
|
-
---
|
|
101
|
-
|
|
102
|
-
## 📖 Documentation by Topic
|
|
103
|
-
|
|
104
|
-
### Context Sizing
|
|
105
|
-
|
|
106
|
-
- [Context Management](ContextManagment.md) - Context tiers and sizing
|
|
107
|
-
- [Context Architecture](ContextArchitecture.md#context-sizing) - Sizing implementation
|
|
108
|
-
|
|
109
|
-
### VRAM Monitoring
|
|
110
|
-
|
|
111
|
-
- [Context Management](ContextManagment.md#vram-monitoring) - VRAM detection
|
|
112
|
-
- [Context Architecture](ContextArchitecture.md#vram-monitoring) - VRAM architecture
|
|
113
|
-
|
|
114
|
-
### Compression
|
|
115
|
-
|
|
116
|
-
- [Context Compression](ContextCompression.md) - Complete compression guide
|
|
117
|
-
- [Context Architecture](ContextArchitecture.md#compression-service) - Compression architecture
|
|
118
|
-
|
|
119
|
-
### Checkpoints
|
|
120
|
-
|
|
121
|
-
- [Checkpoint Flow](CheckpointFlowDiagram.md) - Checkpoint system
|
|
122
|
-
- [Context Architecture](ContextArchitecture.md#checkpoint-system) - Checkpoint architecture
|
|
123
|
-
|
|
124
|
-
### Configuration
|
|
125
|
-
|
|
126
|
-
- [README](README.md#configuration) - Configuration overview
|
|
127
|
-
- [Context Management](ContextManagment.md#configuration) - Detailed settings
|
|
128
|
-
|
|
129
|
-
---
|
|
130
|
-
|
|
131
|
-
## 📖 Documentation by Audience
|
|
132
|
-
|
|
133
|
-
### For New Users
|
|
134
|
-
|
|
135
|
-
1. [README](README.md) - Start here
|
|
136
|
-
2. [Context Management](ContextManagment.md) - Understanding context
|
|
137
|
-
3. [Context Compression](ContextCompression.md) - Managing context
|
|
138
|
-
|
|
139
|
-
### For Regular Users
|
|
140
|
-
|
|
141
|
-
1. [Checkpoint Flow](CheckpointFlowDiagram.md) - Using checkpoints
|
|
142
|
-
2. [Context Compression](ContextCompression.md) - Compression strategies
|
|
143
|
-
3. [README](README.md#configuration) - Configuration options
|
|
144
|
-
|
|
145
|
-
### For Developers
|
|
146
|
-
|
|
147
|
-
1. [Context Architecture](ContextArchitecture.md) - System design
|
|
148
|
-
2. [Context Management](ContextManagment.md) - Implementation details
|
|
149
|
-
3. [Context Compression](ContextCompression.md) - Compression implementation
|
|
150
|
-
|
|
151
|
-
---
|
|
152
|
-
|
|
153
|
-
## 🔗 Related Documentation
|
|
154
|
-
|
|
155
|
-
### Core Systems
|
|
156
|
-
|
|
157
|
-
- [Model Management](../LLM%20Models/README.md) - Model selection
|
|
158
|
-
- [Prompts System](../Prompts%20System/README.md) - System prompts
|
|
159
|
-
- [User Interface](../UI&Settings/README.md) - UI documentation
|
|
160
|
-
|
|
161
|
-
### Commands
|
|
162
|
-
|
|
163
|
-
- [Context Commands](../UI&Settings/Commands.md#context-management) - CLI commands
|
|
164
|
-
- [Snapshot Commands](../UI&Settings/Commands.md#snapshot-management) - Checkpoint commands
|
|
165
|
-
|
|
166
|
-
### Developer Resources
|
|
167
|
-
|
|
168
|
-
- Knowledge DB: `dev_ContextManagement.md` - Architecture details
|
|
169
|
-
- Knowledge DB: `dev_ContextCompression.md` - Compression details
|
|
170
|
-
|
|
171
|
-
---
|
|
172
|
-
|
|
173
|
-
## 📊 Documentation Status
|
|
174
|
-
|
|
175
|
-
### Completed ✅
|
|
176
|
-
|
|
177
|
-
| Document | Status |
|
|
178
|
-
| ------------------------ | ----------- |
|
|
179
|
-
| README.md | ✅ Complete |
|
|
180
|
-
| Index.md | ✅ Complete |
|
|
181
|
-
| ContextArchitecture.md | ✅ Complete |
|
|
182
|
-
| ContextManagment.md | ✅ Complete |
|
|
183
|
-
| ContextCompression.md | ✅ Complete |
|
|
184
|
-
| CheckpointFlowDiagram.md | ✅ Complete |
|
|
185
|
-
|
|
186
|
-
**Overall Progress:** 100% complete (6/6 files)
|
|
187
|
-
|
|
188
|
-
---
|
|
189
|
-
|
|
190
|
-
## 🎯 Quick Links
|
|
191
|
-
|
|
192
|
-
### Common Tasks
|
|
193
|
-
|
|
194
|
-
- Check context usage → [Context Commands](../UI&Settings/Commands.md#context-stats)
|
|
195
|
-
- Compress context → [Context Compression](ContextCompression.md#manual-compression)
|
|
196
|
-
- Create checkpoint → [Checkpoint Flow](CheckpointFlowDiagram.md#creating-checkpoints)
|
|
197
|
-
- Configure context → [README](README.md#configuration)
|
|
198
|
-
|
|
199
|
-
### Understanding Systems
|
|
200
|
-
|
|
201
|
-
- How context sizing works → [Context Management](ContextManagment.md)
|
|
202
|
-
- How compression works → [Context Compression](ContextCompression.md)
|
|
203
|
-
- How checkpoints work → [Checkpoint Flow](CheckpointFlowDiagram.md)
|
|
204
|
-
- System architecture → [Context Architecture](ContextArchitecture.md)
|
|
205
|
-
|
|
206
|
-
---
|
|
207
|
-
|
|
208
|
-
**Last Updated:** January 26, 2026
|
|
209
|
-
**Version:** 0.1.0
|
package/docs/Context/README.md
DELETED
|
@@ -1,390 +0,0 @@
|
|
|
1
|
-
# Context Management Documentation
|
|
2
|
-
|
|
3
|
-
**Last Updated:** January 26, 2026
|
|
4
|
-
|
|
5
|
-
Welcome to the Context Management documentation for OLLM CLI. This section covers the complete context management system, including context sizing, compression, checkpoints, and VRAM monitoring.
|
|
6
|
-
|
|
7
|
-
---
|
|
8
|
-
|
|
9
|
-
## 📚 Documentation Overview
|
|
10
|
-
|
|
11
|
-
### Core Documentation
|
|
12
|
-
|
|
13
|
-
- **[Context Architecture](ContextArchitecture.md)** - Complete system architecture and design
|
|
14
|
-
- **[Context Management](ContextManagment.md)** - Context sizing, tiers, and VRAM monitoring
|
|
15
|
-
- **[Context Compression](ContextCompression.md)** - Compression strategies and implementation
|
|
16
|
-
- **[Checkpoint Flow](CheckpointFlowDiagram.md)** - Checkpoint system and rollover flow
|
|
17
|
-
|
|
18
|
-
---
|
|
19
|
-
|
|
20
|
-
## 🎯 What is Context Management?
|
|
21
|
-
|
|
22
|
-
The **Context Management** system handles the conversation history and system prompts sent to the LLM, ensuring optimal performance within hardware constraints:
|
|
23
|
-
|
|
24
|
-
### 1. **Fixed Context Sizing**
|
|
25
|
-
|
|
26
|
-
Context size is determined once at startup based on available VRAM:
|
|
27
|
-
|
|
28
|
-
- VRAM detection (NVIDIA, AMD, Apple Silicon)
|
|
29
|
-
- Context tier selection (Minimal, Basic, Standard, Premium, Ultra)
|
|
30
|
-
- 85% utilization for optimal performance (pre-calculated in LLM_profiles.json)
|
|
31
|
-
- Context remains FIXED for the entire session
|
|
32
|
-
|
|
33
|
-
### 2. **Context Compression**
|
|
34
|
-
|
|
35
|
-
Automatic compression when context approaches limits:
|
|
36
|
-
|
|
37
|
-
- LLM-based summarization (LLM does the work, not the app)
|
|
38
|
-
- Multiple compression strategies (aggressive, balanced, conservative)
|
|
39
|
-
- Preserves recent messages and critical information
|
|
40
|
-
- Maintains conversation continuity
|
|
41
|
-
|
|
42
|
-
### 3. **Checkpoint System**
|
|
43
|
-
|
|
44
|
-
Save and restore conversation state:
|
|
45
|
-
|
|
46
|
-
- Manual checkpoints for important conversation points
|
|
47
|
-
- Automatic checkpoints before major operations
|
|
48
|
-
- Rollover to new session when context full
|
|
49
|
-
- Checkpoint restoration for session recovery
|
|
50
|
-
|
|
51
|
-
### 4. **VRAM Monitoring**
|
|
52
|
-
|
|
53
|
-
Real-time GPU memory tracking:
|
|
54
|
-
|
|
55
|
-
- Cross-platform support (NVIDIA, AMD, Apple Silicon)
|
|
56
|
-
- Automatic VRAM detection at startup
|
|
57
|
-
- Context tier selection based on available memory
|
|
58
|
-
- Memory safety guards to prevent OOM errors
|
|
59
|
-
|
|
60
|
-
---
|
|
61
|
-
|
|
62
|
-
## 📖 Documentation Structure
|
|
63
|
-
|
|
64
|
-
```
|
|
65
|
-
docs/Context/
|
|
66
|
-
├── README.md ← You are here
|
|
67
|
-
├── Index.md Quick reference with links
|
|
68
|
-
├── ContextArchitecture.md System architecture
|
|
69
|
-
├── ContextManagment.md Context sizing and VRAM
|
|
70
|
-
├── ContextCompression.md Compression system
|
|
71
|
-
└── CheckpointFlowDiagram.md Checkpoint flow
|
|
72
|
-
```
|
|
73
|
-
|
|
74
|
-
---
|
|
75
|
-
|
|
76
|
-
## 🎓 Key Concepts
|
|
77
|
-
|
|
78
|
-
### Context Tiers
|
|
79
|
-
|
|
80
|
-
Five fixed context tiers based on available VRAM:
|
|
81
|
-
|
|
82
|
-
| Tier | Context Size | VRAM Required | Use Case |
|
|
83
|
-
| ------------ | ------------ | ------------- | ------------------------- |
|
|
84
|
-
| **Minimal** | 2K-4K | <4GB | Quick tasks, small models |
|
|
85
|
-
| **Basic** | 4K-8K | 4-8GB | Standard conversations |
|
|
86
|
-
| **Standard** | 8K-16K | 8-12GB | Extended conversations |
|
|
87
|
-
| **Premium** | 16K-32K | 12-24GB | Long conversations |
|
|
88
|
-
| **Ultra** | 32K+ | 24GB+ | Maximum context |
|
|
89
|
-
|
|
90
|
-
**See:** [Context Management](ContextManagment.md)
|
|
91
|
-
|
|
92
|
-
### Context Compression
|
|
93
|
-
|
|
94
|
-
When context approaches the limit, compression automatically triggers:
|
|
95
|
-
|
|
96
|
-
**Process:**
|
|
97
|
-
|
|
98
|
-
1. Detect context approaching limit (e.g., 90% full)
|
|
99
|
-
2. Select compression strategy (aggressive, balanced, conservative)
|
|
100
|
-
3. LLM summarizes older messages
|
|
101
|
-
4. Replace old messages with summary
|
|
102
|
-
5. Continue conversation with more space
|
|
103
|
-
|
|
104
|
-
**See:** [Context Compression](ContextCompression.md)
|
|
105
|
-
|
|
106
|
-
### Checkpoint System
|
|
107
|
-
|
|
108
|
-
Save conversation state for recovery or rollover:
|
|
109
|
-
|
|
110
|
-
**Types:**
|
|
111
|
-
|
|
112
|
-
- **Manual Checkpoints** - User-created save points
|
|
113
|
-
- **Automatic Checkpoints** - Created before major operations
|
|
114
|
-
- **Rollover Checkpoints** - Created when starting new session
|
|
115
|
-
|
|
116
|
-
**See:** [Checkpoint Flow](CheckpointFlowDiagram.md)
|
|
117
|
-
|
|
118
|
-
### VRAM Monitoring
|
|
119
|
-
|
|
120
|
-
Automatic GPU memory detection:
|
|
121
|
-
|
|
122
|
-
**Supported Platforms:**
|
|
123
|
-
|
|
124
|
-
- **NVIDIA** - nvidia-smi (Windows, Linux)
|
|
125
|
-
- **AMD** - rocm-smi (Linux)
|
|
126
|
-
- **Apple Silicon** - Metal API (macOS)
|
|
127
|
-
|
|
128
|
-
**See:** [Context Architecture](ContextArchitecture.md)
|
|
129
|
-
|
|
130
|
-
---
|
|
131
|
-
|
|
132
|
-
## 💡 Common Use Cases
|
|
133
|
-
|
|
134
|
-
### Check Context Usage
|
|
135
|
-
|
|
136
|
-
```bash
|
|
137
|
-
# View current context stats
|
|
138
|
-
/context stats
|
|
139
|
-
|
|
140
|
-
# Shows:
|
|
141
|
-
# - Current tokens used
|
|
142
|
-
# - Total context size
|
|
143
|
-
# - Percentage used
|
|
144
|
-
# - Compression status
|
|
145
|
-
```
|
|
146
|
-
|
|
147
|
-
### Manual Compression
|
|
148
|
-
|
|
149
|
-
```bash
|
|
150
|
-
# Trigger compression manually
|
|
151
|
-
/compact
|
|
152
|
-
|
|
153
|
-
# Options:
|
|
154
|
-
/compact aggressive # Maximum compression
|
|
155
|
-
/compact balanced # Default compression
|
|
156
|
-
/compact conservative # Minimal compression
|
|
157
|
-
```
|
|
158
|
-
|
|
159
|
-
### Create Checkpoint
|
|
160
|
-
|
|
161
|
-
```bash
|
|
162
|
-
# Save current conversation state
|
|
163
|
-
/snapshot create my-checkpoint
|
|
164
|
-
|
|
165
|
-
# List checkpoints
|
|
166
|
-
/snapshot list
|
|
167
|
-
|
|
168
|
-
# Restore checkpoint
|
|
169
|
-
/snapshot restore my-checkpoint
|
|
170
|
-
```
|
|
171
|
-
|
|
172
|
-
### Start New Session
|
|
173
|
-
|
|
174
|
-
```bash
|
|
175
|
-
# Start fresh session (creates rollover checkpoint)
|
|
176
|
-
/session new
|
|
177
|
-
|
|
178
|
-
# Resume previous session
|
|
179
|
-
/session resume <name>
|
|
180
|
-
```
|
|
181
|
-
|
|
182
|
-
**Learn more:** [Context Commands](../UI&Settings/Commands.md#context-management)
|
|
183
|
-
|
|
184
|
-
---
|
|
185
|
-
|
|
186
|
-
## 🛠️ Configuration
|
|
187
|
-
|
|
188
|
-
### Context Settings
|
|
189
|
-
|
|
190
|
-
```yaml
|
|
191
|
-
context:
|
|
192
|
-
# Context tier (auto-detected from VRAM)
|
|
193
|
-
tier: Standard
|
|
194
|
-
|
|
195
|
-
# Enable automatic compression
|
|
196
|
-
autoCompress: true
|
|
197
|
-
|
|
198
|
-
# Compression trigger threshold
|
|
199
|
-
compressionThreshold: 0.9 # 90% full
|
|
200
|
-
|
|
201
|
-
# Compression strategy
|
|
202
|
-
compressionStrategy: balanced # aggressive, balanced, conservative
|
|
203
|
-
```
|
|
204
|
-
|
|
205
|
-
### VRAM Settings
|
|
206
|
-
|
|
207
|
-
```yaml
|
|
208
|
-
vram:
|
|
209
|
-
# Enable VRAM monitoring
|
|
210
|
-
enabled: true
|
|
211
|
-
|
|
212
|
-
# VRAM detection method
|
|
213
|
-
# auto, nvidia-smi, rocm-smi, metal
|
|
214
|
-
detectionMethod: auto
|
|
215
|
-
|
|
216
|
-
# Manual VRAM override (GB)
|
|
217
|
-
manualVRAM: null
|
|
218
|
-
```
|
|
219
|
-
|
|
220
|
-
### Checkpoint Settings
|
|
221
|
-
|
|
222
|
-
```yaml
|
|
223
|
-
checkpoints:
|
|
224
|
-
# Enable automatic checkpoints
|
|
225
|
-
autoCheckpoint: true
|
|
226
|
-
|
|
227
|
-
# Checkpoint before major operations
|
|
228
|
-
checkpointBeforeOperations: true
|
|
229
|
-
|
|
230
|
-
# Maximum checkpoints to keep
|
|
231
|
-
maxCheckpoints: 10
|
|
232
|
-
```
|
|
233
|
-
|
|
234
|
-
**Learn more:** [Configuration](../UI&Settings/Configuration.md)
|
|
235
|
-
|
|
236
|
-
---
|
|
237
|
-
|
|
238
|
-
## 🔍 Troubleshooting
|
|
239
|
-
|
|
240
|
-
### Common Issues
|
|
241
|
-
|
|
242
|
-
**Context fills up too quickly:**
|
|
243
|
-
|
|
244
|
-
- Enable automatic compression: `/config set autoCompress true`
|
|
245
|
-
- Use more aggressive compression: `/compact aggressive`
|
|
246
|
-
- Create checkpoint and start new session: `/snapshot create` then `/session new`
|
|
247
|
-
|
|
248
|
-
**VRAM detection not working:**
|
|
249
|
-
|
|
250
|
-
- Check GPU drivers installed
|
|
251
|
-
- Verify nvidia-smi/rocm-smi in PATH
|
|
252
|
-
- Manual override: `/config set vram.manualVRAM 8` (for 8GB)
|
|
253
|
-
|
|
254
|
-
**Compression not triggering:**
|
|
255
|
-
|
|
256
|
-
- Check compression enabled: `/config get autoCompress`
|
|
257
|
-
- Check threshold: `/config get compressionThreshold`
|
|
258
|
-
- Manually trigger: `/compact`
|
|
259
|
-
|
|
260
|
-
**Checkpoint restore fails:**
|
|
261
|
-
|
|
262
|
-
- Verify checkpoint exists: `/snapshot list`
|
|
263
|
-
- Check checkpoint file permissions
|
|
264
|
-
- Try creating new checkpoint: `/snapshot create test`
|
|
265
|
-
|
|
266
|
-
**See:** [Troubleshooting Guide](../Troubleshooting.md)
|
|
267
|
-
|
|
268
|
-
---
|
|
269
|
-
|
|
270
|
-
## 📊 Implementation Status
|
|
271
|
-
|
|
272
|
-
### Current (v0.1.0)
|
|
273
|
-
|
|
274
|
-
- ✅ VRAM Detection (NVIDIA, AMD, Apple Silicon)
|
|
275
|
-
- ✅ Fixed Context Sizing
|
|
276
|
-
- ✅ Context Tiers (Minimal, Basic, Standard, Premium, Ultra)
|
|
277
|
-
- ✅ LLM-based Compression
|
|
278
|
-
- ✅ Checkpoint System
|
|
279
|
-
- ✅ Context Usage Display
|
|
280
|
-
- ✅ Memory Safety Guards
|
|
281
|
-
|
|
282
|
-
### Planned (v0.2.0)
|
|
283
|
-
|
|
284
|
-
- ⏳ Advanced Compression Strategies
|
|
285
|
-
- ⏳ Context Analytics
|
|
286
|
-
- ⏳ Compression Quality Metrics
|
|
287
|
-
|
|
288
|
-
### Planned (v0.3.0)
|
|
289
|
-
|
|
290
|
-
- ⏳ Multi-tier Compression
|
|
291
|
-
- ⏳ Semantic Context Pruning
|
|
292
|
-
- ⏳ Context Optimization
|
|
293
|
-
|
|
294
|
-
---
|
|
295
|
-
|
|
296
|
-
## 🤝 Related Documentation
|
|
297
|
-
|
|
298
|
-
### Core Systems
|
|
299
|
-
|
|
300
|
-
- [Model Management](../LLM%20Models/README.md) - Model selection and configuration
|
|
301
|
-
- [Prompts System](../Prompts%20System/README.md) - System prompts and templates
|
|
302
|
-
- [User Interface](../UI&Settings/README.md) - UI documentation
|
|
303
|
-
|
|
304
|
-
### Developer Resources
|
|
305
|
-
|
|
306
|
-
- Knowledge DB: `dev_ContextManagement.md` - Context management architecture
|
|
307
|
-
- Knowledge DB: `dev_ContextCompression.md` - Compression implementation
|
|
308
|
-
|
|
309
|
-
---
|
|
310
|
-
|
|
311
|
-
## 🎯 Quick Start
|
|
312
|
-
|
|
313
|
-
### For New Users
|
|
314
|
-
|
|
315
|
-
1. **Check Your Context**
|
|
316
|
-
|
|
317
|
-
```bash
|
|
318
|
-
/context stats
|
|
319
|
-
```
|
|
320
|
-
|
|
321
|
-
2. **Enable Auto-Compression**
|
|
322
|
-
|
|
323
|
-
```bash
|
|
324
|
-
/config set autoCompress true
|
|
325
|
-
```
|
|
326
|
-
|
|
327
|
-
3. **Create Your First Checkpoint**
|
|
328
|
-
```bash
|
|
329
|
-
/snapshot create my-first-checkpoint
|
|
330
|
-
```
|
|
331
|
-
|
|
332
|
-
### For Advanced Users
|
|
333
|
-
|
|
334
|
-
1. **Optimize Compression**
|
|
335
|
-
|
|
336
|
-
```bash
|
|
337
|
-
/config set compressionStrategy aggressive
|
|
338
|
-
/config set compressionThreshold 0.85
|
|
339
|
-
```
|
|
340
|
-
|
|
341
|
-
2. **Monitor VRAM**
|
|
342
|
-
|
|
343
|
-
```bash
|
|
344
|
-
/config get vram
|
|
345
|
-
```
|
|
346
|
-
|
|
347
|
-
3. **Manage Checkpoints**
|
|
348
|
-
```bash
|
|
349
|
-
/snapshot list
|
|
350
|
-
/snapshot restore <name>
|
|
351
|
-
/snapshot delete <name>
|
|
352
|
-
```
|
|
353
|
-
|
|
354
|
-
---
|
|
355
|
-
|
|
356
|
-
## 📈 Performance Tips
|
|
357
|
-
|
|
358
|
-
### Maximize Context Efficiency
|
|
359
|
-
|
|
360
|
-
1. **Use Appropriate Tier** - Don't force larger context than needed
|
|
361
|
-
2. **Enable Auto-Compression** - Let system manage context automatically
|
|
362
|
-
3. **Create Checkpoints** - Save important conversation points
|
|
363
|
-
4. **Start Fresh Sessions** - Use rollover for very long conversations
|
|
364
|
-
5. **Monitor Usage** - Check `/context stats` regularly
|
|
365
|
-
|
|
366
|
-
### Optimize for Your Hardware
|
|
367
|
-
|
|
368
|
-
**Low VRAM (<4GB):**
|
|
369
|
-
|
|
370
|
-
- Use Minimal tier (2K-4K)
|
|
371
|
-
- Aggressive compression
|
|
372
|
-
- Frequent checkpoints
|
|
373
|
-
|
|
374
|
-
**Medium VRAM (4-8GB):**
|
|
375
|
-
|
|
376
|
-
- Use Basic tier (4K-8K)
|
|
377
|
-
- Balanced compression
|
|
378
|
-
- Regular checkpoints
|
|
379
|
-
|
|
380
|
-
**High VRAM (8GB+):**
|
|
381
|
-
|
|
382
|
-
- Use Standard/Premium tier (8K-32K)
|
|
383
|
-
- Conservative compression
|
|
384
|
-
- Occasional checkpoints
|
|
385
|
-
|
|
386
|
-
---
|
|
387
|
-
|
|
388
|
-
**Last Updated:** January 26, 2026
|
|
389
|
-
**Version:** 0.1.0
|
|
390
|
-
**Status:** Active Development
|