@tecet/ollm 0.1.4 → 0.1.5

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (86) hide show
  1. package/dist/cli.js +20 -14
  2. package/dist/cli.js.map +3 -3
  3. package/dist/services/documentService.d.ts.map +1 -1
  4. package/dist/services/documentService.js +12 -2
  5. package/dist/services/documentService.js.map +1 -1
  6. package/dist/ui/components/docs/DocsPanel.d.ts.map +1 -1
  7. package/dist/ui/components/docs/DocsPanel.js +1 -1
  8. package/dist/ui/components/docs/DocsPanel.js.map +1 -1
  9. package/dist/ui/components/launch/VersionBanner.js +1 -1
  10. package/dist/ui/components/launch/VersionBanner.js.map +1 -1
  11. package/dist/ui/components/layout/KeybindsLegend.d.ts.map +1 -1
  12. package/dist/ui/components/layout/KeybindsLegend.js +1 -1
  13. package/dist/ui/components/layout/KeybindsLegend.js.map +1 -1
  14. package/dist/ui/components/tabs/BugReportTab.js +1 -1
  15. package/dist/ui/components/tabs/BugReportTab.js.map +1 -1
  16. package/dist/ui/services/docsService.d.ts +12 -27
  17. package/dist/ui/services/docsService.d.ts.map +1 -1
  18. package/dist/ui/services/docsService.js +40 -67
  19. package/dist/ui/services/docsService.js.map +1 -1
  20. package/docs/README.md +3 -410
  21. package/package.json +10 -7
  22. package/scripts/copy-docs-to-user.cjs +34 -0
  23. package/docs/Context/CheckpointFlowDiagram.md +0 -673
  24. package/docs/Context/ContextArchitecture.md +0 -898
  25. package/docs/Context/ContextCompression.md +0 -1102
  26. package/docs/Context/ContextManagment.md +0 -750
  27. package/docs/Context/Index.md +0 -209
  28. package/docs/Context/README.md +0 -390
  29. package/docs/DevelopmentRoadmap/Index.md +0 -238
  30. package/docs/DevelopmentRoadmap/OLLM-CLI_Releases.md +0 -419
  31. package/docs/DevelopmentRoadmap/PlanedFeatures.md +0 -448
  32. package/docs/DevelopmentRoadmap/README.md +0 -174
  33. package/docs/DevelopmentRoadmap/Roadmap.md +0 -572
  34. package/docs/DevelopmentRoadmap/RoadmapVisual.md +0 -372
  35. package/docs/Hooks/Architecture.md +0 -885
  36. package/docs/Hooks/Index.md +0 -244
  37. package/docs/Hooks/KeyboardShortcuts.md +0 -248
  38. package/docs/Hooks/Protocol.md +0 -817
  39. package/docs/Hooks/README.md +0 -403
  40. package/docs/Hooks/UserGuide.md +0 -1483
  41. package/docs/Hooks/VisualGuide.md +0 -598
  42. package/docs/Index.md +0 -506
  43. package/docs/Installation.md +0 -586
  44. package/docs/Introduction.md +0 -367
  45. package/docs/LLM Models/Index.md +0 -239
  46. package/docs/LLM Models/LLM_GettingStarted.md +0 -748
  47. package/docs/LLM Models/LLM_Index.md +0 -701
  48. package/docs/LLM Models/LLM_MemorySystem.md +0 -337
  49. package/docs/LLM Models/LLM_ModelCompatibility.md +0 -499
  50. package/docs/LLM Models/LLM_ModelsArchitecture.md +0 -933
  51. package/docs/LLM Models/LLM_ModelsCommands.md +0 -839
  52. package/docs/LLM Models/LLM_ModelsConfiguration.md +0 -1094
  53. package/docs/LLM Models/LLM_ModelsList.md +0 -1071
  54. package/docs/LLM Models/LLM_ModelsList.md.backup +0 -400
  55. package/docs/LLM Models/README.md +0 -355
  56. package/docs/MCP/MCP_Architecture.md +0 -1086
  57. package/docs/MCP/MCP_Commands.md +0 -1111
  58. package/docs/MCP/MCP_GettingStarted.md +0 -590
  59. package/docs/MCP/MCP_Index.md +0 -524
  60. package/docs/MCP/MCP_Integration.md +0 -866
  61. package/docs/MCP/MCP_Marketplace.md +0 -160
  62. package/docs/MCP/README.md +0 -415
  63. package/docs/Prompts System/Architecture.md +0 -760
  64. package/docs/Prompts System/Index.md +0 -223
  65. package/docs/Prompts System/PromptsRouting.md +0 -1047
  66. package/docs/Prompts System/PromptsTemplates.md +0 -1102
  67. package/docs/Prompts System/README.md +0 -389
  68. package/docs/Prompts System/SystemPrompts.md +0 -856
  69. package/docs/Quickstart.md +0 -535
  70. package/docs/Tools/Architecture.md +0 -884
  71. package/docs/Tools/GettingStarted.md +0 -624
  72. package/docs/Tools/Index.md +0 -216
  73. package/docs/Tools/ManifestReference.md +0 -141
  74. package/docs/Tools/README.md +0 -440
  75. package/docs/Tools/UserGuide.md +0 -773
  76. package/docs/Troubleshooting.md +0 -1265
  77. package/docs/UI&Settings/Architecture.md +0 -729
  78. package/docs/UI&Settings/ColorASCII.md +0 -34
  79. package/docs/UI&Settings/Commands.md +0 -755
  80. package/docs/UI&Settings/Configuration.md +0 -872
  81. package/docs/UI&Settings/Index.md +0 -293
  82. package/docs/UI&Settings/Keybinds.md +0 -372
  83. package/docs/UI&Settings/README.md +0 -278
  84. package/docs/UI&Settings/Terminal.md +0 -637
  85. package/docs/UI&Settings/Themes.md +0 -604
  86. package/docs/UI&Settings/UIGuide.md +0 -550
@@ -1,209 +0,0 @@
1
- # Context Management Documentation Index
2
-
3
- **Quick Reference with Links**
4
-
5
- This index provides quick navigation to all Context Management documentation with brief descriptions.
6
-
7
- ---
8
-
9
- ## 📚 Core Documentation
10
-
11
- ### [README.md](README.md)
12
-
13
- **Overview and Navigation Guide**
14
-
15
- Main entry point for Context Management documentation. Provides overview of all features, quick links, learning paths, and common use cases.
16
-
17
- **Topics:** Overview, Features, Configuration, Troubleshooting
18
- **Audience:** All users
19
-
20
- ---
21
-
22
- ### [Context Architecture](ContextArchitecture.md)
23
-
24
- **System Architecture and Design**
25
-
26
- Complete technical documentation of the Context Management system architecture. Covers VRAM monitoring, context sizing, compression service, checkpoint system, and all component interactions.
27
-
28
- **Topics:** Architecture, VRAM Detection, Context Tiers, Components, Data Flow
29
- **Audience:** Developers, architects
30
-
31
- **Key Sections:**
32
-
33
- - System overview and architecture
34
- - VRAM monitoring (NVIDIA, AMD, Apple Silicon)
35
- - Context sizing and tier selection
36
- - Compression service architecture
37
- - Checkpoint system design
38
- - Component interactions and data flow
39
-
40
- ---
41
-
42
- ### [Context Management](ContextManagment.md)
43
-
44
- **Context Sizing and VRAM Monitoring**
45
-
46
- Comprehensive guide to context sizing, VRAM monitoring, and context tier selection. Explains how context size is determined at startup and remains fixed for the session.
47
-
48
- **Topics:** Context Tiers, VRAM Detection, Context Sizing, Memory Management
49
- **Audience:** All users
50
-
51
- **Key Sections:**
52
-
53
- - Context tiers (Minimal, Basic, Standard, Premium, Ultra)
54
- - VRAM detection methods
55
- - Context size calculation (85% utilization)
56
- - Fixed context sizing approach
57
- - Memory safety guards
58
- - Context usage monitoring
59
-
60
- ---
61
-
62
- ### [Context Compression](ContextCompression.md)
63
-
64
- **Compression Strategies and Implementation**
65
-
66
- Detailed guide to the context compression system. Explains how LLM-based summarization works, compression strategies, and when compression triggers.
67
-
68
- **Topics:** Compression, Summarization, Strategies, Triggers
69
- **Audience:** All users
70
-
71
- **Key Sections:**
72
-
73
- - LLM-based summarization (LLM does the work)
74
- - Compression strategies (aggressive, balanced, conservative)
75
- - Compression triggers and thresholds
76
- - What gets compressed vs preserved
77
- - Compression quality and effectiveness
78
- - Manual compression commands
79
-
80
- ---
81
-
82
- ### [Checkpoint Flow Diagram](CheckpointFlowDiagram.md)
83
-
84
- **Checkpoint System and Rollover Flow**
85
-
86
- Visual guide to the checkpoint system with flow diagrams. Explains checkpoint types, creation, restoration, and session rollover process.
87
-
88
- **Topics:** Checkpoints, Rollover, Session Management, Recovery
89
- **Audience:** All users
90
-
91
- **Key Sections:**
92
-
93
- - Checkpoint types (manual, automatic, rollover)
94
- - Checkpoint creation flow
95
- - Checkpoint restoration process
96
- - Session rollover workflow
97
- - Checkpoint storage and management
98
- - Recovery scenarios
99
-
100
- ---
101
-
102
- ## 📖 Documentation by Topic
103
-
104
- ### Context Sizing
105
-
106
- - [Context Management](ContextManagment.md) - Context tiers and sizing
107
- - [Context Architecture](ContextArchitecture.md#context-sizing) - Sizing implementation
108
-
109
- ### VRAM Monitoring
110
-
111
- - [Context Management](ContextManagment.md#vram-monitoring) - VRAM detection
112
- - [Context Architecture](ContextArchitecture.md#vram-monitoring) - VRAM architecture
113
-
114
- ### Compression
115
-
116
- - [Context Compression](ContextCompression.md) - Complete compression guide
117
- - [Context Architecture](ContextArchitecture.md#compression-service) - Compression architecture
118
-
119
- ### Checkpoints
120
-
121
- - [Checkpoint Flow](CheckpointFlowDiagram.md) - Checkpoint system
122
- - [Context Architecture](ContextArchitecture.md#checkpoint-system) - Checkpoint architecture
123
-
124
- ### Configuration
125
-
126
- - [README](README.md#configuration) - Configuration overview
127
- - [Context Management](ContextManagment.md#configuration) - Detailed settings
128
-
129
- ---
130
-
131
- ## 📖 Documentation by Audience
132
-
133
- ### For New Users
134
-
135
- 1. [README](README.md) - Start here
136
- 2. [Context Management](ContextManagment.md) - Understanding context
137
- 3. [Context Compression](ContextCompression.md) - Managing context
138
-
139
- ### For Regular Users
140
-
141
- 1. [Checkpoint Flow](CheckpointFlowDiagram.md) - Using checkpoints
142
- 2. [Context Compression](ContextCompression.md) - Compression strategies
143
- 3. [README](README.md#configuration) - Configuration options
144
-
145
- ### For Developers
146
-
147
- 1. [Context Architecture](ContextArchitecture.md) - System design
148
- 2. [Context Management](ContextManagment.md) - Implementation details
149
- 3. [Context Compression](ContextCompression.md) - Compression implementation
150
-
151
- ---
152
-
153
- ## 🔗 Related Documentation
154
-
155
- ### Core Systems
156
-
157
- - [Model Management](../LLM%20Models/README.md) - Model selection
158
- - [Prompts System](../Prompts%20System/README.md) - System prompts
159
- - [User Interface](../UI&Settings/README.md) - UI documentation
160
-
161
- ### Commands
162
-
163
- - [Context Commands](../UI&Settings/Commands.md#context-management) - CLI commands
164
- - [Snapshot Commands](../UI&Settings/Commands.md#snapshot-management) - Checkpoint commands
165
-
166
- ### Developer Resources
167
-
168
- - Knowledge DB: `dev_ContextManagement.md` - Architecture details
169
- - Knowledge DB: `dev_ContextCompression.md` - Compression details
170
-
171
- ---
172
-
173
- ## 📊 Documentation Status
174
-
175
- ### Completed ✅
176
-
177
- | Document | Status |
178
- | ------------------------ | ----------- |
179
- | README.md | ✅ Complete |
180
- | Index.md | ✅ Complete |
181
- | ContextArchitecture.md | ✅ Complete |
182
- | ContextManagment.md | ✅ Complete |
183
- | ContextCompression.md | ✅ Complete |
184
- | CheckpointFlowDiagram.md | ✅ Complete |
185
-
186
- **Overall Progress:** 100% complete (6/6 files)
187
-
188
- ---
189
-
190
- ## 🎯 Quick Links
191
-
192
- ### Common Tasks
193
-
194
- - Check context usage → [Context Commands](../UI&Settings/Commands.md#context-stats)
195
- - Compress context → [Context Compression](ContextCompression.md#manual-compression)
196
- - Create checkpoint → [Checkpoint Flow](CheckpointFlowDiagram.md#creating-checkpoints)
197
- - Configure context → [README](README.md#configuration)
198
-
199
- ### Understanding Systems
200
-
201
- - How context sizing works → [Context Management](ContextManagment.md)
202
- - How compression works → [Context Compression](ContextCompression.md)
203
- - How checkpoints work → [Checkpoint Flow](CheckpointFlowDiagram.md)
204
- - System architecture → [Context Architecture](ContextArchitecture.md)
205
-
206
- ---
207
-
208
- **Last Updated:** January 26, 2026
209
- **Version:** 0.1.0
@@ -1,390 +0,0 @@
1
- # Context Management Documentation
2
-
3
- **Last Updated:** January 26, 2026
4
-
5
- Welcome to the Context Management documentation for OLLM CLI. This section covers the complete context management system, including context sizing, compression, checkpoints, and VRAM monitoring.
6
-
7
- ---
8
-
9
- ## 📚 Documentation Overview
10
-
11
- ### Core Documentation
12
-
13
- - **[Context Architecture](ContextArchitecture.md)** - Complete system architecture and design
14
- - **[Context Management](ContextManagment.md)** - Context sizing, tiers, and VRAM monitoring
15
- - **[Context Compression](ContextCompression.md)** - Compression strategies and implementation
16
- - **[Checkpoint Flow](CheckpointFlowDiagram.md)** - Checkpoint system and rollover flow
17
-
18
- ---
19
-
20
- ## 🎯 What is Context Management?
21
-
22
- The **Context Management** system handles the conversation history and system prompts sent to the LLM, ensuring optimal performance within hardware constraints:
23
-
24
- ### 1. **Fixed Context Sizing**
25
-
26
- Context size is determined once at startup based on available VRAM:
27
-
28
- - VRAM detection (NVIDIA, AMD, Apple Silicon)
29
- - Context tier selection (Minimal, Basic, Standard, Premium, Ultra)
30
- - 85% utilization for optimal performance (pre-calculated in LLM_profiles.json)
31
- - Context remains FIXED for the entire session
32
-
33
- ### 2. **Context Compression**
34
-
35
- Automatic compression when context approaches limits:
36
-
37
- - LLM-based summarization (LLM does the work, not the app)
38
- - Multiple compression strategies (aggressive, balanced, conservative)
39
- - Preserves recent messages and critical information
40
- - Maintains conversation continuity
41
-
42
- ### 3. **Checkpoint System**
43
-
44
- Save and restore conversation state:
45
-
46
- - Manual checkpoints for important conversation points
47
- - Automatic checkpoints before major operations
48
- - Rollover to new session when context full
49
- - Checkpoint restoration for session recovery
50
-
51
- ### 4. **VRAM Monitoring**
52
-
53
- Real-time GPU memory tracking:
54
-
55
- - Cross-platform support (NVIDIA, AMD, Apple Silicon)
56
- - Automatic VRAM detection at startup
57
- - Context tier selection based on available memory
58
- - Memory safety guards to prevent OOM errors
59
-
60
- ---
61
-
62
- ## 📖 Documentation Structure
63
-
64
- ```
65
- docs/Context/
66
- ├── README.md ← You are here
67
- ├── Index.md Quick reference with links
68
- ├── ContextArchitecture.md System architecture
69
- ├── ContextManagment.md Context sizing and VRAM
70
- ├── ContextCompression.md Compression system
71
- └── CheckpointFlowDiagram.md Checkpoint flow
72
- ```
73
-
74
- ---
75
-
76
- ## 🎓 Key Concepts
77
-
78
- ### Context Tiers
79
-
80
- Five fixed context tiers based on available VRAM:
81
-
82
- | Tier | Context Size | VRAM Required | Use Case |
83
- | ------------ | ------------ | ------------- | ------------------------- |
84
- | **Minimal** | 2K-4K | <4GB | Quick tasks, small models |
85
- | **Basic** | 4K-8K | 4-8GB | Standard conversations |
86
- | **Standard** | 8K-16K | 8-12GB | Extended conversations |
87
- | **Premium** | 16K-32K | 12-24GB | Long conversations |
88
- | **Ultra** | 32K+ | 24GB+ | Maximum context |
89
-
90
- **See:** [Context Management](ContextManagment.md)
91
-
92
- ### Context Compression
93
-
94
- When context approaches the limit, compression automatically triggers:
95
-
96
- **Process:**
97
-
98
- 1. Detect context approaching limit (e.g., 90% full)
99
- 2. Select compression strategy (aggressive, balanced, conservative)
100
- 3. LLM summarizes older messages
101
- 4. Replace old messages with summary
102
- 5. Continue conversation with more space
103
-
104
- **See:** [Context Compression](ContextCompression.md)
105
-
106
- ### Checkpoint System
107
-
108
- Save conversation state for recovery or rollover:
109
-
110
- **Types:**
111
-
112
- - **Manual Checkpoints** - User-created save points
113
- - **Automatic Checkpoints** - Created before major operations
114
- - **Rollover Checkpoints** - Created when starting new session
115
-
116
- **See:** [Checkpoint Flow](CheckpointFlowDiagram.md)
117
-
118
- ### VRAM Monitoring
119
-
120
- Automatic GPU memory detection:
121
-
122
- **Supported Platforms:**
123
-
124
- - **NVIDIA** - nvidia-smi (Windows, Linux)
125
- - **AMD** - rocm-smi (Linux)
126
- - **Apple Silicon** - Metal API (macOS)
127
-
128
- **See:** [Context Architecture](ContextArchitecture.md)
129
-
130
- ---
131
-
132
- ## 💡 Common Use Cases
133
-
134
- ### Check Context Usage
135
-
136
- ```bash
137
- # View current context stats
138
- /context stats
139
-
140
- # Shows:
141
- # - Current tokens used
142
- # - Total context size
143
- # - Percentage used
144
- # - Compression status
145
- ```
146
-
147
- ### Manual Compression
148
-
149
- ```bash
150
- # Trigger compression manually
151
- /compact
152
-
153
- # Options:
154
- /compact aggressive # Maximum compression
155
- /compact balanced # Default compression
156
- /compact conservative # Minimal compression
157
- ```
158
-
159
- ### Create Checkpoint
160
-
161
- ```bash
162
- # Save current conversation state
163
- /snapshot create my-checkpoint
164
-
165
- # List checkpoints
166
- /snapshot list
167
-
168
- # Restore checkpoint
169
- /snapshot restore my-checkpoint
170
- ```
171
-
172
- ### Start New Session
173
-
174
- ```bash
175
- # Start fresh session (creates rollover checkpoint)
176
- /session new
177
-
178
- # Resume previous session
179
- /session resume <name>
180
- ```
181
-
182
- **Learn more:** [Context Commands](../UI&Settings/Commands.md#context-management)
183
-
184
- ---
185
-
186
- ## 🛠️ Configuration
187
-
188
- ### Context Settings
189
-
190
- ```yaml
191
- context:
192
- # Context tier (auto-detected from VRAM)
193
- tier: Standard
194
-
195
- # Enable automatic compression
196
- autoCompress: true
197
-
198
- # Compression trigger threshold
199
- compressionThreshold: 0.9 # 90% full
200
-
201
- # Compression strategy
202
- compressionStrategy: balanced # aggressive, balanced, conservative
203
- ```
204
-
205
- ### VRAM Settings
206
-
207
- ```yaml
208
- vram:
209
- # Enable VRAM monitoring
210
- enabled: true
211
-
212
- # VRAM detection method
213
- # auto, nvidia-smi, rocm-smi, metal
214
- detectionMethod: auto
215
-
216
- # Manual VRAM override (GB)
217
- manualVRAM: null
218
- ```
219
-
220
- ### Checkpoint Settings
221
-
222
- ```yaml
223
- checkpoints:
224
- # Enable automatic checkpoints
225
- autoCheckpoint: true
226
-
227
- # Checkpoint before major operations
228
- checkpointBeforeOperations: true
229
-
230
- # Maximum checkpoints to keep
231
- maxCheckpoints: 10
232
- ```
233
-
234
- **Learn more:** [Configuration](../UI&Settings/Configuration.md)
235
-
236
- ---
237
-
238
- ## 🔍 Troubleshooting
239
-
240
- ### Common Issues
241
-
242
- **Context fills up too quickly:**
243
-
244
- - Enable automatic compression: `/config set autoCompress true`
245
- - Use more aggressive compression: `/compact aggressive`
246
- - Create checkpoint and start new session: `/snapshot create` then `/session new`
247
-
248
- **VRAM detection not working:**
249
-
250
- - Check GPU drivers installed
251
- - Verify nvidia-smi/rocm-smi in PATH
252
- - Manual override: `/config set vram.manualVRAM 8` (for 8GB)
253
-
254
- **Compression not triggering:**
255
-
256
- - Check compression enabled: `/config get autoCompress`
257
- - Check threshold: `/config get compressionThreshold`
258
- - Manually trigger: `/compact`
259
-
260
- **Checkpoint restore fails:**
261
-
262
- - Verify checkpoint exists: `/snapshot list`
263
- - Check checkpoint file permissions
264
- - Try creating new checkpoint: `/snapshot create test`
265
-
266
- **See:** [Troubleshooting Guide](../Troubleshooting.md)
267
-
268
- ---
269
-
270
- ## 📊 Implementation Status
271
-
272
- ### Current (v0.1.0)
273
-
274
- - ✅ VRAM Detection (NVIDIA, AMD, Apple Silicon)
275
- - ✅ Fixed Context Sizing
276
- - ✅ Context Tiers (Minimal, Basic, Standard, Premium, Ultra)
277
- - ✅ LLM-based Compression
278
- - ✅ Checkpoint System
279
- - ✅ Context Usage Display
280
- - ✅ Memory Safety Guards
281
-
282
- ### Planned (v0.2.0)
283
-
284
- - ⏳ Advanced Compression Strategies
285
- - ⏳ Context Analytics
286
- - ⏳ Compression Quality Metrics
287
-
288
- ### Planned (v0.3.0)
289
-
290
- - ⏳ Multi-tier Compression
291
- - ⏳ Semantic Context Pruning
292
- - ⏳ Context Optimization
293
-
294
- ---
295
-
296
- ## 🤝 Related Documentation
297
-
298
- ### Core Systems
299
-
300
- - [Model Management](../LLM%20Models/README.md) - Model selection and configuration
301
- - [Prompts System](../Prompts%20System/README.md) - System prompts and templates
302
- - [User Interface](../UI&Settings/README.md) - UI documentation
303
-
304
- ### Developer Resources
305
-
306
- - Knowledge DB: `dev_ContextManagement.md` - Context management architecture
307
- - Knowledge DB: `dev_ContextCompression.md` - Compression implementation
308
-
309
- ---
310
-
311
- ## 🎯 Quick Start
312
-
313
- ### For New Users
314
-
315
- 1. **Check Your Context**
316
-
317
- ```bash
318
- /context stats
319
- ```
320
-
321
- 2. **Enable Auto-Compression**
322
-
323
- ```bash
324
- /config set autoCompress true
325
- ```
326
-
327
- 3. **Create Your First Checkpoint**
328
- ```bash
329
- /snapshot create my-first-checkpoint
330
- ```
331
-
332
- ### For Advanced Users
333
-
334
- 1. **Optimize Compression**
335
-
336
- ```bash
337
- /config set compressionStrategy aggressive
338
- /config set compressionThreshold 0.85
339
- ```
340
-
341
- 2. **Monitor VRAM**
342
-
343
- ```bash
344
- /config get vram
345
- ```
346
-
347
- 3. **Manage Checkpoints**
348
- ```bash
349
- /snapshot list
350
- /snapshot restore <name>
351
- /snapshot delete <name>
352
- ```
353
-
354
- ---
355
-
356
- ## 📈 Performance Tips
357
-
358
- ### Maximize Context Efficiency
359
-
360
- 1. **Use Appropriate Tier** - Don't force larger context than needed
361
- 2. **Enable Auto-Compression** - Let system manage context automatically
362
- 3. **Create Checkpoints** - Save important conversation points
363
- 4. **Start Fresh Sessions** - Use rollover for very long conversations
364
- 5. **Monitor Usage** - Check `/context stats` regularly
365
-
366
- ### Optimize for Your Hardware
367
-
368
- **Low VRAM (<4GB):**
369
-
370
- - Use Minimal tier (2K-4K)
371
- - Aggressive compression
372
- - Frequent checkpoints
373
-
374
- **Medium VRAM (4-8GB):**
375
-
376
- - Use Basic tier (4K-8K)
377
- - Balanced compression
378
- - Regular checkpoints
379
-
380
- **High VRAM (8GB+):**
381
-
382
- - Use Standard/Premium tier (8K-32K)
383
- - Conservative compression
384
- - Occasional checkpoints
385
-
386
- ---
387
-
388
- **Last Updated:** January 26, 2026
389
- **Version:** 0.1.0
390
- **Status:** Active Development