supervertaler 1.9.147__tar.gz → 1.9.153__tar.gz

{supervertaler-1.9.147 → supervertaler-1.9.153}/CHANGELOG.md

@@ -2,46 +2,194 @@
 
 All notable changes to Supervertaler are documented in this file.
 
-**Current Version:** v1.9.147 (January 21, 2026)
+**Current Version:** v1.9.153 (January 23, 2026)
+
+## 📐 Tab Layout Reorganization (v1.9.153) - January 23, 2026
+
+**Better Workflow Organization**
+
+Redesigned the tab layout to consolidate resources and improve translation workflow:
+
+**What Changed:**
+- **Termview stays under grid**: Original position preserved for quick glossary access
+- **Second Termview in right panel**: Duplicate instance so you can see terms while viewing other tabs
+- **Segment Note moved**: Now in right panel alongside Compare Panel and Preview
+- **Session Log moved**: Also in right panel for better organization
+- **Simultaneous updates**: Both Termview instances update together automatically
+
+**New Tab Structure:**
+- **Left panel**: Grid + Termview (collapsible)
+- **Right panel**: Translation Results, Compare Panel, Preview, Segment Note, Session Log, Termview (6 tabs)
+
+**Benefits:**
+- ✅ All reference materials (TM, glossary, notes) in one location
+- ✅ Grid area cleaner - just grid + glossary
+- ✅ Two Termview instances let you see terms while using other tabs
+- ✅ Ctrl+N shortcut still works to jump to Segment Note tab
+
+**Implementation:**
+- New helper method: `_update_both_termviews()` - updates both instances simultaneously
+- Updated 5 locations where Termview gets updated
+- Modified tab creation code to reorganize layout
+- Updated Ctrl+N shortcut to find tab by name (works regardless of tab visibility)
+
+**Future Enhancement (Phase 2):**
+User requested advanced docking: ability to drag tabs to dock them vertically in the right panel (like VS Code). This would require QDockWidget architecture - a significant refactor planned for future version.
+
+---
+
+## ⚡ Instant Glossary Updates (v1.9.152) - January 23, 2026
+
+**Lightning-Fast Term Addition Performance**
+
+Adding terms to glossaries is now instant! The 5-6 second delay when using Alt+Shift+Up/Down shortcuts has been eliminated.
+
+**The Problem:**
+- Users experienced 5-6 second delays after adding glossary terms during translation
+- Long patent sentences with 50+ words required 50+ individual database searches
+- The app was searching for ALL words again just to find the ONE term we just added
+
+**The Solution:**
+- **Direct cache update**: New term added directly to cache instead of full segment re-search
+- **Immediate TermView update**: Display updates instantly using cached matches
+- **Smart highlighting**: Source cell highlighting updated via direct function call
+- **Zero database searches**: We already know what we added - no need to search for it!
+
+**Result:**
+- ✅ TermView shows new term instantly (< 0.1 seconds)
+- ✅ Source highlighting updates instantly
+- ✅ Smooth, responsive workflow for building glossaries
+- ✅ Perfect for intensive patent translation workflows
+
+**Technical Implementation:**
+- Modified `_quick_add_term_with_priority()` to create match entry directly from added term
+- Bypasses expensive `find_termbase_matches_in_source()` database search
+- Calls `highlight_source_with_termbase()` directly with updated cache
+- Maintains all existing functionality while eliminating performance bottleneck
+
+**Files Modified:**
+- `Supervertaler.py` - Optimized glossary quick-add workflow (~60 lines modified)
+
+**🛡️ Exit Crash Fix:**
+- Enhanced `_cleanup_web_views()` method to prevent Python crash on program exit
+- Now properly stops all WebEngine page loading/rendering before cleanup
+- Processes events multiple times and adds delay to ensure Qt finishes cleanup
+- No more "Python has stopped working" dialog when using File → Exit
+
+---
+
+## 🔧 TM Pre-Translation Fixed (v1.9.151) - January 23, 2026
+
+**Critical Fix:** "Pre-translate from TM" batch operation now correctly finds TM matches!
+
+**What Was Broken:**
+- Running Edit → Batch Operations → Pre-translate from TM found 0 matches
+- Even when a 100% TM match was clearly visible in the Compare Panel
+- Issue: SQLite databases cannot be shared across threads
+
+**Root Cause:**
+The `PreTranslationWorker` ran in a background thread, but SQLite connections created in the main thread cannot be used in other threads. This caused a `sqlite3.ProgrammingError`.
+
+**The Fix:**
+- TM pre-translation now runs **on the main thread** (same as the Compare Panel)
+- Uses `QProgressDialog` to show progress and keep UI responsive
+- Uses the **exact same database methods** that work for segment navigation
+- No more SQLite threading errors!
+
+**Before:** "Pre-translate from TM" → 0 matches found
+**After:** "Pre-translate from TM" → Correctly finds all TM matches
+
+## 🔍 Superlookup Language-Aware Search Enhancement (v1.9.149-beta) - January 22, 2026
+
+**Major Enhancement:** Superlookup TM search now intelligently handles language filters!
+
+**What Changed:**
+- **Intuitive Language Filters**: "From: Dutch → To: English" now means "Search FOR Dutch text and show me English translations"
+- **Smart Column Detection**: Searches ALL TMs regardless of their stored direction (NL→EN or EN→NL)
+- **Automatic Swapping**: Finds text in either column and automatically presents results in the correct order
+- **More Powerful Than Traditional CAT Tools**: Unlike memoQ/Trados that only search one TM direction, Supervertaler finds matches everywhere
+
+**How It Works:**
+1. Set "From: Dutch → To: English"
+2. Search for Dutch text
+3. System searches both NL→EN TMs (source column) AND EN→NL TMs (target column)
+4. Results automatically shown with Dutch in source, English in target
+
+**UI Simplification:**
+- **Removed Direction radio buttons** (Both/Source/Target) - always searches both columns now
+- Cleaner, faster interface for translators
+- Language dropdowns are all you need
+
+**UI Polish:**
+- **Renamed "QuickMenu" tab to "Prompt Manager"** - Better clarity for new users looking for translation prompts
+- **Sub-tab renamed**: "Library" → "Prompt Library"
+- Resolves confusion about where to find prompts for single-segment and batch translation
+
+**Technical Details:**
+- Language filters no longer restrict which TMs are searched
+- Post-processing validates search text is in the correct language column
+- Smart swapping ensures results always match user's requested language direction
+
+**Files Modified:**
+- `modules/database_manager.py` - Smart language-aware concordance search
+- `modules/superlookup.py` - Column name handling
+- `Supervertaler.py` - Removed Direction controls, simplified UI, renamed QuickMenu to Prompt Manager
+- `modules/unified_prompt_manager_qt.py` - Updated tab and header labels
+
+---
+
+## 📁 User-Choosable Data Folder Location (v1.9.148-beta) - January 21, 2026
+
+**Major Enhancement:** Users now choose where to store their data on first run!
+
+**What Changed (from v1.9.147):**
+- v1.9.147 stored data in hidden AppData folders - users couldn't easily find/backup their data
+- v1.9.148 uses visible, accessible locations that users control
+
+**The New System:**
+
+| Platform | Default Location |
+|----------|------------------|
+| **Windows** | `C:\Users\Username\Supervertaler\` |
+| **macOS** | `~/Supervertaler/` |
+| **Linux** | `~/Supervertaler/` |
+
+**Key Features:**
+- **First-run dialog** lets users choose their data folder location
+- **Default is visible** in home folder - easy to find and backup
+- **Settings → General** includes "Change..." button to relocate data anytime
+- **Auto-recovery** if config pointer is deleted but data exists at default location
+- **Unified system** - ALL users (pip, EXE, dev) use the same approach
+
+**How It Works:**
+1. On first run, a dialog asks where to store data
+2. User choice is saved to a small config pointer file:
+   - Windows: `%APPDATA%\Supervertaler\config.json`
+   - macOS: `~/Library/Application Support/Supervertaler/config.json`
+   - Linux: `~/.config/Supervertaler/config.json`
+3. This pointer just contains: `{"user_data_path": "C:\\Users\\John\\Supervertaler"}`
+4. If pointer is deleted, app auto-recovers by checking the default location
+
+**Benefits:**
+- ✅ Data is visible and easy to find
+- ✅ Easy to backup (just copy the folder)
+- ✅ User has full control over location
+- ✅ Can use cloud folders (OneDrive, Dropbox, etc.)
+- ✅ Survives pip upgrades
+- ✅ Works identically for all installation types
+
+---
 
 ## 📁 Persistent User Data Location (v1.9.147) - January 21, 2026
 
+*Note: v1.9.148 improves on this by using visible locations and adding user choice.*
+
 **Major Enhancement:** User data (API keys, TMs, glossaries, prompts, settings) now persists across pip upgrades!
 
 **The Problem:**
 - When users ran `pip install --upgrade supervertaler`, their data was wiped
 - This happened because user_data/ was stored inside the pip package directory
 - pip replaces the entire package directory on upgrade, deleting all user files
-- Users reported losing API keys, TMs, glossaries, and prompts after every update
-
-**The Solution:**
-User data is now stored in a **platform-specific persistent location** that lives OUTSIDE the pip package:
-
-| Platform | Location |
-|----------|----------|
-| **Windows** | `%LOCALAPPDATA%\MichaelBeijer\Supervertaler\` (e.g., `C:\Users\John\AppData\Local\MichaelBeijer\Supervertaler\`) |
-| **macOS** | `~/Library/Application Support/Supervertaler/` |
-| **Linux** | `~/.local/share/Supervertaler/` (follows XDG spec) |
-| **Windows EXE** | `user_data/` folder next to the executable (portable mode) |
-| **Development** | `user_data/` or `user_data_private/` next to the script |
-
-**Automatic Migration:**
-- On first run after upgrade, existing data is automatically migrated from the old location
-- A marker file is left in the old location explaining where data went
-- No user action required - just upgrade and everything moves automatically
-
-**What This Means for Users:**
-- ✅ API keys persist across pip upgrades
-- ✅ Translation Memories are preserved
-- ✅ Glossaries (termbases) are preserved
-- ✅ Custom prompts are preserved
-- ✅ All settings are preserved
-- ✅ Windows EXE users unaffected (already portable)
-
-**Technical Details:**
-- Uses `platformdirs` library for cross-platform path handling
-- Added `migrate_user_data_if_needed()` function for one-time migration
-- Migration is safe: copies (not moves) and only runs if old location has content
 
 ---
 

{supervertaler-1.9.147 → supervertaler-1.9.153}/FAQ.md

@@ -1136,9 +1136,9 @@ Michael Beijer, a professional translator, created Supervertaler to:
 - **Google Gemini:** Check current API terms for data retention
 
 **Local Storage:**
-- Projects: `user_data/Projects/`
-- TMs: `user_data/tm/`
-- Termbases: `user_data/termbases/`
+- Projects: `user_data/projects/`
+- TMs: `user_data/resources/`
+- Termbases: `user_data/resources/`
 - All data remains on your machine
 
 **No Telemetry:**

{supervertaler-1.9.147 → supervertaler-1.9.153}/PKG-INFO

@@ -1,7 +1,7 @@
 Metadata-Version: 2.4
 Name: supervertaler
-Version: 1.9.147
-Summary: Professional AI-powered translation workbench with multi-LLM support, glossary system, TM, spellcheck, voice commands, and PyQt6 interface. Batteries included (core).
+Version: 1.9.153
+Summary: Professional AI-enhanced translation workbench with multi-LLM support, glossary system, TM, spellcheck, voice commands, and PyQt6 interface. Batteries included (core).
 Home-page: https://supervertaler.com
 Author: Michael Beijer
 Author-email: Michael Beijer <info@michaelbeijer.co.uk>
@@ -46,7 +46,6 @@ Requires-Dist: chardet>=5.0.0
 Requires-Dist: pyyaml>=6.0.0
 Requires-Dist: markdown>=3.4.0
 Requires-Dist: pyspellchecker>=0.7.0
-Requires-Dist: platformdirs>=4.0.0
 Requires-Dist: sounddevice>=0.4.6
 Requires-Dist: numpy>=1.24.0
 Requires-Dist: PyMuPDF>=1.23.0
@@ -72,7 +71,7 @@ Dynamic: home-page
 Dynamic: license-file
 Dynamic: requires-python
 
-# 🚀 Supervertaler v1.9.147
+# 🚀 Supervertaler v1.9.153
 
 [![PyPI version](https://badge.fury.io/py/supervertaler.svg)](https://pypi.org/project/Supervertaler/)
 [![Python 3.10+](https://img.shields.io/badge/python-3.10+-blue.svg)](https://www.python.org/downloads/)
@@ -80,20 +79,45 @@ Dynamic: requires-python
 
 AI-enhanced CAT tool with multi-LLM support (GPT-4, Claude, Gemini, Ollama), innovative Superlookup concordance system offering access to multiple terminology sources (TMs, glossaries, web resources, etc.), and seamless CAT tool integration (memoQ, Trados, CafeTran, Phrase).
 
-**Current Version:** v1.9.147 (January 21, 2026)
+**Current Version:** v1.9.153 (January 23, 2026)
 
-### NEW in v1.9.147 - 📁 Persistent User Data Location
+### NEW in v1.9.153 - 📝 Tab Layout Reorganization
 
-**No More Data Loss on Upgrade!** User data (API keys, TMs, glossaries, prompts, settings) is now stored in a persistent location that survives `pip install --upgrade`:
+Redesigned the tab layout to improve workflow:
+- Termview stays under the grid
+- Second Termview instance added to right panel
+- Segment Note and Session Log moved to right panel
+- Better organization: Left panel (grid + Termview), Right panel (all other tabs)
 
-| Platform | User Data Location |
-|----------|-------------------|
-| **Windows** | `%LOCALAPPDATA%\MichaelBeijer\Supervertaler\` |
-| **macOS** | `~/Library/Application Support/Supervertaler/` |
-| **Linux** | `~/.local/share/Supervertaler/` |
-| **Windows EXE** | `user_data\` next to executable (portable) |
+### Previously in v1.9.152 - ⚡ Instant Glossary Updates
 
-Existing data is automatically migrated on first run after upgrade.
+**Lightning-Fast Term Addition:** Adding terms to glossaries now feels instant! When you add a term with Alt+Shift+Up/Down, it appears immediately in TermView AND the source highlighting updates instantly - no more 5-6 second delays.
+
+**What Changed:** Instead of searching the entire segment again after adding a term (50+ database queries for long patent sentences), we now add the new term directly to the cache and update the display. The result: instant visual feedback that makes building glossaries during translation feel smooth and responsive.
+
+### v1.9.151 - 🔍 TM Pre-Translation Fixed
+
+**Intuitive Language Filters:** "From: Dutch → To: English" now means what you'd expect - "Search FOR Dutch text and show me English translations"! Searches ALL TMs regardless of their stored direction (NL→EN or EN→NL) and automatically presents results in the correct order.
+
+### v1.9.148-beta - 📁 User-Choosable Data Folder
+
+**Your Data, Your Location!** On first run, you choose where to store your data (API keys, TMs, glossaries, prompts). Default is a visible folder in your home directory:
+
+| Platform | Default Location |
+|----------|-----------------|
+| **Windows** | `C:\Users\Username\Supervertaler\` |
+| **macOS** | `~/Supervertaler/` |
+| **Linux** | `~/Supervertaler/` |
+
+**Features:**
+- First-run dialog lets you choose your data folder
+- Change location anytime in Settings → General
+- Auto-recovery if config pointer is deleted
+- Easy to backup - just copy the folder!
+
+### v1.9.147 - 📁 Persistent User Data Location
+
+**No More Data Loss on Upgrade!** User data now stored outside the pip package directory, surviving `pip install --upgrade`.
 
 ### FIXED in v1.9.146 - 🔑 Gemini/Google API Key Alias
 
@@ -443,7 +467,7 @@ python Supervertaler.py
 - 📊 **Smart Status** - Manual edits reset status requiring confirmation
 
 **v1.4.0 - Supervoice Voice Dictation + Detachable Log:**
-- 🎤 **Supervoice Voice Dictation** - AI-powered hands-free translation input
+- 🎤 **Supervoice Voice Dictation** - AI-enhanced hands-free translation input
 - 🌍 **100+ Languages** - OpenAI Whisper supports virtually any language
 - ⌨️ **F9 Global Hotkey** - Press-to-start, press-to-stop recording anywhere
 - 🎚️ **5 Model Sizes** - Tiny to Large (balance speed vs accuracy)
@@ -493,7 +517,7 @@ python Supervertaler.py
 - 🔍 **Superlookup** - System-wide search with global hotkey (Ctrl+Alt+L)
 - 📝 **TMX Editor** - Professional translation memory editor with database support
 - 🧹 **AutoFingers** - Automated translation pasting for memoQ with tag cleaning
-- 🔧 **PDF Rescue** - AI-powered OCR for poorly formatted PDFs
+- 🔧 **PDF Rescue** - AI-enhanced OCR for poorly formatted PDFs
 - 🔧 **Encoding Repair Tool** - Detect and fix text encoding corruption (mojibake)
 - 💾 **Translation Memory** - Fuzzy matching with TMX import/export
 - 📚 **Multiple Termbases** - Glossary support per project
@@ -554,7 +578,7 @@ For comprehensive project information, see [PROJECT_CONTEXT.md](PROJECT_CONTEXT.
 - 🤖 **LLM Integration** - OpenAI GPT-4/5, Anthropic Claude, Google Gemini
 - 🎯 **Context-aware Translation** - Full document understanding
 - 📚 **Unified Prompt Library** - System Prompts + Custom Instructions
-- 🆘 **PDF Rescue** - AI-powered OCR for badly-formatted PDFs
+- 🆘 **PDF Rescue** - AI-enhanced OCR for badly-formatted PDFs
 - ✅ **CAT Features** - Segment editing, grid pagination, dual selection
 - 📝 **TMX Editor** - Professional translation memory editor
 - 🔗 **CAT Tool Integration** - memoQ, CafeTran, Trados Studio

{supervertaler-1.9.147 → supervertaler-1.9.153}/README.md

@@ -1,4 +1,4 @@
-# 🚀 Supervertaler v1.9.147
+# 🚀 Supervertaler v1.9.153
 
 [![PyPI version](https://badge.fury.io/py/supervertaler.svg)](https://pypi.org/project/Supervertaler/)
 [![Python 3.10+](https://img.shields.io/badge/python-3.10+-blue.svg)](https://www.python.org/downloads/)
@@ -6,20 +6,45 @@
 
 AI-enhanced CAT tool with multi-LLM support (GPT-4, Claude, Gemini, Ollama), innovative Superlookup concordance system offering access to multiple terminology sources (TMs, glossaries, web resources, etc.), and seamless CAT tool integration (memoQ, Trados, CafeTran, Phrase).
 
-**Current Version:** v1.9.147 (January 21, 2026)
+**Current Version:** v1.9.153 (January 23, 2026)
 
-### NEW in v1.9.147 - 📁 Persistent User Data Location
+### NEW in v1.9.153 - 📝 Tab Layout Reorganization
 
-**No More Data Loss on Upgrade!** User data (API keys, TMs, glossaries, prompts, settings) is now stored in a persistent location that survives `pip install --upgrade`:
+Redesigned the tab layout to improve workflow:
+- Termview stays under the grid
+- Second Termview instance added to right panel
+- Segment Note and Session Log moved to right panel
+- Better organization: Left panel (grid + Termview), Right panel (all other tabs)
 
-| Platform | User Data Location |
-|----------|-------------------|
-| **Windows** | `%LOCALAPPDATA%\MichaelBeijer\Supervertaler\` |
-| **macOS** | `~/Library/Application Support/Supervertaler/` |
-| **Linux** | `~/.local/share/Supervertaler/` |
-| **Windows EXE** | `user_data\` next to executable (portable) |
+### Previously in v1.9.152 - ⚡ Instant Glossary Updates
 
-Existing data is automatically migrated on first run after upgrade.
+**Lightning-Fast Term Addition:** Adding terms to glossaries now feels instant! When you add a term with Alt+Shift+Up/Down, it appears immediately in TermView AND the source highlighting updates instantly - no more 5-6 second delays.
+
+**What Changed:** Instead of searching the entire segment again after adding a term (50+ database queries for long patent sentences), we now add the new term directly to the cache and update the display. The result: instant visual feedback that makes building glossaries during translation feel smooth and responsive.
+
+### v1.9.151 - 🔍 TM Pre-Translation Fixed
+
+**Intuitive Language Filters:** "From: Dutch → To: English" now means what you'd expect - "Search FOR Dutch text and show me English translations"! Searches ALL TMs regardless of their stored direction (NL→EN or EN→NL) and automatically presents results in the correct order.
+
+### v1.9.148-beta - 📁 User-Choosable Data Folder
+
+**Your Data, Your Location!** On first run, you choose where to store your data (API keys, TMs, glossaries, prompts). Default is a visible folder in your home directory:
+
+| Platform | Default Location |
+|----------|-----------------|
+| **Windows** | `C:\Users\Username\Supervertaler\` |
+| **macOS** | `~/Supervertaler/` |
+| **Linux** | `~/Supervertaler/` |
+
+**Features:**
+- First-run dialog lets you choose your data folder
+- Change location anytime in Settings → General
+- Auto-recovery if config pointer is deleted
+- Easy to backup - just copy the folder!
+
+### v1.9.147 - 📁 Persistent User Data Location
+
+**No More Data Loss on Upgrade!** User data now stored outside the pip package directory, surviving `pip install --upgrade`.
 
 ### FIXED in v1.9.146 - 🔑 Gemini/Google API Key Alias
 
@@ -369,7 +394,7 @@ python Supervertaler.py
 - 📊 **Smart Status** - Manual edits reset status requiring confirmation
 
 **v1.4.0 - Supervoice Voice Dictation + Detachable Log:**
-- 🎤 **Supervoice Voice Dictation** - AI-powered hands-free translation input
+- 🎤 **Supervoice Voice Dictation** - AI-enhanced hands-free translation input
 - 🌍 **100+ Languages** - OpenAI Whisper supports virtually any language
 - ⌨️ **F9 Global Hotkey** - Press-to-start, press-to-stop recording anywhere
 - 🎚️ **5 Model Sizes** - Tiny to Large (balance speed vs accuracy)
@@ -419,7 +444,7 @@ python Supervertaler.py
 - 🔍 **Superlookup** - System-wide search with global hotkey (Ctrl+Alt+L)
 - 📝 **TMX Editor** - Professional translation memory editor with database support
 - 🧹 **AutoFingers** - Automated translation pasting for memoQ with tag cleaning
-- 🔧 **PDF Rescue** - AI-powered OCR for poorly formatted PDFs
+- 🔧 **PDF Rescue** - AI-enhanced OCR for poorly formatted PDFs
 - 🔧 **Encoding Repair Tool** - Detect and fix text encoding corruption (mojibake)
 - 💾 **Translation Memory** - Fuzzy matching with TMX import/export
 - 📚 **Multiple Termbases** - Glossary support per project
@@ -480,7 +505,7 @@ For comprehensive project information, see [PROJECT_CONTEXT.md](PROJECT_CONTEXT.
 - 🤖 **LLM Integration** - OpenAI GPT-4/5, Anthropic Claude, Google Gemini
 - 🎯 **Context-aware Translation** - Full document understanding
 - 📚 **Unified Prompt Library** - System Prompts + Custom Instructions
-- 🆘 **PDF Rescue** - AI-powered OCR for badly-formatted PDFs
+- 🆘 **PDF Rescue** - AI-enhanced OCR for badly-formatted PDFs
 - ✅ **CAT Features** - Segment editing, grid pagination, dual selection
 - 📝 **TMX Editor** - Professional translation memory editor
 - 🔗 **CAT Tool Integration** - memoQ, CafeTran, Trados Studio