ddtp-translate 0.14.4__tar.gz

ddtp_translate-0.14.4/LICENSE

@@ -0,0 +1,22 @@
+                    GNU GENERAL PUBLIC LICENSE
+                       Version 3, 29 June 2007
+
+ Copyright (C) 2007 Free Software Foundation, Inc. <https://fsf.org/>
+ Everyone is permitted to copy and distribute verbatim copies
+ of this license document, but changing it is not allowed.
+
+                            Preamble
+
+  The GNU General Public License is a free, copyleft license for
+software and other kinds of works.
+
+  The licenses for most software and other practical works are designed
+to take away your freedom to share and change the works.  By contrast,
+the GNU General Public License is intended to guarantee your freedom to
+share and change all versions of a program--to make sure it remains free
+software for all its users.  We, the Free Software Foundation, use the
+GNU General Public License for most of our software; it applies also to
+any other work released this way by its authors.  You can apply it to
+your programs, too.
+
+  For the full license text, see <https://www.gnu.org/licenses/gpl-3.0.txt>

ddtp_translate-0.14.4/PKG-INFO

@@ -0,0 +1,84 @@
+Metadata-Version: 2.4
+Name: ddtp-translate
+Version: 0.14.4
+Summary: Translate Debian package descriptions via DDTP
+Author-email: Daniel Nylander <daniel@danielnylander.se>
+License-Expression: GPL-3.0-or-later
+Project-URL: Homepage, https://github.com/yeager/ddtp-translate
+Classifier: Programming Language :: Python :: 3
+Classifier: Topic :: Software Development :: Localization
+Classifier: Environment :: X11 Applications :: GTK
+Requires-Python: >=3.9
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Provides-Extra: translate
+Requires-Dist: po-translate; extra == "translate"
+Dynamic: license-file
+
+# DDTP Translate [![Version](https://img.shields.io/badge/version-0.14.4-blue.svg)](https://github.com/yeager/ddtp-translate)
+
+## Screenshot
+
+![DDTP Translate](screenshots/main.png)
+
+## Description
+
+DDTP Translate is a GTK4/Adwaita application for translating Debian package descriptions via the DDTP (Debian Description Translation Project). The application provides an intuitive interface for translators to contribute to Debian package description translations, helping make Debian more accessible to users worldwide.
+
+The application streamlines the translation workflow by providing easy access to untranslated descriptions, translation memory features, and quality assurance tools for reviewing existing translations.
+
+## Features
+
+- Translate Debian package descriptions
+- Browse untranslated and pending descriptions
+- Review and edit existing translations
+- Translation memory and suggestions
+- Quality assurance tools
+- Modern GTK4/Adwaita interface
+- Offline translation capabilities
+- Batch translation support
+
+## Installation
+
+### PyPI / pipx (Debian/Ubuntu)
+
+Install GTK4, libadwaita and the system PyGObject bindings first; pip cannot
+install these native system libraries:
+
+```bash
+sudo apt install python3-gi gir1.2-gtk-4.0 gir1.2-adw-1 pipx
+pipx install --system-site-packages ddtp-translate
+```
+
+
+### APT Repository (Debian/Ubuntu)
+
+```bash
+echo "deb https://yeager.github.io/debian-repo stable main" | sudo tee /etc/apt/sources.list.d/yeager-l10n.list
+sudo apt update
+sudo apt install ddtp-translate
+```
+
+### Building from Source
+
+```bash
+git clone https://github.com/yeager/ddtp-translate.git
+cd ddtp-translate
+pip install -e .
+```
+
+## Translation
+
+Translations are maintained through GitHub pull requests. Copy the template
+catalogue in [`po/ddtp-translate.pot`](po/ddtp-translate.pot) to a new locale
+file such as `po/de.po`, translate it with a gettext editor, then open a PR.
+Run `msgfmt --check po/<locale>.po` before submitting it. See
+[CONTRIBUTING.md](CONTRIBUTING.md) for the full review workflow.
+
+## License
+
+GPL-3.0-or-later
+
+## Author
+
+Daniel Nylander (daniel@danielnylander.se)

ddtp_translate-0.14.4/README.md

@@ -0,0 +1,67 @@
+# DDTP Translate [![Version](https://img.shields.io/badge/version-0.14.4-blue.svg)](https://github.com/yeager/ddtp-translate)
+
+## Screenshot
+
+![DDTP Translate](screenshots/main.png)
+
+## Description
+
+DDTP Translate is a GTK4/Adwaita application for translating Debian package descriptions via the DDTP (Debian Description Translation Project). The application provides an intuitive interface for translators to contribute to Debian package description translations, helping make Debian more accessible to users worldwide.
+
+The application streamlines the translation workflow by providing easy access to untranslated descriptions, translation memory features, and quality assurance tools for reviewing existing translations.
+
+## Features
+
+- Translate Debian package descriptions
+- Browse untranslated and pending descriptions
+- Review and edit existing translations
+- Translation memory and suggestions
+- Quality assurance tools
+- Modern GTK4/Adwaita interface
+- Offline translation capabilities
+- Batch translation support
+
+## Installation
+
+### PyPI / pipx (Debian/Ubuntu)
+
+Install GTK4, libadwaita and the system PyGObject bindings first; pip cannot
+install these native system libraries:
+
+```bash
+sudo apt install python3-gi gir1.2-gtk-4.0 gir1.2-adw-1 pipx
+pipx install --system-site-packages ddtp-translate
+```
+
+
+### APT Repository (Debian/Ubuntu)
+
+```bash
+echo "deb https://yeager.github.io/debian-repo stable main" | sudo tee /etc/apt/sources.list.d/yeager-l10n.list
+sudo apt update
+sudo apt install ddtp-translate
+```
+
+### Building from Source
+
+```bash
+git clone https://github.com/yeager/ddtp-translate.git
+cd ddtp-translate
+pip install -e .
+```
+
+## Translation
+
+Translations are maintained through GitHub pull requests. Copy the template
+catalogue in [`po/ddtp-translate.pot`](po/ddtp-translate.pot) to a new locale
+file such as `po/de.po`, translate it with a gettext editor, then open a PR.
+Run `msgfmt --check po/<locale>.po` before submitting it. See
+[CONTRIBUTING.md](CONTRIBUTING.md) for the full review workflow.
+
+## License
+
+GPL-3.0-or-later
+
+## Author
+
+Daniel Nylander (daniel@danielnylander.se)

ddtp_translate-0.14.4/pyproject.toml

@@ -0,0 +1,31 @@
+[build-system]
+requires = ["setuptools>=68.0"]
+build-backend = "setuptools.build_meta"
+
+[project]
+name = "ddtp-translate"
+version = "0.14.4"
+description = "Translate Debian package descriptions via DDTP"
+license = "GPL-3.0-or-later"
+authors = [
+    {name = "Daniel Nylander", email = "daniel@danielnylander.se"},
+]
+readme = "README.md"
+requires-python = ">=3.9"
+classifiers = [
+    "Programming Language :: Python :: 3",
+    "Topic :: Software Development :: Localization",
+    "Environment :: X11 Applications :: GTK",
+]
+
+[project.optional-dependencies]
+translate = ["po-translate"]
+
+[project.scripts]
+ddtp-translate = "ddtp_translate.main:main"
+
+[project.urls]
+Homepage = "https://github.com/yeager/ddtp-translate"
+
+[tool.setuptools.packages.find]
+where = ["src"]

ddtp_translate-0.14.4/setup.cfg

@@ -0,0 +1,4 @@
+[egg_info]
+tag_build = 
+tag_date = 0
+

ddtp_translate-0.14.4/src/ddtp_translate/__init__.py

@@ -0,0 +1,3 @@
+"""DDTP Translate — Translate Debian package descriptions."""
+
+__version__ = "0.14.4"

ddtp_translate-0.14.4/src/ddtp_translate/__main__.py

@@ -0,0 +1,3 @@
+"""Allow running with python -m."""
+from .main import main
+main()

ddtp_translate-0.14.4/src/ddtp_translate/accessibility.py

@@ -0,0 +1,66 @@
+"""Accessibility features: zoom, high contrast, ATK."""
+import gi
+gi.require_version('Gtk', '4.0')
+from gi.repository import Gtk, Gdk, Gio
+
+
+class AccessibilityManager:
+    """Manages accessibility features for a GTK4 window."""
+
+    def __init__(self, window, app=None):
+        self._window = window
+        self._app = app or window.get_application()
+        self._font_scale = 1.0
+        self._high_contrast = False
+        self._css = Gtk.CssProvider()
+        Gtk.StyleContext.add_provider_for_display(
+            Gdk.Display.get_default(), self._css,
+            Gtk.STYLE_PROVIDER_PRIORITY_APPLICATION + 1
+        )
+        self._setup_actions()
+
+    def _setup_actions(self):
+        if self._app is None:
+            return
+        actions = [
+            ('zoom-in', self._zoom_in, ['<Control>plus', '<Control>equal']),
+            ('zoom-out', self._zoom_out, ['<Control>minus']),
+            ('zoom-reset', self._zoom_reset, ['<Control>0']),
+            ('toggle-high-contrast', self._toggle_hc, ['<Control><Shift>h']),
+        ]
+        for name, cb, accels in actions:
+            if not self._app.lookup_action(name):
+                action = Gio.SimpleAction.new(name, None)
+                action.connect('activate', lambda a, p, c=cb: c())
+                self._app.add_action(action)
+                self._app.set_accels_for_action(f'app.{name}', accels)
+
+    def _apply_css(self):
+        css = f'window {{ font-size: {self._font_scale}em; }}'
+        if self._high_contrast:
+            css += """
+            window.high-contrast {
+                border: 2px solid @accent_color;
+                font-weight: bold;
+            }"""
+        self._css.load_from_string(css.encode())
+
+    def _zoom_in(self):
+        self._font_scale = min(self._font_scale + 0.1, 3.0)
+        self._apply_css()
+
+    def _zoom_out(self):
+        self._font_scale = max(self._font_scale - 0.1, 0.5)
+        self._apply_css()
+
+    def _zoom_reset(self):
+        self._font_scale = 1.0
+        self._apply_css()
+
+    def _toggle_hc(self):
+        self._high_contrast = not self._high_contrast
+        if self._high_contrast:
+            self._window.add_css_class('high-contrast')
+        else:
+            self._window.remove_css_class('high-contrast')
+        self._apply_css()

ddtp_translate-0.14.4/src/ddtp_translate/ddtp_api.py

@@ -0,0 +1,356 @@
+"""DDTP HTTP API client — fetch untranslated Debian package descriptions."""
+
+import hashlib
+import json
+import os
+import re
+import time
+import urllib.request
+from pathlib import Path
+
+DDTP_BASE = "https://ddtp.debian.org/ddt.cgi"
+# Fallback: fetch from Debian mirror i18n Translation files
+MIRROR_BASE = "https://deb.debian.org/debian"
+DISTS = ["sid", "trixie", "bookworm"]
+CACHE_TTL = 86400  # 24 hours
+
+# All DDTP-supported language codes
+DDTP_LANGUAGES = [
+    ("ar", "Arabic"),
+    ("bg", "Bulgarian"),
+    ("ca", "Catalan"),
+    ("cs", "Czech"),
+    ("da", "Danish"),
+    ("de", "German"),
+    ("el", "Greek"),
+    ("eo", "Esperanto"),
+    ("es", "Spanish"),
+    ("eu", "Basque"),
+    ("fi", "Finnish"),
+    ("fr", "French"),
+    ("gl", "Galician"),
+    ("hu", "Hungarian"),
+    ("id", "Indonesian"),
+    ("it", "Italian"),
+    ("ja", "Japanese"),
+    ("km", "Khmer"),
+    ("ko", "Korean"),
+    ("lt", "Lithuanian"),
+    ("ml", "Malayalam"),
+    ("nb", "Norwegian Bokmål"),
+    ("nl", "Dutch"),
+    ("pl", "Polish"),
+    ("pt", "Portuguese"),
+    ("pt_BR", "Brazilian Portuguese"),
+    ("ro", "Romanian"),
+    ("ru", "Russian"),
+    ("sk", "Slovak"),
+    ("sl", "Slovenian"),
+    ("sr", "Serbian"),
+    ("sv", "Swedish"),
+    ("th", "Thai"),
+    ("tr", "Turkish"),
+    ("uk", "Ukrainian"),
+    ("vi", "Vietnamese"),
+    ("zh_CN", "Chinese (Simplified)"),
+    ("zh_TW", "Chinese (Traditional)"),
+]
+
+
+def _cache_dir():
+    xdg = os.environ.get("XDG_CACHE_HOME", os.path.expanduser("~/.cache"))
+    d = Path(xdg) / "ddtp-translate"
+    d.mkdir(parents=True, exist_ok=True)
+    return d
+
+
+def _cache_path(lang):
+    return _cache_dir() / f"untranslated_{lang}.json"
+
+
+def _is_cache_valid(path):
+    if not path.exists():
+        return False
+    return (time.time() - path.stat().st_mtime) < CACHE_TTL
+
+
+def compute_description_hash(description):
+    """Compute MD5 hash of the description (used in DDTP email subject)."""
+    return hashlib.md5(description.encode("utf-8")).hexdigest()
+
+
+def parse_ddtp_response(text):
+    """Parse DDTP ddt.cgi response into list of package dicts.
+
+    Response format (one per package, separated by blank lines):
+        Package: <name>
+        Description-md5: <hash>
+        Description-en: <short description>
+         <long description line 1>
+         <long description line 2>
+         .
+    """
+    packages = []
+    current = None
+
+    for line in text.splitlines():
+        if line.startswith("Package: "):
+            if current:
+                packages.append(current)
+            current = {
+                "package": line[9:].strip(),
+                "md5": "",
+                "short": "",
+                "long": "",
+            }
+        elif line.startswith("Description-md5: ") and current:
+            current["md5"] = line[17:].strip()
+        elif line.startswith("Description-en: ") and current:
+            current["short"] = line[16:].strip()
+        elif current and (line.startswith(" ") or line.startswith("\t")):
+            stripped = line.strip()
+            if stripped == ".":
+                current["long"] += "\n"
+            else:
+                if current["long"]:
+                    current["long"] += "\n"
+                current["long"] += stripped
+
+    if current:
+        packages.append(current)
+
+    return packages
+
+
+def _fetch_translation_file(dist, lang):
+    """Download and decompress Translation-XX.bz2 from Debian mirror."""
+    import bz2
+    url = f"{MIRROR_BASE}/dists/{dist}/main/i18n/Translation-{lang}.bz2"
+    try:
+        req = urllib.request.Request(url, headers={"User-Agent": "ddtp-translate/0.1"})
+        with urllib.request.urlopen(req, timeout=60) as resp:
+            compressed = resp.read()
+        return bz2.decompress(compressed).decode("utf-8", errors="replace")
+    except Exception:
+        return None
+
+
+def _parse_translation_file(text):
+    """Parse Debian Translation file into dict of md5 -> {package, short, long}."""
+    entries = {}
+    current = {}
+    in_desc = False
+
+    for line in text.splitlines():
+        if line.startswith("Package: "):
+            if current.get("md5"):
+                entries[current["md5"]] = current
+            current = {"package": line[9:].strip(), "md5": "", "short": "", "long": ""}
+            in_desc = False
+        elif line.startswith("Description-md5: "):
+            current["md5"] = line[17:].strip()
+        elif line.startswith("Description-"):
+            current["short"] = line.split(": ", 1)[1] if ": " in line else ""
+            in_desc = True
+        elif in_desc and (line.startswith(" ") or line.startswith("\t")):
+            stripped = line.strip()
+            if stripped == ".":
+                current["long"] += "\n"
+            else:
+                if current["long"]:
+                    current["long"] += "\n"
+                current["long"] += stripped
+        else:
+            in_desc = False
+
+    if current.get("md5"):
+        entries[current["md5"]] = current
+    return entries
+
+
+def fetch_untranslated_from_mirror(lang, dist="sid"):
+    """Fetch untranslated descriptions by comparing en vs lang Translation files."""
+    cache = _cache_dir() / f"mirror_untranslated_{lang}_{dist}.json"
+
+    if _is_cache_valid(cache):
+        with open(cache, "r", encoding="utf-8") as f:
+            return json.load(f)
+
+    en_text = _fetch_translation_file(dist, "en")
+    if not en_text:
+        raise RuntimeError(f"Failed to download Translation-en for {dist}")
+
+    lang_text = _fetch_translation_file(dist, lang)
+
+    en_entries = _parse_translation_file(en_text)
+    lang_entries = _parse_translation_file(lang_text) if lang_text else {}
+
+    # Untranslated = in en but not in lang
+    untranslated = []
+    for md5, entry in en_entries.items():
+        if md5 not in lang_entries:
+            untranslated.append(entry)
+
+    # Sort by package name
+    untranslated.sort(key=lambda x: x.get("package", ""))
+
+    with open(cache, "w", encoding="utf-8") as f:
+        json.dump(untranslated, f, ensure_ascii=False, indent=2)
+
+    return untranslated
+
+
+def fetch_untranslated(lang, force_refresh=False):
+    """Fetch untranslated descriptions for a language. Returns list of dicts.
+    
+    Tries ddtp.debian.org first, falls back to Debian mirror comparison.
+    """
+    cache = _cache_path(lang)
+
+    if not force_refresh and _is_cache_valid(cache):
+        with open(cache, "r", encoding="utf-8") as f:
+            return json.load(f)
+
+    # Try ddtp.debian.org first
+    url = f"{DDTP_BASE}?lcode={lang}&getuntranslated=1"
+    try:
+        req = urllib.request.Request(url, headers={"User-Agent": "ddtp-translate/0.1"})
+        with urllib.request.urlopen(req, timeout=15) as resp:
+            text = resp.read().decode("utf-8", errors="replace")
+        packages = parse_ddtp_response(text)
+        if packages:
+            with open(cache, "w", encoding="utf-8") as f:
+                json.dump(packages, f, ensure_ascii=False, indent=2)
+            return packages
+    except Exception:
+        pass
+
+    # Fallback: Debian mirror comparison
+    try:
+        packages = fetch_untranslated_from_mirror(lang, "sid")
+        if packages:
+            with open(cache, "w", encoding="utf-8") as f:
+                json.dump(packages, f, ensure_ascii=False, indent=2)
+            return packages
+    except Exception:
+        pass
+
+    # Last resort: stale cache
+    if cache.exists():
+        with open(cache, "r", encoding="utf-8") as f:
+            return json.load(f)
+
+    raise RuntimeError(
+        "Could not fetch DDTP data. Both ddtp.debian.org and "
+        "the Debian mirror (deb.debian.org) are unreachable. "
+        "Please check your internet connection."
+    )
+
+
+def fetch_popcon_data(force_refresh=False):
+    """Fetch Debian popcon (popularity contest) install counts.
+
+    Returns dict mapping package_name -> install_count.
+    Data from https://popcon.debian.org/by_inst.gz
+    """
+    import gzip
+    cache = _cache_dir() / "popcon_by_inst.json"
+
+    if not force_refresh and _is_cache_valid(cache):
+        with open(cache, "r", encoding="utf-8") as f:
+            return json.load(f)
+
+    url = "https://popcon.debian.org/by_inst.gz"
+    try:
+        req = urllib.request.Request(url, headers={"User-Agent": "ddtp-translate/0.8"})
+        with urllib.request.urlopen(req, timeout=30) as resp:
+            compressed = resp.read()
+        text = gzip.decompress(compressed).decode("utf-8", errors="replace")
+    except Exception as exc:
+        # Try stale cache
+        if cache.exists():
+            with open(cache, "r", encoding="utf-8") as f:
+                return json.load(f)
+        return {}
+
+    popcon = {}
+    for line in text.splitlines():
+        if line.startswith("#") or not line.strip():
+            continue
+        parts = line.split()
+        if len(parts) >= 3:
+            try:
+                # Format: rank name inst vote old recent no-files
+                # or: name inst vote old recent no-files (without rank column)
+                # The by_inst format: rank name inst vote old recent no-files
+                rank = parts[0]
+                if rank.isdigit():
+                    pkg_name = parts[1]
+                    inst_count = int(parts[2])
+                else:
+                    pkg_name = parts[0]
+                    inst_count = int(parts[1])
+                popcon[pkg_name] = inst_count
+            except (ValueError, IndexError):
+                continue
+
+    with open(cache, "w", encoding="utf-8") as f:
+        json.dump(popcon, f, ensure_ascii=False)
+
+    return popcon
+
+
+def fetch_ddtp_stats():
+    """Fetch translation statistics from ddtp.debian.org main page.
+
+    Returns dict mapping lang_code -> {
+        'active_translations': int,
+        'previously_translated': int,
+        'total_translations': int,
+    }
+    Also returns total_packages and active_packages as top-level keys.
+    """
+    cache = _cache_dir() / "ddtp_stats.json"
+    if _is_cache_valid(cache):
+        with open(cache, "r", encoding="utf-8") as f:
+            return json.load(f)
+
+    url = "https://ddtp.debian.org/"
+    try:
+        req = urllib.request.Request(url, headers={"User-Agent": "ddtp-translate/0.1"})
+        with urllib.request.urlopen(req, timeout=15) as resp:
+            text = resp.read().decode("utf-8", errors="replace")
+    except Exception as exc:
+        # Try stale cache
+        if cache.exists():
+            with open(cache, "r", encoding="utf-8") as f:
+                return json.load(f)
+        raise RuntimeError(f"Could not fetch DDTP statistics: {exc}")
+
+    stats = {"languages": {}, "total_packages": 0, "active_packages": 0}
+
+    # Parse total/active packages
+    m = re.search(r"(\d+) package descriptions;", text)
+    if m:
+        stats["total_packages"] = int(m.group(1))
+    m = re.search(r"(\d+) package descriptions are active;", text)
+    if m:
+        stats["active_packages"] = int(m.group(1))
+
+    # Parse per-language stats
+    # Pattern: lang XX has N (<a ...>M</a>) active translations from T translations;
+    for m in re.finditer(
+        r'lang (\S+) has (\d+) \(<a[^>]*>(\d+)</a>\) active translations from (\d+) translations;',
+        text,
+    ):
+        lang_code = m.group(1)
+        stats["languages"][lang_code] = {
+            "active_translations": int(m.group(2)),
+            "previously_translated": int(m.group(3)),
+            "total_translations": int(m.group(4)),
+        }
+
+    with open(cache, "w", encoding="utf-8") as f:
+        json.dump(stats, f, ensure_ascii=False, indent=2)
+
+    return stats