transcoder-llm 1.0.0__tar.gz

transcoder_llm-1.0.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2025 EasyCam
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

transcoder_llm-1.0.0/MANIFEST.in

@@ -0,0 +1,25 @@
+include LICENSE
+include README.md
+include README_CN.md
+include pyproject.toml
+include requirements.txt
+include requirements-minimal.txt
+include env.example
+include upload_pypi.sh
+include upload_pypi.bat
+include AGENTS.md
+
+recursive-include templates *.html *.css *.js
+recursive-include static *.css *.js *.png *.jpg *.ico
+recursive-include transcoder *.html *.css *.js
+
+recursive-include data *.json *.csv *.xlsx *.tmx *.tbx
+recursive-exclude data __pycache__
+recursive-exclude tests __pycache__
+recursive-exclude transcoder __pycache__
+
+global-exclude __pycache__
+global-exclude *.py[cod]
+global-exclude *.so
+global-exclude .DS_Store
+global-exclude .git*

transcoder_llm-1.0.0/PKG-INFO

@@ -0,0 +1,324 @@
+Metadata-Version: 2.4
+Name: transcoder-llm
+Version: 1.0.0
+Summary: Multilingual Parallel Translation Platform with Reflection-based Improvement using Local LLMs
+Author-email: TransCoder Team <transcoder@example.com>
+Maintainer-email: TransCoder Team <transcoder@example.com>
+License: MIT
+Project-URL: Homepage, https://github.com/EasyCam/TransCoder
+Project-URL: Documentation, https://github.com/EasyCam/TransCoder#readme
+Project-URL: Repository, https://github.com/EasyCam/TransCoder.git
+Project-URL: Issues, https://github.com/EasyCam/TransCoder/issues
+Project-URL: Changelog, https://github.com/EasyCam/TransCoder/blob/main/CHANGELOG.md
+Keywords: translation,llm,ollama,multilingual,reflection,ai,machine-translation,nlp,local-llm
+Classifier: Development Status :: 4 - Beta
+Classifier: Environment :: Web Environment
+Classifier: Framework :: Flask
+Classifier: Intended Audience :: Developers
+Classifier: Intended Audience :: Science/Research
+Classifier: Intended Audience :: End Users/Desktop
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.8
+Classifier: Programming Language :: Python :: 3.9
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Classifier: Topic :: Text Processing :: Linguistic
+Requires-Python: >=3.8
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: flask>=2.0.0
+Requires-Dist: flask-cors>=3.0.0
+Requires-Dist: ollama>=0.1.0
+Requires-Dist: langdetect>=1.0.0
+Requires-Dist: python-dotenv>=1.0.0
+Requires-Dist: waitress>=2.1.0
+Provides-Extra: web
+Requires-Dist: flask>=2.0.0; extra == "web"
+Requires-Dist: flask-cors>=3.0.0; extra == "web"
+Requires-Dist: waitress>=2.1.0; extra == "web"
+Provides-Extra: vector-db
+Requires-Dist: numpy>=1.20.0; extra == "vector-db"
+Requires-Dist: faiss-cpu>=1.7.0; extra == "vector-db"
+Requires-Dist: sentence-transformers>=2.0.0; extra == "vector-db"
+Provides-Extra: evaluation
+Requires-Dist: sacrebleu>=2.0.0; extra == "evaluation"
+Requires-Dist: bert-score>=0.3.0; extra == "evaluation"
+Requires-Dist: rouge-score>=0.1.0; extra == "evaluation"
+Requires-Dist: nltk>=3.8.0; extra == "evaluation"
+Provides-Extra: terminology
+Requires-Dist: pandas>=1.3.0; extra == "terminology"
+Requires-Dist: openpyxl>=3.0.0; extra == "terminology"
+Provides-Extra: gui
+Requires-Dist: PySide6>=6.4.0; extra == "gui"
+Provides-Extra: all
+Requires-Dist: flask>=2.0.0; extra == "all"
+Requires-Dist: flask-cors>=3.0.0; extra == "all"
+Requires-Dist: ollama>=0.1.0; extra == "all"
+Requires-Dist: langdetect>=1.0.0; extra == "all"
+Requires-Dist: python-dotenv>=1.0.0; extra == "all"
+Requires-Dist: waitress>=2.1.0; extra == "all"
+Requires-Dist: numpy>=1.20.0; extra == "all"
+Requires-Dist: faiss-cpu>=1.7.0; extra == "all"
+Requires-Dist: sentence-transformers>=2.0.0; extra == "all"
+Requires-Dist: sacrebleu>=2.0.0; extra == "all"
+Requires-Dist: bert-score>=0.3.0; extra == "all"
+Requires-Dist: rouge-score>=0.1.0; extra == "all"
+Requires-Dist: nltk>=3.8.0; extra == "all"
+Requires-Dist: pandas>=1.3.0; extra == "all"
+Requires-Dist: openpyxl>=3.0.0; extra == "all"
+Requires-Dist: PySide6>=6.4.0; extra == "all"
+Provides-Extra: dev
+Requires-Dist: pytest>=7.0.0; extra == "dev"
+Requires-Dist: pytest-cov>=4.0.0; extra == "dev"
+Requires-Dist: ruff>=0.1.0; extra == "dev"
+Requires-Dist: mypy>=1.0.0; extra == "dev"
+Requires-Dist: build>=0.10.0; extra == "dev"
+Requires-Dist: twine>=4.0.0; extra == "dev"
+Dynamic: license-file
+
+# TransCoder
+
+[![PyPI version](https://badge.fury.io/py/transcoder-llm.svg)](https://badge.fury.io/py/transcoder-llm)
+[![Python 3.8+](https://img.shields.io/badge/python-3.8+-blue.svg)](https://www.python.org/downloads/)
+[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
+
+**Multilingual Parallel Translation Platform with Reflection-based Improvement using Local LLMs**
+
+TransCoder is a powerful translation platform that leverages local Large Language Models (LLMs) through Ollama, featuring innovative **Reflection-based Translation** methods that significantly improve translation quality through AI self-evaluation and iterative refinement.
+
+## Key Features
+
+### 🌟 Core Innovations
+
+- **三省吾身模式 (Three Reflections Mode)**: Translation → AI Reflection → Improvement cycle
+- **千锤百炼模式 (Iterative Refinement Mode)**: Configurable 1-10 iteration optimization for maximum quality
+
+### 🚀 Main Features
+
+- **Multilingual Parallel Translation**: Translate to multiple languages simultaneously
+- **14 Language Variants**: Including Chinese variants (Simplified, Traditional, Classical)
+- **Local LLM Support**: Works with Ollama (Qwen, Llama, Mistral, etc.)
+- **Translation Memory**: FAISS-based vector database for consistency
+- **Terminology Management**: Professional term consistency across translations
+- **Quality Evaluation**: BLEU, BERTScore, ROUGE metrics
+
+## Installation
+
+### From PyPI (Recommended)
+
+```bash
+pip install transcoder-llm
+
+# With all features
+pip install transcoder-llm[all]
+
+# With specific features
+pip install transcoder-llm[web]      # Web interface
+pip install transcoder-llm[vector-db] # Translation memory
+pip install transcoder-llm[evaluation] # Quality metrics
+```
+
+### From Source
+
+```bash
+git clone https://github.com/EasyCam/TransCoder.git
+cd TransCoder
+pip install -e .
+```
+
+## Quick Start
+
+### 1. Install and Start Ollama
+
+```bash
+# Install Ollama (macOS/Linux)
+curl -fsSL https://ollama.ai/install.sh | sh
+
+# Download a model
+ollama pull qwen3:0.6b
+```
+
+### 2. Start TransCoder
+
+```bash
+# Web interface
+transcoder web
+
+# Or with production server
+transcoder web --production
+
+# CLI translation
+transcoder cli -i input.txt -t en,ja,ko -o output.txt
+```
+
+### 3. Python API
+
+```python
+from transcoder import TransCoderAPI
+
+api = TransCoderAPI(model="qwen3:0.6b")
+
+# Simple translation
+result = api.translate("Hello world", "en", ["zh-cn", "ja"])
+print(result.data["translations"])
+
+# Reflection mode (三省吾身)
+result = api.translate_with_reflection(
+    "Hello world", "en", "zh-cn"
+)
+
+# Iterative refinement (千锤百炼)
+result = api.translate_iterative(
+    "Hello world", "en", "zh-cn", iterations=3
+)
+```
+
+## Translation Modes
+
+### Simple Mode
+Fast one-pass translation for everyday use.
+
+### Reflection Mode (三省吾身)
+```
+Initial Translation → AI Reflection Analysis → Improved Translation
+```
+
+The AI analyzes translation quality from four dimensions:
+- **Accuracy**: Is the meaning fully preserved?
+- **Fluency**: Is the expression natural?
+- **Style**: Is the tone appropriate?
+- **Terminology**: Are terms translated correctly?
+
+### Iterative Refinement (千锤百炼)
+```
+Initial → Reflect → Improve → Reflect → Improve → ... → Final
+```
+
+Configure 1-10 iterations to balance quality vs. speed.
+
+## API Reference
+
+### REST API
+
+```bash
+# Translation
+POST /api/translate
+{
+    "source_text": "Hello world",
+    "source_lang": "en",
+    "target_langs": ["zh-cn", "ja"]
+}
+
+# Reflection
+POST /api/translate/reflect
+{
+    "source_text": "Hello world",
+    "translation": "你好世界",
+    "source_lang": "en",
+    "target_lang": "zh-cn"
+}
+
+# Improvement
+POST /api/translate/improve
+{
+    "source_text": "Hello world",
+    "current_translation": "你好世界",
+    "reflection": "...",
+    "source_lang": "en",
+    "target_lang": "zh-cn"
+}
+```
+
+### Python API
+
+```python
+from transcoder import TransCoderAPI
+
+api = TransCoderAPI()
+
+# Translate
+result = api.translate(text, source_lang, target_langs)
+
+# With reflection
+result = api.translate_with_reflection(text, source_lang, target_lang)
+
+# Iterative
+result = api.translate_iterative(text, source_lang, target_lang, iterations=3)
+
+# Evaluate quality
+result = api.evaluate_translation(source, translated, reference)
+```
+
+## Supported Languages
+
+| Code | Language |
+|------|----------|
+| zh-cn | Chinese (Simplified) |
+| zh-tw | Chinese (Traditional) |
+| zh-classical-cn | Classical Chinese (Simplified) |
+| zh-classical-tw | Classical Chinese (Traditional) |
+| en | English |
+| ja | Japanese |
+| ko | Korean |
+| es | Spanish |
+| fr | French |
+| de | German |
+| ru | Russian |
+| ar | Arabic |
+| pt | Portuguese |
+
+## Project Structure
+
+```
+transcoder/
+├── __init__.py      # Package exports
+├── cli.py           # Command-line interface
+├── api.py           # Unified Python API
+├── core.py          # Core services
+├── app.py           # Flask web application
+└── templates/       # HTML templates
+```
+
+## Development
+
+```bash
+# Install dev dependencies
+pip install -e ".[dev]"
+
+# Run tests
+pytest tests/
+
+# Run linter
+ruff check transcoder/
+
+# Build package
+python -m build
+
+# Upload to PyPI
+./upload_pypi.sh
+```
+
+## License
+
+MIT License - See [LICENSE](LICENSE) for details.
+
+## Citation
+
+If you use TransCoder in your research, please cite:
+
+```bibtex
+@software{transcoder2024,
+  title = {TransCoder: Multilingual Parallel Translation Platform with Reflection-based Improvement},
+  author = {TransCoder Team},
+  year = {2024},
+  url = {https://github.com/EasyCam/TransCoder}
+}
+```
+
+## Contributing
+
+Contributions are welcome! Please read our contributing guidelines before submitting PRs.

transcoder_llm-1.0.0/README.md

@@ -0,0 +1,242 @@
+# TransCoder
+
+[![PyPI version](https://badge.fury.io/py/transcoder-llm.svg)](https://badge.fury.io/py/transcoder-llm)
+[![Python 3.8+](https://img.shields.io/badge/python-3.8+-blue.svg)](https://www.python.org/downloads/)
+[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
+
+**Multilingual Parallel Translation Platform with Reflection-based Improvement using Local LLMs**
+
+TransCoder is a powerful translation platform that leverages local Large Language Models (LLMs) through Ollama, featuring innovative **Reflection-based Translation** methods that significantly improve translation quality through AI self-evaluation and iterative refinement.
+
+## Key Features
+
+### 🌟 Core Innovations
+
+- **三省吾身模式 (Three Reflections Mode)**: Translation → AI Reflection → Improvement cycle
+- **千锤百炼模式 (Iterative Refinement Mode)**: Configurable 1-10 iteration optimization for maximum quality
+
+### 🚀 Main Features
+
+- **Multilingual Parallel Translation**: Translate to multiple languages simultaneously
+- **14 Language Variants**: Including Chinese variants (Simplified, Traditional, Classical)
+- **Local LLM Support**: Works with Ollama (Qwen, Llama, Mistral, etc.)
+- **Translation Memory**: FAISS-based vector database for consistency
+- **Terminology Management**: Professional term consistency across translations
+- **Quality Evaluation**: BLEU, BERTScore, ROUGE metrics
+
+## Installation
+
+### From PyPI (Recommended)
+
+```bash
+pip install transcoder-llm
+
+# With all features
+pip install transcoder-llm[all]
+
+# With specific features
+pip install transcoder-llm[web]      # Web interface
+pip install transcoder-llm[vector-db] # Translation memory
+pip install transcoder-llm[evaluation] # Quality metrics
+```
+
+### From Source
+
+```bash
+git clone https://github.com/EasyCam/TransCoder.git
+cd TransCoder
+pip install -e .
+```
+
+## Quick Start
+
+### 1. Install and Start Ollama
+
+```bash
+# Install Ollama (macOS/Linux)
+curl -fsSL https://ollama.ai/install.sh | sh
+
+# Download a model
+ollama pull qwen3:0.6b
+```
+
+### 2. Start TransCoder
+
+```bash
+# Web interface
+transcoder web
+
+# Or with production server
+transcoder web --production
+
+# CLI translation
+transcoder cli -i input.txt -t en,ja,ko -o output.txt
+```
+
+### 3. Python API
+
+```python
+from transcoder import TransCoderAPI
+
+api = TransCoderAPI(model="qwen3:0.6b")
+
+# Simple translation
+result = api.translate("Hello world", "en", ["zh-cn", "ja"])
+print(result.data["translations"])
+
+# Reflection mode (三省吾身)
+result = api.translate_with_reflection(
+    "Hello world", "en", "zh-cn"
+)
+
+# Iterative refinement (千锤百炼)
+result = api.translate_iterative(
+    "Hello world", "en", "zh-cn", iterations=3
+)
+```
+
+## Translation Modes
+
+### Simple Mode
+Fast one-pass translation for everyday use.
+
+### Reflection Mode (三省吾身)
+```
+Initial Translation → AI Reflection Analysis → Improved Translation
+```
+
+The AI analyzes translation quality from four dimensions:
+- **Accuracy**: Is the meaning fully preserved?
+- **Fluency**: Is the expression natural?
+- **Style**: Is the tone appropriate?
+- **Terminology**: Are terms translated correctly?
+
+### Iterative Refinement (千锤百炼)
+```
+Initial → Reflect → Improve → Reflect → Improve → ... → Final
+```
+
+Configure 1-10 iterations to balance quality vs. speed.
+
+## API Reference
+
+### REST API
+
+```bash
+# Translation
+POST /api/translate
+{
+    "source_text": "Hello world",
+    "source_lang": "en",
+    "target_langs": ["zh-cn", "ja"]
+}
+
+# Reflection
+POST /api/translate/reflect
+{
+    "source_text": "Hello world",
+    "translation": "你好世界",
+    "source_lang": "en",
+    "target_lang": "zh-cn"
+}
+
+# Improvement
+POST /api/translate/improve
+{
+    "source_text": "Hello world",
+    "current_translation": "你好世界",
+    "reflection": "...",
+    "source_lang": "en",
+    "target_lang": "zh-cn"
+}
+```
+
+### Python API
+
+```python
+from transcoder import TransCoderAPI
+
+api = TransCoderAPI()
+
+# Translate
+result = api.translate(text, source_lang, target_langs)
+
+# With reflection
+result = api.translate_with_reflection(text, source_lang, target_lang)
+
+# Iterative
+result = api.translate_iterative(text, source_lang, target_lang, iterations=3)
+
+# Evaluate quality
+result = api.evaluate_translation(source, translated, reference)
+```
+
+## Supported Languages
+
+| Code | Language |
+|------|----------|
+| zh-cn | Chinese (Simplified) |
+| zh-tw | Chinese (Traditional) |
+| zh-classical-cn | Classical Chinese (Simplified) |
+| zh-classical-tw | Classical Chinese (Traditional) |
+| en | English |
+| ja | Japanese |
+| ko | Korean |
+| es | Spanish |
+| fr | French |
+| de | German |
+| ru | Russian |
+| ar | Arabic |
+| pt | Portuguese |
+
+## Project Structure
+
+```
+transcoder/
+├── __init__.py      # Package exports
+├── cli.py           # Command-line interface
+├── api.py           # Unified Python API
+├── core.py          # Core services
+├── app.py           # Flask web application
+└── templates/       # HTML templates
+```
+
+## Development
+
+```bash
+# Install dev dependencies
+pip install -e ".[dev]"
+
+# Run tests
+pytest tests/
+
+# Run linter
+ruff check transcoder/
+
+# Build package
+python -m build
+
+# Upload to PyPI
+./upload_pypi.sh
+```
+
+## License
+
+MIT License - See [LICENSE](LICENSE) for details.
+
+## Citation
+
+If you use TransCoder in your research, please cite:
+
+```bibtex
+@software{transcoder2024,
+  title = {TransCoder: Multilingual Parallel Translation Platform with Reflection-based Improvement},
+  author = {TransCoder Team},
+  year = {2024},
+  url = {https://github.com/EasyCam/TransCoder}
+}
+```
+
+## Contributing
+
+Contributions are welcome! Please read our contributing guidelines before submitting PRs.