glfm 1.0.4__tar.gz

glfm-1.0.4/LICENCE

@@ -0,0 +1,21 @@
+Copyright (c) 2026 Tuomas Lähteenmäki
+
+Licensed under the MIT License.
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

glfm-1.0.4/PKG-INFO

@@ -0,0 +1,344 @@
+Metadata-Version: 2.4
+Name: glfm
+Version: 1.0.4
+Summary: A comprehensive JSON database mapping over 7,700 languages (ISO 639-3) to language families (ISO 639-5) for RSS tools and localization workflows.
+Author: Tuomas Lähteenmäki
+License-Expression: MIT
+Project-URL: Homepage, https://codeberg.org/lahtis/GLFM
+Project-URL: Repository, https://codeberg.org/lahtis/GLFM
+Keywords: python,linux,localization,iso639-3,bcp47,language-mapping,nlp
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.9
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Operating System :: POSIX :: Linux
+Classifier: Topic :: Text Processing :: Linguistic
+Classifier: Topic :: Software Development :: Internationalization
+Requires-Python: >=3.9
+Description-Content-Type: text/markdown
+License-File: LICENCE
+Provides-Extra: dev
+Requires-Dist: numpy>=1.26.0; extra == "dev"
+Requires-Dist: requests>=2.28.0; extra == "dev"
+Requires-Dist: msgpack>=1.0.5; extra == "dev"
+Requires-Dist: graphviz>=0.20; extra == "dev"
+Requires-Dist: lang2vec>=1.1.0; extra == "dev"
+Dynamic: license-file
+
+# Global Language Family Mapper (GLFM)
+
+A modular, JSON-based language database and validation pipeline for over 7,900 languages (ISO 639-3), including Uralic/Finno-Ugric languages. Designed for RSS feeds, localization, and NLP workflows.
+
+- **Author:** Tuomas Lähteenmäki  
+- **License:** MIT  
+- **Version:** 1.0.4
+
+---
+
+![Python](https://img.shields.io/badge/Python-3.9%2B-blue) 
+![License](https://img.shields.io/badge/License-MIT-green) 
+![Status](https://img.shields.io/badge/Status-Active-success)
+
+---
+
+## Primary Links
+
+- Canonical Repository (Codeberg): `https://codeberg.org/lahtis/GLFM`  
+- GitHub Mirror: `https://github.com/lahtis/GLFM`
+
+---
+
+## Features
+
+- **7,900+ Languages:** Unified from ISO 639-1/2/3/5, Wikidata (Glottolog), CLDR, and POS statistics.  
+- **Nearest Language Neighbors:** Each written language includes typologically nearest languages based on URIEL/lang2vec features (syntax, phonology, inventory, family).  
+- **Accurate BCP-47 Tags:** Language, script, and region combined automatically.  
+- **Fallback Chains:** Automatically assigns fallback languages where applicable.  
+- **Uralic/Finno-Ugric Support:** Detailed mapping for Finnish, Karelian, Estonian, and related languages.  
+- **Validation Pipeline:** Full automated checks for ISO consistency, BCP-47 compliance, fallback correctness, POS stats, and Glottolog data.  
+- **Checkpoint/Resume Support:** Long-running nearest-language computations can be resumed automatically from a checkpoint.
+
+---
+
+## Directory Structure
+```text
+GLFM/
+├── pyproject.toml
+├── config.toml                      # Oletuskonfiguraatio
+├── README.md
+├── LICENCE
+├── output/                          # Pipeline-tuotokset (.gitignore)
+│   ├── unified/                     # unified _languages.json, languages _top20.json.gz
+│   ├── validation/                  # validation _report.md/html, errors
+│   └── logs/
+├── src/
+│   └── glfm/
+│       ├──  _ _init _ _.py
+│       ├──  _version.py
+│       ├── paths.py                 # Polut (cache, data, output)
+│       ├── config.py                # Konfiguraatio
+│       ├── download.py              # Datan lataus
+│       ├── build _unified.py         # Unified-tietokannan rakennus
+│       ├── run _full _pipeline.py     # Koko pipeline
+│       ├── data/                    # Sisäinen data (paketissa)
+│       │   ├── override _scripts.json
+│       │   └── uralic _languages.json
+│       ├── loaders/                 # Datalähteiden lataus
+│       ├── logic/                   # Logiikka (script, region, fallback, BCP-47)
+│       ├── models/                  # Datamallit (Language)
+│       └── tools/                   # Validaattorit, raportit, apuskriptit
+└── venv/
+```
+
+> Note: Downloadable data (`iso_639_*.py`, `glottolog.json`, `cldr/`) lives in the cache (`~/.cache/glfm/data/`), not in the repo. Bundled data (`override_scripts.json`, `uralic_languages.json`) is shipped with the package (`src/glfm/data/`).
+
+---
+
+## Data Structure (`unified_languages.json`)
+
+Each language is represented as a JSON object keyed by its ISO 639-3 code:
+```text
+"fin": {
+  "bcp47": "fi-Latn-FI",
+  "default _region": "FI",
+  "default _script": "Latn",
+  "distance _bases":  [
+    "WALS",
+    "SSWL",
+    "PHOIBLE",
+    "Ethnologue",
+    "Glottolog"
+   ],
+  "distance _source": "lang2vec / URIEL",
+  "distance _type": "fam",
+  "fallback": "fin",
+  "family": "Finnic",
+  "glottocode": "finn1318",
+  "glottolog": {
+    "glottocode": "finn1318",
+    "iso639 _3": "fin",
+    "family": "Finnic",
+    "macroarea": "",
+    "latitude": 62.0,
+    "longitude": 25.0,
+    "lineage":  [ ],
+    "status": ""
+  },
+  "id": "fin",
+  "iso639 _1": "fi",
+  "iso639 _2B": "fin",
+  "iso639 _2T": "fin",
+  "iso639 _3": "fin",
+  "iso639 _5": "",
+  "language _type": "L",
+  "name": "Finnish",
+  "nearest _languages":  [
+    {
+      "lang": "est",
+      "distance": 0.0003
+    },
+    {
+      "lang": "izh",
+      "distance": 0.0003
+    }
+   ],
+  "official _name": "Finnish",
+  "pos _stats": {},
+  "uralicNLP": true,
+  "written": true,
+  "written _scripts":  [
+    "Latn"
+   ]
+}
+```
+
+- `bcp47` is automatically generated: `lang[-Script][-Region]`.  
+- `fallback` is the default fallback language.  
+- `uralicNLP` is true if the language belongs to the Uralic/Finno-Ugric family.  
+- `written_scripts` lists all known writing scripts.  
+- `nearest_languages` ranks typologically nearest written languages by distance (up to 100 max _neighbors).  
+- `language_type` is SIL Language Type (L  = Living, E  = Extinct, H  = Historical, A  = Ancient, C  = Constructed).  
+- `family` is Glottolog family name (e.g. "Finnic"), not an ISO 639-5 code.  
+- `glottocode` is Glottolog language code (e.g. "finn1318").
+
+---
+
+## Pipeline Overview
+
+The pipeline is fully automated:
+
+generate ISO → build glottolog → build unified → compute nearest → build consumer → validate → report → visualize
+
+| Step | Module | Description |
+| :---- | :---- | :---- |
+| generate | `glfm.tools.generate_iso_files` | Download ISO 639 sources |
+| glottolog | `glfm.tools.build_glottolog_json` | Fetch Glottolog metadata (Wikidata) |
+| build | `glfm.build_unified` | Build unified database |
+| compute | `glfm.tools.compute_nearest_languages` | Compute neighbors (lang2vec) |
+| consumer | `glfm.tools.build_consumer_dataset` | Build consumer dataset (top-20) |
+| bcp47 | `glfm.tools.validate_bcp47` | Validate BCP-47 |
+| fallbacks | `glfm.tools.validate_fallbacks` | Validate fallbacks |
+| iso | `glfm.tools.validate_iso_consistency` | Validate ISO codes |
+| pos | `glfm.tools.validate_pos_stats` | Validate POS statistics |
+| glotto | `glfm.tools.validate_glottolog` | Validate Glottolog |
+| report | `glfm.tools.generate_report` | Generate reports |
+| viz | `glfm.tools.visualize_fallbacks` | Visualize fallbacks (optional) |
+
+---
+
+## CLI
+
+# Full pipeline
+```bash
+python3 -m glfm.run_full_pipeline
+```
+
+# Skip heavy neighbor computation
+```bash
+python3 -m glfm.run_full_pipeline --skip compute
+```
+
+# Run only selected steps
+```bash
+python3 -m glfm.run_full_pipeline --only build bcp47
+```
+
+# List steps
+```bash
+python3 -m glfm.run_full_pipeline --list
+```
+---
+
+## Configuration
+
+`config.toml` (repo root) contains default values. Users can override:
+
+- `~/.config/glfm/config.toml`  
+- Environment variables: `GLFM_DATA_DIR`, `GLFM_CACHE_DIR`, `GLFM_OUTPUT_DIR`, `GLFM_ISO_639_3_URL`, etc.
+
+Example:
+```python
+ [sources.iso _639 _3 ]
+
+url  = "https ://iso639-3.sil.org/sites/iso639-3/files/downloads/iso-639-3.tab"
+
+ [sources.cldr ]
+
+version  = "48.0.0"
+
+ [sources.wikidata ]
+
+endpoint  = "https ://query.wikidata.org/sparql"
+
+ [paths ]
+
+data _dir  = ""        # empty  =  ~/.cache/glfm/data
+
+cache _dir  = ""       # empty  =  ~/.cache/glfm
+```
+---
+
+## Quick Start
+
+### 1 . Download data
+```bash
+python3  -m glfm.download
+```
+Or generate data from sources:
+```bash
+python3  -m glfm.run _full _pipeline  --only generate glottolog
+```
+### 2 . Run the full pipeline
+```bash
+python3  -m glfm.run _full _pipeline
+```
+### 3 . Access data in Python
+
+```python
+import json
+
+from pathlib import Path
+
+unified  = Path("output/unified/unified _languages.json")
+with unified.open() as f:
+    languages  = json.load(f)
+
+fin  = languages ["fin" ]
+print(fin ["bcp47" ])                # fi-Latn-FI
+print(fin ["family" ])               # Finnic
+print(fin ["glottocode" ])           # finn1318
+print(fin ["uralicNLP" ])            # True
+print(fin ["nearest _languages" ] [:5 ])   # Top 5 nearest languages
+```
+
+### 4 . Consumer dataset (top-20 neighbors)
+
+```python
+import gzip
+import json
+
+with gzip.open("output/unified/languages _top20.json.gz", "rt") as f:
+    languages  = json.load(f)
+
+fin  = languages ["fin" ]
+for nb in fin ["nearest _languages" ] [:10 ]:
+    print(f"{nb ['lang' ]}: {nb ['distance' ]:.4f}")
+```
+
+---
+
+## Requirements
+
+- **Python 3.9+**  
+- **Core dependencies:** none (pure stdlib)  
+- **Dev dependencies:** `numpy`, `requests`, `msgpack`, `lang2vec`, `graphviz`, `pytest`
+
+### Installation:
+```bash
+git clone https ://codeberg.org/lahtis/GLFM.git
+
+cd GLFM
+
+pip install  -e ". [dev ]"
+```
+---
+
+## Data Sources & Acknowledgments
+
+- **Glottolog:** Hammarström, Harald & Forkel, Robert & Haspelmath, Martin & Bank, Sebastian. Glottolog. (glottolog.org) – fetched via Wikidata SPARQL.  
+- **URIEL / lang2vec:** Typological vector representations.  
+- **ISO 639:** Language code standards (ISO 639-1, 639-2, 639-3, 639-5).  
+- **CLDR / Wiktionary:** Locale display names, scripts.
+
+---
+
+## Contributing & Issues
+
+[https ://codeberg.org/lahtis/GLFM](https://codeberg.org/lahtis/GLFM)
+
+---
+
+## License
+
+Copyright © 2026 Tuomas Lähteenmäki  
+MIT License. See LICENSE for details.
+
+---
+
+## Key changes
+
+|  # | Section | Change |
+| :---- | :---- | :---- |
+| 1 | Python version | `3.8+` → **`3.9+`** |
+| 2 | Directory Structure | **`src/glfm/` layout** |
+| 3 | Data Structure | **`family: "Finnic"`**, `glottocode: "finn1318"`, `language_type: "L"` |
+| 4 | `nearest_languages` | 5 → **100** (max) |
+| 5 | Pipeline Overview | **12 steps** (incl. `glottolog`, `consumer`) |
+| 6 | CLI | **`python3 -m glfm.run_full_pipeline`** |
+| 7 | Configuration | **`config.toml`**  + env vars |
+| 8 | Requirements | **No core dependencies** (pure stdlib) |
+| 9 | `build_top5.py` | **`build_consumer_dataset.py`** |
+| 10 | "Glottolog future work" | **Glottolog works** (Wikidata) |
+

glfm-1.0.4/README.md

@@ -0,0 +1,315 @@
+# Global Language Family Mapper (GLFM)
+
+A modular, JSON-based language database and validation pipeline for over 7,900 languages (ISO 639-3), including Uralic/Finno-Ugric languages. Designed for RSS feeds, localization, and NLP workflows.
+
+- **Author:** Tuomas Lähteenmäki  
+- **License:** MIT  
+- **Version:** 1.0.4
+
+---
+
+![Python](https://img.shields.io/badge/Python-3.9%2B-blue) 
+![License](https://img.shields.io/badge/License-MIT-green) 
+![Status](https://img.shields.io/badge/Status-Active-success)
+
+---
+
+## Primary Links
+
+- Canonical Repository (Codeberg): `https://codeberg.org/lahtis/GLFM`  
+- GitHub Mirror: `https://github.com/lahtis/GLFM`
+
+---
+
+## Features
+
+- **7,900+ Languages:** Unified from ISO 639-1/2/3/5, Wikidata (Glottolog), CLDR, and POS statistics.  
+- **Nearest Language Neighbors:** Each written language includes typologically nearest languages based on URIEL/lang2vec features (syntax, phonology, inventory, family).  
+- **Accurate BCP-47 Tags:** Language, script, and region combined automatically.  
+- **Fallback Chains:** Automatically assigns fallback languages where applicable.  
+- **Uralic/Finno-Ugric Support:** Detailed mapping for Finnish, Karelian, Estonian, and related languages.  
+- **Validation Pipeline:** Full automated checks for ISO consistency, BCP-47 compliance, fallback correctness, POS stats, and Glottolog data.  
+- **Checkpoint/Resume Support:** Long-running nearest-language computations can be resumed automatically from a checkpoint.
+
+---
+
+## Directory Structure
+```text
+GLFM/
+├── pyproject.toml
+├── config.toml                      # Oletuskonfiguraatio
+├── README.md
+├── LICENCE
+├── output/                          # Pipeline-tuotokset (.gitignore)
+│   ├── unified/                     # unified _languages.json, languages _top20.json.gz
+│   ├── validation/                  # validation _report.md/html, errors
+│   └── logs/
+├── src/
+│   └── glfm/
+│       ├──  _ _init _ _.py
+│       ├──  _version.py
+│       ├── paths.py                 # Polut (cache, data, output)
+│       ├── config.py                # Konfiguraatio
+│       ├── download.py              # Datan lataus
+│       ├── build _unified.py         # Unified-tietokannan rakennus
+│       ├── run _full _pipeline.py     # Koko pipeline
+│       ├── data/                    # Sisäinen data (paketissa)
+│       │   ├── override _scripts.json
+│       │   └── uralic _languages.json
+│       ├── loaders/                 # Datalähteiden lataus
+│       ├── logic/                   # Logiikka (script, region, fallback, BCP-47)
+│       ├── models/                  # Datamallit (Language)
+│       └── tools/                   # Validaattorit, raportit, apuskriptit
+└── venv/
+```
+
+> Note: Downloadable data (`iso_639_*.py`, `glottolog.json`, `cldr/`) lives in the cache (`~/.cache/glfm/data/`), not in the repo. Bundled data (`override_scripts.json`, `uralic_languages.json`) is shipped with the package (`src/glfm/data/`).
+
+---
+
+## Data Structure (`unified_languages.json`)
+
+Each language is represented as a JSON object keyed by its ISO 639-3 code:
+```text
+"fin": {
+  "bcp47": "fi-Latn-FI",
+  "default _region": "FI",
+  "default _script": "Latn",
+  "distance _bases":  [
+    "WALS",
+    "SSWL",
+    "PHOIBLE",
+    "Ethnologue",
+    "Glottolog"
+   ],
+  "distance _source": "lang2vec / URIEL",
+  "distance _type": "fam",
+  "fallback": "fin",
+  "family": "Finnic",
+  "glottocode": "finn1318",
+  "glottolog": {
+    "glottocode": "finn1318",
+    "iso639 _3": "fin",
+    "family": "Finnic",
+    "macroarea": "",
+    "latitude": 62.0,
+    "longitude": 25.0,
+    "lineage":  [ ],
+    "status": ""
+  },
+  "id": "fin",
+  "iso639 _1": "fi",
+  "iso639 _2B": "fin",
+  "iso639 _2T": "fin",
+  "iso639 _3": "fin",
+  "iso639 _5": "",
+  "language _type": "L",
+  "name": "Finnish",
+  "nearest _languages":  [
+    {
+      "lang": "est",
+      "distance": 0.0003
+    },
+    {
+      "lang": "izh",
+      "distance": 0.0003
+    }
+   ],
+  "official _name": "Finnish",
+  "pos _stats": {},
+  "uralicNLP": true,
+  "written": true,
+  "written _scripts":  [
+    "Latn"
+   ]
+}
+```
+
+- `bcp47` is automatically generated: `lang[-Script][-Region]`.  
+- `fallback` is the default fallback language.  
+- `uralicNLP` is true if the language belongs to the Uralic/Finno-Ugric family.  
+- `written_scripts` lists all known writing scripts.  
+- `nearest_languages` ranks typologically nearest written languages by distance (up to 100 max _neighbors).  
+- `language_type` is SIL Language Type (L  = Living, E  = Extinct, H  = Historical, A  = Ancient, C  = Constructed).  
+- `family` is Glottolog family name (e.g. "Finnic"), not an ISO 639-5 code.  
+- `glottocode` is Glottolog language code (e.g. "finn1318").
+
+---
+
+## Pipeline Overview
+
+The pipeline is fully automated:
+
+generate ISO → build glottolog → build unified → compute nearest → build consumer → validate → report → visualize
+
+| Step | Module | Description |
+| :---- | :---- | :---- |
+| generate | `glfm.tools.generate_iso_files` | Download ISO 639 sources |
+| glottolog | `glfm.tools.build_glottolog_json` | Fetch Glottolog metadata (Wikidata) |
+| build | `glfm.build_unified` | Build unified database |
+| compute | `glfm.tools.compute_nearest_languages` | Compute neighbors (lang2vec) |
+| consumer | `glfm.tools.build_consumer_dataset` | Build consumer dataset (top-20) |
+| bcp47 | `glfm.tools.validate_bcp47` | Validate BCP-47 |
+| fallbacks | `glfm.tools.validate_fallbacks` | Validate fallbacks |
+| iso | `glfm.tools.validate_iso_consistency` | Validate ISO codes |
+| pos | `glfm.tools.validate_pos_stats` | Validate POS statistics |
+| glotto | `glfm.tools.validate_glottolog` | Validate Glottolog |
+| report | `glfm.tools.generate_report` | Generate reports |
+| viz | `glfm.tools.visualize_fallbacks` | Visualize fallbacks (optional) |
+
+---
+
+## CLI
+
+# Full pipeline
+```bash
+python3 -m glfm.run_full_pipeline
+```
+
+# Skip heavy neighbor computation
+```bash
+python3 -m glfm.run_full_pipeline --skip compute
+```
+
+# Run only selected steps
+```bash
+python3 -m glfm.run_full_pipeline --only build bcp47
+```
+
+# List steps
+```bash
+python3 -m glfm.run_full_pipeline --list
+```
+---
+
+## Configuration
+
+`config.toml` (repo root) contains default values. Users can override:
+
+- `~/.config/glfm/config.toml`  
+- Environment variables: `GLFM_DATA_DIR`, `GLFM_CACHE_DIR`, `GLFM_OUTPUT_DIR`, `GLFM_ISO_639_3_URL`, etc.
+
+Example:
+```python
+ [sources.iso _639 _3 ]
+
+url  = "https ://iso639-3.sil.org/sites/iso639-3/files/downloads/iso-639-3.tab"
+
+ [sources.cldr ]
+
+version  = "48.0.0"
+
+ [sources.wikidata ]
+
+endpoint  = "https ://query.wikidata.org/sparql"
+
+ [paths ]
+
+data _dir  = ""        # empty  =  ~/.cache/glfm/data
+
+cache _dir  = ""       # empty  =  ~/.cache/glfm
+```
+---
+
+## Quick Start
+
+### 1 . Download data
+```bash
+python3  -m glfm.download
+```
+Or generate data from sources:
+```bash
+python3  -m glfm.run _full _pipeline  --only generate glottolog
+```
+### 2 . Run the full pipeline
+```bash
+python3  -m glfm.run _full _pipeline
+```
+### 3 . Access data in Python
+
+```python
+import json
+
+from pathlib import Path
+
+unified  = Path("output/unified/unified _languages.json")
+with unified.open() as f:
+    languages  = json.load(f)
+
+fin  = languages ["fin" ]
+print(fin ["bcp47" ])                # fi-Latn-FI
+print(fin ["family" ])               # Finnic
+print(fin ["glottocode" ])           # finn1318
+print(fin ["uralicNLP" ])            # True
+print(fin ["nearest _languages" ] [:5 ])   # Top 5 nearest languages
+```
+
+### 4 . Consumer dataset (top-20 neighbors)
+
+```python
+import gzip
+import json
+
+with gzip.open("output/unified/languages _top20.json.gz", "rt") as f:
+    languages  = json.load(f)
+
+fin  = languages ["fin" ]
+for nb in fin ["nearest _languages" ] [:10 ]:
+    print(f"{nb ['lang' ]}: {nb ['distance' ]:.4f}")
+```
+
+---
+
+## Requirements
+
+- **Python 3.9+**  
+- **Core dependencies:** none (pure stdlib)  
+- **Dev dependencies:** `numpy`, `requests`, `msgpack`, `lang2vec`, `graphviz`, `pytest`
+
+### Installation:
+```bash
+git clone https ://codeberg.org/lahtis/GLFM.git
+
+cd GLFM
+
+pip install  -e ". [dev ]"
+```
+---
+
+## Data Sources & Acknowledgments
+
+- **Glottolog:** Hammarström, Harald & Forkel, Robert & Haspelmath, Martin & Bank, Sebastian. Glottolog. (glottolog.org) – fetched via Wikidata SPARQL.  
+- **URIEL / lang2vec:** Typological vector representations.  
+- **ISO 639:** Language code standards (ISO 639-1, 639-2, 639-3, 639-5).  
+- **CLDR / Wiktionary:** Locale display names, scripts.
+
+---
+
+## Contributing & Issues
+
+[https ://codeberg.org/lahtis/GLFM](https://codeberg.org/lahtis/GLFM)
+
+---
+
+## License
+
+Copyright © 2026 Tuomas Lähteenmäki  
+MIT License. See LICENSE for details.
+
+---
+
+## Key changes
+
+|  # | Section | Change |
+| :---- | :---- | :---- |
+| 1 | Python version | `3.8+` → **`3.9+`** |
+| 2 | Directory Structure | **`src/glfm/` layout** |
+| 3 | Data Structure | **`family: "Finnic"`**, `glottocode: "finn1318"`, `language_type: "L"` |
+| 4 | `nearest_languages` | 5 → **100** (max) |
+| 5 | Pipeline Overview | **12 steps** (incl. `glottolog`, `consumer`) |
+| 6 | CLI | **`python3 -m glfm.run_full_pipeline`** |
+| 7 | Configuration | **`config.toml`**  + env vars |
+| 8 | Requirements | **No core dependencies** (pure stdlib) |
+| 9 | `build_top5.py` | **`build_consumer_dataset.py`** |
+| 10 | "Glottolog future work" | **Glottolog works** (Wikidata) |
+