@mcptoolshop/style-dataset-lab 1.1.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +37 -0
- package/LICENSE +21 -0
- package/README.es.md +142 -0
- package/README.fr.md +142 -0
- package/README.hi.md +142 -0
- package/README.it.md +142 -0
- package/README.ja.md +142 -0
- package/README.md +178 -0
- package/README.pt-BR.md +142 -0
- package/README.zh.md +142 -0
- package/SECURITY.md +28 -0
- package/package.json +45 -0
- package/scripts/bulk-curate-wave2-5.js +138 -0
- package/scripts/bulk-curate-waves11-18.js +413 -0
- package/scripts/canon-bind.js +437 -0
- package/scripts/compare.js +116 -0
- package/scripts/curate-wave25.js +209 -0
- package/scripts/curate.js +136 -0
- package/scripts/generate-controlnet.js +357 -0
- package/scripts/generate-identity.js +633 -0
- package/scripts/generate-ipadapter.js +339 -0
- package/scripts/generate.js +351 -0
- package/scripts/migrate-records.js +147 -0
- package/scripts/painterly-test.js +149 -0
- package/scripts/painterly.js +349 -0
package/CHANGELOG.md
ADDED
|
@@ -0,0 +1,37 @@
|
|
|
1
|
+
# Changelog
|
|
2
|
+
|
|
3
|
+
All notable changes to this project will be documented in this file.
|
|
4
|
+
|
|
5
|
+
## [1.1.0] - 2026-04-14
|
|
6
|
+
|
|
7
|
+
- Monorepo restructure: each game lives in `games/<name>/` with isolated canon, records, and assets
|
|
8
|
+
- All scripts accept `--game <name>` flag (default: `star-freight`)
|
|
9
|
+
- Existing Star Freight data moved to `games/star-freight/`
|
|
10
|
+
- Translations added (7 languages: ja, zh, es, fr, hi, it, pt-BR)
|
|
11
|
+
|
|
12
|
+
## [0.5.0] - 2026-04-14
|
|
13
|
+
|
|
14
|
+
- Identity packet system for waves 27A, 27B, and 28
|
|
15
|
+
- Painterly pipeline for stylized asset generation
|
|
16
|
+
|
|
17
|
+
## [0.4.0] - 2026-03-28
|
|
18
|
+
|
|
19
|
+
- Wave 26: station identities
|
|
20
|
+
- Pairwise comparison tooling for quality ranking
|
|
21
|
+
|
|
22
|
+
## [0.3.0] - 2026-03-15
|
|
23
|
+
|
|
24
|
+
- Wave 25: alien species generation
|
|
25
|
+
- Negative prompt fix (`human` in negative for alien anatomy)
|
|
26
|
+
- Wave 25b: regeneration pass for failed outputs
|
|
27
|
+
|
|
28
|
+
## [0.2.0] - 2026-02-20
|
|
29
|
+
|
|
30
|
+
- Waves 11-24: expanded category coverage
|
|
31
|
+
- Canon binding system linking outputs to design intent
|
|
32
|
+
|
|
33
|
+
## [0.1.0] - 2026-01-10
|
|
34
|
+
|
|
35
|
+
- Initial scaffold and ComfyUI integration
|
|
36
|
+
- Waves 1-10: character costumes (gritty space theme)
|
|
37
|
+
- First export: 570 training units in TRL format
|
package/LICENSE
ADDED
|
@@ -0,0 +1,21 @@
|
|
|
1
|
+
MIT License
|
|
2
|
+
|
|
3
|
+
Copyright (c) 2026 mcp-tool-shop
|
|
4
|
+
|
|
5
|
+
Permission is hereby granted, free of charge, to any person obtaining a copy
|
|
6
|
+
of this software and associated documentation files (the "Software"), to deal
|
|
7
|
+
in the Software without restriction, including without limitation the rights
|
|
8
|
+
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
|
9
|
+
copies of the Software, and to permit persons to whom the Software is
|
|
10
|
+
furnished to do so, subject to the following conditions:
|
|
11
|
+
|
|
12
|
+
The above copyright notice and this permission notice shall be included in all
|
|
13
|
+
copies or substantial portions of the Software.
|
|
14
|
+
|
|
15
|
+
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
|
16
|
+
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
|
17
|
+
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
|
18
|
+
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
|
19
|
+
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
|
20
|
+
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
|
|
21
|
+
SOFTWARE.
|
package/README.es.md
ADDED
|
@@ -0,0 +1,142 @@
|
|
|
1
|
+
<p align="center">
|
|
2
|
+
<a href="README.ja.md">日本語</a> | <a href="README.zh.md">中文</a> | <a href="README.md">English</a> | <a href="README.fr.md">Français</a> | <a href="README.hi.md">हिन्दी</a> | <a href="README.it.md">Italiano</a> | <a href="README.pt-BR.md">Português (BR)</a>
|
|
3
|
+
</p>
|
|
4
|
+
|
|
5
|
+
<p align="center">
|
|
6
|
+
<img src="https://raw.githubusercontent.com/mcp-tool-shop-org/brand/main/logos/style-dataset-lab/readme.png" width="400">
|
|
7
|
+
</p>
|
|
8
|
+
|
|
9
|
+
<p align="center">
|
|
10
|
+
<a href="https://www.npmjs.com/package/@mcptoolshop/style-dataset-lab"><img src="https://img.shields.io/npm/v/@mcptoolshop/style-dataset-lab" alt="npm"></a>
|
|
11
|
+
<a href="LICENSE"><img src="https://img.shields.io/badge/license-MIT-blue" alt="MIT License"></a>
|
|
12
|
+
</p>
|
|
13
|
+
|
|
14
|
+
# style-dataset-lab
|
|
15
|
+
|
|
16
|
+
Factoría de conjuntos de datos visuales: genera, organiza y exporta datos de entrenamiento multimodales para el ajuste fino de modelos de lenguaje visual (VLM).
|
|
17
|
+
|
|
18
|
+
## ¿Qué es esto?
|
|
19
|
+
|
|
20
|
+
Un conjunto de herramientas para construir **"verdad visual" entrenable**. Cada elemento contiene tres cosas:
|
|
21
|
+
|
|
22
|
+
1. **Píxeles de la imagen:** generados por ComfyUI con total trazabilidad (punto de control, LoRA, semilla, muestreador, configuración).
|
|
23
|
+
2. **Explicación canónica:** por qué este elemento está dentro o fuera del estilo, basado en una constitución de estilo.
|
|
24
|
+
3. **Juicio de calidad:** aprobado/rechazado con puntuaciones por dimensión y reglas citadas.
|
|
25
|
+
|
|
26
|
+
La salida se integra con [`@mcptoolshop/repo-dataset`](https://github.com/mcp-tool-shop-org/repo-dataset) para producir datos de entrenamiento multimodales en 10 formatos: TRL, LLaVA, Qwen2-VL, Axolotl, LLaMA-Factory, ShareGPT, pares RLHF, DPO, subtitulado y clasificación.
|
|
27
|
+
|
|
28
|
+
## Modelo de seguridad
|
|
29
|
+
|
|
30
|
+
**Solo local.** style-dataset-lab se comunica con ComfyUI en `localhost:8188` y nunca realiza solicitudes a la red externa. No hay telemetría, ni análisis, ni conexión a servidores externos. La generación de imágenes se realiza completamente en su GPU. Los registros y los datos canónicos permanecen en su sistema de archivos.
|
|
31
|
+
|
|
32
|
+
## Estadísticas del conjunto de datos
|
|
33
|
+
|
|
34
|
+
| Métrica | Valor |
|
|
35
|
+
|--------|-------|
|
|
36
|
+
| Registros organizados | 1,182 |
|
|
37
|
+
| Elementos totales | 2.571 (893 aprobados, 887 variantes con estilo pictórico) |
|
|
38
|
+
| Combinaciones de indicaciones | 28 |
|
|
39
|
+
| Categorías visuales | 18 (disfraces, barcos, interiores, equipos, entornos, especies, estaciones, señalización, iluminación, carga, arquitectura, criaturas, superficies, vida cotidiana, planetario, daño/reparación, biología alienígena, detalles realistas) |
|
|
40
|
+
| Comparaciones por pares | 6 creados por humanos + 71 creados sintéticamente |
|
|
41
|
+
| Tipos de rechazo distintos | 30+ |
|
|
42
|
+
| Sistema de paquetes de identidad | Personajes con nombre con ADN de facción, rango y anclajes visuales. |
|
|
43
|
+
| Formatos de exportación | 10 (a través de `@mcptoolshop/repo-dataset`) |
|
|
44
|
+
|
|
45
|
+
## Instalación
|
|
46
|
+
|
|
47
|
+
```bash
|
|
48
|
+
npm install -g @mcptoolshop/style-dataset-lab
|
|
49
|
+
```
|
|
50
|
+
|
|
51
|
+
Luego, clone un proyecto o inicializa un nuevo espacio de trabajo de conjunto de datos:
|
|
52
|
+
|
|
53
|
+
```bash
|
|
54
|
+
git clone https://github.com/mcp-tool-shop-org/style-dataset-lab my-dataset
|
|
55
|
+
cd my-dataset
|
|
56
|
+
npm install
|
|
57
|
+
```
|
|
58
|
+
|
|
59
|
+
## Flujo de trabajo
|
|
60
|
+
|
|
61
|
+
```bash
|
|
62
|
+
# 1. Start ComfyUI
|
|
63
|
+
# (point it at your checkpoint + LoRA setup)
|
|
64
|
+
|
|
65
|
+
# 2. Generate candidates from a prompt pack
|
|
66
|
+
npm run generate -- inputs/prompts/wave1.json
|
|
67
|
+
npm run generate -- inputs/prompts/wave1.json --dry-run
|
|
68
|
+
|
|
69
|
+
# 3. Generate identity-packet characters
|
|
70
|
+
npm run generate:identity -- inputs/identity-packets/wave27a-identity-spine.json
|
|
71
|
+
|
|
72
|
+
# 4. Generate painterly variants of approved assets
|
|
73
|
+
npm run painterly -- <asset_id>
|
|
74
|
+
|
|
75
|
+
# 5. Curate -- approve, reject, or mark borderline
|
|
76
|
+
npm run curate -- <asset_id> approved "explanation" --scores "silhouette:0.9,palette:0.8"
|
|
77
|
+
npm run curate -- <asset_id> rejected "explanation" --failures "too_clean,wrong_material"
|
|
78
|
+
|
|
79
|
+
# 6. Bind canon explanations to assets
|
|
80
|
+
npm run canon-bind -- <asset_id>
|
|
81
|
+
|
|
82
|
+
# 7. Record pairwise comparisons
|
|
83
|
+
npm run compare -- <asset_a> <asset_b> a "A has better faction read because..."
|
|
84
|
+
|
|
85
|
+
# 8. Export training data via repo-dataset
|
|
86
|
+
npm run export
|
|
87
|
+
npm run inspect
|
|
88
|
+
npm run validate
|
|
89
|
+
```
|
|
90
|
+
|
|
91
|
+
## Estructura de directorios
|
|
92
|
+
|
|
93
|
+
```
|
|
94
|
+
canon/ Style constitution, review rubric, identity gates, species canon
|
|
95
|
+
inputs/
|
|
96
|
+
prompts/ Prompt packs per wave (JSON: subjects, variations, defaults)
|
|
97
|
+
references/ IP-Adapter reference images
|
|
98
|
+
control/ ControlNet control images
|
|
99
|
+
control-guides/ ControlNet guide overlays
|
|
100
|
+
identity-packets/ Named character identity spines (faction DNA, rank, visual anchors)
|
|
101
|
+
outputs/
|
|
102
|
+
candidates/ Raw generations (gitignored)
|
|
103
|
+
approved/ Curated approved (gitignored)
|
|
104
|
+
rejected/ Curated rejected (gitignored)
|
|
105
|
+
borderline/ Curated borderline (gitignored)
|
|
106
|
+
painterly/ Painterly-style variants (gitignored)
|
|
107
|
+
records/ Per-asset JSON (provenance + judgment + canon binding)
|
|
108
|
+
comparisons/ A-vs-B preference judgments
|
|
109
|
+
exports/ repo-dataset output (gitignored)
|
|
110
|
+
scripts/ generate, curate, compare, canon-bind, painterly, identity gen
|
|
111
|
+
workflows/ Reusable ComfyUI workflow templates
|
|
112
|
+
```
|
|
113
|
+
|
|
114
|
+
## Configuración de generación
|
|
115
|
+
|
|
116
|
+
```yaml
|
|
117
|
+
checkpoint: dreamshaperXL_v21TurboDPMSDE.safetensors
|
|
118
|
+
lora: classipeintxl_v21.safetensors (weight: 1.0)
|
|
119
|
+
resolution: 1024x1024
|
|
120
|
+
steps: 8
|
|
121
|
+
cfg: 2.0
|
|
122
|
+
sampler: dpmpp_sde
|
|
123
|
+
scheduler: karras
|
|
124
|
+
speed: ~9s per image (RTX 5080)
|
|
125
|
+
```
|
|
126
|
+
|
|
127
|
+
Modos de generación adicionales: ControlNet (guiado por pose/profundidad), IP-Adapter (guiado por referencia) y paquetes de identidad (consistencia de personajes con nombre).
|
|
128
|
+
|
|
129
|
+
## Requisitos
|
|
130
|
+
|
|
131
|
+
- [ComfyUI](https://github.com/comfyanonymous/ComfyUI) ejecutándose en localhost:8188
|
|
132
|
+
- Punto de control DreamShaper XL Turbo + LoRA ClassipeintXL
|
|
133
|
+
- Node.js 20+
|
|
134
|
+
- [`@mcptoolshop/repo-dataset`](https://github.com/mcp-tool-shop-org/repo-dataset) para la exportación de entrenamiento.
|
|
135
|
+
|
|
136
|
+
## Licencia
|
|
137
|
+
|
|
138
|
+
MIT
|
|
139
|
+
|
|
140
|
+
---
|
|
141
|
+
|
|
142
|
+
Creado por <a href="https://mcp-tool-shop.github.io/">MCP Tool Shop</a>
|
package/README.fr.md
ADDED
|
@@ -0,0 +1,142 @@
|
|
|
1
|
+
<p align="center">
|
|
2
|
+
<a href="README.ja.md">日本語</a> | <a href="README.zh.md">中文</a> | <a href="README.es.md">Español</a> | <a href="README.md">English</a> | <a href="README.hi.md">हिन्दी</a> | <a href="README.it.md">Italiano</a> | <a href="README.pt-BR.md">Português (BR)</a>
|
|
3
|
+
</p>
|
|
4
|
+
|
|
5
|
+
<p align="center">
|
|
6
|
+
<img src="https://raw.githubusercontent.com/mcp-tool-shop-org/brand/main/logos/style-dataset-lab/readme.png" width="400">
|
|
7
|
+
</p>
|
|
8
|
+
|
|
9
|
+
<p align="center">
|
|
10
|
+
<a href="https://www.npmjs.com/package/@mcptoolshop/style-dataset-lab"><img src="https://img.shields.io/npm/v/@mcptoolshop/style-dataset-lab" alt="npm"></a>
|
|
11
|
+
<a href="LICENSE"><img src="https://img.shields.io/badge/license-MIT-blue" alt="MIT License"></a>
|
|
12
|
+
</p>
|
|
13
|
+
|
|
14
|
+
# style-dataset-lab
|
|
15
|
+
|
|
16
|
+
Fabrique de jeux de données visuels : génère, organise et exporte des données d'entraînement multimodales pour l'affinage des modèles de langage visuels (VLM).
|
|
17
|
+
|
|
18
|
+
## Qu'est-ce que c'est ?
|
|
19
|
+
|
|
20
|
+
Une boîte à outils pour créer une **vérité visuelle entraînable**. Chaque élément contient trois informations :
|
|
21
|
+
|
|
22
|
+
1. **Pixels de l'image** : générés par ComfyUI avec une traçabilité complète (point de contrôle, LoRA, graine, échantillonneur, cfg).
|
|
23
|
+
2. **Explication canonique** : pourquoi cet élément est conforme ou non au style, basé sur une constitution du style.
|
|
24
|
+
3. **Jugement de qualité** : approuvé/refusé avec des scores par dimension et des règles citées.
|
|
25
|
+
|
|
26
|
+
La sortie est intégrée à [`@mcptoolshop/repo-dataset`](https://github.com/mcp-tool-shop-org/repo-dataset) pour produire des données d'entraînement multimodales dans 10 formats : TRL, LLaVA, Qwen2-VL, Axolotl, LLaMA-Factory, ShareGPT, paires RLHF, DPO, légende et classification.
|
|
27
|
+
|
|
28
|
+
## Modèle de sécurité
|
|
29
|
+
|
|
30
|
+
**Uniquement local.** style-dataset-lab communique avec ComfyUI sur `localhost:8188` et ne fait jamais de requêtes réseau externes. Pas de télémétrie, pas d'analyses, pas de communication avec un serveur distant. La génération d'images se fait entièrement sur votre GPU. Les enregistrements et les données canoniques restent sur votre système de fichiers.
|
|
31
|
+
|
|
32
|
+
## Statistiques du jeu de données
|
|
33
|
+
|
|
34
|
+
| Métrique | Valeur |
|
|
35
|
+
|--------|-------|
|
|
36
|
+
| Enregistrements organisés | 1,182 |
|
|
37
|
+
| Nombre total d'éléments | 2 571 (893 approuvés, 887 variantes picturales) |
|
|
38
|
+
| Séquences de prompts | 28 |
|
|
39
|
+
| Catégories visuelles | 18 (costumes, bateaux, intérieurs, équipements, environnements, espèces, stations, signalisation, éclairage, cargaison, architecture, créatures, surfaces, vie quotidienne, planétaire, dommages/réparations, biologie extraterrestre, détails de vie) |
|
|
40
|
+
| Comparaisons par paires | 6 réalisées par des humains + 71 synthétiques |
|
|
41
|
+
| Types de refus distincts | 30+ |
|
|
42
|
+
| Système de paquets d'identité | Personnages nommés avec ADN de faction, grade et ancres visuelles. |
|
|
43
|
+
| Formats d'exportation | 10 (via @mcptoolshop/repo-dataset) |
|
|
44
|
+
|
|
45
|
+
## Installation
|
|
46
|
+
|
|
47
|
+
```bash
|
|
48
|
+
npm install -g @mcptoolshop/style-dataset-lab
|
|
49
|
+
```
|
|
50
|
+
|
|
51
|
+
Clonez ensuite un projet ou initialisez un nouvel espace de travail de jeu de données :
|
|
52
|
+
|
|
53
|
+
```bash
|
|
54
|
+
git clone https://github.com/mcp-tool-shop-org/style-dataset-lab my-dataset
|
|
55
|
+
cd my-dataset
|
|
56
|
+
npm install
|
|
57
|
+
```
|
|
58
|
+
|
|
59
|
+
## Flux de travail
|
|
60
|
+
|
|
61
|
+
```bash
|
|
62
|
+
# 1. Start ComfyUI
|
|
63
|
+
# (point it at your checkpoint + LoRA setup)
|
|
64
|
+
|
|
65
|
+
# 2. Generate candidates from a prompt pack
|
|
66
|
+
npm run generate -- inputs/prompts/wave1.json
|
|
67
|
+
npm run generate -- inputs/prompts/wave1.json --dry-run
|
|
68
|
+
|
|
69
|
+
# 3. Generate identity-packet characters
|
|
70
|
+
npm run generate:identity -- inputs/identity-packets/wave27a-identity-spine.json
|
|
71
|
+
|
|
72
|
+
# 4. Generate painterly variants of approved assets
|
|
73
|
+
npm run painterly -- <asset_id>
|
|
74
|
+
|
|
75
|
+
# 5. Curate -- approve, reject, or mark borderline
|
|
76
|
+
npm run curate -- <asset_id> approved "explanation" --scores "silhouette:0.9,palette:0.8"
|
|
77
|
+
npm run curate -- <asset_id> rejected "explanation" --failures "too_clean,wrong_material"
|
|
78
|
+
|
|
79
|
+
# 6. Bind canon explanations to assets
|
|
80
|
+
npm run canon-bind -- <asset_id>
|
|
81
|
+
|
|
82
|
+
# 7. Record pairwise comparisons
|
|
83
|
+
npm run compare -- <asset_a> <asset_b> a "A has better faction read because..."
|
|
84
|
+
|
|
85
|
+
# 8. Export training data via repo-dataset
|
|
86
|
+
npm run export
|
|
87
|
+
npm run inspect
|
|
88
|
+
npm run validate
|
|
89
|
+
```
|
|
90
|
+
|
|
91
|
+
## Structure des répertoires
|
|
92
|
+
|
|
93
|
+
```
|
|
94
|
+
canon/ Style constitution, review rubric, identity gates, species canon
|
|
95
|
+
inputs/
|
|
96
|
+
prompts/ Prompt packs per wave (JSON: subjects, variations, defaults)
|
|
97
|
+
references/ IP-Adapter reference images
|
|
98
|
+
control/ ControlNet control images
|
|
99
|
+
control-guides/ ControlNet guide overlays
|
|
100
|
+
identity-packets/ Named character identity spines (faction DNA, rank, visual anchors)
|
|
101
|
+
outputs/
|
|
102
|
+
candidates/ Raw generations (gitignored)
|
|
103
|
+
approved/ Curated approved (gitignored)
|
|
104
|
+
rejected/ Curated rejected (gitignored)
|
|
105
|
+
borderline/ Curated borderline (gitignored)
|
|
106
|
+
painterly/ Painterly-style variants (gitignored)
|
|
107
|
+
records/ Per-asset JSON (provenance + judgment + canon binding)
|
|
108
|
+
comparisons/ A-vs-B preference judgments
|
|
109
|
+
exports/ repo-dataset output (gitignored)
|
|
110
|
+
scripts/ generate, curate, compare, canon-bind, painterly, identity gen
|
|
111
|
+
workflows/ Reusable ComfyUI workflow templates
|
|
112
|
+
```
|
|
113
|
+
|
|
114
|
+
## Configuration de la génération
|
|
115
|
+
|
|
116
|
+
```yaml
|
|
117
|
+
checkpoint: dreamshaperXL_v21TurboDPMSDE.safetensors
|
|
118
|
+
lora: classipeintxl_v21.safetensors (weight: 1.0)
|
|
119
|
+
resolution: 1024x1024
|
|
120
|
+
steps: 8
|
|
121
|
+
cfg: 2.0
|
|
122
|
+
sampler: dpmpp_sde
|
|
123
|
+
scheduler: karras
|
|
124
|
+
speed: ~9s per image (RTX 5080)
|
|
125
|
+
```
|
|
126
|
+
|
|
127
|
+
Modes de génération supplémentaires : ControlNet (guidé par la pose/la profondeur), IP-Adapter (guidé par une référence) et paquets d'identité (cohérence des personnages nommés).
|
|
128
|
+
|
|
129
|
+
## Prérequis
|
|
130
|
+
|
|
131
|
+
- [ComfyUI](https://github.com/comfyanonymous/ComfyUI) en cours d'exécution sur localhost:8188
|
|
132
|
+
- Point de contrôle DreamShaper XL Turbo + LoRA ClassipeintXL
|
|
133
|
+
- Node.js 20+
|
|
134
|
+
- [`@mcptoolshop/repo-dataset`](https://github.com/mcp-tool-shop-org/repo-dataset) pour l'exportation des données d'entraînement
|
|
135
|
+
|
|
136
|
+
## Licence
|
|
137
|
+
|
|
138
|
+
MIT
|
|
139
|
+
|
|
140
|
+
---
|
|
141
|
+
|
|
142
|
+
Créé par <a href="https://mcp-tool-shop.github.io/">MCP Tool Shop</a>
|
package/README.hi.md
ADDED
|
@@ -0,0 +1,142 @@
|
|
|
1
|
+
<p align="center">
|
|
2
|
+
<a href="README.ja.md">日本語</a> | <a href="README.zh.md">中文</a> | <a href="README.es.md">Español</a> | <a href="README.fr.md">Français</a> | <a href="README.md">English</a> | <a href="README.it.md">Italiano</a> | <a href="README.pt-BR.md">Português (BR)</a>
|
|
3
|
+
</p>
|
|
4
|
+
|
|
5
|
+
<p align="center">
|
|
6
|
+
<img src="https://raw.githubusercontent.com/mcp-tool-shop-org/brand/main/logos/style-dataset-lab/readme.png" width="400">
|
|
7
|
+
</p>
|
|
8
|
+
|
|
9
|
+
<p align="center">
|
|
10
|
+
<a href="https://www.npmjs.com/package/@mcptoolshop/style-dataset-lab"><img src="https://img.shields.io/npm/v/@mcptoolshop/style-dataset-lab" alt="npm"></a>
|
|
11
|
+
<a href="LICENSE"><img src="https://img.shields.io/badge/license-MIT-blue" alt="MIT License"></a>
|
|
12
|
+
</p>
|
|
13
|
+
|
|
14
|
+
# style-dataset-lab
|
|
15
|
+
|
|
16
|
+
विज़ुअल डेटासेट फैक्ट्री -- वीएलएम (VLM) के फाइन-ट्यूनिंग के लिए मल्टीमॉडल प्रशिक्षण डेटा उत्पन्न करें, क्यूरेट करें और निर्यात करें।
|
|
17
|
+
|
|
18
|
+
## यह क्या है
|
|
19
|
+
|
|
20
|
+
यह एक टूलकिट है जिसका उपयोग "**प्रशिक्षण योग्य दृश्य सत्य**" बनाने के लिए किया जाता है। प्रत्येक एसेट में तीन चीजें होती हैं:
|
|
21
|
+
|
|
22
|
+
1. **इमेज पिक्सेल** -- ComfyUI द्वारा उत्पन्न, जिसमें पूर्ण जानकारी (चेकपॉइंट, LoRA, सीड, सैंपलर, cfg) शामिल है।
|
|
23
|
+
2. **मानक व्याख्या** -- यह क्यों 'ऑन-स्टाइल' या 'ऑफ-स्टाइल' है, जो एक 'स्टाइल संविधान' पर आधारित है।
|
|
24
|
+
3. **गुणवत्ता मूल्यांकन** -- स्वीकृत/अस्वीकृत, जिसमें प्रत्येक आयाम के लिए स्कोर और संदर्भित नियम शामिल हैं।
|
|
25
|
+
|
|
26
|
+
आउटपुट [`@mcptoolshop/repo-dataset`](https://github.com/mcp-tool-shop-org/repo-dataset) में जाता है ताकि 10 प्रारूपों में मल्टीमॉडल प्रशिक्षण डेटा उत्पन्न किया जा सके: TRL, LLaVA, Qwen2-VL, Axolotl, LLaMA-Factory, ShareGPT, RLHF जोड़े, DPO, कैप्शनिंग और वर्गीकरण।
|
|
27
|
+
|
|
28
|
+
## सुरक्षा मॉडल
|
|
29
|
+
|
|
30
|
+
**केवल स्थानीय।** style-dataset-lab, `localhost:8188` पर ComfyUI से संवाद करता है और कभी भी बाहरी नेटवर्क अनुरोध नहीं करता है। कोई टेलीमेट्री नहीं, कोई विश्लेषण नहीं, कोई डेटा संग्रह नहीं। इमेज जेनरेशन पूरी तरह से आपके GPU पर होता है। रिकॉर्ड और अन्य डेटा आपके फ़ाइल सिस्टम पर ही रहते हैं।
|
|
31
|
+
|
|
32
|
+
## डेटासेट आँकड़े
|
|
33
|
+
|
|
34
|
+
| मेट्रिक | मान |
|
|
35
|
+
|--------|-------|
|
|
36
|
+
| क्यूरेट किए गए रिकॉर्ड | 1,182 |
|
|
37
|
+
| कुल एसेट | 2,571 (893 स्वीकृत, 887 'पेंटरली' वेरिएंट) |
|
|
38
|
+
| प्रॉम्प्ट वेव्स | 28 |
|
|
39
|
+
| विज़ुअल श्रेणियां | 18 (पोशाक, जहाज, आंतरिक भाग, उपकरण, वातावरण, प्रजातियां, स्टेशन, संकेत, प्रकाश, माल, आर्किटेक्चर, जीव, सतह, दैनिक जीवन, ग्रह, क्षति/मरम्मत, एलियन जीव विज्ञान, वास्तविक विवरण) |
|
|
40
|
+
| जोड़े में तुलनाएं | 6 मानव + 71 सिंथेटिक |
|
|
41
|
+
| विभिन्न अस्वीकृति प्रकार | 30+ |
|
|
42
|
+
| पहचान पैकेज सिस्टम | नाम वाले पात्र, जिनमें गुट (faction) की जानकारी, रैंक और दृश्य संबंधी विशेषताएं शामिल हैं। |
|
|
43
|
+
| निर्यात प्रारूप | 10 ( `@mcptoolshop/repo-dataset` के माध्यम से) |
|
|
44
|
+
|
|
45
|
+
## इंस्टॉल करें
|
|
46
|
+
|
|
47
|
+
```bash
|
|
48
|
+
npm install -g @mcptoolshop/style-dataset-lab
|
|
49
|
+
```
|
|
50
|
+
|
|
51
|
+
फिर एक प्रोजेक्ट को क्लोन करें या एक नया डेटासेट वर्कस्पेस इनिशियलाइज़ करें:
|
|
52
|
+
|
|
53
|
+
```bash
|
|
54
|
+
git clone https://github.com/mcp-tool-shop-org/style-dataset-lab my-dataset
|
|
55
|
+
cd my-dataset
|
|
56
|
+
npm install
|
|
57
|
+
```
|
|
58
|
+
|
|
59
|
+
## वर्कफ़्लो
|
|
60
|
+
|
|
61
|
+
```bash
|
|
62
|
+
# 1. Start ComfyUI
|
|
63
|
+
# (point it at your checkpoint + LoRA setup)
|
|
64
|
+
|
|
65
|
+
# 2. Generate candidates from a prompt pack
|
|
66
|
+
npm run generate -- inputs/prompts/wave1.json
|
|
67
|
+
npm run generate -- inputs/prompts/wave1.json --dry-run
|
|
68
|
+
|
|
69
|
+
# 3. Generate identity-packet characters
|
|
70
|
+
npm run generate:identity -- inputs/identity-packets/wave27a-identity-spine.json
|
|
71
|
+
|
|
72
|
+
# 4. Generate painterly variants of approved assets
|
|
73
|
+
npm run painterly -- <asset_id>
|
|
74
|
+
|
|
75
|
+
# 5. Curate -- approve, reject, or mark borderline
|
|
76
|
+
npm run curate -- <asset_id> approved "explanation" --scores "silhouette:0.9,palette:0.8"
|
|
77
|
+
npm run curate -- <asset_id> rejected "explanation" --failures "too_clean,wrong_material"
|
|
78
|
+
|
|
79
|
+
# 6. Bind canon explanations to assets
|
|
80
|
+
npm run canon-bind -- <asset_id>
|
|
81
|
+
|
|
82
|
+
# 7. Record pairwise comparisons
|
|
83
|
+
npm run compare -- <asset_a> <asset_b> a "A has better faction read because..."
|
|
84
|
+
|
|
85
|
+
# 8. Export training data via repo-dataset
|
|
86
|
+
npm run export
|
|
87
|
+
npm run inspect
|
|
88
|
+
npm run validate
|
|
89
|
+
```
|
|
90
|
+
|
|
91
|
+
## डायरेक्टरी संरचना
|
|
92
|
+
|
|
93
|
+
```
|
|
94
|
+
canon/ Style constitution, review rubric, identity gates, species canon
|
|
95
|
+
inputs/
|
|
96
|
+
prompts/ Prompt packs per wave (JSON: subjects, variations, defaults)
|
|
97
|
+
references/ IP-Adapter reference images
|
|
98
|
+
control/ ControlNet control images
|
|
99
|
+
control-guides/ ControlNet guide overlays
|
|
100
|
+
identity-packets/ Named character identity spines (faction DNA, rank, visual anchors)
|
|
101
|
+
outputs/
|
|
102
|
+
candidates/ Raw generations (gitignored)
|
|
103
|
+
approved/ Curated approved (gitignored)
|
|
104
|
+
rejected/ Curated rejected (gitignored)
|
|
105
|
+
borderline/ Curated borderline (gitignored)
|
|
106
|
+
painterly/ Painterly-style variants (gitignored)
|
|
107
|
+
records/ Per-asset JSON (provenance + judgment + canon binding)
|
|
108
|
+
comparisons/ A-vs-B preference judgments
|
|
109
|
+
exports/ repo-dataset output (gitignored)
|
|
110
|
+
scripts/ generate, curate, compare, canon-bind, painterly, identity gen
|
|
111
|
+
workflows/ Reusable ComfyUI workflow templates
|
|
112
|
+
```
|
|
113
|
+
|
|
114
|
+
## जेनरेशन सेटअप
|
|
115
|
+
|
|
116
|
+
```yaml
|
|
117
|
+
checkpoint: dreamshaperXL_v21TurboDPMSDE.safetensors
|
|
118
|
+
lora: classipeintxl_v21.safetensors (weight: 1.0)
|
|
119
|
+
resolution: 1024x1024
|
|
120
|
+
steps: 8
|
|
121
|
+
cfg: 2.0
|
|
122
|
+
sampler: dpmpp_sde
|
|
123
|
+
scheduler: karras
|
|
124
|
+
speed: ~9s per image (RTX 5080)
|
|
125
|
+
```
|
|
126
|
+
|
|
127
|
+
अतिरिक्त जेनरेशन मोड: ControlNet (पोज़/गहराई-निर्देशित), IP-Adapter (संदर्भ-निर्देशित), और पहचान पैकेज (नाम वाले पात्रों की निरंतरता)।
|
|
128
|
+
|
|
129
|
+
## आवश्यकताएं
|
|
130
|
+
|
|
131
|
+
- `localhost:8188` पर चलने वाला [ComfyUI](https://github.com/comfyanonymous/ComfyUI)
|
|
132
|
+
- DreamShaper XL Turbo चेकपॉइंट + ClassipeintXL LoRA
|
|
133
|
+
- Node.js 20+
|
|
134
|
+
- प्रशिक्षण के लिए निर्यात के लिए [`@mcptoolshop/repo-dataset`](https://github.com/mcp-tool-shop-org/repo-dataset)
|
|
135
|
+
|
|
136
|
+
## लाइसेंस
|
|
137
|
+
|
|
138
|
+
MIT
|
|
139
|
+
|
|
140
|
+
---
|
|
141
|
+
|
|
142
|
+
<a href="https://mcp-tool-shop.github.io/">MCP Tool Shop</a> द्वारा निर्मित।
|
package/README.it.md
ADDED
|
@@ -0,0 +1,142 @@
|
|
|
1
|
+
<p align="center">
|
|
2
|
+
<a href="README.ja.md">日本語</a> | <a href="README.zh.md">中文</a> | <a href="README.es.md">Español</a> | <a href="README.fr.md">Français</a> | <a href="README.hi.md">हिन्दी</a> | <a href="README.md">English</a> | <a href="README.pt-BR.md">Português (BR)</a>
|
|
3
|
+
</p>
|
|
4
|
+
|
|
5
|
+
<p align="center">
|
|
6
|
+
<img src="https://raw.githubusercontent.com/mcp-tool-shop-org/brand/main/logos/style-dataset-lab/readme.png" width="400">
|
|
7
|
+
</p>
|
|
8
|
+
|
|
9
|
+
<p align="center">
|
|
10
|
+
<a href="https://www.npmjs.com/package/@mcptoolshop/style-dataset-lab"><img src="https://img.shields.io/npm/v/@mcptoolshop/style-dataset-lab" alt="npm"></a>
|
|
11
|
+
<a href="LICENSE"><img src="https://img.shields.io/badge/license-MIT-blue" alt="MIT License"></a>
|
|
12
|
+
</p>
|
|
13
|
+
|
|
14
|
+
# style-dataset-lab
|
|
15
|
+
|
|
16
|
+
Strumento per la creazione di dataset visivi: genera, organizza ed esporta dati di training multimodali per l'affinamento di modelli di visione e linguaggio (VLM).
|
|
17
|
+
|
|
18
|
+
## Cos'è questo
|
|
19
|
+
|
|
20
|
+
Un toolkit per creare una "verità visiva" addestrabile. Ogni elemento contiene tre informazioni:
|
|
21
|
+
|
|
22
|
+
1. **Pixel dell'immagine** -- generati da ComfyUI con informazioni complete sulla provenienza (checkpoint, LoRA, seed, sampler, cfg).
|
|
23
|
+
2. **Spiegazione canonica** -- perché questo elemento è conforme o non conforme allo stile, basata su una "costituzione" dello stile.
|
|
24
|
+
3. **Valutazione della qualità** -- approvato/rifiutato con punteggi per ogni dimensione e regole citate.
|
|
25
|
+
|
|
26
|
+
L'output viene utilizzato da [`@mcptoolshop/repo-dataset`](https://github.com/mcp-tool-shop-org/repo-dataset) per creare dati di training multimodali in 10 formati: TRL, LLaVA, Qwen2-VL, Axolotl, LLaMA-Factory, ShareGPT, coppie RLHF, DPO, didascalie e classificazione.
|
|
27
|
+
|
|
28
|
+
## Modello di sicurezza
|
|
29
|
+
|
|
30
|
+
**Solo locale.** style-dataset-lab comunica con ComfyUI su `localhost:8188` e non effettua richieste alla rete esterna. Nessuna telemetria, nessuna analisi, nessuna trasmissione di dati. La generazione delle immagini avviene interamente sulla tua GPU. I dati e le informazioni canoniche rimangono sul tuo filesystem.
|
|
31
|
+
|
|
32
|
+
## Statistiche del dataset
|
|
33
|
+
|
|
34
|
+
| Metrica | Valore |
|
|
35
|
+
|--------|-------|
|
|
36
|
+
| Elementi curati | 1,182 |
|
|
37
|
+
| Elementi totali | 2.571 (893 approvati, 887 varianti pittoriche) |
|
|
38
|
+
| Prompt utilizzati | 28 |
|
|
39
|
+
| Categorie visive | 18 (costumi, navi, interni, attrezzature, ambienti, specie, stazioni, segnaletica, illuminazione, carico, architettura, creature, superfici, vita quotidiana, pianeti, danni/riparazioni, biologia aliena, dettagli di ambienti vissuti) |
|
|
40
|
+
| Confronti a coppie | 6 creati da umani + 71 creati sinteticamente |
|
|
41
|
+
| Tipi di rifiuto distinti | 30+ |
|
|
42
|
+
| Sistema di "identity packet" | Personaggi nominati con DNA della fazione, grado e riferimenti visivi. |
|
|
43
|
+
| Formati di esportazione | 10 (tramite @mcptoolshop/repo-dataset) |
|
|
44
|
+
|
|
45
|
+
## Installazione
|
|
46
|
+
|
|
47
|
+
```bash
|
|
48
|
+
npm install -g @mcptoolshop/style-dataset-lab
|
|
49
|
+
```
|
|
50
|
+
|
|
51
|
+
Successivamente, clona un progetto o inizializza un nuovo spazio di lavoro per il dataset:
|
|
52
|
+
|
|
53
|
+
```bash
|
|
54
|
+
git clone https://github.com/mcp-tool-shop-org/style-dataset-lab my-dataset
|
|
55
|
+
cd my-dataset
|
|
56
|
+
npm install
|
|
57
|
+
```
|
|
58
|
+
|
|
59
|
+
## Flusso di lavoro
|
|
60
|
+
|
|
61
|
+
```bash
|
|
62
|
+
# 1. Start ComfyUI
|
|
63
|
+
# (point it at your checkpoint + LoRA setup)
|
|
64
|
+
|
|
65
|
+
# 2. Generate candidates from a prompt pack
|
|
66
|
+
npm run generate -- inputs/prompts/wave1.json
|
|
67
|
+
npm run generate -- inputs/prompts/wave1.json --dry-run
|
|
68
|
+
|
|
69
|
+
# 3. Generate identity-packet characters
|
|
70
|
+
npm run generate:identity -- inputs/identity-packets/wave27a-identity-spine.json
|
|
71
|
+
|
|
72
|
+
# 4. Generate painterly variants of approved assets
|
|
73
|
+
npm run painterly -- <asset_id>
|
|
74
|
+
|
|
75
|
+
# 5. Curate -- approve, reject, or mark borderline
|
|
76
|
+
npm run curate -- <asset_id> approved "explanation" --scores "silhouette:0.9,palette:0.8"
|
|
77
|
+
npm run curate -- <asset_id> rejected "explanation" --failures "too_clean,wrong_material"
|
|
78
|
+
|
|
79
|
+
# 6. Bind canon explanations to assets
|
|
80
|
+
npm run canon-bind -- <asset_id>
|
|
81
|
+
|
|
82
|
+
# 7. Record pairwise comparisons
|
|
83
|
+
npm run compare -- <asset_a> <asset_b> a "A has better faction read because..."
|
|
84
|
+
|
|
85
|
+
# 8. Export training data via repo-dataset
|
|
86
|
+
npm run export
|
|
87
|
+
npm run inspect
|
|
88
|
+
npm run validate
|
|
89
|
+
```
|
|
90
|
+
|
|
91
|
+
## Struttura delle directory
|
|
92
|
+
|
|
93
|
+
```
|
|
94
|
+
canon/ Style constitution, review rubric, identity gates, species canon
|
|
95
|
+
inputs/
|
|
96
|
+
prompts/ Prompt packs per wave (JSON: subjects, variations, defaults)
|
|
97
|
+
references/ IP-Adapter reference images
|
|
98
|
+
control/ ControlNet control images
|
|
99
|
+
control-guides/ ControlNet guide overlays
|
|
100
|
+
identity-packets/ Named character identity spines (faction DNA, rank, visual anchors)
|
|
101
|
+
outputs/
|
|
102
|
+
candidates/ Raw generations (gitignored)
|
|
103
|
+
approved/ Curated approved (gitignored)
|
|
104
|
+
rejected/ Curated rejected (gitignored)
|
|
105
|
+
borderline/ Curated borderline (gitignored)
|
|
106
|
+
painterly/ Painterly-style variants (gitignored)
|
|
107
|
+
records/ Per-asset JSON (provenance + judgment + canon binding)
|
|
108
|
+
comparisons/ A-vs-B preference judgments
|
|
109
|
+
exports/ repo-dataset output (gitignored)
|
|
110
|
+
scripts/ generate, curate, compare, canon-bind, painterly, identity gen
|
|
111
|
+
workflows/ Reusable ComfyUI workflow templates
|
|
112
|
+
```
|
|
113
|
+
|
|
114
|
+
## Configurazione della generazione
|
|
115
|
+
|
|
116
|
+
```yaml
|
|
117
|
+
checkpoint: dreamshaperXL_v21TurboDPMSDE.safetensors
|
|
118
|
+
lora: classipeintxl_v21.safetensors (weight: 1.0)
|
|
119
|
+
resolution: 1024x1024
|
|
120
|
+
steps: 8
|
|
121
|
+
cfg: 2.0
|
|
122
|
+
sampler: dpmpp_sde
|
|
123
|
+
scheduler: karras
|
|
124
|
+
speed: ~9s per image (RTX 5080)
|
|
125
|
+
```
|
|
126
|
+
|
|
127
|
+
Modalità di generazione aggiuntive: ControlNet (guidato da posa/profondità), IP-Adapter (guidato da riferimento) e "identity packets" (coerenza dei personaggi nominati).
|
|
128
|
+
|
|
129
|
+
## Requisiti
|
|
130
|
+
|
|
131
|
+
- [ComfyUI](https://github.com/comfyanonymous/ComfyUI) in esecuzione su localhost:8188
|
|
132
|
+
- Checkpoint DreamShaper XL Turbo + LoRA ClassipeintXL
|
|
133
|
+
- Node.js 20+
|
|
134
|
+
- [`@mcptoolshop/repo-dataset`](https://github.com/mcp-tool-shop-org/repo-dataset) per l'esportazione dei dati di training
|
|
135
|
+
|
|
136
|
+
## Licenza
|
|
137
|
+
|
|
138
|
+
MIT
|
|
139
|
+
|
|
140
|
+
---
|
|
141
|
+
|
|
142
|
+
Creato da <a href="https://mcp-tool-shop.github.io/">MCP Tool Shop</a
|