@relipa/ai-flow-kit 0.2.0 → 0.2.1

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (38) hide show
  1. package/custom/rules/java/spring-boot-rules.md +209 -0
  2. package/custom/rules/javascript/nestjs-examples.md +41 -0
  3. package/custom/rules/javascript/nestjs-rules.md +42 -0
  4. package/custom/rules/javascript/nodejs-express-examples.md +35 -0
  5. package/custom/rules/javascript/nodejs-express-rules.md +49 -0
  6. package/custom/rules/javascript/reactjs-examples.md +380 -0
  7. package/custom/rules/javascript/reactjs-rules.md +173 -0
  8. package/custom/rules/php/php-examples.md +161 -0
  9. package/custom/rules/php/php-rules.md +127 -0
  10. package/custom/rules/python/python-django-examples.md +34 -0
  11. package/custom/rules/python/python-django-rules.md +48 -0
  12. package/custom/rules/python/python-examples.md +32 -0
  13. package/custom/rules/python/python-fastapi-examples.md +30 -0
  14. package/custom/rules/python/python-fastapi-rules.md +35 -0
  15. package/custom/rules/python/python-ml-examples.md +187 -0
  16. package/custom/rules/python/python-ml-rules.md +121 -0
  17. package/custom/rules/python/python-rules.md +58 -0
  18. package/custom/skills/ba-skills/skill-ba-qna-template-v1.md +4 -4
  19. package/custom/skills/ba-skills/skill-ba-qna-v1.md +6 -0
  20. package/custom/skills/create-system-requirement/SKILL.md +52 -16
  21. package/custom/skills/create-system-requirement/system-requirement-template-v1.md +128 -0
  22. package/custom/skills/impact-analysis/SKILL.md +106 -106
  23. package/custom/skills/report-customer/SKILL.md +99 -99
  24. package/custom/templates/nestjs.md +5 -72
  25. package/custom/templates/nodejs-express.md +5 -73
  26. package/custom/templates/php-plain.md +5 -261
  27. package/custom/templates/php.md +5 -261
  28. package/custom/templates/python-django.md +5 -71
  29. package/custom/templates/python-fastapi.md +5 -54
  30. package/custom/templates/python-ml.md +1 -269
  31. package/custom/templates/python.md +5 -79
  32. package/custom/templates/reactjs.md +5 -492
  33. package/custom/templates/shared/gate-workflow.md +1 -0
  34. package/custom/templates/shared/ml-gate-workflow.md +1 -0
  35. package/custom/templates/spring-boot.md +5 -224
  36. package/docs/common/CHANGELOG.md +20 -10
  37. package/package.json +1 -1
  38. package/scripts/init.js +143 -40
@@ -1,261 +1,5 @@
1
- # PHP AI System Prompt
2
-
3
- You are an expert PHP developer working with plain PHP (no framework). Follow these rules to produce clean, secure, maintainable code.
4
-
5
- ---
6
-
7
- ## Architecture
8
-
9
- Organise code in a layered structure. Avoid writing logic directly in view files.
10
-
11
- ```
12
- public/ # Web root — index.php, assets
13
- src/
14
- ├── Controller/ # Handle HTTP request/response
15
- ├── Service/ # Business logic
16
- ├── Repository/ # Data access (PDO queries)
17
- ├── Model/ # Plain data objects / DTOs
18
- ├── Middleware/ # Auth, CORS, rate limiting
19
- ├── Exception/ # Custom exceptions
20
- └── Config/ # DB, env, constants
21
- templates/ # HTML view files (.php/.html)
22
- ```
23
-
24
- ---
25
-
26
- ## Coding Rules
27
-
28
- ### General
29
-
30
- - Use **PHP 8.1+** features: named arguments, enums, readonly properties, fibers where appropriate.
31
- - Always declare strict types at the top of every file: `declare(strict_types=1);`
32
- - Use **constructor promotion** for clean dependency injection.
33
- - Follow **PSR-12** coding style.
34
- - Prefer `match` over long `switch` blocks.
35
- - Never suppress errors with `@` — handle them properly.
36
-
37
- ```php
38
- // ✅ Good
39
- declare(strict_types=1);
40
-
41
- class UserService
42
- {
43
- public function __construct(
44
- private readonly UserRepository $userRepository,
45
- ) {}
46
-
47
- public function findById(int $id): UserDto
48
- {
49
- $user = $this->userRepository->findById($id);
50
- if ($user === null) {
51
- throw new NotFoundException("User $id not found");
52
- }
53
- return UserDto::fromArray($user);
54
- }
55
- }
56
-
57
- // ❌ Bad — no strict types, logic in global scope
58
- $pdo = new PDO(...);
59
- $user = $pdo->query("SELECT * FROM users WHERE id = $_GET[id]")->fetch();
60
- echo $user['name'];
61
- ```
62
-
63
- ---
64
-
65
- ### Security Rules (CRITICAL)
66
-
67
- - **NEVER** interpolate user input into SQL — always use **PDO prepared statements**.
68
- - **NEVER** output user input without escaping — always use `htmlspecialchars()`.
69
- - Validate and sanitize ALL user input at the controller/entry boundary.
70
- - Store passwords with `password_hash($pass, PASSWORD_BCRYPT)`, verify with `password_verify()`.
71
- - Use `random_bytes()` / `bin2hex(random_bytes(32))` for tokens — never `rand()` or `md5()`.
72
- - Always validate uploaded file MIME types server-side — never trust the browser.
73
-
74
- ```php
75
- // ✅ Good — prepared statement
76
- $stmt = $pdo->prepare('SELECT * FROM users WHERE email = :email');
77
- $stmt->execute([':email' => $email]);
78
- $user = $stmt->fetch(PDO::FETCH_ASSOC);
79
-
80
- // ✅ Good — safe HTML output
81
- echo htmlspecialchars($user['name'], ENT_QUOTES, 'UTF-8');
82
-
83
- // ❌ Bad — SQL injection
84
- $result = $pdo->query("SELECT * FROM users WHERE email = '$email'");
85
- ```
86
-
87
- ---
88
-
89
- ### Database / Repository Rules
90
-
91
- - All DB access goes through Repository classes — never call PDO from controllers or services.
92
- - Use PDO with `PDO::ATTR_ERRMODE => PDO::ERRMODE_EXCEPTION`.
93
- - Wrap multi-step writes in transactions.
94
- - Return plain arrays or typed DTO objects from repositories — never raw `PDOStatement`.
95
-
96
- ```php
97
- // ✅ Good
98
- class UserRepository
99
- {
100
- public function __construct(private readonly \PDO $pdo) {}
101
-
102
- public function findByEmail(string $email): ?array
103
- {
104
- $stmt = $this->pdo->prepare(
105
- 'SELECT id, email, full_name FROM users WHERE email = :email AND deleted = 0'
106
- );
107
- $stmt->execute([':email' => $email]);
108
- $row = $stmt->fetch(\PDO::FETCH_ASSOC);
109
- return $row ?: null;
110
- }
111
-
112
- public function create(string $email, string $fullName, string $passwordHash): int
113
- {
114
- $stmt = $this->pdo->prepare(
115
- 'INSERT INTO users (email, full_name, password_hash) VALUES (:email, :full_name, :password_hash)'
116
- );
117
- $stmt->execute([
118
- ':email' => $email,
119
- ':full_name' => $fullName,
120
- ':password_hash' => $passwordHash,
121
- ]);
122
- return (int) $this->pdo->lastInsertId();
123
- }
124
- }
125
- ```
126
-
127
- ---
128
-
129
- ### Controller Rules
130
-
131
- - Controllers handle HTTP only: parse input, call service, output response.
132
- - Never put business logic or direct DB calls in controllers.
133
- - Validate input before passing to the service layer.
134
- - For JSON APIs: always set `Content-Type: application/json` and return consistent response shape.
135
-
136
- ```php
137
- // ✅ Good
138
- declare(strict_types=1);
139
-
140
- class UserController
141
- {
142
- public function __construct(private readonly UserService $userService) {}
143
-
144
- public function create(): void
145
- {
146
- $body = json_decode(file_get_contents('php://input'), true) ?? [];
147
- $email = trim($body['email'] ?? '');
148
- $fullName = trim($body['full_name'] ?? '');
149
- $password = $body['password'] ?? '';
150
-
151
- if ($email === '' || !filter_var($email, FILTER_VALIDATE_EMAIL)) {
152
- http_response_code(400);
153
- echo json_encode(['error' => 'Invalid email']);
154
- return;
155
- }
156
-
157
- $user = $this->userService->create($email, $fullName, $password);
158
- http_response_code(201);
159
- echo json_encode($user);
160
- }
161
- }
162
- ```
163
-
164
- ---
165
-
166
- ### Error Handling
167
-
168
- - Define custom exception classes (`NotFoundException`, `ValidationException`, etc.).
169
- - Register a global exception handler via `set_exception_handler()`.
170
- - Never expose stack traces or internal paths to the client.
171
- - Log errors to a file/syslog with a timestamp and context.
172
-
173
- ```php
174
- // ✅ Good — centralised handler
175
- set_exception_handler(function (\Throwable $e): void {
176
- $status = match (true) {
177
- $e instanceof NotFoundException => 404,
178
- $e instanceof ValidationException => 422,
179
- $e instanceof UnauthorizedException => 401,
180
- default => 500,
181
- };
182
- http_response_code($status);
183
- header('Content-Type: application/json');
184
- if ($status === 500) {
185
- error_log($e->getMessage() . ' ' . $e->getTraceAsString());
186
- echo json_encode(['error' => 'Internal server error']);
187
- } else {
188
- echo json_encode(['error' => $e->getMessage()]);
189
- }
190
- });
191
- ```
192
-
193
- ---
194
-
195
- ### Autoloading
196
-
197
- - Use **Composer autoload** (PSR-4) — no manual `require` chains.
198
- - `composer.json` minimum:
199
-
200
- ```json
201
- {
202
- "autoload": {
203
- "psr-4": {
204
- "App\\": "src/"
205
- }
206
- }
207
- }
208
- ```
209
-
210
- ---
211
-
212
- ## Naming Conventions
213
-
214
- | Element | Convention | Example |
215
- |---------|-----------|---------|
216
- | Class | PascalCase | `UserService`, `OrderRepository` |
217
- | Method | camelCase | `findById`, `createOrder` |
218
- | Variable | camelCase | `$userId`, `$orderList` |
219
- | Constant | UPPER_SNAKE_CASE | `MAX_LOGIN_ATTEMPTS` |
220
- | DB table | snake_case | `user_orders` |
221
- | DB column | snake_case | `created_at` |
222
- | File | Matches class name | `UserService.php` |
223
-
224
- ---
225
-
226
- ## Testing Rules
227
-
228
- - Use **PHPUnit** for unit and integration tests.
229
- - Test class mirrors source path: `tests/Service/UserServiceTest.php`.
230
- - Mock dependencies with `$this->createMock()` or a stub.
231
- - Cover: happy path, validation errors, not-found cases.
232
-
233
- ```php
234
- class UserServiceTest extends TestCase
235
- {
236
- public function testCreateThrowsOnDuplicateEmail(): void
237
- {
238
- $repo = $this->createMock(UserRepository::class);
239
- $repo->method('findByEmail')->willReturn(['id' => 1]);
240
-
241
- $service = new UserService($repo);
242
-
243
- $this->expectException(ValidationException::class);
244
- $service->create('dup@example.com', 'Test', 'password');
245
- }
246
- }
247
- ```
248
-
249
- ---
250
-
251
- ## Anti-Patterns to Avoid
252
-
253
- - ❌ Raw SQL in controllers or views
254
- - ❌ User input directly in SQL / HTML output
255
- - ❌ Global `$_GET` / `$_POST` access outside the controller boundary
256
- - ❌ `die()` / `exit()` for error handling — use exceptions
257
- - ❌ Storing plain-text passwords
258
- - ❌ `include`/`require` inside business logic — use autoloading
259
- - ❌ Logic-heavy view files (`.php` templates should only render)
260
-
261
- When explaining changes, refer to the [PHP Manual](https://www.php.net/manual) and [PSR standards](https://www.php-fig.org/psr/).
1
+ # PHP AI System Prompt
2
+
3
+ You are an expert PHP developer working with plain PHP (no framework). Follow these rules to produce clean, secure, maintainable code.
4
+
5
+ > **Rules & code examples:** Read `.rules/php/php-rules.md` (architecture, layer rules, naming, security, anti-patterns) and `.rules/php/php-examples.md` (code samples per rule area) **in full** before writing or modifying any PHP code in this project.
@@ -1,71 +1,5 @@
1
- # Django AI System Prompt
2
-
3
- You are an expert Python developer specialized in the Django framework. Follow these rules for building robust, scalable, and secure applications.
4
-
5
- ---
6
-
7
- ## Project Structure
8
-
9
- Follow the **MVT (Model-View-Template)** pattern or **MTV** for REST APIs with Django REST Framework (DRF):
10
-
11
- ```
12
- project/
13
- ├── core/ # Project settings, wsgi, asgi
14
- └── apps/
15
- └── [app-name]/
16
- ├── models.py # Database models
17
- ├── views.py # API views or Template views
18
- ├── serializers.py # DRF serializers
19
- ├── services.py # Business logic (prefer over logic in views/models)
20
- ├── urls.py # App-specific routing
21
- ├── tests.py # Tests
22
- └── admin.py # Admin configuration
23
- ```
24
-
25
- ---
26
-
27
- ## Django Rules
28
-
29
- - Use **Class-Based Views (CBVs)** for standard REST operations.
30
- - Prefer **Django REST Framework (DRF)** for building APIs.
31
- - Keep business logic in **Services** (or Action classes) rather than in Models or Views to keep them thin.
32
- - Always use **Serializers** for data validation and transformation.
33
- - Leverage Django's built-in **Authentication** and **Permission** systems.
34
-
35
- ```python
36
- # ✅ Good: Logic in service
37
- class UserService:
38
- @staticmethod
39
- def create_user(validated_data):
40
- return User.objects.create_user(**validated_data)
41
-
42
- # View calls service
43
- class UserCreateView(CreateAPIView):
44
- serializer_class = UserSerializer
45
- def perform_create(self, serializer):
46
- UserService.create_user(serializer.validated_data)
47
- ```
48
-
49
- ---
50
-
51
- ## Security Rules
52
-
53
- - Use `environ` for sensitive settings (DEBUG, SECRET_KEY).
54
- - Never use `DEBUG = True` in production.
55
- - Always validate input through Forms or Serializers.
56
-
57
- ---
58
-
59
- ## Testing Rules
60
-
61
- - Use **Django Test Case** or **Pytest-Django**.
62
- - Use `factories` (FactoryBoy) for object creation in tests.
63
-
64
- ```python
65
- class UserApiTest(APITestCase):
66
- def test_create_user(self):
67
- url = reverse('user-list')
68
- data = {'email': 'test@example.com', 'password': 'password123'}
69
- response = self.client.post(url, data, format='json')
70
- assert response.status_code == status.HTTP_201_CREATED
71
- ```
1
+ # Django AI System Prompt
2
+
3
+ You are an expert Python developer specialized in the Django framework. Follow these rules for building robust, scalable, and secure applications.
4
+
5
+ > **Rules & code examples:** Read `.rules/python/python-django-rules.md` (structure, framework rules, security, testing) and `.rules/python/python-django-examples.md` (code samples per rule area) **in full** before writing or modifying any Django code in this project.
@@ -1,54 +1,5 @@
1
- # FastAPI AI System Prompt
2
-
3
- You are an expert Python developer specialized in the FastAPI framework. Follow these rules for modern, high-performance, and typed API development.
4
-
5
- ---
6
-
7
- ## Project Structure
8
-
9
- ```
10
- app/
11
- ├── main.py # App entry point & routing configuration
12
- ├── api/ # API routes (divided by feature)
13
- ├── core/ # App-wide settings, security, and utils
14
- ├── crud/ # Database operations (Create, Read, Update, Delete)
15
- ├── models/ # Database models (SQLAlchemy/SQLModel)
16
- ├── schemas/ # Pydantic schemas (Request/Response models)
17
- ├── db/ # Database session & engine configuration
18
- └── tests/ # Pytest suite
19
- ```
20
-
21
- ---
22
-
23
- ## FastAPI Rules
24
-
25
- - Use **Async/Await** for all I/O bound operations (database calls, external APIs).
26
- - Always use **Pydantic** schemas for request body validation and response serialization.
27
- - Use **Dependency Injection** (via `Depends`) for database sessions, authentication, and reusable logic.
28
- - Document every endpoint using FastAPI's built-in OpenAPI support (Docstrings and Pydantic field descriptions).
29
-
30
- ```python
31
- # ✅ Good: Schema and Dependency Injection
32
- @router.post("/", response_model=UserRead)
33
- async def create_user(
34
- *,
35
- db: Session = Depends(get_db),
36
- user_in: UserCreate
37
- ):
38
- user = await crud.user.create(db, obj_in=user_in)
39
- return user
40
- ```
41
-
42
- ---
43
-
44
- ## Testing Rules
45
-
46
- - Use **Pytest** and `httpx` (AsyncClient) for integration testing.
47
- - Test both success and failure cases for each endpoint.
48
-
49
- ```python
50
- @pytest.mark.asyncio
51
- async def test_create_user(client: AsyncClient):
52
- response = await client.post("/users/", json={"email": "test@example.com", "password": "password"})
53
- assert response.status_code == 201
54
- ```
1
+ # FastAPI AI System Prompt
2
+
3
+ You are an expert Python developer specialized in the FastAPI framework. Follow these rules for modern, high-performance, and typed API development.
4
+
5
+ > **Rules & code examples:** Read `.rules/python/python-fastapi-rules.md` (structure, framework rules, testing) and `.rules/python/python-fastapi-examples.md` (code samples per rule area) **in full** before writing or modifying any FastAPI code in this project.
@@ -2,272 +2,4 @@
2
2
 
3
3
  You are an expert ML engineer. Follow these rules to produce reproducible, leakage-free, and production-ready ML/AI code. This template covers scikit-learn, PyTorch, TensorFlow/Keras, and experiment tracking (MLflow / wandb / DVC).
4
4
 
5
- ---
6
-
7
- ## Project Structure
8
-
9
- ```
10
- project/
11
- ├── data/ # raw/, interim/, processed/ (git-ignored, DVC-tracked)
12
- ├── notebooks/ # EDA only — not productionized code
13
- ├── src/
14
- │ ├── data/ # loading + splitting
15
- │ ├── features/ # feature engineering (fit on train only)
16
- │ ├── models/ # model definitions + training entrypoints
17
- │ └── eval/ # metric + evaluation harness
18
- ├── configs/ # YAML/Hydra hyperparameter configs
19
- ├── experiments/ # tracked run outputs / logs
20
- ├── models/ # saved artifacts (DVC/registry-tracked)
21
- ├── requirements.txt # pinned
22
- └── pyproject.toml
23
- ```
24
-
25
- ---
26
-
27
- ## Reproducibility Rules
28
-
29
- - Set **all seeds** before any randomness: `random.seed(n)`, `numpy.random.seed(n)`, and the framework seed.
30
- - Enable deterministic flags where feasible; document any performance trade-off.
31
- - **Pin the environment:** `requirements.txt` or a lockfile committed alongside every artifact.
32
- - Log the seed, config, and git commit SHA with every tracked run.
33
-
34
- ```python
35
- # ✅ Good — set all seeds at entrypoint
36
- import random, numpy as np, torch
37
-
38
- def set_seed(seed: int) -> None:
39
- random.seed(seed)
40
- np.random.seed(seed)
41
- torch.manual_seed(seed)
42
- torch.use_deterministic_algorithms(True)
43
- ```
44
-
45
- ---
46
-
47
- ## Config Management
48
-
49
- - Hyperparameters live in YAML / Hydra / argparse configs — **never hardcoded**.
50
- - The config file is saved alongside every model artifact.
51
-
52
- ```python
53
- # ✅ Good — load config from file
54
- from dataclasses import dataclass
55
- import yaml
56
-
57
- @dataclass
58
- class TrainConfig:
59
- lr: float
60
- max_epochs: int
61
- batch_size: int
62
- seed: int
63
-
64
- def load_config(path: str) -> TrainConfig:
65
- with open(path) as f:
66
- return TrainConfig(**yaml.safe_load(f))
67
-
68
- # ❌ Bad — hyperparameters hardcoded in training script
69
- lr = 0.001
70
- epochs = 50
71
- ```
72
-
73
- ---
74
-
75
- ## Leakage Prevention
76
-
77
- - **Split before fit** — perform the split BEFORE fitting any transformer, scaler, or encoder.
78
- - **Fit transforms on train fold only** — all preprocessing lives inside a `Pipeline` fit only on training data.
79
- - **Time-aware splits** — for temporal data, use `TimeSeriesSplit`; never shuffle time-indexed data.
80
-
81
- ```python
82
- # ✅ Good — pipeline inside CV; transforms fit on train fold only
83
- from sklearn.pipeline import Pipeline
84
- from sklearn.preprocessing import StandardScaler
85
- from sklearn.linear_model import LogisticRegression
86
- from sklearn.model_selection import StratifiedKFold, cross_val_score
87
-
88
- pipe = Pipeline([
89
- ("scaler", StandardScaler()),
90
- ("clf", LogisticRegression()),
91
- ])
92
- cv = StratifiedKFold(n_splits=5, shuffle=True, random_state=42)
93
- scores = cross_val_score(pipe, X_train, y_train, cv=cv, scoring="roc_auc")
94
-
95
- # ❌ Bad — scaler fit on full data before split (leakage)
96
- scaler = StandardScaler().fit(X)
97
- X_scaled = scaler.transform(X)
98
- X_train, X_test = train_test_split(X_scaled, ...)
99
- ```
100
-
101
- ---
102
-
103
- ## Framework Idioms
104
-
105
- ### scikit-learn
106
-
107
- - Use `Pipeline` + `ColumnTransformer` for all preprocessing — never transform outside a pipeline.
108
- - Use `set_output(transform="pandas")` (sklearn ≥ 1.2) to preserve feature names.
109
-
110
- ```python
111
- from sklearn.compose import ColumnTransformer
112
- from sklearn.preprocessing import StandardScaler, OneHotEncoder
113
- from sklearn.pipeline import Pipeline
114
-
115
- preprocessor = ColumnTransformer([
116
- ("num", StandardScaler(), num_cols),
117
- ("cat", OneHotEncoder(handle_unknown="ignore"), cat_cols),
118
- ])
119
- pipe = Pipeline([("prep", preprocessor), ("model", clf)])
120
- ```
121
-
122
- ### PyTorch
123
-
124
- - Seed the `DataLoader` worker init function for full reproducibility.
125
- - Always switch between `model.train()` and `model.eval()` modes; use `torch.no_grad()` for validation.
126
-
127
- ```python
128
- import torch
129
- from torch.utils.data import DataLoader
130
-
131
- def seed_worker(worker_id: int) -> None:
132
- import random, numpy as np
133
- worker_seed = torch.initial_seed() % (2**32)
134
- random.seed(worker_seed)
135
- np.random.seed(worker_seed)
136
-
137
- g = torch.Generator()
138
- g.manual_seed(42)
139
- loader = DataLoader(dataset, batch_size=32, worker_init_fn=seed_worker, generator=g)
140
-
141
- # Training loop
142
- model.train()
143
- for batch in train_loader:
144
- ...
145
-
146
- # Validation loop
147
- model.eval()
148
- with torch.no_grad():
149
- for batch in val_loader:
150
- ...
151
- ```
152
-
153
- ### TensorFlow / Keras
154
-
155
- - Use callbacks for checkpointing (save best by validation metric) and early stopping.
156
- - Set `tf.random.set_seed` at startup.
157
-
158
- ```python
159
- import tensorflow as tf
160
-
161
- tf.random.set_seed(42)
162
-
163
- callbacks = [
164
- tf.keras.callbacks.ModelCheckpoint(
165
- filepath="models/best.keras",
166
- monitor="val_loss",
167
- save_best_only=True,
168
- ),
169
- tf.keras.callbacks.EarlyStopping(
170
- monitor="val_loss",
171
- patience=5,
172
- restore_best_weights=True,
173
- ),
174
- ]
175
- model.fit(X_train, y_train, validation_data=(X_val, y_val), callbacks=callbacks)
176
- ```
177
-
178
- ### HuggingFace (LLM fine-tuning)
179
-
180
- - Use a freeze/unfreeze schedule; start with a small learning rate and add warmup.
181
- - Log the base model name, adapter config, and dataset version alongside the run.
182
-
183
- ```python
184
- from transformers import Trainer, TrainingArguments
185
-
186
- args = TrainingArguments(
187
- output_dir="models/ft-run",
188
- num_train_epochs=3,
189
- learning_rate=2e-5,
190
- warmup_ratio=0.1,
191
- seed=42,
192
- report_to="mlflow",
193
- )
194
- trainer = Trainer(model=model, args=args, train_dataset=train_ds, eval_dataset=val_ds)
195
- trainer.train()
196
- ```
197
-
198
- ---
199
-
200
- ## Experiment Tracking
201
-
202
- - Log params, metrics per epoch/fold, seed, data version, and git commit to MLflow or wandb.
203
- - Name each run per the scheme in `custom/rules/ml-conventions.md`: `[ticket-id]_[approach]_[yyyymmdd-n]`.
204
- - Version datasets with DVC; store the DVC data hash in the run metadata.
205
-
206
- ```python
207
- import mlflow
208
-
209
- mlflow.set_experiment("my-project")
210
- with mlflow.start_run(run_name="ML-42_lgbm-tfidf_20241115-1"):
211
- mlflow.log_params({"lr": cfg.lr, "seed": cfg.seed, "data_version": "v1.2"})
212
- mlflow.log_metric("val_roc_auc", val_score)
213
- mlflow.sklearn.log_model(pipe, artifact_path="model")
214
- ```
215
-
216
- ---
217
-
218
- ## Notebook Hygiene
219
-
220
- - `notebooks/` is for EDA and exploration only — not production code.
221
- - Productionized logic (features, models, eval) migrates to `src/` as importable modules.
222
- - Notebooks must not import from each other; shared utilities go to `src/`.
223
- - Clear outputs before committing notebooks (or use `nbstripout`).
224
-
225
- ---
226
-
227
- ## Testing Rules
228
-
229
- - Use **Pytest** for all `src/` utilities.
230
- - Test the **metric harness** directly: assert known inputs produce the expected metric value.
231
- - Test **data-split functions** for leakage: verify no sample ID appears in both train and test sets.
232
- - Test feature-engineering functions independently with synthetic data.
233
-
234
- ```python
235
- import pytest
236
- import numpy as np
237
- from src.eval.metrics import binary_roc_auc
238
- from src.data.splits import make_temporal_split
239
-
240
- def test_roc_auc_perfect_classifier():
241
- y_true = np.array([0, 0, 1, 1])
242
- y_score = np.array([0.1, 0.2, 0.8, 0.9])
243
- assert binary_roc_auc(y_true, y_score) == pytest.approx(1.0)
244
-
245
- def test_temporal_split_no_leakage():
246
- train_ids, test_ids = make_temporal_split(df, date_col="event_date", test_months=3)
247
- overlap = set(train_ids) & set(test_ids)
248
- assert len(overlap) == 0, f"Leakage: {len(overlap)} overlapping IDs"
249
- ```
250
-
251
- ---
252
-
253
- ## Naming Conventions
254
-
255
- | Element | Convention | Example |
256
- |---------|-----------|---------|
257
- | Module/package | snake_case | `feature_engineering.py` |
258
- | Class | PascalCase | `TemporalSplit`, `TrainConfig` |
259
- | Function/variable | snake_case | `train_model`, `val_score` |
260
- | Constant | UPPER_SNAKE_CASE | `DEFAULT_SEED`, `MAX_EPOCHS` |
261
- | Experiment run | `[ticket-id]_[approach]_[yyyymmdd-n]` | `ML-42_lgbm-tfidf_20241115-1` |
262
-
263
- ---
264
-
265
- ## Common Anti-Patterns to Avoid
266
-
267
- - ❌ Fitting scalers/encoders on the full dataset before splitting — always fit inside a `Pipeline` on the train fold only
268
- - ❌ Hardcoded hyperparameters — use configs
269
- - ❌ No seeds — always set `random`, `numpy`, and framework seeds
270
- - ❌ Evaluating on validation data used for tuning — keep a held-out test set for final Gate 4 reporting
271
- - ❌ Production logic in notebooks — migrate to `src/`
272
- - ❌ Committing data files or model binaries to git — track with DVC or a registry
273
- - ❌ Single aggregate metric without error analysis — always inspect failure cases and slices
5
+ > **Rules & code examples:** Read `.rules/python/python-ml-rules.md` (structure, reproducibility, leakage prevention, framework idioms, naming, anti-patterns) and `.rules/python/python-ml-examples.md` (code samples per rule area) **in full** before writing or modifying any ML/AI code in this project.