data-primals-engine 1.7.2 → 1.7.3

package/doc/Concepts.md

@@ -0,0 +1,122 @@
+# Fundamental Concepts
+
+`data-primals-engine` is built on a set of core concepts designed to provide maximum flexibility and power. Understanding these concepts is essential to getting the most out of the platform.
+
+---
+
+## 1. [Models](data-models)
+
+A **model** represents a data entity in your application, similar to a table in an SQL database or a collection in MongoDB. Each model has a set of fields that define the structure of the data it contains.
+
+- **Visual Definition**: Models can be created and modified directly from the user interface, without requiring manual database migrations.
+
+- **Flexibility**: A model's structure can be updated at any time.
+### Model Generation
+Models are the way to handle structured data. They organize data and they can be declared in JSON.
+
+```json
+{
+  "name": "product",
+  "description": "E-commerce product schema",
+  "fields": [
+    { "name": "name", "type": "string", "required": true },
+    { "name": "price", "type": "number", "required": true },
+    { "name": "stock", "type": "number", "default": 0 },
+    { "name": "category", "type": "relation", "relation": "taxonomy",
+       "relationFilter": { "$eq": ["$type", "category"] }
+    },
+    { "name": "tags", "type": "relation", "relation": "taxonomy", "multiple": true,
+       "relationFilter": { "$eq": ["$type", "keyword"] }
+    }
+  ]
+}
+```
+
+#### Dynamic Index Management
+
+The engine features a sophisticated system for managing database indexes directly from the model editor UI. This eliminates the need for manual database administration or migration scripts for indexing, significantly speeding up development and reducing errors.
+
+Indexes are created, updated, and removed automatically when you save a model's structure. All created indexes are **partial indexes**, meaning they only include documents for the specific model and user, which optimizes storage and performance.
+
+You can enable indexing on any field by checking the `index` box in the model editor and choosing one of the following types:
+
+| Index Type      | `indexType` | Use Case & Behavior                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         -|
+ |-----------------|-------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
+| **Regular**     | `regular`   | **Purpose**: The standard index for most use cases. It dramatically speeds up queries, sorting, and filtering on a specific field. <br/> **Behavior**: Creates a standard ascending B-tree index on a single field. This is the default and most common index type.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      -|
+| **Text Search** | `text`      | **Purpose**: Enables powerful, language-aware full-text search across one or more fields. It's ideal for implementing search bars that need to query descriptions, titles, and other text-heavy content. <br/> **Behavior**: Creates a single, special **compound `text` index** for the entire model. All fields marked with `indexType: 'text'` are included in this single index. This allows you to use MongoDB's `$text` operator in your search queries.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      -|
+| **Geospatial**  | `2dsphere`  | **Purpose**: Essential for location-based queries. It allows you to efficiently find documents within a certain radius, within a polygon, or sorted by distance. <br/> **Behavior**: Creates a `2dsphere` index on a single field. This index type should be used exclusively on fields of type `geolocation` which store data in GeoJSON format (e.g., `{ "type": "Point", "coordinates": [ -73.97, 40.77 ] }`). |
+
+### Model constraints
+```javascript
+{
+    "name": "modelName",
+    "fields": [
+         { "name": "fieldName1", .... },
+         { "name": "fieldName2", .... }
+    ],
+    "constraints": [
+        // uniqueness
+        { "name": "uniqueConstraint", type: "unique", keys: ["fieldName1", "fieldName2"] }
+    ]
+}
+```
+### Other model features
+- Handles up to 1500 direct relations per document by default (can be customized). For larger datasets, use intermediate collections or maxRelationsPerData constant.
+- Anonymizable fields (encrypted for API users)
+
+
+## 2. [Fields](data-models)
+
+**Fields** are the attributes that make up a model. `data-primals-engine` supports a wide variety of field types to cover all needs:
+
+### Fields types
+
+| Type        | Description                                                                         | 	Properties/Notes                                                         | 
+|:------------|:------------------------------------------------------------------------------------|:--------------------------------------------------------------------------|
+| string	     | Character string.                                                                   | 	minLength, maxLength                                                     |
+| string_t	   | International character string ID.                                                  | 	same as string, translated in { key, value }                             |
+| number	     | Numeric value (integer or float).                                                   | 	min, max                                                                 |
+| boolean	    | Boolean value (true/false).	                                                        | –                                                                         |
+| date	       | Stores a ISO date.	                                                                 | –                                                                         |
+| datetime	   | Stores an ISO date and time.	                                                       | –                                                                         |
+| richtext	   | Rich text field (HTML) for WYSIWYG editors.	                                        |                                                                           |
+| richtext_t	 | International rich text field (HTML) for WYSIWYG editors.	                          | i18n                                                                      |
+| email	      | String validated as an email address.	                                              | –                                                                         |
+| password	   | String that will be automatically hashed.	                                          | –                                                                         |
+| enum	       | Allows selecting a value from a predefined list.	                                   | items: ["value1", "value2"]                                               |
+| relation	   | Creates a link to a document in another model.                                      | 	relation: "target_model_name", multiple: true/false                      |
+| file	       | For uploading a file (stored on S3 if configured).	                                 | allowedTypes:['image/jpeg', 'image/png', 'image/bmp'], maxSize: 1024*1000 |
+| image	      | Specialized file type for images, with preview.	                                    | –                                                                         |
+| array	      | Stores a list of values.	                                                           | itemsType: 'enum' // any type except relations                            |
+| object	     | Stores a nested JSON object.	–                                                      |                                                                           |
+| code	       | Stores language="*" as string, stores language="json" as arbitrary JSON structure.	 | language="json" conditionBuilder=true                                     |                                            
+| color	      | Stores an hexadecimal value of an RGB color	                                        | '#FF0000'                                                                 |                                            
+| model	      | Stores a model by name                                                              | –                                                                         |                                            
+| modelField	 | Stores a model field path	                                                          | –                                                                         |                                            
+
+
+Each field can have specific validation rules to guarantee data integrity.
+
+## 3. [Permissions (RBAC)](roles-permissions)
+
+Access management is handled by a **Role-Based Access Control (RBAC)** system.
+
+- **Roles**: You can define roles (e.g., `Admin`, `Editor`, `Visitor`).
+
+- **Granular Permissions**: For each model, you can assign CRUD (Create, Read, Update, Delete) permissions to each role. For example, an `Editor` can create and modify articles, but not delete them.
+
+This system allows for granular security of access to your data.
+
+## 4. [User management](users)
+
+The engine includes a robust authentication system based on **JWT (JSON Web Tokens)**.
+
+- ****: A `User` model is typically used to manage user accounts.
+
+- **Security**: `JWT_SECRET` ensures that tokens cannot be forged.
+
+## 5. Advanced Data Management
+
+- **Complex Queries**: Leverage the power of MongoDB to perform complex queries and aggregations on your data.
+
+- **Automatic Auditing**: The engine can automatically maintain a history of changes for each record, allowing you to know who did what and when.

package/doc/Custom-Endpoints.md

@@ -0,0 +1,31 @@
+# Custom API Endpoints
+
+While `data-primals-engine` provides a full REST API for CRUD operations on your models, you may sometimes need to create API endpoints with specific business logic.
+
+Custom API endpoints allow you to extend the engine's native API in a secure and controlled manner.
+
+---
+
+## Why Create a Custom API Endpoint?
+
+- To execute complex logic that goes beyond simple CRUD operations (e.g., `POST /api/orders/{id}/processPayment`).
+
+- To aggregate data from multiple models into a single response.
+
+- To integrate with external services.
+
+## Creation and Configuration
+
+Custom API endpoints can be created directly from the administration interface. During creation, you configure the following:
+
+- **HTTP Route**: The URL path (e.g., `/my-custom-action`).
+
+- **HTTP Method**: `GET`, `POST`, `PUT`, `DELETE`, etc.
+
+- **Permissions**: Which role is authorized to call this API point.
+
+- **Execution Code**: You write your logic in **JavaScript (Node.js)** directly in a secure (sandbox) environment.
+
+## Secure Execution Environment
+
+The code you write for a custom API point runs in an isolated environment. You have controlled access to engine features (such as `searchData`, `insertData`) and certain Node.js libraries, which ensures that your custom code cannot compromise the security or stability of the main application.

package/doc/Event-system.md

@@ -63,17 +63,16 @@ When multiple listeners are registered for an event, their return values are mer
 
 Here is a list of the most important events you can listen to:
 
-| Event              | Description                                                      | Scope  | Triggered by                 | Arguments (Payload)                                                                |
-|:-------------------|:-----------------------------------------------------------------|:-------|:-----------------------------|:-----------------------------------------------------------------------------------|
-| `OnServerStart`    | Triggered once the HTTP server is started and listening.         | System | `engine.start()`             | `engine`                                                                           |
-| `OnDatabaseLoaded` | Triggered once the lient is ready                                | System |                              | `engine`                                                                           |
-| `OnModelsLoaded`   | Triggered after the initial models are loaded at startup.        | System | `setupInitialModels()`       | `engine`, `dbModels`                                                               |
-| `OnModelEdited`    | Triggered after a model definition has been modified.            | System | `editModel()`                | `newModel`                                                                         |
-| `OnDataAdded`      | Triggered after new data has been inserted.                      | System | `insertData()`               | `engine`, `insertedDocs`                                                           |
-| `OnDataEdited`     | Triggered after data has been edited.                            | System | `editData()` / `patchData()` | `engine`, `{modelName, before, after}`                                             |
-| `OnDataDeleted`    | Triggered just after data is actually deleted.                   | System | `deleteData()`               | `engine`, `{model, filter}`                                                        |
-| `OnDataSearched`   | Triggered after a data search.                                   | System | `searchData()`               | `engine`, `{data, count}`                                                          |
-| `OnDataInsert`     | Triggered just before data insertion. Allows modifying the data. | System | internal                     | `data`                                                                             |
-| `OnDataValidate`   | Triggered to override validation checks.                         | System | internal                     | `value`, `field`, `data`                                                           |
-| `OnChatAction`     | Triggered when an AI assistant decides on an action.             | User   | `handleChatRequest`          | `action`, `params`, `parsedResponse`, `command`, `llmOptions`, `user`, `reqParams` |
-| `OnSystemPrompt`   | Triggered to override the AI assistant's system prompt.          | User   | `handleChatRequest`          | `user`                                                                             |
+| Event            | Description                                                             | Scope  | Triggered by             | Arguments (Payload)                                                  |
+|:-----------------|:------------------------------------------------------------------------|:-------|:-------------------------|:---------------------------------------------------------------------|
+| `OnServerStart`    | Triggered once the HTTP server is started and listening.                | System | `engine.start()`           | `engine`                                                               |
+| `OnModelsLoaded`   | Triggered after the initial models are loaded at startup.               | System | `setupInitialModels()`     | `engine`, `dbModels`                                                     |
+| `OnModelEdited`    | Triggered after a model definition has been modified.                   | System | `editModel()`              | `newModel`                                                             |
+| `OnDataAdded`      | Triggered after new data has been inserted.                             | System | `insertData()`             | `engine`, `insertedDocs`                                                 |
+| `OnDataEdited`     | Triggered after data has been edited.                                   | System | `editData()` / `patchData()` | `engine`, `{modelName, before, after}`                                   |
+| `OnDataDeleted`    | Triggered just after data is actually deleted.                          | System | `deleteData()`             | `engine`, `{model, filter}`                                              |
+| `OnDataSearched`   | Triggered after a data search.                                          | System | `searchData()`             | `engine`, `{data, count}`                                                |
+| `OnDataInsert`     | Triggered just before data insertion. Allows modifying the data.        | System | internal                 | `data`                                                                 |
+| `OnDataValidate`   | Triggered to override validation checks.                                | System | internal                 | `value`, `field`, `data`                                                   |
+| `OnChatAction`     | Triggered when an AI assistant decides on an action.                    | User   | `handleChatRequest`        | `action`, `params`, `parsedResponse`, `command`, `llmOptions`, `user`, `reqParams` |
+| `OnSystemPrompt`   | Triggered to override the AI assistant's system prompt.                 | User   | `handleChatRequest`        | `user`                                                                 |

package/doc/Home.md

@@ -0,0 +1,33 @@
+# Welcome to the data-primals-engine Wiki! 👋
+
+This wiki is your central guide to using, integrating, and extending the platform.
+
+## 🧭 Explore the Platform
+Discover the core features to get started building and managing your data.
+Link to the official documentation: https://data.primals.net/en/documentation/
+
+- 🧠 [Core Concepts](Concepts): Explore the fundamentals of data modeling.
+- 🔌 [Custom API Endpoints](custom-api-endpoints): Create dynamic HTTP routes directly from the backend.
+- 🏗️ [Data Models](data-models): Structure your information.
+- 🗃️ [Data Management](data-management): Create, read, update, and delete your entries.
+- 📈 [Dashboards, KPIs, and Charts](dashboards-kpis-charts): Track your key metrics.
+- 👥 [Users](users): Manage access to the platform.
+- 🔐 [Roles and Permissions](roles-permissions): Define who can see and do what.
+- ⚙️ [Automation with Workflows](automation-workflows): Create automated processes.
+- 🎁 [Pack Gallery](Packs-gallery): Discover ready-to-use configurations.
+- 🤖 [AI Assistance](AI-assistance): Leverage artificial intelligence.
+
+## 🧩 Extend Capabilities
+Go further by developing your own features and business logic.
+
+- ⚡ [Event System](Event-system): React to events in real time.
+- 🧠 [Advanced Workflows](Advanced-workflows): Create complex logic with custom scripts.
+- 📦 [Modules](Modules): Package and share your developments.
+- 🚀 [Sharding & Replication](sharding-replication): Scale horizontally and ensure high availability.
+- ❤️ [Contribute to the project (CONTRIBUTING.md)](https://github.com/anonympins/data-primals-engine/blob/main/CONTRIBUTING.md): Join the developer community.
+
+## 💻 For Developers
+Essential tools for a seamless development experience.
+
+- 📖 [Explore the API with Swagger](https://data.primals.net/api-docs/): Test API access points directly from your browser.
+- 📮 [Postman Collection](https://data.primals.net/doc/API.postman_collection.json): Import our collection to start querying in just a few clicks.

package/doc/Modules.md

@@ -0,0 +1,83 @@
+# Modules: Packaging and Extending Features
+
+The `data-primals-engine` is designed to be modular, allowing you to enable, disable, or create new features in a clean and organized way. A **Module** is a self-contained unit of functionality that plugs into the core engine at startup.
+
+This approach keeps the core lightweight while allowing for powerful extensions like SSO authentication, payment gateway integrations, or custom API functionalities.
+
+## How Modules Work
+
+1.  **Discovery**: The engine looks for modules in the `src/modules/` directory.
+2.  **Activation**: You specify which modules to activate using the `Config` object.
+3.  **Initialization**: For each active module, the engine calls its exported `onInit(engine)` function, passing the main engine instance. This is the module's entry point to interact with the system.
+
+## Enabling an Existing Module
+
+The engine comes with several built-in modules, such as authentication providers. To enable one, you add its name to the `modules` array in your configuration **before** initializing the engine.
+
+**Example: Enabling Google SSO and the Assistant**
+
+```javascript
+import { Engine, Config } from 'data-primals-engine';
+
+// Add modules to the list of modules to be loaded
+Config.Set("modules", ["auth-google", "assistant"]);
+
+const app = express();
+const engine = await Engine.Create({ app });
+```
+
+You may also need to install peer dependencies (`npm install passport-google-oauth20`) and set environment variables (`GOOGLE_CLIENT_ID`, etc.) as required by the module.
+
+## Creating a New Module
+
+Creating a module is straightforward. It only requires a JavaScript file in the `src/modules/my-module/` directory that exports an `async` function named `onInit`.
+
+### Step 1: Create the Module File
+
+Create a new file, for example: `src/modules/greeter/greeter.js`
+
+### Step 2: Write the `onInit` Function
+
+In `greeter.js`, write your initialization logic. The `onInit` function gives you access to the entire engine.
+
+```javascript
+// src/modules/greeter/greeter.js
+
+export async function onInit(engine) {
+    // 1. Get components from the engine
+    const logger = engine.getComponent('Logger');
+    const Event = engine.getComponent('Event');
+
+    // 2. Register a new API endpoint
+    engine.get('/api/greet/:name', (req, res) => {
+        const { name } = req.params;
+        res.json({ message: `Hello, ${name}! Welcome to our custom module.` });
+    });
+
+    // 3. Listen to a core event
+    Event.Listen('OnDataAdded', (engine, insertedDocs) => {
+        if (insertedDocs?.[0]._model === 'user') {
+            logger.info(`A new user has signed up: ${insertedDocs[0].username}`);
+        }
+    }, 'event', 'system');
+
+    // 4. Log that the module has been loaded
+    logger.info("Module 'greeter' loaded successfully.");
+}
+```
+
+### Step 3: Enable Your New Module
+
+In your main server file, enable your module via the `Config` object.
+
+```javascript
+Config.Set("modules", ["greeter"]); // Add your module's folder name
+
+const engine = await Engine.Create({ app });
+// When the server starts, you will see "Module 'greeter' loaded successfully." in your logs.
+// You can now access http://localhost:7633/api/greet/World
+```
+
+Modules are the preferred way to build reusable and maintainable extensions for `data-primals-engine`.
+
+**[Next: Sharding / Replication](sharding-replication)**

package/doc/Packs-gallery.md

@@ -1,4 +1,4 @@
-# Packs Gallery: Discover and Install Ready-to-Use Configurations
+# Data Packs: Discover and Install Ready-to-Use Configurations
 
 **Packs** are pre-built configurations that allow you to quickly set up your `data-primals-engine` application with ready-to-use models, data, workflows, and more. They are designed to bootstrap common use cases like a CRM, an e-commerce backoffice, or a project management tool, saving you significant development time.
 
@@ -6,35 +6,17 @@ The **Pack Gallery** is the centralized place within the UI where you can discov
 
 ## What is a Pack?
 
-A pack is a JSON object that can contain:
+A pack is a JSON object that can contain basically :
 
 -   **`models`**: A list of model definitions (schemas) to be created.
 -   **`data`**: Sample or initial data for the models in the pack. Data can be generic or language-specific.
 -   **`workflows`**: Pre-configured automation workflows, including triggers, steps, and actions.
 -   **`dashboards`** and **`kpis`**: Ready-to-use dashboards and KPIs for monitoring.
+- ...
 
 ## Installing a Pack
 
-You can install a pack in two ways: by its ID from the gallery or by providing a custom JSON structure directly.
-
-### 1. Installing from the Gallery
-
-Each pack in the gallery has a unique ID. You can use the `installPack` function with this ID to install it.
-
-```javascript
-import { installPack } from 'data-primals-engine';
-
-// Assuming 'currentUser' is your authenticated user object
-const packId = "61d1f1a9e3f1a9e3f1a9e3f1"; // Example ID for an e-commerce pack
-const installationSummary = await installPack(packId, currentUser, "en");
-
-console.log(installationSummary);
-// Returns a summary of created models, inserted data, etc.
-```
-
-### 2. Installing a Custom Pack
-
-You can also define a pack on-the-fly and install it. This is useful for migrating configurations between environments or for programmatic setup.
+You can  define a pack on-the-fly and install it. This is useful for migrating configurations between environments or for programmatic setup.
 
 The `installPack` function accepts an array containing the pack's JSON definition.
 
@@ -70,4 +52,7 @@ const summary = await installPack(myCustomPack, currentUser, "en");
 console.log(summary);
 ```
 
-By using packs, you can dramatically accelerate your project setup and ensure consistency across different instances of your application.
+By using packs, you can dramatically accelerate your project setup and ensure consistency across different instances of your application.
+
+
+**[Next: AI assistance](AI-assistance)**

package/doc/Workflows.md

@@ -0,0 +1,32 @@
+# Workflows and Automations
+
+Workflows are one of the most powerful features of `data-primals-engine`. They allow you to automate complex business processes without writing code, by responding to data events or time-based schedules.
+
+---
+
+## Common Use Cases
+
+- Send a welcome email when a new user signs up.
+
+- Update inventory when an order is marked as "completed".
+
+- Generate a PDF report every night at midnight.
+
+- Call an external API when data is modified.
+
+## Trigger Types
+
+A workflow is always initiated by a trigger. There are two main types:
+
+### 1. Data-Driven Triggers (Data Events)
+
+These workflows are triggered automatically when an operation is performed on data:
+- **After Create**: Triggers after a new record is created.
+
+- **After Update**: Triggers after a record is modified.
+
+- **Before Delete**: Triggers just before a record is deleted.
+
+### 2. Scheduled Triggers (Schedules)
+
+These workflows run at specific times, using **cron** syntax. This is ideal for recurring tasks such as reports, database cleanups, or synchronizations.