assemblyline-core 4.5.0.67__tar.gz → 4.5.0.69__tar.gz

assemblyline_core-4.5.0.69/PKG-INFO

@@ -0,0 +1,255 @@
+Metadata-Version: 2.2
+Name: assemblyline-core
+Version: 4.5.0.69
+Summary: Assemblyline 4 - Core components
+Home-page: https://github.com/CybercentreCanada/assemblyline-core/
+Author: CCCS Assemblyline development team
+Author-email: assemblyline@cyber.gc.ca
+License: MIT
+Keywords: assemblyline automated malware analysis gc canada cse-cst cse cst cyber cccs
+Classifier: Development Status :: 5 - Production/Stable
+Classifier: Intended Audience :: Developers
+Classifier: Topic :: Software Development :: Libraries
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Programming Language :: Python :: 3.7
+Classifier: Programming Language :: Python :: 3.8
+Classifier: Programming Language :: Python :: 3.9
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Description-Content-Type: text/markdown
+License-File: LICENCE.md
+Requires-Dist: assemblyline
+Requires-Dist: docker
+Requires-Dist: kubernetes
+Provides-Extra: test
+Requires-Dist: pytest; extra == "test"
+Requires-Dist: assemblyline_client; extra == "test"
+Dynamic: author
+Dynamic: author-email
+Dynamic: classifier
+Dynamic: description
+Dynamic: description-content-type
+Dynamic: home-page
+Dynamic: keywords
+Dynamic: license
+Dynamic: provides-extra
+Dynamic: requires-dist
+Dynamic: summary
+
+[![Discord](https://img.shields.io/badge/chat-on%20discord-7289da.svg?sanitize=true)](https://discord.gg/GUAy9wErNu)
+[![](https://img.shields.io/discord/908084610158714900)](https://discord.gg/GUAy9wErNu)
+[![Static Badge](https://img.shields.io/badge/github-assemblyline-blue?logo=github)](https://github.com/CybercentreCanada/assemblyline)
+[![Static Badge](https://img.shields.io/badge/github-assemblyline--core-blue?logo=github)](https://github.com/CybercentreCanada/assemblyline-core)
+[![GitHub Issues or Pull Requests by label](https://img.shields.io/github/issues/CybercentreCanada/assemblyline/core)](https://github.com/CybercentreCanada/assemblyline/issues?q=is:issue+is:open+label:core)
+[![License](https://img.shields.io/github/license/CybercentreCanada/assemblyline-core)](./LICENSE.md)
+
+# Assemblyline 4 - Core
+
+This repository provides cores services for Assemblyline 4.
+
+## Image variants and tags
+
+| **Tag Type** | **Description**                                                                                  |      **Example Tag**       |
+| :----------: | :----------------------------------------------------------------------------------------------- | :------------------------: |
+|    latest    | The most recent build (can be unstable).                                                         |          `latest`          |
+|  build_type  | The type of build used. `dev` is the latest unstable build. `stable` is the latest stable build. |     `stable` or `dev`      |
+|    series    | Complete build details, including version and build type: `version.buildType`.                   | `4.5.stable`, `4.5.1.dev3` |
+
+## Components
+
+### Alerter
+
+Create alerts for the different submissions in the system.
+
+```bash
+docker run --name alerter cccs/assemblyline-core python -m assemblyline_core.alerter.run_alerter
+```
+
+### Archiver
+
+Archives submissions and their results & files into the archive.
+
+```bash
+docker run --name archiver cccs/assemblyline-core python -m assemblyline_core.archiver.run_archiver
+```
+
+### Dispatcher
+
+Route the files in the system while a submission is tacking place. Make sure all files during a submission are completed by all required services.
+
+```bash
+docker run --name dispatcher cccs/assemblyline-core python -m assemblyline_core.dispatching
+```
+
+### Expiry
+
+Delete submissions and their results when their time-to-live expires.
+
+```bash
+docker run --name expiry cccs/assemblyline-core python -m assemblyline_core.expiry.run_expiry
+```
+
+### Ingester
+
+Move ingested files from the priority queues to the processing queues.
+
+```bash
+docker run --name ingester cccs/assemblyline-core python -m assemblyline_core.ingester
+```
+
+### Metrics
+
+Generates metrics of the different components in the system.
+
+#### Heartbeat Manager
+
+```bash
+docker run --name heartbeat cccs/assemblyline-core python -m assemblyline_core.metrics.run_heartbeat_manager
+```
+
+#### Metrics Aggregator
+
+```bash
+docker run --name metrics cccs/assemblyline-core python -m assemblyline_core.metrics.run_metrics_aggregator
+```
+
+#### Statistics Aggregator
+
+```bash
+docker run --name statistics cccs/assemblyline-core python -m assemblyline_core.metrics.run_statistics_aggregator
+```
+
+### Scaler
+
+Spin up and down services in the system depending on the load.
+
+```bash
+docker run --name scaler cccs/assemblyline-core python -m assemblyline_core.scaler.run_scaler
+```
+
+### Updater
+
+Make sure the different services get their latest update files.
+
+```bash
+docker run --name updater cccs/assemblyline-core python -m assemblyline_core.updater.run_updater
+```
+
+### Workflow
+
+Run the different workflows in the system and apply their labels, priority and status.
+
+```bash
+docker run --name workflow cccs/assemblyline-core python -m assemblyline_core.workflow.run_workflow
+```
+
+## Documentation
+
+For more information about these Assemblyline components, follow this [overview](https://cybercentrecanada.github.io/assemblyline4_docs/overview/architecture/) of the system's architecture.
+
+---
+
+# Assemblyline 4 - Core
+
+Ce dépôt fournit des services de base pour Assemblyline 4.
+
+## Variantes et étiquettes d'image
+
+| **Type d'étiquette** | **Description**                                                                                                  |  **Exemple d'étiquette**   |
+| :------------------: | :--------------------------------------------------------------------------------------------------------------- | :------------------------: |
+|       dernière       | La version la plus récente (peut être instable).                                                                 |          `latest`          |
+|      build_type      | Le type de compilation utilisé. `dev` est la dernière version instable. `stable` est la dernière version stable. |     `stable` ou `dev`      |
+|        séries        | Le détail de compilation utilisé, incluant la version et le type de compilation : `version.buildType`.           | `4.5.stable`, `4.5.1.dev3` |
+
+## Composants
+
+### Alerter
+
+Crée des alertes pour les différentes soumissions dans le système.
+
+```bash
+docker run --name alerter cccs/assemblyline-core python -m assemblyline_core.alerter.run_alerter
+```
+
+### Archiver
+
+Archivage des soumissions, de leurs résultats et des fichiers dans l'archive.
+
+```bash
+docker run --name archiver cccs/assemblyline-core python -m assemblyline_core.archiver.run_archiver
+```
+
+### Dispatcher
+
+Achemine les fichiers dans le système durant une soumission. S'assure que tous les fichiers de la soumission courante soient complétés par tous les services requis.
+
+```bash
+docker run --name dispatcher cccs/assemblyline-core python -m assemblyline_core.dispatching
+```
+
+### Expiration
+
+Supprimer les soumissions et leurs résultats à l'expiration de leur durée de vie.
+
+```bash
+docker run --name expiry cccs/assemblyline-core python -m assemblyline_core.expiry.run_expiry
+```
+
+### Ingester
+
+Déplace les fichiers ingérés des files d'attente prioritaires vers les files d'attente de traitement.
+
+```bash
+docker run --name ingester cccs/assemblyline-core python -m assemblyline_core.ingester
+```
+
+### Métriques
+
+Génère des métriques des différents composants du système.
+
+#### Heartbeat Manager
+
+```bash
+docker run --name heartbeat cccs/assemblyline-core python -m assemblyline_core.metrics.run_heartbeat_manager
+```
+
+#### Agrégateur de métriques
+
+```bash
+docker run --name metrics cccs/assemblyline-core python -m assemblyline_core.metrics.run_metrics_aggregator
+```
+
+##### Agrégateur de statistiques
+
+```bash
+docker run --name statistics cccs/assemblyline-core python -m assemblyline_core.metrics.run_statistics_aggregator
+```
+
+### Scaler
+
+Augmente et diminue les services dans le système en fonction de la charge.
+
+```bash
+docker run --name scaler cccs/assemblyline-core python -m assemblyline_core.scaler.run_scaler
+```
+
+### Mise à jour
+
+Assure que les différents services reçoivent leurs derniers fichiers de mise à jour.
+
+```bash
+docker run --name updater cccs/assemblyline-core python -m assemblyline_core.updater.run_updater
+```
+
+### Workflow
+
+Exécute les différents flux de travail dans le système et appliquer leurs étiquettes, leur priorité et leur statut.
+
+```bash
+docker run --name workflow cccs/assemblyline-core python -m assemblyline_core.workflow.run_workflow
+```
+
+## Documentation
+
+Pour plus d'informations sur ces composants Assemblyline, suivez ce [overview](https://cybercentrecanada.github.io/assemblyline4_docs/overview/architecture/) de l'architecture du système.

assemblyline_core-4.5.0.69/README.md

@@ -0,0 +1,216 @@
+[![Discord](https://img.shields.io/badge/chat-on%20discord-7289da.svg?sanitize=true)](https://discord.gg/GUAy9wErNu)
+[![](https://img.shields.io/discord/908084610158714900)](https://discord.gg/GUAy9wErNu)
+[![Static Badge](https://img.shields.io/badge/github-assemblyline-blue?logo=github)](https://github.com/CybercentreCanada/assemblyline)
+[![Static Badge](https://img.shields.io/badge/github-assemblyline--core-blue?logo=github)](https://github.com/CybercentreCanada/assemblyline-core)
+[![GitHub Issues or Pull Requests by label](https://img.shields.io/github/issues/CybercentreCanada/assemblyline/core)](https://github.com/CybercentreCanada/assemblyline/issues?q=is:issue+is:open+label:core)
+[![License](https://img.shields.io/github/license/CybercentreCanada/assemblyline-core)](./LICENSE.md)
+
+# Assemblyline 4 - Core
+
+This repository provides cores services for Assemblyline 4.
+
+## Image variants and tags
+
+| **Tag Type** | **Description**                                                                                  |      **Example Tag**       |
+| :----------: | :----------------------------------------------------------------------------------------------- | :------------------------: |
+|    latest    | The most recent build (can be unstable).                                                         |          `latest`          |
+|  build_type  | The type of build used. `dev` is the latest unstable build. `stable` is the latest stable build. |     `stable` or `dev`      |
+|    series    | Complete build details, including version and build type: `version.buildType`.                   | `4.5.stable`, `4.5.1.dev3` |
+
+## Components
+
+### Alerter
+
+Create alerts for the different submissions in the system.
+
+```bash
+docker run --name alerter cccs/assemblyline-core python -m assemblyline_core.alerter.run_alerter
+```
+
+### Archiver
+
+Archives submissions and their results & files into the archive.
+
+```bash
+docker run --name archiver cccs/assemblyline-core python -m assemblyline_core.archiver.run_archiver
+```
+
+### Dispatcher
+
+Route the files in the system while a submission is tacking place. Make sure all files during a submission are completed by all required services.
+
+```bash
+docker run --name dispatcher cccs/assemblyline-core python -m assemblyline_core.dispatching
+```
+
+### Expiry
+
+Delete submissions and their results when their time-to-live expires.
+
+```bash
+docker run --name expiry cccs/assemblyline-core python -m assemblyline_core.expiry.run_expiry
+```
+
+### Ingester
+
+Move ingested files from the priority queues to the processing queues.
+
+```bash
+docker run --name ingester cccs/assemblyline-core python -m assemblyline_core.ingester
+```
+
+### Metrics
+
+Generates metrics of the different components in the system.
+
+#### Heartbeat Manager
+
+```bash
+docker run --name heartbeat cccs/assemblyline-core python -m assemblyline_core.metrics.run_heartbeat_manager
+```
+
+#### Metrics Aggregator
+
+```bash
+docker run --name metrics cccs/assemblyline-core python -m assemblyline_core.metrics.run_metrics_aggregator
+```
+
+#### Statistics Aggregator
+
+```bash
+docker run --name statistics cccs/assemblyline-core python -m assemblyline_core.metrics.run_statistics_aggregator
+```
+
+### Scaler
+
+Spin up and down services in the system depending on the load.
+
+```bash
+docker run --name scaler cccs/assemblyline-core python -m assemblyline_core.scaler.run_scaler
+```
+
+### Updater
+
+Make sure the different services get their latest update files.
+
+```bash
+docker run --name updater cccs/assemblyline-core python -m assemblyline_core.updater.run_updater
+```
+
+### Workflow
+
+Run the different workflows in the system and apply their labels, priority and status.
+
+```bash
+docker run --name workflow cccs/assemblyline-core python -m assemblyline_core.workflow.run_workflow
+```
+
+## Documentation
+
+For more information about these Assemblyline components, follow this [overview](https://cybercentrecanada.github.io/assemblyline4_docs/overview/architecture/) of the system's architecture.
+
+---
+
+# Assemblyline 4 - Core
+
+Ce dépôt fournit des services de base pour Assemblyline 4.
+
+## Variantes et étiquettes d'image
+
+| **Type d'étiquette** | **Description**                                                                                                  |  **Exemple d'étiquette**   |
+| :------------------: | :--------------------------------------------------------------------------------------------------------------- | :------------------------: |
+|       dernière       | La version la plus récente (peut être instable).                                                                 |          `latest`          |
+|      build_type      | Le type de compilation utilisé. `dev` est la dernière version instable. `stable` est la dernière version stable. |     `stable` ou `dev`      |
+|        séries        | Le détail de compilation utilisé, incluant la version et le type de compilation : `version.buildType`.           | `4.5.stable`, `4.5.1.dev3` |
+
+## Composants
+
+### Alerter
+
+Crée des alertes pour les différentes soumissions dans le système.
+
+```bash
+docker run --name alerter cccs/assemblyline-core python -m assemblyline_core.alerter.run_alerter
+```
+
+### Archiver
+
+Archivage des soumissions, de leurs résultats et des fichiers dans l'archive.
+
+```bash
+docker run --name archiver cccs/assemblyline-core python -m assemblyline_core.archiver.run_archiver
+```
+
+### Dispatcher
+
+Achemine les fichiers dans le système durant une soumission. S'assure que tous les fichiers de la soumission courante soient complétés par tous les services requis.
+
+```bash
+docker run --name dispatcher cccs/assemblyline-core python -m assemblyline_core.dispatching
+```
+
+### Expiration
+
+Supprimer les soumissions et leurs résultats à l'expiration de leur durée de vie.
+
+```bash
+docker run --name expiry cccs/assemblyline-core python -m assemblyline_core.expiry.run_expiry
+```
+
+### Ingester
+
+Déplace les fichiers ingérés des files d'attente prioritaires vers les files d'attente de traitement.
+
+```bash
+docker run --name ingester cccs/assemblyline-core python -m assemblyline_core.ingester
+```
+
+### Métriques
+
+Génère des métriques des différents composants du système.
+
+#### Heartbeat Manager
+
+```bash
+docker run --name heartbeat cccs/assemblyline-core python -m assemblyline_core.metrics.run_heartbeat_manager
+```
+
+#### Agrégateur de métriques
+
+```bash
+docker run --name metrics cccs/assemblyline-core python -m assemblyline_core.metrics.run_metrics_aggregator
+```
+
+##### Agrégateur de statistiques
+
+```bash
+docker run --name statistics cccs/assemblyline-core python -m assemblyline_core.metrics.run_statistics_aggregator
+```
+
+### Scaler
+
+Augmente et diminue les services dans le système en fonction de la charge.
+
+```bash
+docker run --name scaler cccs/assemblyline-core python -m assemblyline_core.scaler.run_scaler
+```
+
+### Mise à jour
+
+Assure que les différents services reçoivent leurs derniers fichiers de mise à jour.
+
+```bash
+docker run --name updater cccs/assemblyline-core python -m assemblyline_core.updater.run_updater
+```
+
+### Workflow
+
+Exécute les différents flux de travail dans le système et appliquer leurs étiquettes, leur priorité et leur statut.
+
+```bash
+docker run --name workflow cccs/assemblyline-core python -m assemblyline_core.workflow.run_workflow
+```
+
+## Documentation
+
+Pour plus d'informations sur ces composants Assemblyline, suivez ce [overview](https://cybercentrecanada.github.io/assemblyline4_docs/overview/architecture/) de l'architecture du système.

assemblyline_core-4.5.0.69/assemblyline_core/VERSION

@@ -0,0 +1 @@
+4.5.0.69

{assemblyline-core-4.5.0.67 → assemblyline_core-4.5.0.69}/assemblyline_core/dispatching/dispatcher.py

@@ -182,7 +182,7 @@ class TemporaryFileData:
             self.shared_values[key] = []
 
         # make sure the input is the right type
-        if not isinstance(values, list | tuple):
+        if not isinstance(values, (list, tuple)):
             return False
 
         # Add each value one at a time testing for new values

{assemblyline-core-4.5.0.67 → assemblyline_core-4.5.0.69}/assemblyline_core/metrics/helper.py

@@ -1,7 +1,8 @@
 import time
-
 import elasticsearch
 
+from os import environ
+
 from assemblyline.datastore.exceptions import ILMException
 
 MAX_RETRY_BACKOFF = 10
@@ -64,6 +65,11 @@ def create_ilm_policy(es, name, archive_config):
 def ensure_indexes(log, es, config, indexes, datastream_enabled=False):
     for index_type in indexes:
         try:
+            # Get the shard/replica configuration for metric-based indices from the environment
+            # Otherwise default to values for a single-node Elastic cluster
+            replicas = environ.get(f"ELASTIC_{index_type.upper()}_METRICS_REPLICAS", environ.get('ELASTIC_DEFAULT_METRICS_REPLICAS', 0))
+            shards = environ.get(f"ELASTIC_{index_type.upper()}_METRICS_SHARDS", environ.get('ELASTIC_DEFAULT_METRICS_SHARDS', 1))
+
             index = f"al_metrics_{index_type}_ds" if datastream_enabled else f"al_metrics_{index_type}"
             policy = f"{index}_policy"
             while True:
@@ -83,7 +89,9 @@ def ensure_indexes(log, es, config, indexes, datastream_enabled=False):
                 template_body = {
                     "settings": {
                         "index.lifecycle.name": policy,
-                        "index.codec": "best_compression"
+                        "index.codec": "best_compression",
+                        "index.number_of_replicas": replicas,
+                        "index.number_of_shards": shards
                     }
                 }
                 put_template_func = None

{assemblyline-core-4.5.0.67 → assemblyline_core-4.5.0.69}/assemblyline_core/scaler/controllers/kubernetes_ctl.py

@@ -1142,7 +1142,7 @@ class KubernetesController(ControllerInterface):
             service = self.api.read_namespaced_service(deployment_name, self.namespace)
             service.metadata.labels = labels
             service.spec.selector = labels
-            service.spec.ports = [V1ServicePort(port=int(_p)) for _p in spec.container.ports]
+            service.spec.ports = [V1ServicePort(port=int(_p), name=f"port-{_p}") for _p in spec.container.ports]
             self.api.patch_namespaced_service(deployment_name, self.namespace, service)
         except ApiException as error:
             if error.status != 404:
@@ -1152,7 +1152,7 @@ class KubernetesController(ControllerInterface):
                 spec=V1ServiceSpec(
                     cluster_ip='None',
                     selector=labels,
-                    ports=[V1ServicePort(port=int(_p)) for _p in spec.container.ports]
+                    ports=[V1ServicePort(port=int(_p), name=f"port-{_p}") for _p in spec.container.ports]
                 )
             )
             self.api.create_namespaced_service(self.namespace, service)

assemblyline_core-4.5.0.69/assemblyline_core.egg-info/PKG-INFO

@@ -0,0 +1,255 @@
+Metadata-Version: 2.2
+Name: assemblyline-core
+Version: 4.5.0.69
+Summary: Assemblyline 4 - Core components
+Home-page: https://github.com/CybercentreCanada/assemblyline-core/
+Author: CCCS Assemblyline development team
+Author-email: assemblyline@cyber.gc.ca
+License: MIT
+Keywords: assemblyline automated malware analysis gc canada cse-cst cse cst cyber cccs
+Classifier: Development Status :: 5 - Production/Stable
+Classifier: Intended Audience :: Developers
+Classifier: Topic :: Software Development :: Libraries
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Programming Language :: Python :: 3.7
+Classifier: Programming Language :: Python :: 3.8
+Classifier: Programming Language :: Python :: 3.9
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Description-Content-Type: text/markdown
+License-File: LICENCE.md
+Requires-Dist: assemblyline
+Requires-Dist: docker
+Requires-Dist: kubernetes
+Provides-Extra: test
+Requires-Dist: pytest; extra == "test"
+Requires-Dist: assemblyline_client; extra == "test"
+Dynamic: author
+Dynamic: author-email
+Dynamic: classifier
+Dynamic: description
+Dynamic: description-content-type
+Dynamic: home-page
+Dynamic: keywords
+Dynamic: license
+Dynamic: provides-extra
+Dynamic: requires-dist
+Dynamic: summary
+
+[![Discord](https://img.shields.io/badge/chat-on%20discord-7289da.svg?sanitize=true)](https://discord.gg/GUAy9wErNu)
+[![](https://img.shields.io/discord/908084610158714900)](https://discord.gg/GUAy9wErNu)
+[![Static Badge](https://img.shields.io/badge/github-assemblyline-blue?logo=github)](https://github.com/CybercentreCanada/assemblyline)
+[![Static Badge](https://img.shields.io/badge/github-assemblyline--core-blue?logo=github)](https://github.com/CybercentreCanada/assemblyline-core)
+[![GitHub Issues or Pull Requests by label](https://img.shields.io/github/issues/CybercentreCanada/assemblyline/core)](https://github.com/CybercentreCanada/assemblyline/issues?q=is:issue+is:open+label:core)
+[![License](https://img.shields.io/github/license/CybercentreCanada/assemblyline-core)](./LICENSE.md)
+
+# Assemblyline 4 - Core
+
+This repository provides cores services for Assemblyline 4.
+
+## Image variants and tags
+
+| **Tag Type** | **Description**                                                                                  |      **Example Tag**       |
+| :----------: | :----------------------------------------------------------------------------------------------- | :------------------------: |
+|    latest    | The most recent build (can be unstable).                                                         |          `latest`          |
+|  build_type  | The type of build used. `dev` is the latest unstable build. `stable` is the latest stable build. |     `stable` or `dev`      |
+|    series    | Complete build details, including version and build type: `version.buildType`.                   | `4.5.stable`, `4.5.1.dev3` |
+
+## Components
+
+### Alerter
+
+Create alerts for the different submissions in the system.
+
+```bash
+docker run --name alerter cccs/assemblyline-core python -m assemblyline_core.alerter.run_alerter
+```
+
+### Archiver
+
+Archives submissions and their results & files into the archive.
+
+```bash
+docker run --name archiver cccs/assemblyline-core python -m assemblyline_core.archiver.run_archiver
+```
+
+### Dispatcher
+
+Route the files in the system while a submission is tacking place. Make sure all files during a submission are completed by all required services.
+
+```bash
+docker run --name dispatcher cccs/assemblyline-core python -m assemblyline_core.dispatching
+```
+
+### Expiry
+
+Delete submissions and their results when their time-to-live expires.
+
+```bash
+docker run --name expiry cccs/assemblyline-core python -m assemblyline_core.expiry.run_expiry
+```
+
+### Ingester
+
+Move ingested files from the priority queues to the processing queues.
+
+```bash
+docker run --name ingester cccs/assemblyline-core python -m assemblyline_core.ingester
+```
+
+### Metrics
+
+Generates metrics of the different components in the system.
+
+#### Heartbeat Manager
+
+```bash
+docker run --name heartbeat cccs/assemblyline-core python -m assemblyline_core.metrics.run_heartbeat_manager
+```
+
+#### Metrics Aggregator
+
+```bash
+docker run --name metrics cccs/assemblyline-core python -m assemblyline_core.metrics.run_metrics_aggregator
+```
+
+#### Statistics Aggregator
+
+```bash
+docker run --name statistics cccs/assemblyline-core python -m assemblyline_core.metrics.run_statistics_aggregator
+```
+
+### Scaler
+
+Spin up and down services in the system depending on the load.
+
+```bash
+docker run --name scaler cccs/assemblyline-core python -m assemblyline_core.scaler.run_scaler
+```
+
+### Updater
+
+Make sure the different services get their latest update files.
+
+```bash
+docker run --name updater cccs/assemblyline-core python -m assemblyline_core.updater.run_updater
+```
+
+### Workflow
+
+Run the different workflows in the system and apply their labels, priority and status.
+
+```bash
+docker run --name workflow cccs/assemblyline-core python -m assemblyline_core.workflow.run_workflow
+```
+
+## Documentation
+
+For more information about these Assemblyline components, follow this [overview](https://cybercentrecanada.github.io/assemblyline4_docs/overview/architecture/) of the system's architecture.
+
+---
+
+# Assemblyline 4 - Core
+
+Ce dépôt fournit des services de base pour Assemblyline 4.
+
+## Variantes et étiquettes d'image
+
+| **Type d'étiquette** | **Description**                                                                                                  |  **Exemple d'étiquette**   |
+| :------------------: | :--------------------------------------------------------------------------------------------------------------- | :------------------------: |
+|       dernière       | La version la plus récente (peut être instable).                                                                 |          `latest`          |
+|      build_type      | Le type de compilation utilisé. `dev` est la dernière version instable. `stable` est la dernière version stable. |     `stable` ou `dev`      |
+|        séries        | Le détail de compilation utilisé, incluant la version et le type de compilation : `version.buildType`.           | `4.5.stable`, `4.5.1.dev3` |
+
+## Composants
+
+### Alerter
+
+Crée des alertes pour les différentes soumissions dans le système.
+
+```bash
+docker run --name alerter cccs/assemblyline-core python -m assemblyline_core.alerter.run_alerter
+```
+
+### Archiver
+
+Archivage des soumissions, de leurs résultats et des fichiers dans l'archive.
+
+```bash
+docker run --name archiver cccs/assemblyline-core python -m assemblyline_core.archiver.run_archiver
+```
+
+### Dispatcher
+
+Achemine les fichiers dans le système durant une soumission. S'assure que tous les fichiers de la soumission courante soient complétés par tous les services requis.
+
+```bash
+docker run --name dispatcher cccs/assemblyline-core python -m assemblyline_core.dispatching
+```
+
+### Expiration
+
+Supprimer les soumissions et leurs résultats à l'expiration de leur durée de vie.
+
+```bash
+docker run --name expiry cccs/assemblyline-core python -m assemblyline_core.expiry.run_expiry
+```
+
+### Ingester
+
+Déplace les fichiers ingérés des files d'attente prioritaires vers les files d'attente de traitement.
+
+```bash
+docker run --name ingester cccs/assemblyline-core python -m assemblyline_core.ingester
+```
+
+### Métriques
+
+Génère des métriques des différents composants du système.
+
+#### Heartbeat Manager
+
+```bash
+docker run --name heartbeat cccs/assemblyline-core python -m assemblyline_core.metrics.run_heartbeat_manager
+```
+
+#### Agrégateur de métriques
+
+```bash
+docker run --name metrics cccs/assemblyline-core python -m assemblyline_core.metrics.run_metrics_aggregator
+```
+
+##### Agrégateur de statistiques
+
+```bash
+docker run --name statistics cccs/assemblyline-core python -m assemblyline_core.metrics.run_statistics_aggregator
+```
+
+### Scaler
+
+Augmente et diminue les services dans le système en fonction de la charge.
+
+```bash
+docker run --name scaler cccs/assemblyline-core python -m assemblyline_core.scaler.run_scaler
+```
+
+### Mise à jour
+
+Assure que les différents services reçoivent leurs derniers fichiers de mise à jour.
+
+```bash
+docker run --name updater cccs/assemblyline-core python -m assemblyline_core.updater.run_updater
+```
+
+### Workflow
+
+Exécute les différents flux de travail dans le système et appliquer leurs étiquettes, leur priorité et leur statut.
+
+```bash
+docker run --name workflow cccs/assemblyline-core python -m assemblyline_core.workflow.run_workflow
+```
+
+## Documentation
+
+Pour plus d'informations sur ces composants Assemblyline, suivez ce [overview](https://cybercentrecanada.github.io/assemblyline4_docs/overview/architecture/) de l'architecture du système.

assemblyline-core-4.5.0.67/PKG-INFO

@@ -1,60 +0,0 @@
-Metadata-Version: 2.1
-Name: assemblyline-core
-Version: 4.5.0.67
-Summary: Assemblyline 4 - Core components
-Home-page: https://github.com/CybercentreCanada/assemblyline-core/
-Author: CCCS Assemblyline development team
-Author-email: assemblyline@cyber.gc.ca
-License: MIT
-Keywords: assemblyline automated malware analysis gc canada cse-cst cse cst cyber cccs
-Classifier: Development Status :: 5 - Production/Stable
-Classifier: Intended Audience :: Developers
-Classifier: Topic :: Software Development :: Libraries
-Classifier: License :: OSI Approved :: MIT License
-Classifier: Programming Language :: Python :: 3.7
-Classifier: Programming Language :: Python :: 3.8
-Classifier: Programming Language :: Python :: 3.9
-Classifier: Programming Language :: Python :: 3.10
-Classifier: Programming Language :: Python :: 3.11
-Classifier: Programming Language :: Python :: 3.12
-Description-Content-Type: text/markdown
-Provides-Extra: test
-License-File: LICENCE.md
-
-# Assemblyline 4 - Core services
-
-This repository provides cores services for Assemblyline 4.
-
-#### Core Services 
-
-##### Alerter 
-
-Create alerts for the different submissions in the system.
-
-##### Dispatcher
-
-Route the files in the system while a submission is tacking place. Make sure all files during a submission are completed by all required services.
-
-##### Expiry
-
-Delete submissions and their results when their TTL expires.
-
-##### Ingester
-
-Move ingested files from the priority queues to the processing queues.
-
-##### Metrics
-
-Generates metrics of the different components in the system.
-
-##### Scaler
-
-Spin up and down services in the system depending on the load.
-
-##### Updater
-
-Make sure the different services get their latest update files.
-
-##### Workflow
-
-Run the different workflows in the system and apply their labels, priority and status.

assemblyline-core-4.5.0.67/README.md

@@ -1,37 +0,0 @@
-# Assemblyline 4 - Core services
-
-This repository provides cores services for Assemblyline 4.
-
-#### Core Services 
-
-##### Alerter 
-
-Create alerts for the different submissions in the system.
-
-##### Dispatcher
-
-Route the files in the system while a submission is tacking place. Make sure all files during a submission are completed by all required services.
-
-##### Expiry
-
-Delete submissions and their results when their TTL expires.
-
-##### Ingester
-
-Move ingested files from the priority queues to the processing queues.
-
-##### Metrics
-
-Generates metrics of the different components in the system.
-
-##### Scaler
-
-Spin up and down services in the system depending on the load.
-
-##### Updater
-
-Make sure the different services get their latest update files.
-
-##### Workflow
-
-Run the different workflows in the system and apply their labels, priority and status.

assemblyline-core-4.5.0.67/assemblyline_core/VERSION

@@ -1 +0,0 @@
-4.5.0.67

assemblyline-core-4.5.0.67/assemblyline_core.egg-info/PKG-INFO

@@ -1,60 +0,0 @@
-Metadata-Version: 2.1
-Name: assemblyline-core
-Version: 4.5.0.67
-Summary: Assemblyline 4 - Core components
-Home-page: https://github.com/CybercentreCanada/assemblyline-core/
-Author: CCCS Assemblyline development team
-Author-email: assemblyline@cyber.gc.ca
-License: MIT
-Keywords: assemblyline automated malware analysis gc canada cse-cst cse cst cyber cccs
-Classifier: Development Status :: 5 - Production/Stable
-Classifier: Intended Audience :: Developers
-Classifier: Topic :: Software Development :: Libraries
-Classifier: License :: OSI Approved :: MIT License
-Classifier: Programming Language :: Python :: 3.7
-Classifier: Programming Language :: Python :: 3.8
-Classifier: Programming Language :: Python :: 3.9
-Classifier: Programming Language :: Python :: 3.10
-Classifier: Programming Language :: Python :: 3.11
-Classifier: Programming Language :: Python :: 3.12
-Description-Content-Type: text/markdown
-Provides-Extra: test
-License-File: LICENCE.md
-
-# Assemblyline 4 - Core services
-
-This repository provides cores services for Assemblyline 4.
-
-#### Core Services 
-
-##### Alerter 
-
-Create alerts for the different submissions in the system.
-
-##### Dispatcher
-
-Route the files in the system while a submission is tacking place. Make sure all files during a submission are completed by all required services.
-
-##### Expiry
-
-Delete submissions and their results when their TTL expires.
-
-##### Ingester
-
-Move ingested files from the priority queues to the processing queues.
-
-##### Metrics
-
-Generates metrics of the different components in the system.
-
-##### Scaler
-
-Spin up and down services in the system depending on the load.
-
-##### Updater
-
-Make sure the different services get their latest update files.
-
-##### Workflow
-
-Run the different workflows in the system and apply their labels, priority and status.