rccn-gen 1.0.0__tar.gz

rccn_gen-1.0.0/.gitignore

@@ -0,0 +1,21 @@
+*.rs
+*.DS_Store
+*.ipynb
+*.pyc
+venv/
+examples/
+tests/
+*.diff
+*.rs
+*.orig
+*.rej
+*.lock
+__pycache__/
+*target/
+*.xml
+*.whl
+*.egg-info/
+/dist
+rccn_usr_com_app/Cargo.toml
+.rccn_diffs/
+.rccn_snapshots/

rccn_gen-1.0.0/.gitlab-ci.yml

@@ -0,0 +1,16 @@
+stages:
+  - deploy
+deploy:
+  stage: deploy
+  script:
+    - python3 -m venv .venv
+    - source .venv/bin/activate
+    - pip install build twine
+    - python -m build
+    - python3 -m twine upload --verbose --repository pypi dist/* -u __token__ -p $RCCN_3_PYPI
+  only:
+    - main
+  before_script:
+    - apt-get update
+    - apt-get install -y python3 python3-pip
+    - apt install -y python3.11-venv

rccn_gen-1.0.0/PKG-INFO

@@ -0,0 +1,123 @@
+Metadata-Version: 2.4
+Name: rccn_gen
+Version: 1.0.0
+Summary: A python based generator for RACCOON OS source files in Rust from yamcs-pymdb config files.
+Project-URL: Homepage, https://gitlab.com/rccn/pymdb_code_generation
+Project-URL: Issues, https://gitlab.com/rccn/pymdb_code_generation/issues
+Author-email: Fabian Krech <f.krech@tu-berlin.de>
+License-Expression: GPL-3.0
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3
+Requires-Python: >=3.8
+Requires-Dist: yamcs-pymdb>=0.1.0
+Description-Content-Type: text/markdown
+
+# RCCN Code Generator
+This generator is used to generate Rust files to deploy on the RACCOON OS satellite based on the pymdb config files used to generate the ground station XTCE files.
+## Setup
+- Pull the repo
+- Set up a virtual python environment with python 13 kernel and activate:
+    ```zsh
+    python -m venv .venv
+    source .venv/bin/activate
+    ```
+- Install pymdb with `pip install yamcs-pymdb`
+
+## Using the Generator
+The generator is based on pymdb and uses the same structure. Where pymdb gives the user freedom in defining systems, subsystems and their respective relations, the definitions for rust code generation is more restricted. For the rust generation, the user is binded to the following classes:
+- Application,
+- Service, and
+- RCCNCommand.
+
+All classes inherit from pymdb's Subsystem class and extend their functionality. This means that an existing pymdb definition can be used to generate rust code by renaming the respective instances. No functionality for pymdb's XTCE generation will be lost. 
+
+A root system may be defined for the satellite.
+```python
+root_system = System("Satellite")
+```
+
+### Application
+An application can be defined with the following statement.
+```python
+app = Application(system=root_system, name="ExampleApp", apid=42)
+```
+It has the obligatory arguments **system**, **name** and **apid**. After all Applications, Services and RCCNCommands are defined, the rust code generator can be called on the application with `app.generate_rccn_code()`.
+
+### Service
+
+A service may be defined with the following command.
+```python
+service = Service(name="ExampleService", system=app, service_id = 131)
+```
+It has the obligatory arguments **name** and **system**. The system corresponds to the application where the service is associated to. Note that each service has one associated app. A service cannot be associated to more than one apps. You may think of the Application-Service-Command structure as a mathematical tree, where merging branches are not allowed. However, you can create multiple instances of the same service and associate them to different applications, or create multiple identical command instances and associate them to different services. 
+
+### RCCNCommand
+An RCCNCommand can be defined with the following statement.
+```python
+RCCNCommand(
+    system=service,
+    assignments={"subtype": 2},
+    name="StopProcess",
+    arguments=[StringArgument("name", encoding=StringEncoding())],
+)
+```
+Obligatory arguments are **system**, **base**, **name** and **arguments**. The latter can be an empty list. The definition must contain a subtype definition in the assignment property, like shown in the example. 
+
+## Output
+From the python configuration, the `main.rs`, `service.rs`, `command.rs`, `mod.rs`, `Cargo.toml` and `telemetry.rs` files are generated and are structured accordingly:
+- rccn_usr_example_app/
+    - Cargo.toml
+    - src/
+        - main.rs
+        - example_service/
+            - command.rs
+            - service.rs
+            - mod.rs
+            - telemetry.rs
+
+The `Cargo.toml` and `mod.rs` files are generated only if the files don't exist already, as their content doesn't depend on the pymdb config. No user changes will be overwritten. The command and service files are created for each service in the application. 
+
+## How It Works
+The code is generated from templates in the `text_modules` folder. Base templates define the structure for all generated files, respectively. In the templates, two types of keywords can be found and are indicated by `<<KEYWORD>>` encapsulation. 
+
+Keywords beginning with `VAR_` point to a value in the python config created by the user, as shown above. Examples for this are the application identifier (APID) with `<<VAR_APID>>` or the service name with `<<VAR_SERVICE_NAME_UCASE>>`. 
+
+Keywords beginning with `SERVICE_MODULE` or `COMMAND_MODULE` point to other template files in the same folder. The prefix `SERVICE` or `COMMAND` indicates, that this module should be inserted once for every service in the application or once for every command in the service. In this way, the structure of the generated code can be segmented, organized and restructured without any need to change the code generator itself. 
+
+The keyword `<<SERVICE_MODULE_REGISTER_SERVICE>>` for example can be found in the main template and inserts the contents from the `service_module_register_service.txt` file for every service:
+
+```rust
+let service<<VAR_SERVICE_ID>> = <<VAR_SERVICE_NAME_UCASE>>::new();
+app.register_service(service<<VAR_SERVICE_ID>>);
+```
+
+The variable keywords are replaced with the corresponding values in the python configuration. 
+
+## Editing Generated Files
+The code generator allows for the user to make changes to the generated .rs files directly and to keep those changes if the files are regenerated. For this purpose, snapshots of the .rs files are taken, .diff files are created and user changes are rebased to regenerated .rs files. If this behaviour is not desired, it can be turned off with the commands showed below.
+
+```python
+app.generate_rccn_code(rebase_changes=False) # Turn off rebaseing of user changes to newly generated .rs files
+app.generate_rccn_code(snapshots=False, rebase_changes=False) # Turn of rebaseing and snapshot creation 
+```
+
+Please note that switching off rebasing and snapshot creation means that **existing files will be overwritten** and all changes made prior will be lost. 
+
+### Sequence in File Generation
+With the snapshot and rebase functionality enabled, the following steps are run through during the generation of every file. For this example it is assumed that the file that is about to be generated already exists in the export directory from a previous generation and user changes where made to the generated file since then. 
+
+1. If a snapshot exists in `.rccn_snapshots/generated/`, a diff file containing the changes from the snapshot to the file as it exists in the export directory is created.
+2. The current file in the export directory is copied to `.rccn_snapshots/user/`. A subfolder indicates the time of creation.
+3. The new .rs file is generated based on the pymdb config and exported to the export directory, overwriting the existing file.
+4. The new .rs file is copied to `.rccn_snapshots/generated/` for future use.
+5. The new .rs file is patched using the diff file from step 1.
+
+The sequence from above is changed accordingly if no previous snapshot exists. In the `/generated/` folder, there is only one snapshot per application at one time. And this snapshot always represents the .rs file as it is generated. No user changes to the .rs files are tracked in this snapshot. It is only used to determine the user changes to the .rs file in the export directory since the generation.
+
+Snapshots of the .rs files in the export directory are stored in `/user/`. These can be used to undo code regeneration if conflicts arise during the patching. Please note that by default, only the last 10 user snapshots are stored. You can change this property with the following command.
+
+```python
+app.keep_snapshots = 15 # What ever value you want
+```
+
+With the sequence from above, it becomes apperant that changes to the .rs file in the export directory always trump changes to the pymdb config. If for example, a main.rs file is generated for an application with and APID of 42, and this apid is changed in the main.rs file to 45, this change will persist after regenerating from the python config. Even if changes to the pymdb config where made after the changes to the main.rs file. 

rccn_gen-1.0.0/README.md

@@ -0,0 +1,109 @@
+# RCCN Code Generator
+This generator is used to generate Rust files to deploy on the RACCOON OS satellite based on the pymdb config files used to generate the ground station XTCE files.
+## Setup
+- Pull the repo
+- Set up a virtual python environment with python 13 kernel and activate:
+    ```zsh
+    python -m venv .venv
+    source .venv/bin/activate
+    ```
+- Install pymdb with `pip install yamcs-pymdb`
+
+## Using the Generator
+The generator is based on pymdb and uses the same structure. Where pymdb gives the user freedom in defining systems, subsystems and their respective relations, the definitions for rust code generation is more restricted. For the rust generation, the user is binded to the following classes:
+- Application,
+- Service, and
+- RCCNCommand.
+
+All classes inherit from pymdb's Subsystem class and extend their functionality. This means that an existing pymdb definition can be used to generate rust code by renaming the respective instances. No functionality for pymdb's XTCE generation will be lost. 
+
+A root system may be defined for the satellite.
+```python
+root_system = System("Satellite")
+```
+
+### Application
+An application can be defined with the following statement.
+```python
+app = Application(system=root_system, name="ExampleApp", apid=42)
+```
+It has the obligatory arguments **system**, **name** and **apid**. After all Applications, Services and RCCNCommands are defined, the rust code generator can be called on the application with `app.generate_rccn_code()`.
+
+### Service
+
+A service may be defined with the following command.
+```python
+service = Service(name="ExampleService", system=app, service_id = 131)
+```
+It has the obligatory arguments **name** and **system**. The system corresponds to the application where the service is associated to. Note that each service has one associated app. A service cannot be associated to more than one apps. You may think of the Application-Service-Command structure as a mathematical tree, where merging branches are not allowed. However, you can create multiple instances of the same service and associate them to different applications, or create multiple identical command instances and associate them to different services. 
+
+### RCCNCommand
+An RCCNCommand can be defined with the following statement.
+```python
+RCCNCommand(
+    system=service,
+    assignments={"subtype": 2},
+    name="StopProcess",
+    arguments=[StringArgument("name", encoding=StringEncoding())],
+)
+```
+Obligatory arguments are **system**, **base**, **name** and **arguments**. The latter can be an empty list. The definition must contain a subtype definition in the assignment property, like shown in the example. 
+
+## Output
+From the python configuration, the `main.rs`, `service.rs`, `command.rs`, `mod.rs`, `Cargo.toml` and `telemetry.rs` files are generated and are structured accordingly:
+- rccn_usr_example_app/
+    - Cargo.toml
+    - src/
+        - main.rs
+        - example_service/
+            - command.rs
+            - service.rs
+            - mod.rs
+            - telemetry.rs
+
+The `Cargo.toml` and `mod.rs` files are generated only if the files don't exist already, as their content doesn't depend on the pymdb config. No user changes will be overwritten. The command and service files are created for each service in the application. 
+
+## How It Works
+The code is generated from templates in the `text_modules` folder. Base templates define the structure for all generated files, respectively. In the templates, two types of keywords can be found and are indicated by `<<KEYWORD>>` encapsulation. 
+
+Keywords beginning with `VAR_` point to a value in the python config created by the user, as shown above. Examples for this are the application identifier (APID) with `<<VAR_APID>>` or the service name with `<<VAR_SERVICE_NAME_UCASE>>`. 
+
+Keywords beginning with `SERVICE_MODULE` or `COMMAND_MODULE` point to other template files in the same folder. The prefix `SERVICE` or `COMMAND` indicates, that this module should be inserted once for every service in the application or once for every command in the service. In this way, the structure of the generated code can be segmented, organized and restructured without any need to change the code generator itself. 
+
+The keyword `<<SERVICE_MODULE_REGISTER_SERVICE>>` for example can be found in the main template and inserts the contents from the `service_module_register_service.txt` file for every service:
+
+```rust
+let service<<VAR_SERVICE_ID>> = <<VAR_SERVICE_NAME_UCASE>>::new();
+app.register_service(service<<VAR_SERVICE_ID>>);
+```
+
+The variable keywords are replaced with the corresponding values in the python configuration. 
+
+## Editing Generated Files
+The code generator allows for the user to make changes to the generated .rs files directly and to keep those changes if the files are regenerated. For this purpose, snapshots of the .rs files are taken, .diff files are created and user changes are rebased to regenerated .rs files. If this behaviour is not desired, it can be turned off with the commands showed below.
+
+```python
+app.generate_rccn_code(rebase_changes=False) # Turn off rebaseing of user changes to newly generated .rs files
+app.generate_rccn_code(snapshots=False, rebase_changes=False) # Turn of rebaseing and snapshot creation 
+```
+
+Please note that switching off rebasing and snapshot creation means that **existing files will be overwritten** and all changes made prior will be lost. 
+
+### Sequence in File Generation
+With the snapshot and rebase functionality enabled, the following steps are run through during the generation of every file. For this example it is assumed that the file that is about to be generated already exists in the export directory from a previous generation and user changes where made to the generated file since then. 
+
+1. If a snapshot exists in `.rccn_snapshots/generated/`, a diff file containing the changes from the snapshot to the file as it exists in the export directory is created.
+2. The current file in the export directory is copied to `.rccn_snapshots/user/`. A subfolder indicates the time of creation.
+3. The new .rs file is generated based on the pymdb config and exported to the export directory, overwriting the existing file.
+4. The new .rs file is copied to `.rccn_snapshots/generated/` for future use.
+5. The new .rs file is patched using the diff file from step 1.
+
+The sequence from above is changed accordingly if no previous snapshot exists. In the `/generated/` folder, there is only one snapshot per application at one time. And this snapshot always represents the .rs file as it is generated. No user changes to the .rs files are tracked in this snapshot. It is only used to determine the user changes to the .rs file in the export directory since the generation.
+
+Snapshots of the .rs files in the export directory are stored in `/user/`. These can be used to undo code regeneration if conflicts arise during the patching. Please note that by default, only the last 10 user snapshots are stored. You can change this property with the following command.
+
+```python
+app.keep_snapshots = 15 # What ever value you want
+```
+
+With the sequence from above, it becomes apperant that changes to the .rs file in the export directory always trump changes to the pymdb config. If for example, a main.rs file is generated for an application with and APID of 42, and this apid is changed in the main.rs file to 45, this change will persist after regenerating from the python config. Even if changes to the pymdb config where made after the changes to the main.rs file. 

rccn_gen-1.0.0/pyproject.toml

@@ -0,0 +1,27 @@
+[build-system]
+requires = ["hatchling"]
+build-backend = "hatchling.build"
+
+[project]
+name = "rccn_gen"
+version = "1.0.0"
+authors = [
+  { name="Fabian Krech", email="f.krech@tu-berlin.de" },
+]
+description = "A python based generator for RACCOON OS source files in Rust from yamcs-pymdb config files."
+readme = "README.md"
+requires-python = ">=3.8"
+dependencies = [
+    "yamcs-pymdb>=0.1.0",
+]
+classifiers = [
+    "Programming Language :: Python :: 3",
+    "Operating System :: OS Independent",
+]
+license = "GPL-3.0"
+license-files = ["LICEN[CS]E*"]
+
+[project.urls]
+Homepage = "https://gitlab.com/rccn/pymdb_code_generation"
+Issues = "https://gitlab.com/rccn/pymdb_code_generation/issues"
+