wiliot-certificate 4.4.0a1__tar.gz → 4.4.2__tar.gz

{wiliot_certificate-4.4.0a1/src/wiliot_certificate.egg-info → wiliot_certificate-4.4.2}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: wiliot_certificate
-Version: 4.4.0a1
+Version: 4.4.2
 Summary: A library for certifying Wiliot-compliant boards
 Author-email: Wiliot <support@wiliot.com>
 License: MIT License
@@ -30,13 +30,13 @@ Project-URL: Certified, https://www.wiliot.com/product/ambient-iot-network#partn
 Classifier: Programming Language :: Python :: 3
 Classifier: License :: OSI Approved :: MIT License
 Classifier: Operating System :: OS Independent
-Requires-Python: >=3.13
+Requires-Python: >=3.9
 Description-Content-Type: text/markdown
 License-File: LICENSE
 Requires-Dist: jinja2>=3.1.5
 Requires-Dist: appdirs>=1.4.4
 Requires-Dist: plotly>=6.0.0
-Requires-Dist: numpy>=2.2.2
+Requires-Dist: numpy>=1.21.5
 Requires-Dist: pandas>=2.2.3
 Requires-Dist: colorama>=0.4.6
 Requires-Dist: tabulate>=0.9.0
@@ -52,24 +52,33 @@ Requires-Dist: reportlab>=4.3.1
 Requires-Dist: google-api-python-client>=2.162.0
 Dynamic: license-file
 
-# wiliot-certificate
+# wiliot-certificate Version 4.4.0
 
 <!-- Description -->
-wiliot-certificate is a python library with tools used to test & certify boards and their compatibility with Wiliot's echosystem.
+wiliot-certificate is a Python library that provides tools for testing and certifying boards for compatibility with Wiliot’s ecosystem.
 This python package includes the following CLI utilities:
  - Gateway Certificate (`wlt-cert-gw`)
  - Bridge Certificate (`wlt-cert-brg`)
 
+# Version: 
+wiliot-certificate versions 4.4.0 are compatible with firmware version 4.4.6 (ESP: 4.4.44, BLE: 4.4.93)
+
 ## Installing wiliot-certificate
+Uninstall wiliot-deployment-tools if installed (relevant for old wlt-gw-certificate users):
+````commandline
+pip uninstall wiliot-deployment-tools
+````
+
+Install wiliot-certificate:
 ````commandline
 pip install wiliot-certificate
 ````
 
 ## Using wiliot-certificate
 ### Gateway Certificate
-Test Wiliot GWs capabilities.
-The GW Certificate includes different test that run sequentially to test each capability reported by the GW.
-To run the GW Certificate the GW needs to use a public MQTT Broker (Eclipse):
+Test Wiliot Gateway capabilities.
+The Gateway Certificate includes different test that run sequentially to test each capability reported by the Gateway.
+To run the Gateway Certificate the Gateway needs to use a public MQTT Broker (Eclipse):
 
 Host:	mqtt.eclipseprojects.io
 TLS TCP Port:	8883
@@ -79,59 +88,91 @@ Websocket Port:	80
 
 More information can be found at https://mqtt.eclipseprojects.io/.
 
-#### GW Certificate Release Notes:
+#### Gateway Certificate Release Notes:
 Release:
  - Standalone wiliot-certificate package
  - Python 3.13 support
- - Gw API version 205 support
+ - Gateway API version 205 support
  - Registration test added
  - Bridge OTA stage added under actions
  - Aggregation flag supported by StressTest
  - -update flag compatibility fix. Upgrades bootloader if needed
  - -actions flag to select specific actions to test
+ - ACL (Access control list) test for gateways reporting API version 205 in the connection test
+
+#### The following capabilities are not tested in this version
+ - Access control list stress stress
+ - Validation schema verification
+ - Board type registered within the Board Type Management system
+ - Bridge OTA progress reporting
+
 
 ```
-usage: wlt-gw-certificate [-h] -owner OWNER -gw GW [-suffix SUFFIX] [-tests {connection,uplink,downlink,stress}]
+Usage: wlt-cert-gw [-h] -owner OWNER -gw GW [-suffix SUFFIX] [-tests {connection,uplink,downlink,stress}]
 
 Gateway Certificate - CLI Tool to test Wiliot GWs
 
-required arguments:
+Required arguments:
   -gw GW        Gateway ID
 
-optional arguments:
+Optional arguments:
   -owner OWNER  Owner ID (Required for non-registration tests)
   -tests        Pick specific tests to run
   -actions      Pick specific actions to test during the ActionsTest
   -update       Update the firmware of the test board
   -pps          Pick specific PPS rate for the stress test
-  -agg          Time the uplink stages should wait before processing packets
-  -suffix       Allow for different suffixes after the GW ID in MQTT topics
-  -env          Wiliot envrionment for Registration and bridgeOTA tests
+  -agg          Duration uplink stages wait before processing packets
+  -suffix       Allow for different suffixes after the Gateway ID in MQTT topics
+  -env          Wiliot environment for registration and bridgeOTA tests
   -h, --help    show this help message and exit
   ```
 
 ### Bridge Certificate
-Test Wiliot BRGs capabilities.
-The BRG Certificate includes different tests that run sequentially to test each capability reported by the BRG.
-The BRG Certificate tool uses a public MQTT Broker (Eclipse):
-
-Host:	mqtt.eclipseprojects.io
-TLS TCP Port:	8883
-TLS Websocket Port:	443
-TCP Port:	1883
-Websocket Port:	80
-
-More information can be found at https://mqtt.eclipseprojects.io/.
+Test Wiliot Bridge capabilities.
+The Bridge Certificate includes different tests that run sequentially to test each capability reported by the bridge.
+
+
+# update Gateway sim version :
+- Update your gateway and bridge using Wiliot's platform. (https://platform.wiliot.com/) 
+- Transfer the gateway to dev mode - run the following command: py ut\dev_mode.py --gw [GW] --enable
+- Connect the gateway to your laptop via USB connection:
+- Run the following: wlt-cert-brg --gw SIM --brg <XXXXXXXXXXXX> --port <COM_PORT>
+- For other options of running, see the 'run example' section. 
+
+#### Bridge Certificate Release Notes:
+Release
+- First release of Bridge Certificate – includes validation tests for bridge functionality.
+- Additional details are available in the JSON files.
+
+# The following capabilities are not tested in this version
+
+## Power management
+  - Functionality of energize and transmit in sleep mode
+## Edge management
+  - Timing of heartbeat and interface packets 
+## Module Energy 2400
+  - Functionality of energy pattern, output power and duty cycle
+## Module Energy SUB1G
+  - Functionality of energy pattern and duty cycle 
+## Module Datapath 
+  - RSSI edge cases: -127 and 0 
+  - Functionality of transmission pattern, output power
+  - Pacer interval with channel 10 and 500k modulation
+  - Pacer interval using GEN3 Pixels 
+  - Packet filter: the following configuration - DEBUG, TEMP & DEBUG, TEMPS & DEBUG & ADVANCE
+  - Rx rate feature with extended advertising 
+  - Functionality of adaptive pacer algorithm
+  - Supported Pixels for extended advertising and GEN3
+## Calibration 
+  - Functionality of output power and interval calibration 
+  - Functionality of calibration transmission patterns for the configuration STANDARD & EU & DISABLE
 
-#### BRG Certificate Release Notes:
-1.3.0:
- - FIRST VERSION
 
 ```
-usage: brg_certificate_cli.py [-h] [--brg BRG] [--brg_cloud_connectivity BRG_CLOUD_CONNECTIVITY] [--brg1 BRG1] --gw GW [--data {tags,sim}] [--port PORT] [--clean] [--tl TL] [--run RUN]
+usage: wlt-cert-brg [-h] [--brg BRG] [--brg_cloud_connectivity BRG_CLOUD_CONNECTIVITY] [--brg1 BRG1] --gw GW [--data {tags,sim}] [--port PORT] [--clean] [--tl TL] [--run RUN]
                               [--drun DRUN] [--exit_on_test_failure] [--exit_on_param_failure] [--analyze_interference]
 
-Bridge Certificate CLI
+# Bridge Certificate CLI
 
 options:
   -h, --help            show this help message and exit

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/README.md

@@ -1,21 +1,30 @@
-# wiliot-certificate
+# wiliot-certificate Version 4.4.0
 
 <!-- Description -->
-wiliot-certificate is a python library with tools used to test & certify boards and their compatibility with Wiliot's echosystem.
+wiliot-certificate is a Python library that provides tools for testing and certifying boards for compatibility with Wiliot’s ecosystem.
 This python package includes the following CLI utilities:
  - Gateway Certificate (`wlt-cert-gw`)
  - Bridge Certificate (`wlt-cert-brg`)
 
+# Version: 
+wiliot-certificate versions 4.4.0 are compatible with firmware version 4.4.6 (ESP: 4.4.44, BLE: 4.4.93)
+
 ## Installing wiliot-certificate
+Uninstall wiliot-deployment-tools if installed (relevant for old wlt-gw-certificate users):
+````commandline
+pip uninstall wiliot-deployment-tools
+````
+
+Install wiliot-certificate:
 ````commandline
 pip install wiliot-certificate
 ````
 
 ## Using wiliot-certificate
 ### Gateway Certificate
-Test Wiliot GWs capabilities.
-The GW Certificate includes different test that run sequentially to test each capability reported by the GW.
-To run the GW Certificate the GW needs to use a public MQTT Broker (Eclipse):
+Test Wiliot Gateway capabilities.
+The Gateway Certificate includes different test that run sequentially to test each capability reported by the Gateway.
+To run the Gateway Certificate the Gateway needs to use a public MQTT Broker (Eclipse):
 
 Host:	mqtt.eclipseprojects.io
 TLS TCP Port:	8883
@@ -25,59 +34,91 @@ Websocket Port:	80
 
 More information can be found at https://mqtt.eclipseprojects.io/.
 
-#### GW Certificate Release Notes:
+#### Gateway Certificate Release Notes:
 Release:
  - Standalone wiliot-certificate package
  - Python 3.13 support
- - Gw API version 205 support
+ - Gateway API version 205 support
  - Registration test added
  - Bridge OTA stage added under actions
  - Aggregation flag supported by StressTest
  - -update flag compatibility fix. Upgrades bootloader if needed
  - -actions flag to select specific actions to test
+ - ACL (Access control list) test for gateways reporting API version 205 in the connection test
+
+#### The following capabilities are not tested in this version
+ - Access control list stress stress
+ - Validation schema verification
+ - Board type registered within the Board Type Management system
+ - Bridge OTA progress reporting
+
 
 ```
-usage: wlt-gw-certificate [-h] -owner OWNER -gw GW [-suffix SUFFIX] [-tests {connection,uplink,downlink,stress}]
+Usage: wlt-cert-gw [-h] -owner OWNER -gw GW [-suffix SUFFIX] [-tests {connection,uplink,downlink,stress}]
 
 Gateway Certificate - CLI Tool to test Wiliot GWs
 
-required arguments:
+Required arguments:
   -gw GW        Gateway ID
 
-optional arguments:
+Optional arguments:
   -owner OWNER  Owner ID (Required for non-registration tests)
   -tests        Pick specific tests to run
   -actions      Pick specific actions to test during the ActionsTest
   -update       Update the firmware of the test board
   -pps          Pick specific PPS rate for the stress test
-  -agg          Time the uplink stages should wait before processing packets
-  -suffix       Allow for different suffixes after the GW ID in MQTT topics
-  -env          Wiliot envrionment for Registration and bridgeOTA tests
+  -agg          Duration uplink stages wait before processing packets
+  -suffix       Allow for different suffixes after the Gateway ID in MQTT topics
+  -env          Wiliot environment for registration and bridgeOTA tests
   -h, --help    show this help message and exit
   ```
 
 ### Bridge Certificate
-Test Wiliot BRGs capabilities.
-The BRG Certificate includes different tests that run sequentially to test each capability reported by the BRG.
-The BRG Certificate tool uses a public MQTT Broker (Eclipse):
+Test Wiliot Bridge capabilities.
+The Bridge Certificate includes different tests that run sequentially to test each capability reported by the bridge.
+
+
+# update Gateway sim version :
+- Update your gateway and bridge using Wiliot's platform. (https://platform.wiliot.com/) 
+- Transfer the gateway to dev mode - run the following command: py ut\dev_mode.py --gw [GW] --enable
+- Connect the gateway to your laptop via USB connection:
+- Run the following: wlt-cert-brg --gw SIM --brg <XXXXXXXXXXXX> --port <COM_PORT>
+- For other options of running, see the 'run example' section. 
+
+#### Bridge Certificate Release Notes:
+Release
+- First release of Bridge Certificate – includes validation tests for bridge functionality.
+- Additional details are available in the JSON files.
+
+# The following capabilities are not tested in this version
+
+## Power management
+  - Functionality of energize and transmit in sleep mode
+## Edge management
+  - Timing of heartbeat and interface packets 
+## Module Energy 2400
+  - Functionality of energy pattern, output power and duty cycle
+## Module Energy SUB1G
+  - Functionality of energy pattern and duty cycle 
+## Module Datapath 
+  - RSSI edge cases: -127 and 0 
+  - Functionality of transmission pattern, output power
+  - Pacer interval with channel 10 and 500k modulation
+  - Pacer interval using GEN3 Pixels 
+  - Packet filter: the following configuration - DEBUG, TEMP & DEBUG, TEMPS & DEBUG & ADVANCE
+  - Rx rate feature with extended advertising 
+  - Functionality of adaptive pacer algorithm
+  - Supported Pixels for extended advertising and GEN3
+## Calibration 
+  - Functionality of output power and interval calibration 
+  - Functionality of calibration transmission patterns for the configuration STANDARD & EU & DISABLE
 
-Host:	mqtt.eclipseprojects.io
-TLS TCP Port:	8883
-TLS Websocket Port:	443
-TCP Port:	1883
-Websocket Port:	80
-
-More information can be found at https://mqtt.eclipseprojects.io/.
-
-#### BRG Certificate Release Notes:
-1.3.0:
- - FIRST VERSION
 
 ```
-usage: brg_certificate_cli.py [-h] [--brg BRG] [--brg_cloud_connectivity BRG_CLOUD_CONNECTIVITY] [--brg1 BRG1] --gw GW [--data {tags,sim}] [--port PORT] [--clean] [--tl TL] [--run RUN]
+usage: wlt-cert-brg [-h] [--brg BRG] [--brg_cloud_connectivity BRG_CLOUD_CONNECTIVITY] [--brg1 BRG1] --gw GW [--data {tags,sim}] [--port PORT] [--clean] [--tl TL] [--run RUN]
                               [--drun DRUN] [--exit_on_test_failure] [--exit_on_param_failure] [--analyze_interference]
 
-Bridge Certificate CLI
+# Bridge Certificate CLI
 
 options:
   -h, --help            show this help message and exit
@@ -113,4 +154,4 @@ run examples:
   wlt-cert-brg --gw SIM --brg_cloud_connectivity <XXXXXXXXXXXX> --tl certificate_bcc_test_list.txt --port <COM_PORT>
   Run command example with remote GW connection for bridge with cloud connectivity:
   wlt-cert-brg --gw <YYYYYYYYYYYY> --brg_cloud_connectivity <XXXXXXXXXXXX> --tl certificate_bcc_test_list.txt
-  ```
+  ```

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/pyproject.toml

@@ -4,13 +4,13 @@ build-backend = "setuptools.build_meta"
 
 [project]
 name = "wiliot_certificate"
-version = "4.4.0a1"
+version = "4.4.2"
 authors = [
   { name="Wiliot", email="support@wiliot.com" }
 ]
 description = "A library for certifying Wiliot-compliant boards"
 readme = "README.md"
-requires-python = ">=3.13"
+requires-python = ">=3.9"
 classifiers = [
     "Programming Language :: Python :: 3",
     "License :: OSI Approved :: MIT License",
@@ -22,7 +22,7 @@ dependencies = [
     "jinja2>=3.1.5",
     "appdirs>=1.4.4",
     "plotly>=6.0.0",
-    "numpy>=2.2.2",
+    "numpy>=1.21.5",
     "pandas>=2.2.3",
     "colorama>=0.4.6",
     "tabulate>=0.9.0",

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/src/brg_certificate/cert_results.py

@@ -117,7 +117,7 @@ def generate_results_files(html=True, pdf=True, failures=0, skipped=0, start_tim
                 f.write("<p><a href='https://bitbucket.org/wiliot/wiliot-nordic-firmware/commits/{}'>Commit page on bitbucket</a><hr>".format(os.environ['BITBUCKET_COMMIT']))
             f.write(update_status + "<br><br>")
             f.write(error + "<br><br>")
-            f.write(f"{RUN_DUR}: {str(duration).split(".")[0]} <br><br>")
+            f.write(f"{RUN_DUR}: {str(duration).split('.')[0]} <br><br>")
             if brg:
                 f.write(f"{BRG} {BLE_VER}: {brg.version} <br><br>")
         elif tests:
@@ -130,7 +130,7 @@ def generate_results_files(html=True, pdf=True, failures=0, skipped=0, start_tim
                 f.write("<p><a href='https://bitbucket.org/wiliot/wiliot-nordic-firmware/commits/{}'>Commit page on bitbucket</a><hr>".format(os.environ['BITBUCKET_COMMIT']))
                 f.write(update_status + "<br><br>")
             f.write(f"{RUN_DATETIME}: {start_time.strftime('%d/%m/%Y, %H:%M:%S')} <br><br>")
-            f.write(f"{RUN_DUR}: {str(duration).split(".")[0]} <br><br>")
+            f.write(f"{RUN_DUR}: {str(duration).split('.')[0]} <br><br>")
             f.write(f"{CERT_VER}: {CERT_VERSION} <br><br>")
             if internal_brg:
                 f.write(f"{SIM} {BLE_MAC_ADDRESS}: {internal_brg.id_str} <br><br>")

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/src/brg_certificate/certificate_bcc_test_list.txt

@@ -14,8 +14,6 @@ energy2400/pattern_test ENERGY_PATTERN_2_4_NO_ENERGIZING ENERGY_PATTERN_2_4_CHAN
 energy2400/output_power_test -12 -8 -4 0 2 3
 energy2400/duty_cycle_test 1 25 50 75
 energy2400/signal_indicator_test internal_brg rssi_threshold brg0_rx_brg1_tx brg0_none_brg1_rx brg0_rxtx_brg1_rxtx brg0_tx_brg1_none
-energy2400/signal_indicator_ble5_10_500k_test internal_brg rssi_threshold brg0_tx_brg1_rx brg0_none_brg1_rx brg0_rxtx_brg1_rxtx brg0_tx_brg1_none
-energy2400/signal_indicator_ble5_10_250k_test internal_brg rssi_threshold brg0_tx_brg1_rx brg0_none_brg1_rx brg0_rxtx_brg1_rxtx brg0_tx_brg1_none
 
 # ------------- energy_sub1g -------------
 energy_sub1g/pattern_test SUB1G_ENERGY_PATTERN_NO_ENERGIZING SUB1G_ENERGY_PATTERN_SINGLE_TONE_915000 SUB1G_ENERGY_PATTERN_FCC_HOPPING SUB1G_ENERGY_PATTERN_SINGLE_TONE_917500 SUB1G_ENERGY_PATTERN_NZ_HOPPING

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/src/brg_certificate/tests/calibration/interval_test/interval_test.json

@@ -6,7 +6,7 @@
     "initialCondition": "Bridge configured to defaults",
     "procedure": ["Test prolog", "Configurations", "Test epilog and revert to defaults"],
     "expectedOutcome": "All values configured successfully",
-    "mandatory": 1,
+    "mandatory": 0,
     "multiBridgeTest": 0,
     "gwOnlyTest": 0,
     "internalBridge": 1,

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/src/brg_certificate/tests/calibration/interval_test/interval_test.py

@@ -23,7 +23,6 @@ def run(test):
         if test.rc == TEST_FAILED:
             if test.exit_on_param_failure:
                 break  # break the whole for loop and keep the test as failed
-            else:
-                test.reset_result()  # reset result and continue to next param
-                continue
+        test.reset_result()  # reset result and continue to next param
+
     return cert_common.test_epilog(test, revert_brgs=True, modules=[calib_module])

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/src/brg_certificate/tests/calibration/output_power_test/output_power_test.json

@@ -8,7 +8,7 @@
                   "For each supported value - configure the BRG and verify the value",
                   "Test epilog and revert to defaults"],
     "expectedOutcome": "All values configured successfully",
-    "mandatory": 1,
+    "mandatory": 0,
     "multiBridgeTest": 0,
     "gwOnlyTest": 0,
     "internalBridge": 1,

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/src/brg_certificate/tests/calibration/output_power_test/output_power_test.py

@@ -23,7 +23,6 @@ def run(test):
         if test.rc == TEST_FAILED:
             if test.exit_on_param_failure:
                 break  # break the whole for loop and keep the test as failed
-            else:
-                test.reset_result()  # reset result and continue to next param
-                continue
+        test.reset_result()  # reset result and continue to next param
+
     return cert_common.test_epilog(test, revert_brgs=True, modules=[calib_module])

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/src/brg_certificate/tests/calibration/pattern_test/pattern_test.json

@@ -8,7 +8,7 @@
                   "For each supported value - Configure the BRG and verify packet reception functionality (for specific patterns)",
                   "Test epilog and revert to defaults"],
     "expectedOutcome": "All values configured successfully and packets received only on included channels. When configuring the brg to CALIBRATION_PATTERN_38_38_39 we configure the GW to rx channel 37 and make sure GW doesn't get any pixels",
-    "mandatory": 1,
+    "mandatory": 0,
     "multiBridgeTest": 0,
     "gwOnlyTest": 0,
     "internalBridge": 1,

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/src/brg_certificate/tests/calibration/pattern_test/pattern_test.py

@@ -29,8 +29,8 @@ def run(test):
                     if test.exit_on_param_failure:
                         break  # break the whole for loop and keep the test as failed
                     else:
-                        test.reset_result()  # reset result and continue to next param
-                        continue
+                        test.reset_result()  # reset result
+                        continue  # skip the current phase and continue to next param
                 cert_common.wait_time_n_print(CLEAR_DATA_PATH_TIMEOUT)
                 # MQTT scan
                 if test.data == DATA_SIMULATION:
@@ -60,9 +60,7 @@ def run(test):
             if test.rc == TEST_FAILED:
                 if test.exit_on_param_failure:
                     break  # break the whole for loop and keep the test as failed
-                else:
-                    test.reset_result()  # reset result and continue to next param
-                    continue
+            test.reset_result()  # reset result and continue to next param
         else:
             test = cert_config.brg_configure(test, fields=fields, values=[param.value], module=calib_module)[0]
             generate_log_file(test, param.name)
@@ -72,8 +70,6 @@ def run(test):
             if test.rc == TEST_FAILED:
                 if test.exit_on_param_failure:
                     break  # break the whole for loop and keep the test as failed
-                else:
-                    test.reset_result()  # reset result and continue to next param
-                    continue
+            test.reset_result()  # reset result and continue to next param
 
     return cert_common.test_epilog(test, revert_brgs=True, modules=[calib_module, datapath_module])

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/src/brg_certificate/tests/datapath/aging_test/aging_test.py

@@ -135,10 +135,9 @@ def run(test):
         test.add_phase_reason(param.name, test.reason)
         if test.rc == TEST_FAILED:
             if test.exit_on_param_failure:
-                break
-            else:
-                test.reset_result()
-                continue
+                break  # break the whole for loop and keep the test as failed
+        test.reset_result()  # reset result and continue to next param
+
         time.sleep(5)
 
     return cert_common.test_epilog(test, revert_brgs=True, modules=[datapath_module])

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/src/brg_certificate/tests/datapath/num_of_tags_test/num_of_tags_test.py

@@ -60,13 +60,11 @@ def run(test):
 
         # compare the numbers of tags that come from the brg, success in 95% from number of tags (value) or more.
         if num_of_tags < (param.value * 0.95):
-            test.add_reason(f"Found {num_of_tags} pixels expected: {param.name} pixels!")
-            test.add_reason(f"HB: {num_of_tags_HB}, Df: {num_of_tags}")
+            test.add_reason(f"Received {num_of_tags} pixels, expected: {param.name} pixels!")
 
         # compare the counter tags in the HB packet
         if num_of_tags_HB < 0.95 * param.value or num_of_tags_HB > (param.value + 100):
-            test.add_reason(f"Found {num_of_tags_HB} pixels expected: {param.name} pixels!")
-            test.add_reason(f"HB: {num_of_tags_HB}, Df: {num_of_tags}")
+            test.add_reason(f"HB counter: {num_of_tags_HB}, expected: {param.name}!")
         # param epilog
         time.sleep(10)
         generate_log_file(test, param.name)
@@ -75,8 +73,7 @@ def run(test):
         test.add_phase_reason(param.name, test.reason)
         if test.rc == TEST_FAILED:
             if test.exit_on_param_failure:
-                break
-            else:
-                test.reset_result()
+                break  # break the whole for loop and keep the test as failed
+        test.reset_result()  # reset result and continue to next param
 
     return cert_common.test_epilog(test)

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/src/brg_certificate/tests/datapath/output_power_test/output_power_test.json

@@ -8,7 +8,7 @@
                   "For each supported value - configure the BRG and verify the value",
                   "Test epilog and revert to defaults"],
     "expectedOutcome": "All values configured successfully",
-    "mandatory": 1,
+    "mandatory": 0,
     "multiBridgeTest": 0,
     "gwOnlyTest": 0,
     "internalBridge": 1,

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/src/brg_certificate/tests/datapath/output_power_test/output_power_test.py

@@ -23,8 +23,6 @@ def run(test):
         if test.rc == TEST_FAILED:
             if test.exit_on_param_failure:
                 break  # break the whole for loop and keep the test as failed
-            else:
-                test.reset_result()  # reset result and continue to next param
-                continue
+        test.reset_result()  # reset result and continue to next param
 
     return cert_common.test_epilog(test, revert_brgs=True, modules=[datapath_module])

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/src/brg_certificate/tests/datapath/pacer_interval_ble5_test/pacer_interval_ble5_test.json

@@ -8,7 +8,7 @@
                   "For each supported value - Configure the pacer interval, Generate GEN3 pixels packets & scan for packets in the bridge, Compare pacer interval mean per pixel to the configured value",
                   "Test epilog and revert to defaults"],
     "expectedOutcome": "All values configured successfully and actual pacing found matching to the configured values",
-    "mandatory": 1,
+    "mandatory": 0,
     "multiBridgeTest": 0,
     "gwOnlyTest": 0,
     "internalBridge": 1,

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/src/brg_certificate/tests/datapath/pacer_interval_ble5_test/pacer_interval_ble5_test.py

@@ -45,7 +45,6 @@ def run(test):
         if test.rc == TEST_FAILED:
             if test.exit_on_param_failure:
                 break  # break the whole for loop and keep the test as failed
-            else:
-                test.reset_result()  # reset result and continue to next param
-                continue
+        test.reset_result()  # reset result and continue to next param
+
     return cert_common.test_epilog(test, revert_brgs=True, revert_gws=test.internal_brg, modules=[datapath_module], ble5=True)

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/src/brg_certificate/tests/datapath/pacer_interval_test/pacer_interval_test.py

@@ -47,8 +47,6 @@ def run(test):
         if test.rc == TEST_FAILED:
             if test.exit_on_param_failure:
                 break  # break the whole for loop and keep the test as failed
-            else:
-                test.reset_result()  # reset result and continue to next param
-                continue
+        test.reset_result()  # reset result and continue to next param
 
     return cert_common.test_epilog(test, revert_brgs=True, revert_gws=test.internal_brg, modules=[datapath_module])

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/src/brg_certificate/tests/datapath/pattern_test/pattern_test.json

@@ -8,7 +8,7 @@
                   "For each supported value - configure the BRG and verify the value",
                   "Test epilog and revert to defaults"],
     "expectedOutcome": "All values configured successfully",
-    "mandatory": 1,
+    "mandatory": 0,
     "multiBridgeTest": 0,
     "gwOnlyTest": 0,
     "internalBridge": 1,

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/src/brg_certificate/tests/datapath/pattern_test/pattern_test.py

@@ -24,7 +24,5 @@ def run(test):
         if test.rc == TEST_FAILED:
             if test.exit_on_param_failure:
                 break  # break the whole for loop and keep the test as failed
-            else:
-                test.reset_result()  # reset result and continue to next param
-                continue
+        test.reset_result()  # reset result and continue to next param
     return cert_common.test_epilog(test, revert_brgs=True, modules=[datapath_module])

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/src/brg_certificate/tests/datapath/pkt_filter_ble5_test/pkt_filter_ble5_test.json

@@ -11,7 +11,7 @@
                   "Repeat for all given packet filter values",
                   "Test epilog and revert to defaults"],
     "expectedOutcome": "All values configured successfully and actual pacing found matching to the configured values",
-    "mandatory": 1,
+    "mandatory": 0,
     "multiBridgeTest": 0,
     "gwOnlyTest": 0,
     "internalBridge": 1,

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/src/brg_certificate/tests/datapath/pkt_filter_ble5_test/pkt_filter_ble5_test.py

@@ -54,8 +54,6 @@ def run(test):
         if test.rc == TEST_FAILED:
             if test.exit_on_param_failure:
                 break  # break the whole for loop and keep the test as failed
-            else:
-                test.reset_result()  # reset result and continue to next param
-                continue
+        test.reset_result()  # reset result and continue to next param
 
     return cert_common.test_epilog(test, revert_brgs=True, revert_gws=test.internal_brg, modules=[datapath_module], ble5=True)

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/src/brg_certificate/tests/datapath/pkt_filter_gen3_test/pkt_filter_gen3_test.json

@@ -11,7 +11,7 @@
                   "Repeat for all given packet filter values",
                   "Test epilog and revert to defaults"],
     "expectedOutcome": "All values configured successfully and actual pacing found matching to the configured values",
-    "mandatory": 1,
+    "mandatory": 0,
     "multiBridgeTest": 0,
     "gwOnlyTest": 0,
     "internalBridge": 1,

{wiliot_certificate-4.4.0a1 → wiliot_certificate-4.4.2}/src/brg_certificate/tests/datapath/pkt_filter_gen3_test/pkt_filter_gen3_test.py

@@ -55,8 +55,6 @@ def run(test):
         if test.rc == TEST_FAILED:
             if test.exit_on_param_failure:
                 break  # break the whole for loop and keep the test as failed
-            else:
-                test.reset_result()  # reset result and continue to next param
-                continue
+        test.reset_result()  # reset result and continue to next param
 
     return cert_common.test_epilog(test, revert_brgs=True, revert_gws=test.internal_brg, modules=[datapath_module])