naeural-client 2.6.15__py3-none-any.whl → 2.6.16__py3-none-any.whl

naeural_client/_ver.py

@@ -1,4 +1,4 @@
-__VER__ = "2.6.15"
+__VER__ = "2.6.16"
 
 if __name__ == "__main__":
   with open("pyproject.toml", "rt") as fd:

naeural_client/const/base.py

@@ -18,6 +18,9 @@ DAUTH_VARS = [DAUTH_NONCE, BCctbase.SIGN, BCctbase.SENDER, BCctbase.HASH]
 
 ETH_ENABLED_ENV_KEY = 'EE_ETH_ENABLED'
 
+EE_EPOCH_INTERVALS_KEY = 'EE_EPOCH_INTERVALS'
+EE_EPOCH_INTERVAL_SECONDS_KEY = 'EE_EPOCH_INTERVAL_SECONDS'
+
 
 class LocalInfo:
   LOCAL_INFO_FILE = 'local_info.json'

naeural_client-2.6.16.dist-info/METADATA

@@ -0,0 +1,279 @@
+Metadata-Version: 2.4
+Name: naeural_client
+Version: 2.6.16
+Summary: `naeural_client` is the Python SDK required for client app development for the Naeural Edge Protocol Edge Protocol framework
+Project-URL: Homepage, https://github.com/NaeuralEdgeProtocol/naeural_client
+Project-URL: Bug Tracker, https://github.com/NaeuralEdgeProtocol/naeural_client/issues
+Author-email: Andrei Ionut Damian <andrei.damian@me.com>, Cristan Bleotiu <cristibleotiu@gmail.com>, Stefan Saraev <saraevstefan@gmail.com>
+License-File: LICENSE
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3
+Requires-Python: >=3.8
+Requires-Dist: cryptography>=39.0.0
+Requires-Dist: numpy
+Requires-Dist: paho-mqtt
+Requires-Dist: pandas
+Requires-Dist: pika
+Requires-Dist: pyaml
+Requires-Dist: pyopenssl>=23.0.0
+Requires-Dist: python-dateutil
+Requires-Dist: web3
+Description-Content-Type: text/markdown
+
+# Ratio1 SDK
+
+Welcome to the **Ratio1 SDK** repository, formerly known as the **naeural_client SDK**. The Ratio1 SDK is a crucial component of the Ratio1 ecosystem, designed to facilitate interactions, development, and deployment of jobs within the Ratio1 network. By enabling low-code development, the SDK allows developers to build and deploy end-to-end AI (and beyond) cooperative application pipelines seamlessly within the Ratio1 Edge Nodes ecosystem.
+
+## Overview
+
+The **Ratio1 SDK** is engineered to enhance the Ratio1 protocol and ecosystem, aiming to improve the functionality and performance of the Ratio1 Edge Node through dedicated research and community contributions. This SDK serves as an essential tool for developers looking to integrate their applications with the Ratio1 network, enabling them to leverage the decentralized, secure, and privacy-preserving capabilities of Ratio1 Edge Nodes.
+
+Key functionalities of the Ratio1 SDK include:
+
+- **Job Interactions**: Facilitate the development and management of computation tasks within the Ratio1 network.
+- **Development Tools**: Provide low-code solutions for creating and deploying AI-driven application pipelines.
+- **Ecosystem Integration**: Seamlessly integrate with Ratio1 Edge Nodes to utilize their computational resources effectively.
+- **Collaboration and Deployment**: Enable cooperative application development and deployment across multiple edge nodes within the Ratio1 ecosystem.
+
+Unlike the Ratio1 Core Packages, which are intended solely for protocol and ecosystem enhancements and are not meant for standalone installation, the Ratio1 SDK is designed for both client-side development and sending workloads to Ratio1 Edge Nodes, making it an indispensable tool for developers within the ecosystem.
+
+## Dependencies
+
+The Ratio1 SDK relies on several key packages to function effectively. These dependencies are automatically managed when installing the SDK via pip:
+
+- `pika`
+- `paho-mqtt`
+- `numpy`
+- `pyopenssl>=23.0.0`
+- `cryptography>=39.0.0`
+- `python-dateutil`
+- `pyaml`
+
+## Installation
+
+Installing the Ratio1 SDK is straightforward and is intended for development and integration into your projects. Use the following pip commands to install the SDK:
+
+### Standard Installation
+
+To install the Ratio1 SDK, run:
+
+```shell
+pip install ratio1_sdk --upgrade
+```
+
+### Development Installation
+
+For development purposes, you can clone the repository and set up the SDK in an editable mode:
+
+```shell
+git clone https://github.com/Ratio1/ratio1_sdk
+cd ratio1_sdk
+pip install -e .
+```
+
+This allows you to make modifications to the SDK and have them reflected immediately without reinstalling.
+
+## Documentation
+
+Comprehensive documentation for the Ratio1 SDK is currently a work in progress. Minimal documentation is available here, with detailed code examples located in the `tutorials` folder within the project's repository. We encourage developers to explore these examples to understand the SDK's capabilities and integration methods.
+
+## Quick Start Guides
+
+Starting with version 2.6+, the Ratio1 SDK automatically performs self-configuration using **dAuth**—the Ratio1 decentralized self-authentication system. To begin integrating with the Ratio1 network, follow these steps:
+
+### 1. Start a Local Edge Node
+
+Launch a local Ratio1 Edge Node using Docker:
+
+```bash
+docker run -d --name=local_node ratio1/edge_node:develop
+```
+
+After a few seconds, the node will be online. Retrieve the node's address by running:
+
+```bash
+docker exec local_node get_node_info
+```
+
+The output will resemble:
+
+```json
+{
+  "address": "0xai_AtMvIwaEPi5M8cnkdbaZ3tbUhCzKbGKEYuZ1xFtCjT_6",
+  "alias": "6dd74472642e",
+  "eth_address": "0x98FE7c0d8CeC2E97B932D2bDC1bb73B395C9Dfd7"
+}
+```
+
+### 2. Develop and Deploy Jobs
+
+Use the SDK to develop and send workloads to the Edge Nodes. Below are examples of both local and remote execution.
+
+## Examples
+
+### Local Execution
+
+This example demonstrates how to find all 168 prime numbers in the interval 1 - 1000 using local execution. The code leverages multiple threads to perform prime number generation efficiently.
+
+```python
+import numpy as np
+from concurrent.futures import ThreadPoolExecutor
+
+def local_brute_force_prime_number_generator():
+    def is_prime(n):
+        if n <= 1:
+            return False
+        for i in range(2, int(np.sqrt(n)) + 1):
+            if n % i == 0:
+                return False
+        return True
+
+    random_numbers = np.random.randint(1, 1000, 20)
+
+    thread_pool = ThreadPoolExecutor(max_workers=4)
+    are_primes = list(thread_pool.map(is_prime, random_numbers))
+
+    prime_numbers = []
+    for i in range(len(random_numbers)):
+        if are_primes[i]:
+            prime_numbers.append(random_numbers[i])
+
+    return prime_numbers
+
+if __name__ == "__main__":
+    found_so_far = []
+    print_step = 0
+
+    while len(found_so_far) < 168:
+        # Compute a batch of prime numbers
+        prime_numbers = local_brute_force_prime_number_generator()
+
+        # Keep only the new prime numbers
+        for prime_number in prime_numbers:
+            if prime_number not in found_so_far:
+                found_so_far.append(prime_number)
+
+        # Show progress
+        if print_step % 50 == 0:
+            print("Found so far: {}:  {}\n".format(len(found_so_far), sorted(found_so_far)))
+
+        print_step += 1
+
+    # Show final result
+    print("Found so far: {}:  {}\n".format(len(found_so_far), sorted(found_so_far)))
+```
+
+### Remote Execution
+
+To accelerate prime number discovery, this example demonstrates deploying the task across multiple edge nodes within the Ratio1 network. Minimal code changes are required to transition from local to remote execution.
+
+#### 1. Modify the Prime Number Generator
+
+```python
+from ratio1_sdk import CustomPluginTemplate
+
+def remote_brute_force_prime_number_generator(plugin: CustomPluginTemplate):
+    def is_prime(n):
+        if n <= 1:
+            return False
+        for i in range(2, int(plugin.np.sqrt(n)) + 1):
+            if n % i == 0:
+                return False
+        return True
+
+    random_numbers = plugin.np.random.randint(1, 1000, 20)
+    are_primes = plugin.threadapi_map(is_prime, random_numbers, n_threads=4)
+
+    prime_numbers = []
+    for i in range(len(random_numbers)):
+        if are_primes[i]:
+            prime_numbers.append(random_numbers[i])
+
+    return prime_numbers
+```
+
+#### 2. Connect to the Network and Select a Node
+
+```python
+from ratio1_sdk import Session
+from time import sleep
+
+def on_heartbeat(session: Session, node: str, heartbeat: dict):
+    session.P("{} is online".format(node))
+    return
+
+if __name__ == '__main__':
+    session = Session(
+        on_heartbeat=on_heartbeat
+    )
+
+    # Run the program for 15 seconds to detect online nodes
+    sleep(15)
+
+    # Retrieve and select an online node
+    node = "0xai_A8SY7lEqBtf5XaGyB6ipdk5C30vSf3HK4xELp3iplwLe"  # naeural-1
+```
+
+#### 3. Deploy the Distributed Job
+
+```python
+from ratio1_sdk import DistributedCustomCodePresets as Presets
+
+_, _ = session.create_chain_dist_custom_job(
+    node=node,
+    main_node_process_real_time_collected_data=Presets.PROCESS_REAL_TIME_COLLECTED_DATA__KEEP_UNIQUES_IN_AGGREGATED_COLLECTED_DATA,
+    main_node_finish_condition=Presets.FINISH_CONDITION___AGGREGATED_DATA_MORE_THAN_X,
+    main_node_finish_condition_kwargs={"X": 167},
+    main_node_aggregate_collected_data=Presets.AGGREGATE_COLLECTED_DATA___AGGREGATE_COLLECTED_DATA,
+    nr_remote_worker_nodes=2,
+    worker_node_code=remote_brute_force_prime_number_generator,
+    on_data=locally_process_partial_results,
+    deploy=True
+)
+```
+
+#### 4. Close the Session Upon Completion
+
+```python
+# Wait until the finished flag is set to True
+session.run(wait=lambda: not finished, close_pipelines=True)
+```
+
+## Project Financing Disclaimer
+
+This project incorporates open-source components developed with the support of financing grants **SMIS 143488** and **SMIS 156084**, provided by the Romanian Competitiveness Operational Programme. We extend our sincere gratitude for this support, which has been instrumental in advancing our work and enabling us to share these resources with the community.
+
+The content and information within this repository are solely the responsibility of the authors and do not necessarily reflect the views of the funding agencies. The grants have specifically supported certain aspects of this open-source project, facilitating broader dissemination and collaborative development.
+
+For any inquiries regarding the funding and its impact on this project, please contact the authors directly.
+
+## License
+
+This project is licensed under the **Apache 2.0 License**. For more details, please refer to the [LICENSE](LICENSE) file.
+
+## Contact
+
+For more information, visit our website at [https://ratio1.ai](https://ratio1.ai) or reach out to us via email at [support@ratio1.ai](mailto:support@ratio1.ai).
+
+## Citation
+
+If you use the Ratio1 SDK in your research or projects, please cite it as follows:
+
+```bibtex
+@misc{Ratio1SDK,
+  author       = {Ratio1.AI},
+  title        = {Ratio1 SDK},
+  year         = {2024-2025},
+  howpublished = {\url{https://github.com/NaeuralEdgeProtocol/naeural_client}},
+}
+```
+
+```bibtex
+@misc{Ratio1EdgeNode,
+  author = {Ratio1.AI},
+  title = {Ratio1: Edge Node},
+  year = {2024-2025},
+  howpublished = {\url{https://github.com/NaeuralEdgeProtocol/edge_node}},
+}
+```

{naeural_client-2.6.15.dist-info → naeural_client-2.6.16.dist-info}/RECORD

@@ -1,5 +1,5 @@
 naeural_client/__init__.py,sha256=YimqgDbjLuywsf8zCWE0EaUXH4MBUrqLxt0TDV558hQ,632
-naeural_client/_ver.py,sha256=s5A-FwAfqI4BeZ8fzrRTwGs3LEc-m4EQ8BufoeG3kSI,331
+naeural_client/_ver.py,sha256=eM7t0xRbVJaaGjrh0O9tmQF7K_usWv_3wk3hVZ27_Qs,331
 naeural_client/base_decentra_object.py,sha256=C4iwZTkhKNBS4VHlJs5DfElRYLo4Q9l1V1DNVSk1fyQ,4412
 naeural_client/plugins_manager_mixin.py,sha256=X1JdGLDz0gN1rPnTN_5mJXR8JmqoBFQISJXmPR9yvCo,11106
 naeural_client/base/__init__.py,sha256=hACh83_cIv7-PwYMM3bQm2IBmNqiHw-3PAfDfAEKz9A,259
@@ -32,7 +32,7 @@ naeural_client/comm/mqtt_wrapper.py,sha256=Ig3bFZkCbWd4y_Whn2PPa91Z3aLgNbNPau6Tn
 naeural_client/const/README.md,sha256=6OHesr-f5NBuuJGryEoi_TCu2XdlhfQYlDKx_IJoXeg,177
 naeural_client/const/__init__.py,sha256=MM6Zib6i7M2qWcMkLtLx14zqU-lE-u2uPHjNvbh2jAM,478
 naeural_client/const/apps.py,sha256=ePBiJXLuPfFOKuw-LJrT9OWbaodU7QApfDurIPNDoB4,655
-naeural_client/const/base.py,sha256=Ld6WuQeqm5FbARL_-xs3gXxpa46ypksHimAk1g4qanw,4467
+naeural_client/const/base.py,sha256=1ScfnfNd5xeWo7tkkDgQR95vliTpcax025Naj0Lqw38,4574
 naeural_client/const/comms.py,sha256=La6JXWHexH8CfcBCKyT4fCIoeaoZlcm7KtZ57ab4ZgU,2201
 naeural_client/const/environment.py,sha256=iytmTDgbOjvORPwHQmc0K0r-xJx7dnnzNnqAJJiFCDA,870
 naeural_client/const/formatter.py,sha256=AW3bWlqf39uaqV4BBUuW95qKYfF2OkkU4f9hy3kSVhM,200
@@ -81,8 +81,8 @@ naeural_client/utils/__init__.py,sha256=mAnke3-MeRzz3nhQvhuHqLnpaaCSmDxicd7Ck9uw
 naeural_client/utils/comm_utils.py,sha256=4cS9llRr_pK_3rNgDcRMCQwYPO0kcNU7AdWy_LtMyCY,1072
 naeural_client/utils/config.py,sha256=v7xHikr6Z5Sbvf3opYeMhYzGWD2pe0HlRwa-aGJzUh8,6323
 naeural_client/utils/dotenv.py,sha256=_AgSo35n7EnQv5yDyu7C7i0kHragLJoCGydHjvOkrYY,2008
-naeural_client-2.6.15.dist-info/METADATA,sha256=F37VysVyxouaFh-B_tDEHDG_AFQMH03gNF0UbbanqKI,13176
-naeural_client-2.6.15.dist-info/WHEEL,sha256=qtCwoSJWgHk21S1Kb4ihdzI2rlJ1ZKaIurTj_ngOhyQ,87
-naeural_client-2.6.15.dist-info/entry_points.txt,sha256=PNdyotDaQBAslZREx5luVyj0kqpQnwNACwkFNTPIHU4,55
-naeural_client-2.6.15.dist-info/licenses/LICENSE,sha256=cvOsJVslde4oIaTCadabXnPqZmzcBO2f2zwXZRmJEbE,11311
-naeural_client-2.6.15.dist-info/RECORD,,
+naeural_client-2.6.16.dist-info/METADATA,sha256=PaCUsM0cAtvH9ZUTzfwNxZTumPu4np7e3inODMj9WLA,10362
+naeural_client-2.6.16.dist-info/WHEEL,sha256=qtCwoSJWgHk21S1Kb4ihdzI2rlJ1ZKaIurTj_ngOhyQ,87
+naeural_client-2.6.16.dist-info/entry_points.txt,sha256=PNdyotDaQBAslZREx5luVyj0kqpQnwNACwkFNTPIHU4,55
+naeural_client-2.6.16.dist-info/licenses/LICENSE,sha256=cvOsJVslde4oIaTCadabXnPqZmzcBO2f2zwXZRmJEbE,11311
+naeural_client-2.6.16.dist-info/RECORD,,

naeural_client-2.6.15.dist-info/METADATA

@@ -1,358 +0,0 @@
-Metadata-Version: 2.4
-Name: naeural_client
-Version: 2.6.15
-Summary: `naeural_client` is the Python SDK required for client app development for the Naeural Edge Protocol Edge Protocol framework
-Project-URL: Homepage, https://github.com/NaeuralEdgeProtocol/naeural_client
-Project-URL: Bug Tracker, https://github.com/NaeuralEdgeProtocol/naeural_client/issues
-Author-email: Andrei Ionut Damian <andrei.damian@me.com>, Cristan Bleotiu <cristibleotiu@gmail.com>, Stefan Saraev <saraevstefan@gmail.com>
-License-File: LICENSE
-Classifier: License :: OSI Approved :: MIT License
-Classifier: Operating System :: OS Independent
-Classifier: Programming Language :: Python :: 3
-Requires-Python: >=3.8
-Requires-Dist: cryptography>=39.0.0
-Requires-Dist: numpy
-Requires-Dist: paho-mqtt
-Requires-Dist: pandas
-Requires-Dist: pika
-Requires-Dist: pyaml
-Requires-Dist: pyopenssl>=23.0.0
-Requires-Dist: python-dateutil
-Requires-Dist: web3
-Description-Content-Type: text/markdown
-
-# Ratio1 SDK (naeural_client SDK)
-
-This is the Python SDK package that allows interactions, development and deployment of jobs in Ratio1 ecosystem formely known as Naeural Edge Protocol network. The SDK enables low-code development and deployment of end-to-end AI (and not only) cooperative application pipelines within the Ratio1 Edge Nodes ecosystem. 
-
-## Dependencies
-
-This packet depends and will automatically install the following packets: `pika`, `paho-mqtt`, `numpy`, `pyopenssl>=23.0.0`, `cryptography>=39.0.0`, `python-dateutil`, `pyaml`.
-
-## Installation
-
-```shell
-pip install naeural_client --upgrade
-```
-
-### Development installation
-
-```shell
-git clone https://github.com/NaeuralEdgeProtocol/naeural_client
-pip install -e .
-```
-
-## Documentation
-
-Minimal documentation will be presented here. The complete documentation is
-Work in Progress.
-
-Code examples are located in the `tutorials` folder in the project's repository.
-
-## Quick start guides
-
-Starting with version 2.6+ the SDK will automatically perform self-configuration using the dAuth - the Ratio1 decentralized self-authentication system.
-
-In order to start a local edge node you just need to run:
-
-```bash
-docker run -d --name=local_node naeural/edge_node:develop
-```
-after a few seconds the node will be online and you can get the node's address by running:
-
-```bash
-docker exec local_node get_node_info
-```
-
-The output will be similar to:
-
-```json
-{
-  "address": "0xai_AtMvIwaEPi5M8cnkdbaZ3tbUhCzKbGKEYuZ1xFtCjT_6",
-  "alias": "6dd74472642e",
-  "eth_address": "0x98FE7c0d8CeC2E97B932D2bDC1bb73B395C9Dfd7"
-}
-```
-
-
-## Some Examples
-
-### Local Execution
-
-We want to find all $168$ prime numbers in the interval $1$ - $1000$. For this we can run the following code on our local machine.
-
-This code has segments running on multiple threads using a ThreadPool.
-
-```python
-import numpy as np
-from concurrent.futures import ThreadPoolExecutor
-
-
-def local_brute_force_prime_number_generator():
-  def is_prime(n):
-    if n <= 1:
-      return False
-    for i in range(2, int(np.sqrt(n)) + 1):
-      if n % i == 0:
-        return False
-    return True
-
-  random_numbers = np.random.randint(1, 1000, 20)
-
-  thread_pool = ThreadPoolExecutor(max_workers=4)
-  are_primes = list(thread_pool.map(is_prime, random_numbers))
-
-  prime_numbers = []
-  for i in range(len(random_numbers)):
-    if are_primes[i]:
-      prime_numbers.append(random_numbers[i])
-
-  return prime_numbers
-
-
-if __name__ == "__main__":
-  found_so_far = []
-
-  print_step = 0
-
-  while len(found_so_far) < 168:
-    # compute a batch of prime numbers
-    prime_numbers = local_brute_force_prime_number_generator()
-
-    # keep only the new prime numbers
-    for prime_number in prime_numbers:
-      if prime_number not in found_so_far:
-        found_so_far.append(prime_number)
-    # end for
-
-    # show progress
-    if print_step % 50 == 0:
-      print("Found so far: {}:  {}\n".format(len(found_so_far), sorted(found_so_far)))
-
-    print_step += 1
-  # end while
-
-  # show final result
-  print("Found so far: {}:  {}\n".format(len(found_so_far), sorted(found_so_far)))
-```
-
-We can see that we have a `local_brute_force_prime_number_generator` method which will generate a random sample of $20$ numbers that will be checked if they are prime or not.
-
-The rest of the code handles how the numbers generated with this method are kept.
-Because we want to find $168$ unique numbers, we append to the list of found primes only the numbers that are not present yet.
-
-At the end, we want to show a list of all the numbers found.
-
-### Remote Execution
-
-For this example we would like to use multiple edge nodes to find the prime numbers faster.
-
-To execute this code on our network, a series of changes must be made to the `local_brute_force_prime_number_generator` method.
-These changes are the only ones a developer has to do to deploy his own custom code on the network.
-
-For this, we will create a new method, `remote_brute_force_prime_number_generator`, which will use the exposed edge node API methods.
-
-```python
-from naeural_client import CustomPluginTemplate
-
-# through the `plugin` object we get access to the edge node API
-# the CustomPluginTemplate class acts as a documentation for all the available methods and attributes
-# since we do not allow imports in the custom code due to security reasons, the `plugin` object
-#   exposes common modules to the user
-def remote_brute_force_prime_number_generator(plugin: CustomPluginTemplate):
-  def is_prime(n):
-    if n <= 1:
-      return False
-    # we use the `plugin.np` instead of the `np` module
-    for i in range(2, int(plugin.np.sqrt(n)) + 1):
-      if n % i == 0:
-        return False
-    return True
-
-  # we use the `plugin.np` instead of the `np` module
-  random_numbers = plugin.np.random.randint(1, 1000, 20)
-
-  # we use the `plugin.threadapi_map` instead of the `ThreadPoolExecutor.map`
-  are_primes = plugin.threadapi_map(is_prime, random_numbers, n_threads=4)
-
-  prime_numbers = []
-  for i in range(len(random_numbers)):
-    if are_primes[i]:
-      prime_numbers.append(random_numbers[i])
-
-  return prime_numbers
-```
-
-This are all the changes we have to do to deploy this code in the network.
-
-Now lets connect to the network and see what nodes are online.
-We will use the `on_heartbeat` callback to print the nodes.
-
-```python
-from naeural_client import Session
-from time import sleep
-
-def on_heartbeat(session: Session, node: str, heartbeat: dict):
-  # the `.P` method is used to print messages in the console and store them in the log file
-  session.P("{} is online".format(node))
-  return
-
-
-if __name__ == '__main__':
-  # create a session
-  # the network credentials are read from the .env file automatically
-  session = Session(
-      on_heartbeat=on_heartbeat
-  )
-
-  # run the program for 15 seconds to show all the nodes that are online
-  sleep(15)
-
-```
-
-Next we will select an online node. This node will be our entrypoint in the network.
-
-The available nodes in our test net are:
-
-```
-0xai_A8SY7lEqBtf5XaGyB6ipdk5C30vSf3HK4xELp3iplwLe naeural-1
-0xai_Amfnbt3N-qg2-qGtywZIPQBTVlAnoADVRmSAsdDhlQ-6 naeural-2
-0xai_ApltAljEgWk3g8x2QcSa0sS3hT1P4dyCchd04zFSMy5e naeural-3
-```
-
-We will send a task to this node. Since we want to distribute the task of finding prime numbers to multiple nodes, this selected node will handle distribution of tasks and collection of the results.
-
-```python
-node = "0xai_A8SY7lEqBtf5XaGyB6ipdk5C30vSf3HK4xELp3iplwLe" # naeural-1
-
-# we usually wait for the node to be online before sending the task
-# but in this case we are sure that the node is online because we
-# have received heartbeats from it during the sleep period
-
-# session.wait_for_node(node)
-```
-
-Our selected node will periodically output partial results with the prime numbers found so far by the worker nodes. We want to consume these results.
-
-Thus, we need to implement a callback method that will handle this.
-
-```python
-from naeural_client import Pipeline
-
-# a flag used to close the session when the task is finished
-finished = False
-
-def locally_process_partial_results(pipeline: Pipeline, full_payload):
-  global finished
-  found_so_far = full_payload.get("DATA")
-
-  if found_so_far:
-    pipeline.P("Found so far: {}:  {}\n\n".format(len(found_so_far), sorted(found_so_far)))
-
-  progress = full_payload.get("PROGRESS")
-  if progress == 100:
-    pipeline.P("FINISHED\n\n")
-    finished = True
-
-  return
-```
-
-Now we are ready to deploy our job to the network.
-
-```python
-from naeural_client import DistributedCustomCodePresets as Presets
-
-_, _ = session.create_chain_dist_custom_job(
-    # this is the main node, our entrypoint
-    node=node,
-
-    # this function is executed on the main node
-    # this handles what we want to do with primes found by a worker node after an iteration
-    # we want to store only the unique prime numbers
-    # we cam either write a custom code to pass here or we can use a preset
-    main_node_process_real_time_collected_data=Presets.PROCESS_REAL_TIME_COLLECTED_DATA__KEEP_UNIQUES_IN_AGGREGATED_COLLECTED_DATA,
-
-    # this function is executed on the main node
-    # this handles the finish condition of our distributed job
-    # we want to finish when we have found 168 prime numbers
-    # so more than 167 prime numbers
-    # we cam either write a custom code to pass here or we can use a preset
-    main_node_finish_condition=Presets.FINISH_CONDITION___AGGREGATED_DATA_MORE_THAN_X,
-    main_node_finish_condition_kwargs={
-        "X": 167
-    },
-
-    # this function is executed on the main node
-    # this handles the final processing of the results
-    # this function prepares data for the final result of the distributed job
-    # we want to aggregate all the prime numbers found by the worker nodes in a single list
-    # we cam either write a custom code to pass here or we can use a preset
-    main_node_aggregate_collected_data=Presets.AGGREGATE_COLLECTED_DATA___AGGREGATE_COLLECTED_DATA,
-
-    # how many worker nodes we want to use for this task
-    nr_remote_worker_nodes=2,
-
-    # this is the function that will be executed on the worker nodes
-    # this function generates prime numbers using brute force
-    # we simply pass the function reference
-    worker_node_code=remote_brute_force_prime_number_generator,
-
-    # this is the function that will be executed on the client
-    # this is the callback function that processes the partial results
-    # in our case we want to print the partial results
-    on_data=locally_process_partial_results,
-
-    # we want to deploy the job immediately
-    deploy=True
-)
-```
-
-Last but not least, we want to close the session when the distributed job finished.
-
-```python
-# we wait until the finished flag is set to True
-# we want to release the resources allocated on the selected node when the job is finished
-session.run(wait=lambda: not finished, close_pipelines=True)
-```
-
-
-# Project Financing Disclaimer
-
-This project includes open-source components that have been developed with the support of financing grants SMIS 143488 and SMIS 156084, provided by the Romanian Competitiveness Operational Programme. We are grateful for this support, which has enabled us to advance our work and share these resources with the community.
-
-The content and information provided within this repository are solely the responsibility of the authors and do not necessarily reflect the views of the funding agencies. The funding received under these grants has been instrumental in supporting specific parts of this open source project, allowing for broader dissemination and collaborative development.
-
-For any inquiries related to the funding and its impact on this project, please contact the authors directly.
-
-
-# Citation
-
-```bibtex
-@misc{naeural_client,
-  author = {Stefan Saraev, Andrei Damian},
-  title = {naeural_client: Python SDK for Naeural Edge Protocol Edge Protocol},
-  year = {2024},
-  howpublished = {\url{https://github.com/Naeural Edge ProtocolEdgeProtocol/naeural_client}},
-}
-```
-
-```bibtex
-@misc{project_funding_acknowledgment1,
-  author       = {Damian, Bleotiu, Saraev, Constantinescu},
-  title        = {SOLIS – Sistem Omogen multi-Locație cu funcționalități Inteligente și Sustenabile”
-SMIS 143488},
-  howpublished = {\url{https://github.com/Naeural Edge ProtocolEdgeProtocol/}},
-  note         = {This project includes open-source components developed with support from the Romanian Competitiveness Operational Programme under grants SMIS 143488. The content is solely the responsibility of the authors and does not necessarily reflect the views of the funding agencies.},
-  year         = {2021-2022}
-}
-```
-
-```bibtex
-@misc{project_funding_acknowledgment2,
-  author       = {Damian, Bleotiu, Saraev, Constantinescu, Milik, Lupaescu},
-  title        = {ReDeN – Rețea Descentralizată Neurală SMIS 156084},
-  howpublished = {\url{https://github.com/Naeural Edge ProtocolEdgeProtocol/}},
-  note         = {This project includes open-source components developed with support from the Romanian Competitiveness Operational Programme under grants SMIS 143488. The content is solely the responsibility of the authors and does not necessarily reflect the views of the funding agencies.},
-  year         = {2023-2024}
-}
-```