@samanbayaka/core 0.0.1

package/README.md

@@ -0,0 +1,812 @@
+<p align="center" style="margin: 0;">
+  <img style="background-color: #000; border-radius: 30%;" src="https://unpkg.com/samanbayaka/public/favicon.svg" width="256" />
+</p>
+
+# samanbayaka
+
+This project is a modular, production-ready microservices framework built with Moleculer and Moleculer-Web latest, using NATS as a high-performance messaging transporter and AJV for robust schema validation. It provides a scalable foundation for developing distributed Node.js applications, emphasizing fault tolerance, clean architecture, and efficient service communication. The system is designed to support flexible orchestration of services while maintaining strong validation and reliability across components.
+
+[![NPM version](https://img.shields.io/npm/v/samanbayaka.svg)](https://www.npmjs.com/package/samanbayaka)
+[![License](https://img.shields.io/npm/l/samanbayaka.svg)](LICENSE)
+
+- [Table of contents](#table-of-contents)
+- [Features](#features)
+- [Installation](#installation)
+- [Prerequisites](#prerequisites)
+- [Documentations](#documentations)
+  - [Errors](#errors)
+  - [getConfig](#getConfig)
+  - [loadDemo](#loadDemo)
+  - [registerSystemAPI](#registerSystemAPI)
+  - [registerEdgeAPI](#registerEdgeAPI)
+  - [registerServices](#registerServices)
+  - [registerBridgeServices](#registerBridgeServices)
+- [Usage](#usage)
+- [Demo](#Demo)
+- [Dockers](#dockers)
+  - [Etcd](#etcd)
+
+## Features
+
+- `Moleculer`-based framework for building microservices
+- Use `NATS` transporter for high-performance message bus
+- Use `Redpanda` transporter for persistent, robust, and scalable message bus with ACL support.
+- In memory L1 cache and `Redis` cache for L2
+- Schema validation using `AJV`
+- Config-driven service initialization using `etcd`
+- Create a `Demo` service to demonstrate the workflow
+- Dynamically register Edge Services and Microservices
+- Centralized error handling middleware
+- Graceful shutdown handling `SIGINT`, `SIGTERM`
+
+- REPL support for debugging
+- Log shipping using agent like `fluentbit` to `OpenObserve`
+- Metrics shipping using `Opentelemetry` to `OpenObserve` 
+- Token based access of restricted endpoints
+
+
+## Installation
+
+```bash
+pnpm install samanbayaka
+```
+Once the package is installed, you can import the library using import or require approach:
+```bash
+import sbk from "samanbayaka"
+```
+## Prerequisites
+It is assumed that `NATS`, `Redpanda`, `Redis`,`fluentbit`,`OpenObserve` and `etcd` are installed and properly configured. All services should be discoverable through the /etc/hosts file.
+### Minimum required Node.js version: >= 22.x.x
+```bash
+node -v
+nvm use 22
+```
+Additionally, `OpenObserve` is used to view logs and telemetry and `fluentbit` for log shipping.
+
+### Environment variables
+
+
+To connect to the etcd configuration server, the application requires the `SBK_CONFIG_CRED` environment variable. The etcd server listens on the default port 2379.
+
+Export the environment variable before running the application.
+```bash 
+export SBK_CONFIG_CRED='<your_etcd_user> <your_etcd_pass> <your_etcd_port>'
+```
+or 
+
+To make the variable available across terminal sessions, add it to your shell configuration file.
+
+Open your `.bashrc` file:
+```bash
+nano ~/.bashrc
+```
+Add the following line:
+```bash
+export SBK_CONFIG_CRED='<your_etcd_user> <your_etcd_pass> <your_etcd_port>'
+
+```
+ Save the file and reload the configuration:
+
+```bash
+source ~/.bashrc
+```
+ or 
+ 
+You can provide the environment variable only for a single execution without exporting it.
+```bash
+SBK_CONFIG_CRED='<your_etcd_user> <your_etcd_pass> <your_etcd_port>' node index.mjs
+```
+
+
+Optionally, you may verify the set environment variables.
+```bash
+echo $SBK_CONFIG_CRED
+```
+### Configuration files
+Create a directory to store the configuration files, then copy all configuration files from the current project path into this directory and update them as needed. Before copying, ensure that your current working directory is the project directory.
+```bash
+pwd
+sudo mkdir -p /usr/local/etc/<your_folder>
+sudo cp config/*.*  /usr/local/etc/<your_folder>
+```
+### Log files
+For production, it is recommended to create a new directory named <your_folder> under /var/log to store logs.
+```bash
+sudo mkdir -p /var/log/<your_folder>
+sudo chown -R $USER:$(id -gn) /var/log/<your_folder>
+sudo chmod 755 /var/log/<your_folder>
+```
+Optionally, you can clear the contents of the log files if they become too large by running:
+```bash
+truncate -s 0 /var/log/<your_folder>/sbk-*.log
+```
+
+### Configure agent for log shipping
+You can configure `fluentbit` as the log shipping agent to forward logs to `OpenObserve`. By default, `OpenObserve` listens on port `5080`. The `fluentbit` configuration is as follows:
+
+Open /etc/fluent-bit/fluent-bit.conf and paste the following:
+```bash
+[SERVICE]
+    Flush         1
+    Log_Level     info
+    Daemon        off
+    Parsers_File  parsers.conf
+
+[INPUT]
+    Name                 tail
+    Path                 /var/log/<your_folder>/*.log
+    Tag                  <your_tag_name>
+    DB                   /var/log/fluent-bit-tail.db
+    db.compare_filename  True
+    Mem_Buf_Limit        50MB
+    Skip_Long_Lines      On
+
+[OUTPUT]
+    Name                  http
+    Match                 *
+    Host                  <your_openobserve_server_host>
+    Port                  <your_openobserve_server_port>
+    URI                   /api/default/<your_tag_name>/_json
+    HTTP_User             <your_openobserve_user>
+    HTTP_Passwd           <your_opeobserve_password>
+    Format                json
+    Json_date_key         time
+    Json_date_format      iso8601
+    TLS                   off
+    compress              gzip
+
+```
+
+
+### Setup logrotate (optional)
+Create config file:
+```bash
+sudo nano /etc/logrotate.d/sbk
+```
+Paste this:
+```bash
+/var/log/samanbayaka/sbk-*.log {
+  daily
+  rotate 14
+  compress
+  delaycompress
+  missingok
+  notifempty
+  copytruncate
+  create 0640 node node
+}
+```
+### Setup SSL certificate for system endpoints
+```bash
+openssl req -x509 -newkey rsa:2048 -nodes \
+  -keyout <your_filename>.key \
+  -out <your_filename>.crt \
+  -days 365
+```
+
+## Documentations
+
+### Errors
+
+`sbk.Errors` exposes the Moleculer `Errors` object.
+
+### getConfigs
+
+`sbk.getConfigs` is a function that returns a configuration object from a specific path of `etcd` server.
+
+
+### createDemo
+
+`sbk.createDemo` is an asynchronous function that creates a demo service to help users understand the project.
+
+### registerSystemAPI
+
+`sbk.registerSystemAPI` is an asynchronous function that registers a gateway service to expose REST APIs for system management. It is a mandatory service that must be registered for every project.
+
+
+### registerEdgeAPI
+
+`sbk.registerEdgeAPI` is an asynchronous function that registers a gateway service to expose REST APIs for the underlying microservices.
+
+### registerServices 
+
+`sbk.registerServices` is an asynchronous function that registers microservices based on the business needs.
+
+##### Function Signature
+
+```js
+sbk.registerServices(schema)
+```
+
+##### Parameter
+
+*  `schema` - An object that follows the Moleculer service schema structure.
+
+Example:
+
+```js
+{
+  name: "math",
+  actions: {
+    add: {
+      rest: {
+        method: "GET",
+        path: "/add"
+      },
+      openapi: {
+        summary: "addition",
+        description: "addition of two numbers",
+        parameters: [
+          {
+            name: "addend1",
+            in: "query",
+            description: "addend",
+            schema: {
+              type: "integer"
+            },
+            examples: [
+              5,
+              8
+            ],
+          },
+          {
+            name: "addend2",
+            in: "query",
+            description: "addend",
+            schema: {
+              type: "integer"
+            },
+            examples: [
+              7,
+              9
+            ],
+          },
+        ],
+      },
+      handler: async(ctx) =>{
+        return Number(ctx.params.query.addend1) + Number(ctx.params.query.addend2)
+      }
+    },
+    sub: {
+      rest: {
+        method: "POST",
+        path: "/sub"
+      },
+      openapi: {
+        summary: "substraction",
+        description: "substraction of two numbers",
+        parameters: [
+          {
+            name: "minuend",
+            in: "query",
+            description: "minuend",
+            schema: {
+              type: "integer"
+            },
+            examples: [
+              15,
+              18
+            ],
+          },
+          {
+            name: "subtrahend",
+            in: "query",
+            description: "subtrahend",
+            schema: {
+              type: "integer"
+            },
+            examples: [
+              7,
+              9
+            ],
+          },
+        ],
+      },
+      handler: async(ctx) =>{
+        return Number(ctx.params.query.minuend) - Number(ctx.params.query.subtrahend)
+      }
+    },
+  }
+}
+```
+
+
+### registerBridgeServices
+
+`sbk.registerBridgeServices` is an asynchronous function used to initialize and manage message brokers such as `Kafka`, `MQTT`, and `RabbitMQ`.
+
+##### Function Signature
+
+```js
+sbk.registerBridgeServices(
+  type,
+  brokerOpts = {},
+  callback = () => {}
+)
+```
+##### Parameters
+
+* `type` *(string)* - Specifies the broker type to initialize. Supported values:
+
+  * `"kafka"`
+  * `"mqtt"`
+  * `"amqp"`
+
+Example:
+
+```js
+"kafka"
+```
+
+
+* `brokerOpts` *(object)* - Configuration object used to initialize the broker client, producer, and consumer. Example structure:
+
+```js
+{
+  name: <your_service_name>
+  client: {},
+  producer: {},
+  consumer: {
+    groupId: "all",
+    interMessageDelayMs: 10,
+  },
+  logLevel: "INFO",
+  gzip: true,
+  msgPack: true,
+  rest: false,
+}
+```
+
+Configuration Options
+
+| Property | Type | Description |
+|---|---|---|
+| `name` | `string` | Only lowercase letters (a–z), digits (0–9), and hyphens (-) are allowed. |
+| `client` | `object` | Broker client configuration |
+| `producer` | `object` | Producer configuration |
+| `consumer` | `object` | Consumer configuration |
+| `consumer.groupId` | `string` | Consumer group identifier is mandatory for the consumer |
+| `consumer.interMessageDelayMs` | `number` | Optional delay between messages in milliseconds |
+| `logLevel` | `string` | Logging level (`NOTHING`, `ERROR`, `WARN`, `INFO`, `DEBUG`), default `NOTHING` |
+| `gzip` | `boolean` | Enables message compression; only GZIP is supported, default `true` |
+| `msgPack` | `boolean` | Enables MessagePack serialization, default `true` |
+| `rest` | `boolean` | Enables REST end point, default `false` |
+
+
+* `callback` *(function)* - Callback function executed when a message/event is received.
+
+Arguments
+
+| Argument | Description |
+|---|---|
+| `ctx` | Broker context |
+| `payload` | Incoming message payload |
+
+Example:
+
+```js
+(ctx, payload) => {
+  ctx.broker.logger.debug(payload)
+}
+```
+
+## Usage
+### Register gateway service
+The `gateway` is a critical service that exposes all endpoints as REST APIs. At least one Gateway service must be running to make the REST APIs accessible.
+```bash
+mkdir gateway
+cd gateway
+pnpm init
+pnpm install samanbayaka
+touch index.mjs
+```
+
+Open `index.mjs` and paste the following:
+```bash
+import sbk from "samanbayaka"
+await sbk.registerEdgeAPI()
+```
+---
+### Register microservices
+```bash
+mkdir <your_service_name>
+cd <your_service_name>
+pnpm init
+pnpm install samanbayaka
+touch index.mjs
+```
+
+A microservice, such as `hello`, can be created as follows:
+```bash
+mkdir hello
+cd hello
+pnpm init
+pnpm install samanbayaka
+touch index.mjs
+```
+
+Open `index.mjs` and paste the following:
+```bash
+import sbk from "samanbayaka"
+await sbk.registerServices({
+  name: "hello",
+  version: "v1",
+
+  actions: {
+    hello: {
+      rest: {
+        method: "GET",
+        path: "/hello"
+      },
+
+      /**
+       * Enable caching to this action
+       */
+      cache: {
+
+        /**
+         * Cache entries expire after 30 seconds.
+         * For L1 caching, TTL should be defined as [L2_TTL, L1_TTL].
+         * Example: ttl: [60, 10] → L2 TTL is 60 seconds and L1 TTL is 10 seconds.
+         */      
+        ttl: 30
+      },
+      handler(ctx){
+        return "Hello Samanbayaka"
+      }
+    },
+    welcome: {
+      rest: "GET /welcome",
+      handler(ctx) {
+        return `Welcome, ${ctx.params.query?.name || "Guest"} - ${ctx.broker.nodeID}`
+      }
+    },
+  },
+})
+
+```
+---
+### Register bridge services
+##### for producer
+```bash
+mkdir <your_service_name>-<type>-<topic>
+cd <your_service_name>-<type>-<topic>
+pnpm init
+pnpm install samanbayaka
+touch index.mjs
+```
+An bridge service, such as a `producer` that publishes messages to the `STUDENT` topic, can be created as follows:
+```js
+mkdir producer-kafka-student
+cd producer-kafka-student
+pnpm init
+pnpm install samanbayaka
+touch index.mjs
+```
+
+Open `index.mjs` and paste the following:
+```bash
+import sbk from "samanbayaka"
+await sbk.registerBridgeServices(
+  "kafka",
+  {
+    name: "producer-kafka-student", 
+    rest: true,
+    ...
+  }, 
+  () => {}
+)
+```
+In the service configuration `name` end with "`*`" i.e. `producer-kafka-student*` can capable to publish to the all topics start with `STUDENT` like `STUDENT.SCIENCE`, `STUDENT.ARTS` etc.
+```js
+name: "producer-kafka-student*"
+```
+
+If you do not expose the service as a REST API and run it as a private/internal service, either remove the `rest` property or set it to `false`.
+```js
+rest: false
+```
+
+#### for consumer
+```bash
+mkdir <your_service_name>-<type>-<topic>-<group>
+cd <your_service_name>-<type>-<topic>-<group>
+pnpm init
+pnpm install samanbayaka
+touch index.mjs
+```
+An bridge service, such as a `consumer` that subscribe messages from the `STUDENT` topic having group name `junior`, can be created as follows:
+```js
+mkdir consumer-kafka-student-junior
+cd consumer-kafka-student-junior
+pnpm init
+pnpm install samanbayaka
+touch index.mjs
+```
+Open `index.mjs` and paste the following:
+```bash
+import sbk from "samanbayaka"
+await sbk.registerBridgeServices(
+  "kafka",
+  {
+    name: "consumer-kafka-student", 
+    consumer: {
+      groupId: "junior",
+      interMessageDelayMs: 10,
+      ...
+    },
+    ...
+  }, 
+  () => {}
+)
+```
+The `interMessageDelayMs` option introduces a delay between two consecutive message/event consumptions, measured in milliseconds. If you do not need any delay between message consumption, simply remove the `interMessageDelayMs` property from the consumer options.
+
+
+---
+
+### Run the services 
+
+ * For development/testing environment
+
+```bash
+cd <your_path>/gateway
+SBK_CONFIG_CRED='<your_etcd_user> <your_etcd_pass> <your_etcd_port>' node index.mjs
+cd <your_path>/hello
+SBK_CONFIG_CRED='<your_etcd_user> <your_etcd_pass> <your_etcd_port>' node index.mjs
+```
+
+ * For production environment
+```bash
+cd <your_path>/gateway
+SBK_CONFIG_CRED='<your_etcd_user> <your_etcd_pass> <your_etcd_port>' node index.mjs >> /var/log/samanbayaka/sbk-${HOSTNAME}-$$.log 2>&1
+cd <your_path>/hello
+SBK_CONFIG_CRED='<your_etcd_user> <your_etcd_pass> <your_etcd_port>' node index.mjs >> /var/log/samanbayaka/sbk-${HOSTNAME}-$$.log 2>&1
+```
+or
+```bash
+cd <your_path>/gateway
+SBK_CONFIG_CRED='<your_etcd_user> <your_etcd_pass> <your_etcd_port>' pm2 start index.mjs --name "$(basename "$PWD")" --stop-exit-codes 1 --output /var/log/samanbayaka/sbk-out-${HOSTNAME}-$$.log --error /var/log/samanbayaka/sbk-err-${HOSTNAME}-$$.log
+cd <your_path>/hello
+SBK_CONFIG_CRED='<your_etcd_user> <your_etcd_pass> <your_etcd_port>' pm2 start index.mjs --name "$(basename "$PWD")" --stop-exit-codes 1 --output /var/log/samanbayaka/sbk-out-${HOSTNAME}-$$.log --error /var/log/samanbayaka/sbk-err-${HOSTNAME}-$$.log
+```
+
+## Demo
+You can also run the demo service to better understand how microservices work in the Moleculer ecosystem and how REST APIs are exposed.
+```bash
+mkdir demo
+cd demo
+pnpm init
+pnpm install samanbayaka
+touch demo.mjs
+```
+Open and edit the `demo.mjs` file as follows
+```bash
+import sbk from "samanbayaka"
+await sbk.createDemo()
+```
+Run the service, demo
+```bash
+node demo.mjs
+```
+
+## Dockers
+
+### `etcd`
+To manage configurations centrally, use the docker-compose.yml file to run `etcd` and all `.yml` configuration files must be deployed to /usr/local/etc/your_project_name.
+```bash
+mkdir -p etcd
+cd etcd
+touch docker-compose.yml
+export ETCD_ROOT_PW=<your_root_pass>
+export ETCD_CONFIG_ADMIN_PW=<your_config_admin_pass>
+sudo mkdir -p /usr/local/etc/<your_project_name>
+``` 
+
+Open `docker-compose.yml` and paste the following:
+```yml
+services:
+  etcd:
+    image: quay.io/coreos/etcd:v3.5.5
+    container_name: <your_container_name>
+
+    ports:
+      - "<your_api_port>:2379"
+      - "<your_cluster_port>:2380"
+
+    volumes:
+      - /usr/local/etc/<your_project_name>:/etcd-data
+
+    command:
+      - /usr/local/bin/etcd
+      - --name=etcd
+      - --data-dir=/etcd-data
+      - --listen-client-urls=http://0.0.0.0:2379
+      - --advertise-client-urls=http://etcd:2379
+      - --listen-peer-urls=http://0.0.0.0:2380
+      - --initial-advertise-peer-urls=http://etcd:2380
+      - --initial-cluster=etcd=http://etcd:2380
+      - --initial-cluster-state=new
+
+    restart: unless-stopped
+
+  etcd-init:
+    image: quay.io/coreos/etcd:v3.5.5
+    depends_on:
+      - etcd
+
+    volumes:
+      - /usr/local/etc/<your_project_name>:/etcd-data
+
+    environment:
+      - ETCDCTL_API=3
+
+    entrypoint: 
+      - /bin/sh
+      - -c
+
+    command:
+      - |
+        set -e
+
+        echo "waiting for etcd..."
+
+        for i in $(seq 1 30); do
+          etcdctl --endpoints=http://etcd:2379 endpoint health && break
+          echo "retry $$i..."
+          sleep 2
+        done
+
+        echo "etcd initialized"
+
+        echo "Creating the root role"
+        etcdctl --endpoints=http://etcd:2379 role add root || true
+
+        echo "Creating the root user"
+        etcdctl --endpoints=http://etcd:2379 user add root:${ETCD_ROOT_PW} || true
+
+        echo "Granting the root role to the root user"
+        etcdctl --endpoints=http://etcd:2379 user grant-role root root
+
+        echo "Enable authentication"
+        etcdctl --endpoints=http://etcd:2379 auth enable || true
+
+        # -------------------------------------------------------
+
+        echo "Creating admin role"
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} role add admin
+
+        echo "Granting broad permissions"
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} role grant-permission --prefix=true admin readwrite /
+
+        echo "Creating configadmin user"
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} user add configadmin:${ETCD_CONFIG_ADMIN_PW}
+
+        echo "Assign role"
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} user grant-role configadmin admin
+
+        # ---------------------------------------------------------
+
+        echo "Creating Roles and Granting"
+
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} role add default
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} role grant-permission --prefix=true default read /config/sbk/global/
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} role grant-permission --prefix=true default read /config/sbk/members/
+
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} role add edge
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} role grant-permission --prefix=true edge read /config/sbk/edge/
+
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} role add bridge
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} role grant-permission --prefix=true bridge read /config/sbk/bridge/
+
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} role add sap
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} role grant-permission --prefix=true sap read /config/sbk/sap/
+
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} role add dbs
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} role grant-permission --prefix=true dbs read /config/sbk/dbs/
+
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} role add msg
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} role grant-permission --prefix=true msg read /config/sbk/msg/
+
+        # ---------------------------------------------------------
+        
+        echo "Creating User and Assign Role"
+
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} user add sbk:<your_pass>
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} user grant-role sbk default
+
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} user add apigw:<your_pass>
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} user grant-role apigw default
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} user grant-role apigw edge
+
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} user add msgbus:<your_pass>
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} user grant-role msgbus default
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} user grant-role msgbus bridge
+
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} user add sap:<your_pass>
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} user grant-role sap default
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} user grant-role sap sap
+
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} user add dbs:<your_pass>
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} user grant-role dbs default
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} user grant-role dbs dbs
+
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} user add msg:<your_pass>
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} user grant-role msg default
+        etcdctl --endpoints=http://etcd:2379 --user=root:${ETCD_ROOT_PW} user grant-role msg msg
+
+        # ---------------------------------------------------------
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/sys/yaml/sysconfig "$(cat /etcd-data/sysconfig.yml)" || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/sys/certs/SERVER_KEY "" || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/sys/certs/SERVER_CRT "" || true
+
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/global/envs/REVISION "" || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/global/envs/APP_ENV development || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/global/envs/LOG_LEVEL warn || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/global/envs/MAX_L1_TTL 120 || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/global/envs/MAX_L2_TTL 600 || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/global/envs/TELEMETRY false || true
+
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/global/broker/yaml/nats "$(cat /etcd-data/nats.yml)" || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/global/catcher/yaml/redis "$(cat /etcd-data/redis.yml)" || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/global/telemetry/yaml/openobserve "$(cat /etcd-data/openobserve.yml)" || true
+
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/edge/yaml/auth "$(cat /etcd-data/auth.yml)" || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/edge/yaml/roles "$(cat /etcd-data/roles.yml)" || true
+        #--------------------------------------------------
+        # regx pattern for allow corss site like 
+        # abc.example.com, pqr.example.com
+        # and cors origins like abc.example1.com
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/edge/CORS "^(?:[a-zA-Z0-9-]+\\.)?(?:wbsedcl\\.in|wbsedcl\\.incom)$" || true
+
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/bridge/yaml/kafka "$(cat /etcd-data/kafka.yml)" || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/bridge/yaml/mqtt "$(cat /etcd-data/mqtt.yml)" || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/bridge/yaml/amqp "$(cat /etcd-data/amqp.yml)" || true
+
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/sap/yaml/isu "$(cat /etcd-data/isu.yml)" || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/sap/yaml/erp "$(cat /etcd-data/erp.yml)" || true
+
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/dbs/pg/yaml/gisdb "$(cat /etcd-data/gisdb.yml)" || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/dbs/pg/yaml/geomdb "$(cat /etcd-data/geomdb.yml)" || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/dbs/pg/yaml/acmadb "$(cat /etcd-data/acmadb.yml)" || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/dbs/pg/yaml/isudb "$(cat /etcd-data/isudb.yml)" || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/dbs/pg/yaml/crmdb "$(cat /etcd-data/crmdb.yml)" || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/dbs/pg/yaml/mdasdb "$(cat /etcd-data/mdasdb.yml)" || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/dbs/pg/yaml/route-sms "$(cat /etcd-data/route-sms.yml)" || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/dbs/pg/yaml/route-otp "$(cat /etcd-data/route-otp.yml)" || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/dbs/pg/yaml/outlook "$(cat /etcd-data/outlook.yml)" || true
+
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/members/demo true || true
+        
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/members/system true || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/members/system/envs/LOG_LEVEL error || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/members/system/envs/MAX_L1_TTL 0 || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/members/system/envs/MAX_L2_TTL 0 || true
+
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/members/gateway true || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/members/gateway/envs/PORT 8765 || true
+
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/members/test true || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/members/sms add || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/members/email add || true
+        etcdctl --endpoints=http://etcd:2379 --user=configadmin:${ETCD_CONFIG_ADMIN_PW} put /config/sbk/members/dbs-pg-gisadmin add || true
+
+
+        #etcdctl --endpoints=http://etcd:2379 --user=<your_user>:<your_pass> get /config/sbk/ --prefix
+        #etcdctl --endpoints=http://etcd:2379 --user=<your_user>:<your_pass> get /config/sbk/global/app_env
+
+        echo "etcd initialization completed"
+```
+Optionally verify:
+```bash
+docker ps | grep '<your_container_name>'
+```
+Optionally check health:
+```bash
+docker exec -it <your_container_name> etcdctl --endpoints=http://etcd:2379 endpoint health
+```
+---
+
+<p align="center" style="margin-top: 100px;">
+  <img src="https://moleculer.services/images/banner.png" alt="Moleculer Logo" width="600">
+</p>