@hotmeshio/hotmesh 0.2.3 → 0.3.0

package/README.md

@@ -10,13 +10,13 @@ npm install @hotmeshio/hotmesh
 You have a Redis instance? Good. You're ready to go.
 
 ## Learn
-[SDK Docs](https://hotmeshio.github.io/sdk-typescript/) | [Samples](https://github.com/hotmeshio/samples-typescript) | [Intro Video](https://www.loom.com/share/211bd4b4038d42f0ba34374ef5b6f961?sid=7b889a56-f60f-4ccc-84e7-8c2697e548a9)
+[📄 Docs](https://hotmeshio.github.io/sdk-typescript/) | [💼 Projects](https://github.com/hotmeshio/samples-typescript) | [🎥 Overview (3m)](https://www.loom.com/share/211bd4b4038d42f0ba34374ef5b6f961?sid=7b889a56-f60f-4ccc-84e7-8c2697e548a9) | [🎥 Transactional Workflow (9m)](https://www.loom.com/share/54ffd5266baf4ac6b287578abfd1d821?sid=0db2cef8-ef0d-4e02-a0b7-a1ee14f476ce)
 
 ## MeshCall | Connect Everything
-[MeshCall](https://hotmeshio.github.io/sdk-typescript/classes/services_meshcall.MeshCall.html) connects your functions to the Redis-backed mesh, exposing them as idempotent endpoints. Function responses are cacheable and functions can even run as idempotent cron jobs. Make blazing fast interservice calls that return in milliseconds without the overhead of HTTP.
+[MeshCall](https://hotmeshio.github.io/sdk-typescript/classes/services_meshcall.MeshCall.html) connects your services as a singular mesh, exposing functions as idempotent endpoints. Function responses are cacheable and functions can even run as idempotent cron jobs. Make blazing fast interservice calls that return in milliseconds without the overhead of HTTP.
 
 <details style="padding: .5em">
-  <summary style="font-size:1.25em;">Run an idempotent cron job</summary>
+  <summary style="font-size:1.25em;">Run an idempotent cron job <small>[more]</small></summary>
 
   ### Run a Cron
   This example demonstrates an *idempotent* cron that runs daily at midnight. The `id` makes each cron job unique and ensures that only one instance runs, despite repeated invocations. *The `cron` method returns `false` if a workflow is already running with the same `id`.*
@@ -54,7 +54,7 @@ You have a Redis instance? Good. You're ready to go.
 </details>
 
 <details style="padding: .5em">
-  <summary style="font-size:1.25em;">Interrupt a cron job</summary>
+  <summary style="font-size:1.25em;">Interrupt a cron job <small>[more]</small></summary>
 
   ### Interrupt a Cron
   This example demonstrates how to cancel a running cron job.
@@ -76,7 +76,7 @@ You have a Redis instance? Good. You're ready to go.
 </details>
 
 <details style="padding: .5em">
-  <summary style="font-size:1.25em;">Call any function in any service</summary>
+  <summary style="font-size:1.25em;">Call any function in any service <small>[more]</small></summary>
 
   ### Call a Function
   Make blazing fast interservice calls that behave like HTTP but without the setup and performance overhead. This example demonstrates how to connect a function to the mesh and call it from anywhere on the network.
@@ -129,7 +129,7 @@ You have a Redis instance? Good. You're ready to go.
 </details>
 
 <details style="padding: .5em">
-  <summary style="font-size:1.25em;">Call and <b>cache</b> a function</summary>
+  <summary style="font-size:1.25em;">Call and <b>cache</b> a function <small>[more]</small></summary>
 
   ### Cache a Function
   Redis is great for unburdening stressed services. This solution builds upon the previous example, caching the response. The linked function will only be re/called when the cached result expires. Everything remains the same, except the caller which specifies an `id` and `ttl`.
@@ -172,7 +172,7 @@ You have a Redis instance? Good. You're ready to go.
 [MeshFlow](https://hotmeshio.github.io/sdk-typescript/classes/services_meshflow.MeshFlow.html) is a drop-in replacement for [Temporal.io](https://temporal.io). If you need to orchestrate your functions as durable workflows, MeshFlow combines the popular Temporal SDK with Redis' *in-memory execution speed*.
 
 <details style="padding: .5em">
-  <summary style="font-size:1.25em;">Orchestrate unpredictable activities</summary>
+  <summary style="font-size:1.25em;">Orchestrate unpredictable activities <small>[more]</small></summary>
 
 ### Proxy Activities
 When an endpoint is unpredictable, use `proxyActivities`. HotMesh will retry as necessary until the call succeeds. This example demonstrates a workflow that greets a user in both English and Spanish. Even though both activities throw random errors, the workflow always returns a successful result.
@@ -263,7 +263,7 @@ When an endpoint is unpredictable, use `proxyActivities`. HotMesh will retry as
 </details>
 
 <details style="padding: .5em">
-  <summary style="font-size:1.25em;">Pause and wait for a signal</summary>
+  <summary style="font-size:1.25em;">Pause and wait for a signal <small>[more]</small></summary>
 
 ### Wait for Signal
 Pause a function and only awaken when a matching signal is received from the outide.
@@ -356,7 +356,7 @@ Pause a function and only awaken when a matching signal is received from the out
 </details>
 
 <details style="padding: .5em">
-  <summary style="font-size:1.25em;">Wait for multiple signals (collation)</summary>
+  <summary style="font-size:1.25em;">Wait for multiple signals (collation) <small>[more]</small></summary>
 
 ### Collate Multiple Signals
 Use a standard `Promise` to collate and cache multiple signals. HotMesh will only awaken once **all** signals have arrived. HotMesh will track up to 25 concurrent signals.
@@ -406,7 +406,7 @@ Use a standard `Promise` to collate and cache multiple signals. HotMesh will onl
 </details>
 
 <details style="padding: .5em">
-  <summary style="font-size:1.25em;">Create a recurring, cyclical workflow</summary>
+  <summary style="font-size:1.25em;">Create a recurring, cyclical workflow <small>[more]</small></summary>
 
 ### Cyclical Workflow
 This example calls an activity and then sleeps for a week. It runs indefinitely until it's manually stopped. It takes advantage of durable execution and can safely sleep for months or years.
@@ -511,7 +511,7 @@ Deployments with the Redis `FT.SEARCH` module enabled can use the **MeshData** m
 *For those Redis deployments without the `FT.SEARCH` module, it's still useful to define a workflow schema. The MeshData class provides convenience methods for reading and writing hash field data to a workflow record (e.g., `get`, `del`, and `incr`).*
 
 <details style="padding: .5em">
-  <summary style="font-size:1.25em;">Create a search index</summary>
+  <summary style="font-size:1.25em;">Create a search index <small>[more]</small></summary>
 
 ### Workflow Data Indexes
 
@@ -551,7 +551,7 @@ This example demonstrates how to define a schema and deploy an index for a 'user
 </details>
 
 <details style="padding: .5em">
-  <summary style="font-size:1.25em;">Create an indexed, searchable record</summary>
+  <summary style="font-size:1.25em;">Create an indexed, searchable record <small>[more]</small></summary>
 
 ### Workflow Record Data
 This example demonstrates how to create a 'user' workflow backed by the searchable schema from the prior example.
@@ -631,7 +631,7 @@ This example demonstrates how to create a 'user' workflow backed by the searchab
 </details>
 
 <details style="padding: .5em">
-  <summary style="font-size:1.25em;">Fetch record data</summary>
+  <summary style="font-size:1.25em;">Fetch record data <small>[more]</small></summary>
 
 ### Read Record Data
 This example demonstrates how to read data fields directly from a workflow.
@@ -662,7 +662,7 @@ This example demonstrates how to read data fields directly from a workflow.
 </details> 
 
 <details style="padding: .5em">
-  <summary style="font-size:1.25em;">Search record data</summary>
+  <summary style="font-size:1.25em;">Search record data <small>[more]</small></summary>
 
 ### Query Record Data
 This example demonstrates how to search for those workflows where a given condition exists in the data. This one searches for active users. *NOTE: The native Redis FT.SEARCH syntax is supported. The JSON abstraction shown here is a convenience method for straight-forward, one-dimensional queries.*

package/build/modules/enums.d.ts

@@ -1,6 +1,7 @@
 import { LogLevel } from '../types/logger';
 export declare const HMSH_LOGLEVEL: LogLevel;
 export declare const HMSH_IS_CLUSTER: boolean;
+export declare const HMSH_SIGNAL_EXPIRE = 3600;
 export declare const HMSH_CODE_SUCCESS = 200;
 export declare const HMSH_CODE_PENDING = 202;
 export declare const HMSH_CODE_NOTFOUND = 404;

package/build/modules/enums.js

@@ -1,8 +1,9 @@
 "use strict";
 Object.defineProperty(exports, "__esModule", { value: true });
-exports.HMSH_GUID_SIZE = exports.HMSH_SCOUT_INTERVAL_SECONDS = exports.HMSH_FIDELITY_SECONDS = exports.HMSH_EXPIRE_DURATION = exports.HMSH_XPENDING_COUNT = exports.HMSH_XCLAIM_COUNT = exports.HMSH_XCLAIM_DELAY_MS = exports.HMSH_BLOCK_TIME_MS = exports.HMSH_MESHFLOW_EXP_BACKOFF = exports.HMSH_MESHFLOW_MAX_INTERVAL = exports.HMSH_MESHFLOW_MAX_ATTEMPTS = exports.HMSH_GRADUATED_INTERVAL_MS = exports.HMSH_MAX_TIMEOUT_MS = exports.HMSH_MAX_RETRIES = exports.MAX_DELAY = exports.HMSH_EXPIRE_JOB_SECONDS = exports.HMSH_OTT_WAIT_TIME = exports.HMSH_ACTIVATION_MAX_RETRY = exports.HMSH_QUORUM_DELAY_MS = exports.HMSH_QUORUM_ROLLCALL_CYCLES = exports.HMSH_STATUS_UNKNOWN = exports.HMSH_CODE_MESHFLOW_RETRYABLE = exports.HMSH_CODE_MESHFLOW_FATAL = exports.HMSH_CODE_MESHFLOW_MAXED = exports.HMSH_CODE_MESHFLOW_TIMEOUT = exports.HMSH_CODE_MESHFLOW_WAIT = exports.HMSH_CODE_MESHFLOW_PROXY = exports.HMSH_CODE_MESHFLOW_CHILD = exports.HMSH_CODE_MESHFLOW_ALL = exports.HMSH_CODE_MESHFLOW_SLEEP = exports.HMSH_CODE_UNACKED = exports.HMSH_CODE_TIMEOUT = exports.HMSH_CODE_UNKNOWN = exports.HMSH_CODE_INTERRUPT = exports.HMSH_CODE_NOTFOUND = exports.HMSH_CODE_PENDING = exports.HMSH_CODE_SUCCESS = exports.HMSH_IS_CLUSTER = exports.HMSH_LOGLEVEL = void 0;
+exports.HMSH_GUID_SIZE = exports.HMSH_SCOUT_INTERVAL_SECONDS = exports.HMSH_FIDELITY_SECONDS = exports.HMSH_EXPIRE_DURATION = exports.HMSH_XPENDING_COUNT = exports.HMSH_XCLAIM_COUNT = exports.HMSH_XCLAIM_DELAY_MS = exports.HMSH_BLOCK_TIME_MS = exports.HMSH_MESHFLOW_EXP_BACKOFF = exports.HMSH_MESHFLOW_MAX_INTERVAL = exports.HMSH_MESHFLOW_MAX_ATTEMPTS = exports.HMSH_GRADUATED_INTERVAL_MS = exports.HMSH_MAX_TIMEOUT_MS = exports.HMSH_MAX_RETRIES = exports.MAX_DELAY = exports.HMSH_EXPIRE_JOB_SECONDS = exports.HMSH_OTT_WAIT_TIME = exports.HMSH_ACTIVATION_MAX_RETRY = exports.HMSH_QUORUM_DELAY_MS = exports.HMSH_QUORUM_ROLLCALL_CYCLES = exports.HMSH_STATUS_UNKNOWN = exports.HMSH_CODE_MESHFLOW_RETRYABLE = exports.HMSH_CODE_MESHFLOW_FATAL = exports.HMSH_CODE_MESHFLOW_MAXED = exports.HMSH_CODE_MESHFLOW_TIMEOUT = exports.HMSH_CODE_MESHFLOW_WAIT = exports.HMSH_CODE_MESHFLOW_PROXY = exports.HMSH_CODE_MESHFLOW_CHILD = exports.HMSH_CODE_MESHFLOW_ALL = exports.HMSH_CODE_MESHFLOW_SLEEP = exports.HMSH_CODE_UNACKED = exports.HMSH_CODE_TIMEOUT = exports.HMSH_CODE_UNKNOWN = exports.HMSH_CODE_INTERRUPT = exports.HMSH_CODE_NOTFOUND = exports.HMSH_CODE_PENDING = exports.HMSH_CODE_SUCCESS = exports.HMSH_SIGNAL_EXPIRE = exports.HMSH_IS_CLUSTER = exports.HMSH_LOGLEVEL = void 0;
 exports.HMSH_LOGLEVEL = process.env.HMSH_LOGLEVEL || 'info';
 exports.HMSH_IS_CLUSTER = process.env.HMSH_IS_CLUSTER === 'true';
+exports.HMSH_SIGNAL_EXPIRE = 3600;
 exports.HMSH_CODE_SUCCESS = 200;
 exports.HMSH_CODE_PENDING = 202;
 exports.HMSH_CODE_NOTFOUND = 404;

package/build/modules/errors.d.ts

@@ -39,6 +39,7 @@ declare class MeshFlowChildError extends Error {
     backoffCoefficient: number;
     code: number;
     expire: number;
+    persistent: boolean;
     signalIn: boolean;
     workflowDimension: string;
     index: number;

package/build/modules/errors.js

@@ -53,6 +53,7 @@ class MeshFlowChildError extends Error {
         this.workflowTopic = params.workflowTopic;
         this.parentWorkflowId = params.parentWorkflowId;
         this.expire = params.expire;
+        this.persistent = params.persistent;
         this.signalIn = params.signalIn;
         this.originJobId = params.originJobId;
         this.index = params.index;

package/build/modules/utils.d.ts

@@ -36,3 +36,4 @@ export declare function getValueByPath(obj: {
 }, path: string): any;
 export declare function restoreHierarchy(obj: StringAnyType): StringAnyType;
 export declare function isValidCron(cronExpression: string): boolean;
+export declare const s: (input: string) => number;

package/build/modules/utils.js

@@ -3,20 +3,12 @@ var __importDefault = (this && this.__importDefault) || function (mod) {
     return (mod && mod.__esModule) ? mod : { "default": mod };
 };
 Object.defineProperty(exports, "__esModule", { value: true });
-exports.isValidCron = exports.restoreHierarchy = exports.getValueByPath = exports.getIndexedHash = exports.getSymVal = exports.getSymKey = exports.formatISODate = exports.getTimeSeries = exports.getSubscriptionTopic = exports.findSubscriptionForTrigger = exports.findTopKey = exports.matchesStatus = exports.matchesStatusCode = exports.identifyRedisTypeFromClass = exports.polyfill = exports.identifyRedisType = exports.XSleepFor = exports.sleepImmediate = exports.sleepFor = exports.guid = exports.deterministicRandom = exports.deepCopy = exports.getSystemHealth = exports.hashOptions = void 0;
+exports.s = exports.isValidCron = exports.restoreHierarchy = exports.getValueByPath = exports.getIndexedHash = exports.getSymVal = exports.getSymKey = exports.formatISODate = exports.getTimeSeries = exports.getSubscriptionTopic = exports.findSubscriptionForTrigger = exports.findTopKey = exports.matchesStatus = exports.matchesStatusCode = exports.identifyRedisTypeFromClass = exports.polyfill = exports.identifyRedisType = exports.XSleepFor = exports.sleepImmediate = exports.sleepFor = exports.guid = exports.deterministicRandom = exports.deepCopy = exports.getSystemHealth = exports.hashOptions = void 0;
 const os_1 = __importDefault(require("os"));
 const crypto_1 = require("crypto");
 const nanoid_1 = require("nanoid");
+const ms_1 = __importDefault(require("ms"));
 const enums_1 = require("./enums");
-async function safeExecute(operation, defaultValue) {
-    try {
-        return await operation;
-    }
-    catch (error) {
-        console.error(`Operation Error: ${error}`);
-        return defaultValue;
-    }
-}
 const hashOptions = (options) => {
     const str = JSON.stringify(options);
     return (0, crypto_1.createHash)('sha256').update(str).digest('hex');
@@ -244,3 +236,7 @@ function isValidCron(cronExpression) {
     return cronRegex.test(cronExpression);
 }
 exports.isValidCron = isValidCron;
+const s = (input) => {
+    return (0, ms_1.default)(input) / 1000;
+};
+exports.s = s;

package/build/package.json

@@ -1,6 +1,6 @@
 {
     "name": "@hotmeshio/hotmesh",
-    "version": "0.2.3",
+    "version": "0.3.0",
     "description": "Unbreakable Workflows",
     "main": "./build/index.js",
     "types": "./build/index.d.ts",

package/build/services/activities/activity.d.ts

@@ -59,6 +59,9 @@ declare class Activity {
     resolveDad(): string;
     resolveAdjacentDad(): string;
     filterAdjacent(): Promise<StreamData[]>;
+    isJobComplete(jobStatus: JobStatus): boolean;
+    shouldEmit(): boolean;
+    shouldPersistJob(): boolean;
     transition(adjacencyList: StreamData[], jobStatus: JobStatus): Promise<string[]>;
     jobWasInterrupted(jobStatus: JobStatus): boolean;
 }

package/build/services/activities/activity.js

@@ -405,6 +405,10 @@ class Activity {
     initPolicies(context) {
         const expire = pipe_1.Pipe.resolve(this.config.expire ?? enums_1.HMSH_EXPIRE_DURATION, context);
         context.metadata.expire = expire;
+        if (this.config.persistent != undefined) {
+            const persistent = pipe_1.Pipe.resolve(this.config.persistent ?? false, context);
+            context.metadata.persistent = persistent;
+        }
     }
     bindActivityData(type) {
         this.context[this.metadata.aid][type].data = this.data;
@@ -446,21 +450,34 @@ class Activity {
         }
         return adjacencyList;
     }
+    isJobComplete(jobStatus) {
+        return jobStatus <= 0;
+    }
+    shouldEmit() {
+        if (this.config.emit) {
+            return pipe_1.Pipe.resolve(this.config.emit, this.context) === true;
+        }
+        return false;
+    }
+    shouldPersistJob() {
+        if (this.config.persist !== undefined) {
+            return pipe_1.Pipe.resolve(this.config.persist, this.context) === true;
+        }
+        return false;
+    }
     async transition(adjacencyList, jobStatus) {
         if (this.jobWasInterrupted(jobStatus)) {
             return;
         }
         let mIds = [];
-        let emit = false;
-        if (this.config.emit) {
-            emit = pipe_1.Pipe.resolve(this.config.emit, this.context);
-        }
-        if (jobStatus <= 0 || emit) {
+        if (this.shouldEmit() ||
+            this.isJobComplete(jobStatus) ||
+            this.shouldPersistJob()) {
             await this.engine.runJobCompletionTasks(this.context, {
-                emit: jobStatus > 0,
+                emit: !this.isJobComplete(jobStatus) && !this.shouldPersistJob(),
             });
         }
-        if (adjacencyList.length && jobStatus > 0) {
+        if (adjacencyList.length && !this.isJobComplete(jobStatus)) {
             const multi = this.store.getMulti();
             for (const execSignal of adjacencyList) {
                 await this.engine.router?.publishMessage(null, execSignal, multi);

package/build/services/activities/hook.js

@@ -7,6 +7,7 @@ const pipe_1 = require("../pipe");
 const task_1 = require("../task");
 const telemetry_1 = require("../telemetry");
 const stream_1 = require("../../types/stream");
+const enums_1 = require("../../modules/enums");
 const activity_1 = require("./activity");
 class Hook extends activity_1.Activity {
     constructor(config, data, metadata, hook, engine, context) {
@@ -68,7 +69,7 @@ class Hook extends activity_1.Activity {
     }
     async doHook(telemetry) {
         const multi = this.store.getMulti();
-        await this.registerHook(multi);
+        await this.registerHook(enums_1.HMSH_IS_CLUSTER ? undefined : multi);
         this.mapOutputData();
         this.mapJobData();
         await this.setState(multi);
@@ -102,7 +103,7 @@ class Hook extends activity_1.Activity {
     }
     async registerHook(multi) {
         if (this.config.hook?.topic) {
-            return await this.engine.taskService.registerWebHook(this.config.hook.topic, this.context, this.resolveDad(), multi);
+            return await this.engine.taskService.registerWebHook(this.config.hook.topic, this.context, this.resolveDad(), this.context.metadata.expire, multi);
         }
         else if (this.config.sleep) {
             const duration = pipe_1.Pipe.resolve(this.config.sleep, this.context);

package/build/services/activities/trigger.js

@@ -40,6 +40,7 @@ class Trigger extends activity_1.Activity {
             else {
                 await this.registerJobDependency(multi);
             }
+            await collator_1.CollatorService.notarizeInception(this, this.context.metadata.guid, multi);
             await multi.exec();
             this.execAdjacentParent();
             telemetry.mapActivityAttributes();
@@ -51,13 +52,24 @@ class Trigger extends activity_1.Activity {
             return this.context.metadata.jid;
         }
         catch (error) {
+            telemetry?.setActivityError(error.message);
             if (error instanceof errors_1.DuplicateJobError) {
-                this.logger.error('duplicate-job-error', { job_id: error.jobId });
+                const isOverage = await collator_1.CollatorService.isInceptionOverage(this, this.context.metadata.guid);
+                if (isOverage) {
+                    this.logger.info('duplicate-job-overage', {
+                        job_id: error.jobId,
+                        guid: this.context.metadata.guid,
+                    });
+                    return;
+                }
+                this.logger.error('duplicate-job-error', {
+                    job_id: error.jobId,
+                    guid: this.context.metadata.guid,
+                });
             }
             else {
                 this.logger.error('trigger-process-error', { ...error });
             }
-            telemetry?.setActivityError(error.message);
             throw error;
         }
         finally {
@@ -82,9 +94,6 @@ class Trigger extends activity_1.Activity {
         if (options.pending) {
             return -1;
         }
-        else if (options.statusThreshold) {
-            return 1000000 - options.statusThreshold + count;
-        }
         return count;
     }
     async setExpired(seconds, multi) {
@@ -166,6 +175,7 @@ class Trigger extends activity_1.Activity {
                 tpc: this.config.subscribes,
                 trc: this.context.metadata.trc,
                 spn: this.context.metadata.spn,
+                guid: this.context.metadata.guid,
                 jid: jobId,
                 dad: collator_1.CollatorService.getDimensionalSeed(),
                 key: jobKey,

package/build/services/collator/index.d.ts

@@ -13,6 +13,8 @@ declare class CollatorService {
     static authorizeReentry(activity: Activity, multi?: RedisMulti): Promise<number>;
     static notarizeEarlyExit(activity: Activity, multi?: RedisMulti): Promise<number>;
     static notarizeEarlyCompletion(activity: Activity, multi?: RedisMulti): Promise<number>;
+    static notarizeInception(activity: Activity, guid: string, multi: RedisMulti): Promise<void>;
+    static isInceptionOverage(activity: Activity, guid: string): Promise<boolean>;
     static notarizeReentry(activity: Activity, guid: string, multi?: RedisMulti): Promise<number>;
     static notarizeContinuation(activity: Activity, multi?: RedisMulti): Promise<number>;
     static notarizeCompletion(activity: Activity, multi?: RedisMulti): Promise<number>;

package/build/services/collator/index.js

@@ -43,6 +43,18 @@ class CollatorService {
             : 11000000000000;
         return await activity.store.collate(activity.context.metadata.jid, activity.metadata.aid, 1000001 - decrement, this.getDimensionalAddress(activity), multi);
     }
+    static async notarizeInception(activity, guid, multi) {
+        if (guid) {
+            await activity.store.collateSynthetic(activity.context.metadata.jid, guid, 1000000, multi);
+        }
+    }
+    static async isInceptionOverage(activity, guid) {
+        if (guid) {
+            const amount = await activity.store.collateSynthetic(activity.context.metadata.jid, guid, 1000000);
+            return amount > 1000000;
+        }
+        return false;
+    }
     static async notarizeReentry(activity, guid, multi) {
         const jid = activity.context.metadata.jid;
         const localMulti = multi || activity.store.getMulti();

package/build/services/compiler/deployer.js

@@ -125,6 +125,7 @@ class Deployer {
                     activities[activityKey].publishes = graph.publishes;
                 }
                 activities[activityKey].expire = graph.expire ?? undefined;
+                activities[activityKey].persistent = graph.persistent ?? undefined;
             }
         }
     }

package/build/services/engine/index.js

@@ -92,6 +92,7 @@ class EngineService {
             reclaimDelay: config.engine.reclaimDelay,
             reclaimCount: config.engine.reclaimCount,
             throttle,
+            readonly: config.engine.readonly,
         }, this.stream, this.store, this.logger);
     }
     async fetchAndVerifyVID(vid, count = 0) {

package/build/services/exporter/index.js

@@ -15,7 +15,7 @@ class ExporterService {
             this.symbols = this.store.getAllSymbols();
             this.symbols = await this.symbols;
         }
-        const depData = await this.store.getDependencies(jobId);
+        const depData = [];
         const jobData = await this.store.getRaw(jobId);
         const jobExport = this.inflate(jobData, depData);
         return jobExport;

package/build/services/meshcall/index.d.ts

@@ -1,21 +1,21 @@
 import { HotMesh } from '../hotmesh';
-import { MeshCallConnectParams, MeshCallCronParams, MeshCallExecParams, MeshCallFlushParams, MeshCallInterruptParams } from '../../types/meshcall';
+import { MeshCallConnectParams, MeshCallCronParams, MeshCallExecParams, MeshCallFlushParams, MeshCallInstanceOptions, MeshCallInterruptParams } from '../../types/meshcall';
 import { RedisConfig } from '../../types';
 declare class MeshCall {
     static workers: Map<string, HotMesh | Promise<HotMesh>>;
     static engines: Map<string, HotMesh | Promise<HotMesh>>;
     static connections: Map<string, any>;
     constructor();
-    static findFirstMatching(workers: Map<string, HotMesh | Promise<HotMesh>>, namespace: string, config: RedisConfig): Promise<HotMesh | void>;
-    static getHotMeshClient: (namespace: string, connection: RedisConfig) => Promise<HotMesh>;
+    static findFirstMatching(targets: Map<string, HotMesh | Promise<HotMesh>>, namespace: string, config: RedisConfig, options?: MeshCallInstanceOptions): Promise<HotMesh | void>;
+    static getHotMeshClient: (namespace: string, connection: RedisConfig, options?: MeshCallInstanceOptions) => Promise<HotMesh>;
     static verifyWorkflowActive(hotMesh: HotMesh, appId?: string, count?: number): Promise<boolean>;
     static activateWorkflow(hotMesh: HotMesh, appId?: string, version?: string): Promise<void>;
-    static getInstance(namespace: string, redis: RedisConfig): Promise<HotMesh>;
+    static getInstance(namespace: string, redis: RedisConfig, options?: MeshCallInstanceOptions): Promise<HotMesh>;
     static connect(params: MeshCallConnectParams): Promise<HotMesh>;
     static exec<U>(params: MeshCallExecParams): Promise<U>;
     static flush(params: MeshCallFlushParams): Promise<void>;
     static cron(params: MeshCallCronParams): Promise<boolean>;
-    static interrupt(params: MeshCallInterruptParams): Promise<void>;
+    static interrupt(params: MeshCallInterruptParams): Promise<boolean>;
     static shutdown(): Promise<void>;
 }
 export { MeshCall };

package/build/services/meshcall/index.js

@@ -1,11 +1,7 @@
 "use strict";
-var __importDefault = (this && this.__importDefault) || function (mod) {
-    return (mod && mod.__esModule) ? mod : { "default": mod };
-};
 var _a;
 Object.defineProperty(exports, "__esModule", { value: true });
 exports.MeshCall = void 0;
-const ms_1 = __importDefault(require("ms"));
 const hotmesh_1 = require("../hotmesh");
 const enums_1 = require("../../modules/enums");
 const utils_1 = require("../../modules/utils");
@@ -14,11 +10,15 @@ const cron_1 = require("../pipe/functions/cron");
 const factory_1 = require("./schemas/factory");
 class MeshCall {
     constructor() { }
-    static async findFirstMatching(workers, namespace = key_1.HMNS, config) {
-        for (const [id, hotMeshInstance] of workers) {
-            if ((await hotMeshInstance).namespace === namespace) {
+    static async findFirstMatching(targets, namespace = key_1.HMNS, config, options = {}) {
+        for (const [id, hotMeshInstance] of targets) {
+            const hotMesh = await hotMeshInstance;
+            const appId = hotMesh.engine.appId;
+            if (appId === namespace) {
                 if (id.startsWith((0, utils_1.hashOptions)(config.options))) {
-                    return hotMeshInstance;
+                    if (Boolean(options.readonly) == Boolean(hotMesh.engine.router.readonly)) {
+                        return hotMeshInstance;
+                    }
                 }
             }
         }
@@ -60,12 +60,15 @@ class MeshCall {
             }
         }
     }
-    static async getInstance(namespace, redis) {
-        let hotMeshInstance = await MeshCall.findFirstMatching(MeshCall.workers, namespace, redis);
+    static async getInstance(namespace, redis, options = {}) {
+        let hotMeshInstance;
+        if (!options.readonly) {
+            hotMeshInstance = await MeshCall.findFirstMatching(MeshCall.workers, namespace, redis, options);
+        }
         if (!hotMeshInstance) {
-            hotMeshInstance = await MeshCall.findFirstMatching(MeshCall.engines, namespace, redis);
+            hotMeshInstance = await MeshCall.findFirstMatching(MeshCall.engines, namespace, redis, options);
             if (!hotMeshInstance) {
-                hotMeshInstance = (await MeshCall.getHotMeshClient(namespace, redis));
+                hotMeshInstance = (await MeshCall.getHotMeshClient(namespace, redis, options));
             }
         }
         return hotMeshInstance;
@@ -121,7 +124,7 @@ class MeshCall {
         }
         let expire = 1;
         if (params.options?.ttl) {
-            expire = (0, ms_1.default)(params.options.ttl) / 1000;
+            expire = (0, utils_1.s)(params.options.ttl);
         }
         const jobOutput = await hotMeshInstance.pubsub(TOPIC, { id, expire, topic: params.topic, args: params.args }, null, 30000);
         return jobOutput?.data?.response;
@@ -131,7 +134,7 @@ class MeshCall {
         await hotMeshInstance.scrub(params.id ?? params?.options?.id);
     }
     static async cron(params) {
-        try {
+        if (params.callback) {
             await MeshCall.connect({
                 logLevel: params.logLevel,
                 guid: params.guid,
@@ -140,22 +143,24 @@ class MeshCall {
                 callback: params.callback,
                 namespace: params.namespace,
             });
-            const TOPIC = `${params.namespace ?? key_1.HMNS}.cron`;
-            let delay = params.options.delay
-                ? (0, ms_1.default)(params.options.delay) / 1000
-                : undefined;
-            let cron;
-            let interval = enums_1.HMSH_FIDELITY_SECONDS;
-            if ((0, utils_1.isValidCron)(params.options.interval)) {
-                cron = params.options.interval;
-                delay = Math.max(new cron_1.CronHandler().nextDelay(cron), 0);
-            }
-            else {
-                const seconds = (0, ms_1.default)(params.options.interval) / 1000;
-                interval = Math.max(seconds, enums_1.HMSH_FIDELITY_SECONDS);
-            }
-            const maxCycles = params.options.maxCycles ?? 1000000;
-            const hotMeshInstance = await MeshCall.getInstance(params.namespace, params.redis);
+        }
+        const TOPIC = `${params.namespace ?? key_1.HMNS}.cron`;
+        const maxCycles = params.options.maxCycles ?? 100000;
+        let interval = enums_1.HMSH_FIDELITY_SECONDS;
+        let delay;
+        let cron;
+        if ((0, utils_1.isValidCron)(params.options.interval)) {
+            cron = params.options.interval;
+            const nextDelay = new cron_1.CronHandler().nextDelay(cron);
+            delay = nextDelay > 0 ? nextDelay : undefined;
+        }
+        else {
+            const seconds = (0, utils_1.s)(params.options.interval);
+            interval = Math.max(seconds, enums_1.HMSH_FIDELITY_SECONDS);
+            delay = params.options.delay ? (0, utils_1.s)(params.options.delay) : undefined;
+        }
+        try {
+            const hotMeshInstance = await MeshCall.getInstance(params.namespace, params.redis, { readonly: params.callback ? false : true, guid: params.guid });
             await hotMeshInstance.pub(TOPIC, {
                 id: params.options.id,
                 topic: params.topic,
@@ -176,7 +181,13 @@ class MeshCall {
     }
     static async interrupt(params) {
         const hotMeshInstance = await MeshCall.getInstance(params.namespace, params.redis);
-        await hotMeshInstance.interrupt(`${params.namespace ?? key_1.HMNS}.cron`, params.options.id, { throw: false, expire: 60 });
+        try {
+            await hotMeshInstance.interrupt(`${params.namespace ?? key_1.HMNS}.cron`, params.options.id, { throw: false, expire: 1 });
+        }
+        catch (error) {
+            return false;
+        }
+        return true;
     }
     static async shutdown() {
         for (const [_, hotMeshInstance] of MeshCall.workers) {
@@ -193,7 +204,7 @@ _a = MeshCall;
 MeshCall.workers = new Map();
 MeshCall.engines = new Map();
 MeshCall.connections = new Map();
-MeshCall.getHotMeshClient = async (namespace, connection) => {
+MeshCall.getHotMeshClient = async (namespace, connection, options = {}) => {
     const optionsHash = (0, utils_1.hashOptions)(connection.options);
     const targetNS = namespace ?? key_1.HMNS;
     const connectionNS = `${optionsHash}.${targetNS}`;
@@ -203,6 +214,7 @@ MeshCall.getHotMeshClient = async (namespace, connection) => {
         return hotMeshClient;
     }
     const hotMeshClient = hotmesh_1.HotMesh.init({
+        guid: options.guid,
         appId: targetNS,
         logLevel: enums_1.HMSH_LOGLEVEL,
         engine: {
@@ -210,6 +222,7 @@ MeshCall.getHotMeshClient = async (namespace, connection) => {
                 class: connection.class,
                 options: connection.options,
             },
+            readonly: options.readonly,
         },
     });
     MeshCall.engines.set(connectionNS, hotMeshClient);

package/build/services/meshcall/schemas/factory.js

@@ -72,8 +72,6 @@ const getWorkflowYAML = (appId = key_1.HMNS, version = exports.VERSION) => {
 
     - subscribes: ${appId}.cron
 
-      expire: 120
-
       input:
         schema:
           type: object
@@ -123,6 +121,8 @@ const getWorkflowYAML = (appId = key_1.HMNS, version = exports.VERSION) => {
               properties:
                 sleepSeconds:
                   type: number
+                iterationCount:
+                  type: number
             maps:
               sleepSeconds:
                 '@pipe':

package/build/services/meshdata/index.d.ts

@@ -1,6 +1,6 @@
 import { HotMesh } from '../hotmesh';
 import { WorkflowOptions, WorkflowSearchOptions, FindJobsOptions, FindOptions, FindWhereOptions, SearchResults, FindWhereQuery } from '../../types/meshflow';
-import { CallOptions, ConnectionInput, ConnectOptions, ExecInput, HookInput } from '../../types/meshdata';
+import { CallOptions, ConnectionInput, ExecInput, HookInput } from '../../types/meshdata';
 import { RedisClass, RedisOptions } from '../../types/redis';
 import { StringAnyType, StringStringType } from '../../types/serializer';
 import { JobInterruptOptions, JobOutput } from '../../types/job';
@@ -45,7 +45,7 @@ declare class MeshData {
         unsub: (callback: QuorumMessageCallback, options?: SubscriptionOptions) => Promise<void>;
     };
     connect<T>({ entity, target, options, }: ConnectionInput<T>): Promise<boolean>;
-    bindCallOptions(args: any[], options: ConnectOptions, callOptions?: CallOptions): StringAnyType;
+    bindCallOptions(args: any[], callOptions?: CallOptions): StringAnyType;
     pauseForTTL<T>(result: T, options: CallOptions): Promise<void>;
     publishDone<T>(result: T, hotMesh: HotMesh, options: CallOptions): Promise<void>;
     flush(entity: string, id: string, namespace?: string): Promise<string | void>;