@hotmeshio/hotmesh 0.0.2 → 0.0.4

package/README.md

@@ -1,7 +1,7 @@
 # HotMesh
 ![alpha release](https://img.shields.io/badge/release-alpha-yellow)
 
-Build sophisticated, durable workflows without the overhead of a dedicated server cluster. With HotMesh, your code remains front and center using [infrastructure](./docs/faq.md#what-is-hotmesh) you already own.
+Build sophisticated, durable workflows without the overhead of a dedicated server cluster. With HotMesh, your code remains front and center using [infrastructure](https://github.com/hotmeshio/sdk-typescript/blob/main/docs/faq.md#what-is-hotmesh) you already own.
 
 ## Install
 [![npm version](https://badge.fury.io/js/%40hotmeshio%2Fhotmesh.svg)](https://badge.fury.io/js/%40hotmeshio%2Fhotmesh)
@@ -98,7 +98,7 @@ run().catch((err) => {
 });
 ```
 
->HotMesh delivers durable function execution using a swarm of [distributed engines](./docs/distributed_orchestration.md). The design  consumes leftover CPU on your microservices to execute workflows without the cost and complexity of a central server.
+>HotMesh delivers durable function execution using a [distributed service mesh](https://github.com/hotmeshio/sdk-typescript/blob/main/docs/distributed_orchestration.md). The design consumes leftover CPU on your microservices to execute workflows without the cost and complexity of a central server/control plane.
 
 ## Advanced Design
 HotMesh's TypeScript SDK is the easiest way to make your functions durable. But if you need full control over your function lifecycles (including high-volume, high-speed use cases), you can use HotMesh's underlying YAML models to optimize your durable workflows. The following model depicts a sequence of activities orchestrated by HotMesh. Any function you associate with a `topic` in your YAML definition is guaranteed to be durable.
@@ -208,34 +208,34 @@ const hotMesh = await HotMesh.init({
 ```
 
 ### Observability
-Workflows and activities are run according to the rules you define, offering [Graph-Oriented](./docs/system_lifecycle.md#telemetry) telemetry insights into your legacy function executions.
+Workflows and activities are run according to the rules you define, offering [Graph-Oriented](https://github.com/hotmeshio/sdk-typescript/blob/main/docs/system_lifecycle.md#telemetry) telemetry insights into your legacy function executions.
 
 ## FAQ
-Refer to the [FAQ](./docs/faq.md) for terminology, definitions, and an exploration of how HotMesh facilitates orchestration use cases.
+Refer to the [FAQ](https://github.com/hotmeshio/sdk-typescript/blob/main/docs/faq.md) for terminology, definitions, and an exploration of how HotMesh facilitates orchestration use cases.
 
 ## Quick Start
-Refer to the [Quick Start](./docs/quickstart.md) for sample flows you can easily copy, paste, and modify to get started.
+Refer to the [Quick Start](https://github.com/hotmeshio/sdk-typescript/blob/main/docs/quickstart.md) for sample flows you can easily copy, paste, and modify to get started.
 
 ## Developer Guide
-For more details on the complete development process, including information about schemas, APIs, and deployment, consult the [Developer Guide](./docs/developer_guide.md).
+For more details on the complete development process, including information about schemas, APIs, and deployment, consult the [Developer Guide](https://github.com/hotmeshio/sdk-typescript/blob/main/docs/developer_guide.md).
 
 ## Model Driven Development
-[Model Driven Development](./docs/model_driven_development.md) is an established strategy for managing process-oriented tasks. Check out this guide to understand its foundational principles.
+[Model Driven Development](https://github.com/hotmeshio/sdk-typescript/blob/main/docs/model_driven_development.md) is an established strategy for managing process-oriented tasks. Check out this guide to understand its foundational principles.
 
 ## Data Mapping
-Exchanging data between activities is central to HotMesh. For detailed information on supported functions and the functional mapping syntax (@pipes), see the [Data Mapping Overview](./docs/data_mapping.md).
+Exchanging data between activities is central to HotMesh. For detailed information on supported functions and the functional mapping syntax (@pipes), see the [Data Mapping Overview](https://github.com/hotmeshio/sdk-typescript/blob/main/docs/data_mapping.md).
 
 ## Composition
-While the simplest graphs are linear, detailing a consistent sequence of non-cyclical activities, graphs can be layered to represent intricate business scenarios. Some can even be designed to accommodate long-lasting workflows that span months. For more details, check out the [Composable Workflow Guide](./docs/composable_workflow.md).
+While the simplest graphs are linear, detailing a consistent sequence of non-cyclical activities, graphs can be layered to represent intricate business scenarios. Some can even be designed to accommodate long-lasting workflows that span months. For more details, check out the [Composable Workflow Guide](https://github.com/hotmeshio/sdk-typescript/blob/main/docs/composable_workflow.md).
 
 ## Architectural First Principles
-For a deep dive into HotMesh's distributed orchestration philosophy, refer to the [Architectural First Principles Overview](./docs/architecture.md).
+For a deep dive into HotMesh's distributed orchestration philosophy, refer to the [Architectural First Principles Overview](https://github.com/hotmeshio/sdk-typescript/blob/main/docs/architecture.md).
 
 ## Distributed Orchestration
-HotMesh is a distributed orchestration engine. Refer to the [Distributed Orchestration Guide](./docs/distributed_orchestration.md) for a detailed breakdown of the approach.
+HotMesh is a distributed orchestration engine. Refer to the [Distributed Orchestration Guide](https://github.com/hotmeshio/sdk-typescript/blob/main/docs/distributed_orchestration.md) for a detailed breakdown of the approach.
 
 ## System Lifecycle
-Gain insight into the HotMesh's monitoring, exception handling, and alarm configurations via the [System Lifecycle Guide](./docs/system_lifecycle.md).
+Gain insight into the HotMesh's monitoring, exception handling, and alarm configurations via the [System Lifecycle Guide](https://github.com/hotmeshio/sdk-typescript/blob/main/docs/system_lifecycle.md).
 
 ## Alpha Release
-So what exacty is an [alpha release](./docs/alpha.md)?!
+So what exacty is an [alpha release](https://github.com/hotmeshio/sdk-typescript/blob/main/docs/alpha.md)?!

package/build/package.json

@@ -1,14 +1,14 @@
 {
     "name": "@hotmeshio/hotmesh",
-    "version": "0.0.2",
+    "version": "0.0.4",
     "description": "Durable Workflows",
     "main": "build/index.js",
     "types": "build/index.d.ts",
     "repository": {
         "type": "git",
-        "url": "https://github.com/hotmeshio/hotmesh.git"
+        "url": "https://github.com/hotmeshio/sdk-typescript.git"
     },
-    "homepage": "https://github.com/hotmeshio/hotmesh#readme",
+    "homepage": "https://github.com/hotmeshio/sdk-typescript#readme",
     "publishConfig": {
         "access": "public"
     },

package/build/services/activities/activity.d.ts

@@ -53,6 +53,8 @@ declare class Activity {
     initSelf(context: StringAnyType): JobState;
     initPolicies(context: JobState): void;
     bindActivityData(type: 'output' | 'hook'): void;
+    resolveDad(): string;
+    resolveAdjacentDad(): string;
     filterAdjacent(): Promise<StreamData[]>;
     transition(adjacencyList: StreamData[], jobStatus: JobStatus): Promise<string[]>;
 }

package/build/services/activities/activity.js

@@ -100,7 +100,8 @@ class Activity {
             const durationInSeconds = pipe_1.Pipe.resolve(this.config.sleep, this.context);
             const jobId = this.context.metadata.jid;
             const activityId = this.metadata.aid;
-            await this.engine.task.registerTimeHook(jobId, activityId, 'sleep', durationInSeconds);
+            const dId = this.metadata.dad;
+            await this.engine.task.registerTimeHook(jobId, `${activityId}${dId || ''}`, 'sleep', durationInSeconds);
             return jobId;
         }
     }
@@ -158,6 +159,7 @@ class Activity {
             return jobStatus;
         }
         catch (error) {
+            console.error('this error?', error);
             this.logger.error('engine-process-hook-event-error', error);
             telemetry.setActivityError(error.message);
             throw error;
@@ -214,11 +216,10 @@ class Activity {
         }) ?? [];
     }
     bindDimensionalAddress(state) {
-        const { aid, dad } = this.metadata;
-        state[`${aid}/output/metadata/dad`] = dad;
+        const dad = this.resolveDad();
+        state[`${this.metadata.aid}/output/metadata/dad`] = dad;
     }
     async setState(multi) {
-        const { id: appId } = await this.engine.getVID();
         const jobId = this.context.metadata.jid;
         this.bindJobMetadata();
         this.bindActivityMetadata();
@@ -233,7 +234,8 @@ class Activity {
             this.metadata.aid,
             ...presets
         ];
-        return await this.store.setState(state, this.getJobStatus(), jobId, appId, symbolNames, multi);
+        const dIds = collator_1.CollatorService.getDimensionsById([...this.config.ancestors, this.metadata.aid], this.resolveDad());
+        return await this.store.setState(state, this.getJobStatus(), jobId, symbolNames, dIds, multi);
     }
     bindJobMetadata() {
         //both legs of the most recently run activity (1 and 2) modify ju (job_updated)
@@ -247,6 +249,7 @@ class Activity {
         if (this.status === stream_1.StreamStatus.ERROR) {
             self.output.metadata.err = JSON.stringify(this.data);
         }
+        //todo: verify leg2 never overwrites leg1 `ac`
         self.output.metadata.ac =
             self.output.metadata.au = (0, utils_1.formatISODate)(new Date());
         self.output.metadata.atp = this.config.type;
@@ -315,10 +318,11 @@ class Activity {
             }
         }
         telemetry_1.TelemetryService.addTargetTelemetryPaths(consumes, this.config, this.metadata, this.leg);
-        const { dad, jid } = this.context.metadata;
+        let { dad, jid } = this.context.metadata;
         jobId = jobId || jid;
         //`state` is a flat hash
-        const [state, status] = await this.store.getState(jobId, consumes);
+        const dIds = collator_1.CollatorService.getDimensionsById([...this.config.ancestors, this.metadata.aid], dad);
+        const [state, status] = await this.store.getState(jobId, consumes, dIds);
         //`context` is a tree
         this.context = (0, utils_1.restoreHierarchy)(state);
         this.initDimensionalAddress(dad);
@@ -353,11 +357,25 @@ class Activity {
     bindActivityData(type) {
         this.context[this.metadata.aid][type].data = this.data;
     }
+    resolveDad() {
+        let dad = this.metadata.dad;
+        if (this.adjacentIndex > 0) {
+            //if adjacent index > 0 the activity is cycling; replace last index with cycle index
+            dad = `${dad.substring(0, dad.lastIndexOf(','))},${this.adjacentIndex}`;
+        }
+        return dad;
+    }
+    resolveAdjacentDad() {
+        //concat self and child dimension (all children (leg 1) begin life at 0)
+        return `${this.resolveDad()}${dimension_1.DimensionService.getSeed(0)}`;
+    }
+    ;
     async filterAdjacent() {
         const adjacencyList = [];
         const transitions = await this.store.getTransitions(await this.engine.getVID());
         const transition = transitions[`.${this.metadata.aid}`];
-        const adjacentSuffix = dimension_1.DimensionService.getSeed(this.adjacentIndex);
+        //resolve the dimensional address for adjacent children
+        const adjacentDad = this.resolveAdjacentDad();
         if (transition) {
             for (const toActivityId in transition) {
                 const transitionRule = transition[toActivityId];
@@ -365,7 +383,7 @@ class Activity {
                     adjacencyList.push({
                         metadata: {
                             jid: this.context.metadata.jid,
-                            dad: `${this.metadata.dad}${adjacentSuffix}`,
+                            dad: adjacentDad,
                             aid: toActivityId,
                             spn: this.context['$self'].output.metadata?.l2s,
                             trc: this.context.metadata.trc,

package/build/services/activities/worker.js

@@ -42,6 +42,7 @@ class Worker extends activity_1.Activity {
                 this.logger.error('worker-get-state-error', error);
             }
             else {
+                console.error(error);
                 this.logger.error('worker-process-error', error);
             }
             telemetry.setActivityError(error.message);

package/build/services/collator/index.d.ts

@@ -1,10 +1,11 @@
-import { RedisMulti } from "../../types/redis";
-import { CollationStage } from "../../types/collator";
-import { ActivityDuplex } from "../../types/activity";
-import { HotMeshGraph } from "../../types/hotmesh";
-import { Activity } from "../activities/activity";
+import { RedisMulti } from '../../types/redis';
+import { CollationStage } from '../../types/collator';
+import { ActivityDuplex } from '../../types/activity';
+import { HotMeshGraph } from '../../types/hotmesh';
+import { Activity } from '../activities/activity';
 declare class CollatorService {
     static targetLength: number;
+    static getDimensionalAddress(activity: Activity): Record<string, string>;
     static notarizeEntry(activity: Activity, multi?: RedisMulti): Promise<number>;
     static authorizeReentry(activity: Activity, multi?: RedisMulti): Promise<number>;
     static notarizeEarlyCompletion(activity: Activity, multi?: RedisMulti): Promise<number>;
@@ -17,6 +18,7 @@ declare class CollatorService {
     static isInactive(num: number): boolean;
     static isPrimed(amount: number, leg: ActivityDuplex): boolean;
     static verifyInteger(amount: number, leg: ActivityDuplex, stage: CollationStage): void;
+    static getDimensionsById(ancestors: string[], dad: string): Record<string, string>;
     /**
      * All non-trigger activities are assigned a status seed by their parent
      */

package/build/services/collator/index.js

@@ -4,9 +4,18 @@ exports.CollatorService = void 0;
 const errors_1 = require("../../modules/errors");
 const collator_1 = require("../../types/collator");
 class CollatorService {
+    static getDimensionalAddress(activity) {
+        let dad = activity.context.metadata.dad || activity.metadata.dad;
+        //todo: unsure about this reset
+        // if (dad && activity.leg === 2) {
+        //   console.log('setting dad index back to 0=>', dad);
+        //   dad = `${dad.substring(0, dad.lastIndexOf(','))},0`;
+        // }
+        return CollatorService.getDimensionsById([...activity.config.ancestors, activity.metadata.aid], dad);
+    }
     static async notarizeEntry(activity, multi) {
         //decrement by -100_000_000_000_000
-        const amount = await activity.store.collate(activity.context.metadata.jid, activity.metadata.aid, -100000000000000, multi);
+        const amount = await activity.store.collate(activity.context.metadata.jid, activity.metadata.aid, -100000000000000, this.getDimensionalAddress(activity), multi);
         this.verifyInteger(amount, 1, 'enter');
         return amount;
     }
@@ -14,30 +23,30 @@ class CollatorService {
     static async authorizeReentry(activity, multi) {
         //set second digit to 8, allowing for re-entry
         //decrement by -10_000_000_000_000
-        const amount = await activity.store.collate(activity.context.metadata.jid, activity.metadata.aid, -10000000000000, multi);
+        const amount = await activity.store.collate(activity.context.metadata.jid, activity.metadata.aid, -10000000000000, this.getDimensionalAddress(activity), multi);
         //this.verifyInteger(amount, 1, 'exit');
         return amount;
     }
     static async notarizeEarlyCompletion(activity, multi) {
         //initialize both `possible` (1m) and `actualized` (1) zero dimension, while decrementing the 2nd and 3rd digits to deactivate the activity
-        return await activity.store.collate(activity.context.metadata.jid, activity.metadata.aid, 1000001 - 11000000000000, multi);
+        return await activity.store.collate(activity.context.metadata.jid, activity.metadata.aid, 1000001 - 11000000000000, this.getDimensionalAddress(activity), multi);
     }
     ;
     static async notarizeReentry(activity, multi) {
         //increment by 1_000_000 (indicates re-entry and is used to drive the 'dimensional address' for adjacent activities (minus 1))
-        const amount = await activity.store.collate(activity.context.metadata.jid, activity.metadata.aid, 1000000, multi);
+        const amount = await activity.store.collate(activity.context.metadata.jid, activity.metadata.aid, 1000000, this.getDimensionalAddress(activity), multi);
         this.verifyInteger(amount, 2, 'enter');
         return amount;
     }
     ;
     static async notarizeContinuation(activity, multi) {
         //keep open; actualize the leg2 dimension (+1)
-        return await activity.store.collate(activity.context.metadata.jid, activity.metadata.aid, 1, multi);
+        return await activity.store.collate(activity.context.metadata.jid, activity.metadata.aid, 1, this.getDimensionalAddress(activity), multi);
     }
     ;
     static async notarizeCompletion(activity, multi) {
         //close out; actualize leg2 dimension (+1) and decrement the 3rd digit (-1_000_000_000_000)
-        return await activity.store.collate(activity.context.metadata.jid, activity.metadata.aid, 1 - 1000000000000, multi);
+        return await activity.store.collate(activity.context.metadata.jid, activity.metadata.aid, 1 - 1000000000000, this.getDimensionalAddress(activity), multi);
     }
     ;
     static getDigitAtIndex(num, targetDigitIndex) {
@@ -106,6 +115,20 @@ class CollatorService {
             throw new errors_1.CollationError(amount, leg, stage, faultType);
         }
     }
+    static getDimensionsById(ancestors, dad) {
+        //ancestors is an ordered list of all ancestors, starting with the trigger (['t1', 'a1', 'a2'])
+        //dad is the dimensional address of the ancestors list (',0,5,3')
+        //loop through the ancestors list and create a map of the ancestor to the dimensional address.
+        //return { 't1': ',0', 'a1': ',0,5', 'a1': ',0,5,3', $ADJACENT: ',0,5,3,0' };
+        // `adjacent` is a special key that is used to track the dimensional address of adjacent activities
+        const map = { '$ADJACENT': `${dad},0` };
+        let dadStr = dad;
+        ancestors.reverse().forEach((ancestor) => {
+            map[ancestor] = dadStr;
+            dadStr = dadStr.substring(0, dadStr.lastIndexOf(','));
+        });
+        return map;
+    }
     /**
      * All non-trigger activities are assigned a status seed by their parent
      */

package/build/services/compiler/deployer.d.ts

@@ -1,7 +1,7 @@
 import { StoreService } from '../store';
-import { HotMeshGraph, HotMeshManifest } from "../../types/hotmesh";
-import { RedisClient, RedisMulti } from "../../types/redis";
-import { Symbols } from "../../types/serializer";
+import { HotMeshGraph, HotMeshManifest } from '../../types/hotmesh';
+import { RedisClient, RedisMulti } from '../../types/redis';
+import { Symbols } from '../../types/serializer';
 declare class Deployer {
     manifest: HotMeshManifest | null;
     store: StoreService<RedisClient, RedisMulti> | null;
@@ -12,6 +12,7 @@ declare class Deployer {
         version: string;
     };
     generateSymKeys(): Promise<void>;
+    bindSelf(consumes: Record<string, string[]>, produces: string[], activityId: string): void;
     bindSymbols(startIndex: number, maxIndex: number, existingSymbols: Symbols, prefix: string, produces: string[]): Symbols;
     copyJobSchemas(): void;
     bindBackRefs(): void;

package/build/services/compiler/deployer.js

@@ -53,6 +53,7 @@ class Deployer {
             for (const [activityId, activity] of Object.entries(graph.activities)) {
                 const [lower, upper, symbols] = await this.store.reserveSymbolRange(activityId, DEFAULT_RANGE_SIZE, 'ACTIVITY');
                 const prefix = `${activityId}/`; //activity meta/data is namespaced
+                this.bindSelf(activity.consumes, activity.produces, activityId);
                 const newSymbols = this.bindSymbols(lower, upper, symbols, prefix, activity.produces);
                 if (Object.keys(newSymbols).length) {
                     await this.store.addSymbols(activityId, newSymbols);
@@ -60,6 +61,19 @@ class Deployer {
             }
         }
     }
+    bindSelf(consumes, produces, activityId) {
+        //bind self-referential mappings
+        for (const selfId of [activityId, '$self']) {
+            const selfConsumes = consumes[selfId];
+            if (selfConsumes) {
+                for (const path of selfConsumes) {
+                    if (!produces.includes(path)) {
+                        produces.push(path);
+                    }
+                }
+            }
+        }
+    }
     bindSymbols(startIndex, maxIndex, existingSymbols, prefix, produces) {
         let newSymbols = {};
         let currentSymbols = { ...existingSymbols };

package/build/services/dimension/index.d.ts

@@ -1,4 +1,4 @@
-import { HotMeshGraph } from "../../types/hotmesh";
+import { HotMeshGraph } from '../../types/hotmesh';
 declare class DimensionService {
     static targetLength: number;
     /**

package/build/services/durable/client.d.ts

@@ -1,6 +1,6 @@
-import { WorkflowHandleService } from "./handle";
-import { HotMeshService as HotMesh } from "../hotmesh";
-import { ClientConfig, Connection, WorkflowOptions } from "../../types/durable";
+import { WorkflowHandleService } from './handle';
+import { HotMeshService as HotMesh } from '../hotmesh';
+import { ClientConfig, Connection, WorkflowOptions } from '../../types/durable';
 export declare class ClientService {
     connection: Connection;
     options: WorkflowOptions;

package/build/services/durable/client.js

@@ -92,7 +92,16 @@ class ClientService {
                 await hotMesh.activate(version);
             }
             catch (err) {
-                hotMesh.engine.logger.error('durable-client-workflow-activation-err', err);
+                hotMesh.engine.logger.error('durable-client-deploy-activate-err', err);
+                throw err;
+            }
+        }
+        else if (app && !app.active) {
+            try {
+                await hotMesh.activate(version);
+            }
+            catch (err) {
+                hotMesh.engine.logger.error('durable-client-activate-err', err);
                 throw err;
             }
         }

package/build/services/durable/handle.d.ts

@@ -1,4 +1,4 @@
-import { HotMeshService as HotMesh } from "../hotmesh";
+import { HotMeshService as HotMesh } from '../hotmesh';
 export declare class WorkflowHandleService {
     hotMesh: HotMesh;
     workflowTopic: string;

package/build/services/durable/worker.js

@@ -73,7 +73,16 @@ class WorkerService {
                 await hotMesh.activate(version);
             }
             catch (err) {
-                hotMesh.engine.logger.error('durable-worker-workflow-activation-error', err);
+                hotMesh.engine.logger.error('durable-worker-deploy-activate-err', err);
+                throw err;
+            }
+        }
+        else if (app && !app.active) {
+            try {
+                await hotMesh.activate(version);
+            }
+            catch (err) {
+                hotMesh.engine.logger.error('durable-worker-activate-err', err);
                 throw err;
             }
         }
@@ -176,7 +185,16 @@ class WorkerService {
                 await hotMesh.activate(version);
             }
             catch (err) {
-                console.log('durable-worker-activity-workflow-activation-error', err);
+                console.log('durable-worker-activity-deploy-activate-error', err);
+                throw err;
+            }
+        }
+        else if (app && !app.active) {
+            try {
+                await hotMesh.activate(version);
+            }
+            catch (err) {
+                hotMesh.engine.logger.error('durable-worker-activity-activate-err', err);
                 throw err;
             }
         }

package/build/services/engine/index.d.ts

@@ -58,7 +58,7 @@ declare class EngineService {
     hasParentJob(context: JobState): boolean;
     resolveError(metadata: JobMetadata): StreamError | undefined;
     scrub(jobId: string): Promise<void>;
-    hook(topic: string, data: JobData): Promise<JobStatus | void>;
+    hook(topic: string, data: JobData, dad?: string): Promise<JobStatus | void>;
     hookTime(jobId: string, activityId: string): Promise<JobStatus | void>;
     hookAll(hookTopic: string, data: JobData, query: JobStatsInput, queryFacets?: string[]): Promise<string[]>;
     pub(topic: string, data: JobData, context?: JobState): Promise<string>;

package/build/services/engine/index.js

@@ -317,21 +317,37 @@ class EngineService {
         await this.store.scrub(jobId);
     }
     // ****************** `HOOK` ACTIVITY RE-ENTRY POINT *****************
-    async hook(topic, data) {
+    async hook(topic, data, dad) {
         const hookRule = await this.storeSignaler.getHookRule(topic);
+        const [aid, schema] = await this.getSchema(`.${hookRule.to}`);
+        if (!dad) {
+            //assume dimensional address is singular (0)
+            // for ancestors and self if not provided
+            // todo: register
+            dad = ',0'.repeat(schema.ancestors.length + 1);
+        }
         const streamData = {
             type: stream_2.StreamDataType.WEBHOOK,
-            metadata: { aid: `${hookRule.to}`, topic },
+            metadata: {
+                //jid is unknown at this point; will be resolved using the data
+                aid,
+                dad,
+                topic
+            },
             data,
         };
         await this.streamSignaler.publishMessage(null, streamData);
     }
     async hookTime(jobId, activityId) {
+        //the activityid is concatenated with its dimensional address (dad); split to resolve
+        const [aid, ...dimensions] = activityId.split(',');
+        const dad = `,${dimensions.join(',')}`;
         const streamData = {
             type: stream_2.StreamDataType.TIMEHOOK,
             metadata: {
                 jid: jobId,
-                aid: activityId,
+                aid,
+                dad,
             },
             data: { timestamp: Date.now() },
         };
@@ -484,12 +500,13 @@ class EngineService {
     //      (e.g, if {dimensions:true}, use hscan to deliver
     //      the full set of dimensional job data)
     async getState(topic, jobId) {
-        const { id: appId } = await this.getVID();
         const jobSymbols = await this.store.getSymbols(`$${topic}`);
         const consumes = {
             [`$${topic}`]: Object.keys(jobSymbols)
         };
-        const output = await this.store.getState(jobId, consumes);
+        //job data exists at the 'zero' dimension; pass an empty object
+        const dIds = {};
+        const output = await this.store.getState(jobId, consumes, dIds);
         if (!output) {
             throw new Error(`not found ${jobId}`);
         }

package/build/services/hotmesh/index.d.ts

@@ -37,7 +37,7 @@ declare class HotMeshService {
     getIds(topic: string, query: JobStatsInput, queryFacets?: any[]): Promise<IdsResponse>;
     resolveQuery(topic: string, query: JobStatsInput): Promise<GetStatsOptions>;
     scrub(jobId: string): Promise<void>;
-    hook(topic: string, data: JobData): Promise<JobStatus | void>;
+    hook(topic: string, data: JobData, dad?: string): Promise<JobStatus | void>;
     hookAll(hookTopic: string, data: JobData, query: JobStatsInput, queryFacets?: string[]): Promise<string[]>;
     stop(): Promise<void>;
     compress(terms: string[]): Promise<boolean>;

package/build/services/hotmesh/index.js

@@ -116,9 +116,9 @@ class HotMeshService {
         await this.engine?.scrub(jobId);
     }
     // ****** `HOOK` ACTIVITY RE-ENTRY POINT ******
-    async hook(topic, data) {
+    async hook(topic, data, dad) {
         //return collation int
-        return await this.engine?.hook(topic, data);
+        return await this.engine?.hook(topic, data, dad);
     }
     async hookAll(hookTopic, data, query, queryFacets = []) {
         return await this.engine?.hookAll(hookTopic, data, query, queryFacets);

package/build/services/serializer/index.d.ts

@@ -1,3 +1,4 @@
+import { Consumes } from '../../types/activity';
 import { StringStringType, StringAnyType, SymbolMap, SymbolMaps, SymbolSets, Symbols } from '../../types/serializer';
 export declare const MDATA_SYMBOLS: {
     SLOTS: number;
@@ -15,12 +16,16 @@ export declare const MDATA_SYMBOLS: {
     };
 };
 export declare class SerializerService {
+    dIds: StringStringType;
     symKeys: SymbolMaps;
     symReverseKeys: SymbolMaps;
     symValMaps: SymbolMap;
     symValReverseMaps: SymbolMap;
     constructor();
-    resetSymbols(symKeys: SymbolSets, symVals: Symbols): void;
+    abbreviate(consumes: Consumes, symbolNames: string[], fields?: string[]): string[];
+    resolveDimensionalIndex(path: string): string;
+    isJobPath(path: string): boolean;
+    resetSymbols(symKeys: SymbolSets, symVals: Symbols, dIds: StringStringType): void;
     getReverseKeyMap(keyMap: SymbolMap, id?: string): SymbolMap;
     getReverseValueMap(valueMap: SymbolMap): SymbolMap;
     static filterSymVals(startIndex: number, maxIndex: number, existingSymbolValues: Symbols, proposedValues: Set<string>): Symbols;