@anonaddy/omni-worker 0.0.1 → 0.1.0

package/README.md

@@ -1,21 +1,27 @@
 # 👷 Omni Worker - A Versatile Worker for Typescript
-Webworkers (browser) and thread workers (NodeJS) are usually limiting in their application, since the code that runs on a worker needs to be serializable. Therefore interfaces aren't fully supported, and also 3rd party libraries usually don't work.
+Webworkers (browser) and thread workers (NodeJS) are usually limiting in their application, since the code that runs on a worker needs to be serializable. Therefore, most interfaces aren't fully supported, and also 3rd party modules usually don't work or give you a serious headache when implementing them...
 
-Enter the stage, OmniWorkers! These workers allow you to simply declare any interface with functions that will actually run inside a worker. Whether it be on the web (webworker) or as a thread worker in NodeJS, these workers will run your code, no matter what.
+Enter the stage, OmniWorkers! These workers allow you to simply declare any interface with functions that will actually run inside a worker. Whether it be on the web (webworker) or on NodeJS (thread worker), these workers will run your code, period.
 
 ## How does it Work?
-In the case of jsDOM, the UI will block at certain tasks if it's too heavy. Alternatively, in case of Node, load times will take longer since the JavaScript V8 engine only runs one event loop thread. Even when using asynchronous code, the event loop can easily get overloaded.
+In the case of using typescript for front-end projects, a UI will simply block at certain tasks if they're too heavy. Alternatively, in case of Node, load times can significantly increase since the JavaScript V8 engine only runs one event loop thread. Even when using asynchronous code, the event loop is still just one thread.
 
 ### Workers
-The [Webworker API](https://developer.mozilla.org/en-US/docs/Web/API/Web_Workers_API) for the web and [Worker Threads](https://nodejs.org/api/worker_threads.html) for NodeJS allow us to declare code inside a seperate file, which will run in its own context. The advantage, is that we now have more than one event loop thread to work on. The drawback of course, is that all code executed inside these (contexed) workers needs to be serializable, since your code is basically shipped into the worker for execution. If you have code that depends on other 3rd party libraries, your code will most-likely not build, since the code inside the worker context is closed off.
+The [Webworker API](https://developer.mozilla.org/en-US/docs/Web/API/Web_Workers_API) for the web and [Worker Threads](https://nodejs.org/api/worker_threads.html) for NodeJS allow us to declare code inside a seperate file, which will run in its own context (event loop). The advantage of this is that we now have more than one event loop thread to work with. 
+
+The drawback here, is that all code executed inside these (contexed) workers needs to be serializable, since your code is basically shipped into the worker for execution. This is done through the Worker communication interface. Should your code depend on other 3rd party libraries, your code will most-likely not execute, since the code inside the worker context is mostly closed off.
 
 ### 👷 OmniWorkers
-So how do OmniWorkers stand out from normal workers? First off, the simplicity. Simply declare your code and expose it to the main event loop. Then, build the OmniWorker by referencing you file. Now, the OmniWorker will expose the object with functions you've injected into the worker container. You can use your own functions with primitive types, functions directly taken from 3rd party modules or a hybrid mix of both. Let's look at an example:
+So how do OmniWorkers stand out from normal workers? First off, their simplicity. Simply declare your code and expose it to the main event loop. Then build the OmniWorker by simply referencing you file. Now, the OmniWorker will expose the object with functions you've injected into the worker container. You can use your own functions with primitive types, functions directly taken from 3rd party modules or a hybrid mix of both. Let's look at an example:
 
 #### `👷‍♀️ workers/worker.ts`
 ```javascript
 import { NodeOmniWorker } from "@anonaddy/omni-worker";
+
+// Interface declared by you
 import { IMyOmniWorkerFunctions } from "./worker-model";
+
+// 3rd party module dependency
 import { capitalize } from "lodash";
 
 // Declare your functions using an interface
@@ -37,15 +43,16 @@ import { NodeOmniWorker } from "@anonaddy/omni-worker";
 import { IMyOmniWorkerFunctions } from "./worker-model";
 
 // Use the static path from your project's root
-const WORKER_DIR = "src/workers";
-
-// Build the worker from the file you specified and the
-// functions that were exposed
-const worker = await NodeOmniWorker
-  .build<IMyOmniWorkerFunctions>(`${WORKER_DIR}/worker`);
+const WORKER_DIR = "./src/workers";
 
 // Placing anonymous async function on the event loop
 setTimeout(async () => {
+
+  // Build the worker from the file you specified and the
+  // functions that were exposed
+  const worker = await NodeOmniWorker
+    .build<IMyOmniWorkerFunctions>(`${WORKER_DIR}/worker.ts`);
+
   const sum = await worker.use().add(1, 2);
   const str = await worker.use().capitalize("hello");
 
@@ -54,34 +61,83 @@ setTimeout(async () => {
     The result of my sum is: ${sum}!
     Aren't Omniworkers just awesome?!
   `);
+
+  // Release resources once you're done!
+  await worker.destroy();
 }, 0);
 ```
-Your code can now just asynchronously call the logic you have declared and exposed inside your worker. Simply call the `worker.use()` function and you'll have access to all the functions defined by you inside your `IMyOwnWorkerFunctions` interface.
+Your code can now just **asynchronously** call the logic you have declared and exposed inside your worker.ts. Simply call the `worker.use()` function and you'll have access to all the functions defined by you inside your `IMyOwnWorkerFunctions` interface. 
 
-### Under the Hood
-This modules leverages [Comlink](https://github.com/GoogleChromeLabs/comlink) and [Esbuild](https://github.com/evanw/esbuild) to parse your container code, build it and wire it up to the main event loop using Comlink.
+> `⚠️ Even if your functions are not returning a Promise in your declaration file, now they will!`
+
+### Worker Pools
+Sometimes, having one worker just isn't enough. Worker pools are capable of instantiating multiple workers and consuming their compute power in a round-robin fashion. Let's look at an example:
+
+#### `🏊‍♂️ pool.ts`
+```javascript
+import { NodeOmniWorkerPool } from '@anonaddy/omni-worker';
+import { IMyOmniWorkerFunctions } from "./worker-model";
+
+setTimeout(async () => {
 
-### Tests
-Tests are included inside this library. If you would like to learn how to build and instantiate your workers, you can find examples inside the test code, for node inside `__tests_node__` and for web `__tests_dom__` respectively.
+  const pool = await NodeOmniWorkerPool
+    .buildAndLaunch<IMyOmniWorkerFunctions>(
+      './src/worker/workers/normal.worker.ts',
+      { numOfWorkers: 4 }
+    );
+
+  const sentence = "i very much like your new tie brother joe";
+  const fns: (() => Promise<string>)[] = [];
+
+  // capitalize each word (promisified)
+  for (const word of sentence.split(' ')) {
+    const fn = async () => {
+      return await pool.use().capitalize(word);
+    }
+    fns.push(fn);
+  }
+  
+  // await all promises and join up the words
+  const result = await Promise.all(fns.map(fn => fn()));
+  console.log(result.join(' '));
+  
+  // Release resources once you're done!
+  await pool.destroy();
+
+}, 0);
+
+```
+The code example above will create a worker pool of 4 workers with the code you specified. All work will be distributed round-robin across the OmniWorkers.
+
+### Under the Hood
+This modules leverages [Webpack](https://www.npmjs.com/package/webpack) to parse your container code and build it. From there, it's wired up to the main event loop using a great module called [Comlink](https://github.com/GoogleChromeLabs/comlink). This module abstracts away the communication between the main event loop and Workers.
 
 # Potential Issues
-There's cases where building the worker could lead to errors. Especially when working with packages that use bindings for other languages such as C or C++ for example and that are built to `*.node` binary files using node-gyp. One could experience situations like:
+There's cases where building the worker(pool)s could lead to errors. Especially when working with modules that use bindings to other languages such as C or C++. These are usually compiled to native code such as `*.node` binary files using node-gyp. A common error is:
 ```
-❌ Module did not self-register: /path/to/node-gyp/built/binary.node
+❌ Module did not self-register: /path/to/native/binary.node
 ```
-The root cause is assumed to be a mismatch on either the build or the initialization stage of the binary. Oftentimes, performing these steps, helps:
+If you're trying to run multiple OmniWorkers (for example inside an OmniWorkerPool) and multiple OmniWorkers depend on the same library (with native .node binary), then this could lead to serious issues. The reason for this, is that multiple contexts are trying to access the same .node file at the same time, which leads to NodeJS not being able to access the file (DLOPEN fails).
+
+If you're absolutely sure that you're only running one OmniWorker and that your OmniWorker depends on native code, but the build still fails, theses are some steps you could try, before trying to start the OmniWorker again:
 ``` bash
-# first, retry the rebuild
+# rebuild the .node native code
 npm rebuild <your lib>
 
-# if that didn't work
+# if that didn't work try deleting package info
 rm -rf node_modules
 mv package-lock.json package-lock.json.backup # make sure to make a backup!
 npm i
 ```
-Should you run into the issue above, or similar other issues, please drop me an email on the address mentioned at the bottom of this doc.
+Should you not be able to solve your issue, please drop me an email so we can try and analyze the issue together.
 
 # Project Status
-Currently, only `NodeOmniWorker`s are available. The `WebOmniWorker`s will also be available soon. Please stay tuned! In case you have any questions, make sure to drop me an [email](mailto:7ebr7fa0@anonaddy.com) and I will try to get back to you asap.
+Currently, only `NodeOmniWorker`s and `NodeOmniWorkerPool`s are available. The `WebOmniWorker`s along with their pools will also be available soon. Please stay tuned! In case you have any questions, make sure to drop me an [email](mailto:7ebr7fa0@anonaddy.com) and I will try to get back to you asap.
+
+## Change Log
+|Version|Description|
+|:-:|-|
+|**v0.1.0**|Switched from ESBuild to Webpack for NodeJS and introduced the NodeOmniWorkerPool|
+|**v0.0.1**|Basic of single NodeOmniWorker with code having native dependencies still crashing|
 
-🏗️ **Happy (Omni)Working!!** 🏗️
+### 🏗️ Happy (Omni)Working!! 🏗️

package/dist/cjs/index.js

@@ -1,84 +1,8 @@
 "use strict";
-var __createBinding = (this && this.__createBinding) || (Object.create ? (function(o, m, k, k2) {
-    if (k2 === undefined) k2 = k;
-    var desc = Object.getOwnPropertyDescriptor(m, k);
-    if (!desc || ("get" in desc ? !m.__esModule : desc.writable || desc.configurable)) {
-      desc = { enumerable: true, get: function() { return m[k]; } };
-    }
-    Object.defineProperty(o, k2, desc);
-}) : (function(o, m, k, k2) {
-    if (k2 === undefined) k2 = k;
-    o[k2] = m[k];
-}));
-var __setModuleDefault = (this && this.__setModuleDefault) || (Object.create ? (function(o, v) {
-    Object.defineProperty(o, "default", { enumerable: true, value: v });
-}) : function(o, v) {
-    o["default"] = v;
-});
-var __importStar = (this && this.__importStar) || (function () {
-    var ownKeys = function(o) {
-        ownKeys = Object.getOwnPropertyNames || function (o) {
-            var ar = [];
-            for (var k in o) if (Object.prototype.hasOwnProperty.call(o, k)) ar[ar.length] = k;
-            return ar;
-        };
-        return ownKeys(o);
-    };
-    return function (mod) {
-        if (mod && mod.__esModule) return mod;
-        var result = {};
-        if (mod != null) for (var k = ownKeys(mod), i = 0; i < k.length; i++) if (k[i] !== "default") __createBinding(result, mod, k[i]);
-        __setModuleDefault(result, mod);
-        return result;
-    };
-})();
-var __importDefault = (this && this.__importDefault) || function (mod) {
-    return (mod && mod.__esModule) ? mod : { "default": mod };
-};
 Object.defineProperty(exports, "__esModule", { value: true });
-exports.NodeOmniWorker = void 0;
-const worker_threads_1 = require("worker_threads");
-const Comlink = __importStar(require("comlink"));
-const node_adapter_js_1 = __importDefault(require("comlink/dist/umd/node-adapter.js"));
-const node_1 = require("./builder/node");
-class NodeOmniWorker {
-    constructor(api) {
-        this.isInitialized = () => (this._api !== undefined);
-        this.use = () => {
-            const isInitialized = this.isInitialized();
-            if (isInitialized) {
-                return this._api;
-            }
-            else {
-                throw Error('worker is not yet initialized. make sure to call the .set() function, first');
-            }
-        };
-        this._api = api;
-        return this;
-    }
-    /**
-     * Build the OmniWorker from a worker file. Please note that the functions
-     * on the worker file need to first be exposed using the expose({ <functions> })
-     * functions, in order to start this build step.
-     *
-     * @param path The relative path to where the worker module is located
-     * @returns A new Node OmniWorker
-     */
-    static async build(path) {
-        const api = await (0, node_1.buildApiNode)(path);
-        return new NodeOmniWorker(api);
-    }
-}
-exports.NodeOmniWorker = NodeOmniWorker;
-/**
- * Expose the functions inside the worker to the rest of the application.
- * After having exposed the functions, the build step can be initiated.
- * @param functions An object with functions inside the worker to be exposed to
- * the rest of the application.
- */
-NodeOmniWorker.expose = (functions) => {
-    if (worker_threads_1.parentPort) {
-        Comlink.expose(functions, (0, node_adapter_js_1.default)(worker_threads_1.parentPort));
-    }
-};
+exports.NodeOmniWorkerPool = exports.NodeOmniWorker = void 0;
+var node_1 = require("./node");
+Object.defineProperty(exports, "NodeOmniWorker", { enumerable: true, get: function () { return node_1.NodeOmniWorker; } });
+var pool_1 = require("./node/pool");
+Object.defineProperty(exports, "NodeOmniWorkerPool", { enumerable: true, get: function () { return pool_1.NodeOmniWorkerPool; } });
 //# sourceMappingURL=index.js.map

package/dist/cjs/index.js.map

@@ -1 +1 @@
-{"version":3,"file":"index.js","sourceRoot":"","sources":["../../src/index.ts"],"names":[],"mappings":";;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;AAGA,mDAA4C;AAC5C,iDAAmC;AACnC,uFAA4D;AAC5D,yCAA8C;AAE9C,MAAa,cAAc;IAGzB,YAAoB,GAAsB;QAgCnC,kBAAa,GAAG,GAAY,EAAE,CAAC,CACpC,IAAI,CAAC,IAAI,KAAK,SAAS,CACxB,CAAC;QAEK,QAAG,GAAG,GAAG,EAAE;YAChB,MAAM,aAAa,GAAG,IAAI,CAAC,aAAa,EAAE,CAAC;YAC3C,IAAI,aAAa,EAAE,CAAC;gBAClB,OAAO,IAAI,CAAC,IAAK,CAAC;YACpB,CAAC;iBAAM,CAAC;gBACN,MAAM,KAAK,CAAC,6EAA6E,CAAC,CAAC;YAC7F,CAAC;QACH,CAAC,CAAA;QA1CC,IAAI,CAAC,IAAI,GAAG,GAAG,CAAC;QAChB,OAAO,IAAI,CAAC;IACd,CAAC;IAcD;;;;;;;OAOG;IACI,MAAM,CAAC,KAAK,CAAC,KAAK,CACvB,IAAY;QAEZ,MAAM,GAAG,GAAG,MAAM,IAAA,mBAAY,EAAI,IAAI,CAAC,CAAC;QACxC,OAAO,IAAI,cAAc,CAAI,GAAG,CAAC,CAAC;IACpC,CAAC;;AAjCH,wCA+CC;AAvCC;;;;;GAKG;AACW,qBAAM,GAAG,CAAI,SAAY,EAAE,EAAE;IACzC,IAAI,2BAAU,EAAE,CAAC;QACf,OAAO,CAAC,MAAM,CAAC,SAAS,EAAE,IAAA,yBAAY,EAAC,2BAAU,CAAC,CAAC,CAAC;IACtD,CAAC;AACH,CAAC,AAJmB,CAInB"}
+{"version":3,"file":"index.js","sourceRoot":"","sources":["../../src/index.ts"],"names":[],"mappings":";;;AAKA,+BAEgB;AADd,sGAAA,cAAc,OAAA;AAGhB,oCAEqB;AADnB,0GAAA,kBAAkB,OAAA"}

package/dist/cjs/node/builder/constants.js

@@ -0,0 +1,19 @@
+"use strict";
+var __importDefault = (this && this.__importDefault) || function (mod) {
+    return (mod && mod.__esModule) ? mod : { "default": mod };
+};
+Object.defineProperty(exports, "__esModule", { value: true });
+exports.tsNodeCompilerOptions = exports.tsCompilerOptions = void 0;
+const typescript_1 = __importDefault(require("typescript"));
+exports.tsCompilerOptions = {
+    module: typescript_1.default.ModuleKind.CommonJS,
+    target: typescript_1.default.ScriptTarget.ES2018,
+};
+exports.tsNodeCompilerOptions = {
+    transpileOnly: true,
+    compilerOptions: {
+        module: 'CommonJS',
+        target: 'ES5'
+    }
+};
+//# sourceMappingURL=constants.js.map

package/dist/cjs/node/builder/constants.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"constants.js","sourceRoot":"","sources":["../../../../src/node/builder/constants.ts"],"names":[],"mappings":";;;;;;AACA,4DAA6B;AAEhB,QAAA,iBAAiB,GAAuB;IACnD,MAAM,EAAE,oBAAE,CAAC,UAAU,CAAC,QAAQ;IAC9B,MAAM,EAAE,oBAAE,CAAC,YAAY,CAAC,MAAM;CAC/B,CAAA;AAEY,QAAA,qBAAqB,GAAoB;IACpD,aAAa,EAAE,IAAI;IACnB,eAAe,EAAE;QACf,MAAM,EAAE,UAAU;QAClB,MAAM,EAAE,KAAK;KACd;CACF,CAAA"}

package/dist/cjs/node/builder/helpers.js

@@ -0,0 +1,158 @@
+"use strict";
+var __importDefault = (this && this.__importDefault) || function (mod) {
+    return (mod && mod.__esModule) ? mod : { "default": mod };
+};
+Object.defineProperty(exports, "__esModule", { value: true });
+exports.getCallerDir = getCallerDir;
+exports.buildWorkerCode = buildWorkerCode;
+const webpack_node_externals_1 = __importDefault(require("webpack-node-externals"));
+const path_1 = __importDefault(require("path"));
+const fs_1 = __importDefault(require("fs"));
+const webpack_1 = require("webpack");
+const terser_webpack_plugin_1 = __importDefault(require("terser-webpack-plugin"));
+const BUILD_PATH = path_1.default.join(__dirname, '.out');
+const BUILD_FILENAME = 'bundle.js';
+const BUILD_FILE_PATH = path_1.default.join(BUILD_PATH, BUILD_FILENAME);
+function getCallerDir() {
+    try {
+        const stack = new Error().stack;
+        const line = stack.split('\n')[1].trim();
+        const segment = line.split(' ')[1];
+        const part = segment.split(':')[0];
+        const dirName = path_1.default.dirname(part);
+        return dirName;
+    }
+    catch (e) {
+        // console.error('building caller path failed', e);
+        return './';
+    }
+}
+function buildWorkerCode(entryFile) {
+    return new Promise((resolve, reject) => {
+        if (!fs_1.default.existsSync(BUILD_PATH)) {
+            fs_1.default.mkdirSync(BUILD_PATH, { recursive: true });
+        }
+        const config = getWebpackConfig(entryFile);
+        const compiler = (0, webpack_1.webpack)(config);
+        compiler.run((err, stats) => {
+            if (err) {
+                reject(err);
+                return;
+            }
+            /*
+            console.log(stats?.toString({
+              chunks: false,
+              colors: true
+            }));
+            */
+            const bundledCode = fs_1.default
+                .readFileSync(BUILD_FILE_PATH, 'utf8');
+            resolve(bundledCode);
+            // clean up the build folder
+            fs_1.default.rm(BUILD_PATH, { recursive: true, force: true }, (err) => {
+                if (err) {
+                    reject(err);
+                }
+            });
+        });
+    });
+}
+const resolveNodeModules = (packageName) => require.resolve(packageName, {
+    paths: [
+        path_1.default.resolve(__dirname, 'node_modules')
+    ]
+});
+const getWebpackConfig = (entry) => ({
+    entry,
+    output: {
+        filename: BUILD_FILENAME,
+        path: BUILD_PATH,
+        libraryTarget: 'commonjs2',
+        module: false,
+        iife: false,
+        umdNamedDefine: true,
+    },
+    resolve: {
+        extensions: ['.ts', '.js'],
+        fallback: {
+            assert: false,
+            buffer: false,
+            console: false,
+            constants: false,
+            crypto: false,
+            domain: false,
+            events: false,
+            fs: false,
+            http: false,
+            https: false,
+            module: false,
+            net: false,
+            os: false,
+            path: false,
+            process: false,
+            punycode: false,
+            querystring: false,
+            readline: false,
+            stream: false,
+            string_decoder: false,
+            sys: false,
+            timers: false,
+            tls: false,
+            tty: false,
+            url: false,
+            util: false,
+            vm: false,
+            worker_threads: false,
+            zlib: false,
+        },
+    },
+    resolveLoader: {
+        modules: [
+            path_1.default.resolve(process.cwd(), 'node_modules')
+        ]
+    },
+    mode: 'production',
+    optimization: {
+        minimize: true,
+        minimizer: [
+            new terser_webpack_plugin_1.default({
+                terserOptions: {
+                    compress: {
+                        drop_console: true,
+                        drop_debugger: true
+                    },
+                }
+            })
+        ]
+    },
+    target: 'node',
+    module: {
+        rules: [
+            {
+                test: /\.ts$/,
+                use: [
+                    {
+                        loader: resolveNodeModules('babel-loader'),
+                        options: {
+                            presets: [
+                                resolveNodeModules('@babel/preset-env'),
+                                resolveNodeModules('@babel/preset-typescript')
+                            ],
+                            plugins: [
+                                resolveNodeModules('@babel/plugin-transform-modules-commonjs')
+                            ]
+                        },
+                    }
+                ],
+                exclude: /node_modules/
+            }
+        ],
+    },
+    devtool: 'source-map',
+    stats: 'verbose',
+    externals: [(0, webpack_node_externals_1.default)({
+            importType: 'commonjs',
+        })],
+    cache: false
+});
+//# sourceMappingURL=helpers.js.map

package/dist/cjs/node/builder/helpers.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"helpers.js","sourceRoot":"","sources":["../../../../src/node/builder/helpers.ts"],"names":[],"mappings":";;;;;AAWA,oCAaC;AAED,0CAoCC;AA9DD,oFAAmD;AACnD,gDAAwB;AAExB,4CAAoB;AACpB,qCAAkC;AAClC,kFAAiD;AAEjD,MAAM,UAAU,GAAG,cAAI,CAAC,IAAI,CAAC,SAAS,EAAE,MAAM,CAAC,CAAC;AAChD,MAAM,cAAc,GAAG,WAAW,CAAC;AACnC,MAAM,eAAe,GAAG,cAAI,CAAC,IAAI,CAAC,UAAU,EAAE,cAAc,CAAC,CAAC;AAE9D,SAAgB,YAAY;IAC1B,IAAI,CAAC;QACH,MAAM,KAAK,GAAG,IAAI,KAAK,EAAE,CAAC,KAAM,CAAC;QACjC,MAAM,IAAI,GAAG,KAAK,CAAC,KAAK,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC,CAAC,IAAI,EAAE,CAAC;QACzC,MAAM,OAAO,GAAG,IAAI,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,CAAC;QACnC,MAAM,IAAI,GAAG,OAAO,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,CAAC;QACnC,MAAM,OAAO,GAAG,cAAI,CAAC,OAAO,CAAC,IAAI,CAAC,CAAC;QAEnC,OAAO,OAAO,CAAC;IACjB,CAAC;IAAC,OAAO,CAAC,EAAE,CAAC;QACX,mDAAmD;QACnD,OAAO,IAAI,CAAC;IACd,CAAC;AACH,CAAC;AAED,SAAgB,eAAe,CAAC,SAAiB;IAC/C,OAAO,IAAI,OAAO,CAAS,CAAC,OAAO,EAAE,MAAM,EAAE,EAAE;QAE7C,IAAI,CAAC,YAAE,CAAC,UAAU,CAAC,UAAU,CAAC,EAAE,CAAC;YAC/B,YAAE,CAAC,SAAS,CAAC,UAAU,EAAE,EAAE,SAAS,EAAE,IAAI,EAAE,CAAC,CAAC;QAChD,CAAC;QAED,MAAM,MAAM,GAAG,gBAAgB,CAAC,SAAS,CAAC,CAAC;QAC3C,MAAM,QAAQ,GAAG,IAAA,iBAAO,EAAC,MAAM,CAAC,CAAC;QAEjC,QAAQ,CAAC,GAAG,CAAC,CAAC,GAAG,EAAE,KAAK,EAAE,EAAE;YAC1B,IAAI,GAAG,EAAE,CAAC;gBACR,MAAM,CAAC,GAAG,CAAC,CAAC;gBACZ,OAAO;YACT,CAAC;YAED;;;;;cAKE;YAEF,MAAM,WAAW,GAAG,YAAE;iBACnB,YAAY,CAAC,eAAe,EAAE,MAAM,CAAC,CAAC;YAEzC,OAAO,CAAC,WAAW,CAAC,CAAC;YAErB,4BAA4B;YAC5B,YAAE,CAAC,EAAE,CAAC,UAAU,EAAE,EAAE,SAAS,EAAE,IAAI,EAAE,KAAK,EAAE,IAAI,EAAE,EAAE,CAAC,GAAG,EAAE,EAAE;gBAC1D,IAAI,GAAG,EAAE,CAAC;oBACR,MAAM,CAAC,GAAG,CAAC,CAAC;gBACd,CAAC;YACH,CAAC,CAAC,CAAC;QACL,CAAC,CAAC,CAAC;IACL,CAAC,CAAC,CAAC;AACL,CAAC;AAED,MAAM,kBAAkB,GAAG,CAAC,WAAmB,EAAE,EAAE,CACjD,OAAO,CAAC,OAAO,CAAC,WAAW,EACzB;IACE,KAAK,EAAE;QACL,cAAI,CAAC,OAAO,CAAC,SAAS,EAAE,cAAc,CAAC;KACxC;CACF,CAAC,CAAC;AAEP,MAAM,gBAAgB,GAAG,CAAC,KAAa,EAAiB,EAAE,CAAC,CAAC;IAC1D,KAAK;IACL,MAAM,EAAE;QACN,QAAQ,EAAE,cAAc;QACxB,IAAI,EAAE,UAAU;QAChB,aAAa,EAAE,WAAW;QAC1B,MAAM,EAAE,KAAK;QACb,IAAI,EAAE,KAAK;QACX,cAAc,EAAE,IAAI;KACrB;IACD,OAAO,EAAE;QACP,UAAU,EAAE,CAAC,KAAK,EAAE,KAAK,CAAC;QAC1B,QAAQ,EAAE;YACR,MAAM,EAAE,KAAK;YACb,MAAM,EAAE,KAAK;YACb,OAAO,EAAE,KAAK;YACd,SAAS,EAAE,KAAK;YAChB,MAAM,EAAE,KAAK;YACb,MAAM,EAAE,KAAK;YACb,MAAM,EAAE,KAAK;YACb,EAAE,EAAE,KAAK;YACT,IAAI,EAAE,KAAK;YACX,KAAK,EAAE,KAAK;YACZ,MAAM,EAAE,KAAK;YACb,GAAG,EAAE,KAAK;YACV,EAAE,EAAE,KAAK;YACT,IAAI,EAAE,KAAK;YACX,OAAO,EAAE,KAAK;YACd,QAAQ,EAAE,KAAK;YACf,WAAW,EAAE,KAAK;YAClB,QAAQ,EAAE,KAAK;YACf,MAAM,EAAE,KAAK;YACb,cAAc,EAAE,KAAK;YACrB,GAAG,EAAE,KAAK;YACV,MAAM,EAAE,KAAK;YACb,GAAG,EAAE,KAAK;YACV,GAAG,EAAE,KAAK;YACV,GAAG,EAAE,KAAK;YACV,IAAI,EAAE,KAAK;YACX,EAAE,EAAE,KAAK;YACT,cAAc,EAAE,KAAK;YACrB,IAAI,EAAE,KAAK;SACZ;KACF;IACD,aAAa,EAAE;QACb,OAAO,EAAE;YACP,cAAI,CAAC,OAAO,CAAC,OAAO,CAAC,GAAG,EAAE,EAAE,cAAc,CAAC;SAC5C;KACF;IACD,IAAI,EAAE,YAAY;IAClB,YAAY,EAAE;QACZ,QAAQ,EAAE,IAAI;QACd,SAAS,EAAE;YACT,IAAI,+BAAY,CAAC;gBACf,aAAa,EAAE;oBACb,QAAQ,EAAE;wBACR,YAAY,EAAE,IAAI;wBAClB,aAAa,EAAE,IAAI;qBACpB;iBACF;aACF,CAAC;SACH;KACF;IACD,MAAM,EAAE,MAAM;IACd,MAAM,EAAE;QACN,KAAK,EAAE;YACL;gBACE,IAAI,EAAE,OAAO;gBACb,GAAG,EAAG;oBACJ;wBACE,MAAM,EAAE,kBAAkB,CAAC,cAAc,CAAC;wBAC1C,OAAO,EAAE;4BACP,OAAO,EAAE;gCACP,kBAAkB,CAAC,mBAAmB,CAAC;gCACvC,kBAAkB,CAAC,0BAA0B,CAAC;6BAC/C;4BACD,OAAO,EAAE;gCACP,kBAAkB,CAAC,0CAA0C,CAAC;6BAC/D;yBACF;qBACF;iBACF;gBACD,OAAO,EAAE,cAAc;aACxB;SACF;KACF;IACD,OAAO,EAAE,YAAY;IACrB,KAAK,EAAE,SAAS;IAChB,SAAS,EAAE,CAAC,IAAA,gCAAa,EAAC;YACxB,UAAU,EAAE,UAAU;SACvB,CAAC,CAAC;IACH,KAAK,EAAE,KAAK;CACb,CAAC,CAAC"}

package/dist/cjs/node/builder/index.js

@@ -0,0 +1,25 @@
+"use strict";
+var __importDefault = (this && this.__importDefault) || function (mod) {
+    return (mod && mod.__esModule) ? mod : { "default": mod };
+};
+Object.defineProperty(exports, "__esModule", { value: true });
+exports.buildNodeApiAndWorkerFromCode = exports.genWorkerCodeFromFile = void 0;
+const comlink_1 = __importDefault(require("comlink"));
+const worker_threads_1 = require("worker_threads");
+const node_adapter_js_1 = __importDefault(require("comlink/dist/umd/node-adapter.js"));
+const helpers_1 = require("./helpers");
+const path_1 = __importDefault(require("path"));
+const genWorkerCodeFromFile = async (workerPath) => {
+    const callerDir = (0, helpers_1.getCallerDir)();
+    const resolvedPath = path_1.default.resolve(callerDir, workerPath);
+    const code = await (0, helpers_1.buildWorkerCode)(resolvedPath);
+    return code;
+};
+exports.genWorkerCodeFromFile = genWorkerCodeFromFile;
+const buildNodeApiAndWorkerFromCode = (code) => {
+    const worker = new worker_threads_1.Worker(code, { eval: true });
+    const api = comlink_1.default.wrap((0, node_adapter_js_1.default)(worker));
+    return { worker, api };
+};
+exports.buildNodeApiAndWorkerFromCode = buildNodeApiAndWorkerFromCode;
+//# sourceMappingURL=index.js.map

package/dist/cjs/node/builder/index.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"index.js","sourceRoot":"","sources":["../../../../src/node/builder/index.ts"],"names":[],"mappings":";;;;;;AAAA,sDAA8B;AAC9B,mDAAwC;AACxC,uFAA4D;AAC5D,uCAA0D;AAC1D,gDAAwB;AAEjB,MAAM,qBAAqB,GAAG,KAAK,EACxC,UAAkB,EACD,EAAE;IACnB,MAAM,SAAS,GAAG,IAAA,sBAAY,GAAE,CAAC;IACjC,MAAM,YAAY,GAAG,cAAI,CAAC,OAAO,CAAC,SAAS,EAAE,UAAU,CAAC,CAAC;IACzD,MAAM,IAAI,GAAG,MAAM,IAAA,yBAAe,EAAC,YAAY,CAAC,CAAC;IACjD,OAAO,IAAI,CAAC;AACd,CAAC,CAAA;AAPY,QAAA,qBAAqB,yBAOjC;AAEM,MAAM,6BAA6B,GAAG,CAC3C,IAAY,EACsC,EAAE;IAEpD,MAAM,MAAM,GAAG,IAAI,uBAAM,CAAC,IAAI,EAAE,EAAE,IAAI,EAAE,IAAI,EAAE,CAAC,CAAC;IAChD,MAAM,GAAG,GAAG,iBAAO,CAAC,IAAI,CAAI,IAAA,yBAAY,EAAC,MAAM,CAAC,CAAC,CAAC;IAElD,OAAO,EAAE,MAAM,EAAE,GAAG,EAAE,CAAC;AACzB,CAAC,CAAA;AARY,QAAA,6BAA6B,iCAQzC"}

package/dist/cjs/{builder → node/builder}/node.js

@@ -38,43 +38,17 @@ var __importDefault = (this && this.__importDefault) || function (mod) {
 Object.defineProperty(exports, "__esModule", { value: true });
 exports.buildApiNode = void 0;
 const Comlink = __importStar(require("comlink"));
-const esbuild = __importStar(require("esbuild"));
-const external_imports_1 = __importDefault(require("./plugins/external-imports"));
 const worker_threads_1 = require("worker_threads");
 const node_adapter_js_1 = __importDefault(require("comlink/dist/umd/node-adapter.js"));
-const _path = __importStar(require("path"));
-const native_module_1 = require("../builder/plugins/native-module");
 const helpers_1 = require("./helpers");
-const buildApiNode = async (path) => {
+const path_1 = __importDefault(require("path"));
+const buildApiNode = async (workerPath) => {
     const callerDir = (0, helpers_1.getCallerDir)();
-    const resolvedPath = _path.resolve(callerDir, path);
-    const result = await esbuild.build({
-        entryPoints: [resolvedPath],
-        loader: {
-            ".ts": "ts",
-            ".js": "js",
-            ".node": "binary"
-        },
-        format: "cjs",
-        bundle: true,
-        minify: true,
-        write: false,
-        plugins: [
-            native_module_1.nativeModulePlugin,
-            external_imports_1.default,
-        ]
-    });
-    const outputFiles = result.outputFiles;
-    if (!outputFiles ||
-        result.outputFiles.length < 1 ||
-        result.outputFiles[0].text === undefined ||
-        result.outputFiles[0].text === "") {
-        throw Error("no build output for worker");
-    }
-    const scriptData = result.outputFiles[0].text.trim();
-    const worker = new worker_threads_1.Worker(scriptData, { eval: true });
+    const resolvedPath = path_1.default.resolve(callerDir, workerPath);
+    const js = await (0, helpers_1.buildWorkerCode)(resolvedPath);
+    const worker = new worker_threads_1.Worker(js, { eval: true });
     const api = Comlink.wrap((0, node_adapter_js_1.default)(worker));
-    return api;
+    return { api, worker };
 };
 exports.buildApiNode = buildApiNode;
 //# sourceMappingURL=node.js.map

package/dist/cjs/node/builder/node.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"node.js","sourceRoot":"","sources":["../../../../src/node/builder/node.ts"],"names":[],"mappings":";;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;AAAA,iDAAmC;AACnC,mDAAwC;AACxC,uFAA4D;AAC5D,uCAA0D;AAC1D,gDAAwB;AAEjB,MAAM,YAAY,GAAG,KAAK,EAC/B,UAAkB,EACkC,EAAE;IAEtD,MAAM,SAAS,GAAG,IAAA,sBAAY,GAAE,CAAC;IACjC,MAAM,YAAY,GAAG,cAAI,CAAC,OAAO,CAAC,SAAS,EAAE,UAAU,CAAC,CAAC;IAEzD,MAAM,EAAE,GAAG,MAAM,IAAA,yBAAe,EAAC,YAAY,CAAC,CAAC;IAE/C,MAAM,MAAM,GAAG,IAAI,uBAAM,CAAC,EAAE,EAAE,EAAE,IAAI,EAAE,IAAI,EAAE,CAAC,CAAC;IAC9C,MAAM,GAAG,GAAG,OAAO,CAAC,IAAI,CAAI,IAAA,yBAAY,EAAC,MAAM,CAAC,CAAC,CAAC;IAElD,OAAO,EAAE,GAAG,EAAE,MAAM,EAAE,CAAC;AACzB,CAAC,CAAA;AAbY,QAAA,YAAY,gBAaxB"}

package/dist/cjs/node/index.js

@@ -0,0 +1,66 @@
+"use strict";
+var __importDefault = (this && this.__importDefault) || function (mod) {
+    return (mod && mod.__esModule) ? mod : { "default": mod };
+};
+Object.defineProperty(exports, "__esModule", { value: true });
+exports.NodeOmniWorker = void 0;
+const worker_threads_1 = require("worker_threads");
+const comlink_1 = __importDefault(require("comlink"));
+const node_adapter_1 = __importDefault(require("comlink/dist/umd/node-adapter"));
+const builder_1 = require("./builder");
+class NodeOmniWorker {
+    constructor(code, worker, api) {
+        this.isInitialized = () => (this._api !== undefined);
+        this.use = () => {
+            const isInitialized = this.isInitialized();
+            if (isInitialized) {
+                return this._api;
+            }
+            else {
+                throw Error('worker is not yet initialized. make sure to call the .set() function, first');
+            }
+        };
+        this.clone = (numOfTimes) => {
+            const workers = [];
+            for (let i = 0; i <= numOfTimes; i++) {
+                const code = this._code;
+                const { worker, api } = (0, builder_1.buildNodeApiAndWorkerFromCode)(code);
+                workers.push(new NodeOmniWorker(code, worker, api));
+            }
+            return workers;
+        };
+        this.destroy = async () => {
+            await this._worker.terminate();
+        };
+        this._code = code;
+        this._worker = worker;
+        this._api = api;
+        return this;
+    }
+    /**
+     * Build the OmniWorker from a worker file. Please note that the functions
+     * on the worker file need to first be exposed using the expose({ <functions> })
+     * functions, in order to start this build step.
+     *
+     * @param path The relative path to where the worker module is located
+     * @returns A new Node OmniWorker
+     */
+    static async build(path) {
+        const code = await (0, builder_1.genWorkerCodeFromFile)(path);
+        const { worker, api } = (0, builder_1.buildNodeApiAndWorkerFromCode)(code);
+        return new NodeOmniWorker(code, worker, api);
+    }
+}
+exports.NodeOmniWorker = NodeOmniWorker;
+/**
+ * Expose the functions inside the worker to the rest of the application.
+ * After having exposed the functions, the build step can be initiated.
+ * @param functions An object with functions inside the worker to be exposed to
+ * the rest of the application.
+ */
+NodeOmniWorker.expose = (functions) => {
+    if (worker_threads_1.parentPort) {
+        comlink_1.default.expose(functions, (0, node_adapter_1.default)(worker_threads_1.parentPort));
+    }
+};
+//# sourceMappingURL=index.js.map

package/dist/cjs/node/index.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"index.js","sourceRoot":"","sources":["../../../src/node/index.ts"],"names":[],"mappings":";;;;;;AACA,mDAAoD;AACpD,sDAA8B;AAC9B,iFAAyD;AACzD,uCAAiF;AAGjF,MAAa,cAAc;IAKzB,YACE,IAAY,EACZ,MAAc,EACd,GAA4B;QAoCvB,kBAAa,GAAG,GAAY,EAAE,CAAC,CACpC,IAAI,CAAC,IAAI,KAAK,SAAS,CACxB,CAAC;QAEK,QAAG,GAAG,GAAG,EAAE;YAChB,MAAM,aAAa,GAAG,IAAI,CAAC,aAAa,EAAE,CAAC;YAC3C,IAAI,aAAa,EAAE,CAAC;gBAClB,OAAO,IAAI,CAAC,IAAK,CAAC;YACpB,CAAC;iBAAM,CAAC;gBACN,MAAM,KAAK,CAAC,6EAA6E,CAAC,CAAC;YAC7F,CAAC;QACH,CAAC,CAAA;QAEM,UAAK,GAAG,CAAC,UAAkB,EAAE,EAAE;YACpC,MAAM,OAAO,GAAwB,EAAE,CAAC;YACxC,KAAK,IAAI,CAAC,GAAG,CAAC,EAAE,CAAC,IAAI,UAAU,EAAE,CAAC,EAAE,EAAE,CAAC;gBACrC,MAAM,IAAI,GAAG,IAAI,CAAC,KAAK,CAAC;gBACxB,MAAM,EAAE,MAAM,EAAE,GAAG,EAAE,GAAG,IAAA,uCAA6B,EAAI,IAAI,CAAC,CAAC;gBAC/D,OAAO,CAAC,IAAI,CAAC,IAAI,cAAc,CAAI,IAAI,EAAE,MAAM,EAAE,GAAG,CAAC,CAAC,CAAC;YACzD,CAAC;YACD,OAAO,OAAO,CAAC;QACjB,CAAC,CAAA;QAEM,YAAO,GAAG,KAAK,IAAI,EAAE;YAC1B,MAAM,IAAI,CAAC,OAAO,CAAC,SAAS,EAAE,CAAC;QACjC,CAAC,CAAA;QA3DC,IAAI,CAAC,KAAK,GAAG,IAAI,CAAC;QAClB,IAAI,CAAC,OAAO,GAAG,MAAM,CAAC;QACtB,IAAI,CAAC,IAAI,GAAG,GAAG,CAAC;QAChB,OAAO,IAAI,CAAC;IACd,CAAC;IAcD;;;;;;;OAOG;IACI,MAAM,CAAC,KAAK,CAAC,KAAK,CACvB,IAAY;QAEZ,MAAM,IAAI,GAAG,MAAM,IAAA,+BAAqB,EAAC,IAAI,CAAC,CAAC;QAC/C,MAAM,EAAE,MAAM,EAAE,GAAG,EAAE,GAAG,IAAA,uCAA6B,EAAI,IAAI,CAAC,CAAC;QAC/D,OAAO,IAAI,cAAc,CAAI,IAAI,EAAE,MAAM,EAAE,GAAG,CAAC,CAAC;IAClD,CAAC;;AA1CH,wCAsEC;AAtDC;;;;;GAKG;AACW,qBAAM,GAAG,CAAmB,SAAY,EAAE,EAAE;IACxD,IAAI,2BAAU,EAAE,CAAC;QACf,iBAAO,CAAC,MAAM,CAAC,SAAS,EAAE,IAAA,sBAAY,EAAC,2BAAU,CAAC,CAAC,CAAC;IACtD,CAAC;AACH,CAAC,AAJmB,CAInB"}