@transcend-io/cli 6.23.1 → 6.24.0

package/README.md

@@ -90,71 +90,75 @@
     - [Authentication](#authentication-19)
     - [Arguments](#arguments-19)
     - [Usage](#usage-20)
-  - [tr-retry-request-data-silos](#tr-retry-request-data-silos)
+  - [tr-skip-preflight-jobs](#tr-skip-preflight-jobs)
     - [Authentication](#authentication-20)
     - [Arguments](#arguments-20)
     - [Usage](#usage-21)
-  - [tr-update-consent-manager](#tr-update-consent-manager)
+  - [tr-retry-request-data-silos](#tr-retry-request-data-silos)
     - [Authentication](#authentication-21)
     - [Arguments](#arguments-21)
     - [Usage](#usage-22)
-  - [tr-consent-managers-to-business-entities](#tr-consent-managers-to-business-entities)
+  - [tr-update-consent-manager](#tr-update-consent-manager)
     - [Authentication](#authentication-22)
     - [Arguments](#arguments-22)
     - [Usage](#usage-23)
-  - [tr-consent-manager-service-json-to-yml](#tr-consent-manager-service-json-to-yml)
+  - [tr-consent-managers-to-business-entities](#tr-consent-managers-to-business-entities)
     - [Authentication](#authentication-23)
     - [Arguments](#arguments-23)
     - [Usage](#usage-24)
-  - [tr-derive-data-silos-from-data-flows](#tr-derive-data-silos-from-data-flows)
+  - [tr-consent-manager-service-json-to-yml](#tr-consent-manager-service-json-to-yml)
     - [Authentication](#authentication-24)
     - [Arguments](#arguments-24)
     - [Usage](#usage-25)
-  - [tr-derive-data-silos-from-data-flows-cross-instance](#tr-derive-data-silos-from-data-flows-cross-instance)
+  - [tr-derive-data-silos-from-data-flows](#tr-derive-data-silos-from-data-flows)
     - [Authentication](#authentication-25)
     - [Arguments](#arguments-25)
     - [Usage](#usage-26)
-  - [tr-pull-consent-metrics](#tr-pull-consent-metrics)
+  - [tr-derive-data-silos-from-data-flows-cross-instance](#tr-derive-data-silos-from-data-flows-cross-instance)
     - [Authentication](#authentication-26)
     - [Arguments](#arguments-26)
     - [Usage](#usage-27)
-  - [tr-pull-datapoints](#tr-pull-datapoints)
+  - [tr-pull-consent-metrics](#tr-pull-consent-metrics)
     - [Authentication](#authentication-27)
     - [Arguments](#arguments-27)
     - [Usage](#usage-28)
-  - [tr-pull-pull-unstructured-discovery-files](#tr-pull-pull-unstructured-discovery-files)
+  - [tr-pull-datapoints](#tr-pull-datapoints)
     - [Authentication](#authentication-28)
     - [Arguments](#arguments-28)
     - [Usage](#usage-29)
-  - [tr-upload-preferences](#tr-upload-preferences)
+  - [tr-pull-pull-unstructured-discovery-files](#tr-pull-pull-unstructured-discovery-files)
     - [Authentication](#authentication-29)
-    - [Authentication](#authentication-30)
     - [Arguments](#arguments-29)
     - [Usage](#usage-30)
-  - [tr-upload-consent-preferences](#tr-upload-consent-preferences)
+  - [tr-upload-preferences](#tr-upload-preferences)
+    - [Authentication](#authentication-30)
     - [Authentication](#authentication-31)
     - [Arguments](#arguments-30)
     - [Usage](#usage-31)
-  - [tr-pull-consent-preferences](#tr-pull-consent-preferences)
+  - [tr-upload-consent-preferences](#tr-upload-consent-preferences)
     - [Authentication](#authentication-32)
     - [Arguments](#arguments-31)
     - [Usage](#usage-32)
-  - [tr-upload-data-flows-from-csv](#tr-upload-data-flows-from-csv)
+  - [tr-pull-consent-preferences](#tr-pull-consent-preferences)
     - [Authentication](#authentication-33)
     - [Arguments](#arguments-32)
     - [Usage](#usage-33)
-  - [tr-upload-cookies-from-csv](#tr-upload-cookies-from-csv)
+  - [tr-upload-data-flows-from-csv](#tr-upload-data-flows-from-csv)
     - [Authentication](#authentication-34)
     - [Arguments](#arguments-33)
     - [Usage](#usage-34)
-  - [tr-generate-api-keys](#tr-generate-api-keys)
+  - [tr-upload-cookies-from-csv](#tr-upload-cookies-from-csv)
     - [Authentication](#authentication-35)
     - [Arguments](#arguments-34)
     - [Usage](#usage-35)
-  - [tr-build-xdi-sync-endpoint](#tr-build-xdi-sync-endpoint)
+  - [tr-generate-api-keys](#tr-generate-api-keys)
     - [Authentication](#authentication-36)
     - [Arguments](#arguments-35)
     - [Usage](#usage-36)
+  - [tr-build-xdi-sync-endpoint](#tr-build-xdi-sync-endpoint)
+    - [Authentication](#authentication-37)
+    - [Arguments](#arguments-36)
+    - [Usage](#usage-37)
 - [Prompt Manager](#prompt-manager)
 - [Proxy usage](#proxy-usage)
 
@@ -1995,6 +1999,39 @@ Set to status "RESOLVED" instead of status "SKIPPED"
 yarn tr-skip-request-data-silos --auth=$TRANSCEND_API_KEY --dataSiloId=70810f2e-cf90-43f6-9776-901a5950599f --status=RESOLVED
 ```
 
+### tr-skip-preflight-jobs
+
+This command allows for bulk skipping preflight checks.
+
+#### Authentication
+
+In order to use this cli, you will first need to generate an API key on the Transcend Admin Dashboard (https://app.transcend.io/infrastructure/api-keys).
+
+The API key must have the following scopes:
+
+- "Manage Request Compilation"
+
+#### Arguments
+
+| Argument     | Description                                                                   | Type            | Default                  | Required |
+| ------------ | ----------------------------------------------------------------------------- | --------------- | ------------------------ | -------- |
+| auth         | The Transcend API key with the scopes necessary for the command.              | string          | N/A                      | true     |
+| enricherIds  | The ID of the enrichers to skip privacy request jobs for.                     | string[] - UUID | N/A                      | true     |
+| transcendUrl | URL of the Transcend backend. Use https://api.us.transcend.io for US hosting. | string - URL    | https://api.transcend.io | false    |
+
+#### Usage
+
+```sh
+yarn tr-skip-preflight-jobs --auth=$TRANSCEND_API_KEY --enricherIds=70810f2e-cf90-43f6-9776-901a5950599f
+```
+
+Specifying the backend URL, needed for US hosted backend infrastructure.
+
+```sh
+yarn tr-skip-preflight-jobs --auth=$TRANSCEND_API_KEY --enricherIds=70810f2e-cf90-43f6-9776-901a5950599f,db1e64ba-cea6-43ff-ad27-5dc8122e5224 \
+ --transcendUrl=https://api.us.transcend.io
+```
+
 ### tr-retry-request-data-silos
 
 This command allows for bulk restarting a set of data silos jobs for open privacy requests. This is equivalent to clicking the "Wipe and Retry" button for a particular data silo across a set of privacy requests.

package/build/cli-skip-preflight-jobs.d.ts

@@ -0,0 +1,3 @@
+#!/usr/bin/env node
+export {};
+//# sourceMappingURL=cli-skip-preflight-jobs.d.ts.map

package/build/cli-skip-preflight-jobs.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"cli-skip-preflight-jobs.d.ts","sourceRoot":"","sources":["../src/cli-skip-preflight-jobs.ts"],"names":[],"mappings":""}

package/build/cli-skip-preflight-jobs.js

@@ -0,0 +1,53 @@
+#!/usr/bin/env node
+"use strict";
+var __importDefault = (this && this.__importDefault) || function (mod) {
+    return (mod && mod.__esModule) ? mod : { "default": mod };
+};
+Object.defineProperty(exports, "__esModule", { value: true });
+const yargs_parser_1 = __importDefault(require("yargs-parser"));
+const colors_1 = __importDefault(require("colors"));
+const logger_1 = require("./logger");
+const requests_1 = require("./requests");
+const constants_1 = require("./constants");
+/**
+ * Given an enricher ID, skip all active enrichment jobs that are open for that enricher
+ *
+ * Requires an API key with scope:
+ * - "Manage Request Compilation"
+ *
+ * Dev Usage:
+ * yarn ts-node ./src/cli-skip-preflight-jobs.ts --auth=$TRANSCEND_API_KEY \
+ *   --enricherIds=92636cda-b7c6-48c6-b1b1-2df574596cbc
+ *
+ * Standard usage:
+ * yarn tr-skip-request-data-silos --auth=$TRANSCEND_API_KEY  \
+ *   --enricherIds=92636cda-b7c6-48c6-b1b1-2df574596cbc
+ */
+async function main() {
+    // Parse command line arguments
+    const { 
+    /** Transcend Backend URL */
+    transcendUrl = constants_1.DEFAULT_TRANSCEND_API, 
+    /** API key */
+    auth, 
+    /** Enricher ID to mark requests fpr */
+    enricherIds, } = (0, yargs_parser_1.default)(process.argv.slice(2));
+    // Ensure auth is passed
+    if (!auth) {
+        logger_1.logger.error(colors_1.default.red('A Transcend API key must be provided. You can specify using --auth=$TRANSCEND_API_KEY'));
+        process.exit(1);
+    }
+    // Ensure enricherIds is provided
+    if (!enricherIds) {
+        logger_1.logger.error(colors_1.default.red('An enricher ID must be provided. You can specify using --enricherIds=2560bb81-b837-4c6f-a57e-dcef87069d43'));
+        process.exit(1);
+    }
+    // Upload privacy requests
+    await (0, requests_1.skipPreflightJobs)({
+        transcendUrl,
+        auth,
+        enricherIds: (0, requests_1.splitCsvToList)(enricherIds),
+    });
+}
+main();
+//# sourceMappingURL=cli-skip-preflight-jobs.js.map

package/build/cli-skip-preflight-jobs.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"cli-skip-preflight-jobs.js","sourceRoot":"","sources":["../src/cli-skip-preflight-jobs.ts"],"names":[],"mappings":";;;;;;AAEA,gEAAiC;AACjC,oDAA4B;AAE5B,qCAAkC;AAClC,yCAA+D;AAC/D,2CAAoD;AAEpD;;;;;;;;;;;;;GAaG;AACH,KAAK,UAAU,IAAI;IACjB,+BAA+B;IAC/B,MAAM;IACJ,4BAA4B;IAC5B,YAAY,GAAG,iCAAqB;IACpC,cAAc;IACd,IAAI;IACJ,uCAAuC;IACvC,WAAW,GACZ,GAAG,IAAA,sBAAK,EAAC,OAAO,CAAC,IAAI,CAAC,KAAK,CAAC,CAAC,CAAC,CAA8B,CAAC;IAE9D,wBAAwB;IACxB,IAAI,CAAC,IAAI,EAAE;QACT,eAAM,CAAC,KAAK,CACV,gBAAM,CAAC,GAAG,CACR,uFAAuF,CACxF,CACF,CAAC;QACF,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;KACjB;IAED,iCAAiC;IACjC,IAAI,CAAC,WAAW,EAAE;QAChB,eAAM,CAAC,KAAK,CACV,gBAAM,CAAC,GAAG,CACR,2GAA2G,CAC5G,CACF,CAAC;QACF,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;KACjB;IAED,0BAA0B;IAC1B,MAAM,IAAA,4BAAiB,EAAC;QACtB,YAAY;QACZ,IAAI;QACJ,WAAW,EAAE,IAAA,yBAAc,EAAC,WAAW,CAAC;KACzC,CAAC,CAAC;AACL,CAAC;AACD,IAAI,EAAE,CAAC"}

package/build/graphql/gqls/RequestEnricher.d.ts

@@ -1,3 +1,4 @@
 export declare const REQUEST_ENRICHERS: string;
 export declare const RETRY_REQUEST_ENRICHER: string;
+export declare const SKIP_REQUEST_ENRICHER: string;
 //# sourceMappingURL=RequestEnricher.d.ts.map

package/build/graphql/gqls/RequestEnricher.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"RequestEnricher.d.ts","sourceRoot":"","sources":["../../../src/graphql/gqls/RequestEnricher.ts"],"names":[],"mappings":"AAIA,eAAO,MAAM,iBAAiB,QA4B7B,CAAC;AAEF,eAAO,MAAM,sBAAsB,QAQlC,CAAC"}
+{"version":3,"file":"RequestEnricher.d.ts","sourceRoot":"","sources":["../../../src/graphql/gqls/RequestEnricher.ts"],"names":[],"mappings":"AAIA,eAAO,MAAM,iBAAiB,QA4B7B,CAAC;AAEF,eAAO,MAAM,sBAAsB,QAQlC,CAAC;AAEF,eAAO,MAAM,qBAAqB,QAQjC,CAAC"}

package/build/graphql/gqls/RequestEnricher.js

@@ -1,6 +1,6 @@
 "use strict";
 Object.defineProperty(exports, "__esModule", { value: true });
-exports.RETRY_REQUEST_ENRICHER = exports.REQUEST_ENRICHERS = void 0;
+exports.SKIP_REQUEST_ENRICHER = exports.RETRY_REQUEST_ENRICHER = exports.REQUEST_ENRICHERS = void 0;
 const graphql_request_1 = require("graphql-request");
 // TODO: https://transcend.height.app/T-27909 - enable optimizations
 // isExportCsv: true
@@ -42,4 +42,13 @@ exports.RETRY_REQUEST_ENRICHER = (0, graphql_request_1.gql) `
     }
   }
 `;
+exports.SKIP_REQUEST_ENRICHER = (0, graphql_request_1.gql) `
+  mutation TranscendCliSkipRequestEnricher($requestEnricherId: ID!) {
+    skipRequestEnricher(id: $requestEnricherId) {
+      requestEnricher {
+        id
+      }
+    }
+  }
+`;
 //# sourceMappingURL=RequestEnricher.js.map

package/build/graphql/gqls/RequestEnricher.js.map

@@ -1 +1 @@
-{"version":3,"file":"RequestEnricher.js","sourceRoot":"","sources":["../../../src/graphql/gqls/RequestEnricher.ts"],"names":[],"mappings":";;;AAAA,qDAAsC;AAEtC,oEAAoE;AACpE,oBAAoB;AACP,QAAA,iBAAiB,GAAG,IAAA,qBAAG,EAAA;;;;;;;;;;;;;;;;;;;;;;;;;;;;CA4BnC,CAAC;AAEW,QAAA,sBAAsB,GAAG,IAAA,qBAAG,EAAA;;;;;;;;CAQxC,CAAC"}
+{"version":3,"file":"RequestEnricher.js","sourceRoot":"","sources":["../../../src/graphql/gqls/RequestEnricher.ts"],"names":[],"mappings":";;;AAAA,qDAAsC;AAEtC,oEAAoE;AACpE,oBAAoB;AACP,QAAA,iBAAiB,GAAG,IAAA,qBAAG,EAAA;;;;;;;;;;;;;;;;;;;;;;;;;;;;CA4BnC,CAAC;AAEW,QAAA,sBAAsB,GAAG,IAAA,qBAAG,EAAA;;;;;;;;CAQxC,CAAC;AAEW,QAAA,qBAAqB,GAAG,IAAA,qBAAG,EAAA;;;;;;;;CAQvC,CAAC"}

package/build/requests/index.d.ts

@@ -20,6 +20,7 @@ export * from './extractClientError';
 export * from './uploadPrivacyRequestsFromCsv';
 export * from './bulkRestartRequests';
 export * from './restartPrivacyRequest';
+export * from './skipPreflightJobs';
 export * from './bulkRetryEnrichers';
 export * from './retryRequestDataSilos';
 export * from './pullPrivacyRequests';

package/build/requests/index.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../../src/requests/index.ts"],"names":[],"mappings":"AAAA,cAAc,qBAAqB,CAAC;AACpC,cAAc,aAAa,CAAC;AAC5B,cAAc,iBAAiB,CAAC;AAChC,cAAc,kBAAkB,CAAC;AACjC,cAAc,6BAA6B,CAAC;AAC5C,cAAc,WAAW,CAAC;AAC1B,cAAc,4BAA4B,CAAC;AAC3C,cAAc,cAAc,CAAC;AAC7B,cAAc,6BAA6B,CAAC;AAC5C,cAAc,sBAAsB,CAAC;AACrC,cAAc,wBAAwB,CAAC;AACvC,cAAc,6BAA6B,CAAC;AAC5C,cAAc,wBAAwB,CAAC;AACvC,cAAc,0BAA0B,CAAC;AACzC,cAAc,uCAAuC,CAAC;AACtD,cAAc,2BAA2B,CAAC;AAC1C,cAAc,yBAAyB,CAAC;AACxC,cAAc,0BAA0B,CAAC;AACzC,cAAc,sBAAsB,CAAC;AACrC,cAAc,gCAAgC,CAAC;AAC/C,cAAc,uBAAuB,CAAC;AACtC,cAAc,yBAAyB,CAAC;AACxC,cAAc,sBAAsB,CAAC;AACrC,cAAc,yBAAyB,CAAC;AACxC,cAAc,uBAAuB,CAAC;AACtC,cAAc,wBAAwB,CAAC;AACvC,cAAc,sCAAsC,CAAC"}
+{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../../src/requests/index.ts"],"names":[],"mappings":"AAAA,cAAc,qBAAqB,CAAC;AACpC,cAAc,aAAa,CAAC;AAC5B,cAAc,iBAAiB,CAAC;AAChC,cAAc,kBAAkB,CAAC;AACjC,cAAc,6BAA6B,CAAC;AAC5C,cAAc,WAAW,CAAC;AAC1B,cAAc,4BAA4B,CAAC;AAC3C,cAAc,cAAc,CAAC;AAC7B,cAAc,6BAA6B,CAAC;AAC5C,cAAc,sBAAsB,CAAC;AACrC,cAAc,wBAAwB,CAAC;AACvC,cAAc,6BAA6B,CAAC;AAC5C,cAAc,wBAAwB,CAAC;AACvC,cAAc,0BAA0B,CAAC;AACzC,cAAc,uCAAuC,CAAC;AACtD,cAAc,2BAA2B,CAAC;AAC1C,cAAc,yBAAyB,CAAC;AACxC,cAAc,0BAA0B,CAAC;AACzC,cAAc,sBAAsB,CAAC;AACrC,cAAc,gCAAgC,CAAC;AAC/C,cAAc,uBAAuB,CAAC;AACtC,cAAc,yBAAyB,CAAC;AACxC,cAAc,qBAAqB,CAAC;AACpC,cAAc,sBAAsB,CAAC;AACrC,cAAc,yBAAyB,CAAC;AACxC,cAAc,uBAAuB,CAAC;AACtC,cAAc,wBAAwB,CAAC;AACvC,cAAc,sCAAsC,CAAC"}

package/build/requests/index.js

@@ -36,6 +36,7 @@ __exportStar(require("./extractClientError"), exports);
 __exportStar(require("./uploadPrivacyRequestsFromCsv"), exports);
 __exportStar(require("./bulkRestartRequests"), exports);
 __exportStar(require("./restartPrivacyRequest"), exports);
+__exportStar(require("./skipPreflightJobs"), exports);
 __exportStar(require("./bulkRetryEnrichers"), exports);
 __exportStar(require("./retryRequestDataSilos"), exports);
 __exportStar(require("./pullPrivacyRequests"), exports);

package/build/requests/index.js.map

@@ -1 +1 @@
-{"version":3,"file":"index.js","sourceRoot":"","sources":["../../src/requests/index.ts"],"names":[],"mappings":";;;;;;;;;;;;;;;;AAAA,sDAAoC;AACpC,8CAA4B;AAC5B,kDAAgC;AAChC,mDAAiC;AACjC,8DAA4C;AAC5C,4CAA0B;AAC1B,6DAA2C;AAC3C,+CAA6B;AAC7B,8DAA4C;AAC5C,uDAAqC;AACrC,yDAAuC;AACvC,8DAA4C;AAC5C,yDAAuC;AACvC,2DAAyC;AACzC,wEAAsD;AACtD,4DAA0C;AAC1C,0DAAwC;AACxC,2DAAyC;AACzC,uDAAqC;AACrC,iEAA+C;AAC/C,wDAAsC;AACtC,0DAAwC;AACxC,uDAAqC;AACrC,0DAAwC;AACxC,wDAAsC;AACtC,yDAAuC;AACvC,uEAAqD"}
+{"version":3,"file":"index.js","sourceRoot":"","sources":["../../src/requests/index.ts"],"names":[],"mappings":";;;;;;;;;;;;;;;;AAAA,sDAAoC;AACpC,8CAA4B;AAC5B,kDAAgC;AAChC,mDAAiC;AACjC,8DAA4C;AAC5C,4CAA0B;AAC1B,6DAA2C;AAC3C,+CAA6B;AAC7B,8DAA4C;AAC5C,uDAAqC;AACrC,yDAAuC;AACvC,8DAA4C;AAC5C,yDAAuC;AACvC,2DAAyC;AACzC,wEAAsD;AACtD,4DAA0C;AAC1C,0DAAwC;AACxC,2DAAyC;AACzC,uDAAqC;AACrC,iEAA+C;AAC/C,wDAAsC;AACtC,0DAAwC;AACxC,sDAAoC;AACpC,uDAAqC;AACrC,0DAAwC;AACxC,wDAAsC;AACtC,yDAAuC;AACvC,uEAAqD"}

package/build/requests/skipPreflightJobs.d.ts

@@ -0,0 +1,20 @@
+import { RequestStatus } from '@transcend-io/privacy-types';
+/**
+ * Given an enricher ID, mark all open request enrichers as skipped
+ *
+ * @param options - Options
+ * @returns Number of items skipped
+ */
+export declare function skipPreflightJobs({ enricherIds, auth, concurrency, transcendUrl, }: {
+    /** Transcend API key authentication */
+    auth: string;
+    /** Enricher IDs to pull down jobs for */
+    enricherIds: string[];
+    /** Upload concurrency */
+    concurrency?: number;
+    /** API URL for Transcend backend */
+    transcendUrl?: string;
+    /** Request statuses to mark as completed */
+    requestStatuses?: RequestStatus[];
+}): Promise<number>;
+//# sourceMappingURL=skipPreflightJobs.d.ts.map

package/build/requests/skipPreflightJobs.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"skipPreflightJobs.d.ts","sourceRoot":"","sources":["../../src/requests/skipPreflightJobs.ts"],"names":[],"mappings":"AAWA,OAAO,EAEL,aAAa,EACd,MAAM,6BAA6B,CAAC;AAGrC;;;;;GAKG;AACH,wBAAsB,iBAAiB,CAAC,EACtC,WAAW,EACX,IAAI,EACJ,WAAiB,EACjB,YAAoC,GACrC,EAAE;IACD,uCAAuC;IACvC,IAAI,EAAE,MAAM,CAAC;IACb,yCAAyC;IACzC,WAAW,EAAE,MAAM,EAAE,CAAC;IACtB,yBAAyB;IACzB,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,oCAAoC;IACpC,YAAY,CAAC,EAAE,MAAM,CAAC;IACtB,4CAA4C;IAC5C,eAAe,CAAC,EAAE,aAAa,EAAE,CAAC;CACnC,GAAG,OAAO,CAAC,MAAM,CAAC,CAuFlB"}

package/build/requests/skipPreflightJobs.js

@@ -0,0 +1,73 @@
+"use strict";
+var __importDefault = (this && this.__importDefault) || function (mod) {
+    return (mod && mod.__esModule) ? mod : { "default": mod };
+};
+Object.defineProperty(exports, "__esModule", { value: true });
+exports.skipPreflightJobs = void 0;
+const bluebird_1 = require("bluebird");
+const colors_1 = __importDefault(require("colors"));
+const logger_1 = require("../logger");
+const graphql_1 = require("../graphql");
+const cli_progress_1 = __importDefault(require("cli-progress"));
+const privacy_types_1 = require("@transcend-io/privacy-types");
+const constants_1 = require("../constants");
+/**
+ * Given an enricher ID, mark all open request enrichers as skipped
+ *
+ * @param options - Options
+ * @returns Number of items skipped
+ */
+async function skipPreflightJobs({ enricherIds, auth, concurrency = 100, transcendUrl = constants_1.DEFAULT_TRANSCEND_API, }) {
+    // Find all requests made before createdAt that are in a removing data state
+    const client = (0, graphql_1.buildTranscendGraphQLClient)(transcendUrl, auth);
+    // Time duration
+    const t0 = new Date().getTime();
+    // fetch all RequestDataSilos that are open
+    const requests = await (0, graphql_1.fetchAllRequests)(client, {
+        statuses: [privacy_types_1.RequestStatus.Enriching],
+    });
+    // Notify Transcend
+    logger_1.logger.info(colors_1.default.magenta(`Processing enricher: "${enricherIds.join(',')}" fetched "${requests.length}" in enriching status.`));
+    // create a new progress bar instance and use shades_classic theme
+    const progressBar = new cli_progress_1.default.SingleBar({}, cli_progress_1.default.Presets.shades_classic);
+    let total = 0;
+    progressBar.start(requests.length, 0);
+    let totalSkipped = 0;
+    await (0, bluebird_1.map)(requests, async (request) => {
+        // FIXME dont pull all in
+        const requestEnrichers = await (0, graphql_1.fetchAllRequestEnrichers)(client, {
+            requestId: request.id,
+        });
+        const requestEnrichersFiltered = requestEnrichers.filter((enricher) => enricherIds.includes(enricher.enricher.id) &&
+            ![
+                privacy_types_1.RequestEnricherStatus.Resolved,
+                privacy_types_1.RequestEnricherStatus.Skipped,
+                // eslint-disable-next-line @typescript-eslint/no-explicit-any
+            ].includes(enricher.status));
+        // FIXME
+        if (requestEnrichersFiltered.length > 0) {
+            await (0, bluebird_1.mapSeries)(requestEnrichersFiltered, async (requestEnricher) => {
+                try {
+                    await (0, graphql_1.makeGraphQLRequest)(client, graphql_1.SKIP_REQUEST_ENRICHER, {
+                        requestEnricherId: requestEnricher.id,
+                    });
+                    totalSkipped += 1;
+                }
+                catch (err) {
+                    if (!err.message.includes('Client error: Cannot skip Request enricher because it has already completed')) {
+                        throw err;
+                    }
+                }
+            });
+        }
+        total += 1;
+        progressBar.update(total);
+    }, { concurrency });
+    progressBar.stop();
+    const t1 = new Date().getTime();
+    const totalTime = t1 - t0;
+    logger_1.logger.info(colors_1.default.green(`Successfully skipped "${totalSkipped}" for  "${requests.length}" requests in "${totalTime / 1000}" seconds!`));
+    return requests.length;
+}
+exports.skipPreflightJobs = skipPreflightJobs;
+//# sourceMappingURL=skipPreflightJobs.js.map

package/build/requests/skipPreflightJobs.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"skipPreflightJobs.js","sourceRoot":"","sources":["../../src/requests/skipPreflightJobs.ts"],"names":[],"mappings":";;;;;;AAAA,uCAA0C;AAC1C,oDAA4B;AAC5B,sCAAmC;AACnC,wCAMoB;AACpB,gEAAuC;AACvC,+DAGqC;AACrC,4CAAqD;AAErD;;;;;GAKG;AACI,KAAK,UAAU,iBAAiB,CAAC,EACtC,WAAW,EACX,IAAI,EACJ,WAAW,GAAG,GAAG,EACjB,YAAY,GAAG,iCAAqB,GAYrC;IACC,4EAA4E;IAC5E,MAAM,MAAM,GAAG,IAAA,qCAA2B,EAAC,YAAY,EAAE,IAAI,CAAC,CAAC;IAE/D,gBAAgB;IAChB,MAAM,EAAE,GAAG,IAAI,IAAI,EAAE,CAAC,OAAO,EAAE,CAAC;IAEhC,2CAA2C;IAC3C,MAAM,QAAQ,GAAG,MAAM,IAAA,0BAAgB,EAAC,MAAM,EAAE;QAC9C,QAAQ,EAAE,CAAC,6BAAa,CAAC,SAAS,CAAC;KACpC,CAAC,CAAC;IAEH,mBAAmB;IACnB,eAAM,CAAC,IAAI,CACT,gBAAM,CAAC,OAAO,CACZ,yBAAyB,WAAW,CAAC,IAAI,CAAC,GAAG,CAAC,cAC5C,QAAQ,CAAC,MACX,wBAAwB,CACzB,CACF,CAAC;IAEF,kEAAkE;IAClE,MAAM,WAAW,GAAG,IAAI,sBAAW,CAAC,SAAS,CAC3C,EAAE,EACF,sBAAW,CAAC,OAAO,CAAC,cAAc,CACnC,CAAC;IAEF,IAAI,KAAK,GAAG,CAAC,CAAC;IACd,WAAW,CAAC,KAAK,CAAC,QAAQ,CAAC,MAAM,EAAE,CAAC,CAAC,CAAC;IACtC,IAAI,YAAY,GAAG,CAAC,CAAC;IACrB,MAAM,IAAA,cAAG,EACP,QAAQ,EACR,KAAK,EAAE,OAAO,EAAE,EAAE;QAChB,yBAAyB;QACzB,MAAM,gBAAgB,GAAG,MAAM,IAAA,kCAAwB,EAAC,MAAM,EAAE;YAC9D,SAAS,EAAE,OAAO,CAAC,EAAE;SACtB,CAAC,CAAC;QACH,MAAM,wBAAwB,GAAG,gBAAgB,CAAC,MAAM,CACtD,CAAC,QAAQ,EAAE,EAAE,CACX,WAAW,CAAC,QAAQ,CAAC,QAAQ,CAAC,QAAQ,CAAC,EAAE,CAAC;YAC1C,CAAC;gBACC,qCAAqB,CAAC,QAAQ;gBAC9B,qCAAqB,CAAC,OAAO;gBAC7B,8DAA8D;aAC/D,CAAC,QAAQ,CAAC,QAAQ,CAAC,MAAa,CAAC,CACrC,CAAC;QAEF,QAAQ;QACR,IAAI,wBAAwB,CAAC,MAAM,GAAG,CAAC,EAAE;YACvC,MAAM,IAAA,oBAAS,EAAC,wBAAwB,EAAE,KAAK,EAAE,eAAe,EAAE,EAAE;gBAClE,IAAI;oBACF,MAAM,IAAA,4BAAkB,EAGrB,MAAM,EAAE,+BAAqB,EAAE;wBAChC,iBAAiB,EAAE,eAAe,CAAC,EAAE;qBACtC,CAAC,CAAC;oBACH,YAAY,IAAI,CAAC,CAAC;iBACnB;gBAAC,OAAO,GAAG,EAAE;oBACZ,IACE,CAAC,GAAG,CAAC,OAAO,CAAC,QAAQ,CACnB,6EAA6E,CAC9E,EACD;wBACA,MAAM,GAAG,CAAC;qBACX;iBACF;YACH,CAAC,CAAC,CAAC;SACJ;QACD,KAAK,IAAI,CAAC,CAAC;QACX,WAAW,CAAC,MAAM,CAAC,KAAK,CAAC,CAAC;IAC5B,CAAC,EACD,EAAE,WAAW,EAAE,CAChB,CAAC;IAEF,WAAW,CAAC,IAAI,EAAE,CAAC;IACnB,MAAM,EAAE,GAAG,IAAI,IAAI,EAAE,CAAC,OAAO,EAAE,CAAC;IAChC,MAAM,SAAS,GAAG,EAAE,GAAG,EAAE,CAAC;IAE1B,eAAM,CAAC,IAAI,CACT,gBAAM,CAAC,KAAK,CACV,yBAAyB,YAAY,WACnC,QAAQ,CAAC,MACX,kBAAkB,SAAS,GAAG,IAAI,YAAY,CAC/C,CACF,CAAC;IACF,OAAO,QAAQ,CAAC,MAAM,CAAC;AACzB,CAAC;AAvGD,8CAuGC"}