@apify/actor-utils 0.1.3-beta.0 → 0.1.3-beta.2

package/README.md

@@ -1,29 +1,37 @@
-# safePushData
+# pushDataWithSchemaRepair
 
 TypeScript library wrapper that survives Apify dataset schema-validation
 failures. When an upstream data source produces an item that doesn't match
 the dataset's JSON schema, the platform rejects the **entire batch** with
-a 400 error — losing every other valid item in that push. `safePushData`
-parses the validation error, strips the offending fields, and retries.
+a 400 error — losing every other valid item in that push.
+`pushDataWithSchemaRepair` parses the validation error, strips the
+offending fields, and retries.
 
 ## Usage
 
 ```ts
 import { Actor } from 'apify';
-import { safePushData } from 'apify-actor-utils';
+import { pushDataWithSchemaRepair } from 'apify-actor-utils';
 
 await Actor.init();
 
-const result = await safePushData((batch) => Actor.pushData(batch), items);
+const result = await pushDataWithSchemaRepair((batch) => Actor.pushData(batch), items);
 
 console.log(result);
-// { pushed: 2, dropped: [...], attempts: 2 }
+// { pushedCount: 2, droppedItems: [...], attemptCount: 2, pushResult: undefined }
 ```
 
 Accepts a single item or an array. `pushFn` is the first positional arg
 and is required — the library itself never imports the Apify SDK, and a
 CI check forbids `.pushData(` from appearing anywhere in the source.
 
+Whatever `pushFn` resolves to comes back as `pushResult`, so a push
+function with a meaningful return value stays usable:
+
+```ts
+const { pushResult } = await pushDataWithSchemaRepair((batch) => client.dataset(id).pushItems(batch), items);
+```
+
 ## Performance notes
 
 The happy path is a single `try/await pushFn(items)` with **no extra
@@ -38,11 +46,12 @@ every AJV error per item:
 
 | Error                                | Action                                                                             |
 | ------------------------------------ | ---------------------------------------------------------------------------------- |
-| `required` at the root               | Set the missing field to `null` and mark the path as a placeholder.                |
-| `additionalProperties` at the root   | Delete the unknown property.                                                       |
+| `required` (at any depth)            | Set the missing field to `null` and mark the path as a placeholder.                |
+| `additionalProperties` (any depth)   | Delete the unknown property.                                                       |
 | `type` / `format` / etc. at the root | Item itself is the wrong shape → dropped.                                          |
 | Constraint on a **placeholder** path | Replace with a type-aware default (see below). If no default is known → dropped.   |
 | Constraint on **user-supplied** data | Delete the field. If the schema later marks it required, a placeholder takes over. |
+| Nothing on the item was actionable   | Item is dropped — an unchanged item would fail identically on the next push.       |
 
 ### Placeholder defaults
 
@@ -73,19 +82,52 @@ The retry loop chases one layer of errors per round
 (`required` → `type` → push) until either the push succeeds
 or `maxAttempts` (default 5) is hit.
 
+### When the attempt cap is hit
+
+Items still failing on the last allowed attempt are dropped — but the rest
+of the batch is **not** lost with them. Because a rejected push stores
+nothing at all, the wrapper drops the incurable items and then makes one
+final push with the survivors, which the API already validated in the
+previous round. That final push is counted in `attemptCount`, so a run that
+exhausts `maxAttempts: 5` can report `attemptCount: 6`.
+
+## Logging
+
+Every failed round logs which fields went wrong, so you can fix the schema
+(or the scraper) without digging through the returned `droppedItems`:
+
+```
+pushDataWithSchemaRepair: schema validation failed on attempt 1: 12 invalid item(s); repaired fields: /age (type), /name (required), /tags/[] (type); dropped 2 item(s) on unfixable fields: /email (format); retrying with 10 item(s).
+pushDataWithSchemaRepair: gave up after 5 attempts; dropped 3 item(s) still failing on fields: /sku (pattern); pushing the 9 valid item(s) left.
+```
+
+The field list is a **set**, not a per-item breakdown — one bad field
+usually shows up on many items in a batch, and knowing which item had which
+problem rarely changes what you do about it. Array indices collapse
+(`/tags/0`, `/tags/7` → `/tags/[]`) for the same reason, and the list is
+capped at 20 entries with the rest reported as `(+N more)`.
+
 ## Options
 
-| Option        | Type     | Default | Notes                |
-| ------------- | -------- | ------- | -------------------- |
-| `maxAttempts` | `number` | `5`     | Hard cap on retries. |
+| Option        | Type     | Default | Notes                                                          |
+| ------------- | -------- | ------- | -------------------------------------------------------------- |
+| `maxAttempts` | `number` | `5`     | Cap on repair rounds, plus the final salvage push if it's hit. |
 
 ## Return shape
 
+Names say what they hold: `*Count` is a number, `*Items` is an array of
+objects.
+
 ```ts
-interface SafePushDataResult<T> {
-    pushed: number;
-    dropped: { item: T; errors: ValidationError[] }[];
-    attempts: number;
+interface PushDataWithSchemaRepairResult<T, R = unknown> {
+    /** How many of the caller's items made it into the dataset. */
+    pushedCount: number;
+    /** The items we couldn't repair, each with the errors that doomed it. */
+    droppedItems: { item: T; errors: ValidationError[] }[];
+    /** How many times `pushFn` was actually called. */
+    attemptCount: number;
+    /** What the successful `pushFn` call resolved to; absent if none did. */
+    pushResult?: R;
 }
 ```
 
@@ -103,12 +145,12 @@ Highlights:
 
 ```
 .
-├── index.ts                      # package entry point, re-exports src/
-├── src/safePushData.ts           # the library
-├── test/safePushData.test.ts     # node:test suite
+├── index.ts                               # package entry point, re-exports src/
+├── src/pushDataWithSchemaRepair.ts        # the library
+├── test/pushDataWithSchemaRepair.test.ts  # node:test suite
 ├── scripts/
-│   ├── check-pushdata.mjs        # CI guard against direct .pushData() calls
-│   └── probe-errors.mjs          # reference: re-derive the API error shape
+│   ├── check-pushdata.mjs                 # CI guard against direct .pushData() calls
+│   └── probe-errors.mjs                   # reference: re-derive the API error shape
 ├── tsconfig.json
 └── package.json
 ```

package/dist/index.d.ts

@@ -1,3 +1,3 @@
-export { safePushData, isSchemaValidationError } from './src/safePushData.js';
-export type { ValidationError, DroppedItem, SafePushDataResult, SafePushDataOptions, PushFn, } from './src/safePushData.js';
+export { pushDataWithSchemaRepair, isSchemaValidationError } from './src/pushDataWithSchemaRepair.js';
+export type { ValidationError, DroppedItem, PushDataWithSchemaRepairResult, PushDataWithSchemaRepairOptions, PushFn, } from './src/pushDataWithSchemaRepair.js';
 //# sourceMappingURL=index.d.ts.map

package/dist/index.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../index.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,YAAY,EAAE,uBAAuB,EAAE,MAAM,uBAAuB,CAAC;AAC9E,YAAY,EACR,eAAe,EACf,WAAW,EACX,kBAAkB,EAClB,mBAAmB,EACnB,MAAM,GACT,MAAM,uBAAuB,CAAC"}
+{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../index.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,wBAAwB,EAAE,uBAAuB,EAAE,MAAM,mCAAmC,CAAC;AACtG,YAAY,EACR,eAAe,EACf,WAAW,EACX,8BAA8B,EAC9B,+BAA+B,EAC/B,MAAM,GACT,MAAM,mCAAmC,CAAC"}

package/dist/index.js

@@ -1,2 +1,2 @@
-export { safePushData, isSchemaValidationError } from './src/safePushData.js';
+export { pushDataWithSchemaRepair, isSchemaValidationError } from './src/pushDataWithSchemaRepair.js';
 //# sourceMappingURL=index.js.map

package/dist/index.js.map

@@ -1 +1 @@
-{"version":3,"file":"index.js","sourceRoot":"","sources":["../index.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,YAAY,EAAE,uBAAuB,EAAE,MAAM,uBAAuB,CAAC"}
+{"version":3,"file":"index.js","sourceRoot":"","sources":["../index.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,wBAAwB,EAAE,uBAAuB,EAAE,MAAM,mCAAmC,CAAC"}

package/dist/src/{safePushData.d.ts → pushDataWithSchemaRepair.d.ts}

@@ -23,15 +23,23 @@ export interface DroppedItem<T> {
     item: T;
     errors: ValidationError[];
 }
-export interface SafePushDataResult<T> {
-    pushed: number;
-    dropped: DroppedItem<T>[];
-    attempts: number;
+export interface PushDataWithSchemaRepairResult<T, R = unknown> {
+    /** How many of the caller's items made it into the dataset. */
+    pushedCount: number;
+    /** The items we couldn't repair, each with the errors that doomed it. */
+    droppedItems: DroppedItem<T>[];
+    /** How many times `pushFn` was actually called. */
+    attemptCount: number;
+    /**
+     * What the successful `pushFn` call resolved to (e.g. the API response).
+     * Absent when no push ever succeeded — i.e. when every item was dropped.
+     */
+    pushResult?: R;
 }
-export interface SafePushDataOptions {
+export interface PushDataWithSchemaRepairOptions {
     maxAttempts?: number;
 }
-export type PushFn<T> = (items: T[]) => Promise<unknown>;
+export type PushFn<T, R = unknown> = (items: T[]) => Promise<R>;
 /**
  * Push `input` via `pushFn`, surviving Apify dataset schema-validation
  * failures by cleaning offending items and retrying.
@@ -40,7 +48,9 @@ export type PushFn<T> = (items: T[]) => Promise<unknown>;
  * direct `.pushData()` calls in this library, so the binding lives at the
  * call site: `(b) => Actor.pushData(b)` or
  * `(b) => client.dataset(id).pushItems(b)`.
+ *
+ * Whatever `pushFn` resolves to is handed back untouched as `pushResult`.
  */
-export declare function safePushData<T>(pushFn: PushFn<T>, input: T | T[], options?: SafePushDataOptions): Promise<SafePushDataResult<T>>;
+export declare function pushDataWithSchemaRepair<T, R = unknown>(pushFn: PushFn<T, R>, input: T | T[], options?: PushDataWithSchemaRepairOptions): Promise<PushDataWithSchemaRepairResult<T, R>>;
 export {};
-//# sourceMappingURL=safePushData.d.ts.map
+//# sourceMappingURL=pushDataWithSchemaRepair.d.ts.map

package/dist/src/pushDataWithSchemaRepair.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"pushDataWithSchemaRepair.d.ts","sourceRoot":"","sources":["../../src/pushDataWithSchemaRepair.ts"],"names":[],"mappings":"AAWA,QAAA,MAAM,iBAAiB,4BAA4B,CAAC;AAcpD,MAAM,WAAW,eAAe;IAC5B,YAAY,EAAE,MAAM,CAAC;IACrB,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,OAAO,EAAE,MAAM,CAAC;IAChB,MAAM,CAAC,EAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,CAAC;IACjC,OAAO,CAAC,EAAE,MAAM,CAAC;CACpB;AAED,UAAU,WAAW;IACjB,YAAY,EAAE,MAAM,CAAC;IACrB,gBAAgB,EAAE,eAAe,EAAE,CAAC;CACvC;AAKD,UAAU,qBAAqB;IAC3B,IAAI,EAAE,OAAO,iBAAiB,CAAC;IAC/B,UAAU,EAAE,GAAG,CAAC;IAChB,OAAO,EAAE,MAAM,CAAC;IAChB,IAAI,EAAE;QAAE,YAAY,EAAE,WAAW,EAAE,CAAA;KAAE,CAAC;CACzC;AAED,wBAAgB,uBAAuB,CAAC,GAAG,EAAE,OAAO,GAAG,GAAG,IAAI,qBAAqB,CAMlF;AAED,MAAM,WAAW,WAAW,CAAC,CAAC;IAC1B,IAAI,EAAE,CAAC,CAAC;IACR,MAAM,EAAE,eAAe,EAAE,CAAC;CAC7B;AAID,MAAM,WAAW,8BAA8B,CAAC,CAAC,EAAE,CAAC,GAAG,OAAO;IAC1D,+DAA+D;IAC/D,WAAW,EAAE,MAAM,CAAC;IACpB,yEAAyE;IACzE,YAAY,EAAE,WAAW,CAAC,CAAC,CAAC,EAAE,CAAC;IAC/B,mDAAmD;IACnD,YAAY,EAAE,MAAM,CAAC;IACrB;;;OAGG;IACH,UAAU,CAAC,EAAE,CAAC,CAAC;CAClB;AAED,MAAM,WAAW,+BAA+B;IAC5C,WAAW,CAAC,EAAE,MAAM,CAAC;CACxB;AAED,MAAM,MAAM,MAAM,CAAC,CAAC,EAAE,CAAC,GAAG,OAAO,IAAI,CAAC,KAAK,EAAE,CAAC,EAAE,KAAK,OAAO,CAAC,CAAC,CAAC,CAAC;AAEhE;;;;;;;;;;GAUG;AACH,wBAAsB,wBAAwB,CAAC,CAAC,EAAE,CAAC,GAAG,OAAO,EACzD,MAAM,EAAE,MAAM,CAAC,CAAC,EAAE,CAAC,CAAC,EACpB,KAAK,EAAE,CAAC,GAAG,CAAC,EAAE,EACd,OAAO,GAAE,+BAAoC,GAC9C,OAAO,CAAC,8BAA8B,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC,CAe/C"}

package/dist/src/pushDataWithSchemaRepair.js

@@ -0,0 +1,448 @@
+// pushDataWithSchemaRepair: parse the Apify dataset schema-validation error,
+// repair the offending items (strip bad fields, placeholder missing required
+// ones), and retry the push.
+//
+// NOTE: instead of recursively healing the data one error-round at a time, we
+// could parse the Actor's `dataset_schema.json` up front and fix every item in
+// a single pass (we'd know each field's expected type / constraints without
+// waiting for the API to report them). That would avoid the multi-round retry
+// loop, but requires heavier code (locating + loading the schema, resolving
+// $refs, walking the schema tree). Something to consider in the future.
+const SCHEMA_ERROR_TYPE = 'schema-validation-error';
+// Cap on how many distinct field issues we spell out in one log line. A
+// pathological batch can fail on hundreds of fields; the overflow is
+// summarised as a count instead of flooding the Actor log.
+const MAX_LOGGED_FIELDS = 20;
+// Shared empty error list. Positions that validated fine in the current round
+// point at this instead of allocating a fresh array each time.
+const NO_ERRORS = [];
+export function isSchemaValidationError(err) {
+    if (!err || typeof err !== 'object')
+        return false;
+    const e = err;
+    if (e.type !== SCHEMA_ERROR_TYPE)
+        return false;
+    if (e.statusCode !== 400)
+        return false;
+    return Array.isArray(e.data?.invalidItems);
+}
+/**
+ * Push `input` via `pushFn`, surviving Apify dataset schema-validation
+ * failures by cleaning offending items and retrying.
+ *
+ * `pushFn` is mandatory and intentionally not bundled — a CI check forbids
+ * direct `.pushData()` calls in this library, so the binding lives at the
+ * call site: `(b) => Actor.pushData(b)` or
+ * `(b) => client.dataset(id).pushItems(b)`.
+ *
+ * Whatever `pushFn` resolves to is handed back untouched as `pushResult`.
+ */
+export async function pushDataWithSchemaRepair(pushFn, input, options = {}) {
+    const items = Array.isArray(input) ? input : [input];
+    // Happy path: assume validation will succeed (the overwhelmingly common
+    // case). No working copies, no maps, no per-item wrapper objects — just
+    // hand the caller's array to pushFn and return on success.
+    try {
+        const pushResult = await pushFn(items);
+        return { pushedCount: items.length, droppedItems: [], attemptCount: 1, pushResult };
+    }
+    catch (err) {
+        if (!isSchemaValidationError(err))
+            throw err;
+        // Clamp to >=1: the initial push above always counts as one attempt,
+        // so 0/negative would make the reported `attemptCount` lie about it.
+        return cleanAndRetry(pushFn, items, err, Math.max(1, options.maxAttempts ?? 5));
+    }
+}
+async function cleanAndRetry(pushFn, originalItems, initialError, maxAttempts) {
+    // working[i] is what we'll send on the next push. We mutate this array
+    // in place (splicing drops, replacing cleaned entries); the caller's
+    // `originalItems` is never touched.
+    const working = originalItems.slice();
+    // Parallel to `working`. Holds the original (untouched) reference so a
+    // dropped report shows what the caller actually passed in, even if the
+    // item was partially cleaned before being dropped on a later round.
+    const originalAt = originalItems.slice();
+    // Parallel to `working`. Tracks which paths inside each item are
+    // placeholders we set (vs. real user data). Needed so we can chase
+    // follow-up type/minLength/enum errors on the placeholder field
+    // without looping forever; for user-supplied fields the existing
+    // "delete the field" behaviour stays in effect.
+    const placeholderPaths = originalItems.map(() => new Set());
+    // Parallel to `working`. The errors the API reported for this position in
+    // the *current* round, reset every round. Non-empty therefore means "still
+    // failing right now", which is what decides who gets dropped when we run
+    // out of attempts — and it gives that drop a reason to report.
+    const roundErrors = originalItems.map(() => NO_ERRORS);
+    const dropped = [];
+    let attempts = 1;
+    let lastError = initialError;
+    // Remove position `i` from every parallel array and record why it went.
+    const dropAt = (i, errors) => {
+        dropped.push({ item: originalAt[i], errors });
+        working.splice(i, 1);
+        originalAt.splice(i, 1);
+        placeholderPaths.splice(i, 1);
+        roundErrors.splice(i, 1);
+    };
+    // Every return path below either follows a successful push or has dropped
+    // everything that isn't in it, so "original minus dropped" is exactly what
+    // landed. (A rejected push stores nothing at all — not even the items the
+    // API found no fault with.)
+    const result = (attemptCount, pushResult) => ({
+        pushedCount: originalItems.length - dropped.length,
+        droppedItems: dropped,
+        attemptCount,
+        pushResult,
+    });
+    while (true) {
+        // Process this round's errors. Highest position first so the splices
+        // below don't shift positions we still need to look at.
+        const invalids = lastError.data.invalidItems.slice().sort((a, b) => b.itemPosition - a.itemPosition);
+        roundErrors.fill(NO_ERRORS);
+        // Which fields went wrong this round, across every failing item. We
+        // deliberately don't track which item had which problem — with more
+        // than one bad item that detail is noise, and the field set is what
+        // actually tells you what to fix in the schema or the scraper.
+        const repairedFields = new Set();
+        const droppedFields = new Set();
+        let droppedThisRound = 0;
+        for (const invalid of invalids) {
+            const i = invalid.itemPosition;
+            // Guard against a malformed/unexpected error payload (e.g. a
+            // position outside the batch we actually sent) instead of
+            // crashing on `working[i]` being undefined.
+            if (i < 0 || i >= working.length) {
+                console.log(`pushDataWithSchemaRepair: ignoring out-of-range itemPosition ${i} in validation error response.`);
+                continue;
+            }
+            const cleaned = cleanItemFields(working[i], invalid.validationErrors, placeholderPaths[i]);
+            if (cleaned === null) {
+                collectFieldIssues(invalid.validationErrors, droppedFields);
+                droppedThisRound++;
+                dropAt(i, invalid.validationErrors);
+            }
+            else {
+                working[i] = cleaned;
+                roundErrors[i] = invalid.validationErrors;
+                collectFieldIssues(invalid.validationErrors, repairedFields);
+            }
+        }
+        const report = [
+            `pushDataWithSchemaRepair: schema validation failed on attempt ${attempts}: ${lastError.data.invalidItems.length} invalid item(s)`,
+        ];
+        if (repairedFields.size > 0)
+            report.push(`repaired fields: ${formatFields(repairedFields)}`);
+        if (droppedThisRound > 0) {
+            report.push(`dropped ${droppedThisRound} item(s) on unfixable fields: ${formatFields(droppedFields)}`);
+        }
+        if (working.length === 0)
+            report.push('nothing left to retry.');
+        else if (attempts < maxAttempts)
+            report.push(`retrying with ${working.length} item(s).`);
+        else
+            report.push(`attempt cap reached with ${working.length} item(s) left.`);
+        console.log(report.join('; '));
+        if (working.length === 0)
+            return result(attempts);
+        attempts++;
+        if (attempts > maxAttempts) {
+            // Out of repair rounds. Drop what's still failing — but a rejected
+            // push stores *nothing*, so keeping the rest in the batch would
+            // throw away perfectly valid items along with the bad ones. Give
+            // the survivors one clean push of their own instead. They were
+            // validated in the round above and left untouched since, so this
+            // push is expected to go through.
+            const unresolvedFields = new Set();
+            let unresolved = 0;
+            for (let i = working.length - 1; i >= 0; i--) {
+                if (roundErrors[i].length === 0)
+                    continue;
+                collectFieldIssues(roundErrors[i], unresolvedFields);
+                unresolved++;
+                dropAt(i, roundErrors[i]);
+            }
+            const giveUp = [`pushDataWithSchemaRepair: gave up after ${maxAttempts} attempts`];
+            if (unresolved > 0) {
+                giveUp.push(`dropped ${unresolved} item(s) still failing on fields: ${formatFields(unresolvedFields)}`);
+            }
+            giveUp.push(working.length > 0 ? `pushing the ${working.length} valid item(s) left.` : 'nothing to salvage.');
+            console.log(giveUp.join('; '));
+            if (working.length === 0)
+                return result(maxAttempts);
+            try {
+                const pushResult = await pushFn(working);
+                return result(attempts, pushResult);
+            }
+            catch (err) {
+                if (!isSchemaValidationError(err))
+                    throw err;
+                // Even the survivors were rejected, so nothing landed. Report
+                // each one with whatever the API said about it this time.
+                const errorsAt = new Map();
+                for (const invalid of err.data.invalidItems) {
+                    errorsAt.set(invalid.itemPosition, invalid.validationErrors);
+                }
+                console.log(`pushDataWithSchemaRepair: final push of ${working.length} item(s) was rejected too; dropping them.`);
+                for (let i = working.length - 1; i >= 0; i--)
+                    dropAt(i, errorsAt.get(i) ?? NO_ERRORS);
+                return result(attempts);
+            }
+        }
+        try {
+            const pushResult = await pushFn(working);
+            return result(attempts, pushResult);
+        }
+        catch (err) {
+            if (!isSchemaValidationError(err))
+                throw err;
+            lastError = err;
+        }
+    }
+}
+// Add a `path (keyword)` label for every AJV error into `into`. A Set is
+// used on purpose: one bad field usually shows up on many items in the
+// batch, and repeating it once per item makes the log unreadable.
+function collectFieldIssues(validationErrors, into) {
+    for (const err of validationErrors)
+        into.add(fieldIssueLabel(err));
+}
+// Human-readable "which field is broken, and how" for one AJV error.
+//
+// `required` and `additionalProperties` report the *parent* in instancePath
+// and name the offending key in params, so we re-attach it — otherwise a
+// missing top-level field would log as the useless `(item root)`.
+function fieldIssueLabel(err) {
+    const child = offendingKey(err.params);
+    const parent = err.instancePath || '';
+    const path = child === undefined ? parent : `${parent}/${escapeJsonPointerSegment(child)}`;
+    return `${path === '' ? '(item root)' : collapseArrayIndices(path)} (${err.keyword})`;
+}
+// The key an error blames when instancePath points at its parent.
+function offendingKey(params) {
+    if (typeof params?.missingProperty === 'string')
+        return params.missingProperty;
+    if (typeof params?.additionalProperty === 'string')
+        return params.additionalProperty;
+    return undefined;
+}
+// `/tags/0` and `/tags/7` are the same *field* as far as the log is
+// concerned, so collapse numeric segments into `/tags/[]`. Keeps a batch
+// with a hundred bad array elements down to a single entry.
+function collapseArrayIndices(path) {
+    return path.replace(/\/\d+(?=\/|$)/g, '/[]');
+}
+// Render a field-issue set as a stable, bounded, comma-separated list.
+function formatFields(fields) {
+    const sorted = [...fields].sort();
+    if (sorted.length <= MAX_LOGGED_FIELDS)
+        return sorted.join(', ');
+    const shown = sorted.slice(0, MAX_LOGGED_FIELDS);
+    return `${shown.join(', ')} (+${sorted.length - MAX_LOGGED_FIELDS} more)`;
+}
+// Try to repair a single item given its AJV errors. Returns null when the
+// item can't be salvaged — including when none of its errors turned out to
+// be actionable, since re-pushing an unchanged item would just reproduce the
+// same errors and burn the remaining attempts.
+//
+// Mutates `placeholderPaths` to record any fields we filled in ourselves,
+// so the caller can keep iterating on them across rounds.
+function cleanItemFields(item, validationErrors, placeholderPaths) {
+    // structuredClone so we never mutate the caller's data.
+    const cloned = structuredClone(item);
+    let changed = false;
+    for (const err of sortForRepair(validationErrors)) {
+        const instancePath = err.instancePath || '';
+        const path = parseJsonPointer(instancePath);
+        // Missing required field: insert a placeholder and remember we did
+        // so. The next round will see a `type` error on this path and we'll
+        // upgrade null to a type-appropriate value. The property is named in
+        // params — instancePath points at the object that's missing it, which
+        // may be the item root or any object nested inside it.
+        if (err.keyword === 'required' && typeof err.params?.missingProperty === 'string') {
+            const target = [...path, err.params.missingProperty];
+            if (setAtPath(cloned, target, null)) {
+                placeholderPaths.add(toJsonPointer(target));
+                changed = true;
+            }
+            continue;
+        }
+        // Unknown property: also named in params, with instancePath pointing
+        // at its parent. Strip it.
+        if (err.keyword === 'additionalProperties' && typeof err.params?.additionalProperty === 'string') {
+            if (deleteAtPath(cloned, [...path, err.params.additionalProperty]))
+                changed = true;
+            continue;
+        }
+        // Any other error at the root means the item itself is the wrong
+        // shape (wrong type, failed `anyOf`, …) — there's no field to strip.
+        if (path.length === 0)
+            return null;
+        // Errors on a path we placeholder'd: try to satisfy the constraint
+        // rather than delete the field (deleting would re-trigger required).
+        if (placeholderPaths.has(instancePath)) {
+            const fix = placeholderFor(err);
+            if (!fix.ok) {
+                // Constraint we don't know how to satisfy on a placeholder
+                // field (e.g. pattern, custom format). Give up on this item.
+                return null;
+            }
+            if (setAtPath(cloned, path, fix.value))
+                changed = true;
+            continue;
+        }
+        // User-supplied field with a violation we don't try to coerce.
+        // Strip it; if the schema declares it required, the next push will
+        // re-add a placeholder.
+        if (deleteAtPath(cloned, path))
+            changed = true;
+    }
+    // Nothing we could act on (paths that no longer exist, keywords with no
+    // handler): the next push would fail identically, so drop the item now
+    // instead of spending every remaining attempt to learn that.
+    return changed ? cloned : null;
+}
+// Order one item's errors so the repairs don't interfere with each other.
+// Deleting `/tags/0` shifts every later element down, so sibling array
+// indices have to be handled highest-first; deeper paths come before their
+// ancestors for the same reason.
+function sortForRepair(validationErrors) {
+    return validationErrors
+        .map((err) => ({ err, path: parseJsonPointer(err.instancePath || '') }))
+        .sort((a, b) => comparePaths(a.path, b.path))
+        .map((entry) => entry.err);
+}
+function comparePaths(a, b) {
+    for (let i = 0; i < Math.min(a.length, b.length); i++) {
+        if (a[i] === b[i])
+            continue;
+        const ai = Number(a[i]);
+        const bi = Number(b[i]);
+        // Sibling array elements: highest index first.
+        if (Number.isInteger(ai) && Number.isInteger(bi))
+            return bi - ai;
+        return a[i] < b[i] ? -1 : 1;
+    }
+    // Same prefix: the deeper path first.
+    return b.length - a.length;
+}
+// Pick a value that will satisfy `err.keyword` on a placeholder field.
+// Returns ok:false when we don't have a sensible default; the caller drops
+// the item in that case.
+//
+// We deliberately only placeholder the four "empty" values — `''`, `[]`, `{}`,
+// and `null`. These are unambiguously empty and can't be mistaken for real
+// data. We do NOT fabricate values for `enum`, `format`, `minLength`, numeric
+// bounds, etc.: a made-up email, a first-enum-value, or a `'_'.repeat(N)`
+// string all silently poison the customer's dataset with plausible-looking
+// junk. Better to drop the item than to lie about its contents. As a result
+// the only keyword we handle is `type` (only for those four target types) —
+// everything else falls through to ok:false and the item is dropped.
+function placeholderFor(err) {
+    const params = err.params ?? {};
+    if (err.keyword !== 'type')
+        return { ok: false };
+    // params.type is the expected type as a string, or an array of strings
+    // when the field allows multiple types (e.g. `['string', 'null']`).
+    const types = Array.isArray(params.type) ? params.type : [params.type];
+    // Union type that permits null: prefer null. It's the cleanest possible
+    // placeholder — it commits to no concrete value at all — so whenever the
+    // schema allows it, that's what we use.
+    if (types.length > 1 && types.includes('null')) {
+        return { ok: true, value: null };
+    }
+    // Otherwise take the first allowed type we have an "empty" default for.
+    // integer / number / boolean are intentionally absent: 0 / false read as
+    // real data, so a field of only those types is dropped instead.
+    for (const t of types) {
+        switch (t) {
+            case 'null':
+                return { ok: true, value: null };
+            case 'string':
+                return { ok: true, value: '' };
+            case 'array':
+                return { ok: true, value: [] };
+            case 'object':
+                return { ok: true, value: {} };
+            default:
+                break;
+        }
+    }
+    return { ok: false };
+}
+// Parse a JSON Pointer (RFC 6901) into decoded segments.
+// "" -> []; "/foo/bar" -> ["foo","bar"]; "/tags/0" -> ["tags","0"].
+function parseJsonPointer(pointer) {
+    if (!pointer)
+        return [];
+    return pointer
+        .split('/')
+        .slice(1)
+        .map((seg) => seg.replace(/~1/g, '/').replace(/~0/g, '~'));
+}
+// Inverse of parseJsonPointer — used to record placeholder paths in the same
+// encoding the API reports them in, so later errors match by string.
+function toJsonPointer(path) {
+    return path.map((seg) => `/${escapeJsonPointerSegment(seg)}`).join('');
+}
+function escapeJsonPointerSegment(segment) {
+    return segment.replace(/~/g, '~0').replace(/\//g, '~1');
+}
+// Delete the value at `path` inside `obj`. Arrays splice; `sortForRepair`
+// makes sure sibling indices are processed highest-first so the shift
+// doesn't invalidate the paths we haven't handled yet.
+function deleteAtPath(obj, path) {
+    if (path.length === 0)
+        return false;
+    // eslint-disable-next-line @typescript-eslint/no-explicit-any
+    let cursor = obj;
+    for (let i = 0; i < path.length - 1; i++) {
+        const key = path[i];
+        if (cursor == null || typeof cursor !== 'object')
+            return false;
+        cursor = Array.isArray(cursor) ? cursor[Number(key)] : cursor[key];
+    }
+    if (cursor == null || typeof cursor !== 'object')
+        return false;
+    const last = path[path.length - 1];
+    if (Array.isArray(cursor)) {
+        const idx = Number(last);
+        if (!Number.isInteger(idx) || idx < 0 || idx >= cursor.length)
+            return false;
+        cursor.splice(idx, 1);
+        return true;
+    }
+    if (Object.prototype.hasOwnProperty.call(cursor, last)) {
+        delete cursor[last];
+        return true;
+    }
+    return false;
+}
+// Set the value at `path` inside `obj`. Only the final segment is created —
+// every parent on the way has to exist already (it does: the API reports the
+// error against an object it found).
+function setAtPath(obj, path, value) {
+    if (path.length === 0)
+        return false;
+    // eslint-disable-next-line @typescript-eslint/no-explicit-any
+    let cursor = obj;
+    for (let i = 0; i < path.length - 1; i++) {
+        const key = path[i];
+        if (cursor == null || typeof cursor !== 'object')
+            return false;
+        cursor = Array.isArray(cursor) ? cursor[Number(key)] : cursor[key];
+    }
+    if (cursor == null || typeof cursor !== 'object')
+        return false;
+    const last = path[path.length - 1];
+    if (Array.isArray(cursor)) {
+        const idx = Number(last);
+        if (!Number.isInteger(idx) || idx < 0)
+            return false;
+        cursor[idx] = value;
+        return true;
+    }
+    cursor[last] = value;
+    return true;
+}
+//# sourceMappingURL=pushDataWithSchemaRepair.js.map

package/dist/src/pushDataWithSchemaRepair.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"pushDataWithSchemaRepair.js","sourceRoot":"","sources":["../../src/pushDataWithSchemaRepair.ts"],"names":[],"mappings":"AAAA,6EAA6E;AAC7E,6EAA6E;AAC7E,6BAA6B;AAC7B,EAAE;AACF,8EAA8E;AAC9E,+EAA+E;AAC/E,4EAA4E;AAC5E,8EAA8E;AAC9E,4EAA4E;AAC5E,wEAAwE;AAExE,MAAM,iBAAiB,GAAG,yBAAyB,CAAC;AAEpD,wEAAwE;AACxE,qEAAqE;AACrE,2DAA2D;AAC3D,MAAM,iBAAiB,GAAG,EAAE,CAAC;AAE7B,8EAA8E;AAC9E,+DAA+D;AAC/D,MAAM,SAAS,GAAsB,EAAE,CAAC;AA4BxC,MAAM,UAAU,uBAAuB,CAAC,GAAY;IAChD,IAAI,CAAC,GAAG,IAAI,OAAO,GAAG,KAAK,QAAQ;QAAE,OAAO,KAAK,CAAC;IAClD,MAAM,CAAC,GAAG,GAAqC,CAAC;IAChD,IAAI,CAAC,CAAC,IAAI,KAAK,iBAAiB;QAAE,OAAO,KAAK,CAAC;IAC/C,IAAI,CAAC,CAAC,UAAU,KAAK,GAAG;QAAE,OAAO,KAAK,CAAC;IACvC,OAAO,KAAK,CAAC,OAAO,CAAC,CAAC,CAAC,IAAI,EAAE,YAAY,CAAC,CAAC;AAC/C,CAAC;AA6BD;;;;;;;;;;GAUG;AACH,MAAM,CAAC,KAAK,UAAU,wBAAwB,CAC1C,MAAoB,EACpB,KAAc,EACd,UAA2C,EAAE;IAE7C,MAAM,KAAK,GAAG,KAAK,CAAC,OAAO,CAAC,KAAK,CAAC,CAAC,CAAC,CAAC,KAAK,CAAC,CAAC,CAAC,CAAC,KAAK,CAAC,CAAC;IAErD,wEAAwE;IACxE,wEAAwE;IACxE,2DAA2D;IAC3D,IAAI,CAAC;QACD,MAAM,UAAU,GAAG,MAAM,MAAM,CAAC,KAAK,CAAC,CAAC;QACvC,OAAO,EAAE,WAAW,EAAE,KAAK,CAAC,MAAM,EAAE,YAAY,EAAE,EAAE,EAAE,YAAY,EAAE,CAAC,EAAE,UAAU,EAAE,CAAC;IACxF,CAAC;IAAC,OAAO,GAAG,EAAE,CAAC;QACX,IAAI,CAAC,uBAAuB,CAAC,GAAG,CAAC;YAAE,MAAM,GAAG,CAAC;QAC7C,qEAAqE;QACrE,qEAAqE;QACrE,OAAO,aAAa,CAAC,MAAM,EAAE,KAAK,EAAE,GAAG,EAAE,IAAI,CAAC,GAAG,CAAC,CAAC,EAAE,OAAO,CAAC,WAAW,IAAI,CAAC,CAAC,CAAC,CAAC;IACpF,CAAC;AACL,CAAC;AAED,KAAK,UAAU,aAAa,CACxB,MAAoB,EACpB,aAA2B,EAC3B,YAAmC,EACnC,WAAmB;IAEnB,uEAAuE;IACvE,qEAAqE;IACrE,oCAAoC;IACpC,MAAM,OAAO,GAAQ,aAAa,CAAC,KAAK,EAAE,CAAC;IAC3C,uEAAuE;IACvE,uEAAuE;IACvE,oEAAoE;IACpE,MAAM,UAAU,GAAQ,aAAa,CAAC,KAAK,EAAE,CAAC;IAC9C,iEAAiE;IACjE,mEAAmE;IACnE,gEAAgE;IAChE,iEAAiE;IACjE,gDAAgD;IAChD,MAAM,gBAAgB,GAAkB,aAAa,CAAC,GAAG,CAAC,GAAG,EAAE,CAAC,IAAI,GAAG,EAAU,CAAC,CAAC;IACnF,0EAA0E;IAC1E,2EAA2E;IAC3E,yEAAyE;IACzE,+DAA+D;IAC/D,MAAM,WAAW,GAAwB,aAAa,CAAC,GAAG,CAAC,GAAG,EAAE,CAAC,SAAS,CAAC,CAAC;IAC5E,MAAM,OAAO,GAAqB,EAAE,CAAC;IACrC,IAAI,QAAQ,GAAG,CAAC,CAAC;IACjB,IAAI,SAAS,GAA0B,YAAY,CAAC;IAEpD,wEAAwE;IACxE,MAAM,MAAM,GAAG,CAAC,CAAS,EAAE,MAAyB,EAAQ,EAAE;QAC1D,OAAO,CAAC,IAAI,CAAC,EAAE,IAAI,EAAE,UAAU,CAAC,CAAC,CAAC,EAAE,MAAM,EAAE,CAAC,CAAC;QAC9C,OAAO,CAAC,MAAM,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC;QACrB,UAAU,CAAC,MAAM,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC;QACxB,gBAAgB,CAAC,MAAM,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC;QAC9B,WAAW,CAAC,MAAM,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC;IAC7B,CAAC,CAAC;IAEF,0EAA0E;IAC1E,2EAA2E;IAC3E,0EAA0E;IAC1E,4BAA4B;IAC5B,MAAM,MAAM,GAAG,CAAC,YAAoB,EAAE,UAAc,EAAwC,EAAE,CAAC,CAAC;QAC5F,WAAW,EAAE,aAAa,CAAC,MAAM,GAAG,OAAO,CAAC,MAAM;QAClD,YAAY,EAAE,OAAO;QACrB,YAAY;QACZ,UAAU;KACb,CAAC,CAAC;IAEH,OAAO,IAAI,EAAE,CAAC;QACV,qEAAqE;QACrE,wDAAwD;QACxD,MAAM,QAAQ,GAAG,SAAS,CAAC,IAAI,CAAC,YAAY,CAAC,KAAK,EAAE,CAAC,IAAI,CAAC,CAAC,CAAC,EAAE,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,YAAY,GAAG,CAAC,CAAC,YAAY,CAAC,CAAC;QACrG,WAAW,CAAC,IAAI,CAAC,SAAS,CAAC,CAAC;QAE5B,oEAAoE;QACpE,oEAAoE;QACpE,oEAAoE;QACpE,+DAA+D;QAC/D,MAAM,cAAc,GAAG,IAAI,GAAG,EAAU,CAAC;QACzC,MAAM,aAAa,GAAG,IAAI,GAAG,EAAU,CAAC;QACxC,IAAI,gBAAgB,GAAG,CAAC,CAAC;QAEzB,KAAK,MAAM,OAAO,IAAI,QAAQ,EAAE,CAAC;YAC7B,MAAM,CAAC,GAAG,OAAO,CAAC,YAAY,CAAC;YAC/B,6DAA6D;YAC7D,0DAA0D;YAC1D,4CAA4C;YAC5C,IAAI,CAAC,GAAG,CAAC,IAAI,CAAC,IAAI,OAAO,CAAC,MAAM,EAAE,CAAC;gBAC/B,OAAO,CAAC,GAAG,CACP,gEAAgE,CAAC,gCAAgC,CACpG,CAAC;gBACF,SAAS;YACb,CAAC;YACD,MAAM,OAAO,GAAG,eAAe,CAAC,OAAO,CAAC,CAAC,CAAC,EAAE,OAAO,CAAC,gBAAgB,EAAE,gBAAgB,CAAC,CAAC,CAAC,CAAC,CAAC;YAC3F,IAAI,OAAO,KAAK,IAAI,EAAE,CAAC;gBACnB,kBAAkB,CAAC,OAAO,CAAC,gBAAgB,EAAE,aAAa,CAAC,CAAC;gBAC5D,gBAAgB,EAAE,CAAC;gBACnB,MAAM,CAAC,CAAC,EAAE,OAAO,CAAC,gBAAgB,CAAC,CAAC;YACxC,CAAC;iBAAM,CAAC;gBACJ,OAAO,CAAC,CAAC,CAAC,GAAG,OAAO,CAAC;gBACrB,WAAW,CAAC,CAAC,CAAC,GAAG,OAAO,CAAC,gBAAgB,CAAC;gBAC1C,kBAAkB,CAAC,OAAO,CAAC,gBAAgB,EAAE,cAAc,CAAC,CAAC;YACjE,CAAC;QACL,CAAC;QAED,MAAM,MAAM,GAAG;YACX,iEAAiE,QAAQ,KAAK,SAAS,CAAC,IAAI,CAAC,YAAY,CAAC,MAAM,kBAAkB;SACrI,CAAC;QACF,IAAI,cAAc,CAAC,IAAI,GAAG,CAAC;YAAE,MAAM,CAAC,IAAI,CAAC,oBAAoB,YAAY,CAAC,cAAc,CAAC,EAAE,CAAC,CAAC;QAC7F,IAAI,gBAAgB,GAAG,CAAC,EAAE,CAAC;YACvB,MAAM,CAAC,IAAI,CAAC,WAAW,gBAAgB,iCAAiC,YAAY,CAAC,aAAa,CAAC,EAAE,CAAC,CAAC;QAC3G,CAAC;QACD,IAAI,OAAO,CAAC,MAAM,KAAK,CAAC;YAAE,MAAM,CAAC,IAAI,CAAC,wBAAwB,CAAC,CAAC;aAC3D,IAAI,QAAQ,GAAG,WAAW;YAAE,MAAM,CAAC,IAAI,CAAC,iBAAiB,OAAO,CAAC,MAAM,WAAW,CAAC,CAAC;;YACpF,MAAM,CAAC,IAAI,CAAC,4BAA4B,OAAO,CAAC,MAAM,gBAAgB,CAAC,CAAC;QAC7E,OAAO,CAAC,GAAG,CAAC,MAAM,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC,CAAC;QAE/B,IAAI,OAAO,CAAC,MAAM,KAAK,CAAC;YAAE,OAAO,MAAM,CAAC,QAAQ,CAAC,CAAC;QAElD,QAAQ,EAAE,CAAC;QACX,IAAI,QAAQ,GAAG,WAAW,EAAE,CAAC;YACzB,mEAAmE;YACnE,gEAAgE;YAChE,iEAAiE;YACjE,+DAA+D;YAC/D,iEAAiE;YACjE,kCAAkC;YAClC,MAAM,gBAAgB,GAAG,IAAI,GAAG,EAAU,CAAC;YAC3C,IAAI,UAAU,GAAG,CAAC,CAAC;YACnB,KAAK,IAAI,CAAC,GAAG,OAAO,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC,IAAI,CAAC,EAAE,CAAC,EAAE,EAAE,CAAC;gBAC3C,IAAI,WAAW,CAAC,CAAC,CAAC,CAAC,MAAM,KAAK,CAAC;oBAAE,SAAS;gBAC1C,kBAAkB,CAAC,WAAW,CAAC,CAAC,CAAC,EAAE,gBAAgB,CAAC,CAAC;gBACrD,UAAU,EAAE,CAAC;gBACb,MAAM,CAAC,CAAC,EAAE,WAAW,CAAC,CAAC,CAAC,CAAC,CAAC;YAC9B,CAAC;YACD,MAAM,MAAM,GAAG,CAAC,2CAA2C,WAAW,WAAW,CAAC,CAAC;YACnF,IAAI,UAAU,GAAG,CAAC,EAAE,CAAC;gBACjB,MAAM,CAAC,IAAI,CAAC,WAAW,UAAU,qCAAqC,YAAY,CAAC,gBAAgB,CAAC,EAAE,CAAC,CAAC;YAC5G,CAAC;YACD,MAAM,CAAC,IAAI,CACP,OAAO,CAAC,MAAM,GAAG,CAAC,CAAC,CAAC,CAAC,eAAe,OAAO,CAAC,MAAM,sBAAsB,CAAC,CAAC,CAAC,qBAAqB,CACnG,CAAC;YACF,OAAO,CAAC,GAAG,CAAC,MAAM,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC,CAAC;YAE/B,IAAI,OAAO,CAAC,MAAM,KAAK,CAAC;gBAAE,OAAO,MAAM,CAAC,WAAW,CAAC,CAAC;YAErD,IAAI,CAAC;gBACD,MAAM,UAAU,GAAG,MAAM,MAAM,CAAC,OAAO,CAAC,CAAC;gBACzC,OAAO,MAAM,CAAC,QAAQ,EAAE,UAAU,CAAC,CAAC;YACxC,CAAC;YAAC,OAAO,GAAG,EAAE,CAAC;gBACX,IAAI,CAAC,uBAAuB,CAAC,GAAG,CAAC;oBAAE,MAAM,GAAG,CAAC;gBAC7C,8DAA8D;gBAC9D,0DAA0D;gBAC1D,MAAM,QAAQ,GAAG,IAAI,GAAG,EAA6B,CAAC;gBACtD,KAAK,MAAM,OAAO,IAAI,GAAG,CAAC,IAAI,CAAC,YAAY,EAAE,CAAC;oBAC1C,QAAQ,CAAC,GAAG,CAAC,OAAO,CAAC,YAAY,EAAE,OAAO,CAAC,gBAAgB,CAAC,CAAC;gBACjE,CAAC;gBACD,OAAO,CAAC,GAAG,CACP,2CAA2C,OAAO,CAAC,MAAM,2CAA2C,CACvG,CAAC;gBACF,KAAK,IAAI,CAAC,GAAG,OAAO,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC,IAAI,CAAC,EAAE,CAAC,EAAE;oBAAE,MAAM,CAAC,CAAC,EAAE,QAAQ,CAAC,GAAG,CAAC,CAAC,CAAC,IAAI,SAAS,CAAC,CAAC;gBACtF,OAAO,MAAM,CAAC,QAAQ,CAAC,CAAC;YAC5B,CAAC;QACL,CAAC;QAED,IAAI,CAAC;YACD,MAAM,UAAU,GAAG,MAAM,MAAM,CAAC,OAAO,CAAC,CAAC;YACzC,OAAO,MAAM,CAAC,QAAQ,EAAE,UAAU,CAAC,CAAC;QACxC,CAAC;QAAC,OAAO,GAAG,EAAE,CAAC;YACX,IAAI,CAAC,uBAAuB,CAAC,GAAG,CAAC;gBAAE,MAAM,GAAG,CAAC;YAC7C,SAAS,GAAG,GAAG,CAAC;QACpB,CAAC;IACL,CAAC;AACL,CAAC;AAED,yEAAyE;AACzE,uEAAuE;AACvE,kEAAkE;AAClE,SAAS,kBAAkB,CAAC,gBAA4C,EAAE,IAAiB;IACvF,KAAK,MAAM,GAAG,IAAI,gBAAgB;QAAE,IAAI,CAAC,GAAG,CAAC,eAAe,CAAC,GAAG,CAAC,CAAC,CAAC;AACvE,CAAC;AAED,qEAAqE;AACrE,EAAE;AACF,4EAA4E;AAC5E,yEAAyE;AACzE,kEAAkE;AAClE,SAAS,eAAe,CAAC,GAAoB;IACzC,MAAM,KAAK,GAAG,YAAY,CAAC,GAAG,CAAC,MAAM,CAAC,CAAC;IACvC,MAAM,MAAM,GAAG,GAAG,CAAC,YAAY,IAAI,EAAE,CAAC;IACtC,MAAM,IAAI,GAAG,KAAK,KAAK,SAAS,CAAC,CAAC,CAAC,MAAM,CAAC,CAAC,CAAC,GAAG,MAAM,IAAI,wBAAwB,CAAC,KAAK,CAAC,EAAE,CAAC;IAC3F,OAAO,GAAG,IAAI,KAAK,EAAE,CAAC,CAAC,CAAC,aAAa,CAAC,CAAC,CAAC,oBAAoB,CAAC,IAAI,CAAC,KAAK,GAAG,CAAC,OAAO,GAAG,CAAC;AAC1F,CAAC;AAED,kEAAkE;AAClE,SAAS,YAAY,CAAC,MAA2C;IAC7D,IAAI,OAAO,MAAM,EAAE,eAAe,KAAK,QAAQ;QAAE,OAAO,MAAM,CAAC,eAAe,CAAC;IAC/E,IAAI,OAAO,MAAM,EAAE,kBAAkB,KAAK,QAAQ;QAAE,OAAO,MAAM,CAAC,kBAAkB,CAAC;IACrF,OAAO,SAAS,CAAC;AACrB,CAAC;AAED,oEAAoE;AACpE,yEAAyE;AACzE,4DAA4D;AAC5D,SAAS,oBAAoB,CAAC,IAAY;IACtC,OAAO,IAAI,CAAC,OAAO,CAAC,gBAAgB,EAAE,KAAK,CAAC,CAAC;AACjD,CAAC;AAED,uEAAuE;AACvE,SAAS,YAAY,CAAC,MAA2B;IAC7C,MAAM,MAAM,GAAG,CAAC,GAAG,MAAM,CAAC,CAAC,IAAI,EAAE,CAAC;IAClC,IAAI,MAAM,CAAC,MAAM,IAAI,iBAAiB;QAAE,OAAO,MAAM,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC;IACjE,MAAM,KAAK,GAAG,MAAM,CAAC,KAAK,CAAC,CAAC,EAAE,iBAAiB,CAAC,CAAC;IACjD,OAAO,GAAG,KAAK,CAAC,IAAI,CAAC,IAAI,CAAC,MAAM,MAAM,CAAC,MAAM,GAAG,iBAAiB,QAAQ,CAAC;AAC9E,CAAC;AAED,0EAA0E;AAC1E,2EAA2E;AAC3E,6EAA6E;AAC7E,+CAA+C;AAC/C,EAAE;AACF,0EAA0E;AAC1E,0DAA0D;AAC1D,SAAS,eAAe,CAAI,IAAO,EAAE,gBAAmC,EAAE,gBAA6B;IACnG,wDAAwD;IACxD,MAAM,MAAM,GAAG,eAAe,CAAC,IAAI,CAAM,CAAC;IAC1C,IAAI,OAAO,GAAG,KAAK,CAAC;IAEpB,KAAK,MAAM,GAAG,IAAI,aAAa,CAAC,gBAAgB,CAAC,EAAE,CAAC;QAChD,MAAM,YAAY,GAAG,GAAG,CAAC,YAAY,IAAI,EAAE,CAAC;QAC5C,MAAM,IAAI,GAAG,gBAAgB,CAAC,YAAY,CAAC,CAAC;QAE5C,mEAAmE;QACnE,oEAAoE;QACpE,qEAAqE;QACrE,sEAAsE;QACtE,uDAAuD;QACvD,IAAI,GAAG,CAAC,OAAO,KAAK,UAAU,IAAI,OAAO,GAAG,CAAC,MAAM,EAAE,eAAe,KAAK,QAAQ,EAAE,CAAC;YAChF,MAAM,MAAM,GAAG,CAAC,GAAG,IAAI,EAAE,GAAG,CAAC,MAAM,CAAC,eAAe,CAAC,CAAC;YACrD,IAAI,SAAS,CAAC,MAAM,EAAE,MAAM,EAAE,IAAI,CAAC,EAAE,CAAC;gBAClC,gBAAgB,CAAC,GAAG,CAAC,aAAa,CAAC,MAAM,CAAC,CAAC,CAAC;gBAC5C,OAAO,GAAG,IAAI,CAAC;YACnB,CAAC;YACD,SAAS;QACb,CAAC;QAED,qEAAqE;QACrE,2BAA2B;QAC3B,IAAI,GAAG,CAAC,OAAO,KAAK,sBAAsB,IAAI,OAAO,GAAG,CAAC,MAAM,EAAE,kBAAkB,KAAK,QAAQ,EAAE,CAAC;YAC/F,IAAI,YAAY,CAAC,MAAM,EAAE,CAAC,GAAG,IAAI,EAAE,GAAG,CAAC,MAAM,CAAC,kBAAkB,CAAC,CAAC;gBAAE,OAAO,GAAG,IAAI,CAAC;YACnF,SAAS;QACb,CAAC;QAED,iEAAiE;QACjE,qEAAqE;QACrE,IAAI,IAAI,CAAC,MAAM,KAAK,CAAC;YAAE,OAAO,IAAI,CAAC;QAEnC,mEAAmE;QACnE,qEAAqE;QACrE,IAAI,gBAAgB,CAAC,GAAG,CAAC,YAAY,CAAC,EAAE,CAAC;YACrC,MAAM,GAAG,GAAG,cAAc,CAAC,GAAG,CAAC,CAAC;YAChC,IAAI,CAAC,GAAG,CAAC,EAAE,EAAE,CAAC;gBACV,2DAA2D;gBAC3D,6DAA6D;gBAC7D,OAAO,IAAI,CAAC;YAChB,CAAC;YACD,IAAI,SAAS,CAAC,MAAM,EAAE,IAAI,EAAE,GAAG,CAAC,KAAK,CAAC;gBAAE,OAAO,GAAG,IAAI,CAAC;YACvD,SAAS;QACb,CAAC;QAED,+DAA+D;QAC/D,mEAAmE;QACnE,wBAAwB;QACxB,IAAI,YAAY,CAAC,MAAM,EAAE,IAAI,CAAC;YAAE,OAAO,GAAG,IAAI,CAAC;IACnD,CAAC;IAED,wEAAwE;IACxE,uEAAuE;IACvE,6DAA6D;IAC7D,OAAO,OAAO,CAAC,CAAC,CAAC,MAAM,CAAC,CAAC,CAAC,IAAI,CAAC;AACnC,CAAC;AAED,0EAA0E;AAC1E,uEAAuE;AACvE,2EAA2E;AAC3E,iCAAiC;AACjC,SAAS,aAAa,CAAC,gBAAmC;IACtD,OAAO,gBAAgB;SAClB,GAAG,CAAC,CAAC,GAAG,EAAE,EAAE,CAAC,CAAC,EAAE,GAAG,EAAE,IAAI,EAAE,gBAAgB,CAAC,GAAG,CAAC,YAAY,IAAI,EAAE,CAAC,EAAE,CAAC,CAAC;SACvE,IAAI,CAAC,CAAC,CAAC,EAAE,CAAC,EAAE,EAAE,CAAC,YAAY,CAAC,CAAC,CAAC,IAAI,EAAE,CAAC,CAAC,IAAI,CAAC,CAAC;SAC5C,GAAG,CAAC,CAAC,KAAK,EAAE,EAAE,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC;AACnC,CAAC;AAED,SAAS,YAAY,CAAC,CAAW,EAAE,CAAW;IAC1C,KAAK,IAAI,CAAC,GAAG,CAAC,EAAE,CAAC,GAAG,IAAI,CAAC,GAAG,CAAC,CAAC,CAAC,MAAM,EAAE,CAAC,CAAC,MAAM,CAAC,EAAE,CAAC,EAAE,EAAE,CAAC;QACpD,IAAI,CAAC,CAAC,CAAC,CAAC,KAAK,CAAC,CAAC,CAAC,CAAC;YAAE,SAAS;QAC5B,MAAM,EAAE,GAAG,MAAM,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC;QACxB,MAAM,EAAE,GAAG,MAAM,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC;QACxB,+CAA+C;QAC/C,IAAI,MAAM,CAAC,SAAS,CAAC,EAAE,CAAC,IAAI,MAAM,CAAC,SAAS,CAAC,EAAE,CAAC;YAAE,OAAO,EAAE,GAAG,EAAE,CAAC;QACjE,OAAO,CAAC,CAAC,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC;IAChC,CAAC;IACD,sCAAsC;IACtC,OAAO,CAAC,CAAC,MAAM,GAAG,CAAC,CAAC,MAAM,CAAC;AAC/B,CAAC;AAED,uEAAuE;AACvE,2EAA2E;AAC3E,yBAAyB;AACzB,EAAE;AACF,+EAA+E;AAC/E,2EAA2E;AAC3E,8EAA8E;AAC9E,0EAA0E;AAC1E,2EAA2E;AAC3E,4EAA4E;AAC5E,4EAA4E;AAC5E,qEAAqE;AACrE,SAAS,cAAc,CAAC,GAAoB;IACxC,MAAM,MAAM,GAAG,GAAG,CAAC,MAAM,IAAI,EAAE,CAAC;IAChC,IAAI,GAAG,CAAC,OAAO,KAAK,MAAM;QAAE,OAAO,EAAE,EAAE,EAAE,KAAK,EAAE,CAAC;IAEjD,uEAAuE;IACvE,oEAAoE;IACpE,MAAM,KAAK,GAAG,KAAK,CAAC,OAAO,CAAC,MAAM,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC,MAAM,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC,MAAM,CAAC,IAAI,CAAC,CAAC;IAEvE,wEAAwE;IACxE,yEAAyE;IACzE,wCAAwC;IACxC,IAAI,KAAK,CAAC,MAAM,GAAG,CAAC,IAAI,KAAK,CAAC,QAAQ,CAAC,MAAM,CAAC,EAAE,CAAC;QAC7C,OAAO,EAAE,EAAE,EAAE,IAAI,EAAE,KAAK,EAAE,IAAI,EAAE,CAAC;IACrC,CAAC;IAED,wEAAwE;IACxE,yEAAyE;IACzE,gEAAgE;IAChE,KAAK,MAAM,CAAC,IAAI,KAAK,EAAE,CAAC;QACpB,QAAQ,CAAC,EAAE,CAAC;YACR,KAAK,MAAM;gBACP,OAAO,EAAE,EAAE,EAAE,IAAI,EAAE,KAAK,EAAE,IAAI,EAAE,CAAC;YACrC,KAAK,QAAQ;gBACT,OAAO,EAAE,EAAE,EAAE,IAAI,EAAE,KAAK,EAAE,EAAE,EAAE,CAAC;YACnC,KAAK,OAAO;gBACR,OAAO,EAAE,EAAE,EAAE,IAAI,EAAE,KAAK,EAAE,EAAE,EAAE,CAAC;YACnC,KAAK,QAAQ;gBACT,OAAO,EAAE,EAAE,EAAE,IAAI,EAAE,KAAK,EAAE,EAAE,EAAE,CAAC;YACnC;gBACI,MAAM;QACd,CAAC;IACL,CAAC;IACD,OAAO,EAAE,EAAE,EAAE,KAAK,EAAE,CAAC;AACzB,CAAC;AAED,yDAAyD;AACzD,oEAAoE;AACpE,SAAS,gBAAgB,CAAC,OAAe;IACrC,IAAI,CAAC,OAAO;QAAE,OAAO,EAAE,CAAC;IACxB,OAAO,OAAO;SACT,KAAK,CAAC,GAAG,CAAC;SACV,KAAK,CAAC,CAAC,CAAC;SACR,GAAG,CAAC,CAAC,GAAG,EAAE,EAAE,CAAC,GAAG,CAAC,OAAO,CAAC,KAAK,EAAE,GAAG,CAAC,CAAC,OAAO,CAAC,KAAK,EAAE,GAAG,CAAC,CAAC,CAAC;AACnE,CAAC;AAED,6EAA6E;AAC7E,qEAAqE;AACrE,SAAS,aAAa,CAAC,IAAc;IACjC,OAAO,IAAI,CAAC,GAAG,CAAC,CAAC,GAAG,EAAE,EAAE,CAAC,IAAI,wBAAwB,CAAC,GAAG,CAAC,EAAE,CAAC,CAAC,IAAI,CAAC,EAAE,CAAC,CAAC;AAC3E,CAAC;AAED,SAAS,wBAAwB,CAAC,OAAe;IAC7C,OAAO,OAAO,CAAC,OAAO,CAAC,IAAI,EAAE,IAAI,CAAC,CAAC,OAAO,CAAC,KAAK,EAAE,IAAI,CAAC,CAAC;AAC5D,CAAC;AAED,0EAA0E;AAC1E,sEAAsE;AACtE,uDAAuD;AACvD,SAAS,YAAY,CAAC,GAAY,EAAE,IAAc;IAC9C,IAAI,IAAI,CAAC,MAAM,KAAK,CAAC;QAAE,OAAO,KAAK,CAAC;IACpC,8DAA8D;IAC9D,IAAI,MAAM,GAAQ,GAAG,CAAC;IACtB,KAAK,IAAI,CAAC,GAAG,CAAC,EAAE,CAAC,GAAG,IAAI,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC,EAAE,EAAE,CAAC;QACvC,MAAM,GAAG,GAAG,IAAI,CAAC,CAAC,CAAC,CAAC;QACpB,IAAI,MAAM,IAAI,IAAI,IAAI,OAAO,MAAM,KAAK,QAAQ;YAAE,OAAO,KAAK,CAAC;QAC/D,MAAM,GAAG,KAAK,CAAC,OAAO,CAAC,MAAM,CAAC,CAAC,CAAC,CAAC,MAAM,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC;IACvE,CAAC;IACD,IAAI,MAAM,IAAI,IAAI,IAAI,OAAO,MAAM,KAAK,QAAQ;QAAE,OAAO,KAAK,CAAC;IAC/D,MAAM,IAAI,GAAG,IAAI,CAAC,IAAI,CAAC,MAAM,GAAG,CAAC,CAAC,CAAC;IACnC,IAAI,KAAK,CAAC,OAAO,CAAC,MAAM,CAAC,EAAE,CAAC;QACxB,MAAM,GAAG,GAAG,MAAM,CAAC,IAAI,CAAC,CAAC;QACzB,IAAI,CAAC,MAAM,CAAC,SAAS,CAAC,GAAG,CAAC,IAAI,GAAG,GAAG,CAAC,IAAI,GAAG,IAAI,MAAM,CAAC,MAAM;YAAE,OAAO,KAAK,CAAC;QAC5E,MAAM,CAAC,MAAM,CAAC,GAAG,EAAE,CAAC,CAAC,CAAC;QACtB,OAAO,IAAI,CAAC;IAChB,CAAC;IACD,IAAI,MAAM,CAAC,SAAS,CAAC,cAAc,CAAC,IAAI,CAAC,MAAM,EAAE,IAAI,CAAC,EAAE,CAAC;QACrD,OAAO,MAAM,CAAC,IAAI,CAAC,CAAC;QACpB,OAAO,IAAI,CAAC;IAChB,CAAC;IACD,OAAO,KAAK,CAAC;AACjB,CAAC;AAED,4EAA4E;AAC5E,6EAA6E;AAC7E,qCAAqC;AACrC,SAAS,SAAS,CAAC,GAAY,EAAE,IAAc,EAAE,KAAc;IAC3D,IAAI,IAAI,CAAC,MAAM,KAAK,CAAC;QAAE,OAAO,KAAK,CAAC;IACpC,8DAA8D;IAC9D,IAAI,MAAM,GAAQ,GAAG,CAAC;IACtB,KAAK,IAAI,CAAC,GAAG,CAAC,EAAE,CAAC,GAAG,IAAI,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC,EAAE,EAAE,CAAC;QACvC,MAAM,GAAG,GAAG,IAAI,CAAC,CAAC,CAAC,CAAC;QACpB,IAAI,MAAM,IAAI,IAAI,IAAI,OAAO,MAAM,KAAK,QAAQ;YAAE,OAAO,KAAK,CAAC;QAC/D,MAAM,GAAG,KAAK,CAAC,OAAO,CAAC,MAAM,CAAC,CAAC,CAAC,CAAC,MAAM,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC;IACvE,CAAC;IACD,IAAI,MAAM,IAAI,IAAI,IAAI,OAAO,MAAM,KAAK,QAAQ;QAAE,OAAO,KAAK,CAAC;IAC/D,MAAM,IAAI,GAAG,IAAI,CAAC,IAAI,CAAC,MAAM,GAAG,CAAC,CAAC,CAAC;IACnC,IAAI,KAAK,CAAC,OAAO,CAAC,MAAM,CAAC,EAAE,CAAC;QACxB,MAAM,GAAG,GAAG,MAAM,CAAC,IAAI,CAAC,CAAC;QACzB,IAAI,CAAC,MAAM,CAAC,SAAS,CAAC,GAAG,CAAC,IAAI,GAAG,GAAG,CAAC;YAAE,OAAO,KAAK,CAAC;QACpD,MAAM,CAAC,GAAG,CAAC,GAAG,KAAK,CAAC;QACpB,OAAO,IAAI,CAAC;IAChB,CAAC;IACD,MAAM,CAAC,IAAI,CAAC,GAAG,KAAK,CAAC;IACrB,OAAO,IAAI,CAAC;AAChB,CAAC"}

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@apify/actor-utils",
-  "version": "0.1.3-beta.0",
+  "version": "0.1.3-beta.2",
   "type": "module",
   "description": "Wrapper around Actor.pushData that survives dataset schema-validation failures by stripping offending fields and retrying. Callers pass the actual push function as pushFn.",
   "repository": {

package/dist/src/safePushData.d.ts.map

@@ -1 +0,0 @@
-{"version":3,"file":"safePushData.d.ts","sourceRoot":"","sources":["../../src/safePushData.ts"],"names":[],"mappings":"AAWA,QAAA,MAAM,iBAAiB,4BAA4B,CAAC;AAKpD,MAAM,WAAW,eAAe;IAC5B,YAAY,EAAE,MAAM,CAAC;IACrB,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,OAAO,EAAE,MAAM,CAAC;IAChB,MAAM,CAAC,EAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,CAAC;IACjC,OAAO,CAAC,EAAE,MAAM,CAAC;CACpB;AAED,UAAU,WAAW;IACjB,YAAY,EAAE,MAAM,CAAC;IACrB,gBAAgB,EAAE,eAAe,EAAE,CAAC;CACvC;AAKD,UAAU,qBAAqB;IAC3B,IAAI,EAAE,OAAO,iBAAiB,CAAC;IAC/B,UAAU,EAAE,GAAG,CAAC;IAChB,OAAO,EAAE,MAAM,CAAC;IAChB,IAAI,EAAE;QAAE,YAAY,EAAE,WAAW,EAAE,CAAA;KAAE,CAAC;CACzC;AAED,wBAAgB,uBAAuB,CAAC,GAAG,EAAE,OAAO,GAAG,GAAG,IAAI,qBAAqB,CAMlF;AAED,MAAM,WAAW,WAAW,CAAC,CAAC;IAC1B,IAAI,EAAE,CAAC,CAAC;IACR,MAAM,EAAE,eAAe,EAAE,CAAC;CAC7B;AAED,MAAM,WAAW,kBAAkB,CAAC,CAAC;IACjC,MAAM,EAAE,MAAM,CAAC;IACf,OAAO,EAAE,WAAW,CAAC,CAAC,CAAC,EAAE,CAAC;IAC1B,QAAQ,EAAE,MAAM,CAAC;CACpB;AAED,MAAM,WAAW,mBAAmB;IAChC,WAAW,CAAC,EAAE,MAAM,CAAC;CACxB;AAED,MAAM,MAAM,MAAM,CAAC,CAAC,IAAI,CAAC,KAAK,EAAE,CAAC,EAAE,KAAK,OAAO,CAAC,OAAO,CAAC,CAAC;AAEzD;;;;;;;;GAQG;AACH,wBAAsB,YAAY,CAAC,CAAC,EAChC,MAAM,EAAE,MAAM,CAAC,CAAC,CAAC,EACjB,KAAK,EAAE,CAAC,GAAG,CAAC,EAAE,EACd,OAAO,GAAE,mBAAwB,GAClC,OAAO,CAAC,kBAAkB,CAAC,CAAC,CAAC,CAAC,CAehC"}

package/dist/src/safePushData.js

@@ -1,285 +0,0 @@
-// safePushData: parse the Apify dataset schema-validation error, repair the
-// offending items (strip bad fields, placeholder missing required ones), and
-// retry the push.
-//
-// NOTE: instead of recursively healing the data one error-round at a time, we
-// could parse the Actor's `dataset_schema.json` up front and fix every item in
-// a single pass (we'd know each field's expected type / constraints without
-// waiting for the API to report them). That would avoid the multi-round retry
-// loop, but requires heavier code (locating + loading the schema, resolving
-// $refs, walking the schema tree). Something to consider in the future.
-const SCHEMA_ERROR_TYPE = 'schema-validation-error';
-export function isSchemaValidationError(err) {
-    if (!err || typeof err !== 'object')
-        return false;
-    const e = err;
-    if (e.type !== SCHEMA_ERROR_TYPE)
-        return false;
-    if (e.statusCode !== 400)
-        return false;
-    return Array.isArray(e.data?.invalidItems);
-}
-/**
- * Push `input` via `pushFn`, surviving Apify dataset schema-validation
- * failures by cleaning offending items and retrying.
- *
- * `pushFn` is mandatory and intentionally not bundled — a CI check forbids
- * direct `.pushData()` calls in this library, so the binding lives at the
- * call site: `(b) => Actor.pushData(b)` or
- * `(b) => client.dataset(id).pushItems(b)`.
- */
-export async function safePushData(pushFn, input, options = {}) {
-    const items = Array.isArray(input) ? input : [input];
-    // Happy path: assume validation will succeed (the overwhelmingly common
-    // case). No working copies, no maps, no per-item wrapper objects — just
-    // hand the caller's array to pushFn and return on success.
-    try {
-        await pushFn(items);
-        return { pushed: items.length, dropped: [], attempts: 1 };
-    }
-    catch (err) {
-        if (!isSchemaValidationError(err))
-            throw err;
-        // Clamp to >=1: the initial push above always counts as one attempt,
-        // so 0/negative would make the reported `attempts` lie about it.
-        return cleanAndRetry(pushFn, items, err, Math.max(1, options.maxAttempts ?? 5));
-    }
-}
-async function cleanAndRetry(pushFn, originalItems, initialError, maxAttempts) {
-    // working[i] is what we'll send on the next push. We mutate this array
-    // in place (splicing drops, replacing cleaned entries); the caller's
-    // `originalItems` is never touched.
-    const working = originalItems.slice();
-    // Parallel to `working`. Holds the original (untouched) reference so a
-    // dropped report shows what the caller actually passed in, even if the
-    // item was partially cleaned before being dropped on a later round.
-    const originalAt = originalItems.slice();
-    // Parallel to `working`. Tracks which paths inside each item are
-    // placeholders we set (vs. real user data). Needed so we can chase
-    // follow-up type/minLength/enum errors on the placeholder field
-    // without looping forever; for user-supplied fields the existing
-    // "delete the field" behaviour stays in effect.
-    const placeholderPaths = originalItems.map(() => new Set());
-    // Parallel to `working`. The validation errors that were last reported
-    // for this position — kept so a give-up drop (maxAttempts exceeded) can
-    // still report *why*, not just that it gave up.
-    const lastErrorsAt = originalItems.map(() => []);
-    const dropped = [];
-    let attempts = 1;
-    let lastError = initialError;
-    while (true) {
-        // Process this round's errors. Highest position first so the splices
-        // below don't shift positions we still need to look at.
-        const invalids = lastError.data.invalidItems.slice().sort((a, b) => b.itemPosition - a.itemPosition);
-        for (const invalid of invalids) {
-            const i = invalid.itemPosition;
-            // Guard against a malformed/unexpected error payload (e.g. a
-            // position outside the batch we actually sent) instead of
-            // crashing on `working[i]` being undefined.
-            if (i < 0 || i >= working.length) {
-                console.log(`safePushData: ignoring out-of-range itemPosition ${i} in validation error response.`);
-                continue;
-            }
-            const cleaned = cleanItemFields(working[i], invalid.validationErrors, placeholderPaths[i]);
-            if (cleaned === null) {
-                dropped.push({ item: originalAt[i], errors: invalid.validationErrors });
-                working.splice(i, 1);
-                originalAt.splice(i, 1);
-                placeholderPaths.splice(i, 1);
-                lastErrorsAt.splice(i, 1);
-            }
-            else {
-                working[i] = cleaned;
-                lastErrorsAt[i] = invalid.validationErrors;
-            }
-        }
-        console.log(`safePushData: schema validation failed on attempt ${attempts}: ` +
-            `${lastError.data.invalidItems.length} invalid item(s); ` +
-            `retrying with ${working.length} item(s).`);
-        if (working.length === 0) {
-            return { pushed: originalItems.length - dropped.length, dropped, attempts };
-        }
-        attempts++;
-        if (attempts > maxAttempts) {
-            console.log(`safePushData: gave up after ${maxAttempts} attempts with ${working.length} item(s) still failing.`);
-            for (let i = 0; i < working.length; i++) {
-                dropped.push({ item: originalAt[i], errors: lastErrorsAt[i] });
-            }
-            return { pushed: originalItems.length - dropped.length, dropped, attempts: maxAttempts };
-        }
-        try {
-            await pushFn(working);
-            return { pushed: originalItems.length - dropped.length, dropped, attempts };
-        }
-        catch (err) {
-            if (!isSchemaValidationError(err))
-                throw err;
-            lastError = err;
-        }
-    }
-}
-// Try to repair a single item given its AJV errors. Returns null when the
-// item can't be salvaged.
-//
-// Mutates `placeholderPaths` to record any fields we filled in ourselves,
-// so the caller can keep iterating on them across rounds.
-function cleanItemFields(item, validationErrors, placeholderPaths) {
-    // structuredClone so we never mutate the caller's data.
-    const cloned = structuredClone(item);
-    for (const err of validationErrors) {
-        const instancePath = err.instancePath || '';
-        const path = parseJsonPointer(instancePath);
-        // Root-level errors describe the item as a whole.
-        if (path.length === 0) {
-            // Missing required field: insert a placeholder and remember we
-            // did so. The next round will see a `type` error on this path
-            // and we'll upgrade null to a type-appropriate value.
-            if (err.keyword === 'required' && typeof err.params?.missingProperty === 'string') {
-                const prop = err.params.missingProperty;
-                cloned[prop] = null;
-                placeholderPaths.add(`/${prop}`);
-                continue;
-            }
-            // Strip an unknown property reported at the root.
-            if (err.keyword === 'additionalProperties' && typeof err.params?.additionalProperty === 'string') {
-                delete cloned[err.params.additionalProperty];
-                continue;
-            }
-            // type/format/etc. at the root means the item itself is the wrong shape.
-            return null;
-        }
-        // Errors on a path we placeholder'd: try to satisfy the constraint
-        // rather than delete the field (deleting would re-trigger required).
-        if (placeholderPaths.has(instancePath)) {
-            const fix = placeholderFor(err);
-            if (fix.ok) {
-                setAtPath(cloned, path, fix.value);
-                continue;
-            }
-            // Constraint we don't know how to satisfy on a placeholder field
-            // (e.g. pattern, custom format). Give up on this item.
-            return null;
-        }
-        // additionalProperties errors point at the *parent* object; the
-        // offending key is in params, not in instancePath.
-        if (err.keyword === 'additionalProperties' && typeof err.params?.additionalProperty === 'string') {
-            deleteAtPath(cloned, [...path, err.params.additionalProperty]);
-            continue;
-        }
-        // User-supplied field with a violation we don't try to coerce.
-        // Strip it; if the schema declares it required, the next push will
-        // re-add a placeholder.
-        deleteAtPath(cloned, path);
-    }
-    return cloned;
-}
-// Pick a value that will satisfy `err.keyword` on a placeholder field.
-// Returns ok:false when we don't have a sensible default; the caller drops
-// the item in that case.
-//
-// We deliberately only placeholder the four "empty" values — `''`, `[]`, `{}`,
-// and `null`. These are unambiguously empty and can't be mistaken for real
-// data. We do NOT fabricate values for `enum`, `format`, `minLength`, numeric
-// bounds, etc.: a made-up email, a first-enum-value, or a `'_'.repeat(N)`
-// string all silently poison the customer's dataset with plausible-looking
-// junk. Better to drop the item than to lie about its contents. As a result
-// the only keyword we handle is `type` (only for those four target types) —
-// everything else falls through to ok:false and the item is dropped.
-function placeholderFor(err) {
-    const params = err.params ?? {};
-    if (err.keyword !== 'type')
-        return { ok: false };
-    // params.type is the expected type as a string, or an array of strings
-    // when the field allows multiple types (e.g. `['string', 'null']`).
-    const types = Array.isArray(params.type) ? params.type : [params.type];
-    // Union type that permits null: prefer null. It's the cleanest possible
-    // placeholder — it commits to no concrete value at all — so whenever the
-    // schema allows it, that's what we use.
-    if (types.length > 1 && types.includes('null')) {
-        return { ok: true, value: null };
-    }
-    // Otherwise take the first allowed type we have an "empty" default for.
-    // integer / number / boolean are intentionally absent: 0 / false read as
-    // real data, so a field of only those types is dropped instead.
-    for (const t of types) {
-        switch (t) {
-            case 'null':
-                return { ok: true, value: null };
-            case 'string':
-                return { ok: true, value: '' };
-            case 'array':
-                return { ok: true, value: [] };
-            case 'object':
-                return { ok: true, value: {} };
-            default:
-                break;
-        }
-    }
-    return { ok: false };
-}
-// Parse a JSON Pointer (RFC 6901) into decoded segments.
-// "" -> []; "/foo/bar" -> ["foo","bar"]; "/tags/0" -> ["tags","0"].
-function parseJsonPointer(pointer) {
-    if (!pointer)
-        return [];
-    return pointer
-        .split('/')
-        .slice(1)
-        .map((seg) => seg.replace(/~1/g, '/').replace(/~0/g, '~'));
-}
-// Delete the value at `path` inside `obj`. Arrays splice (so later
-// `/tags/N` errors in the same round line up with their original indices).
-function deleteAtPath(obj, path) {
-    if (path.length === 0)
-        return false;
-    // eslint-disable-next-line @typescript-eslint/no-explicit-any
-    let cursor = obj;
-    for (let i = 0; i < path.length - 1; i++) {
-        const key = path[i];
-        if (cursor == null || typeof cursor !== 'object')
-            return false;
-        cursor = Array.isArray(cursor) ? cursor[Number(key)] : cursor[key];
-    }
-    if (cursor == null || typeof cursor !== 'object')
-        return false;
-    const last = path[path.length - 1];
-    if (Array.isArray(cursor)) {
-        const idx = Number(last);
-        if (!Number.isInteger(idx) || idx < 0 || idx >= cursor.length)
-            return false;
-        cursor.splice(idx, 1);
-        return true;
-    }
-    if (Object.prototype.hasOwnProperty.call(cursor, last)) {
-        delete cursor[last];
-        return true;
-    }
-    return false;
-}
-// Set the value at `path` inside `obj`. Creates nothing — the path must
-// already exist (placeholder fields are created at the root, not nested).
-function setAtPath(obj, path, value) {
-    if (path.length === 0)
-        return false;
-    // eslint-disable-next-line @typescript-eslint/no-explicit-any
-    let cursor = obj;
-    for (let i = 0; i < path.length - 1; i++) {
-        const key = path[i];
-        if (cursor == null || typeof cursor !== 'object')
-            return false;
-        cursor = Array.isArray(cursor) ? cursor[Number(key)] : cursor[key];
-    }
-    if (cursor == null || typeof cursor !== 'object')
-        return false;
-    const last = path[path.length - 1];
-    if (Array.isArray(cursor)) {
-        const idx = Number(last);
-        if (!Number.isInteger(idx) || idx < 0)
-            return false;
-        cursor[idx] = value;
-        return true;
-    }
-    cursor[last] = value;
-    return true;
-}
-//# sourceMappingURL=safePushData.js.map

package/dist/src/safePushData.js.map

@@ -1 +0,0 @@
-{"version":3,"file":"safePushData.js","sourceRoot":"","sources":["../../src/safePushData.ts"],"names":[],"mappings":"AAAA,4EAA4E;AAC5E,6EAA6E;AAC7E,kBAAkB;AAClB,EAAE;AACF,8EAA8E;AAC9E,+EAA+E;AAC/E,4EAA4E;AAC5E,8EAA8E;AAC9E,4EAA4E;AAC5E,wEAAwE;AAExE,MAAM,iBAAiB,GAAG,yBAAyB,CAAC;AA4BpD,MAAM,UAAU,uBAAuB,CAAC,GAAY;IAChD,IAAI,CAAC,GAAG,IAAI,OAAO,GAAG,KAAK,QAAQ;QAAE,OAAO,KAAK,CAAC;IAClD,MAAM,CAAC,GAAG,GAAqC,CAAC;IAChD,IAAI,CAAC,CAAC,IAAI,KAAK,iBAAiB;QAAE,OAAO,KAAK,CAAC;IAC/C,IAAI,CAAC,CAAC,UAAU,KAAK,GAAG;QAAE,OAAO,KAAK,CAAC;IACvC,OAAO,KAAK,CAAC,OAAO,CAAC,CAAC,CAAC,IAAI,EAAE,YAAY,CAAC,CAAC;AAC/C,CAAC;AAmBD;;;;;;;;GAQG;AACH,MAAM,CAAC,KAAK,UAAU,YAAY,CAC9B,MAAiB,EACjB,KAAc,EACd,UAA+B,EAAE;IAEjC,MAAM,KAAK,GAAG,KAAK,CAAC,OAAO,CAAC,KAAK,CAAC,CAAC,CAAC,CAAC,KAAK,CAAC,CAAC,CAAC,CAAC,KAAK,CAAC,CAAC;IAErD,wEAAwE;IACxE,wEAAwE;IACxE,2DAA2D;IAC3D,IAAI,CAAC;QACD,MAAM,MAAM,CAAC,KAAK,CAAC,CAAC;QACpB,OAAO,EAAE,MAAM,EAAE,KAAK,CAAC,MAAM,EAAE,OAAO,EAAE,EAAE,EAAE,QAAQ,EAAE,CAAC,EAAE,CAAC;IAC9D,CAAC;IAAC,OAAO,GAAG,EAAE,CAAC;QACX,IAAI,CAAC,uBAAuB,CAAC,GAAG,CAAC;YAAE,MAAM,GAAG,CAAC;QAC7C,qEAAqE;QACrE,iEAAiE;QACjE,OAAO,aAAa,CAAC,MAAM,EAAE,KAAK,EAAE,GAAG,EAAE,IAAI,CAAC,GAAG,CAAC,CAAC,EAAE,OAAO,CAAC,WAAW,IAAI,CAAC,CAAC,CAAC,CAAC;IACpF,CAAC;AACL,CAAC;AAED,KAAK,UAAU,aAAa,CACxB,MAAiB,EACjB,aAA2B,EAC3B,YAAmC,EACnC,WAAmB;IAEnB,uEAAuE;IACvE,qEAAqE;IACrE,oCAAoC;IACpC,MAAM,OAAO,GAAQ,aAAa,CAAC,KAAK,EAAE,CAAC;IAC3C,uEAAuE;IACvE,uEAAuE;IACvE,oEAAoE;IACpE,MAAM,UAAU,GAAQ,aAAa,CAAC,KAAK,EAAE,CAAC;IAC9C,iEAAiE;IACjE,mEAAmE;IACnE,gEAAgE;IAChE,iEAAiE;IACjE,gDAAgD;IAChD,MAAM,gBAAgB,GAAkB,aAAa,CAAC,GAAG,CAAC,GAAG,EAAE,CAAC,IAAI,GAAG,EAAU,CAAC,CAAC;IACnF,uEAAuE;IACvE,wEAAwE;IACxE,gDAAgD;IAChD,MAAM,YAAY,GAAwB,aAAa,CAAC,GAAG,CAAC,GAAG,EAAE,CAAC,EAAE,CAAC,CAAC;IACtE,MAAM,OAAO,GAAqB,EAAE,CAAC;IACrC,IAAI,QAAQ,GAAG,CAAC,CAAC;IACjB,IAAI,SAAS,GAA0B,YAAY,CAAC;IAEpD,OAAO,IAAI,EAAE,CAAC;QACV,qEAAqE;QACrE,wDAAwD;QACxD,MAAM,QAAQ,GAAG,SAAS,CAAC,IAAI,CAAC,YAAY,CAAC,KAAK,EAAE,CAAC,IAAI,CAAC,CAAC,CAAC,EAAE,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,YAAY,GAAG,CAAC,CAAC,YAAY,CAAC,CAAC;QAErG,KAAK,MAAM,OAAO,IAAI,QAAQ,EAAE,CAAC;YAC7B,MAAM,CAAC,GAAG,OAAO,CAAC,YAAY,CAAC;YAC/B,6DAA6D;YAC7D,0DAA0D;YAC1D,4CAA4C;YAC5C,IAAI,CAAC,GAAG,CAAC,IAAI,CAAC,IAAI,OAAO,CAAC,MAAM,EAAE,CAAC;gBAC/B,OAAO,CAAC,GAAG,CAAC,oDAAoD,CAAC,gCAAgC,CAAC,CAAC;gBACnG,SAAS;YACb,CAAC;YACD,MAAM,OAAO,GAAG,eAAe,CAAC,OAAO,CAAC,CAAC,CAAC,EAAE,OAAO,CAAC,gBAAgB,EAAE,gBAAgB,CAAC,CAAC,CAAC,CAAC,CAAC;YAC3F,IAAI,OAAO,KAAK,IAAI,EAAE,CAAC;gBACnB,OAAO,CAAC,IAAI,CAAC,EAAE,IAAI,EAAE,UAAU,CAAC,CAAC,CAAC,EAAE,MAAM,EAAE,OAAO,CAAC,gBAAgB,EAAE,CAAC,CAAC;gBACxE,OAAO,CAAC,MAAM,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC;gBACrB,UAAU,CAAC,MAAM,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC;gBACxB,gBAAgB,CAAC,MAAM,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC;gBAC9B,YAAY,CAAC,MAAM,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC;YAC9B,CAAC;iBAAM,CAAC;gBACJ,OAAO,CAAC,CAAC,CAAC,GAAG,OAAO,CAAC;gBACrB,YAAY,CAAC,CAAC,CAAC,GAAG,OAAO,CAAC,gBAAgB,CAAC;YAC/C,CAAC;QACL,CAAC;QAED,OAAO,CAAC,GAAG,CACP,qDAAqD,QAAQ,IAAI;YAC7D,GAAG,SAAS,CAAC,IAAI,CAAC,YAAY,CAAC,MAAM,oBAAoB;YACzD,iBAAiB,OAAO,CAAC,MAAM,WAAW,CACjD,CAAC;QAEF,IAAI,OAAO,CAAC,MAAM,KAAK,CAAC,EAAE,CAAC;YACvB,OAAO,EAAE,MAAM,EAAE,aAAa,CAAC,MAAM,GAAG,OAAO,CAAC,MAAM,EAAE,OAAO,EAAE,QAAQ,EAAE,CAAC;QAChF,CAAC;QAED,QAAQ,EAAE,CAAC;QACX,IAAI,QAAQ,GAAG,WAAW,EAAE,CAAC;YACzB,OAAO,CAAC,GAAG,CACP,+BAA+B,WAAW,kBAAkB,OAAO,CAAC,MAAM,yBAAyB,CACtG,CAAC;YACF,KAAK,IAAI,CAAC,GAAG,CAAC,EAAE,CAAC,GAAG,OAAO,CAAC,MAAM,EAAE,CAAC,EAAE,EAAE,CAAC;gBACtC,OAAO,CAAC,IAAI,CAAC,EAAE,IAAI,EAAE,UAAU,CAAC,CAAC,CAAC,EAAE,MAAM,EAAE,YAAY,CAAC,CAAC,CAAC,EAAE,CAAC,CAAC;YACnE,CAAC;YACD,OAAO,EAAE,MAAM,EAAE,aAAa,CAAC,MAAM,GAAG,OAAO,CAAC,MAAM,EAAE,OAAO,EAAE,QAAQ,EAAE,WAAW,EAAE,CAAC;QAC7F,CAAC;QAED,IAAI,CAAC;YACD,MAAM,MAAM,CAAC,OAAO,CAAC,CAAC;YACtB,OAAO,EAAE,MAAM,EAAE,aAAa,CAAC,MAAM,GAAG,OAAO,CAAC,MAAM,EAAE,OAAO,EAAE,QAAQ,EAAE,CAAC;QAChF,CAAC;QAAC,OAAO,GAAG,EAAE,CAAC;YACX,IAAI,CAAC,uBAAuB,CAAC,GAAG,CAAC;gBAAE,MAAM,GAAG,CAAC;YAC7C,SAAS,GAAG,GAAG,CAAC;QACpB,CAAC;IACL,CAAC;AACL,CAAC;AAED,0EAA0E;AAC1E,0BAA0B;AAC1B,EAAE;AACF,0EAA0E;AAC1E,0DAA0D;AAC1D,SAAS,eAAe,CAAI,IAAO,EAAE,gBAAmC,EAAE,gBAA6B;IACnG,wDAAwD;IACxD,MAAM,MAAM,GAAG,eAAe,CAAC,IAAI,CAAM,CAAC;IAE1C,KAAK,MAAM,GAAG,IAAI,gBAAgB,EAAE,CAAC;QACjC,MAAM,YAAY,GAAG,GAAG,CAAC,YAAY,IAAI,EAAE,CAAC;QAC5C,MAAM,IAAI,GAAG,gBAAgB,CAAC,YAAY,CAAC,CAAC;QAE5C,kDAAkD;QAClD,IAAI,IAAI,CAAC,MAAM,KAAK,CAAC,EAAE,CAAC;YACpB,+DAA+D;YAC/D,8DAA8D;YAC9D,sDAAsD;YACtD,IAAI,GAAG,CAAC,OAAO,KAAK,UAAU,IAAI,OAAO,GAAG,CAAC,MAAM,EAAE,eAAe,KAAK,QAAQ,EAAE,CAAC;gBAChF,MAAM,IAAI,GAAG,GAAG,CAAC,MAAM,CAAC,eAAe,CAAC;gBACvC,MAAkC,CAAC,IAAI,CAAC,GAAG,IAAI,CAAC;gBACjD,gBAAgB,CAAC,GAAG,CAAC,IAAI,IAAI,EAAE,CAAC,CAAC;gBACjC,SAAS;YACb,CAAC;YACD,kDAAkD;YAClD,IAAI,GAAG,CAAC,OAAO,KAAK,sBAAsB,IAAI,OAAO,GAAG,CAAC,MAAM,EAAE,kBAAkB,KAAK,QAAQ,EAAE,CAAC;gBAC/F,OAAQ,MAAkC,CAAC,GAAG,CAAC,MAAM,CAAC,kBAAkB,CAAC,CAAC;gBAC1E,SAAS;YACb,CAAC;YACD,yEAAyE;YACzE,OAAO,IAAI,CAAC;QAChB,CAAC;QAED,mEAAmE;QACnE,qEAAqE;QACrE,IAAI,gBAAgB,CAAC,GAAG,CAAC,YAAY,CAAC,EAAE,CAAC;YACrC,MAAM,GAAG,GAAG,cAAc,CAAC,GAAG,CAAC,CAAC;YAChC,IAAI,GAAG,CAAC,EAAE,EAAE,CAAC;gBACT,SAAS,CAAC,MAAM,EAAE,IAAI,EAAE,GAAG,CAAC,KAAK,CAAC,CAAC;gBACnC,SAAS;YACb,CAAC;YACD,iEAAiE;YACjE,uDAAuD;YACvD,OAAO,IAAI,CAAC;QAChB,CAAC;QAED,gEAAgE;QAChE,mDAAmD;QACnD,IAAI,GAAG,CAAC,OAAO,KAAK,sBAAsB,IAAI,OAAO,GAAG,CAAC,MAAM,EAAE,kBAAkB,KAAK,QAAQ,EAAE,CAAC;YAC/F,YAAY,CAAC,MAAM,EAAE,CAAC,GAAG,IAAI,EAAE,GAAG,CAAC,MAAM,CAAC,kBAAkB,CAAC,CAAC,CAAC;YAC/D,SAAS;QACb,CAAC;QAED,+DAA+D;QAC/D,mEAAmE;QACnE,wBAAwB;QACxB,YAAY,CAAC,MAAM,EAAE,IAAI,CAAC,CAAC;IAC/B,CAAC;IAED,OAAO,MAAM,CAAC;AAClB,CAAC;AAED,uEAAuE;AACvE,2EAA2E;AAC3E,yBAAyB;AACzB,EAAE;AACF,+EAA+E;AAC/E,2EAA2E;AAC3E,8EAA8E;AAC9E,0EAA0E;AAC1E,2EAA2E;AAC3E,4EAA4E;AAC5E,4EAA4E;AAC5E,qEAAqE;AACrE,SAAS,cAAc,CAAC,GAAoB;IACxC,MAAM,MAAM,GAAG,GAAG,CAAC,MAAM,IAAI,EAAE,CAAC;IAChC,IAAI,GAAG,CAAC,OAAO,KAAK,MAAM;QAAE,OAAO,EAAE,EAAE,EAAE,KAAK,EAAE,CAAC;IAEjD,uEAAuE;IACvE,oEAAoE;IACpE,MAAM,KAAK,GAAG,KAAK,CAAC,OAAO,CAAC,MAAM,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC,MAAM,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC,MAAM,CAAC,IAAI,CAAC,CAAC;IAEvE,wEAAwE;IACxE,yEAAyE;IACzE,wCAAwC;IACxC,IAAI,KAAK,CAAC,MAAM,GAAG,CAAC,IAAI,KAAK,CAAC,QAAQ,CAAC,MAAM,CAAC,EAAE,CAAC;QAC7C,OAAO,EAAE,EAAE,EAAE,IAAI,EAAE,KAAK,EAAE,IAAI,EAAE,CAAC;IACrC,CAAC;IAED,wEAAwE;IACxE,yEAAyE;IACzE,gEAAgE;IAChE,KAAK,MAAM,CAAC,IAAI,KAAK,EAAE,CAAC;QACpB,QAAQ,CAAC,EAAE,CAAC;YACR,KAAK,MAAM;gBACP,OAAO,EAAE,EAAE,EAAE,IAAI,EAAE,KAAK,EAAE,IAAI,EAAE,CAAC;YACrC,KAAK,QAAQ;gBACT,OAAO,EAAE,EAAE,EAAE,IAAI,EAAE,KAAK,EAAE,EAAE,EAAE,CAAC;YACnC,KAAK,OAAO;gBACR,OAAO,EAAE,EAAE,EAAE,IAAI,EAAE,KAAK,EAAE,EAAE,EAAE,CAAC;YACnC,KAAK,QAAQ;gBACT,OAAO,EAAE,EAAE,EAAE,IAAI,EAAE,KAAK,EAAE,EAAE,EAAE,CAAC;YACnC;gBACI,MAAM;QACd,CAAC;IACL,CAAC;IACD,OAAO,EAAE,EAAE,EAAE,KAAK,EAAE,CAAC;AACzB,CAAC;AAED,yDAAyD;AACzD,oEAAoE;AACpE,SAAS,gBAAgB,CAAC,OAAe;IACrC,IAAI,CAAC,OAAO;QAAE,OAAO,EAAE,CAAC;IACxB,OAAO,OAAO;SACT,KAAK,CAAC,GAAG,CAAC;SACV,KAAK,CAAC,CAAC,CAAC;SACR,GAAG,CAAC,CAAC,GAAG,EAAE,EAAE,CAAC,GAAG,CAAC,OAAO,CAAC,KAAK,EAAE,GAAG,CAAC,CAAC,OAAO,CAAC,KAAK,EAAE,GAAG,CAAC,CAAC,CAAC;AACnE,CAAC;AAED,mEAAmE;AACnE,2EAA2E;AAC3E,SAAS,YAAY,CAAC,GAAY,EAAE,IAAc;IAC9C,IAAI,IAAI,CAAC,MAAM,KAAK,CAAC;QAAE,OAAO,KAAK,CAAC;IACpC,8DAA8D;IAC9D,IAAI,MAAM,GAAQ,GAAG,CAAC;IACtB,KAAK,IAAI,CAAC,GAAG,CAAC,EAAE,CAAC,GAAG,IAAI,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC,EAAE,EAAE,CAAC;QACvC,MAAM,GAAG,GAAG,IAAI,CAAC,CAAC,CAAC,CAAC;QACpB,IAAI,MAAM,IAAI,IAAI,IAAI,OAAO,MAAM,KAAK,QAAQ;YAAE,OAAO,KAAK,CAAC;QAC/D,MAAM,GAAG,KAAK,CAAC,OAAO,CAAC,MAAM,CAAC,CAAC,CAAC,CAAC,MAAM,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC;IACvE,CAAC;IACD,IAAI,MAAM,IAAI,IAAI,IAAI,OAAO,MAAM,KAAK,QAAQ;QAAE,OAAO,KAAK,CAAC;IAC/D,MAAM,IAAI,GAAG,IAAI,CAAC,IAAI,CAAC,MAAM,GAAG,CAAC,CAAC,CAAC;IACnC,IAAI,KAAK,CAAC,OAAO,CAAC,MAAM,CAAC,EAAE,CAAC;QACxB,MAAM,GAAG,GAAG,MAAM,CAAC,IAAI,CAAC,CAAC;QACzB,IAAI,CAAC,MAAM,CAAC,SAAS,CAAC,GAAG,CAAC,IAAI,GAAG,GAAG,CAAC,IAAI,GAAG,IAAI,MAAM,CAAC,MAAM;YAAE,OAAO,KAAK,CAAC;QAC5E,MAAM,CAAC,MAAM,CAAC,GAAG,EAAE,CAAC,CAAC,CAAC;QACtB,OAAO,IAAI,CAAC;IAChB,CAAC;IACD,IAAI,MAAM,CAAC,SAAS,CAAC,cAAc,CAAC,IAAI,CAAC,MAAM,EAAE,IAAI,CAAC,EAAE,CAAC;QACrD,OAAO,MAAM,CAAC,IAAI,CAAC,CAAC;QACpB,OAAO,IAAI,CAAC;IAChB,CAAC;IACD,OAAO,KAAK,CAAC;AACjB,CAAC;AAED,wEAAwE;AACxE,0EAA0E;AAC1E,SAAS,SAAS,CAAC,GAAY,EAAE,IAAc,EAAE,KAAc;IAC3D,IAAI,IAAI,CAAC,MAAM,KAAK,CAAC;QAAE,OAAO,KAAK,CAAC;IACpC,8DAA8D;IAC9D,IAAI,MAAM,GAAQ,GAAG,CAAC;IACtB,KAAK,IAAI,CAAC,GAAG,CAAC,EAAE,CAAC,GAAG,IAAI,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC,EAAE,EAAE,CAAC;QACvC,MAAM,GAAG,GAAG,IAAI,CAAC,CAAC,CAAC,CAAC;QACpB,IAAI,MAAM,IAAI,IAAI,IAAI,OAAO,MAAM,KAAK,QAAQ;YAAE,OAAO,KAAK,CAAC;QAC/D,MAAM,GAAG,KAAK,CAAC,OAAO,CAAC,MAAM,CAAC,CAAC,CAAC,CAAC,MAAM,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC;IACvE,CAAC;IACD,IAAI,MAAM,IAAI,IAAI,IAAI,OAAO,MAAM,KAAK,QAAQ;QAAE,OAAO,KAAK,CAAC;IAC/D,MAAM,IAAI,GAAG,IAAI,CAAC,IAAI,CAAC,MAAM,GAAG,CAAC,CAAC,CAAC;IACnC,IAAI,KAAK,CAAC,OAAO,CAAC,MAAM,CAAC,EAAE,CAAC;QACxB,MAAM,GAAG,GAAG,MAAM,CAAC,IAAI,CAAC,CAAC;QACzB,IAAI,CAAC,MAAM,CAAC,SAAS,CAAC,GAAG,CAAC,IAAI,GAAG,GAAG,CAAC;YAAE,OAAO,KAAK,CAAC;QACpD,MAAM,CAAC,GAAG,CAAC,GAAG,KAAK,CAAC;QACpB,OAAO,IAAI,CAAC;IAChB,CAAC;IACD,MAAM,CAAC,IAAI,CAAC,GAAG,KAAK,CAAC;IACrB,OAAO,IAAI,CAAC;AAChB,CAAC"}