@bytebrand/export-cars 1.26.28 → 1.26.30

package/README.md

@@ -47,6 +47,106 @@ bq mk --table \
 
 Tables created before 1.26.28 need the two gate columns: `bq update <table> schema/feed-items.json`.
 
+## Clean images for ChatGPT Ads / OpenAI product feed (ADV-336)
+
+Library only. The OpenAI ExportType, transformer and version bump come with ADV-335.
+
+**Clean profile** (`ImageType.clean`, `ImagesService.getCleanImages`):
+- Uses only the car's own Imbo photos (the loader's cleaned list), ordered deterministically:
+  - the hero first: a 3/4 exterior, `ext_f_right`, else `ext_f_left`;
+  - then the other exterior views, then the interior views (`IMAGES_SORT_ORDER`).
+- Drops `_feat_` close-ups, `conext_*`, codes unknown to `IMAGES_SORT_ORDER` (e.g. `simple_*`, `middle_console`,
+  `ext_lr_main`) and repeated imageIdentifiers.
+- Returns `[]` when there is no 3/4 exterior shot: the car is skipped. A placeholder is never added.
+- Every URL is the explicit JPEG `https://images.auto.de/carimage/{carId}/{imageId}/large-cached.jpeg`. The
+  extension-less `.../large` returns WebP or JPEG depending on the `Accept` header (no `Vary`), so the format
+  a crawler gets could differ from the one we checked.
+- What the images host does to these photos (imbo `background` transform):
+  - plates are blurred;
+  - EXIF orientation is applied;
+  - images are not upscaled; the output is about 1000–1600 px wide, 4:3 for background-removed photos;
+  - no overlay or logo.
+
+  No sRGB conversion is done; source photos carry no ICC profile.
+- The Meta AIA financing images (`generated_images/.../meta-aia-financing-*`) are never used here. A rate or
+  financing overlay stays off.
+
+**URL check** (`ImageUrlValidator`, one instance per export run):
+- Sends HEAD, falling back to GET on 405/501, with a bounded number of parallel requests. Each URL is checked once per run.
+- A URL is valid only if:
+  - the final status is 200;
+  - the MIME type is `image/jpeg` or `image/png` (WebP only if a partner explicitly allows it);
+  - it is HTTPS;
+  - it has no credentials and is not a `noimage` placeholder;
+  - redirects stay within `maxRedirects`.
+- images.auto.de answers unknown, deleted or foreign-car images with **404 plus an image/jpeg body**, so the
+  Content-Type alone proves nothing.
+- `stats` returns per-reason counts for the run log: `http_status`, `wrong_mime`, `timeout`,
+  `too_many_redirects`, `placeholder`, `not_https`, `credentials_in_url`, `invalid_url`, `network_error`,
+  `budget_exhausted`.
+
+**OpenAI fields** (`transformers/openai-image-fields.ts`):
+- `image_url` = the first valid hero candidate.
+- `additional_image_urls` = all other valid images, exterior before interior, with no count limit (OpenAI states none).
+- No valid hero means `fields: null`: skip the car and count it.
+- Serialization:
+  - CSV: `serializeAdditionalImageUrlsForCsv` gives one quoted cell, URLs comma-separated, commas inside URLs as `%2C`.
+  - JSONL: `serializeAdditionalImageUrlsForJsonl` gives an array.
+- Do not mix these with the Google-compatible `image_link` / `additional_image_link`.
+- OpenAI states no pixel, ratio, byte or count limits for product images. None are enforced here, and none
+  may be added without the account's written requirements (GATE subtask).
+
+**Crawler access**
+- Images host `images.auto.de`:
+  - direct nginx, not behind Cloudflare, so no WAF;
+  - `robots.txt` returns 404, which means everything is allowed;
+  - OAI-SearchBot gets 200.
+- CDP `www.auto.de/search/vehicle/<id>`:
+  - `services/content-wordpress/wp/robots.txt` disallows `/search/` for `*`. OpenAI crawlers obey robots.txt,
+    so a dedicated `OAI-AdsBot` group allows `/search/vehicle/` and repeats the `*` Disallow rules (a bot with
+    its own group ignores `*`). Keep both groups in sync.
+  - OAI-SearchBot stays under `*`.
+  - Cloudflare: the custom rule "Allow Search Bots" (`cf.client.bot`, skip) runs before "captcha for search"
+    (js_challenge on `www.auto.de/search`). A CF-verified OAI-AdsBot should pass. Unverified clients outside
+    DACH get a 403 challenge. No CF rule change was made.
+
+**QA / runbook**
+- Unit and regression tests: `npm test`.
+  - `test/images-regression.test.ts` compares every existing image output (default, marketing, Google ext/int)
+    with `test/fixtures/images.golden.json`. That file was recorded before this change. Never regenerate it to
+    make the test pass.
+- Real-photo check: build the clean list from the public Imbo list
+  `https://www.auto.de/service/image-imbo/users/<carId>/images.json?fields[]=imageIdentifier&fields[]=metadata&metadata=1&limit=0`,
+  then run `ImageUrlValidator` with an OAI-SearchBot `userAgent`.
+- Crawler check: with an OAI-AdsBot UA, `curl https://www.auto.de/robots.txt` and the CDP. Run from a non-DACH
+  vantage and expect a challenge unless the IP is a verified OpenAI one.
+- Rollback:
+  - library: nothing uses `ImageType.clean` until ADV-335 wires it, so revert the commit;
+  - robots.txt: remove the `OAI-AdsBot` group and redeploy content-wordpress.
+
+**Known risks / open questions**
+- No revision marker in v1. An in-place Imbo `PUT` keeps the imageIdentifier, so the same URL can serve new
+  bytes from a stale cache. After a car is deleted, cached image URLs can keep answering 200 until the cache
+  expires. Mitigations:
+  - send a full catalog upload on every image or description change (ADV-335);
+  - re-validate on every run.
+- `ext_lr_main` (a real side or rear-3/4 exterior shot, present on most cars) is unknown to `IMAGES_SORT_ORDER`,
+  so the clean profile drops it.
+- The CDP is a client-side SPA with no SSR (fe-main nginx serves `index.html` for `/search*`). A crawler that
+  doesn't run JS sees an empty page, which is a risk for the OAI-AdsBot landing-page review.
+- Pre-existing: the `DEFAULT_IMAGES` placeholders (`carimage/noimage/...`) answer 404, yet default-type partner
+  feeds append them when a car has fewer than 17 photos. Separate ticket.
+- Marketing: open www to OAI-SearchBot (ChatGPT search indexing)? Not done, business decision.
+- No rights or licence flag exists in the Imbo metadata, so "missing rights" cannot be enforced from data.
+- Before go-live, the account's image requirements must be confirmed with OpenAI (GATE).
+
+## OpenAI Ads vehicle feed (`exportType=openai_ads`, ADV-335)
+
+OpenAI-format product CSV for ChatGPT Ads, built from the base export snapshot with the clean images above.
+Dry-run by default (`resources/openai_ads-dryrun/`), fail-closed (`services/feed-guard.ts`), sold/removed cars kept as
+`out_of_stock` via a ledger of sent ids. No transport yet. Mapping and open questions: `docs/openai-ads/AUDIT.md`;
+params, guard codes, monitoring and rollback: `docs/openai-ads/RUNBOOK.md`.
+
 ## Publication gate for estimated EnVKV values (EnVKV C8)
 
 car-basic-data fills missing or implausible consumption / CO2 values from the CO2 estimator, the

package/dist/configs/index.d.ts

@@ -20,3 +20,4 @@ export * from './mitula.config';
 export * from './awin.config';
 export * from './evium.config';
 export * from './santander.config';
+export * from './openai-ads.config';

package/dist/configs/index.js

@@ -36,4 +36,5 @@ __exportStar(require("./mitula.config"), exports);
 __exportStar(require("./awin.config"), exports);
 __exportStar(require("./evium.config"), exports);
 __exportStar(require("./santander.config"), exports);
+__exportStar(require("./openai-ads.config"), exports);
 //# sourceMappingURL=index.js.map

package/dist/configs/index.js.map

@@ -1 +1 @@
-{"version":3,"file":"index.js","sourceRoot":"","sources":["../../src/configs/index.ts"],"names":[],"mappings":";;;;;;;;;;;;;;;;AAAA,uDAAqC;AACrC,gDAA8B;AAC9B,kDAAgC;AAChC,qDAAmC;AACnC,oDAAkC;AAClC,kDAAgC;AAChC,sDAAoC;AACpC,iDAA+B;AAC/B,8CAA4B;AAC5B,kDAAgC;AAChC,6DAA2C;AAC3C,mDAAiC;AACjC,qDAAmC;AACnC,iDAA+B;AAC/B,kDAAgC;AAChC,sDAAoC;AACpC,yDAAuC;AACvC,kDAAgC;AAChC,kDAAgC;AAChC,gDAA8B;AAC9B,iDAA+B;AAC/B,qDAAmC"}
+{"version":3,"file":"index.js","sourceRoot":"","sources":["../../src/configs/index.ts"],"names":[],"mappings":";;;;;;;;;;;;;;;;AAAA,uDAAqC;AACrC,gDAA8B;AAC9B,kDAAgC;AAChC,qDAAmC;AACnC,oDAAkC;AAClC,kDAAgC;AAChC,sDAAoC;AACpC,iDAA+B;AAC/B,8CAA4B;AAC5B,kDAAgC;AAChC,6DAA2C;AAC3C,mDAAiC;AACjC,qDAAmC;AACnC,iDAA+B;AAC/B,kDAAgC;AAChC,sDAAoC;AACpC,yDAAuC;AACvC,kDAAgC;AAChC,kDAAgC;AAChC,gDAA8B;AAC9B,iDAA+B;AAC/B,qDAAmC;AACnC,sDAAoC"}

package/dist/configs/openai-ads.config.d.ts

@@ -0,0 +1,22 @@
+import { Params } from '../interfaces/params.interface';
+import { FeedGuardOptions } from '../services/feed-guard';
+import { Config } from './config';
+export declare const OPENAI_ADS_DEFAULTS: {
+    sellerName: string;
+    retentionDays: number;
+    imageConcurrency: number;
+    minSourceItems: number;
+    minPublishedItems: number;
+    maxDropPercent: number;
+    maxSourceAgeHours: number;
+    maxStaleHours: number;
+};
+export declare class OpenAiAdsConfig extends Config {
+    dryRun: boolean;
+    sellerName: string;
+    retentionDays: number;
+    imageConcurrency: number;
+    stateDir: string;
+    feedGuard: FeedGuardOptions;
+    constructor(params: Params);
+}

package/dist/configs/openai-ads.config.js

@@ -0,0 +1,56 @@
+"use strict";
+Object.defineProperty(exports, "__esModule", { value: true });
+exports.OpenAiAdsConfig = exports.OPENAI_ADS_DEFAULTS = void 0;
+const lodash_1 = require("lodash");
+const enums_1 = require("../enums");
+const config_1 = require("./config");
+const text = (value) => (typeof value === 'string' ? value.trim() : '');
+const positiveNumber = (value, fallback) => {
+    const parsed = (0, lodash_1.toNumber)(text(value));
+    return text(value) && Number.isFinite(parsed) && parsed > 0 ? parsed : fallback;
+};
+exports.OPENAI_ADS_DEFAULTS = {
+    sellerName: 'auto.de',
+    retentionDays: 15,
+    imageConcurrency: 16,
+    minSourceItems: 1000,
+    minPublishedItems: 500,
+    maxDropPercent: 20,
+    maxSourceAgeHours: 26,
+    maxStaleHours: 48,
+};
+class OpenAiAdsConfig extends config_1.Config {
+    dryRun;
+    sellerName;
+    retentionDays;
+    imageConcurrency;
+    stateDir;
+    feedGuard;
+    constructor(params) {
+        super(params);
+        this.dryRun = text(params.openAiAdsDryRun).toLowerCase() !== 'false';
+        const mode = this.dryRun ? 'dryrun' : 'export';
+        this.pathesConfig.localConvertedDirectory = `resources/${enums_1.ExportType.OPENAI_ADS}-${mode}`;
+        this.stateDir = `resources/${enums_1.ExportType.OPENAI_ADS}-state/${mode}`;
+        this.imageType = enums_1.ImageType.clean;
+        this.sellerName = text(params.openAiAdsSellerName) || exports.OPENAI_ADS_DEFAULTS.sellerName;
+        this.retentionDays = positiveNumber(params.openAiAdsRetentionDays, exports.OPENAI_ADS_DEFAULTS.retentionDays);
+        this.imageConcurrency = positiveNumber(params.openAiAdsImageConcurrency, exports.OPENAI_ADS_DEFAULTS.imageConcurrency);
+        const cap = positiveNumber(params.maxCurrentSalesPrice, 0);
+        this.maxCurrentSalesPrice = cap || undefined;
+        this.feedGuard = {
+            stateDir: this.stateDir,
+            minSourceItems: positiveNumber(params.feedGuardMinSourceItems, exports.OPENAI_ADS_DEFAULTS.minSourceItems),
+            minPublishedItems: positiveNumber(params.feedGuardMinPublishedItems, exports.OPENAI_ADS_DEFAULTS.minPublishedItems),
+            maxDropPercent: positiveNumber(params.feedGuardMaxDropPercent, exports.OPENAI_ADS_DEFAULTS.maxDropPercent),
+            maxSourceAgeHours: positiveNumber(params.feedGuardMaxSourceAgeHours, exports.OPENAI_ADS_DEFAULTS.maxSourceAgeHours),
+            maxStaleHours: positiveNumber(params.feedGuardMaxStaleHours, exports.OPENAI_ADS_DEFAULTS.maxStaleHours),
+            acceptDrop: text(params.feedGuardAcceptDrop).toLowerCase() === 'true',
+        };
+        this.outputFiles = [
+            `${this.pathesConfig.localConvertedDirectory}/api_export_cars_${enums_1.ExportType.OPENAI_ADS}.${enums_1.FileType.CSV}`,
+        ];
+    }
+}
+exports.OpenAiAdsConfig = OpenAiAdsConfig;
+//# sourceMappingURL=openai-ads.config.js.map

package/dist/configs/openai-ads.config.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"openai-ads.config.js","sourceRoot":"","sources":["../../src/configs/openai-ads.config.ts"],"names":[],"mappings":";;;AAAA,mCAAkC;AAElC,oCAA2D;AAG3D,qCAAkC;AAElC,MAAM,IAAI,GAAG,CAAC,KAAc,EAAU,EAAE,CAAC,CAAC,OAAO,KAAK,KAAK,QAAQ,CAAC,CAAC,CAAC,KAAK,CAAC,IAAI,EAAE,CAAC,CAAC,CAAC,EAAE,CAAC,CAAC;AAEzF,MAAM,cAAc,GAAG,CAAC,KAAc,EAAE,QAAgB,EAAU,EAAE;IAClE,MAAM,MAAM,GAAG,IAAA,iBAAQ,EAAC,IAAI,CAAC,KAAK,CAAC,CAAC,CAAC;IACrC,OAAO,IAAI,CAAC,KAAK,CAAC,IAAI,MAAM,CAAC,QAAQ,CAAC,MAAM,CAAC,IAAI,MAAM,GAAG,CAAC,CAAC,CAAC,CAAC,MAAM,CAAC,CAAC,CAAC,QAAQ,CAAC;AAClF,CAAC,CAAC;AAIW,QAAA,mBAAmB,GAAG;IACjC,UAAU,EAAE,SAAS;IACrB,aAAa,EAAE,EAAE;IACjB,gBAAgB,EAAE,EAAE;IACpB,cAAc,EAAE,IAAI;IACpB,iBAAiB,EAAE,GAAG;IACtB,cAAc,EAAE,EAAE;IAClB,iBAAiB,EAAE,EAAE;IACrB,aAAa,EAAE,EAAE;CAClB,CAAC;AASF,MAAa,eAAgB,SAAQ,eAAM;IACzC,MAAM,CAAU;IAChB,UAAU,CAAS;IACnB,aAAa,CAAS;IACtB,gBAAgB,CAAS;IACzB,QAAQ,CAAS;IACjB,SAAS,CAAmB;IAE5B,YAAY,MAAc;QACxB,KAAK,CAAC,MAAM,CAAC,CAAC;QACd,IAAI,CAAC,MAAM,GAAG,IAAI,CAAC,MAAM,CAAC,eAAe,CAAC,CAAC,WAAW,EAAE,KAAK,OAAO,CAAC;QACrE,MAAM,IAAI,GAAG,IAAI,CAAC,MAAM,CAAC,CAAC,CAAC,QAAQ,CAAC,CAAC,CAAC,QAAQ,CAAC;QAC/C,IAAI,CAAC,YAAY,CAAC,uBAAuB,GAAG,aAAa,kBAAU,CAAC,UAAU,IAAI,IAAI,EAAE,CAAC;QACzF,IAAI,CAAC,QAAQ,GAAG,aAAa,kBAAU,CAAC,UAAU,UAAU,IAAI,EAAE,CAAC;QACnE,IAAI,CAAC,SAAS,GAAG,iBAAS,CAAC,KAAK,CAAC;QACjC,IAAI,CAAC,UAAU,GAAG,IAAI,CAAC,MAAM,CAAC,mBAAmB,CAAC,IAAI,2BAAmB,CAAC,UAAU,CAAC;QACrF,IAAI,CAAC,aAAa,GAAG,cAAc,CAAC,MAAM,CAAC,sBAAsB,EAAE,2BAAmB,CAAC,aAAa,CAAC,CAAC;QACtG,IAAI,CAAC,gBAAgB,GAAG,cAAc,CAAC,MAAM,CAAC,yBAAyB,EAAE,2BAAmB,CAAC,gBAAgB,CAAC,CAAC;QAG/G,MAAM,GAAG,GAAG,cAAc,CAAC,MAAM,CAAC,oBAAoB,EAAE,CAAC,CAAC,CAAC;QAC3D,IAAI,CAAC,oBAAoB,GAAG,GAAG,IAAI,SAAS,CAAC;QAC7C,IAAI,CAAC,SAAS,GAAG;YACf,QAAQ,EAAE,IAAI,CAAC,QAAQ;YACvB,cAAc,EAAE,cAAc,CAAC,MAAM,CAAC,uBAAuB,EAAE,2BAAmB,CAAC,cAAc,CAAC;YAClG,iBAAiB,EAAE,cAAc,CAAC,MAAM,CAAC,0BAA0B,EAAE,2BAAmB,CAAC,iBAAiB,CAAC;YAC3G,cAAc,EAAE,cAAc,CAAC,MAAM,CAAC,uBAAuB,EAAE,2BAAmB,CAAC,cAAc,CAAC;YAClG,iBAAiB,EAAE,cAAc,CAAC,MAAM,CAAC,0BAA0B,EAAE,2BAAmB,CAAC,iBAAiB,CAAC;YAC3G,aAAa,EAAE,cAAc,CAAC,MAAM,CAAC,sBAAsB,EAAE,2BAAmB,CAAC,aAAa,CAAC;YAC/F,UAAU,EAAE,IAAI,CAAC,MAAM,CAAC,mBAAmB,CAAC,CAAC,WAAW,EAAE,KAAK,MAAM;SACtE,CAAC;QACF,IAAI,CAAC,WAAW,GAAG;YACjB,GAAG,IAAI,CAAC,YAAY,CAAC,uBAAuB,oBAAoB,kBAAU,CAAC,UAAU,IAAI,gBAAQ,CAAC,GAAG,EAAE;SACxG,CAAC;IACJ,CAAC;CACF;AAnCD,0CAmCC"}

package/dist/enums/export-type.enum.d.ts

@@ -20,5 +20,6 @@ export declare enum ExportType {
     MITULA = "mitula",
     AWIN = "awin",
     SANTANDER = "santander",
-    EVIUM = "evium"
+    EVIUM = "evium",
+    OPENAI_ADS = "openai_ads"
 }

package/dist/enums/export-type.enum.js

@@ -25,5 +25,6 @@ var ExportType;
     ExportType["AWIN"] = "awin";
     ExportType["SANTANDER"] = "santander";
     ExportType["EVIUM"] = "evium";
+    ExportType["OPENAI_ADS"] = "openai_ads";
 })(ExportType || (exports.ExportType = ExportType = {}));
 //# sourceMappingURL=export-type.enum.js.map

package/dist/enums/export-type.enum.js.map

@@ -1 +1 @@
-{"version":3,"file":"export-type.enum.js","sourceRoot":"","sources":["../../src/enums/export-type.enum.ts"],"names":[],"mappings":";;;AAAA,IAAY,UAgCX;AAhCD,WAAY,UAAU;IAIpB,+BAAiB,CAAA;IACjB,iCAAmB,CAAA;IACnB,6BAAe,CAAA;IACf,uCAAyB,CAAA;IACzB,+BAAiB,CAAA;IACjB,uBAAS,CAAA;IACT,+BAAiB,CAAA;IACjB,6BAAe,CAAA;IACf,qCAAuB,CAAA;IAIvB,mCAAqB,CAAA;IACrB,qCAAuB,CAAA;IAIvB,2BAAa,CAAA;IACb,yCAA2B,CAAA;IAC3B,uCAAyB,CAAA;IACzB,sDAAwC,CAAA;IACxC,+BAAiB,CAAA;IACjB,4CAA8B,CAAA;IAC9B,+BAAiB,CAAA;IACjB,+BAAiB,CAAA;IACjB,2BAAa,CAAA;IACb,qCAAuB,CAAA;IACvB,6BAAe,CAAA;AACjB,CAAC,EAhCW,UAAU,0BAAV,UAAU,QAgCrB"}
+{"version":3,"file":"export-type.enum.js","sourceRoot":"","sources":["../../src/enums/export-type.enum.ts"],"names":[],"mappings":";;;AAAA,IAAY,UAkCX;AAlCD,WAAY,UAAU;IAIpB,+BAAiB,CAAA;IACjB,iCAAmB,CAAA;IACnB,6BAAe,CAAA;IACf,uCAAyB,CAAA;IACzB,+BAAiB,CAAA;IACjB,uBAAS,CAAA;IACT,+BAAiB,CAAA;IACjB,6BAAe,CAAA;IACf,qCAAuB,CAAA;IAIvB,mCAAqB,CAAA;IACrB,qCAAuB,CAAA;IAIvB,2BAAa,CAAA;IACb,yCAA2B,CAAA;IAC3B,uCAAyB,CAAA;IACzB,sDAAwC,CAAA;IACxC,+BAAiB,CAAA;IACjB,4CAA8B,CAAA;IAC9B,+BAAiB,CAAA;IACjB,+BAAiB,CAAA;IACjB,2BAAa,CAAA;IACb,qCAAuB,CAAA;IACvB,6BAAe,CAAA;IAEf,uCAAyB,CAAA;AAC3B,CAAC,EAlCW,UAAU,0BAAV,UAAU,QAkCrB"}

package/dist/enums/image-type.enum.d.ts

@@ -1,4 +1,5 @@
 export declare enum ImageType {
     default = "default",
-    marketing = "marketing"
+    marketing = "marketing",
+    clean = "clean"
 }

package/dist/enums/image-type.enum.js

@@ -5,5 +5,6 @@ var ImageType;
 (function (ImageType) {
     ImageType["default"] = "default";
     ImageType["marketing"] = "marketing";
+    ImageType["clean"] = "clean";
 })(ImageType || (exports.ImageType = ImageType = {}));
 //# sourceMappingURL=image-type.enum.js.map

package/dist/enums/image-type.enum.js.map

@@ -1 +1 @@
-{"version":3,"file":"image-type.enum.js","sourceRoot":"","sources":["../../src/enums/image-type.enum.ts"],"names":[],"mappings":";;;AAAA,IAAY,SAGX;AAHD,WAAY,SAAS;IACnB,gCAAmB,CAAA;IACnB,oCAAuB,CAAA;AACzB,CAAC,EAHW,SAAS,yBAAT,SAAS,QAGpB"}
+{"version":3,"file":"image-type.enum.js","sourceRoot":"","sources":["../../src/enums/image-type.enum.ts"],"names":[],"mappings":";;;AAAA,IAAY,SAQX;AARD,WAAY,SAAS;IACnB,gCAAmB,CAAA;IACnB,oCAAuB,CAAA;IAKvB,4BAAe,CAAA;AACjB,CAAC,EARW,SAAS,yBAAT,SAAS,QAQpB"}

package/dist/export.schema.d.ts

@@ -1,5 +1,5 @@
-import { AlleskralleConfig, As24Config, Auto24Config, AutouncleConfig, DasparkingConfig, EautoConfig, FbConfig, GoogleConfig, MarktdeConfig, MeinstadtConfig, OoyyoConfig, YescarConfig, KleinanzeigeFocusConfig, AutoboerseConfig, ByOwnerConfig, FacebookShopConfig, CriteoConfig, TrovitConfig, MitulaConfig, AwinConfig, EviumConfig, SantanderConfig } from './configs';
-import { As24Exporter, Auto24Exporter, AutouncleExporter, ByOwnerExporter, FbExporter, GoogleExporter, MeinstadtExporter, MobileExporter, OoyyoExporter, ModixExporter, RubrikkExporter, FacebookShopExporter, TrovitExporter, AwinExporter, SantanderExporter, CriteoExporter } from './exporters';
+import { AlleskralleConfig, As24Config, Auto24Config, AutouncleConfig, DasparkingConfig, EautoConfig, FbConfig, GoogleConfig, MarktdeConfig, MeinstadtConfig, OoyyoConfig, YescarConfig, KleinanzeigeFocusConfig, AutoboerseConfig, ByOwnerConfig, FacebookShopConfig, CriteoConfig, TrovitConfig, MitulaConfig, AwinConfig, EviumConfig, SantanderConfig, OpenAiAdsConfig } from './configs';
+import { As24Exporter, Auto24Exporter, AutouncleExporter, ByOwnerExporter, FbExporter, GoogleExporter, MeinstadtExporter, MobileExporter, OoyyoExporter, ModixExporter, RubrikkExporter, FacebookShopExporter, TrovitExporter, AwinExporter, SantanderExporter, CriteoExporter, OpenAiAdsExporter } from './exporters';
 export declare const exportSchema: {
     eauto: {
         config: typeof EautoConfig;
@@ -89,4 +89,8 @@ export declare const exportSchema: {
         config: typeof SantanderConfig;
         exporter: typeof SantanderExporter;
     };
+    openai_ads: {
+        config: typeof OpenAiAdsConfig;
+        exporter: typeof OpenAiAdsExporter;
+    };
 };

package/dist/export.schema.js

@@ -93,5 +93,9 @@ exports.exportSchema = {
         config: configs_1.SantanderConfig,
         exporter: exporters_1.SantanderExporter,
     },
+    [enums_1.ExportType.OPENAI_ADS]: {
+        config: configs_1.OpenAiAdsConfig,
+        exporter: exporters_1.OpenAiAdsExporter,
+    },
 };
 //# sourceMappingURL=export.schema.js.map

package/dist/export.schema.js.map

@@ -1 +1 @@
-{"version":3,"file":"export.schema.js","sourceRoot":"","sources":["../src/export.schema.ts"],"names":[],"mappings":";;;AAAA,mCAAqC;AAErC,uCAuBmB;AACnB,2CAiBqB;AAER,QAAA,YAAY,GAAG;IAC1B,CAAC,kBAAU,CAAC,KAAK,CAAC,EAAE;QAClB,MAAM,EAAE,qBAAW;QACnB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,MAAM,CAAC,EAAE;QACnB,MAAM,EAAE,sBAAY;QACpB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,OAAO,CAAC,EAAE;QACpB,MAAM,EAAE,uBAAa;QACrB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,MAAM,CAAC,EAAE;QACnB,MAAM,EAAE,sBAAY;QACpB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,EAAE,CAAC,EAAE;QACf,MAAM,EAAE,kBAAQ;QAChB,QAAQ,EAAE,sBAAU;KACrB;IACD,CAAC,kBAAU,CAAC,MAAM,CAAC,EAAE;QACnB,MAAM,EAAE,sBAAY;QACpB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,KAAK,CAAC,EAAE;QAClB,MAAM,EAAE,qBAAW;QACnB,QAAQ,EAAE,yBAAa;KACxB;IACD,CAAC,kBAAU,CAAC,SAAS,CAAC,EAAE;QACtB,MAAM,EAAE,yBAAe;QACvB,QAAQ,EAAE,6BAAiB;KAC5B;IACD,CAAC,kBAAU,CAAC,QAAQ,CAAC,EAAE;QACrB,MAAM,EAAE,uBAAa;QACrB,QAAQ,EAAE,2BAAe;KAC1B;IACD,CAAC,kBAAU,CAAC,SAAS,CAAC,EAAE;QACtB,MAAM,EAAE,yBAAe;QACvB,QAAQ,EAAE,6BAAiB;KAC5B;IACD,CAAC,kBAAU,CAAC,IAAI,CAAC,EAAE;QACjB,MAAM,EAAE,oBAAU;QAClB,QAAQ,EAAE,wBAAY;KACvB;IACD,CAAC,kBAAU,CAAC,WAAW,CAAC,EAAE;QACxB,MAAM,EAAE,2BAAiB;QACzB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,UAAU,CAAC,EAAE;QACvB,MAAM,EAAE,0BAAgB;QACxB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,kBAAkB,CAAC,EAAE;QAC/B,MAAM,EAAE,iCAAuB;QAC/B,QAAQ,EAAE,2BAAe;KAC1B;IACD,CAAC,kBAAU,CAAC,UAAU,CAAC,EAAE;QACvB,MAAM,EAAE,0BAAgB;QACxB,QAAQ,EAAE,yBAAa;KACxB;IACD,CAAC,kBAAU,CAAC,MAAM,CAAC,EAAE;QACnB,MAAM,EAAE,sBAAY;QACpB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,aAAa,CAAC,EAAE;QAC1B,MAAM,EAAE,4BAAkB;QAC1B,QAAQ,EAAE,gCAAoB;KAC/B;IACD,CAAC,kBAAU,CAAC,MAAM,CAAC,EAAE;QACnB,MAAM,EAAE,sBAAY;QACpB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,MAAM,CAAC,EAAE;QACnB,MAAM,EAAE,sBAAY;QACpB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,IAAI,CAAC,EAAE;QACjB,MAAM,EAAE,oBAAU;QAClB,QAAQ,EAAE,wBAAY;KACvB;IACD,CAAC,kBAAU,CAAC,KAAK,CAAC,EAAE;QAClB,MAAM,EAAE,qBAAW;QACnB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,SAAS,CAAC,EAAE;QACtB,MAAM,EAAE,yBAAe;QACvB,QAAQ,EAAE,6BAAiB;KAC5B;CACF,CAAC"}
+{"version":3,"file":"export.schema.js","sourceRoot":"","sources":["../src/export.schema.ts"],"names":[],"mappings":";;;AAAA,mCAAqC;AAErC,uCAwBmB;AACnB,2CAkBqB;AAER,QAAA,YAAY,GAAG;IAC1B,CAAC,kBAAU,CAAC,KAAK,CAAC,EAAE;QAClB,MAAM,EAAE,qBAAW;QACnB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,MAAM,CAAC,EAAE;QACnB,MAAM,EAAE,sBAAY;QACpB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,OAAO,CAAC,EAAE;QACpB,MAAM,EAAE,uBAAa;QACrB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,MAAM,CAAC,EAAE;QACnB,MAAM,EAAE,sBAAY;QACpB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,EAAE,CAAC,EAAE;QACf,MAAM,EAAE,kBAAQ;QAChB,QAAQ,EAAE,sBAAU;KACrB;IACD,CAAC,kBAAU,CAAC,MAAM,CAAC,EAAE;QACnB,MAAM,EAAE,sBAAY;QACpB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,KAAK,CAAC,EAAE;QAClB,MAAM,EAAE,qBAAW;QACnB,QAAQ,EAAE,yBAAa;KACxB;IACD,CAAC,kBAAU,CAAC,SAAS,CAAC,EAAE;QACtB,MAAM,EAAE,yBAAe;QACvB,QAAQ,EAAE,6BAAiB;KAC5B;IACD,CAAC,kBAAU,CAAC,QAAQ,CAAC,EAAE;QACrB,MAAM,EAAE,uBAAa;QACrB,QAAQ,EAAE,2BAAe;KAC1B;IACD,CAAC,kBAAU,CAAC,SAAS,CAAC,EAAE;QACtB,MAAM,EAAE,yBAAe;QACvB,QAAQ,EAAE,6BAAiB;KAC5B;IACD,CAAC,kBAAU,CAAC,IAAI,CAAC,EAAE;QACjB,MAAM,EAAE,oBAAU;QAClB,QAAQ,EAAE,wBAAY;KACvB;IACD,CAAC,kBAAU,CAAC,WAAW,CAAC,EAAE;QACxB,MAAM,EAAE,2BAAiB;QACzB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,UAAU,CAAC,EAAE;QACvB,MAAM,EAAE,0BAAgB;QACxB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,kBAAkB,CAAC,EAAE;QAC/B,MAAM,EAAE,iCAAuB;QAC/B,QAAQ,EAAE,2BAAe;KAC1B;IACD,CAAC,kBAAU,CAAC,UAAU,CAAC,EAAE;QACvB,MAAM,EAAE,0BAAgB;QACxB,QAAQ,EAAE,yBAAa;KACxB;IACD,CAAC,kBAAU,CAAC,MAAM,CAAC,EAAE;QACnB,MAAM,EAAE,sBAAY;QACpB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,aAAa,CAAC,EAAE;QAC1B,MAAM,EAAE,4BAAkB;QAC1B,QAAQ,EAAE,gCAAoB;KAC/B;IACD,CAAC,kBAAU,CAAC,MAAM,CAAC,EAAE;QACnB,MAAM,EAAE,sBAAY;QACpB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,MAAM,CAAC,EAAE;QACnB,MAAM,EAAE,sBAAY;QACpB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,IAAI,CAAC,EAAE;QACjB,MAAM,EAAE,oBAAU;QAClB,QAAQ,EAAE,wBAAY;KACvB;IACD,CAAC,kBAAU,CAAC,KAAK,CAAC,EAAE;QAClB,MAAM,EAAE,qBAAW;QACnB,QAAQ,EAAE,0BAAc;KACzB;IACD,CAAC,kBAAU,CAAC,SAAS,CAAC,EAAE;QACtB,MAAM,EAAE,yBAAe;QACvB,QAAQ,EAAE,6BAAiB;KAC5B;IACD,CAAC,kBAAU,CAAC,UAAU,CAAC,EAAE;QACvB,MAAM,EAAE,yBAAe;QACvB,QAAQ,EAAE,6BAAiB;KAC5B;CACF,CAAC"}

package/dist/exporters/index.d.ts

@@ -14,3 +14,4 @@ export * from './facebook-shop.exporter';
 export * from './trovit.exporter';
 export * from './awin.exporter';
 export * from './santander.exporter';
+export * from './openai-ads.exporter';

package/dist/exporters/index.js

@@ -30,4 +30,5 @@ __exportStar(require("./facebook-shop.exporter"), exports);
 __exportStar(require("./trovit.exporter"), exports);
 __exportStar(require("./awin.exporter"), exports);
 __exportStar(require("./santander.exporter"), exports);
+__exportStar(require("./openai-ads.exporter"), exports);
 //# sourceMappingURL=index.js.map

package/dist/exporters/index.js.map

@@ -1 +1 @@
-{"version":3,"file":"index.js","sourceRoot":"","sources":["../../src/exporters/index.ts"],"names":[],"mappings":";;;;;;;;;;;;;;;;AAAA,kDAAgC;AAChC,oDAAkC;AAClC,uDAAqC;AACrC,sDAAoC;AACpC,oDAAkC;AAClC,gDAA8B;AAC9B,oDAAkC;AAClC,uDAAqC;AACrC,oDAAkC;AAClC,mDAAiC;AACjC,mDAAiC;AACjC,qDAAmC;AACnC,2DAAyC;AACzC,oDAAkC;AAClC,kDAAgC;AAChC,uDAAqC"}
+{"version":3,"file":"index.js","sourceRoot":"","sources":["../../src/exporters/index.ts"],"names":[],"mappings":";;;;;;;;;;;;;;;;AAAA,kDAAgC;AAChC,oDAAkC;AAClC,uDAAqC;AACrC,sDAAoC;AACpC,oDAAkC;AAClC,gDAA8B;AAC9B,oDAAkC;AAClC,uDAAqC;AACrC,oDAAkC;AAClC,mDAAiC;AACjC,mDAAiC;AACjC,qDAAmC;AACnC,2DAAyC;AACzC,oDAAkC;AAClC,kDAAgC;AAChC,uDAAqC;AACrC,wDAAsC"}

package/dist/exporters/openai-ads.exporter.d.ts

@@ -0,0 +1,13 @@
+import { CarService, ConfigService, ImagesService, LoaderService, RulesService } from '../services';
+import { Exporter } from '../interfaces/exporter.interface';
+export declare class OpenAiAdsExporter implements Exporter {
+    private carService;
+    private configService;
+    private rulesService;
+    private loaderService;
+    private imagesService;
+    constructor(carService: CarService, configService: ConfigService, rulesService: RulesService, loaderService: LoaderService, imagesService: ImagesService);
+    export(): Promise<void>;
+    private readonly dealerStatuses;
+    private dealerStatus;
+}

package/dist/exporters/openai-ads.exporter.js

@@ -0,0 +1,91 @@
+"use strict";
+var __decorate = (this && this.__decorate) || function (decorators, target, key, desc) {
+    var c = arguments.length, r = c < 3 ? target : desc === null ? desc = Object.getOwnPropertyDescriptor(target, key) : desc, d;
+    if (typeof Reflect === "object" && typeof Reflect.decorate === "function") r = Reflect.decorate(decorators, target, key, desc);
+    else for (var i = decorators.length - 1; i >= 0; i--) if (d = decorators[i]) r = (c < 3 ? d(r) : c > 3 ? d(target, key, r) : d(target, key)) || r;
+    return c > 3 && r && Object.defineProperty(target, key, r), r;
+};
+var __metadata = (this && this.__metadata) || function (k, v) {
+    if (typeof Reflect === "object" && typeof Reflect.metadata === "function") return Reflect.metadata(k, v);
+};
+Object.defineProperty(exports, "__esModule", { value: true });
+exports.OpenAiAdsExporter = void 0;
+const common_1 = require("@nestjs/common");
+const cronicle_helper_1 = require("@bytebrand/cronicle-helper");
+const schema_tools_1 = require("@bytebrand/schema-tools");
+const i18n_dictionaries_1 = require("@bytebrand/i18n-dictionaries");
+const services_1 = require("../services");
+const image_url_validator_service_1 = require("../services/image-url-validator.service");
+const feed_guard_1 = require("../services/feed-guard");
+const openai_ads_feed_run_1 = require("../services/openai-ads-feed-run");
+const openai_image_fields_1 = require("../transformers/openai-image-fields");
+let OpenAiAdsExporter = class OpenAiAdsExporter {
+    carService;
+    configService;
+    rulesService;
+    loaderService;
+    imagesService;
+    constructor(carService, configService, rulesService, loaderService, imagesService) {
+        this.carService = carService;
+        this.configService = configService;
+        this.rulesService = rulesService;
+        this.loaderService = loaderService;
+        this.imagesService = imagesService;
+    }
+    async export() {
+        const config = this.configService.config;
+        const translator = new schema_tools_1.TranslatorExtended({ ...i18n_dictionaries_1.de, ...i18n_dictionaries_1.deVehicleProps, ...i18n_dictionaries_1.deVehicleDetailsPage });
+        const validator = new image_url_validator_service_1.ImageUrlValidator({ concurrency: config.imageConcurrency });
+        const run = new openai_ads_feed_run_1.OpenAiAdsFeedRun({
+            forEachChunk: fn => this.loaderService.process((chunk) => fn(chunk.data)),
+            filterCar: source => this.carService.filterCar(source, this.rulesService.rules),
+            dealerStatus: ownerId => this.dealerStatus(ownerId),
+            resolveImages: ({ car, images }) => (0, openai_image_fields_1.resolveOpenAiImageFields)(this.imagesService.getCleanImages(car._id, images), validator),
+            imageStats: () => validator.stats,
+            guard: new feed_guard_1.FeedGuard(config.feedGuard),
+        }, {
+            runId: config.runId,
+            dryRun: config.dryRun,
+            sourceDirectory: config.pathesConfig.localDirectory,
+            sourceBaseFileName: config.pathesConfig.baseFileName,
+            outputFile: config.outputFiles[0],
+            stateDir: config.stateDir,
+            retentionDays: config.retentionDays,
+            mapping: {
+                domain: config.domain,
+                sellerName: config.sellerName,
+                translate: key => translator.translateVal(key),
+            },
+        });
+        try {
+            const report = await run.run();
+            if (report.stale) {
+                console.log(`OpenAI ads feed STALE: last good file ${report.lastGoodAgeHours?.toFixed(1)} h old`);
+            }
+        }
+        catch (error) {
+            cronicle_helper_1.LoggerService.exitError(`OpenAI ads feed not published: ${error?.message ?? error}`);
+            process.exit(1);
+        }
+    }
+    dealerStatuses = new Map();
+    dealerStatus(ownerId) {
+        if (!ownerId) {
+            return Promise.resolve('unknown');
+        }
+        if (!this.dealerStatuses.has(ownerId)) {
+            this.dealerStatuses.set(ownerId, this.carService.getOwner(ownerId).then(owner => (!owner ? 'unknown' : owner.active === false || owner.blacklist === true ? 'inactive' : 'active'), () => 'unknown'));
+        }
+        return this.dealerStatuses.get(ownerId);
+    }
+};
+exports.OpenAiAdsExporter = OpenAiAdsExporter;
+exports.OpenAiAdsExporter = OpenAiAdsExporter = __decorate([
+    (0, common_1.Injectable)(),
+    __metadata("design:paramtypes", [services_1.CarService,
+        services_1.ConfigService,
+        services_1.RulesService,
+        services_1.LoaderService,
+        services_1.ImagesService])
+], OpenAiAdsExporter);
+//# sourceMappingURL=openai-ads.exporter.js.map

package/dist/exporters/openai-ads.exporter.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"openai-ads.exporter.js","sourceRoot":"","sources":["../../src/exporters/openai-ads.exporter.ts"],"names":[],"mappings":";;;;;;;;;;;;AAAA,2CAA4C;AAE5C,gEAA2D;AAC3D,0DAA6D;AAC7D,oEAAwF;AAExF,0CAAoG;AACpG,yFAA4E;AAC5E,uDAAmD;AACnD,yEAA4F;AAC5F,6EAA+E;AAUxE,IAAM,iBAAiB,GAAvB,MAAM,iBAAiB;IAElB;IACA;IACA;IACA;IACA;IALV,YACU,UAAsB,EACtB,aAA4B,EAC5B,YAA0B,EAC1B,aAA4B,EAC5B,aAA4B;QAJ5B,eAAU,GAAV,UAAU,CAAY;QACtB,kBAAa,GAAb,aAAa,CAAe;QAC5B,iBAAY,GAAZ,YAAY,CAAc;QAC1B,kBAAa,GAAb,aAAa,CAAe;QAC5B,kBAAa,GAAb,aAAa,CAAe;IAClC,CAAC;IAEL,KAAK,CAAC,MAAM;QACV,MAAM,MAAM,GAAG,IAAI,CAAC,aAAa,CAAC,MAAyB,CAAC;QAC5D,MAAM,UAAU,GAAG,IAAI,iCAAkB,CAAC,EAAE,GAAG,sBAAE,EAAE,GAAG,kCAAc,EAAE,GAAG,wCAAoB,EAAE,CAAC,CAAC;QACjG,MAAM,SAAS,GAAG,IAAI,+CAAiB,CAAC,EAAE,WAAW,EAAE,MAAM,CAAC,gBAAgB,EAAE,CAAC,CAAC;QAElF,MAAM,GAAG,GAAG,IAAI,sCAAgB,CAC9B;YACE,YAAY,EAAE,EAAE,CAAC,EAAE,CAAC,IAAI,CAAC,aAAa,CAAC,OAAO,CAAC,CAAC,KAAuB,EAAE,EAAE,CAAC,EAAE,CAAC,KAAK,CAAC,IAAmB,CAAC,CAAC;YAC1G,SAAS,EAAE,MAAM,CAAC,EAAE,CAAC,IAAI,CAAC,UAAU,CAAC,SAAS,CAAC,MAAM,EAAE,IAAI,CAAC,YAAY,CAAC,KAAK,CAAC;YAC/E,YAAY,EAAE,OAAO,CAAC,EAAE,CAAC,IAAI,CAAC,YAAY,CAAC,OAAO,CAAC;YACnD,aAAa,EAAE,CAAC,EAAE,GAAG,EAAE,MAAM,EAAE,EAAE,EAAE,CACjC,IAAA,8CAAwB,EAAC,IAAI,CAAC,aAAa,CAAC,cAAc,CAAC,GAAG,CAAC,GAAG,EAAE,MAAM,CAAC,EAAE,SAAS,CAAC;YACzF,UAAU,EAAE,GAAG,EAAE,CAAC,SAAS,CAAC,KAAK;YACjC,KAAK,EAAE,IAAI,sBAAS,CAAC,MAAM,CAAC,SAAS,CAAC;SACvC,EACD;YACE,KAAK,EAAE,MAAM,CAAC,KAAK;YACnB,MAAM,EAAE,MAAM,CAAC,MAAM;YACrB,eAAe,EAAE,MAAM,CAAC,YAAY,CAAC,cAAc;YACnD,kBAAkB,EAAE,MAAM,CAAC,YAAY,CAAC,YAAY;YACpD,UAAU,EAAE,MAAM,CAAC,WAAW,CAAC,CAAC,CAAC;YACjC,QAAQ,EAAE,MAAM,CAAC,QAAQ;YACzB,aAAa,EAAE,MAAM,CAAC,aAAa;YACnC,OAAO,EAAE;gBACP,MAAM,EAAE,MAAM,CAAC,MAAM;gBACrB,UAAU,EAAE,MAAM,CAAC,UAAU;gBAC7B,SAAS,EAAE,GAAG,CAAC,EAAE,CAAC,UAAU,CAAC,YAAY,CAAC,GAAG,CAAC;aAC/C;SACF,CACF,CAAC;QAEF,IAAI;YACF,MAAM,MAAM,GAAG,MAAM,GAAG,CAAC,GAAG,EAAE,CAAC;YAC/B,IAAI,MAAM,CAAC,KAAK,EAAE;gBAChB,OAAO,CAAC,GAAG,CAAC,yCAAyC,MAAM,CAAC,gBAAgB,EAAE,OAAO,CAAC,CAAC,CAAC,QAAQ,CAAC,CAAC;aACnG;SACF;QAAC,OAAO,KAAK,EAAE;YAId,+BAAa,CAAC,SAAS,CAAC,kCAAkC,KAAK,EAAE,OAAO,IAAI,KAAK,EAAE,CAAC,CAAC;YACrF,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;SACjB;IACH,CAAC;IAIgB,cAAc,GAAG,IAAI,GAAG,EAAiC,CAAC;IAInE,YAAY,CAAC,OAAe;QAClC,IAAI,CAAC,OAAO,EAAE;YACZ,OAAO,OAAO,CAAC,OAAO,CAAC,SAAS,CAAC,CAAC;SACnC;QACD,IAAI,CAAC,IAAI,CAAC,cAAc,CAAC,GAAG,CAAC,OAAO,CAAC,EAAE;YACrC,IAAI,CAAC,cAAc,CAAC,GAAG,CAAC,OAAO,EAAE,IAAI,CAAC,UAAU,CAAC,QAAQ,CAAC,OAAO,CAAC,CAAC,IAAI,CACrE,KAAK,CAAC,EAAE,CAAC,CAAC,CAAC,KAAK,CAAC,CAAC,CAAC,SAAS,CAAC,CAAC,CAAC,KAAK,CAAC,MAAM,KAAK,KAAK,IAAI,KAAK,CAAC,SAAS,KAAK,IAAI,CAAC,CAAC,CAAC,UAAU,CAAC,CAAC,CAAC,QAAQ,CAAC,EAC1G,GAAG,EAAE,CAAC,SAAyB,CAChC,CAAC,CAAC;SACJ;QACD,OAAO,IAAI,CAAC,cAAc,CAAC,GAAG,CAAC,OAAO,CAAC,CAAC;IAC1C,CAAC;CACF,CAAA;AAxEY,8CAAiB;4BAAjB,iBAAiB;IAD7B,IAAA,mBAAU,GAAE;qCAGW,qBAAU;QACP,wBAAa;QACd,uBAAY;QACX,wBAAa;QACb,wBAAa;GAN3B,iBAAiB,CAwE7B"}

package/dist/formats/openai-ads-csv.builder.d.ts

@@ -0,0 +1,15 @@
+import { OpenAiAdsRow } from '../interfaces/openai-ads.interface';
+export declare const toCsvCell: (value: string | boolean | undefined | null) => string;
+export declare const toCsvLine: (cells: Array<string | boolean | undefined | null>) => string;
+export declare const openAiAdsCsvHeader: () => string;
+export declare const openAiAdsCsvRow: (row: OpenAiAdsRow) => string;
+export declare class OpenAiAdsCsvBuilder {
+    private readonly fileName;
+    private stream;
+    private rows;
+    constructor(fileName: string);
+    buildStart(): Promise<void>;
+    addItem(row: OpenAiAdsRow): Promise<void>;
+    buildEnd(): Promise<number>;
+    private write;
+}

package/dist/formats/openai-ads-csv.builder.js

@@ -0,0 +1,48 @@
+"use strict";
+Object.defineProperty(exports, "__esModule", { value: true });
+exports.OpenAiAdsCsvBuilder = exports.openAiAdsCsvRow = exports.openAiAdsCsvHeader = exports.toCsvLine = exports.toCsvCell = void 0;
+const fs_1 = require("fs");
+const events_1 = require("events");
+const openai_ads_interface_1 = require("../interfaces/openai-ads.interface");
+const toCsvCell = (value) => {
+    if (value === undefined || value === null) {
+        return '';
+    }
+    const text = typeof value === 'boolean' ? (value ? 'true' : 'false') : value;
+    return /[",\r\n]/.test(text) ? `"${text.replace(/"/g, '""')}"` : text;
+};
+exports.toCsvCell = toCsvCell;
+const toCsvLine = (cells) => `${cells.map(exports.toCsvCell).join(',')}\n`;
+exports.toCsvLine = toCsvLine;
+const openAiAdsCsvHeader = () => (0, exports.toCsvLine)([...openai_ads_interface_1.OPENAI_ADS_COLUMNS]);
+exports.openAiAdsCsvHeader = openAiAdsCsvHeader;
+const openAiAdsCsvRow = (row) => (0, exports.toCsvLine)(openai_ads_interface_1.OPENAI_ADS_COLUMNS.map(column => row[column]));
+exports.openAiAdsCsvRow = openAiAdsCsvRow;
+class OpenAiAdsCsvBuilder {
+    fileName;
+    stream;
+    rows = 0;
+    constructor(fileName) {
+        this.fileName = fileName;
+    }
+    async buildStart() {
+        this.stream = (0, fs_1.createWriteStream)(this.fileName, { encoding: 'utf8' });
+        await this.write((0, exports.openAiAdsCsvHeader)());
+    }
+    async addItem(row) {
+        await this.write((0, exports.openAiAdsCsvRow)(row));
+        this.rows += 1;
+    }
+    async buildEnd() {
+        this.stream.end();
+        await (0, events_1.once)(this.stream, 'finish');
+        return this.rows;
+    }
+    async write(chunk) {
+        if (!this.stream.write(chunk)) {
+            await (0, events_1.once)(this.stream, 'drain');
+        }
+    }
+}
+exports.OpenAiAdsCsvBuilder = OpenAiAdsCsvBuilder;
+//# sourceMappingURL=openai-ads-csv.builder.js.map

package/dist/formats/openai-ads-csv.builder.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"openai-ads-csv.builder.js","sourceRoot":"","sources":["../../src/formats/openai-ads-csv.builder.ts"],"names":[],"mappings":";;;AAAA,2BAAoD;AACpD,mCAA8B;AAE9B,6EAAsF;AAK/E,MAAM,SAAS,GAAG,CAAC,KAA0C,EAAU,EAAE;IAC9E,IAAI,KAAK,KAAK,SAAS,IAAI,KAAK,KAAK,IAAI,EAAE;QACzC,OAAO,EAAE,CAAC;KACX;IACD,MAAM,IAAI,GAAG,OAAO,KAAK,KAAK,SAAS,CAAC,CAAC,CAAC,CAAC,KAAK,CAAC,CAAC,CAAC,MAAM,CAAC,CAAC,CAAC,OAAO,CAAC,CAAC,CAAC,CAAC,KAAK,CAAC;IAC7E,OAAO,UAAU,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC,IAAI,IAAI,CAAC,OAAO,CAAC,IAAI,EAAE,IAAI,CAAC,GAAG,CAAC,CAAC,CAAC,IAAI,CAAC;AACxE,CAAC,CAAC;AANW,QAAA,SAAS,aAMpB;AAEK,MAAM,SAAS,GAAG,CAAC,KAAiD,EAAU,EAAE,CAAC,GAAG,KAAK,CAAC,GAAG,CAAC,iBAAS,CAAC,CAAC,IAAI,CAAC,GAAG,CAAC,IAAI,CAAC;AAAjH,QAAA,SAAS,aAAwG;AAEvH,MAAM,kBAAkB,GAAG,GAAW,EAAE,CAAC,IAAA,iBAAS,EAAC,CAAC,GAAG,yCAAkB,CAAC,CAAC,CAAC;AAAtE,QAAA,kBAAkB,sBAAoD;AAE5E,MAAM,eAAe,GAAG,CAAC,GAAiB,EAAU,EAAE,CAAC,IAAA,iBAAS,EAAC,yCAAkB,CAAC,GAAG,CAAC,MAAM,CAAC,EAAE,CAAC,GAAG,CAAC,MAAM,CAAC,CAAC,CAAC,CAAC;AAA1G,QAAA,eAAe,mBAA2F;AAOvH,MAAa,mBAAmB;IAID;IAHrB,MAAM,CAAc;IACpB,IAAI,GAAG,CAAC,CAAC;IAEjB,YAA6B,QAAgB;QAAhB,aAAQ,GAAR,QAAQ,CAAQ;IAAI,CAAC;IAElD,KAAK,CAAC,UAAU;QACd,IAAI,CAAC,MAAM,GAAG,IAAA,sBAAiB,EAAC,IAAI,CAAC,QAAQ,EAAE,EAAE,QAAQ,EAAE,MAAM,EAAE,CAAC,CAAC;QACrE,MAAM,IAAI,CAAC,KAAK,CAAC,IAAA,0BAAkB,GAAE,CAAC,CAAC;IACzC,CAAC;IAED,KAAK,CAAC,OAAO,CAAC,GAAiB;QAC7B,MAAM,IAAI,CAAC,KAAK,CAAC,IAAA,uBAAe,EAAC,GAAG,CAAC,CAAC,CAAC;QACvC,IAAI,CAAC,IAAI,IAAI,CAAC,CAAC;IACjB,CAAC;IAED,KAAK,CAAC,QAAQ;QACZ,IAAI,CAAC,MAAM,CAAC,GAAG,EAAE,CAAC;QAClB,MAAM,IAAA,aAAI,EAAC,IAAI,CAAC,MAAM,EAAE,QAAQ,CAAC,CAAC;QAClC,OAAO,IAAI,CAAC,IAAI,CAAC;IACnB,CAAC;IAEO,KAAK,CAAC,KAAK,CAAC,KAAa;QAC/B,IAAI,CAAC,IAAI,CAAC,MAAM,CAAC,KAAK,CAAC,KAAK,CAAC,EAAE;YAC7B,MAAM,IAAA,aAAI,EAAC,IAAI,CAAC,MAAM,EAAE,OAAO,CAAC,CAAC;SAClC;IACH,CAAC;CACF;AA3BD,kDA2BC"}

package/dist/interfaces/openai-ads.interface.d.ts

@@ -0,0 +1,35 @@
+export declare const OPENAI_ADS_COLUMNS: readonly ["item_id", "title", "description", "url", "brand", "seller_name", "image_url", "additional_image_urls", "availability", "price", "condition", "is_ads_eligible"];
+export type OpenAiAdsColumn = typeof OPENAI_ADS_COLUMNS[number];
+export type OpenAiAdsAvailability = 'in_stock' | 'out_of_stock';
+export type OpenAiAdsCondition = 'new' | 'used';
+export interface OpenAiAdsRow {
+    item_id: string;
+    title: string;
+    description: string;
+    url: string;
+    brand: string;
+    seller_name: string;
+    image_url: string;
+    additional_image_urls: string;
+    availability: OpenAiAdsAvailability;
+    price: string;
+    condition: OpenAiAdsCondition;
+    is_ads_eligible: boolean;
+}
+export declare enum OpenAiAdsExclusion {
+    noId = "no_id",
+    duplicateId = "duplicate_id",
+    filtered = "filtered",
+    invalidPrice = "invalid_price",
+    noTitle = "no_title",
+    noBrand = "no_brand",
+    conditionUnknown = "condition_unknown",
+    dealerInactive = "dealer_inactive",
+    dealerUnknown = "dealer_unknown",
+    noImage = "no_image"
+}
+export declare enum OpenAiAdsOutOfStockReason {
+    reserved = "reserved",
+    soldFlag = "sold_flag",
+    notInSnapshot = "not_in_snapshot"
+}

package/dist/interfaces/openai-ads.interface.js

@@ -0,0 +1,37 @@
+"use strict";
+Object.defineProperty(exports, "__esModule", { value: true });
+exports.OpenAiAdsOutOfStockReason = exports.OpenAiAdsExclusion = exports.OPENAI_ADS_COLUMNS = void 0;
+exports.OPENAI_ADS_COLUMNS = [
+    'item_id',
+    'title',
+    'description',
+    'url',
+    'brand',
+    'seller_name',
+    'image_url',
+    'additional_image_urls',
+    'availability',
+    'price',
+    'condition',
+    'is_ads_eligible',
+];
+var OpenAiAdsExclusion;
+(function (OpenAiAdsExclusion) {
+    OpenAiAdsExclusion["noId"] = "no_id";
+    OpenAiAdsExclusion["duplicateId"] = "duplicate_id";
+    OpenAiAdsExclusion["filtered"] = "filtered";
+    OpenAiAdsExclusion["invalidPrice"] = "invalid_price";
+    OpenAiAdsExclusion["noTitle"] = "no_title";
+    OpenAiAdsExclusion["noBrand"] = "no_brand";
+    OpenAiAdsExclusion["conditionUnknown"] = "condition_unknown";
+    OpenAiAdsExclusion["dealerInactive"] = "dealer_inactive";
+    OpenAiAdsExclusion["dealerUnknown"] = "dealer_unknown";
+    OpenAiAdsExclusion["noImage"] = "no_image";
+})(OpenAiAdsExclusion || (exports.OpenAiAdsExclusion = OpenAiAdsExclusion = {}));
+var OpenAiAdsOutOfStockReason;
+(function (OpenAiAdsOutOfStockReason) {
+    OpenAiAdsOutOfStockReason["reserved"] = "reserved";
+    OpenAiAdsOutOfStockReason["soldFlag"] = "sold_flag";
+    OpenAiAdsOutOfStockReason["notInSnapshot"] = "not_in_snapshot";
+})(OpenAiAdsOutOfStockReason || (exports.OpenAiAdsOutOfStockReason = OpenAiAdsOutOfStockReason = {}));
+//# sourceMappingURL=openai-ads.interface.js.map

package/dist/interfaces/openai-ads.interface.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"openai-ads.interface.js","sourceRoot":"","sources":["../../src/interfaces/openai-ads.interface.ts"],"names":[],"mappings":";;;AAGa,QAAA,kBAAkB,GAAG;IAChC,SAAS;IACT,OAAO;IACP,aAAa;IACb,KAAK;IACL,OAAO;IACP,aAAa;IACb,WAAW;IACX,uBAAuB;IACvB,cAAc;IACd,OAAO;IACP,WAAW;IACX,iBAAiB;CACT,CAAC;AA4BX,IAAY,kBAWX;AAXD,WAAY,kBAAkB;IAC5B,oCAAc,CAAA;IACd,kDAA4B,CAAA;IAC5B,2CAAqB,CAAA;IACrB,oDAA8B,CAAA;IAC9B,0CAAoB,CAAA;IACpB,0CAAoB,CAAA;IACpB,4DAAsC,CAAA;IACtC,wDAAkC,CAAA;IAClC,sDAAgC,CAAA;IAChC,0CAAoB,CAAA;AACtB,CAAC,EAXW,kBAAkB,kCAAlB,kBAAkB,QAW7B;AAGD,IAAY,yBAKX;AALD,WAAY,yBAAyB;IACnC,kDAAqB,CAAA;IACrB,mDAAsB,CAAA;IAEtB,8DAAiC,CAAA;AACnC,CAAC,EALW,yBAAyB,yCAAzB,yBAAyB,QAKpC"}

package/dist/interfaces/params.interface.d.ts

@@ -18,6 +18,16 @@ export interface Params {
     publicationGateBqProject?: string;
     publicationGateBqDataset?: string;
     publicationGateBqTable?: string;
+    openAiAdsDryRun?: string;
+    openAiAdsSellerName?: string;
+    openAiAdsRetentionDays?: string;
+    openAiAdsImageConcurrency?: string;
+    feedGuardMinSourceItems?: string;
+    feedGuardMinPublishedItems?: string;
+    feedGuardMaxDropPercent?: string;
+    feedGuardMaxSourceAgeHours?: string;
+    feedGuardMaxStaleHours?: string;
+    feedGuardAcceptDrop?: string;
 }
 export interface FeedItemsBigQueryTarget {
     project: string;