@ak--47/dungeon-master 1.5.0 → 1.5.1

package/CHANGELOG.md

@@ -2,6 +2,49 @@
 
 All notable changes to `@ak--47/dungeon-master`.
 
+## 1.5.1 — 2026-05-20
+
+Quality + ergonomics release. No new analytical capabilities — fixes accumulated rough edges around concurrency, accuracy, profiles, and config ergonomics that surfaced after 1.5.0 shipped. Adds a generator-side retention shaper, exposes a config sub-object API for cleaner dungeon files, and restructures all 48 shipped dungeons to a canonical layout. Top-level keys keep working for back-compat.
+
+### Added
+
+- **`credentials` / `switches` / `identity` config sub-objects.** New ergonomic shape for grouping related dungeon keys: `credentials: { token, region, serviceAccount, serviceSecret, projectId }`, `switches: { hasLocation, hasCampaigns, hasSessionIds, hasAvatar, isAnonymous, ... }`, `identity: { avgDevicePerUser, sessionTimeout }`. `mergeConfigSubObjects` hoists sub-object values into top-level keys at validation time; top-level still wins when both set (with a verbose warn). Old flat top-level keys keep working — back-compat suite in `tests/unit/config-restructure.test.js`.
+- **`retentionCurve` config knob.** Generator-side retention shaper. Accepts an array of `{day, retention}` waypoints; the engine interpolates log-linearly to drop late events per user based on first-event age. Independent of `engagementDecay`. Enables analytical-style retention shapes (D1 80% → D7 50% → D30 20%) at dungeon-config level instead of via hooks.
+- **Per-macro `avgActiveDaysPerUser` defaults.** When `avgActiveDaysPerUser` is unset, defaults derived per macro: steady=15, growth=10, viral=20, decline=5, flat=20 (numDays/4 cap). Removes the need to hand-tune for every macro.
+- **`COUNT_DISTINCT` aggregation in `emulateBreakdown`** (`type: 'distinctCount'`). Mirrors Mixpanel's count-distinct measure for cohort sizing / unique-user breakdowns.
+- **`userSeed` config knob.** Separate distinct_id seed from the main `seed`. Lets you regenerate a dataset with a different event distribution while keeping the user pool stable across runs — useful for incremental data layering.
+- **`result.profilesPushed`** count exposed on the `Result` object. Reports how many profiles actually got pushed to `/engage` after `_drop` filtering.
+- **`runWithDataset(begin, now, fn)`** API for explicit dataset-window scoping (rare — most callers don't need this; in-process `generate()` calls now auto-scope via AsyncLocalStorage).
+
+### Changed
+
+- **Anonymous non-converters get `_drop: true` stamped on their profile.** Real-world Mixpanel `$identify` semantics — profiles only exist for users who actually identified. Born-in-dataset users who never reach an `isAuthEvent` step in their first funnel are anonymous: events still flow (tied to `device_id`), but no profile is pushed to `/engage`. `userProfilesData` still contains every profile object; `mixpanel-sender` filters `_drop:true` before push. Pre-existing users are considered already-identified and never get `_drop`. The `everything` hook can rescue a profile by `delete meta.profile._drop`.
+- **`numEvents` more accurate.** Removed dice rolls + `0.714` magic dampening from per-user budget computation; replaced with a clean `chance.normal(mean=budget, dev=budget/3)`. Old behavior overshot the target by 1.6-2x; new behavior matches the configured rate within ±3% across all 5 macros at 50K target. **If you previously tuned `avgEventsPerUserPerDay` around the old overshoot, expect ~40-60% fewer events at the same rate.** Recompute targets.
+- **Default `Platform` device property removed.** 59 entries commented out in `lib/templates/defaults.js` (15 iOS + 15 Android + 29 Desktop). `os` already carries the platform signal. If a dungeon reads `Platform` in hooks or downstream, you'll see undefined — define `Platform` explicitly in your event properties to opt back in.
+- **`hasAnonIds` deprecated.** Use `identity.avgDevicePerUser: 1` instead. The deprecated alias still works through 1.5.x: when `hasAnonIds: true` is set without an explicit `avgDevicePerUser`, the validator promotes to `avgDevicePerUser: 1`.
+- **`DATASET_NOW` / `DATASET_BEGIN` scoped via AsyncLocalStorage.** No more module-level mutable globals. In-process concurrent `generate()` calls with different `datasetStart`/`datasetEnd` windows now produce isolated, in-window output. Legacy `setDatasetNow` / `setDatasetBegin` setters remain as back-compat shims.
+- **UTC bare-date parsing** for `datasetStart` / `datasetEnd`. `"2026-01-01"` parses as `2026-01-01T00:00:00Z`, not as local-midnight (which shifted the window by UTC offset).
+- **Quiet by default.** `verbose: false` (default) now gates all warnings, info logs, and dataset-context messages. Set `verbose: true` to opt back into the chatty output.
+- **GCS upload retry hardening.** 10 retries with exponential backoff, 10-minute total budget. Handles transient cloud upload failures without giving up.
+- **>64K user runs no longer crash V8.** Internal data structure swap (`Array` for sparse-keyed maps) eliminates V8 limit hit at high user counts.
+- **All 48 shipped dungeons restructured to canonical layout.** Sections in fixed order: IMPORTS → OVERVIEW → HOOK STORIES → SCALE → KNOBS → DATA ARRAYS → HOOK STATE → HELPER FUNCTIONS → CONFIG. Hook stories preserve full per-hook Mixpanel report docs; `config.hook` becomes a thin dispatcher delegating to per-type helpers (`handleEventHooks`, `handleEverythingHooks`, etc.). Zero behavioral changes — every dungeon's seed-pinned output is unchanged.
+- **All 49 dungeons + ~18 test fixtures migrated to the new sub-object API.** Cosmetic adoption only — `mergeConfigSubObjects` already supported both shapes since Phase 1.
+
+### Fixed
+
+- **Standalone events now stamp `config.superProps`.** Was silently `{}` before — masked by the validator's auto-funnel pre-fix in 1.5.0. Surfaced by the `numEvents` overshoot fix when the `useFunnel` gate started routing more users to the standalone path.
+- **Born-late funnel auth events past `FIXED_NOW` no longer set `userAuthTimeMs`.** Engine drops the event at storage time (`funnels.js:640`) but previously still recorded the auth-time, marking the user as authed without a real sign_up event. Fix gates `authTimeMs` on `!_drop` (`funnels.js:328`). Affected 1-2% of users in test runs.
+- **Pre-existing user events strict-clamp at `FIXED_BEGIN`.** Born-outside-window users no longer leak events into the pre-dataset window via TimeSoup's sub-window distribution.
+
+### Docs
+
+- **HOOKS.md targeted edits.** Recipe 4.25 (First-Touch Attribution Bias) gains a v1.5 note pointing to Recipe 4.26's OVERWRITE pattern when `hasCampaigns: true`. Atom catalog gains a footnote that `injectBetween` / `injectBurst` / `injectAfterEvent` / `injectOnNewDays` no longer require trailing `record.sort(...)` calls — covered by `autoSortAfterEverything: true` default since 1.5.0.
+- **`docs/guides/1.5.1-upgrade-guide.md`** — TL;DR + per-change action items for existing dungeon authors.
+
+### Infra
+
+- 95+ commits across the branch; 1269 vitest tests pass; engine canary 10/10; engine-shape full sweep 194/194; smoke test 20/20 verticals; 5-vertical hook verifier matches Sprint 1 baseline (ecommerce 10/10, fitness 12/12, sass 10/10, social 11/11, dating 11/13 pre-existing small-mode artifacts).
+
 ## 1.5.0 — 2026-05-08
 
 The "count and verify like Mixpanel does" release. Aligns BOTH the data generation engine AND the verifier with Mixpanel's actual counting semantics — greedy single-pass funnels, distinct-period frequency counting, null-aware aggregation, touchpoint-capped attribution, identity merge, retention, sessions, time-bucketed trends. Removes `bunchIntoSessions`, the root cause of funnel ordering corruption since 1.0.

package/HOOKS.md

@@ -1183,6 +1183,13 @@ first-touch result as stamping 10 — Mixpanel's attribution module
 (`attributed_value_reader.cpp`) only considers `TOUCHPOINTS_LIMIT = 10`. Aim
 for sparse, deterministic touches.
 
+**v1.5 with `hasCampaigns: true`:** when the engine has already stamped UTMs
+on up to `maxTouchpointsPerUser` events per user (default 10), DO NOT stamp
+fresh touches in your hook — they'd push the user past the cap and fall
+outside Mixpanel's last-10 window. Use [Recipe 4.26](#426-bias-engine-stamped-touches-v15)
+to OVERWRITE the engine's `utm_source` on the existing stamped events
+instead. See [§2.4](#24-attribution-caps-at-10-touchpoints).
+
 ---
 
 #### 4.26 Bias Engine-Stamped Touches (v1.5)
@@ -1326,6 +1333,12 @@ Import from `@ak--47/dungeon-master/hook-helpers`:
 | `isPreAuthEvent` | identity | `(event, authTime) -> boolean` | Check if before user's stitch |
 | `splitByAuth` | identity | `(events, authTime) -> { preAuth, postAuth, stitch }` | Partition by auth boundary |
 
+**Inject atoms + v1.5:** the engine auto-sorts events by time after the
+`everything` hook (`autoSortAfterEverything: true` default — see Principle
+26). Hooks using `injectBetween` / `injectBurst` / `injectAfterEvent` /
+`injectOnNewDays` no longer need a trailing `record.sort(...)` to keep the
+greedy funnel engine happy.
+
 Full JSDoc in [`lib/hook-helpers/*.js`](lib/hook-helpers/).
 
 ---

package/dungeons/technical/ad-spend.js

@@ -1,59 +1,51 @@
-// ── TWEAK THESE ──
-const SEED = "ad spend test";
-const num_days = 90;
-const num_users = 1_000;
-const avg_events_per_user_per_day = 0.56;
-let token = "";
-
-// ── env overrides ──
-if (process.env.MP_TOKEN) token = process.env.MP_TOKEN;
-
-import Chance from 'chance';
-let chance = new Chance();
-import dayjs from "dayjs";
-import utc from "dayjs/plugin/utc.js";
-dayjs.extend(utc);
-import { uid, comma } from 'ak-tools';
-import { weighNumRange, date, integer, weighChoices } from "../../lib/utils/utils.js";
-
+// ── IMPORTS ──
+import { weighNumRange } from "../../lib/utils/utils.js";
 /** @typedef {import("../../types").Dungeon} Config */
-/**
- * ═══════════════════════════════════════════════════════════════
- * TECHNICAL TEST: Ad Spend & Campaign Attribution
- * ═══════════════════════════════════════════════════════════════
- *
- * Tests Mixpanel ad spend data generation and campaign attribution.
- * - 1,000 users, 50K events, 90 days
- * - hasAdSpend: true — generates cost, CPC, CTR, impressions, clicks
- * - hasCampaigns: true — adds UTM parameters to events
- * - hasBrowser: true — required for campaign tracking
- * - 6 events: signup, page view, purchase, ad click, search, share
- *
- * No hooks. Focus is on verifying ad spend event structure
- * and campaign attribution properties flow through correctly.
+
+// ── OVERVIEW ──
+/*
+ * NAME:       ad-spend
+ * PURPOSE:    exercises hasAdSpend + hasCampaigns — generates cost/CPC/CTR/impressions/clicks + UTM attribution
+ * SCALE:      1,000 users, ~50K events, 90 days
+ * EVENTS (6): sign up, page view, purchase, ad click, search, share
+ * FUNNELS (0): none
  */
 
-/** @type {import('../../types').Dungeon} */
+// ── SCALE ──
+const SEED = "ad spend test";
+const NUM_DAYS = 90;
+const NUM_USERS = 1_000;
+const EVENTS_PER_DAY = 0.56;
+const token = process.env.MP_TOKEN || "";
+
+// ── CONFIG ──
+/** @type {Config} */
 const config = {
-	token,
 	seed: SEED,
 	name: "ad-spend",
-	numDays: num_days,
-	avgEventsPerUserPerDay: avg_events_per_user_per_day,
-	numUsers: num_users,
+	numDays: NUM_DAYS,
+	avgEventsPerUserPerDay: EVENTS_PER_DAY,
+	numUsers: NUM_USERS,
 	format: 'json',
-	region: "US",
-	hasAnonIds: true,
-	hasSessionIds: true,
-	hasAdSpend: true,
-	hasLocation: false,
-	hasAndroidDevices: false,
-	hasIOSDevices: false,
-	hasDesktopDevices: true,
-	hasBrowser: true,
-	hasCampaigns: true,
-	isAnonymous: false,
-	alsoInferFunnels: false,
+	credentials: {
+		token,
+		region: "US",
+	},
+	switches: {
+		hasSessionIds: true,
+		hasAdSpend: true,
+		hasLocation: false,
+		hasAndroidDevices: false,
+		hasIOSDevices: false,
+		hasDesktopDevices: true,
+		hasBrowser: true,
+		hasCampaigns: true,
+		isAnonymous: false,
+		alsoInferFunnels: false,
+	},
+	identity: {
+		avgDevicePerUser: 1,
+	},
 	concurrency: 1,
 	writeToDisk: false,
 

package/dungeons/technical/anonymous-users.js

@@ -1,50 +1,52 @@
-// ── TWEAK THESE ──
+// ── IMPORTS ──
+import Chance from 'chance';
+let chance = new Chance();
+import { weighNumRange, weighChoices } from "../../lib/utils/utils.js";
+/** @typedef {import("../../types").Dungeon} Config */
+
+// ── OVERVIEW ──
+/*
+ * NAME:       anonymous-users
+ * PURPOSE:    Anonymous-user mode fixture — exercises isAnonymous + hasAnonIds + anon-to-identified flow
+ * SCALE:      1,000 users, ~50K events, 180 days
+ * EVENTS (5): page view, signup, feature used, purchase, button click
+ * FUNNELS (0): none
+ */
+
+// ── SCALE ──
 const SEED = "anonymous-users";
 const num_days = 180;
 const num_users = 1_000;
 const avg_events_per_user_per_day = 0.28;
-let token = "";
-
-// ── env overrides ──
-if (process.env.MP_TOKEN) token = process.env.MP_TOKEN;
-
-/**
- * Anonymous Users — tests anonymous user mode, anonIds, and identity merge.
- *
- * Exercises: isAnonymous mode, hasAnonIds for anonymous-to-identified
- * user flows, long 180-day timespan for tail behavior.
- *
- * - 1000 users, 50K events, 180 days
- * - isAnonymous: true, hasAnonIds: true
- * - Simple events with signup as isFirstEvent (identity resolution point)
- * - No hooks, minimal config
- */
-
-import Chance from 'chance';
-let chance = new Chance();
-import { weighNumRange, weighChoices } from "../../lib/utils/utils.js";
+const token = process.env.MP_TOKEN || "";
 
-/** @typedef {import("../../types").Dungeon} Config */
-/** @type {import('../../types').Dungeon} */
+// ── CONFIG ──
+/** @type {Config} */
 const config = {
-	token,
 	seed: SEED,
 	numDays: num_days,
 	avgEventsPerUserPerDay: avg_events_per_user_per_day,
 	numUsers: num_users,
 	format: "json",
-	region: "US",
-	isAnonymous: true,
-	hasAnonIds: true,
-	hasSessionIds: true,
-	hasAdSpend: false,
-	hasLocation: false,
-	hasAndroidDevices: true,
-	hasIOSDevices: true,
-	hasDesktopDevices: true,
-	hasBrowser: true,
-	hasCampaigns: false,
-	alsoInferFunnels: false,
+	credentials: {
+		token,
+		region: "US",
+	},
+	switches: {
+		isAnonymous: true,
+		hasSessionIds: true,
+		hasAdSpend: false,
+		hasLocation: false,
+		hasAndroidDevices: true,
+		hasIOSDevices: true,
+		hasDesktopDevices: true,
+		hasBrowser: true,
+		hasCampaigns: false,
+		alsoInferFunnels: false,
+	},
+	identity: {
+		avgDevicePerUser: 1,
+	},
 	concurrency: 1,
 	writeToDisk: false,
 

package/dungeons/technical/array-of-object-lookup.js

@@ -1,40 +1,24 @@
-// ── TWEAK THESE ──
-const SEED = "dm4-array-of-object-lookup";
-const num_days = 60;
-const num_users = 1_000;
-const avg_events_per_user_per_day = 1.67;
-let token = "";
-
-// ── env overrides ──
-if (process.env.MP_TOKEN) token = process.env.MP_TOKEN;
-
-import Chance from 'chance';
-let chance = new Chance();
+// ── IMPORTS ──
+import Chance from "chance";
 import dayjs from "dayjs";
 import utc from "dayjs/plugin/utc.js";
 dayjs.extend(utc);
-import { uid, comma } from 'ak-tools';
-import { weighNumRange, date, integer, weighChoices } from "../../lib/utils/utils.js";
-
+import { weighNumRange, integer, weighChoices } from "../../lib/utils/utils.js";
 /** @typedef {import("../../types").Dungeon} Config */
-const videoCategories = ["funny", "educational", "inspirational", "music", "news", "sports", "cooking", "DIY", "travel", "gaming"];
-const spiritAnimals = ["duck", "dog", "otter", "penguin", "cat", "elephant", "lion", "cheetah", "giraffe", "zebra", "rhino", "hippo", "whale", "dolphin", "shark", "octopus", "squid", "jellyfish", "starfish", "seahorse", "crab", "lobster", "shrimp", "clam", "snail", "slug", "butterfly", "moth", "bee", "wasp", "ant", "beetle", "ladybug", "caterpillar", "centipede", "millipede", "scorpion", "spider", "tarantula", "tick", "mite", "mosquito", "fly", "dragonfly", "damselfly", "grasshopper", "cricket", "locust", "mantis", "cockroach", "termite", "praying mantis", "walking stick", "stick bug", "leaf insect", "lacewing", "aphid", "cicada", "thrips", "psyllid", "scale insect", "whitefly", "mealybug", "planthopper", "leafhopper", "treehopper", "flea", "louse", "bedbug", "flea beetle", "weevil", "longhorn beetle", "leaf beetle", "tiger beetle", "ground beetle", "lady beetle", "firefly", "click beetle", "rove beetle", "scarab beetle", "dung beetle", "stag beetle", "rhinoceros beetle", "hercules beetle", "goliath beetle", "jewel beetle", "tortoise beetle"];
 
-/**
- * ═══════════════════════════════════════════════════════════════
- * DATASET OVERVIEW
- * ═══════════════════════════════════════════════════════════════
- *
- * Array-of-Object Lookup Test — tests nested product arrays in events.
- * - 1,000 users over 60 days, ~100K events
- * - Events: checkout (cart array), add to cart, view/save item (single item)
- * - Lookup table: 1,000 products with price, category, descriptor
- * - Tests Mixpanel's array-of-objects property handling
- *
- * ═══════════════════════════════════════════════════════════════
- * ANALYTICS HOOKS (3 patterns)
- * ═══════════════════════════════════════════════════════════════
- *
+// ── OVERVIEW ──
+/*
+ * NAME:       array-of-object-lookup
+ * PURPOSE:    Exercises nested product arrays in events plus a lookup table
+ *             keyed by product_id with rich attributes.
+ * SCALE:      1,000 users, ~100K events, 60 days
+ * EVENTS (4): checkout (cart array), add to cart, view item, save item (single item)
+ * FUNNELS (0): none
+ * LOOKUPS (1): product_id (1,000 entries; amount, quantity, featured, category, descriptor)
+ */
+
+// ── HOOK STORIES ──
+/*
  * 1. COUPON DISCOUNT TAGGING (event hook)
  *    Checkout events with coupons get discount_applied: true and
  *    discount_percent extracted from the coupon string.
@@ -48,27 +32,124 @@ const spiritAnimals = ["duck", "dog", "otter", "penguin", "cat", "elephant", "li
  *    events tagged user_segment: "window_shopper".
  */
 
-/** @type {import('../types.js').Dungeon} */
+// ── SCALE ──
+const SEED = "dm4-array-of-object-lookup";
+const NUM_DAYS = 60;
+const NUM_USERS = 1_000;
+const EVENTS_PER_DAY = 1.67;
+const token = process.env.MP_TOKEN || "";
+
+const chance = new Chance();
+
+// ── DATA ARRAYS ──
+const spiritAnimals = ["duck", "dog", "otter", "penguin", "cat", "elephant", "lion", "cheetah", "giraffe", "zebra", "rhino", "hippo", "whale", "dolphin", "shark", "octopus", "squid", "jellyfish", "starfish", "seahorse", "crab", "lobster", "shrimp", "clam", "snail", "slug", "butterfly", "moth", "bee", "wasp", "ant", "beetle", "ladybug", "caterpillar", "centipede", "millipede", "scorpion", "spider", "tarantula", "tick", "mite", "mosquito", "fly", "dragonfly", "damselfly", "grasshopper", "cricket", "locust", "mantis", "cockroach", "termite", "praying mantis", "walking stick", "stick bug", "leaf insect", "lacewing", "aphid", "cicada", "thrips", "psyllid", "scale insect", "whitefly", "mealybug", "planthopper", "leafhopper", "treehopper", "flea", "louse", "bedbug", "flea beetle", "weevil", "longhorn beetle", "leaf beetle", "tiger beetle", "ground beetle", "lady beetle", "firefly", "click beetle", "rove beetle", "scarab beetle", "dung beetle", "stag beetle", "rhinoceros beetle", "hercules beetle", "goliath beetle", "jewel beetle", "tortoise beetle"];
+
+// ── HELPER FUNCTIONS ──
+function makeProducts(maxItems = 5) {
+	return function () {
+		const categories = ["electronics", "books", "clothing", "home", "garden", "toys", "sports", "automotive", "beauty", "health", "grocery", "jewelry", "shoes", "tools", "office supplies"];
+		const descriptors = ["brand new", "open box", "refurbished", "used", "like new", "vintage", "antique", "collectible"];
+		const suffix = ["item", "product", "good", "merchandise", "thing", "object", "widget", "gadget", "device", "apparatus", "contraption", "instrument", "tool", "implement", "utensil", "appliance", "machine", "equipment", "gear", "kit", "set", "package"];
+		const assetPreview = ['.png', '.jpg', '.jpeg', '.heic', '.mp4', '.mov', '.avi'];
+		const data = [];
+		const numOfItems = integer(1, maxItems);
+
+		for (var i = 0; i < numOfItems; i++) {
+			const category = chance.pickone(categories);
+			const descriptor = chance.pickone(descriptors);
+			const suffixWord = chance.pickone(suffix);
+			const slug = `${descriptor.replace(/\s+/g, '-').toLowerCase()}-${suffixWord.replace(/\s+/g, '-').toLowerCase()}`;
+			const asset = chance.pickone(assetPreview);
+
+			const price = integer(1, 100);
+			const quantity = integer(1, 5);
+			const product_id = integer(1, 1_000);
+
+			const item = {
+				product_id: product_id,
+				product_url: `https://example.com/assets/${product_id}`,
+			};
+
+			data.push(item);
+		}
+
+		return () => [data];
+	};
+}
+
+function flip(likelihood = 50) {
+	return chance.bool({ likelihood });
+}
+
+function handleEventHooks(record) {
+	// Pattern 1: Checkouts with coupons get a discount_applied flag and adjusted total
+	if (record.event === "checkout" && record.coupon && record.coupon !== "none") {
+		record.discount_applied = true;
+		const pctMatch = record.coupon.match(/(\d+)%/);
+		if (pctMatch) {
+			record.discount_percent = parseInt(pctMatch[1]);
+		}
+	}
+
+	// Pattern 2: "save item" events on weekends are tagged as wishlist behavior
+	if (record.event === "save item") {
+		const dow = dayjs(record.time).day();
+		if (dow === 0 || dow === 6) {
+			record.save_context = "weekend_browse";
+		} else {
+			record.save_context = "weekday_intent";
+		}
+	}
+
+	return record;
+}
+
+function handleEverythingHooks(record, meta) {
+	const profile = meta.profile;
+	record.forEach(e => {
+		e.theme = profile.theme;
+	});
+
+	// Pattern 3: Users who view 5+ items but never checkout are tagged as window shoppers
+	const views = record.filter(e => e.event === "view item").length;
+	const checkouts = record.filter(e => e.event === "checkout").length;
+	if (views >= 5 && checkouts === 0) {
+		for (const e of record) {
+			e.user_segment = "window_shopper";
+		}
+	}
+
+	return record;
+}
+
+// ── CONFIG ──
+/** @type {Config} */
 const config = {
-	token,
 	seed: SEED,
 	name: "array-of-object-lookup",
-	numDays: num_days,
-	avgEventsPerUserPerDay: avg_events_per_user_per_day,
-	numUsers: num_users,
-	format: 'json', //csv or json
-	region: "US",
-	hasAnonIds: true, //if true, anonymousIds are created for each user
-	hasSessionIds: true, //if true, hasSessionIds are created for each user
-	hasAdSpend: false,
-	hasLocation: true,
-	hasAndroidDevices: false,
-	hasIOSDevices: false,
-	hasDesktopDevices: true,
-	hasBrowser: true,
-	hasCampaigns: false,
-	isAnonymous: false,
-	alsoInferFunnels: true,
+	numDays: NUM_DAYS,
+	avgEventsPerUserPerDay: EVENTS_PER_DAY,
+	numUsers: NUM_USERS,
+	format: 'json',
+	credentials: {
+		token,
+		region: "US",
+	},
+	switches: {
+		hasSessionIds: true,
+		hasAdSpend: false,
+		hasLocation: true,
+		hasAndroidDevices: false,
+		hasIOSDevices: false,
+		hasDesktopDevices: true,
+		hasBrowser: true,
+		hasCampaigns: false,
+		isAnonymous: false,
+		alsoInferFunnels: true,
+	},
+	identity: {
+		avgDevicePerUser: 1,
+	},
 	concurrency: 1,
 	writeToDisk: false,
 	events: [
@@ -108,28 +189,18 @@ const config = {
 				save_context: ["weekday_intent"],
 				user_segment: ["regular"],
 			}
-		}		
+		}
 	],
-	funnels: [	],
+	funnels: [],
 	superProps: {
 		theme: ["light", "dark", "custom", "light", "dark"],
 	},
-	/*
-	user properties work the same as event properties
-	each key should be an array or function reference
-	*/
 	userProps: {
 		theme: ["light", "dark", "custom", "light", "dark"],
-		// title: chance.profession.bind(chance),
-		// luckyNumber: weighNumRange(1, 500, .3),
 		spiritAnimal: spiritAnimals
 	},
 	scdProps: {},
 	mirrorProps: {},
-	/*
-	for group analytics keys, we need an array of arrays [[],[],[]]
-	each pair represents a group_key and the number of profiles for that key
-	*/
 	groupKeys: [],
 	groupProps: {},
 	lookupTables: [{
@@ -141,101 +212,13 @@ const config = {
 			featured: flip,
 			category: ["electronics", "books", "clothing", "home", "garden", "toys", "sports", "automotive", "beauty", "health", "grocery", "jewelry", "shoes", "tools", "office supplies"],
 			descriptor: ["brand new", "open box", "refurbished", "used", "like new", "vintage", "antique", "collectible"]
-			
 		}
-
 	}],
 	hook: function (record, type, meta) {
-
-		if (type === "event") {
-			// Pattern 1: Checkouts with coupons get a discount_applied flag and adjusted total
-			if (record.event === "checkout" && record.coupon && record.coupon !== "none") {
-				record.discount_applied = true;
-				const pctMatch = record.coupon.match(/(\d+)%/);
-				if (pctMatch) {
-					record.discount_percent = parseInt(pctMatch[1]);
-				}
-			}
-
-			// Pattern 2: "save item" events on weekends are tagged as wishlist behavior
-			if (record.event === "save item") {
-				const dow = dayjs(record.time).day();
-				if (dow === 0 || dow === 6) {
-					record.save_context = "weekend_browse";
-				} else {
-					record.save_context = "weekday_intent";
-				}
-			}
-		}
-
-		if (type === "everything") {
-			const profile = meta.profile;
-			record.forEach(e => {
-				e.theme = profile.theme;
-			});
-
-			// Pattern 3: Users who view 5+ items but never checkout are tagged as window shoppers
-			const views = record.filter(e => e.event === "view item").length;
-			const checkouts = record.filter(e => e.event === "checkout").length;
-			if (views >= 5 && checkouts === 0) {
-				for (const e of record) {
-					e.user_segment = "window_shopper";
-				}
-			}
-		}
-
+		if (type === "event") return handleEventHooks(record);
+		if (type === "everything") return handleEverythingHooks(record, meta);
 		return record;
 	}
 };
 
-function makeProducts(maxItems = 5) {
-	return function () {
-		const categories = ["electronics", "books", "clothing", "home", "garden", "toys", "sports", "automotive", "beauty", "health", "grocery", "jewelry", "shoes", "tools", "office supplies"];
-		const descriptors = ["brand new", "open box", "refurbished", "used", "like new", "vintage", "antique", "collectible"];
-		const suffix = ["item", "product", "good", "merchandise", "thing", "object", "widget", "gadget", "device", "apparatus", "contraption", "instrument", "tool", "implement", "utensil", "appliance", "machine", "equipment", "gear", "kit", "set", "package"];
-		const assetPreview = ['.png', '.jpg', '.jpeg', '.heic', '.mp4', '.mov', '.avi'];
-		const data = [];
-		const numOfItems = integer(1, maxItems);
-
-		for (var i = 0; i < numOfItems; i++) {
-			const category = chance.pickone(categories);
-			const descriptor = chance.pickone(descriptors);
-			const suffixWord = chance.pickone(suffix);
-			const slug = `${descriptor.replace(/\s+/g, '-').toLowerCase()}-${suffixWord.replace(/\s+/g, '-').toLowerCase()}`;
-			const asset = chance.pickone(assetPreview);
-
-			// const product_id = chance.guid();
-			const price = integer(1, 100);
-			const quantity = integer(1, 5);
-			const product_id = integer(1, 1_000);
-
-			const item = {
-				product_id: product_id,
-				product_url: `https://example.com/assets/${product_id}`,
-				// sku: integer(11111, 99999),
-				// amount: price,
-				// quantity: quantity,
-				// total_value: price * quantity,
-				// featured: chance.pickone([true, false, false]),
-				// category: category,
-				// descriptor: descriptor,
-				// slug: slug,
-				
-				// assetType: asset
-
-			};
-
-			data.push(item);
-		}
-
-		return () => [data];
-	};
-};
-
-
-function flip(likelihood = 50) {
-	return chance.bool({ likelihood });
-}
-
-
-export default config;
+export default config;