backend-manager 5.8.1 → 5.8.3

package/CHANGELOG.md

@@ -14,6 +14,28 @@ The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/).
 - `Fixed` for any bug fixes.
 - `Security` in case of vulnerabilities.
 
+# [5.8.3] - 2026-06-19
+
+### Fixed
+- **Ghostii feed tracking timestamps.** `trackFeedItem` now uses BEM's standard `metadata.{created,updated}` with `timestamp` (ISO) and `timestampUNIX` (seconds) instead of `FieldValue.serverTimestamp()`, which failed in the emulator context.
+
+### Changed
+- **Firestore collection rename.** `ghostii-feed-items` → `ghostii-sources` for clarity and consistency with the OMEGA naming convention.
+- **Extended feed test coverage.** Added 5 marketing/social feeds (Social Media Examiner, Hootsuite, Sprout Social, Buffer, Digiday) to the real-feed integration test. Threshold bumped from 2/3 to 5/7.
+
+# [5.8.2] - 2026-06-19
+
+### Fixed
+- **Setup crash on fresh projects.** `npx mgr setup` crashed with `Cannot read properties of undefined (reading 'default')` when `.firebaserc`, `firebase.json`, or `backend-manager-config.json` didn't exist. Setup now scaffolds all three from templates before reading from them.
+- **`engines.node` hard crash.** Missing `engines.node` in `package.json` threw an unrecoverable error. Now auto-fixes it using the current Node.js major version.
+- **`dependencies['backend-manager']` crash.** The local-BEM detection crashed when `backend-manager` was listed in `devDependencies` instead of `dependencies`.
+
+### Changed
+- **Unified scaffold pass.** Consolidated config scaffolding, `engines.node` fix, and doc defaults into one `[DEFAULTS]` section with a single file reload afterwards. Eliminates scattered scaffolding steps and conditional re-loads.
+
+### Added
+- **`templates/firebase.json`** — standard Firebase config template (hosting, functions, firestore, database, storage, emulators) scaffolded into new projects by `npx mgr setup`.
+
 # [5.8.1] - 2026-06-19
 
 ### Fixed

package/CLAUDE.md

@@ -18,7 +18,7 @@ Backend Manager (BEM) is a comprehensive framework for building modern Firebase
 ### For Consuming Projects
 
 1. `npm install backend-manager --save-dev` (inside `functions/`)
-2. `npx mgr setup` — validates config, scaffolds defaults (CLAUDE.md, CHANGELOG.md, docs/, test/), provisions Firestore indexes
+2. `npx mgr setup` — bootstraps a new project (scaffolds `.firebaserc`, `firebase.json`, `backend-manager-config.json`, `engines.node`, CLAUDE.md, CHANGELOG.md, docs/, test/), validates config, provisions Firestore indexes
 3. `npx mgr emulator` — start Firebase emulators (auth/firestore/functions/database/storage)
 4. `npx mgr serve` — local serve with Stripe webhook forwarding (if `STRIPE_SECRET_KEY` is set)
 5. `npx mgr test` — runs framework + project test suites against an emulator. Positional target(s) select which test FILES run, by source + path (multiple space-separated targets compose):
@@ -64,7 +64,7 @@ Every feature ships with tests at EVERY surface it exposes — logic (`test/rout
 
 | Command | Description |
 |---|---|
-| `setup` | Validate config, scaffold defaults (CLAUDE.md, CHANGELOG.md, docs/, test/), provision Firestore indexes |
+| `setup` | Bootstrap new projects (scaffolds config files + doc defaults), validate config, provision Firestore indexes |
 | `emulator` | Start Firebase emulators (auth/firestore/functions/database/storage) |
 | `serve` | Local Firebase serve (with auto Stripe webhook forwarding if keys set) |
 | `watch` | Auto-reload functions on file change |

package/PROGRESS.md

@@ -2,13 +2,23 @@
 > Agents and maintainers should update this file regularly to reflect the current state of the project.
 
 ## 🎯 Current Focus
-* **Goal:** RSS/Atom feed-based article generation for the Ghostii system
-* **Current Phase:** Shipped
-* **Priority:** Complete
-* **Last Updated:** 2026-06-18 7:30 PM PDT
-* **Notes:** BEM v5.8.0 published to npm. Ghostii-backend v1.0.5 deployed to Firebase. All code, tests, and docs shipped.
+* **Goal:** Ghostii feed sources cleanup + Somiibo consumer config
+* **Current Phase:** Fixes applied + tested, pending commit + publish
+* **Priority:** High
+* **Last Updated:** 2026-06-19 3:05 AM PDT
+* **Notes:** Renamed Firestore collection `ghostii-feed-items` → `ghostii-sources`. Fixed `FieldValue.serverTimestamp()` → BEM metadata pattern. Added 5 marketing/social feeds to extended tests. All tests passing (20/20 standard, 9/9 extended). Somiibo consumer has feeds configured + `ghostii-sources.md` evaluation doc. Needs BEM publish + consumer deploy.
 
 ## 📌 Active Task List
+* [ ] Phase 6: Setup scaffolds essential configs for fresh projects
+  * [x] Task 6.1: Add `templates/firebase.json` standard template
+  * [x] Task 6.2: Add `scaffoldConfigs()` + `resolveProjectId()` to setup.js (runs before config resolution)
+  * [x] Task 6.3: Auto-fix `engines.node` instead of throwing
+  * [x] Task 6.4: Fix `dependencies['backend-manager']` crash when BEM is in devDependencies
+  * [x] Task 6.5: Verify fix on truly bare project (dailyembers-backend — 13/14 pass, only service-account expected)
+  * [x] Task 6.6: Optimize — consolidate scattered scaffolding into one `[DEFAULTS]` pass with `loadFiles()` DRY extraction
+  * [x] Task 6.7: Regression test on existing project (ultimate-jekyll-backend — all pass)
+  * [x] Task 6.8: Update docs (CLAUDE.md, CHANGELOG.md)
+  * [ ] Task 6.9: Publish new BEM version
 * [ ] Phase 5: Ghostii feed-based article system
   * [x] Task 5.1: Create `feed-parser.js` (RSS 2.0, Atom 1.0, JSON Feed parser + article extractor)
   * [x] Task 5.2: Add `fast-xml-parser` dependency to BEM

package/docs/ghostii.md

@@ -46,27 +46,30 @@ Each `ghostii[]` entry has a `sources` array. The cron picks one at random per a
 ### Feed source flow
 
 1. Fetch and parse the RSS/Atom/JSON feed via `feed-parser.parseFeed()`
-2. Query `ghostii-feed-items` in Firestore for already-processed items
+2. Query `ghostii-sources` in Firestore for already-processed items
 3. Filter to unprocessed items, pick the newest
 4. Extract full article content from the item URL via `feed-parser.extractArticleContent()`
 5. Pass extracted text as `sourceContent` to the Ghostii API (separate from the `description` prompt)
-6. After publish, write a tracking doc to `ghostii-feed-items/{hash}`
+6. After publish, write a tracking doc to `ghostii-sources/{hash}`
 7. On failure (feed unreachable, unparseable, exhausted): fall back to `$app` behavior
 
 ### Feed item tracking
 
-Collection: `ghostii-feed-items` (consumer project Firestore)
+Collection: `ghostii-sources` (consumer project Firestore)
 
 ```js
-ghostii-feed-items/{sha256(feedUrl + '::' + itemId).slice(0,20)}: {
+ghostii-sources/{sha256(feedUrl + '::' + itemId).slice(0,20)}: {
   feedUrl: 'https://...',
   itemId: 'guid-or-url',
   itemUrl: 'https://...',
   itemTitle: '...',
-  processedAt: Timestamp,
   brandId: '...',
   postUrl: '...',
   postSlug: '...',
+  metadata: {
+    created: { timestamp: '...ISO...', timestampUNIX: 1234567890 },
+    updated: { timestamp: '...ISO...', timestampUNIX: 1234567890 },
+  },
   metadata: { created: Timestamp },
 }
 ```

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "backend-manager",
-  "version": "5.8.1",
+  "version": "5.8.3",
   "description": "Quick tools for developing Firebase functions",
   "main": "src/manager/index.js",
   "bin": {

package/src/cli/commands/setup.js

@@ -70,14 +70,8 @@ class SetupCommand extends BaseCommand {
     // prints it on a hard failure; we print it here on success).
     self.setupSummary = new ui.Summary().start();
 
-    // Load files
-    self.package = loadJSON(`${self.firebaseProjectPath}/functions/package.json`);
-    self.firebaseJSON = loadJSON(`${self.firebaseProjectPath}/firebase.json`);
-    self.firebaseRC = loadJSON(`${self.firebaseProjectPath}/.firebaserc`);
-    self.remoteconfigJSON = loadJSON(`${self.firebaseProjectPath}/functions/remoteconfig.template.json`);
-    self.projectPackage = loadJSON(`${self.firebaseProjectPath}/package.json`);
-    self.bemConfigJSON = loadJSON(`${self.firebaseProjectPath}/functions/backend-manager-config.json`);
-    self.gitignore = jetpack.read(`${self.firebaseProjectPath}/.gitignore`) || '';
+    // Initial load — returns {} for missing files so scaffold checks can run.
+    this.loadFiles();
 
     // Check if package exists
     if (!hasContent(self.package)) {
@@ -93,12 +87,23 @@ class SetupCommand extends BaseCommand {
       process.exit(1);
     }
 
-    // Load the rules files
-    this.getRulesFile();
+    // One unified scaffold pass: config files, package.json fixes, doc defaults.
+    // Everything that creates/fixes files goes here, BEFORE any code reads from
+    // them. One reload afterwards picks up the final state.
+    ui.section('Defaults');
+    this.scaffoldConfigs();
+    this.scaffoldPackageJson();
+    this.copyDefaults();
+    this.loadFiles();
+
+    // Clean up leftover trigger files + stale log files from older BEM versions
+    this.cleanupGeneratedArtifacts();
 
+    // Load the rules files (reads from BEM's own templates/, not consumer files)
+    this.getRulesFile();
     self.default.rulesVersionRegex = new RegExp(`///---version=${self.default.version}---///`);
 
-    // Set project info
+    // Resolve project info — safe now, scaffoldConfigs guarantees these exist.
     self.projectId = self.firebaseRC.projects.default;
     self.projectUrl = `https://console.firebase.google.com/project/${self.projectId}`;
     self.apiUrl = `https://api.${(self.bemConfigJSON.brand?.url || '').replace(/^https?:\/\//, '')}`;
@@ -110,24 +115,15 @@ class SetupCommand extends BaseCommand {
     ui.field('Project', self.projectId, { pad: 9 });
     ui.field('API', self.apiUrl, { pad: 9, valueColor: chalk.cyan });
 
-    if (!self.package || !self.package.engines || !self.package.engines.node) {
-      throw new Error('Missing <engines.node> in package.json');
-    }
-
-    // Clean up leftover trigger files + stale log files from older BEM versions
-    this.cleanupGeneratedArtifacts();
-
-    // Copy / merge defaults into consumer project root (matches EM/BXM/UJM pattern).
-    // Runs BEFORE tests so any test that inspects scaffolded files sees the merged state.
-    ui.section('Defaults');
-    this.copyDefaults();
-
     // Run all tests
     ui.section('Checks');
     await this.runTests();
 
     // Warn if using local backend-manager
-    if (self.package.dependencies['backend-manager'].includes('file:')) {
+    const bemDep = self.package.dependencies?.['backend-manager']
+      || self.package.devDependencies?.['backend-manager']
+      || '';
+    if (bemDep.includes('file:')) {
       ui.section('Notices');
       ui.status('warn', `Using the local ${chalk.bold('backend-manager')} source (file: dependency)`, { level: 2 });
     }
@@ -245,6 +241,84 @@ class SetupCommand extends BaseCommand {
     }
   }
 
+  loadFiles() {
+    const self = this.main;
+    self.package = loadJSON(`${self.firebaseProjectPath}/functions/package.json`);
+    self.firebaseJSON = loadJSON(`${self.firebaseProjectPath}/firebase.json`);
+    self.firebaseRC = loadJSON(`${self.firebaseProjectPath}/.firebaserc`);
+    self.remoteconfigJSON = loadJSON(`${self.firebaseProjectPath}/functions/remoteconfig.template.json`);
+    self.projectPackage = loadJSON(`${self.firebaseProjectPath}/package.json`);
+    self.bemConfigJSON = loadJSON(`${self.firebaseProjectPath}/functions/backend-manager-config.json`);
+    self.gitignore = jetpack.read(`${self.firebaseProjectPath}/.gitignore`) || '';
+  }
+
+  scaffoldPackageJson() {
+    const self = this.main;
+    const ui = this.ui;
+
+    if (!self.package.engines || !self.package.engines.node) {
+      const nodeVer = String(parseInt(process.versions.node, 10));
+      self.package.engines = self.package.engines || {};
+      self.package.engines.node = nodeVer;
+      jetpack.write(`${self.firebaseProjectPath}/functions/package.json`, JSON.stringify(self.package, null, 2));
+      ui.status('add', `Added ${chalk.cyan('engines.node')} = ${chalk.bold(nodeVer)} to package.json`, { level: 2 });
+    }
+  }
+
+  scaffoldConfigs() {
+    const self = this.main;
+    const ui = this.ui;
+    const templatesDir = path.resolve(`${__dirname}/../../../templates`);
+    let touched = 0;
+
+    // .firebaserc — resolve project ID from service account or env
+    const firebasercPath = `${self.firebaseProjectPath}/.firebaserc`;
+    if (!hasContent(self.firebaseRC)) {
+      const projectId = this.resolveProjectId();
+      jetpack.write(firebasercPath, JSON.stringify({ projects: { default: projectId } }, null, 2) + '\n');
+      ui.status('add', `Created ${chalk.cyan('.firebaserc')} (project: ${chalk.bold(projectId)})`, { level: 2 });
+      touched++;
+    }
+
+    // firebase.json
+    const firebaseJsonPath = `${self.firebaseProjectPath}/firebase.json`;
+    if (!hasContent(self.firebaseJSON)) {
+      const templatePath = path.join(templatesDir, 'firebase.json');
+      jetpack.copy(templatePath, firebaseJsonPath);
+      ui.status('add', `Created ${chalk.cyan('firebase.json')}`, { level: 2 });
+      touched++;
+    }
+
+    // backend-manager-config.json
+    const bemConfigPath = `${self.firebaseProjectPath}/functions/backend-manager-config.json`;
+    if (!hasContent(self.bemConfigJSON)) {
+      const templatePath = path.join(templatesDir, 'backend-manager-config.json');
+      jetpack.copy(templatePath, bemConfigPath);
+      ui.status('add', `Created ${chalk.cyan('functions/backend-manager-config.json')}`, { level: 2 });
+      touched++;
+    }
+
+    return touched;
+  }
+
+  resolveProjectId() {
+    const self = this.main;
+    const saPath = `${self.firebaseProjectPath}/functions/service-account.json`;
+
+    if (jetpack.exists(saPath)) {
+      try {
+        const sa = JSON.parse(jetpack.read(saPath));
+        if (sa.project_id) {
+          return sa.project_id;
+        }
+      } catch (e) {
+        // Fall through
+      }
+    }
+
+    return process.env.GCLOUD_PROJECT || 'demo-project';
+  }
+
   cleanupGeneratedArtifacts() {
     const self = this.main;
 

package/src/manager/events/cron/daily/ghostii-auto-publisher.js

@@ -12,7 +12,7 @@
  *   'https://...'       — fetch URL content as prompt seed
  *   '<text>'            — use directly as prompt seed
  *
- * Feed items are tracked in Firestore (`ghostii-feed-items`) so the same
+ * Feed items are tracked in Firestore (`ghostii-sources`) so the same
  * article is never processed twice. When a feed is unreachable or exhausted,
  * the entry falls back to $app behavior.
  */
@@ -381,7 +381,7 @@ async function getProcessedItemIds(admin, feedUrl) {
   }
 
   const snapshot = await admin.firestore()
-    .collection('ghostii-feed-items')
+    .collection('ghostii-sources')
     .where('feedUrl', '==', feedUrl)
     .select('itemId', 'itemUrl')
     .get();
@@ -413,18 +413,20 @@ async function getProcessedItemIds(admin, feedUrl) {
  */
 async function trackFeedItem(admin, { feedUrl, item, brandId, postUrl, postSlug }) {
   const docId = feedItemHash(feedUrl, item.id || item.url);
+  const nowISO = new Date().toISOString();
+  const nowUNIX = Math.round(Date.now() / 1000);
 
-  await admin.firestore().doc(`ghostii-feed-items/${docId}`).set({
+  await admin.firestore().doc(`ghostii-sources/${docId}`).set({
     feedUrl: feedUrl,
     itemId: item.id || item.url,
     itemUrl: item.url,
     itemTitle: item.title,
-    processedAt: admin.firestore.FieldValue.serverTimestamp(),
     brandId: brandId,
     postUrl: postUrl || null,
     postSlug: postSlug || null,
     metadata: {
-      created: admin.firestore.FieldValue.serverTimestamp(),
+      created: { timestamp: nowISO, timestampUNIX: nowUNIX },
+      updated: { timestamp: nowISO, timestampUNIX: nowUNIX },
     },
   });
 }

package/src/manager/libraries/email/data/disposable-domains.json

@@ -237,6 +237,7 @@
   "4warding.org",
   "50set.ru",
   "51baidu.tech",
+  "521883.xyz",
   "52mails.com",
   "55hosting.net",
   "5ghgfhfghfgh.tk",
@@ -252,6 +253,7 @@
   "5y.loseyourip.com",
   "5ymail.com",
   "60minutemail.com",
+  "628868.xyz",
   "66-77.cc",
   "668fmail.com",
   "672643.net",
@@ -508,6 +510,7 @@
   "alienware13.com",
   "aligamel.com",
   "alightmotion.cloud",
+  "alightmotion.id",
   "aligroup.uk",
   "alilot.com",
   "alin.cc.cd",
@@ -568,6 +571,7 @@
   "amail.com",
   "amail1.com",
   "amail4.me",
+  "amazinggift.life",
   "amazingly.online",
   "amazon-aws.org",
   "amberwe.us",
@@ -1399,6 +1403,7 @@
   "code-gmail.com",
   "codeandscotch.com",
   "codeguard.net",
+  "codei.site",
   "coderdir.com",
   "codestar.site",
   "codesuc.top",
@@ -1483,6 +1488,7 @@
   "crossmailjet.com",
   "crossroadsmail.com",
   "crunchcompass.com",
+  "cruncoau.asia",
   "crusthost.com",
   "cryptoavalonsolhub.cloud",
   "cryptogmail.com",
@@ -3441,6 +3447,7 @@
   "jav8.de",
   "javadmin.com",
   "javaemail.com",
+  "javaka.live",
   "javindra.cfd",
   "jbsze.com",
   "jbsze.ne",
@@ -3539,6 +3546,7 @@
   "kagi.be",
   "kakadua.net",
   "kakao-mail.com",
+  "kakaomail.kr",
   "kakator.com",
   "kakaveo3.io.vn",
   "kakslsie.store",
@@ -4042,6 +4050,7 @@
   "maildrop.ml",
   "maildu.de",
   "maildx.com",
+  "maildy.site",
   "maileater.com",
   "mailed.in",
   "mailed.ro",
@@ -5031,6 +5040,8 @@
   "otpku.com",
   "ouchcloud.com",
   "ouk.me",
+  "oupul8b1k.bond",
+  "oupul8b1k.cyou",
   "ourklips.com",
   "ourl.me",
   "ourpreviewdomain.com",
@@ -5045,6 +5056,8 @@
   "owleyes.ch",
   "owlpic.com",
   "ownsyou.de",
+  "owo-mailteam.bond",
+  "owo-mailteam.cyou",
   "owube.com",
   "oxfo.edu.pl",
   "oxmail.homes",
@@ -5638,12 +5651,14 @@
   "satisfyme.club",
   "satukosong.com",
   "saturrshop.uk",
+  "saungadaid.pro",
   "sausen.com",
   "savests.com",
   "say0.com",
   "saynotospams.com",
   "sayverfox.com",
   "scatmail.com",
+  "scatterteam.com",
   "scay.net",
   "schachrol.com",
   "schafmail.de",
@@ -5764,6 +5779,7 @@
   "shuelder.com",
   "shut.name",
   "shut.ws",
+  "shxwonew.xyz",
   "siap-sepuh.com",
   "siberpay.com",
   "sicmg.com",
@@ -7310,8 +7326,12 @@
   "yopmail.fr",
   "yopmail.gq",
   "yopmail.kro.kr",
+  "yopmail.loseyourip.com",
   "yopmail.net",
+  "yopmail.ooguy.com",
   "yopmail.pp.ua",
+  "yopmail.theworkpc.com",
+  "yopmail.webredirect.org",
   "yoptruc.fr.nf",
   "yordanmail.cf",
   "yorushika.one",
@@ -7345,6 +7365,7 @@
   "ytpayy.com",
   "yugasandrika.com",
   "yui.it",
+  "yujiehanjiao.cc",
   "yuki.ren",
   "yun.pics",
   "yuoia.com",
@@ -7468,6 +7489,7 @@
   "zzzzzzzzzzzzzz-2092.dynv6.net",
   "zzzzzzzzzzzzzz-277.dynv6.net",
   "zzzzzzzzzzzzzz-3294.dynv6.net",
+  "zzzzzzzzzzzzzz-3330.dynv6.net",
   "zzzzzzzzzzzzzz-3535.dynv6.net",
   "zzzzzzzzzzzzzz-3928.dynv6.net",
   "zzzzzzzzzzzzzz-3940.dynv6.net",

package/templates/firebase.json

@@ -0,0 +1,66 @@
+{
+  "hosting": {
+    "public": "public",
+    "ignore": [
+      "firebase.json",
+      "**/.*",
+      "**/node_modules/**"
+    ],
+    "rewrites": [
+      {
+        "source": "{/backend-manager,/backend-manager/**,/mcp,/mcp/**,/.well-known/oauth-protected-resource,/.well-known/oauth-authorization-server,/authorize,/token,/register}",
+        "function": "bm_api"
+      }
+    ]
+  },
+  "functions": [
+    {
+      "source": "functions",
+      "codebase": "default",
+      "ignore": [
+        "node_modules",
+        ".git",
+        "firebase-debug.log",
+        "firebase-debug.*.log"
+      ]
+    }
+  ],
+  "firestore": {
+    "rules": "firestore.rules",
+    "indexes": "firestore.indexes.json"
+  },
+  "database": {
+    "rules": "database.rules.json"
+  },
+  "storage": {
+    "rules": "storage.rules"
+  },
+  "emulators": {
+    "auth": {
+      "port": 9099
+    },
+    "functions": {
+      "port": 5001
+    },
+    "firestore": {
+      "port": 8080
+    },
+    "database": {
+      "port": 9000
+    },
+    "hosting": {
+      "port": 5002
+    },
+    "storage": {
+      "port": 9199
+    },
+    "ui": {
+      "enabled": true,
+      "port": 4050
+    },
+    "pubsub": {
+      "port": 8085
+    },
+    "singleProjectMode": true
+  }
+}

package/test/helpers/content/ghostii-auto-publisher.js

@@ -176,7 +176,7 @@ module.exports = {
           postSlug: 'test-article',
         });
 
-        const doc = await admin.firestore().doc(`ghostii-feed-items/${docId}`).get();
+        const doc = await admin.firestore().doc(`ghostii-sources/${docId}`).get();
         assert.ok(doc.exists, 'tracking doc created');
 
         const data = doc.data();
@@ -188,6 +188,13 @@ module.exports = {
         assert.equal(data.postUrl, 'https://test-brand.com/blog/test-article');
         assert.equal(data.postSlug, 'test-article');
         assert.ok(data.metadata, 'has metadata object');
+        assert.ok(data.metadata.created, 'has metadata.created');
+        assert.ok(data.metadata.updated, 'has metadata.updated');
+        assert.equal(typeof data.metadata.created.timestamp, 'string', 'created.timestamp is ISO string');
+        assert.equal(typeof data.metadata.created.timestampUNIX, 'number', 'created.timestampUNIX is number');
+        assert.equal(typeof data.metadata.updated.timestamp, 'string', 'updated.timestamp is ISO string');
+        assert.equal(typeof data.metadata.updated.timestampUNIX, 'number', 'updated.timestampUNIX is number');
+        assert.ok(!data.processedAt, 'no legacy processedAt field');
       },
     },
 

package/test/helpers/content/ghostii-feed-integration.js

@@ -26,22 +26,15 @@ const TEMP_DIR = path.join(BEM_ROOT, '.temp', 'ghostii-feed', `run-${new Date().
 
 // --- Real feed URLs for extended tests ---
 // Chosen for stability and confirmed to work with wonderful-fetch.
+// Includes generic tech feeds + marketing/social feeds used by OMEGA consumers.
 const REAL_FEEDS = [
-  {
-    name: 'Ars Technica',
-    url: 'https://feeds.arstechnica.com/arstechnica/technology-lab',
-    format: 'rss',
-  },
-  {
-    name: 'TechCrunch',
-    url: 'https://techcrunch.com/feed/',
-    format: 'rss',
-  },
-  {
-    name: 'Politico',
-    url: 'https://rss.politico.com/politics-news.xml',
-    format: 'rss',
-  },
+  { name: 'Ars Technica', url: 'https://feeds.arstechnica.com/arstechnica/technology-lab', format: 'rss' },
+  { name: 'TechCrunch', url: 'https://techcrunch.com/feed/', format: 'rss' },
+  { name: 'Social Media Examiner', url: 'https://www.socialmediaexaminer.com/feed/', format: 'rss' },
+  { name: 'Hootsuite Blog', url: 'https://blog.hootsuite.com/feed/', format: 'rss' },
+  { name: 'Sprout Social Insights', url: 'https://sproutsocial.com/insights/feed/', format: 'rss' },
+  { name: 'Buffer Resources', url: 'https://buffer.com/resources/feed/', format: 'rss' },
+  { name: 'Digiday', url: 'https://digiday.com/feed/', format: 'rss' },
 ];
 
 /**
@@ -333,7 +326,7 @@ module.exports = {
 
         // Verify the doc was stored with the expected hash ID
         const expectedDocId = feedItemHash(realFeedUrl, firstItem.id || firstItem.url);
-        const doc = await admin.firestore().doc(`ghostii-feed-items/${expectedDocId}`).get();
+        const doc = await admin.firestore().doc(`ghostii-sources/${expectedDocId}`).get();
 
         assert.ok(doc.exists, 'tracking doc exists at expected hash-based ID');
 
@@ -375,11 +368,11 @@ module.exports = {
           saveArtifact(`feed-${feed.name.toLowerCase().replace(/\s+/g, '-')}-raw.xml`, text);
         }
 
-        // At least 2 of 3 feeds should parse successfully
+        // At least 5 of 7 feeds should parse successfully
         const successful = results.filter((r) => r.items > 0);
         assert.ok(
-          successful.length >= 2,
-          `at least 2 of ${REAL_FEEDS.length} real feeds parsed successfully: ${JSON.stringify(results)}`,
+          successful.length >= 5,
+          `at least 5 of ${REAL_FEEDS.length} real feeds parsed successfully: ${JSON.stringify(results)}`,
         );
 
         // Save summary