@cutting/performance-scout 0.1.0

package/.claude/settings.local.json

@@ -0,0 +1,5 @@
+{
+  "permissions": {
+    "allow": ["Bash(lighthouse:*)", "WebSearch"]
+  }
+}

package/.serper-cache.json

@@ -0,0 +1 @@
+["shopify.co.uk"]

package/CHANGELOG.md

@@ -0,0 +1,13 @@
+# performance-scout
+
+## 0.1.0
+
+### Minor Changes
+
+- 5637cb3: add performance-scout to npm
+
+## 1.1.0
+
+### Minor Changes
+
+- 859cfd7: add performance-scout to npm

package/README.md

@@ -0,0 +1,98 @@
+# Performance Scout
+
+A TypeScript CLI tool that discovers UK Shopify sites and tests their performance using Lighthouse.
+
+## Features
+
+- Discovers candidate Shopify sites from a local file OR Serper API
+- Verifies sites are actually Shopify stores
+- Runs Lighthouse performance tests (desktop and mobile)
+- Filters sites below a configurable performance threshold
+- Outputs results as a markdown table
+
+## Setup
+
+### Prerequisites
+
+- Node.js (v18 or higher recommended)
+- npm or yarn
+- Chrome/Chromium (required by Lighthouse)
+
+### Installation
+
+1. Install dependencies:
+
+```bash
+npm install
+```
+
+2. Set your Serper API key (required only if using `--use-serper`):
+
+```bash
+export SERPER_API_KEY=your_api_key_here
+```
+
+### Configuration
+
+Edit `config.json` to adjust settings:
+
+- `THRESHOLD`: Performance score threshold (0-100). Sites scoring below this on desktop OR mobile are included in results. Default: 50
+- `MAX_RESULTS`: Maximum number of results to collect. Default: 10
+
+### Candidates File
+
+Add domains (one per line) to `candidates.txt`:
+
+```
+example.co.uk
+shop.example.com
+another-shop.co.uk
+```
+
+## Usage
+
+### Scan using candidates.txt (default)
+
+```bash
+npm run scan
+```
+
+### Scan using Serper API
+
+```bash
+npm run scan:serper
+```
+
+Or with the flag directly:
+
+```bash
+npm run scan -- --use-serper
+```
+
+The tool will:
+
+1. Load candidates from either `candidates.txt` (default) or Serper API (if `--use-serper` flag is used)
+2. Verify each candidate is a Shopify site
+3. Run Lighthouse tests (desktop and mobile) on verified sites
+4. Keep only sites scoring below the threshold
+5. Stop after finding `MAX_RESULTS` qualifying sites
+6. Output a markdown table to `results.md` and console
+
+## Output
+
+Results are saved to `results.md` in the following format:
+
+| Site             | Desktop Perf | Mobile Perf |
+| ---------------- | ------------ | ----------- |
+| example.co.uk    | 45           | 38          |
+| shop.example.com | 52           | 41          |
+
+Performance scores range from 0-100, where higher is better.
+
+## Notes
+
+- Built with TypeScript and runs using tsx (no build step required)
+- Serper API results are cached in `.serper-cache.json` to avoid repeated API calls
+- Lighthouse tests can take 30-60 seconds per site
+- Sites that cannot be reached or verified as Shopify stores are skipped
+- If fewer than `MAX_RESULTS` qualifying sites are found, the tool outputs what it has

package/SPEC.md

@@ -0,0 +1,16 @@
+Create a Node.js (ESM) CLI tool that:
+
+- Discovers candidate UK Shopify sites:
+  - Primary: read candidate domains from candidates.txt (one per line, domains only)
+  - Optional: if SERPER_API_KEY exists, fetch more candidates via Serper “search” API for query: '"cdn.shopify.com" site:.uk' and add unique domains.
+- For each candidate, verify Shopify by fetching https://<domain>/ and checking for common Shopify signals (cdn.shopify.com, myshopify.com, /cdn/shop, “Powered by Shopify”).
+- Run Lighthouse CLI twice per accepted site:
+  - Desktop: lighthouse https://<domain> --preset=desktop --only-categories=performance --output json --quiet --chrome-flags="--headless"
+  - Mobile: lighthouse https://<domain> --only-categories=performance --output json --quiet --chrome-flags="--headless"
+- Parse the JSON from stdout, extract categories.performance.score, convert to 0–100.
+- Keep only sites where (desktop < THRESHOLD) OR (mobile < THRESHOLD), where THRESHOLD comes from config.json (default 50).
+- Stop once you have 10 rows (configurable MAX_RESULTS in config.json).
+- Output a markdown table:
+  | Site | Desktop Perf | Mobile Perf |
+- Add package.json scripts: "scan": "node ./scan.mjs"
+- Include README with setup + how to run.

package/candidates.txt

@@ -0,0 +1 @@
+lisaeldridge.com

package/completed.md

@@ -0,0 +1,352 @@
+shopify.co.uk
+dakine.co.uk
+irockersup.co.uk
+cocoandblu.co.uk
+llcompany.co.uk
+mitchum.co.uk
+sweetify.uk
+vicegolf.co.uk
+toast.co.uk
+urbancan.co.uk
+shop.hants.gov.uk
+pinterest.co.uk
+lashify.uk
+besidemealways.co.uk
+abbotshill.herts.sch.uk
+coolframes.co.uk
+styleaddict.uk
+sugarrushsweeties.co.uk
+childsplayclothing.co.uk
+nicholataylorson.co.uk
+lisaeldridge.com
+tropicskincare.com
+dunelondon.com
+pelacase.ca
+kyliejennercosmetics.co.uk
+limely.co.uk
+izie.co.uk
+davinci-gourmet.co.uk
+thejammyvegan.co.uk
+leathermissalcovers.co.uk
+wwf.org.uk
+getcrooked.co.uk
+diabetes.org.uk
+committees.parliament.uk
+muckandmelt.co.uk
+sweetsforall.co.uk
+paperlanterncompany.co.uk
+play.diabetes.org.uk
+munchkin.co.uk
+foiltickets.co.uk
+eatsleeplive.co.uk
+firsttactical.co.uk
+foxproject.org.uk
+seamlesspos.co.uk
+stcatherineschool.co.uk
+shop.the-connaught.co.uk
+emmabridgewater.co.uk
+kraken-signs.co.uk
+craftcellar.co.uk
+exhibitioncourthotel4.co.uk
+vouchergate.co.uk
+strategycore.co.uk
+aya.co.uk
+richardtaunton.ac.uk
+cotswoldlavender.co.uk
+cumulus.hosiene.co.uk
+gitlab.cim.rhul.ac.uk
+bartshealth.nhs.uk
+hub.qmplus.qmul.ac.uk
+yumove.co.uk
+basschat.co.uk
+speakerpoint.co.uk
+tornadomotorsport.co.uk
+threadtype.co.uk
+ohgm.co.uk
+s1000xr.uk
+niococktails.co.uk
+lisou.co.uk
+support.cleancanvas.co.uk
+freelancer.co.uk
+rmweb.co.uk
+insigneart.co.uk
+theoodie.co.uk
+napapijri.co.uk
+herbalplan.co.uk
+exampaperspractice.co.uk
+packagingwise.co.uk
+stevemadden.co.uk
+brycelandsco.co.uk
+cremeofnature.co.uk
+g-heat.co.uk
+digraphics.co.uk
+walkersworkwear.co.uk
+malayacosmetics.co.uk
+shepherdandwoodward.co.uk
+smdesigns.co.uk
+source-vintage.co.uk
+igmaynard.co.uk
+daydress.co.uk
+super73.co.uk
+diabetes.co.uk
+hanro.co.uk
+saltbeerfactory.co.uk
+sodastream.co.uk
+dermalogica.co.uk
+suffolklatchcompany.co.uk
+rwa.org.uk
+hambledonvineyard.co.uk
+gray-nicolls.co.uk
+1881distillery.co.uk
+ecoscent.co.uk
+brotherscider.co.uk
+watchesofwales.co.uk
+welovecornhole.co.uk
+plouise.co.uk
+kingkraft.co.uk
+crumbsanddoilies.co.uk
+pretavoir.co.uk
+thecandlebrand.co.uk
+k18hair.co.uk
+eshvi.co.uk
+butlerscheeses.co.uk
+michaelspiers.co.uk
+pubstuff.co.uk
+lowa.co.uk
+womag.co.uk
+free-stuff.co.uk
+morrison-sporrans.co.uk
+blumkit.co.uk
+direct-drainage.co.uk
+mancoco.co.uk
+hyper-creative.co.uk
+omnitub.co.uk
+hardtimesclothing.co.uk
+bluettipower.co.uk
+italianostucco.co.uk
+firepit.co.uk
+chubbsafesonline.co.uk
+impulsefragrances.co.uk
+tomscakes.co.uk
+jacksgolf.co.uk
+truggery.co.uk
+skyflite.co.uk
+crusadergifts.co.uk
+persephonebooks.co.uk
+ginamarie.co.uk
+lilydogtreats.co.uk
+bradleysmoker.co.uk
+skullcandy.co.uk
+newbie.uk
+realagency.co.uk
+beastmaker.co.uk
+songmicshome.co.uk
+guernseysurfschool.co.uk
+stop-n-go.co.uk
+justrug.co.uk
+buttermilk.co.uk
+janeausten.co.uk
+homefire.co.uk
+eletewater.co.uk
+soek.co.uk
+nordicoutdoor.co.uk
+newtoncomm.co.uk
+gingerandwhite.uk
+prendas.co.uk
+egw.co.uk
+prettyshiny.co.uk
+styling.uk
+onlinecyclinggear.uk
+lovisa.co.uk
+gep.co.uk
+brickabrac.co.uk
+lakelandales.co.uk
+rokit.co.uk
+coolcomponents.co.uk
+extreme-pop.co.uk
+aranhufenia.co.uk
+shoplavenderblue.uk
+idbrandedltd.co.uk
+affiliatecompare.co.uk
+jeanstore.co.uk
+whipmats.co.uk
+finsur.co.uk
+topology.dbk-test.sites.k-hosting.co.uk
+elementman.co.uk
+wahoogifts.co.uk
+knownsource.co.uk
+dolcevalentina.co.uk
+fenwick.co.uk
+bestgymequipment.co.uk
+roofingoutlet.co.uk
+vapefiend.co.uk
+subprintsolutions.co.uk
+cakeandflowers.co.uk
+modelboatmayhem.co.uk
+themissingbean.co.uk
+sierranevadashop.co.uk
+cocopzazz.co.uk
+owenscott.co.uk
+rohleder.co.uk
+fastdecor.co.uk
+julychild.co.uk
+firstmats.co.uk
+sweetz4u.co.uk
+thesweetiejarargyll.co.uk
+cobragolf.co.uk
+pedelecs.co.uk
+snowheads.co.uk
+lafromagerie.co.uk
+mhsweets.co.uk
+jolieleather.co.uk
+oatco.co.uk
+nailberry.co.uk
+printpanoramics.co.uk
+sontuosostone.co.uk
+greenandgable.co.uk
+scoopeeze.co.uk
+shop.the-berkeley.co.uk
+poochandmutt.co.uk
+bornprimitive.co.uk
+odyl.co.uk
+godivaboutique.co.uk
+roalex.co.uk
+thelongship.co.uk
+winchester.ac.uk
+abdn.ac.uk
+annadavies.co.uk
+eprints.whiterose.ac.uk
+tours.eca.ed.ac.uk
+sirri.co.uk
+kateyang.co.uk
+deuscustoms.co.uk
+temperleylondon.uk
+studio.co.uk
+blushboutiqueessex.co.uk
+sarasbeads.co.uk
+theglovestore.co.uk
+palladiumboots.co.uk
+amazon.co.uk
+lighthouseclothing.co.uk
+stovesupermarket.co.uk
+dancingleopard.co.uk
+ellaandjo.co.uk
+complementaryfitness.co.uk
+heroturfs.co.uk
+legion-fitness-equipment.co.uk
+reformerlab.co.uk
+nuudcare.co.uk
+jllfitness.co.uk
+iron-neck.co.uk
+applications2.napier.ac.uk
+norfolkfootball.co.uk
+forum.bloodcancer.org.uk
+wchc.nhs.uk
+tims.nhs.uk
+solgar.co.uk
+humberandnorthyorkshire.org.uk
+exercisebooksdirect.co.uk
+ballet-boutique.co.uk
+fallainfitness.co.uk
+madeinheene.hee.nhs.uk
+kegel8.co.uk
+workoutforless.co.uk
+buyinsulation.co.uk
+themossway.co.uk
+brfonline.org.uk
+nurokor.co.uk
+yuum.co.uk
+theorthofitstore.co.uk
+thecornishfishmonger.co.uk
+savecobradford.co.uk
+discount-supplements.co.uk
+virtualracinguk.co.uk
+killercandy.co.uk
+alexdavispcs.co.uk
+sole-mate.uk
+luvtoo.co.uk
+sunnygo.co.uk
+ferristale.co.uk
+allforhealthcare.co.uk
+drheffs.co.uk
+gethlth.co.uk
+pinhoepharmacy.co.uk
+smallpetselect.co.uk
+tmcwakefield.co.uk
+sweetcures.co.uk
+yo-yodesk.co.uk
+youreyehealth.co.uk
+asthmaandlung.org.uk
+oxfordhealth.nhs.uk
+shop.bounceandbella.co.uk
+nichs.org.uk
+cellumauk.co.uk
+camdenandislingtontalkingtherapies.nhs.uk
+niassembly.gov.uk
+mandatorytraining.co.uk
+spiral.imperial.ac.uk
+angelwatchco.co.uk
+gp-training.hee.nhs.uk
+rcp.ac.uk
+pureadmin.qub.ac.uk
+pure.manchester.ac.uk
+orca.cardiff.ac.uk
+reader.health.org.uk
+kclpure.kcl.ac.uk
+csp.org.uk
+iow.gov.uk
+democracy.brent.gov.uk
+core.ac.uk
+balancecoffee.co.uk
+st-giles.walsall.sch.uk
+acutemedjournal.co.uk
+sbcskincare.co.uk
+lauramercier.co.uk
+psoriasis-association.org.uk
+assets.publishing.service.gov.uk
+wildwoodpets.co.uk
+nibandnoble.co.uk
+additionallengths.co.uk
+holyfamilyhighschool.co.uk
+england.nhs.uk
+council.lancashire.gov.uk
+wheybetter.co.uk
+adph.org.uk
+glostext.gloucestershire.gov.uk
+purdeys.co.uk
+boopbeauty.co.uk
+ash.org.uk
+vybey.co.uk
+farmologie.co.uk
+morishsnacks.co.uk
+bareminerals.co.uk
+wigglywigglers.co.uk
+doghealth.co.uk
+medscope.co.uk
+ebay.co.uk
+avocadoninja.co.uk
+artshape.co.uk
+treflachfarm.co.uk
+aquaskincare.co.uk
+sassyjaxcreative.co.uk
+nice.org.uk
+somavedic.uk
+bidfoodcateringsupplies.co.uk
+volaresports.co.uk
+tlcsport.co.uk
+infinityclub.uk
+messyweekend.co.uk
+app.whering.co.uk
+mentalriders.co.uk
+nuevoonline.uk
+love2shopoffers.co.uk
+flamingorock.co.uk
+gymbagessentials.co.uk
+sculptedbyaimee.co.uk
+hfcosmetics.co.uk
+shopsafe.co.uk
+gracebeautybox.co.uk
+magnitone.co.uk
+honestyforyourskin.co.uk
+bombacious.co.uk
+ireneforteskincare.co.uk

package/config.json

@@ -0,0 +1,16 @@
+{
+  "DESKTOP_THRESHOLD": 40,
+  "MOBILE_THRESHOLD": 30,
+  "SEO_THRESHOLD": 50,
+  "MAX_RESULTS": 100,
+  "crawledVerticals": [
+    "fashion",
+    "fitness",
+    "health",
+    "sports",
+    "shoes",
+    "cosmetics",
+    "food",
+    "skincard"
+  ]
+}

package/eslint.config.mjs

@@ -0,0 +1,4 @@
+import defaultConfig from '@cutting/eslint-config/eslint';
+
+/** @type {import("eslint").Linter.Config} */
+export default [{ ignores: ['tools'] }, ...defaultConfig];

package/package.json

@@ -0,0 +1,31 @@
+{
+  "name": "@cutting/performance-scout",
+  "version": "0.1.0",
+  "type": "module",
+  "publishConfig": {
+    "access": "public"
+  },
+  "description": "CLI tool to discover and test UK Shopify sites for performance",
+  "keywords": [
+    "shopify",
+    "lighthouse",
+    "performance",
+    "cli"
+  ],
+  "author": "",
+  "license": "MIT",
+  "dependencies": {
+    "lighthouse": "^13.0.1",
+    "serpapi": "^2.2.1"
+  },
+  "devDependencies": {
+    "tsx": "^4.21.0"
+  },
+  "volta": {
+    "extends": "../../package.json"
+  },
+  "scripts": {
+    "scan": "tsx ./scan.ts",
+    "scan:serper": "tsx ./scan.ts --use-serper"
+  }
+}

package/results.md

@@ -0,0 +1,15 @@
+| Site                       | Desktop Perf | Mobile Perf | SEO |
+| -------------------------- | ------------ | ----------- | --- |
+| bareminerals.co.uk         | 38           | 6           | 92  |
+| pretavoir.co.uk            | 48           | 9           | 69  |
+| boopbeauty.co.uk           | 73           | 10          | 85  |
+| bradleysmoker.co.uk        | 77           | 17          | 85  |
+| lisaeldridge.com           | 42           | 20          | 92  |
+| rokit.co.uk                | 44           | 22          | 77  |
+| mandatorytraining.co.uk    | 60           | 24          | 75  |
+| songmicshome.co.uk         | 31           | 26          | 69  |
+| lighthouseclothing.co.uk   | 72           | 26          | 92  |
+| bornprimitive.co.uk        | 51           | 27          | 92  |
+| lovisa.co.uk               | 36           | 29          | 92  |
+| tropicskincare.com         | 55           | 30          | 92  |
+| kyliejennercosmetics.co.uk | 43           | 33          | 100 |

package/scan.ts

@@ -0,0 +1,307 @@
+#!/usr/bin/env tsx
+
+import { execFile } from 'child_process';
+import { existsSync } from 'fs';
+import fs from 'fs/promises';
+import type { Result as LHResult } from 'lighthouse';
+import path from 'path';
+import { getJson } from 'serpapi';
+import { fileURLToPath } from 'url';
+import { promisify } from 'util';
+
+const __filename = fileURLToPath(import.meta.url);
+const __dirname = path.dirname(__filename);
+
+const execFileAsync = promisify(execFile);
+
+interface Config {
+  DESKTOP_THRESHOLD: number;
+  MOBILE_THRESHOLD: number;
+  SEO_THRESHOLD: number;
+  MAX_RESULTS: number;
+  crawledVerticals: string[];
+}
+
+const config: Config = JSON.parse(await fs.readFile(path.join(__dirname, 'config.json'), 'utf-8'));
+const DESKTOP_THRESHOLD = config.DESKTOP_THRESHOLD;
+const MOBILE_THRESHOLD = config.MOBILE_THRESHOLD;
+const SEO_THRESHOLD = config.SEO_THRESHOLD;
+const MAX_RESULTS = config.MAX_RESULTS;
+
+const COMPLETED_FILE = path.join(__dirname, 'completed.md');
+const CONFIG_FILE = path.join(__dirname, 'config.json');
+
+const useSerper = process.argv.includes('--use-serper');
+const verticalArg = process.argv.find((arg) => arg.startsWith('--vertical='));
+const vertical = verticalArg ? verticalArg.split('=')[1] : null;
+
+async function loadCompletedDomains(): Promise<Set<string>> {
+  if (!existsSync(COMPLETED_FILE)) {
+    return new Set();
+  }
+  const content = await fs.readFile(COMPLETED_FILE, 'utf-8');
+  const domains = content
+    .split('\n')
+    .map((line) => line.trim())
+    .filter((line) => line.length > 0);
+  return new Set(domains);
+}
+
+async function addCompletedDomain(domain: string): Promise<void> {
+  await fs.appendFile(COMPLETED_FILE, `${domain}\n`);
+}
+
+async function loadCandidatesFromFile(): Promise<string[]> {
+  const candidatesPath = path.join(__dirname, 'candidates.txt');
+  if (!existsSync(candidatesPath)) {
+    return [];
+  }
+  const content = await fs.readFile(candidatesPath, 'utf-8');
+  return content
+    .split('\n')
+    .map((line) => line.trim())
+    .filter((line) => line.length > 0);
+}
+
+async function saveConfig(): Promise<void> {
+  await fs.writeFile(CONFIG_FILE, JSON.stringify(config, null, 2) + '\n');
+}
+
+async function fetchSerperCandidates(completedDomains: Set<string>): Promise<string[]> {
+  const apiKey = process.env.SERPER_API_KEY;
+  if (!apiKey) {
+    throw new Error('SERPER_API_KEY environment variable is required');
+  }
+
+  if (!vertical) {
+    throw new Error('--vertical=<keyword> is required when using --use-serper');
+  }
+
+  if (config.crawledVerticals.includes(vertical)) {
+    console.log(`Vertical "${vertical}" already crawled, exiting.`);
+    process.exit(0);
+  }
+
+  console.log(`Fetching candidates from Serper API for vertical: ${vertical}...`);
+
+  let query = `"cdn.shopify.com" ${vertical} site:.uk`;
+  for (const domain of completedDomains) {
+    query += ` -site:${domain}`;
+  }
+
+  console.log(`Query: ${query}`);
+  console.log(`Query length: ${query.length} characters`);
+
+  const domains: string[] = [];
+  const resultsPerPage = 10;
+  const totalRequests = Math.ceil(MAX_RESULTS / resultsPerPage);
+
+  for (let i = 0; i < totalRequests && domains.length < MAX_RESULTS; i++) {
+    const start = i * resultsPerPage;
+    console.log(`Fetching results ${start + 1}-${start + resultsPerPage}...`);
+
+    const response = await getJson({
+      engine: 'google',
+      q: query,
+      api_key: apiKey,
+      num: resultsPerPage,
+      start,
+    });
+
+    if (response.organic_results) {
+      for (const result of response.organic_results) {
+        if (result.link && domains.length < MAX_RESULTS) {
+          try {
+            const url = new URL(result.link);
+            const domain = url.hostname.replace(/^www\./, '');
+            if (!domains.includes(domain)) {
+              domains.push(domain);
+            }
+          } catch (e) {
+            console.error(`Invalid URL from Serper: ${result.link}`, e instanceof Error ? e.message : String(e));
+          }
+        }
+      }
+    }
+
+    if (!response.organic_results || response.organic_results.length === 0) {
+      console.log(`No more results after ${start} results`);
+      break;
+    }
+  }
+
+  console.log(`Fetched ${domains.length} domains from Serper API`);
+  return domains;
+}
+
+async function verifyShopify(domain: string): Promise<boolean> {
+  try {
+    const url = `https://${domain}/`;
+    const controller = new AbortController();
+    const timeout = setTimeout(() => controller.abort(), 10000);
+
+    const response = await fetch(url, {
+      signal: controller.signal,
+      headers: {
+        'User-Agent': 'Mozilla/5.0 (compatible; PerformanceScout/1.0)',
+      },
+    });
+
+    clearTimeout(timeout);
+
+    if (!response.ok) {
+      return false;
+    }
+
+    const html = await response.text();
+    const lowerHtml = html.toLowerCase();
+
+    const hasShopifySignal =
+      lowerHtml.includes('cdn.shopify.com') ||
+      lowerHtml.includes('myshopify.com') ||
+      lowerHtml.includes('/cdn/shop') ||
+      lowerHtml.includes('powered by shopify');
+
+    return hasShopifySignal;
+  } catch (error) {
+    console.error(error);
+    console.error(`Error verifying ${domain}:`, error instanceof Error ? error.message : String(error));
+    return false;
+  }
+}
+
+async function runLighthouse(
+  domain: string,
+  isDesktop: boolean = false,
+): Promise<{ performance: number | null; seo: number | null }> {
+  const url = `https://${domain}`;
+  const args = [url, '--only-categories=performance,seo', '--output=json', '--quiet', '--chrome-flags=--headless'];
+
+  if (isDesktop) {
+    args.push('--preset=desktop');
+  }
+
+  try {
+    const { stdout } = await execFileAsync('lighthouse', args, { maxBuffer: 10 * 1024 * 1024 });
+    const result = JSON.parse(stdout) as LHResult;
+    const perfScore = result.categories?.performance?.score;
+    const seoScore = result.categories?.seo?.score;
+    return {
+      performance: perfScore !== null && perfScore !== undefined ? Math.round(perfScore * 100) : null,
+      seo: seoScore !== null && seoScore !== undefined ? Math.round(seoScore * 100) : null,
+    };
+  } catch (error) {
+    console.error(
+      `Lighthouse error for ${domain} (${isDesktop ? 'desktop' : 'mobile'}):`,
+      error instanceof Error ? error.message : String(error),
+    );
+    return { performance: null, seo: null };
+  }
+}
+
+async function testSite(domain: string) {
+  console.log(`Testing ${domain}...`);
+
+  const [desktopResult, mobileResult] = await Promise.all([runLighthouse(domain, true), runLighthouse(domain, false)]);
+
+  return {
+    domain,
+    desktopScore: desktopResult.performance,
+    mobileScore: mobileResult.performance,
+    seoScore: mobileResult.seo,
+  };
+}
+
+async function main(): Promise<void> {
+  console.log('Performance Scout - Starting scan...\n');
+
+  const completedDomains = await loadCompletedDomains();
+  console.log(`Loaded ${completedDomains.size} completed domains\n`);
+
+  let allCandidates: string[];
+  if (useSerper) {
+    console.log('Using Serper API as candidate source\n');
+    allCandidates = await fetchSerperCandidates(completedDomains);
+  } else {
+    console.log('Using candidates.txt as candidate source\n');
+    allCandidates = await loadCandidatesFromFile();
+  }
+
+  console.log(`Total candidates to check: ${allCandidates.length}\n`);
+
+  const outputPath = path.join(__dirname, 'results.md');
+  const fileExists = existsSync(outputPath);
+  const needsHeader = !fileExists || (await fs.readFile(outputPath, 'utf-8')).length === 0;
+
+  if (needsHeader) {
+    await fs.writeFile(
+      outputPath,
+      '| Site | Desktop Perf | Mobile Perf | SEO |\n|------|--------------|-------------|-----|\n',
+    );
+  }
+
+  const results: Awaited<ReturnType<typeof testSite>>[] = [];
+
+  for (const domain of allCandidates) {
+    if (useSerper && completedDomains.has(domain)) {
+      console.log(`${domain} already completed, skipping.\n`);
+      continue;
+    }
+
+    console.log(`Verifying ${domain} is a Shopify site...`);
+    const isShopify = await verifyShopify(domain);
+
+    if (!isShopify) {
+      console.log(`${domain} is not a Shopify site, skipping.\n`);
+      if (!completedDomains.has(domain)) {
+        await addCompletedDomain(domain);
+        completedDomains.add(domain);
+      }
+      continue;
+    }
+
+    console.log(`${domain} verified as Shopify site.`);
+    const testResult = await testSite(domain);
+
+    if (!completedDomains.has(domain)) {
+      await addCompletedDomain(domain);
+      completedDomains.add(domain);
+    }
+
+    const desktop = testResult.desktopScore !== null ? testResult.desktopScore : 'N/A';
+    const mobile = testResult.mobileScore !== null ? testResult.mobileScore : 'N/A';
+    const seo = testResult.seoScore !== null ? testResult.seoScore : 'N/A';
+
+    const meetsThreshold =
+      testResult.desktopScore !== null &&
+      testResult.mobileScore !== null &&
+      testResult.seoScore !== null &&
+      (testResult.desktopScore < DESKTOP_THRESHOLD ||
+        testResult.mobileScore < MOBILE_THRESHOLD ||
+        testResult.seoScore < SEO_THRESHOLD);
+
+    if (meetsThreshold) {
+      results.push(testResult);
+      const row = `| ${testResult.domain} | ${desktop} | ${mobile} | ${seo} |\n`;
+      console.log(`Writing to ${outputPath}: ${row.trim()}`);
+      await fs.appendFile(outputPath, row);
+      console.log(
+        `Added ${domain} to results (${results.length}) - Desktop: ${desktop}, Mobile: ${mobile}, SEO: ${seo}\n`,
+      );
+    } else {
+      console.log(`${domain} scores too high, skipping - Desktop: ${desktop}, Mobile: ${mobile}, SEO: ${seo}\n`);
+    }
+  }
+
+  if (useSerper && vertical) {
+    config.crawledVerticals.push(vertical);
+    await saveConfig();
+    console.log(`Added "${vertical}" to crawled verticals.`);
+  }
+
+  console.log(`\n=== Scan Complete ===`);
+  console.log(`Total results: ${results.length}`);
+  console.log(`Results saved to ${outputPath}`);
+}
+
+main().catch(console.error);