qualia-framework 5.3.0 → 5.5.0

package/skills/qualia-road/SKILL.md

@@ -1,6 +1,6 @@
 ---
 name: qualia-road
-description: "Show the Qualia workflow map in the terminal — Project → Journey → Milestones → Phases → Tasks. Lists every command, when to use it, and how phases chain. Use when user asks 'how does Qualia work', 'what's the workflow', 'show me the road', 'what command does X', 'how do projects flow', or is new to the framework. (For an interactive HTML reference instead, use /qualia-help.)"
+description: "TERMINAL workflow map — Project → Journey → Milestones → Phases → Tasks. Use this in headless/SSH/no-browser sessions or when the user asks for the road in chat. For the HTML reference (default when a browser is available), use /qualia-help. Triggers: 'how does Qualia work', 'what's the workflow', 'show me the road', 'what command does X', 'how do projects flow', 'in terminal please', SSH context."
 disable-model-invocation: true
 allowed-tools:
   - Read
@@ -45,14 +45,24 @@ Every road agent loads `PRODUCT.md + DESIGN.md + design-laws.md` substrate. Buil
 /qualia-polish --quick                       ~1m  gates only
 ```
 
-## /qualia-polish-loop -- autonomous visual QA (v5.1+)
+## /qualia-polish-loop -- autonomous visual QA (v5.1+, hardened in v5.2)
 ```
-/qualia-polish-loop http://localhost:3000     screenshot + eval + fix loop
-/qualia-polish-loop {url} --max 4            cap iterations
-/qualia-polish-loop {url} --ref design.png   anchor to reference image
+/qualia-polish-loop http://localhost:3000                screenshot + eval + fix loop
+/qualia-polish-loop {url} --max 4                       cap iterations
+/qualia-polish-loop {url} --ref design.png              anchor to reference image
+/qualia-polish-loop {url} --reduced-motion              force prefers-reduced-motion (v5.2+)
+/qualia-polish-loop --routes /a,/b,/c                   multi-route sweep (v5.2+)
 ```
 Screenshots at 3 viewports (375/768/1440), scores 8 design dimensions using vision, fixes issues, re-screenshots, loops until all dims >= 3 or kill-switch triggers. Per-iteration git commits for clean revert.
 
+## v5.3+ skills (Matt Pocock gaps closed)
+```
+/qualia-prd            synthesize current conversation → .planning/PRD-{slug}.md (durable feature spec)
+/qualia-hook-gen       convert a CLAUDE.md/rules instruction into a deterministic pre-tool-use hook
+/qualia-optimize --deepen   now spawns 3 parallel interface-design variants per candidate (Step 5b)
+```
+`/qualia-prd` pairs with `/qualia-issues` to form the PRD → vertical-slice → execute loop. `/qualia-hook-gen` reduces lifetime token cost (each migrated rule frees ~50-200 tokens per request). `/qualia-optimize --deepen` produces dramatically better refactor RFCs because 3 radically-different interfaces are surfaced and the human picks/hybridizes.
+
 ## Alignment substrate (v5.0+)
 Before high-stakes phases, run alignment skills against `.planning/CONTEXT.md` (domain glossary) and `.planning/decisions/` (ADRs):
 

package/skills/qualia-task/SKILL.md

@@ -1,6 +1,6 @@
 ---
 name: qualia-task
-description: "Builds a single focused task in a fresh builder context with atomic commit and validation. More structured than /qualia-quick, lighter than /qualia-build (no phase plan needed). Use when the user says 'build this one thing', 'add a component', 'implement this feature', 'qualia-task', or for any 1-5 file change outside a full phase."
+description: "Single focused task with a FRESH builder subagent spawn — 1-3 hours, 1-5 files, atomic commit, validation contract. Heavier than /qualia-quick (which runs inline with no spawn) but lighter than /qualia-build (which needs a phase plan). Use when the user says 'build this one thing', 'add a component', 'implement this feature', 'qualia-task', or for any 1-5 file feature outside a full phase."
 allowed-tools:
   - Bash
   - Read

package/templates/CONTEXT.md

@@ -18,14 +18,15 @@ A unit of work inside a milestone. 2–5 tasks. Ends in a verification gate.
 **Avoid:** epic, story, ticket, sprint.
 
 ### Task
-A single commit-sized unit with one verification contract.
-**Avoid:** subtask, chore, todo.
+A framework-internal execution unit: one commit-sized work item with one verification contract.
+**Avoid:** using "task" as an ERP assignment or employee performance label unless the product domain explicitly needs it.
 
 ## Relationships
 - Project holds many Milestones
 - Milestone holds many Phases
 - Phase holds many Tasks
 - Task carries one Verification Contract
+- ERP tracks project deadlines, milestone deadlines, and employee shift submissions; framework tasks stay internal.
 - {{add domain-specific relationships, e.g. "Customer holds many Orders"}}
 
 ## Flagged ambiguities

package/templates/PRODUCT.md

@@ -49,7 +49,7 @@ Sites the project should NOT look like. Anti-references pin down what the design
 - {URL or descriptor} — ...
 ```
 
-For Brand register, these are usually saturated aesthetic lanes (see `rules/design-brand.md`).
+For Brand register, these are usually saturated aesthetic lanes (see `qualia-design/design-brand.md`).
 For Product register, these are usually patterns we don't want to inherit (e.g., "Salesforce Lightning — too dense, too many panels").
 
 ## Positive references (optional, ≤3)

package/templates/help.html

@@ -479,7 +479,7 @@
       <li><span class="rule-icon">1</span> Feature branches by default &mdash; OWNER overrides must be explicit</li>
       <li><span class="rule-icon">2</span> Read before write &mdash; understand files before editing</li>
       <li><span class="rule-icon">3</span> MVP first &mdash; build what's asked, nothing extra</li>
-      <li><span class="rule-icon">4</span> /qualia-report before clock-out &mdash; mandatory, enforced by ERP</li>
+      <li><span class="rule-icon">4</span> /qualia-report before clock-out &mdash; mandatory shift submission in ERP</li>
       <li><span class="rule-icon">5</span> Secrets through approved flows &mdash; use set-erp-key or ask Fawzi</li>
       <li><span class="rule-icon">6</span> Stuck 30+ minutes? Ask Fawzi</li>
     </ul>

package/templates/phase-context.md

@@ -13,11 +13,12 @@ Captured during `/qualia-discuss {N}` — decisions, trade-offs, and constraints
 
 ## Locked Decisions
 
-Non-negotiable choices. Planner must honor these exactly.
+Non-negotiable choices. Planner must honor these exactly. Every row has a stable ID (`D-NN`) — the planner's Decision Coverage Audit checks each is implemented; the plan-checker BLOCKS if any is missing.
 
-| Decision | Rationale | Source |
-|----------|-----------|--------|
-| {e.g., "Use Supabase RLS for authorization, not middleware"} | {e.g., "Client compliance requires database-level checks"} | {who/when} |
+| ID | Decision | Rationale | Source |
+|----|----------|-----------|--------|
+| D-01 | {e.g., "Use Supabase RLS for authorization, not middleware"} | {e.g., "Client compliance requires database-level checks"} | {who/when} |
+| D-02 | {next decision} | {rationale} | {source} |
 
 ## Discretion (Planner Chooses)
 

package/tests/bin.test.sh

@@ -1201,7 +1201,7 @@ else
 fi
 
 # 108. package.json version is 5.x (5.1+ accepted; v5.1 / v5.2 share the v5 line)
-if grep -qE '"5\.[123]\.' "$FRAMEWORK_DIR/package.json"; then
+if grep -qE '"5\.[1234]\.' "$FRAMEWORK_DIR/package.json"; then
   pass "package.json version is 5.x"
 else
   fail_case "package.json version not 5.x"
@@ -1430,7 +1430,7 @@ fi
 
 # 128. package.json bumped to 5.x (5.1+ accepted; 5.2 is the v5.2 release)
 PKG_V=$($NODE -e 'console.log(require("'"$FRAMEWORK_DIR"'/package.json").version)')
-if echo "$PKG_V" | grep -qE "^5\.[123]\."; then
+if echo "$PKG_V" | grep -qE "^5\.[1234]\."; then
   pass "package.json version bumped to 5.x ($PKG_V)"
 else
   fail_case "package.json version not 5.x" "got=$PKG_V"
@@ -1577,12 +1577,42 @@ fi
 
 # 143. package.json version is 5.x (5.1+ accepted; v5.3 is the v5.3 release)
 PKG_V=$($NODE -e 'console.log(require("'"$FRAMEWORK_DIR"'/package.json").version)')
-if echo "$PKG_V" | grep -qE "^5\.[123]\."; then
+if echo "$PKG_V" | grep -qE "^5\.[1234]\."; then
   pass "package.json version is 5.x ($PKG_V) — v5.3 accepted"
 else
   fail_case "package.json version not 5.x" "got=$PKG_V"
 fi
 
+echo ""
+echo "--- ERP shift-report contract ---"
+
+# 144. qualia-report describes clock-out as truthful shift submission, not task completion
+if grep -qi "daily shift report" "$TMP/.claude/skills/qualia-report/SKILL.md" \
+   && grep -qi "not a task-completion ceremony" "$TMP/.claude/skills/qualia-report/SKILL.md" \
+   && grep -qi "What happened during your shift" "$TMP/.claude/skills/qualia-report/SKILL.md"; then
+  pass "qualia-report frames clock-out as shift submission, not task completion"
+else
+  fail_case "qualia-report missing shift-submission contract"
+fi
+
+# 145. ERP contract documents the date model: project, milestone, employee submission
+if grep -q "Project deadline" "$FRAMEWORK_DIR/docs/erp-contract.md" \
+   && grep -q "Milestone deadline" "$FRAMEWORK_DIR/docs/erp-contract.md" \
+   && grep -q "Employee submission date" "$FRAMEWORK_DIR/docs/erp-contract.md" \
+   && grep -q "Phase and task counters remain framework telemetry" "$FRAMEWORK_DIR/docs/erp-contract.md"; then
+  pass "ERP contract documents project/milestone/submission date model"
+else
+  fail_case "ERP contract missing date-model clarification"
+fi
+
+# 146. Project glossary keeps framework tasks internal to agent execution
+if grep -q "framework-internal execution unit" "$FRAMEWORK_DIR/templates/CONTEXT.md" \
+   && grep -q "ERP tracks project deadlines, milestone deadlines, and employee shift submissions" "$FRAMEWORK_DIR/templates/CONTEXT.md"; then
+  pass "CONTEXT template distinguishes internal tasks from ERP workflow"
+else
+  fail_case "CONTEXT template missing framework-task vs ERP-workflow distinction"
+fi
+
 echo ""
 echo "=== Results: $PASS passed, $FAIL failed ==="
 [ "$FAIL" -eq 0 ] && exit 0 || exit 1

package/tests/lib.test.sh

@@ -57,6 +57,27 @@ console.log(errs.length > 0 ? "REJECTED" : "ACCEPTED");
 ')
 [ "$OUT" = "REJECTED" ] && ok "rejects malformed contract" || fail "malformed accepted"
 
+OUT=$($NODE -e '
+const pc = require("'"$PC"'");
+const slop = {
+  version: 1, phase: 1, goal: "x", why: "y",
+  generated_at: "t", generated_by: "planner", source_plan_hash: "h",
+  success_criteria: ["sc"],
+  tasks: [{
+    id: "T1", title: "t", wave: 1, depends_on: [],
+    files_modify: [], files_create: [], files_delete: [],
+    acceptance_criteria: ["minimal implementation of login"],
+    action: "Add hardcoded for now placeholder, will be wired later",
+    context_files: [],
+    verification: [{ type: "file-exists", path: "a.ts" }]
+  }]
+};
+const errs = pc.validate(slop);
+const hits = errs.filter(e => /scope-reduction/.test(e));
+console.log(hits.length >= 2 ? "DETECTED" : "MISSED:" + errs.join(";"));
+')
+[ "$OUT" = "DETECTED" ] && ok "detects scope-reduction phrases in action + acceptance_criteria" || fail "scope-reduction missed: $OUT"
+
 OUT=$($NODE -e '
 const pc = require("'"$PC"'");
 const c = {

package/tests/skills.test.sh

@@ -0,0 +1,143 @@
+#!/bin/bash
+# Qualia Framework — skill smoke tests
+# Verifies every skills/*/SKILL.md is well-formed:
+#   - YAML frontmatter present and parseable
+#   - name field matches folder name
+#   - description present and substantive
+#   - description has trigger phrases (or skill is disable-model-invocation)
+#   - body has at least one h1 heading and 2+ sections
+#
+# Run: bash tests/skills.test.sh
+
+PASS=0
+FAIL=0
+SKILLS_DIR="$(cd "$(dirname "$0")/../skills" && pwd)"
+
+# Skills allowed to ship without trigger phrases — disable-model-invocation
+# skills only fire on explicit slash command, so triggers are optional.
+SKIP_TRIGGER_CHECK=("qualia-road" "qualia-handoff")
+
+pass() {
+  echo "  ✓ $1"
+  PASS=$((PASS + 1))
+}
+
+fail_case() {
+  echo "  ✗ $1"
+  echo "    $2"
+  FAIL=$((FAIL + 1))
+}
+
+is_in_skip_list() {
+  local needle="$1"
+  for x in "${SKIP_TRIGGER_CHECK[@]}"; do
+    [ "$x" = "$needle" ] && return 0
+  done
+  return 1
+}
+
+echo "skills.test.sh — smoke tests for every skills/*/SKILL.md"
+echo ""
+
+for skill_dir in "$SKILLS_DIR"/*/; do
+  name=$(basename "$skill_dir")
+  skill_md="$skill_dir/SKILL.md"
+
+  # Existence
+  if [ ! -f "$skill_md" ]; then
+    fail_case "$name" "SKILL.md not found at $skill_md"
+    continue
+  fi
+
+  # Frontmatter present
+  if ! head -1 "$skill_md" | grep -q "^---$"; then
+    fail_case "$name: frontmatter" "first line is not '---'"
+    continue
+  fi
+  if ! sed -n '2,30p' "$skill_md" | grep -q "^---$"; then
+    fail_case "$name: frontmatter" "no closing --- within first 30 lines"
+    continue
+  fi
+
+  # name field matches folder
+  fm_name=$(grep "^name:" "$skill_md" | head -1 | sed 's/^name:[[:space:]]*//' | tr -d '"')
+  if [ "$fm_name" != "$name" ]; then
+    fail_case "$name: name field" "frontmatter says name=\"$fm_name\", folder is \"$name\""
+    continue
+  fi
+  pass "$name: frontmatter name matches folder"
+
+  # description field present + substantive
+  fm_desc=$(grep "^description:" "$skill_md" | head -1 | sed 's/^description:[[:space:]]*//')
+  desc_len=${#fm_desc}
+  if [ "$desc_len" -lt 50 ]; then
+    fail_case "$name: description" "description is $desc_len chars, expected >= 50"
+    continue
+  fi
+  pass "$name: description present (${desc_len} chars)"
+
+  # Trigger phrases (unless disable-model-invocation or in transitional skip list)
+  if ! is_in_skip_list "$name"; then
+    has_disable=$(grep -c "disable-model-invocation:[[:space:]]*true" "$skill_md")
+    if [ "$has_disable" = "0" ]; then
+      if echo "$fm_desc" | grep -qiE "trigger|when user|use when|invoke|says|use this|fire on|user types"; then
+        pass "$name: description has trigger guidance"
+      else
+        fail_case "$name: triggers" "description lacks trigger phrases (Trigger:/Use when:/'says'/etc.) and skill is not disable-model-invocation"
+      fi
+    fi
+  fi
+
+  # Body has an h1 heading
+  h1_count=$(grep -cE "^# " "$skill_md")
+  if [ "$h1_count" -ge 1 ]; then
+    pass "$name: body has h1 heading"
+  else
+    fail_case "$name: body" "no h1 heading (^# ) in body"
+  fi
+
+  # Body has at least one section (any ## heading)
+  h2_count=$(grep -cE "^## " "$skill_md")
+  if [ "$h2_count" -ge 1 ]; then
+    pass "$name: body has section heading (${h2_count} found)"
+  else
+    fail_case "$name: body" "no '## ' section heading; every skill needs at least one"
+  fi
+
+  # Cache-aware spawn audit (per rules/grounding.md):
+  # Every spawn to a CUSTOM (qualia-*) agent must anchor the prompt with
+  # `@~/.claude/agents/{name}.md` (either `Role: @...` or `Read your role:
+  # @...` — both forms accepted). The role file is session-stable; placing
+  # it first lets Anthropic's prompt cache reuse the prefix across spawns
+  # (documented 81-90% cost reduction). If task-specific content lands
+  # before the role anchor, the entire prefix recomputes on every spawn.
+  #
+  # Built-in subagent types (Explore, general-purpose, Plan, etc.) have
+  # stable system-prompt baselines on Anthropic's side; no Role anchor
+  # required. We count only `subagent_type="qualia-*"` spawns.
+  #
+  # Some skills follow progressive-disclosure discipline (e.g.
+  # qualia-polish-loop) and put the literal spawn template in REFERENCE.md
+  # while SKILL.md mentions the spawn in prose. We scan both.
+  custom_spawn_count=$(grep -c 'subagent_type="qualia-' "$skill_md")
+  ref_md="$skill_dir/REFERENCE.md"
+  if [ -f "$ref_md" ]; then
+    custom_spawn_count=$((custom_spawn_count + $(grep -c 'subagent_type="qualia-' "$ref_md")))
+  fi
+  if [ "${custom_spawn_count:-0}" -gt 0 ]; then
+    role_count=$(grep -cE '@~/\.claude/agents/' "$skill_md")
+    if [ -f "$ref_md" ]; then
+      role_count=$((role_count + $(grep -cE '@~/\.claude/agents/' "$ref_md")))
+    fi
+    if [ "${role_count:-0}" -ge "$custom_spawn_count" ]; then
+      pass "$name: spawn audit ($custom_spawn_count custom spawn(s), all role-anchored for cache)"
+    else
+      fail_case "$name: spawn audit" "$custom_spawn_count custom spawn(s) but only ${role_count:-0} '@~/.claude/agents/' anchors — prompt cache will miss"
+    fi
+  fi
+done
+
+echo ""
+echo "=== Results: $PASS passed, $FAIL failed ==="
+
+[ "$FAIL" = "0" ]

package/tests/slop-detect.test.sh

@@ -0,0 +1,160 @@
+#!/bin/bash
+# Qualia Framework — bin/slop-detect.mjs behavior tests
+# Verifies the AI-tells gatekeeper actually catches what it claims to catch.
+#
+# Run: bash tests/slop-detect.test.sh
+
+PASS=0
+FAIL=0
+SLOP_DETECT="$(cd "$(dirname "$0")/../bin" && pwd)/slop-detect.mjs"
+NODE="${NODE:-node}"
+
+TMP_DIRS=()
+cleanup() {
+  for d in "${TMP_DIRS[@]}"; do
+    [ -d "$d" ] && rm -rf "$d"
+  done
+}
+trap cleanup EXIT
+
+mktmp() {
+  local TMP
+  TMP=$(mktemp -d)
+  TMP_DIRS+=("$TMP")
+  echo "$TMP"
+}
+
+pass() {
+  echo "  ✓ $1"
+  PASS=$((PASS + 1))
+}
+
+fail_case() {
+  echo "  ✗ $1"
+  echo "    $2"
+  FAIL=$((FAIL + 1))
+}
+
+echo "slop-detect.test.sh — bin/slop-detect.mjs behavioral tests"
+echo ""
+
+# ── Sanity: file exists and parses ────────────────────────────────────
+if [ ! -f "$SLOP_DETECT" ]; then
+  fail_case "slop-detect exists" "$SLOP_DETECT not found"
+  echo "=== Results: $PASS passed, $FAIL failed ==="
+  exit 1
+fi
+pass "slop-detect.mjs exists at expected path"
+
+if ! $NODE --check "$SLOP_DETECT" 2>&1 | head -1; then
+  pass "slop-detect.mjs parses as valid JS"
+fi
+# Above is a heredoc test — node --check succeeds silently on valid JS.
+# Re-test explicitly so a parse error fails the suite.
+if $NODE --check "$SLOP_DETECT" 2>/dev/null; then
+  pass "slop-detect.mjs syntax is valid"
+else
+  fail_case "syntax check" "node --check failed on $SLOP_DETECT"
+fi
+
+# ── Clean file: should exit 0 ─────────────────────────────────────────
+TMP=$(mktmp)
+cat > "$TMP/clean.tsx" <<'EOF'
+import { Button } from '@/components/ui/button';
+
+export default function Page() {
+  return (
+    <div className="bg-surface text-foreground">
+      <h1 className="text-display">Welcome</h1>
+      <Button variant="primary">Continue setup</Button>
+    </div>
+  );
+}
+EOF
+if $NODE "$SLOP_DETECT" "$TMP/clean.tsx" >/dev/null 2>&1; then
+  pass "exits 0 on a clean .tsx file"
+else
+  fail_case "clean file" "exit non-zero on a deliberately clean file"
+fi
+
+# ── Em-dash detection (HIGH severity — reported, doesn't block) ──────
+# Em-dash is HIGH not CRITICAL, so default exit is 0; we verify the
+# FINDING is reported to stdout/stderr, not the exit code.
+TMP2=$(mktmp)
+cat > "$TMP2/emdash.tsx" <<'EOF'
+export default function Page() {
+  return <p>Welcome — to our amazing platform</p>;
+}
+EOF
+OUT=$($NODE "$SLOP_DETECT" "$TMP2/emdash.tsx" 2>&1 || true)
+if echo "$OUT" | grep -qiE "em.?dash|—"; then
+  pass "reports em-dash finding (HIGH severity, non-blocking)"
+else
+  fail_case "em-dash detection" "no em-dash mention in output: $(echo "$OUT" | head -c 120)"
+fi
+
+# ── Banned-font detection ─────────────────────────────────────────────
+TMP3=$(mktmp)
+cat > "$TMP3/font.css" <<'EOF'
+body { font-family: "Inter", sans-serif; }
+EOF
+EXIT_CODE=0
+$NODE "$SLOP_DETECT" "$TMP3/font.css" >/dev/null 2>&1 || EXIT_CODE=$?
+if [ "$EXIT_CODE" = "1" ]; then
+  pass "exits 1 on banned font (Inter) in CSS"
+else
+  fail_case "banned-font detection" "expected exit 1, got $EXIT_CODE"
+fi
+
+# ── Purple-blue gradient detection ────────────────────────────────────
+TMP4=$(mktmp)
+cat > "$TMP4/gradient.tsx" <<'EOF'
+export default function Hero() {
+  return <div className="bg-gradient-to-r from-blue-500 to-purple-600">Hi</div>;
+}
+EOF
+EXIT_CODE=0
+$NODE "$SLOP_DETECT" "$TMP4/gradient.tsx" >/dev/null 2>&1 || EXIT_CODE=$?
+if [ "$EXIT_CODE" = "1" ]; then
+  pass "exits 1 on purple-blue gradient (the #1 AI-design tell)"
+else
+  fail_case "gradient detection" "expected exit 1, got $EXIT_CODE"
+fi
+
+# ── Existing fixture: skills/qualia-polish-loop/fixtures/broken.html ──
+FIXTURE="$(cd "$(dirname "$0")/.." && pwd)/skills/qualia-polish-loop/fixtures/broken.html"
+if [ -f "$FIXTURE" ]; then
+  EXIT_CODE=0
+  $NODE "$SLOP_DETECT" "$FIXTURE" >/dev/null 2>&1 || EXIT_CODE=$?
+  if [ "$EXIT_CODE" = "1" ]; then
+    pass "exits 1 on the broken.html fixture (designed to hit critical bans)"
+  else
+    fail_case "fixture detection" "broken.html fixture exited $EXIT_CODE; expected 1"
+  fi
+else
+  echo "  - broken.html fixture not present, skipping"
+fi
+
+# ── --json flag produces JSON output ─────────────────────────────────
+TMP5=$(mktmp)
+cp "$TMP3/font.css" "$TMP5/font.css"
+JSON_OUT=$($NODE "$SLOP_DETECT" --json "$TMP5/font.css" 2>/dev/null || true)
+if echo "$JSON_OUT" | head -1 | grep -qE "^[\{\[]"; then
+  pass "--json flag produces JSON-shaped output"
+else
+  fail_case "--json output" "first line is not JSON-shaped: '$(echo "$JSON_OUT" | head -c 80)'"
+fi
+
+# ── Invocation error: no path provided AND no default repo ───────────
+EXIT_CODE=0
+$NODE "$SLOP_DETECT" /nonexistent/path/that/cannot/exist >/dev/null 2>&1 || EXIT_CODE=$?
+if [ "$EXIT_CODE" = "2" ] || [ "$EXIT_CODE" = "0" ]; then
+  pass "handles missing path gracefully (exit=$EXIT_CODE — 0=skip, 2=invocation error)"
+else
+  fail_case "missing path" "unexpected exit $EXIT_CODE on /nonexistent path"
+fi
+
+echo ""
+echo "=== Results: $PASS passed, $FAIL failed ==="
+
+[ "$FAIL" = "0" ]