codymaster 7.0.1 → 7.0.3

package/skills/cm-cro-methodology/references/funnel-analysis.md

@@ -0,0 +1,365 @@
+# Funnel Analysis Framework
+
+Deep methodology for mapping, analyzing, and optimizing conversion funnels.
+
+## Funnel Philosophy
+
+A funnel isn't just a visualization—it's a diagnostic tool. Every business has a funnel, whether they've mapped it or not. The question is: where is it leaking?
+
+**Core insight:** Most businesses focus on the top of the funnel (traffic) when the biggest wins are often in the middle (conversion) or bottom (retention/expansion).
+
+---
+
+## Mapping Your Funnel
+
+### The Basic Funnel Structure
+
+```
+Awareness → Interest → Consideration → Intent → Evaluation → Purchase → Retention → Advocacy
+```
+
+### Simplified Business Models
+
+**E-commerce:**
+```
+Visit → View Product → Add to Cart → Begin Checkout → Complete Purchase → Repeat Purchase
+```
+
+**SaaS:**
+```
+Visit → Signup → Onboard → Activate → Engage → Convert (Paid) → Retain → Expand
+```
+
+**Lead Generation:**
+```
+Visit → Lead Magnet → MQL → SQL → Opportunity → Close → Upsell
+```
+
+**Content/Media:**
+```
+Visit → Read/View → Subscribe → Engage → Share → Become Regular
+```
+
+### Identifying All Steps
+
+List every step a customer takes from first touch to desired outcome:
+
+1. **Acquisition touchpoints** - Where do they first hear about you?
+2. **Engagement actions** - What do they do before converting?
+3. **Conversion moments** - Where do they make commitments?
+4. **Value realization** - When do they get what they came for?
+5. **Expansion opportunities** - How do they become more valuable?
+
+---
+
+## Blocked Arteries
+
+A "blocked artery" is a high-traffic path with underperformance—a point where lots of visitors enter but few progress.
+
+### How to Find Blocked Arteries
+
+**Step 1: Map traffic volume at each stage**
+
+```
+Homepage:         10,000 visitors
+Product page:     3,000 visitors (30% of traffic)
+Add to cart:      600 visitors (20% of product viewers)
+Checkout start:   300 visitors (50% of cart adds)
+Purchase:         150 visitors (50% of checkout starts)
+```
+
+**Step 2: Calculate conversion at each step**
+
+```
+Homepage → Product:     30%
+Product → Cart:         20% ← Potential blocked artery
+Cart → Checkout:        50%
+Checkout → Purchase:    50%
+```
+
+**Step 3: Compare to benchmarks**
+
+| Stage | Your Rate | Industry Benchmark | Opportunity |
+|-------|-----------|-------------------|-------------|
+| Home → Product | 30% | 25-35% | On track |
+| Product → Cart | 20% | 5-10% | Actually good |
+| Cart → Checkout | 50% | 60-70% | **Blocked artery** |
+| Checkout → Purchase | 50% | 70-80% | **Blocked artery** |
+
+**Step 4: Prioritize by impact**
+
+Impact = Traffic Volume × Conversion Gap
+
+```
+Cart → Checkout: 600 × (0.65 - 0.50) = 90 potential conversions
+Checkout → Purchase: 300 × (0.75 - 0.50) = 75 potential conversions
+```
+
+### Common Blocked Arteries
+
+| Location | Typical Causes |
+|----------|----------------|
+| Homepage → Category | Unclear value proposition, poor navigation |
+| Category → Product | Weak product presentation, too many choices |
+| Product → Cart | Missing information, price shock, no urgency |
+| Cart → Checkout | Unexpected costs, account requirement, trust issues |
+| Checkout → Purchase | Form friction, payment options, shipping cost shock |
+| Trial → Paid | Poor onboarding, unclear value, wrong timing |
+
+---
+
+## Missing Links
+
+A "missing link" is an absent or underutilized funnel stage that leaves value on the table.
+
+### Common Missing Links
+
+**Pre-purchase:**
+- No retargeting for abandoned visitors
+- No email capture before purchase intent
+- No comparison tools for researchers
+- No social proof at decision points
+
+**Purchase:**
+- No upsell/cross-sell offers
+- No subscription/bundle options
+- No referral program at purchase
+- No installation/setup guidance
+
+**Post-purchase:**
+- No email onboarding sequence
+- No check-in at key milestones
+- No expansion offers at right time
+- No advocacy program for happy customers
+
+### Missing Link Audit
+
+| Funnel Stage | Existing Assets | Missing Opportunities |
+|--------------|-----------------|----------------------|
+| Awareness | Ads, content | Referral program? |
+| Interest | Landing pages | Lead magnet? |
+| Consideration | Product pages | Comparison tool? |
+| Intent | Cart | Save for later? |
+| Purchase | Checkout | Order bump? |
+| Onboarding | Email 1 | Video tutorial? |
+| Retention | None | Check-in sequence? |
+| Expansion | None | Usage-based prompts? |
+| Advocacy | None | Referral incentive? |
+
+### Cross-Sell Mapping
+
+Map products that naturally pair together:
+
+| Product A | Natural Cross-Sell | When to Offer |
+|-----------|-------------------|---------------|
+| Running shoes | Socks, insoles | Cart/checkout |
+| SaaS subscription | Premium features | After activation |
+| Course | Coaching add-on | During course |
+| Software | Training | Post-purchase |
+
+---
+
+## Industry Funnel Patterns
+
+### E-commerce Funnels
+
+**Standard:**
+```
+Visit → Browse → Product → Cart → Checkout → Purchase
+```
+
+**Enhanced:**
+```
+Visit → Browse → Product → Wishlist/Email → Retarget → Cart → Checkout → Upsell → Purchase → Post-purchase email → Review request → Repeat purchase
+```
+
+**Key metrics:**
+- Cart abandonment rate (benchmark: 70%)
+- Checkout abandonment rate (benchmark: 25%)
+- Repeat purchase rate (benchmark: 25-40%)
+
+### SaaS Funnels
+
+**Standard:**
+```
+Visit → Trial/Freemium → Activation → Engagement → Conversion
+```
+
+**Enhanced:**
+```
+Visit → Content → Lead magnet → Nurture → Trial → Onboarding → Activation → Engagement → Conversion → Onboarding (paid) → Expansion → Advocacy
+```
+
+**Key metrics:**
+- Trial-to-paid conversion (benchmark: 3-5% freemium, 15-25% free trial)
+- Activation rate (varies by product)
+- Expansion revenue % (benchmark: 30%+ of revenue)
+
+### Lead Generation Funnels
+
+**Standard:**
+```
+Visit → Form → Lead → Sales contact → Opportunity → Close
+```
+
+**Enhanced:**
+```
+Visit → Lead magnet → Nurture → Scorecard/Quiz → MQL → SDR qualify → Demo → SQL → Proposal → Close → Onboarding → Expansion
+```
+
+**Key metrics:**
+- Lead-to-MQL conversion (benchmark: 20-30%)
+- MQL-to-SQL conversion (benchmark: 30-50%)
+- SQL-to-close rate (benchmark: 20-40%)
+
+### Subscription/Membership Funnels
+
+**Standard:**
+```
+Visit → Free content → Subscribe → Retain
+```
+
+**Enhanced:**
+```
+Visit → Free content → Email opt-in → Free trial → Subscribe → Onboard → Engage → Retain → Annual upgrade → Advocacy
+```
+
+**Key metrics:**
+- Free-to-paid conversion (benchmark: 2-5%)
+- Monthly churn rate (benchmark: 3-7%)
+- Annual vs. monthly mix (benchmark: 30%+ annual)
+
+---
+
+## Funnel Prioritization Framework
+
+### Calculate Opportunity Value
+
+For each potential improvement:
+
+```
+Opportunity = (Current Volume) × (Conversion Gap) × (Revenue per Conversion)
+```
+
+**Example:**
+```
+Current: 1,000 visitors, 2% conversion, $100/conversion = $2,000 revenue
+Potential: 1,000 visitors, 3% conversion, $100/conversion = $3,000 revenue
+Opportunity value: $1,000/month = $12,000/year
+```
+
+### Prioritization Matrix
+
+| Opportunity | Volume | Gap | Value | Ease | Priority |
+|-------------|--------|-----|-------|------|----------|
+| Checkout abandonment | 500/mo | 25% | $125 | Medium | High |
+| Add cross-sell | 200/mo | 30% | $20 | Easy | High |
+| Reduce form fields | 1000/mo | 10% | $50 | Easy | High |
+| Redesign homepage | 5000/mo | 2% | $100 | Hard | Medium |
+| Add video | 300/mo | 15% | $100 | Medium | Medium |
+
+### The 80/20 Rule in Funnels
+
+Typically:
+- 80% of revenue comes from 20% of the funnel stages
+- 80% of drop-off happens at 20% of the steps
+- 80% of improvement potential is in 20% of the pages
+
+**Focus ruthlessly on the high-impact stages before optimizing everything.**
+
+---
+
+## Funnel Visualization
+
+### Basic Funnel Chart
+
+```
+┌─────────────────────────────────────────┐ 10,000
+│            Website Visits               │
+├───────────────────────────────┐         │ 3,000 (30%)
+│      Product Page Views       │
+├─────────────────────┐         │         │ 600 (20%)
+│   Add to Cart       │
+├───────────────┐     │         │         │ 300 (50%)
+│  Checkout     │
+├─────────┐     │     │         │         │ 150 (50%)
+│ Purchase│
+└─────────┘
+```
+
+### Leakage Analysis
+
+At each stage, map where users go instead:
+
+```
+Product Page (3,000 visitors)
+├─→ Add to Cart: 600 (20%)
+├─→ Exit site: 1,500 (50%)
+├─→ Browse other products: 600 (20%)
+├─→ Check reviews/FAQ: 200 (7%)
+└─→ Contact support: 100 (3%)
+```
+
+**Insight:** 50% exit from product page—that's the primary leak to investigate.
+
+---
+
+## Funnel Optimization Checklist
+
+### Before Optimizing
+
+- [ ] Have you mapped the complete funnel?
+- [ ] Do you have baseline conversion rates at each stage?
+- [ ] Have you identified the biggest blocked arteries?
+- [ ] Have you audited for missing links?
+- [ ] Do you know your industry benchmarks?
+- [ ] Have you calculated opportunity values?
+
+### During Optimization
+
+- [ ] Are you testing bold changes, not tweaks?
+- [ ] Are you measuring the right metrics?
+- [ ] Are you waiting for statistical significance?
+- [ ] Are you documenting learnings?
+
+### After Optimization
+
+- [ ] Did conversion improve at the target stage?
+- [ ] Did downstream metrics also improve?
+- [ ] Did any metrics unexpectedly decrease?
+- [ ] Can this learning apply to other funnels?
+
+---
+
+## Advanced: Multi-Touch Attribution
+
+### The Problem
+
+Customers don't convert in a straight line. They might:
+1. See a Facebook ad
+2. Google your brand
+3. Read a blog post
+4. Leave
+5. Get retargeted
+6. Return via email
+7. Convert
+
+Which touchpoint gets credit?
+
+### Attribution Models
+
+| Model | Description | Best For |
+|-------|-------------|----------|
+| First-touch | First interaction gets 100% | Brand awareness campaigns |
+| Last-touch | Final interaction gets 100% | Direct response |
+| Linear | Equal credit to all touches | Understanding journey |
+| Time-decay | Recent touches get more credit | Short sales cycles |
+| Position-based | 40% first, 40% last, 20% middle | Balanced view |
+| Data-driven | Algorithm assigns based on data | Sophisticated analysis |
+
+### Practical Recommendation
+
+1. Start with last-touch (simplest)
+2. Add first-touch to understand acquisition
+3. Graduate to position-based for balanced view
+4. Only use data-driven with sufficient volume

package/skills/cm-cro-methodology/references/testing-methodology.md

@@ -0,0 +1,330 @@
+# CRO Testing Methodology
+
+Deep-dive into experiment design, statistical rigor, and test prioritization from the CRE Methodology.
+
+## The Philosophy of Bold Testing
+
+### Why "Meek Tweaks" Fail
+
+Most A/B tests fail because they're too small to detect. Button color changes, minor copy tweaks, and micro-optimizations suffer from:
+
+1. **Insufficient sample size** - Small changes require massive traffic to reach significance
+2. **Interaction effects** - Minor changes get lost in noise
+3. **Opportunity cost** - Time spent on 2% wins could find 200% wins
+
+**Rule: Test big changes that could double conversion, not small changes that might move it 5%.**
+
+### The 10x Mindset
+
+Before any test, ask: "Could this 10x our results?" If not, is it worth testing?
+
+- **Worth testing:** Complete page redesign, new value proposition, fundamentally different offer
+- **Not worth testing:** Button color, font size, image swap
+
+---
+
+## A/B Testing vs. Multivariate Testing
+
+### A/B Testing (Split Testing)
+
+Compare two (or more) complete versions against each other.
+
+| Aspect | Details |
+|--------|---------|
+| **Best for** | Testing big concepts, page redesigns, offers |
+| **Traffic needed** | Lower (split between 2-4 variants) |
+| **Insights** | Which version wins overall |
+| **Limitation** | Doesn't show which elements contributed |
+
+**When to use:**
+- You have a hypothesis about a major change
+- Traffic is limited
+- You're comparing conceptual approaches
+
+### Multivariate Testing (MVT)
+
+Test multiple elements simultaneously to find optimal combination.
+
+| Aspect | Details |
+|--------|---------|
+| **Best for** | Optimizing elements after winning concept proven |
+| **Traffic needed** | Much higher (combinations multiply) |
+| **Insights** | Which specific elements drive results |
+| **Limitation** | Requires significant traffic |
+
+**When to use:**
+- You have a winning page to optimize further
+- High traffic (100k+ monthly visitors)
+- Clear, isolated elements to test
+
+### Traffic Requirements
+
+**A/B Test:**
+```
+Minimum sample per variant = 250-500 conversions
+For 2 variants with 5% conversion: 10,000-20,000 visitors needed
+```
+
+**Multivariate Test:**
+```
+Combinations = (Options for Element 1) × (Options for Element 2) × ...
+Example: 3 headlines × 3 images × 2 CTAs = 18 combinations
+Each combination needs 250+ conversions = 90,000+ conversions total
+```
+
+**Recommendation:** Start with A/B tests. Only move to MVT when you have:
+- Proven winning page concept
+- 100k+ monthly visitors
+- Mature testing program
+
+---
+
+## Statistical Significance
+
+### What It Means
+
+Statistical significance tells you: "How likely is this result due to chance vs. a real effect?"
+
+**Industry standard:** 95% confidence (p-value < 0.05)
+- 95% confident the difference is real
+- 5% chance it's random noise
+
+### Common Mistakes
+
+**1. Peeking and stopping early**
+
+Checking results daily and stopping when you see a winner leads to false positives.
+
+- **Wrong:** "We're at 95% confidence after 3 days—ship it!"
+- **Right:** Pre-determine sample size and test duration; don't stop early
+
+**2. Calling tests with insufficient data**
+
+| Visitors | Conversions | Can you call it? |
+|----------|-------------|------------------|
+| 500 | 15 vs 20 | No |
+| 5,000 | 150 vs 200 | Possibly |
+| 50,000 | 1,500 vs 2,000 | Yes |
+
+**3. Ignoring practical significance**
+
+A statistically significant 0.1% lift isn't worth implementation complexity.
+
+**4. Multiple comparison problem**
+
+Testing 20 variants? One will show "significance" by chance alone.
+
+### Sample Size Calculation
+
+Before testing, calculate required sample size:
+
+**Inputs needed:**
+- Baseline conversion rate
+- Minimum detectable effect (MDE) you care about
+- Statistical power (typically 80%)
+- Significance level (typically 95%)
+
+**Rule of thumb:**
+```
+For 5% baseline, 20% relative lift detection:
+~25,000 visitors per variant needed
+
+For 5% baseline, 50% relative lift detection:
+~4,000 visitors per variant needed
+```
+
+**Key insight:** The smaller the effect you want to detect, the more traffic you need. This is why bold changes are better—they're detectable with less traffic.
+
+### Test Duration
+
+**Minimum test duration:**
+- At least 1 full business cycle (typically 1-2 weeks)
+- Include weekdays AND weekends
+- Account for seasonality
+
+**Why?**
+- Visitor behavior differs by day of week
+- Friday buyers differ from Monday researchers
+- Monthly cycles affect B2B especially
+
+---
+
+## ICE Prioritization Framework
+
+Prioritize test ideas using ICE scores:
+
+### Impact (1-10)
+"If this wins, how big would the impact be?"
+
+| Score | Impact Level |
+|-------|--------------|
+| 10 | Could double conversion rate |
+| 7-9 | Major improvement (30-50%+) |
+| 4-6 | Moderate improvement (10-30%) |
+| 1-3 | Minor improvement (<10%) |
+
+### Confidence (1-10)
+"How confident are we this will work?"
+
+| Score | Confidence Level |
+|-------|------------------|
+| 10 | Proven in research, worked before |
+| 7-9 | Strong research supports it |
+| 4-6 | Reasonable hypothesis |
+| 1-3 | Gut feeling, unvalidated |
+
+### Ease (1-10)
+"How easy is this to implement and test?"
+
+| Score | Ease Level |
+|-------|------------|
+| 10 | Text change only |
+| 7-9 | Design change, no dev needed |
+| 4-6 | Requires development |
+| 1-3 | Major technical lift |
+
+### ICE Score Calculation
+
+```
+ICE Score = (Impact + Confidence + Ease) / 3
+```
+
+Or weighted:
+```
+ICE Score = (Impact × 2 + Confidence × 1.5 + Ease × 1) / 4.5
+```
+
+### Sample Prioritization
+
+| Test Idea | Impact | Confidence | Ease | Score |
+|-----------|--------|------------|------|-------|
+| New headline from customer research | 8 | 9 | 10 | 9.0 |
+| Add video testimonial | 7 | 7 | 6 | 6.7 |
+| Redesign checkout flow | 9 | 6 | 3 | 6.0 |
+| Change button color | 2 | 2 | 10 | 4.7 |
+
+---
+
+## Test Documentation
+
+### Before the Test
+
+Document:
+1. **Hypothesis:** "If we [change X], then [metric Y] will improve because [reason based on research]"
+2. **Primary metric:** One metric that determines winner
+3. **Secondary metrics:** Additional metrics to monitor
+4. **Guardrail metrics:** Metrics that shouldn't decrease
+5. **Sample size requirement**
+6. **Test duration**
+7. **Traffic allocation**
+
+### After the Test
+
+Document:
+1. **Results:** Raw numbers, conversion rates, confidence interval
+2. **Statistical significance:** p-value, confidence level
+3. **Practical significance:** Is the lift worth implementing?
+4. **Learnings:** What does this teach us about our customers?
+5. **Next steps:** Ship winner, iterate, or abandon?
+
+### Learnings Database
+
+Every test should add to organizational knowledge:
+
+| Test | Hypothesis | Result | Learning | Applicable to |
+|------|------------|--------|----------|---------------|
+| Homepage headline A/B | Customer language converts better | Winner: +27% | Customers care about outcomes, not features | All landing pages |
+| Form length test | Shorter forms convert better | Loser: no diff | Our audience expects detailed forms | Lead gen pages |
+
+---
+
+## When Tests Fail
+
+### Types of "Failure"
+
+**1. No winner (inconclusive)**
+- Sample size too small
+- Effect size too small to detect
+- Test needed to run longer
+
+**2. Control wins**
+- New version is worse
+- Hypothesis was wrong
+- Still a learning!
+
+**3. Technical problems**
+- Tracking broke
+- Experience differed from plan
+- Sample contamination
+
+### What to Do
+
+1. **Document the learning** - "We learned customers prefer X"
+2. **Investigate why** - Go back to research
+3. **Don't give up on the page** - The opportunity exists, you just haven't found the solution
+4. **Try a bolder change** - Maybe the change wasn't big enough
+
+**Critical insight:** A failed test that teaches you something is more valuable than a winning test you don't understand.
+
+---
+
+## CRO Team Dynamics
+
+### Roles in a CRO Program
+
+| Role | Responsibility |
+|------|----------------|
+| **CRO Lead** | Strategy, prioritization, stakeholder management |
+| **Researcher** | User research, surveys, analytics analysis |
+| **Designer** | Wireframes, mockups, user flows |
+| **Developer** | Test implementation, technical QA |
+| **Analyst** | Results analysis, statistical rigor |
+
+### Getting Stakeholder Buy-In
+
+**Common objections:**
+
+| Objection | Counter |
+|-----------|---------|
+| "We already know what works" | "Then testing will confirm it quickly" |
+| "Testing takes too long" | "Shipping wrong things costs more" |
+| "Our traffic is too low" | "Then we test bigger changes" |
+| "The CEO wants X" | "Let's test to validate the idea" |
+
+**Building credibility:**
+1. Start with quick wins (high-traffic pages, obvious problems)
+2. Document and share learnings widely
+3. Quantify impact in revenue terms
+4. Build testing into the culture, not just a project
+
+### Test Velocity
+
+**Goal:** Increase valid tests per month over time.
+
+| Maturity | Tests/Month | Characteristics |
+|----------|-------------|-----------------|
+| Beginner | 1-2 | Manual processes, ad-hoc |
+| Developing | 4-6 | Established backlog, regular cadence |
+| Advanced | 10-20 | Parallel testing, mature process |
+| Expert | 20+ | Multiple simultaneous tests, automated |
+
+---
+
+## Testing Platform Comparison
+
+| Platform | Best For | Limitations |
+|----------|----------|-------------|
+| Google Optimize | Beginners, free tier | Sunsetting, limited features |
+| VWO | Mid-market, visual editor | Can be slow, limited targeting |
+| Optimizely | Enterprise, complex tests | Expensive, learning curve |
+| LaunchDarkly | Dev-centric, feature flags | Not optimized for marketing |
+| Custom | Full control | Development cost |
+
+### Key Features to Look For
+
+- Visual editor for non-developers
+- Robust statistical engine
+- Segment targeting
+- Integrations (analytics, CDP, etc.)
+- Flicker prevention
+- Mutually exclusive experiments