codymaster 5.2.0 → 7.0.0

package/skills/cm-cro-methodology/references/funnel-analysis.md

@@ -1,365 +0,0 @@
-# Funnel Analysis Framework
-
-Deep methodology for mapping, analyzing, and optimizing conversion funnels.
-
-## Funnel Philosophy
-
-A funnel isn't just a visualization—it's a diagnostic tool. Every business has a funnel, whether they've mapped it or not. The question is: where is it leaking?
-
-**Core insight:** Most businesses focus on the top of the funnel (traffic) when the biggest wins are often in the middle (conversion) or bottom (retention/expansion).
-
----
-
-## Mapping Your Funnel
-
-### The Basic Funnel Structure
-
-```
-Awareness → Interest → Consideration → Intent → Evaluation → Purchase → Retention → Advocacy
-```
-
-### Simplified Business Models
-
-**E-commerce:**
-```
-Visit → View Product → Add to Cart → Begin Checkout → Complete Purchase → Repeat Purchase
-```
-
-**SaaS:**
-```
-Visit → Signup → Onboard → Activate → Engage → Convert (Paid) → Retain → Expand
-```
-
-**Lead Generation:**
-```
-Visit → Lead Magnet → MQL → SQL → Opportunity → Close → Upsell
-```
-
-**Content/Media:**
-```
-Visit → Read/View → Subscribe → Engage → Share → Become Regular
-```
-
-### Identifying All Steps
-
-List every step a customer takes from first touch to desired outcome:
-
-1. **Acquisition touchpoints** - Where do they first hear about you?
-2. **Engagement actions** - What do they do before converting?
-3. **Conversion moments** - Where do they make commitments?
-4. **Value realization** - When do they get what they came for?
-5. **Expansion opportunities** - How do they become more valuable?
-
----
-
-## Blocked Arteries
-
-A "blocked artery" is a high-traffic path with underperformance—a point where lots of visitors enter but few progress.
-
-### How to Find Blocked Arteries
-
-**Step 1: Map traffic volume at each stage**
-
-```
-Homepage:         10,000 visitors
-Product page:     3,000 visitors (30% of traffic)
-Add to cart:      600 visitors (20% of product viewers)
-Checkout start:   300 visitors (50% of cart adds)
-Purchase:         150 visitors (50% of checkout starts)
-```
-
-**Step 2: Calculate conversion at each step**
-
-```
-Homepage → Product:     30%
-Product → Cart:         20% ← Potential blocked artery
-Cart → Checkout:        50%
-Checkout → Purchase:    50%
-```
-
-**Step 3: Compare to benchmarks**
-
-| Stage | Your Rate | Industry Benchmark | Opportunity |
-|-------|-----------|-------------------|-------------|
-| Home → Product | 30% | 25-35% | On track |
-| Product → Cart | 20% | 5-10% | Actually good |
-| Cart → Checkout | 50% | 60-70% | **Blocked artery** |
-| Checkout → Purchase | 50% | 70-80% | **Blocked artery** |
-
-**Step 4: Prioritize by impact**
-
-Impact = Traffic Volume × Conversion Gap
-
-```
-Cart → Checkout: 600 × (0.65 - 0.50) = 90 potential conversions
-Checkout → Purchase: 300 × (0.75 - 0.50) = 75 potential conversions
-```
-
-### Common Blocked Arteries
-
-| Location | Typical Causes |
-|----------|----------------|
-| Homepage → Category | Unclear value proposition, poor navigation |
-| Category → Product | Weak product presentation, too many choices |
-| Product → Cart | Missing information, price shock, no urgency |
-| Cart → Checkout | Unexpected costs, account requirement, trust issues |
-| Checkout → Purchase | Form friction, payment options, shipping cost shock |
-| Trial → Paid | Poor onboarding, unclear value, wrong timing |
-
----
-
-## Missing Links
-
-A "missing link" is an absent or underutilized funnel stage that leaves value on the table.
-
-### Common Missing Links
-
-**Pre-purchase:**
-- No retargeting for abandoned visitors
-- No email capture before purchase intent
-- No comparison tools for researchers
-- No social proof at decision points
-
-**Purchase:**
-- No upsell/cross-sell offers
-- No subscription/bundle options
-- No referral program at purchase
-- No installation/setup guidance
-
-**Post-purchase:**
-- No email onboarding sequence
-- No check-in at key milestones
-- No expansion offers at right time
-- No advocacy program for happy customers
-
-### Missing Link Audit
-
-| Funnel Stage | Existing Assets | Missing Opportunities |
-|--------------|-----------------|----------------------|
-| Awareness | Ads, content | Referral program? |
-| Interest | Landing pages | Lead magnet? |
-| Consideration | Product pages | Comparison tool? |
-| Intent | Cart | Save for later? |
-| Purchase | Checkout | Order bump? |
-| Onboarding | Email 1 | Video tutorial? |
-| Retention | None | Check-in sequence? |
-| Expansion | None | Usage-based prompts? |
-| Advocacy | None | Referral incentive? |
-
-### Cross-Sell Mapping
-
-Map products that naturally pair together:
-
-| Product A | Natural Cross-Sell | When to Offer |
-|-----------|-------------------|---------------|
-| Running shoes | Socks, insoles | Cart/checkout |
-| SaaS subscription | Premium features | After activation |
-| Course | Coaching add-on | During course |
-| Software | Training | Post-purchase |
-
----
-
-## Industry Funnel Patterns
-
-### E-commerce Funnels
-
-**Standard:**
-```
-Visit → Browse → Product → Cart → Checkout → Purchase
-```
-
-**Enhanced:**
-```
-Visit → Browse → Product → Wishlist/Email → Retarget → Cart → Checkout → Upsell → Purchase → Post-purchase email → Review request → Repeat purchase
-```
-
-**Key metrics:**
-- Cart abandonment rate (benchmark: 70%)
-- Checkout abandonment rate (benchmark: 25%)
-- Repeat purchase rate (benchmark: 25-40%)
-
-### SaaS Funnels
-
-**Standard:**
-```
-Visit → Trial/Freemium → Activation → Engagement → Conversion
-```
-
-**Enhanced:**
-```
-Visit → Content → Lead magnet → Nurture → Trial → Onboarding → Activation → Engagement → Conversion → Onboarding (paid) → Expansion → Advocacy
-```
-
-**Key metrics:**
-- Trial-to-paid conversion (benchmark: 3-5% freemium, 15-25% free trial)
-- Activation rate (varies by product)
-- Expansion revenue % (benchmark: 30%+ of revenue)
-
-### Lead Generation Funnels
-
-**Standard:**
-```
-Visit → Form → Lead → Sales contact → Opportunity → Close
-```
-
-**Enhanced:**
-```
-Visit → Lead magnet → Nurture → Scorecard/Quiz → MQL → SDR qualify → Demo → SQL → Proposal → Close → Onboarding → Expansion
-```
-
-**Key metrics:**
-- Lead-to-MQL conversion (benchmark: 20-30%)
-- MQL-to-SQL conversion (benchmark: 30-50%)
-- SQL-to-close rate (benchmark: 20-40%)
-
-### Subscription/Membership Funnels
-
-**Standard:**
-```
-Visit → Free content → Subscribe → Retain
-```
-
-**Enhanced:**
-```
-Visit → Free content → Email opt-in → Free trial → Subscribe → Onboard → Engage → Retain → Annual upgrade → Advocacy
-```
-
-**Key metrics:**
-- Free-to-paid conversion (benchmark: 2-5%)
-- Monthly churn rate (benchmark: 3-7%)
-- Annual vs. monthly mix (benchmark: 30%+ annual)
-
----
-
-## Funnel Prioritization Framework
-
-### Calculate Opportunity Value
-
-For each potential improvement:
-
-```
-Opportunity = (Current Volume) × (Conversion Gap) × (Revenue per Conversion)
-```
-
-**Example:**
-```
-Current: 1,000 visitors, 2% conversion, $100/conversion = $2,000 revenue
-Potential: 1,000 visitors, 3% conversion, $100/conversion = $3,000 revenue
-Opportunity value: $1,000/month = $12,000/year
-```
-
-### Prioritization Matrix
-
-| Opportunity | Volume | Gap | Value | Ease | Priority |
-|-------------|--------|-----|-------|------|----------|
-| Checkout abandonment | 500/mo | 25% | $125 | Medium | High |
-| Add cross-sell | 200/mo | 30% | $20 | Easy | High |
-| Reduce form fields | 1000/mo | 10% | $50 | Easy | High |
-| Redesign homepage | 5000/mo | 2% | $100 | Hard | Medium |
-| Add video | 300/mo | 15% | $100 | Medium | Medium |
-
-### The 80/20 Rule in Funnels
-
-Typically:
-- 80% of revenue comes from 20% of the funnel stages
-- 80% of drop-off happens at 20% of the steps
-- 80% of improvement potential is in 20% of the pages
-
-**Focus ruthlessly on the high-impact stages before optimizing everything.**
-
----
-
-## Funnel Visualization
-
-### Basic Funnel Chart
-
-```
-┌─────────────────────────────────────────┐ 10,000
-│            Website Visits               │
-├───────────────────────────────┐         │ 3,000 (30%)
-│      Product Page Views       │
-├─────────────────────┐         │         │ 600 (20%)
-│   Add to Cart       │
-├───────────────┐     │         │         │ 300 (50%)
-│  Checkout     │
-├─────────┐     │     │         │         │ 150 (50%)
-│ Purchase│
-└─────────┘
-```
-
-### Leakage Analysis
-
-At each stage, map where users go instead:
-
-```
-Product Page (3,000 visitors)
-├─→ Add to Cart: 600 (20%)
-├─→ Exit site: 1,500 (50%)
-├─→ Browse other products: 600 (20%)
-├─→ Check reviews/FAQ: 200 (7%)
-└─→ Contact support: 100 (3%)
-```
-
-**Insight:** 50% exit from product page—that's the primary leak to investigate.
-
----
-
-## Funnel Optimization Checklist
-
-### Before Optimizing
-
-- [ ] Have you mapped the complete funnel?
-- [ ] Do you have baseline conversion rates at each stage?
-- [ ] Have you identified the biggest blocked arteries?
-- [ ] Have you audited for missing links?
-- [ ] Do you know your industry benchmarks?
-- [ ] Have you calculated opportunity values?
-
-### During Optimization
-
-- [ ] Are you testing bold changes, not tweaks?
-- [ ] Are you measuring the right metrics?
-- [ ] Are you waiting for statistical significance?
-- [ ] Are you documenting learnings?
-
-### After Optimization
-
-- [ ] Did conversion improve at the target stage?
-- [ ] Did downstream metrics also improve?
-- [ ] Did any metrics unexpectedly decrease?
-- [ ] Can this learning apply to other funnels?
-
----
-
-## Advanced: Multi-Touch Attribution
-
-### The Problem
-
-Customers don't convert in a straight line. They might:
-1. See a Facebook ad
-2. Google your brand
-3. Read a blog post
-4. Leave
-5. Get retargeted
-6. Return via email
-7. Convert
-
-Which touchpoint gets credit?
-
-### Attribution Models
-
-| Model | Description | Best For |
-|-------|-------------|----------|
-| First-touch | First interaction gets 100% | Brand awareness campaigns |
-| Last-touch | Final interaction gets 100% | Direct response |
-| Linear | Equal credit to all touches | Understanding journey |
-| Time-decay | Recent touches get more credit | Short sales cycles |
-| Position-based | 40% first, 40% last, 20% middle | Balanced view |
-| Data-driven | Algorithm assigns based on data | Sophisticated analysis |
-
-### Practical Recommendation
-
-1. Start with last-touch (simplest)
-2. Add first-touch to understand acquisition
-3. Graduate to position-based for balanced view
-4. Only use data-driven with sufficient volume

package/skills/cm-cro-methodology/references/testing-methodology.md

@@ -1,330 +0,0 @@
-# CRO Testing Methodology
-
-Deep-dive into experiment design, statistical rigor, and test prioritization from the CRE Methodology.
-
-## The Philosophy of Bold Testing
-
-### Why "Meek Tweaks" Fail
-
-Most A/B tests fail because they're too small to detect. Button color changes, minor copy tweaks, and micro-optimizations suffer from:
-
-1. **Insufficient sample size** - Small changes require massive traffic to reach significance
-2. **Interaction effects** - Minor changes get lost in noise
-3. **Opportunity cost** - Time spent on 2% wins could find 200% wins
-
-**Rule: Test big changes that could double conversion, not small changes that might move it 5%.**
-
-### The 10x Mindset
-
-Before any test, ask: "Could this 10x our results?" If not, is it worth testing?
-
-- **Worth testing:** Complete page redesign, new value proposition, fundamentally different offer
-- **Not worth testing:** Button color, font size, image swap
-
----
-
-## A/B Testing vs. Multivariate Testing
-
-### A/B Testing (Split Testing)
-
-Compare two (or more) complete versions against each other.
-
-| Aspect | Details |
-|--------|---------|
-| **Best for** | Testing big concepts, page redesigns, offers |
-| **Traffic needed** | Lower (split between 2-4 variants) |
-| **Insights** | Which version wins overall |
-| **Limitation** | Doesn't show which elements contributed |
-
-**When to use:**
-- You have a hypothesis about a major change
-- Traffic is limited
-- You're comparing conceptual approaches
-
-### Multivariate Testing (MVT)
-
-Test multiple elements simultaneously to find optimal combination.
-
-| Aspect | Details |
-|--------|---------|
-| **Best for** | Optimizing elements after winning concept proven |
-| **Traffic needed** | Much higher (combinations multiply) |
-| **Insights** | Which specific elements drive results |
-| **Limitation** | Requires significant traffic |
-
-**When to use:**
-- You have a winning page to optimize further
-- High traffic (100k+ monthly visitors)
-- Clear, isolated elements to test
-
-### Traffic Requirements
-
-**A/B Test:**
-```
-Minimum sample per variant = 250-500 conversions
-For 2 variants with 5% conversion: 10,000-20,000 visitors needed
-```
-
-**Multivariate Test:**
-```
-Combinations = (Options for Element 1) × (Options for Element 2) × ...
-Example: 3 headlines × 3 images × 2 CTAs = 18 combinations
-Each combination needs 250+ conversions = 90,000+ conversions total
-```
-
-**Recommendation:** Start with A/B tests. Only move to MVT when you have:
-- Proven winning page concept
-- 100k+ monthly visitors
-- Mature testing program
-
----
-
-## Statistical Significance
-
-### What It Means
-
-Statistical significance tells you: "How likely is this result due to chance vs. a real effect?"
-
-**Industry standard:** 95% confidence (p-value < 0.05)
-- 95% confident the difference is real
-- 5% chance it's random noise
-
-### Common Mistakes
-
-**1. Peeking and stopping early**
-
-Checking results daily and stopping when you see a winner leads to false positives.
-
-- **Wrong:** "We're at 95% confidence after 3 days—ship it!"
-- **Right:** Pre-determine sample size and test duration; don't stop early
-
-**2. Calling tests with insufficient data**
-
-| Visitors | Conversions | Can you call it? |
-|----------|-------------|------------------|
-| 500 | 15 vs 20 | No |
-| 5,000 | 150 vs 200 | Possibly |
-| 50,000 | 1,500 vs 2,000 | Yes |
-
-**3. Ignoring practical significance**
-
-A statistically significant 0.1% lift isn't worth implementation complexity.
-
-**4. Multiple comparison problem**
-
-Testing 20 variants? One will show "significance" by chance alone.
-
-### Sample Size Calculation
-
-Before testing, calculate required sample size:
-
-**Inputs needed:**
-- Baseline conversion rate
-- Minimum detectable effect (MDE) you care about
-- Statistical power (typically 80%)
-- Significance level (typically 95%)
-
-**Rule of thumb:**
-```
-For 5% baseline, 20% relative lift detection:
-~25,000 visitors per variant needed
-
-For 5% baseline, 50% relative lift detection:
-~4,000 visitors per variant needed
-```
-
-**Key insight:** The smaller the effect you want to detect, the more traffic you need. This is why bold changes are better—they're detectable with less traffic.
-
-### Test Duration
-
-**Minimum test duration:**
-- At least 1 full business cycle (typically 1-2 weeks)
-- Include weekdays AND weekends
-- Account for seasonality
-
-**Why?**
-- Visitor behavior differs by day of week
-- Friday buyers differ from Monday researchers
-- Monthly cycles affect B2B especially
-
----
-
-## ICE Prioritization Framework
-
-Prioritize test ideas using ICE scores:
-
-### Impact (1-10)
-"If this wins, how big would the impact be?"
-
-| Score | Impact Level |
-|-------|--------------|
-| 10 | Could double conversion rate |
-| 7-9 | Major improvement (30-50%+) |
-| 4-6 | Moderate improvement (10-30%) |
-| 1-3 | Minor improvement (<10%) |
-
-### Confidence (1-10)
-"How confident are we this will work?"
-
-| Score | Confidence Level |
-|-------|------------------|
-| 10 | Proven in research, worked before |
-| 7-9 | Strong research supports it |
-| 4-6 | Reasonable hypothesis |
-| 1-3 | Gut feeling, unvalidated |
-
-### Ease (1-10)
-"How easy is this to implement and test?"
-
-| Score | Ease Level |
-|-------|------------|
-| 10 | Text change only |
-| 7-9 | Design change, no dev needed |
-| 4-6 | Requires development |
-| 1-3 | Major technical lift |
-
-### ICE Score Calculation
-
-```
-ICE Score = (Impact + Confidence + Ease) / 3
-```
-
-Or weighted:
-```
-ICE Score = (Impact × 2 + Confidence × 1.5 + Ease × 1) / 4.5
-```
-
-### Sample Prioritization
-
-| Test Idea | Impact | Confidence | Ease | Score |
-|-----------|--------|------------|------|-------|
-| New headline from customer research | 8 | 9 | 10 | 9.0 |
-| Add video testimonial | 7 | 7 | 6 | 6.7 |
-| Redesign checkout flow | 9 | 6 | 3 | 6.0 |
-| Change button color | 2 | 2 | 10 | 4.7 |
-
----
-
-## Test Documentation
-
-### Before the Test
-
-Document:
-1. **Hypothesis:** "If we [change X], then [metric Y] will improve because [reason based on research]"
-2. **Primary metric:** One metric that determines winner
-3. **Secondary metrics:** Additional metrics to monitor
-4. **Guardrail metrics:** Metrics that shouldn't decrease
-5. **Sample size requirement**
-6. **Test duration**
-7. **Traffic allocation**
-
-### After the Test
-
-Document:
-1. **Results:** Raw numbers, conversion rates, confidence interval
-2. **Statistical significance:** p-value, confidence level
-3. **Practical significance:** Is the lift worth implementing?
-4. **Learnings:** What does this teach us about our customers?
-5. **Next steps:** Ship winner, iterate, or abandon?
-
-### Learnings Database
-
-Every test should add to organizational knowledge:
-
-| Test | Hypothesis | Result | Learning | Applicable to |
-|------|------------|--------|----------|---------------|
-| Homepage headline A/B | Customer language converts better | Winner: +27% | Customers care about outcomes, not features | All landing pages |
-| Form length test | Shorter forms convert better | Loser: no diff | Our audience expects detailed forms | Lead gen pages |
-
----
-
-## When Tests Fail
-
-### Types of "Failure"
-
-**1. No winner (inconclusive)**
-- Sample size too small
-- Effect size too small to detect
-- Test needed to run longer
-
-**2. Control wins**
-- New version is worse
-- Hypothesis was wrong
-- Still a learning!
-
-**3. Technical problems**
-- Tracking broke
-- Experience differed from plan
-- Sample contamination
-
-### What to Do
-
-1. **Document the learning** - "We learned customers prefer X"
-2. **Investigate why** - Go back to research
-3. **Don't give up on the page** - The opportunity exists, you just haven't found the solution
-4. **Try a bolder change** - Maybe the change wasn't big enough
-
-**Critical insight:** A failed test that teaches you something is more valuable than a winning test you don't understand.
-
----
-
-## CRO Team Dynamics
-
-### Roles in a CRO Program
-
-| Role | Responsibility |
-|------|----------------|
-| **CRO Lead** | Strategy, prioritization, stakeholder management |
-| **Researcher** | User research, surveys, analytics analysis |
-| **Designer** | Wireframes, mockups, user flows |
-| **Developer** | Test implementation, technical QA |
-| **Analyst** | Results analysis, statistical rigor |
-
-### Getting Stakeholder Buy-In
-
-**Common objections:**
-
-| Objection | Counter |
-|-----------|---------|
-| "We already know what works" | "Then testing will confirm it quickly" |
-| "Testing takes too long" | "Shipping wrong things costs more" |
-| "Our traffic is too low" | "Then we test bigger changes" |
-| "The CEO wants X" | "Let's test to validate the idea" |
-
-**Building credibility:**
-1. Start with quick wins (high-traffic pages, obvious problems)
-2. Document and share learnings widely
-3. Quantify impact in revenue terms
-4. Build testing into the culture, not just a project
-
-### Test Velocity
-
-**Goal:** Increase valid tests per month over time.
-
-| Maturity | Tests/Month | Characteristics |
-|----------|-------------|-----------------|
-| Beginner | 1-2 | Manual processes, ad-hoc |
-| Developing | 4-6 | Established backlog, regular cadence |
-| Advanced | 10-20 | Parallel testing, mature process |
-| Expert | 20+ | Multiple simultaneous tests, automated |
-
----
-
-## Testing Platform Comparison
-
-| Platform | Best For | Limitations |
-|----------|----------|-------------|
-| Google Optimize | Beginners, free tier | Sunsetting, limited features |
-| VWO | Mid-market, visual editor | Can be slow, limited targeting |
-| Optimizely | Enterprise, complex tests | Expensive, learning curve |
-| LaunchDarkly | Dev-centric, feature flags | Not optimized for marketing |
-| Custom | Full control | Development cost |
-
-### Key Features to Look For
-
-- Visual editor for non-developers
-- Robust statistical engine
-- Segment targeting
-- Integrations (analytics, CDP, etc.)
-- Flicker prevention
-- Mutually exclusive experiments