mover-os 4.0.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Potentially problematic release.


This version of mover-os might be problematic. Click here for more details.

Files changed (149) hide show
  1. package/README.md +201 -0
  2. package/install.js +1424 -0
  3. package/package.json +35 -0
  4. package/src/hooks/context-staleness.sh +46 -0
  5. package/src/hooks/dirty-tree-guard.sh +33 -0
  6. package/src/hooks/engine-protection.sh +43 -0
  7. package/src/hooks/git-safety.sh +47 -0
  8. package/src/hooks/pre-compact-backup.sh +177 -0
  9. package/src/hooks/session-log-reminder.sh +64 -0
  10. package/src/skills/THIRD-PARTY-LICENSES.md +53 -0
  11. package/src/skills/agent-code-reviewer/SKILL.md +41 -0
  12. package/src/skills/agent-content-researcher/SKILL.md +59 -0
  13. package/src/skills/agent-research-analyst/SKILL.md +53 -0
  14. package/src/skills/agent-security-auditor/SKILL.md +42 -0
  15. package/src/skills/agent-strategy-analyst/SKILL.md +54 -0
  16. package/src/skills/defuddle/SKILL.md +41 -0
  17. package/src/skills/find-bugs/SKILL.md +75 -0
  18. package/src/skills/find-skills/SKILL.md +133 -0
  19. package/src/skills/frontend-design/LICENSE.txt +177 -0
  20. package/src/skills/frontend-design/SKILL.md +42 -0
  21. package/src/skills/human-writer/SKILL.md +185 -0
  22. package/src/skills/json-canvas/SKILL.md +656 -0
  23. package/src/skills/marketingskills/.claude-plugin/marketplace.json +45 -0
  24. package/src/skills/marketingskills/README.md +204 -0
  25. package/src/skills/marketingskills/skills/ab-test-setup/SKILL.md +508 -0
  26. package/src/skills/marketingskills/skills/analytics-tracking/SKILL.md +539 -0
  27. package/src/skills/marketingskills/skills/competitor-alternatives/SKILL.md +750 -0
  28. package/src/skills/marketingskills/skills/copy-editing/SKILL.md +439 -0
  29. package/src/skills/marketingskills/skills/copywriting/SKILL.md +455 -0
  30. package/src/skills/marketingskills/skills/email-sequence/SKILL.md +925 -0
  31. package/src/skills/marketingskills/skills/form-cro/SKILL.md +425 -0
  32. package/src/skills/marketingskills/skills/free-tool-strategy/SKILL.md +576 -0
  33. package/src/skills/marketingskills/skills/launch-strategy/SKILL.md +344 -0
  34. package/src/skills/marketingskills/skills/marketing-ideas/SKILL.md +565 -0
  35. package/src/skills/marketingskills/skills/marketing-psychology/SKILL.md +451 -0
  36. package/src/skills/marketingskills/skills/onboarding-cro/SKILL.md +433 -0
  37. package/src/skills/marketingskills/skills/page-cro/SKILL.md +334 -0
  38. package/src/skills/marketingskills/skills/paid-ads/SKILL.md +551 -0
  39. package/src/skills/marketingskills/skills/paywall-upgrade-cro/SKILL.md +570 -0
  40. package/src/skills/marketingskills/skills/popup-cro/SKILL.md +449 -0
  41. package/src/skills/marketingskills/skills/pricing-strategy/SKILL.md +710 -0
  42. package/src/skills/marketingskills/skills/programmatic-seo/SKILL.md +626 -0
  43. package/src/skills/marketingskills/skills/referral-program/SKILL.md +602 -0
  44. package/src/skills/marketingskills/skills/schema-markup/SKILL.md +596 -0
  45. package/src/skills/marketingskills/skills/seo-audit/SKILL.md +384 -0
  46. package/src/skills/marketingskills/skills/signup-flow-cro/SKILL.md +355 -0
  47. package/src/skills/marketingskills/skills/social-content/SKILL.md +807 -0
  48. package/src/skills/obsidian-bases/SKILL.md +651 -0
  49. package/src/skills/obsidian-cli/SKILL.md +103 -0
  50. package/src/skills/obsidian-markdown/SKILL.md +620 -0
  51. package/src/skills/react-best-practices/SKILL.md +136 -0
  52. package/src/skills/refactoring/SKILL.md +119 -0
  53. package/src/skills/seo-content-writer/SKILL.md +661 -0
  54. package/src/skills/seo-content-writer/references/content-structure-templates.md +875 -0
  55. package/src/skills/seo-content-writer/references/title-formulas.md +339 -0
  56. package/src/skills/skill-creator/LICENSE.txt +202 -0
  57. package/src/skills/skill-creator/SKILL.md +357 -0
  58. package/src/skills/skill-creator/references/output-patterns.md +82 -0
  59. package/src/skills/skill-creator/references/workflows.md +28 -0
  60. package/src/skills/skill-creator/scripts/init_skill.py +303 -0
  61. package/src/skills/skill-creator/scripts/package_skill.py +110 -0
  62. package/src/skills/skill-creator/scripts/quick_validate.py +103 -0
  63. package/src/skills/systematic-debugging/CREATION-LOG.md +119 -0
  64. package/src/skills/systematic-debugging/SKILL.md +296 -0
  65. package/src/skills/systematic-debugging/condition-based-waiting-example.ts +158 -0
  66. package/src/skills/systematic-debugging/condition-based-waiting.md +115 -0
  67. package/src/skills/systematic-debugging/defense-in-depth.md +122 -0
  68. package/src/skills/systematic-debugging/find-polluter.sh +63 -0
  69. package/src/skills/systematic-debugging/root-cause-tracing.md +169 -0
  70. package/src/skills/systematic-debugging/test-academic.md +14 -0
  71. package/src/skills/systematic-debugging/test-pressure-1.md +58 -0
  72. package/src/skills/systematic-debugging/test-pressure-2.md +68 -0
  73. package/src/skills/systematic-debugging/test-pressure-3.md +69 -0
  74. package/src/skills/ui-ux-pro-max/SKILL.md +386 -0
  75. package/src/skills/webhook-handler-patterns/SKILL.md +81 -0
  76. package/src/skills/webhook-handler-patterns/references/error-handling.md +299 -0
  77. package/src/skills/webhook-handler-patterns/references/frameworks/express.md +295 -0
  78. package/src/skills/webhook-handler-patterns/references/frameworks/fastapi.md +415 -0
  79. package/src/skills/webhook-handler-patterns/references/frameworks/nextjs.md +331 -0
  80. package/src/skills/webhook-handler-patterns/references/handler-sequence.md +51 -0
  81. package/src/skills/webhook-handler-patterns/references/idempotency.md +227 -0
  82. package/src/skills/webhook-handler-patterns/references/retry-logic.md +261 -0
  83. package/src/structure/00_Inbox/.gitkeep +0 -0
  84. package/src/structure/00_Inbox/Quick_Capture.md +5 -0
  85. package/src/structure/01_Projects/.gitkeep +0 -0
  86. package/src/structure/01_Projects/_Template Project/plan.md +55 -0
  87. package/src/structure/01_Projects/_Template Project/project_brief.md +45 -0
  88. package/src/structure/01_Projects/_Template Project/project_state.md +19 -0
  89. package/src/structure/02_Areas/Engine/Active_Context.md +126 -0
  90. package/src/structure/02_Areas/Engine/Auto_Learnings.md +36 -0
  91. package/src/structure/02_Areas/Engine/Dailies/.gitkeep +0 -0
  92. package/src/structure/02_Areas/Engine/Daily_Template.md +130 -0
  93. package/src/structure/02_Areas/Engine/Goals.md +65 -0
  94. package/src/structure/02_Areas/Engine/Identity_Prime_template.md +86 -0
  95. package/src/structure/02_Areas/Engine/Metrics_Log.md +45 -0
  96. package/src/structure/02_Areas/Engine/Monthly Reviews/.gitkeep +0 -0
  97. package/src/structure/02_Areas/Engine/Mover_Dossier.md +120 -0
  98. package/src/structure/02_Areas/Engine/Quarterly Reviews/.gitkeep +0 -0
  99. package/src/structure/02_Areas/Engine/Someday_Maybe.md +51 -0
  100. package/src/structure/02_Areas/Engine/Strategy_template.md +65 -0
  101. package/src/structure/02_Areas/Engine/Weekly Reviews/.gitkeep +0 -0
  102. package/src/structure/03_Library/Cheatsheets/.gitkeep +0 -0
  103. package/src/structure/03_Library/Entities/Decisions/_TEMPLATE.md +38 -0
  104. package/src/structure/03_Library/Entities/Entities MOC.md +49 -0
  105. package/src/structure/03_Library/Entities/Organizations/_TEMPLATE.md +28 -0
  106. package/src/structure/03_Library/Entities/People/_TEMPLATE.md +31 -0
  107. package/src/structure/03_Library/Entities/Places/_TEMPLATE.md +26 -0
  108. package/src/structure/03_Library/Inputs/.gitkeep +0 -0
  109. package/src/structure/03_Library/Inputs/Archive/.gitkeep +0 -0
  110. package/src/structure/03_Library/Inputs/Articles/.gitkeep +0 -0
  111. package/src/structure/03_Library/Inputs/Articles/_TEMPLATE.md +29 -0
  112. package/src/structure/03_Library/Inputs/Books/.gitkeep +0 -0
  113. package/src/structure/03_Library/Inputs/Books/_TEMPLATE.md +41 -0
  114. package/src/structure/03_Library/Inputs/Inputs MOC.md +40 -0
  115. package/src/structure/03_Library/Inputs/Videos/.gitkeep +0 -0
  116. package/src/structure/03_Library/Inputs/Videos/_TEMPLATE.md +29 -0
  117. package/src/structure/03_Library/MOCs/.gitkeep +0 -0
  118. package/src/structure/03_Library/Misc/.gitkeep +0 -0
  119. package/src/structure/03_Library/Principles/.gitkeep +0 -0
  120. package/src/structure/03_Library/Principles/Naval_Leverage.md +65 -0
  121. package/src/structure/03_Library/SOPs/Mover_OS_Architecture.md +74 -0
  122. package/src/structure/03_Library/SOPs/Tech_Doctrine.md +123 -0
  123. package/src/structure/03_Library/SOPs/Tech_Stack.md +55 -0
  124. package/src/structure/03_Library/SOPs/Zone_Operating.md +58 -0
  125. package/src/structure/04_Archives/.gitkeep +0 -0
  126. package/src/system/AI_INSTALL_MANIFEST.md +219 -0
  127. package/src/system/Mover_Global_Rules.md +646 -0
  128. package/src/system/V4_CONTEXT.md +223 -0
  129. package/src/workflows/analyse-day.md +376 -0
  130. package/src/workflows/context.md +24 -0
  131. package/src/workflows/debrief.md +199 -0
  132. package/src/workflows/debug-resistance.md +181 -0
  133. package/src/workflows/harvest.md +240 -0
  134. package/src/workflows/history.md +247 -0
  135. package/src/workflows/ignite.md +696 -0
  136. package/src/workflows/init-plan.md +16 -0
  137. package/src/workflows/log.md +314 -0
  138. package/src/workflows/morning.md +209 -0
  139. package/src/workflows/overview.md +203 -0
  140. package/src/workflows/pivot-strategy.md +218 -0
  141. package/src/workflows/plan-tomorrow.md +286 -0
  142. package/src/workflows/primer.md +209 -0
  143. package/src/workflows/project-notes.md +17 -0
  144. package/src/workflows/reboot.md +201 -0
  145. package/src/workflows/refactor-plan.md +135 -0
  146. package/src/workflows/review-week.md +537 -0
  147. package/src/workflows/setup.md +387 -0
  148. package/src/workflows/update.md +411 -0
  149. package/src/workflows/walkthrough.md +259 -0
@@ -0,0 +1,204 @@
1
+ # Marketing Skills for Claude Code
2
+
3
+ A collection of AI agent skills focused on marketing tasks. Built for technical marketers and founders who want Claude Code (or similar AI coding assistants) to help with conversion optimization, copywriting, SEO, analytics, and growth engineering.
4
+
5
+ Built by [Corey Haines](https://corey.co?ref=marketingskills). Need hands-on help? Check out [Conversion Factory](https://conversionfactory.co?ref=marketingskills) — Corey's agency for conversion optimization, landing pages, and growth strategy. Want to learn more about marketing? Subscribe to [Swipe Files](https://swipefiles.com?ref=marketingskills).
6
+
7
+ **Contributions welcome!** Found a way to improve a skill or have a new one to add? [Open a PR](#contributing).
8
+
9
+ ## What are Skills?
10
+
11
+ Skills are markdown files that give AI agents specialized knowledge and workflows for specific tasks. When you add these to your project, Claude Code can recognize when you're working on a marketing task and apply the right frameworks and best practices.
12
+
13
+ ## Available Skills
14
+
15
+ | Skill | Description | Triggers |
16
+ |-------|-------------|----------|
17
+ | [ab-test-setup](skills/ab-test-setup/) | Plan and implement A/B tests | "A/B test," "split test," "experiment" |
18
+ | [analytics-tracking](skills/analytics-tracking/) | Set up tracking and measurement | "tracking," "GA4," "GTM," "events" |
19
+ | [competitor-alternatives](skills/competitor-alternatives/) | Competitor comparison and alternative pages | "vs page," "alternative page," "[X] vs [Y]" |
20
+ | [copy-editing](skills/copy-editing/) | Edit and polish existing copy | "edit this copy," "review my copy," "copy sweep" |
21
+ | [copywriting](skills/copywriting/) | Write or improve marketing copy | "write copy," "rewrite," "headlines," "CTA copy" |
22
+ | [email-sequence](skills/email-sequence/) | Build email sequences and drip campaigns | "email sequence," "drip campaign," "nurture" |
23
+ | [form-cro](skills/form-cro/) | Optimize lead capture and contact forms | "form optimization," "lead form," "contact form" |
24
+ | [free-tool-strategy](skills/free-tool-strategy/) | Plan engineering-as-marketing tools | "free tool," "calculator," "lead gen tool" |
25
+ | [launch-strategy](skills/launch-strategy/) | Product launches and feature announcements | "launch," "Product Hunt," "feature release" |
26
+ | [marketing-ideas](skills/marketing-ideas/) | 140 SaaS marketing ideas and strategies | "marketing ideas," "growth ideas," "how to market" |
27
+ | [marketing-psychology](skills/marketing-psychology/) | 70+ mental models for marketing | "psychology," "mental models," "cognitive bias" |
28
+ | [onboarding-cro](skills/onboarding-cro/) | Improve user activation and onboarding | "onboarding," "activation," "first-run experience" |
29
+ | [page-cro](skills/page-cro/) | Conversion optimization for any marketing page | "optimize [page]," "CRO," "page isn't converting" |
30
+ | [paid-ads](skills/paid-ads/) | Create and optimize paid ad campaigns | "PPC," "Google Ads," "Meta ads," "paid media" |
31
+ | [paywall-upgrade-cro](skills/paywall-upgrade-cro/) | In-app paywalls and upgrade screens | "paywall," "upgrade screen," "feature gate" |
32
+ | [popup-cro](skills/popup-cro/) | Create/optimize popups and modals | "popup," "modal," "exit intent" |
33
+ | [pricing-strategy](skills/pricing-strategy/) | Design pricing, packaging, and monetization | "pricing," "tiers," "freemium," "willingness to pay" |
34
+ | [programmatic-seo](skills/programmatic-seo/) | Build SEO pages at scale | "programmatic SEO," "template pages," "pages at scale" |
35
+ | [referral-program](skills/referral-program/) | Design referral and affiliate programs | "referral," "affiliate," "word of mouth," "viral" |
36
+ | [schema-markup](skills/schema-markup/) | Add structured data and rich snippets | "schema," "JSON-LD," "structured data" |
37
+ | [seo-audit](skills/seo-audit/) | Audit technical and on-page SEO | "SEO audit," "technical SEO," "not ranking" |
38
+ | [signup-flow-cro](skills/signup-flow-cro/) | Optimize signup and registration flows | "signup optimization," "registration form" |
39
+ | [social-content](skills/social-content/) | Create and schedule social media content | "LinkedIn post," "Twitter thread," "social media" |
40
+
41
+ ## Installation
42
+
43
+ ### Option 1: CLI Install (Recommended)
44
+
45
+ Use [add-skill](https://github.com/vercel-labs/add-skill) to install skills directly:
46
+
47
+ ```bash
48
+ # Install all skills
49
+ npx add-skill coreyhaines31/marketingskills
50
+
51
+ # Install specific skills
52
+ npx add-skill coreyhaines31/marketingskills --skill page-cro copywriting
53
+
54
+ # List available skills
55
+ npx add-skill coreyhaines31/marketingskills --list
56
+ ```
57
+
58
+ This automatically installs to your `.claude/skills/` directory.
59
+
60
+ ### Option 2: Claude Code Plugin
61
+
62
+ Install via Claude Code's built-in plugin system:
63
+
64
+ ```bash
65
+ # Add the marketplace
66
+ /plugin marketplace add coreyhaines31/marketingskills
67
+
68
+ # Install all marketing skills
69
+ /plugin install marketing-skills
70
+ ```
71
+
72
+ ### Option 3: Clone and Copy
73
+
74
+ Clone the entire repo and copy the skills folder:
75
+
76
+ ```bash
77
+ git clone https://github.com/coreyhaines31/marketingskills.git
78
+ cp -r marketingskills/skills/* .claude/skills/
79
+ ```
80
+
81
+ ### Option 4: Git Submodule
82
+
83
+ Add as a submodule for easy updates:
84
+
85
+ ```bash
86
+ git submodule add https://github.com/coreyhaines31/marketingskills.git .claude/marketingskills
87
+ ```
88
+
89
+ Then reference skills from `.claude/marketingskills/skills/`.
90
+
91
+ ### Option 5: Fork and Customize
92
+
93
+ 1. Fork this repository
94
+ 2. Customize skills for your specific needs
95
+ 3. Clone your fork into your projects
96
+
97
+ ## Usage
98
+
99
+ Once installed, just ask Claude Code to help with marketing tasks:
100
+
101
+ ```
102
+ "Help me optimize this landing page for conversions"
103
+ → Uses page-cro skill
104
+
105
+ "Write homepage copy for my SaaS"
106
+ → Uses copywriting skill
107
+
108
+ "Set up GA4 tracking for signups"
109
+ → Uses analytics-tracking skill
110
+
111
+ "Create a 5-email welcome sequence"
112
+ → Uses email-sequence skill
113
+ ```
114
+
115
+ You can also invoke skills directly:
116
+
117
+ ```
118
+ /page-cro
119
+ /email-sequence
120
+ /seo-audit
121
+ ```
122
+
123
+ ## Skill Categories
124
+
125
+ ### Conversion Optimization
126
+ - `page-cro` - Any marketing page
127
+ - `signup-flow-cro` - Registration flows
128
+ - `onboarding-cro` - Post-signup activation
129
+ - `form-cro` - Lead capture forms
130
+ - `popup-cro` - Modals and overlays
131
+ - `paywall-upgrade-cro` - In-app upgrade moments
132
+
133
+ ### Content & Copy
134
+ - `copywriting` - Marketing page copy
135
+ - `copy-editing` - Edit and polish existing copy
136
+ - `email-sequence` - Automated email flows
137
+ - `social-content` - Social media content
138
+
139
+ ### SEO & Discovery
140
+ - `seo-audit` - Technical and on-page SEO
141
+ - `programmatic-seo` - Scaled page generation
142
+ - `competitor-alternatives` - Comparison and alternative pages
143
+ - `schema-markup` - Structured data
144
+
145
+ ### Paid & Distribution
146
+ - `paid-ads` - Google, Meta, LinkedIn ad campaigns
147
+ - `social-content` - Social media scheduling and strategy
148
+
149
+ ### Measurement & Testing
150
+ - `analytics-tracking` - Event tracking setup
151
+ - `ab-test-setup` - Experiment design
152
+
153
+ ### Growth Engineering
154
+ - `free-tool-strategy` - Marketing tools and calculators
155
+ - `referral-program` - Referral and affiliate programs
156
+
157
+ ### Strategy & Monetization
158
+ - `marketing-ideas` - 140 SaaS marketing ideas
159
+ - `marketing-psychology` - Mental models and psychology
160
+ - `launch-strategy` - Product launches and announcements
161
+ - `pricing-strategy` - Pricing, packaging, and monetization
162
+
163
+ ## Contributing
164
+
165
+ Found a way to improve a skill? Have a new skill to suggest? PRs and issues welcome!
166
+
167
+ **Ideas for contributions:**
168
+ - Improve existing skill instructions or frameworks
169
+ - Add new experiment ideas or best practices
170
+ - Fix typos or clarify confusing sections
171
+ - Suggest new skills (open an issue first to discuss)
172
+ - Add examples or case studies
173
+
174
+ **How to contribute:**
175
+ 1. Fork the repo
176
+ 2. Edit the skill file(s)
177
+ 3. Submit a PR with a clear description of what you improved
178
+
179
+ ### Skill File Structure
180
+
181
+ Each skill is a directory containing a `SKILL.md` file:
182
+
183
+ ```
184
+ skills/
185
+ skill-name/
186
+ SKILL.md
187
+ ```
188
+
189
+ The `SKILL.md` file follows this format:
190
+
191
+ ```markdown
192
+ ---
193
+ name: skill-name
194
+ description: One-line description for skill selection
195
+ ---
196
+
197
+ # Skill Name
198
+
199
+ [Full instructions for the AI agent]
200
+ ```
201
+
202
+ ## License
203
+
204
+ MIT - Use these however you want.
@@ -0,0 +1,508 @@
1
+ ---
2
+ name: ab-test-setup
3
+ description: When the user wants to plan, design, or implement an A/B test or experiment. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "variant copy," "multivariate test," or "hypothesis." For tracking implementation, see analytics-tracking.
4
+ ---
5
+
6
+ # A/B Test Setup
7
+
8
+ You are an expert in experimentation and A/B testing. Your goal is to help design tests that produce statistically valid, actionable results.
9
+
10
+ ## Initial Assessment
11
+
12
+ Before designing a test, understand:
13
+
14
+ 1. **Test Context**
15
+ - What are you trying to improve?
16
+ - What change are you considering?
17
+ - What made you want to test this?
18
+
19
+ 2. **Current State**
20
+ - Baseline conversion rate?
21
+ - Current traffic volume?
22
+ - Any historical test data?
23
+
24
+ 3. **Constraints**
25
+ - Technical implementation complexity?
26
+ - Timeline requirements?
27
+ - Tools available?
28
+
29
+ ---
30
+
31
+ ## Core Principles
32
+
33
+ ### 1. Start with a Hypothesis
34
+ - Not just "let's see what happens"
35
+ - Specific prediction of outcome
36
+ - Based on reasoning or data
37
+
38
+ ### 2. Test One Thing
39
+ - Single variable per test
40
+ - Otherwise you don't know what worked
41
+ - Save MVT for later
42
+
43
+ ### 3. Statistical Rigor
44
+ - Pre-determine sample size
45
+ - Don't peek and stop early
46
+ - Commit to the methodology
47
+
48
+ ### 4. Measure What Matters
49
+ - Primary metric tied to business value
50
+ - Secondary metrics for context
51
+ - Guardrail metrics to prevent harm
52
+
53
+ ---
54
+
55
+ ## Hypothesis Framework
56
+
57
+ ### Structure
58
+
59
+ ```
60
+ Because [observation/data],
61
+ we believe [change]
62
+ will cause [expected outcome]
63
+ for [audience].
64
+ We'll know this is true when [metrics].
65
+ ```
66
+
67
+ ### Examples
68
+
69
+ **Weak hypothesis:**
70
+ "Changing the button color might increase clicks."
71
+
72
+ **Strong hypothesis:**
73
+ "Because users report difficulty finding the CTA (per heatmaps and feedback), we believe making the button larger and using contrasting color will increase CTA clicks by 15%+ for new visitors. We'll measure click-through rate from page view to signup start."
74
+
75
+ ### Good Hypotheses Include
76
+
77
+ - **Observation**: What prompted this idea
78
+ - **Change**: Specific modification
79
+ - **Effect**: Expected outcome and direction
80
+ - **Audience**: Who this applies to
81
+ - **Metric**: How you'll measure success
82
+
83
+ ---
84
+
85
+ ## Test Types
86
+
87
+ ### A/B Test (Split Test)
88
+ - Two versions: Control (A) vs. Variant (B)
89
+ - Single change between versions
90
+ - Most common, easiest to analyze
91
+
92
+ ### A/B/n Test
93
+ - Multiple variants (A vs. B vs. C...)
94
+ - Requires more traffic
95
+ - Good for testing several options
96
+
97
+ ### Multivariate Test (MVT)
98
+ - Multiple changes in combinations
99
+ - Tests interactions between changes
100
+ - Requires significantly more traffic
101
+ - Complex analysis
102
+
103
+ ### Split URL Test
104
+ - Different URLs for variants
105
+ - Good for major page changes
106
+ - Easier implementation sometimes
107
+
108
+ ---
109
+
110
+ ## Sample Size Calculation
111
+
112
+ ### Inputs Needed
113
+
114
+ 1. **Baseline conversion rate**: Your current rate
115
+ 2. **Minimum detectable effect (MDE)**: Smallest change worth detecting
116
+ 3. **Statistical significance level**: Usually 95%
117
+ 4. **Statistical power**: Usually 80%
118
+
119
+ ### Quick Reference
120
+
121
+ | Baseline Rate | 10% Lift | 20% Lift | 50% Lift |
122
+ |---------------|----------|----------|----------|
123
+ | 1% | 150k/variant | 39k/variant | 6k/variant |
124
+ | 3% | 47k/variant | 12k/variant | 2k/variant |
125
+ | 5% | 27k/variant | 7k/variant | 1.2k/variant |
126
+ | 10% | 12k/variant | 3k/variant | 550/variant |
127
+
128
+ ### Formula Resources
129
+ - Evan Miller's calculator: https://www.evanmiller.org/ab-testing/sample-size.html
130
+ - Optimizely's calculator: https://www.optimizely.com/sample-size-calculator/
131
+
132
+ ### Test Duration
133
+
134
+ ```
135
+ Duration = Sample size needed per variant × Number of variants
136
+ ───────────────────────────────────────────────────
137
+ Daily traffic to test page × Conversion rate
138
+ ```
139
+
140
+ Minimum: 1-2 business cycles (usually 1-2 weeks)
141
+ Maximum: Avoid running too long (novelty effects, external factors)
142
+
143
+ ---
144
+
145
+ ## Metrics Selection
146
+
147
+ ### Primary Metric
148
+ - Single metric that matters most
149
+ - Directly tied to hypothesis
150
+ - What you'll use to call the test
151
+
152
+ ### Secondary Metrics
153
+ - Support primary metric interpretation
154
+ - Explain why/how the change worked
155
+ - Help understand user behavior
156
+
157
+ ### Guardrail Metrics
158
+ - Things that shouldn't get worse
159
+ - Revenue, retention, satisfaction
160
+ - Stop test if significantly negative
161
+
162
+ ### Metric Examples by Test Type
163
+
164
+ **Homepage CTA test:**
165
+ - Primary: CTA click-through rate
166
+ - Secondary: Time to click, scroll depth
167
+ - Guardrail: Bounce rate, downstream conversion
168
+
169
+ **Pricing page test:**
170
+ - Primary: Plan selection rate
171
+ - Secondary: Time on page, plan distribution
172
+ - Guardrail: Support tickets, refund rate
173
+
174
+ **Signup flow test:**
175
+ - Primary: Signup completion rate
176
+ - Secondary: Field-level completion, time to complete
177
+ - Guardrail: User activation rate (post-signup quality)
178
+
179
+ ---
180
+
181
+ ## Designing Variants
182
+
183
+ ### Control (A)
184
+ - Current experience, unchanged
185
+ - Don't modify during test
186
+
187
+ ### Variant (B+)
188
+
189
+ **Best practices:**
190
+ - Single, meaningful change
191
+ - Bold enough to make a difference
192
+ - True to the hypothesis
193
+
194
+ **What to vary:**
195
+
196
+ Headlines/Copy:
197
+ - Message angle
198
+ - Value proposition
199
+ - Specificity level
200
+ - Tone/voice
201
+
202
+ Visual Design:
203
+ - Layout structure
204
+ - Color and contrast
205
+ - Image selection
206
+ - Visual hierarchy
207
+
208
+ CTA:
209
+ - Button copy
210
+ - Size/prominence
211
+ - Placement
212
+ - Number of CTAs
213
+
214
+ Content:
215
+ - Information included
216
+ - Order of information
217
+ - Amount of content
218
+ - Social proof type
219
+
220
+ ### Documenting Variants
221
+
222
+ ```
223
+ Control (A):
224
+ - Screenshot
225
+ - Description of current state
226
+
227
+ Variant (B):
228
+ - Screenshot or mockup
229
+ - Specific changes made
230
+ - Hypothesis for why this will win
231
+ ```
232
+
233
+ ---
234
+
235
+ ## Traffic Allocation
236
+
237
+ ### Standard Split
238
+ - 50/50 for A/B test
239
+ - Equal split for multiple variants
240
+
241
+ ### Conservative Rollout
242
+ - 90/10 or 80/20 initially
243
+ - Limits risk of bad variant
244
+ - Longer to reach significance
245
+
246
+ ### Ramping
247
+ - Start small, increase over time
248
+ - Good for technical risk mitigation
249
+ - Most tools support this
250
+
251
+ ### Considerations
252
+ - Consistency: Users see same variant on return
253
+ - Segment sizes: Ensure segments are large enough
254
+ - Time of day/week: Balanced exposure
255
+
256
+ ---
257
+
258
+ ## Implementation Approaches
259
+
260
+ ### Client-Side Testing
261
+
262
+ **Tools**: PostHog, Optimizely, VWO, custom
263
+
264
+ **How it works**:
265
+ - JavaScript modifies page after load
266
+ - Quick to implement
267
+ - Can cause flicker
268
+
269
+ **Best for**:
270
+ - Marketing pages
271
+ - Copy/visual changes
272
+ - Quick iteration
273
+
274
+ ### Server-Side Testing
275
+
276
+ **Tools**: PostHog, LaunchDarkly, Split, custom
277
+
278
+ **How it works**:
279
+ - Variant determined before page renders
280
+ - No flicker
281
+ - Requires development work
282
+
283
+ **Best for**:
284
+ - Product features
285
+ - Complex changes
286
+ - Performance-sensitive pages
287
+
288
+ ### Feature Flags
289
+
290
+ - Binary on/off (not true A/B)
291
+ - Good for rollouts
292
+ - Can convert to A/B with percentage split
293
+
294
+ ---
295
+
296
+ ## Running the Test
297
+
298
+ ### Pre-Launch Checklist
299
+
300
+ - [ ] Hypothesis documented
301
+ - [ ] Primary metric defined
302
+ - [ ] Sample size calculated
303
+ - [ ] Test duration estimated
304
+ - [ ] Variants implemented correctly
305
+ - [ ] Tracking verified
306
+ - [ ] QA completed on all variants
307
+ - [ ] Stakeholders informed
308
+
309
+ ### During the Test
310
+
311
+ **DO:**
312
+ - Monitor for technical issues
313
+ - Check segment quality
314
+ - Document any external factors
315
+
316
+ **DON'T:**
317
+ - Peek at results and stop early
318
+ - Make changes to variants
319
+ - Add traffic from new sources
320
+ - End early because you "know" the answer
321
+
322
+ ### Peeking Problem
323
+
324
+ Looking at results before reaching sample size and stopping when you see significance leads to:
325
+ - False positives
326
+ - Inflated effect sizes
327
+ - Wrong decisions
328
+
329
+ **Solutions:**
330
+ - Pre-commit to sample size and stick to it
331
+ - Use sequential testing if you must peek
332
+ - Trust the process
333
+
334
+ ---
335
+
336
+ ## Analyzing Results
337
+
338
+ ### Statistical Significance
339
+
340
+ - 95% confidence = p-value < 0.05
341
+ - Means: <5% chance result is random
342
+ - Not a guarantee—just a threshold
343
+
344
+ ### Practical Significance
345
+
346
+ Statistical ≠ Practical
347
+
348
+ - Is the effect size meaningful for business?
349
+ - Is it worth the implementation cost?
350
+ - Is it sustainable over time?
351
+
352
+ ### What to Look At
353
+
354
+ 1. **Did you reach sample size?**
355
+ - If not, result is preliminary
356
+
357
+ 2. **Is it statistically significant?**
358
+ - Check confidence intervals
359
+ - Check p-value
360
+
361
+ 3. **Is the effect size meaningful?**
362
+ - Compare to your MDE
363
+ - Project business impact
364
+
365
+ 4. **Are secondary metrics consistent?**
366
+ - Do they support the primary?
367
+ - Any unexpected effects?
368
+
369
+ 5. **Any guardrail concerns?**
370
+ - Did anything get worse?
371
+ - Long-term risks?
372
+
373
+ 6. **Segment differences?**
374
+ - Mobile vs. desktop?
375
+ - New vs. returning?
376
+ - Traffic source?
377
+
378
+ ### Interpreting Results
379
+
380
+ | Result | Conclusion |
381
+ |--------|------------|
382
+ | Significant winner | Implement variant |
383
+ | Significant loser | Keep control, learn why |
384
+ | No significant difference | Need more traffic or bolder test |
385
+ | Mixed signals | Dig deeper, maybe segment |
386
+
387
+ ---
388
+
389
+ ## Documenting and Learning
390
+
391
+ ### Test Documentation
392
+
393
+ ```
394
+ Test Name: [Name]
395
+ Test ID: [ID in testing tool]
396
+ Dates: [Start] - [End]
397
+ Owner: [Name]
398
+
399
+ Hypothesis:
400
+ [Full hypothesis statement]
401
+
402
+ Variants:
403
+ - Control: [Description + screenshot]
404
+ - Variant: [Description + screenshot]
405
+
406
+ Results:
407
+ - Sample size: [achieved vs. target]
408
+ - Primary metric: [control] vs. [variant] ([% change], [confidence])
409
+ - Secondary metrics: [summary]
410
+ - Segment insights: [notable differences]
411
+
412
+ Decision: [Winner/Loser/Inconclusive]
413
+ Action: [What we're doing]
414
+
415
+ Learnings:
416
+ [What we learned, what to test next]
417
+ ```
418
+
419
+ ### Building a Learning Repository
420
+
421
+ - Central location for all tests
422
+ - Searchable by page, element, outcome
423
+ - Prevents re-running failed tests
424
+ - Builds institutional knowledge
425
+
426
+ ---
427
+
428
+ ## Output Format
429
+
430
+ ### Test Plan Document
431
+
432
+ ```
433
+ # A/B Test: [Name]
434
+
435
+ ## Hypothesis
436
+ [Full hypothesis using framework]
437
+
438
+ ## Test Design
439
+ - Type: A/B / A/B/n / MVT
440
+ - Duration: X weeks
441
+ - Sample size: X per variant
442
+ - Traffic allocation: 50/50
443
+
444
+ ## Variants
445
+ [Control and variant descriptions with visuals]
446
+
447
+ ## Metrics
448
+ - Primary: [metric and definition]
449
+ - Secondary: [list]
450
+ - Guardrails: [list]
451
+
452
+ ## Implementation
453
+ - Method: Client-side / Server-side
454
+ - Tool: [Tool name]
455
+ - Dev requirements: [If any]
456
+
457
+ ## Analysis Plan
458
+ - Success criteria: [What constitutes a win]
459
+ - Segment analysis: [Planned segments]
460
+ ```
461
+
462
+ ### Results Summary
463
+ When test is complete
464
+
465
+ ### Recommendations
466
+ Next steps based on results
467
+
468
+ ---
469
+
470
+ ## Common Mistakes
471
+
472
+ ### Test Design
473
+ - Testing too small a change (undetectable)
474
+ - Testing too many things (can't isolate)
475
+ - No clear hypothesis
476
+ - Wrong audience
477
+
478
+ ### Execution
479
+ - Stopping early
480
+ - Changing things mid-test
481
+ - Not checking implementation
482
+ - Uneven traffic allocation
483
+
484
+ ### Analysis
485
+ - Ignoring confidence intervals
486
+ - Cherry-picking segments
487
+ - Over-interpreting inconclusive results
488
+ - Not considering practical significance
489
+
490
+ ---
491
+
492
+ ## Questions to Ask
493
+
494
+ If you need more context:
495
+ 1. What's your current conversion rate?
496
+ 2. How much traffic does this page get?
497
+ 3. What change are you considering and why?
498
+ 4. What's the smallest improvement worth detecting?
499
+ 5. What tools do you have for testing?
500
+ 6. Have you tested this area before?
501
+
502
+ ---
503
+
504
+ ## Related Skills
505
+
506
+ - **page-cro**: For generating test ideas based on CRO principles
507
+ - **analytics-tracking**: For setting up test measurement
508
+ - **copywriting**: For creating variant copy