Creating effective variations is a crucial part of a successful A/B test. The changes you introduce must be impactful enough to show measurable differences in performance.
The baseline (original version) serves as the reference point. Ensure that the baseline reflects your current best-performing version, so you can measure improvements against it.
To keep your experiment manageable and ensure statistical significance, limit the number of variations to two or three. Each additional variation requires more traffic and time to achieve reliable results.
You’ll need around 7,000 users per variation to detect a 1% change in performance from your baseline.
Learn more about statistical significance here.
Gleef specializes in A/B testing for wording, not UI. Testing user interface (UI) elements involves different strategies that can affect the overall structure of your website. Our goal is to keep A/B testing simple, no-code, and focused on wording.