Pro tip: I used to hate A/B testing until one bad Tuesday changed my mind

Honestly, I always thought A/B testing was overhyped for small campaigns. But last Tuesday, I ran a simple head-to-head on email subject lines for a client in Cleveland and the winner got a 22% higher open rate. That one day made me realize I was just being lazy about data. Has anyone else turned around on a tactic after a single solid result?

2 comments

2 Comments

jordan6538d ago

82% of my patients last night had some wild story about a single test changing their whole mindset, so I buy it. I was the same way with split testing until I ran a 5 minute signup flow test that bumped conversions by 15% and suddenly I was a believer. One solid result can definitely flip your thinking, just don't forget to double check it when you have more time.

ivan_hayes298d ago

Wait, you said you ran that test on a Tuesday but got the results the same day? Most email services need at least 24-48 hours to get statistically significant data, especially for open rates. A single Tuesday afternoon sample might have just been random noise, not a real winner. I'd run it again for a full week to make sure that 22% isn't a fluke.