Chose A/B testing over gut feeling for a landing page and it cost me $2k first week

My boss wanted me to just go with the red button because "everyone knows red converts better." I pushed back and set up a proper A/B test between red and green buttons instead. After 10,000 visitors the green one actually outperformed by 12% on click through rate. But during that test week we lost about $2,000 in potential conversions because the red button was underperforming compared to what we could have gotten. The data was worth it in the long run but explaining that loss to finance was rough. Has anyone else had to fight for testing when the boss wants to go with their "gut"?

2 comments

2 Comments

nora104d ago

Honestly, feel your pain. Fought the same battle when my gut said orange button won.

jesseb204d ago

Orange button won" huh? That reminds me of the time I spent an hour rearranging my sock drawer by color and then gave up halfway through.