37
Question about A/B testing landing pages after a conference mishap
I was at a marketing conference in Austin last month and a speaker called out my company's landing page on stage (yikes). Turns out our sign-up button was the same color as the background on mobile. We had been running A/B tests for weeks on desktop but totally ignored mobile optimization. After that, I spent around 40 hours rebuilding our whole testing setup. Now I test everything on three different devices before launch. Has anyone else dealt with a layout flaw that broke their conversion numbers?
3 comments
Log in to join the discussion
Log In3 Comments
spencer_ross2mo ago
Yes! That screen recording tip is genius. I started doing the same thing after a similar issue where my checkout button on Android was completely hidden behind the keyboard. I thought I was going crazy looking at analytics all day. Now I keep a cheap Android tablet on my desk just for testing every change before it goes live. The stupidest little CSS bugs can tank your numbers and you'd never catch them in DevTools.
6
valwest2mo ago
Oh man, that conference story is brutal but honestly such a wake up call for everyone. I had a similar thing happen with my own site where the checkout button was literally invisible on iOS Safari because of some weird CSS issue I never caught. I spent two weeks chasing a 30% drop in conversions and it took a friend looking over my shoulder to spot it. I ended up building a simple checklist for myself that I run through before any launch now. It includes checking the page on three real devices (not just browser tools cause those lie) and also doing a quick screen recording of myself trying to navigate it. The screen recording thing really helps because you see it like a user would instead of just staring at code.
5