It's been on our agenda for a long time but urged on by some commenters on this blog, particularly Niki Scevak who I caught up with last week it's finally made it to the top of our to do list!
Based on our traffic and conversions we think we'll need to run each test for about 1-2 months to collect enough data to get a statistically significant result, so we want to make sure that the things we test have a reasonable chance of making a decent impact to our conversion rate.
We have a few ideas of things to test but we're probably a little too close to the website to judge it properly, so we thought we'd ask for people's thoughts here.
If you were going to run an A/B test on Shoes of Prey with the goal of increasing our sales conversion rate, what would you test first?
Update: A friend made the good point that I haven't actually explained what an A/B test is and not everyone is a web geek - good point! An A/B test is a structured way of testing two different variations of something on a website to see which has a better outcome, in our case, conversion rate. Simple tests can include testing two different photos on a home page to see which converts better, or two different coloured 'Add to cart' buttons. There's a great example on the website Which Test Won? at the moment of a blue shadow behind an 'Add gadget to your site' button increasing versions by 50.5%! Most variations aren't quite that dramatic, but 20% improvements are not out of the question for a lot of A/B tests.