Intro to A/B Split Testing
Friday, July 25th, 2008Split testing is a process used to optimize conversion rate. The term conversion rate refers to the percentage of visitors who take a particular action. If we are talking about an email newsletter opt-in page, then an opt-in is a conversion. If instead, we are talking about a sales letter, then each and every sale is a conversion.
Split testing comes in two basic flavors. The first is the relatively simple, yet effective A/B split testing. In this type of testing the idea is to test only two options against each other while trying to keep all other factors constant. The second family of split testing is the possibly more effective, yet significantly more complicated, multi-variant split testing. In this post we will examine only A/B split testing.
Now that we know what split testing is, let’s consider some of the situations that we can use split testing in. We can split test different layout versions for an e-commerce site. We could test different versions of a sales letter. Alternatively we could split test various attributes of an email opt-in, name squeeze page.



