Lead Generation For Dummies
Book image
Explore Book Buy On Amazon

When you conduct a lead-generation generation test, you're investigating your hypothesis so you can prove or disprove your theory. There are many best practices to testing and many elements to think about. The following list gives some easy-to-follow steps to conducting an A/B test:

  1. Isolate your variable.

    This test uses an example email A/B test using two different From names:

    • From address for the control parameter: Marketo Premium Content

    • From address for the test email: The personal email address of a sales rep.

  2. Use a sufficiently large sample size.

    It's tough to prove a hypothesis if your test sample size is small. The larger your sample size can be, the better your test results are. But you have to be careful. For this email example, if the sample size is too large, you risk having a large portion of your database receiving a less-effective email. You have to strike a balance right in the middle.

  3. Eliminate confounding variables.

    Many factors can affect the results of your test, so try to eliminate variables that would render your test obsolete.

    For this example, you don't just need to leave your control unchanged, but you also need to send your emails at the same time and make sure your test is randomized. If you're using a marketing automation solution, you can usually conduct A/B testing quickly and efficiently by sending 50 percent of your emails to a random sample of your designated list.

  4. Review the results.

    After you have sent out your test, wait to examine your results to prove or disprove your hypothesis. First, you need to look to determine if a statistical significance — the probability that results are meaningful and not because of chance — exists between your two versions.

    Use an A/B testing significance calculator (one from Visual Website Optimizer appears in the image). You input the number of visitors for both the control and the variation, as well as the number of conversions. And then you can calculate the significance.

    You can also use calculators to determine the confidence score, so you know just how significant your test is. A 95 percent or more confidence score is where you want to be to know your test is significant.


    Back to the From name test. The personalized From name had 1,000 more opens and 500 more clicks than the control name. The confidence score was 99 percent. And because only one factor was isolated, it was clear why the email with the personalized From name received more clicks.

Next, you optimize your campaigns based off of your test results. This should be fairly simple and straightforward if you're always testing (which is highly suggested). Take your results and implement them!

About This Article

This article is from the book:

About the book author:

Dayna Rothman is the senior content marketing manager at Marketo, a leader in the marketing automation space. Dayna leads content creation and strategy at Marketo and is the managing editor for the Marketo blog, which receives more than 400,000 unique visitors per year. Dayna has also been featured as one of the top 25 content marketers to watch according to Kapost, and one of the top 50 content marketing influencers according to Onalytica.

This article can be found in the category: