Yesterday, I attended a presentation by Dan Chuparkoff, the VP of Product at Civis Analytics. Civis Analytics is a data and analytics giant based in Chicago. If anyone knows about testing, whether it be websites or products, it’s them. Chuparkoff was kind enough to share his wisdom with the crowd. Fun fact: not only is he an expert when it comes to A/B testing, he is also the father of identical twins, so he basically lives A/B testing 24/7. The take-home message from Chuparkoff’s talk was that your audience is a collection of individuals, not an homogenous group. Therefore straight A/B testing does not always work the way that marketers think it should. Different people are turned on or off by different things and standard A/B testing does not always get to the root of what turns people away, only what encourages people to click, or view, or buy. In order to make the most of your testing it’s best to fully understand the influence that your the influence your marketing is having, not necessarily the amount of clicks that it gets. It’s just as important to understand why some people didn’t click as it is to track the people who did. While it might seem complicated to try to reach every segment of your audience with the message that they will find most attractive, it is important to try and tailor your message for different segments as well as learn the segments that make up your audience and do your best to keep them engaged.
