A/B Test: Did Adding a “Hint” Help or Hurt This Headline by 313%?

The winner: Version B

Could two words cause a 312.94% difference in opt-in rate?

That’s what happened in the A/B test we’re looking at today. While this result may be uncommon (unless you start with a really low opt-in rate), it’s also inspiring: once you see the difference a few tweaks to your headline can make, you can start optimizing with ease.

Today’s split test comes from the website of our own podcast, ConversionCast. We tested two LeadBox™ headlines based on the idea of increasing customer value. In one, we added two extra words about building relationships. In the other, we gave away a little more about the contents of the lead magnet with a “hint.” Here are the competing headlines(the minor tweaks are in bold):

  • Free Report Reveals…The Exact Strategy Lisa McQueen Used to Build Relationships & Increase Lifetime Customer Value By 144%
  • Free Report Reveals…The Exact Strategy Lisa McQueen Used to Increase Lifetime Customer Value By 144% (Hint: Automation)

Which version do you think increased opt-ins for this LeadBox™ by 312.94%?

Go down to the comments and tell us which one you’d choose and why—then vote below to see if you were right!

Vote to reveal the winning A/B-tested LeadPage® and our analysis.

Vote: Which Page Won This Split Test?
1 What's Your Vote?
2 And the Winner Is...
Build Relationships
Hint: Automation
1 What's Your Vote?
2 And the Winner Is...
3 Free Guide
Free Download: See Results from 20 of the Best Split Tests We've Featured on Our Podcast, ConversionCast (Called "The Split Testing Encyclopedia of Results").
It Contains Dozens of More Split Test Ideas, Results, and Insights.)
Click Here to Download my Free Guide

PRIVACY POLICY: We hate SPAM and promise to keep your email address safe.

YES! Nice call!
Nope! Try Again Next Time!
Winner: Version B created an overall increase of 312.94%
28% 72%

How People Voted

Click here to see our take on these results

If you chose Version B you are correct!

Version B, with a 100% probability of outperforming Version A, increased opt-ins by 312.94%.
Although we can’t say with total certainty why this change caused the increase, here are a couple of my speculations:

  • The headline in Version B more clearly communicated what visitors would learn about in the report, adding value to the lead magnet.
  • Visitors may have found more value in automation tips than in relationship-building advice.

Why do you think Version B outperformed Version A? Let us know in the comments!

Not all visitors are the same, but A/B testing your headlines may be something to consider for your own LeadBoxes®.

Click here to get the free split-test guide

What Do You Think?

Did this test’s results surprise you? Why do you think Version B increased conversions so dramatically? Leave a comment below and let us know your thoughts.

If you’re new to LeadPages, you should know that all Pro and Advanced users can run any A/B test inside LeadPages in just five clicks.

Do you have a LeadBox™ like this one that you would like to test? If so, you can set up the exact same type of test in under a minute. You can also A/B test your images, form fields, calls-to-action, and just about any other change you can think of.

Watch the quick video below for an introduction to enabling split testing on your LeadPages account.


More About LeadBox™ Headlines

A/B Test: Which Landing Page Headline Increased Opt-ins by 123.38%?
For another example of the power of headlines, check out this LeadBox™ test.

A/B Test: Which SEO-Related Headline Increased Opt-ins by 26.79%?
Not sure which headline to use for your landing pages? Check out this A/B test and vote to see which SEO-related headline gave this LeadBox a 26.79% lift!

  • AcesUp311

    Not a fan of this example. The first ad copy contains “…Build Relationships & Increase Lifetime Customer value by 144%.” In the second ad, it does not have “Build Relationships” but does have the added “(Hint: Automation)” so we are forced to wonder which bit of copy increased (or decreased) conversions. A better test would be to have two ads with and without the “(Hint: Automation)” ending. Then take the winner of that and split test it with and without the “Build Relationships” bit of copy.

    • Daphne Sidor

      I see where you’re coming from, Aces. One thing we can say from this test is that that the audience responded far better to the “Hint” addition than to the idea of “building relationships,” so that’s valuable knowledge to have in itself. (You could also argue that there’s something to be said for keeping the lengths of the headlines identical, so that we’re not accidentally testing how visitors respond to headline length.) But yes: if you wanted to specifically test whether adding a parenthetical statement or adding a second goal to your headline was useful, my first choice would be to test those two strategies independently, too,

      Thanks for weighing in!