The A/B test results are in! #Curveball


When I ran an A/B test on my subject lines last week, I promised to let you know which one won.

Well, the results are in!

If you remember, there were two subject lines. The first was more curiosity-driven, and the second was more pain-driven...

Subject line A: THIS is how to improve your open rates

Subject line B: Low open rates? Let's fix that

I'd guessed that the second subject line, the pain-driven one, would win.

Looks like I was wrong. Kind of πŸ˜†

Here are the A/B test results:

44.42% = THIS is how to improve your open rates

43.69% = Low open rates? Let's fix that

But here's the thing...

The 0.73% difference is statistically insignificant. Meaning, subject line A won...but not by enough margin to really matter or influence my decisions.

The thing about testing data like this is you have to know when the data doesn't mean much πŸ˜†

This 0.73% statistically insignificant result does still mean something, though.

It tells us:

1 - My audience is driven pretty equally by both pain and curiosity. There's no strong preference, so I can safely use both. (At least in this case. That might change if, for example, I'm selling a specific product that offers a specific outcome).

2 - It could mean that I didn't test hard or deep enough. Maybe next time I try a different angle, like pain vs dream state (or goals). Now that would be an interesting test.

​​The lesson here is that A/B tests don’t always have to lead to change.

Sometimes, they simply confirm that what you’re doing is already working – and that’s a win too :)

Eman

PS. I just opened up 1:1 business coaching spots for service providers. You'll get (almost) unlimited access to my business brain on your business for a whole month. Get the details here

PPS. This coaching works best when you have a specific business problem you need help untangling and straightening out, or a specific goal you want to work towards. It's not cheap because my coaching is valuable and it works. And I have the testimonials and results to prove that

PPPS. I should mention, this offer won't be around forever. I'm testing to see if there's any interest in it. If there is, it'll be around for a little while. If there isn't, it'll disappear. This isn't one of those "I'll sign up in a few months" kinda situations. If you know you want a spot, grab one :)
​


Find me online, Reader? πŸ˜πŸ‘‡πŸ½

The Email Rules

I've helped business owners like you make MILLIONS of dollars with my email strategy & copy skills. Join my newsletter and learn how to make more money with better (DIY) emails for your business. If you like a good story & a great business lesson, this is the newsletter for you.

Read more from The Email Rules

So, I'd never usually email you two days in a row Reader, but I just launched a brand-new service and I couldn't wait until next week to tell you about it. Especially since one of the two spots has already gone. Let me tell you about... ✨ The Newsletter Build ✨ It's the VIP Week that turns your "really nice" weekly newsletter into your most profitable sales channel. Yepp, you heard that right: I build your newsletter system for you. It's designed for online business owners with a list of...

You already know how the traditional marketing funnel works: Top of funnel, middle of funnel, bottom of funnel. Awareness, consideration, decision. Cold lead, warm lead, hot lead. Nice and neat. Top to bottom. One direction. It's a great model that still works, but I don't think it's the best model anymore. The traditional funnel assumes your subscribers move through your world in a straight line. That they find you on socials, sign up for your lead magnet, get your emails, and then buy. But...

There's a problem I've been seeing more and more lately, and I think it deserves a name. So I've given it one. Nice Newsletter Syndrome. You send an email, and someone replies almost immediately: "I love your newsletter. It's the best thing in my inbox." Another one comes in: "This really made me think." Someone forwards it to a friend. Someone else tells you that they look forward to your emails every week. And on paper, this all sounds great. Because it is great, in a way. Your subscribers...