Close (X)

Blog

Email Marketing, Business & Monkeys

Posts Tagged ‘a/b test email marketing’

A/B Split Testing – Does it Help Email Marketing?

Tuesday, August 26th, 2008

Ever since we launched our automatic email optimizer, we’ve been tracking all this wonderful A/B testing data on our system.

We analyzed 1,720 A/B tested campaigns, sent to 6,226,331 inboxes (we only included campaigns sent to over 500 recipients).

Overall, we found that A/B split winners did better than non-tested campaigns. By how much?

Before we give you the exact numbers, test your email marketing aptitude and pick the winning subject line from these real life A/B email tests conducted by our customers:

Winning Subject Lines by Open Rate
Test Group “A” Test Group “B”
Don’t Forget Mom… Gifts Mom Will Love!
Protect Yourself From the Sun This Summer… The Best Sunscreen, Hats, Rash Guards and More…
[COMPANY]: March [COMPANY] Mail Spring Update from [COMPANY]
[COMPANY] March Newsletter March is National Crochet Month
[COMPANY]: France River Cruise & Golf – Last Call [COMPANY]: Last Call for France River Cruise & Golf
Computer Security Quarterly – Spring ‘08 2007 Record Year For Data Breaches
Coupon Enclosed – Save on Printer Ink, Toner, Paper, Storage Media Now – HP, Xerox, Canon, Brother, Dell & More News & Discounts from [COMPANY] – Savings on Printer Supplies from HP, Xerox, Brother, Canon and More
[COMPANY] Easter Newsletter – Free Shipping [COMPANY] Easter Newsletter

(more…)

Personalizing Subject Lines – Does It Help Or Hurt Open Rates?

Wednesday, February 27th, 2008

More and more customers are using our automated A/B campaign testing tool to see what subject lines work best, and what day/time works best.

So right now, I’m looking at A/B split data across tons of campaigns. This is a real gold mine for email marketing research, so I was hoping to discover some universal truths that debunk what the “experts” tell us. Like, “Wednesdays are always best, not Mondays, so in your face!” Turns out, the only thing I’ve really learned is that all the expert tips out there on email marketing (mine included) are worthless. The results are all over the board. At first I was frustrated by the lack of consistency in all this data. Then, I realized that this is exactly the whole point—there is no silver bullet. Everything depends on your company, your offer, your list, etc. The only way to tell what works is to test, test, test.

But I am looking across all these amazing stats, and noticing some interesting patterns. For example, personalizing your subject line (such as with “FNAME”) doesn’t seem to help open rates very much. In fact, it can actually hurt…

(more…)

http://www.mailchimp.com/nonrestrictiveocean.php