Close (X)

Blog

Email Marketing, Business & Monkeys

Archive for the ‘Stats’ Category

A/B Split Testing – Does it Help Email Marketing?

Tuesday, August 26th, 2008

Ever since we launched our automatic email optimizer, we’ve been tracking all this wonderful A/B testing data on our system.

We analyzed 1,720 A/B tested campaigns, sent to 6,226,331 inboxes (we only included campaigns sent to over 500 recipients).

Overall, we found that A/B split winners did better than non-tested campaigns. By how much?

Before we give you the exact numbers, test your email marketing aptitude and pick the winning subject line from these real life A/B email tests conducted by our customers:

Winning Subject Lines by Open Rate
Test Group “A” Test Group “B”
Don’t Forget Mom… Gifts Mom Will Love!
Protect Yourself From the Sun This Summer… The Best Sunscreen, Hats, Rash Guards and More…
[COMPANY]: March [COMPANY] Mail Spring Update from [COMPANY]
[COMPANY] March Newsletter March is National Crochet Month
[COMPANY]: France River Cruise & Golf – Last Call [COMPANY]: Last Call for France River Cruise & Golf
Computer Security Quarterly – Spring ‘08 2007 Record Year For Data Breaches
Coupon Enclosed – Save on Printer Ink, Toner, Paper, Storage Media Now – HP, Xerox, Canon, Brother, Dell & More News & Discounts from [COMPANY] – Savings on Printer Supplies from HP, Xerox, Brother, Canon and More
[COMPANY] Easter Newsletter – Free Shipping [COMPANY] Easter Newsletter

(more…)

MailChimp’s A/B Email Tester Can Be Really Mean

Monday, August 11th, 2008

A lot of people tell us they appreciate the compliments that MailChimp gives them when they do their email marketing. Our chimp chatter feeds and little love notes seem to put a smile on our customers’ faces.

But this weekend, I discovered there’s a mean side of MailChimp, too…

(more…)

Average Delivery Rate is 56% for Legit Senders

Friday, August 1st, 2008

returnpath-reputation-study-q208.jpgReturnPath just released their 2008 Q2 Reputation Benchmark Report. There’s a lot of great data to digest here.

  • Only about 20% of email servers out there are properly setup and can be considered “legit” email senders.
  • Your Sender Score can be closely correlated with your Delivered Rate (something I assumed in this blog post, but couldn’t provide any proof—until now). Note that “delivered” means “it made it to the machine of your recipient” but doesn’t necessarily mean “it wasn’t spam filtered.” The mailman delivers your mail, but doesn’t know if recipients will rip it up and throw it away before reading it.
  • Only 0.63% of email from legit servers can be classified as “Commercial.” That either means commercial email marketers are not sending as much email (and “clogging up the intertubes”) as we all thought, or that they’re all sending from illegit or unknown servers, and not following best practices.

Then, they give two big whoppers of insight:

(more…)

I’m Running Circles Around My Industry!

Thursday, July 31st, 2008

Jesse’s our new API engineer. He’s been quietly beefing up the MailChimp API’s functionality, and making it work with just about any application or database that you can think of hooking us into, or building a plugin for.

He just recently sent an email announcement to our API users about some upcoming changes. Of course Jesse’s used MailChimp to send countless tests to himself. But this was his first time sending out a “real campaign, to a real list with real people” using MailChimp. It was also our first-ever attempt at contacting  just our API users, so this was a learning experience for all of us.

Compare your stats to your industry peersI casually walked past his desk a few hours after he sent the campaign, and asked him how his stats looked. I thought he’d say, “Hmm, I dunno, let me check” and then he’d open his browser, log in, etc. But nope, he made this quick flick of his wrist, and up popped his email campaign report.

Turns out he’d been watching his stats change by the minute (like all our new customers who send their first campaigns).It was cool to see him so happy about his stats.

It’s exciting to see your email stats go up, up, up for the first time. Eventually, you get past that first high, and will prefer to receive your stats later, via RSS.

Anyway, before his campaign stats page fully loaded, and before our pie charts boing-boinged into place, he told me, “I’m running circles around the software industry.”

He was referring to our email marketing benchmark data, which we embed right into  your MailChimp email marketing stats (screenshot of how that works).

Jesse got a 50% open rate and 11% click rate, which when compared to the average for the software industry, is pretty darn good. How do you compare to your industry peers?

Email Marketing Benchmarks – Stats by business size, stats by industry

Wednesday, July 30th, 2008

email-stats-by-company-size.pngI casually mentioned to our lead engineer that it would be cool if we could take all these hundreds of millions of emails we’ve delivered, analyzed their stats (like open rate, clicks, bounces, abuse complaints, unsubscribes, etc) and come up with a chart of some sort that compared email marketing stats by business size.

Turns out he was looking for any excuse to play with Google’s new Visualization API, so he jumped at the chance. Funny how stuff turns out that way…

(more…)

Abuse Complaints Going Up?

Wednesday, June 25th, 2008

abuse-complaints-yahoo.gifSome of our users are getting really worried about their abuse complaint numbers spiking (from 1 or 2 per campaign to 5 or 7) recently.

Nice to hear you’re so concerned! But there’s nothing to worry about in the short term. Here’s what’s happening…

(more…)

Compare Your Email Stats To Industry Benchmarks

Saturday, June 21st, 2008

Ever looked at your email open rate, and wondered “how do I compare to others in my industry?”

We just added that information to MailChimp’s email marketing reports.

Now, when you open up your email campaign’s stats, you can compare your open rate, click rate, and bounce rate to other companies in your industry (we analyzed over 170 million emails to get this information):

Click the screenshot to zoom in:

Email Marketing Benchmarks in MailChimp

The nice thing is we also show you how you compare to your own average (for that list), so you can see if your campaigns are improving or not. In the email campaign report above, my campaign got a 47.5% open rate, which is way better than the IT/Technology industry’s average open rate of 19.6%. But before I go asking my boss for a raise, I can see that my open rate actually fell from my normal average of 50.4%. Uh-oh. Maybe it was my subject line, or the day I sent my email, or the timing. Time to start optimizing!

AOL is watching your bounce rates

Friday, April 25th, 2008

Strongmail reports that AOL is filtering email based on your hard bounces. The basic idea is if you’ve got way too many hard bounces, you’ve got bad list hygiene, and they don’t want you sending email to their servers.

If you’re using MailChimp’s managed lists, we automagically clean hard bounces from your list immediately, to prevent this sort of thing. If you manage your list by hand in some excel file, and you manually remove bounces and unsubscribes “whenever you can get to them,” you’re going to have problems (and not just with AOL).  If you’re sending your very first email campaign to an old list you’ve been collecting for years, you should remove any contacts older than 1 year, and then send your campaign in small chunks.

On a related note, here are “average email bounce rates by industry.”

Also, the new MailChimp reports will show you what your bounce rate is by ISP:

email-domain-performance.png

Non-Profits – Wealthy Donors Favor Internet

Monday, March 24th, 2008

If you work at a non-profit, and you’re thinking about getting into email marketing, here’s some justification for you: Major donors to charities tend to favor using the Internet, according to a new study from Convio.

Check out the article if you’re a non-profit, or a creative agency that serves non-profits. They’ve got some interesting stats, like: “A full 72% of respondents percent say donating online is more efficient and helps charities reduce administrative costs”

Test Your Event Reminders

Wednesday, March 12th, 2008

MailChimp holds a Getting Started Webinar every Wednesday. We basically send an invitation to all the new free trials that signed up the previous week, and invite them to watch us run through the basics. Most people end up figuring out MailChimp on their own, but a handful of people enjoy a live demo.

Anyway, we used to send a reminder every Monday, giving people the dial-in instructions for the Wednesday webinar. A couple weeks ago, the job duties for sending those invitations got passed on to someone else in the office, who forgot to send the invitation on Monday. Oops.

So he sent it on Tuesday instead, and we noticed the attendance rate almost doubled. Just by sending on a different day. We’ve since changed the invitation schedule to Tuesdays, and are still enjoying consistently better attendance.

Is it because Tuesdays are better than Mondays? Or is it simply because the invitation is being sent closer to the event? You can hope for an accidental discovery like ours, or you can use our automated A/B testing tool to find out yourself.

http://www.mailchimp.com/nonrestrictiveocean.php