Does human-written or AI-generated content perform better?

By Sean Tinney February 22, 2023

We examined an e mail written by a human versus one written by synthetic intelligence, uncover which is best to your emails.

Synthetic intelligence (additionally known as AI) is taking up. It’s in all places from social media, digital assistants, chat bots, to the transportation trade. It’s even in meals providers. Have you ever seen these AI-robot fast food restaurants?

As using synthetic intelligence continues to develop, it’s no shock that it has made its approach into e mail advertising. One space specifically the place AI has been gaining consideration is within the creation of e mail content material. 

Whereas human-written emails are what everyone knows and have written for years, many entrepreneurs are turning to AI-generated content material. However is that this higher? Certainly folks studying these emails can inform the distinction between a human and robotic, proper?

Think about should you might immediate an AI-content software to jot down nice high quality emails. No extra sleepless nights questioning in case your e mail goes to carry out. Plus, consider all of the hours you’ll get again in your week since you didn’t want to jot down emails.

I didn’t need to think about the chance anymore, so I made a decision to check a human-written e mail vs AI-generated content material. 

Organising the human vs AI e mail content material check

Listed here are the steps I took to arrange my email split test:

1 – Decide the e-mail matter

First I wanted a subject, so why not write the content material about utilizing synthetic intelligence in e mail advertising.

2 – Discover an AI-writing software 

I selected ChatGPT since I had already used them and was conversant in the software. However there are many different AI writing solutions that I might have used for this check.

3 – Write my e mail copy

Once I wrote my copy I wished to focus on the worth of e mail advertising but in addition talk my ache level with emails – the time it takes me to jot down them. Then I wished to introduce AI-powered writing instruments as an choice for those that can also be on the lookout for a fast resolution

Right here’s my copy of the e-mail:

4 – Create the AI generated content material

When utilizing ChatGPT, the primary web page has a bit the place you kind your directions. I’ve discovered the extra element you present right here, the nearer this AI content material writing software gives a draft inline along with your imaginative and prescient. 

I structured my preliminary directions as if I had been typing one thing to a copy-writer. I wished the tone to be witty as a result of that is how my draft felt and I wished related writing kinds. And I wished the AI generated content material to observe an analogous construction as my model, which was to ascertain me as a reputable supply, reference my ache level, then present the answer.

Right here had been the directions I offered for my first e mail try:

The primary AI generated content material was good. It appeared like a human wrote it nevertheless I felt the copy was too sturdy at selling ChatGPT as an answer. Right here’s what was generated primarily based on my preliminary directions:

Now if I labored at ChatGPT, this copy can be excellent. However, the aim of my e mail was to not promote ChatGPT, I merely wished to counsel them as an choice.

So at this level I wanted to replace my directions to make it sound much less like a gross sales e mail. Right here’s the place synthetic intelligence in content material advertising is highly effective, I merely typed directions as if I used to be offering suggestions to knowledgeable content material author.

These directions gave me my remaining AI e mail advertising content material draft:

You could discover three of the ultimate 4 paragraphs are the identical because the human (that’s me) written content material. That was strategic on my half as a result of I wished to let readers know they had been a part of this check because the e mail matter was on AI content material writing.

Check Outcomes

• The e-mail written by me had a 6.2% extra clicks.
• The hyperlink asking readers to strive ChatGPT had 19.9% extra clicks within the AI generated content material. The AI e mail did a greater job selling the advantages of AI content material writing.

What’s higher – human or synthetic intelligence?

Might you inform the distinction between the 2 emails? If I didn’t write and arrange this check, I actually wouldn’t have the ability to distinguish between the 2.

Whereas the human written e mail had extra clicks, I can’t overlook the truth that the AI-written e mail had almost 20% extra clicks on the “strive ChatGPT” hyperlink.

My conclusions

So, is an e mail written by synthetic intelligence higher than a human?

Relying on the kind of content material you propose on writing, that AI-generated content material might carry out higher than a human-written e mail.

Should you’re writing e mail content material for a services or products you propose promoting, than I feel AI-generated content material might be actually highly effective. As evident by the quantity of people that clicked the “strive ChatGPT” button on the AI generated e mail.

Nonetheless, I feel one space that human written content material will at all times be extra highly effective is when writing a private story or one thing primarily based in your expertise. 

Should you take a look at the e-mail written by me, I wrote about MY private expertise. I did this to attempt to get the readers to narrate to me. I tried to offer ChatGPT directions to create an analogous intro, however I don’t assume it’s succesful.

What’s subsequent

Total, I imagine AI content material writing is fairly near human written content material.

The outcomes of my check confirmed a 6.2% improve in clicks for the human written e mail. This can be a good improve however not insurmountable. Subsequent time we check this, I gained’t be shocked if the AI e mail noticed extra clicks. Why? As a result of AI is studying and getting higher every day.

So will I take advantage of an AI e mail writing assistant sooner or later? Sure. All of us get author’s block and I feel these AI instruments are nice to enrich your writing. 

I like to recommend experimenting with an AI content material writing software. You could discover that it writes higher copy and will get higher outcomes. On the very least you possibly can use AI to generate concepts to your, topic traces (see our list of the top subject line generator tools), write a portion of your publication, or simply to drag bits and items of content material you’re feeling is stronger than what you’ll write.

I’d love to listen to your success tales with synthetic intelligence in content material advertising. Depart your feedback beneath.