Back

Experiment Four: October 2020

Human Presence, Aspect Ratio, & CTAs
Marpipe

Does Creative Matter: a series of experiments in which we run ads targeting marketers, telling the marketers that these ads are part of an experiment. The goal is to prove how small creative changes within your ads can have a large impact on performance.

In our October 2020 experiment, we decided to widen our experimental elements to really challenge the winners! This cycle ran for 7 days and collected 1,729 clicks.

Outline

This experiment included the below variable groups and values.

  • Human Presence: Original Bottle vs HumanFace and Bottle vs HumanHand and Bottle
  • Aspect Ratio: 1x1 vs 9x16 v 16x9
  • CTA Button: OrangeCircle vs OrangeBlueGradient vs None

CTR Results

The most impactful creative component from this experiment was the 9x16 Aspect Ratio, with an avg. CTR of 5.11%. On the other hand, ads with the 16x9 Aspect Ratio were by far the worst.

Click Results

The Original Product (Human: None) was responsible for over 18% of the clicks in this cycle, tied with the No CTA Button variant.

After running four cycles and only spending $900, we've have a total average CTR of 4.95%, and total clicks of 9,417. It's very clear that the Original product image, without humans is our best image element. Next month, we'll test all new elements to see what else impacts performance!

Read our full creative testing guide

SIGN UP FOR THE EXPERIMENTAL METHOD NEWSLETTER
TO GET THE GUIDE

Download Now
View Sources

Heading 1

Heading 2

Heading 3

Heading 4

Heading 5
Heading 6
"This is a block quote"
  1. This
  2. is
  3. an
  4. ordered
  5. list

This text is bold

The rich text element allows you to create and format headings, paragraphs, blockquotes, images, and video all in one place instead of having to add and format them individually. Just double-click and easily create content.

A rich text element can be used with static or dynamic content. For static content, just drop it into any page and begin editing. For dynamic content, add a rich text field to any collection and then connect a rich text element to that field in the settings panel. Voila!

How to Run a Multivariate Test

The Beginner's Guide

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Tiffany Johnson Headshot

How to Run a Multivariate Test
The Beginner's Guide

Plus, Get our Weekly
Experimentation newsletter!

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.