Back
All Resources

The Rotation Experiments Review

Running Multiple Experiments for Continuous Improvement
Marpipe

The Rotation is an application that lets men rent unlimited streetwear, for one low monthly price. They offer a massive catalog and allow their subscribers to swap items whenever they want.

Experiment Cycle 1 Set Up

Since they had never run a Lead campaign before, we were starting from scratch. We decided to split the testing campaign into two small experiments to optimize our learnings. For the first experiment, we created & tested a total of 144 variants with $2,500 in ad spend!

Experiment Cycle 1 Results

The first experiment gave us a strong base to build off of, with the top performing ad having an average CPA of $1.33.

With such strong performers, we decided to test wider for round two instead of deeper.

Experiment Cycle 2 Set Up

For our second experiment, we cut the worst performing audience in an effort to learn more about the top performing segments. For Experiment Cycle 2 we created & tested a total of 252 variants with $2,500 in ad spend!

Experiment Cycle 2 Results

The second experiment proved out assumptions from the first as the audience, design, and text type winners remained consistent. The top performing ad in Cycle 2 had a CPA of $1.25! It’s clear that The Rotation should use App imagery, text that falls into the B category of their classification system, and the Hypebeast audience for best performance.

Conclusion

By splitting their experiment into two tests, The Rotation was able to capture deeper & wider learnings than if they had only done one. Plus, they were able to confirm the findings from Cycle 1 by retesting and challenging them in Cycle 2. Lastly, they were able to find positive outliers that they can begin scaling!

Read our full creative testing guide

SIGN UP FOR THE EXPERIMENTAL METHOD NEWSLETTER
TO GET THE GUIDE

Download Now
View Sources

Heading 1

Heading 2

Heading 3

Heading 4

Heading 5
Heading 6
"This is a block quote"
  1. This
  2. is
  3. an
  4. ordered
  5. list

This text is bold

The rich text element allows you to create and format headings, paragraphs, blockquotes, images, and video all in one place instead of having to add and format them individually. Just double-click and easily create content.

A rich text element can be used with static or dynamic content. For static content, just drop it into any page and begin editing. For dynamic content, add a rich text field to any collection and then connect a rich text element to that field in the settings panel. Voila!

How to Run a Multivariate Test

The Beginner's Guide

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Tiffany Johnson Headshot

How to Run a Multivariate Test
The Beginner's Guide

Plus, Get our Weekly
Experimentation newsletter!

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.