Back
All Resources

How Formula Tested 100+ Nutrients on 2500+ Participants

To Find the 10 Combinations that Optimize Life for 85% of People
Brett Friedman

The Company

Formula is a bioinformatics startup that uses data to tailor nootropic brain supplements to each users’ unique brain chemistry and daily activities.

The Big Idea

Formula conducted the largest trial ever done on the efficacy of cognitive enhancing supplements (aka. nootropics) in order to train a recommendation engine that accurately predicts the best nootropics for each individual user. They tested 100+ ingredients on 2500+ participants, gathering over three million data points.

The Formula team wanted to see if they removed the controls and stringent oversight of the widely accepted clinical trial model, increased participant numbers by orders of magnitude, would they be able to build a data set large enough to train an algorithm to accurately predict user-specific supplement efficacy.

The Questions

Specifically, Formula asked:

  1. Which nutrients have the highest efficacy?
  2. Which nutrients have the lowest occurrence of side effects?
  3. What is the optimal combination of nutrients required to achieve desired effects without unwanted side effects?
  4. Which nutrients, dosages, and combinations are best for specific types of mental tasks?

The Experiment

Formula conducted a semi-blind four-way crossover trial where participants were given pre-measured, daily pill packs for thirty days. They were told the ingredients inside the box, but they did not know which ingredients they were taking each day. Formula sent two SMS texts each day each asking eight questions to collect data.  

The Results

After a 24 month period, 2500 people had gone through the trial. 127 ingredients had been tested. Three million data points had been collected. For those of you familiar with large datasets, three million may not be that much. However, the largest trials done on nootropics prior to Formula included between 10 and 100 participants.

What they learned was that the most popular nootropic blends on the market work for only 48% of the population. After testing over two thousand combinations (aka stacks), there were 10 that worked for 85% of the population, each with their own optimal use case.

They also showed that Phenylpiracetam, out of all the 19 derivatives of Racetams, had the highest efficacy and highest reorder velocity. Second highest efficacy was Noopept.

In terms of adverse reactions, they found that Aniracetam and Noopept both have a side effect occurrence lower than 5% of the population.  

While there’s no clear winning combination, as even genetically similar people like siblings can respond differently to different nootropics, there are specific stacks effective for particular mental tasks. For example, Aniracetam and Pramiracetam mixed are optimal for creative tasks and social fluidity. It scored the highest in creative writing tasks and helped people who normally struggle in social situations to lubricate their social interactions.

The Implications

They wouldn’t have been able to build a bootstrapped business with an unlimited amount of skews i.e. if each combination only works with a few people. However, being able to identify the top ten that worked for 85% of the population allowed them to create a pared down system that we could scale quickly without large amounts of cash being poured into the business, while still maintaining really high efficacy. Which is the real reason that people come back. The key to not only finding the best nutrients and exact dosages, but also finding what they needed to focus on to build a business to scale quickly.

If they had to make a new supplement combination for each user by hand, they wouldn’t be able to handle more than a hundred customers a month. Understanding the core ten that have 85% to work allows us to work with thousands and still provide value.

The Future

With improvements in price and convenience of at-home genetic testing and wearables becoming more ubiquitous, they’ll use this data alongside their own user observations to expand into growing categories such as sleep, probiotics and daily vitamins. Eventually, they’ll be able create a 3-D printed, auto optimizing daily supplement that knows all of your genetic dispositions, nutrient deficiencies, activities and can adjust on a weekly basis.  

The Application

There are years and years with geniuses upon geniuses that worked to develop the scientific method and clinical trial methods. For academics and scientists, the goal was always to create insights that are published and reviewed by peers.

Formula took a similar process and changed its goal. Rather than focus on a publishable study, the goal was more altruistic, it was less politics, it was very simply to train a recommender engine. To collect enough data to personalize nootropics.  

Try this for your project: Take a rigorous process and redefine why you’re doing it. Loosen regulations that over-constrain your outcomes and leverage the open-ness to collect more information than you normally could have.

Happy testing!

The Team

Formula is a team of 7 from the NYC area.
Website: https://findmyformula.com/
Instagram: https://www.instagram.com/findmyformula/

Read our full creative testing guide

SIGN UP FOR THE EXPERIMENTAL METHOD NEWSLETTER
TO GET THE GUIDE

Download Now
View Sources

Heading 1

Heading 2

Heading 3

Heading 4

Heading 5
Heading 6
"This is a block quote"
  1. This
  2. is
  3. an
  4. ordered
  5. list

This text is bold

The rich text element allows you to create and format headings, paragraphs, blockquotes, images, and video all in one place instead of having to add and format them individually. Just double-click and easily create content.

A rich text element can be used with static or dynamic content. For static content, just drop it into any page and begin editing. For dynamic content, add a rich text field to any collection and then connect a rich text element to that field in the settings panel. Voila!

How to Run a Multivariate Test

The Beginner's Guide

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Tiffany Johnson Headshot

How to Run a Multivariate Test
The Beginner's Guide

Plus, Get our Weekly
Experimentation newsletter!

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.