Date:

Product:

Your Name:

Fill in before running the experiment


We Believe That…

<aside> 🎯 Write a hypothesis that contains a single risky assumption that can be tested and measured.

E.g. “We know that app users have better retention rates than web users, and we believe this is causation, not correlation. Therefore, if we encourage new signups to install our app after they register, rather than using our web version, it will increase our retention rates.”

</aside>

Therefore We Will…

<aside> 🎯 Briefly explain your experiment at a high level.

E.g. “We randomly split new signups, and redirect half of them to the app store, and allow half of them to stay with our current mobile web experience.”

</aside>

Cost Impact & Estimates

<aside> 🎯 1. In terms of time and money, on a scale from 1 – 5, is this hard/slow/expensive (1) or easy/cheap/fast (5)? 2. If this works, how much will it impact our overall business growth? (1 = no noticeable impact, 5 = huge massive obvious impact) 3. Is there a faster, easier, cheaper way to test this?

</aside>

We Will Measure…

<aside> 🎯 Choose a success metric that is deep enough in the funnel to be meaningful.

*E.g. not “clicks” and shallow enough that you can get your results data quickly.

E.g. For the app retention experiment, maybe it’s month 2 retention rates as your primary metric. But also keep an eye on number of logins or transactions or some other behavioural metric, and long-term retention metrics as your test cohort matures.*

</aside>