Optimization and A/B Testing Statistics

October 25, 2012

Optimization and A/B Testing Statistics

Whether you've got a lean startup or a fat Fortune 500, the faster you learn the faster you'll grow.  Optimization and a/b testing is at the heart of learning fast.

I guarantee you will learn something in this course that will raise your skill level.  With the 30-day money-back guarantee, you can't lose. 

We start with the basics, then cover the 8 steps of running a solid a/b test.  Next we dive deep into the statistics behind hypothesis testing.  In the long-run you will save your organization headaches by setting up tests correctly and analyzing them with the right statistical rigour. 

There is double and triple digit ROI around optimization for companies that figure it out.  Start now and impress your colleagues on Monday morning.


Topics include:

Examples of a/b tests

Hypothesis testing

Measurement as risk reduction

Selecting a KPI or success metric

8 Steps for Running an A/B Test

Selecting from amongs a/b test and MVT test designs

Lift Threshold

Null Hypothesis

Statistical significance

Sample size estimates

confidence interval

test statistic


standard error of the mean


Fischer Exact test

Statistical Power

Type I error

Type II error


How to choose what statistical test to run



No Of Lectures
No Of Hours
3 hours
  • How long do I have access to the course materials?
    You can view and review the lecture materials indefinitely, like an on-demand channel.
  • What is the refund policy on the course?
    We like to keep our users happy, so we have a 30-day no questions asked refund policy. Send an email to support@udemy.com for refund requests.
  • Can I take my courses with me wherever I go?
    Definitely! If you have an internet connection, courses on Udemy are available on any device at any time. If you don't have an internet connection, some instructors also let their students download course lectures. That's up to the instructor though, so make sure you get on their good side!