epochs

Learn · Module 15 · Statistics and experiments · Lesson 4 of 5

Reading results honestly

Most wrong conclusions don't come from bad maths. They come from asking too many questions or looking at the data in the wrong slices.

3 minute read

In short
  • Testing many things guarantees some false wins: 20 tests at 5% gives a 64% chance of at least one.
  • Simpson's paradox: a different mix of groups can reverse the overall result.
  • Correlation suggests ideas; only randomised tests show cause.

This lesson is part of Pro

The first two lessons of every module are free. Pro opens every lesson and every project.

See Pro plansFrom ₹119 a month. No auto-renewal.