epochs

Learn · Module 02 · Classical machine learning · Lesson 5 of 8

Boosting and random forests

One tree is easy to fool. Many trees, combined well, are among the strongest models for tables of data.

4 minute read

In short
  • Random forests average many independent trees, which reduces variance.
  • Boosting adds trees in sequence, each fitted to the remaining errors, which reduces bias.
  • Boosted trees are the go-to model for tabular data.

This lesson is part of Pro

The first two lessons of every module are free. Pro opens every lesson and every project.

See Pro plansFrom ₹119 a month. No auto-renewal.