Boosting

Boosting and random forests: ensembles that won competitions

AdaBoost, gradient boosting, and random forests dominated tabular ML and Kaggle contests before ubiquitous deep learning.