Model Tuning Intuition 201

Understand how cross-validation is used to evaluate the bias-variance tradeoff of machine learning models.

Back to the darts

This lesson combines several topics. Assume there’s some training data, access to the CART classification tree algorithm, and some hyperparameter values. This is everything needed to perform ten-fold cross-validation (CV). Regarding the bias-variance tradeoff, each CV iteration is conceptually a dart thrown at the dartboard.

Performing CV for each set of hyperparameter values is a best practice. Assuming there are four sets of hyperparameter values, the following image visualizes cross-validation in terms of the bias-variance tradeoff:

Get hands-on with 1200+ tech skills courses.