Early stopping

A regularizer that monitors a validation metric during training and halts once it has not improved for a set number of epochs (the patience), then restores the best checkpoint. It limits how long the model has to memorize the training set.

Stop training where validation loss bottoms out, before it climbs again

Example

With patience = 5, validation loss bottoms out at epoch 12 and fails to improve through epoch 17, so training stops at 17 and the weights from epoch 12 are restored.

See it in the lesson: Early Stopping →

Related terms

More in Regularization & Generalization