Epoch

Also: epochs, training epoch

Training usually runs for many epochs, each split into steps of one mini-batch. Validation metrics are often checked once per epoch, for example to decide when to stop early.

Example

50,000 training examples with a batch size of 100 make 500 steps per epoch, so 20 epochs is 10,000 parameter updates.

See it in the lesson: Early Stopping →

Related terms

More in Optimization & Training