Regularization¶

Regularization is an modification we make to a learning algorithm (in general by adding an additional term to the loss function) to reduce its generalization error, but not its training error.