Your History

Menu

\( \textup{reg} \)

Short Description

This is the symbol used for representing a regularization function.

Medium Description

This is the symbol used for representing a regularization function. This is added to the loss function in order to encourage finding simpler models.

Long Description

The symbol \(\textup{reg}\) represents a regularization function, also known as penalty term or regularizer. The addition of a regularizer results in the learning algorithm trying to optimize for both loss and regularization. This will result in a simpler model, at the possible cost of reduced performance.

References

Jaeger, H. (n.d.). Neural Networks (AI) (WBAI028-05) Lecture Notes BSc program in Artificial Intelligence. Retrieved April 26, 2024, from https://www.ai.rug.nl/minds/uploads/LN_NN_RUG.pdf