This is the symbol representing the learning rate.
This is the symbol representing the learning rate. It controls the strength of the update procedure of the model's parameters - \( \htmlClass{sdt-0000000083}{\theta} \). The smaller the learning rate, the slower the training.
The symbol, \(\mu\), represents the learning rate. It controls the strength of the update procedure of the model's parameters - \( \htmlClass{sdt-0000000083}{\theta} \). The smaller the learning rate, the slower the training.
It is commonly used in gradient-based learning algorithms, where the learning rate controls the size of the step that parameters are moved by during a single iteration of learning.
Jaeger, H. (2024). Neural Networks (AI) (WBAI028-05) Lecture Notes BSc program in Artificial Intelligence. Retrieved April 14, 2024, from https://www.ai.rug.nl/minds/uploads/LN_NN_RUG.pdf