GLOSSARY TERM
What is Momentum?
An optimization technique that accelerates gradient descent by considering previous gradients.
Momentum adds a fraction of the past weight update vector to the current one. This dampens oscillations in ravines and propels the optimizer through shallow local minima, leading to significantly faster convergence.
Velocity in Optimization
Leverage advanced momentum optimizers to streamline your machine learning jobs.