'On the Hyperparameters in Stochastic Gradient Descent with Momentum', by Bin Shi.
http://jmlr.org/papers/v25/22-1189.html #sgd #hyperparameters #stochastic
Mastodon is the best way to keep up with what's happening.
Follow anyone across the fediverse and see it all in chronological order. No algorithms, ads, or clickbait in sight.