Publication Details

SELECT * FROM publications WHERE Record_Number=10895
Reference TypeConference Proceedings
Author(s)Daniel, C.; Taylor, J.; Nowozin, S.
TitleLearning Step Size Controllers for Robust Neural Network Training
Journal/Conference/Book TitleNational Conference of the American Association for Artificial Intelligence (AAAI)
AbstractThis paper investigates algorithms to automatically adapt the learning rate of neural networks (NNs). Starting with stochastic gradient descent, a large variety of learning methods has been proposed for the NN setting. However, these methods are usually sensitive to the initial learning rate which has to be chosen by the experimenter. We investigate several features and show how an adaptive controller can adjust the learning rate without prior knowledge of the learning problem at hand.
Link to PDF


zum Seitenanfang