As the learning rate is one of the most important hyper-parameters to tune for training convolutional neural networks. In this paper, a powerful technique to select a range of learning rates for a neural network that named cyclical learning rate was implemented with two different skewness degrees. It is an approach to adjust where the value is c…
neural-network clr cnn range hyperparameters learning-rate expense cyclical-learning-rates epochs learning-rates clr-policies skewness-degrees
-
Updated
Jan 19, 2019 - Jupyter Notebook