Joint training of parameters and step size (JTPS) is an optimization technique that permits backpropagation directly into the learning rate.