Tune gradient descent optimizers and race them to the minimum.