Does Slow and Steady Win The Race?