Abstract: Stochastic optimization algorithms are widely used to solve large-scale machine learning problems ... we perform a comprehensive convergence rate analysis of stochastic gradient descent (SGD ...