The Dimension Strikes Back with Gradients: Generalization of Gradient Methods in Stochastic Convex Optimization

Keyphrases

• Training Examples 100%
• Gradient Method 100%
• Stochastic Gradient Descent 100%
• Gradient Descent 100%
• Stochastic Convex Optimization 100%
• Test Performance 50%
• Learning Problems 50%
• Excess Risk 50%
• Sample Complexity 50%
• Optimal Performance 50%
• Feldman 50%
• Generalization Performance 50%
• Construction Technique 50%
• Empirical Risk 50%
• Empirical Risk Minimization 50%
• Optimal Test 50%
• Optimization Setting 50%
• Empirical Error 50%
• Mini-batch Gradient Descent 50%

Mathematics

• Stochastics 100%
• Open Question 50%
• Approximates 25%
• Probability Theory 25%
• Excess Risk 25%