Asynchronous Stochastic Optimization Robust to Arbitrary Delays

Keyphrases

• Distributed Stochastic Optimization 100%
• Stochastic Gradient 100%
• Arbitrary Delay 100%
• Nonconvex 50%
• Stationary Point 50%
• 2-step 50%
• Stochastic Optimization 50%
• Computational Load 50%
• Average Delay 50%
• Gradient Update 50%
• Delay Distribution 50%
• Smooth Optimization 50%
• Optimization Setting 50%
• Central Server 50%
• Communication Load 50%
• Delayed Gradient 50%
• MaxT 50%
• Asynchronous Distributed Optimization 50%
• Stochastic Gradient Decent 50%
• Heterogeneous Distributed Systems 50%

Computer Science

• Stochastic Optimization 100%
• Simple Algorithm 50%
• Efficient Algorithm 50%
• Distributed Systems 50%
• Distributed Optimization 50%
• Stationary Point 50%
• Delay Distribution 50%

Mathematics

• Stochastics 100%
• Stationary Point 20%
• Variance 20%
• Time Step 20%
• Distributed Systems 20%