Issues

• Parameter-free, Dynamic, and Strongly-Adaptive Online Learning

  parameter-free
  CompML/survey-stochastic-optimization#23 · Filter by author nocotan opened on Jan 15, 2021
  

• Stochastic gradient descent on Riemannian manifolds

  riemannian optimization
  CompML/survey-stochastic-optimization#21 · Filter by author nocotan opened on Jan 13, 2021
  

• Adabelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients

  deep learning
  CompML/survey-stochastic-optimization#19 · Filter by author nocotan opened on Jan 7, 2021
  

• Gradient Descent with Early Stopping is Provably Robust to Label Noise for Overparameterized Neural Networks

  deep learning
  CompML/survey-stochastic-optimization#17 · Filter by author nocotan opened on Jan 5, 2021
  

• Scaling SGD Batch Size to 32K for ImageNet Training

  deep learning
  CompML/survey-stochastic-optimization#15 · Filter by author nocotan opened on Jan 4, 2021
  

• AdaScale SGD: A User-Friendly Algorithm for Distributed Training

  deep learningparameter-free
  CompML/survey-stochastic-optimization#13 · Filter by author nocotan opened on Jan 4, 2021
  

• Augment Your Batch: Improving Generalization Through Instance Repetition

  CompML/survey-stochastic-optimization#12 · Filter by author nocotan opened on Jan 2, 2021
  

• The Limit of the Batch Size

  deep learning
  CompML/survey-stochastic-optimization#11 · Filter by author nocotan opened on Jan 2, 2021
  

• On the distance between two neural networks and the stability of learning

  deep learningparameter-free
  CompML/survey-stochastic-optimization#10 · Filter by author nocotan opened on Jan 2, 2021
  

• Choosing the Sample with Lowest Loss makes SGD Robust

  deep learning
  CompML/survey-stochastic-optimization#9 · Filter by author nocotan opened on Jan 1, 2021
  

• SEVER: A Robust Meta-Algorithm for Stochastic Optimization

  deep learningmeta-algorithm
  CompML/survey-stochastic-optimization#8 · Filter by author nocotan opened on Dec 31, 2020
  

• The Implicit Bias of AdaGrad on Separable Data

  deep learning
  CompML/survey-stochastic-optimization#7 · Filter by author nocotan opened on Dec 31, 2020
  

• Riemannian SVRG: Fast Stochastic Optimization on Riemannian Manifolds

  riemannian optimization
  CompML/survey-stochastic-optimization#6 · Filter by author nocotan opened on Dec 30, 2020
  

• A Sufficient Condition for Convergences of Adam and RMSProp

  deep learning
  CompML/survey-stochastic-optimization#5 · Filter by author nocotan opened on Dec 29, 2020
  

• Sharpness-Aware Minimization for Efficiently Improving Generalization

  deep learning
  CompML/survey-stochastic-optimization#4 · Filter by author nocotan opened on Dec 29, 2020
  

• Achieving All with No Parameters: AdaNormalHedge

  Parameter-free Learning with Expertsparameter-free
  CompML/survey-stochastic-optimization#3 · Filter by author nocotan opened on Dec 28, 2020
  

• ImageNet Training in Minutes

  deep learning
  CompML/survey-stochastic-optimization#2 · Filter by author nocotan opened on Dec 28, 2020
  

• Training deep networks without learning rates through coin betting

  deep learningParameter-free optimization for deep learningparameter-free
  CompML/survey-stochastic-optimization#1 · Filter by author nocotan opened on Dec 11, 2020
  1