Lecture 6
Readings:
Deep learning with Elastic Averaging SGD Links to an external site., Sixin Zhang, Anna Choromanska, Yann LeCun, NIPS 2015.
Slides Download Slides by Zihao Zhang
Asymptotically exact, embarrassingly parallel MCMC Links to an external site., W. Neiswanger, C. Wang, and E. Xing, UAI, 2014.
Slides Download Slides by Bichen Wu
Asynchronous Distributed ADMM for Consensus Optimization Links to an external site. Ruiliang Zhang, James T. Kwok, JMLR 2014.
Slides Download Slides by Francois Belletti
Recommended:
On the importance of initialization and momentum in deep learning Links to an external site., Ilya Sutskever, James Martens, George Dahl, Geoffrey Hinton, JMLR 2013