Numerical Analysis: Bao Wang, The University of Utah, Implicit Methods for Deep Learning
ZoomAt the heart of modern deep learning is the deep neural nets accompanied by stochastic optimization and sampling algorithms. These architectures and algorithms have an explicit flavor. In particular, traditional deep nets compose affine and simple nonlinear transformations, defining an explicit function for representation learning. The explicit deep nets lack flexibility and adaptivity for modeling…