It is well-known that nearly any function can be approximated arbitrarily-well by a neural network with non-linear activations. However, one cannot guarantee that the weights in the neural network remain bounded in norm as the approximation error goes to zero, which is an important consideration when practically training neural networks. This raises the question: What…

Extreme weather events are of growing concern for societies because under climate change their frequency and intensity are expected to increase significantly. Unfortunately, general circulation models (GCMs)--currently the primary tool for climate projections--cannot characterize weather extremes accurately. Here, we report on advances in the application of a multi-scale deep learning framework, trained on reanalysis data,…

The Basis Pursuit Denoising problem, also known as the least absolute shrinkage and selection operator (Lasso) problem, is a cornerstone of compressive sensing, statistics and machine learning. In high-dimensional problems, recovering an exact sparse solution requires robust and efficient optimization algorithms. State-of-the-art algorithms for the Basis Pursuit Denoising problem, however, were not traditionally designed to…