Weilin Li, Courant Institute, Generalization error of minimum weighted norm and kernel interpolation
ZoomA central question in machine learning theory is whether an algorithm enjoys good generalization, which is the ability to correctly predict new examples from prior observations. While classical wisdom advocates for methods with fewer parameters than data points in order to avoid overfitting, modern machine learning algorithms are severely over-parameterized and perfectly fit training data.…