3

Understanding Incremental Learning of Gradient Descent -- A Fine-grained Analysis of Matrix Sensing
It is believed that Gradient Descent (GD) induces an implicit bias towards good generalization in training machine learning models. …
Jikai Jin, Zhiyuan Li, Kaifeng Lyu, Simon S. Du, Jason D. Lee
PDF Cite ArXiv
Understanding Incremental Learning of Gradient Descent -- A Fine-grained Analysis of Matrix Sensing