Understanding Adam Optimizer via Online Learning of Updates: Adam is FTRL in Disguise.

Kwangjun Ahn, Zhiyu Zhang, Yunbum Kook, Yan Dai

Browse the full ICML paper archive.