Skip to content

Depen Morwani

Publication record assembled from the DBLP archive of ranked conferences.

Papers indexed

7

Venues

3

Active years

2022–2025

Best venue rank

A*

Where they publish

Papers

7 indexed papers, newest first.

YearVenueTitleAuthors
2025ICLRSOAP: Improving and Stabilizing Shampoo using Adam for Language Modeling.Nikhil Vyas, Depen Morwani, Rosie Zhao, Itai Shapira, David Brandfonbrener, Lucas Janson, Sham M. Kakade
2025ICLRA New Perspective on Shampoo's Preconditioner.Depen Morwani, Itai Shapira, Nikhil Vyas, Eran Malach, Sham M. Kakade, Lucas Janson
2025ICLRHow Does Critical Batch Size Scale in Pre-training?Hanlin Zhang, Depen Morwani, Nikhil Vyas, Jingfeng Wu, Difan Zou, Udaya Ghai, Dean P. Foster, Sham M. Kakade
2025ICLRDeconstructing What Makes a Good Optimizer for Autoregressive Language Models.Rosie Zhao, Depen Morwani, David Brandfonbrener, Nikhil Vyas, Sham M. Kakade
2024ICLRFeature emergence via margin maximization: case studies in algebraic tasks.Depen Morwani, Benjamin L. Edelman, Costin-Andrei Oncescu, Rosie Zhao, Sham M. Kakade
2024ICMLBeyond Implicit Bias: The Insignificance of SGD Noise in Online Learning.Nikhil Vyas, Depen Morwani, Rosie Zhao, Gal Kaplun, Sham M. Kakade, Boaz Barak
2022ALTInductive Bias of Gradient Descent for Weight Normalized Smooth Homogeneous Neural Nets.Depen Morwani, Harish G. Ramaswamy