| 2025 | ICLR | What Does It Mean to Be a Transformer? Insights from a Theoretical Hessian Analysis. | Weronika Ormaniec, Felix Dangel, Sidak Pal Singh |
| 2025 | ICML | Fishers for Free? Approximating the Fisher Information Matrix by Recycling the Squared Gradient Accumulator. | Yu Xin Li, Felix Dangel, Derek Tam, Colin Raffel |
| 2025 | ICML | Hide & Seek: Transformer Symmetries Obscure Sharpness & Riemannian Geometry Finds It. | Marvin F. da Silva, Felix Dangel, Sageev Oore |
| 2024 | ICML | Revisiting Scalable Hessian Diagonal Approximations for Applications in Reinforcement Learning. | Mohamed Elsayed, Homayoon Farrahi, Felix Dangel, A. Rupam Mahmood |
| 2024 | ICML | Can We Remove the Square-Root in Adaptive Gradient Methods? A Second-Order Perspective. | Wu Lin, Felix Dangel, Runa Eschenhagen, Juhan Bae, Richard E. Turner, Alireza Makhzani |
| 2024 | ICML | Structured Inverse-Free Natural Gradient Descent: Memory-Efficient & Numerically-Stable KFAC. | Wu Lin, Felix Dangel, Runa Eschenhagen, Kirill Neklyudov, Agustinus Kristiadi, Richard E. Turner, Alireza Makhzani |
| 2020 | AISTATS | Modular Block-diagonal Curvature Approximations for Feedforward Architectures. | Felix Dangel, Stefan Harmeling, Philipp Hennig |
| 2020 | ICLR | BackPACK: Packing more into Backprop. | Felix Dangel, Frederik Kunstner, Philipp Hennig |