| 2025 | ICLR | What Does It Mean to Be a Transformer? Insights from a Theoretical Hessian Analysis. | Weronika Ormaniec, Felix Dangel, Sidak Pal Singh |
| 2025 | ICLR | The Directionality of Optimization Trajectories in Neural Networks. | Sidak Pal Singh, Bobby He, Thomas Hofmann, Bernhard Schlkopf |
| 2025 | ICML | Avoiding spurious sharpness minimization broadens applicability of SAM. | Sidak Pal Singh, Hossein Mobahi, Atish Agarwala, Yann N. Dauphin |
| 2024 | AAAI | Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers (Student Abstract). | Danilo Dordevic, Vukasin Bozic, Joseph Thommes, Daniele Coppola, Sidak Pal Singh |
| 2024 | ICLR | Transformer Fusion with Optimal Transport. | Moritz Imfeld, Jacopo Graldi, Marco Giordano, Thomas Hofmann, Sotiris Anagnostidis, Sidak Pal Singh |
| 2024 | ICLR | Some Fundamental Aspects about Lipschitz Continuity of Neural Networks. | Grigory Khromov, Sidak Pal Singh |
| 2024 | ICLR | Towards Meta-Pruning via Optimal Transport. | Alexander Theus, Olin Geimer, Friedrich Wicke, Thomas Hofmann, Sotiris Anagnostidis, Sidak Pal Singh |
| 2023 | ICML | The Hessian perspective into the Nature of Convolutional Neural Networks. | Sidak Pal Singh, Thomas Hofmann, Bernhard Schlkopf |
| 2022 | ICLR | Phenomenology of Double Descent in Finite-Width Neural Networks. | Sidak Pal Singh, Aurlien Lucchi, Thomas Hofmann, Bernhard Schlkopf |
| 2020 | AISTATS | Context Mover's Distance & Barycenters: Optimal Transport of Contexts for Building Representations. | Sidak Pal Singh, Andreas Hug, Aymeric Dieuleveut, Martin Jaggi |
| 2019 | ICLR | Context Mover's Distance & Barycenters: Optimal transport of contexts for building representations. | Sidak Pal Singh, Andreas Hug, Aymeric Dieuleveut, Martin Jaggi |
| 2017 | ICWS | RaaS and Hierarchical Aggregation Revisited. | Rohit Ranchal, Sidak Pal Singh, Pelin Angin, Ajay Mohindra, Hui Lei, Bharat K. Bhargava |
| 2016 | IJCAI | SL - FII: Syntactic and Lexical Constraints with Frequency based Iterative Improvement for Disease Mention Recognition in News Headlines. | Sidak Pal Singh, Sopan Khosla, Sajal Rustagi, Manisha Patel, Dhaval Patel |