| 2025 | CogSci | The Ungrounded Alignment Problem. | Marc Pickett, Aakash Kumar Nain, Joseph Modayil, Llion Jones |
| 2018 | AAAI | Rainbow: Combining Improvements in Deep Reinforcement Learning. | Matteo Hessel, Joseph Modayil, Hado van Hasselt, Tom Schaul, Georg Ostrovski, Will Dabney, Dan Horgan, Bilal Piot, Mohammad Gheshlaghi Azar, David Silver |
| 2013 | AAAI | Two Perspectives on Learning Rich Representations from Robot Experience. | Joseph Modayil |
| 2012 | SMC | Acquiring a broad range of empirical knowledge in real time by temporal-difference learning. | Joseph Modayil, Adam White, Patrick M. Pilarski, Richard S. Sutton |
| 2010 | IROS | Extending rapidly-exploring random trees for asymptotically optimal anytime motion planning. | Yasin Abbasi-Yadkori, Joseph Modayil, Csaba Szepesvri |
| 2007 | AAAI | Autonomous Development of a Grounded Object Ontology by a Learning Robot. | Joseph Modayil, Benjamin Kuipers |
| 2006 | ICRA | Autonomous Shape Model Learning for Object Localization and Recognition. | Joseph Modayil, Benjamin Kuipers |
| 2004 | ICRA | Local Metrical and Global Topological Maps in the Hybrid Spatial Semantic Hierarchy. | Benjamin Kuipers, Joseph Modayil, Patrick Beeson, Matt MacMahon, Francesco Savelli |
| 2004 | IROS | Using the topological skeleton for scalable global metrical map-building. | Joseph Modayil, Patrick Beeson, Benjamin Kuipers |
| 2004 | IROS | Bootstrap learning for object discovery. | Joseph Modayil, Benjamin Kuipers |