| 2009 | UAI | Conditional Probability Tree Estimation Analysis and Algorithms. | Alina Beygelzimer, John Langford, Yury Lifshits, Gregory B. Sorkin, Alexander L. Strehl |
| 2008 | ICML | Exploration scavenging. | John Langford, Alexander L. Strehl, Jennifer Wortman |
| 2008 | ISAIM | Probably Approximately Correct (PAC) Exploration in Reinforcement Learning. | Alexander L. Strehl |
| 2007 | AAAI | Efficient Structure Learning in Factored-State MDPs. | Alexander L. Strehl, Carlos Diuk, Michael L. Littman |
| 2006 | ICML | PAC model-free reinforcement learning. | Alexander L. Strehl, Lihong Li, Eric Wiewiora, John Langford, Michael L. Littman |
| 2006 | ICML | Experience-efficient learning in associative bandit problems. | Alexander L. Strehl, Chris Mesterharm, Michael L. Littman, Haym Hirsh |
| 2006 | UAI | Incremental Model-based Learners With Formal Learning-Time Guarantees. | Alexander L. Strehl, Lihong Li, Michael L. Littman |
| 2005 | ICML | A theoretical analysis of Model-Based Interval Estimation. | Alexander L. Strehl, Michael L. Littman |
| 2004 | ICTAI | An Empirical Evaluation of Interval Estimation for Markov Decision Processes. | Alexander L. Strehl, Michael L. Littman |