| 2006 | Online Tracking of Linear Subspaces. | Koby Crammer |
| 2006 | Subset Ranking Using Regression. | David Cossock, Tong Zhang |
| 2006 | Tracking the Best Hyperplane with a Simple Budget Perceptron. | Nicol Cesa-Bianchi, Claudio Gentile |
| 2006 | Memory-Limited U-Shaped Learning. | Lorenzo Carlucci, John Case, Sanjay Jain, Frank Stephan |
| 2006 | Aggregation and Sparsity Via | Florentina Bunea, Alexandre B. Tsybakov, Marten H. Wegkamp |
| 2006 | Exact Learning Composed Classes with a Small Number of Mistakes. | Nader H. Bshouty, Hanna Mazzawi |
| 2006 | On Optimal Learning Algorithms for Multiplicity Automata. | Laurence Bisht, Nader H. Bshouty, Hanna Mazzawi |
| 2006 | A Sober Look at Clustering Stability. | Shai Ben-David, Ulrike von Luxburg, Dvid Pl |
| 2006 | Teaching Randomized Learners. | Frank J. Balbach, Thomas Zeugmann |
| 2006 | A Randomized Online Learning Algorithm for Better Variance Control. | Jean-Yves Audibert |
| 2006 | Learning Near-Optimal Policies with Bellman-Residual Minimization Based Fitted Policy Iteration and a Single Sample Path. | Andrs Antos, Csaba Szepesvri, Rmi Munos |
| 2006 | Unifying Divergence Minimization and Statistical Inference Via Convex Duality. | Yasemin Altun, Alexander J. Smola |
| 2006 | Continuous Experts and the Binning Algorithm. | Jacob D. Abernethy, John Langford, Manfred K. Warmuth |
| 2005 | Localized Upper and Lower Bounds for Some Estimation Problems. | Tong Zhang |
| 2005 | Data Dependent Concentration Bounds for Sequential Prediction Algorithms. | Tong Zhang |
| 2005 | Leaving the Span. | Manfred K. Warmuth, S. V. N. Vishwanathan |
| 2005 | On the Consistency of Multiclass Classification Methods. | Ambuj Tewari, Peter L. Bartlett |
| 2005 | Fast Rates for Support Vector Machines. | Ingo Steinwart, Clint Scovel |
| 2005 | Rank, Trace-Norm and Max-Norm. | Nathan Srebro, Adi Shraibman |
| 2005 | A New Perspective on an Old Perceptron Algorithm. | Shai Shalev-Shwartz, Yoram Singer |
| 2005 | Margin-Based Ranking Meets Boosting in the Middle. | Cynthia Rudin, Corinna Cortes, Mehryar Mohri, Robert E. Schapire |
| 2005 | Ellipsoid Approximation Using Random Vectors. | Shahar Mendelson, Alain Pajor |
| 2005 | On the Limitations of Embedding Methods. | Shahar Mendelson |
| 2005 | On a Syntactic Characterization of Classification with a Mind Change Bound. | Eric Martin, Arun Sharma |
| 2005 | Mind Change Efficient Learning. | Wei Luo, Oliver Schulte |