| 2005 | Compute Inclusion Depth of a Pattern. | Wei Luo |
| 2005 | Martingale Boosting. | Philip M. Long, Rocco A. Servedio |
| 2005 | General Polynomial Time Decomposition Algorithms. | Nikolas List, Hans Ulrich Simon |
| 2005 | The Value of Agreement, a New Boosting Algorithm. | Boaz Leskes |
| 2005 | Sensitive Error Correcting Output Codes. | John Langford, Alina Beygelzimer |
| 2005 | The Cross Validation Problem. | John Langford |
| 2005 | Optimum Follow the Leader Algorithm. | Dima Kuzmin, Manfred K. Warmuth |
| 2005 | Unlabeled Compression Schemes for Maximum Classes, . | Dima Kuzmin, Manfred K. Warmuth |
| 2005 | Exponential Convergence Rates in Classification. | Vladimir Koltchinskii, Olexandra Beznosova |
| 2005 | The Spectral Method for General Mixture Models. | Ravindran Kannan, Hadi Salmasian, Santosh S. Vempala |
| 2005 | The Weak Aggregating Algorithm and Weak Mixability. | Yuri Kalnishkan, Michael V. Vyugin |
| 2005 | Trading in Markovian Price Models. | Sham M. Kakade, Michael J. Kearns |
| 2005 | Generalization Error Bounds Using Unlabeled Data. | Matti Kriinen |
| 2005 | From Graphs to Manifolds - Weak and Strong Pointwise Consistency of Graph Laplacians. | Matthias Hein, Jean-Yves Audibert, Ulrike von Luxburg |
| 2005 | Tracking the Best of Many Experts. | Andrs Gyrgy, Tams Linder, Gbor Lugosi |
| 2005 | Asymptotic Log-Loss of Prequential Maximum Likelihood Codes. | Peter Grnwald, Steven de Rooij |
| 2005 | Permutation Tests for Classification. | Polina Golland, Feng Liang, Sayan Mukherjee, Dmitry Panchenko |
| 2005 | On Attribute Efficient and Non-adaptive Learning of Parities and DNF Expressions. | Vitaly Feldman |
| 2005 | Separating Models of Learning from Correlated and Uncorrelated Data. | Ariel Elbaz, Homin K. Lee, Rocco A. Servedio, Andrew Wan |
| 2005 | Approximating a Gram Matrix for Improved Kernel-Based Learning. | Petros Drineas, Michael W. Mahoney |
| 2005 | Analysis of Perceptron-Based Active Learning. | Sanjoy Dasgupta, Adam Tauman Kalai, Claire Monteleoni |
| 2005 | Loss Bounds for Online Category Ranking. | Koby Crammer, Yoram Singer |
| 2005 | Ranking and Scoring Using Empirical Risk Minimization. | Stphan Clmenon, Gbor Lugosi, Nicolas Vayatis |
| 2005 | Improved Second-Order Bounds for Prediction with Expert Advice. | Nicol Cesa-Bianchi, Yishay Mansour, Gilles Stoltz |
| 2005 | Variations on U-Shaped Learning. | Lorenzo Carlucci, Sanjay Jain, Efim B. Kinber, Frank Stephan |