| 2026 | COLT | Online Market Making and the Value of Observing the Order Book. | Davide Maran, Marcello Restelli |
| 2025 | AISTATS | Efficient Exploitation of Hierarchical Structure in Sparse Reward Reinforcement Learning. | Gianluca Drappo, Arnaud Robert, Marcello Restelli, Aldo A. Faisal, Alberto Maria Metelli, Ciara Pike-Burke |
| 2025 | AISTATS | Achieving $\widetilde{\mathcal{O}}(\sqrt{T})$ Regret in Average-Reward POMDPs with Known Observation Models. | Alessio Russo, Alberto Maria Metelli, Marcello Restelli |
| 2025 | ECAI | "So, Tell Me About Your Policy...": Distillation of Interpretable Policies from Deep Reinforcement Learning Agents. | Giovanni Dispoto, Paolo Bonetti, Marcello Restelli |
| 2025 | ICML | Enhancing Diversity In Parallel Agents: A Maximum State Entropy Exploration Story. | Vincenzo De Paola, Riccardo Zamboni, Mirco Mutti, Marcello Restelli |
| 2025 | IJCNN | A Reinforcement Learning Approach for Optimal Control in Microgrids. | Davide Salaorni, Federico Bianchi, Marcello Restelli, Francesco Trov |
| 2024 | AAAI | Online Markov Decision Processes Configuration with Continuous Decision Space. | Davide Maran, Pierriccardo Olivieri, Francesco Emanuele Stradi, Giuseppe Urso, Nicola Gatti, Marcello Restelli |
| 2024 | AAAI | Parameterized Projected Bellman Operator. | Tho Vincent, Alberto Maria Metelli, Boris Belousov, Jan Peters, Marcello Restelli, Carlo D'Eramo |
| 2024 | AISTATS | Autoregressive Bandits. | Francesco Bacchiocchi, Gianmarco Genalti, Davide Maran, Marco Mussi, Marcello Restelli, Nicola Gatti, Alberto Maria Metelli |
| 2024 | COLT | Projection by Convolution: Optimal Sample Complexity for Reinforcement Learning in Continuous-Space MDPs. | Davide Maran, Alberto Maria Metelli, Matteo Papini, Marcello Restelli |
| 2024 | ICANN | Building Surrogate Models Using Trajectories of Agents Trained by Reinforcement Learning. | Julen Cestero, Marco Quartulli, Marcello Restelli |
| 2024 | ICLR | Exploiting Causal Graph Priors with Posterior Sampling for Reinforcement Learning. | Mirco Mutti, Riccardo De Santi, Marcello Restelli, Alexander Marx, Giorgia Ramponi |
| 2024 | ICML | Graph-Triggered Rising Bandits. | Gianmarco Genalti, Marco Mussi, Nicola Gatti, Marcello Restelli, Matteo Castiglioni, Alberto Maria Metelli |
| 2024 | ICML | No-Regret Reinforcement Learning in Smooth MDPs. | Davide Maran, Alberto Maria Metelli, Matteo Papini, Marcello Restelli |
| 2024 | ICML | Factored-Reward Bandits with Intermediate Observations. | Marco Mussi, Simone Drago, Marcello Restelli, Alberto Maria Metelli |
| 2024 | ICML | Best Arm Identification for Stochastic Rising Bandits. | Marco Mussi, Alessandro Montenegro, Francesco Trov, Marcello Restelli, Alberto Maria Metelli |
| 2024 | ICML | How to Explore with Belief: State Entropy Maximization in POMDPs. | Riccardo Zamboni, Duilio Cirino, Marcello Restelli, Mirco Mutti |
| 2024 | IJCNN | Causal Feature Selection via Transfer Entropy. | Paolo Bonetti, Alberto Maria Metelli, Marcello Restelli |
| 2024 | IJCNN | The Power of Hybrid Learning in Industrial Robotics: Efficient Grasping Strategies with Supervised-Driven Reinforcement Learning. | Vincenzo De Paola, Giuseppe Calcagno, Alberto Maria Metelli, Marcello Restelli |
| 2023 | AAAI | Wasserstein Actor-Critic: Directed Exploration via Optimism for Continuous-Actions Control. | Amarildo Likmeta, Matteo Sacco, Alberto Maria Metelli, Marcello Restelli |
| 2023 | AAAI | Tight Performance Guarantees of Imitator Policies with Continuous Actions. | Davide Maran, Alberto Maria Metelli, Marcello Restelli |
| 2023 | AAAI | Dynamic Pricing with Volume Discounts in Online Settings. | Marco Mussi, Gianmarco Genalti, Alessandro Nuara, Francesco Trov, Marcello Restelli, Nicola Gatti |
| 2023 | AAAI | Provably Efficient Causal Model-Based Reinforcement Learning for Systematic Generalization. | Mirco Mutti, Riccardo De Santi, Emanuele Rossi, Juan Felipe Caldern, Michael M. Bronstein, Marcello Restelli |
| 2023 | AAAI | Simultaneously Updating All Persistence Values in Reinforcement Learning. | Luca Sabbioni, Luca Al Daire, Lorenzo Bisi, Alberto Maria Metelli, Marcello Restelli |
| 2023 | AISTATS | A Tale of Sampling and Estimation in Discounted Reinforcement Learning. | Alberto Maria Metelli, Mirco Mutti, Marcello Restelli |
| 2023 | ICML | Towards Theoretical Understanding of Inverse Reinforcement Learning. | Alberto Maria Metelli, Filippo Lazzati, Marcello Restelli |
| 2023 | ICML | Dynamical Linear Bandits. | Marco Mussi, Alberto Maria Metelli, Marcello Restelli |
| 2023 | ICML | Truncating Trajectories in Monte Carlo Reinforcement Learning. | Riccardo Poiani, Alberto Maria Metelli, Marcello Restelli |
| 2023 | ITW | Information-Theoretic Regret Bounds for Bandits with Fixed Expert Advice. | Khaled Eldowa, Nicol Cesa-Bianchi, Alberto Maria Metelli, Marcello Restelli |
| 2023 | UAI | On the Relation between Policy Improvement and Off-Policy Minimum-Variance Policy Evaluation. | Alberto Maria Metelli, Samuele Meta, Marcello Restelli |
| 2022 | AAAI | Lifelong Hyper-Policy Optimization with Multiple Importance Sampling Regularization. | Pierre Liotet, Francesco Vidaich, Alberto Maria Metelli, Marcello Restelli |
| 2022 | AAAI | Unsupervised Reinforcement Learning in Multiple Environments. | Mirco Mutti, Mattia Mancassola, Marcello Restelli |
| 2022 | AISTATS | Finite Sample Analysis of Mean-Volatility Actor-Critic for Risk-Averse Reinforcement Learning. | Khaled Eldowa, Lorenzo Bisi, Marcello Restelli |
| 2022 | AISTATS | Reward-Free Policy Space Compression for Reinforcement Learning. | Mirco Mutti, Stefano Del Col, Marcello Restelli |
| 2022 | ICLR | Goal-Directed Planning via Hindsight Experience Replay. | Lorenzo Moro, Amarildo Likmeta, Enrico Prati, Marcello Restelli |
| 2022 | ICML | Balancing Sample Efficiency and Suboptimality in Inverse Reinforcement Learning. | Angelo Damiani, Giorgio Manganini, Alberto Maria Metelli, Marcello Restelli |
| 2022 | ICML | Delayed Reinforcement Learning by Imitation. | Pierre Liotet, Davide Maran, Lorenzo Bisi, Marcello Restelli |
| 2022 | ICML | Stochastic Rising Bandits. | Alberto Maria Metelli, Francesco Trov, Matteo Pirola, Marcello Restelli |
| 2022 | ICML | The Importance of Non-Markovianity in Maximum State Entropy Exploration. | Mirco Mutti, Riccardo De Santi, Marcello Restelli |
| 2022 | IJCAI | Multi-Armed Bandit Problem with Temporally-Partitioned Rewards: When Partial Feedback Counts. | Giulia Romano, Andrea Agostini, Francesco Trov, Nicola Gatti, Marcello Restelli |
| 2022 | IJCNN | Storehouse: a Reinforcement Learning Environment for Optimizing Warehouse Management. | Julen Cestero, Marco Quartulli, Alberto Maria Metelli, Marcello Restelli |
| 2022 | KDD | Pricing the Long Tail by Explainable Product Aggregation and Monotonic Bandits. | Marco Mussi, Gianmarco Genalti, Francesco Trov, Alessandro Nuara, Nicola Gatti, Marcello Restelli |
| 2022 | UAI | Learning in Markov games: Can we exploit a general-sum opponent? | Giorgia Ramponi, Marcello Restelli |
| 2021 | AAAI | Policy Optimization as Online Learning with Mediator Feedback. | Alberto Maria Metelli, Matteo Papini, Pierluca D'Oro, Marcello Restelli |
| 2021 | AAAI | Task-Agnostic Exploration via Policy Gradient of a Non-Parametric State Entropy Estimate. | Mirco Mutti, Lorenzo Pratissoli, Marcello Restelli |
| 2021 | AAAI | Newton Optimization on Helmholtz Decomposition for Continuous Games. | Giorgia Ramponi, Marcello Restelli |
| 2021 | ICML | Provably Efficient Learning of Transferable Rewards. | Alberto Maria Metelli, Giorgia Ramponi, Alessandro Concetti, Marcello Restelli |
| 2021 | ICML | Leveraging Good Representations in Linear Contextual Bandits. | Matteo Papini, Andrea Tirinzoni, Marcello Restelli, Alessandro Lazaric, Matteo Pirotta |
| 2021 | IJCAI | Meta-Reinforcement Learning by Tracking Task Non-stationarity. | Riccardo Poiani, Andrea Tirinzoni, Marcello Restelli |
| 2021 | IJCNN | Learning a Belief Representation for Delayed Reinforcement Learning. | Pierre Liotet, Erick Venneri, Marcello Restelli |
| 2021 | UAI | Time-variant variational transfer for value functions. | Giuseppe Canonaco, Andrea Soprani, Matteo Giuliani, Andrea Castelletti, Manuel Roveri, Marcello Restelli |
| 2020 | AAAI | Gradient-Aware Model-Based Policy Search. | Pierluca D'Oro, Alberto Maria Metelli, Andrea Tirinzoni, Matteo Papini, Marcello Restelli |
| 2020 | AAAI | An Intrinsically-Motivated Approach for Learning Highly Exploring and Fast Mixing Policies. | Mirco Mutti, Marcello Restelli |
| 2020 | AISTATS | Balancing Learning Speed and Stability in Policy Gradient via Adaptive Exploration. | Matteo Papini, Andrea Battistello, Marcello Restelli |
| 2020 | AISTATS | Truly Batch Model-Free Inverse Reinforcement Learning about Multiple Intentions. | Giorgia Ramponi, Amarildo Likmeta, Alberto Maria Metelli, Andrea Tirinzoni, Marcello Restelli |
| 2020 | AISTATS | A Novel Confidence-Based Algorithm for Structured Bandits. | Andrea Tirinzoni, Alessandro Lazaric, Marcello Restelli |
| 2020 | ECAI | Model-Free Non-Stationarity Detection and Adaptation in Reinforcement Learning. | Giuseppe Canonaco, Marcello Restelli, Manuel Roveri |
| 2020 | ICLR | Sharing Knowledge in Multi-Task Deep Reinforcement Learning. | Carlo D'Eramo, Davide Tateo, Andrea Bonarini, Marcello Restelli, Jan Peters |
| 2020 | ICML | Control Frequency Adaptation via Action Persistence in Batch Reinforcement Learning. | Alberto Maria Metelli, Flavio Mazzolini, Lorenzo Bisi, Luca Sabbioni, Marcello Restelli |
| 2020 | ICML | Sequential Transfer in Reinforcement Learning with a Generative Model. | Andrea Tirinzoni, Riccardo Poiani, Marcello Restelli |
| 2020 | IJCAI | Risk-Averse Trust Region Optimization for Reward-Volatility Reduction. | Lorenzo Bisi, Luca Sabbioni, Edoardo Vittori, Matteo Papini, Marcello Restelli |
| 2020 | ICPR | Inferring Functional Properties from Fluid Dynamics Features. | Andrea Schillaci, Maurizio Quadrio, Carlotta Pipolo, Marcello Restelli, Giacomo Boracchi |
| 2019 | ICML | Reinforcement Learning in Configurable Continuous Environments. | Alberto Maria Metelli, Emanuele Ghelfi, Marcello Restelli |
| 2019 | ICML | Optimistic Policy Optimization via Multiple Importance Sampling. | Matteo Papini, Alberto Maria Metelli, Lorenzo Lupo, Marcello Restelli |
| 2019 | ICML | Transfer of Samples in Policy Search via Multiple Importance Sampling. | Andrea Tirinzoni, Mattia Salvini, Marcello Restelli |
| 2019 | IJCNN | Feature Selection via Mutual Information: New Theoretical Insights. | Mario Beraha, Alberto Maria Metelli, Matteo Papini, Andrea Tirinzoni, Marcello Restelli |
| 2019 | IJCNN | Exploiting Action-Value Uncertainty to Drive Exploration in Reinforcement Learning. | Carlo D'Eramo, Andrea Cini, Marcello Restelli |
| 2019 | IJCNN | Exploration Driven by an Optimistic Bellman Equation. | Samuele Tosatto, Carlo D'Eramo, Joni Pajarinen, Marcello Restelli, Jan Peters |
| 2019 | WWW | Dealing with Interdependencies and Uncertainty in Multi-Channel Advertising Campaigns Optimization. | Alessandro Nuara, Nicola Sosio, Francesco Trov, Maria Chiara Zaccardi, Nicola Gatti, Marcello Restelli |
| 2018 | AAAI | A Combinatorial-Bandit Algorithm for the Online Joint Bid/Budget Optimization of Pay-per-Click Advertising Campaigns. | Alessandro Nuara, Francesco Trov, Nicola Gatti, Marcello Restelli |
| 2018 | ICML | Configurable Markov Decision Processes. | Alberto Maria Metelli, Mirco Mutti, Marcello Restelli |
| 2018 | ICML | Stochastic Variance-Reduced Policy Gradient. | Matteo Papini, Damiano Binaghi, Giuseppe Canonaco, Matteo Pirotta, Marcello Restelli |
| 2018 | ICML | Importance Weighted Transfer of Samples in Reinforcement Learning. | Andrea Tirinzoni, Andrea Sessa, Matteo Pirotta, Marcello Restelli |
| 2018 | IJCNN | Targeting Optimization for Internet Advertising by Learning from Logged Bandit Feedback. | Margherita Gasparini, Alessandro Nuara, Francesco Trov, Nicola Gatti, Marcello Restelli |
| 2017 | AAAI | Estimating the Maximum Expected Value in Continuous Reinforcement Learning Problems. | Carlo D'Eramo, Alessandro Nuara, Matteo Pirotta, Marcello Restelli |
| 2017 | AAAI | Unimodal Thompson Sampling for Graph-Structured Arms. | Stefano Paladino, Francesco Trov, Marcello Restelli, Nicola Gatti |
| 2017 | ICML | Boosted Fitted Q-Iteration. | Samuele Tosatto, Matteo Pirotta, Carlo D'Eramo, Marcello Restelli |
| 2017 | IJCNN | Risk-averse trees for learning from logged bandit feedback. | Francesco Trov, Stefano Paladino, Paolo Simone, Marcello Restelli, Nicola Gatti |
| 2017 | UAI | Regret Minimization Algorithms for the Followers Behaviour Identification in Leadership Games. | Lorenzo Bisi, Giuseppe De Nittis, Francesco Trov, Marcello Restelli, Nicola Gatti |
| 2016 | AAAI | Sequence-Form and Evolutionary Dynamics: Realization Equivalence to Agent Form and Logit Dynamics. | Nicola Gatti, Marcello Restelli |
| 2016 | AAAI | Inverse Reinforcement Learning through Policy Gradient Minimization. | Matteo Pirotta, Marcello Restelli |
| 2016 | ECAI | Budgeted Multi-Armed Bandit in Continuous Action Space. | Francesco Trov, Stefano Paladino, Marcello Restelli, Nicola Gatti |
| 2016 | ICML | Estimating Maximum Expected Value through Gaussian Approximation. | Carlo D'Eramo, Marcello Restelli, Alessandro Nuara |
| 2015 | AAAI | Multi-Objective Reinforcement Learning with Continuous Pareto Frontier Approximation. | Matteo Pirotta, Simone Parisi, Marcello Restelli |
| 2015 | ICRA | Estimating a Mean-Path from a set of 2-D curves. | Amir M. Ghalamzan E., Luca Bascetta, Marcello Restelli, Paolo Rocco |
| 2015 | IJCNN | Following Newton direction in Policy Gradient with parameter exploration. | Giorgio Manganini, Matteo Pirotta, Marcello Restelli, Luca Bascetta |
| 2014 | AAAI | Evolutionary Dynamics of Q-Learning over the Sequence Form. | Fabio Panozzo, Nicola Gatti, Marcello Restelli |
| 2014 | IJCNN | Policy gradient approaches for multi-objective sequential decision making. | Simone Parisi, Matteo Pirotta, Nicola Smacchia, Luca Bascetta, Marcello Restelli |
| 2013 | AAAI | Efficient Evolutionary Dynamics with Extensive-Form Games. | Nicola Gatti, Fabio Panozzo, Marcello Restelli |
| 2013 | ICML | Safe Policy Iteration. | Matteo Pirotta, Marcello Restelli, Alessio Pecorino, Daniele Calandriello |
| 2012 | AAAI | Computing Equilibria with Two-Player Zero-Sum Continuous Stochastic Games with Switching Controller. | Guido Bonomi, Nicola Gatti, Fabio Panozzo, Marcello Restelli |
| 2012 | IJCNN | Tree-based Fitted Q-iteration for Multi-Objective Markov Decision problems. | Andrea Castelletti, Francesca Pianosi, Marcello Restelli |
| 2009 | ICINCO | Batch Reinforcement Learning - An Application to a Controllable Semi-active Suspension System. | Simone Tognetti, Marcello Restelli, Sergio M. Savaresi, Cristiano Spelta |
| 2008 | ICML | Transfer of samples in batch reinforcement learning. | Alessandro Lazaric, Marcello Restelli, Andrea Bonarini |
| 2007 | AAMAS | Bifurcation Analysis of Reinforcement Learning Agents in the Selten's Horse Game. | Alessandro Lazaric, Enrique Munoz de Cote, Fabio Dercole, Marcello Restelli |
| 2007 | ICINCO | Piecewise constant reinforcement learning for robotic applications. | Andrea Bonarini, Alessandro Lazaric, Marcello Restelli |
| 2005 | ICRA | Automatic Error Detection and Reduction for an Odometric Sensor based on Two Optical Mice. | Andrea Bonarini, Matteo Matteucci, Marcello Restelli |
| 2005 | ICRA | MRT: Robotics Off-the-Shelf with the Modular Robotic Toolkit. | Andrea Bonarini, Matteo Matteucci, Marcello Restelli |
| 2004 | ICINCO | Dead Reckoning for Mobile Robots Using Two Optical Mice. | Andrea Bonarini, Matteo Matteucci, Marcello Restelli |
| 2004 | IROS | A kinematic-independent dead-reckoning sensor for indoor mobile robotics. | Andrea Bonarini, Matteo Matteucci, Marcello Restelli |
| 2003 | RoboCup | Filling the Gap among Coordination, Planning, and Reaction Using a Fuzzy Cognitive Model. | Andrea Bonarini, Matteo Matteucci, Marcello Restelli |
| 2003 | RoboCup | A Probabilistic Framework for Weighting Different Sensor Data in MUREA. | Marcello Restelli, Domenico G. Sorrenti, Fabio M. Marchese |
| 2002 | IROS | A robot localization method based on evidence accumulation and multi-resolution. | Marcello Restelli, Domenico G. Sorrenti, Fabio M. Marchese |
| 2002 | RoboCup | MUREA: A MUlti-Resolution Evidence Accumulation Method for Robot Localization in Known Environments. | Marcello Restelli, Domenico G. Sorrenti, Fabio M. Marchese |
| 2001 | RoboCup | Fun2Mas: The Milan Robocup Team. | Andrea Bonarini, Giovanni Invernizzi, Fabio M. Marchese, Matteo Matteucci, Marcello Restelli, Domenico G. Sorrenti |
| 2001 | RoboCup | A Framework for Robust Sensing in Multi-agent Systems. | Andrea Bonarini, Matteo Matteucci, Marcello Restelli |