publications

Recent work from the group, organized by research theme.

Our recent work develops the foundations of sequential decision-making while turning those ideas into practical learning methods.

RL theory and bandit algorithms

We study how agents can learn and make reliable decisions under uncertainty, partial observability, non-stationarity, and risk.

2026

  1. ICML
    Commit to the Bit: Reactive Reinforcement Learning Done Right
    Onno Eberhard, Claire Vernade, and Michael Muehlebach
    In International Conference on Machine Learning, 2026
  2. COLT
    Tight Sample Complexity Bounds for Entropic Best Policy Identification
    Amer Essakine, and Claire Vernade
    In Conference on Learning Theory, 2026

2025

  1. EWRL
    Efficient Risk-sensitive Planning via Entropic Risk Measures
    Alexandre Marthe, Samuel Bounan, Aurélien Garivier, and 1 more author
    European Workshop on Reinforcement Learning, 2025
  2. NeurIPS
    Non-Stationary Lipschitz Bandits
    Nicolas Nguyen, Solenne Gaucher, and Claire Vernade
    In Advances in Neural Information Processing Systems, 2025
  3. ICML
    Partially Observable Reinforcement Learning with Memory Traces
    Onno Eberhard, Michael Muehlebach, and Claire Vernade
    In International Conference on Machine Learning, 2025
  4. AISTATS
    Prior-Dependent Allocations for Bayesian Fixed-Budget Best-Arm Identification in Structured Bandits
    Nicolas Nguyen, Imad Aouali, András György, and 1 more author
    In International Conference on Artificial Intelligence and Statistics, 2025

2024

  1. Preprint
    A Pontryagin Perspective on Reinforcement Learning
    Onno Eberhard, Claire Vernade, and Michael Muehlebach
    arXiv preprint, 2024
  2. RLC
    Non-stationary Bandits and Meta-Learning with a Small Set of Optimal Arms
    MohammadJavad Azizi, Thang Duong, Yasin Abbasi-Yadkori, and 3 more authors
    In Reinforcement Learning Conference, 2024

2023

  1. NeurIPS
    Beyond Average Return in Markov Decision Processes
    Alexandre Marthe, Aurélien Garivier, and Claire Vernade
    In Advances in Neural Information Processing Systems, 2023

Practical and cost-efficient learning algorithms from interactive sources

We design learning systems that use interaction, demonstrations, and changing data streams efficiently, without sacrificing robustness or flexibility.

2026

  1. Preprint
    To Retain or to Adapt? Generalizing Continual Learning
    Giulia Lanzillotta, Mandana Samiei, Doina Precup, and 2 more authors
    arXiv preprint, 2026
  2. Preprint
    Split the Differences, Pool the Rest: Provably Efficient Multi-Objective Imitation
    Ziyad Sheebaelhamd, Luca Viano, Volkan Cevher, and 1 more author
    arXiv preprint, 2026

2025

  1. NeurIPS
    Quantization-Free Autoregressive Action Transformer
    Ziyad Sheebaelhamd, Michael Tschannen, Michael Muehlebach, and 1 more author
    In Advances in Neural Information Processing Systems, 2025

For a complete and current record, see Claire Vernade’s Google Scholar profile.