Workshop on Real World Experiment Design and Active Learning at ICML 2020

Virtual workshop, 18 July 2020 @ICML

This workshop aims to bring together researchers from academia and industry to discuss major challenges, outline recent advances, and highlight future directions pertaining to novel and existing large-scale real-world experiment design and active learning problems. We aim to highlight new and emerging research opportunities for the ML community that arise from the evolving needs to make experiment design and active learning procedures that are theoretically and practically relevant for realistic applications. Progress in this area has the potential to provide immense benefits in using experiment design and active learning algorithms in emerging high impact applications, such as material design, computational biology, algorithm configuration, AutoML, crowdsourcing, citizen science, robotics, and more.

Remark: In light of the COVID-19 situation, the workshop will be held virtually. For more information, please see the ICML conference website.


  • [Video] José Miguel Hernández Lobato: Latent Space Optimization with Deep Generative Models
  • [Video] Tom Rainforth: Designing Bayesian-Optimal Experiments with Stochastic Gradients
  • [Video] Dorsa Sadigh: Active Learning of Robot Reward Functions
  • [Video] Anca Dragan: Active Learning through Physically-embodied, Synthesized-from-“scratch” Queries
  • [Video] Aaditya Ramdas: Uncertainty Quantification Using Martingales for Misspecified Gaussian Processes
  • [Video] Shipra Agrawal: Learning to Manage Inventory
  • [Video] Jennifer Listgarten: Machine Learning-based Design (of Proteins, Small Molecules and Beyond)
  • [Video] Angela Schoellig: Safe and Efficient Active Learning Strategies for Robotics Applications
  • [Video] Pietro Perona: Towards Causal Benchmarking of Bias in Face Analysis Algorithms

Invited Speakers

Call for Submissions & Important Dates

Please see the Call for papers for submission instructions.

  • Submission deadline: 22 June 2020, 11:59 PM (AoE time)
  • Camera-ready paper submission deadline: 15 July 2020, 11:59 PM (AoE time)
  • Lightning talk slides submission deadline: 15 July 2020, 11:59 PM (AoE time)
  • Workshop date: 18th July 2020