Skip to yearly menu bar Skip to main content


Spotlight Poster

Addressing Misspecification in Simulation-based Inference through Data-driven Calibration

Antoine Wehenkel · Juan L. Gamella · Ozan Sener · Jens Behrmann · Guillermo Sapiro · Jörn Jacobsen · Marco Cuturi

East Exhibition Hall A-B #E-1404
[ ] [ ]
Tue 15 Jul 4:30 p.m. PDT — 7 p.m. PDT
 
Oral presentation: Oral 2E Optimal Transport
Tue 15 Jul 3:30 p.m. PDT — 4:30 p.m. PDT

Abstract:

Driven by steady progress in deep generative modeling, simulation-based inference (SBI) has emerged as the workhorse for inferring the parameters of stochastic simulators. However, recent work has demonstrated that model misspecification can harm SBI's reliability, preventing its adoption in important applications where only misspecified simulators are available.This work introduces robust posterior estimation (RoPE), a framework that overcomes model misspecification with a small real-world calibration set of ground truth parameter measurements.We formalize the misspecification gap as the solution of an optimal transport (OT) problem between learned representations of real-world and simulated observations, allowing RoPE to learn a model of the misspecification without placing additional assumptions on its nature. RoPE shows how the calibration set and OT together offer a controllable balance between calibrated uncertainty and informative inference even under severely misspecified simulators. Results on four synthetic tasks and two real-world problems with ground-truth labels demonstrate that RoPE outperforms baselines and consistently returns informative and calibrated credible intervals.

Lay Summary:

When scientists use computer simulations to understand real-world systems, the simulations are often imperfect and can lead to incorrect conclusions. This paper introduces a method called RoPE that helps fix these problems by using a small amount of real-world data to adjust the simulation results. This way, the method gives more accurate and trustworthy answers, even when the original simulation isn't perfect.

Chat is not available.