Skip to yearly menu bar Skip to main content


Poster
in
Workshop: 1st Workshop on Foundation Models for Structured Data (FMSD)

Multivariate Calibration is Performative: A Perspective on Pitfalls and Progress

Sofian Zalouk · Charles Marx · Syrine Belakaria · Chris De Sa · Stefano Ermon


Abstract:

Reliable structured prediction requires forecasts that are calibrated both marginally and jointly. We identify two fundamental challenges in post-hoc multivariate calibration: performativity, where recalibration alters the very statistics used to assess calibration, and proportionality, the need to preserve a model’s learned dependence structure when correcting miscalibration. We show that two trivial forecasters can satisfy any notion of multivariate calibration, motivating a search for minimal corrections. By framing recalibration as a constrained optimization problem, we outline principled directions for feedback-aware algorithms that deliver reliable multivariate forecasts.

Chat is not available.