Poster
in
Workshop: 1st Workshop on Foundation Models for Structured Data (FMSD)
Multivariate Calibration is Performative: A Perspective on Pitfalls and Progress
Sofian Zalouk · Charles Marx · Syrine Belakaria · Chris De Sa · Stefano Ermon
Abstract:
Reliable structured prediction requires forecasts that are calibrated both marginally and jointly. We identify two fundamental challenges in post-hoc multivariate calibration: performativity, where recalibration alters the very statistics used to assess calibration, and proportionality, the need to preserve a model’s learned dependence structure when correcting miscalibration. We show that two trivial forecasters can satisfy any notion of multivariate calibration, motivating a search for minimal corrections. By framing recalibration as a constrained optimization problem, we outline principled directions for feedback-aware algorithms that deliver reliable multivariate forecasts.
Chat is not available.