Skip to yearly menu bar Skip to main content


Poster
in
Workshop: 3rd Workshop on High-dimensional Learning Dynamics (HiLD)

Understanding Lookahead Dynamics Through Laplace Transforms

Aniket Sanyal · Tatjana Chavdarova


Abstract: We introduce a frequency-domain framework for convergence analysis of hyper parameters in game optimization, leveraging High-Resolution Differential Equations (HRDEs) and Laplace transforms. Focusing on the Lookahead algorithm--parameterized by gradient steps $k$ and averaging coefficient $\alpha$--we reformulate oscillatory dynamics in bilinear games from the discrete time domain into the frequency domain, enabling precise convergence criteria. Our higher-precision $\mathcal{O}(\gamma^2)$-HRDE models derive tighter criteria, while even simplified $\mathcal{O}(\gamma)$-HRDE models retain practical utility: they prioritize actionable hyperparameter selection over analytically exhaustive expressions. Validated empirically in discrete-time dynamics, this approach potentially extends locally linear operators, bridging scalability and stability in game-theoretic training.

Chat is not available.