Poster
Position: Spectral GNNs Rely Less on Graph Fourier Basis than Conceived
Yuhe Guo · Huayi Tang · Jiahong Ma · Hongteng Xu · Zhewei Wei
East Exhibition Hall A-B #E-506
Have you ever heard of the Fourier basis? Its striking ability to represent global oscillations at different frequencies is nothing short of impressive. On graphs, researchers have tried to harness a similar idea by defining a “graph Fourier basis”—essentially transplanting the classical Fourier concept onto network structures. They treat it as a powerful tool for analyzing signals on graphs.There are plenty of reasons to be fascinated by the graph Fourier basis. In graph neural networks, practitioners first encode the graph as a Laplacian matrix and then seek ways to exploit its eigenvectors—i.e., the graph Fourier basis. What’s clever is that they often combine this approach with polynomial approximation techniques, which bypass the costly full spectral decomposition yet still allow the graph Fourier basis to be used in practice.But is the graph Fourier basis really as useful as everyone assumes? When we visualized these basis vectors on a 3D mesh of a horse, we observed that many of them clearly no longer exhibited the hallmark global oscillations (We also did other analysis). This led us to ask: where does the belief come from that “the graph Fourier basis is semantically meaningful, just like the classical Fourier basis”? We uncovered several factors: an unquestioning trust in mathematical analogies (even when those analogies jump too far), the influence of high-profile research directions, and a tendency to overgeneralize from familiar concepts.At the same time, we realized that polynomial approximation—used as the vehicle for employing the graph Fourier basis—naturally prevents the "graph Fourier atoms" from being revealed. In order to ensure basic stability and generalization, we rarely use polynomials that are complex enough. Therefore, our position paper takes a step back to reflect on how these technical developments have unfolded. It argues that we need to rethink our reliance on the graph Fourier basis and examine what we have achieved and why are the networks working.