I'm surprised to see almost no discussion of fourier series in that paper, considering fourier series is all about representing signals as linear combinations of sinusoidal functions.
[1] https://geometricdeeplearning.com
[2] https://arxiv.org/pdf/2104.13478.pdf page 27 (23 if you count book pages).