>Our key insight is that the diagonal linear recurrent layer can act as a gradient accumulator
So they're sort of reinventing the discrete-time differentiator from signal processing, but parameterized neurally?
So they're sort of reinventing the discrete-time differentiator from signal processing, but parameterized neurally?