I don't think Hyena can be run in RNN mode, though. But it _might_ scale better than the LRU model (second paper).
Reply on news.ycombinator.com