They Do, the latest rwkv v5, matches mamba at 3b scale, and from the benchmarks I see, its similar to hyena