I agree with this sentiment. To be fair though, the authors did attempt to generate a biologically plausible RNN, which they published in a previous article...
https://www.pnas.org/content/pnas/116/45/22811.full.pdf
I'm not fully sold on this model, but the article is fairly dense and I dont fully understand it. (Sejnowski, the senior author, was on my dissertation committee; he fell asleep during my defense lol)