Single Headed Attention RNN: Stop Thinking with Your Head (2019)

This caught my attention (heh) because it is research done on a commodity desktop computer.