Calculating self-attention is still quadratic though. So you get the negatives of transformers there too.