Perhaps it’s an issue is that text often has directionality.

https://arxiv.org/abs/2401.17505