The issue with latex is that I don't personally use it every day, and I suspect many people are in that camp. When you just use it ocassionally, all that syntax just falls out of your brain, leading to a frustrating loop where you're constantly relearning latex.

In comparison, I use vim keybindings every day. As a result, despite how esoteric it may be, it's well ingrained into my muscle memory.