Do you do vim with Gboard/SwiftKey or do you have a hardware keyboard?
Switching it to anything but english to make use of dictionaries makes potential special characters vanish from the long-press popups...
I also find that vim is easier to use for editing than Android editors. It is easier to use insertion, movement, and deletion commands instead of trying to tap on the right position or dragging to select.