I had the same complaint, but there's actually a setting for that. Uncheck "stop cursor on error" under Miscellaneous.
And, it should move the cursor without moving the text.
Anyway, as someone who's tried to learn to type on prototype hardware without a working backspace, I appreciate the feature :)