Looks like shift+arrow keys will still select the text and the selected text can be replaced by typing over it.