You would be surprised how much software is built exclusively for TERM=xterm or TERM=xterm-*.
And yes, that difference is significant because the F-keys, Ins, End and companions won't work.
Instead of a standard, we have mountains of terminfo entries which are mostly slight xterm variants and ancient hardware