You are overlooking the fact that the word is flagged as offensive. That is the entirety of the issue.
Definition of retarded
1 informal + offensive : very stupid or foolish
2 dated, now offensive : affected by intellectual disability : INTELLECTUALLY DISABLED