You're turning a discussion about what someone did into a discussion about who they are.[1]
I think racism is just as charged. Don't you?
For example, I think "naive" is a similar word in that it necessarily implies a characterization of the person beyond the action itself.