I think trans people are overgeneralizing from their own psyches. They feel like they are in the wrong body, and they assume that everyone else would feel the same if they were body-swapped into the opposite sex. But as far as I can tell, only a tiny fraction of people experience this. Gender dysphoria seems to be about as common as aphantasia or synesthesia.
Personally, I don't think of my body as part of my identity. It's a machine that I ride around in. If I woke up in the body of a woman, I'd be really annoyed but I doubt I'd go through years of hormones and surgery to be perceived as a man again. It would be easier to learn how to use the new body than to try to make it closer to what I'm used to.