The feminist mindset is that biological sex, gender, and sexuality do not depend on each other.
edit: To clarify you do not choose the gender you identify as, but you can choose the gender you present as.
I don't know if the transgender thing is just about wanting different sexual appendices or also about living the gender stereotypes.
I am by know mean speaking for transgendered people and if you want the best answer you should ask them. As far as I am aware it is mostly about identifying with a different gender role and for some (definitely not all) that includes having the sexual characteristics associated with that gender role.
There are plenty of transgendered people who identify as the opposite gender but are completely comfortable with their own physical sexual characteristics.