In some places, rejecting that person because they are trans could be considered a hate crime. Just because someone will not date me because I am Southeast Asian, or I won't date them because they are not the gender I prefer, does not make anyone racist or transphobic. It's a personal preference.