They're not all taking banned substances. Case in point, Hergie Bacyadan and Elis Lundholm competed in the last Summer and Winter Olympics respectively.
This would be like if two trans women, who has not undergone any hormone replacement therapy or surgery, would compete in men's divisions.