High affinity RBCs would actually be a disadvantage for athletics. You actually don't need very high affinity to pick up oxygen from the lungs -- your lungs are comparatively extremely high in oxygen. What matters more is being able to drop the oxygen off in peripheral tissues. Higher affinity means that it's harder to actually deliver the oxygen, which is why we evolutionarily developed the switch away from fetal hemoglobin.