A feature flag doesn't have to impact compiler performance unless enabled.
(I'm not for/against the philosophy of the decision making, just pointing it out).
you could have two totally separate compilers, which go does, there is the gcc variant. i don’t know if it tends to produce faster binaries though.