Well, the SR-71 could go over Mach 3 at 85,000 ft. If you could have somehow pushed it to that speed at sea level, you would have had even worse heat problems.
Requiring a few states to hang a left makes it difficult to both evade and defense hit a target, right?
Your attacker is going to have roughly the same problem turning as you do. Though an unmanned attack vehicle (missile, drone) isn't limited by physiological g-force limitations.
At some point though your airframe becomes airframes and flight dynamics change considerably.