> But it's possible to hit this button again and re-enable Cloudflare forwarding temporarily if we find ourselves under attack, so I figure this is a good option.
Plan to redeploy your production server to a new IP address too since the attacker will still be able to hit it directly.