The "low audio quality after/during conference" problem as I understand it is because of the SCO codec used for Bluetooth microphone stuff (which is lower bandwidth but allows you to speak and listen at the same time). It takes a few seconds for the AirPods to switch back to their usual codec.
Is there a way to fix this without ditching Bluetooth?