I would worry about the latency of a round-trip over Bluetooth. Google search tells me it’s, optimistically, 100ms single-trip, so 200ms round trip (https://www.headphonesty.com/2020/07/fix-sound-delay-bluetoo...)
You're a tad bit incorrect on Bluetooth round trip a few centimers being 150+ms. Plenty of game controllers operate on or on top of Bluetooth and do not have 150ms latency. Headset Profile (HSP) bluetooth also does not (usually) have 150ms+ latency, usually more along the lines of maybe 30ms latency while many Bluetooth controllers will have <10ms latency.
https://www.reddit.com/r/RocketLeague/comments/8wvf9u/contro...
I'm not the person who designs codecs, but I'd wager most of the lag seen with Bluetooth audio systems come from the codecs. Bluetooth devices are often incredibly power constrained, so codecs operating over Bluetooth are usually trying to balance quality with computational complexity and dealing with packetization of the audio. When you're listening to an audio stream, it appears like a continuous stream of data. In reality, its chunks of data. You're listening to a previous chunk of data while the device is waiting to get the next packet, apply error correction to it, decode the very highly compressed data, and have the waveform ready to go out to your ears all on usually pretty cheap and highly power constrained equipment. It then has to be a bit tolerant to the above mentioned spread spectrum and a potential dropped packet here and there while still seeming to just be a continuous audio stream.
So in short, there's latency in a lot of Bluetooth audio codecs because the designers of the codecs felt the latency tradeoff was acceptable given the bandwidth, compute, power, and quality envelopes based on technology available at the time of crafting the codec.
Meanwhile, you're sending out pings on a device with keys on the keyboard bigger than the battery on a lot of bluetooth headsets with many orders of magnitude more processing power whose wireless connection is not normally that much of a power concern encoding/decoding extremely basic data to one of the companies with the most privately owned fiber with billions of dollars of computing equipment.
LE Audio: Announced in January 2020 at CES by the Bluetooth SIG, LE Audio will run on the Bluetooth Low Energy radio lowering battery consumption, and allow the protocol to carry sound and add features such as one set of headphones connecting to multiple audio sources or multiple headphones connecting to one source It uses a new LC3 codec. BLE Audio will also add support for hearing aids.