Furthermore, administrative controls (headphones) for what is actually a safety and health problem (excess noise) are the solution of last resort from a health and safety perspective. A good health and safety person would advise structural mitigation, not forcing everyone to put on personal protective equipment (headphones.)
When open plan offices can regularly burst up to 95 dB (yes, I took in a meter and measured the last one I was in) and are often 65 dB when they are "quiet", noise is absolutely a health and safety issue. Constant noise, even if not immediately damaging to hearing, can cause increased stress and other physiological issues.
I've also tried earphones with music, but I can't work like that for long, I just start listening to the music instead. I need peace and quiet.
And of course there's the issue of visual noise as well.
https://www.amazon.co.uk/Bio-Ears-Silicone-EarPlugs-Protecti...
I split one in two and use them that way, I've gotten to work with them in before without noticing, maybe worth a shot.
I bought a box of 100 pairs of Bilsom 303 plugs a couple of years ago, for motorcycling. The whole box was $40.