They're rightly concerned that it will be used like notification permissions: just one more thing you need to cancel when you use a site. Yes you need to consent, but even being asked is audacious.
It's not at all clear that a similar widely applicable use-case exists for Bluetooth.