You have no right to not be filmed in public, in the US at least. Someone can already film you with their phone, what makes this any different?
IR LED laden accessories will probably be your best bet.
Yes, we're being spied on everywhere. But that in no way means that it's pointless to avoid it wherever we can.
And that's not counting other wearable cameras, such as the Meta RayBans mentioned elsewhere in this conversation.