For >= 256 bit operations you need to decide to commit to them or not. If you go all-in on them and use them well, you will get the same work in less time and less joules than without them. If they won't help, don't use them. But, popping in and using them for tiny bits would be the slow and hot worst of both worlds.
Doesn't this hurt other users/applications on adjacent hyperthreads or cores? Or is it just HT?
Nit: most 256-bit AVX2 integer instructions (exception: multiply) do not trigger downclocking.
Is there a central list of these safe instructions?