> are cookie banners really so frustrating

They would be a LOT less frustrating if:

a) they were standardized — they currently add a hefty cognitive load while parsing them, deciding which action to take, etc.

b) they worked properly — I would say, more often than not, they 'forget' the previous setting. I should never see a cookie popup on the same site twice unless I clear my browser settings.