The guard watching your building needs to have full access to every room so that they can check if a bad guy got there without a key.

You need to trust the guard implicitly.

"Security" software has always been like that. What's bonkers is the state of regulations and auditing where putting this kind of crap on your systems is somehow seen as increasing your security rather than decreasing it.