This illustrates the janitor principle. The person with the most physical access is not the security guard, but the janitor.

If you don't consider the janitor in your physical access planning, you are leaving lots of vulnerabilities.