my parents live in an affluent southern california suburb and still do this all the time. when i visit i just walk in the front door.
in most suburban places you can also leave the garage door open all day long just fine.
it's primarily dense cities that are the issue. just like online, when there's transience and anonymity, there's a high incentive for people to behave poorly.