It is amazing that people have nothing better to do than be concerned about their neighbors trash can being outside at 3:00pm
Generally you might go for some time the day before and some time the evening after collection. It's not that 4pm is a magic number that someone obsesses about, it's just a reasonable number given the goal of wanting the area to look pretty and you gotta pick one.