Playing the devil's advocate: Why shouldn't a server get to decide which clients it wants to talk to?
But each person developing a web scrapping bot realizes at most after a week that being honest with User-agent has negative impact on how well it works, and changing it to existing browser takes literally seconds.