I think in part, it's because "they" have a degree. There can be quite a bit of condescension from people who have degrees towards those who don't.. "I got a degree to get this job, you should have one too".