Most ISP don't care about it. But there are certain enterprises that know almost nothing about email, they employ "specialized tools" that scan and classify incoming email (read Symantec whatever) and make evereyone's lives harder.
Those "specialized tools" make email viable. Without it, everyone would be spoofing everything and you wouldn't use email anymore.