I need glasses but rarely wear them. I'm happy watching 480p most of the time.
I do care about video quality although I know that I'm in the minority (many people say that picture quality is the most important thing in a TV but very few of them can actually identify it). Given that my very weak prescription makes such a difference (720P and 1080P content is probably the same without my glasses) it wouldn't surprise me if many people really couldn't see it.
Glad to know I'm not alone ;)