For the record, I'm a graduate of the Harvard Extension program (undergrad) and I'm also a member of the Harvard Club of NY.
If you're in your 20's and have no other accomplishments to speak of then the signaling effect of having an Ivy League degree is probably going to do something for you.
But if you're in your 30s or 40s, you're going to be judged on what you've done outside of an academic environment by almost every single person you meet.
In fact, trying to game the prestige game in your 30s or 40s by touting your Ivy League degree is likely to have a NEGATIVE effect on your prospects. Just ask anyone from Harvard about the "dropping the H-bomb."
Personally, I think the whole prestige thing is just so much hot air. I've met plenty of dolts with Harvard degrees and plenty of supremely intelligent people who have only a year or two of college.
Keep this in mind: I have tons of friends who did an undergrad and a graduate degree at Harvard; not a single one has ever held that over my head or compared my degree with theirs.