One data point: I was at Georgia Tech for undergrad, now at Caltech for a CS PhD. Both are good schools, but Caltech is definitely considered more "elite". As a Caltech student, I definitely attract attention that I just didn't get at a Georgia Tech student.