So I have no clue about being uninvited from TED, but if you want to sit up front, there's plenty of opportunity to do so. I'm hardly an 'A' lister and I had no problem joining the scrum (which is everyone) at the rope to trot to the front rows for those sessions that I wanted to see closer.
Mind you, I've only been to the one ted (2010) so maybe I'm not the big authority here, but I found 'A' people approachable and friendly and I'd say it was pretty great.