Well, for me, it's a lifetime (nearly) of observing how people who dress up for an occasion behave as opposed to those who don't. Churches would make for an interesting exploration in regards to this topic, some still dress, many don't. I don't think your points your other three points are invalid, though.
I didn't know that the Castle had become so expensive. I was a member for about three years in the 80's. At the time, as a blue-collar stiff, I found it quite affordable -- of course, I paid no cover charge.
While some hoped to see celebrities there, a not infrequent occurrence, I was thrilled to meet close-up magic icons like John Carney, Derek Dingle, and Dai Vernon, and to watch many other notables such as Daryl, Bruce Cervon, Eugene Burger, Paul Harris, and Earl Nelson.
One day, a couple of blocks over, at Hollywood Magic (a magic retailer) I watched Harry Anderson of Night Court fame, throwing three-card monte on the customer side of the counter while holding his three-year-old daughter in one arm as he did it -- perhaps he just stood her on the counter with his arm around her as he threw? Not sure, it's been many years. Despite, being very familiar with the sleight, I could not follow the movement of the queen any better than any mark would/could. He was about as humble as they come, and I couldn't have cared much less about his celebrity, but I sure was impressed with his technique.