You’re implying that everyone who doesn’t go to Harvard thinks of Harvard on the same level as a sports team RIVALRY, which is of course absurd.
It’s more like someone whose allegiance to a team is unknown, saying he’s okay with NYC charging sales tax at Yankees games.