The implication is that most institutions suffer from this disadvantage, and saying "Ivy League" is a shorthand for that proposition, since it is assumed (correctly or not) that Ivy League universities are at least as good as most other educational institutions.

That was the intent of the jab -- you could say it about any place that 'teaches' math.