Because that's the number conferences that are generally considered to be better than the rest. Just like the "top 4" computer science schools in the US are unambiguously Stanford, UC Berkeley, MIT, and Carnegie Mellon. You can ask, why not 5? Because then you start getting into questions about whether you want to include UCLA or UIUC or Caltech and it's significantly more complicated.