They aren't "getting bigger every year"; they've stayed basically the same size for a very long time. The incoming Tacoma/4R is almost the same size as that 2004 model, and is a hybrid to boot with a true 4WD system. It's larger than the RAV4, but the gap has gotten smaller every time the RAV4 gets larger.
Source: Currently have a 2004 GX470, used to have a 2018 GX460, most of my friends have 4R's or Tacoma's. Note that my daily is a Mercedes Metris because my child is special needs; the GX has been in the family for a very long time at this point.