Pretty much. My main problem is with socializing - will I be able to socialize with the 18 year olds I'll be living with?
A point that I haven't seen addressed in other comments is the cost. If the additional 2 years ends up costing you a lot more money then I would vote against it. If you are in a country where tuition/boarding are paid then that isn't a factor to consider.
Sure, an 18 year old has 10% less life experience than a 20 year old, but as an 40 year old, I can say almost all of you youngin's haven't got much life experience at all, 90% of nothing is nothing. ;p