Yes, but it's not where most actually go. 75% of degrees are awarded by public colleges and universities.
Quality education can be public and free.
And not all private universities are "better" than all public universities. Think Berkeley, UT, umich, etc. All fantastic and in many areas clobber many / most private universities. There are some obvious outliers at the very top-ranked schools but, statistically, almost nobody goes to them.
It's messy and complex, but at the end of the day, the public universities educate drastically more people and generally do a good job of it; they have to be considered any time we talk about access to education.