Yes everyone does do that. Most people will not take a tangential single sentence criticism of an institution to mean that you hold none of the typical accompanying political views and are just narrowly opining on your experience.

I would imagine a large majority of readers read your original post and immediately in their head thought, “are they one of those school voucher people” or something along those lines.