Public Schools aren't just benefiting people with kids. It benefits society (a society you and OP are members of). Getting rid of schools is like getting rid of the military. Maybe you feel like you don't personally benefit from it and you want your taxes back, but that's not how it works.
Not should it. An ideal government functions to help the people not individual persons.