If you refuse to help other people’s children get an education, you’re evading taxes and that is unethical.
I went to a wealthy private high school. 15 years later, most of the children from wealthy parents didn't amount to much. The top 50% work a high level role at their parent's company (probably taking the job from someone more skilled). At worst, they are still supported by their parents in their 30s, career-less. Only the top 5% multiplied their parent's wealth.
The money spent on private education could have been used to support low-income students, which would reduce crime and create a more powerful middle-class.
If I could change the tax code I would cut income taxes (why discourage work?) but jack up taxes on inheritances/gifts.