This is a salient point. But I don't think the answer is "parents homeschooling" which can only ever address privileged individuals.
Might there be some way we can get more people involved in the the lives of all children that fit the description of "someone who has a better chance of actually caring about them"? That's the problem I believe homeschool ignores.