Why not?
I think most people tend to overestimate the degree of variation in innate ability among the general population. Most of what might typically be considered "innate ability" is actually a result of factors that are not innate at all.
To your second example - Do you really assume that nothing can be done to mitigate the potentially negative impact of having the "wrong" parents? I have a family member who works in education and spends lots of time working on that specific problem.
Creating an educational system that works for the majority of people, as opposed to the elite, doesn't have to be a destructive, or even particularly controversial, endeavor.