You're missing the fact that modern day schools and the education system are a very recent invention. We've done ok in 5000 years without it.