We should do this for everyone. It's unclear to me why we should not find the passion and best way to teach "average" students too.
The only difference between "gifted" and "average" students is really how quickly they can learn certain material -- and maybe an increase in their ceiling for learning certain material. But I don't think there is a fundamental qualitative difference in how they should be taught.