I was learning matrix algebra in 4th grade based on the soviet system whereas everyone here was barely doing 2 + 2 = ? in some worksheet. Surprisingly folks managed to not be bored. If your standard is what the current system teaches then it's not hard to improve it and have people not be bored while still not drawing a distinction between "gifted" and "non-gifted".