I’d argue that people need to be taught basic group theory and abstract algebra first, preferably in the form of puzzles to get familiar with more abstract thinking, and to see things in terms of composition of objects instead a of mixing numeracy in the mix.

I think that numbers create all sorts of problems because people focus on them as they are familiar and miss the bigger picture.