In the exact same way that LLMs allow anyone to vibe code an app but do not replace real understanding of system design due to its essential complexity, non-mathematicians will quickly learn that asking an LLM to pump out advanced mathematical statements to you, even if they are correct (and even if you could verify them) does not constitute understanding, and that the human brain is the bottleneck either way.
It is only if the LLM is super-human at simplification and explaining that a difference will be noted. This would be excellent for mathematics but its not a foregone conclusion (and the argument of most mathematicians, such as Terence Tao, is that this distillation process is one of the key parts of doing mathematics, and that LLMs so far seem to be going in the opposite direction. I suspect its probably user error and leveraging the tools better will produce different outcomes, but mathematicians are only just starting the journey that software developers have been going through, so patience is needed).