Agreed, it'll be a big problem if we don't keep our skills and rely on AI too much. Same with outsourcing manufacturing, at some point you loose the skill to produce products completely and are dependent on other countries.
With the WWW we thought everyone having access to all information would enlighten them, but without knowledge people do not recognize the right information, and are more likely to trust (mis)information that they think they understand.
What if LLMs give us all the answers that we need to solve all problems, but we are too uninformed and unskilled to recognize these answers? People will turn away from AI, and return to information that they can understand and trust, even if it's false.
Anyway, nothing new actually, we've seen this with science for some time now. It's too advanced for most people to understand and validate, so people distrust it and turn to other sources of information.