That's not how knowledge works. Think of exams where you could have your textbooks and use them.
An LLM is the doctor in your pocket. It's yours to use, and whether it is in your head (like a doctor who had to take exams to prove they really had it in their head), or in your pocket makes no difference in your ability to achieve a task.
"Intelligence: the ability to acquire and apply knowledge and skills."
Well, if I can acquire knowledge from the LLM, and apply it using the LLM's instructions, I now have achieved intelligence without doing an exam.
Problem is, I can lose my LLM. A doctor could lose their mental faculties though.