Just because GPT-4 uses matrix multiplication doesn't mean it can perform matrix multiplication — lots of people complain how bad LLMs are at arithmetic.

My brain uses quantum mechanics for protein folding, my mind cannot perform the maths of QM.