Chomsky's critique of LLMs was somehow not even correct about his own theories (https://x.com/profraha/status/1634311282135318529). And of course has the usual problem of 1. claiming LLMs are random statistical models (they aren't, the sampler is) 2. claiming instead of generating correct text they only "seemingly" generate correct text and not explaining why this is any less impossible.
But people have built explicit grammar knowledge into LLMs (it's in llama.cpp) and nobody seems to need it to make English text.
Of course the main reason Chomsky is a crank is that he's completely convinced he's right about politics despite his unbroken record of endorsing every mass murderer in the world as long as they're anti-American.