Yep, the interesting thing is genetic algorithms previously were mostly good at course search and less good at fine search.
They also often converge to a local minima, and are costly.
It’ll be interesting to see if LLMs change that, or whether we are just approximating something a gradient could do better