This is frankly one of the best uses of LLMs (along with proposing and evaluating drug therapies), and I think it's (at least partially) because these are things that will only work in the hands of people who are already experts and motivated in the field. The proposed thing is validate (or not validated), and then everyone moves on (either using the cool new thing, or knowing that it doesn't work). I'd also throw robotics in here.

The fact that the major "uses" of LLMs have been contributing to the acceleration of the dead internet theory, and building millions of versions of the same apps that no one is going to maintain, is extremely sad.

Math is necessary to science, how can you cordon off and block math developments while expecting intereting physics developments? Physics often produces new and interesting math.