Your intuition runs counter to most folks experience. I work on complex machine learning training loops and loss functions. LLMs work great on that.
Training loops, sure... those are pretty much straight pattern recognition w/ well-represented APIs. But more broadly? Not so much.