I recall reading a book on String Theory in the late 1990s edited by Ed Witten where he mentions the problems with physics and the limits of mathematical techniques. It's long ago so I can't paraphrase his words accurately but he did so with such eloquence that I've long remembered the fact. He pitched the problem in terms of both existing physics and of new '21st Century' ideas inklings of which had somehow trickled down into the 20th Century and that physicists needed new mathematics to deal with them (I hope I've not mangled his words too much).
Nevertheless, I'm still in awe of Schwinger, Feynman et al who actually made renormalization work despite—according to Feynman—it being a 'dippy process'. These guys were truly physics and mathematics 'magicians'.