One case where you probably can't is for image uploads. You might think it would be nice to allow a user to upload a svg for their avatar or something.
But SVG can embed javascript which can lead to XSS: https://hackerone.com/reports/148853
But SVG can embed javascript which can lead to XSS: https://hackerone.com/reports/148853