I see a big security problem with SVG: browsers allow executing scripts in SVG files in site security context, so you have to check for a lot of script execution vectors in SVG before you allow uploading user files.
https://github.com/wikimedia/mediawiki/blob/4aa9e1/includes/...
https://github.com/wikimedia/mediawiki/blob/4aa9e1/includes/...