"USENIX Security '20 - Everything Old is New Again: Binary Security of WebAssembly"
Most of the rest of unsafe uses are to skip rust checks that have already been asserted and for FFI which is unavoidable.
There are only a few unsafe uses whose invariants are not well defined. I only gave it a quick look but I doubt they're risky.
Even if an attacker manages to exploit ruffle, I wonder what could they do in a WASM sandbox in an isolated domain.
There are some scenarios when vulnerabilities in a wasm compiled program can be harmful too though. For example the web page embedding the emulated flash applet doesn't necessarily intend to give that app full access to that origin's context. For example it could exfiltrate some api keys or other security tokens of the logged in user of the containing page.