Did you try doing your Rust dev on Mac? I've built Unity plugins in Rust and have been able to load and unload them without crashes, but I've only tried on a Mac.
It might also be because I was loading the DLL "manually" from C# - a fully fledged plugin might work better.