The point in Rust and C# and Java and others is that memory safety is either mandatory or opt-out instead of opt-in. This means you have some guarantees about the whole ecosystem.
Of course you can augment a language with libraries. But you are one developer and everyone else will make different choices.