Having only a small part of the code with unsafe means you only have to check only a small % of the code for UB/security holes and not the whole code base like in C.
It just limits the places shit can happen and which need to be closely reviewed which alone is a big help.