This seems like a slightly amateur/hobbyist recommendation, but every approach is valid under certain circumstances.

If it's a database or otherwise expensive to recreate file (like a certificate that's subject to renewal rate limits) keep it somewhere you can get to it if the VM needs recreated. Typically this is a mounted volume on a SAN in larger self-hosted environments.