So this is why VSCode somewhat recently started asking if I trusted the authors/owners of remote folders.
Luckily the web version is indistinguishable from the "native" version, they did a great work there.
Just share a folder with the VM and then bind mount whatever you want to edit at the time. No need to trust the author with all your credentials.