You can configure Vim to put the swap files in your ~/.vim instead of the directory of the file you're editing, which in my experience is much less annoying - see https://github.com/GregorStocks/configs/blob/35ab5c3c45e5cfa...