To find VIM swp files you can run this command on your public_html directory:
find . -name "*.swp"
You can find and remove them with: find . -name "*.swp" -exec rm -f \{\} \;