I don't use plugins just because I don't know what or whose system I'm going to be using vim on. The reason I use vim is because it's everywhere. When I started programming, I used emacs, and actually dropped it years later for that reason.
Correspondingly, I have a lot of cool plugins in my .vimrc now, and my editor works better.
Bonus: no remote echo typing lag! (Yes, I know about mosh.)
The *BSDs come with vi for example