1. IntelliSense support is the best outside of Visual Studio itself. 2. Integrated debugging (currently use C#/mono and Python debuggers a lot) 3. Great git integration. Best "GUI" client around. (advanced git features are not provided, but everyday stuff is really well done) 4. Visually appealing. Not saddled with a terminal heritage.
Just to name a few. Yes, Vim and Emacs have all of these, to some degree. But VS Code does them all better (IMO).
It's fun to use. There's a lot to discover, but there's enough there to be productive right from the start.