Pandoc isn't used by this VSCode plugin, so I'm not sure why that's relevant? Generating a PDF from Pandoc depends on LaTeX, which is over 2GB. Definitely not a solution for "everywhere".
Also there are some arguably nicer alternatives to just shoving LaTeX syntax into markdown, for example http://asciimath.org.