Forgive my lack of specificity, as I am quite new to Julia, however, I believe that after the initial compile takes place, you do experience significantly faster runtimes, so you can "forgive" the one time delay.
I think you can also have VS Code just load up the packages you expect to use on a regular basis at startup.