Sublime Text is likely closer to what you're looking for.
I think the VSCode config is just JSON on disk and I believe you can install plugins on the CLI. You could probably have a bash or Python script do the setup pretty easily.
Edit: responded before coffee, missed the “native GUI”; please disregard