If it's a work machine, you probably have network drives. Git bash is incredibly slow when working with network drives.
I'm talking about local filesystem. Things like reflecting git status in $PS1 take many hundreds of milliseconds...
bash is slow? Maybe, but I've never noticed a problem. I have opened huge files in vim as well.
The bash in MinGW-64, or whatever it's called that comes with git for Windows. Which doesn't come with vim, IIRC, so that can't have been what you're talking about, right?