I got you. I like to be focused on a single thing so whatever is in front of me is relevant to the current task: Either selecting files or viewing them. So I've never been a fan of the file explorer windows/dock in most editors and IDEs.
In Vim, I use vinegar, which bind the minus key to display the file's directory in netrw and in netrw, go up.