> You will need to keep the name of previous branch in your head
Not even that - "git checkout -" is like "cd -", but for branches.
I have it on a short alias - cor. I do "cob asdf", do some work, then "cor". (I have 28 aliases for git alone, 2 or 3 letters each. And I still get to autocomplete any options when necessary, thanks to https://github.com/cykerway/complete-alias).