FWIW, I tend to use mod-z to switch to last-used workspace with toggleWS, which seems to cover a lot of those cases pretty well.