That's the largest gripe I've had. Eventually, I got used to not relying on GUI scrollback - that actually sped things up for me. In a pinch I just `hotkey, [` to activate scroll, then just use my mouse or page-up & page-down.
Even if you don't use tmux, get used to piping anything you'd want to read through `less`. It'll speed your workflow up.