In your ssh config:
Host my-trusted-powerful-remote-machine.whatever.com
ForwardAgent yes
There is still one problem if you like to re-use long-running screen/tmux sessions, for a solution to this see for instance https://gist.github.com/martijnvermaat/8070533