When I was at Google, there was a modified version of ssh-agent, that would simply ask before signing any login request. It popped up a window (x11 or curses, I think regulated by an external program) that asked "Do you want to connect to HOST?"
It seemed such an obvious feature that I was surprised it wasn't part of the standard distribution.