People won't expect you to pick up on visual cues like the person you responded to, though.