"Then NASA’s plan dictates that you take manual control and fly back to safety."
I believe that visually flying back would be extremely difficult unless you're already quite close. The further you are away, the more you'll be thwarted in your efforts by orbital mechanics acting in counter-intuitive way. Unless you have a good understanding of orbital mechanics and can apply it to your advantage by using just your eyes.
I wonder if NASA has any plans or provides any training around this.