Humans have innate knowledge that help them interact with the world and can learn from physical interaction for the rest. RGB images aren't enough.
And when I took real classes in a real Cessna, this experience was transferable (aka the flying model I had in my brain was very similar to the one I experienced with my full body in the cockpit).