Also how do you connect up the nerves? A heart transplant works because the heart is basically self-regulating. But the eye needs thousands of nerves to connect to the brain to be useful.
It would be quite an achievement though, because axons navigate their way by a gradients of some chemicals, which probably dissipate with age.
And problems will not end when nerves have grown. Brains would need to learn how to use them.