Nuclear planes have already been built and tested. The problem is the shielding to keep the pilots from dying is too heavy. A cruise missile gets rid of the need for that.
In fact, according to Wikipedia, the risk of crashing and making a mess was a factor in the cancellation of both programs.