I don't think that's much to worry about. The total energy needs of the US could be met by putting solar panels on only a small percentage of land, far smaller than what's needed for agriculture. Furthermore in some cases the land can be dual use
If you sacrificed 10% of Nevada, which history shows we are more than ready to do, that alone would quite easily power America.