It isn't so much the source of the radiation, as it is what your body does with the material. When you eat a banana, your body gains additional potassium, and over the next several days your kidneys will expel that excess. So, your exposure to the tiny amount of Potassium-40 in the banana is very brief. OTOH, your body treats the Strontium-90 in nuclear fallout like calcium, depositing it in your bones and bone marrow subjecting you to continuous radiation exposure. Likewise Iodine-131 will concentrate in the thyroid.