What about then if you eat a banana daily, so there is no chance of fully expelling the potassium
If we take a look at our handy dandy xkcd radiation chart[1], we can see that eating a banana every day for a year exposes you to about 36.5 uSv radiation, slightly less than you get during a six hour airline flight. By comparison, the potassium naturally contained in your body already exposes you to 390 uSv radiation in a year.