The vast majority of effects of a dirty bomb are foiled by such advanced technologies as windows and showers. The initial conventional explosion will kill and injure far more people than the radioactive dust. At worst, that dust will slightly increase cancer rates for people relatively close to the location of the bomb (say, upto a few hundred meters) over their lifetime.