There are records of people killed by meteorites, literally in single digits.
A simple statistical test would give you an idea. With 10B people on Earth, a "one in a million per lifetime chance" would happen to 10M people during their lifetimes. If we optimistically assume that a lifetime is 100 years, and the chances do not change with age, the event would affect 100k people every year.