I mean, that's kind of what HIV was up until the mid-late 90s anyway. No symptoms for years and then nearly 100% mortality.

It's killed millions but still hasn't wiped out civilization.