There are people getting sick without having been in contact with other people who are sick. How else would that happen?

"Most contagious when symptomatic" is not even remotely the same thing as "not contagious unless symptomatic". We also don't have a good picture of what symptoms look like aside from the most serious cases.