You're probably correct here.

Flu cases are tracked due to its severity. Cold cases are likely not often even paid attention to by many of those experiencing them.

Anecdotally, I and my friends and relatives hunkered down for COVID in 2020, and we had more cases turn out to be actually COVID-19 than common colds.