Did you just entirely dismiss what he said about catching it?
It is not his responsibility to protect you or anyone else. YOU can stay home and isolate if you can't handle being out. Stop putting your burden on everyone else. You (and your ilk) have no right to demand protection from others while putting yourself in harms way.
"I can't handle my own health anxiety so I'm going to make sure everyone makes ME feel better regardless of how it affects their lives"
You're the selfish one in this situation.