99.99% of all websites visits are from people who can’t or don’t know how to change their browser font. Saying ‘don’t set a font’ is equivalent to saying ‘use Times New Roman.’
When the web was created, HTML was meant to semantically describe text documents. But that isn’t an accurate description of the web today. Today, websites have complete control over their own visual appearance.