The virus travels on the air, and spread has even been attributed to foul air leaking from sewage systems back into people's homes.
https://www.sciencedirect.com/science/article/pii/S016041202...
Also food and other required resources are similarly unable to teleport through walls, so the people involved in growing, transporting, preparing and delivering them to your door can't do "lockdown" like the minority who are able to work from home.