I don't really see the need to use headphones. Almost nobody in my team does, and we were already working from home ~50% of the time before the current situation.
Despite all the bad things I want to say about the Macbook Pro provided by my employer, its speakers and mic do a pretty good job during videochat.