You’re not alone. My startup is specifically going against the trend and trying to hire in just two locations (Austin and SF), because our founding group feels the same as you. So far when we’ve been recruiting people we lead with “we have two offices and strongly prefer candidates work in one of them.” It either ends the conversation or is our #1 selling point.

I think over time the market will discover what percentage of people want remote and which percent want in-person, and then whatever that percentage is, the distribution of companies going remote or not will match.