Yep, there are always trade-offs. The current remote work paradigm is benefitting folks who are more senior, more capable of getting more done with more focused time at the expense of younger, single folks who have a lot more to gain from having close-knit relationships in person with other coworkers.
The other side of the coin is as you mentioned: people who mainly rely on relationships and politics to get ahead without contributing concrete value are starting to feel the squeeze under this paradigm.
As is the case with everything though, I expect that the pendulum will swing back at some point. Nothing lasts forever.