So, enjoy your remote work - and for many professions it won't be an issue - but for some careers watch as your in-person colleagues advance faster, earn more & enjoy greater trust and responsibility.
To know when to talk or shut up in a meeting or read other people emotions to see that someone might be polite but is actually pissed off takes quite a lot of working together and a lot of meetings.
If the bosses (the higher-ups, not the middle managers) don't like you, you're not going to get this anyway, and 99% of whether they decide they like you is based on preexisting social class similiarity. The pre-anointed winners with rich, connected daddies benefit from this--they're the ones who get tapped to be CEO's proteges--and they'll be just fine without going into an office.
The rest of us, if we have to go to an office, are just wasting our time so someone else feels important, and that's really it. They don't see us as one of them, so they're not going to invest in our careers, so we have no reason to care beyond the minimum and having to pretend otherwise (that is, indulge and uphold bourgeois false consciousness) is emotional labor we're better off without having to do.