https://www.google.com/maps/@42.368276,-71.198303,3a,90y,169...
But while it could be done, most offices don't have the insides separated out (wiring,plumbing) installed and non-opening windows. And zoning.
It can be done, but it might not end up being cheap.
It seems like in most cases it'd be cheaper to either tear them down before rebuilding, or to just start building from scratch in a more desirable location.
Of course, I don't think modern office buildings will have the appeal of "exposed brick" and "thick wooden support beams", but maybe the people of 100 years ago would have thought the same about those buildings.
I've seen in down quite successfully in dense urban locations for condos but that only worked because the land was highly valuable and the building had grandfathered exemption from zoning / sightline laws for height.
Office tenants want large, unbroken floorplans, so most office buildings built in the last few decades have a lot of interior space that's far from any windows. Residential uses need windows for every unit.
Adding plumbing for individual kitchens and baths, creating separate HVAC zones, etc. adds more costs and complications.