I'm not sure it's an introvert thing... I've no desire or need to go to the office, I have many friends not at work and have no need for the false "socialising" you get in the office environment
For me I don't need it, and I've proven that again working for a Belgium team from London. To tell me I need it to build rapport is ridiculous and a waste of my time and money.