> but then I realized I had too much of my social life tied up in my job.

Yup! Remote workers need to realise this, and build up a local social life.