I would say that living in the middle of nowhere has certainly harmed me, which is somewhat related if the reason you want to work remotely is to say, relocate from a tech city to a rural area.

I am slowly figuring out that the onus is on me to do things like, say, flying out to conferences so I can make up the difference. My advice would be to have a plan in place for dealing with geographic and self isolation before you accept the remote job offer.