I work remote and i hate it, sitting all day is killing me, my 5 minute daily stand-up is nowhere near enough social interaction for a whole day's work. I've been looking for a role better suited to me for over a year, but the market is miserable.
I miss having jobs where at least a lot of the time i was moving around or working directly with other people. More than anything else i miss casual conversation with coworkers (which still happened with excruciating rarity even when i was doing most of my programming in an office).
I'm glad you love programming and find the career ideal. I don't mean to harp or whine, just pointing out your ideals aren't universal even amount programmers.