I work remotely, and absolutely work off-hours, weekend hours, and some holiday hours. I also take long lunches on weekdays, sleep in if I feel like it, go out on long walks when I need a break, and just stop working mid afternoon if I'm not in the zone. Overall, it balances out. I work when I am productive, usually right around 40 hours a week.
But I can see why people would think I'm working extra hours if all they are looking at is my Slack availability. The connectivity of my devices !== whether or not I'm actually going to respond if you send me a message.