If your budget allows it, doing an in-person week every quarter is my preferred approach.
Before, when working in the office, we used to follow the SAFe framework, which promotes doing a 2-day planning workshop every 4 to 6 sprints.
I got to know more about my colleagues during those 2 days offsite than during the 4 in-office sprints preceding it.