My experience has aligned with the person you're responding too. Often the best ideas came out of lunch conversations, slam diagramming on hallway white-boards....
I like to say that small meetings of 2-4 people are great for figuring out what to do, and larger meetings are great to have a discussion about the plan made by the smaller meeting. It constrains the discussion and helps to limit rat-holing.
Lots of people waste time and hide in online meetings too.
Let’s be deliberate about it - eg “hey let’s grab lunch together and then whiteboard out a few ideas”
To me, this kind of deep collaboration is a reason to be in the same physical space.
Though it only actually happens a handful of times a year - even if you sit next to the collaborators daily.