Invitations to "casual chats" over breakfast or dinner in the office cafeteria are IME quite common in the latter, especially if you're seeking access to senior leadership or flagged as someone whose opinion/buy-off is important to a project.
Even without an explicit invitation, if you're at the office already there's no real barrier to someone pulling you in to a project-related discussion. At that point you're effectively on the clock whether you intended/wanted to be or not.
It really comes down to the fact that commitments, decisions, and requests for assistance made across a cafeteria table are not considered any less binding, which means you can't just "relax and enjoy the free food" when it's provided at work by your employer.
(Conversely, if you're someone who tries to protect your personal time and set clear boundaries between work and non-work hours, you miss out on a lot of these ad-hoc meetings, which can result in a persistent lack of access and influence compared to your colleagues who spend 12+ hours a day on-site.)