Although in order for robots/agents to have properly meaningful, naturalistic interactions with humans they need to co-create a language of gaze and other joint attention cues:

https://link.springer.com/chapter/10.1007/978-3-031-19679-9_...

https://psyarxiv.com/ca8st/