Prof. Zhou Yu explains her work on Situated Intelligent Interactive Systems here. You might find this useful.

https://www.youtube.com/watch?v=39T9ukI9HnQ