The dataset humans are using does not just include the audio stream but also visual context. E.g. people pointing at things while talking about them.