Couldn't you use face recognition and skip the deep learning part.
I was playing with the Sonos Python API and I found one where if the camera spotted an office worker it played their theme music.
It used some face recognition API.
But good work nonetheless