After some prompting, I got a response. It identified the dog in the image, but the dog was in the center point. I gave Gemini the Home Alone image and it couldn't identify the Christmas tree, returning invalid coordinates.
The post has been updated accordingly.