Sunset is easier since it only requires knowledge of the camera location. No fancy stuff needed. Finding objects would require the full video feed being analysed.
Location of the camera doesn't guarantee that a sunset is visible.
True, everything is based on time & location of the camera. I manually curated the cameras and made sure there is around 50% sky in the image. Also if the camera is not pointed perfectly to the sunset/sunrise you will most of the time see it based on the colors. A next step I want to integrate is that it will select the camera based on the amount of orange/red.