After a few weekends of iterating and improving the model/training set, we were convinced we’d win the next race… only to lose almost immediately by crossing the lines on the track.
We did some inverse model explanation work which quickly showed that our car was paying attention to the overhead skylights more than the actual tracks. Unlike the other weekends, it was a foggy day!
A quick hack to cut out the top 50% of each training image brought our car back to its prior reliability.