Is it possible the NN is just memorizing each course? I don't think he mentioned in the video what the train/test split was.
its in the middle of the video, there is no split, It can only drive tracks it was trained on, and only after manually intervening and teaching it special cases (recovering from getting stuck)