Yeah, vision is indeed used only to localize, not really to recognize the track. Low-key this is what I don't like Waymo/Cruise approach to autonomous driving - they use HD maps to localize themselves and I see that as finding an easy way out instead of tackling the harder problem.