I mean, there is no requirement that we use neural networks for driving (or for all of driving); standard logic and sensor analysis is also an option if less general. There are also things like automatic emergency braking that kick in with direct logic even when a human is driving; presumably we may be able to make more advanced similar systems for self driving.
But in general I would definitely agree that putting chatgpt into a car would end poorly.