The vehicles they’ve already shipped have about the equivalent tensor compute as an NVIDIA V100, and much less than that for older model cars.
The Bitter Lesson is that self driving AIs will probably need large scale more than anything. If we look at the capabilities of something like GPT-4V, it’s a good sign of what’s needed as the baseline minimum.
By extrapolating industry trends, I suspect that a future GPT 6 or 7 level AI with true video input might be able to be specialised to perform real time driving with human-level capability to parse complex situations such as construction sites or accident scenes.
That level of AI inference would require at least an order of magnitude more compute than what’s in any shipping Tesla, maybe more.
Elon promised something that will be possible, but not with the hardware of they day.
When Elon made his comments about “every Tesla shopping now has FSD hardware” he may have just been honestly optimistic. This was before GPT2, let alone the current state of the art. I can forgiven him for that, but not for doubling down on statements that are clearly no longer valid.