This is the keyword here, just because the other approach is harder does not mean it is impossible.
It's a decent gamble to try and do things the hard way if it is possible to be deployed on cheaper/smaller hardware (eg: no lidars, just cameras).
No. It's not a good idea. It's not a good gamble. It's stupid, and the engineers can see it's stupid. A lot of them have quit, reducing the very slim chances of it working even further.
Hint: it's not the sensor inputs that are the bottleneck!
Not my area of expertise, so I’d rather not try to predict what will work and what won’t.