The auto industry profitability depends on passenger miles - less miles, less cars + parts, less revenue.
Google isn't going to get into the car assembly business. One or more of the innovative car firms will just licence the self drive technology into an existing platform as a first step.
Car makers themselves have been experimenting with this stuff for decades. If you google around you'll find BMWs doing high speed laps of race circuits with no drivers.
A modern S-Class Benz can literally drive itself already - it has brake assist, lane assist, steering assist, parking assist and radar guided cruise control. It knows where it is going and how long it will take to get there. The driver really is only a small part of the driving equation in a car like this.