It wasn't an idea that could be sold until cars had the hardware for remote control; which only came into being with the "self driving" hype storm.
When you say "remote control", though; the issues of trust come up in people mind. Those issues should exists when its onboard software you're trusting, too; but humans don't see it that way as easily.
How can you trust that your car isn't being driven by some methed up teenager playing 14 games of "carmageddon" at once for a "click farm" type arrangement?
... It never occurs to people to ask "how can i trust this software is better at carmageddon than the 14 year old?"