Correct, this is no different than the mattress industry or bridal industry. There has to be a large premium over the price of the product to support the people operating the business. This is because there are established points-of-sale that were established before doing direct business with the consumer was reasonable, or because there is some additional value added during the sale by a physical presence (test drive, testing a mattress, getting fitted for a gown).
The remaining issue is eliminating the "icky" feeling that comes with buying a mattress or car. This could be eliminated if franchise laws could be repealed, but that's a hard battle. I believe Chrysler had set up a dealership recently in L.A. (to sell Chryslers, Jeeps, Dodges and Fiats), but dealers pointed out how it was illegal and had the state force that dealership's closure.
Imagine if there were brand-owned dealerships, that eliminated the haggle, leveraged their distribution networks to minimize the numbers of actual cars on their floor plan, and allowed customers to buy direct for a flat price. Would be nice, right? Actually, this is possible, but it does involve a bit of legwork. I've bought my last two cars straight from the port of entry, but a lot of legwork is involved, as is developing a relationship with the right individuals. I should blog about that one day, as how to get around the nonsense of the mattress industry.