1. People would shy away from this new form of transportation. Why? People get on airplanes every day without thinking much about it. Ditto for driving 60+ mph a few feet from stationary obstacles and opposing traffic. Risk and transport seem to go hand in hand.
2. It would be cheaper to build an "unsafe for humans" version first. Why? If the ultimate goal is human transport then I think it's easy to argue the opposite. Why build a system with different design goals, different termination points, etc and then build a system with completely different goals.
3. Lowered road traffic. That might be true but at what scale would that kick in? Is that a worthwhile near/mid-term goal? What about the negative press generated by killing truck driving jobs?
You also have to look at the perceived value of the system, especially early on. If you put a link between two major cities and can significantly impact travel (from an individual perspective) between the two the PR will be fantastic. In comparison, how much freight are you going to have to move around before there's a noticeable impact? What would that impact even be? Shipping is one of those things that is invisible to most people unless it's not functioning properly.
Also don't forget that Elon is already tackling two modes of human transportation with a very high potential for blowback in the case of a fatal accident. I don't think he would shy away from it.