Payback. Risk. Magnitude. Is there really any more to it than that?
1. Huge investment required up front.
2. First of its kind, so lots of risk.
3. Small potential gain relative to the investment.
In fact, Hyperloop was never proposed as a VC funded project by Musk. He's merely proposing it as an alternative to high-speed rail. Historically, public transit loses money, making it a terrible investment. However, it's a public good so governments continue to support them.