The US NE corridor is arguably the only place it makes sense to build a high speed train network.
You'll notice that Elon Musk's plan for the Hyperloop includes an option for shooting automobiles through the tubes. That's because the mass transit within the cities on that coast is shit.
Inter-city mass transit only makes sense once you've solved intra-city mass transit. Unless you really, really love hanging out within a few city blocks of an inter-city train station, you need to have a convenient, desirable mass transit system waiting for you in the city you're going to. If you're linking Boston, New York, Philadelphia, Baltimore, and DC, you're liking the best mass transit system in America with four other pretty good transit systems. Cutting Boston to DC from 6.5 hours to 90 minutes is definitely worth doing.