Acela's average speed is 82 mph between NYC and Boston. 66 mph between NYC and DC. When you add the time to get to/from the stations my point makes a lot of sense.
If you remember the history, many of the existing rail lines were built before the suburban explosion post WWII. To make Acela go faster, the route would need straighter track which would require buying a lot of expensive, already developed, land.