Some buses will take bicycles, and they have more services each day too. Amtrak may as well not exist except for specific commuter services such as NYC-Boston Acela (which is not value for money unless you're in the 1%).
NJ Transit, LIRR, and Metro-North are fairly cheap, compared to their counterparts elsewhere in the first world. Too bad they're not long-distance.
I've also tried four of the bus lines. They're generally cool, but there are significant differences in terms of convenience of the pick-up and drop-off points at both ends. They don't all go right to the door of Penn Station. ;) Still, for someone on a budget, they just whip the alternatives. The only way either trains or planes could win would be to offer a significant reduction in total door-to-door travel time with prices no worse than double. I don't see any way they'll be able to do that.
If people want to improve the long-distance transportation infrastructure, I think high speed rail is the wrong place to look. There are surely better ways to take advantage of the train right-of-way and station infrastructure, probably some variant on electric buses traveling at the same speed as today.