Because the environmental impact of trains is, while controversial, unquestionably less than that of flying.
Because trains should be moving at an average of 140mph or so, which is more than twice that of a bus.
Because most airports don't connect you to the entire globe in a single hop, so you may as well take the train to the existing one that does.
CAHSR costs ballooned, but so do highway and airport expansions. The U.S. and many other countries have cost management problems with all large infrastructure projects.
I don’t get the country size argument either. Europe and China are also huge with trains stopping in small cities. At least, each coast should have a north-south line plus some truck lines to heavily populated areas.