The rivers weren't remotely good enough, which is why the Erie Canal was dug. For the first 70 years, commerce east to west had to go around the horn of S. America, and the economy still boomed.
The explosion of the railroad system solved those problems, but that was around 1870.
Massive oil, gas and coal reserves are hardly unique to America. Oil, for example, has made Saudi Arabia very wealthy, but not an economic powerhouse.