We would only build a space elevator if it made economic sense. Given the reality of construction costs, even if we had the materials, it would like cost many trillions of dollars (at least) so whatever we used it for would have to produce much more value than that.
Even more importantly, if we had access to the materials necessary to build space elevators, there are other, much more pressing terrestrial needs that would use up all those materials long before somebody tried to build an elevator.
No matter how much fun it is to contemplate their existence, nobody has come up with a justification for the necessary investment required to build and operate one.