Perhaps if you're building a cellar. If you want to make a 10-story building - even in a virgin terrain, it's a complicated operation.

Not to mention that you need to make the materials such that they resist a huge side pressure, water leaks and so on.

Psychological costs are also costs.