The data storage structure are explained here: http://roguetemple.com/z/hyper/dev.php

And algorithms for the procedural generation are indeed quite challenging (as you noticed, you cannot just work on all 10^7000 cells).