Could these world models be used to build some sort of endless GranTurismo type street racing game?
Not for the rendering (that's still way too expensive), but for the initial world generation that gets iteratively refined and then still ultimately gets converted into textured triangles.
Almost all video game environments? No way. That statement really needs to be qualified with the genres of games you're considering.