* As noted, the zoning laws and general policies surrounding real estate have made it so that residential development keeps with demand. In every developed area, the buildings consistently climb to 8 stories high. I can't speak for Europe but this is something the U.S. simply cannot do within its existing policy regime, now that the automobile suburbs are built out. It's stuck with an escalating price bubble for the foreseeable future.
* The shinkansen itself cannot be underestimated either. Other cities tend to be like "suburbs of Tokyo" in the Japanese model, taking pressure off the city to go supertall.
* Although you can find neighborhoods with large office parks and highways(e.g. Akasaka), the zoning laws permit using your home to do business, which reduces average commutes and requirements for dedicated workspace, and goes a long way to explain the high degree of similarity between any two random urban streets in the country.
* The rail lines are also real estate companies, which creates a virtuous cycle around every transit stop to pile on amenities and maximize the attractiveness of each neighborhood. You have to go quite far out to find "sleepy" train stations.
* The keiretsu business model that built contemporary Japan is likewise intertwined with the transit and development pattern. The economics of the conglomerate dictate that business units should complement and support each other which allows for a certain degree of robustness, further encouraging neighborhoods that have many similar patterns. Even in Sapporo, with it's 19th-century gridded blocks designed by an American, the overall development is distinctly Japanese. U.S. style patterns tend to favor superlative extremes of optimization - the biggest, the fastest, the most profitable - and not average case outcomes. Manhattan may be exceptional simply because we've assumed every city should be exceptional.