I seriously doubt any substantial part of the slowdowns are caused by improved worker safety. Yes there is a correlation between those two trends, but as we all know, that doesn't prove causation.
We have enormously better technology today than in the 30s, and should be able to put of a skyscraper in 1/4 of the time. I understand that's more or less what China does.