You go where the best chance for what you're trying to achieve is. For pg it was silicon valley, for you it's NYC, for investment funds in Europe it's going to be London, for engineering in Europe it's going to be Germany.
I don't think your analogy is that accurate, we have plenty of successes here (James Dyson, Theo Paphitis, Alan Sugar, Richard Branson) as well as the many smaller ones noone knows about. Also, failure is relative. In the industry I work in, there are people that I know well who have exited on good terms, my main business makes a fraction of what they made, but I enjoy the freedom more and (to the best of my knowledge) so do the guys that work for me.
I do agree about the difference in the cost of failure though. Personally I blame Del Boy Trotter for a lot of that.