Would a single browser make the Web fast? No, it wouldn't. If Microsoft Explorer had won and locked down users and websites, would the Web today be fast? No, the Web would not be fast.
Are there fast websites? Yes, I'm typing into one. I think the reason the web is slow is feature creep by both browsers and websites. Diversity is not the problem. Complexity is the problem.