As horrible as they were, the British Empire probably was a positive influence on the world. Without them I doubt we would be able to have a conversation 1000s of miles away right now.
The same argument can be made for the Roman Empire. Empires of the past are looked down on because they are a unified machine of violence, a center of evil we can point to and hate.
Creating civilization is brutal, but the alternative is much scarier. A world of tribes and decentralized violence & oppression toward no end. Just as much pain, but not recorded, all in vain.