The way to decentralise without the risk of inherent centralisation is to go p2p. If everyone installing an app runs their own instance and doesn’t need to pick a server, then the efficiency gains of a server drop off massively.
This is why we’re hoping to steer Matrix from being decentralised-at-the-servers to being decentralised-at-the-clients.