Also you can host a completely isolated matrix server, that does not connect to "the Matrix network"

For example, every client could choose to run its own server to have a perfectly decentralized network. Federation is a feature that allows for greater than 1:1 mapping between clients and servers.

No, decentralization is invented alongside the blockchain and nothing without a blockchain is decentralized. :)