It's more complex than that. There needs also to be a consensus to remove a block of the chain.

Without consensus, the best-case scenario would be that it results in a fork.