> Who cares if the server is not ?

Well... if E2EE is properly implemented, you could be broadcasting your messages on twitter and you'd still be safe.