The key could be only on the client side, derived from your password. Ok they could be evil and send it to their server in the next update, we will have to trust them not to do so.
If the argument is trust, then end to end encryption isn't much of a selling point, you could make the same argument when they have raw access to the messages themselves.