We're constantly iterating on Element's UI, and the concepts are getting constantly de-weirded. For instance, one of the things many people complain about is that it's possible (and indeed easy) to end up with multiple DMs with the same person. So we're in the process of defaulting to "canonical DMs" (i.e. one DM for each pair of people). Others complain about the hassle of managing E2EE (verifying new logins; backing up your keys with recovery passphrases/keys, etc) - the Matrix equivalent of the Signal recovery PIN drama. We're going to be reworking that all (again) next year, too. So yeah, the UI isn't perfect, but hopefully we're working on it, and it should get better.
Meanwhile, the nice thing about Matrix is you can use whatever app you like - e.g. SchildiChat is a fork of Element Android, FluffyChat's good too, so use whatever floats your boat.