Matrix has e2ee but the overall UX of Matrix is still not really there, and the encryption can have issues where messages are not able to be decrypted. It has been audited and is open source. With Matrix you have more freedom because you can run your own server, but personally I would pick Signal since there is less chance of messing things up, for example accidentally having an un-encrypted chat.
Telegram does not do encrypted chats by default and has a history of implementing their own poor encryption. The Telegram server is closed source.
WhatsApp has good encryption, the same as Signal, enabled for all chats. But it is closed source.