My primary concern about Signal and usability is the insistence on using phone numbers to identify a person as a user ID.
Anything that relies on SS7/PSTN working correctly is a very bad design choice in my opinion.
Giving out your phone number to possibly untrusted contacts is also a bad decision because it opens up opportunities for scams, spam and social-engineering attempted hijacks of accounts (SIM swap attacks etc).