I, on the contrary, disagree with the single point of failure point. Nothing prevents Signal to internally build n systems that federates together and can be down/broken independently.
Is this likely? No. Is this a single point of failure? Yes.
All the internal federation in the world does not allow me to pack up and move while still chatting with my old contacts.