Right now, if I was running some open source OS on an open source hardware, with random 3rd party unverified apps, etc. - I would have no confidence in myself to keep that thing secure.
I agree that things like openssh can be more secure because there is a huge number of individuals and corporations using it, there are a lot of eyes on it. It is open source and secure.
That's not the same as something as big as an iPhone. iPhone is an ecosystem of apps, cloud data, biometrics, hardware encryption (secure enclave), etc. and finally the physical device.