99% of the users do not know what is actually trusted or not. If third party sources gets popular, it gets even more difficult over time.
Epic one very big well known company and on that case you might trust their APK, but it is not the case for other thousand companies.
When the habit of downloading APK:s gets more popular again, as it used to, then malware spreadingg and phishing gets more popular as it used.
It is easier to get people install software from random sources since it is not uncommon. At the moment, it is uncommon and phishing is harder.