Email passwords are not for preventing impersonation. For one, POP3 passwords are separate from SMTP. Second, nothing in SMTP prevents impersonation… large mail handlers like GMail don’t allow it anymore, but you can put whatever you want in the “From” field. Things like SPF, DMARC and DKIM are there to prevent impersonation at the domain level for mail servers that want to protect their users.