Assuming one has a smartphone, they don't even need the password to login. They already have access to your mailbox.

If one doesn't have a smartphone, then they need to first find out your email then try to login. By the time that is figured out you might have disabled it by logging to your account from somewhere else.